2023-10-09T15:16:16.726 INFO:root:teuthology version: 0.0.1.dev194+g54e62bc 2023-10-09T15:16:16.726 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469 --verbose --description fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} --owner scheduled_vshankar@teuthology --name vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi -- /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/orig.config.yaml 2023-10-09T15:16:16.768 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T15:16:16.853 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469 branch: wip-yuri-testing-2023-10-06-0949-quincy description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} email: vshankar@redhat.com first_in_suite: false job_id: '7418469' kernel: client: sha1: distro flavor: default kdb: true sha1: fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: rhel os_version: '8.4' overrides: admin_socket: branch: wip-yuri-testing-2023-10-06-0949-quincy ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri-testing-2023-10-06-0949-quincy sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 3972 sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 sleep_before_teardown: 0 subset: 819/1024 suite: fs suite_branch: wip-yuri-testing-2023-10-06-0949-quincy suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 targets: smithi033.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8Cd69H7fO59C6291Fi5/uUVmocaao6IhQtTEvcF8JmC7Fabc4duFOQe0AZeQwLthyVs+w5SISN7WfTT742QOI= smithi059.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD/gDT8Hk4uMQYpOVyMlMDMbG2vsnKuxqFGNcqxbQ3WXPkV8e9j4RhIqIXkz1VP3SGwAzY+QmmeNeDBOue5qjEc= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - ceph: create_rbd_pool: false - kclient: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestVolumes - tasks.cephfs.test_volumes.TestSubvolumeGroups - tasks.cephfs.test_volumes.TestSubvolumes teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 54e62bcbac4e53d9685e08328b790d3b20d71cae timestamp: 2023-10-09_15:09:03 tube: smithi user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2830 2023-10-09T15:16:16.853 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa; will attempt to use it 2023-10-09T15:16:16.854 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks 2023-10-09T15:16:16.854 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-10-09T15:16:16.855 INFO:teuthology.task.internal:Checking packages... 2023-10-09T15:16:16.875 INFO:teuthology.task.internal:Checking packages for os_type 'rhel', flavor 'default' and ceph hash '08cac0187919fc3a247efdf445f652e2fb30a647' 2023-10-09T15:16:16.875 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-10-09T15:16:16.875 INFO:teuthology.packaging:ref: None 2023-10-09T15:16:16.875 INFO:teuthology.packaging:tag: None 2023-10-09T15:16:16.875 INFO:teuthology.packaging:branch: wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T15:16:16.875 INFO:teuthology.packaging:sha1: 08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T15:16:16.876 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri-testing-2023-10-06-0949-quincy 2023-10-09T15:16:17.026 INFO:teuthology.task.internal:Found packages for ceph version 17.2.6-1320.g08cac018 2023-10-09T15:16:17.026 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-10-09T15:16:17.034 INFO:teuthology.task.internal:no buildpackages task found 2023-10-09T15:16:17.034 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-10-09T15:16:17.089 INFO:teuthology.task.internal:Saving configuration 2023-10-09T15:16:17.104 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-10-09T15:16:17.112 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T15:16:17.136 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 15:10:20.608008', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8Cd69H7fO59C6291Fi5/uUVmocaao6IhQtTEvcF8JmC7Fabc4duFOQe0AZeQwLthyVs+w5SISN7WfTT742QOI='} 2023-10-09T15:16:17.161 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 15:10:20.609495', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD/gDT8Hk4uMQYpOVyMlMDMbG2vsnKuxqFGNcqxbQ3WXPkV8e9j4RhIqIXkz1VP3SGwAzY+QmmeNeDBOue5qjEc='} 2023-10-09T15:16:17.161 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-10-09T15:16:17.169 INFO:teuthology.task.internal:roles: ubuntu@smithi033.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-10-09T15:16:17.169 INFO:teuthology.task.internal:roles: ubuntu@smithi059.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-10-09T15:16:17.169 INFO:teuthology.run_tasks:Running task console_log... 2023-10-09T15:16:17.243 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fa5ef035b80>, signals=[15]) 2023-10-09T15:16:17.243 INFO:teuthology.run_tasks:Running task internal.connect... 2023-10-09T15:16:17.250 INFO:teuthology.task.internal:Opening connections... 2023-10-09T15:16:17.250 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:16:17.252 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:16:17.322 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:16:17.323 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:16:17.390 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-10-09T15:16:17.399 DEBUG:teuthology.orchestra.run.smithi033:> uname -m 2023-10-09T15:16:17.416 INFO:teuthology.orchestra.run.smithi033.stdout:x86_64 2023-10-09T15:16:17.417 DEBUG:teuthology.orchestra.run.smithi033:> cat /etc/os-release 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:ID="rhel" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:ID_LIKE="fedora" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:VERSION_ID="8.4" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:PLATFORM_ID="platform:el8" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:ANSI_COLOR="0;31" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T15:16:17.473 INFO:teuthology.orchestra.run.smithi033.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T15:16:17.474 INFO:teuthology.orchestra.run.smithi033.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T15:16:17.475 INFO:teuthology.lock.ops:Updating smithi033.front.sepia.ceph.com on lock server 2023-10-09T15:16:17.504 DEBUG:teuthology.orchestra.run.smithi059:> uname -m 2023-10-09T15:16:17.521 INFO:teuthology.orchestra.run.smithi059.stdout:x86_64 2023-10-09T15:16:17.521 DEBUG:teuthology.orchestra.run.smithi059:> cat /etc/os-release 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:NAME="Red Hat Enterprise Linux" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION="8.4 (Ootpa)" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:ID="rhel" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:ID_LIKE="fedora" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:VERSION_ID="8.4" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:PLATFORM_ID="platform:el8" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:PRETTY_NAME="Red Hat Enterprise Linux 8.4 (Ootpa)" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:ANSI_COLOR="0;31" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:CPE_NAME="cpe:/o:redhat:enterprise_linux:8.4:GA" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:HOME_URL="https://www.redhat.com/" 2023-10-09T15:16:17.579 INFO:teuthology.orchestra.run.smithi059.stdout:DOCUMENTATION_URL="https://access.redhat.com/documentation/red_hat_enterprise_linux/8/" 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT="Red Hat Enterprise Linux 8" 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_BUGZILLA_PRODUCT_VERSION=8.4 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux" 2023-10-09T15:16:17.580 INFO:teuthology.orchestra.run.smithi059.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="8.4" 2023-10-09T15:16:17.580 INFO:teuthology.lock.ops:Updating smithi059.front.sepia.ceph.com on lock server 2023-10-09T15:16:17.612 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-10-09T15:16:17.622 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-10-09T15:16:17.631 INFO:teuthology.task.internal:Checking for old test directory... 2023-10-09T15:16:17.632 DEBUG:teuthology.orchestra.run.smithi033:> test '!' -e /home/ubuntu/cephtest 2023-10-09T15:16:17.634 DEBUG:teuthology.orchestra.run.smithi059:> test '!' -e /home/ubuntu/cephtest 2023-10-09T15:16:17.651 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-10-09T15:16:17.659 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-10-09T15:16:17.659 DEBUG:teuthology.orchestra.run.smithi033:> test -z $(ls -A /var/lib/ceph) 2023-10-09T15:16:17.691 DEBUG:teuthology.orchestra.run.smithi059:> test -z $(ls -A /var/lib/ceph) 2023-10-09T15:16:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T15:16:17.708 INFO:teuthology.orchestra.run.smithi059.stderr:ls: cannot access '/var/lib/ceph': No such file or directory 2023-10-09T15:16:17.708 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-10-09T15:16:17.765 INFO:teuthology.run_tasks:Running task kernel... 2023-10-09T15:16:17.780 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'} 2023-10-09T15:16:17.780 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}, 'client.2': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}, 'client.3': {'sha1': 'distro'}} 2023-10-09T15:16:17.780 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}, 'client.1': {'sha1': 'distro'}}, timeout 300 2023-10-09T15:16:17.781 DEBUG:teuthology.orchestra.run.smithi033:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T15:16:17.781 DEBUG:teuthology.orchestra.run.smithi059:> test -f /run/.containerenv -o -f /.dockerenv 2023-10-09T15:16:17.797 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:16:17.798 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2023-10-09T15:16:17.798 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:16:17.799 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-09T15:16:17.856 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T15:16:17.856 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-305.25.1.el8_4.x86_64 2023-10-09T15:16:17.857 INFO:teuthology.task.kernel:Running kernel on smithi059: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T15:16:17.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum install -y kernel 2023-10-09T15:16:17.857 INFO:teuthology.task.kernel:Running kernel on smithi033: 4.18.0-305.25.1.el8_4.x86_64 2023-10-09T15:16:17.857 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum install -y kernel 2023-10-09T15:16:19.335 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:19.336 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-10-09T15:16:19.358 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:19.359 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-09T15:16:20.803 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 16 kB/s | 3.5 kB 00:00 2023-10-09T15:16:20.867 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2023-10-09T15:16:24.214 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 4.8 MB/s | 16 MB 00:03 2023-10-09T15:16:25.398 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 3.5 MB/s | 16 MB 00:04 2023-10-09T15:16:27.737 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-09T15:16:28.515 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T15:16:28.516 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T15:16:28.516 INFO:teuthology.orchestra.run.smithi059.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T15:16:28.678 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-09T15:16:28.680 INFO:teuthology.orchestra.run.smithi059.stdout:Nothing to do. 2023-10-09T15:16:28.680 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-09T15:16:28.802 DEBUG:teuthology.orchestra.run.smithi059:> echo no | sudo yum reinstall kernel || true 2023-10-09T15:16:28.960 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 4.8 MB/s | 24 kB 00:00 2023-10-09T15:16:29.166 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:29.166 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-10-09T15:16:29.479 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 03:16:27 PM UTC. 2023-10-09T15:16:29.606 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T15:16:29.606 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:29.606 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:29.631 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2023-10-09T15:16:29.682 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum reinstall -y kernel || true 2023-10-09T15:16:29.710 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-80.el8.x86_64 is already installed. 2023-10-09T15:16:29.711 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-425.3.1.el8.x86_64 is already installed. 2023-10-09T15:16:29.711 INFO:teuthology.orchestra.run.smithi033.stdout:Package kernel-4.18.0-305.25.1.el8_4.x86_64 is already installed. 2023-10-09T15:16:29.867 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2023-10-09T15:16:29.869 INFO:teuthology.orchestra.run.smithi033.stdout:Nothing to do. 2023-10-09T15:16:29.869 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2023-10-09T15:16:30.003 DEBUG:teuthology.orchestra.run.smithi033:> echo no | sudo yum reinstall kernel || true 2023-10-09T15:16:30.047 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:30.047 INFO:teuthology.orchestra.run.smithi059.stdout:Unable to read consumer identity 2023-10-09T15:16:30.351 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:00:03 ago on Mon 09 Oct 2023 03:16:27 PM UTC. 2023-10-09T15:16:30.369 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:30.369 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-09T15:16:30.500 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T15:16:30.500 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:30.500 INFO:teuthology.orchestra.run.smithi059.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:30.512 INFO:teuthology.orchestra.run.smithi059.stderr:Error: No packages marked for reinstall. 2023-10-09T15:16:30.568 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T15:16:30.676 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:02 ago on Mon 09 Oct 2023 03:16:28 PM UTC. 2023-10-09T15:16:30.697 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.698 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.698 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.699 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T15:16:30.699 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T15:16:30.699 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2023-10-09T15:16:30.699 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi059.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T15:16:30.699 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T15:16:30.800 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T15:16:30.800 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:30.800 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:30.828 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2023-10-09T15:16:30.829 INFO:teuthology.orchestra.run.smithi059.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.830 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.830 DEBUG:teuthology.orchestra.run.smithi059:> sudo rpm -qi grub2-tools 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Name : grub2-tools 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Epoch : 1 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Version : 2.02 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Release : 99.el8_4.1 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Architecture: x86_64 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Group : System Environment/Base 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:Size : 9264631 2023-10-09T15:16:30.858 INFO:teuthology.orchestra.run.smithi059.stdout:License : GPLv3+ 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Relocations : (not relocatable) 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Packager : Red Hat, Inc. 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Vendor : Red Hat, Inc. 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Summary : Support tools for GRUB. 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:Description : 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T15:16:30.859 INFO:teuthology.orchestra.run.smithi059.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T15:16:30.860 INFO:teuthology.orchestra.run.smithi059.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T15:16:30.860 INFO:teuthology.orchestra.run.smithi059.stdout:hardware devices. 2023-10-09T15:16:30.860 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:16:30.860 INFO:teuthology.orchestra.run.smithi059.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T15:16:30.860 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T15:16:30.861 INFO:teuthology.task.kernel:Updating grub on smithi059 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:30.861 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T15:16:30.884 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum reinstall -y kernel || true 2023-10-09T15:16:31.247 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-09T15:16:31.248 INFO:teuthology.orchestra.run.smithi033.stdout:Unable to read consumer identity 2023-10-09T15:16:31.545 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:00:03 ago on Mon 09 Oct 2023 03:16:28 PM UTC. 2023-10-09T15:16:31.674 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-80.el8.x86_64 (from anaconda) not available. 2023-10-09T15:16:31.674 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-425.3.1.el8.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:31.674 INFO:teuthology.orchestra.run.smithi033.stdout:Installed package kernel-4.18.0-305.25.1.el8_4.x86_64 (from rhel-8-for-x86_64-baseos-rpms) not available. 2023-10-09T15:16:31.687 INFO:teuthology.orchestra.run.smithi033.stderr:Error: No packages marked for reinstall. 2023-10-09T15:16:31.744 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T15:16:31.875 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:31.876 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:31.876 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-305.25.1.el8_4.x86_64 Expected: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:31.876 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-10-09T15:16:31.876 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-10-09T15:16:31.876 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2023-10-09T15:16:31.876 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi033.front.sepia.ceph.com, path=None, version=distro) 2023-10-09T15:16:31.876 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q kernel | sort -rV | head -n 1 2023-10-09T15:16:32.007 INFO:teuthology.orchestra.run.smithi033.stdout:kernel-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:32.007 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:32.008 DEBUG:teuthology.orchestra.run.smithi033:> sudo rpm -qi grub2-tools 2023-10-09T15:16:32.035 INFO:teuthology.orchestra.run.smithi033.stdout:Name : grub2-tools 2023-10-09T15:16:32.035 INFO:teuthology.orchestra.run.smithi033.stdout:Epoch : 1 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Version : 2.02 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Release : 99.el8_4.1 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Architecture: x86_64 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Install Date: Wed 21 Dec 2022 01:02:32 PM UTC 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Group : System Environment/Base 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Size : 9264631 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:License : GPLv3+ 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Signature : RSA/SHA256, Thu 09 Sep 2021 09:41:55 AM UTC, Key ID 199e2f91fd431d51 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Source RPM : grub2-2.02-99.el8_4.1.src.rpm 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Build Date : Tue 18 May 2021 07:46:34 AM UTC 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Build Host : x86-vm-07.build.eng.bos.redhat.com 2023-10-09T15:16:32.036 INFO:teuthology.orchestra.run.smithi033.stdout:Relocations : (not relocatable) 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:Packager : Red Hat, Inc. 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:Vendor : Red Hat, Inc. 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:URL : http://www.gnu.org/software/grub/ 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:Summary : Support tools for GRUB. 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:Description : 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:customizable bootloader with modular architecture. It supports a rich 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:variety of kernel formats, file systems, computer architectures and 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:hardware devices. 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:16:32.037 INFO:teuthology.orchestra.run.smithi033.stdout:This subpackage provides tools for support of all platforms. 2023-10-09T15:16:32.038 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-10-09T15:16:32.038 INFO:teuthology.task.kernel:Updating grub on smithi033 to boot 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:32.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-10-09T15:16:32.268 INFO:teuthology.orchestra.run.smithi059.stderr:Generating grub configuration file ... 2023-10-09T15:16:33.236 INFO:teuthology.orchestra.run.smithi033.stderr:Generating grub configuration file ... 2023-10-09T15:16:34.521 INFO:teuthology.orchestra.run.smithi059.stderr:done 2023-10-09T15:16:34.523 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-09T15:16:34.540 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.uufrQy2y0n 2023-10-09T15:16:34.541 DEBUG:teuthology.orchestra.run.smithi059:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.uufrQy2y0n 2023-10-09T15:16:34.609 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.uufrQy2y0n 2023-10-09T15:16:34.767 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.uufrQy2y0n is 6KB 2023-10-09T15:16:34.817 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.uufrQy2y0n 2023-10-09T15:16:34.831 DEBUG:teuthology.orchestra.run.smithi059:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T15:16:34.902 INFO:teuthology.orchestra.run.smithi059.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T15:16:34.903 INFO:teuthology.orchestra.run.smithi059.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T15:16:34.903 INFO:teuthology.orchestra.run.smithi059.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T15:16:34.903 INFO:teuthology.orchestra.run.smithi059.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T15:16:34.904 DEBUG:teuthology.orchestra.run.smithi059:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:35.070 DEBUG:teuthology.orchestra.run.smithi059:> sudo shutdown -r now 2023-10-09T15:16:35.485 INFO:teuthology.orchestra.run.smithi033.stderr:done 2023-10-09T15:16:35.487 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2023-10-09T15:16:35.506 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.a6TkjAdoef 2023-10-09T15:16:35.506 DEBUG:teuthology.orchestra.run.smithi033:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.a6TkjAdoef 2023-10-09T15:16:35.575 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.a6TkjAdoef 2023-10-09T15:16:35.733 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.a6TkjAdoef is 6KB 2023-10-09T15:16:35.784 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.a6TkjAdoef 2023-10-09T15:16:35.798 DEBUG:teuthology.orchestra.run.smithi033:> sudo /bin/ls /boot/loader/entries || true 2023-10-09T15:16:35.863 INFO:teuthology.orchestra.run.smithi033.stdout:298e228f3b5e401e8ac0f5ae159a2e06-0-rescue.conf 2023-10-09T15:16:35.864 INFO:teuthology.orchestra.run.smithi033.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-305.25.1.el8_4.x86_64.conf 2023-10-09T15:16:35.864 INFO:teuthology.orchestra.run.smithi033.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64.conf 2023-10-09T15:16:35.864 INFO:teuthology.orchestra.run.smithi033.stdout:298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-80.el8.x86_64.conf 2023-10-09T15:16:35.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo grub2-set-default 298e228f3b5e401e8ac0f5ae159a2e06-4.18.0-425.3.1.el8.x86_64 2023-10-09T15:16:36.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo shutdown -r now 2023-10-09T15:17:05.102 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2023-10-09T15:17:05.103 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:17:05.104 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:17:06.028 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2023-10-09T15:17:06.029 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:17:06.029 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:17:23.450 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.59 2023-10-09T15:17:24.474 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-09T15:17:32.458 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:17:32.459 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:17:33.476 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:17:33.477 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:17:51.866 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-09T15:18:03.879 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:18:03.880 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:18:06.942 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.33 2023-10-09T15:18:21.954 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:18:21.955 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:18:22.378 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-09T15:18:22.638 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:18:22.638 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T15:18:22.639 DEBUG:teuthology.orchestra.run.smithi033:> uname -r 2023-10-09T15:18:22.694 INFO:teuthology.orchestra.run.smithi033.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T15:18:22.695 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:18:22.695 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T15:18:22.695 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T15:18:23.696 DEBUG:teuthology.parallel:result is None 2023-10-09T15:18:32.461 DEBUG:teuthology.orchestra.remote:timed out 2023-10-09T15:18:44.463 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:18:44.463 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:18:44.814 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-09T15:18:45.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:18:45.078 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-425.3.1.el8.x86_64"... 2023-10-09T15:18:45.079 DEBUG:teuthology.orchestra.run.smithi059:> uname -r 2023-10-09T15:18:45.134 INFO:teuthology.orchestra.run.smithi059.stdout:4.18.0-425.3.1.el8.x86_64 2023-10-09T15:18:45.134 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-425.3.1.el8.x86_64 vs 4.18.0-425.3.1.el8.x86_64 2023-10-09T15:18:45.134 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-10-09T15:18:45.134 DEBUG:teuthology.task.kernel:Distro of this test job: rhel 2023-10-09T15:18:46.135 DEBUG:teuthology.parallel:result is None 2023-10-09T15:18:46.135 INFO:teuthology.run_tasks:Running task internal.base... 2023-10-09T15:18:46.143 INFO:teuthology.task.internal:Creating test directory... 2023-10-09T15:18:46.143 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T15:18:46.145 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-10-09T15:18:46.163 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-10-09T15:18:46.174 INFO:teuthology.run_tasks:Running task internal.archive... 2023-10-09T15:18:46.189 INFO:teuthology.task.internal:Creating archive directory... 2023-10-09T15:18:46.189 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T15:18:46.203 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-10-09T15:18:46.236 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-10-09T15:18:46.247 INFO:teuthology.task.internal:Enabling coredump saving... 2023-10-09T15:18:46.247 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T15:18:46.274 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-10-09T15:18:46.349 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T15:18:46.370 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T15:18:46.380 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T15:18:46.396 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-10-09T15:18:46.398 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-10-09T15:18:46.406 INFO:teuthology.task.internal:Configuring sudo... 2023-10-09T15:18:46.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T15:18:46.409 DEBUG:teuthology.orchestra.run.smithi059:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-10-09T15:18:46.436 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-10-09T15:18:46.449 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-10-09T15:18:46.449 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T15:18:46.480 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-10-09T15:18:46.495 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T15:18:46.581 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T15:18:46.643 DEBUG:teuthology.orchestra.run.smithi033:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T15:18:46.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T15:18:46.728 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:18:46.728 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T15:18:46.794 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T15:18:46.836 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-10-09T15:18:46.915 DEBUG:teuthology.orchestra.run.smithi059:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T15:18:46.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-10-09T15:18:46.999 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:18:46.999 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-10-09T15:18:47.065 DEBUG:teuthology.orchestra.run.smithi033:> sudo service rsyslog restart 2023-10-09T15:18:47.067 DEBUG:teuthology.orchestra.run.smithi059:> sudo service rsyslog restart 2023-10-09T15:18:47.130 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T15:18:47.156 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T15:18:47.639 INFO:teuthology.run_tasks:Running task internal.timer... 2023-10-09T15:18:47.649 INFO:teuthology.task.internal:Starting timer... 2023-10-09T15:18:47.649 INFO:teuthology.run_tasks:Running task pcp... 2023-10-09T15:18:47.666 INFO:teuthology.run_tasks:Running task selinux... 2023-10-09T15:18:47.678 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']} 2023-10-09T15:18:47.678 DEBUG:teuthology.orchestra.run.smithi033:> sudo service auditd rotate 2023-10-09T15:18:47.738 INFO:teuthology.orchestra.run.smithi033.stdout:Rotating logs: [ OK ] 2023-10-09T15:18:47.740 DEBUG:teuthology.orchestra.run.smithi059:> sudo service auditd rotate 2023-10-09T15:18:47.820 INFO:teuthology.orchestra.run.smithi059.stdout:Rotating logs: [ OK ] 2023-10-09T15:18:47.821 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-10-09T15:18:47.822 DEBUG:teuthology.orchestra.run.smithi033:> /usr/sbin/getenforce 2023-10-09T15:18:47.845 INFO:teuthology.orchestra.run.smithi033.stdout:Permissive 2023-10-09T15:18:47.845 DEBUG:teuthology.orchestra.run.smithi059:> /usr/sbin/getenforce 2023-10-09T15:18:47.865 INFO:teuthology.orchestra.run.smithi059.stdout:Permissive 2023-10-09T15:18:47.865 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi033.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi059.front.sepia.ceph.com': 'permissive'} 2023-10-09T15:18:47.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T15:18:47.910 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:18:47.911 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T15:18:47.937 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:18:47.937 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-10-09T15:18:47.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo /usr/sbin/setenforce permissive 2023-10-09T15:18:47.978 DEBUG:teuthology.orchestra.run.smithi059:> sudo /usr/sbin/setenforce permissive 2023-10-09T15:18:48.005 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-10-09T15:18:48.015 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-10-09T15:18:48.015 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-10-09T15:18:48.032 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-10-09T15:18:48.033 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi033.front.sepia.ceph.com,smithi059.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-10-09T15:27:32.799 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi033.front.sepia.ceph.com'), Remote(name='ubuntu@smithi059.front.sepia.ceph.com')] 2023-10-09T15:27:32.800 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:27:32.801 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi033.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:27:32.874 DEBUG:teuthology.orchestra.run.smithi033:> true 2023-10-09T15:27:32.938 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi033.front.sepia.ceph.com' 2023-10-09T15:27:32.938 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:27:32.938 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi059.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-10-09T15:27:33.006 DEBUG:teuthology.orchestra.run.smithi059:> true 2023-10-09T15:27:33.031 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi059.front.sepia.ceph.com' 2023-10-09T15:27:33.031 INFO:teuthology.run_tasks:Running task clock... 2023-10-09T15:27:33.041 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-10-09T15:27:33.042 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T15:27:33.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T15:27:33.044 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-10-09T15:27:33.045 DEBUG:teuthology.orchestra.run.smithi059:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T15:27:33.074 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T15:27:33.089 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T15:27:33.102 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-10-09T15:27:33.117 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-10-09T15:27:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:sudo: ntpd: command not found 2023-10-09T15:27:33.141 INFO:teuthology.orchestra.run.smithi033.stdout:506 Cannot talk to daemon 2023-10-09T15:27:33.156 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T15:27:33.159 INFO:teuthology.orchestra.run.smithi059.stderr:sudo: ntpd: command not found 2023-10-09T15:27:33.170 INFO:teuthology.orchestra.run.smithi059.stdout:506 Cannot talk to daemon 2023-10-09T15:27:33.171 INFO:teuthology.orchestra.run.smithi033.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T15:27:33.184 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-10-09T15:27:33.199 INFO:teuthology.orchestra.run.smithi059.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-10-09T15:27:33.242 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2023-10-09T15:27:33.245 INFO:teuthology.orchestra.run.smithi033.stdout:210 Number of sources = 4 2023-10-09T15:27:33.245 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T15:27:33.246 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2023-10-09T15:27:33.246 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.246 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.246 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.247 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.264 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-09T15:27:33.267 INFO:teuthology.orchestra.run.smithi059.stdout:210 Number of sources = 4 2023-10-09T15:27:33.267 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T15:27:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-09T15:27:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.268 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:27:33.268 INFO:teuthology.run_tasks:Running task install... 2023-10-09T15:27:33.278 DEBUG:teuthology.task.install:project ceph 2023-10-09T15:27:33.278 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}} 2023-10-09T15:27:33.279 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'} 2023-10-09T15:27:33.279 INFO:teuthology.task.install:Using flavor: default 2023-10-09T15:27:33.287 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-10-09T15:27:33.287 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']} 2023-10-09T15:27:33.287 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T15:27:33.288 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T15:27:33.290 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'tag': None, 'wait_for_package': False} 2023-10-09T15:27:33.291 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T15:27:33.441 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T15:27:33.441 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T15:27:33.528 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/ 2023-10-09T15:27:33.528 INFO:teuthology.task.install.rpm:Package version is 17.2.6-1320.g08cac018 2023-10-09T15:27:33.650 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T15:27:33.651 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:27:33.651 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T15:27:33.678 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T15:27:33.678 DEBUG:teuthology.orchestra.run.smithi033:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T15:27:33.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T15:27:33.767 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuri-testing-2023-10-06-0949-quincy/08cac0187919fc3a247efdf445f652e2fb30a647/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-10-09T15:27:33.767 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:27:33.767 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-10-09T15:27:33.795 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel on remote rpm x86_64 2023-10-09T15:27:33.796 DEBUG:teuthology.orchestra.run.smithi059:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08cac0187919fc3a247efdf445f652e2fb30a647/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-10-09T15:27:33.823 DEBUG:teuthology.orchestra.run.smithi033:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T15:27:33.863 DEBUG:teuthology.orchestra.run.smithi059:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-10-09T15:27:33.890 INFO:teuthology.orchestra.run.smithi033.stdout:check_obsoletes = 1 2023-10-09T15:27:33.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum clean all 2023-10-09T15:27:33.942 DEBUG:teuthology.orchestra.run.smithi059:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-10-09T15:27:34.008 INFO:teuthology.orchestra.run.smithi059.stdout:check_obsoletes = 1 2023-10-09T15:27:34.009 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum clean all 2023-10-09T15:27:34.303 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-09T15:27:34.420 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-09T15:27:35.457 INFO:teuthology.orchestra.run.smithi033.stdout:44 files removed 2023-10-09T15:27:35.515 DEBUG:teuthology.orchestra.run.smithi033:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T15:27:35.602 INFO:teuthology.orchestra.run.smithi059.stdout:44 files removed 2023-10-09T15:27:35.661 DEBUG:teuthology.orchestra.run.smithi059:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel 2023-10-09T15:27:35.886 INFO:teuthology.orchestra.run.smithi033.stdout:Updating Subscription Management repositories. 2023-10-09T15:27:36.035 INFO:teuthology.orchestra.run.smithi059.stdout:Updating Subscription Management repositories. 2023-10-09T15:27:37.837 INFO:teuthology.orchestra.run.smithi033.stdout:ceph packages for x86_64 120 kB/s | 78 kB 00:00 2023-10-09T15:27:37.939 INFO:teuthology.orchestra.run.smithi059.stdout:ceph packages for x86_64 172 kB/s | 78 kB 00:00 2023-10-09T15:27:38.202 INFO:teuthology.orchestra.run.smithi033.stdout:ceph noarch packages 29 kB/s | 9.2 kB 00:00 2023-10-09T15:27:38.244 INFO:teuthology.orchestra.run.smithi059.stdout:ceph noarch packages 35 kB/s | 9.2 kB 00:00 2023-10-09T15:27:38.553 INFO:teuthology.orchestra.run.smithi059.stdout:ceph source packages 5.3 kB/s | 1.5 kB 00:00 2023-10-09T15:27:38.605 INFO:teuthology.orchestra.run.smithi033.stdout:ceph source packages 3.9 kB/s | 1.5 kB 00:00 2023-10-09T15:27:38.713 INFO:teuthology.orchestra.run.smithi059.stdout:Copr repo for python3-asyncssh owned by ceph 27 kB/s | 3.5 kB 00:00 2023-10-09T15:27:38.744 INFO:teuthology.orchestra.run.smithi033.stdout:Copr repo for python3-asyncssh owned by ceph 32 kB/s | 3.5 kB 00:00 2023-10-09T15:27:55.549 INFO:teuthology.orchestra.run.smithi059.stdout:Extra Packages for Enterprise Linux 969 kB/s | 16 MB 00:16 2023-10-09T15:27:55.647 INFO:teuthology.orchestra.run.smithi033.stdout:Extra Packages for Enterprise Linux 965 kB/s | 16 MB 00:16 2023-10-09T15:27:59.175 INFO:teuthology.orchestra.run.smithi033.stdout:lab-extras 4.2 MB/s | 24 kB 00:00 2023-10-09T15:27:59.207 INFO:teuthology.orchestra.run.smithi059.stdout:lab-extras 4.3 MB/s | 24 kB 00:00 2023-10-09T15:27:59.582 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 103 MB/s | 33 MB 00:00 2023-10-09T15:27:59.637 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - AppStre 96 MB/s | 33 MB 00:00 2023-10-09T15:28:05.099 INFO:teuthology.orchestra.run.smithi033.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 109 MB/s | 38 MB 00:00 2023-10-09T15:28:05.486 INFO:teuthology.orchestra.run.smithi059.stdout:Red Hat Enterprise Linux 8 for x86_64 - BaseOS 106 MB/s | 38 MB 00:00 2023-10-09T15:28:13.905 INFO:teuthology.orchestra.run.smithi033.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T15:28:13.905 INFO:teuthology.orchestra.run.smithi033.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T15:28:13.917 INFO:teuthology.orchestra.run.smithi033.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T15:28:13.918 INFO:teuthology.orchestra.run.smithi033.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T15:28:13.919 INFO:teuthology.orchestra.run.smithi033.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T15:28:13.919 INFO:teuthology.orchestra.run.smithi033.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T15:28:13.921 INFO:teuthology.orchestra.run.smithi033.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T15:28:13.924 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T15:28:13.925 INFO:teuthology.orchestra.run.smithi033.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T15:28:14.478 INFO:teuthology.orchestra.run.smithi033.stdout:Dependencies resolved. 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================================== 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: Package Arch Version Repository Size 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================================== 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout:Installing: 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T15:28:14.490 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T15:28:14.491 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T15:28:14.492 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrading: 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout:Installing dependencies: 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T15:28:14.493 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T15:28:14.494 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T15:28:14.495 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T15:28:14.496 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T15:28:14.497 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T15:28:14.498 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T15:28:14.499 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:28:14.500 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction Summary 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:====================================================================================================================== 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:Install 118 Packages 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:Upgrade 2 Packages 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:Total download size: 202 M 2023-10-09T15:28:14.501 INFO:teuthology.orchestra.run.smithi033.stdout:Downloading Packages: 2023-10-09T15:28:14.521 INFO:teuthology.orchestra.run.smithi059.stdout:Package librados2-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T15:28:14.522 INFO:teuthology.orchestra.run.smithi059.stdout:Package librbd1-1:12.2.7-9.el8.x86_64 is already installed. 2023-10-09T15:28:14.533 INFO:teuthology.orchestra.run.smithi059.stdout:Package NetworkManager-1:1.30.0-13.el8_4.x86_64 is already installed. 2023-10-09T15:28:14.534 INFO:teuthology.orchestra.run.smithi059.stdout:Package iproute-5.9.0-4.el8.x86_64 is already installed. 2023-10-09T15:28:14.535 INFO:teuthology.orchestra.run.smithi059.stdout:Package util-linux-2.32.1-27.el8.x86_64 is already installed. 2023-10-09T15:28:14.536 INFO:teuthology.orchestra.run.smithi059.stdout:Package libacl-devel-2.2.53-1.el8.x86_64 is already installed. 2023-10-09T15:28:14.537 INFO:teuthology.orchestra.run.smithi059.stdout:Package libattr-devel-2.4.48-3.el8.x86_64 is already installed. 2023-10-09T15:28:14.540 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsdump-3.1.8-2.el8.x86_64 is already installed. 2023-10-09T15:28:14.541 INFO:teuthology.orchestra.run.smithi059.stdout:Package xfsprogs-5.0.0-8.el8.x86_64 is already installed. 2023-10-09T15:28:14.838 INFO:teuthology.orchestra.run.smithi033.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 24 kB/s | 6.4 kB 00:00 2023-10-09T15:28:15.052 INFO:teuthology.orchestra.run.smithi059.stdout:Dependencies resolved. 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: Package Arch Version Repository Size 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout:Installing: 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: bison x86_64 3.0.4-10.el8 rhel-8-for-x86_64-appstream-rpms 688 k 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph x86_64 2:17.2.6-1320.g08cac018.el8 ceph 6.4 k 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.2 M 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 876 k 2023-10-09T15:28:15.064 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache x86_64 2:17.2.6-1320.g08cac018.el8 ceph 162 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr x86_64 2:17.2.6-1320.g08cac018.el8 ceph 1.6 M 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 121 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 1.7 M 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 7.4 M 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 47 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test x86_64 2:17.2.6-1320.g08cac018.el8 ceph 52 M 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 267 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 80 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 255 k 2023-10-09T15:28:15.065 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 18 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel x86_64 0.182-3.el8 rhel-8-for-x86_64-baseos-rpms 59 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: flex x86_64 2.6.1-9.el8 rhel-8-for-x86_64-appstream-rpms 320 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel x86_64 0.3.112-1.el8 rhel-8-for-x86_64-baseos-rpms 19 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 25 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 797 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel x86_64 2:17.2.6-1320.g08cac018.el8 ceph 130 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: libtool x86_64 2.4.6-25.el8 rhel-8-for-x86_64-appstream-rpms 709 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel x86_64 2.32.1-27.el8 rhel-8-for-x86_64-baseos-rpms 97 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel x86_64 1:1.1.1g-15.el8_3 rhel-8-for-x86_64-baseos-rpms 2.3 M 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs x86_64 2:17.2.6-1320.g08cac018.el8 ceph 190 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados x86_64 2:17.2.6-1320.g08cac018.el8 ceph 371 k 2023-10-09T15:28:15.066 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 358 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw x86_64 2:17.2.6-1320.g08cac018.el8 ceph 107 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 90 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 173 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel x86_64 5.0.0-8.el8 rhel-8-for-x86_64-baseos-rpms 70 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrading: 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: librados2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.5 M 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.6 M 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout:Installing dependencies: 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: automake noarch 1.16.1-7.el8 rhel-8-for-x86_64-appstream-rpms 713 k 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 23 M 2023-10-09T15:28:15.067 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 23 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds x86_64 2:17.2.6-1320.g08cac018.el8 ceph 2.3 M 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 238 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon x86_64 2:17.2.6-1320.g08cac018.el8 ceph 3.9 M 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd x86_64 2:17.2.6-1320.g08cac018.el8 ceph 17 M 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts noarch 2:17.2.6-1320.g08cac018.el8 ceph-noarch 14 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux x86_64 2:17.2.6-1320.g08cac018.el8 ceph 24 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: fuse x86_64 2.9.7-12.el8 rhel-8-for-x86_64-baseos-rpms 83 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: jq x86_64 1.5-12.el8 rhel-8-for-x86_64-appstream-rpms 161 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel x86_64 1.5.10-6.el8 rhel-8-for-x86_64-baseos-rpms 48 k 2023-10-09T15:28:15.068 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel x86_64 1.18.2-8.3.el8_4 rhel-8-for-x86_64-baseos-rpms 559 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite x86_64 2:17.2.6-1320.g08cac018.el8 ceph 174 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel x86_64 1.45.6-1.el8 rhel-8-for-x86_64-baseos-rpms 38 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 639 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath x86_64 8.4.1-1.el8 rhel-8-for-x86_64-baseos-rpms 169 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq x86_64 0.9.0-3.el8 rhel-8-for-x86_64-baseos-rpms 47 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 507 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka x86_64 0.11.4-1.el8 rhel-8-for-x86_64-appstream-rpms 353 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2 x86_64 2:17.2.6-1320.g08cac018.el8 ceph 5.6 M 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel x86_64 2.9-5.el8 rhel-8-for-x86_64-baseos-rpms 200 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel x86_64 2.9-2.el8 rhel-8-for-x86_64-baseos-rpms 86 k 2023-10-09T15:28:15.069 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel x86_64 0.3.0-5.el8 rhel-8-for-x86_64-baseos-rpms 18 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust x86_64 2.8.1-11.el8 rhel-8-for-x86_64-appstream-rpms 259 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma x86_64 6.8.2-2.el8 rhel-8-for-x86_64-appstream-rpms 187 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: openblas x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.6 M 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads x86_64 0.3.12-1.el8 rhel-8-for-x86_64-appstream-rpms 4.7 M 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 605 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 229 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32 x86_64 10.32-2.el8 rhel-8-for-x86_64-baseos-rpms 220 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh noarch 2.7.0-2.el8 epel 476 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel noarch 2.5.1-5.el8 rhel-8-for-x86_64-appstream-rpms 4.8 M 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2023-10-09T15:28:15.070 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse x86_64 2:17.2.6-1320.g08cac018.el8 ceph 45 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common x86_64 2:17.2.6-1320.g08cac018.el8 ceph 115 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2 noarch 2.10.1-2.el8_0 rhel-8-for-x86_64-appstream-rpms 538 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch noarch 1.21-2.el8 rhel-8-for-x86_64-appstream-rpms 27 k 2023-10-09T15:28:15.071 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer noarch 1.10-11.el8 rhel-8-for-x86_64-appstream-rpms 20 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt noarch 1.6.1-2.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako noarch 1.0.6-13.el8 rhel-8-for-x86_64-appstream-rpms 157 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe x86_64 0.23-19.el8 rhel-8-for-x86_64-appstream-rpms 39 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort noarch 7.1.1-2.el8 epel 60 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 3.7 M 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py x86_64 1:1.14.3-9.el8 rhel-8-for-x86_64-appstream-rpms 225 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib noarch 2.1.0-1.el8 rhel-8-for-x86_64-baseos-rpms 155 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2023-10-09T15:28:15.072 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable noarch 0.7.2-14.el8 rhel-8-for-x86_64-appstream-rpms 44 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1 noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 126 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 rhel-8-for-x86_64-appstream-rpms 110 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz noarch 2017.2-9.el8 rhel-8-for-x86_64-appstream-rpms 54 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 rhel-8-for-x86_64-baseos-rpms 43 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy x86_64 1.0.0-20.module+el8.1.0+3334+5cb623d7 rhel-8-for-x86_64-appstream-rpms 15 M 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2023-10-09T15:28:15.073 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug noarch 0.12.2-4.el8 rhel-8-for-x86_64-appstream-rpms 457 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: socat x86_64 1.7.3.3-2.el8 rhel-8-for-x86_64-appstream-rpms 302 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet x86_64 1.6.1-20.el8 lab-extras 70 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel x86_64 1.2.11-17.el8 rhel-8-for-x86_64-baseos-rpms 58 k 2023-10-09T15:28:15.074 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction Summary 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:====================================================================================================================== 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:Install 118 Packages 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:Upgrade 2 Packages 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:Total download size: 202 M 2023-10-09T15:28:15.075 INFO:teuthology.orchestra.run.smithi059.stdout:Downloading Packages: 2023-10-09T15:28:15.324 INFO:teuthology.orchestra.run.smithi033.stdout:(2/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 1.8 MB/s | 876 kB 00:00 2023-10-09T15:28:15.415 INFO:teuthology.orchestra.run.smithi033.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 1.7 MB/s | 162 kB 00:00 2023-10-09T15:28:15.701 INFO:teuthology.orchestra.run.smithi033.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 8.1 MB/s | 2.3 MB 00:00 2023-10-09T15:28:15.751 INFO:teuthology.orchestra.run.smithi059.stdout:(1/120): ceph-17.2.6-1320.g08cac018.el8.x86_64. 20 kB/s | 6.4 kB 00:00 2023-10-09T15:28:15.813 INFO:teuthology.orchestra.run.smithi033.stdout:(5/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 4.1 MB/s | 5.2 MB 00:01 2023-10-09T15:28:15.846 INFO:teuthology.orchestra.run.smithi033.stdout:(6/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 1.6 MB 00:00 2023-10-09T15:28:16.286 INFO:teuthology.orchestra.run.smithi033.stdout:(7/120): ceph-mon-17.2.6-1320.g08cac018.el8.x86 8.3 MB/s | 3.9 MB 00:00 2023-10-09T15:28:16.871 INFO:teuthology.orchestra.run.smithi059.stdout:(2/120): ceph-base-17.2.6-1320.g08cac018.el8.x8 3.6 MB/s | 5.2 MB 00:01 2023-10-09T15:28:16.933 INFO:teuthology.orchestra.run.smithi059.stdout:(3/120): ceph-immutable-object-cache-17.2.6-132 2.6 MB/s | 162 kB 00:00 2023-10-09T15:28:17.322 INFO:teuthology.orchestra.run.smithi059.stdout:(4/120): ceph-mds-17.2.6-1320.g08cac018.el8.x86 5.9 MB/s | 2.3 MB 00:00 2023-10-09T15:28:17.666 INFO:teuthology.orchestra.run.smithi059.stdout:(5/120): ceph-mgr-17.2.6-1320.g08cac018.el8.x86 4.6 MB/s | 1.6 MB 00:00 2023-10-09T15:28:17.741 INFO:teuthology.orchestra.run.smithi059.stdout:(6/120): ceph-fuse-17.2.6-1320.g08cac018.el8.x8 440 kB/s | 876 kB 00:01 2023-10-09T15:28:18.271 INFO:teuthology.orchestra.run.smithi033.stdout:(8/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 6.9 MB/s | 17 MB 00:02 2023-10-09T15:28:18.406 INFO:teuthology.orchestra.run.smithi033.stdout:(9/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 7.9 MB/s | 17 MB 00:02 2023-10-09T15:28:18.407 INFO:teuthology.orchestra.run.smithi033.stdout:(10/120): ceph-selinux-17.2.6-1320.g08cac018.el 180 kB/s | 24 kB 00:00 2023-10-09T15:28:18.463 INFO:teuthology.orchestra.run.smithi033.stdout:(11/120): cephfs-mirror-17.2.6-1320.g08cac018.e 4.4 MB/s | 255 kB 00:00 2023-10-09T15:28:18.603 INFO:teuthology.orchestra.run.smithi033.stdout:(12/120): ceph-common-17.2.6-1320.g08cac018.el8 5.8 MB/s | 23 MB 00:04 2023-10-09T15:28:18.663 INFO:teuthology.orchestra.run.smithi033.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 124 kB/s | 25 kB 00:00 2023-10-09T15:28:18.713 INFO:teuthology.orchestra.run.smithi033.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 3.4 MB/s | 174 kB 00:00 2023-10-09T15:28:18.748 INFO:teuthology.orchestra.run.smithi033.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 3.7 MB/s | 130 kB 00:00 2023-10-09T15:28:18.750 INFO:teuthology.orchestra.run.smithi033.stdout:(16/120): libcephfs2-17.2.6-1320.g08cac018.el8. 5.3 MB/s | 797 kB 00:00 2023-10-09T15:28:18.833 INFO:teuthology.orchestra.run.smithi033.stdout:(17/120): libradosstriper1-17.2.6-1320.g08cac01 5.8 MB/s | 507 kB 00:00 2023-10-09T15:28:18.862 INFO:teuthology.orchestra.run.smithi033.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 1.5 MB/s | 45 kB 00:00 2023-10-09T15:28:18.905 INFO:teuthology.orchestra.run.smithi033.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 2.7 MB/s | 115 kB 00:00 2023-10-09T15:28:18.947 INFO:teuthology.orchestra.run.smithi033.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 4.4 MB/s | 190 kB 00:00 2023-10-09T15:28:18.997 INFO:teuthology.orchestra.run.smithi033.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 7.4 MB/s | 371 kB 00:00 2023-10-09T15:28:19.049 INFO:teuthology.orchestra.run.smithi033.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 6.7 MB/s | 358 kB 00:00 2023-10-09T15:28:19.085 INFO:teuthology.orchestra.run.smithi033.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 2.9 MB/s | 107 kB 00:00 2023-10-09T15:28:19.107 INFO:teuthology.orchestra.run.smithi033.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.2 MB/s | 90 kB 00:00 2023-10-09T15:28:19.225 INFO:teuthology.orchestra.run.smithi059.stdout:(7/120): ceph-osd-17.2.6-1320.g08cac018.el8.x86 11 MB/s | 17 MB 00:01 2023-10-09T15:28:19.351 INFO:teuthology.orchestra.run.smithi033.stdout:(25/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 14 MB/s | 3.5 MB 00:00 2023-10-09T15:28:19.388 INFO:teuthology.orchestra.run.smithi033.stdout:(26/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 4.7 MB/s | 173 kB 00:00 2023-10-09T15:28:19.416 INFO:teuthology.orchestra.run.smithi033.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 821 kB/s | 23 kB 00:00 2023-10-09T15:28:19.448 INFO:teuthology.orchestra.run.smithi033.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 3.8 MB/s | 121 kB 00:00 2023-10-09T15:28:19.637 INFO:teuthology.orchestra.run.smithi033.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 8.9 MB/s | 1.7 MB 00:00 2023-10-09T15:28:19.861 INFO:teuthology.orchestra.run.smithi033.stdout:(30/120): librgw2-17.2.6-1320.g08cac018.el8.x86 5.0 MB/s | 5.6 MB 00:01 2023-10-09T15:28:19.962 INFO:teuthology.orchestra.run.smithi033.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 2.3 MB/s | 238 kB 00:00 2023-10-09T15:28:20.052 INFO:teuthology.orchestra.run.smithi033.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 527 kB/s | 47 kB 00:00 2023-10-09T15:28:20.145 INFO:teuthology.orchestra.run.smithi033.stdout:(33/120): ceph-prometheus-alerts-17.2.6-1320.g0 155 kB/s | 14 kB 00:00 2023-10-09T15:28:20.244 INFO:teuthology.orchestra.run.smithi033.stdout:(34/120): ceph-volume-17.2.6-1320.g08cac018.el8 2.6 MB/s | 267 kB 00:00 2023-10-09T15:28:20.330 INFO:teuthology.orchestra.run.smithi033.stdout:(35/120): cephadm-17.2.6-1320.g08cac018.el8.noa 943 kB/s | 80 kB 00:00 2023-10-09T15:28:20.390 INFO:teuthology.orchestra.run.smithi033.stdout:(36/120): ceph-mgr-diskprediction-local-17.2.6- 9.8 MB/s | 7.4 MB 00:00 2023-10-09T15:28:20.415 INFO:teuthology.orchestra.run.smithi033.stdout:(37/120): cephfs-top-17.2.6-1320.g08cac018.el8. 212 kB/s | 18 kB 00:00 2023-10-09T15:28:20.601 INFO:teuthology.orchestra.run.smithi059.stdout:(8/120): ceph-radosgw-17.2.6-1320.g08cac018.el8 12 MB/s | 17 MB 00:01 2023-10-09T15:28:20.622 INFO:teuthology.orchestra.run.smithi059.stdout:(9/120): ceph-selinux-17.2.6-1320.g08cac018.el8 1.1 MB/s | 24 kB 00:00 2023-10-09T15:28:20.839 INFO:teuthology.orchestra.run.smithi033.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 139 kB/s | 59 kB 00:00 2023-10-09T15:28:21.021 INFO:teuthology.orchestra.run.smithi033.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 485 kB/s | 306 kB 00:00 2023-10-09T15:28:21.032 INFO:teuthology.orchestra.run.smithi033.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 388 kB/s | 75 kB 00:00 2023-10-09T15:28:21.142 INFO:teuthology.orchestra.run.smithi033.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 399 kB/s | 44 kB 00:00 2023-10-09T15:28:21.243 INFO:teuthology.orchestra.run.smithi033.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.1 MB/s | 476 kB 00:00 2023-10-09T15:28:21.346 INFO:teuthology.orchestra.run.smithi033.stdout:(43/120): python3-beautifulsoup4-4.6.3-2.el8.1. 908 kB/s | 185 kB 00:00 2023-10-09T15:28:21.346 INFO:teuthology.orchestra.run.smithi033.stdout:(44/120): python3-cachetools-3.1.1-4.el8.noarch 318 kB/s | 33 kB 00:00 2023-10-09T15:28:21.443 INFO:teuthology.orchestra.run.smithi033.stdout:(45/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.7 MB/s | 173 kB 00:00 2023-10-09T15:28:21.444 INFO:teuthology.orchestra.run.smithi033.stdout:(46/120): python3-certifi-2018.10.15-7.el8.noar 166 kB/s | 16 kB 00:00 2023-10-09T15:28:21.536 INFO:teuthology.orchestra.run.smithi033.stdout:(47/120): python3-google-auth-1.1.1-10.el8.noar 890 kB/s | 81 kB 00:00 2023-10-09T15:28:21.630 INFO:teuthology.orchestra.run.smithi033.stdout:(48/120): python3-cherrypy-18.4.0-1.el8.noarch. 2.0 MB/s | 384 kB 00:00 2023-10-09T15:28:21.633 INFO:teuthology.orchestra.run.smithi033.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 114 kB/s | 11 kB 00:00 2023-10-09T15:28:21.715 INFO:teuthology.orchestra.run.smithi033.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 207 kB/s | 18 kB 00:00 2023-10-09T15:28:21.821 INFO:teuthology.orchestra.run.smithi033.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 461 kB/s | 49 kB 00:00 2023-10-09T15:28:21.936 INFO:teuthology.orchestra.run.smithi033.stdout:(52/120): python3-more-itertools-7.2.0-3.el8.no 510 kB/s | 59 kB 00:00 2023-10-09T15:28:22.040 INFO:teuthology.orchestra.run.smithi033.stdout:(53/120): python3-natsort-7.1.1-2.el8.noarch.rp 582 kB/s | 60 kB 00:00 2023-10-09T15:28:22.148 INFO:teuthology.orchestra.run.smithi033.stdout:(54/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.6 MB/s | 283 kB 00:00 2023-10-09T15:28:22.255 INFO:teuthology.orchestra.run.smithi033.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 147 kB/s | 16 kB 00:00 2023-10-09T15:28:22.347 INFO:teuthology.orchestra.run.smithi033.stdout:(56/120): python3-kubernetes-11.0.0-6.el8.noarc 1.6 MB/s | 1.2 MB 00:00 2023-10-09T15:28:22.361 INFO:teuthology.orchestra.run.smithi033.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 318 kB/s | 34 kB 00:00 2023-10-09T15:28:22.455 INFO:teuthology.orchestra.run.smithi033.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 1.8 MB/s | 196 kB 00:00 2023-10-09T15:28:22.467 INFO:teuthology.orchestra.run.smithi033.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 607 kB/s | 64 kB 00:00 2023-10-09T15:28:22.558 INFO:teuthology.orchestra.run.smithi033.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 182 kB/s | 19 kB 00:00 2023-10-09T15:28:22.570 INFO:teuthology.orchestra.run.smithi033.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 233 kB/s | 24 kB 00:00 2023-10-09T15:28:22.659 INFO:teuthology.orchestra.run.smithi033.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 290 kB/s | 29 kB 00:00 2023-10-09T15:28:22.666 INFO:teuthology.orchestra.run.smithi059.stdout:(10/120): ceph-mon-17.2.6-1320.g08cac018.el8.x8 805 kB/s | 3.9 MB 00:05 2023-10-09T15:28:22.672 INFO:teuthology.orchestra.run.smithi033.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 269 kB/s | 27 kB 00:00 2023-10-09T15:28:22.769 INFO:teuthology.orchestra.run.smithi033.stdout:(64/120): python3-webob-1.8.5-1.el8.1.noarch.rp 2.5 MB/s | 251 kB 00:00 2023-10-09T15:28:22.852 INFO:teuthology.orchestra.run.smithi033.stdout:(65/120): python3-waitress-1.4.3-1.el8.noarch.r 1.3 MB/s | 255 kB 00:00 2023-10-09T15:28:22.856 INFO:teuthology.orchestra.run.smithi033.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 704 kB/s | 61 kB 00:00 2023-10-09T15:28:22.950 INFO:teuthology.orchestra.run.smithi033.stdout:(67/120): python3-webtest-2.0.33-1.el8.noarch.r 873 kB/s | 85 kB 00:00 2023-10-09T15:28:22.954 INFO:teuthology.orchestra.run.smithi033.stdout:(68/120): python3-zc-lockfile-2.0-2.el8.noarch. 236 kB/s | 23 kB 00:00 2023-10-09T15:28:22.959 INFO:teuthology.orchestra.run.smithi033.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 14 MB/s | 70 kB 00:00 2023-10-09T15:28:23.139 INFO:teuthology.orchestra.run.smithi059.stdout:(11/120): ceph-test-17.2.6-1320.g08cac018.el8.x 21 MB/s | 52 MB 00:02 2023-10-09T15:28:23.142 INFO:teuthology.orchestra.run.smithi059.stdout:(12/120): cephfs-mirror-17.2.6-1320.g08cac018.e 537 kB/s | 255 kB 00:00 2023-10-09T15:28:23.161 INFO:teuthology.orchestra.run.smithi059.stdout:(13/120): libcephfs-devel-17.2.6-1320.g08cac018 1.2 MB/s | 25 kB 00:00 2023-10-09T15:28:23.183 INFO:teuthology.orchestra.run.smithi059.stdout:(14/120): libcephsqlite-17.2.6-1320.g08cac018.e 7.6 MB/s | 174 kB 00:00 2023-10-09T15:28:23.205 INFO:teuthology.orchestra.run.smithi059.stdout:(15/120): librados-devel-17.2.6-1320.g08cac018. 5.8 MB/s | 130 kB 00:00 2023-10-09T15:28:23.249 INFO:teuthology.orchestra.run.smithi059.stdout:(16/120): libradosstriper1-17.2.6-1320.g08cac01 11 MB/s | 507 kB 00:00 2023-10-09T15:28:23.314 INFO:teuthology.orchestra.run.smithi033.stdout:(70/120): python3-scipy-1.0.0-20.module+el8.1.0 41 MB/s | 15 MB 00:00 2023-10-09T15:28:23.332 INFO:teuthology.orchestra.run.smithi033.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 2.4 MB/s | 44 kB 00:00 2023-10-09T15:28:23.350 INFO:teuthology.orchestra.run.smithi033.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.5 MB/s | 27 kB 00:00 2023-10-09T15:28:23.369 INFO:teuthology.orchestra.run.smithi033.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 8.1 MB/s | 161 kB 00:00 2023-10-09T15:28:23.391 INFO:teuthology.orchestra.run.smithi033.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 15 MB/s | 320 kB 00:00 2023-10-09T15:28:23.411 INFO:teuthology.orchestra.run.smithi033.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 22 MB/s | 457 kB 00:00 2023-10-09T15:28:23.492 INFO:teuthology.orchestra.run.smithi033.stdout:(76/120): python3-babel-2.5.1-5.el8.noarch.rpm 60 MB/s | 4.8 MB 00:00 2023-10-09T15:28:23.507 INFO:teuthology.orchestra.run.smithi059.stdout:(17/120): librgw2-17.2.6-1320.g08cac018.el8.x86 22 MB/s | 5.6 MB 00:00 2023-10-09T15:28:23.509 INFO:teuthology.orchestra.run.smithi033.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.2 MB/s | 39 kB 00:00 2023-10-09T15:28:23.529 INFO:teuthology.orchestra.run.smithi059.stdout:(18/120): python3-ceph-argparse-17.2.6-1320.g08 2.0 MB/s | 45 kB 00:00 2023-10-09T15:28:23.536 INFO:teuthology.orchestra.run.smithi033.stdout:(78/120): bison-3.0.4-10.el8.x86_64.rpm 26 MB/s | 688 kB 00:00 2023-10-09T15:28:23.551 INFO:teuthology.orchestra.run.smithi059.stdout:(19/120): python3-ceph-common-17.2.6-1320.g08ca 5.2 MB/s | 115 kB 00:00 2023-10-09T15:28:23.557 INFO:teuthology.orchestra.run.smithi033.stdout:(79/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 12 MB/s | 259 kB 00:00 2023-10-09T15:28:23.574 INFO:teuthology.orchestra.run.smithi059.stdout:(20/120): python3-cephfs-17.2.6-1320.g08cac018. 8.3 MB/s | 190 kB 00:00 2023-10-09T15:28:23.576 INFO:teuthology.orchestra.run.smithi033.stdout:(80/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 12 MB/s | 225 kB 00:00 2023-10-09T15:28:23.595 INFO:teuthology.orchestra.run.smithi033.stdout:(81/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 6.6 MB/s | 126 kB 00:00 2023-10-09T15:28:23.598 INFO:teuthology.orchestra.run.smithi059.stdout:(21/120): python3-rados-17.2.6-1320.g08cac018.e 15 MB/s | 371 kB 00:00 2023-10-09T15:28:23.622 INFO:teuthology.orchestra.run.smithi059.stdout:(22/120): python3-rbd-17.2.6-1320.g08cac018.el8 15 MB/s | 358 kB 00:00 2023-10-09T15:28:23.644 INFO:teuthology.orchestra.run.smithi059.stdout:(23/120): python3-rgw-17.2.6-1320.g08cac018.el8 4.9 MB/s | 107 kB 00:00 2023-10-09T15:28:23.662 INFO:teuthology.orchestra.run.smithi033.stdout:(82/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 56 MB/s | 3.7 MB 00:00 2023-10-09T15:28:23.666 INFO:teuthology.orchestra.run.smithi059.stdout:(24/120): rbd-fuse-17.2.6-1320.g08cac018.el8.x8 4.2 MB/s | 90 kB 00:00 2023-10-09T15:28:23.682 INFO:teuthology.orchestra.run.smithi033.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.4 MB/s | 187 kB 00:00 2023-10-09T15:28:23.703 INFO:teuthology.orchestra.run.smithi033.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 25 MB/s | 538 kB 00:00 2023-10-09T15:28:23.724 INFO:teuthology.orchestra.run.smithi033.stdout:(85/120): thrift-0.13.0-2.el8.x86_64.rpm 2.2 MB/s | 1.7 MB 00:00 2023-10-09T15:28:23.725 INFO:teuthology.orchestra.run.smithi033.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 13 MB/s | 302 kB 00:00 2023-10-09T15:28:23.750 INFO:teuthology.orchestra.run.smithi033.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 6.3 MB/s | 157 kB 00:00 2023-10-09T15:28:23.775 INFO:teuthology.orchestra.run.smithi033.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 2.2 MB/s | 110 kB 00:00 2023-10-09T15:28:23.783 INFO:teuthology.orchestra.run.smithi033.stdout:(89/120): librdkafka-0.11.4-1.el8.x86_64.rpm 10 MB/s | 353 kB 00:00 2023-10-09T15:28:23.790 INFO:teuthology.orchestra.run.smithi059.stdout:(25/120): libcephfs2-17.2.6-1320.g08cac018.el8. 1.2 MB/s | 797 kB 00:00 2023-10-09T15:28:23.792 INFO:teuthology.orchestra.run.smithi033.stdout:(90/120): python3-jsonpointer-1.10-11.el8.noarc 1.1 MB/s | 20 kB 00:00 2023-10-09T15:28:23.811 INFO:teuthology.orchestra.run.smithi033.stdout:(91/120): libtool-2.4.6-25.el8.x86_64.rpm 25 MB/s | 709 kB 00:00 2023-10-09T15:28:23.812 INFO:teuthology.orchestra.run.smithi033.stdout:(92/120): python3-pytz-2017.2-9.el8.noarch.rpm 2.7 MB/s | 54 kB 00:00 2023-10-09T15:28:23.832 INFO:teuthology.orchestra.run.smithi059.stdout:(26/120): rbd-mirror-17.2.6-1320.g08cac018.el8. 21 MB/s | 3.5 MB 00:00 2023-10-09T15:28:23.853 INFO:teuthology.orchestra.run.smithi059.stdout:(27/120): ceph-grafana-dashboards-17.2.6-1320.g 1.1 MB/s | 23 kB 00:00 2023-10-09T15:28:23.875 INFO:teuthology.orchestra.run.smithi059.stdout:(28/120): ceph-mgr-cephadm-17.2.6-1320.g08cac01 5.4 MB/s | 121 kB 00:00 2023-10-09T15:28:23.910 INFO:teuthology.orchestra.run.smithi033.stdout:(93/120): openblas-0.3.12-1.el8.x86_64.rpm 48 MB/s | 4.6 MB 00:00 2023-10-09T15:28:23.923 INFO:teuthology.orchestra.run.smithi033.stdout:(94/120): openblas-threads-0.3.12-1.el8.x86_64. 42 MB/s | 4.7 MB 00:00 2023-10-09T15:28:23.935 INFO:teuthology.orchestra.run.smithi033.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-09T15:28:23.940 INFO:teuthology.orchestra.run.smithi033.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.1 MB/s | 19 kB 00:00 2023-10-09T15:28:23.952 INFO:teuthology.orchestra.run.smithi033.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.5 MB/s | 43 kB 00:00 2023-10-09T15:28:23.957 INFO:teuthology.orchestra.run.smithi033.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.8 MB/s | 155 kB 00:00 2023-10-09T15:28:23.959 INFO:teuthology.orchestra.run.smithi059.stdout:(29/120): ceph-mgr-dashboard-17.2.6-1320.g08cac 20 MB/s | 1.7 MB 00:00 2023-10-09T15:28:23.969 INFO:teuthology.orchestra.run.smithi033.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 13 MB/s | 220 kB 00:00 2023-10-09T15:28:23.974 INFO:teuthology.orchestra.run.smithi059.stdout:(30/120): rbd-nbd-17.2.6-1320.g08cac018.el8.x86 948 kB/s | 173 kB 00:00 2023-10-09T15:28:23.974 INFO:teuthology.orchestra.run.smithi033.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 2.8 MB/s | 48 kB 00:00 2023-10-09T15:28:23.989 INFO:teuthology.orchestra.run.smithi033.stdout:(101/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 11 MB/s | 229 kB 00:00 2023-10-09T15:28:23.993 INFO:teuthology.orchestra.run.smithi033.stdout:(102/120): python3-requests-oauthlib-1.0.0-1.el 2.3 MB/s | 43 kB 00:00 2023-10-09T15:28:24.009 INFO:teuthology.orchestra.run.smithi033.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.1 MB/s | 18 kB 00:00 2023-10-09T15:28:24.040 INFO:teuthology.orchestra.run.smithi033.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 46 MB/s | 2.3 MB 00:00 2023-10-09T15:28:24.042 INFO:teuthology.orchestra.run.smithi033.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2023-10-09T15:28:24.058 INFO:teuthology.orchestra.run.smithi033.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 4.4 MB/s | 83 kB 00:00 2023-10-09T15:28:24.060 INFO:teuthology.orchestra.run.smithi033.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 3.2 MB/s | 59 kB 00:00 2023-10-09T15:28:24.076 INFO:teuthology.orchestra.run.smithi033.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 9.5 MB/s | 169 kB 00:00 2023-10-09T15:28:24.081 INFO:teuthology.orchestra.run.smithi033.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 1.8 MB/s | 38 kB 00:00 2023-10-09T15:28:24.092 INFO:teuthology.orchestra.run.smithi033.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 5.3 MB/s | 86 kB 00:00 2023-10-09T15:28:24.099 INFO:teuthology.orchestra.run.smithi033.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.1 MB/s | 58 kB 00:00 2023-10-09T15:28:24.108 INFO:teuthology.orchestra.run.smithi033.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.8 MB/s | 47 kB 00:00 2023-10-09T15:28:24.121 INFO:teuthology.orchestra.run.smithi033.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 24 MB/s | 559 kB 00:00 2023-10-09T15:28:24.133 INFO:teuthology.orchestra.run.smithi033.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 26 MB/s | 639 kB 00:00 2023-10-09T15:28:24.139 INFO:teuthology.orchestra.run.smithi033.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.0 MB/s | 70 kB 00:00 2023-10-09T15:28:24.152 INFO:teuthology.orchestra.run.smithi033.stdout:(116/120): libselinux-devel-2.9-5.el8.x86_64.rp 10 MB/s | 200 kB 00:00 2023-10-09T15:28:24.156 INFO:teuthology.orchestra.run.smithi033.stdout:(117/120): libuuid-devel-2.32.1-27.el8.x86_64.r 5.4 MB/s | 97 kB 00:00 2023-10-09T15:28:24.167 INFO:teuthology.orchestra.run.smithi059.stdout:(31/120): ceph-mgr-modules-core-17.2.6-1320.g08 1.2 MB/s | 238 kB 00:00 2023-10-09T15:28:24.242 INFO:teuthology.orchestra.run.smithi059.stdout:(32/120): ceph-mgr-rook-17.2.6-1320.g08cac018.e 637 kB/s | 47 kB 00:00 2023-10-09T15:28:24.311 INFO:teuthology.orchestra.run.smithi059.stdout:(33/120): ceph-mgr-diskprediction-local-17.2.6- 21 MB/s | 7.4 MB 00:00 2023-10-09T15:28:24.322 INFO:teuthology.orchestra.run.smithi059.stdout:(34/120): ceph-prometheus-alerts-17.2.6-1320.g0 184 kB/s | 14 kB 00:00 2023-10-09T15:28:24.334 INFO:teuthology.orchestra.run.smithi059.stdout:(35/120): ceph-volume-17.2.6-1320.g08cac018.el8 11 MB/s | 267 kB 00:00 2023-10-09T15:28:24.356 INFO:teuthology.orchestra.run.smithi059.stdout:(36/120): cephfs-top-17.2.6-1320.g08cac018.el8. 862 kB/s | 18 kB 00:00 2023-10-09T15:28:24.394 INFO:teuthology.orchestra.run.smithi059.stdout:(37/120): cephadm-17.2.6-1320.g08cac018.el8.noa 1.1 MB/s | 80 kB 00:00 2023-10-09T15:28:24.459 INFO:teuthology.orchestra.run.smithi033.stdout:(118/120): librados2-17.2.6-1320.g08cac018.el8. 11 MB/s | 3.5 MB 00:00 2023-10-09T15:28:24.855 INFO:teuthology.orchestra.run.smithi059.stdout:(38/120): liboath-2.6.2-3.el8.x86_64.rpm 128 kB/s | 59 kB 00:00 2023-10-09T15:28:24.964 INFO:teuthology.orchestra.run.smithi059.stdout:(39/120): gperftools-libs-2.7-9.el8.x86_64.rpm 503 kB/s | 306 kB 00:00 2023-10-09T15:28:25.027 INFO:teuthology.orchestra.run.smithi059.stdout:(40/120): libunwind-1.3.1-3.el8.x86_64.rpm 438 kB/s | 75 kB 00:00 2023-10-09T15:28:25.137 INFO:teuthology.orchestra.run.smithi059.stdout:(41/120): python3-bcrypt-3.1.6-2.el8.1.x86_64.r 397 kB/s | 44 kB 00:00 2023-10-09T15:28:25.166 INFO:teuthology.orchestra.run.smithi033.stdout:(119/120): librbd1-17.2.6-1320.g08cac018.el8.x8 3.6 MB/s | 3.6 MB 00:01 2023-10-09T15:28:25.167 INFO:teuthology.orchestra.run.smithi059.stdout:(42/120): python3-asyncssh-2.7.0-2.el8.noarch.r 2.3 MB/s | 476 kB 00:00 2023-10-09T15:28:25.260 INFO:teuthology.orchestra.run.smithi059.stdout:(43/120): python3-cachetools-3.1.1-4.el8.noarch 356 kB/s | 33 kB 00:00 2023-10-09T15:28:25.305 INFO:teuthology.orchestra.run.smithi059.stdout:(44/120): python3-beautifulsoup4-4.6.3-2.el8.1. 1.1 MB/s | 185 kB 00:00 2023-10-09T15:28:25.360 INFO:teuthology.orchestra.run.smithi059.stdout:(45/120): python3-certifi-2018.10.15-7.el8.noar 163 kB/s | 16 kB 00:00 2023-10-09T15:28:25.420 INFO:teuthology.orchestra.run.smithi059.stdout:(46/120): python3-cheroot-8.5.2-1.el8.noarch.rp 1.5 MB/s | 173 kB 00:00 2023-10-09T15:28:25.472 INFO:teuthology.orchestra.run.smithi059.stdout:(47/120): python3-cherrypy-18.4.0-1.el8.noarch. 3.4 MB/s | 384 kB 00:00 2023-10-09T15:28:25.521 INFO:teuthology.orchestra.run.smithi059.stdout:(48/120): python3-google-auth-1.1.1-10.el8.noar 807 kB/s | 81 kB 00:00 2023-10-09T15:28:25.557 INFO:teuthology.orchestra.run.smithi059.stdout:(49/120): python3-jaraco-6.2-6.el8.noarch.rpm 131 kB/s | 11 kB 00:00 2023-10-09T15:28:25.600 INFO:teuthology.orchestra.run.smithi059.stdout:(50/120): python3-jaraco-functools-2.0-4.el8.no 221 kB/s | 18 kB 00:00 2023-10-09T15:28:25.685 INFO:teuthology.orchestra.run.smithi059.stdout:(51/120): python3-logutils-0.3.5-11.el8.noarch. 575 kB/s | 49 kB 00:00 2023-10-09T15:28:25.735 INFO:teuthology.orchestra.run.smithi059.stdout:(52/120): python3-kubernetes-11.0.0-6.el8.noarc 6.6 MB/s | 1.2 MB 00:00 2023-10-09T15:28:25.781 INFO:teuthology.orchestra.run.smithi059.stdout:(53/120): python3-more-itertools-7.2.0-3.el8.no 614 kB/s | 59 kB 00:00 2023-10-09T15:28:25.814 INFO:teuthology.orchestra.run.smithi059.stdout:(54/120): python3-natsort-7.1.1-2.el8.noarch.rp 762 kB/s | 60 kB 00:00 2023-10-09T15:28:25.889 INFO:teuthology.orchestra.run.smithi059.stdout:(55/120): python3-portend-2.6-1.el8.noarch.rpm 210 kB/s | 16 kB 00:00 2023-10-09T15:28:25.902 INFO:teuthology.orchestra.run.smithi059.stdout:(56/120): python3-pecan-1.3.2-9.el8.noarch.rpm 2.3 MB/s | 283 kB 00:00 2023-10-09T15:28:25.997 INFO:teuthology.orchestra.run.smithi059.stdout:(57/120): python3-repoze-lru-0.7-6.el8.noarch.r 311 kB/s | 34 kB 00:00 2023-10-09T15:28:26.117 INFO:teuthology.orchestra.run.smithi059.stdout:(58/120): python3-routes-2.4.1-12.el8.noarch.rp 913 kB/s | 196 kB 00:00 2023-10-09T15:28:26.155 INFO:teuthology.orchestra.run.smithi059.stdout:(59/120): python3-rsa-4.9-2.el8.noarch.rpm 409 kB/s | 64 kB 00:00 2023-10-09T15:28:26.237 INFO:teuthology.orchestra.run.smithi059.stdout:(60/120): python3-simplegeneric-0.8.1-17.el8.no 156 kB/s | 19 kB 00:00 2023-10-09T15:28:26.276 INFO:teuthology.orchestra.run.smithi059.stdout:(61/120): python3-singledispatch-3.4.0.3-18.el8 196 kB/s | 24 kB 00:00 2023-10-09T15:28:26.332 INFO:teuthology.orchestra.run.smithi059.stdout:(62/120): python3-tempora-1.14.1-5.el8.noarch.r 310 kB/s | 29 kB 00:00 2023-10-09T15:28:26.356 INFO:teuthology.orchestra.run.smithi059.stdout:(63/120): python3-trustme-0.6.0-4.el8.noarch.rp 347 kB/s | 27 kB 00:00 2023-10-09T15:28:26.553 INFO:teuthology.orchestra.run.smithi059.stdout:(64/120): python3-waitress-1.4.3-1.el8.noarch.r 1.1 MB/s | 255 kB 00:00 2023-10-09T15:28:26.613 INFO:teuthology.orchestra.run.smithi059.stdout:(65/120): python3-webob-1.8.5-1.el8.1.noarch.rp 980 kB/s | 251 kB 00:00 2023-10-09T15:28:26.647 INFO:teuthology.orchestra.run.smithi059.stdout:(66/120): python3-websocket-client-0.56.0-5.el8 648 kB/s | 61 kB 00:00 2023-10-09T15:28:26.762 INFO:teuthology.orchestra.run.smithi059.stdout:(67/120): python3-zc-lockfile-2.0-2.el8.noarch. 200 kB/s | 23 kB 00:00 2023-10-09T15:28:27.025 INFO:teuthology.orchestra.run.smithi059.stdout:(68/120): python3-webtest-2.0.33-1.el8.noarch.r 207 kB/s | 85 kB 00:00 2023-10-09T15:28:27.042 INFO:teuthology.orchestra.run.smithi059.stdout:(69/120): xmlstarlet-1.6.1-20.el8.x86_64.rpm 4.1 MB/s | 70 kB 00:00 2023-10-09T15:28:27.114 INFO:teuthology.orchestra.run.smithi059.stdout:(70/120): thrift-0.13.0-2.el8.x86_64.rpm 4.9 MB/s | 1.7 MB 00:00 2023-10-09T15:28:27.147 INFO:teuthology.orchestra.run.smithi059.stdout:(71/120): python3-prettytable-0.7.2-14.el8.noar 1.3 MB/s | 44 kB 00:00 2023-10-09T15:28:27.164 INFO:teuthology.orchestra.run.smithi059.stdout:(72/120): python3-jsonpatch-1.21-2.el8.noarch.r 1.6 MB/s | 27 kB 00:00 2023-10-09T15:28:27.181 INFO:teuthology.orchestra.run.smithi059.stdout:(73/120): jq-1.5-12.el8.x86_64.rpm 9.3 MB/s | 161 kB 00:00 2023-10-09T15:28:27.199 INFO:teuthology.orchestra.run.smithi059.stdout:(74/120): flex-2.6.1-9.el8.x86_64.rpm 17 MB/s | 320 kB 00:00 2023-10-09T15:28:27.223 INFO:teuthology.orchestra.run.smithi059.stdout:(75/120): python3-werkzeug-0.12.2-4.el8.noarch. 19 MB/s | 457 kB 00:00 2023-10-09T15:28:27.384 INFO:teuthology.orchestra.run.smithi059.stdout:(76/120): python3-scipy-1.0.0-20.module+el8.1.0 43 MB/s | 15 MB 00:00 2023-10-09T15:28:27.401 INFO:teuthology.orchestra.run.smithi059.stdout:(77/120): python3-markupsafe-0.23-19.el8.x86_64 2.3 MB/s | 39 kB 00:00 2023-10-09T15:28:27.419 INFO:teuthology.orchestra.run.smithi059.stdout:(78/120): python3-babel-2.5.1-5.el8.noarch.rpm 24 MB/s | 4.8 MB 00:00 2023-10-09T15:28:27.429 INFO:teuthology.orchestra.run.smithi059.stdout:(79/120): bison-3.0.4-10.el8.x86_64.rpm 24 MB/s | 688 kB 00:00 2023-10-09T15:28:27.438 INFO:teuthology.orchestra.run.smithi059.stdout:(80/120): lttng-ust-2.8.1-11.el8.x86_64.rpm 14 MB/s | 259 kB 00:00 2023-10-09T15:28:27.448 INFO:teuthology.orchestra.run.smithi059.stdout:(81/120): python3-numpy-f2py-1.14.3-9.el8.x86_6 12 MB/s | 225 kB 00:00 2023-10-09T15:28:27.453 INFO:teuthology.orchestra.run.smithi059.stdout:(82/120): python3-pyasn1-0.3.7-6.el8.noarch.rpm 8.4 MB/s | 126 kB 00:00 2023-10-09T15:28:27.473 INFO:teuthology.orchestra.run.smithi059.stdout:(83/120): oniguruma-6.8.2-2.el8.x86_64.rpm 9.4 MB/s | 187 kB 00:00 2023-10-09T15:28:27.497 INFO:teuthology.orchestra.run.smithi059.stdout:(84/120): python3-jinja2-2.10.1-2.el8_0.noarch. 22 MB/s | 538 kB 00:00 2023-10-09T15:28:27.517 INFO:teuthology.orchestra.run.smithi059.stdout:(85/120): python3-numpy-1.14.3-9.el8.x86_64.rpm 54 MB/s | 3.7 MB 00:00 2023-10-09T15:28:27.521 INFO:teuthology.orchestra.run.smithi059.stdout:(86/120): socat-1.7.3.3-2.el8.x86_64.rpm 12 MB/s | 302 kB 00:00 2023-10-09T15:28:27.535 INFO:teuthology.orchestra.run.smithi059.stdout:(87/120): python3-mako-1.0.6-13.el8.noarch.rpm 8.9 MB/s | 157 kB 00:00 2023-10-09T15:28:27.537 INFO:teuthology.orchestra.run.smithi059.stdout:(88/120): python3-pyasn1-modules-0.3.7-6.el8.no 6.8 MB/s | 110 kB 00:00 2023-10-09T15:28:27.554 INFO:teuthology.orchestra.run.smithi059.stdout:(89/120): python3-jsonpointer-1.10-11.el8.noarc 1.2 MB/s | 20 kB 00:00 2023-10-09T15:28:27.556 INFO:teuthology.orchestra.run.smithi059.stdout:(90/120): librdkafka-0.11.4-1.el8.x86_64.rpm 16 MB/s | 353 kB 00:00 2023-10-09T15:28:27.570 INFO:teuthology.orchestra.run.smithi059.stdout:(91/120): python3-pytz-2017.2-9.el8.noarch.rpm 4.0 MB/s | 54 kB 00:00 2023-10-09T15:28:27.579 INFO:teuthology.orchestra.run.smithi059.stdout:(92/120): libtool-2.4.6-25.el8.x86_64.rpm 28 MB/s | 709 kB 00:00 2023-10-09T15:28:27.663 INFO:teuthology.orchestra.run.smithi059.stdout:(93/120): openblas-threads-0.3.12-1.el8.x86_64. 51 MB/s | 4.7 MB 00:00 2023-10-09T15:28:27.681 INFO:teuthology.orchestra.run.smithi059.stdout:(94/120): openblas-0.3.12-1.el8.x86_64.rpm 45 MB/s | 4.6 MB 00:00 2023-10-09T15:28:27.690 INFO:teuthology.orchestra.run.smithi059.stdout:(95/120): automake-1.16.1-7.el8.noarch.rpm 26 MB/s | 713 kB 00:00 2023-10-09T15:28:27.700 INFO:teuthology.orchestra.run.smithi059.stdout:(96/120): libaio-devel-0.3.112-1.el8.x86_64.rpm 1.0 MB/s | 19 kB 00:00 2023-10-09T15:28:27.710 INFO:teuthology.orchestra.run.smithi059.stdout:(97/120): python3-jwt-1.6.1-2.el8.noarch.rpm 2.1 MB/s | 43 kB 00:00 2023-10-09T15:28:27.718 INFO:teuthology.orchestra.run.smithi059.stdout:(98/120): python3-oauthlib-2.1.0-1.el8.noarch.r 8.5 MB/s | 155 kB 00:00 2023-10-09T15:28:27.729 INFO:teuthology.orchestra.run.smithi059.stdout:(99/120): pcre2-utf32-10.32-2.el8.x86_64.rpm 12 MB/s | 220 kB 00:00 2023-10-09T15:28:27.732 INFO:teuthology.orchestra.run.smithi059.stdout:(100/120): keyutils-libs-devel-1.5.10-6.el8.x86 3.3 MB/s | 48 kB 00:00 2023-10-09T15:28:27.746 INFO:teuthology.orchestra.run.smithi059.stdout:(101/120): python3-requests-oauthlib-1.0.0-1.el 3.1 MB/s | 43 kB 00:00 2023-10-09T15:28:27.748 INFO:teuthology.orchestra.run.smithi059.stdout:(102/120): pcre2-utf16-10.32-2.el8.x86_64.rpm 12 MB/s | 229 kB 00:00 2023-10-09T15:28:27.764 INFO:teuthology.orchestra.run.smithi059.stdout:(103/120): libverto-devel-0.3.0-5.el8.x86_64.rp 1.1 MB/s | 18 kB 00:00 2023-10-09T15:28:27.794 INFO:teuthology.orchestra.run.smithi059.stdout:(104/120): openssl-devel-1.1.1g-15.el8_3.x86_64 49 MB/s | 2.3 MB 00:00 2023-10-09T15:28:27.797 INFO:teuthology.orchestra.run.smithi059.stdout:(105/120): pcre2-devel-10.32-2.el8.x86_64.rpm 18 MB/s | 605 kB 00:00 2023-10-09T15:28:27.811 INFO:teuthology.orchestra.run.smithi059.stdout:(106/120): fuse-2.9.7-12.el8.x86_64.rpm 4.8 MB/s | 83 kB 00:00 2023-10-09T15:28:27.812 INFO:teuthology.orchestra.run.smithi059.stdout:(107/120): elfutils-libelf-devel-0.182-3.el8.x8 3.8 MB/s | 59 kB 00:00 2023-10-09T15:28:27.826 INFO:teuthology.orchestra.run.smithi059.stdout:(108/120): libquadmath-8.4.1-1.el8.x86_64.rpm 11 MB/s | 169 kB 00:00 2023-10-09T15:28:27.828 INFO:teuthology.orchestra.run.smithi059.stdout:(109/120): libcom_err-devel-1.45.6-1.el8.x86_64 2.3 MB/s | 38 kB 00:00 2023-10-09T15:28:27.843 INFO:teuthology.orchestra.run.smithi059.stdout:(110/120): libsepol-devel-2.9-2.el8.x86_64.rpm 4.9 MB/s | 86 kB 00:00 2023-10-09T15:28:27.844 INFO:teuthology.orchestra.run.smithi059.stdout:(111/120): zlib-devel-1.2.11-17.el8.x86_64.rpm 3.4 MB/s | 58 kB 00:00 2023-10-09T15:28:27.860 INFO:teuthology.orchestra.run.smithi059.stdout:(112/120): librabbitmq-0.9.0-3.el8.x86_64.rpm 2.8 MB/s | 47 kB 00:00 2023-10-09T15:28:27.868 INFO:teuthology.orchestra.run.smithi059.stdout:(113/120): krb5-devel-1.18.2-8.3.el8_4.x86_64.r 24 MB/s | 559 kB 00:00 2023-10-09T15:28:27.882 INFO:teuthology.orchestra.run.smithi059.stdout:(114/120): libgfortran-8.4.1-1.el8.x86_64.rpm 29 MB/s | 639 kB 00:00 2023-10-09T15:28:27.885 INFO:teuthology.orchestra.run.smithi059.stdout:(115/120): xfsprogs-devel-5.0.0-8.el8.x86_64.rp 4.0 MB/s | 70 kB 00:00 2023-10-09T15:28:27.899 INFO:teuthology.orchestra.run.smithi059.stdout:(116/120): libuuid-devel-2.32.1-27.el8.x86_64.r 6.6 MB/s | 97 kB 00:00 2023-10-09T15:28:27.901 INFO:teuthology.orchestra.run.smithi059.stdout:(117/120): libselinux-devel-2.9-5.el8.x86_64.rp 10 MB/s | 200 kB 00:00 2023-10-09T15:28:28.153 INFO:teuthology.orchestra.run.smithi059.stdout:(118/120): librbd1-17.2.6-1320.g08cac018.el8.x8 14 MB/s | 3.6 MB 00:00 2023-10-09T15:28:29.451 INFO:teuthology.orchestra.run.smithi059.stdout:(119/120): librados2-17.2.6-1320.g08cac018.el8. 2.2 MB/s | 3.5 MB 00:01 2023-10-09T15:28:34.685 INFO:teuthology.orchestra.run.smithi059.stdout:(120/120): ceph-common-17.2.6-1320.g08cac018.el 1.2 MB/s | 23 MB 00:19 2023-10-09T15:28:34.691 INFO:teuthology.orchestra.run.smithi059.stdout:-------------------------------------------------------------------------------- 2023-10-09T15:28:34.692 INFO:teuthology.orchestra.run.smithi059.stdout:Total 10 MB/s | 202 MB 00:19 2023-10-09T15:28:34.749 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction check 2023-10-09T15:28:34.876 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction check succeeded. 2023-10-09T15:28:34.876 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction test 2023-10-09T15:28:35.338 INFO:teuthology.orchestra.run.smithi033.stdout:(120/120): ceph-test-17.2.6-1320.g08cac018.el8. 3.0 MB/s | 52 MB 00:16 2023-10-09T15:28:35.343 INFO:teuthology.orchestra.run.smithi033.stdout:-------------------------------------------------------------------------------- 2023-10-09T15:28:35.343 INFO:teuthology.orchestra.run.smithi033.stdout:Total 9.7 MB/s | 202 MB 00:20 2023-10-09T15:28:35.400 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction check 2023-10-09T15:28:35.527 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction check succeeded. 2023-10-09T15:28:35.527 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction test 2023-10-09T15:28:36.588 INFO:teuthology.orchestra.run.smithi059.stdout:Transaction test succeeded. 2023-10-09T15:28:36.593 INFO:teuthology.orchestra.run.smithi059.stdout:Running transaction 2023-10-09T15:28:37.265 INFO:teuthology.orchestra.run.smithi033.stdout:Transaction test succeeded. 2023-10-09T15:28:37.269 INFO:teuthology.orchestra.run.smithi033.stdout:Running transaction 2023-10-09T15:28:41.493 INFO:teuthology.orchestra.run.smithi059.stdout: Preparing : 1/1 2023-10-09T15:28:41.679 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T15:28:41.912 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-09T15:28:42.138 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T15:28:42.284 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T15:28:42.435 INFO:teuthology.orchestra.run.smithi033.stdout: Preparing : 1/1 2023-10-09T15:28:42.521 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T15:28:42.633 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/122 2023-10-09T15:28:42.863 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librabbitmq-0.9.0-3.el8.x86_64 2/122 2023-10-09T15:28:42.947 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T15:28:43.057 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T15:28:43.188 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T15:28:43.218 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librdkafka-0.11.4-1.el8.x86_64 3/122 2023-10-09T15:28:43.406 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T15:28:43.615 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T15:28:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 4/122 2023-10-09T15:28:43.854 INFO:teuthology.orchestra.run.smithi059.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:28:43.988 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:28:44.057 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T15:28:44.171 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:28:44.281 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:28:44.483 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 5/122 2023-10-09T15:28:44.627 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T15:28:44.673 INFO:teuthology.orchestra.run.smithi033.stdout: Upgrading : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:28:44.812 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:28:45.123 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:28:45.236 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:28:45.334 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T15:28:45.537 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:28:45.598 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T15:28:45.656 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:28:45.892 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T15:28:46.079 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T15:28:46.282 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : thrift-0.13.0-2.el8.x86_64 9/122 2023-10-09T15:28:46.295 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:28:46.406 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:28:46.465 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:28:46.577 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:28:46.596 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T15:28:46.665 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T15:28:46.827 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 11/122 2023-10-09T15:28:46.855 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-09T15:28:46.996 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T15:28:47.005 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 12/122 2023-10-09T15:28:47.142 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T15:28:47.231 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:28:47.304 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T15:28:47.343 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:28:47.498 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T15:28:47.569 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 14/122 2023-10-09T15:28:47.741 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : zlib-devel-1.2.11-17.el8.x86_64 15/122 2023-10-09T15:28:47.914 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T15:28:47.915 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T15:28:48.087 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T15:28:48.101 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libquadmath-8.4.1-1.el8.x86_64 16/122 2023-10-09T15:28:48.289 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T15:28:48.645 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T15:28:48.877 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libgfortran-8.4.1-1.el8.x86_64 17/122 2023-10-09T15:28:49.048 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T15:28:49.112 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T15:28:49.592 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-threads-0.3.12-1.el8.x86_64 18/122 2023-10-09T15:28:49.789 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T15:28:49.890 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T15:28:50.167 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-09T15:28:50.370 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-09T15:28:50.538 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: openblas-0.3.12-1.el8.x86_64 19/122 2023-10-09T15:28:50.567 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-09T15:28:50.801 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-1:1.14.3-9.el8.x86_64 20/122 2023-10-09T15:28:50.807 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-09T15:28:50.996 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 21/122 2023-10-09T15:28:51.118 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-09T15:28:51.143 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pytz-2017.2-9.el8.noarch 22/122 2023-10-09T15:28:51.394 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T15:28:51.432 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 23/122 2023-10-09T15:28:51.569 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T15:28:51.732 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T15:28:51.769 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 24/122 2023-10-09T15:28:52.010 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 25/122 2023-10-09T15:28:52.042 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T15:28:52.188 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 26/122 2023-10-09T15:28:52.317 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 27/122 2023-10-09T15:28:52.601 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 28/122 2023-10-09T15:28:53.145 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-09T15:28:53.507 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-09T15:28:53.655 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-mako-1.0.6-13.el8.noarch 29/122 2023-10-09T15:28:53.791 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-09T15:28:53.982 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-babel-2.5.1-5.el8.noarch 30/122 2023-10-09T15:28:54.010 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-09T15:28:54.291 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jinja2-2.10.1-2.el8_0.noarch 31/122 2023-10-09T15:28:54.307 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-09T15:28:54.562 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 32/122 2023-10-09T15:28:54.594 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T15:28:54.824 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 33/122 2023-10-09T15:28:55.152 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T15:28:56.804 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T15:28:57.184 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-09T15:28:57.404 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T15:28:57.442 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 34/122 2023-10-09T15:28:57.598 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T15:28:57.760 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 35/122 2023-10-09T15:28:57.841 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T15:28:57.979 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rsa-4.9-2.el8.noarch 36/122 2023-10-09T15:28:58.051 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T15:28:58.184 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 37/122 2023-10-09T15:28:58.274 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T15:28:58.392 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 38/122 2023-10-09T15:28:58.458 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-09T15:28:58.612 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 39/122 2023-10-09T15:28:58.634 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-09T15:28:58.792 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 40/122 2023-10-09T15:28:58.831 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-09T15:28:58.989 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-09T15:28:58.991 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libuuid-devel-2.32.1-27.el8.x86_64 41/122 2023-10-09T15:28:59.159 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libsepol-devel-2.9-2.el8.x86_64 42/122 2023-10-09T15:28:59.175 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-09T15:28:59.358 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcom_err-devel-1.45.6-1.el8.x86_64 43/122 2023-10-09T15:28:59.388 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-09T15:28:59.524 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : fuse-2.9.7-12.el8.x86_64 44/122 2023-10-09T15:28:59.566 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-09T15:28:59.678 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libverto-devel-0.3.0-5.el8.x86_64 45/122 2023-10-09T15:28:59.920 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-09T15:28:59.923 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf16-10.32-2.el8.x86_64 46/122 2023-10-09T15:29:00.093 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : keyutils-libs-devel-1.5.10-6.el8.x86_64 47/122 2023-10-09T15:29:00.183 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-09T15:29:00.433 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-09T15:29:00.434 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-utf32-10.32-2.el8.x86_64 48/122 2023-10-09T15:29:00.724 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : pcre2-devel-10.32-2.el8.x86_64 49/122 2023-10-09T15:29:00.758 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-09T15:29:00.976 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-09T15:29:01.006 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libselinux-devel-2.9-5.el8.x86_64 50/122 2023-10-09T15:29:01.202 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-09T15:29:01.319 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : krb5-devel-1.18.2-8.3.el8_4.x86_64 51/122 2023-10-09T15:29:01.430 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-09T15:29:01.536 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : automake-1.16.1-7.el8.noarch 52/122 2023-10-09T15:29:01.641 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-09T15:29:01.778 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 53/122 2023-10-09T15:29:01.802 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T15:29:01.915 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T15:29:01.972 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 54/122 2023-10-09T15:29:02.078 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-09T15:29:02.201 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : socat-1.7.3.3-2.el8.x86_64 55/122 2023-10-09T15:29:02.282 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-09T15:29:02.387 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T15:29:02.479 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: oniguruma-6.8.2-2.el8.x86_64 56/122 2023-10-09T15:29:02.481 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T15:29:02.655 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T15:29:02.680 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : jq-1.5-12.el8.x86_64 57/122 2023-10-09T15:29:02.857 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 58/122 2023-10-09T15:29:02.957 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T15:29:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 59/122 2023-10-09T15:29:03.205 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T15:29:03.230 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 60/122 2023-10-09T15:29:03.453 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T15:29:03.525 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 61/122 2023-10-09T15:29:03.648 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T15:29:03.772 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 62/122 2023-10-09T15:29:03.816 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T15:29:03.962 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 63/122 2023-10-09T15:29:04.052 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T15:29:04.117 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 64/122 2023-10-09T15:29:04.301 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 65/122 2023-10-09T15:29:04.304 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T15:29:04.496 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 66/122 2023-10-09T15:29:04.561 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T15:29:04.738 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 67/122 2023-10-09T15:29:04.832 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T15:29:04.938 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-natsort-7.1.1-2.el8.noarch 68/122 2023-10-09T15:29:05.026 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T15:29:05.149 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 69/122 2023-10-09T15:29:05.302 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T15:29:05.303 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 70/122 2023-10-09T15:29:05.534 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T15:29:05.553 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 71/122 2023-10-09T15:29:05.775 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T15:29:05.793 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 72/122 2023-10-09T15:29:06.061 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 73/122 2023-10-09T15:29:06.074 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T15:29:06.361 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T15:29:06.380 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-portend-2.6-1.el8.noarch 74/122 2023-10-09T15:29:06.639 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T15:29:06.644 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 75/122 2023-10-09T15:29:06.824 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 76/122 2023-10-09T15:29:06.929 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T15:29:07.101 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 77/122 2023-10-09T15:29:08.201 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T15:29:08.292 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 78/122 2023-10-09T15:29:08.536 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T15:29:08.586 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 79/122 2023-10-09T15:29:08.730 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T15:29:08.813 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 80/122 2023-10-09T15:29:09.090 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T15:29:09.172 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 81/122 2023-10-09T15:29:09.346 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T15:29:09.458 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 82/122 2023-10-09T15:29:09.710 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T15:29:09.758 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 83/122 2023-10-09T15:29:10.000 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T15:29:10.014 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : python3-asyncssh-2.7.0-2.el8.noarch 84/122 2023-10-09T15:29:10.195 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T15:29:10.205 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 85/122 2023-10-09T15:29:10.393 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T15:29:10.419 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 86/122 2023-10-09T15:29:15.870 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:15.919 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:16.167 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:16.400 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:16.795 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:17.018 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 87/122 2023-10-09T15:29:17.094 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T15:29:17.187 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T15:29:17.314 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T15:29:17.350 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T15:29:17.392 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 88/122 2023-10-09T15:29:17.535 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T15:29:35.610 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T15:29:35.610 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /sys 2023-10-09T15:29:35.610 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /proc 2023-10-09T15:29:35.610 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /run 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /mnt 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /var/tmp 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /home 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /tmp 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout:skipping the directory /dev 2023-10-09T15:29:35.611 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:29:35.911 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 89/122 2023-10-09T15:29:35.911 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /sys 2023-10-09T15:29:35.911 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /proc 2023-10-09T15:29:35.911 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /run 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /mnt 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /var/tmp 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /home 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /tmp 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout:skipping the directory /dev 2023-10-09T15:29:35.912 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:29:36.023 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T15:29:36.306 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T15:29:37.598 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T15:29:37.799 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T15:29:37.892 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 90/122 2023-10-09T15:29:38.027 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T15:29:38.044 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T15:29:38.248 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T15:29:38.260 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 91/122 2023-10-09T15:29:38.414 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T15:29:38.663 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T15:29:38.826 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 92/122 2023-10-09T15:29:38.847 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T15:29:38.865 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T15:29:38.989 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T15:29:39.007 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 93/122 2023-10-09T15:29:42.013 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T15:29:42.014 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T15:29:42.161 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T15:29:42.171 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 94/122 2023-10-09T15:29:42.370 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T15:29:42.379 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 95/122 2023-10-09T15:29:42.534 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T15:29:42.609 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 96/122 2023-10-09T15:29:42.747 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T15:29:42.905 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T15:29:42.974 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T15:29:43.136 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 97/122 2023-10-09T15:29:43.190 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T15:29:43.376 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T15:29:44.223 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T15:29:44.421 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 98/122 2023-10-09T15:29:44.438 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T15:29:44.541 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T15:29:44.605 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T15:29:44.710 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 99/122 2023-10-09T15:29:44.955 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T15:29:45.165 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T15:29:45.199 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 100/122 2023-10-09T15:29:45.204 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T15:29:45.343 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T15:29:45.380 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 101/122 2023-10-09T15:29:45.396 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T15:29:45.408 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T15:29:45.563 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T15:29:45.574 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 102/122 2023-10-09T15:29:47.132 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T15:29:47.275 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 103/122 2023-10-09T15:29:47.373 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T15:29:47.465 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T15:29:47.518 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T15:29:47.604 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 104/122 2023-10-09T15:29:47.638 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T15:29:47.683 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T15:29:47.863 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T15:29:47.880 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T15:29:47.907 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.6-1320.g08cac 105/122 2023-10-09T15:29:48.080 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T15:29:48.249 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T15:29:48.446 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 106/122 2023-10-09T15:29:48.454 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T15:29:48.596 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T15:29:53.697 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T15:29:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 107/122 2023-10-09T15:29:54.032 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T15:29:54.183 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 108/122 2023-10-09T15:29:54.220 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T15:29:54.370 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T15:29:54.987 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T15:29:55.127 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: libtool-2.4.6-25.el8.x86_64 109/122 2023-10-09T15:29:55.376 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-09T15:29:55.467 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : openssl-devel-1:1.1.1g-15.el8_3.x86_64 110/122 2023-10-09T15:29:55.598 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-09T15:29:55.719 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 111/122 2023-10-09T15:29:55.757 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-09T15:29:55.865 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : xfsprogs-devel-5.0.0-8.el8.x86_64 112/122 2023-10-09T15:29:55.968 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T15:29:56.050 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 113/122 2023-10-09T15:29:56.142 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T15:29:56.200 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : elfutils-libelf-devel-0.182-3.el8.x86_64 114/122 2023-10-09T15:29:56.271 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T15:29:56.379 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 115/122 2023-10-09T15:29:56.479 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T15:29:56.538 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 116/122 2023-10-09T15:29:56.646 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T15:29:56.672 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 117/122 2023-10-09T15:29:56.899 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-09T15:29:56.928 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : libaio-devel-0.3.112-1.el8.x86_64 118/122 2023-10-09T15:29:57.102 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T15:29:57.111 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T15:29:57.172 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T15:29:57.172 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: bison-3.0.4-10.el8.x86_64 119/122 2023-10-09T15:29:57.345 INFO:teuthology.orchestra.run.smithi033.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T15:29:57.355 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T15:29:57.355 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T15:29:57.386 INFO:teuthology.orchestra.run.smithi059.stdout: Installing : flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T15:29:57.397 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: flex-2.6.1-9.el8.x86_64 120/122 2023-10-09T15:29:57.397 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T15:29:57.548 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T15:29:57.548 INFO:teuthology.orchestra.run.smithi033.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:29:57.640 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 121/122 2023-10-09T15:29:57.640 INFO:teuthology.orchestra.run.smithi059.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:29:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:29:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T15:29:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T15:29:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T15:29:58.434 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T15:29:58.435 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T15:29:58.436 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T15:29:58.437 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T15:29:58.438 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T15:29:58.439 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-09T15:29:58.440 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-09T15:29:58.441 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-09T15:29:58.442 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-09T15:29:58.443 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-09T15:29:58.444 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-09T15:29:58.444 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-09T15:29:58.444 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T15:29:58.444 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T15:29:58.444 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-2:17.2.6-1320.g08cac018.el8.x86_64 1/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 3/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 4/122 2023-10-09T15:29:58.613 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-immutable-object-cache-2:17.2.6-1320.g08cac 5/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 6/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 7/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 8/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 9/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 10/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 11/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 12/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 13/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_ 14/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 15/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 16/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados-devel-2:17.2.6-1320.g08cac018.el8.x86_6 17/122 2023-10-09T15:29:58.614 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86 18/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 19/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-argparse-2:17.2.6-1320.g08cac018.el 20/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-ceph-common-2:17.2.6-1320.g08cac018.el8. 21/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_6 22/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 23/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 24/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 25/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 26/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 27/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 28/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-grafana-dashboards-2:17.2.6-1320.g08cac018. 29/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noa 30/122 2023-10-09T15:29:58.615 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.n 31/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-diskprediction-local-2:17.2.6-1320.g08c 32/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el 33/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 34/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.e 35/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 36/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephadm-2:17.2.6-1320.g08cac018.el8.noarch 37/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 38/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 39/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 40/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 41/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-asyncssh-2.7.0-2.el8.noarch 42/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 43/122 2023-10-09T15:29:58.616 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 44/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 45/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 46/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 47/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 48/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 49/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 50/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 51/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 52/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 53/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 54/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-natsort-7.1.1-2.el8.noarch 55/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 56/122 2023-10-09T15:29:58.617 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-portend-2.6-1.el8.noarch 57/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 58/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 59/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 60/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 61/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 62/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 63/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 64/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 65/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 66/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 67/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 68/122 2023-10-09T15:29:58.618 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 69/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 70/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 71/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb62 72/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 73/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 74/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : jq-1.5-12.el8.x86_64 75/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : flex-2.6.1-9.el8.x86_64 76/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 77/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-babel-2.5.1-5.el8.noarch 78/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 79/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : bison-3.0.4-10.el8.x86_64 80/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 81/122 2023-10-09T15:29:58.619 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-f2py-1:1.14.3-9.el8.x86_64 82/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 83/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-numpy-1:1.14.3-9.el8.x86_64 84/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : oniguruma-6.8.2-2.el8.x86_64 85/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jinja2-2.10.1-2.el8_0.noarch 86/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : socat-1.7.3.3-2.el8.x86_64 87/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-mako-1.0.6-13.el8.noarch 88/122 2023-10-09T15:29:58.620 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 89/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librdkafka-0.11.4-1.el8.x86_64 90/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 91/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libtool-2.4.6-25.el8.x86_64 92/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-pytz-2017.2-9.el8.noarch 93/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-threads-0.3.12-1.el8.x86_64 94/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openblas-0.3.12-1.el8.x86_64 95/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : automake-1.16.1-7.el8.noarch 96/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libaio-devel-0.3.112-1.el8.x86_64 97/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 98/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 99/122 2023-10-09T15:29:58.623 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf32-10.32-2.el8.x86_64 100/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : keyutils-libs-devel-1.5.10-6.el8.x86_64 101/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-utf16-10.32-2.el8.x86_64 102/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 103/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : openssl-devel-1:1.1.1g-15.el8_3.x86_64 104/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libverto-devel-0.3.0-5.el8.x86_64 105/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : pcre2-devel-10.32-2.el8.x86_64 106/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : fuse-2.9.7-12.el8.x86_64 107/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : elfutils-libelf-devel-0.182-3.el8.x86_64 108/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libquadmath-8.4.1-1.el8.x86_64 109/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libcom_err-devel-1.45.6-1.el8.x86_64 110/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libsepol-devel-2.9-2.el8.x86_64 111/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : zlib-devel-1.2.11-17.el8.x86_64 112/122 2023-10-09T15:29:58.624 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librabbitmq-0.9.0-3.el8.x86_64 113/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : krb5-devel-1.18.2-8.3.el8_4.x86_64 114/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libgfortran-8.4.1-1.el8.x86_64 115/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : xfsprogs-devel-5.0.0-8.el8.x86_64 116/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libselinux-devel-2.9-5.el8.x86_64 117/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : libuuid-devel-2.32.1-27.el8.x86_64 118/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-2:17.2.6-1320.g08cac018.el8.x86_64 119/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 120/122 2023-10-09T15:29:58.625 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 121/122 2023-10-09T15:30:00.694 INFO:teuthology.orchestra.run.smithi033.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:30:00.694 INFO:teuthology.orchestra.run.smithi033.stdout:Last metadata expiration check: 0:01:55 ago on Mon 09 Oct 2023 03:28:05 PM UTC. 2023-10-09T15:30:01.008 INFO:teuthology.orchestra.run.smithi059.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 122/122 2023-10-09T15:30:01.008 INFO:teuthology.orchestra.run.smithi059.stdout:Last metadata expiration check: 0:01:56 ago on Mon 09 Oct 2023 03:28:05 PM UTC. 2023-10-09T15:30:02.892 INFO:teuthology.orchestra.run.smithi033.stdout:Installed products updated. 2023-10-09T15:30:03.049 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:03.049 INFO:teuthology.orchestra.run.smithi033.stdout:Upgraded: 2023-10-09T15:30:03.049 INFO:teuthology.orchestra.run.smithi033.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout:Installed: 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.050 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.051 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: jq-1.5-12.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T15:30:03.052 INFO:teuthology.orchestra.run.smithi033.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.053 INFO:teuthology.orchestra.run.smithi033.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T15:30:03.054 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T15:30:03.055 INFO:teuthology.orchestra.run.smithi033.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T15:30:03.056 INFO:teuthology.orchestra.run.smithi033.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.057 INFO:teuthology.orchestra.run.smithi033.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T15:30:03.058 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T15:30:03.059 INFO:teuthology.orchestra.run.smithi033.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T15:30:03.060 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:03.060 INFO:teuthology.orchestra.run.smithi033.stdout:Complete! 2023-10-09T15:30:03.367 INFO:teuthology.orchestra.run.smithi059.stdout:Installed products updated. 2023-10-09T15:30:03.375 DEBUG:teuthology.parallel:result is None 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout:Upgraded: 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: librados2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: librbd1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout:Installed: 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: automake-1.16.1-7.el8.noarch 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: bison-3.0.4-10.el8.x86_64 2023-10-09T15:30:03.524 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-base-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-grafana-dashboards-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-immutable-object-cache-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mds-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-dashboard-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-diskprediction-local-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-modules-core-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mgr-rook-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.525 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-mon-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-osd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-prometheus-alerts-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-radosgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-selinux-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-test-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: ceph-volume-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: cephadm-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: cephfs-top-2:17.2.6-1320.g08cac018.el8.noarch 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: elfutils-libelf-devel-0.182-3.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: flex-2.6.1-9.el8.x86_64 2023-10-09T15:30:03.526 INFO:teuthology.orchestra.run.smithi059.stdout: fuse-2.9.7-12.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: jq-1.5-12.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: keyutils-libs-devel-1.5.10-6.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: krb5-devel-1.18.2-8.3.el8_4.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libaio-devel-0.3.112-1.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libcephfs2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libcephsqlite-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libcom_err-devel-1.45.6-1.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libgfortran-8.4.1-1.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: liboath-2.6.2-3.el8.x86_64 2023-10-09T15:30:03.527 INFO:teuthology.orchestra.run.smithi059.stdout: libquadmath-8.4.1-1.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: librabbitmq-0.9.0-3.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: librados-devel-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libradosstriper1-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: librdkafka-0.11.4-1.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: librgw2-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libselinux-devel-2.9-5.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libsepol-devel-2.9-2.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libtool-2.4.6-25.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libunwind-1.3.1-3.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libuuid-devel-2.32.1-27.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: libverto-devel-0.3.0-5.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: lttng-ust-2.8.1-11.el8.x86_64 2023-10-09T15:30:03.528 INFO:teuthology.orchestra.run.smithi059.stdout: oniguruma-6.8.2-2.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-0.3.12-1.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: openblas-threads-0.3.12-1.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: openssl-devel-1:1.1.1g-15.el8_3.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-devel-10.32-2.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf16-10.32-2.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: pcre2-utf32-10.32-2.el8.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: python3-asyncssh-2.7.0-2.el8.noarch 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: python3-babel-2.5.1-5.el8.noarch 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2023-10-09T15:30:03.529 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cachetools-3.1.1-4.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-argparse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-ceph-common-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cephfs-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-certifi-2018.10.15-7.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cheroot-8.5.2-1.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-6.2-6.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jinja2-2.10.1-2.el8_0.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpatch-1.21-2.el8.noarch 2023-10-09T15:30:03.530 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jsonpointer-1.10-11.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-jwt-1.6.1-2.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-logutils-0.3.5-11.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-mako-1.0.6-13.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-markupsafe-0.23-19.el8.x86_64 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-natsort-7.1.1-2.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-1:1.14.3-9.el8.x86_64 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-numpy-f2py-1:1.14.3-9.el8.x86_64 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pecan-1.3.2-9.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-portend-2.6-1.el8.noarch 2023-10-09T15:30:03.531 INFO:teuthology.orchestra.run.smithi059.stdout: python3-prettytable-0.7.2-14.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-pytz-2017.2-9.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rados-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-repoze-lru-0.7-6.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rgw-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-routes-2.4.1-12.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-rsa-4.9-2.el8.noarch 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d7.x86_64 2023-10-09T15:30:03.532 INFO:teuthology.orchestra.run.smithi059.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-tempora-1.14.1-5.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-trustme-0.6.0-4.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-waitress-1.4.3-1.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webob-1.8.5-1.el8.1.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-webtest-2.0.33-1.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-fuse-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-mirror-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.533 INFO:teuthology.orchestra.run.smithi059.stdout: rbd-nbd-2:17.2.6-1320.g08cac018.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: socat-1.7.3.3-2.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: thrift-0.13.0-2.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: xfsprogs-devel-5.0.0-8.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: zlib-devel-1.2.11-17.el8.x86_64 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:03.534 INFO:teuthology.orchestra.run.smithi059.stdout:Complete! 2023-10-09T15:30:03.829 DEBUG:teuthology.parallel:result is None 2023-10-09T15:30:03.830 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T15:30:03.970 DEBUG:teuthology.orchestra.run.smithi033:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T15:30:03.993 INFO:teuthology.orchestra.run.smithi033.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T15:30:03.993 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T15:30:03.993 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T15:30:03.994 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&sha1=08cac0187919fc3a247efdf445f652e2fb30a647 2023-10-09T15:30:04.210 DEBUG:teuthology.orchestra.run.smithi059:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-10-09T15:30:04.233 INFO:teuthology.orchestra.run.smithi059.stdout:17.2.6-1320.g08cac018.el8 2023-10-09T15:30:04.233 INFO:teuthology.packaging:The installed version of ceph is 17.2.6-1320.g08cac018.el8 2023-10-09T15:30:04.233 INFO:teuthology.task.install:The correct ceph version 17.2.6-1320.g08cac018 is installed. 2023-10-09T15:30:04.233 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-10-09T15:30:04.234 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:04.234 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T15:30:04.277 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:04.278 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-10-09T15:30:04.318 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-10-09T15:30:04.318 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:04.318 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T15:30:04.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T15:30:04.414 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:04.414 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/daemon-helper 2023-10-09T15:30:04.439 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-10-09T15:30:04.505 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-10-09T15:30:04.505 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:04.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T15:30:04.532 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T15:30:04.599 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:04.599 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/adjust-ulimits 2023-10-09T15:30:04.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-10-09T15:30:04.688 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-10-09T15:30:04.689 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:04.689 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T15:30:04.715 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T15:30:04.782 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:04.782 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/usr/bin/stdin-killer 2023-10-09T15:30:04.807 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-10-09T15:30:04.871 INFO:teuthology.run_tasks:Running task ceph... 2023-10-09T15:30:04.937 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-10-09T15:30:04.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 777 /var/log/ceph 2023-10-09T15:30:04.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 777 /var/log/ceph 2023-10-09T15:30:04.964 INFO:tasks.ceph:Disabling ceph logrotate... 2023-10-09T15:30:04.964 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T15:30:05.006 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/logrotate.d/ceph 2023-10-09T15:30:05.030 INFO:tasks.ceph:Creating extra log directories... 2023-10-09T15:30:05.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T15:30:05.072 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-10-09T15:30:05.106 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-10-09T15:30:05.106 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-10-09T15:30:05.106 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-10-09T15:30:05.107 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:05.107 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T15:30:05.154 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:05.268 DEBUG:teuthology.orchestra.run.smithi033:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:05.293 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:05.293 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-10-09T15:30:05.308 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:05.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:05.450 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-10-09T15:30:05.451 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-10-09T15:30:05.451 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469', 'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'description': 'fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7418469', 'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'rhel', 'os_version': '8.4', 'overrides': {'admin_socket': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy'}, 'ceph': {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'kclient': {'syntax': 'v1'}, 'selinux': {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 3972, 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'sleep_before_teardown': 0, 'subset': '819/1024', 'suite': 'fs', 'suite_branch': 'wip-yuri-testing-2023-10-06-0949-quincy', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'targets': {'smithi033.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8Cd69H7fO59C6291Fi5/uUVmocaao6IhQtTEvcF8JmC7Fabc4duFOQe0AZeQwLthyVs+w5SISN7WfTT742QOI=', 'smithi059.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD/gDT8Hk4uMQYpOVyMlMDMbG2vsnKuxqFGNcqxbQ3WXPkV8e9j4RhIqIXkz1VP3SGwAzY+QmmeNeDBOue5qjEc='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'client': {'sha1': 'distro'}, 'flavor': 'default', 'kdb': True, 'sha1': 'fef64f93da2bbe59bfa57cc5e0530b4dcd2f9c7c'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel']}, 'flavor': 'default', 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647'}}, {'ceph': {'create_rbd_pool': False, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '08cac0187919fc3a247efdf445f652e2fb30a647', 'cluster': 'ceph'}}, {'kclient': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestVolumes', 'tasks.cephfs.test_volumes.TestSubvolumeGroups', 'tasks.cephfs.test_volumes.TestSubvolumes']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ["local function is_kupstream() return yaml.ktype == 'upstream' end", "local function is_kdistro() return yaml.ktype == 'distro' end", 'local function is_fuse() return false end', 'local function syntax_version() return yaml.overrides.kclient.syntax end']}, 'teuthology_branch': 'main', 'teuthology_sha1': '54e62bcbac4e53d9685e08328b790d3b20d71cae', 'timestamp': '2023-10-09_15:09:03', 'tube': 'smithi', 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2830'} 2023-10-09T15:30:05.452 DEBUG:teuthology.orchestra.run.smithi033:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T15:30:05.454 DEBUG:teuthology.orchestra.run.smithi059:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-10-09T15:30:05.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T15:30:05.508 DEBUG:teuthology.orchestra.run.smithi059:> sudo install -d -m0777 -- /var/run/ceph 2023-10-09T15:30:05.566 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:05.566 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T15:30:05.586 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T15:30:05.587 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_1 2023-10-09T15:30:05.641 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T15:30:05.641 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:05.641 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 215711 Links: 1 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-09 15:29:58.001147339 +0000 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-09 15:27:02.997201628 +0000 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-09 15:27:02.997201628 +0000 2023-10-09T15:30:05.642 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-09T15:30:05.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T15:30:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-09T15:30:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-09T15:30:05.705 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000220475 s, 2.3 MB/s 2023-10-09T15:30:05.706 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T15:30:05.763 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_2 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 223353 Links: 1 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-09 15:29:58.001147339 +0000 2023-10-09T15:30:05.818 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-09 15:27:03.513193226 +0000 2023-10-09T15:30:05.819 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-09 15:27:03.513193226 +0000 2023-10-09T15:30:05.819 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-09T15:30:05.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T15:30:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-09T15:30:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-09T15:30:05.882 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000221811 s, 2.3 MB/s 2023-10-09T15:30:05.883 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T15:30:05.939 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_3 2023-10-09T15:30:05.994 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 222503 Links: 1 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-09 15:29:58.001147339 +0000 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-09 15:27:03.987185508 +0000 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-09 15:27:03.987185508 +0000 2023-10-09T15:30:05.995 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-09T15:30:05.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T15:30:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-09T15:30:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-09T15:30:06.058 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.00023649 s, 2.2 MB/s 2023-10-09T15:30:06.059 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T15:30:06.115 DEBUG:teuthology.orchestra.run.smithi033:> stat /dev/vg_nvme/lv_4 2023-10-09T15:30:06.170 INFO:teuthology.orchestra.run.smithi033.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T15:30:06.170 INFO:teuthology.orchestra.run.smithi033.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Device: 6h/6d Inode: 219985 Links: 1 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Access: 2023-10-09 15:29:58.001147339 +0000 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Modify: 2023-10-09 15:27:04.498177187 +0000 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout:Change: 2023-10-09 15:27:04.498177187 +0000 2023-10-09T15:30:06.171 INFO:teuthology.orchestra.run.smithi033.stdout: Birth: - 2023-10-09T15:30:06.171 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T15:30:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records in 2023-10-09T15:30:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:1+0 records out 2023-10-09T15:30:06.234 INFO:teuthology.orchestra.run.smithi033.stderr:512 bytes copied, 0.000202505 s, 2.5 MB/s 2023-10-09T15:30:06.235 DEBUG:teuthology.orchestra.run.smithi033:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T15:30:06.291 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:06.292 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:06.292 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/scratch_devs of=/dev/stdout 2023-10-09T15:30:06.308 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-10-09T15:30:06.308 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_1 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 220670 Links: 1 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-09 15:29:58.148541813 +0000 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-09 15:27:00.974240315 +0000 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-09 15:27:00.974240315 +0000 2023-10-09T15:30:06.364 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-09T15:30:06.365 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-10-09T15:30:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-09T15:30:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-09T15:30:06.429 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000246854 s, 2.1 MB/s 2023-10-09T15:30:06.430 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-10-09T15:30:06.487 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_2 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 221477 Links: 1 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-09 15:29:58.148541813 +0000 2023-10-09T15:30:06.544 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-09 15:27:01.475234130 +0000 2023-10-09T15:30:06.545 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-09 15:27:01.475234130 +0000 2023-10-09T15:30:06.545 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-09T15:30:06.545 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-10-09T15:30:06.608 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-09T15:30:06.608 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-09T15:30:06.608 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000247909 s, 2.1 MB/s 2023-10-09T15:30:06.609 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-10-09T15:30:06.665 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_3 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 220846 Links: 1 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:06.721 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-09 15:29:58.149541801 +0000 2023-10-09T15:30:06.722 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-09 15:27:01.983227860 +0000 2023-10-09T15:30:06.722 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-09 15:27:01.983227860 +0000 2023-10-09T15:30:06.722 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-09T15:30:06.722 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-10-09T15:30:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-09T15:30:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-09T15:30:06.785 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000222287 s, 2.3 MB/s 2023-10-09T15:30:06.786 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-10-09T15:30:06.842 DEBUG:teuthology.orchestra.run.smithi059:> stat /dev/vg_nvme/lv_4 2023-10-09T15:30:06.897 INFO:teuthology.orchestra.run.smithi059.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-10-09T15:30:06.897 INFO:teuthology.orchestra.run.smithi059.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Device: 6h/6d Inode: 221002 Links: 1 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Context: system_u:object_r:device_t:s0 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Access: 2023-10-09 15:29:58.149541801 +0000 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Modify: 2023-10-09 15:27:02.500221479 +0000 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout:Change: 2023-10-09 15:27:02.500221479 +0000 2023-10-09T15:30:06.898 INFO:teuthology.orchestra.run.smithi059.stdout: Birth: - 2023-10-09T15:30:06.898 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-10-09T15:30:06.960 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records in 2023-10-09T15:30:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:1+0 records out 2023-10-09T15:30:06.961 INFO:teuthology.orchestra.run.smithi059.stderr:512 bytes copied, 0.000193588 s, 2.6 MB/s 2023-10-09T15:30:06.962 DEBUG:teuthology.orchestra.run.smithi059:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-10-09T15:30:07.017 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:07.017 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T15:30:07.017 INFO:tasks.ceph:Generating config... 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] client mount timeout = 600 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] debug client = 20 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] debug ms = 1 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] pid file = 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-10-09T15:30:07.019 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-10-09T15:30:07.019 INFO:tasks.ceph:[global] ms die on skipped message = False 2023-10-09T15:30:07.019 INFO:tasks.ceph:[mds] debug mds = 20 2023-10-09T15:30:07.019 INFO:tasks.ceph:[mds] debug ms = 1 2023-10-09T15:30:07.019 INFO:tasks.ceph:[mds] mds debug frag = True 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mgr] debug client = 20 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mgr] debug finisher = 20 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mgr] debug ms = 1 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mon] debug mon = 20 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mon] debug ms = 1 2023-10-09T15:30:07.020 INFO:tasks.ceph:[mon] debug paxos = 20 2023-10-09T15:30:07.021 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] bdev async discard = True 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] bdev enable discard = True 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] debug ms = 1 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] debug osd = 20 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-10-09T15:30:07.021 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-10-09T15:30:07.022 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-10-09T15:30:07.022 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2023-10-09T15:30:07.022 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2023-10-09T15:30:07.022 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-10-09T15:30:07.022 INFO:tasks.ceph:Setting up mon.a... 2023-10-09T15:30:07.022 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-10-09T15:30:07.068 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.keyring 2023-10-09T15:30:07.071 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-10-09T15:30:07.114 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T15:30:07.180 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.33'), ('mon.b', '172.21.15.59'), ('mon.c', '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]')] 2023-10-09T15:30:07.181 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.33,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]', 'ms die on skipped message': False}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'mds': {'debug mds': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-10-09T15:30:07.182 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:07.182 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T15:30:07.235 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.33 --add b 172.21.15.59 --addv c '[v2:172.21.15.59:3301,v1:172.21.15.59:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:07.320 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:07.320 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: generated fsid 38c7cb5d-ab66-41cb-ab30-25e3d813cdd1 2023-10-09T15:30:07.320 INFO:teuthology.orchestra.run.smithi033.stdout:setting min_mon_release = octopus 2023-10-09T15:30:07.320 INFO:teuthology.orchestra.run.smithi033.stdout:epoch 0 2023-10-09T15:30:07.320 INFO:teuthology.orchestra.run.smithi033.stdout:fsid 38c7cb5d-ab66-41cb-ab30-25e3d813cdd1 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:last_changed 2023-10-09T15:30:07.321049+0000 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:created 2023-10-09T15:30:07.321049+0000 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:min_mon_release 15 (octopus) 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:election_strategy: 1 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:0: [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] mon.a 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:1: [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] mon.b 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:2: [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] mon.c 2023-10-09T15:30:07.321 INFO:teuthology.orchestra.run.smithi033.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-10-09T15:30:07.322 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-10-09T15:30:07.337 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 38c7cb5d-ab66-41cb-ab30-25e3d813cdd1... 2023-10-09T15:30:07.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T15:30:07.380 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-10-09T15:30:07.421 INFO:teuthology.orchestra.run.smithi033.stdout:[global] 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: chdir = "" 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: auth supported = cephx 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: filestore xattr use omap = true 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: mon clock drift allowed = 1.000 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: osd crush chooseleaf type = 0 2023-10-09T15:30:07.422 INFO:teuthology.orchestra.run.smithi033.stdout: auth debug = true 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on old message = true 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on bug = true 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: mon pg warn max object skew = 0 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default size = 2 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.423 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow primary affinity = true 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd allow pg remap = true 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on legacy crush tunables = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on crush straw calc version zero = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on no sortbitwise = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on osd down out interval zero = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon warn on too few osds = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: mon_allow_pool_size_one = true 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.424 INFO:teuthology.orchestra.run.smithi033.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: osd default data pool replay window = 5 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: mon allow pool delete = true 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: mon cluster log file level = debug 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: debug asserts on shutdown = true 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: mon health detail to clog = false 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: mon host = "172.21.15.33,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: ms die on skipped message = False 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: fsid = 38c7cb5d-ab66-41cb-ab30-25e3d813cdd1 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.425 INFO:teuthology.orchestra.run.smithi033.stdout:[osd] 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd journal size = 100 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub load threshold = 5.0 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd scrub max interval = 600 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd mclock profile = high_recovery_ops 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd recover clone overlap = true 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd recovery max chunk = 1048576 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug shutdown = true 2023-10-09T15:30:07.426 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug op order = true 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug verify stray on activate = true 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: osd open classes on start = true 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug pg log writeout = true 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: osd deep scrub update digest min age = 30 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: osd map max advance = 10 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: journal zero on create = true 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: filestore ondisk finisher threads = 3 2023-10-09T15:30:07.427 INFO:teuthology.orchestra.run.smithi033.stdout: filestore apply finisher threads = 3 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bdev debug aio = true 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: osd debug misdirected ops = true 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bdev async discard = True 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bdev enable discard = True 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore allocator = bitmap 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore block size = 96636764160 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: bluestore fsck on mount = True 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluefs = 1/20 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: debug bluestore = 1/20 2023-10-09T15:30:07.428 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: debug osd = 20 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: debug rocksdb = 4/10 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd full ratio = 0.9 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd nearfull ratio = 0.8 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: osd failsafe full ratio = 0.95 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: osd objectstore = bluestore 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr] 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: debug mgr = 20 2023-10-09T15:30:07.429 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: mgr/telemetry/nag = false 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug finisher = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout:[mon] 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug mon = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug paxos = 20 2023-10-09T15:30:07.430 INFO:teuthology.orchestra.run.smithi033.stdout: debug auth = 20 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon data avail warn = 5 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon mgr mkfs grace = 240 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min pgs per osd = 4 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd reporter subtree level = osd 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon osd prime pg temp = true 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: mon reweight min bytes per osd = 10 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.431 INFO:teuthology.orchestra.run.smithi033.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: # 1m isn't quite enough 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: mon_down_mkfs_grace = 2m 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: mon_warn_on_filestore_osds = false 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: mon op complaint time = 120 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout:[client] 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: rgw cache enabled = true 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable ops log = true 2023-10-09T15:30:07.432 INFO:teuthology.orchestra.run.smithi033.stdout: rgw enable usage log = true 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: client mount timeout = 600 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: debug client = 20 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: pid file = "" 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.a] 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.b] 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mon.c] 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2023-10-09T15:30:07.433 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout:[mds] 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: debug mds = 20 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: debug ms = 1 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug frag = True 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: mds debug scatterstat = True 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: mds op complaint time = 180 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: mds verify scatter = True 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: osd op complaint time = 180 2023-10-09T15:30:07.434 INFO:teuthology.orchestra.run.smithi033.stdout: rados mon op timeout = 900 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi033.stdout: rados osd op timeout = 900 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout:[global] 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout: chdir = "" 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout: auth supported = cephx 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.435 INFO:teuthology.orchestra.run.smithi059.stdout: filestore xattr use omap = true 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: mon clock drift allowed = 1.000 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: osd crush chooseleaf type = 0 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: auth debug = true 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on old message = true 2023-10-09T15:30:07.436 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on bug = true 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: mon max pg per osd = 10000 # >= luminous 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: mon pg warn max object skew = 0 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: # disable pg_autoscaler by default for new pools 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: osd_pool_default_pg_autoscale_mode = off 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default size = 2 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow primary affinity = true 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd allow pg remap = true 2023-10-09T15:30:07.437 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on legacy crush tunables = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on crush straw calc version zero = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on no sortbitwise = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on osd down out interval zero = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon warn on too few osds = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_pool_no_redundancy = false 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: mon_allow_pool_size_one = true 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: osd default data pool replay window = 5 2023-10-09T15:30:07.438 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: mon allow pool delete = true 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: mon cluster log file level = debug 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: debug asserts on shutdown = true 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: mon health detail to clog = false 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: mon host = "172.21.15.33,172.21.15.59,[v2:172.21.15.59:3301,v1:172.21.15.59:6790]" 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: ms die on skipped message = False 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: fsid = 38c7cb5d-ab66-41cb-ab30-25e3d813cdd1 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout:[osd] 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: osd journal size = 100 2023-10-09T15:30:07.439 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub load threshold = 5.0 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd scrub max interval = 600 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd mclock profile = high_recovery_ops 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd recover clone overlap = true 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd recovery max chunk = 1048576 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug shutdown = true 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug op order = true 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug verify stray on activate = true 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.440 INFO:teuthology.orchestra.run.smithi059.stdout: osd open classes on start = true 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug pg log writeout = true 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: osd deep scrub update digest min age = 30 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: osd map max advance = 10 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: journal zero on create = true 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: filestore ondisk finisher threads = 3 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: filestore apply finisher threads = 3 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.441 INFO:teuthology.orchestra.run.smithi059.stdout: bdev debug aio = true 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: osd debug misdirected ops = true 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: bdev async discard = True 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: bdev enable discard = True 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore allocator = bitmap 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore block size = 96636764160 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: bluestore fsck on mount = True 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluefs = 1/20 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: debug bluestore = 1/20 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: debug osd = 20 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: debug rocksdb = 4/10 2023-10-09T15:30:07.442 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd backfillfull_ratio = 0.85 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd full ratio = 0.9 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd nearfull ratio = 0.8 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: osd failsafe full ratio = 0.95 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: osd objectstore = bluestore 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr] 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: debug mgr = 20 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-09T15:30:07.443 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: mgr/telemetry/nag = false 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug finisher = 20 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout:[mon] 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug mon = 20 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug paxos = 20 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: debug auth = 20 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: mon data avail warn = 5 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: mon mgr mkfs grace = 240 2023-10-09T15:30:07.444 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min pgs per osd = 4 2023-10-09T15:30:07.445 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd reporter subtree level = osd 2023-10-09T15:30:07.445 INFO:teuthology.orchestra.run.smithi059.stdout: mon osd prime pg temp = true 2023-10-09T15:30:07.445 INFO:teuthology.orchestra.run.smithi059.stdout: mon reweight min bytes per osd = 10 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: auth mon ticket ttl = 660 # 11m 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: auth service ticket ttl = 240 # 4m 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: # don't complain about insecure global_id in the test suite 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-10-09T15:30:07.446 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: # 1m isn't quite enough 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: mon_down_mkfs_grace = 2m 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: mon_warn_on_filestore_osds = false 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: mon op complaint time = 120 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout:[client] 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: rgw cache enabled = true 2023-10-09T15:30:07.447 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable ops log = true 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: rgw enable usage log = true 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: client mount timeout = 600 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: debug client = 20 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: pid file = "" 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-09T15:30:07.448 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.a] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.b] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mon.c] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout:[mds] 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout: debug mds = 20 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout: debug ms = 1 2023-10-09T15:30:07.449 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug frag = True 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: mds debug scatterstat = True 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: mds op complaint time = 180 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: mds verify scatter = True 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: osd op complaint time = 180 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: rados mon op timeout = 900 2023-10-09T15:30:07.450 INFO:teuthology.orchestra.run.smithi059.stdout: rados osd op timeout = 900 2023-10-09T15:30:07.451 INFO:tasks.ceph:Creating admin key on mon.a... 2023-10-09T15:30:07.452 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-10-09T15:30:07.545 INFO:tasks.ceph:Copying monmap to all nodes... 2023-10-09T15:30:07.545 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:07.545 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-10-09T15:30:07.560 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:07.560 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-10-09T15:30:07.615 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:30:07.615 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:07.616 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T15:30:07.616 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T15:30:07.691 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:07.691 DEBUG:teuthology.orchestra.run.smithi033:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:07.746 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:30:07.747 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:07.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd of=/etc/ceph/ceph.keyring 2023-10-09T15:30:07.747 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-10-09T15:30:07.782 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:07.782 DEBUG:teuthology.orchestra.run.smithi059:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:07.837 INFO:tasks.ceph:Setting up mon nodes... 2023-10-09T15:30:07.837 INFO:tasks.ceph:Setting up mgr nodes... 2023-10-09T15:30:07.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T15:30:07.886 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-10-09T15:30:07.889 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T15:30:07.975 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-10-09T15:30:07.978 INFO:tasks.ceph:Setting up mds nodes... 2023-10-09T15:30:07.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T15:30:08.029 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-10-09T15:30:08.031 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-10-09T15:30:08.056 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T15:30:08.145 INFO:teuthology.orchestra.run.smithi033.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-10-09T15:30:08.148 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-10-09T15:30:08.173 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T15:30:08.222 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-10-09T15:30:08.225 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-10-09T15:30:08.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T15:30:08.339 INFO:teuthology.orchestra.run.smithi059.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-10-09T15:30:08.342 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-10-09T15:30:08.366 INFO:tasks.ceph_client:Setting up client nodes... 2023-10-09T15:30:08.367 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-10-09T15:30:08.405 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-10-09T15:30:08.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-10-09T15:30:08.497 INFO:teuthology.orchestra.run.smithi033.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-10-09T15:30:08.510 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-10-09T15:30:08.549 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-10-09T15:30:08.562 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-10-09T15:30:08.640 INFO:teuthology.orchestra.run.smithi059.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-10-09T15:30:08.653 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-10-09T15:30:08.653 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi033.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi059.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-10-09T15:30:08.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-10-09T15:30:08.679 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:08.679 INFO:tasks.ceph:role: osd.0 2023-10-09T15:30:08.679 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:30:08.679 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:08.752 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:08.753 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:08.753 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:08.753 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:09.189 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2023-10-09T15:30:09.190 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2023-10-09T15:30:09.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-10-09T15:30:09.346 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-10-09T15:30:09.379 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-10-09T15:30:09.445 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:09.445 INFO:tasks.ceph:role: osd.1 2023-10-09T15:30:09.445 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:30:09.445 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T15:30:09.518 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:09.518 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:09.519 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:09.943 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2023-10-09T15:30:09.944 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2023-10-09T15:30:09.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-10-09T15:30:10.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-10-09T15:30:10.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-10-09T15:30:10.150 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:10.150 INFO:tasks.ceph:role: osd.2 2023-10-09T15:30:10.150 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:30:10.150 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T15:30:10.224 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:10.224 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:10.224 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:10.224 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2023-10-09T15:30:10.224 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:10.225 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:10.225 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:10.225 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:10.225 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:10.225 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:10.667 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2023-10-09T15:30:10.669 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2023-10-09T15:30:10.669 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-10-09T15:30:10.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-10-09T15:30:10.892 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-10-09T15:30:10.960 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:10.961 INFO:tasks.ceph:role: osd.3 2023-10-09T15:30:10.961 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:30:10.961 DEBUG:teuthology.orchestra.run.smithi033:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T15:30:11.035 INFO:teuthology.orchestra.run.smithi033.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:11.035 INFO:teuthology.orchestra.run.smithi033.stdout: = reflink=1 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:11.037 INFO:teuthology.orchestra.run.smithi033.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:11.461 INFO:teuthology.orchestra.run.smithi033.stdout:Discarding blocks...Done. 2023-10-09T15:30:11.463 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi033.front.sepia.ceph.com -o noatime 2023-10-09T15:30:11.464 DEBUG:teuthology.orchestra.run.smithi033:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-10-09T15:30:11.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-10-09T15:30:11.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:11.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.758+0000 7f73cde41540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-10-09T15:30:11.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.758+0000 7f73cde41540 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-10-09T15:30:11.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.758+0000 7f73cde41540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T15:30:11.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.758+0000 7f73cde41540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T15:30:11.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.758+0000 7f73cde41540 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2023-10-09T15:30:11.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:11.759+0000 7f73cde41540 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2023-10-09T15:30:12.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:12.283+0000 7f73cde41540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:13.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:13.046+0000 7f73cde41540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:13.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:13.809+0000 7f73cde41540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:14.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-10-09T15:30:14.633 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.719+0000 7f5a7e100540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.720+0000 7f5a7e100540 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.720+0000 7f5a7e100540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.720+0000 7f5a7e100540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.720+0000 7f5a7e100540 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2023-10-09T15:30:14.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:14.720+0000 7f5a7e100540 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2023-10-09T15:30:15.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:15.259+0000 7f5a7e100540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:16.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:16.022+0000 7f5a7e100540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:16.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:16.786+0000 7f5a7e100540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:17.588 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-10-09T15:30:17.618 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.705+0000 7fc06833e540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-10-09T15:30:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.705+0000 7fc06833e540 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-10-09T15:30:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.705+0000 7fc06833e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T15:30:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.705+0000 7fc06833e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T15:30:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.705+0000 7fc06833e540 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2023-10-09T15:30:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:17.706+0000 7fc06833e540 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2023-10-09T15:30:18.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:18.231+0000 7fc06833e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:18.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:18.996+0000 7fc06833e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:19.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:19.759+0000 7fc06833e540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:20.559 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-10-09T15:30:20.588 DEBUG:teuthology.orchestra.run.smithi033:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.675+0000 7f6f97b1c540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-10-09T15:30:20.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.675+0000 7f6f97b1c540 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-10-09T15:30:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.675+0000 7f6f97b1c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T15:30:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.675+0000 7f6f97b1c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T15:30:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.675+0000 7f6f97b1c540 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2023-10-09T15:30:20.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:20.676+0000 7f6f97b1c540 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2023-10-09T15:30:21.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:21.202+0000 7f6f97b1c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:21.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:21.970+0000 7f6f97b1c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:22.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:22.733+0000 7f6f97b1c540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:23.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-10-09T15:30:23.564 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-10-09T15:30:23.594 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:23.595 INFO:tasks.ceph:role: osd.4 2023-10-09T15:30:23.595 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:30:23.595 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-10-09T15:30:23.669 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:23.670 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:24.094 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-09T15:30:24.096 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-09T15:30:24.096 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-10-09T15:30:24.288 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-10-09T15:30:24.322 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-10-09T15:30:24.390 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:24.390 INFO:tasks.ceph:role: osd.5 2023-10-09T15:30:24.390 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:30:24.391 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:24.465 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:24.466 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:24.466 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:24.466 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:24.466 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:24.883 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-09T15:30:24.884 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-09T15:30:24.884 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-10-09T15:30:24.988 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-10-09T15:30:25.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-10-09T15:30:25.086 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:25.086 INFO:tasks.ceph:role: osd.6 2023-10-09T15:30:25.086 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:30:25.086 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:25.161 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:25.162 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:25.162 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:25.608 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-09T15:30:25.610 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-09T15:30:25.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-10-09T15:30:25.777 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-10-09T15:30:25.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-10-09T15:30:25.883 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-10-09T15:30:25.883 INFO:tasks.ceph:role: osd.7 2023-10-09T15:30:25.883 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:30:25.883 DEBUG:teuthology.orchestra.run.smithi059:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-10-09T15:30:25.959 INFO:teuthology.orchestra.run.smithi059.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-10-09T15:30:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 attr=2, projid32bit=1 2023-10-09T15:30:25.959 INFO:teuthology.orchestra.run.smithi059.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: = reflink=1 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: = sunit=0 swidth=0 blks 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout:log =internal log bsize=4096 blocks=11443, version=2 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-10-09T15:30:25.960 INFO:teuthology.orchestra.run.smithi059.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-10-09T15:30:26.403 INFO:teuthology.orchestra.run.smithi059.stdout:Discarding blocks...Done. 2023-10-09T15:30:26.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi059.front.sepia.ceph.com -o noatime 2023-10-09T15:30:26.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-10-09T15:30:26.587 DEBUG:teuthology.orchestra.run.smithi059:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-10-09T15:30:26.621 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.721+0000 7f8e95dab540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-10-09T15:30:26.721 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.721+0000 7f8e95dab540 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-10-09T15:30:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.721+0000 7f8e95dab540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T15:30:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.721+0000 7f8e95dab540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T15:30:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.721+0000 7f8e95dab540 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2023-10-09T15:30:26.722 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:26.722+0000 7f8e95dab540 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2023-10-09T15:30:27.253 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:27.253+0000 7f8e95dab540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:28.016 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:28.016+0000 7f8e95dab540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:28.782 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:28.782+0000 7f8e95dab540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:29.584 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-10-09T15:30:29.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.698+0000 7f20a17ee540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.699+0000 7f20a17ee540 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.699+0000 7f20a17ee540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.699+0000 7f20a17ee540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.699+0000 7f20a17ee540 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2023-10-09T15:30:29.699 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:29.699+0000 7f20a17ee540 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2023-10-09T15:30:30.231 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:30.232+0000 7f20a17ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:30.992 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:30.993+0000 7f20a17ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:31.756 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:31.756+0000 7f20a17ee540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:32.556 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-10-09T15:30:32.586 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:32.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.673+0000 7f74676cc540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-10-09T15:30:32.673 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.673+0000 7f74676cc540 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-10-09T15:30:32.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.674+0000 7f74676cc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T15:30:32.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.674+0000 7f74676cc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T15:30:32.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.674+0000 7f74676cc540 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2023-10-09T15:30:32.674 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:32.674+0000 7f74676cc540 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2023-10-09T15:30:33.200 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:33.200+0000 7f74676cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:33.965 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:33.966+0000 7f74676cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:34.728 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:34.728+0000 7f74676cc540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:35.453 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:35.456 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:30:35.537 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-10-09T15:30:35.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:35.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-10-09T15:30:35.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-10-09T15:30:35.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T15:30:35.651 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T15:30:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2023-10-09T15:30:35.652 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:35.651+0000 7fdce6626540 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2023-10-09T15:30:36.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:36.175+0000 7fdce6626540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:36.940 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:36.941+0000 7fdce6626540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:37.704 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:37.704+0000 7fdce6626540 -1 bluestore::NCB::__restore_allocator::Failed open_for_read with error-code -2 2023-10-09T15:30:38.506 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-10-09T15:30:38.536 INFO:tasks.ceph:Reading keys from all nodes... 2023-10-09T15:30:38.536 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.536 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-10-09T15:30:38.564 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.564 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-10-09T15:30:38.632 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.632 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-10-09T15:30:38.699 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.699 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-10-09T15:30:38.766 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-10-09T15:30:38.831 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-10-09T15:30:38.897 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:38.897 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-10-09T15:30:38.963 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:38.963 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-10-09T15:30:38.993 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:38.993 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-10-09T15:30:39.062 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.062 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-10-09T15:30:39.130 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.130 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-10-09T15:30:39.197 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-10-09T15:30:39.264 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-10-09T15:30:39.331 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.331 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-10-09T15:30:39.396 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:39.396 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-10-09T15:30:39.413 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:39.413 DEBUG:teuthology.orchestra.run.smithi033:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-10-09T15:30:39.469 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.469 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-10-09T15:30:39.484 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:39.484 DEBUG:teuthology.orchestra.run.smithi059:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-10-09T15:30:39.540 INFO:tasks.ceph:Adding keys to all mons... 2023-10-09T15:30:39.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T15:30:39.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo tee -a /etc/ceph/ceph.keyring 2023-10-09T15:30:39.582 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.y] 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw== 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.a] 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA== 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.c] 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA== 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.0] 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ== 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.1] 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w== 2023-10-09T15:30:39.583 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.2] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.3] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[mgr.x] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.b] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[mds.d] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.4] 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g== 2023-10-09T15:30:39.584 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.5] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.6] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[osd.7] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[client.0] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[client.2] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[client.1] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg== 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout:[client.3] 2023-10-09T15:30:39.585 INFO:teuthology.orchestra.run.smithi033.stdout: key = AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ== 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.y] 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw== 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.a] 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA== 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.c] 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA== 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.0] 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ== 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.1] 2023-10-09T15:30:39.604 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.2] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.3] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[mgr.x] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.b] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[mds.d] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A== 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.4] 2023-10-09T15:30:39.605 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.5] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.6] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[osd.7] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[client.0] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[client.2] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[client.1] 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg== 2023-10-09T15:30:39.606 INFO:teuthology.orchestra.run.smithi059.stdout:[client.3] 2023-10-09T15:30:39.607 INFO:teuthology.orchestra.run.smithi059.stdout: key = AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ== 2023-10-09T15:30:39.608 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T15:30:39.629 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T15:30:39.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:39.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:39.751 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:39.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:39.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.806 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.856 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.906 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:39.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.005 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T15:30:40.007 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-10-09T15:30:40.055 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:40.057 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:40.108 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:40.110 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-10-09T15:30:40.161 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.163 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.211 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.213 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.261 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.263 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-10-09T15:30:40.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.367 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.420 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.474 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-10-09T15:30:40.578 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-10-09T15:30:40.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-10-09T15:30:40.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T15:30:40.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-10-09T15:30:40.720 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-10-09T15:30:40.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T15:30:40.837 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-10-09T15:30:40.862 DEBUG:teuthology.orchestra.run.smithi059:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-10-09T15:30:40.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-10-09T15:30:41.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-10-09T15:30:41.044 DEBUG:teuthology.orchestra.run.smithi033:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:41.047 DEBUG:teuthology.orchestra.run.smithi059:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-10-09T15:30:41.099 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-10-09T15:30:41.100 INFO:tasks.ceph.mon.a:Restarting daemon 2023-10-09T15:30:41.100 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-10-09T15:30:41.102 INFO:tasks.ceph.mon.a:Started 2023-10-09T15:30:41.102 INFO:tasks.ceph.mon.b:Restarting daemon 2023-10-09T15:30:41.102 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-10-09T15:30:41.142 INFO:tasks.ceph.mon.b:Started 2023-10-09T15:30:41.142 INFO:tasks.ceph.mon.c:Restarting daemon 2023-10-09T15:30:41.142 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-10-09T15:30:41.144 INFO:tasks.ceph.mon.c:Started 2023-10-09T15:30:41.144 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-10-09T15:30:41.144 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-10-09T15:30:41.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-10-09T15:30:41.146 INFO:tasks.ceph.mgr.y:Started 2023-10-09T15:30:41.146 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-10-09T15:30:41.147 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-10-09T15:30:41.148 INFO:tasks.ceph.mgr.x:Started 2023-10-09T15:30:41.149 INFO:tasks.ceph:Setting crush tunables to default 2023-10-09T15:30:41.149 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph osd crush tunables default 2023-10-09T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.267+0000 7f1db0a02700 1 Processor -- start 2023-10-09T15:30:41.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1db0a02700 1 -- start start 2023-10-09T15:30:41.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1db0a02700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 0x7f1dac06dc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1db0a02700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac06d7b0 con 0x7f1dac157480 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1db0a02700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dac06cba0 con 0x7f1dac06c6a0 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1db0a02700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dac06ce80 con 0x7f1dac0c7720 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1daa59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 0x7f1dac06dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1daad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1dac157480 0x7f1dac0c7010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47006/0 (socket says 172.21.15.33:47006) 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.268+0000 7f1daad9d700 1 -- 172.21.15.33:0/3056559332 learned_addr learned my addr 172.21.15.33:0/3056559332 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.269+0000 7f1daa59c700 1 -- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 msgr2=0x7f1dac06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.269+0000 7f1daa59c700 1 -- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 msgr2=0x7f1dac06dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.269+0000 7f1daa59c700 1 --2- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 0x7f1dac06dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2023-10-09T15:30:41.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.269+0000 7f1daa59c700 1 --2- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 0x7f1dac06dc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-10-09T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.461+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4176720894 0 0) 0x7f1dac06d7b0 con 0x7f1dac157480 2023-10-09T15:30:41.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.461+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d98003570 con 0x7f1dac157480 2023-10-09T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4166603185 0 0) 0x7f1d98003570 con 0x7f1dac157480 2023-10-09T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 msgr2=0x7f1dac06dc40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 --2- 172.21.15.33:0/3056559332 >> v2:172.21.15.33:3300/0 conn(0x7f1dac0c7720 0x7f1dac06dc40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 >> v1:172.21.15.59:6789/0 conn(0x7f1dac06c6a0 legacy=0x7f1dac0af7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac06d160 con 0x7f1dac157480 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1d94001470 con 0x7f1dac157480 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 >> v1:172.21.15.33:6789/0 conn(0x7f1dac157480 legacy=0x7f1dac0c7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d98003a60 0x7f1d98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d98004810 0x7f1d98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1d9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac06ce80 con 0x7f1d980052e0 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9800c230 con 0x7f1d98003a60 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d9800c3f0 con 0x7f1d98004810 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1daad9d700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d98003a60 0x7f1d98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1daa59c700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d98004810 0x7f1d98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.463+0000 7f1dab59e700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1d9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 -- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d98004810 msgr2=0x7f1d98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d98004810 0x7f1d98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 -- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d98003a60 msgr2=0x7f1d98003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d98003a60 0x7f1d98003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 -- 172.21.15.33:0/3056559332 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d98003570 con 0x7f1d980052e0 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1daad9d700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d98003a60 0x7f1d98003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 -- 172.21.15.33:0/3056559332 reap_dead start 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1dab59e700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1d9800ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1da4001fc0 tx=0x7f1da4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90680913faba3b73 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da4001950 con 0x7f1d980052e0 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1da400c8b0 con 0x7f1d980052e0 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.464+0000 7f1da9d9b700 1 -- 172.21.15.33:0/3056559332 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1da400cc90 con 0x7f1d980052e0 2023-10-09T15:30:41.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 -- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 msgr2=0x7f1d9800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1d9800ba60 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1da4001fc0 tx=0x7f1da4001640 comp rx=0 tx=0).stop 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 -- 172.21.15.33:0/3056559332 shutdown_connections 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 --2- 172.21.15.33:0/3056559332 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1d9800ba60 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 -- 172.21.15.33:0/3056559332 >> 172.21.15.33:0/3056559332 conn(0x7f1dac06e720 msgr2=0x7f1dac06eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 -- 172.21.15.33:0/3056559332 shutdown_connections 2023-10-09T15:30:41.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.465+0000 7f1db0a02700 1 -- 172.21.15.33:0/3056559332 wait complete. 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.466+0000 7f1db0a02700 1 Processor -- start 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 -- start start 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dac159e30 0x7f1dac15a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dac1547f0 0x7f1dac154c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:41.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac155190 con 0x7f1d980052e0 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac150840 con 0x7f1dac159e30 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1db0a02700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dac0cb130 con 0x7f1dac1547f0 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1daad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1daad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35598/0 (socket says 172.21.15.33:35598) 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.467+0000 7f1daad9d700 1 -- 172.21.15.33:0/1759332339 learned_addr learned my addr 172.21.15.33:0/1759332339 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daa59c700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dac159e30 0x7f1dac15a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1dab59e700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dac1547f0 0x7f1dac154c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 -- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dac1547f0 msgr2=0x7f1dac154c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dac1547f0 0x7f1dac154c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 -- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dac159e30 msgr2=0x7f1dac15a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dac159e30 0x7f1dac15a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 -- 172.21.15.33:0/1759332339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dac0cb410 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1daad9d700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007710 tx=0x7f1d94001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d94018030 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d9400fa50 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dac0cb6f0 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9400fdd0 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.468+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dac0cbcb0 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.469+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f1d9401b070 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.469+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f1d94019070 con 0x7f1d980052e0 2023-10-09T15:30:41.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.469+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dac04c3c0 con 0x7f1d980052e0 2023-10-09T15:30:41.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.472+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f1d94013600 con 0x7f1d980052e0 2023-10-09T15:30:41.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.549+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f1dac15ab30 con 0x7f1d980052e0 2023-10-09T15:30:41.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.555+0000 7f1da2ffd700 1 -- 172.21.15.33:0/1759332339 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f1d94013b00 con 0x7f1d980052e0 2023-10-09T15:30:41.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 msgr2=0x7f1dac150300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d94007710 tx=0x7f1d94001e50 comp rx=0 tx=0).stop 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 shutdown_connections 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d980052e0 0x7f1dac150300 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1dac1547f0 0x7f1dac154c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 --2- 172.21.15.33:0/1759332339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1dac159e30 0x7f1dac15a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.556+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 >> 172.21.15.33:0/1759332339 conn(0x7f1dac06e720 msgr2=0x7f1dac06a1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.557+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 shutdown_connections 2023-10-09T15:30:41.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:41.557+0000 7f1db0a02700 1 -- 172.21.15.33:0/1759332339 wait complete. 2023-10-09T15:30:41.559 INFO:teuthology.orchestra.run.smithi033.stderr:adjusted tunables profile to default 2023-10-09T15:30:41.569 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-10-09T15:30:41.570 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:41.570 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-10-09T15:30:41.598 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:41.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-10-09T15:30:41.664 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:41.664 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-10-09T15:30:41.730 DEBUG:teuthology.orchestra.run.smithi033:> set -ex 2023-10-09T15:30:41.730 DEBUG:teuthology.orchestra.run.smithi033:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-10-09T15:30:41.797 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:41.797 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-10-09T15:30:41.822 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:41.822 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-10-09T15:30:41.887 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:41.888 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-10-09T15:30:41.952 DEBUG:teuthology.orchestra.run.smithi059:> set -ex 2023-10-09T15:30:41.953 DEBUG:teuthology.orchestra.run.smithi059:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-10-09T15:30:42.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 11698e8d-2071-4bc8-b0a2-9a3180ed683a 0 2023-10-09T15:30:42.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.174+0000 7fb6b5821700 1 Processor -- start 2023-10-09T15:30:42.175 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.174+0000 7fb6b5821700 1 -- start start 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6b5821700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6b00684e0 0x7fb6b00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6b5821700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b0068320 con 0x7fb6b00cd780 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6b5821700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6b015ae00 con 0x7fb6b00cc910 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6b5821700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6b015a560 con 0x7fb6b00684e0 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6aeffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fb6b00cc910 0x7fb6b0159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34934/0 (socket says 172.21.15.59:34934) 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6aeffd700 1 -- 172.21.15.59:0/656478143 learned_addr learned my addr 172.21.15.59:0/656478143 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.175+0000 7fb6ae7fc700 1 --2- 172.21.15.59:0/656478143 >> v2:172.21.15.33:3300/0 conn(0x7fb6b00684e0 0x7fb6b00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 516460836 0 0) 0x7fb698001110 con 0x7fb6b00cc910 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb69c003570 con 0x7fb6b00cc910 2023-10-09T15:30:42.178 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4114092991 0 0) 0x7fb6a8001490 con 0x7fb6b00cd780 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb698001110 con 0x7fb6b00cd780 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6ae7fc700 1 -- 172.21.15.59:0/656478143 >> v1:172.21.15.59:6789/0 conn(0x7fb6b00cc910 legacy=0x7fb6b0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6ae7fc700 1 -- 172.21.15.59:0/656478143 >> v1:172.21.15.33:6789/0 conn(0x7fb6b00cd780 legacy=0x7fb6b015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6ae7fc700 1 -- 172.21.15.59:0/656478143 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b015a840 con 0x7fb6b00684e0 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6ae7fc700 1 --2- 172.21.15.59:0/656478143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00684e0 0x7fb6b00cd240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00098e0 tx=0x7fb6a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d655f2e1f02547ac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011630 con 0x7fb6b00684e0 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a0011790 con 0x7fb6b00684e0 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.176+0000 7fb6adffb700 1 -- 172.21.15.59:0/656478143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a0011b30 con 0x7fb6b00684e0 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 -- 172.21.15.59:0/656478143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00684e0 msgr2=0x7fb6b00cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 --2- 172.21.15.59:0/656478143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00684e0 0x7fb6b00cd240 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb6a00098e0 tx=0x7fb6a00091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.179 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 -- 172.21.15.59:0/656478143 shutdown_connections 2023-10-09T15:30:42.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 --2- 172.21.15.59:0/656478143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00684e0 0x7fb6b00cd240 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 -- 172.21.15.59:0/656478143 >> 172.21.15.59:0/656478143 conn(0x7fb6b006d7b0 msgr2=0x7fb6b006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 -- 172.21.15.59:0/656478143 shutdown_connections 2023-10-09T15:30:42.180 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.177+0000 7fb6b5821700 1 -- 172.21.15.59:0/656478143 wait complete. 2023-10-09T15:30:42.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.178+0000 7fb6b5821700 1 Processor -- start 2023-10-09T15:30:42.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.178+0000 7fb6b5821700 1 -- start start 2023-10-09T15:30:42.182 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 0x7fb6b00ac960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 0x7fb6b00aa8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00adb00 con 0x7fb6b00cc910 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00ae0c0 con 0x7fb6b00684e0 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6b5821700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6b00ad420 con 0x7fb6b00cd780 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6aeffd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34738/0 (socket says 172.21.15.59:34738) 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6aeffd700 1 -- 172.21.15.59:0/2050984747 learned_addr learned my addr 172.21.15.59:0/2050984747 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 0x7fb6b00aa8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6ae7fc700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 0x7fb6b00ac960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 -- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 msgr2=0x7fb6b0146e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.183 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 -- 172.21.15.59:0/2050984747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 msgr2=0x7fb6b00ac960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 0x7fb6b00ac960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6af7fe700 1 -- 172.21.15.59:0/2050984747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6a0009420 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6aeffd700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.179+0000 7fb6ae7fc700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 0x7fb6b00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6af7fe700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 0x7fb6b00aa8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c910 tx=0x7fb6a8007ee0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8012630 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6a80127b0 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6b00ad700 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8012b70 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6b0147350 con 0x7fb6b00cd780 2023-10-09T15:30:42.184 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fb6a8001a60 con 0x7fb6b00cd780 2023-10-09T15:30:42.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.180+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb6a801b410 con 0x7fb6b00cd780 2023-10-09T15:30:42.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.181+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6b004c3c0 con 0x7fb6b00cd780 2023-10-09T15:30:42.185 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.183+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fb6a8016030 con 0x7fb6b00cd780 2023-10-09T15:30:42.268 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.267+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "11698e8d-2071-4bc8-b0a2-9a3180ed683a", "id": 0} v 0) v1 -- 0x7fb6b00ae200 con 0x7fb6b00cd780 2023-10-09T15:30:42.273 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.273+0000 7fb6a6ffd700 1 -- 172.21.15.59:0/2050984747 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "11698e8d-2071-4bc8-b0a2-9a3180ed683a", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fb6b0068320 con 0x7fb6b00cd780 2023-10-09T15:30:42.274 INFO:teuthology.orchestra.run.smithi059.stdout:0 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 msgr2=0x7fb6b00aa8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 0x7fb6b00aa8b0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb6a800c910 tx=0x7fb6a8007ee0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 shutdown_connections 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6b00cd780 0x7fb6b00aa8b0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6b00684e0 0x7fb6b0146e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 --2- 172.21.15.59:0/2050984747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6b00cc910 0x7fb6b00ac960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 >> 172.21.15.59:0/2050984747 conn(0x7fb6b006d7b0 msgr2=0x7fb6b0158d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 shutdown_connections 2023-10-09T15:30:42.275 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.274+0000 7fb6b5821700 1 -- 172.21.15.59:0/2050984747 wait complete. 2023-10-09T15:30:42.286 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 5735ffa2-877b-4776-a802-b46feeedf128 1 2023-10-09T15:30:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.404+0000 7f6d24c8b700 1 Processor -- start 2023-10-09T15:30:42.405 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.404+0000 7f6d24c8b700 1 -- start start 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d24c8b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6d2006dc70 0x7f6d20159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d24c8b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d2006e0e0 0x7f6d200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d24c8b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6d200ccfd0 con 0x7f6d20159530 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d24c8b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2015a3d0 con 0x7f6d2006dc70 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d24c8b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6d2015a6b0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d2006e0e0 0x7f6d200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6d2006e0e0 0x7f6d200cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34746/0 (socket says 172.21.15.59:34746) 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1e59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6d20159530 0x7f6d200ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34940/0 (socket says 172.21.15.59:34940) 2023-10-09T15:30:42.408 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/723206253 learned_addr learned my addr 172.21.15.59:0/723206253 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1dd9b700 1 --2- 172.21.15.59:0/723206253 >> v2:172.21.15.33:3300/0 conn(0x7f6d2006dc70 0x7f6d20159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/723206253 >> v2:172.21.15.33:3300/0 conn(0x7f6d2006dc70 msgr2=0x7f6d20159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/723206253 >> v2:172.21.15.33:3300/0 conn(0x7f6d2006dc70 0x7f6d20159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/723206253 >> v1:172.21.15.59:6789/0 conn(0x7f6d20159530 legacy=0x7f6d200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 -- 172.21.15.59:0/723206253 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d2015a990 con 0x7f6d2006e0e0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1d59a700 1 -- 172.21.15.59:0/723206253 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1787890600 0 0) 0x7f6d200ccfd0 con 0x7f6d20159530 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/723206253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d200cb6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d200cf2b0 tx=0x7f6d18009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0d199fa9e651898 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1d59a700 1 -- 172.21.15.59:0/723206253 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1800e070 con 0x7f6d2006e0e0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1d59a700 1 -- 172.21.15.59:0/723206253 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1800ba20 con 0x7f6d2006e0e0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.405+0000 7f6d1d59a700 1 -- 172.21.15.59:0/723206253 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d180092e0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 -- 172.21.15.59:0/723206253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 msgr2=0x7f6d200cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.409 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/723206253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d200cb6f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f6d200cf2b0 tx=0x7f6d18009840 comp rx=0 tx=0).stop 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 -- 172.21.15.59:0/723206253 shutdown_connections 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/723206253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d200cb6f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/723206253 >> v2:172.21.15.33:3300/0 conn(0x7f6d2006dc70 0x7f6d20159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 -- 172.21.15.59:0/723206253 >> 172.21.15.59:0/723206253 conn(0x7f6d200703a0 msgr2=0x7f6d200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 -- 172.21.15.59:0/723206253 shutdown_connections 2023-10-09T15:30:42.410 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.406+0000 7f6d24c8b700 1 -- 172.21.15.59:0/723206253 wait complete. 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.408+0000 7f6d24c8b700 1 Processor -- start 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.408+0000 7f6d24c8b700 1 -- start start 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 0x7f6d2016a110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d20159530 0x7f6d200b54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d2016a650 con 0x7f6d2006dc70 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6d200b61f0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6d20157550 con 0x7f6d20159530 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34756/0 (socket says 172.21.15.59:34756) 2023-10-09T15:30:42.413 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 -- 172.21.15.59:0/120092427 learned_addr learned my addr 172.21.15.59:0/120092427 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 0x7f6d2016a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1ed9d700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d20159530 0x7f6d200b54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 -- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d20159530 msgr2=0x7f6d200b54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d20159530 0x7f6d200b54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 -- 172.21.15.59:0/120092427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 msgr2=0x7f6d2016a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 0x7f6d2016a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 -- 172.21.15.59:0/120092427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6d18009ae0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1e59c700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 0x7f6d2016a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d1dd9b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400ec80 tx=0x7f6d140091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400c850 con 0x7f6d2006e0e0 2023-10-09T15:30:42.414 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6d1400c9b0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6d20158810 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.410+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6d1400cd50 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.411+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6d200b3b90 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.411+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f6d14005c80 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.411+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f6d14006020 con 0x7f6d2006e0e0 2023-10-09T15:30:42.415 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.412+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6d2004c3c0 con 0x7f6d2006e0e0 2023-10-09T15:30:42.416 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.416+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f6d14021060 con 0x7f6d2006e0e0 2023-10-09T15:30:42.501 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.500+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5735ffa2-877b-4776-a802-b46feeedf128", "id": 1} v 0) v1 -- 0x7f6d2015ac70 con 0x7f6d2006e0e0 2023-10-09T15:30:42.504 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.504+0000 7f6d0e7fc700 1 -- 172.21.15.59:0/120092427 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5735ffa2-877b-4776-a802-b46feeedf128", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6d14017070 con 0x7f6d2006e0e0 2023-10-09T15:30:42.505 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 msgr2=0x7f6d201582d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f6d1400ec80 tx=0x7f6d140091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 shutdown_connections 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6d2006dc70 0x7f6d2016a110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6d20159530 0x7f6d200b54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 --2- 172.21.15.59:0/120092427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6d2006e0e0 0x7f6d201582d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 >> 172.21.15.59:0/120092427 conn(0x7f6d200703a0 msgr2=0x7f6d200cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 shutdown_connections 2023-10-09T15:30:42.506 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.505+0000 7f6d24c8b700 1 -- 172.21.15.59:0/120092427 wait complete. 2023-10-09T15:30:42.517 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 5447cdc2-e857-406d-b56c-0f238c8332ad 2 2023-10-09T15:30:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.634+0000 7f7f6dc87700 1 Processor -- start 2023-10-09T15:30:42.635 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.634+0000 7f7f6dc87700 1 -- start start 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 0x7f7f68159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f6806e0e0 0x7f7f680cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f680ccfd0 con 0x7f7f6806dc70 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f680cf0e0 con 0x7f7f6806e0e0 2023-10-09T15:30:42.638 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f6dc87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f6815a3d0 con 0x7f7f68159530 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f6806e0e0 0x7f7f680cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f67fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7f6806e0e0 0x7f7f680cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34766/0 (socket says 172.21.15.59:34766) 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f677fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34052/0 (socket says 172.21.15.59:34052) 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f67fff700 1 -- 172.21.15.59:0/1644013701 learned_addr learned my addr 172.21.15.59:0/1644013701 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.635+0000 7f7f66ffd700 1 --2- 172.21.15.59:0/1644013701 >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 0x7f7f68159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 -- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 msgr2=0x7f7f680ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 -- 172.21.15.59:0/1644013701 >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 msgr2=0x7f7f68159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1644013701 >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 0x7f7f68159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.639 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 -- 172.21.15.59:0/1644013701 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f6815a6b0 con 0x7f7f6806e0e0 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f677fe700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f66ffd700 1 --2- 172.21.15.59:0/1644013701 >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 0x7f7f68159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6806e0e0 0x7f7f680cb6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f68089880 tx=0x7f7f60009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8f714871eed3a5a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f667fc700 1 -- 172.21.15.59:0/1644013701 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f6000e070 con 0x7f7f6806e0e0 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f667fc700 1 -- 172.21.15.59:0/1644013701 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f6000ba20 con 0x7f7f6806e0e0 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.636+0000 7f7f667fc700 1 -- 172.21.15.59:0/1644013701 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600092e0 con 0x7f7f6806e0e0 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6806e0e0 msgr2=0x7f7f680cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6806e0e0 0x7f7f680cb6f0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7f68089880 tx=0x7f7f60009840 comp rx=0 tx=0).stop 2023-10-09T15:30:42.640 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1644013701 shutdown_connections 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f6806e0e0 0x7f7f680cb6f0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1644013701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f68159530 0x7f7f680ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1644013701 >> v2:172.21.15.33:3300/0 conn(0x7f7f6806dc70 0x7f7f68159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1644013701 >> 172.21.15.59:0/1644013701 conn(0x7f7f680703a0 msgr2=0x7f7f680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1644013701 shutdown_connections 2023-10-09T15:30:42.641 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.637+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1644013701 wait complete. 2023-10-09T15:30:42.643 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.638+0000 7f7f6dc87700 1 Processor -- start 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.638+0000 7f7f6dc87700 1 -- start start 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f6806dc70 0x7f7f68143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680b6480 con 0x7f7f6806dc70 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680b3a00 con 0x7f7f68159530 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f6dc87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f680b3fc0 con 0x7f7f6806e0e0 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.644 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f66ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34770/0 (socket says 172.21.15.59:34770) 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 -- 172.21.15.59:0/1987486414 learned_addr learned my addr 172.21.15.59:0/1987486414 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f66ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34060/0 (socket says 172.21.15.59:34060) 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f677fe700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f6806dc70 0x7f7f68143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 -- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 msgr2=0x7f7f6815bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 -- 172.21.15.59:0/1987486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f6806dc70 msgr2=0x7f7f68143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f6806dc70 0x7f7f68143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f67fff700 1 -- 172.21.15.59:0/1987486414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f58009420 con 0x7f7f68159530 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.639+0000 7f7f66ffd700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.645 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f67fff700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f60012000 tx=0x7f7f60018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f600032f0 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f60008e50 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f60009ae0 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f60026690 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f6815c920 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f7f60003040 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.640+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f7f6001d850 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.641+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f6804c3c0 con 0x7f7f68159530 2023-10-09T15:30:42.646 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.643+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f7f60021070 con 0x7f7f68159530 2023-10-09T15:30:42.696 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:42.695+0000 7f35842d6180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T15:30:42.696 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:42.695+0000 7f927d8dd180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-10-09T15:30:42.729 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.728+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5447cdc2-e857-406d-b56c-0f238c8332ad", "id": 2} v 0) v1 -- 0x7f7f6815a990 con 0x7f7f68159530 2023-10-09T15:30:42.732 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.732+0000 7f7f4f7fe700 1 -- 172.21.15.59:0/1987486414 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5447cdc2-e857-406d-b56c-0f238c8332ad", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7f60026a40 con 0x7f7f68159530 2023-10-09T15:30:42.733 INFO:teuthology.orchestra.run.smithi059.stdout:2 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 msgr2=0x7f7f6815c220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7f60012000 tx=0x7f7f60018000 comp rx=0 tx=0).stop 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 shutdown_connections 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7f6806dc70 0x7f7f68143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7f68159530 0x7f7f6815c220 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 --2- 172.21.15.59:0/1987486414 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7f6806e0e0 0x7f7f6815bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 >> 172.21.15.59:0/1987486414 conn(0x7f7f680703a0 msgr2=0x7f7f68158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 shutdown_connections 2023-10-09T15:30:42.734 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.733+0000 7f7f6dc87700 1 -- 172.21.15.59:0/1987486414 wait complete. 2023-10-09T15:30:42.745 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new c5b016b7-3590-4fd7-ab97-6198dc0fa04a 3 2023-10-09T15:30:42.833 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:42.833+0000 7f927d8dd180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T15:30:42.837 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:42.836+0000 7f35842d6180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-10-09T15:30:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.863+0000 7f3d95c1a700 1 Processor -- start 2023-10-09T15:30:42.864 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.863+0000 7f3d95c1a700 1 -- start start 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d95c1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d95c1a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d9006e0e0 0x7f3d900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d95c1a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d900ccfd0 con 0x7f3d9006dc70 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d95c1a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d900cf0e0 con 0x7f3d9006e0e0 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d95c1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015a3d0 con 0x7f3d90159530 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d9006e0e0 0x7f3d900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d9006e0e0 0x7f3d900cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34780/0 (socket says 172.21.15.59:34780) 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8effd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3d9006dc70 0x7f3d90159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34944/0 (socket says 172.21.15.59:34944) 2023-10-09T15:30:42.867 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34068/0 (socket says 172.21.15.59:34068) 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 -- 172.21.15.59:0/1159116203 learned_addr learned my addr 172.21.15.59:0/1159116203 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 -- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 msgr2=0x7f3d900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 -- 172.21.15.59:0/1159116203 >> v1:172.21.15.59:6789/0 conn(0x7f3d9006dc70 legacy=0x7f3d90159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8ffff700 1 -- 172.21.15.59:0/1159116203 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9015a6b0 con 0x7f3d9006e0e0 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8e7fc700 1 -- 172.21.15.59:0/1159116203 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 978287201 0 0) 0x7f3d900ccfd0 con 0x7f3d9006dc70 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.864+0000 7f3d8f7fe700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d8ffff700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb6f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009f20 tx=0x7f3d88009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6b1a46d267d7e674 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d8e7fc700 1 -- 172.21.15.59:0/1159116203 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8800e070 con 0x7f3d9006e0e0 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d8e7fc700 1 -- 172.21.15.59:0/1159116203 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8800b9d0 con 0x7f3d9006e0e0 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d8e7fc700 1 -- 172.21.15.59:0/1159116203 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d880092e0 con 0x7f3d9006e0e0 2023-10-09T15:30:42.868 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 msgr2=0x7f3d900cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb6f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f3d88009f20 tx=0x7f3d88009840 comp rx=0 tx=0).stop 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1159116203 shutdown_connections 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb6f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1159116203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d90159530 0x7f3d900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.865+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1159116203 >> 172.21.15.59:0/1159116203 conn(0x7f3d900703a0 msgr2=0x7f3d900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.866+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1159116203 shutdown_connections 2023-10-09T15:30:42.869 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.866+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1159116203 wait complete. 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.867+0000 7f3d95c1a700 1 Processor -- start 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.867+0000 7f3d95c1a700 1 -- start start 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.867+0000 7f3d95c1a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.867+0000 7f3d95c1a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 0x7f3d900cb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015d960 con 0x7f3d90159530 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015cd90 con 0x7f3d9006e0e0 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9015ddf0 con 0x7f3d9006dc70 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.872 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34078/0 (socket says 172.21.15.59:34078) 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 -- 172.21.15.59:0/1016286591 learned_addr learned my addr 172.21.15.59:0/1016286591 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8ffff700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 0x7f3d900cb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 -- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 msgr2=0x7f3d900cb4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 -- 172.21.15.59:0/1016286591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 msgr2=0x7f3d900cb9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 0x7f3d900cb9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 -- 172.21.15.59:0/1016286591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d80009420 con 0x7f3d9006dc70 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8ffff700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 0x7f3d900cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d8f7fe700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000ec80 tx=0x7f3d800091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000c850 con 0x7f3d9006dc70 2023-10-09T15:30:42.873 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d8000c9b0 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d88009ae0 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d8000cd30 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.868+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d9015d310 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.869+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f3d80013900 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.869+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f3d8001cb20 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.869+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d9015dc40 con 0x7f3d9006dc70 2023-10-09T15:30:42.874 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.871+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f3d8003b6d0 con 0x7f3d9006dc70 2023-10-09T15:30:42.912 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:42.911+0000 7f927d8dd180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T15:30:42.918 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:42.917+0000 7f35842d6180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-10-09T15:30:42.956 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.956+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c5b016b7-3590-4fd7-ab97-6198dc0fa04a", "id": 3} v 0) v1 -- 0x7f3d9004c3c0 con 0x7f3d9006dc70 2023-10-09T15:30:42.960 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.960+0000 7f3d877fe700 1 -- 172.21.15.59:0/1016286591 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c5b016b7-3590-4fd7-ab97-6198dc0fa04a", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3d8002a030 con 0x7f3d9006dc70 2023-10-09T15:30:42.961 INFO:teuthology.orchestra.run.smithi059.stdout:3 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 msgr2=0x7f3d900c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f3d8000ec80 tx=0x7f3d800091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 shutdown_connections 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d90159530 0x7f3d900cb9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d9006dc70 0x7f3d900c7790 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 --2- 172.21.15.59:0/1016286591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9006e0e0 0x7f3d900cb4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 >> 172.21.15.59:0/1016286591 conn(0x7f3d900703a0 msgr2=0x7f3d900c6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 shutdown_connections 2023-10-09T15:30:42.962 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:42.961+0000 7f3d95c1a700 1 -- 172.21.15.59:0/1016286591 wait complete. 2023-10-09T15:30:42.974 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 4a7d4640-8d7f-476f-aea1-1c935778d122 4 2023-10-09T15:30:43.092 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.091+0000 7f49c10b6700 1 Processor -- start 2023-10-09T15:30:43.093 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.091+0000 7f49c10b6700 1 -- start start 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49c10b6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49bc0c8ee0 0x7f49bc159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49c10b6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0c71a0 con 0x7f49bc06f060 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49c10b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49bc0c7a40 con 0x7f49bc1597e0 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49c10b6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49bc06d3d0 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49bb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49bc0c8ee0 0x7f49bc159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49bad9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49bc1597e0 0x7f49bc06e950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34954/0 (socket says 172.21.15.59:34954) 2023-10-09T15:30:43.095 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49bb59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49bc0c8ee0 0x7f49bc159bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34794/0 (socket says 172.21.15.59:34794) 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.092+0000 7f49bb59e700 1 -- 172.21.15.59:0/2037374730 learned_addr learned my addr 172.21.15.59:0/2037374730 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49bb59e700 1 -- 172.21.15.59:0/2037374730 >> v1:172.21.15.59:6789/0 conn(0x7f49bc1597e0 legacy=0x7f49bc06e950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49bb59e700 1 -- 172.21.15.59:0/2037374730 >> v1:172.21.15.33:6789/0 conn(0x7f49bc06f060 legacy=0x7f49bc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49b9d9b700 1 -- 172.21.15.59:0/2037374730 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 343575231 0 0) 0x7f49bc0c7a40 con 0x7f49bc1597e0 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49bb59e700 1 -- 172.21.15.59:0/2037374730 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49bc0c73f0 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49bb59e700 1 --2- 172.21.15.59:0/2037374730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc0c8ee0 0x7f49bc159bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009f20 tx=0x7f49b4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=567990d3344176f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49b9d9b700 1 -- 172.21.15.59:0/2037374730 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b400e070 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.096 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49b9d9b700 1 -- 172.21.15.59:0/2037374730 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b400b980 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49b9d9b700 1 -- 172.21.15.59:0/2037374730 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b40092e0 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49c10b6700 1 -- 172.21.15.59:0/2037374730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc0c8ee0 msgr2=0x7f49bc159bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.093+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2037374730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc0c8ee0 0x7f49bc159bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009f20 tx=0x7f49b4009840 comp rx=0 tx=0).stop 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.094+0000 7f49c10b6700 1 -- 172.21.15.59:0/2037374730 shutdown_connections 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.094+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2037374730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc0c8ee0 0x7f49bc159bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.094+0000 7f49c10b6700 1 -- 172.21.15.59:0/2037374730 >> 172.21.15.59:0/2037374730 conn(0x7f49bc0ccb60 msgr2=0x7f49bc0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.094+0000 7f49c10b6700 1 -- 172.21.15.59:0/2037374730 shutdown_connections 2023-10-09T15:30:43.097 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.094+0000 7f49c10b6700 1 -- 172.21.15.59:0/2037374730 wait complete. 2023-10-09T15:30:43.099 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.095+0000 7f49c10b6700 1 Processor -- start 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.095+0000 7f49c10b6700 1 -- start start 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.095+0000 7f49c10b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49bc06f060 0x7f49bc0b1300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.095+0000 7f49c10b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49bc0c8ee0 0x7f49bc0b1840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0b2080 con 0x7f49bc06f060 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc0b2360 con 0x7f49bc1597e0 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49bc15d4c0 con 0x7f49bc0c8ee0 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34802/0 (socket says 172.21.15.59:34802) 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 -- 172.21.15.59:0/2398327879 learned_addr learned my addr 172.21.15.59:0/2398327879 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.100 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49ba59c700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49bc0c8ee0 0x7f49bc0b1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bad9d700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49bc06f060 0x7f49bc0b1300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 -- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49bc0c8ee0 msgr2=0x7f49bc0b1840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49bc0c8ee0 0x7f49bc0b1840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 -- 172.21.15.59:0/2398327879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49bc06f060 msgr2=0x7f49bc0b1300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49bc06f060 0x7f49bc0b1300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 -- 172.21.15.59:0/2398327879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49b4009ae0 con 0x7f49bc1597e0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49bb59e700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ab0 tx=0x7f49b4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b4012b30 con 0x7f49bc1597e0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49b4012c90 con 0x7f49bc1597e0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49bc15d7a0 con 0x7f49bc1597e0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49b401d670 con 0x7f49bc1597e0 2023-10-09T15:30:43.101 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.096+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49bc15f9b0 con 0x7f49bc1597e0 2023-10-09T15:30:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.097+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f49b401daa0 con 0x7f49bc1597e0 2023-10-09T15:30:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.097+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f49b4025900 con 0x7f49bc1597e0 2023-10-09T15:30:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.098+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49bc0b25a0 con 0x7f49bc1597e0 2023-10-09T15:30:43.102 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.100+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f49b40446d0 con 0x7f49bc1597e0 2023-10-09T15:30:43.103 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:43.103+0000 7f927d8dd180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T15:30:43.128 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:43.127+0000 7f35842d6180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-10-09T15:30:43.234 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.233+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4a7d4640-8d7f-476f-aea1-1c935778d122", "id": 4} v 0) v1 -- 0x7f49bc04c3c0 con 0x7f49bc1597e0 2023-10-09T15:30:43.237 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.237+0000 7f49b2ffd700 1 -- 172.21.15.59:0/2398327879 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4a7d4640-8d7f-476f-aea1-1c935778d122", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f49b4033030 con 0x7f49bc1597e0 2023-10-09T15:30:43.238 INFO:teuthology.orchestra.run.smithi059.stdout:4 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 msgr2=0x7f49bc0c53f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f49b4009ab0 tx=0x7f49b4017000 comp rx=0 tx=0).stop 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 shutdown_connections 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49bc06f060 0x7f49bc0b1300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49bc1597e0 0x7f49bc0c53f0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 --2- 172.21.15.59:0/2398327879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49bc0c8ee0 0x7f49bc0b1840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 >> 172.21.15.59:0/2398327879 conn(0x7f49bc0ccb60 msgr2=0x7f49bc06b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 shutdown_connections 2023-10-09T15:30:43.239 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.238+0000 7f49c10b6700 1 -- 172.21.15.59:0/2398327879 wait complete. 2023-10-09T15:30:43.250 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new cdfeca37-6607-4e31-849f-f9c2d90f49f9 5 2023-10-09T15:30:43.284 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:43.283+0000 7f927d8dd180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T15:30:43.339 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:43.338+0000 7f35842d6180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-10-09T15:30:43.369 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:43.368+0000 7f927d8dd180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T15:30:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.368+0000 7f98509bd700 1 Processor -- start 2023-10-09T15:30:43.369 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.368+0000 7f98509bd700 1 -- start start 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f98509bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f984c157930 0x7f984c0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f98509bd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f984c0cd2b0 0x7f984c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f98509bd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f984c0c32a0 con 0x7f984c0ca2c0 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f98509bd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c0c9730 con 0x7f984c0cd2b0 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f98509bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f984c0c4100 con 0x7f984c157930 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f984a59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f984c157930 0x7f984c0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f9849d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f984c0ca2c0 0x7f984c0ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34964/0 (socket says 172.21.15.59:34964) 2023-10-09T15:30:43.372 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f9849d9b700 1 -- 172.21.15.59:0/927117229 learned_addr learned my addr 172.21.15.59:0/927117229 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.369+0000 7f984ad9d700 1 --2- 172.21.15.59:0/927117229 >> v2:172.21.15.33:3300/0 conn(0x7f984c0cd2b0 0x7f984c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984a59c700 1 -- 172.21.15.59:0/927117229 >> v2:172.21.15.33:3300/0 conn(0x7f984c0cd2b0 msgr2=0x7f984c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984a59c700 1 --2- 172.21.15.59:0/927117229 >> v2:172.21.15.33:3300/0 conn(0x7f984c0cd2b0 0x7f984c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984a59c700 1 -- 172.21.15.59:0/927117229 >> v1:172.21.15.59:6789/0 conn(0x7f984c0ca2c0 legacy=0x7f984c0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984a59c700 1 -- 172.21.15.59:0/927117229 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f984c0c34f0 con 0x7f984c157930 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984959a700 1 -- 172.21.15.59:0/927117229 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3328094318 0 0) 0x7f984c0c32a0 con 0x7f984c0ca2c0 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984a59c700 1 --2- 172.21.15.59:0/927117229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0ab070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f984c06ab90 tx=0x7f98400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb3b3e48d002dde1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984959a700 1 -- 172.21.15.59:0/927117229 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840011630 con 0x7f984c157930 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984959a700 1 -- 172.21.15.59:0/927117229 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840011790 con 0x7f984c157930 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.370+0000 7f984959a700 1 -- 172.21.15.59:0/927117229 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840011b30 con 0x7f984c157930 2023-10-09T15:30:43.373 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 -- 172.21.15.59:0/927117229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 msgr2=0x7f984c0ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 --2- 172.21.15.59:0/927117229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0ab070 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f984c06ab90 tx=0x7f98400091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 -- 172.21.15.59:0/927117229 shutdown_connections 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 --2- 172.21.15.59:0/927117229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0ab070 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 --2- 172.21.15.59:0/927117229 >> v2:172.21.15.33:3300/0 conn(0x7f984c0cd2b0 0x7f984c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 -- 172.21.15.59:0/927117229 >> 172.21.15.59:0/927117229 conn(0x7f984c088000 msgr2=0x7f984c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 -- 172.21.15.59:0/927117229 shutdown_connections 2023-10-09T15:30:43.374 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.371+0000 7f98509bd700 1 -- 172.21.15.59:0/927117229 wait complete. 2023-10-09T15:30:43.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.372+0000 7f98509bd700 1 Processor -- start 2023-10-09T15:30:43.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.372+0000 7f98509bd700 1 -- start start 2023-10-09T15:30:43.376 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.372+0000 7f98509bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 0x7f984c154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0c7fe0 con 0x7f984c0ca2c0 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0c73d0 con 0x7f984c157930 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984c0c76b0 con 0x7f984c0cd2b0 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f9849d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 0x7f984c154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f9849d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34096/0 (socket says 172.21.15.59:34096) 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34818/0 (socket says 172.21.15.59:34818) 2023-10-09T15:30:43.377 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f9849d9b700 1 -- 172.21.15.59:0/1125030368 learned_addr learned my addr 172.21.15.59:0/1125030368 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 -- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 msgr2=0x7f984c0ae530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 -- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 msgr2=0x7f984c0aea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 -- 172.21.15.59:0/1125030368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840009420 con 0x7f984c0ca2c0 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f9849d9b700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984ad9d700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f984a59c700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 0x7f984c154310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9840016000 tx=0x7f9840017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840011900 con 0x7f984c0ca2c0 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9840011a80 con 0x7f984c0ca2c0 2023-10-09T15:30:43.378 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f984c0c7990 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.373+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9840023640 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.374+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f984c154850 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.374+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f9840023a70 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.374+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1296+0+0 (secure 0 0 0) 0x7f9840023d20 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.374+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f984c04c3c0 con 0x7f984c0ca2c0 2023-10-09T15:30:43.379 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.377+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f9840028070 con 0x7f984c0ca2c0 2023-10-09T15:30:43.422 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:43.421+0000 7f35842d6180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-10-09T15:30:43.462 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.461+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd new", "uuid": "cdfeca37-6607-4e31-849f-f9c2d90f49f9", "id": 5} v 0) v1 -- 0x7f984c155b20 con 0x7f984c0ca2c0 2023-10-09T15:30:43.465 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.464+0000 7f983a7fc700 1 -- 172.21.15.59:0/1125030368 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "cdfeca37-6607-4e31-849f-f9c2d90f49f9", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9840015020 con 0x7f984c0ca2c0 2023-10-09T15:30:43.465 INFO:teuthology.orchestra.run.smithi059.stdout:5 2023-10-09T15:30:43.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 msgr2=0x7f984c154310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.466 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 0x7f984c154310 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f9840016000 tx=0x7f9840017000 comp rx=0 tx=0).stop 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 shutdown_connections 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f984c0ca2c0 0x7f984c154310 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f984c157930 0x7f984c0aea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 --2- 172.21.15.59:0/1125030368 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f984c0cd2b0 0x7f984c0ae530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 >> 172.21.15.59:0/1125030368 conn(0x7f984c088000 msgr2=0x7f984c154e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 shutdown_connections 2023-10-09T15:30:43.467 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.465+0000 7f98509bd700 1 -- 172.21.15.59:0/1125030368 wait complete. 2023-10-09T15:30:43.479 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 182e9ee5-69eb-42f5-8140-c236652bd24e 6 2023-10-09T15:30:43.510 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:43.510+0000 7f927d8dd180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T15:30:43.566 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:43.565+0000 7f35842d6180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-10-09T15:30:43.598 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.597+0000 7fc773a88700 1 Processor -- start 2023-10-09T15:30:43.599 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.598+0000 7fc773a88700 1 -- start start 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.598+0000 7fc773a88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc76c159530 0x7fc76c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.598+0000 7fc773a88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.598+0000 7fc773a88700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c0ccfd0 con 0x7fc76c06dc70 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc773a88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cf0e0 con 0x7fc76c159530 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc773a88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15a3d0 con 0x7fc76c06e0e0 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc76c159530 0x7fc76c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc772025700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.601 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc76c159530 0x7fc76c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34822/0 (socket says 172.21.15.59:34822) 2023-10-09T15:30:43.602 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 -- 172.21.15.59:0/1600488185 learned_addr learned my addr 172.21.15.59:0/1600488185 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 -- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 msgr2=0x7fc76c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 -- 172.21.15.59:0/1600488185 >> v1:172.21.15.33:6789/0 conn(0x7fc76c06dc70 legacy=0x7fc76c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 -- 172.21.15.59:0/1600488185 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c15a6b0 con 0x7fc76c159530 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc772025700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc771824700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c0ceba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0099b0 tx=0x7fc75c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=876a28d9f799b376 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc770822700 1 -- 172.21.15.59:0/1600488185 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c009ea0 con 0x7fc76c159530 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc770822700 1 -- 172.21.15.59:0/1600488185 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc75c00b860 con 0x7fc76c159530 2023-10-09T15:30:43.603 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.599+0000 7fc770822700 1 -- 172.21.15.59:0/1600488185 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc75c00bc00 con 0x7fc76c159530 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 -- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 msgr2=0x7fc76c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c0ceba0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fc75c0099b0 tx=0x7fc75c009250 comp rx=0 tx=0).stop 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 -- 172.21.15.59:0/1600488185 shutdown_connections 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 --2- 172.21.15.59:0/1600488185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c0ceba0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 -- 172.21.15.59:0/1600488185 >> 172.21.15.59:0/1600488185 conn(0x7fc76c0703a0 msgr2=0x7fc76c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 -- 172.21.15.59:0/1600488185 shutdown_connections 2023-10-09T15:30:43.604 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.600+0000 7fc773a88700 1 -- 172.21.15.59:0/1600488185 wait complete. 2023-10-09T15:30:43.606 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.601+0000 7fc773a88700 1 Processor -- start 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.601+0000 7fc773a88700 1 -- start start 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76c06dc70 0x7fc76c152df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c15c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15cc20 con 0x7fc76c06dc70 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15c6e0 con 0x7fc76c159530 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc773a88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c15c940 con 0x7fc76c06e0e0 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc771023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c15c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.607 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.59:34826/0 (socket says 172.21.15.59:34826) 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc771023700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c15c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34108/0 (socket says 172.21.15.59:34108) 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 -- 172.21.15.59:0/777795200 learned_addr learned my addr 172.21.15.59:0/777795200 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc771824700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76c06dc70 0x7fc76c152df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 -- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 msgr2=0x7fc76c15c1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c15c1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 -- 172.21.15.59:0/777795200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76c06dc70 msgr2=0x7fc76c152df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76c06dc70 0x7fc76c152df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.602+0000 7fc772025700 1 -- 172.21.15.59:0/777795200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009a20 con 0x7fc76c159530 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc772025700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc76400ef90 tx=0x7fc76400b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764009d00 con 0x7fc76c159530 2023-10-09T15:30:43.608 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76400f040 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc75c0094f0 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76400ce20 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c15d7d0 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fc764014690 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.603+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1411+0+0 (secure 0 0 0) 0x7fc76401db40 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.604+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c04c3c0 con 0x7fc76c159530 2023-10-09T15:30:43.609 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.606+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fc76403b6d0 con 0x7fc76c159530 2023-10-09T15:30:43.610 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:43.609+0000 7f927d8dd180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T15:30:43.669 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:43.667+0000 7f35842d6180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-10-09T15:30:43.691 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.691+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "182e9ee5-69eb-42f5-8140-c236652bd24e", "id": 6} v 0) v1 -- 0x7fc76c15a990 con 0x7fc76c159530 2023-10-09T15:30:43.700 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.699+0000 7fc761ffb700 1 -- 172.21.15.59:0/777795200 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "182e9ee5-69eb-42f5-8140-c236652bd24e", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fc76402a070 con 0x7fc76c159530 2023-10-09T15:30:43.700 INFO:teuthology.orchestra.run.smithi059.stdout:6 2023-10-09T15:30:43.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 msgr2=0x7fc76c14e1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fc76400ef90 tx=0x7fc76400b040 comp rx=0 tx=0).stop 2023-10-09T15:30:43.701 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 shutdown_connections 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc76c06dc70 0x7fc76c152df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc76c159530 0x7fc76c14e1c0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 --2- 172.21.15.59:0/777795200 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc76c06e0e0 0x7fc76c15c1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 >> 172.21.15.59:0/777795200 conn(0x7fc76c0703a0 msgr2=0x7fc76c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 shutdown_connections 2023-10-09T15:30:43.702 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.700+0000 7fc773a88700 1 -- 172.21.15.59:0/777795200 wait complete. 2023-10-09T15:30:43.713 DEBUG:teuthology.orchestra.run.smithi059:> sudo ceph --cluster ceph osd new 22ca6a0f-6836-46df-a2b3-6dd040198cfe 7 2023-10-09T15:30:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.830+0000 7f54133ea700 1 Processor -- start 2023-10-09T15:30:43.831 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.830+0000 7f54133ea700 1 -- start start 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54133ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f540c153a00 0x7f540c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54133ea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c15ac50 con 0x7f540c0cea00 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54133ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f540c15d010 con 0x7f540c15de50 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54133ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f540c15af60 con 0x7f540c153a00 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54123e8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f540c153a00 0x7f540c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f5411be7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f540c15de50 0x7f540c15a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.59:34966/0 (socket says 172.21.15.59:34966) 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f5411be7700 1 -- 172.21.15.59:0/3945311732 learned_addr learned my addr 172.21.15.59:0/3945311732 (peer_addr_for_me v1:172.21.15.59:0/0) 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54123e8700 1 -- 172.21.15.59:0/3945311732 >> v1:172.21.15.59:6789/0 conn(0x7f540c15de50 legacy=0x7f540c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54123e8700 1 -- 172.21.15.59:0/3945311732 >> v1:172.21.15.33:6789/0 conn(0x7f540c0cea00 legacy=0x7f540c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.831+0000 7f54123e8700 1 -- 172.21.15.59:0/3945311732 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f540c15b240 con 0x7f540c153a00 2023-10-09T15:30:43.833 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54123e8700 1 --2- 172.21.15.59:0/3945311732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c153a00 0x7f540c153dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54080098e0 tx=0x7f54080091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c9e42b621e3bfcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54113e6700 1 -- 172.21.15.59:0/3945311732 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5408009e80 con 0x7f540c153a00 2023-10-09T15:30:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54113e6700 1 -- 172.21.15.59:0/3945311732 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540800b860 con 0x7f540c153a00 2023-10-09T15:30:43.834 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54113e6700 1 -- 172.21.15.59:0/3945311732 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540800bbe0 con 0x7f540c153a00 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54133ea700 1 -- 172.21.15.59:0/3945311732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c153a00 msgr2=0x7f540c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54133ea700 1 --2- 172.21.15.59:0/3945311732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c153a00 0x7f540c153dd0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f54080098e0 tx=0x7f54080091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54133ea700 1 -- 172.21.15.59:0/3945311732 shutdown_connections 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54133ea700 1 --2- 172.21.15.59:0/3945311732 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c153a00 0x7f540c153dd0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.832+0000 7f54133ea700 1 -- 172.21.15.59:0/3945311732 >> 172.21.15.59:0/3945311732 conn(0x7f540c0703a0 msgr2=0x7f540c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.838 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.833+0000 7f54133ea700 1 -- 172.21.15.59:0/3945311732 shutdown_connections 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.833+0000 7f54133ea700 1 -- 172.21.15.59:0/3945311732 wait complete. 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 Processor -- start 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 -- start start 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c153a00 0x7f540c0b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 0x7f540c0c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cc0e0 con 0x7f540c153a00 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cc3c0 con 0x7f540c15de50 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.834+0000 7f54133ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540c0cc6a0 con 0x7f540c0cea00 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54123e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 0x7f540c0c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.839 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54123e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.59:34122/0 (socket says 172.21.15.59:34122) 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54123e8700 1 -- 172.21.15.59:0/227732140 learned_addr learned my addr 172.21.15.59:0/227732140 (peer_addr_for_me v2:172.21.15.59:0/0) 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5411be7700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c153a00 0x7f540c0b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 -- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 msgr2=0x7f540c156ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 -- 172.21.15.59:0/227732140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c153a00 msgr2=0x7f540c0b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c153a00 0x7f540c0b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 -- 172.21.15.59:0/227732140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5408009420 con 0x7f540c15de50 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54123e8700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f5412be9700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 0x7f540c0c83b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f540400c790 tx=0x7f54040015f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012630 con 0x7f540c15de50 2023-10-09T15:30:43.840 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54040127b0 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f540c0cc980 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404012b70 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f540c157020 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.835+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f5404003030 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.836+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1526+0+0 (secure 0 0 0) 0x7f540401b400 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.836+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f540c0c6380 con 0x7f540c15de50 2023-10-09T15:30:43.841 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.838+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f540401b5c0 con 0x7f540c15de50 2023-10-09T15:30:43.927 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.926+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd new", "uuid": "22ca6a0f-6836-46df-a2b3-6dd040198cfe", "id": 7} v 0) v1 -- 0x7f540c0ccea0 con 0x7f540c15de50 2023-10-09T15:30:43.935 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.934+0000 7f54027fc700 1 -- 172.21.15.59:0/227732140 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "22ca6a0f-6836-46df-a2b3-6dd040198cfe", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7f540401b9f0 con 0x7f540c15de50 2023-10-09T15:30:43.935 INFO:teuthology.orchestra.run.smithi059.stdout:7 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 msgr2=0x7f540c0c83b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 0x7f540c0c83b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f540400c790 tx=0x7f54040015f0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 shutdown_connections 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f540c15de50 0x7f540c0c83b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f540c0cea00 0x7f540c156ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.936 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 --2- 172.21.15.59:0/227732140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f540c153a00 0x7f540c0b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:43.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 >> 172.21.15.59:0/227732140 conn(0x7f540c0703a0 msgr2=0x7f540c0c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:43.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 shutdown_connections 2023-10-09T15:30:43.937 INFO:teuthology.orchestra.run.smithi059.stderr:2023-10-09T15:30:43.935+0000 7f54133ea700 1 -- 172.21.15.59:0/227732140 wait complete. 2023-10-09T15:30:43.948 INFO:tasks.ceph.osd.0:Restarting daemon 2023-10-09T15:30:43.948 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-10-09T15:30:43.950 INFO:tasks.ceph.osd.0:Started 2023-10-09T15:30:43.950 INFO:tasks.ceph.osd.1:Restarting daemon 2023-10-09T15:30:43.950 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-10-09T15:30:43.952 INFO:tasks.ceph.osd.1:Started 2023-10-09T15:30:43.952 INFO:tasks.ceph.osd.2:Restarting daemon 2023-10-09T15:30:43.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-10-09T15:30:43.954 INFO:tasks.ceph.osd.2:Started 2023-10-09T15:30:43.954 INFO:tasks.ceph.osd.3:Restarting daemon 2023-10-09T15:30:43.955 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-10-09T15:30:43.957 INFO:tasks.ceph.osd.3:Started 2023-10-09T15:30:43.957 INFO:tasks.ceph.osd.4:Restarting daemon 2023-10-09T15:30:43.957 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-10-09T15:30:43.959 INFO:tasks.ceph.osd.4:Started 2023-10-09T15:30:43.959 INFO:tasks.ceph.osd.5:Restarting daemon 2023-10-09T15:30:43.959 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-10-09T15:30:43.961 INFO:tasks.ceph.osd.5:Started 2023-10-09T15:30:43.961 INFO:tasks.ceph.osd.6:Restarting daemon 2023-10-09T15:30:43.962 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-10-09T15:30:43.963 INFO:tasks.ceph.osd.6:Started 2023-10-09T15:30:43.963 INFO:tasks.ceph.osd.7:Restarting daemon 2023-10-09T15:30:43.964 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-10-09T15:30:43.966 INFO:tasks.ceph.osd.7:Started 2023-10-09T15:30:43.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:44.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.104+0000 7f7898a88700 1 Processor -- start 2023-10-09T15:30:44.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.104+0000 7f7898a88700 1 -- start start 2023-10-09T15:30:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.105+0000 7f7898a88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 0x7f789415b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.105+0000 7f7898a88700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f789415bbf0 con 0x7f789415b750 2023-10-09T15:30:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.105+0000 7f7898a88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7894158000 con 0x7f7894140e50 2023-10-09T15:30:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.105+0000 7f7898a88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940cb4d0 con 0x7f78940af730 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7892d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f789415b750 0x7f78940cc1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47026/0 (socket says 172.21.15.33:47026) 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7892d9d700 1 -- 172.21.15.33:0/1208547321 learned_addr learned my addr 172.21.15.33:0/1208547321 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7891d9b700 1 --2- 172.21.15.33:0/1208547321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 0x7f789415b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314177486 0 0) 0x7f7894158000 con 0x7f7894140e50 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7880003570 con 0x7f7894140e50 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1047551051 0 0) 0x7f789415bbf0 con 0x7f789415b750 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7894158000 con 0x7f789415b750 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7891d9b700 1 -- 172.21.15.33:0/1208547321 >> v1:172.21.15.59:6789/0 conn(0x7f7894140e50 legacy=0x7f78940af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7891d9b700 1 -- 172.21.15.33:0/1208547321 >> v1:172.21.15.33:6789/0 conn(0x7f789415b750 legacy=0x7f78940cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7891d9b700 1 -- 172.21.15.33:0/1208547321 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78940cbd10 con 0x7f78940af730 2023-10-09T15:30:44.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f7891d9b700 1 --2- 172.21.15.33:0/1208547321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 0x7f789415b210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f787c009910 tx=0x7f787c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=245e19292a13e974 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011630 con 0x7f78940af730 2023-10-09T15:30:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c011790 con 0x7f78940af730 2023-10-09T15:30:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.106+0000 7f789159a700 1 -- 172.21.15.33:0/1208547321 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011b30 con 0x7f78940af730 2023-10-09T15:30:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 -- 172.21.15.33:0/1208547321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 msgr2=0x7f789415b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 --2- 172.21.15.33:0/1208547321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 0x7f789415b210 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f787c009910 tx=0x7f787c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 -- 172.21.15.33:0/1208547321 shutdown_connections 2023-10-09T15:30:44.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 --2- 172.21.15.33:0/1208547321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78940af730 0x7f789415b210 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 -- 172.21.15.33:0/1208547321 >> 172.21.15.33:0/1208547321 conn(0x7f78940cded0 msgr2=0x7f789406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 -- 172.21.15.33:0/1208547321 shutdown_connections 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.107+0000 7f7898a88700 1 -- 172.21.15.33:0/1208547321 wait complete. 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.108+0000 7f7898a88700 1 Processor -- start 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.108+0000 7f7898a88700 1 -- start start 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78940af730 0x7f789416a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f789415b750 0x7f78940b1e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7894169b00 con 0x7f7894140e50 2023-10-09T15:30:44.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c7e20 con 0x7f78940af730 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7898a88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78940c7210 con 0x7f789415b750 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35634/0 (socket says 172.21.15.33:35634) 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 -- 172.21.15.33:0/3351128279 learned_addr learned my addr 172.21.15.33:0/3351128279 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f789259c700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78940af730 0x7f789416a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7892d9d700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f789415b750 0x7f78940b1e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 -- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f789415b750 msgr2=0x7f78940b1e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f789415b750 0x7f78940b1e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 -- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78940af730 msgr2=0x7f789416a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78940af730 0x7f789416a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 -- 172.21.15.33:0/3351128279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c009420 con 0x7f7894140e50 2023-10-09T15:30:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.109+0000 7f7891d9b700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f787c009f00 tx=0x7f787c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c01f070 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f787c002f70 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78940c74f0 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f787c011900 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78940c7ab0 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7f787c023070 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.110+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7f787c011a60 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.111+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f789404c3c0 con 0x7f7894140e50 2023-10-09T15:30:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.113+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7f787c02a070 con 0x7f7894140e50 2023-10-09T15:30:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.191+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f78940c7f60 con 0x7f7894140e50 2023-10-09T15:30:44.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.192+0000 7f788a7fc700 1 -- 172.21.15.33:0/3351128279 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7f787c015020 con 0x7f7894140e50 2023-10-09T15:30:44.193 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:44.193 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":10,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:43.928887+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 msgr2=0x7f78940b1920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f787c009f00 tx=0x7f787c017000 comp rx=0 tx=0).stop 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 shutdown_connections 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f789415b750 0x7f78940b1e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78940af730 0x7f789416a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 --2- 172.21.15.33:0/3351128279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7894140e50 0x7f78940b1920 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 >> 172.21.15.33:0/3351128279 conn(0x7f78940cded0 msgr2=0x7f78940af020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:44.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 shutdown_connections 2023-10-09T15:30:44.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:44.193+0000 7f7898a88700 1 -- 172.21.15.33:0/3351128279 wait complete. 2023-10-09T15:30:44.206 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-10-09T15:30:44.206 INFO:tasks.ceph:Waiting for OSDs to come up 2023-10-09T15:30:44.210 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:44.210+0000 7f927d8dd180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T15:30:44.236 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:44.235+0000 7f35842d6180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-10-09T15:30:44.292 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:44.291+0000 7f927d8dd180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T15:30:44.317 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:44.317+0000 7f35842d6180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-10-09T15:30:44.372 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:44.372+0000 7f927d8dd180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T15:30:44.398 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:44.398+0000 7f35842d6180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-10-09T15:30:44.554 INFO:tasks.ceph.osd.3.smithi033.stderr:2023-10-09T15:30:44.553+0000 7f1bf3cb0540 -1 Falling back to public interface 2023-10-09T15:30:44.565 INFO:tasks.ceph.osd.5.smithi059.stderr:2023-10-09T15:30:44.564+0000 7fc36ca66540 -1 Falling back to public interface 2023-10-09T15:30:44.565 INFO:tasks.ceph.osd.4.smithi059.stderr:2023-10-09T15:30:44.565+0000 7fe640892540 -1 Falling back to public interface 2023-10-09T15:30:44.570 INFO:tasks.ceph.osd.7.smithi059.stderr:2023-10-09T15:30:44.569+0000 7fe1e2393540 -1 Falling back to public interface 2023-10-09T15:30:44.578 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-09T15:30:44.577+0000 7f0c619ce540 -1 Falling back to public interface 2023-10-09T15:30:44.582 INFO:tasks.ceph.osd.1.smithi033.stderr:2023-10-09T15:30:44.581+0000 7f9f8bc2a540 -1 Falling back to public interface 2023-10-09T15:30:44.582 INFO:tasks.ceph.osd.2.smithi033.stderr:2023-10-09T15:30:44.581+0000 7f9aee6a4540 -1 Falling back to public interface 2023-10-09T15:30:44.583 INFO:tasks.ceph.osd.1.smithi033.stderr:2023-10-09T15:30:44.582+0000 7f9f86053700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6816/0: (98) Address already in use 2023-10-09T15:30:44.583 INFO:tasks.ceph.osd.6.smithi059.stderr:2023-10-09T15:30:44.581+0000 7f84c2885540 -1 Falling back to public interface 2023-10-09T15:30:44.585 INFO:tasks.ceph.osd.2.smithi033.stderr:2023-10-09T15:30:44.585+0000 7f9ae8acd700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6827/0: (98) Address already in use 2023-10-09T15:30:44.982 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:44.981+0000 7f927d8dd180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T15:30:45.012 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:45.021 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:45.020+0000 7f35842d6180 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-10-09T15:30:45.122 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.121+0000 7fa470e23700 1 Processor -- start 2023-10-09T15:30:45.122 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.121+0000 7fa470e23700 1 -- start start 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa470e23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 0x7fa46c0c7ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa470e23700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0c8550 con 0x7fa46c0c80e0 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa470e23700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa46c0b0450 con 0x7fa46c0cbff0 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa470e23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0ccde0 con 0x7fa46c159a50 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa469d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa46c0c80e0 0x7fa46c0cb8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47042/0 (socket says 172.21.15.33:47042) 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa469d9b700 1 -- 172.21.15.33:0/301928905 learned_addr learned my addr 172.21.15.33:0/301928905 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:45.124 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.122+0000 7fa46a59c700 1 --2- 172.21.15.33:0/301928905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 0x7fa46c0c7ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3897092865 0 0) 0x7fa46c0c8550 con 0x7fa46c0c80e0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa454003570 con 0x7fa46c0c80e0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1804443208 0 0) 0x7fa46c0b0450 con 0x7fa46c0cbff0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa46c0c8550 con 0x7fa46c0cbff0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46a59c700 1 -- 172.21.15.33:0/301928905 >> v1:172.21.15.59:6789/0 conn(0x7fa46c0cbff0 legacy=0x7fa46c0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46a59c700 1 -- 172.21.15.33:0/301928905 >> v1:172.21.15.33:6789/0 conn(0x7fa46c0c80e0 legacy=0x7fa46c0cb8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46a59c700 1 -- 172.21.15.33:0/301928905 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa46c0ce100 con 0x7fa46c159a50 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46a59c700 1 --2- 172.21.15.33:0/301928905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 0x7fa46c0c7ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009e90 tx=0x7fa45c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=34ede23107832ec1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c00e070 con 0x7fa46c159a50 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00bb80 con 0x7fa46c159a50 2023-10-09T15:30:45.125 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.123+0000 7fa46959a700 1 -- 172.21.15.33:0/301928905 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c012430 con 0x7fa46c159a50 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 -- 172.21.15.33:0/301928905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 msgr2=0x7fa46c0c7ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 --2- 172.21.15.33:0/301928905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 0x7fa46c0c7ba0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fa45c009e90 tx=0x7fa45c009780 comp rx=0 tx=0).stop 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 -- 172.21.15.33:0/301928905 shutdown_connections 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 --2- 172.21.15.33:0/301928905 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c159a50 0x7fa46c0c7ba0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 -- 172.21.15.33:0/301928905 >> 172.21.15.33:0/301928905 conn(0x7fa46c0ca930 msgr2=0x7fa46c0cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 -- 172.21.15.33:0/301928905 shutdown_connections 2023-10-09T15:30:45.128 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.124+0000 7fa470e23700 1 -- 172.21.15.33:0/301928905 wait complete. 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.125+0000 7fa470e23700 1 Processor -- start 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.125+0000 7fa470e23700 1 -- start start 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c0cbff0 0x7fa46c0c5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c159a50 0x7fa46c0c2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c15c940 con 0x7fa46c0c80e0 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0c6d40 con 0x7fa46c159a50 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa46c0c64a0 con 0x7fa46c0cbff0 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35640/0 (socket says 172.21.15.33:35640) 2023-10-09T15:30:45.129 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 -- 172.21.15.33:0/1641734012 learned_addr learned my addr 172.21.15.33:0/1641734012 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa469d9b700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c0cbff0 0x7fa46c0c5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46ad9d700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c159a50 0x7fa46c0c2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 -- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c0cbff0 msgr2=0x7fa46c0c5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c0cbff0 0x7fa46c0c5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 -- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c159a50 msgr2=0x7fa46c0c2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c159a50 0x7fa46c0c2c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 -- 172.21.15.33:0/1641734012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa45c009a20 con 0x7fa46c0c80e0 2023-10-09T15:30:45.130 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa46a59c700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097c0 tx=0x7fa45c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c009420 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45c00be40 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa46c0c6780 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.126+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45c0276c0 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.127+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa46c0c6170 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.127+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 1) v1 ==== 521+0+0 (secure 0 0 0) 0x7fa45c024070 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.127+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1641+0+0 (secure 0 0 0) 0x7fa45c01db00 con 0x7fa46c0c80e0 2023-10-09T15:30:45.131 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:45.127+0000 7f927d8dd180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T15:30:45.132 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.127+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa46c04c3c0 con 0x7fa46c0c80e0 2023-10-09T15:30:45.132 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.129+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+71349 (secure 0 0 0) 0x7fa45c0476d0 con 0x7fa46c0c80e0 2023-10-09T15:30:45.165 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:45.164+0000 7f35842d6180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-10-09T15:30:45.201 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.200+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa46c0cc540 con 0x7fa46c0c80e0 2023-10-09T15:30:45.201 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.201+0000 7fa45a7fc700 1 -- 172.21.15.33:0/1641734012 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7013 (secure 0 0 0) 0x7fa45c036030 con 0x7fa46c0c80e0 2023-10-09T15:30:45.202 INFO:teuthology.misc.health.smithi033.stdout: 2023-10-09T15:30:45.202 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":10,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:43.928887+0000","last_up_change":"0.000000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 msgr2=0x7fa46c0c56f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa45c0097c0 tx=0x7fa45c019000 comp rx=0 tx=0).stop 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 shutdown_connections 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa46c0c80e0 0x7fa46c0c56f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa46c159a50 0x7fa46c0c2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 --2- 172.21.15.33:0/1641734012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa46c0cbff0 0x7fa46c0c5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 >> 172.21.15.33:0/1641734012 conn(0x7fa46c0ca930 msgr2=0x7fa46c15b610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 shutdown_connections 2023-10-09T15:30:45.203 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:45.202+0000 7fa470e23700 1 -- 172.21.15.33:0/1641734012 wait complete. 2023-10-09T15:30:45.213 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-10-09T15:30:45.216 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:45.216+0000 7f927d8dd180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T15:30:45.263 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:45.263+0000 7f35842d6180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-10-09T15:30:45.475 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:45.475+0000 7f927d8dd180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T15:30:45.522 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:45.522+0000 7f35842d6180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-10-09T15:30:45.555 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:45.555+0000 7f927d8dd180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T15:30:45.603 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:45.602+0000 7f35842d6180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-10-09T15:30:46.424 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.425+0000 7f927d8dd180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T15:30:46.463 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:46.462+0000 7f35842d6180 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-10-09T15:30:46.501 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.502+0000 7f927d8dd180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T15:30:46.540 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:46.539+0000 7f35842d6180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-10-09T15:30:46.579 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.579+0000 7f927d8dd180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T15:30:46.617 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:46.617+0000 7f35842d6180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-10-09T15:30:46.718 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.718+0000 7f927d8dd180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T15:30:46.757 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:46.757+0000 7f35842d6180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-10-09T15:30:46.807 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.807+0000 7f927d8dd180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T15:30:46.846 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:46.845+0000 7f35842d6180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-10-09T15:30:46.966 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:46.966+0000 7f927d8dd180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T15:30:47.005 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:47.004+0000 7f35842d6180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-10-09T15:30:47.048 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:47.048+0000 7f927d8dd180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T15:30:47.093 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:47.093+0000 7f35842d6180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-10-09T15:30:47.132 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:47.132+0000 7f927d8dd180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T15:30:47.172 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:47.171+0000 7f35842d6180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-10-09T15:30:47.213 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:47.214+0000 7f927d8dd180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T15:30:47.251 INFO:tasks.ceph.mgr.x.smithi059.stderr:2023-10-09T15:30:47.250+0000 7f35842d6180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-10-09T15:30:47.849 INFO:tasks.ceph.osd.2.smithi033.stderr:2023-10-09T15:30:47.849+0000 7f9aee6a4540 -1 osd.2 0 log_to_monitors true 2023-10-09T15:30:48.026 INFO:tasks.ceph.osd.3.smithi033.stderr:2023-10-09T15:30:48.027+0000 7f1bf3cb0540 -1 osd.3 0 log_to_monitors true 2023-10-09T15:30:48.036 INFO:tasks.ceph.osd.5.smithi059.stderr:2023-10-09T15:30:48.036+0000 7fc36ca66540 -1 osd.5 0 log_to_monitors true 2023-10-09T15:30:48.075 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-09T15:30:48.075+0000 7f0c619ce540 -1 osd.0 0 log_to_monitors true 2023-10-09T15:30:48.082 INFO:tasks.ceph.osd.6.smithi059.stderr:2023-10-09T15:30:48.081+0000 7f84c2885540 -1 osd.6 0 log_to_monitors true 2023-10-09T15:30:48.082 INFO:tasks.ceph.osd.7.smithi059.stderr:2023-10-09T15:30:48.082+0000 7fe1e2393540 -1 osd.7 0 log_to_monitors true 2023-10-09T15:30:48.086 INFO:tasks.ceph.osd.4.smithi059.stderr:2023-10-09T15:30:48.086+0000 7fe640892540 -1 osd.4 0 log_to_monitors true 2023-10-09T15:30:48.091 INFO:tasks.ceph.osd.1.smithi033.stderr:2023-10-09T15:30:48.092+0000 7f9f8bc2a540 -1 osd.1 0 log_to_monitors true 2023-10-09T15:30:48.238 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:48.238+0000 7f9236cde700 -1 mgr.server handle_report got status from non-daemon mon.c 2023-10-09T15:30:48.238 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:30:48.238+0000 7f9236cde700 -1 mgr.server handle_report got status from non-daemon mon.b 2023-10-09T15:30:51.323 INFO:tasks.ceph.osd.4.smithi059.stderr:2023-10-09T15:30:51.322+0000 7fe6374b4700 -1 osd.4 0 waiting for initial osdmap 2023-10-09T15:30:51.324 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-09T15:30:51.325+0000 7f0c585f0700 -1 osd.0 0 waiting for initial osdmap 2023-10-09T15:30:51.330 INFO:tasks.ceph.osd.4.smithi059.stderr:2023-10-09T15:30:51.329+0000 7fe6302ab700 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.330 INFO:tasks.ceph.osd.0.smithi033.stderr:2023-10-09T15:30:51.330+0000 7f0c513e7700 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.346 INFO:tasks.ceph.osd.1.smithi033.stderr:2023-10-09T15:30:51.346+0000 7f9f8404f700 -1 osd.1 0 waiting for initial osdmap 2023-10-09T15:30:51.352 INFO:tasks.ceph.osd.1.smithi033.stderr:2023-10-09T15:30:51.353+0000 7f9f7b643700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.361 INFO:tasks.ceph.osd.7.smithi059.stderr:2023-10-09T15:30:51.361+0000 7fe1d8fb5700 -1 osd.7 0 waiting for initial osdmap 2023-10-09T15:30:51.365 INFO:tasks.ceph.osd.5.smithi059.stderr:2023-10-09T15:30:51.365+0000 7fc363688700 -1 osd.5 0 waiting for initial osdmap 2023-10-09T15:30:51.367 INFO:tasks.ceph.osd.7.smithi059.stderr:2023-10-09T15:30:51.366+0000 7fe1d1dac700 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.368 INFO:tasks.ceph.osd.6.smithi059.stderr:2023-10-09T15:30:51.367+0000 7f84b94a7700 -1 osd.6 0 waiting for initial osdmap 2023-10-09T15:30:51.371 INFO:tasks.ceph.osd.5.smithi059.stderr:2023-10-09T15:30:51.370+0000 7fc35c47f700 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.375 INFO:tasks.ceph.osd.6.smithi059.stderr:2023-10-09T15:30:51.375+0000 7f84b229e700 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.379 INFO:tasks.ceph.osd.3.smithi033.stderr:2023-10-09T15:30:51.379+0000 7f1bec0d5700 -1 osd.3 0 waiting for initial osdmap 2023-10-09T15:30:51.383 INFO:tasks.ceph.osd.3.smithi033.stderr:2023-10-09T15:30:51.383+0000 7f1be36c9700 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:51.384 INFO:tasks.ceph.osd.2.smithi033.stderr:2023-10-09T15:30:51.384+0000 7f9ae6ac9700 -1 osd.2 0 waiting for initial osdmap 2023-10-09T15:30:51.388 INFO:tasks.ceph.osd.2.smithi033.stderr:2023-10-09T15:30:51.389+0000 7f9ade0bd700 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-10-09T15:30:52.019 DEBUG:teuthology.orchestra.run.smithi033:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:52.143 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.143+0000 7f7459c59700 1 Processor -- start 2023-10-09T15:30:52.143 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.143+0000 7f7459c59700 1 -- start start 2023-10-09T15:30:52.145 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7459c59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f745415dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.145 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7459c59700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74540cd720 0x7f74540caf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.145 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7459c59700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74540cc2b0 con 0x7f74540ce580 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7459c59700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74540cb490 con 0x7f74540cd720 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7459c59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540cb6a0 con 0x7f74540cd350 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74540cd720 0x7f74540caf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74540cd720 0x7f74540caf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55610/0 (socket says 172.21.15.33:55610) 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 -- 172.21.15.33:0/3100579176 learned_addr learned my addr 172.21.15.33:0/3100579176 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7453fff700 1 --1- 172.21.15.33:0/3100579176 >> v1:172.21.15.33:6789/0 conn(0x7f74540ce580 0x7f74540cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58790/0 (socket says 172.21.15.33:58790) 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f74537fe700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f745415dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 -- 172.21.15.33:0/3100579176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 msgr2=0x7f745415dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f745415dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.146 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 -- 172.21.15.33:0/3100579176 >> v1:172.21.15.33:6789/0 conn(0x7f74540ce580 legacy=0x7f74540cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f74527fc700 1 -- 172.21.15.33:0/3100579176 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3925132563 0 0) 0x7f74540cc2b0 con 0x7f74540ce580 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 -- 172.21.15.33:0/3100579176 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74540cb980 con 0x7f74540cd720 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.144+0000 7f7452ffd700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540cd720 0x7f74540caf50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74480099b0 tx=0x7f7448009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65616787a623f3e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f74527fc700 1 -- 172.21.15.33:0/3100579176 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800b860 con 0x7f74540cd720 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f74527fc700 1 -- 172.21.15.33:0/3100579176 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744800b9c0 con 0x7f74540cd720 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f74527fc700 1 -- 172.21.15.33:0/3100579176 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744800bd60 con 0x7f74540cd720 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 -- 172.21.15.33:0/3100579176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540cd720 msgr2=0x7f74540caf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540cd720 0x7f74540caf50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f74480099b0 tx=0x7f7448009250 comp rx=0 tx=0).stop 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 -- 172.21.15.33:0/3100579176 shutdown_connections 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f745415dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 --2- 172.21.15.33:0/3100579176 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540cd720 0x7f74540caf50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.147 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 -- 172.21.15.33:0/3100579176 >> 172.21.15.33:0/3100579176 conn(0x7f7454099a70 msgr2=0x7f745406cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:52.148 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 -- 172.21.15.33:0/3100579176 shutdown_connections 2023-10-09T15:30:52.148 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.145+0000 7f7459c59700 1 -- 172.21.15.33:0/3100579176 wait complete. 2023-10-09T15:30:52.150 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 Processor -- start 2023-10-09T15:30:52.150 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 -- start start 2023-10-09T15:30:52.150 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f7454153810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.150 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540cd720 0x7f74540b4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540c7710 con 0x7f74540ce580 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74540b5150 con 0x7f74540cd720 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7459c59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74540c7960 con 0x7f74540cd350 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7453fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7453fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55618/0 (socket says 172.21.15.33:55618) 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.147+0000 7f7453fff700 1 -- 172.21.15.33:0/2160099408 learned_addr learned my addr 172.21.15.33:0/2160099408 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f74537fe700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f7454153810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7452ffd700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540cd720 0x7f74540b4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 -- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 msgr2=0x7f7454153810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f7454153810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.151 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 -- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540cd720 msgr2=0x7f74540b4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540cd720 0x7f74540b4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 -- 172.21.15.33:0/2160099408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74480094f0 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7453fff700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f744c00ccc0 tx=0x7f744c001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c005df0 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c00a600 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74540c7c40 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c00a9c0 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.148+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74540c8440 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.149+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745404c3c0 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.150+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f744c0070f0 con 0x7f74540ce580 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.150+0000 7f743b7fe700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 0x7f7440069380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.152 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.150+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2227+0+0 (secure 0 0 0) 0x7f744c083680 con 0x7f74540ce580 2023-10-09T15:30:52.153 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.150+0000 7f74537fe700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 0x7f7440069380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.153 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.150+0000 7f74537fe700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 0x7f7440069380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7444006aa0 tx=0x7f7444008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.154 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.155+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f744c0517e0 con 0x7f74540ce580 2023-10-09T15:30:52.358 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.358+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74540cbc60 con 0x7f74540ce580 2023-10-09T15:30:52.358 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.359+0000 7f743b7fe700 1 -- 172.21.15.33:0/2160099408 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f744c00ad70 con 0x7f74540ce580 2023-10-09T15:30:52.359 INFO:teuthology.misc.health.smithi033.stdout: 2023-10-09T15:30:52.359 INFO:teuthology.misc.health.smithi033.stdout:{"epoch":13,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:52.334027+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:30:52.361 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 msgr2=0x7f7440069380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.361 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 0x7f7440069380 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7444006aa0 tx=0x7f7444008040 comp rx=0 tx=0).stop 2023-10-09T15:30:52.361 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 msgr2=0x7f74540add90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.361 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f744c00ccc0 tx=0x7f744c001a70 comp rx=0 tx=0).stop 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 shutdown_connections 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7440066ed0 0x7f7440069380 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74540ce580 0x7f74540add90 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74540cd350 0x7f7454153810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 --2- 172.21.15.33:0/2160099408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74540cd720 0x7f74540b4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 >> 172.21.15.33:0/2160099408 conn(0x7f7454099a70 msgr2=0x7f745415a610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 shutdown_connections 2023-10-09T15:30:52.362 INFO:teuthology.misc.health.smithi033.stderr:2023-10-09T15:30:52.361+0000 7f7459c59700 1 -- 172.21.15.33:0/2160099408 wait complete. 2023-10-09T15:30:52.372 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-10-09T15:30:52.372 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-10-09T15:30:52.372 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:30:52.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:30:52.374 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:30:52.375 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:30:52.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:30:52.376 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:30:52.377 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:30:52.377 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:30:52.379 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:30:52.379 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:30:52.379 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:30:52.381 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:30:52.381 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-10-09T15:30:52.382 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:52.450 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:30:52.451 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:30:52.452 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:30:52.452+0000 7fb0fb760700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T15:30:52.461 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:30:52.461 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:30:52.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.507+0000 7f3bbac9b700 1 Processor -- start 2023-10-09T15:30:52.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.507+0000 7f3bbac9b700 1 -- start start 2023-10-09T15:30:52.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bbac9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bbac9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bbac9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb40c3d00 con 0x7f3bb40c95c0 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bbac9b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb40c3110 con 0x7f3bb40aaec0 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bbac9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb40c33d0 con 0x7f3bb40caa00 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bba49a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bb9498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bb9c99700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f3bb40c95c0 0x7f3bb4157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:37328/0 (socket says 172.21.15.33:37328) 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bb9498700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:42462/0 (socket says 172.21.15.33:42462) 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bba49a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:35480/0 (socket says 172.21.15.33:35480) 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.508+0000 7f3bb9498700 1 -- 172.21.15.33:0/4137737710 learned_addr learned my addr 172.21.15.33:0/4137737710 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb9498700 1 -- 172.21.15.33:0/4137737710 >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 msgr2=0x7f3bb40c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb9498700 1 --2- 172.21.15.33:0/4137737710 >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb9498700 1 -- 172.21.15.33:0/4137737710 >> v1:172.21.15.59:6789/0 conn(0x7f3bb40c95c0 legacy=0x7f3bb4157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb9498700 1 -- 172.21.15.33:0/4137737710 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb40c36b0 con 0x7f3bb40caa00 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bba49a700 1 --2- 172.21.15.33:0/4137737710 >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb9498700 1 --2- 172.21.15.33:0/4137737710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40099b0 tx=0x7f3ba4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc0a114781c5b22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb8c97700 1 -- 172.21.15.33:0/4137737710 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4009ea0 con 0x7f3bb40caa00 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb8c97700 1 -- 172.21.15.33:0/4137737710 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba400b860 con 0x7f3bb40caa00 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bb8c97700 1 -- 172.21.15.33:0/4137737710 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400bc00 con 0x7f3bb40caa00 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bbac9b700 1 -- 172.21.15.33:0/4137737710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 msgr2=0x7f3bb41579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.509+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/4137737710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40099b0 tx=0x7f3ba4009250 comp rx=0 tx=0).stop 2023-10-09T15:30:52.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 -- 172.21.15.33:0/4137737710 shutdown_connections 2023-10-09T15:30:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/4137737710 >> v2:172.21.15.59:3300/0 conn(0x7f3bb40aaec0 0x7f3bb40c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/4137737710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40caa00 0x7f3bb41579a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 -- 172.21.15.33:0/4137737710 >> 172.21.15.33:0/4137737710 conn(0x7f3bb4088000 msgr2=0x7f3bb40ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 -- 172.21.15.33:0/4137737710 shutdown_connections 2023-10-09T15:30:52.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.510+0000 7f3bbac9b700 1 -- 172.21.15.33:0/4137737710 wait complete. 2023-10-09T15:30:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.511+0000 7f3bbac9b700 1 Processor -- start 2023-10-09T15:30:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.511+0000 7f3bbac9b700 1 -- start start 2023-10-09T15:30:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.511+0000 7f3bbac9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.511+0000 7f3bbac9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bbac9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bbac9b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4156860 con 0x7f3bb406ed70 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bbac9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4156cf0 con 0x7f3bb40c95c0 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bbac9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb4155c50 con 0x7f3bb40aaec0 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9c99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9498700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55660/0 (socket says 172.21.15.33:55660) 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9c99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:42474/0 (socket says 172.21.15.33:42474) 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9498700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:35492/0 (socket says 172.21.15.33:35492) 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 -- 172.21.15.33:0/3078211243 learned_addr learned my addr 172.21.15.33:0/3078211243 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 -- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 msgr2=0x7f3bb414fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 -- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 msgr2=0x7f3bb406e830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 -- 172.21.15.33:0/3078211243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac009a20 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9498700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bb9c99700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bba49a700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009fc0 tx=0x7f3bac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac00cbd0 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bac00f040 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bac014480 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.512+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ba40094f0 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.513+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb4156210 con 0x7f3bb406ed70 2023-10-09T15:30:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.513+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb404c3c0 con 0x7f3bb406ed70 2023-10-09T15:30:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.514+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f3bac003020 con 0x7f3bb406ed70 2023-10-09T15:30:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.514+0000 7f3ba9ffb700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 0x7f3b98069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.514+0000 7f3bb9c99700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 0x7f3b98069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.514+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f3bac084870 con 0x7f3bb406ed70 2023-10-09T15:30:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.515+0000 7f3bb9c99700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 0x7f3b98069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40ada80 tx=0x7f3bb0007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.519+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3bac052090 con 0x7f3bb406ed70 2023-10-09T15:30:52.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.716+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb40c3990 con 0x7f3bb406ed70 2023-10-09T15:30:52.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.717+0000 7f3ba9ffb700 1 -- 172.21.15.33:0/3078211243 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+10348 (secure 0 0 0) 0x7f3bac0556b0 con 0x7f3bb406ed70 2023-10-09T15:30:52.717 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:52.717 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":13,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:52.334027+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:30:52.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 msgr2=0x7f3b98069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 0x7f3b98069350 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3bb40ada80 tx=0x7f3bb0007ea0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 msgr2=0x7f3bb415be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3bac009fc0 tx=0x7f3bac00b040 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 shutdown_connections 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b98066ea0 0x7f3b98069350 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb406ed70 0x7f3bb415be00 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb40aaec0 0x7f3bb414fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 --2- 172.21.15.33:0/3078211243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb40c95c0 0x7f3bb406e830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 >> 172.21.15.33:0/3078211243 conn(0x7f3bb4088000 msgr2=0x7f3bb4069060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 shutdown_connections 2023-10-09T15:30:52.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.719+0000 7f3bbac9b700 1 -- 172.21.15.33:0/3078211243 wait complete. 2023-10-09T15:30:52.731 INFO:tasks.cephfs.filesystem.ceph_manager:[] 2023-10-09T15:30:52.731 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:30:52.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.851+0000 7f6ca9c79700 1 Processor -- start 2023-10-09T15:30:52.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.851+0000 7f6ca9c79700 1 -- start start 2023-10-09T15:30:52.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca9c79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ca40cb970 0x7f6ca4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca9c79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca9c79700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ca415ae40 con 0x7f6ca40cb5a0 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca9c79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ca40ce0f0 con 0x7f6ca40cb970 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca9c79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40d13f0 con 0x7f6ca415a400 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ca40cb970 0x7f6ca4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:42478/0 (socket says 172.21.15.33:42478) 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca3fff700 1 -- 172.21.15.33:0/2351055688 learned_addr learned my addr 172.21.15.33:0/2351055688 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca37fe700 1 --1- 172.21.15.33:0/2351055688 >> v1:172.21.15.59:6789/0 conn(0x7f6ca40cb5a0 0x7f6ca40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:37338/0 (socket says 172.21.15.33:37338) 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 msgr2=0x7f6ca4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca2ffd700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2351055688 >> v1:172.21.15.59:6789/0 conn(0x7f6ca40cb5a0 legacy=0x7f6ca40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2351055688 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ca415ab60 con 0x7f6ca40cb970 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca27fc700 1 -- 172.21.15.33:0/2351055688 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1256261890 0 0) 0x7f6ca415ae40 con 0x7f6ca40cb5a0 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.852+0000 7f6ca3fff700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca2ffd700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca40cb970 0x7f6ca4159ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c980098e0 tx=0x7f6c980091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ffc42b90510361c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca27fc700 1 -- 172.21.15.33:0/2351055688 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800b640 con 0x7f6ca40cb970 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca27fc700 1 -- 172.21.15.33:0/2351055688 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c9800b7a0 con 0x7f6ca40cb970 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca27fc700 1 -- 172.21.15.33:0/2351055688 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800bb40 con 0x7f6ca40cb970 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca40cb970 msgr2=0x7f6ca4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca40cb970 0x7f6ca4159ec0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f6c980098e0 tx=0x7f6c980091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2351055688 shutdown_connections 2023-10-09T15:30:52.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca415a400 0x7f6ca4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2351055688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca40cb970 0x7f6ca4159ec0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2351055688 >> 172.21.15.33:0/2351055688 conn(0x7f6ca4070e30 msgr2=0x7f6ca40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:52.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2351055688 shutdown_connections 2023-10-09T15:30:52.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.853+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2351055688 wait complete. 2023-10-09T15:30:52.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.854+0000 7f6ca9c79700 1 Processor -- start 2023-10-09T15:30:52.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 -- start start 2023-10-09T15:30:52.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca40cb5a0 0x7f6ca40ca130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca415a400 0x7f6ca40c83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40ca670 con 0x7f6ca40cb970 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c9ca0 con 0x7f6ca415a400 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca9c79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ca40c9090 con 0x7f6ca40cb5a0 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55670/0 (socket says 172.21.15.33:55670) 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.855+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2782334975 learned_addr learned my addr 172.21.15.33:0/2782334975 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca3fff700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca415a400 0x7f6ca40c83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca40cb5a0 0x7f6ca40ca130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca40cb5a0 msgr2=0x7f6ca40ca130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca40cb5a0 0x7f6ca40ca130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca415a400 msgr2=0x7f6ca40c83a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca415a400 0x7f6ca40c83a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 -- 172.21.15.33:0/2782334975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0094f0 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca2ffd700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009f80 tx=0x7f6c98017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c9800bb20 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c98011420 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c98011800 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c98009420 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.856+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ca40c9650 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.857+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ca40c9e10 con 0x7f6ca40cb970 2023-10-09T15:30:52.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.857+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f6c98011c30 con 0x7f6ca40cb970 2023-10-09T15:30:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.858+0000 7f6c8b7fe700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 0x7f6c90069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.858+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 4467+0+0 (secure 0 0 0) 0x7f6c98085a10 con 0x7f6ca40cb970 2023-10-09T15:30:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.858+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 0x7f6c90069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.858+0000 7f6ca37fe700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 0x7f6c90069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001f50 tx=0x7f6c94005cf0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:52.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:52.862+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c98053230 con 0x7f6ca40cb970 2023-10-09T15:30:53.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.102+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ca404c3c0 con 0x7f6ca40cb970 2023-10-09T15:30:53.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.102+0000 7f6c8b7fe700 1 -- 172.21.15.33:0/2782334975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1256 (secure 0 0 0) 0x7f6c98056850 con 0x7f6ca40cb970 2023-10-09T15:30:53.102 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:53.102 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-10-09T15:30:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 msgr2=0x7f6c90069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 0x7f6c90069350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f6c94001f50 tx=0x7f6c94005cf0 comp rx=0 tx=0).stop 2023-10-09T15:30:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 msgr2=0x7f6ca40b59f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009f80 tx=0x7f6c98017000 comp rx=0 tx=0).stop 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 shutdown_connections 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c90066ea0 0x7f6c90069350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ca415a400 0x7f6ca40c83a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ca40cb5a0 0x7f6ca40ca130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 --2- 172.21.15.33:0/2782334975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ca40cb970 0x7f6ca40b59f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 >> 172.21.15.33:0/2782334975 conn(0x7f6ca4070e30 msgr2=0x7f6ca40b2450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 shutdown_connections 2023-10-09T15:30:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:53.104+0000 7f6ca9c79700 1 -- 172.21.15.33:0/2782334975 wait complete. 2023-10-09T15:30:53.106 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 2 2023-10-09T15:30:55.117 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:30:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.243+0000 7f10c2572700 1 Processor -- start 2023-10-09T15:30:55.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.243+0000 7f10c2572700 1 -- start start 2023-10-09T15:30:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c2572700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10bc0a90d0 0x7f10bc06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c2572700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 0x7f10bc0af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c2572700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc0aeee0 con 0x7f10bc0a8d00 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c2572700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc06e820 con 0x7f10bc0a90d0 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c2572700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0ae680 con 0x7f10bc06e380 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10bb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f10bc0a90d0 0x7f10bc06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10bbfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f10bc0a8d00 0x7f10bc0cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58816/0 (socket says 172.21.15.33:58816) 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10bbfff700 1 -- 172.21.15.33:0/2116963304 learned_addr learned my addr 172.21.15.33:0/2116963304 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.244+0000 7f10c0b0f700 1 --2- 172.21.15.33:0/2116963304 >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 0x7f10bc0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10baffd700 1 -- 172.21.15.33:0/2116963304 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 215202185 0 0) 0x7f10bc0aeee0 con 0x7f10bc0a8d00 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10baffd700 1 -- 172.21.15.33:0/2116963304 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10a4003570 con 0x7f10bc0a8d00 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10bb7fe700 1 -- 172.21.15.33:0/2116963304 >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 msgr2=0x7f10bc0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/2116963304 >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 0x7f10bc0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10bb7fe700 1 -- 172.21.15.33:0/2116963304 >> v1:172.21.15.33:6789/0 conn(0x7f10bc0a8d00 legacy=0x7f10bc0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10bb7fe700 1 -- 172.21.15.33:0/2116963304 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0cf490 con 0x7f10bc0a90d0 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10c0b0f700 1 --2- 172.21.15.33:0/2116963304 >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 0x7f10bc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:55.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/2116963304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0a90d0 0x7f10bc06de40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098d0 tx=0x7f10ac009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab91ef20458f3c6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10baffd700 1 -- 172.21.15.33:0/2116963304 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac005c10 con 0x7f10bc0a90d0 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10baffd700 1 -- 172.21.15.33:0/2116963304 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac005d70 con 0x7f10bc0a90d0 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.245+0000 7f10baffd700 1 -- 172.21.15.33:0/2116963304 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac006260 con 0x7f10bc0a90d0 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 -- 172.21.15.33:0/2116963304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0a90d0 msgr2=0x7f10bc06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 --2- 172.21.15.33:0/2116963304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0a90d0 0x7f10bc06de40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098d0 tx=0x7f10ac009120 comp rx=0 tx=0).stop 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 -- 172.21.15.33:0/2116963304 shutdown_connections 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 --2- 172.21.15.33:0/2116963304 >> v2:172.21.15.59:3300/0 conn(0x7f10bc06e380 0x7f10bc0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 --2- 172.21.15.33:0/2116963304 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0a90d0 0x7f10bc06de40 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 -- 172.21.15.33:0/2116963304 >> 172.21.15.33:0/2116963304 conn(0x7f10bc06ce80 msgr2=0x7f10bc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:55.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 -- 172.21.15.33:0/2116963304 shutdown_connections 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.246+0000 7f10c2572700 1 -- 172.21.15.33:0/2116963304 wait complete. 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.247+0000 7f10c2572700 1 Processor -- start 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.247+0000 7f10c2572700 1 -- start start 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0a8d00 0x7f10bc0690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0a90d0 0x7f10bc1565c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15d070 con 0x7f10bc06e380 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15c460 con 0x7f10bc0a90d0 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c2572700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15c740 con 0x7f10bc0a8d00 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55706/0 (socket says 172.21.15.33:55706) 2023-10-09T15:30:55.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 -- 172.21.15.33:0/394083882 learned_addr learned my addr 172.21.15.33:0/394083882 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10c0b0f700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0a90d0 0x7f10bc1565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0a8d00 0x7f10bc0690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 -- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0a8d00 msgr2=0x7f10bc0690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0a8d00 0x7f10bc0690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 -- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0a90d0 msgr2=0x7f10bc1565c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0a90d0 0x7f10bc1565c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 -- 172.21.15.33:0/394083882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10b4009a20 con 0x7f10bc06e380 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10bbfff700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c790 tx=0x7f10b0007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b00072e0 con 0x7f10bc06e380 2023-10-09T15:30:55.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.248+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10b0007440 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.249+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10ac0093c0 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.249+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b00057f0 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.249+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc15cd00 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.249+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc04c3c0 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.250+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 4) v1 ==== 84684+0+0 (secure 0 0 0) 0x7f10b0005c20 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.250+0000 7f10a3fff700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 0x7f10a8069350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.250+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f10b00833b0 con 0x7f10bc06e380 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.250+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 0x7f10a8069350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.251+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 0x7f10a8069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098d0 tx=0x7f10ac016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.258+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10b004b5a0 con 0x7f10bc06e380 2023-10-09T15:30:55.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.511+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f10bc0a8640 con 0x7f10bc06e380 2023-10-09T15:30:55.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.511+0000 7f10a3fff700 1 -- 172.21.15.33:0/394083882 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3518 (secure 0 0 0) 0x7f10b0017090 con 0x7f10bc06e380 2023-10-09T15:30:55.511 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:55.512 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4279,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.513+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 msgr2=0x7f10a8069350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.513+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 0x7f10a8069350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0098d0 tx=0x7f10ac016000 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.513+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 msgr2=0x7f10bc15bb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.513+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f10b000c790 tx=0x7f10b0007c80 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 shutdown_connections 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066ea0 0x7f10a8069350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc06e380 0x7f10bc15bb10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0a90d0 0x7f10bc1565c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 --2- 172.21.15.33:0/394083882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0a8d00 0x7f10bc0690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 >> 172.21.15.33:0/394083882 conn(0x7f10bc06ce80 msgr2=0x7f10bc0afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:55.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 shutdown_connections 2023-10-09T15:30:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.514+0000 7f10c2572700 1 -- 172.21.15.33:0/394083882 wait complete. 2023-10-09T15:30:55.515 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 3 2023-10-09T15:30:55.527 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:55.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 Processor -- start 2023-10-09T15:30:55.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 -- start start 2023-10-09T15:30:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 0x7f6efc0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6efc0ce1a0 con 0x7f6efc0a8be0 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6efc0cd5d0 con 0x7f6efc0aee90 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.652+0000 7f6f02d79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc0cd870 con 0x7f6efc06d280 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 0x7f6efc0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efbfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:35548/0 (socket says 172.21.15.33:35548) 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f00b15700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6efc0a8be0 0x7f6efc0ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:37346/0 (socket says 172.21.15.33:37346) 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efbfff700 1 -- 172.21.15.33:0/2606024241 learned_addr learned my addr 172.21.15.33:0/2606024241 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 -- 172.21.15.33:0/2606024241 >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 msgr2=0x7f6efc0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 --2- 172.21.15.33:0/2606024241 >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 -- 172.21.15.33:0/2606024241 >> v1:172.21.15.59:6789/0 conn(0x7f6efc0a8be0 legacy=0x7f6efc0ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 -- 172.21.15.33:0/2606024241 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6efc0cdb50 con 0x7f6efc06d280 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efb7fe700 1 -- 172.21.15.33:0/2606024241 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097390325 0 0) 0x7f6efc0ce1a0 con 0x7f6efc0a8be0 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efbfff700 1 --2- 172.21.15.33:0/2606024241 >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6f01316700 1 --2- 172.21.15.33:0/2606024241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 0x7f6efc0b08c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0098e0 tx=0x7f6eec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ac4c3770ce714a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.653+0000 7f6efb7fe700 1 -- 172.21.15.33:0/2606024241 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00b6d0 con 0x7f6efc06d280 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6efb7fe700 1 -- 172.21.15.33:0/2606024241 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eec00b830 con 0x7f6efc06d280 2023-10-09T15:30:55.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6efb7fe700 1 -- 172.21.15.33:0/2606024241 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eec00bbd0 con 0x7f6efc06d280 2023-10-09T15:30:55.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 -- 172.21.15.33:0/2606024241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 msgr2=0x7f6efc0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 --2- 172.21.15.33:0/2606024241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 0x7f6efc0b08c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6eec0098e0 tx=0x7f6eec0091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 -- 172.21.15.33:0/2606024241 shutdown_connections 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 --2- 172.21.15.33:0/2606024241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc06d280 0x7f6efc0b08c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 --2- 172.21.15.33:0/2606024241 >> v2:172.21.15.59:3300/0 conn(0x7f6efc0aee90 0x7f6efc0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 -- 172.21.15.33:0/2606024241 >> 172.21.15.33:0/2606024241 conn(0x7f6efc06ce80 msgr2=0x7f6efc0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 -- 172.21.15.33:0/2606024241 shutdown_connections 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.654+0000 7f6f02d79700 1 -- 172.21.15.33:0/2606024241 wait complete. 2023-10-09T15:30:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.655+0000 7f6f02d79700 1 Processor -- start 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.655+0000 7f6f02d79700 1 -- start start 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc06d280 0x7f6efc15c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc0aee90 0x7f6efc0cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc157310 con 0x7f6efc0a8be0 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc15d8b0 con 0x7f6efc06d280 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f02d79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6efc15cca0 con 0x7f6efc0aee90 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6efbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6efbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55722/0 (socket says 172.21.15.33:55722) 2023-10-09T15:30:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6efbfff700 1 -- 172.21.15.33:0/1627065209 learned_addr learned my addr 172.21.15.33:0/1627065209 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f01316700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc0aee90 0x7f6efc0cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.656+0000 7f6f00b15700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc06d280 0x7f6efc15c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 -- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc0aee90 msgr2=0x7f6efc0cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc0aee90 0x7f6efc0cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 -- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc06d280 msgr2=0x7f6efc15c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc06d280 0x7f6efc15c6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 -- 172.21.15.33:0/1627065209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef0009480 con 0x7f6efc0a8be0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6efbfff700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000ec00 tx=0x7f6ef0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef0005a00 con 0x7f6efc0a8be0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ef0005b60 con 0x7f6efc0a8be0 2023-10-09T15:30:55.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ef000c920 con 0x7f6efc0a8be0 2023-10-09T15:30:55.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6eec009420 con 0x7f6efc0a8be0 2023-10-09T15:30:55.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.657+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6efc15d260 con 0x7f6efc0a8be0 2023-10-09T15:30:55.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.658+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6efc15da20 con 0x7f6efc0a8be0 2023-10-09T15:30:55.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.658+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ef000cd10 con 0x7f6efc0a8be0 2023-10-09T15:30:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.659+0000 7f6ef8ff9700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 0x7f6ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.659+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6ef0084710 con 0x7f6efc0a8be0 2023-10-09T15:30:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.659+0000 7f6f00b15700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 0x7f6ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:55.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.659+0000 7f6f00b15700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 0x7f6ee80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40022a0 tx=0x7f6ef4001ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:55.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.663+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ef0051cd0 con 0x7f6efc0a8be0 2023-10-09T15:30:55.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.862+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6efc04c3c0 con 0x7f6efc0a8be0 2023-10-09T15:30:55.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.863+0000 7f6ef8ff9700 1 -- 172.21.15.33:0/1627065209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12079 (secure 0 0 0) 0x7f6ef00552f0 con 0x7f6efc0a8be0 2023-10-09T15:30:55.863 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:55.863 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:55.615617+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:30:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 msgr2=0x7f6ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 0x7f6ee80693e0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6ef40022a0 tx=0x7f6ef4001ad0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 msgr2=0x7f6efc15dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6ef000ec00 tx=0x7f6ef0009220 comp rx=0 tx=0).stop 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 shutdown_connections 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ee8066f30 0x7f6ee80693e0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6efc0aee90 0x7f6efc0cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6efc06d280 0x7f6efc15c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 --2- 172.21.15.33:0/1627065209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6efc0a8be0 0x7f6efc15dd40 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:55.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 >> 172.21.15.33:0/1627065209 conn(0x7f6efc06ce80 msgr2=0x7f6efc0ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 shutdown_connections 2023-10-09T15:30:55.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:55.865+0000 7f6f02d79700 1 -- 172.21.15.33:0/1627065209 wait complete. 2023-10-09T15:30:55.877 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:30:55.877 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:30:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.000+0000 7fd508c74700 1 Processor -- start 2023-10-09T15:30:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.000+0000 7fd508c74700 1 -- start start 2023-10-09T15:30:56.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd508c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 0x7fd50415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd508c74700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50415ac50 con 0x7fd5040cea00 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd508c74700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd50415d010 con 0x7fd504153a00 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd508c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd50415af60 con 0x7fd504153dd0 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd503fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd5040cea00 0x7fd5040cee60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58824/0 (socket says 172.21.15.33:58824) 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd503fff700 1 -- 172.21.15.33:0/1634627522 learned_addr learned my addr 172.21.15.33:0/1634627522 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd502ffd700 1 --2- 172.21.15.33:0/1634627522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 0x7fd50415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd5027fc700 1 -- 172.21.15.33:0/1634627522 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2262900526 0 0) 0x7fd50415ac50 con 0x7fd5040cea00 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd5027fc700 1 -- 172.21.15.33:0/1634627522 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4ec003570 con 0x7fd5040cea00 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd502ffd700 1 -- 172.21.15.33:0/1634627522 >> v1:172.21.15.59:6789/0 conn(0x7fd504153a00 legacy=0x7fd50415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd502ffd700 1 -- 172.21.15.33:0/1634627522 >> v1:172.21.15.33:6789/0 conn(0x7fd5040cea00 legacy=0x7fd5040cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd502ffd700 1 -- 172.21.15.33:0/1634627522 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd50415b240 con 0x7fd504153dd0 2023-10-09T15:30:56.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd502ffd700 1 --2- 172.21.15.33:0/1634627522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 0x7fd50415de50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009910 tx=0x7fd4f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26c26100abd74c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.001+0000 7fd5027fc700 1 -- 172.21.15.33:0/1634627522 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f800b680 con 0x7fd504153dd0 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd5027fc700 1 -- 172.21.15.33:0/1634627522 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4f800b7e0 con 0x7fd504153dd0 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd5027fc700 1 -- 172.21.15.33:0/1634627522 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4f800bb60 con 0x7fd504153dd0 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 -- 172.21.15.33:0/1634627522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 msgr2=0x7fd50415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 --2- 172.21.15.33:0/1634627522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 0x7fd50415de50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd4f8009910 tx=0x7fd4f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 -- 172.21.15.33:0/1634627522 shutdown_connections 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 --2- 172.21.15.33:0/1634627522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd504153dd0 0x7fd50415de50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 -- 172.21.15.33:0/1634627522 >> 172.21.15.33:0/1634627522 conn(0x7fd5040703a0 msgr2=0x7fd5040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 -- 172.21.15.33:0/1634627522 shutdown_connections 2023-10-09T15:30:56.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.002+0000 7fd508c74700 1 -- 172.21.15.33:0/1634627522 wait complete. 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.003+0000 7fd508c74700 1 Processor -- start 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.003+0000 7fd508c74700 1 -- start start 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5040cea00 0x7fd504155d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504153a00 0x7fd5040c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5040c8720 con 0x7fd504153dd0 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd504156c60 con 0x7fd504153a00 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd508c74700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5041563c0 con 0x7fd5040cea00 2023-10-09T15:30:56.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55728/0 (socket says 172.21.15.33:55728) 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 -- 172.21.15.33:0/4119878927 learned_addr learned my addr 172.21.15.33:0/4119878927 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd502ffd700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504153a00 0x7fd5040c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd5037fe700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5040cea00 0x7fd504155d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 -- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5040cea00 msgr2=0x7fd504155d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5040cea00 0x7fd504155d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 -- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504153a00 msgr2=0x7fd5040c5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504153a00 0x7fd5040c5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.004+0000 7fd503fff700 1 -- 172.21.15.33:0/4119878927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4f8009420 con 0x7fd504153dd0 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd503fff700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0010e0 tx=0x7fd4fc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc005c00 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5041566a0 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4fc005d60 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4fc0072e0 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.005+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd504152550 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.006+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5040c84f0 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.006+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd4fc012400 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.007+0000 7fd4eb7fe700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 0x7fd4f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.007+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd4fc0835a0 con 0x7fd504153dd0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.007+0000 7fd5037fe700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 0x7fd4f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.007+0000 7fd5037fe700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 0x7fd4f00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4007fd0 tx=0x7fd4f40016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.011+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5040c84f0 con 0x7fd504153dd0 2023-10-09T15:30:56.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.208+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd5040c84f0 con 0x7fd504153dd0 2023-10-09T15:30:56.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.209+0000 7fd4eb7fe700 1 -- 172.21.15.33:0/4119878927 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd5040c84f0 con 0x7fd504153dd0 2023-10-09T15:30:56.209 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 msgr2=0x7fd4f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 0x7fd4f00693e0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd4f4007fd0 tx=0x7fd4f40016f0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 msgr2=0x7fd504152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc0010e0 tx=0x7fd4fc007dd0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 shutdown_connections 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4f0066f30 0x7fd4f00693e0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd504153dd0 0x7fd504152010 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5040cea00 0x7fd504155d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 --2- 172.21.15.33:0/4119878927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd504153a00 0x7fd5040c5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 >> 172.21.15.33:0/4119878927 conn(0x7fd5040703a0 msgr2=0x7fd5040b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 shutdown_connections 2023-10-09T15:30:56.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.211+0000 7fd508c74700 1 -- 172.21.15.33:0/4119878927 wait complete. 2023-10-09T15:30:56.223 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:30:56.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.344+0000 7f3703634700 1 Processor -- start 2023-10-09T15:30:56.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.344+0000 7f3703634700 1 -- start start 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3703634700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36fc0cb5a0 0x7f36fc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3703634700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f36fc15a5d0 0x7f36fc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3703634700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36fc15ae40 con 0x7f36fc0cd9e0 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3703634700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc0d13f0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3703634700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36fc15ab60 con 0x7f36fc15a5d0 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f37013d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36fc0cb5a0 0x7f36fc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f37013d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f36fc0cb5a0 0x7f36fc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55752/0 (socket says 172.21.15.33:55752) 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f37013d0700 1 -- 172.21.15.33:0/3749592512 learned_addr learned my addr 172.21.15.33:0/3749592512 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.345+0000 7f3701bd1700 1 --2- 172.21.15.33:0/3749592512 >> v2:172.21.15.59:3300/0 conn(0x7f36fc15a5d0 0x7f36fc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f37013d0700 1 -- 172.21.15.33:0/3749592512 >> v2:172.21.15.59:3300/0 conn(0x7f36fc15a5d0 msgr2=0x7f36fc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f37013d0700 1 --2- 172.21.15.33:0/3749592512 >> v2:172.21.15.59:3300/0 conn(0x7f36fc15a5d0 0x7f36fc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f37013d0700 1 -- 172.21.15.33:0/3749592512 >> v1:172.21.15.59:6789/0 conn(0x7f36fc0cd9e0 legacy=0x7f36fc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f37013d0700 1 -- 172.21.15.33:0/3749592512 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36fc0ccf00 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f37013d0700 1 --2- 172.21.15.33:0/3749592512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc0cb970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009f20 tx=0x7f36ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aaff6f2423de3d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f36fbfff700 1 -- 172.21.15.33:0/3749592512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec00e070 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f36fbfff700 1 -- 172.21.15.33:0/3749592512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec00b990 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f36fbfff700 1 -- 172.21.15.33:0/3749592512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec0092e0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f3703634700 1 -- 172.21.15.33:0/3749592512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 msgr2=0x7f36fc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.346+0000 7f3703634700 1 --2- 172.21.15.33:0/3749592512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc0cb970 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009f20 tx=0x7f36ec009840 comp rx=0 tx=0).stop 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 -- 172.21.15.33:0/3749592512 shutdown_connections 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 --2- 172.21.15.33:0/3749592512 >> v2:172.21.15.59:3300/0 conn(0x7f36fc15a5d0 0x7f36fc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 --2- 172.21.15.33:0/3749592512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc0cb970 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 -- 172.21.15.33:0/3749592512 >> 172.21.15.33:0/3749592512 conn(0x7f36fc070e30 msgr2=0x7f36fc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 -- 172.21.15.33:0/3749592512 shutdown_connections 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.347+0000 7f3703634700 1 -- 172.21.15.33:0/3749592512 wait complete. 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.348+0000 7f3703634700 1 Processor -- start 2023-10-09T15:30:56.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.348+0000 7f3703634700 1 -- start start 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36fc0cd9e0 0x7f36fc15ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 0x7f36fc0b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc15d780 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc1566c0 con 0x7f36fc15a5d0 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36fc15cb70 con 0x7f36fc0cd9e0 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55760/0 (socket says 172.21.15.33:55760) 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 -- 172.21.15.33:0/3427839305 learned_addr learned my addr 172.21.15.33:0/3427839305 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3701bd1700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 0x7f36fc0b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3700bcf700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36fc0cd9e0 0x7f36fc15ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 -- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36fc0cd9e0 msgr2=0x7f36fc15ba20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36fc0cd9e0 0x7f36fc15ba20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 -- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 msgr2=0x7f36fc0b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 0x7f36fc0b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 -- 172.21.15.33:0/3427839305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36ec009ae0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3701bd1700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 0x7f36fc0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f37013d0700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009880 tx=0x7f36ec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec008a50 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36ec008bb0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36fc15ce50 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36ec026460 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.349+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36fc15d410 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.350+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36fc04c3c0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.351+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f36ec003040 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.351+0000 7f36f97fa700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 0x7f36e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.351+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f36ec086010 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.351+0000 7f3700bcf700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 0x7f36e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.351+0000 7f3700bcf700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 0x7f36e80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0afa30 tx=0x7f36f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.356+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f36ec0535d0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.553+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f36fc0cd1e0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.553+0000 7f36f97fa700 1 -- 172.21.15.33:0/3427839305 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f36ec056bf0 con 0x7f36fc0cb5a0 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:30:56.553 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:30:56.554 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:30:56.554 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 msgr2=0x7f36e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 0x7f36e80693e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f36fc0afa30 tx=0x7f36f0009040 comp rx=0 tx=0).stop 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 msgr2=0x7f36fc156180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f36ec009880 tx=0x7f36ec018000 comp rx=0 tx=0).stop 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 shutdown_connections 2023-10-09T15:30:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f36e8066f30 0x7f36e80693e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f36fc0cb5a0 0x7f36fc156180 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f36fc15a5d0 0x7f36fc0b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 --2- 172.21.15.33:0/3427839305 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f36fc0cd9e0 0x7f36fc15ba20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 >> 172.21.15.33:0/3427839305 conn(0x7f36fc070e30 msgr2=0x7f36fc0c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 shutdown_connections 2023-10-09T15:30:56.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.555+0000 7f3703634700 1 -- 172.21.15.33:0/3427839305 wait complete. 2023-10-09T15:30:56.567 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:30:56.567 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.690+0000 7f78ae8f3700 1 Processor -- start 2023-10-09T15:30:56.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.690+0000 7f78ae8f3700 1 -- start start 2023-10-09T15:30:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f78a80cb880 0x7f78a80cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 0x7f78a80cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cd5a0 0x7f78a81591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80cead0 con 0x7f78a80cb880 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78a80cf330 con 0x7f78a80b04f0 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ae8f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a80cddd0 con 0x7f78a80cd5a0 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f78a80cb880 0x7f78a80cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f78a80cb880 0x7f78a80cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55766/0 (socket says 172.21.15.33:55766) 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 -- 172.21.15.33:0/4264622376 learned_addr learned my addr 172.21.15.33:0/4264622376 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a77fe700 1 --2- 172.21.15.33:0/4264622376 >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 0x7f78a80cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78ace90700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cd5a0 0x7f78a81591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 -- 172.21.15.33:0/4264622376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cd5a0 msgr2=0x7f78a81591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cd5a0 0x7f78a81591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 -- 172.21.15.33:0/4264622376 >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 msgr2=0x7f78a80cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 --2- 172.21.15.33:0/4264622376 >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 0x7f78a80cd060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 -- 172.21.15.33:0/4264622376 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a80cece0 con 0x7f78a80cb880 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a77fe700 1 --2- 172.21.15.33:0/4264622376 >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 0x7f78a80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a7fff700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80cb880 0x7f78a80cbc50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f78a815d3d0 tx=0x7f7898009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4700b4a3e2dcd6f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.691+0000 7f78a6ffd700 1 -- 172.21.15.33:0/4264622376 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800b860 con 0x7f78a80cb880 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78a6ffd700 1 -- 172.21.15.33:0/4264622376 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789800b9c0 con 0x7f78a80cb880 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78a6ffd700 1 -- 172.21.15.33:0/4264622376 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789800bd60 con 0x7f78a80cb880 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 -- 172.21.15.33:0/4264622376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80cb880 msgr2=0x7f78a80cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80cb880 0x7f78a80cbc50 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f78a815d3d0 tx=0x7f7898009250 comp rx=0 tx=0).stop 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 -- 172.21.15.33:0/4264622376 shutdown_connections 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cd5a0 0x7f78a81591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/4264622376 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80cb880 0x7f78a80cbc50 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/4264622376 >> v2:172.21.15.59:3300/0 conn(0x7f78a80b04f0 0x7f78a80cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 -- 172.21.15.33:0/4264622376 >> 172.21.15.33:0/4264622376 conn(0x7f78a80703a0 msgr2=0x7f78a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 -- 172.21.15.33:0/4264622376 shutdown_connections 2023-10-09T15:30:56.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.692+0000 7f78ae8f3700 1 -- 172.21.15.33:0/4264622376 wait complete. 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.693+0000 7f78ae8f3700 1 Processor -- start 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.693+0000 7f78ae8f3700 1 -- start start 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 0x7f78a80c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a80cd5a0 0x7f78a80c96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a81497e0 con 0x7f78a80b04f0 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a816a970 con 0x7f78a80cd5a0 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ae8f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a8169d80 con 0x7f78a80cb880 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55768/0 (socket says 172.21.15.33:55768) 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a7fff700 1 -- 172.21.15.33:0/2985784541 learned_addr learned my addr 172.21.15.33:0/2985784541 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78ace90700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a80cd5a0 0x7f78a80c96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a77fe700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 0x7f78a80c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a7fff700 1 -- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 msgr2=0x7f78a80c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.694+0000 7f78a7fff700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 0x7f78a80c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78a7fff700 1 -- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a80cd5a0 msgr2=0x7f78a80c96d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78a7fff700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a80cd5a0 0x7f78a80c96d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78a7fff700 1 -- 172.21.15.33:0/2985784541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78980094f0 con 0x7f78a80b04f0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78a77fe700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 0x7f78a80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78a7fff700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7898009290 tx=0x7f7898017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789801a450 con 0x7f78a80b04f0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789801a5b0 con 0x7f78a80b04f0 2023-10-09T15:30:56.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78a816a040 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789801a970 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.695+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a816a600 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.696+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a80cbcb0 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.696+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f789801ad20 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.697+0000 7f788ffff700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.697+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f78980858b0 con 0x7f78a80b04f0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.697+0000 7f78a77fe700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.697+0000 7f78a77fe700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 0x7f78940693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f789c006f00 tx=0x7f789c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.701+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7898052e70 con 0x7f78a80b04f0 2023-10-09T15:30:56.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:56.895+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f78a816a7c0 con 0x7f78a80b04f0 2023-10-09T15:30:57.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.635+0000 7f788ffff700 1 -- 172.21.15.33:0/2985784541 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7f789802a0b0 con 0x7f78a80b04f0 2023-10-09T15:30:57.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.639+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 msgr2=0x7f78940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.639+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 0x7f78940693e0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f789c006f00 tx=0x7f789c008040 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.639+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 msgr2=0x7f78a81492a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.639+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7898009290 tx=0x7f7898017000 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 shutdown_connections 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7894066f30 0x7f78940693e0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f78a80b04f0 0x7f78a81492a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78a80cd5a0 0x7f78a80c96d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 --2- 172.21.15.33:0/2985784541 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f78a80cb880 0x7f78a80c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 >> 172.21.15.33:0/2985784541 conn(0x7f78a80703a0 msgr2=0x7f78a8157220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:57.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 shutdown_connections 2023-10-09T15:30:57.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.640+0000 7f78ae8f3700 1 -- 172.21.15.33:0/2985784541 wait complete. 2023-10-09T15:30:57.641 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:30:57.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:30:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.788+0000 7f66948eb700 1 Processor -- start 2023-10-09T15:30:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.788+0000 7f66948eb700 1 -- start start 2023-10-09T15:30:57.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f66948eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6690159380 0x7f6690159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f66948eb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66900cb3f0 0x7f669015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f66948eb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66900ccfa0 con 0x7f66900cea00 2023-10-09T15:30:57.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f66948eb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66900cb880 con 0x7f66900cb3f0 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f66948eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66900cbb60 con 0x7f6690159380 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66900cb3f0 0x7f669015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66900cb3f0 0x7f669015dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55772/0 (socket says 172.21.15.33:55772) 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f66900cea00 0x7f66900cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58830/0 (socket says 172.21.15.33:58830) 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 -- 172.21.15.33:0/479721916 learned_addr learned my addr 172.21.15.33:0/479721916 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668f7fe700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6690159380 0x7f6690159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 -- 172.21.15.33:0/479721916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6690159380 msgr2=0x7f6690159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6690159380 0x7f6690159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 -- 172.21.15.33:0/479721916 >> v1:172.21.15.33:6789/0 conn(0x7f66900cea00 legacy=0x7f66900cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.789+0000 7f668effd700 1 -- 172.21.15.33:0/479721916 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66900cbe40 con 0x7f66900cb3f0 2023-10-09T15:30:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f668effd700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cb3f0 0x7f669015dc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66840099b0 tx=0x7f6684009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1e70e6c8933852 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f668e7fc700 1 -- 172.21.15.33:0/479721916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400b860 con 0x7f66900cb3f0 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f668e7fc700 1 -- 172.21.15.33:0/479721916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f668400b9c0 con 0x7f66900cb3f0 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f668e7fc700 1 -- 172.21.15.33:0/479721916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f668400bd60 con 0x7f66900cb3f0 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 -- 172.21.15.33:0/479721916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cb3f0 msgr2=0x7f669015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cb3f0 0x7f669015dc00 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f66840099b0 tx=0x7f6684009250 comp rx=0 tx=0).stop 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 -- 172.21.15.33:0/479721916 shutdown_connections 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6690159380 0x7f6690159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 --2- 172.21.15.33:0/479721916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cb3f0 0x7f669015dc00 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 -- 172.21.15.33:0/479721916 >> 172.21.15.33:0/479721916 conn(0x7f66900703a0 msgr2=0x7f66900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 -- 172.21.15.33:0/479721916 shutdown_connections 2023-10-09T15:30:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.790+0000 7f66948eb700 1 -- 172.21.15.33:0/479721916 wait complete. 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 Processor -- start 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 -- start start 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66900cb3f0 0x7f66900c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6690159380 0x7f66900b2860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690169b60 con 0x7f66900cea00 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6690169da0 con 0x7f6690159380 2023-10-09T15:30:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.792+0000 7f66948eb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669016a080 con 0x7f66900cb3f0 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55778/0 (socket says 172.21.15.33:55778) 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 -- 172.21.15.33:0/2844823474 learned_addr learned my addr 172.21.15.33:0/2844823474 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668ffff700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6690159380 0x7f66900b2860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668f7fe700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66900cb3f0 0x7f66900c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 -- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66900cb3f0 msgr2=0x7f66900c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66900cb3f0 0x7f66900c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 -- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6690159380 msgr2=0x7f66900b2860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6690159380 0x7f66900b2860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 -- 172.21.15.33:0/2844823474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66840094f0 con 0x7f66900cea00 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f668effd700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6684009290 tx=0x7f6684017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:57.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684024440 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66840245a0 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f669016a360 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6684024940 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.793+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669016a920 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.794+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669004c3c0 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.794+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f668401a420 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.795+0000 7f66777fe700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 0x7f667c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.795+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6684086210 con 0x7f66900cea00 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.795+0000 7f668f7fe700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 0x7f667c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:57.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.795+0000 7f668f7fe700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 0x7f667c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6680006fd0 tx=0x7f6680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:57.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.799+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6684053660 con 0x7f66900cea00 2023-10-09T15:30:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:57.992+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f66900cc120 con 0x7f66900cea00 2023-10-09T15:30:58.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.639+0000 7f66777fe700 1 -- 172.21.15.33:0/2844823474 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6684056c80 con 0x7f66900cea00 2023-10-09T15:30:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.645+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 msgr2=0x7f667c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.645+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 0x7f667c0693e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f6680006fd0 tx=0x7f6680008040 comp rx=0 tx=0).stop 2023-10-09T15:30:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.645+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 msgr2=0x7f66900b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.645+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f6684009290 tx=0x7f6684017000 comp rx=0 tx=0).stop 2023-10-09T15:30:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 shutdown_connections 2023-10-09T15:30:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f667c066f30 0x7f667c0693e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6690159380 0x7f66900b2860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66900cb3f0 0x7f66900c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 --2- 172.21.15.33:0/2844823474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66900cea00 0x7f66900b2320 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.647+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 >> 172.21.15.33:0/2844823474 conn(0x7f66900703a0 msgr2=0x7f6690153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:58.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.652+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 shutdown_connections 2023-10-09T15:30:58.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.652+0000 7f66948eb700 1 -- 172.21.15.33:0/2844823474 wait complete. 2023-10-09T15:30:58.659 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:30:58.673 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:30:58.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.800+0000 7ffb85690700 1 Processor -- start 2023-10-09T15:30:58.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.800+0000 7ffb85690700 1 -- start start 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb85690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 0x7ffb80153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb85690700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb800cea00 0x7ffb800cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb85690700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb8015ac50 con 0x7ffb8015de50 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb85690700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb8015d010 con 0x7ffb800cea00 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb85690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb8015af60 con 0x7ffb80153a00 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb84e8f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb800cea00 0x7ffb800cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 0x7ffb80153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb7f7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7ffb8015de50 0x7ffb8015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:37374/0 (socket says 172.21.15.33:37374) 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.801+0000 7ffb7f7fe700 1 -- 172.21.15.33:0/2433858655 learned_addr learned my addr 172.21.15.33:0/2433858655 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7effd700 1 -- 172.21.15.33:0/2433858655 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 906301657 0 0) 0x7ffb8015ac50 con 0x7ffb8015de50 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7effd700 1 -- 172.21.15.33:0/2433858655 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ffb6c003570 con 0x7ffb8015de50 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb84e8f700 1 -- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 msgr2=0x7ffb80153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb84e8f700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 0x7ffb80153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb84e8f700 1 -- 172.21.15.33:0/2433858655 >> v1:172.21.15.59:6789/0 conn(0x7ffb8015de50 legacy=0x7ffb8015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb84e8f700 1 -- 172.21.15.33:0/2433858655 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb8015b240 con 0x7ffb800cea00 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7ffff700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 0x7ffb80153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb84e8f700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb800cea00 0x7ffb800cee40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e60 tx=0x7ffb78009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da35083b368e4404 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7effd700 1 -- 172.21.15.33:0/2433858655 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800e070 con 0x7ffb800cea00 2023-10-09T15:30:58.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7effd700 1 -- 172.21.15.33:0/2433858655 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb7800bab0 con 0x7ffb800cea00 2023-10-09T15:30:58.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.802+0000 7ffb7effd700 1 -- 172.21.15.33:0/2433858655 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb7800be30 con 0x7ffb800cea00 2023-10-09T15:30:58.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 -- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb800cea00 msgr2=0x7ffb800cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb800cea00 0x7ffb800cee40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb78009e60 tx=0x7ffb78009780 comp rx=0 tx=0).stop 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 -- 172.21.15.33:0/2433858655 shutdown_connections 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb800cea00 0x7ffb800cee40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 --2- 172.21.15.33:0/2433858655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb80153a00 0x7ffb80153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 -- 172.21.15.33:0/2433858655 >> 172.21.15.33:0/2433858655 conn(0x7ffb800703a0 msgr2=0x7ffb800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 -- 172.21.15.33:0/2433858655 shutdown_connections 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.803+0000 7ffb85690700 1 -- 172.21.15.33:0/2433858655 wait complete. 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.804+0000 7ffb85690700 1 Processor -- start 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.804+0000 7ffb85690700 1 -- start start 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 0x7ffb8015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8015de50 0x7ffb8014d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c58b0 con 0x7ffb800cea00 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c5b90 con 0x7ffb80153a00 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb85690700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb800c5e70 con 0x7ffb8015de50 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55780/0 (socket says 172.21.15.33:55780) 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 -- 172.21.15.33:0/1882885055 learned_addr learned my addr 172.21.15.33:0/1882885055 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7f7fe700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 0x7ffb8015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb84e8f700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8015de50 0x7ffb8014d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 -- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8015de50 msgr2=0x7ffb8014d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8015de50 0x7ffb8014d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 -- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 msgr2=0x7ffb8015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 0x7ffb8015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 -- 172.21.15.33:0/1882885055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb68009420 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7f7fe700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 0x7ffb8015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb7ffff700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ec80 tx=0x7ffb680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800c920 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.805+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb6800ca80 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.806+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb78009a20 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.806+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb6800ce00 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.806+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb800cb1b0 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.806+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb8004c3c0 con 0x7ffb800cea00 2023-10-09T15:30:58.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.807+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ffb68013680 con 0x7ffb800cea00 2023-10-09T15:30:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.807+0000 7ffb77fff700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 0x7ffb600693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.808+0000 7ffb7f7fe700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 0x7ffb600693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.808+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ffb68084b90 con 0x7ffb800cea00 2023-10-09T15:30:58.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.808+0000 7ffb7f7fe700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 0x7ffb600693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb800b2780 tx=0x7ffb70009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:58.812+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb68051e60 con 0x7ffb800cea00 2023-10-09T15:30:59.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.053+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb8015b520 con 0x7ffb800cea00 2023-10-09T15:30:59.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.661+0000 7ffb77fff700 1 -- 172.21.15.33:0/1882885055 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ffb680170c0 con 0x7ffb800cea00 2023-10-09T15:30:59.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 msgr2=0x7ffb600693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 0x7ffb600693e0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7ffb800b2780 tx=0x7ffb70009040 comp rx=0 tx=0).stop 2023-10-09T15:30:59.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 msgr2=0x7ffb800c52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ec80 tx=0x7ffb680091a0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 shutdown_connections 2023-10-09T15:30:59.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb60066f30 0x7ffb600693e0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb800cea00 0x7ffb800c52d0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb8015de50 0x7ffb8014d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 --2- 172.21.15.33:0/1882885055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb80153a00 0x7ffb8015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 >> 172.21.15.33:0/1882885055 conn(0x7ffb800703a0 msgr2=0x7ffb80159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 shutdown_connections 2023-10-09T15:30:59.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.667+0000 7ffb85690700 1 -- 172.21.15.33:0/1882885055 wait complete. 2023-10-09T15:30:59.676 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 2 and data pool 3 2023-10-09T15:30:59.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:30:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.810+0000 7efe92433700 1 Processor -- start 2023-10-09T15:30:59.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.810+0000 7efe92433700 1 -- start start 2023-10-09T15:30:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe92433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 0x7efe8c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe92433700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe8c0cde50 0x7efe8c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe92433700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe8c15ae40 con 0x7efe8c0cd9e0 2023-10-09T15:30:59.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe92433700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c0d13f0 con 0x7efe8c0cde50 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe92433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c15ab60 con 0x7efe8c0cb5a0 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe909d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe8c0cde50 0x7efe8c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe8b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7efe8c0cd9e0 0x7efe8c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58836/0 (socket says 172.21.15.33:58836) 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe8b7fe700 1 -- 172.21.15.33:0/2776377731 learned_addr learned my addr 172.21.15.33:0/2776377731 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe8bfff700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 0x7efe8c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe909d0700 1 -- 172.21.15.33:0/2776377731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 msgr2=0x7efe8c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe909d0700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 0x7efe8c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe909d0700 1 -- 172.21.15.33:0/2776377731 >> v1:172.21.15.33:6789/0 conn(0x7efe8c0cd9e0 legacy=0x7efe8c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe909d0700 1 -- 172.21.15.33:0/2776377731 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0ccf00 con 0x7efe8c0cde50 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.811+0000 7efe8affd700 1 -- 172.21.15.33:0/2776377731 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2794978659 0 0) 0x7efe8c15ae40 con 0x7efe8c0cd9e0 2023-10-09T15:30:59.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe8bfff700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 0x7efe8c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe909d0700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0cde50 0x7efe8c156e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe84009e60 tx=0x7efe84009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d67438b5f6a0f313 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe8affd700 1 -- 172.21.15.33:0/2776377731 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400e070 con 0x7efe8c0cde50 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe8affd700 1 -- 172.21.15.33:0/2776377731 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400bc30 con 0x7efe8c0cde50 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe8affd700 1 -- 172.21.15.33:0/2776377731 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe84012430 con 0x7efe8c0cde50 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 -- 172.21.15.33:0/2776377731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0cde50 msgr2=0x7efe8c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0cde50 0x7efe8c156e90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe84009e60 tx=0x7efe84009780 comp rx=0 tx=0).stop 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 -- 172.21.15.33:0/2776377731 shutdown_connections 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0cde50 0x7efe8c156e90 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 --2- 172.21.15.33:0/2776377731 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cb5a0 0x7efe8c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 -- 172.21.15.33:0/2776377731 >> 172.21.15.33:0/2776377731 conn(0x7efe8c070e30 msgr2=0x7efe8c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 -- 172.21.15.33:0/2776377731 shutdown_connections 2023-10-09T15:30:59.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.812+0000 7efe92433700 1 -- 172.21.15.33:0/2776377731 wait complete. 2023-10-09T15:30:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.813+0000 7efe92433700 1 Processor -- start 2023-10-09T15:30:59.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 -- start start 2023-10-09T15:30:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cb5a0 0x7efe8c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 0x7efe8c1596d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c159c10 con 0x7efe8c1694b0 2023-10-09T15:30:59.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1572f0 con 0x7efe8c0cb5a0 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.814+0000 7efe92433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c1575d0 con 0x7efe8c0cd9e0 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55804/0 (socket says 172.21.15.33:55804) 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 -- 172.21.15.33:0/1359980915 learned_addr learned my addr 172.21.15.33:0/1359980915 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 0x7efe8c1596d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe8bfff700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cb5a0 0x7efe8c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 -- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 msgr2=0x7efe8c1596d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 0x7efe8c1596d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 -- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cb5a0 msgr2=0x7efe8c156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cb5a0 0x7efe8c156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:30:59.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 -- 172.21.15.33:0/1359980915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84009a20 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 0x7efe8c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe909d0700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe8c06ea60 tx=0x7efe84019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8401d630 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8401d7b0 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c1578b0 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8401db70 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.815+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c157e70 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.816+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c158090 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.817+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe84024070 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.817+0000 7efe83fff700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.817+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efe84086f00 con 0x7efe8c1694b0 2023-10-09T15:30:59.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.817+0000 7efe8bfff700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:30:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.817+0000 7efe8bfff700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00ac00 tx=0x7efe7c006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:30:59.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:30:59.821+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe84054170 con 0x7efe8c1694b0 2023-10-09T15:31:00.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.017+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe8c04c3c0 con 0x7efe8c1694b0 2023-10-09T15:31:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.018+0000 7efe83fff700 1 -- 172.21.15.33:0/1359980915 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7efe84057790 con 0x7efe8c1694b0 2023-10-09T15:31:00.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:00.018 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:59.054113+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 msgr2=0x7efe6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7efe7c00ac00 tx=0x7efe7c006f90 comp rx=0 tx=0).stop 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 msgr2=0x7efe8c169930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7efe8c06ea60 tx=0x7efe84019000 comp rx=0 tx=0).stop 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 shutdown_connections 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c1694b0 0x7efe8c169930 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cb5a0 0x7efe8c156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 --2- 172.21.15.33:0/1359980915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cd9e0 0x7efe8c1596d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 >> 172.21.15.33:0/1359980915 conn(0x7efe8c070e30 msgr2=0x7efe8c0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 shutdown_connections 2023-10-09T15:31:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.020+0000 7efe92433700 1 -- 172.21.15.33:0/1359980915 wait complete. 2023-10-09T15:31:00.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.151+0000 7f883b754700 1 Processor -- start 2023-10-09T15:31:00.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.151+0000 7f883b754700 1 -- start start 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f883b754700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 0x7f88340cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f883b754700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88340cd9e0 0x7f8834159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f883b754700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f883415ae40 con 0x7f88340cde50 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f883b754700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88340d13f0 con 0x7f88340cd9e0 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f883b754700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883415ab60 con 0x7f88340cb5a0 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f88394f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 0x7f88340cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f8838cef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88340cd9e0 0x7f8834159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f8838cef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f88340cd9e0 0x7f8834159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:35658/0 (socket says 172.21.15.33:35658) 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f88394f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 0x7f88340cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:42660/0 (socket says 172.21.15.33:42660) 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f8839cf1700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f88340cde50 0x7f8834156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:37376/0 (socket says 172.21.15.33:37376) 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.152+0000 7f8838cef700 1 -- 172.21.15.33:0/12370416 learned_addr learned my addr 172.21.15.33:0/12370416 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8838cef700 1 -- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 msgr2=0x7f88340cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8838cef700 1 --2- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 0x7f88340cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8838cef700 1 -- 172.21.15.33:0/12370416 >> v1:172.21.15.59:6789/0 conn(0x7f88340cde50 legacy=0x7f8834156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8838cef700 1 -- 172.21.15.33:0/12370416 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88340ccf00 con 0x7f88340cd9e0 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8838cef700 1 --2- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f8834159ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88280099b0 tx=0x7f8828009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7c526cd01e5ad3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8833fff700 1 -- 172.21.15.33:0/12370416 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8828009ea0 con 0x7f88340cd9e0 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8833fff700 1 -- 172.21.15.33:0/12370416 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882800b860 con 0x7f88340cd9e0 2023-10-09T15:31:00.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.153+0000 7f8833fff700 1 -- 172.21.15.33:0/12370416 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882800bc00 con 0x7f88340cd9e0 2023-10-09T15:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 -- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 msgr2=0x7f8834159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 --2- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f8834159ec0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f88280099b0 tx=0x7f8828009250 comp rx=0 tx=0).stop 2023-10-09T15:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 -- 172.21.15.33:0/12370416 shutdown_connections 2023-10-09T15:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 --2- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f88340cb5a0 0x7f88340cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 --2- 172.21.15.33:0/12370416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f8834159ec0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 -- 172.21.15.33:0/12370416 >> 172.21.15.33:0/12370416 conn(0x7f8834070e30 msgr2=0x7f88340d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 -- 172.21.15.33:0/12370416 shutdown_connections 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.154+0000 7f883b754700 1 -- 172.21.15.33:0/12370416 wait complete. 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.155+0000 7f883b754700 1 Processor -- start 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.155+0000 7f883b754700 1 -- start start 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f883414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 0x7f88341593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834155560 con 0x7f88340cb5a0 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8834157440 con 0x7f88340cd9e0 2023-10-09T15:31:00.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f883b754700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8834157160 con 0x7f8834156c60 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55812/0 (socket says 172.21.15.33:55812) 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 -- 172.21.15.33:0/1409084183 learned_addr learned my addr 172.21.15.33:0/1409084183 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f8839cf1700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 0x7f88341593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f8838cef700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f883414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 -- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 msgr2=0x7f88341593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 0x7f88341593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 -- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 msgr2=0x7f883414eaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f883414eaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 -- 172.21.15.33:0/1409084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88280094f0 con 0x7f88340cb5a0 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f8839cf1700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 0x7f88341593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.156+0000 7f88394f0700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8824009ef0 tx=0x7f882400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.157+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f882400cbc0 con 0x7f88340cb5a0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.157+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f882400f040 con 0x7f88340cb5a0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.157+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8834154fa0 con 0x7f88340cb5a0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.157+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8824014480 con 0x7f88340cb5a0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.157+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88341598f0 con 0x7f88340cb5a0 2023-10-09T15:31:00.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.158+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f883414f2d0 con 0x7f88340cb5a0 2023-10-09T15:31:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.158+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f88240147f0 con 0x7f88340cb5a0 2023-10-09T15:31:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.158+0000 7f88317fa700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 0x7f88200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.159+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8824084ed0 con 0x7f88340cb5a0 2023-10-09T15:31:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.159+0000 7f8838cef700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 0x7f88200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.159+0000 7f8838cef700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 0x7f88200693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f88280099b0 tx=0x7f8828017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.163+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8824052140 con 0x7f88340cb5a0 2023-10-09T15:31:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.357+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f883404c3c0 con 0x7f88340cb5a0 2023-10-09T15:31:00.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.358+0000 7f88317fa700 1 -- 172.21.15.33:0/1409084183 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f8824055760 con 0x7f88340cb5a0 2023-10-09T15:31:00.358 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:00.358 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":19,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:30:59.054113+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:00.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 msgr2=0x7f88200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 0x7f88200693e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f88280099b0 tx=0x7f8828017000 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 msgr2=0x7f883414f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8824009ef0 tx=0x7f882400b040 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 shutdown_connections 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8820066f30 0x7f88200693e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f88340cb5a0 0x7f883414f480 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8834156c60 0x7f88341593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 --2- 172.21.15.33:0/1409084183 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88340cd9e0 0x7f883414eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.360+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 >> 172.21.15.33:0/1409084183 conn(0x7f8834070e30 msgr2=0x7f88340d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.361+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 shutdown_connections 2023-10-09T15:31:00.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.361+0000 7f883b754700 1 -- 172.21.15.33:0/1409084183 wait complete. 2023-10-09T15:31:00.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:31:00.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.495+0000 7f8cef855700 1 Processor -- start 2023-10-09T15:31:00.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.495+0000 7f8cef855700 1 -- start start 2023-10-09T15:31:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cef855700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cef855700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cef855700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce80ccfd0 con 0x7f8ce806dc70 2023-10-09T15:31:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cef855700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ce80cf0e0 con 0x7f8ce806e0e0 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cef855700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce815a3d0 con 0x7f8ce8159530 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55822/0 (socket says 172.21.15.33:55822) 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 -- 172.21.15.33:0/1079043671 learned_addr learned my addr 172.21.15.33:0/1079043671 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8cecdf0700 1 --1- 172.21.15.33:0/1079043671 >> v1:172.21.15.33:6789/0 conn(0x7f8ce806dc70 0x7f8ce8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58850/0 (socket says 172.21.15.33:58850) 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ced5f1700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 -- 172.21.15.33:0/1079043671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 msgr2=0x7f8ce80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 -- 172.21.15.33:0/1079043671 >> v1:172.21.15.33:6789/0 conn(0x7f8ce806dc70 legacy=0x7f8ce8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 -- 172.21.15.33:0/1079043671 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce815a6b0 con 0x7f8ce806e0e0 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ceddf2700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009f20 tx=0x7f8cd8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e6f26afad28dc9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ce7fff700 1 -- 172.21.15.33:0/1079043671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd800e070 con 0x7f8ce806e0e0 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ce7fff700 1 -- 172.21.15.33:0/1079043671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cd800b9d0 con 0x7f8ce806e0e0 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.496+0000 7f8ce7fff700 1 -- 172.21.15.33:0/1079043671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cd80092e0 con 0x7f8ce806e0e0 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 -- 172.21.15.33:0/1079043671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806e0e0 msgr2=0x7f8ce80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f8cd8009f20 tx=0x7f8cd8009840 comp rx=0 tx=0).stop 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 -- 172.21.15.33:0/1079043671 shutdown_connections 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80cb6f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 --2- 172.21.15.33:0/1079043671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 -- 172.21.15.33:0/1079043671 >> 172.21.15.33:0/1079043671 conn(0x7f8ce80703a0 msgr2=0x7f8ce80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 -- 172.21.15.33:0/1079043671 shutdown_connections 2023-10-09T15:31:00.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.497+0000 7f8cef855700 1 -- 172.21.15.33:0/1079043671 wait complete. 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.498+0000 7f8cef855700 1 Processor -- start 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.498+0000 7f8cef855700 1 -- start start 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80c7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce8155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c8e20 con 0x7f8ce806dc70 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c8210 con 0x7f8ce806e0e0 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cef855700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce80c84f0 con 0x7f8ce8159530 2023-10-09T15:31:00.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55830/0 (socket says 172.21.15.33:55830) 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 -- 172.21.15.33:0/401610144 learned_addr learned my addr 172.21.15.33:0/401610144 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cecdf0700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80c7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ceddf2700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce8155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 -- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 msgr2=0x7f8ce8155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce8155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 -- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 msgr2=0x7f8ce80c7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80c7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ced5f1700 1 -- 172.21.15.33:0/401610144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8009ae0 con 0x7f8ce806dc70 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8cecdf0700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.499+0000 7f8ceddf2700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:00.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8ced5f1700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e930 tx=0x7f8ce00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000eed0 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce000c850 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce80c87d0 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce000cbf0 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.500+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce8158240 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.501+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce80c9100 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.501+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ce0013470 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.501+0000 7f8ce57fa700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.501+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ce00847c0 con 0x7f8ce806dc70 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.502+0000 7f8cecdf0700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:00.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.502+0000 7f8cecdf0700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 0x7f8cd40693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8070840 tx=0x7f8cdc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:00.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.506+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ce0051990 con 0x7f8ce806dc70 2023-10-09T15:31:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:00.749+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8ce804c3c0 con 0x7f8ce806dc70 2023-10-09T15:31:01.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.671+0000 7f8ce57fa700 1 -- 172.21.15.33:0/401610144 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v7) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8ce0054fb0 con 0x7f8ce806dc70 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 msgr2=0x7f8cd40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 0x7f8cd40693e0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f8ce8070840 tx=0x7f8cdc009040 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 msgr2=0x7f8ce80c92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8ce000e930 tx=0x7f8ce00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 shutdown_connections 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8cd4066f30 0x7f8cd40693e0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ce806dc70 0x7f8ce80c92b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ce8159530 0x7f8ce8155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 --2- 172.21.15.33:0/401610144 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ce806e0e0 0x7f8ce80c7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 >> 172.21.15.33:0/401610144 conn(0x7f8ce80703a0 msgr2=0x7f8ce80d0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:01.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 shutdown_connections 2023-10-09T15:31:01.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.674+0000 7f8cef855700 1 -- 172.21.15.33:0/401610144 wait complete. 2023-10-09T15:31:01.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:31:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.817+0000 7f20dc0c0700 1 Processor -- start 2023-10-09T15:31:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.818+0000 7f20dc0c0700 1 -- start start 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.818+0000 7f20dc0c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20d4155f30 0x7f20d4156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.818+0000 7f20dc0c0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d41575a0 con 0x7f20d4155b60 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.818+0000 7f20dc0c0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20d40b0e40 con 0x7f20d41599d0 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.818+0000 7f20dc0c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20d4156990 con 0x7f20d4155f30 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d9e5c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f20d4155b60 0x7f20d40b0730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47898/0 (socket says 172.21.15.33:47898) 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d9e5c700 1 -- 172.21.15.33:0/3194082832 learned_addr learned my addr 172.21.15.33:0/3194082832 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d965b700 1 --2- 172.21.15.33:0/3194082832 >> v2:172.21.15.59:3300/0 conn(0x7f20d4155f30 0x7f20d4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568186429 0 0) 0x7f20d41575a0 con 0x7f20d4155b60 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20bc003570 con 0x7f20d4155b60 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4282563167 0 0) 0x7f20bc003570 con 0x7f20d4155b60 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 >> v2:172.21.15.59:3300/0 conn(0x7f20d4155f30 msgr2=0x7f20d4156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 --2- 172.21.15.33:0/3194082832 >> v2:172.21.15.59:3300/0 conn(0x7f20d4155f30 0x7f20d4156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 >> v1:172.21.15.59:6789/0 conn(0x7f20d41599d0 legacy=0x7f20d4157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d4156c70 con 0x7f20d4155b60 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f20c40017f0 con 0x7f20d4155b60 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 >> v1:172.21.15.33:6789/0 conn(0x7f20d4155b60 legacy=0x7f20d40b0730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 0x7f20bc003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc004810 0x7f20bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20bc0051c0 0x7f20bc00cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d4156990 con 0x7f20bc003a60 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc00d160 con 0x7f20bc004810 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20bc00d320 con 0x7f20bc0051c0 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 0x7f20bc003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20d965b700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc004810 0x7f20bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.819+0000 7f20da65d700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20bc0051c0 0x7f20bc00cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 -- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20bc0051c0 msgr2=0x7f20bc00cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20bc0051c0 0x7f20bc00cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 -- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc004810 msgr2=0x7f20bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc004810 0x7f20bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 -- 172.21.15.33:0/3194082832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20bc003570 con 0x7f20bc003a60 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20da65d700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20bc0051c0 0x7f20bc00cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20da65d700 1 -- 172.21.15.33:0/3194082832 reap_dead start 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 0x7f20bc003e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a940 tx=0x7f20d40b1580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a3948b944c70335 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40070d0 con 0x7f20bc003a60 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c4007230 con 0x7f20bc003a60 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20d8e5a700 1 -- 172.21.15.33:0/3194082832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c40075f0 con 0x7f20bc003a60 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20dc0c0700 1 -- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 msgr2=0x7f20bc003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 0x7f20bc003e30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a940 tx=0x7f20d40b1580 comp rx=0 tx=0).stop 2023-10-09T15:31:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20dc0c0700 1 -- 172.21.15.33:0/3194082832 shutdown_connections 2023-10-09T15:31:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/3194082832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20bc003a60 0x7f20bc003e30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.820+0000 7f20dc0c0700 1 -- 172.21.15.33:0/3194082832 >> 172.21.15.33:0/3194082832 conn(0x7f20d406d170 msgr2=0x7f20d40cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.821+0000 7f20dc0c0700 1 -- 172.21.15.33:0/3194082832 shutdown_connections 2023-10-09T15:31:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.821+0000 7f20dc0c0700 1 -- 172.21.15.33:0/3194082832 wait complete. 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 Processor -- start 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 -- start start 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc003a60 0x7f20d40c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d40c6e40 0x7f20d40ca320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c2140 con 0x7f20d40c44a0 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c3060 con 0x7f20bc003a60 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.822+0000 7f20dc0c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20d40c18a0 con 0x7f20d40c6e40 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42254/0 (socket says 172.21.15.33:42254) 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 -- 172.21.15.33:0/647034745 learned_addr learned my addr 172.21.15.33:0/647034745 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc003a60 0x7f20d40c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20da65d700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d40c6e40 0x7f20d40ca320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 -- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d40c6e40 msgr2=0x7f20d40ca320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d40c6e40 0x7f20d40ca320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 -- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc003a60 msgr2=0x7f20d40c11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc003a60 0x7f20d40c11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 -- 172.21.15.33:0/647034745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20d40c1b80 con 0x7f20d40c44a0 2023-10-09T15:31:01.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d965b700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20c8011b40 tx=0x7f20c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800f940 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20c800faa0 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20c800fe40 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20d40c1e60 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.823+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20d40c4910 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.824+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20d40c3210 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.825+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f20c801d690 con 0x7f20d40c44a0 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.825+0000 7f20d1ffb700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:01.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.825+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f20c8018070 con 0x7f20d40c44a0 2023-10-09T15:31:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.825+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.826+0000 7f20d9e5c700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 0x7f20c00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a430 tx=0x7f20c4015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:01.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:01.830+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f20d40c3210 con 0x7f20d40c44a0 2023-10-09T15:31:02.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.071+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f20d40c31d0 con 0x7f20d40c44a0 2023-10-09T15:31:02.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.673+0000 7f20d1ffb700 1 -- 172.21.15.33:0/647034745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7f20c8052410 con 0x7f20d40c44a0 2023-10-09T15:31:02.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 msgr2=0x7f20c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 0x7f20c00693e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f20c400a430 tx=0x7f20c4015000 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 msgr2=0x7f20d40c7d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f20c8011b40 tx=0x7f20c80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 shutdown_connections 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20c0066f30 0x7f20c00693e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f20d40c6e40 0x7f20d40ca320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20bc003a60 0x7f20d40c11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 --2- 172.21.15.33:0/647034745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20d40c44a0 0x7f20d40c7d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.676+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 >> 172.21.15.33:0/647034745 conn(0x7f20d406d170 msgr2=0x7f20d4152cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.677+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 shutdown_connections 2023-10-09T15:31:02.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.677+0000 7f20dc0c0700 1 -- 172.21.15.33:0/647034745 wait complete. 2023-10-09T15:31:02.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:02.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 Processor -- start 2023-10-09T15:31:02.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 -- start start 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25640cb970 0x7f2564159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 0x7f2564156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f256415ae40 con 0x7f25640cb5a0 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640ce0f0 con 0x7f25640cb970 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.820+0000 7f256af77700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25640d13f0 con 0x7f256415a400 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f25640cb970 0x7f2564159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2568d13700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f25640cb5a0 0x7f25640cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47900/0 (socket says 172.21.15.33:47900) 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2568d13700 1 -- 172.21.15.33:0/969646518 learned_addr learned my addr 172.21.15.33:0/969646518 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:02.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2569514700 1 --2- 172.21.15.33:0/969646518 >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 0x7f2564156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 -- 172.21.15.33:0/969646518 >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 msgr2=0x7f2564156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 --2- 172.21.15.33:0/969646518 >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 0x7f2564156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 -- 172.21.15.33:0/969646518 >> v1:172.21.15.33:6789/0 conn(0x7f25640cb5a0 legacy=0x7f25640cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 -- 172.21.15.33:0/969646518 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f256415ab60 con 0x7f25640cb970 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2569514700 1 --2- 172.21.15.33:0/969646518 >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 0x7f2564156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f2563fff700 1 --2- 172.21.15.33:0/969646518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25640cb970 0x7f2564159ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25640ccdf0 tx=0x7f25540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b90b708a57e83289 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f25637fe700 1 -- 172.21.15.33:0/969646518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400b6b0 con 0x7f25640cb970 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f25637fe700 1 -- 172.21.15.33:0/969646518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255400b810 con 0x7f25640cb970 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.821+0000 7f25637fe700 1 -- 172.21.15.33:0/969646518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255400bbb0 con 0x7f25640cb970 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 -- 172.21.15.33:0/969646518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25640cb970 msgr2=0x7f2564159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 --2- 172.21.15.33:0/969646518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25640cb970 0x7f2564159ec0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f25640ccdf0 tx=0x7f25540091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 -- 172.21.15.33:0/969646518 shutdown_connections 2023-10-09T15:31:02.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 --2- 172.21.15.33:0/969646518 >> v2:172.21.15.59:3300/0 conn(0x7f256415a400 0x7f2564156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 --2- 172.21.15.33:0/969646518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25640cb970 0x7f2564159ec0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 -- 172.21.15.33:0/969646518 >> 172.21.15.33:0/969646518 conn(0x7f2564070e30 msgr2=0x7f25640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:02.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 -- 172.21.15.33:0/969646518 shutdown_connections 2023-10-09T15:31:02.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.822+0000 7f256af77700 1 -- 172.21.15.33:0/969646518 wait complete. 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.823+0000 7f256af77700 1 Processor -- start 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.823+0000 7f256af77700 1 -- start start 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25640cb5a0 0x7f25640c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25640cb970 0x7f256415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25641571b0 con 0x7f256415a400 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25641575a0 con 0x7f25640cb970 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f256af77700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2564157880 con 0x7f25640cb5a0 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42262/0 (socket says 172.21.15.33:42262) 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 -- 172.21.15.33:0/716221977 learned_addr learned my addr 172.21.15.33:0/716221977 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2563fff700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25640cb970 0x7f256415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2568d13700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25640cb5a0 0x7f25640c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 -- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25640cb5a0 msgr2=0x7f25640c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25640cb5a0 0x7f25640c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 -- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25640cb970 msgr2=0x7f256415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:02.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25640cb970 0x7f256415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.824+0000 7f2569514700 1 -- 172.21.15.33:0/716221977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2554009420 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f2569514700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f255c009fc0 tx=0x7f255c0099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c00dbe0 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f255c00f040 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2564157b60 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f255c015440 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.825+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f256415c840 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.826+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25641572f0 con 0x7f256415a400 2023-10-09T15:31:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.826+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f255c01e3b0 con 0x7f256415a400 2023-10-09T15:31:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.827+0000 7f2560ff9700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 0x7f25440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.827+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f255c084880 con 0x7f256415a400 2023-10-09T15:31:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.827+0000 7f2568d13700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 0x7f25440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.827+0000 7f2568d13700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 0x7f25440693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f254c007130 tx=0x7f254c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:02.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:02.831+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f255c051af0 con 0x7f256415a400 2023-10-09T15:31:03.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.069+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f256404c3c0 con 0x7f256415a400 2023-10-09T15:31:03.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.070+0000 7f2560ff9700 1 -- 172.21.15.33:0/716221977 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f255c01a090 con 0x7f256415a400 2023-10-09T15:31:03.070 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:03.070 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:03.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 msgr2=0x7f25440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 0x7f25440693e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f254c007130 tx=0x7f254c007eb0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 msgr2=0x7f25641531d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f255c009fc0 tx=0x7f255c0099b0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 shutdown_connections 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2544066f30 0x7f25440693e0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f256415a400 0x7f25641531d0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25640cb5a0 0x7f25640c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 --2- 172.21.15.33:0/716221977 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25640cb970 0x7f256415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 >> 172.21.15.33:0/716221977 conn(0x7f2564070e30 msgr2=0x7f25640ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 shutdown_connections 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.072+0000 7f256af77700 1 -- 172.21.15.33:0/716221977 wait complete. 2023-10-09T15:31:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:03.084 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:03.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.203+0000 7f9d52c95700 1 Processor -- start 2023-10-09T15:31:03.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.203+0000 7f9d52c95700 1 -- start start 2023-10-09T15:31:03.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.203+0000 7f9d52c95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.203+0000 7f9d52c95700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d4c0cd9e0 0x7f9d4c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d52c95700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d4c15ae40 con 0x7f9d4c0cde50 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d52c95700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d4c0d13f0 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d52c95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c15ab60 con 0x7f9d4c0cb5a0 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d50a31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9d4c0cd9e0 0x7f9d4c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d51232700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9d4c0cde50 0x7f9d4c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42632/0 (socket says 172.21.15.33:42632) 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d51232700 1 -- 172.21.15.33:0/520631072 learned_addr learned my addr 172.21.15.33:0/520631072 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 -- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 msgr2=0x7f9d4c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 --2- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 -- 172.21.15.33:0/520631072 >> v1:172.21.15.59:6789/0 conn(0x7f9d4c0cde50 legacy=0x7f9d4c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/520631072 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 223176168 0 0) 0x7f9d4c15ae40 con 0x7f9d4c0cde50 2023-10-09T15:31:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 -- 172.21.15.33:0/520631072 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d4c0ccf00 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.204+0000 7f9d4bfff700 1 --2- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c159ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098e0 tx=0x7f9d3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ef0e280158b572a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/520631072 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00b640 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/520631072 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d3c00b7a0 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d4b7fe700 1 -- 172.21.15.33:0/520631072 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d3c00bb40 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 -- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 msgr2=0x7f9d4c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 --2- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c159ec0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9d3c0098e0 tx=0x7f9d3c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 -- 172.21.15.33:0/520631072 shutdown_connections 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 --2- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 --2- 172.21.15.33:0/520631072 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c159ec0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 -- 172.21.15.33:0/520631072 >> 172.21.15.33:0/520631072 conn(0x7f9d4c070e30 msgr2=0x7f9d4c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 -- 172.21.15.33:0/520631072 shutdown_connections 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.205+0000 7f9d52c95700 1 -- 172.21.15.33:0/520631072 wait complete. 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.206+0000 7f9d52c95700 1 Processor -- start 2023-10-09T15:31:03.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 -- start start 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c0b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c159350 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c159580 con 0x7f9d4c0cd9e0 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d52c95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d4c159860 con 0x7f9d4c0cb5a0 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d51232700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d51232700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42270/0 (socket says 172.21.15.33:42270) 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d51232700 1 -- 172.21.15.33:0/1315771390 learned_addr learned my addr 172.21.15.33:0/1315771390 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.207+0000 7f9d4bfff700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c0b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d50a31700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 -- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 msgr2=0x7f9d4c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 -- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 msgr2=0x7f9d4c0b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c0b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 -- 172.21.15.33:0/1315771390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d3c009420 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d4bfff700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c0b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d51232700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400cbf0 tx=0x7f9d440019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400a8b0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d4400aa10 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400add0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d4c159b40 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.208+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d4c15e2c0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.209+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d4c04c3c0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.209+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9d44007300 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.210+0000 7f9d48ff9700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 0x7f9d2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.210+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9d440847d0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.210+0000 7f9d50a31700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 0x7f9d2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.210+0000 7f9d50a31700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 0x7f9d2c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009db0 tx=0x7f9d340091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.214+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9d44051ac0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.409+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d4c0cd1e0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.409+0000 7f9d48ff9700 1 -- 172.21.15.33:0/1315771390 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f9d440550e0 con 0x7f9d4c0c9f50 2023-10-09T15:31:03.409 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:03.409 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 msgr2=0x7f9d2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 0x7f9d2c0693e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d34009db0 tx=0x7f9d340091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 msgr2=0x7f9d4c155e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9d4400cbf0 tx=0x7f9d440019b0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 shutdown_connections 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9d2c066f30 0x7f9d2c0693e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9d4c0c9f50 0x7f9d4c155e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9d4c0cb5a0 0x7f9d4c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 --2- 172.21.15.33:0/1315771390 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9d4c0cd9e0 0x7f9d4c0b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 >> 172.21.15.33:0/1315771390 conn(0x7f9d4c070e30 msgr2=0x7f9d4c0c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 shutdown_connections 2023-10-09T15:31:03.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.412+0000 7f9d52c95700 1 -- 172.21.15.33:0/1315771390 wait complete. 2023-10-09T15:31:03.424 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:31:03.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:03.464 INFO:tasks.ceph.mds.d.smithi059.stderr:2023-10-09T15:31:03.463+0000 7f7247371700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:31:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.543+0000 7f8e324cb700 1 Processor -- start 2023-10-09T15:31:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.543+0000 7f8e324cb700 1 -- start start 2023-10-09T15:31:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e324cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c153c30 0x7f8e2c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e324cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2c15de50 0x7f8e2c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e324cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e2c15afd0 con 0x7f8e2c0cef40 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e324cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e2c15b2b0 con 0x7f8e2c15de50 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e324cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c15b590 con 0x7f8e2c153c30 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e314c9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c153c30 0x7f8e2c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e30cc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2c15de50 0x7f8e2c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e30cc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e2c15de50 0x7f8e2c0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49746/0 (socket says 172.21.15.33:49746) 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e30cc8700 1 -- 172.21.15.33:0/2229943253 learned_addr learned my addr 172.21.15.33:0/2229943253 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.544+0000 7f8e31cca700 1 --1- 172.21.15.33:0/2229943253 >> v1:172.21.15.59:6789/0 conn(0x7f8e2c0cef40 0x7f8e2c06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42640/0 (socket says 172.21.15.33:42640) 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e30cc8700 1 -- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c153c30 msgr2=0x7f8e2c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e30cc8700 1 --2- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c153c30 0x7f8e2c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e30cc8700 1 -- 172.21.15.33:0/2229943253 >> v1:172.21.15.59:6789/0 conn(0x7f8e2c0cef40 legacy=0x7f8e2c06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e2bfff700 1 -- 172.21.15.33:0/2229943253 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3142407049 0 0) 0x7f8e2c15afd0 con 0x7f8e2c0cef40 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e30cc8700 1 -- 172.21.15.33:0/2229943253 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e2c15b870 con 0x7f8e2c15de50 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e30cc8700 1 --2- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c15de50 0x7f8e2c0cea00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e200099b0 tx=0x7f8e20009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=998ff8d40ff4d257 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e2bfff700 1 -- 172.21.15.33:0/2229943253 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e20009ea0 con 0x7f8e2c15de50 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e2bfff700 1 -- 172.21.15.33:0/2229943253 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2000b860 con 0x7f8e2c15de50 2023-10-09T15:31:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e2bfff700 1 -- 172.21.15.33:0/2229943253 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000bc00 con 0x7f8e2c15de50 2023-10-09T15:31:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 -- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c15de50 msgr2=0x7f8e2c0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 --2- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c15de50 0x7f8e2c0cea00 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f8e200099b0 tx=0x7f8e20009250 comp rx=0 tx=0).stop 2023-10-09T15:31:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 -- 172.21.15.33:0/2229943253 shutdown_connections 2023-10-09T15:31:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 --2- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c153c30 0x7f8e2c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 --2- 172.21.15.33:0/2229943253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c15de50 0x7f8e2c0cea00 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 -- 172.21.15.33:0/2229943253 >> 172.21.15.33:0/2229943253 conn(0x7f8e2c0703a0 msgr2=0x7f8e2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.545+0000 7f8e324cb700 1 -- 172.21.15.33:0/2229943253 shutdown_connections 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.546+0000 7f8e324cb700 1 -- 172.21.15.33:0/2229943253 wait complete. 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 Processor -- start 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 -- start start 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c0cef40 0x7f8e2c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c15de50 0x7f8e2c0cc620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0c9ed0 con 0x7f8e2c153c30 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0ca360 con 0x7f8e2c0cef40 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.547+0000 7f8e324cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e2c0c92c0 con 0x7f8e2c15de50 2023-10-09T15:31:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42274/0 (socket says 172.21.15.33:42274) 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 -- 172.21.15.33:0/3395667689 learned_addr learned my addr 172.21.15.33:0/3395667689 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e31cca700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c15de50 0x7f8e2c0cc620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e314c9700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c0cef40 0x7f8e2c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 -- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c15de50 msgr2=0x7f8e2c0cc620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c15de50 0x7f8e2c0cc620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 -- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c0cef40 msgr2=0x7f8e2c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c0cef40 0x7f8e2c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 -- 172.21.15.33:0/3395667689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e200094f0 con 0x7f8e2c153c30 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e30cc8700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06eb00 tx=0x7f8e20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2000bbe0 con 0x7f8e2c153c30 2023-10-09T15:31:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2001a450 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c0c95a0 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2001a810 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.548+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e2c0c9b60 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.549+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e2c04c3c0 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.550+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e2001ac00 con 0x7f8e2c153c30 2023-10-09T15:31:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.550+0000 7f8e297fa700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 0x7f8e180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.550+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8e20086050 con 0x7f8e2c153c30 2023-10-09T15:31:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.550+0000 7f8e314c9700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 0x7f8e180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.551+0000 7f8e314c9700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 0x7f8e180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0cda30 tx=0x7f8e1c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.555+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e200532c0 con 0x7f8e2c153c30 2023-10-09T15:31:03.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.742+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8e2c0caef0 con 0x7f8e18066f30 2023-10-09T15:31:03.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.750+0000 7f8e297fa700 1 -- 172.21.15.33:0/3395667689 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254057 (secure 0 0 0) 0x7f8e2c0caef0 con 0x7f8e18066f30 2023-10-09T15:31:03.753 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 msgr2=0x7f8e180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 0x7f8e180693e0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c0cda30 tx=0x7f8e1c00b040 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 msgr2=0x7f8e2c0cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c06eb00 tx=0x7f8e20017000 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 shutdown_connections 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e18066f30 0x7f8e180693e0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e2c15de50 0x7f8e2c0cc620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e2c0cef40 0x7f8e2c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 --2- 172.21.15.33:0/3395667689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e2c153c30 0x7f8e2c0cc0e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 >> 172.21.15.33:0/3395667689 conn(0x7f8e2c0703a0 msgr2=0x7f8e2c070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 shutdown_connections 2023-10-09T15:31:03.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.753+0000 7f8e324cb700 1 -- 172.21.15.33:0/3395667689 wait complete. 2023-10-09T15:31:03.756 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:03.765 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T15:31:03.235652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381324,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593396,"statfs":{"total":773094113280,"available":770655637504,"internally_reserved":0,"allocated":2514944,"data_stored":1584640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639067+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636785+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638112+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638937+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636766+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637117+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636783+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.642077+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637863+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640800+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641041+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638275+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639623+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641975+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637780+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644226+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641511+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640065+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641134+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644069+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641727+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T15:30:56.331104+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:56.331104+0000","last_peered":"2023-10-09T15:30:56.331104+0000","last_clean":"2023-10-09T15:30:56.331104+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:56.331104+0000","last_undegraded":"2023-10-09T15:30:56.331104+0000","last_fullsized":"2023-10-09T15:30:56.331104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637092+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637290+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639983+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637178+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637781+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639802+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641040+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637902+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644183+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640004+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644260+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":641708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":757760,"data_stored":640697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:03.771 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.924+0000 7fbabafa0700 1 Processor -- start 2023-10-09T15:31:03.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbabafa0700 1 -- start start 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbabafa0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbab415a7d0 0x7fbab4158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbabafa0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab4158c80 con 0x7fbab41508c0 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbabafa0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbab4158f60 con 0x7fbab4150c90 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbabafa0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbab415afc0 con 0x7fbab415a7d0 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.925+0000 7fbab8d3c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbab41508c0 0x7fbab415a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47906/0 (socket says 172.21.15.33:47906) 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab8d3c700 1 -- 172.21.15.33:0/2594540742 learned_addr learned my addr 172.21.15.33:0/2594540742 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1529560706 0 0) 0x7fbab4158c80 con 0x7fbab41508c0 2023-10-09T15:31:03.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab3fff700 1 --2- 172.21.15.33:0/2594540742 >> v2:172.21.15.59:3300/0 conn(0x7fbab415a7d0 0x7fbab4158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba9c003570 con 0x7fbab41508c0 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3883178594 0 0) 0x7fba9c003570 con 0x7fbab41508c0 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 >> v2:172.21.15.59:3300/0 conn(0x7fbab415a7d0 msgr2=0x7fbab4158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 --2- 172.21.15.33:0/2594540742 >> v2:172.21.15.59:3300/0 conn(0x7fbab415a7d0 0x7fbab4158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 >> v1:172.21.15.59:6789/0 conn(0x7fbab4150c90 legacy=0x7fbab4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4159240 con 0x7fbab41508c0 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fbaac0017f0 con 0x7fbab41508c0 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 >> v1:172.21.15.33:6789/0 conn(0x7fbab41508c0 legacy=0x7fbab415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba9c003a60 0x7fba9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fba9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9c0051c0 0x7fba9c00dc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c00e2b0 con 0x7fba9c004810 2023-10-09T15:31:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c009a80 con 0x7fba9c0051c0 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba9c009c40 con 0x7fba9c003a60 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab3fff700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fba9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab8d3c700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba9c003a60 0x7fba9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.926+0000 7fbab953d700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9c0051c0 0x7fba9c00dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 -- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba9c003a60 msgr2=0x7fba9c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba9c003a60 0x7fba9c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 -- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9c0051c0 msgr2=0x7fba9c00dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba9c0051c0 0x7fba9c00dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 -- 172.21.15.33:0/2594540742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c003570 con 0x7fba9c004810 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab953d700 1 -- 172.21.15.33:0/2594540742 reap_dead start 2023-10-09T15:31:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab3fff700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fba9c004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c00 tx=0x7fbaa80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30f734b6a7a5f4f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800e710 con 0x7fba9c004810 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaa800e870 con 0x7fba9c004810 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbab37fe700 1 -- 172.21.15.33:0/2594540742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaa800ec30 con 0x7fba9c004810 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 -- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 msgr2=0x7fba9c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fba9c004c80 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fbaa8009c00 tx=0x7fbaa80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 -- 172.21.15.33:0/2594540742 shutdown_connections 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 --2- 172.21.15.33:0/2594540742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fba9c004c80 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 -- 172.21.15.33:0/2594540742 >> 172.21.15.33:0/2594540742 conn(0x7fbab40cded0 msgr2=0x7fbab406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 -- 172.21.15.33:0/2594540742 shutdown_connections 2023-10-09T15:31:03.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.927+0000 7fbabafa0700 1 -- 172.21.15.33:0/2594540742 wait complete. 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 Processor -- start 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 -- start start 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbab4152830 0x7fbab4155690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbab414dd10 0x7fbab406b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab40c2ba0 con 0x7fba9c004810 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41566f0 con 0x7fbab4152830 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbabafa0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbab41512c0 con 0x7fbab414dd10 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.929+0000 7fbab8d3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42286/0 (socket says 172.21.15.33:42286) 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 -- 172.21.15.33:0/4285071770 learned_addr learned my addr 172.21.15.33:0/4285071770 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab3fff700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbab4152830 0x7fbab4155690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab953d700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbab414dd10 0x7fbab406b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 -- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbab414dd10 msgr2=0x7fbab406b850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbab414dd10 0x7fbab406b850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 -- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbab4152830 msgr2=0x7fbab4155690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbab4152830 0x7fbab4155690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 -- 172.21.15.33:0/4285071770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbab4155bd0 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab8d3c700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007ac0 tx=0x7fbaac0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac0133f0 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbaac013550 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbab4152ca0 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbaac013910 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.930+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbab4156130 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.931+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbab40b2580 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.931+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbaac013cc0 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.932+0000 7fbab0ff9700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.932+0000 7fbab3fff700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.932+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbaac085100 con 0x7fba9c004810 2023-10-09T15:31:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.932+0000 7fbab3fff700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 0x7fbaa00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80091e0 tx=0x7fbaa801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:03.936+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbaac052370 con 0x7fba9c004810 2023-10-09T15:31:04.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.125+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbab4151400 con 0x7fbaa0066f30 2023-10-09T15:31:04.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.132+0000 7fbab0ff9700 1 -- 172.21.15.33:0/4285071770 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254057 (secure 0 0 0) 0x7fbaa8023040 con 0x7fbaa0066f30 2023-10-09T15:31:04.135 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 msgr2=0x7fbaa00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 0x7fbaa00693e0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fbaa80091e0 tx=0x7fbaa801a000 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 msgr2=0x7fbab41662e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fbaac007ac0 tx=0x7fbaac0021d0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 shutdown_connections 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbaa0066f30 0x7fbaa00693e0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba9c004810 0x7fbab41662e0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbab414dd10 0x7fbab406b850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 --2- 172.21.15.33:0/4285071770 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbab4152830 0x7fbab4155690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 >> 172.21.15.33:0/4285071770 conn(0x7fbab40cded0 msgr2=0x7fbab414ffd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:04.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 shutdown_connections 2023-10-09T15:31:04.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.135+0000 7fbabafa0700 1 -- 172.21.15.33:0/4285071770 wait complete. 2023-10-09T15:31:04.138 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:04.147 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T15:31:03.235652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381324,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593396,"statfs":{"total":773094113280,"available":770655637504,"internally_reserved":0,"allocated":2514944,"data_stored":1584640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639067+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636785+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638112+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638937+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636766+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637117+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636783+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.642077+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637863+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640800+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641041+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638275+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639623+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641975+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637780+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644226+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641511+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640065+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641134+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644069+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641727+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T15:30:56.331104+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:56.331104+0000","last_peered":"2023-10-09T15:30:56.331104+0000","last_clean":"2023-10-09T15:30:56.331104+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:56.331104+0000","last_undegraded":"2023-10-09T15:30:56.331104+0000","last_fullsized":"2023-10-09T15:30:56.331104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637092+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637290+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639983+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637178+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637781+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639802+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641040+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637902+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644183+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640004+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644260+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":641708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":757760,"data_stored":640697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:04.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.307+0000 7f2bb0f7d700 1 Processor -- start 2023-10-09T15:31:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.307+0000 7f2bb0f7d700 1 -- start start 2023-10-09T15:31:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bb0f7d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2bac15de50 0x7f2bac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bb0f7d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2bac0cef40 0x7f2bac15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bb0f7d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2bac0cf3c0 con 0x7f2bac153c30 2023-10-09T15:31:04.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bb0f7d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac15afd0 con 0x7f2bac15de50 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bb0f7d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bac15b2b0 con 0x7f2bac0cef40 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baaffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2bac15de50 0x7f2bac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bab7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2bac153c30 0x7f2bac15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47910/0 (socket says 172.21.15.33:47910) 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2bab7fe700 1 -- 172.21.15.33:0/391257825 learned_addr learned my addr 172.21.15.33:0/391257825 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2babfff700 1 --2- 172.21.15.33:0/391257825 >> v2:172.21.15.59:3300/0 conn(0x7f2bac0cef40 0x7f2bac15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baaffd700 1 -- 172.21.15.33:0/391257825 >> v2:172.21.15.59:3300/0 conn(0x7f2bac0cef40 msgr2=0x7f2bac15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baaffd700 1 --2- 172.21.15.33:0/391257825 >> v2:172.21.15.59:3300/0 conn(0x7f2bac0cef40 0x7f2bac15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baaffd700 1 -- 172.21.15.33:0/391257825 >> v1:172.21.15.33:6789/0 conn(0x7f2bac153c30 legacy=0x7f2bac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baaffd700 1 -- 172.21.15.33:0/391257825 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bac15b590 con 0x7f2bac15de50 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.308+0000 7f2baa7fc700 1 -- 172.21.15.33:0/391257825 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 953052046 0 0) 0x7f2bac0cf3c0 con 0x7f2bac153c30 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2baaffd700 1 --2- 172.21.15.33:0/391257825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac15de50 0x7f2bac0cea00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0cdab0 tx=0x7f2ba00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9a3e1ff26083008 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2baa7fc700 1 -- 172.21.15.33:0/391257825 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000b6b0 con 0x7f2bac15de50 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2baa7fc700 1 -- 172.21.15.33:0/391257825 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000b810 con 0x7f2bac15de50 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2baa7fc700 1 -- 172.21.15.33:0/391257825 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba000bbb0 con 0x7f2bac15de50 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/391257825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac15de50 msgr2=0x7f2bac0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/391257825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac15de50 0x7f2bac0cea00 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0cdab0 tx=0x7f2ba00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/391257825 shutdown_connections 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/391257825 >> v2:172.21.15.59:3300/0 conn(0x7f2bac0cef40 0x7f2bac15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/391257825 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac15de50 0x7f2bac0cea00 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/391257825 >> 172.21.15.33:0/391257825 conn(0x7f2bac0703a0 msgr2=0x7f2bac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/391257825 shutdown_connections 2023-10-09T15:31:04.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.309+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/391257825 wait complete. 2023-10-09T15:31:04.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 Processor -- start 2023-10-09T15:31:04.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 -- start start 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bac0cef40 0x7f2bac143d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bac15de50 0x7f2bac0b4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b4080 con 0x7f2bac153c30 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b3470 con 0x7f2bac0cef40 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2bb0f7d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bac0b3750 con 0x7f2bac15de50 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2baaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42306/0 (socket says 172.21.15.33:42306) 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.311+0000 7f2baaffd700 1 -- 172.21.15.33:0/2978175411 learned_addr learned my addr 172.21.15.33:0/2978175411 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2bab7fe700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bac0cef40 0x7f2bac143d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2babfff700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bac15de50 0x7f2bac0b4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 -- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bac15de50 msgr2=0x7f2bac0b4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bac15de50 0x7f2bac0b4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 -- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bac0cef40 msgr2=0x7f2bac143d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bac0cef40 0x7f2bac143d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 -- 172.21.15.33:0/2978175411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ba0009420 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2baaffd700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bac06eb00 tx=0x7f2ba0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0000d10 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ba000bb90 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bac0b3a30 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ba0011670 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.312+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bac16abe0 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.313+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bac0b3ed0 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.314+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2ba0011aa0 con 0x7f2bac153c30 2023-10-09T15:31:04.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.314+0000 7f2b937fe700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.314+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2ba0085ea0 con 0x7f2bac153c30 2023-10-09T15:31:04.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.314+0000 7f2bab7fe700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.314+0000 7f2bab7fe700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 0x7f2b980693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0709d0 tx=0x7f2b9c007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.318+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ba0053110 con 0x7f2bac153c30 2023-10-09T15:31:04.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.511+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2bac04c3c0 con 0x7f2b98066f30 2023-10-09T15:31:04.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.518+0000 7f2b937fe700 1 -- 172.21.15.33:0/2978175411 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+254057 (secure 0 0 0) 0x7f2bac04c3c0 con 0x7f2b98066f30 2023-10-09T15:31:04.521 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 msgr2=0x7f2b980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 0x7f2b980693e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f2bac0709d0 tx=0x7f2b9c007f50 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 msgr2=0x7f2bac0c9950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bac06eb00 tx=0x7f2ba0017000 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 shutdown_connections 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b98066f30 0x7f2b980693e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2bac15de50 0x7f2bac0b4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2bac0cef40 0x7f2bac143d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 --2- 172.21.15.33:0/2978175411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2bac153c30 0x7f2bac0c9950 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 >> 172.21.15.33:0/2978175411 conn(0x7f2bac0703a0 msgr2=0x7f2bac152fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:04.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 shutdown_connections 2023-10-09T15:31:04.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.521+0000 7f2bb0f7d700 1 -- 172.21.15.33:0/2978175411 wait complete. 2023-10-09T15:31:04.524 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:04.533 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-10-09T15:31:03.235652+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381324,"kb_used_data":2456,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593396,"statfs":{"total":773094113280,"available":770655637504,"internally_reserved":0,"allocated":2514944,"data_stored":1584640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.599001"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639067+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636785+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638112+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638937+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636766+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637117+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.636783+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.642077+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637863+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640800+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641041+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.638275+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639623+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641975+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637780+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644226+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641511+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640065+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641134+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644069+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641727+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":160,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-10-09T15:30:56.331104+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:56.331104+0000","last_peered":"2023-10-09T15:30:56.331104+0000","last_clean":"2023-10-09T15:30:56.331104+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:56.331104+0000","last_undegraded":"2023-10-09T15:30:56.331104+0000","last_fullsized":"2023-10-09T15:30:56.331104+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637092+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637290+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639983+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637178+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637781+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.639802+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.641040+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.637902+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644183+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.640004+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:30:57.628594+0000","last_change":"2023-10-09T15:30:57.644260+0000","last_active":"2023-10-09T15:30:57.628594+0000","last_peered":"2023-10-09T15:30:57.628594+0000","last_clean":"2023-10-09T15:30:57.628594+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:57.628594+0000","last_undegraded":"2023-10-09T15:30:57.628594+0000","last_fullsized":"2023-10-09T15:30:57.628594+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:30:58.633392+0000","last_change":"2023-10-09T15:30:58.633392+0000","last_active":"2023-10-09T15:30:58.633392+0000","last_peered":"2023-10-09T15:30:58.633392+0000","last_clean":"2023-10-09T15:30:58.633392+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:30:58.633392+0000","last_undegraded":"2023-10-09T15:30:58.633392+0000","last_fullsized":"2023-10-09T15:30:58.633392+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298032,"kb_used_data":744,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073808,"statfs":{"total":96636764160,"available":96331579392,"internally_reserved":0,"allocated":761856,"data_stored":641708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51500000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297440,"kb_used_data":152,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074400,"statfs":{"total":96636764160,"available":96332185600,"internally_reserved":0,"allocated":155648,"data_stored":45535,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54100000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35899999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58499999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298592,"kb_used_data":740,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073248,"statfs":{"total":96636764160,"available":96331005952,"internally_reserved":0,"allocated":757760,"data_stored":640697,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40999999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38600000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.79300000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68899999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77300000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42599999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51200000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58799999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574850,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32900000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34599999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.371}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45200000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54200000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297452,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074388,"statfs":{"total":96636764160,"available":96332173312,"internally_reserved":0,"allocated":167936,"data_stored":51340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65000000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61199999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:04.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-10-09T15:31:04.538 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.538 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-10-09T15:31:04.539 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-10-09T15:31:04.540 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-10-09T15:31:04.541 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.639067+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-10-09T15:31:04.542 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.636785+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.638112+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-10-09T15:31:04.543 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.638937+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.636766+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637117+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-10-09T15:31:04.544 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.636783+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.642077+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-10-09T15:31:04.545 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637863+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.640800+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-10-09T15:31:04.546 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641041+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.638275+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.639623+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-10-09T15:31:04.547 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641975+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637780+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-10-09T15:31:04.548 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.644226+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641511+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.640065+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-10-09T15:31:04.549 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641134+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.644069+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-10-09T15:31:04.550 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641727+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637092+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637290+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-10-09T15:31:04.551 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.639983+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:45:54.233842+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637178+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.552 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637781+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.639802+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:31:12.842208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.641040+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-10-09T15:31:04.553 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.637902+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.644183+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-10-09T15:31:04.554 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.640004+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:30:57.628594+0000', 'last_change': '2023-10-09T15:30:57.644260+0000', 'last_active': '2023-10-09T15:30:57.628594+0000', 'last_peered': '2023-10-09T15:30:57.628594+0000', 'last_clean': '2023-10-09T15:30:57.628594+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:57.628594+0000', 'last_undegraded': '2023-10-09T15:30:57.628594+0000', 'last_fullsized': '2023-10-09T15:30:57.628594+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:57.628594+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-10-09T15:31:04.555 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-10-09T15:31:04.556 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.557 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-10-09T15:31:04.558 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:30:58.633392+0000', 'last_change': '2023-10-09T15:30:58.633392+0000', 'last_active': '2023-10-09T15:30:58.633392+0000', 'last_peered': '2023-10-09T15:30:58.633392+0000', 'last_clean': '2023-10-09T15:30:58.633392+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:30:58.633392+0000', 'last_undegraded': '2023-10-09T15:30:58.633392+0000', 'last_fullsized': '2023-10-09T15:30:58.633392+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'last_clean_scrub_stamp': '2023-10-09T15:30:58.633392+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:04.559 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T15:31:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.691+0000 7f3674722700 1 Processor -- start 2023-10-09T15:31:04.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.691+0000 7f3674722700 1 -- start start 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3674722700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f366c0a8d00 0x7f366c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3674722700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c0a90d0 0x7f366c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3674722700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f366c06e7f0 con 0x7f366c06e380 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3674722700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f366c0ae680 con 0x7f366c0a8d00 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3674722700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c0aeee0 con 0x7f366c0a90d0 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f36724be700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f366c0a8d00 0x7f366c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3672cbf700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f366c06e380 0x7f366c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47922/0 (socket says 172.21.15.33:47922) 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.692+0000 7f3672cbf700 1 -- 172.21.15.33:0/1889317372 learned_addr learned my addr 172.21.15.33:0/1889317372 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36724be700 1 -- 172.21.15.33:0/1889317372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c0a90d0 msgr2=0x7f366c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36724be700 1 --2- 172.21.15.33:0/1889317372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c0a90d0 0x7f366c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36724be700 1 -- 172.21.15.33:0/1889317372 >> v1:172.21.15.33:6789/0 conn(0x7f366c06e380 legacy=0x7f366c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36724be700 1 -- 172.21.15.33:0/1889317372 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f366c0cf490 con 0x7f366c0a8d00 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36714bc700 1 -- 172.21.15.33:0/1889317372 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152219572 0 0) 0x7f366c06e7f0 con 0x7f366c06e380 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36724be700 1 --2- 172.21.15.33:0/1889317372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a8d00 0x7f366c0cddf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36640098d0 tx=0x7f3664009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c50ec76f8669447 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36714bc700 1 -- 172.21.15.33:0/1889317372 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3664009e70 con 0x7f366c0a8d00 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36714bc700 1 -- 172.21.15.33:0/1889317372 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3664005c10 con 0x7f366c0a8d00 2023-10-09T15:31:04.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f36714bc700 1 -- 172.21.15.33:0/1889317372 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f366400b650 con 0x7f366c0a8d00 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.693+0000 7f3674722700 1 -- 172.21.15.33:0/1889317372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a8d00 msgr2=0x7f366c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 --2- 172.21.15.33:0/1889317372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a8d00 0x7f366c0cddf0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f36640098d0 tx=0x7f3664009120 comp rx=0 tx=0).stop 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 -- 172.21.15.33:0/1889317372 shutdown_connections 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 --2- 172.21.15.33:0/1889317372 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a8d00 0x7f366c0cddf0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 --2- 172.21.15.33:0/1889317372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c0a90d0 0x7f366c06de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 -- 172.21.15.33:0/1889317372 >> 172.21.15.33:0/1889317372 conn(0x7f366c06ce80 msgr2=0x7f366c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 -- 172.21.15.33:0/1889317372 shutdown_connections 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.694+0000 7f3674722700 1 -- 172.21.15.33:0/1889317372 wait complete. 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.695+0000 7f3674722700 1 Processor -- start 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.695+0000 7f3674722700 1 -- start start 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c06e380 0x7f366c14b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f366c0a8d00 0x7f366c15f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c1600c0 con 0x7f366c0a90d0 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f366c098a30 con 0x7f366c0a8d00 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f366c15fb00 con 0x7f366c06e380 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42326/0 (socket says 172.21.15.33:42326) 2023-10-09T15:31:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 -- 172.21.15.33:0/894466267 learned_addr learned my addr 172.21.15.33:0/894466267 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f36724be700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c06e380 0x7f366c14b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3671cbd700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f366c0a8d00 0x7f366c15f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 -- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c06e380 msgr2=0x7f366c14b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c06e380 0x7f366c14b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 -- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f366c0a8d00 msgr2=0x7f366c15f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f366c0a8d00 0x7f366c15f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 -- 172.21.15.33:0/894466267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36640093c0 con 0x7f366c0a90d0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3672cbf700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f365c00ccc0 tx=0x7f365c001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00a880 con 0x7f366c0a90d0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f365c00a9e0 con 0x7f366c0a90d0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f366c15fde0 con 0x7f366c0a90d0 2023-10-09T15:31:04.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f365c00ad80 con 0x7f366c0a90d0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.696+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f366c14bda0 con 0x7f366c0a90d0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.697+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f366c04c3c0 con 0x7f366c0a90d0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.698+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f365c007300 con 0x7f366c0a90d0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.698+0000 7f366a7fc700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 0x7f36580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.698+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f365c084820 con 0x7f366c0a90d0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.698+0000 7f36724be700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 0x7f36580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:04.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.699+0000 7f36724be700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 0x7f36580693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3664009160 tx=0x7f3664016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:04.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.702+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f365c051b10 con 0x7f366c0a90d0 2023-10-09T15:31:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.973+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f366c067b20 con 0x7f366c0a90d0 2023-10-09T15:31:04.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.974+0000 7f366a7fc700 1 -- 172.21.15.33:0/894466267 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1109 (secure 0 0 0) 0x7f365c055130 con 0x7f366c0a90d0 2023-10-09T15:31:04.974 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:04.974 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":23,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1696865452,"num_in_osds":8,"osd_in_since":1696865443,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2438475776,"bytes_avail":770655637504,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":8,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4279}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-10-09T15:30:41.429546+0000","services":{}},"progress_events":{}} 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.975+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 msgr2=0x7f36580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 0x7f36580693e0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3664009160 tx=0x7f3664016000 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 msgr2=0x7f366c09af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f365c00ccc0 tx=0x7f365c001a20 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 shutdown_connections 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3658066f30 0x7f36580693e0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f366c0a90d0 0x7f366c09af80 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f366c06e380 0x7f366c14b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 --2- 172.21.15.33:0/894466267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f366c0a8d00 0x7f366c15f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 >> 172.21.15.33:0/894466267 conn(0x7f366c06ce80 msgr2=0x7f366c0b32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:04.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 shutdown_connections 2023-10-09T15:31:04.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:04.976+0000 7f3674722700 1 -- 172.21.15.33:0/894466267 wait complete. 2023-10-09T15:31:04.987 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T15:31:04.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:05.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.107+0000 7f63a34c6700 1 Processor -- start 2023-10-09T15:31:05.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.107+0000 7f63a34c6700 1 -- start start 2023-10-09T15:31:05.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a34c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 0x7f639c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a34c6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f639c0cd9e0 0x7f639c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a34c6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f639c15ae40 con 0x7f639c0cde50 2023-10-09T15:31:05.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a34c6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f639c0d13f0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a34c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c15ab60 con 0x7f639c0cb5a0 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f639c0cd9e0 0x7f639c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a1a63700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f639c0cde50 0x7f639c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47938/0 (socket says 172.21.15.33:47938) 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f639c0cd9e0 0x7f639c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42328/0 (socket says 172.21.15.33:42328) 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a1a63700 1 -- 172.21.15.33:0/4041810523 learned_addr learned my addr 172.21.15.33:0/4041810523 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 -- 172.21.15.33:0/4041810523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 msgr2=0x7f639c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a1262700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 0x7f639c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 0x7f639c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 -- 172.21.15.33:0/4041810523 >> v1:172.21.15.33:6789/0 conn(0x7f639c0cde50 legacy=0x7f639c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a0a61700 1 -- 172.21.15.33:0/4041810523 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f639c0ccf00 con 0x7f639c0cd9e0 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f6393fff700 1 -- 172.21.15.33:0/4041810523 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 224844647 0 0) 0x7f639c15ae40 con 0x7f639c0cde50 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.108+0000 7f63a1262700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 0x7f639c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a0a61700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c159ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f638c0098e0 tx=0x7f638c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b5509bbca921d29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f6393fff700 1 -- 172.21.15.33:0/4041810523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c009e80 con 0x7f639c0cd9e0 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f6393fff700 1 -- 172.21.15.33:0/4041810523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c00b860 con 0x7f639c0cd9e0 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f6393fff700 1 -- 172.21.15.33:0/4041810523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00bbe0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 -- 172.21.15.33:0/4041810523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 msgr2=0x7f639c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c159ec0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f638c0098e0 tx=0x7f638c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 -- 172.21.15.33:0/4041810523 shutdown_connections 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c0cb5a0 0x7f639c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 --2- 172.21.15.33:0/4041810523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c159ec0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 -- 172.21.15.33:0/4041810523 >> 172.21.15.33:0/4041810523 conn(0x7f639c070e30 msgr2=0x7f639c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 -- 172.21.15.33:0/4041810523 shutdown_connections 2023-10-09T15:31:05.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.109+0000 7f63a34c6700 1 -- 172.21.15.33:0/4041810523 wait complete. 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.110+0000 7f63a34c6700 1 Processor -- start 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.110+0000 7f63a34c6700 1 -- start start 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f639c0cb5a0 0x7f639c0c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c171550 0x7f639c1719f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c15cf30 con 0x7f639c0cd9e0 2023-10-09T15:31:05.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f639c171ff0 con 0x7f639c0cb5a0 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a34c6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f639c1722d0 con 0x7f639c171550 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a0a61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a0a61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42344/0 (socket says 172.21.15.33:42344) 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.111+0000 7f63a0a61700 1 -- 172.21.15.33:0/2514772536 learned_addr learned my addr 172.21.15.33:0/2514772536 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 -- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c171550 msgr2=0x7f639c1719f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c171550 0x7f639c1719f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 -- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f639c0cb5a0 msgr2=0x7f639c0c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a1262700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f639c0cb5a0 0x7f639c0c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f639c0cb5a0 0x7f639c0c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 -- 172.21.15.33:0/2514772536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f638c009420 con 0x7f639c0cd9e0 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a0a61700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f639c06ea60 tx=0x7f638c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:05.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c00bbe0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f638c011420 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f638c0117c0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f639c15c8e0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.112+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f639c1564a0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.113+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f639c15d0a0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.113+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f638c011bb0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.114+0000 7f63917fa700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.114+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f638c085c60 con 0x7f639c0cd9e0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.114+0000 7f63a1262700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:05.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.114+0000 7f63a1262700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 0x7f6380069410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6394008a50 tx=0x7f6394008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:05.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.118+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f638c052ed0 con 0x7f639c0cd9e0 2023-10-09T15:31:05.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.306+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f639c04c3c0 con 0x7f6380066f60 2023-10-09T15:31:05.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.313+0000 7f63917fa700 1 -- 172.21.15.33:0/2514772536 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7f639c04c3c0 con 0x7f6380066f60 2023-10-09T15:31:05.316 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 msgr2=0x7f6380069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 0x7f6380069410 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6394008a50 tx=0x7f6394008040 comp rx=0 tx=0).stop 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 msgr2=0x7f639c1467f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f639c06ea60 tx=0x7f638c017000 comp rx=0 tx=0).stop 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 shutdown_connections 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6380066f60 0x7f6380069410 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f639c171550 0x7f639c1719f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f639c0cb5a0 0x7f639c0c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 --2- 172.21.15.33:0/2514772536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f639c0cd9e0 0x7f639c1467f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 >> 172.21.15.33:0/2514772536 conn(0x7f639c070e30 msgr2=0x7f639c0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 shutdown_connections 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:05.316+0000 7f63a34c6700 1 -- 172.21.15.33:0/2514772536 wait complete. 2023-10-09T15:31:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:05.328 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-10-09T15:31:05.235970+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.599319"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682261+0000","last_change":"2023-10-09T15:30:59.675453+0000","last_active":"2023-10-09T15:30:59.682261+0000","last_peered":"2023-10-09T15:30:59.682261+0000","last_clean":"2023-10-09T15:30:59.682261+0000","last_became_active":"2023-10-09T15:30:59.675159+0000","last_became_peered":"2023-10-09T15:30:59.675159+0000","last_unstale":"2023-10-09T15:30:59.682261+0000","last_undegraded":"2023-10-09T15:30:59.682261+0000","last_fullsized":"2023-10-09T15:30:59.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670422+0000","last_change":"2023-10-09T15:30:59.666350+0000","last_active":"2023-10-09T15:30:59.670422+0000","last_peered":"2023-10-09T15:30:59.670422+0000","last_clean":"2023-10-09T15:30:59.670422+0000","last_became_active":"2023-10-09T15:30:59.665970+0000","last_became_peered":"2023-10-09T15:30:59.665970+0000","last_unstale":"2023-10-09T15:30:59.670422+0000","last_undegraded":"2023-10-09T15:30:59.670422+0000","last_fullsized":"2023-10-09T15:30:59.670422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669088+0000","last_change":"2023-10-09T15:30:59.663886+0000","last_active":"2023-10-09T15:30:59.669088+0000","last_peered":"2023-10-09T15:30:59.669088+0000","last_clean":"2023-10-09T15:30:59.669088+0000","last_became_active":"2023-10-09T15:30:59.663598+0000","last_became_peered":"2023-10-09T15:30:59.663598+0000","last_unstale":"2023-10-09T15:30:59.669088+0000","last_undegraded":"2023-10-09T15:30:59.669088+0000","last_fullsized":"2023-10-09T15:30:59.669088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672923+0000","last_change":"2023-10-09T15:30:59.666790+0000","last_active":"2023-10-09T15:30:59.672923+0000","last_peered":"2023-10-09T15:30:59.672923+0000","last_clean":"2023-10-09T15:30:59.672923+0000","last_became_active":"2023-10-09T15:30:59.666144+0000","last_became_peered":"2023-10-09T15:30:59.666144+0000","last_unstale":"2023-10-09T15:30:59.672923+0000","last_undegraded":"2023-10-09T15:30:59.672923+0000","last_fullsized":"2023-10-09T15:30:59.672923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679237+0000","last_change":"2023-10-09T15:30:59.670991+0000","last_active":"2023-10-09T15:30:59.679237+0000","last_peered":"2023-10-09T15:30:59.679237+0000","last_clean":"2023-10-09T15:30:59.679237+0000","last_became_active":"2023-10-09T15:30:59.670704+0000","last_became_peered":"2023-10-09T15:30:59.670704+0000","last_unstale":"2023-10-09T15:30:59.679237+0000","last_undegraded":"2023-10-09T15:30:59.679237+0000","last_fullsized":"2023-10-09T15:30:59.679237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675697+0000","last_change":"2023-10-09T15:30:59.667866+0000","last_active":"2023-10-09T15:30:59.675697+0000","last_peered":"2023-10-09T15:30:59.675697+0000","last_clean":"2023-10-09T15:30:59.675697+0000","last_became_active":"2023-10-09T15:30:59.667647+0000","last_became_peered":"2023-10-09T15:30:59.667647+0000","last_unstale":"2023-10-09T15:30:59.675697+0000","last_undegraded":"2023-10-09T15:30:59.675697+0000","last_fullsized":"2023-10-09T15:30:59.675697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679218+0000","last_change":"2023-10-09T15:30:59.670699+0000","last_active":"2023-10-09T15:30:59.679218+0000","last_peered":"2023-10-09T15:30:59.679218+0000","last_clean":"2023-10-09T15:30:59.679218+0000","last_became_active":"2023-10-09T15:30:59.670342+0000","last_became_peered":"2023-10-09T15:30:59.670342+0000","last_unstale":"2023-10-09T15:30:59.679218+0000","last_undegraded":"2023-10-09T15:30:59.679218+0000","last_fullsized":"2023-10-09T15:30:59.679218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679139+0000","last_change":"2023-10-09T15:30:59.670588+0000","last_active":"2023-10-09T15:30:59.679139+0000","last_peered":"2023-10-09T15:30:59.679139+0000","last_clean":"2023-10-09T15:30:59.679139+0000","last_became_active":"2023-10-09T15:30:59.670286+0000","last_became_peered":"2023-10-09T15:30:59.670286+0000","last_unstale":"2023-10-09T15:30:59.679139+0000","last_undegraded":"2023-10-09T15:30:59.679139+0000","last_fullsized":"2023-10-09T15:30:59.679139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682230+0000","last_change":"2023-10-09T15:30:59.674866+0000","last_active":"2023-10-09T15:30:59.682230+0000","last_peered":"2023-10-09T15:30:59.682230+0000","last_clean":"2023-10-09T15:30:59.682230+0000","last_became_active":"2023-10-09T15:30:59.674592+0000","last_became_peered":"2023-10-09T15:30:59.674592+0000","last_unstale":"2023-10-09T15:30:59.682230+0000","last_undegraded":"2023-10-09T15:30:59.682230+0000","last_fullsized":"2023-10-09T15:30:59.682230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:18.896209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677373+0000","last_change":"2023-10-09T15:30:59.670458+0000","last_active":"2023-10-09T15:30:59.677373+0000","last_peered":"2023-10-09T15:30:59.677373+0000","last_clean":"2023-10-09T15:30:59.677373+0000","last_became_active":"2023-10-09T15:30:59.670170+0000","last_became_peered":"2023-10-09T15:30:59.670170+0000","last_unstale":"2023-10-09T15:30:59.677373+0000","last_undegraded":"2023-10-09T15:30:59.677373+0000","last_fullsized":"2023-10-09T15:30:59.677373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677264+0000","last_change":"2023-10-09T15:30:59.672093+0000","last_active":"2023-10-09T15:30:59.677264+0000","last_peered":"2023-10-09T15:30:59.677264+0000","last_clean":"2023-10-09T15:30:59.677264+0000","last_became_active":"2023-10-09T15:30:59.671829+0000","last_became_peered":"2023-10-09T15:30:59.671829+0000","last_unstale":"2023-10-09T15:30:59.677264+0000","last_undegraded":"2023-10-09T15:30:59.677264+0000","last_fullsized":"2023-10-09T15:30:59.677264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674095+0000","last_change":"2023-10-09T15:30:59.652602+0000","last_active":"2023-10-09T15:30:59.674095+0000","last_peered":"2023-10-09T15:30:59.674095+0000","last_clean":"2023-10-09T15:30:59.674095+0000","last_became_active":"2023-10-09T15:30:59.652304+0000","last_became_peered":"2023-10-09T15:30:59.652304+0000","last_unstale":"2023-10-09T15:30:59.674095+0000","last_undegraded":"2023-10-09T15:30:59.674095+0000","last_fullsized":"2023-10-09T15:30:59.674095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:07.825038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.662644+0000","last_change":"2023-10-09T15:30:59.658543+0000","last_active":"2023-10-09T15:30:59.662644+0000","last_peered":"2023-10-09T15:30:59.662644+0000","last_clean":"2023-10-09T15:30:59.662644+0000","last_became_active":"2023-10-09T15:30:59.658260+0000","last_became_peered":"2023-10-09T15:30:59.658260+0000","last_unstale":"2023-10-09T15:30:59.662644+0000","last_undegraded":"2023-10-09T15:30:59.662644+0000","last_fullsized":"2023-10-09T15:30:59.662644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665749+0000","last_change":"2023-10-09T15:30:59.661916+0000","last_active":"2023-10-09T15:30:59.665749+0000","last_peered":"2023-10-09T15:30:59.665749+0000","last_clean":"2023-10-09T15:30:59.665749+0000","last_became_active":"2023-10-09T15:30:59.661612+0000","last_became_peered":"2023-10-09T15:30:59.661612+0000","last_unstale":"2023-10-09T15:30:59.665749+0000","last_undegraded":"2023-10-09T15:30:59.665749+0000","last_fullsized":"2023-10-09T15:30:59.665749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680476+0000","last_change":"2023-10-09T15:30:59.677507+0000","last_active":"2023-10-09T15:30:59.680476+0000","last_peered":"2023-10-09T15:30:59.680476+0000","last_clean":"2023-10-09T15:30:59.680476+0000","last_became_active":"2023-10-09T15:30:59.677142+0000","last_became_peered":"2023-10-09T15:30:59.677142+0000","last_unstale":"2023-10-09T15:30:59.680476+0000","last_undegraded":"2023-10-09T15:30:59.680476+0000","last_fullsized":"2023-10-09T15:30:59.680476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675582+0000","last_change":"2023-10-09T15:30:59.669137+0000","last_active":"2023-10-09T15:30:59.675582+0000","last_peered":"2023-10-09T15:30:59.675582+0000","last_clean":"2023-10-09T15:30:59.675582+0000","last_became_active":"2023-10-09T15:30:59.668871+0000","last_became_peered":"2023-10-09T15:30:59.668871+0000","last_unstale":"2023-10-09T15:30:59.675582+0000","last_undegraded":"2023-10-09T15:30:59.675582+0000","last_fullsized":"2023-10-09T15:30:59.675582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681093+0000","last_change":"2023-10-09T15:30:59.675035+0000","last_active":"2023-10-09T15:30:59.681093+0000","last_peered":"2023-10-09T15:30:59.681093+0000","last_clean":"2023-10-09T15:30:59.681093+0000","last_became_active":"2023-10-09T15:30:59.674718+0000","last_became_peered":"2023-10-09T15:30:59.674718+0000","last_unstale":"2023-10-09T15:30:59.681093+0000","last_undegraded":"2023-10-09T15:30:59.681093+0000","last_fullsized":"2023-10-09T15:30:59.681093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677089+0000","last_change":"2023-10-09T15:30:59.675915+0000","last_active":"2023-10-09T15:30:59.677089+0000","last_peered":"2023-10-09T15:30:59.677089+0000","last_clean":"2023-10-09T15:30:59.677089+0000","last_became_active":"2023-10-09T15:30:59.675642+0000","last_became_peered":"2023-10-09T15:30:59.675642+0000","last_unstale":"2023-10-09T15:30:59.677089+0000","last_undegraded":"2023-10-09T15:30:59.677089+0000","last_fullsized":"2023-10-09T15:30:59.677089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679359+0000","last_change":"2023-10-09T15:30:59.671221+0000","last_active":"2023-10-09T15:30:59.679359+0000","last_peered":"2023-10-09T15:30:59.679359+0000","last_clean":"2023-10-09T15:30:59.679359+0000","last_became_active":"2023-10-09T15:30:59.670944+0000","last_became_peered":"2023-10-09T15:30:59.670944+0000","last_unstale":"2023-10-09T15:30:59.679359+0000","last_undegraded":"2023-10-09T15:30:59.679359+0000","last_fullsized":"2023-10-09T15:30:59.679359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682812+0000","last_change":"2023-10-09T15:30:58.654623+0000","last_active":"2023-10-09T15:30:59.682812+0000","last_peered":"2023-10-09T15:30:59.682812+0000","last_clean":"2023-10-09T15:30:59.682812+0000","last_became_active":"2023-10-09T15:30:58.654351+0000","last_became_peered":"2023-10-09T15:30:58.654351+0000","last_unstale":"2023-10-09T15:30:59.682812+0000","last_undegraded":"2023-10-09T15:30:59.682812+0000","last_fullsized":"2023-10-09T15:30:59.682812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.660456+0000","last_change":"2023-10-09T15:30:59.656560+0000","last_active":"2023-10-09T15:30:59.660456+0000","last_peered":"2023-10-09T15:30:59.660456+0000","last_clean":"2023-10-09T15:30:59.660456+0000","last_became_active":"2023-10-09T15:30:59.656293+0000","last_became_peered":"2023-10-09T15:30:59.656293+0000","last_unstale":"2023-10-09T15:30:59.660456+0000","last_undegraded":"2023-10-09T15:30:59.660456+0000","last_fullsized":"2023-10-09T15:30:59.660456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679270+0000","last_change":"2023-10-09T15:30:58.659955+0000","last_active":"2023-10-09T15:30:59.679270+0000","last_peered":"2023-10-09T15:30:59.679270+0000","last_clean":"2023-10-09T15:30:59.679270+0000","last_became_active":"2023-10-09T15:30:58.659645+0000","last_became_peered":"2023-10-09T15:30:58.659645+0000","last_unstale":"2023-10-09T15:30:59.679270+0000","last_undegraded":"2023-10-09T15:30:59.679270+0000","last_fullsized":"2023-10-09T15:30:59.679270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675130+0000","last_change":"2023-10-09T15:30:59.667774+0000","last_active":"2023-10-09T15:30:59.675130+0000","last_peered":"2023-10-09T15:30:59.675130+0000","last_clean":"2023-10-09T15:30:59.675130+0000","last_became_active":"2023-10-09T15:30:59.667490+0000","last_became_peered":"2023-10-09T15:30:59.667490+0000","last_unstale":"2023-10-09T15:30:59.675130+0000","last_undegraded":"2023-10-09T15:30:59.675130+0000","last_fullsized":"2023-10-09T15:30:59.675130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680068+0000","last_change":"2023-10-09T15:30:58.658690+0000","last_active":"2023-10-09T15:30:59.680068+0000","last_peered":"2023-10-09T15:30:59.680068+0000","last_clean":"2023-10-09T15:30:59.680068+0000","last_became_active":"2023-10-09T15:30:58.658429+0000","last_became_peered":"2023-10-09T15:30:58.658429+0000","last_unstale":"2023-10-09T15:30:59.680068+0000","last_undegraded":"2023-10-09T15:30:59.680068+0000","last_fullsized":"2023-10-09T15:30:59.680068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681667+0000","last_change":"2023-10-09T15:30:59.678307+0000","last_active":"2023-10-09T15:30:59.681667+0000","last_peered":"2023-10-09T15:30:59.681667+0000","last_clean":"2023-10-09T15:30:59.681667+0000","last_became_active":"2023-10-09T15:30:59.678048+0000","last_became_peered":"2023-10-09T15:30:59.678048+0000","last_unstale":"2023-10-09T15:30:59.681667+0000","last_undegraded":"2023-10-09T15:30:59.681667+0000","last_fullsized":"2023-10-09T15:30:59.681667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681194+0000","last_change":"2023-10-09T15:30:58.661313+0000","last_active":"2023-10-09T15:30:59.681194+0000","last_peered":"2023-10-09T15:30:59.681194+0000","last_clean":"2023-10-09T15:30:59.681194+0000","last_became_active":"2023-10-09T15:30:58.661029+0000","last_became_peered":"2023-10-09T15:30:58.661029+0000","last_unstale":"2023-10-09T15:30:59.681194+0000","last_undegraded":"2023-10-09T15:30:59.681194+0000","last_fullsized":"2023-10-09T15:30:59.681194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:20.445789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681768+0000","last_change":"2023-10-09T15:30:59.679014+0000","last_active":"2023-10-09T15:30:59.681768+0000","last_peered":"2023-10-09T15:30:59.681768+0000","last_clean":"2023-10-09T15:30:59.681768+0000","last_became_active":"2023-10-09T15:30:59.678577+0000","last_became_peered":"2023-10-09T15:30:59.678577+0000","last_unstale":"2023-10-09T15:30:59.681768+0000","last_undegraded":"2023-10-09T15:30:59.681768+0000","last_fullsized":"2023-10-09T15:30:59.681768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681275+0000","last_change":"2023-10-09T15:30:58.656303+0000","last_active":"2023-10-09T15:30:59.681275+0000","last_peered":"2023-10-09T15:30:59.681275+0000","last_clean":"2023-10-09T15:30:59.681275+0000","last_became_active":"2023-10-09T15:30:58.655754+0000","last_became_peered":"2023-10-09T15:30:58.655754+0000","last_unstale":"2023-10-09T15:30:59.681275+0000","last_undegraded":"2023-10-09T15:30:59.681275+0000","last_fullsized":"2023-10-09T15:30:59.681275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677214+0000","last_change":"2023-10-09T15:30:59.661929+0000","last_active":"2023-10-09T15:30:59.677214+0000","last_peered":"2023-10-09T15:30:59.677214+0000","last_clean":"2023-10-09T15:30:59.677214+0000","last_became_active":"2023-10-09T15:30:59.661661+0000","last_became_peered":"2023-10-09T15:30:59.661661+0000","last_unstale":"2023-10-09T15:30:59.677214+0000","last_undegraded":"2023-10-09T15:30:59.677214+0000","last_fullsized":"2023-10-09T15:30:59.677214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:21.450587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678717+0000","last_change":"2023-10-09T15:30:58.651818+0000","last_active":"2023-10-09T15:30:59.678717+0000","last_peered":"2023-10-09T15:30:59.678717+0000","last_clean":"2023-10-09T15:30:59.678717+0000","last_became_active":"2023-10-09T15:30:58.651546+0000","last_became_peered":"2023-10-09T15:30:58.651546+0000","last_unstale":"2023-10-09T15:30:59.678717+0000","last_undegraded":"2023-10-09T15:30:59.678717+0000","last_fullsized":"2023-10-09T15:30:59.678717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665613+0000","last_change":"2023-10-09T15:30:59.660923+0000","last_active":"2023-10-09T15:30:59.665613+0000","last_peered":"2023-10-09T15:30:59.665613+0000","last_clean":"2023-10-09T15:30:59.665613+0000","last_became_active":"2023-10-09T15:30:59.660614+0000","last_became_peered":"2023-10-09T15:30:59.660614+0000","last_unstale":"2023-10-09T15:30:59.665613+0000","last_undegraded":"2023-10-09T15:30:59.665613+0000","last_fullsized":"2023-10-09T15:30:59.665613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.652963+0000","last_change":"2023-10-09T15:30:58.654565+0000","last_active":"2023-10-09T15:30:59.652963+0000","last_peered":"2023-10-09T15:30:59.652963+0000","last_clean":"2023-10-09T15:30:59.652963+0000","last_became_active":"2023-10-09T15:30:58.654100+0000","last_became_peered":"2023-10-09T15:30:58.654100+0000","last_unstale":"2023-10-09T15:30:59.652963+0000","last_undegraded":"2023-10-09T15:30:59.652963+0000","last_fullsized":"2023-10-09T15:30:59.652963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.663038+0000","last_change":"2023-10-09T15:30:59.659944+0000","last_active":"2023-10-09T15:30:59.663038+0000","last_peered":"2023-10-09T15:30:59.663038+0000","last_clean":"2023-10-09T15:30:59.663038+0000","last_became_active":"2023-10-09T15:30:59.659370+0000","last_became_peered":"2023-10-09T15:30:59.659370+0000","last_unstale":"2023-10-09T15:30:59.663038+0000","last_undegraded":"2023-10-09T15:30:59.663038+0000","last_fullsized":"2023-10-09T15:30:59.663038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657161+0000","last_change":"2023-10-09T15:30:58.663665+0000","last_active":"2023-10-09T15:30:59.657161+0000","last_peered":"2023-10-09T15:30:59.657161+0000","last_clean":"2023-10-09T15:30:59.657161+0000","last_became_active":"2023-10-09T15:30:58.663374+0000","last_became_peered":"2023-10-09T15:30:58.663374+0000","last_unstale":"2023-10-09T15:30:59.657161+0000","last_undegraded":"2023-10-09T15:30:59.657161+0000","last_fullsized":"2023-10-09T15:30:59.657161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668305+0000","last_change":"2023-10-09T15:30:59.662643+0000","last_active":"2023-10-09T15:30:59.668305+0000","last_peered":"2023-10-09T15:30:59.668305+0000","last_clean":"2023-10-09T15:30:59.668305+0000","last_became_active":"2023-10-09T15:30:59.662002+0000","last_became_peered":"2023-10-09T15:30:59.662002+0000","last_unstale":"2023-10-09T15:30:59.668305+0000","last_undegraded":"2023-10-09T15:30:59.668305+0000","last_fullsized":"2023-10-09T15:30:59.668305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648439+0000","last_change":"2023-10-09T15:30:58.657412+0000","last_active":"2023-10-09T15:30:59.648439+0000","last_peered":"2023-10-09T15:30:59.648439+0000","last_clean":"2023-10-09T15:30:59.648439+0000","last_became_active":"2023-10-09T15:30:58.657086+0000","last_became_peered":"2023-10-09T15:30:58.657086+0000","last_unstale":"2023-10-09T15:30:59.648439+0000","last_undegraded":"2023-10-09T15:30:59.648439+0000","last_fullsized":"2023-10-09T15:30:59.648439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678652+0000","last_change":"2023-10-09T15:30:59.672392+0000","last_active":"2023-10-09T15:30:59.678652+0000","last_peered":"2023-10-09T15:30:59.678652+0000","last_clean":"2023-10-09T15:30:59.678652+0000","last_became_active":"2023-10-09T15:30:59.671757+0000","last_became_peered":"2023-10-09T15:30:59.671757+0000","last_unstale":"2023-10-09T15:30:59.678652+0000","last_undegraded":"2023-10-09T15:30:59.678652+0000","last_fullsized":"2023-10-09T15:30:59.678652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658666+0000","last_change":"2023-10-09T15:30:58.657247+0000","last_active":"2023-10-09T15:30:59.658666+0000","last_peered":"2023-10-09T15:30:59.658666+0000","last_clean":"2023-10-09T15:30:59.658666+0000","last_became_active":"2023-10-09T15:30:58.656943+0000","last_became_peered":"2023-10-09T15:30:58.656943+0000","last_unstale":"2023-10-09T15:30:59.658666+0000","last_undegraded":"2023-10-09T15:30:59.658666+0000","last_fullsized":"2023-10-09T15:30:59.658666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675152+0000","last_change":"2023-10-09T15:30:59.667816+0000","last_active":"2023-10-09T15:30:59.675152+0000","last_peered":"2023-10-09T15:30:59.675152+0000","last_clean":"2023-10-09T15:30:59.675152+0000","last_became_active":"2023-10-09T15:30:59.667529+0000","last_became_peered":"2023-10-09T15:30:59.667529+0000","last_unstale":"2023-10-09T15:30:59.675152+0000","last_undegraded":"2023-10-09T15:30:59.675152+0000","last_fullsized":"2023-10-09T15:30:59.675152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682943+0000","last_change":"2023-10-09T15:30:58.661206+0000","last_active":"2023-10-09T15:30:59.682943+0000","last_peered":"2023-10-09T15:30:59.682943+0000","last_clean":"2023-10-09T15:30:59.682943+0000","last_became_active":"2023-10-09T15:30:58.660947+0000","last_became_peered":"2023-10-09T15:30:58.660947+0000","last_unstale":"2023-10-09T15:30:59.682943+0000","last_undegraded":"2023-10-09T15:30:59.682943+0000","last_fullsized":"2023-10-09T15:30:59.682943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682953+0000","last_change":"2023-10-09T15:30:59.670968+0000","last_active":"2023-10-09T15:30:59.682953+0000","last_peered":"2023-10-09T15:30:59.682953+0000","last_clean":"2023-10-09T15:30:59.682953+0000","last_became_active":"2023-10-09T15:30:59.670674+0000","last_became_peered":"2023-10-09T15:30:59.670674+0000","last_unstale":"2023-10-09T15:30:59.682953+0000","last_undegraded":"2023-10-09T15:30:59.682953+0000","last_fullsized":"2023-10-09T15:30:59.682953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:50.286664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.685943+0000","last_change":"2023-10-09T15:30:58.651540+0000","last_active":"2023-10-09T15:30:59.685943+0000","last_peered":"2023-10-09T15:30:59.685943+0000","last_clean":"2023-10-09T15:30:59.685943+0000","last_became_active":"2023-10-09T15:30:58.651207+0000","last_became_peered":"2023-10-09T15:30:58.651207+0000","last_unstale":"2023-10-09T15:30:59.685943+0000","last_undegraded":"2023-10-09T15:30:59.685943+0000","last_fullsized":"2023-10-09T15:30:59.685943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679374+0000","last_change":"2023-10-09T15:30:59.672317+0000","last_active":"2023-10-09T15:30:59.679374+0000","last_peered":"2023-10-09T15:30:59.679374+0000","last_clean":"2023-10-09T15:30:59.679374+0000","last_became_active":"2023-10-09T15:30:59.671578+0000","last_became_peered":"2023-10-09T15:30:59.671578+0000","last_unstale":"2023-10-09T15:30:59.679374+0000","last_undegraded":"2023-10-09T15:30:59.679374+0000","last_fullsized":"2023-10-09T15:30:59.679374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683332+0000","last_change":"2023-10-09T15:30:58.655428+0000","last_active":"2023-10-09T15:30:59.683332+0000","last_peered":"2023-10-09T15:30:59.683332+0000","last_clean":"2023-10-09T15:30:59.683332+0000","last_became_active":"2023-10-09T15:30:58.655117+0000","last_became_peered":"2023-10-09T15:30:58.655117+0000","last_unstale":"2023-10-09T15:30:59.683332+0000","last_undegraded":"2023-10-09T15:30:59.683332+0000","last_fullsized":"2023-10-09T15:30:59.683332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677001+0000","last_change":"2023-10-09T15:30:59.672831+0000","last_active":"2023-10-09T15:30:59.677001+0000","last_peered":"2023-10-09T15:30:59.677001+0000","last_clean":"2023-10-09T15:30:59.677001+0000","last_became_active":"2023-10-09T15:30:59.672528+0000","last_became_peered":"2023-10-09T15:30:59.672528+0000","last_unstale":"2023-10-09T15:30:59.677001+0000","last_undegraded":"2023-10-09T15:30:59.677001+0000","last_fullsized":"2023-10-09T15:30:59.677001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654038+0000","last_change":"2023-10-09T15:30:58.658373+0000","last_active":"2023-10-09T15:30:59.654038+0000","last_peered":"2023-10-09T15:30:59.654038+0000","last_clean":"2023-10-09T15:30:59.654038+0000","last_became_active":"2023-10-09T15:30:58.657565+0000","last_became_peered":"2023-10-09T15:30:58.657565+0000","last_unstale":"2023-10-09T15:30:59.654038+0000","last_undegraded":"2023-10-09T15:30:59.654038+0000","last_fullsized":"2023-10-09T15:30:59.654038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681399+0000","last_change":"2023-10-09T15:30:59.680133+0000","last_active":"2023-10-09T15:30:59.681399+0000","last_peered":"2023-10-09T15:30:59.681399+0000","last_clean":"2023-10-09T15:30:59.681399+0000","last_became_active":"2023-10-09T15:30:59.679719+0000","last_became_peered":"2023-10-09T15:30:59.679719+0000","last_unstale":"2023-10-09T15:30:59.681399+0000","last_undegraded":"2023-10-09T15:30:59.681399+0000","last_fullsized":"2023-10-09T15:30:59.681399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648962+0000","last_change":"2023-10-09T15:30:58.651661+0000","last_active":"2023-10-09T15:30:59.648962+0000","last_peered":"2023-10-09T15:30:59.648962+0000","last_clean":"2023-10-09T15:30:59.648962+0000","last_became_active":"2023-10-09T15:30:58.651305+0000","last_became_peered":"2023-10-09T15:30:58.651305+0000","last_unstale":"2023-10-09T15:30:59.648962+0000","last_undegraded":"2023-10-09T15:30:59.648962+0000","last_fullsized":"2023-10-09T15:30:59.648962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659671+0000","last_change":"2023-10-09T15:30:59.655537+0000","last_active":"2023-10-09T15:30:59.659671+0000","last_peered":"2023-10-09T15:30:59.659671+0000","last_clean":"2023-10-09T15:30:59.659671+0000","last_became_active":"2023-10-09T15:30:59.655224+0000","last_became_peered":"2023-10-09T15:30:59.655224+0000","last_unstale":"2023-10-09T15:30:59.659671+0000","last_undegraded":"2023-10-09T15:30:59.659671+0000","last_fullsized":"2023-10-09T15:30:59.659671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680601+0000","last_change":"2023-10-09T15:30:58.656284+0000","last_active":"2023-10-09T15:30:59.680601+0000","last_peered":"2023-10-09T15:30:59.680601+0000","last_clean":"2023-10-09T15:30:59.680601+0000","last_became_active":"2023-10-09T15:30:58.655961+0000","last_became_peered":"2023-10-09T15:30:58.655961+0000","last_unstale":"2023-10-09T15:30:59.680601+0000","last_undegraded":"2023-10-09T15:30:59.680601+0000","last_fullsized":"2023-10-09T15:30:59.680601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681315+0000","last_change":"2023-10-09T15:30:59.678338+0000","last_active":"2023-10-09T15:30:59.681315+0000","last_peered":"2023-10-09T15:30:59.681315+0000","last_clean":"2023-10-09T15:30:59.681315+0000","last_became_active":"2023-10-09T15:30:59.678037+0000","last_became_peered":"2023-10-09T15:30:59.678037+0000","last_unstale":"2023-10-09T15:30:59.681315+0000","last_undegraded":"2023-10-09T15:30:59.681315+0000","last_fullsized":"2023-10-09T15:30:59.681315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683056+0000","last_change":"2023-10-09T15:30:58.650299+0000","last_active":"2023-10-09T15:30:59.683056+0000","last_peered":"2023-10-09T15:30:59.683056+0000","last_clean":"2023-10-09T15:30:59.683056+0000","last_became_active":"2023-10-09T15:30:58.650000+0000","last_became_peered":"2023-10-09T15:30:58.650000+0000","last_unstale":"2023-10-09T15:30:59.683056+0000","last_undegraded":"2023-10-09T15:30:59.683056+0000","last_fullsized":"2023-10-09T15:30:59.683056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680986+0000","last_change":"2023-10-09T15:30:59.678288+0000","last_active":"2023-10-09T15:30:59.680986+0000","last_peered":"2023-10-09T15:30:59.680986+0000","last_clean":"2023-10-09T15:30:59.680986+0000","last_became_active":"2023-10-09T15:30:59.677944+0000","last_became_peered":"2023-10-09T15:30:59.677944+0000","last_unstale":"2023-10-09T15:30:59.680986+0000","last_undegraded":"2023-10-09T15:30:59.680986+0000","last_fullsized":"2023-10-09T15:30:59.680986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658167+0000","last_change":"2023-10-09T15:30:58.658451+0000","last_active":"2023-10-09T15:30:59.658167+0000","last_peered":"2023-10-09T15:30:59.658167+0000","last_clean":"2023-10-09T15:30:59.658167+0000","last_became_active":"2023-10-09T15:30:58.658175+0000","last_became_peered":"2023-10-09T15:30:58.658175+0000","last_unstale":"2023-10-09T15:30:59.658167+0000","last_undegraded":"2023-10-09T15:30:59.658167+0000","last_fullsized":"2023-10-09T15:30:59.658167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681686+0000","last_change":"2023-10-09T15:30:59.676593+0000","last_active":"2023-10-09T15:30:59.681686+0000","last_peered":"2023-10-09T15:30:59.681686+0000","last_clean":"2023-10-09T15:30:59.681686+0000","last_became_active":"2023-10-09T15:30:59.676207+0000","last_became_peered":"2023-10-09T15:30:59.676207+0000","last_unstale":"2023-10-09T15:30:59.681686+0000","last_undegraded":"2023-10-09T15:30:59.681686+0000","last_fullsized":"2023-10-09T15:30:59.681686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653922+0000","last_change":"2023-10-09T15:30:58.658074+0000","last_active":"2023-10-09T15:30:59.653922+0000","last_peered":"2023-10-09T15:30:59.653922+0000","last_clean":"2023-10-09T15:30:59.653922+0000","last_became_active":"2023-10-09T15:30:58.657593+0000","last_became_peered":"2023-10-09T15:30:58.657593+0000","last_unstale":"2023-10-09T15:30:59.653922+0000","last_undegraded":"2023-10-09T15:30:59.653922+0000","last_fullsized":"2023-10-09T15:30:59.653922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676703+0000","last_change":"2023-10-09T15:30:59.659550+0000","last_active":"2023-10-09T15:30:59.676703+0000","last_peered":"2023-10-09T15:30:59.676703+0000","last_clean":"2023-10-09T15:30:59.676703+0000","last_became_active":"2023-10-09T15:30:59.658537+0000","last_became_peered":"2023-10-09T15:30:59.658537+0000","last_unstale":"2023-10-09T15:30:59.676703+0000","last_undegraded":"2023-10-09T15:30:59.676703+0000","last_fullsized":"2023-10-09T15:30:59.676703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:26.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672420+0000","last_change":"2023-10-09T15:30:59.663481+0000","last_active":"2023-10-09T15:30:59.672420+0000","last_peered":"2023-10-09T15:30:59.672420+0000","last_clean":"2023-10-09T15:30:59.672420+0000","last_became_active":"2023-10-09T15:30:59.662876+0000","last_became_peered":"2023-10-09T15:30:59.662876+0000","last_unstale":"2023-10-09T15:30:59.672420+0000","last_undegraded":"2023-10-09T15:30:59.672420+0000","last_fullsized":"2023-10-09T15:30:59.672420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659902+0000","last_change":"2023-10-09T15:30:58.654763+0000","last_active":"2023-10-09T15:30:59.659902+0000","last_peered":"2023-10-09T15:30:59.659902+0000","last_clean":"2023-10-09T15:30:59.659902+0000","last_became_active":"2023-10-09T15:30:58.654402+0000","last_became_peered":"2023-10-09T15:30:58.654402+0000","last_unstale":"2023-10-09T15:30:59.659902+0000","last_undegraded":"2023-10-09T15:30:59.659902+0000","last_fullsized":"2023-10-09T15:30:59.659902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680417+0000","last_change":"2023-10-09T15:30:59.673338+0000","last_active":"2023-10-09T15:30:59.680417+0000","last_peered":"2023-10-09T15:30:59.680417+0000","last_clean":"2023-10-09T15:30:59.680417+0000","last_became_active":"2023-10-09T15:30:59.673073+0000","last_became_peered":"2023-10-09T15:30:59.673073+0000","last_unstale":"2023-10-09T15:30:59.680417+0000","last_undegraded":"2023-10-09T15:30:59.680417+0000","last_fullsized":"2023-10-09T15:30:59.680417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653750+0000","last_change":"2023-10-09T15:30:58.656757+0000","last_active":"2023-10-09T15:30:59.653750+0000","last_peered":"2023-10-09T15:30:59.653750+0000","last_clean":"2023-10-09T15:30:59.653750+0000","last_became_active":"2023-10-09T15:30:58.656177+0000","last_became_peered":"2023-10-09T15:30:58.656177+0000","last_unstale":"2023-10-09T15:30:59.653750+0000","last_undegraded":"2023-10-09T15:30:59.653750+0000","last_fullsized":"2023-10-09T15:30:59.653750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654959+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:59.654959+0000","last_peered":"2023-10-09T15:30:59.654959+0000","last_clean":"2023-10-09T15:30:59.654959+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:59.654959+0000","last_undegraded":"2023-10-09T15:30:59.654959+0000","last_fullsized":"2023-10-09T15:30:59.654959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665718+0000","last_change":"2023-10-09T15:30:59.660707+0000","last_active":"2023-10-09T15:30:59.665718+0000","last_peered":"2023-10-09T15:30:59.665718+0000","last_clean":"2023-10-09T15:30:59.665718+0000","last_became_active":"2023-10-09T15:30:59.660311+0000","last_became_peered":"2023-10-09T15:30:59.660311+0000","last_unstale":"2023-10-09T15:30:59.665718+0000","last_undegraded":"2023-10-09T15:30:59.665718+0000","last_fullsized":"2023-10-09T15:30:59.665718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654997+0000","last_change":"2023-10-09T15:30:58.658938+0000","last_active":"2023-10-09T15:30:59.654997+0000","last_peered":"2023-10-09T15:30:59.654997+0000","last_clean":"2023-10-09T15:30:59.654997+0000","last_became_active":"2023-10-09T15:30:58.658670+0000","last_became_peered":"2023-10-09T15:30:58.658670+0000","last_unstale":"2023-10-09T15:30:59.654997+0000","last_undegraded":"2023-10-09T15:30:59.654997+0000","last_fullsized":"2023-10-09T15:30:59.654997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657329+0000","last_change":"2023-10-09T15:30:58.659276+0000","last_active":"2023-10-09T15:30:59.657329+0000","last_peered":"2023-10-09T15:30:59.657329+0000","last_clean":"2023-10-09T15:30:59.657329+0000","last_became_active":"2023-10-09T15:30:58.659014+0000","last_became_peered":"2023-10-09T15:30:58.659014+0000","last_unstale":"2023-10-09T15:30:59.657329+0000","last_undegraded":"2023-10-09T15:30:59.657329+0000","last_fullsized":"2023-10-09T15:30:59.657329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669321+0000","last_change":"2023-10-09T15:30:59.662896+0000","last_active":"2023-10-09T15:30:59.669321+0000","last_peered":"2023-10-09T15:30:59.669321+0000","last_clean":"2023-10-09T15:30:59.669321+0000","last_became_active":"2023-10-09T15:30:59.662565+0000","last_became_peered":"2023-10-09T15:30:59.662565+0000","last_unstale":"2023-10-09T15:30:59.669321+0000","last_undegraded":"2023-10-09T15:30:59.669321+0000","last_fullsized":"2023-10-09T15:30:59.669321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T15:31:00.658977+0000","last_change":"2023-10-09T15:30:58.654960+0000","last_active":"2023-10-09T15:31:00.658977+0000","last_peered":"2023-10-09T15:31:00.658977+0000","last_clean":"2023-10-09T15:31:00.658977+0000","last_became_active":"2023-10-09T15:30:58.654642+0000","last_became_peered":"2023-10-09T15:30:58.654642+0000","last_unstale":"2023-10-09T15:31:00.658977+0000","last_undegraded":"2023-10-09T15:31:00.658977+0000","last_fullsized":"2023-10-09T15:31:00.658977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679337+0000","last_change":"2023-10-09T15:30:59.673541+0000","last_active":"2023-10-09T15:30:59.679337+0000","last_peered":"2023-10-09T15:30:59.679337+0000","last_clean":"2023-10-09T15:30:59.679337+0000","last_became_active":"2023-10-09T15:30:59.673264+0000","last_became_peered":"2023-10-09T15:30:59.673264+0000","last_unstale":"2023-10-09T15:30:59.679337+0000","last_undegraded":"2023-10-09T15:30:59.679337+0000","last_fullsized":"2023-10-09T15:30:59.679337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680182+0000","last_change":"2023-10-09T15:30:58.653278+0000","last_active":"2023-10-09T15:30:59.680182+0000","last_peered":"2023-10-09T15:30:59.680182+0000","last_clean":"2023-10-09T15:30:59.680182+0000","last_became_active":"2023-10-09T15:30:58.652915+0000","last_became_peered":"2023-10-09T15:30:58.652915+0000","last_unstale":"2023-10-09T15:30:59.680182+0000","last_undegraded":"2023-10-09T15:30:59.680182+0000","last_fullsized":"2023-10-09T15:30:59.680182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665653+0000","last_change":"2023-10-09T15:30:59.661222+0000","last_active":"2023-10-09T15:30:59.665653+0000","last_peered":"2023-10-09T15:30:59.665653+0000","last_clean":"2023-10-09T15:30:59.665653+0000","last_became_active":"2023-10-09T15:30:59.660941+0000","last_became_peered":"2023-10-09T15:30:59.660941+0000","last_unstale":"2023-10-09T15:30:59.665653+0000","last_undegraded":"2023-10-09T15:30:59.665653+0000","last_fullsized":"2023-10-09T15:30:59.665653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654786+0000","last_change":"2023-10-09T15:30:58.660025+0000","last_active":"2023-10-09T15:30:59.654786+0000","last_peered":"2023-10-09T15:30:59.654786+0000","last_clean":"2023-10-09T15:30:59.654786+0000","last_became_active":"2023-10-09T15:30:58.659194+0000","last_became_peered":"2023-10-09T15:30:58.659194+0000","last_unstale":"2023-10-09T15:30:59.654786+0000","last_undegraded":"2023-10-09T15:30:59.654786+0000","last_fullsized":"2023-10-09T15:30:59.654786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678479+0000","last_change":"2023-10-09T15:30:59.664311+0000","last_active":"2023-10-09T15:30:59.678479+0000","last_peered":"2023-10-09T15:30:59.678479+0000","last_clean":"2023-10-09T15:30:59.678479+0000","last_became_active":"2023-10-09T15:30:59.664084+0000","last_became_peered":"2023-10-09T15:30:59.664084+0000","last_unstale":"2023-10-09T15:30:59.678479+0000","last_undegraded":"2023-10-09T15:30:59.678479+0000","last_fullsized":"2023-10-09T15:30:59.678479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:34.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.655505+0000","last_change":"2023-10-09T15:30:58.658966+0000","last_active":"2023-10-09T15:30:59.655505+0000","last_peered":"2023-10-09T15:30:59.655505+0000","last_clean":"2023-10-09T15:30:59.655505+0000","last_became_active":"2023-10-09T15:30:58.658723+0000","last_became_peered":"2023-10-09T15:30:58.658723+0000","last_unstale":"2023-10-09T15:30:59.655505+0000","last_undegraded":"2023-10-09T15:30:59.655505+0000","last_fullsized":"2023-10-09T15:30:59.655505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670057+0000","last_change":"2023-10-09T15:30:59.662640+0000","last_active":"2023-10-09T15:30:59.670057+0000","last_peered":"2023-10-09T15:30:59.670057+0000","last_clean":"2023-10-09T15:30:59.670057+0000","last_became_active":"2023-10-09T15:30:59.662342+0000","last_became_peered":"2023-10-09T15:30:59.662342+0000","last_unstale":"2023-10-09T15:30:59.670057+0000","last_undegraded":"2023-10-09T15:30:59.670057+0000","last_fullsized":"2023-10-09T15:30:59.670057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.656826+0000","last_change":"2023-10-09T15:30:58.658056+0000","last_active":"2023-10-09T15:30:59.656826+0000","last_peered":"2023-10-09T15:30:59.656826+0000","last_clean":"2023-10-09T15:30:59.656826+0000","last_became_active":"2023-10-09T15:30:58.657777+0000","last_became_peered":"2023-10-09T15:30:58.657777+0000","last_unstale":"2023-10-09T15:30:59.656826+0000","last_undegraded":"2023-10-09T15:30:59.656826+0000","last_fullsized":"2023-10-09T15:30:59.656826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674709+0000","last_change":"2023-10-09T15:30:59.664936+0000","last_active":"2023-10-09T15:30:59.674709+0000","last_peered":"2023-10-09T15:30:59.674709+0000","last_clean":"2023-10-09T15:30:59.674709+0000","last_became_active":"2023-10-09T15:30:59.664631+0000","last_became_peered":"2023-10-09T15:30:59.664631+0000","last_unstale":"2023-10-09T15:30:59.674709+0000","last_undegraded":"2023-10-09T15:30:59.674709+0000","last_fullsized":"2023-10-09T15:30:59.674709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683165+0000","last_change":"2023-10-09T15:30:58.659699+0000","last_active":"2023-10-09T15:30:59.683165+0000","last_peered":"2023-10-09T15:30:59.683165+0000","last_clean":"2023-10-09T15:30:59.683165+0000","last_became_active":"2023-10-09T15:30:58.659378+0000","last_became_peered":"2023-10-09T15:30:58.659378+0000","last_unstale":"2023-10-09T15:30:59.683165+0000","last_undegraded":"2023-10-09T15:30:59.683165+0000","last_fullsized":"2023-10-09T15:30:59.683165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:49.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677259+0000","last_change":"2023-10-09T15:30:59.662826+0000","last_active":"2023-10-09T15:30:59.677259+0000","last_peered":"2023-10-09T15:30:59.677259+0000","last_clean":"2023-10-09T15:30:59.677259+0000","last_became_active":"2023-10-09T15:30:59.662503+0000","last_became_peered":"2023-10-09T15:30:59.662503+0000","last_unstale":"2023-10-09T15:30:59.677259+0000","last_undegraded":"2023-10-09T15:30:59.677259+0000","last_fullsized":"2023-10-09T15:30:59.677259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659777+0000","last_change":"2023-10-09T15:30:58.657426+0000","last_active":"2023-10-09T15:30:59.659777+0000","last_peered":"2023-10-09T15:30:59.659777+0000","last_clean":"2023-10-09T15:30:59.659777+0000","last_became_active":"2023-10-09T15:30:58.657154+0000","last_became_peered":"2023-10-09T15:30:58.657154+0000","last_unstale":"2023-10-09T15:30:59.659777+0000","last_undegraded":"2023-10-09T15:30:59.659777+0000","last_fullsized":"2023-10-09T15:30:59.659777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681135+0000","last_change":"2023-10-09T15:30:59.673642+0000","last_active":"2023-10-09T15:30:59.681135+0000","last_peered":"2023-10-09T15:30:59.681135+0000","last_clean":"2023-10-09T15:30:59.681135+0000","last_became_active":"2023-10-09T15:30:59.671999+0000","last_became_peered":"2023-10-09T15:30:59.671999+0000","last_unstale":"2023-10-09T15:30:59.681135+0000","last_undegraded":"2023-10-09T15:30:59.681135+0000","last_fullsized":"2023-10-09T15:30:59.681135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683681+0000","last_change":"2023-10-09T15:30:58.658112+0000","last_active":"2023-10-09T15:30:59.683681+0000","last_peered":"2023-10-09T15:30:59.683681+0000","last_clean":"2023-10-09T15:30:59.683681+0000","last_became_active":"2023-10-09T15:30:58.657790+0000","last_became_peered":"2023-10-09T15:30:58.657790+0000","last_unstale":"2023-10-09T15:30:59.683681+0000","last_undegraded":"2023-10-09T15:30:59.683681+0000","last_fullsized":"2023-10-09T15:30:59.683681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672943+0000","last_change":"2023-10-09T15:30:59.667024+0000","last_active":"2023-10-09T15:30:59.672943+0000","last_peered":"2023-10-09T15:30:59.672943+0000","last_clean":"2023-10-09T15:30:59.672943+0000","last_became_active":"2023-10-09T15:30:59.666511+0000","last_became_peered":"2023-10-09T15:30:59.666511+0000","last_unstale":"2023-10-09T15:30:59.672943+0000","last_undegraded":"2023-10-09T15:30:59.672943+0000","last_fullsized":"2023-10-09T15:30:59.672943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679463+0000","last_change":"2023-10-09T15:30:58.652304+0000","last_active":"2023-10-09T15:30:59.679463+0000","last_peered":"2023-10-09T15:30:59.679463+0000","last_clean":"2023-10-09T15:30:59.679463+0000","last_became_active":"2023-10-09T15:30:58.651797+0000","last_became_peered":"2023-10-09T15:30:58.651797+0000","last_unstale":"2023-10-09T15:30:59.679463+0000","last_undegraded":"2023-10-09T15:30:59.679463+0000","last_fullsized":"2023-10-09T15:30:59.679463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.688154+0000","last_change":"2023-10-09T15:30:59.681772+0000","last_active":"2023-10-09T15:30:59.688154+0000","last_peered":"2023-10-09T15:30:59.688154+0000","last_clean":"2023-10-09T15:30:59.688154+0000","last_became_active":"2023-10-09T15:30:59.681493+0000","last_became_peered":"2023-10-09T15:30:59.681493+0000","last_unstale":"2023-10-09T15:30:59.688154+0000","last_undegraded":"2023-10-09T15:30:59.688154+0000","last_fullsized":"2023-10-09T15:30:59.688154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659649+0000","last_change":"2023-10-09T15:30:59.655754+0000","last_active":"2023-10-09T15:30:59.659649+0000","last_peered":"2023-10-09T15:30:59.659649+0000","last_clean":"2023-10-09T15:30:59.659649+0000","last_became_active":"2023-10-09T15:30:59.655349+0000","last_became_peered":"2023-10-09T15:30:59.655349+0000","last_unstale":"2023-10-09T15:30:59.659649+0000","last_undegraded":"2023-10-09T15:30:59.659649+0000","last_fullsized":"2023-10-09T15:30:59.659649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676461+0000","last_change":"2023-10-09T15:30:59.671922+0000","last_active":"2023-10-09T15:30:59.676461+0000","last_peered":"2023-10-09T15:30:59.676461+0000","last_clean":"2023-10-09T15:30:59.676461+0000","last_became_active":"2023-10-09T15:30:59.671653+0000","last_became_peered":"2023-10-09T15:30:59.671653+0000","last_unstale":"2023-10-09T15:30:59.676461+0000","last_undegraded":"2023-10-09T15:30:59.676461+0000","last_fullsized":"2023-10-09T15:30:59.676461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675676+0000","last_change":"2023-10-09T15:30:59.667346+0000","last_active":"2023-10-09T15:30:59.675676+0000","last_peered":"2023-10-09T15:30:59.675676+0000","last_clean":"2023-10-09T15:30:59.675676+0000","last_became_active":"2023-10-09T15:30:59.666133+0000","last_became_peered":"2023-10-09T15:30:59.666133+0000","last_unstale":"2023-10-09T15:30:59.675676+0000","last_undegraded":"2023-10-09T15:30:59.675676+0000","last_fullsized":"2023-10-09T15:30:59.675676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665591+0000","last_change":"2023-10-09T15:30:59.659235+0000","last_active":"2023-10-09T15:30:59.665591+0000","last_peered":"2023-10-09T15:30:59.665591+0000","last_clean":"2023-10-09T15:30:59.665591+0000","last_became_active":"2023-10-09T15:30:59.658828+0000","last_became_peered":"2023-10-09T15:30:59.658828+0000","last_unstale":"2023-10-09T15:30:59.665591+0000","last_undegraded":"2023-10-09T15:30:59.665591+0000","last_fullsized":"2023-10-09T15:30:59.665591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683058+0000","last_change":"2023-10-09T15:30:59.675159+0000","last_active":"2023-10-09T15:30:59.683058+0000","last_peered":"2023-10-09T15:30:59.683058+0000","last_clean":"2023-10-09T15:30:59.683058+0000","last_became_active":"2023-10-09T15:30:59.674897+0000","last_became_peered":"2023-10-09T15:30:59.674897+0000","last_unstale":"2023-10-09T15:30:59.683058+0000","last_undegraded":"2023-10-09T15:30:59.683058+0000","last_fullsized":"2023-10-09T15:30:59.683058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668705+0000","last_change":"2023-10-09T15:30:59.662912+0000","last_active":"2023-10-09T15:30:59.668705+0000","last_peered":"2023-10-09T15:30:59.668705+0000","last_clean":"2023-10-09T15:30:59.668705+0000","last_became_active":"2023-10-09T15:30:59.662380+0000","last_became_peered":"2023-10-09T15:30:59.662380+0000","last_unstale":"2023-10-09T15:30:59.668705+0000","last_undegraded":"2023-10-09T15:30:59.668705+0000","last_fullsized":"2023-10-09T15:30:59.668705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677401+0000","last_change":"2023-10-09T15:30:59.673219+0000","last_active":"2023-10-09T15:30:59.677401+0000","last_peered":"2023-10-09T15:30:59.677401+0000","last_clean":"2023-10-09T15:30:59.677401+0000","last_became_active":"2023-10-09T15:30:59.672928+0000","last_became_peered":"2023-10-09T15:30:59.672928+0000","last_unstale":"2023-10-09T15:30:59.677401+0000","last_undegraded":"2023-10-09T15:30:59.677401+0000","last_fullsized":"2023-10-09T15:30:59.677401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683108+0000","last_change":"2023-10-09T15:30:59.678780+0000","last_active":"2023-10-09T15:30:59.683108+0000","last_peered":"2023-10-09T15:30:59.683108+0000","last_clean":"2023-10-09T15:30:59.683108+0000","last_became_active":"2023-10-09T15:30:59.678502+0000","last_became_peered":"2023-10-09T15:30:59.678502+0000","last_unstale":"2023-10-09T15:30:59.683108+0000","last_undegraded":"2023-10-09T15:30:59.683108+0000","last_fullsized":"2023-10-09T15:30:59.683108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675559+0000","last_change":"2023-10-09T15:30:59.668814+0000","last_active":"2023-10-09T15:30:59.675559+0000","last_peered":"2023-10-09T15:30:59.675559+0000","last_clean":"2023-10-09T15:30:59.675559+0000","last_became_active":"2023-10-09T15:30:59.668501+0000","last_became_peered":"2023-10-09T15:30:59.668501+0000","last_unstale":"2023-10-09T15:30:59.675559+0000","last_undegraded":"2023-10-09T15:30:59.675559+0000","last_fullsized":"2023-10-09T15:30:59.675559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683026+0000","last_change":"2023-10-09T15:30:59.674502+0000","last_active":"2023-10-09T15:30:59.683026+0000","last_peered":"2023-10-09T15:30:59.683026+0000","last_clean":"2023-10-09T15:30:59.683026+0000","last_became_active":"2023-10-09T15:30:59.674165+0000","last_became_peered":"2023-10-09T15:30:59.674165+0000","last_unstale":"2023-10-09T15:30:59.683026+0000","last_undegraded":"2023-10-09T15:30:59.683026+0000","last_fullsized":"2023-10-09T15:30:59.683026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680953+0000","last_change":"2023-10-09T15:30:59.675013+0000","last_active":"2023-10-09T15:30:59.680953+0000","last_peered":"2023-10-09T15:30:59.680953+0000","last_clean":"2023-10-09T15:30:59.680953+0000","last_became_active":"2023-10-09T15:30:59.674731+0000","last_became_peered":"2023-10-09T15:30:59.674731+0000","last_unstale":"2023-10-09T15:30:59.680953+0000","last_undegraded":"2023-10-09T15:30:59.680953+0000","last_fullsized":"2023-10-09T15:30:59.680953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677154+0000","last_change":"2023-10-09T15:30:59.674112+0000","last_active":"2023-10-09T15:30:59.677154+0000","last_peered":"2023-10-09T15:30:59.677154+0000","last_clean":"2023-10-09T15:30:59.677154+0000","last_became_active":"2023-10-09T15:30:59.673855+0000","last_became_peered":"2023-10-09T15:30:59.673855+0000","last_unstale":"2023-10-09T15:30:59.677154+0000","last_undegraded":"2023-10-09T15:30:59.677154+0000","last_fullsized":"2023-10-09T15:30:59.677154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.661031+0000","last_change":"2023-10-09T15:30:59.656928+0000","last_active":"2023-10-09T15:30:59.661031+0000","last_peered":"2023-10-09T15:30:59.661031+0000","last_clean":"2023-10-09T15:30:59.661031+0000","last_became_active":"2023-10-09T15:30:59.656505+0000","last_became_peered":"2023-10-09T15:30:59.656505+0000","last_unstale":"2023-10-09T15:30:59.661031+0000","last_undegraded":"2023-10-09T15:30:59.661031+0000","last_fullsized":"2023-10-09T15:30:59.661031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:05.545 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:31:05.548 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:31:08.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.468+0000 7ff53b59e700 1 Processor -- start 2023-10-09T15:31:08.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.468+0000 7ff53b59e700 1 -- start start 2023-10-09T15:31:08.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 0x7ff53c0ca080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53b59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff53c0af2a0 0x7ff53c0cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53b59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff53c06b690 con 0x7ff53c0aeed0 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53b59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff53c0b0bd0 con 0x7ff53c0af2a0 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c0b0eb0 con 0x7ff53c0b0720 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff53c0af2a0 0x7ff53c0cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53a59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff53c0aeed0 0x7ff53c0b0010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47940/0 (socket says 172.21.15.33:47940) 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53a59c700 1 -- 172.21.15.33:0/1500044298 learned_addr learned my addr 172.21.15.33:0/1500044298 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53ad9d700 1 -- 172.21.15.33:0/1500044298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 msgr2=0x7ff53c0ca080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff531d9b700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 0x7ff53c0ca080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53ad9d700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 0x7ff53c0ca080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53ad9d700 1 -- 172.21.15.33:0/1500044298 >> v1:172.21.15.33:6789/0 conn(0x7ff53c0aeed0 legacy=0x7ff53c0b0010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff539d9b700 1 -- 172.21.15.33:0/1500044298 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 465811456 0 0) 0x7ff53c06b690 con 0x7ff53c0aeed0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff53ad9d700 1 -- 172.21.15.33:0/1500044298 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff53c0b1190 con 0x7ff53c0af2a0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.469+0000 7ff531d9b700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 0x7ff53c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53ad9d700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c0cb990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff534009e60 tx=0x7ff534009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbfed38e5df0c35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff539d9b700 1 -- 172.21.15.33:0/1500044298 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff53400e070 con 0x7ff53c0af2a0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff539d9b700 1 -- 172.21.15.33:0/1500044298 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff53400bc30 con 0x7ff53c0af2a0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff539d9b700 1 -- 172.21.15.33:0/1500044298 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff534012430 con 0x7ff53c0af2a0 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 -- 172.21.15.33:0/1500044298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 msgr2=0x7ff53c0cb990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c0cb990 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff534009e60 tx=0x7ff534009780 comp rx=0 tx=0).stop 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 -- 172.21.15.33:0/1500044298 shutdown_connections 2023-10-09T15:31:08.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c0cb990 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1500044298 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0b0720 0x7ff53c0ca080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 -- 172.21.15.33:0/1500044298 >> 172.21.15.33:0/1500044298 conn(0x7ff53c0675a0 msgr2=0x7ff53c067970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:08.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 -- 172.21.15.33:0/1500044298 shutdown_connections 2023-10-09T15:31:08.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.470+0000 7ff53b59e700 1 -- 172.21.15.33:0/1500044298 wait complete. 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 Processor -- start 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 -- start start 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0aeed0 0x7ff53c154e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0b0720 0x7ff53c14ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c1691e0 con 0x7ff53c0af2a0 2023-10-09T15:31:08.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c155930 con 0x7ff53c0b0720 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.472+0000 7ff53b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff53c1688b0 con 0x7ff53c0aeed0 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42352/0 (socket says 172.21.15.33:42352) 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 -- 172.21.15.33:0/1210065168 learned_addr learned my addr 172.21.15.33:0/1210065168 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff53a59c700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0aeed0 0x7ff53c154e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff53ad9d700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0b0720 0x7ff53c14ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 -- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0aeed0 msgr2=0x7ff53c154e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0aeed0 0x7ff53c154e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 -- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0b0720 msgr2=0x7ff53c14ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0b0720 0x7ff53c14ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 -- 172.21.15.33:0/1210065168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff534009a20 con 0x7ff53c0af2a0 2023-10-09T15:31:08.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff531d9b700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c830 tx=0x7ff524008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524011600 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff524011760 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff53c168b90 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff524011b20 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.473+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff53c1684d0 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.474+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff53c04c3c0 con 0x7ff53c0af2a0 2023-10-09T15:31:08.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.475+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff524024480 con 0x7ff53c0af2a0 2023-10-09T15:31:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.476+0000 7ff532ffd700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.476+0000 7ff53a59c700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.476+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff524084970 con 0x7ff53c0af2a0 2023-10-09T15:31:08.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.476+0000 7ff53a59c700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 0x7ff51c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff52c007160 tx=0x7ff52c007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.480+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff524051c60 con 0x7ff53c0af2a0 2023-10-09T15:31:08.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.669+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff53c169320 con 0x7ff51c066f30 2023-10-09T15:31:08.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.677+0000 7ff532ffd700 1 -- 172.21.15.33:0/1210065168 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264595 (secure 0 0 0) 0x7ff53c169320 con 0x7ff51c066f30 2023-10-09T15:31:08.680 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:08.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 msgr2=0x7ff51c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 0x7ff51c0693e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7ff52c007160 tx=0x7ff52c007f50 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 msgr2=0x7ff53c14ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ff52400c830 tx=0x7ff524008040 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 shutdown_connections 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff51c066f30 0x7ff51c0693e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff53c0b0720 0x7ff53c14ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff53c0aeed0 0x7ff53c154e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 --2- 172.21.15.33:0/1210065168 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff53c0af2a0 0x7ff53c14ea40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 >> 172.21.15.33:0/1210065168 conn(0x7ff53c0675a0 msgr2=0x7ff53c0ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 shutdown_connections 2023-10-09T15:31:08.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.680+0000 7ff53b59e700 1 -- 172.21.15.33:0/1210065168 wait complete. 2023-10-09T15:31:08.683 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:08.692 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":20,"stamp":"2023-10-09T15:31:07.236481+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":40,"apply_latency_ms":40,"commit_latency_ns":40000000,"apply_latency_ns":40000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001662"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682261+0000","last_change":"2023-10-09T15:30:59.675453+0000","last_active":"2023-10-09T15:30:59.682261+0000","last_peered":"2023-10-09T15:30:59.682261+0000","last_clean":"2023-10-09T15:30:59.682261+0000","last_became_active":"2023-10-09T15:30:59.675159+0000","last_became_peered":"2023-10-09T15:30:59.675159+0000","last_unstale":"2023-10-09T15:30:59.682261+0000","last_undegraded":"2023-10-09T15:30:59.682261+0000","last_fullsized":"2023-10-09T15:30:59.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670422+0000","last_change":"2023-10-09T15:30:59.666350+0000","last_active":"2023-10-09T15:30:59.670422+0000","last_peered":"2023-10-09T15:30:59.670422+0000","last_clean":"2023-10-09T15:30:59.670422+0000","last_became_active":"2023-10-09T15:30:59.665970+0000","last_became_peered":"2023-10-09T15:30:59.665970+0000","last_unstale":"2023-10-09T15:30:59.670422+0000","last_undegraded":"2023-10-09T15:30:59.670422+0000","last_fullsized":"2023-10-09T15:30:59.670422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669088+0000","last_change":"2023-10-09T15:30:59.663886+0000","last_active":"2023-10-09T15:30:59.669088+0000","last_peered":"2023-10-09T15:30:59.669088+0000","last_clean":"2023-10-09T15:30:59.669088+0000","last_became_active":"2023-10-09T15:30:59.663598+0000","last_became_peered":"2023-10-09T15:30:59.663598+0000","last_unstale":"2023-10-09T15:30:59.669088+0000","last_undegraded":"2023-10-09T15:30:59.669088+0000","last_fullsized":"2023-10-09T15:30:59.669088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672923+0000","last_change":"2023-10-09T15:30:59.666790+0000","last_active":"2023-10-09T15:30:59.672923+0000","last_peered":"2023-10-09T15:30:59.672923+0000","last_clean":"2023-10-09T15:30:59.672923+0000","last_became_active":"2023-10-09T15:30:59.666144+0000","last_became_peered":"2023-10-09T15:30:59.666144+0000","last_unstale":"2023-10-09T15:30:59.672923+0000","last_undegraded":"2023-10-09T15:30:59.672923+0000","last_fullsized":"2023-10-09T15:30:59.672923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679237+0000","last_change":"2023-10-09T15:30:59.670991+0000","last_active":"2023-10-09T15:30:59.679237+0000","last_peered":"2023-10-09T15:30:59.679237+0000","last_clean":"2023-10-09T15:30:59.679237+0000","last_became_active":"2023-10-09T15:30:59.670704+0000","last_became_peered":"2023-10-09T15:30:59.670704+0000","last_unstale":"2023-10-09T15:30:59.679237+0000","last_undegraded":"2023-10-09T15:30:59.679237+0000","last_fullsized":"2023-10-09T15:30:59.679237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675697+0000","last_change":"2023-10-09T15:30:59.667866+0000","last_active":"2023-10-09T15:30:59.675697+0000","last_peered":"2023-10-09T15:30:59.675697+0000","last_clean":"2023-10-09T15:30:59.675697+0000","last_became_active":"2023-10-09T15:30:59.667647+0000","last_became_peered":"2023-10-09T15:30:59.667647+0000","last_unstale":"2023-10-09T15:30:59.675697+0000","last_undegraded":"2023-10-09T15:30:59.675697+0000","last_fullsized":"2023-10-09T15:30:59.675697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679218+0000","last_change":"2023-10-09T15:30:59.670699+0000","last_active":"2023-10-09T15:30:59.679218+0000","last_peered":"2023-10-09T15:30:59.679218+0000","last_clean":"2023-10-09T15:30:59.679218+0000","last_became_active":"2023-10-09T15:30:59.670342+0000","last_became_peered":"2023-10-09T15:30:59.670342+0000","last_unstale":"2023-10-09T15:30:59.679218+0000","last_undegraded":"2023-10-09T15:30:59.679218+0000","last_fullsized":"2023-10-09T15:30:59.679218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679139+0000","last_change":"2023-10-09T15:30:59.670588+0000","last_active":"2023-10-09T15:30:59.679139+0000","last_peered":"2023-10-09T15:30:59.679139+0000","last_clean":"2023-10-09T15:30:59.679139+0000","last_became_active":"2023-10-09T15:30:59.670286+0000","last_became_peered":"2023-10-09T15:30:59.670286+0000","last_unstale":"2023-10-09T15:30:59.679139+0000","last_undegraded":"2023-10-09T15:30:59.679139+0000","last_fullsized":"2023-10-09T15:30:59.679139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682230+0000","last_change":"2023-10-09T15:30:59.674866+0000","last_active":"2023-10-09T15:30:59.682230+0000","last_peered":"2023-10-09T15:30:59.682230+0000","last_clean":"2023-10-09T15:30:59.682230+0000","last_became_active":"2023-10-09T15:30:59.674592+0000","last_became_peered":"2023-10-09T15:30:59.674592+0000","last_unstale":"2023-10-09T15:30:59.682230+0000","last_undegraded":"2023-10-09T15:30:59.682230+0000","last_fullsized":"2023-10-09T15:30:59.682230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:18.896209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677373+0000","last_change":"2023-10-09T15:30:59.670458+0000","last_active":"2023-10-09T15:30:59.677373+0000","last_peered":"2023-10-09T15:30:59.677373+0000","last_clean":"2023-10-09T15:30:59.677373+0000","last_became_active":"2023-10-09T15:30:59.670170+0000","last_became_peered":"2023-10-09T15:30:59.670170+0000","last_unstale":"2023-10-09T15:30:59.677373+0000","last_undegraded":"2023-10-09T15:30:59.677373+0000","last_fullsized":"2023-10-09T15:30:59.677373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677264+0000","last_change":"2023-10-09T15:30:59.672093+0000","last_active":"2023-10-09T15:30:59.677264+0000","last_peered":"2023-10-09T15:30:59.677264+0000","last_clean":"2023-10-09T15:30:59.677264+0000","last_became_active":"2023-10-09T15:30:59.671829+0000","last_became_peered":"2023-10-09T15:30:59.671829+0000","last_unstale":"2023-10-09T15:30:59.677264+0000","last_undegraded":"2023-10-09T15:30:59.677264+0000","last_fullsized":"2023-10-09T15:30:59.677264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674095+0000","last_change":"2023-10-09T15:30:59.652602+0000","last_active":"2023-10-09T15:30:59.674095+0000","last_peered":"2023-10-09T15:30:59.674095+0000","last_clean":"2023-10-09T15:30:59.674095+0000","last_became_active":"2023-10-09T15:30:59.652304+0000","last_became_peered":"2023-10-09T15:30:59.652304+0000","last_unstale":"2023-10-09T15:30:59.674095+0000","last_undegraded":"2023-10-09T15:30:59.674095+0000","last_fullsized":"2023-10-09T15:30:59.674095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:07.825038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.662644+0000","last_change":"2023-10-09T15:30:59.658543+0000","last_active":"2023-10-09T15:30:59.662644+0000","last_peered":"2023-10-09T15:30:59.662644+0000","last_clean":"2023-10-09T15:30:59.662644+0000","last_became_active":"2023-10-09T15:30:59.658260+0000","last_became_peered":"2023-10-09T15:30:59.658260+0000","last_unstale":"2023-10-09T15:30:59.662644+0000","last_undegraded":"2023-10-09T15:30:59.662644+0000","last_fullsized":"2023-10-09T15:30:59.662644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665749+0000","last_change":"2023-10-09T15:30:59.661916+0000","last_active":"2023-10-09T15:30:59.665749+0000","last_peered":"2023-10-09T15:30:59.665749+0000","last_clean":"2023-10-09T15:30:59.665749+0000","last_became_active":"2023-10-09T15:30:59.661612+0000","last_became_peered":"2023-10-09T15:30:59.661612+0000","last_unstale":"2023-10-09T15:30:59.665749+0000","last_undegraded":"2023-10-09T15:30:59.665749+0000","last_fullsized":"2023-10-09T15:30:59.665749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680476+0000","last_change":"2023-10-09T15:30:59.677507+0000","last_active":"2023-10-09T15:30:59.680476+0000","last_peered":"2023-10-09T15:30:59.680476+0000","last_clean":"2023-10-09T15:30:59.680476+0000","last_became_active":"2023-10-09T15:30:59.677142+0000","last_became_peered":"2023-10-09T15:30:59.677142+0000","last_unstale":"2023-10-09T15:30:59.680476+0000","last_undegraded":"2023-10-09T15:30:59.680476+0000","last_fullsized":"2023-10-09T15:30:59.680476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675582+0000","last_change":"2023-10-09T15:30:59.669137+0000","last_active":"2023-10-09T15:30:59.675582+0000","last_peered":"2023-10-09T15:30:59.675582+0000","last_clean":"2023-10-09T15:30:59.675582+0000","last_became_active":"2023-10-09T15:30:59.668871+0000","last_became_peered":"2023-10-09T15:30:59.668871+0000","last_unstale":"2023-10-09T15:30:59.675582+0000","last_undegraded":"2023-10-09T15:30:59.675582+0000","last_fullsized":"2023-10-09T15:30:59.675582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681093+0000","last_change":"2023-10-09T15:30:59.675035+0000","last_active":"2023-10-09T15:30:59.681093+0000","last_peered":"2023-10-09T15:30:59.681093+0000","last_clean":"2023-10-09T15:30:59.681093+0000","last_became_active":"2023-10-09T15:30:59.674718+0000","last_became_peered":"2023-10-09T15:30:59.674718+0000","last_unstale":"2023-10-09T15:30:59.681093+0000","last_undegraded":"2023-10-09T15:30:59.681093+0000","last_fullsized":"2023-10-09T15:30:59.681093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677089+0000","last_change":"2023-10-09T15:30:59.675915+0000","last_active":"2023-10-09T15:30:59.677089+0000","last_peered":"2023-10-09T15:30:59.677089+0000","last_clean":"2023-10-09T15:30:59.677089+0000","last_became_active":"2023-10-09T15:30:59.675642+0000","last_became_peered":"2023-10-09T15:30:59.675642+0000","last_unstale":"2023-10-09T15:30:59.677089+0000","last_undegraded":"2023-10-09T15:30:59.677089+0000","last_fullsized":"2023-10-09T15:30:59.677089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679359+0000","last_change":"2023-10-09T15:30:59.671221+0000","last_active":"2023-10-09T15:30:59.679359+0000","last_peered":"2023-10-09T15:30:59.679359+0000","last_clean":"2023-10-09T15:30:59.679359+0000","last_became_active":"2023-10-09T15:30:59.670944+0000","last_became_peered":"2023-10-09T15:30:59.670944+0000","last_unstale":"2023-10-09T15:30:59.679359+0000","last_undegraded":"2023-10-09T15:30:59.679359+0000","last_fullsized":"2023-10-09T15:30:59.679359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682812+0000","last_change":"2023-10-09T15:30:58.654623+0000","last_active":"2023-10-09T15:30:59.682812+0000","last_peered":"2023-10-09T15:30:59.682812+0000","last_clean":"2023-10-09T15:30:59.682812+0000","last_became_active":"2023-10-09T15:30:58.654351+0000","last_became_peered":"2023-10-09T15:30:58.654351+0000","last_unstale":"2023-10-09T15:30:59.682812+0000","last_undegraded":"2023-10-09T15:30:59.682812+0000","last_fullsized":"2023-10-09T15:30:59.682812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.660456+0000","last_change":"2023-10-09T15:30:59.656560+0000","last_active":"2023-10-09T15:30:59.660456+0000","last_peered":"2023-10-09T15:30:59.660456+0000","last_clean":"2023-10-09T15:30:59.660456+0000","last_became_active":"2023-10-09T15:30:59.656293+0000","last_became_peered":"2023-10-09T15:30:59.656293+0000","last_unstale":"2023-10-09T15:30:59.660456+0000","last_undegraded":"2023-10-09T15:30:59.660456+0000","last_fullsized":"2023-10-09T15:30:59.660456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679270+0000","last_change":"2023-10-09T15:30:58.659955+0000","last_active":"2023-10-09T15:30:59.679270+0000","last_peered":"2023-10-09T15:30:59.679270+0000","last_clean":"2023-10-09T15:30:59.679270+0000","last_became_active":"2023-10-09T15:30:58.659645+0000","last_became_peered":"2023-10-09T15:30:58.659645+0000","last_unstale":"2023-10-09T15:30:59.679270+0000","last_undegraded":"2023-10-09T15:30:59.679270+0000","last_fullsized":"2023-10-09T15:30:59.679270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675130+0000","last_change":"2023-10-09T15:30:59.667774+0000","last_active":"2023-10-09T15:30:59.675130+0000","last_peered":"2023-10-09T15:30:59.675130+0000","last_clean":"2023-10-09T15:30:59.675130+0000","last_became_active":"2023-10-09T15:30:59.667490+0000","last_became_peered":"2023-10-09T15:30:59.667490+0000","last_unstale":"2023-10-09T15:30:59.675130+0000","last_undegraded":"2023-10-09T15:30:59.675130+0000","last_fullsized":"2023-10-09T15:30:59.675130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680068+0000","last_change":"2023-10-09T15:30:58.658690+0000","last_active":"2023-10-09T15:30:59.680068+0000","last_peered":"2023-10-09T15:30:59.680068+0000","last_clean":"2023-10-09T15:30:59.680068+0000","last_became_active":"2023-10-09T15:30:58.658429+0000","last_became_peered":"2023-10-09T15:30:58.658429+0000","last_unstale":"2023-10-09T15:30:59.680068+0000","last_undegraded":"2023-10-09T15:30:59.680068+0000","last_fullsized":"2023-10-09T15:30:59.680068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681667+0000","last_change":"2023-10-09T15:30:59.678307+0000","last_active":"2023-10-09T15:30:59.681667+0000","last_peered":"2023-10-09T15:30:59.681667+0000","last_clean":"2023-10-09T15:30:59.681667+0000","last_became_active":"2023-10-09T15:30:59.678048+0000","last_became_peered":"2023-10-09T15:30:59.678048+0000","last_unstale":"2023-10-09T15:30:59.681667+0000","last_undegraded":"2023-10-09T15:30:59.681667+0000","last_fullsized":"2023-10-09T15:30:59.681667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681194+0000","last_change":"2023-10-09T15:30:58.661313+0000","last_active":"2023-10-09T15:30:59.681194+0000","last_peered":"2023-10-09T15:30:59.681194+0000","last_clean":"2023-10-09T15:30:59.681194+0000","last_became_active":"2023-10-09T15:30:58.661029+0000","last_became_peered":"2023-10-09T15:30:58.661029+0000","last_unstale":"2023-10-09T15:30:59.681194+0000","last_undegraded":"2023-10-09T15:30:59.681194+0000","last_fullsized":"2023-10-09T15:30:59.681194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:20.445789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681768+0000","last_change":"2023-10-09T15:30:59.679014+0000","last_active":"2023-10-09T15:30:59.681768+0000","last_peered":"2023-10-09T15:30:59.681768+0000","last_clean":"2023-10-09T15:30:59.681768+0000","last_became_active":"2023-10-09T15:30:59.678577+0000","last_became_peered":"2023-10-09T15:30:59.678577+0000","last_unstale":"2023-10-09T15:30:59.681768+0000","last_undegraded":"2023-10-09T15:30:59.681768+0000","last_fullsized":"2023-10-09T15:30:59.681768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681275+0000","last_change":"2023-10-09T15:30:58.656303+0000","last_active":"2023-10-09T15:30:59.681275+0000","last_peered":"2023-10-09T15:30:59.681275+0000","last_clean":"2023-10-09T15:30:59.681275+0000","last_became_active":"2023-10-09T15:30:58.655754+0000","last_became_peered":"2023-10-09T15:30:58.655754+0000","last_unstale":"2023-10-09T15:30:59.681275+0000","last_undegraded":"2023-10-09T15:30:59.681275+0000","last_fullsized":"2023-10-09T15:30:59.681275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677214+0000","last_change":"2023-10-09T15:30:59.661929+0000","last_active":"2023-10-09T15:30:59.677214+0000","last_peered":"2023-10-09T15:30:59.677214+0000","last_clean":"2023-10-09T15:30:59.677214+0000","last_became_active":"2023-10-09T15:30:59.661661+0000","last_became_peered":"2023-10-09T15:30:59.661661+0000","last_unstale":"2023-10-09T15:30:59.677214+0000","last_undegraded":"2023-10-09T15:30:59.677214+0000","last_fullsized":"2023-10-09T15:30:59.677214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:21.450587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678717+0000","last_change":"2023-10-09T15:30:58.651818+0000","last_active":"2023-10-09T15:30:59.678717+0000","last_peered":"2023-10-09T15:30:59.678717+0000","last_clean":"2023-10-09T15:30:59.678717+0000","last_became_active":"2023-10-09T15:30:58.651546+0000","last_became_peered":"2023-10-09T15:30:58.651546+0000","last_unstale":"2023-10-09T15:30:59.678717+0000","last_undegraded":"2023-10-09T15:30:59.678717+0000","last_fullsized":"2023-10-09T15:30:59.678717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665613+0000","last_change":"2023-10-09T15:30:59.660923+0000","last_active":"2023-10-09T15:30:59.665613+0000","last_peered":"2023-10-09T15:30:59.665613+0000","last_clean":"2023-10-09T15:30:59.665613+0000","last_became_active":"2023-10-09T15:30:59.660614+0000","last_became_peered":"2023-10-09T15:30:59.660614+0000","last_unstale":"2023-10-09T15:30:59.665613+0000","last_undegraded":"2023-10-09T15:30:59.665613+0000","last_fullsized":"2023-10-09T15:30:59.665613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.652963+0000","last_change":"2023-10-09T15:30:58.654565+0000","last_active":"2023-10-09T15:30:59.652963+0000","last_peered":"2023-10-09T15:30:59.652963+0000","last_clean":"2023-10-09T15:30:59.652963+0000","last_became_active":"2023-10-09T15:30:58.654100+0000","last_became_peered":"2023-10-09T15:30:58.654100+0000","last_unstale":"2023-10-09T15:30:59.652963+0000","last_undegraded":"2023-10-09T15:30:59.652963+0000","last_fullsized":"2023-10-09T15:30:59.652963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.663038+0000","last_change":"2023-10-09T15:30:59.659944+0000","last_active":"2023-10-09T15:30:59.663038+0000","last_peered":"2023-10-09T15:30:59.663038+0000","last_clean":"2023-10-09T15:30:59.663038+0000","last_became_active":"2023-10-09T15:30:59.659370+0000","last_became_peered":"2023-10-09T15:30:59.659370+0000","last_unstale":"2023-10-09T15:30:59.663038+0000","last_undegraded":"2023-10-09T15:30:59.663038+0000","last_fullsized":"2023-10-09T15:30:59.663038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657161+0000","last_change":"2023-10-09T15:30:58.663665+0000","last_active":"2023-10-09T15:30:59.657161+0000","last_peered":"2023-10-09T15:30:59.657161+0000","last_clean":"2023-10-09T15:30:59.657161+0000","last_became_active":"2023-10-09T15:30:58.663374+0000","last_became_peered":"2023-10-09T15:30:58.663374+0000","last_unstale":"2023-10-09T15:30:59.657161+0000","last_undegraded":"2023-10-09T15:30:59.657161+0000","last_fullsized":"2023-10-09T15:30:59.657161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668305+0000","last_change":"2023-10-09T15:30:59.662643+0000","last_active":"2023-10-09T15:30:59.668305+0000","last_peered":"2023-10-09T15:30:59.668305+0000","last_clean":"2023-10-09T15:30:59.668305+0000","last_became_active":"2023-10-09T15:30:59.662002+0000","last_became_peered":"2023-10-09T15:30:59.662002+0000","last_unstale":"2023-10-09T15:30:59.668305+0000","last_undegraded":"2023-10-09T15:30:59.668305+0000","last_fullsized":"2023-10-09T15:30:59.668305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648439+0000","last_change":"2023-10-09T15:30:58.657412+0000","last_active":"2023-10-09T15:30:59.648439+0000","last_peered":"2023-10-09T15:30:59.648439+0000","last_clean":"2023-10-09T15:30:59.648439+0000","last_became_active":"2023-10-09T15:30:58.657086+0000","last_became_peered":"2023-10-09T15:30:58.657086+0000","last_unstale":"2023-10-09T15:30:59.648439+0000","last_undegraded":"2023-10-09T15:30:59.648439+0000","last_fullsized":"2023-10-09T15:30:59.648439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678652+0000","last_change":"2023-10-09T15:30:59.672392+0000","last_active":"2023-10-09T15:30:59.678652+0000","last_peered":"2023-10-09T15:30:59.678652+0000","last_clean":"2023-10-09T15:30:59.678652+0000","last_became_active":"2023-10-09T15:30:59.671757+0000","last_became_peered":"2023-10-09T15:30:59.671757+0000","last_unstale":"2023-10-09T15:30:59.678652+0000","last_undegraded":"2023-10-09T15:30:59.678652+0000","last_fullsized":"2023-10-09T15:30:59.678652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658666+0000","last_change":"2023-10-09T15:30:58.657247+0000","last_active":"2023-10-09T15:30:59.658666+0000","last_peered":"2023-10-09T15:30:59.658666+0000","last_clean":"2023-10-09T15:30:59.658666+0000","last_became_active":"2023-10-09T15:30:58.656943+0000","last_became_peered":"2023-10-09T15:30:58.656943+0000","last_unstale":"2023-10-09T15:30:59.658666+0000","last_undegraded":"2023-10-09T15:30:59.658666+0000","last_fullsized":"2023-10-09T15:30:59.658666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675152+0000","last_change":"2023-10-09T15:30:59.667816+0000","last_active":"2023-10-09T15:30:59.675152+0000","last_peered":"2023-10-09T15:30:59.675152+0000","last_clean":"2023-10-09T15:30:59.675152+0000","last_became_active":"2023-10-09T15:30:59.667529+0000","last_became_peered":"2023-10-09T15:30:59.667529+0000","last_unstale":"2023-10-09T15:30:59.675152+0000","last_undegraded":"2023-10-09T15:30:59.675152+0000","last_fullsized":"2023-10-09T15:30:59.675152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682943+0000","last_change":"2023-10-09T15:30:58.661206+0000","last_active":"2023-10-09T15:30:59.682943+0000","last_peered":"2023-10-09T15:30:59.682943+0000","last_clean":"2023-10-09T15:30:59.682943+0000","last_became_active":"2023-10-09T15:30:58.660947+0000","last_became_peered":"2023-10-09T15:30:58.660947+0000","last_unstale":"2023-10-09T15:30:59.682943+0000","last_undegraded":"2023-10-09T15:30:59.682943+0000","last_fullsized":"2023-10-09T15:30:59.682943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682953+0000","last_change":"2023-10-09T15:30:59.670968+0000","last_active":"2023-10-09T15:30:59.682953+0000","last_peered":"2023-10-09T15:30:59.682953+0000","last_clean":"2023-10-09T15:30:59.682953+0000","last_became_active":"2023-10-09T15:30:59.670674+0000","last_became_peered":"2023-10-09T15:30:59.670674+0000","last_unstale":"2023-10-09T15:30:59.682953+0000","last_undegraded":"2023-10-09T15:30:59.682953+0000","last_fullsized":"2023-10-09T15:30:59.682953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:50.286664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.685943+0000","last_change":"2023-10-09T15:30:58.651540+0000","last_active":"2023-10-09T15:30:59.685943+0000","last_peered":"2023-10-09T15:30:59.685943+0000","last_clean":"2023-10-09T15:30:59.685943+0000","last_became_active":"2023-10-09T15:30:58.651207+0000","last_became_peered":"2023-10-09T15:30:58.651207+0000","last_unstale":"2023-10-09T15:30:59.685943+0000","last_undegraded":"2023-10-09T15:30:59.685943+0000","last_fullsized":"2023-10-09T15:30:59.685943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679374+0000","last_change":"2023-10-09T15:30:59.672317+0000","last_active":"2023-10-09T15:30:59.679374+0000","last_peered":"2023-10-09T15:30:59.679374+0000","last_clean":"2023-10-09T15:30:59.679374+0000","last_became_active":"2023-10-09T15:30:59.671578+0000","last_became_peered":"2023-10-09T15:30:59.671578+0000","last_unstale":"2023-10-09T15:30:59.679374+0000","last_undegraded":"2023-10-09T15:30:59.679374+0000","last_fullsized":"2023-10-09T15:30:59.679374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683332+0000","last_change":"2023-10-09T15:30:58.655428+0000","last_active":"2023-10-09T15:30:59.683332+0000","last_peered":"2023-10-09T15:30:59.683332+0000","last_clean":"2023-10-09T15:30:59.683332+0000","last_became_active":"2023-10-09T15:30:58.655117+0000","last_became_peered":"2023-10-09T15:30:58.655117+0000","last_unstale":"2023-10-09T15:30:59.683332+0000","last_undegraded":"2023-10-09T15:30:59.683332+0000","last_fullsized":"2023-10-09T15:30:59.683332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677001+0000","last_change":"2023-10-09T15:30:59.672831+0000","last_active":"2023-10-09T15:30:59.677001+0000","last_peered":"2023-10-09T15:30:59.677001+0000","last_clean":"2023-10-09T15:30:59.677001+0000","last_became_active":"2023-10-09T15:30:59.672528+0000","last_became_peered":"2023-10-09T15:30:59.672528+0000","last_unstale":"2023-10-09T15:30:59.677001+0000","last_undegraded":"2023-10-09T15:30:59.677001+0000","last_fullsized":"2023-10-09T15:30:59.677001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654038+0000","last_change":"2023-10-09T15:30:58.658373+0000","last_active":"2023-10-09T15:30:59.654038+0000","last_peered":"2023-10-09T15:30:59.654038+0000","last_clean":"2023-10-09T15:30:59.654038+0000","last_became_active":"2023-10-09T15:30:58.657565+0000","last_became_peered":"2023-10-09T15:30:58.657565+0000","last_unstale":"2023-10-09T15:30:59.654038+0000","last_undegraded":"2023-10-09T15:30:59.654038+0000","last_fullsized":"2023-10-09T15:30:59.654038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681399+0000","last_change":"2023-10-09T15:30:59.680133+0000","last_active":"2023-10-09T15:30:59.681399+0000","last_peered":"2023-10-09T15:30:59.681399+0000","last_clean":"2023-10-09T15:30:59.681399+0000","last_became_active":"2023-10-09T15:30:59.679719+0000","last_became_peered":"2023-10-09T15:30:59.679719+0000","last_unstale":"2023-10-09T15:30:59.681399+0000","last_undegraded":"2023-10-09T15:30:59.681399+0000","last_fullsized":"2023-10-09T15:30:59.681399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648962+0000","last_change":"2023-10-09T15:30:58.651661+0000","last_active":"2023-10-09T15:30:59.648962+0000","last_peered":"2023-10-09T15:30:59.648962+0000","last_clean":"2023-10-09T15:30:59.648962+0000","last_became_active":"2023-10-09T15:30:58.651305+0000","last_became_peered":"2023-10-09T15:30:58.651305+0000","last_unstale":"2023-10-09T15:30:59.648962+0000","last_undegraded":"2023-10-09T15:30:59.648962+0000","last_fullsized":"2023-10-09T15:30:59.648962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659671+0000","last_change":"2023-10-09T15:30:59.655537+0000","last_active":"2023-10-09T15:30:59.659671+0000","last_peered":"2023-10-09T15:30:59.659671+0000","last_clean":"2023-10-09T15:30:59.659671+0000","last_became_active":"2023-10-09T15:30:59.655224+0000","last_became_peered":"2023-10-09T15:30:59.655224+0000","last_unstale":"2023-10-09T15:30:59.659671+0000","last_undegraded":"2023-10-09T15:30:59.659671+0000","last_fullsized":"2023-10-09T15:30:59.659671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680601+0000","last_change":"2023-10-09T15:30:58.656284+0000","last_active":"2023-10-09T15:30:59.680601+0000","last_peered":"2023-10-09T15:30:59.680601+0000","last_clean":"2023-10-09T15:30:59.680601+0000","last_became_active":"2023-10-09T15:30:58.655961+0000","last_became_peered":"2023-10-09T15:30:58.655961+0000","last_unstale":"2023-10-09T15:30:59.680601+0000","last_undegraded":"2023-10-09T15:30:59.680601+0000","last_fullsized":"2023-10-09T15:30:59.680601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681315+0000","last_change":"2023-10-09T15:30:59.678338+0000","last_active":"2023-10-09T15:30:59.681315+0000","last_peered":"2023-10-09T15:30:59.681315+0000","last_clean":"2023-10-09T15:30:59.681315+0000","last_became_active":"2023-10-09T15:30:59.678037+0000","last_became_peered":"2023-10-09T15:30:59.678037+0000","last_unstale":"2023-10-09T15:30:59.681315+0000","last_undegraded":"2023-10-09T15:30:59.681315+0000","last_fullsized":"2023-10-09T15:30:59.681315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683056+0000","last_change":"2023-10-09T15:30:58.650299+0000","last_active":"2023-10-09T15:30:59.683056+0000","last_peered":"2023-10-09T15:30:59.683056+0000","last_clean":"2023-10-09T15:30:59.683056+0000","last_became_active":"2023-10-09T15:30:58.650000+0000","last_became_peered":"2023-10-09T15:30:58.650000+0000","last_unstale":"2023-10-09T15:30:59.683056+0000","last_undegraded":"2023-10-09T15:30:59.683056+0000","last_fullsized":"2023-10-09T15:30:59.683056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680986+0000","last_change":"2023-10-09T15:30:59.678288+0000","last_active":"2023-10-09T15:30:59.680986+0000","last_peered":"2023-10-09T15:30:59.680986+0000","last_clean":"2023-10-09T15:30:59.680986+0000","last_became_active":"2023-10-09T15:30:59.677944+0000","last_became_peered":"2023-10-09T15:30:59.677944+0000","last_unstale":"2023-10-09T15:30:59.680986+0000","last_undegraded":"2023-10-09T15:30:59.680986+0000","last_fullsized":"2023-10-09T15:30:59.680986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658167+0000","last_change":"2023-10-09T15:30:58.658451+0000","last_active":"2023-10-09T15:30:59.658167+0000","last_peered":"2023-10-09T15:30:59.658167+0000","last_clean":"2023-10-09T15:30:59.658167+0000","last_became_active":"2023-10-09T15:30:58.658175+0000","last_became_peered":"2023-10-09T15:30:58.658175+0000","last_unstale":"2023-10-09T15:30:59.658167+0000","last_undegraded":"2023-10-09T15:30:59.658167+0000","last_fullsized":"2023-10-09T15:30:59.658167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681686+0000","last_change":"2023-10-09T15:30:59.676593+0000","last_active":"2023-10-09T15:30:59.681686+0000","last_peered":"2023-10-09T15:30:59.681686+0000","last_clean":"2023-10-09T15:30:59.681686+0000","last_became_active":"2023-10-09T15:30:59.676207+0000","last_became_peered":"2023-10-09T15:30:59.676207+0000","last_unstale":"2023-10-09T15:30:59.681686+0000","last_undegraded":"2023-10-09T15:30:59.681686+0000","last_fullsized":"2023-10-09T15:30:59.681686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653922+0000","last_change":"2023-10-09T15:30:58.658074+0000","last_active":"2023-10-09T15:30:59.653922+0000","last_peered":"2023-10-09T15:30:59.653922+0000","last_clean":"2023-10-09T15:30:59.653922+0000","last_became_active":"2023-10-09T15:30:58.657593+0000","last_became_peered":"2023-10-09T15:30:58.657593+0000","last_unstale":"2023-10-09T15:30:59.653922+0000","last_undegraded":"2023-10-09T15:30:59.653922+0000","last_fullsized":"2023-10-09T15:30:59.653922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676703+0000","last_change":"2023-10-09T15:30:59.659550+0000","last_active":"2023-10-09T15:30:59.676703+0000","last_peered":"2023-10-09T15:30:59.676703+0000","last_clean":"2023-10-09T15:30:59.676703+0000","last_became_active":"2023-10-09T15:30:59.658537+0000","last_became_peered":"2023-10-09T15:30:59.658537+0000","last_unstale":"2023-10-09T15:30:59.676703+0000","last_undegraded":"2023-10-09T15:30:59.676703+0000","last_fullsized":"2023-10-09T15:30:59.676703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:26.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672420+0000","last_change":"2023-10-09T15:30:59.663481+0000","last_active":"2023-10-09T15:30:59.672420+0000","last_peered":"2023-10-09T15:30:59.672420+0000","last_clean":"2023-10-09T15:30:59.672420+0000","last_became_active":"2023-10-09T15:30:59.662876+0000","last_became_peered":"2023-10-09T15:30:59.662876+0000","last_unstale":"2023-10-09T15:30:59.672420+0000","last_undegraded":"2023-10-09T15:30:59.672420+0000","last_fullsized":"2023-10-09T15:30:59.672420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659902+0000","last_change":"2023-10-09T15:30:58.654763+0000","last_active":"2023-10-09T15:30:59.659902+0000","last_peered":"2023-10-09T15:30:59.659902+0000","last_clean":"2023-10-09T15:30:59.659902+0000","last_became_active":"2023-10-09T15:30:58.654402+0000","last_became_peered":"2023-10-09T15:30:58.654402+0000","last_unstale":"2023-10-09T15:30:59.659902+0000","last_undegraded":"2023-10-09T15:30:59.659902+0000","last_fullsized":"2023-10-09T15:30:59.659902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680417+0000","last_change":"2023-10-09T15:30:59.673338+0000","last_active":"2023-10-09T15:30:59.680417+0000","last_peered":"2023-10-09T15:30:59.680417+0000","last_clean":"2023-10-09T15:30:59.680417+0000","last_became_active":"2023-10-09T15:30:59.673073+0000","last_became_peered":"2023-10-09T15:30:59.673073+0000","last_unstale":"2023-10-09T15:30:59.680417+0000","last_undegraded":"2023-10-09T15:30:59.680417+0000","last_fullsized":"2023-10-09T15:30:59.680417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653750+0000","last_change":"2023-10-09T15:30:58.656757+0000","last_active":"2023-10-09T15:30:59.653750+0000","last_peered":"2023-10-09T15:30:59.653750+0000","last_clean":"2023-10-09T15:30:59.653750+0000","last_became_active":"2023-10-09T15:30:58.656177+0000","last_became_peered":"2023-10-09T15:30:58.656177+0000","last_unstale":"2023-10-09T15:30:59.653750+0000","last_undegraded":"2023-10-09T15:30:59.653750+0000","last_fullsized":"2023-10-09T15:30:59.653750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654959+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:59.654959+0000","last_peered":"2023-10-09T15:30:59.654959+0000","last_clean":"2023-10-09T15:30:59.654959+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:59.654959+0000","last_undegraded":"2023-10-09T15:30:59.654959+0000","last_fullsized":"2023-10-09T15:30:59.654959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665718+0000","last_change":"2023-10-09T15:30:59.660707+0000","last_active":"2023-10-09T15:30:59.665718+0000","last_peered":"2023-10-09T15:30:59.665718+0000","last_clean":"2023-10-09T15:30:59.665718+0000","last_became_active":"2023-10-09T15:30:59.660311+0000","last_became_peered":"2023-10-09T15:30:59.660311+0000","last_unstale":"2023-10-09T15:30:59.665718+0000","last_undegraded":"2023-10-09T15:30:59.665718+0000","last_fullsized":"2023-10-09T15:30:59.665718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654997+0000","last_change":"2023-10-09T15:30:58.658938+0000","last_active":"2023-10-09T15:30:59.654997+0000","last_peered":"2023-10-09T15:30:59.654997+0000","last_clean":"2023-10-09T15:30:59.654997+0000","last_became_active":"2023-10-09T15:30:58.658670+0000","last_became_peered":"2023-10-09T15:30:58.658670+0000","last_unstale":"2023-10-09T15:30:59.654997+0000","last_undegraded":"2023-10-09T15:30:59.654997+0000","last_fullsized":"2023-10-09T15:30:59.654997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657329+0000","last_change":"2023-10-09T15:30:58.659276+0000","last_active":"2023-10-09T15:30:59.657329+0000","last_peered":"2023-10-09T15:30:59.657329+0000","last_clean":"2023-10-09T15:30:59.657329+0000","last_became_active":"2023-10-09T15:30:58.659014+0000","last_became_peered":"2023-10-09T15:30:58.659014+0000","last_unstale":"2023-10-09T15:30:59.657329+0000","last_undegraded":"2023-10-09T15:30:59.657329+0000","last_fullsized":"2023-10-09T15:30:59.657329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669321+0000","last_change":"2023-10-09T15:30:59.662896+0000","last_active":"2023-10-09T15:30:59.669321+0000","last_peered":"2023-10-09T15:30:59.669321+0000","last_clean":"2023-10-09T15:30:59.669321+0000","last_became_active":"2023-10-09T15:30:59.662565+0000","last_became_peered":"2023-10-09T15:30:59.662565+0000","last_unstale":"2023-10-09T15:30:59.669321+0000","last_undegraded":"2023-10-09T15:30:59.669321+0000","last_fullsized":"2023-10-09T15:30:59.669321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T15:31:00.658977+0000","last_change":"2023-10-09T15:30:58.654960+0000","last_active":"2023-10-09T15:31:00.658977+0000","last_peered":"2023-10-09T15:31:00.658977+0000","last_clean":"2023-10-09T15:31:00.658977+0000","last_became_active":"2023-10-09T15:30:58.654642+0000","last_became_peered":"2023-10-09T15:30:58.654642+0000","last_unstale":"2023-10-09T15:31:00.658977+0000","last_undegraded":"2023-10-09T15:31:00.658977+0000","last_fullsized":"2023-10-09T15:31:00.658977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679337+0000","last_change":"2023-10-09T15:30:59.673541+0000","last_active":"2023-10-09T15:30:59.679337+0000","last_peered":"2023-10-09T15:30:59.679337+0000","last_clean":"2023-10-09T15:30:59.679337+0000","last_became_active":"2023-10-09T15:30:59.673264+0000","last_became_peered":"2023-10-09T15:30:59.673264+0000","last_unstale":"2023-10-09T15:30:59.679337+0000","last_undegraded":"2023-10-09T15:30:59.679337+0000","last_fullsized":"2023-10-09T15:30:59.679337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680182+0000","last_change":"2023-10-09T15:30:58.653278+0000","last_active":"2023-10-09T15:30:59.680182+0000","last_peered":"2023-10-09T15:30:59.680182+0000","last_clean":"2023-10-09T15:30:59.680182+0000","last_became_active":"2023-10-09T15:30:58.652915+0000","last_became_peered":"2023-10-09T15:30:58.652915+0000","last_unstale":"2023-10-09T15:30:59.680182+0000","last_undegraded":"2023-10-09T15:30:59.680182+0000","last_fullsized":"2023-10-09T15:30:59.680182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665653+0000","last_change":"2023-10-09T15:30:59.661222+0000","last_active":"2023-10-09T15:30:59.665653+0000","last_peered":"2023-10-09T15:30:59.665653+0000","last_clean":"2023-10-09T15:30:59.665653+0000","last_became_active":"2023-10-09T15:30:59.660941+0000","last_became_peered":"2023-10-09T15:30:59.660941+0000","last_unstale":"2023-10-09T15:30:59.665653+0000","last_undegraded":"2023-10-09T15:30:59.665653+0000","last_fullsized":"2023-10-09T15:30:59.665653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654786+0000","last_change":"2023-10-09T15:30:58.660025+0000","last_active":"2023-10-09T15:30:59.654786+0000","last_peered":"2023-10-09T15:30:59.654786+0000","last_clean":"2023-10-09T15:30:59.654786+0000","last_became_active":"2023-10-09T15:30:58.659194+0000","last_became_peered":"2023-10-09T15:30:58.659194+0000","last_unstale":"2023-10-09T15:30:59.654786+0000","last_undegraded":"2023-10-09T15:30:59.654786+0000","last_fullsized":"2023-10-09T15:30:59.654786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678479+0000","last_change":"2023-10-09T15:30:59.664311+0000","last_active":"2023-10-09T15:30:59.678479+0000","last_peered":"2023-10-09T15:30:59.678479+0000","last_clean":"2023-10-09T15:30:59.678479+0000","last_became_active":"2023-10-09T15:30:59.664084+0000","last_became_peered":"2023-10-09T15:30:59.664084+0000","last_unstale":"2023-10-09T15:30:59.678479+0000","last_undegraded":"2023-10-09T15:30:59.678479+0000","last_fullsized":"2023-10-09T15:30:59.678479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:34.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.655505+0000","last_change":"2023-10-09T15:30:58.658966+0000","last_active":"2023-10-09T15:30:59.655505+0000","last_peered":"2023-10-09T15:30:59.655505+0000","last_clean":"2023-10-09T15:30:59.655505+0000","last_became_active":"2023-10-09T15:30:58.658723+0000","last_became_peered":"2023-10-09T15:30:58.658723+0000","last_unstale":"2023-10-09T15:30:59.655505+0000","last_undegraded":"2023-10-09T15:30:59.655505+0000","last_fullsized":"2023-10-09T15:30:59.655505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670057+0000","last_change":"2023-10-09T15:30:59.662640+0000","last_active":"2023-10-09T15:30:59.670057+0000","last_peered":"2023-10-09T15:30:59.670057+0000","last_clean":"2023-10-09T15:30:59.670057+0000","last_became_active":"2023-10-09T15:30:59.662342+0000","last_became_peered":"2023-10-09T15:30:59.662342+0000","last_unstale":"2023-10-09T15:30:59.670057+0000","last_undegraded":"2023-10-09T15:30:59.670057+0000","last_fullsized":"2023-10-09T15:30:59.670057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.656826+0000","last_change":"2023-10-09T15:30:58.658056+0000","last_active":"2023-10-09T15:30:59.656826+0000","last_peered":"2023-10-09T15:30:59.656826+0000","last_clean":"2023-10-09T15:30:59.656826+0000","last_became_active":"2023-10-09T15:30:58.657777+0000","last_became_peered":"2023-10-09T15:30:58.657777+0000","last_unstale":"2023-10-09T15:30:59.656826+0000","last_undegraded":"2023-10-09T15:30:59.656826+0000","last_fullsized":"2023-10-09T15:30:59.656826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674709+0000","last_change":"2023-10-09T15:30:59.664936+0000","last_active":"2023-10-09T15:30:59.674709+0000","last_peered":"2023-10-09T15:30:59.674709+0000","last_clean":"2023-10-09T15:30:59.674709+0000","last_became_active":"2023-10-09T15:30:59.664631+0000","last_became_peered":"2023-10-09T15:30:59.664631+0000","last_unstale":"2023-10-09T15:30:59.674709+0000","last_undegraded":"2023-10-09T15:30:59.674709+0000","last_fullsized":"2023-10-09T15:30:59.674709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683165+0000","last_change":"2023-10-09T15:30:58.659699+0000","last_active":"2023-10-09T15:30:59.683165+0000","last_peered":"2023-10-09T15:30:59.683165+0000","last_clean":"2023-10-09T15:30:59.683165+0000","last_became_active":"2023-10-09T15:30:58.659378+0000","last_became_peered":"2023-10-09T15:30:58.659378+0000","last_unstale":"2023-10-09T15:30:59.683165+0000","last_undegraded":"2023-10-09T15:30:59.683165+0000","last_fullsized":"2023-10-09T15:30:59.683165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:49.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677259+0000","last_change":"2023-10-09T15:30:59.662826+0000","last_active":"2023-10-09T15:30:59.677259+0000","last_peered":"2023-10-09T15:30:59.677259+0000","last_clean":"2023-10-09T15:30:59.677259+0000","last_became_active":"2023-10-09T15:30:59.662503+0000","last_became_peered":"2023-10-09T15:30:59.662503+0000","last_unstale":"2023-10-09T15:30:59.677259+0000","last_undegraded":"2023-10-09T15:30:59.677259+0000","last_fullsized":"2023-10-09T15:30:59.677259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659777+0000","last_change":"2023-10-09T15:30:58.657426+0000","last_active":"2023-10-09T15:30:59.659777+0000","last_peered":"2023-10-09T15:30:59.659777+0000","last_clean":"2023-10-09T15:30:59.659777+0000","last_became_active":"2023-10-09T15:30:58.657154+0000","last_became_peered":"2023-10-09T15:30:58.657154+0000","last_unstale":"2023-10-09T15:30:59.659777+0000","last_undegraded":"2023-10-09T15:30:59.659777+0000","last_fullsized":"2023-10-09T15:30:59.659777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681135+0000","last_change":"2023-10-09T15:30:59.673642+0000","last_active":"2023-10-09T15:30:59.681135+0000","last_peered":"2023-10-09T15:30:59.681135+0000","last_clean":"2023-10-09T15:30:59.681135+0000","last_became_active":"2023-10-09T15:30:59.671999+0000","last_became_peered":"2023-10-09T15:30:59.671999+0000","last_unstale":"2023-10-09T15:30:59.681135+0000","last_undegraded":"2023-10-09T15:30:59.681135+0000","last_fullsized":"2023-10-09T15:30:59.681135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683681+0000","last_change":"2023-10-09T15:30:58.658112+0000","last_active":"2023-10-09T15:30:59.683681+0000","last_peered":"2023-10-09T15:30:59.683681+0000","last_clean":"2023-10-09T15:30:59.683681+0000","last_became_active":"2023-10-09T15:30:58.657790+0000","last_became_peered":"2023-10-09T15:30:58.657790+0000","last_unstale":"2023-10-09T15:30:59.683681+0000","last_undegraded":"2023-10-09T15:30:59.683681+0000","last_fullsized":"2023-10-09T15:30:59.683681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672943+0000","last_change":"2023-10-09T15:30:59.667024+0000","last_active":"2023-10-09T15:30:59.672943+0000","last_peered":"2023-10-09T15:30:59.672943+0000","last_clean":"2023-10-09T15:30:59.672943+0000","last_became_active":"2023-10-09T15:30:59.666511+0000","last_became_peered":"2023-10-09T15:30:59.666511+0000","last_unstale":"2023-10-09T15:30:59.672943+0000","last_undegraded":"2023-10-09T15:30:59.672943+0000","last_fullsized":"2023-10-09T15:30:59.672943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679463+0000","last_change":"2023-10-09T15:30:58.652304+0000","last_active":"2023-10-09T15:30:59.679463+0000","last_peered":"2023-10-09T15:30:59.679463+0000","last_clean":"2023-10-09T15:30:59.679463+0000","last_became_active":"2023-10-09T15:30:58.651797+0000","last_became_peered":"2023-10-09T15:30:58.651797+0000","last_unstale":"2023-10-09T15:30:59.679463+0000","last_undegraded":"2023-10-09T15:30:59.679463+0000","last_fullsized":"2023-10-09T15:30:59.679463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.688154+0000","last_change":"2023-10-09T15:30:59.681772+0000","last_active":"2023-10-09T15:30:59.688154+0000","last_peered":"2023-10-09T15:30:59.688154+0000","last_clean":"2023-10-09T15:30:59.688154+0000","last_became_active":"2023-10-09T15:30:59.681493+0000","last_became_peered":"2023-10-09T15:30:59.681493+0000","last_unstale":"2023-10-09T15:30:59.688154+0000","last_undegraded":"2023-10-09T15:30:59.688154+0000","last_fullsized":"2023-10-09T15:30:59.688154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659649+0000","last_change":"2023-10-09T15:30:59.655754+0000","last_active":"2023-10-09T15:30:59.659649+0000","last_peered":"2023-10-09T15:30:59.659649+0000","last_clean":"2023-10-09T15:30:59.659649+0000","last_became_active":"2023-10-09T15:30:59.655349+0000","last_became_peered":"2023-10-09T15:30:59.655349+0000","last_unstale":"2023-10-09T15:30:59.659649+0000","last_undegraded":"2023-10-09T15:30:59.659649+0000","last_fullsized":"2023-10-09T15:30:59.659649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676461+0000","last_change":"2023-10-09T15:30:59.671922+0000","last_active":"2023-10-09T15:30:59.676461+0000","last_peered":"2023-10-09T15:30:59.676461+0000","last_clean":"2023-10-09T15:30:59.676461+0000","last_became_active":"2023-10-09T15:30:59.671653+0000","last_became_peered":"2023-10-09T15:30:59.671653+0000","last_unstale":"2023-10-09T15:30:59.676461+0000","last_undegraded":"2023-10-09T15:30:59.676461+0000","last_fullsized":"2023-10-09T15:30:59.676461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675676+0000","last_change":"2023-10-09T15:30:59.667346+0000","last_active":"2023-10-09T15:30:59.675676+0000","last_peered":"2023-10-09T15:30:59.675676+0000","last_clean":"2023-10-09T15:30:59.675676+0000","last_became_active":"2023-10-09T15:30:59.666133+0000","last_became_peered":"2023-10-09T15:30:59.666133+0000","last_unstale":"2023-10-09T15:30:59.675676+0000","last_undegraded":"2023-10-09T15:30:59.675676+0000","last_fullsized":"2023-10-09T15:30:59.675676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665591+0000","last_change":"2023-10-09T15:30:59.659235+0000","last_active":"2023-10-09T15:30:59.665591+0000","last_peered":"2023-10-09T15:30:59.665591+0000","last_clean":"2023-10-09T15:30:59.665591+0000","last_became_active":"2023-10-09T15:30:59.658828+0000","last_became_peered":"2023-10-09T15:30:59.658828+0000","last_unstale":"2023-10-09T15:30:59.665591+0000","last_undegraded":"2023-10-09T15:30:59.665591+0000","last_fullsized":"2023-10-09T15:30:59.665591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683058+0000","last_change":"2023-10-09T15:30:59.675159+0000","last_active":"2023-10-09T15:30:59.683058+0000","last_peered":"2023-10-09T15:30:59.683058+0000","last_clean":"2023-10-09T15:30:59.683058+0000","last_became_active":"2023-10-09T15:30:59.674897+0000","last_became_peered":"2023-10-09T15:30:59.674897+0000","last_unstale":"2023-10-09T15:30:59.683058+0000","last_undegraded":"2023-10-09T15:30:59.683058+0000","last_fullsized":"2023-10-09T15:30:59.683058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668705+0000","last_change":"2023-10-09T15:30:59.662912+0000","last_active":"2023-10-09T15:30:59.668705+0000","last_peered":"2023-10-09T15:30:59.668705+0000","last_clean":"2023-10-09T15:30:59.668705+0000","last_became_active":"2023-10-09T15:30:59.662380+0000","last_became_peered":"2023-10-09T15:30:59.662380+0000","last_unstale":"2023-10-09T15:30:59.668705+0000","last_undegraded":"2023-10-09T15:30:59.668705+0000","last_fullsized":"2023-10-09T15:30:59.668705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677401+0000","last_change":"2023-10-09T15:30:59.673219+0000","last_active":"2023-10-09T15:30:59.677401+0000","last_peered":"2023-10-09T15:30:59.677401+0000","last_clean":"2023-10-09T15:30:59.677401+0000","last_became_active":"2023-10-09T15:30:59.672928+0000","last_became_peered":"2023-10-09T15:30:59.672928+0000","last_unstale":"2023-10-09T15:30:59.677401+0000","last_undegraded":"2023-10-09T15:30:59.677401+0000","last_fullsized":"2023-10-09T15:30:59.677401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683108+0000","last_change":"2023-10-09T15:30:59.678780+0000","last_active":"2023-10-09T15:30:59.683108+0000","last_peered":"2023-10-09T15:30:59.683108+0000","last_clean":"2023-10-09T15:30:59.683108+0000","last_became_active":"2023-10-09T15:30:59.678502+0000","last_became_peered":"2023-10-09T15:30:59.678502+0000","last_unstale":"2023-10-09T15:30:59.683108+0000","last_undegraded":"2023-10-09T15:30:59.683108+0000","last_fullsized":"2023-10-09T15:30:59.683108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675559+0000","last_change":"2023-10-09T15:30:59.668814+0000","last_active":"2023-10-09T15:30:59.675559+0000","last_peered":"2023-10-09T15:30:59.675559+0000","last_clean":"2023-10-09T15:30:59.675559+0000","last_became_active":"2023-10-09T15:30:59.668501+0000","last_became_peered":"2023-10-09T15:30:59.668501+0000","last_unstale":"2023-10-09T15:30:59.675559+0000","last_undegraded":"2023-10-09T15:30:59.675559+0000","last_fullsized":"2023-10-09T15:30:59.675559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683026+0000","last_change":"2023-10-09T15:30:59.674502+0000","last_active":"2023-10-09T15:30:59.683026+0000","last_peered":"2023-10-09T15:30:59.683026+0000","last_clean":"2023-10-09T15:30:59.683026+0000","last_became_active":"2023-10-09T15:30:59.674165+0000","last_became_peered":"2023-10-09T15:30:59.674165+0000","last_unstale":"2023-10-09T15:30:59.683026+0000","last_undegraded":"2023-10-09T15:30:59.683026+0000","last_fullsized":"2023-10-09T15:30:59.683026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680953+0000","last_change":"2023-10-09T15:30:59.675013+0000","last_active":"2023-10-09T15:30:59.680953+0000","last_peered":"2023-10-09T15:30:59.680953+0000","last_clean":"2023-10-09T15:30:59.680953+0000","last_became_active":"2023-10-09T15:30:59.674731+0000","last_became_peered":"2023-10-09T15:30:59.674731+0000","last_unstale":"2023-10-09T15:30:59.680953+0000","last_undegraded":"2023-10-09T15:30:59.680953+0000","last_fullsized":"2023-10-09T15:30:59.680953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677154+0000","last_change":"2023-10-09T15:30:59.674112+0000","last_active":"2023-10-09T15:30:59.677154+0000","last_peered":"2023-10-09T15:30:59.677154+0000","last_clean":"2023-10-09T15:30:59.677154+0000","last_became_active":"2023-10-09T15:30:59.673855+0000","last_became_peered":"2023-10-09T15:30:59.673855+0000","last_unstale":"2023-10-09T15:30:59.677154+0000","last_undegraded":"2023-10-09T15:30:59.677154+0000","last_fullsized":"2023-10-09T15:30:59.677154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.661031+0000","last_change":"2023-10-09T15:30:59.656928+0000","last_active":"2023-10-09T15:30:59.661031+0000","last_peered":"2023-10-09T15:30:59.661031+0000","last_clean":"2023-10-09T15:30:59.661031+0000","last_became_active":"2023-10-09T15:30:59.656505+0000","last_became_peered":"2023-10-09T15:30:59.656505+0000","last_unstale":"2023-10-09T15:30:59.661031+0000","last_undegraded":"2023-10-09T15:30:59.661031+0000","last_fullsized":"2023-10-09T15:30:59.661031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38200000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29399999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63800000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.745}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68999999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.495}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.755}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68500000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30499999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.77200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.83299999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73999999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65100000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56699999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54300000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:08.696 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:31:08.697 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-10-09T15:31:08.697 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-10-09T15:31:08.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-10-09T15:31:08.697 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-10-09T15:31:08.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.850+0000 7ff215873700 1 Processor -- start 2023-10-09T15:31:08.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.850+0000 7ff215873700 1 -- start start 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff215873700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff2101594d0 0x7ff2100cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff215873700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff2100cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff215873700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff21015e010 con 0x7ff2101598a0 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff215873700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff21015d420 con 0x7ff2101594d0 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff215873700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff21015d6e0 con 0x7ff2100cb1a0 2023-10-09T15:31:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff2101594d0 0x7ff2100cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff2101598a0 0x7ff2100ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47956/0 (socket says 172.21.15.33:47956) 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20f7fe700 1 -- 172.21.15.33:0/497349568 learned_addr learned my addr 172.21.15.33:0/497349568 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20e7fc700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff2100cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 -- 172.21.15.33:0/497349568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 msgr2=0x7ff2100cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff2100cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 -- 172.21.15.33:0/497349568 >> v1:172.21.15.33:6789/0 conn(0x7ff2101598a0 legacy=0x7ff2100ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 -- 172.21.15.33:0/497349568 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff21015d9c0 con 0x7ff2101594d0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20dffb700 1 -- 172.21.15.33:0/497349568 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3239341672 0 0) 0x7ff21015e010 con 0x7ff2101598a0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.851+0000 7ff20effd700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101594d0 0x7ff2100cea70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff200009e60 tx=0x7ff200009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=649c23b37b68dbd5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff20dffb700 1 -- 172.21.15.33:0/497349568 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff20000e070 con 0x7ff2101594d0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff20dffb700 1 -- 172.21.15.33:0/497349568 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff20000bb60 con 0x7ff2101594d0 2023-10-09T15:31:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff20dffb700 1 -- 172.21.15.33:0/497349568 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff200012430 con 0x7ff2101594d0 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 -- 172.21.15.33:0/497349568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101594d0 msgr2=0x7ff2100cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101594d0 0x7ff2100cea70 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff200009e60 tx=0x7ff200009780 comp rx=0 tx=0).stop 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 -- 172.21.15.33:0/497349568 shutdown_connections 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101594d0 0x7ff2100cea70 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 --2- 172.21.15.33:0/497349568 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff2100cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 -- 172.21.15.33:0/497349568 >> 172.21.15.33:0/497349568 conn(0x7ff2100703a0 msgr2=0x7ff210070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 -- 172.21.15.33:0/497349568 shutdown_connections 2023-10-09T15:31:08.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.852+0000 7ff215873700 1 -- 172.21.15.33:0/497349568 wait complete. 2023-10-09T15:31:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.853+0000 7ff215873700 1 Processor -- start 2023-10-09T15:31:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.853+0000 7ff215873700 1 -- start start 2023-10-09T15:31:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff210150a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2101594d0 0x7ff21015b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c8ee0 con 0x7ff2101598a0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff210150f40 con 0x7ff2101594d0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff215873700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2100c8010 con 0x7ff2100cb1a0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff20f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff20f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42362/0 (socket says 172.21.15.33:42362) 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff20f7fe700 1 -- 172.21.15.33:0/3756660588 learned_addr learned my addr 172.21.15.33:0/3756660588 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff20e7fc700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2101594d0 0x7ff21015b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.854+0000 7ff20effd700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff210150a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 -- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 msgr2=0x7ff210150a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff210150a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 -- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2101594d0 msgr2=0x7ff21015b8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2101594d0 0x7ff21015b8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 -- 172.21.15.33:0/3756660588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff200009a20 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20effd700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff210150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff20f7fe700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c530 tx=0x7ff208007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208005b30 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff208005c90 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2100c82d0 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff208007320 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.855+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2100c8890 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.856+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff21004c3c0 con 0x7ff2101598a0 2023-10-09T15:31:08.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.856+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff20801b3b0 con 0x7ff2101598a0 2023-10-09T15:31:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.857+0000 7ff206ffd700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.857+0000 7ff20effd700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.857+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff2080839a0 con 0x7ff2101598a0 2023-10-09T15:31:08.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.857+0000 7ff20effd700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2000097c0 tx=0x7ff200019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:08.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:08.861+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff208050c10 con 0x7ff2101598a0 2023-10-09T15:31:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.112+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7ff2100c9020 con 0x7ff2101598a0 2023-10-09T15:31:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.115+0000 7ff206ffd700 1 -- 172.21.15.33:0/3756660588 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+163698 (secure 0 0 0) 0x7ff2100c9020 con 0x7ff2101598a0 2023-10-09T15:31:09.118 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 msgr2=0x7ff1f00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 0x7ff1f00693e0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7ff2000097c0 tx=0x7ff200019000 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 msgr2=0x7ff21015bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7ff20800c530 tx=0x7ff208007f90 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 shutdown_connections 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff1f0066f30 0x7ff1f00693e0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff2101598a0 0x7ff21015bde0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff2100cb1a0 0x7ff210150a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 --2- 172.21.15.33:0/3756660588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff2101594d0 0x7ff21015b8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 >> 172.21.15.33:0/3756660588 conn(0x7ff2100703a0 msgr2=0x7ff2101527d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 shutdown_connections 2023-10-09T15:31:09.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.118+0000 7ff215873700 1 -- 172.21.15.33:0/3756660588 wait complete. 2023-10-09T15:31:09.131 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":5,"active_gid":4102,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6832","nonce":90672},{"type":"v1","addr":"172.21.15.33:6833","nonce":90672}]},"active_addr":"172.21.15.33:6833/90672","active_change":"2023-10-09T15:30:47.227987+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":4106,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.1.5","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":714960672}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1759915585}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":1131922425}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.33:0","nonce":3504273632}]}]} 2023-10-09T15:31:09.135 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-10-09T15:31:09.135 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-10-09T15:31:09.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:09.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.254+0000 7fe6024ee700 1 Processor -- start 2023-10-09T15:31:09.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.254+0000 7fe6024ee700 1 -- start start 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe6024ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5fc15de50 0x7fe5fc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe6024ee700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc0cf3c0 con 0x7fe5fc0cef40 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe6024ee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5fc15afd0 con 0x7fe5fc153c30 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe6024ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5fc15b2b0 con 0x7fe5fc15de50 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe601ced700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe5fc0cef40 0x7fe5fc15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47970/0 (socket says 172.21.15.33:47970) 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe601ced700 1 -- 172.21.15.33:0/189787064 learned_addr learned my addr 172.21.15.33:0/189787064 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe600ceb700 1 --2- 172.21.15.33:0/189787064 >> v2:172.21.15.59:3300/0 conn(0x7fe5fc15de50 0x7fe5fc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149608013 0 0) 0x7fe5fc0cf3c0 con 0x7fe5fc0cef40 2023-10-09T15:31:09.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe5e4003570 con 0x7fe5fc0cef40 2023-10-09T15:31:09.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 55072086 0 0) 0x7fe5e4003570 con 0x7fe5fc0cef40 2023-10-09T15:31:09.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 >> v2:172.21.15.59:3300/0 conn(0x7fe5fc15de50 msgr2=0x7fe5fc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:09.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 --2- 172.21.15.33:0/189787064 >> v2:172.21.15.59:3300/0 conn(0x7fe5fc15de50 0x7fe5fc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.255+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 >> v1:172.21.15.59:6789/0 conn(0x7fe5fc153c30 legacy=0x7fe5fc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc15b590 con 0x7fe5fc0cef40 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fe5f4001470 con 0x7fe5fc0cef40 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 >> v1:172.21.15.33:6789/0 conn(0x7fe5fc0cef40 legacy=0x7fe5fc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc15b2b0 con 0x7fe5e4003a60 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e400c0d0 con 0x7fe5e4004810 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5e400c290 con 0x7fe5e40051c0 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe600ceb700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe601ced700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 -- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5e40051c0 msgr2=0x7fe5e400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5e40051c0 0x7fe5e400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 -- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4004810 msgr2=0x7fe5e4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4004810 0x7fe5e4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 -- 172.21.15.33:0/189787064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e4003570 con 0x7fe5e4003a60 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe601ced700 1 -- 172.21.15.33:0/189787064 reap_dead start 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe6014ec700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001fc0 tx=0x7fe5ec001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b84a56a94fd893b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec001950 con 0x7fe5e4003a60 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5ec00c8b0 con 0x7fe5e4003a60 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.256+0000 7fe5fbfff700 1 -- 172.21.15.33:0/189787064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec00cc50 con 0x7fe5e4003a60 2023-10-09T15:31:09.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 -- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 msgr2=0x7fe5e4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001fc0 tx=0x7fe5ec001640 comp rx=0 tx=0).stop 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 -- 172.21.15.33:0/189787064 shutdown_connections 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 --2- 172.21.15.33:0/189787064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5e4003a60 0x7fe5e4003e70 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 -- 172.21.15.33:0/189787064 >> 172.21.15.33:0/189787064 conn(0x7fe5fc0703a0 msgr2=0x7fe5fc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 -- 172.21.15.33:0/189787064 shutdown_connections 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.257+0000 7fe6024ee700 1 -- 172.21.15.33:0/189787064 wait complete. 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.258+0000 7fe6024ee700 1 Processor -- start 2023-10-09T15:31:09.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.258+0000 7fe6024ee700 1 -- start start 2023-10-09T15:31:09.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4003a60 0x7fe5fc14dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 0x7fe5fc0b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc16a570 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0b2250 con 0x7fe5e4003a60 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6024ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5fc0c8630 con 0x7fe5fc0b18a0 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42386/0 (socket says 172.21.15.33:42386) 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 -- 172.21.15.33:0/1807583154 learned_addr learned my addr 172.21.15.33:0/1807583154 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe6014ec700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4003a60 0x7fe5fc14dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe600ceb700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 0x7fe5fc0b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 -- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 msgr2=0x7fe5fc0b1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 0x7fe5fc0b1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 -- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4003a60 msgr2=0x7fe5fc14dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4003a60 0x7fe5fc14dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe601ced700 1 -- 172.21.15.33:0/1807583154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0c88d0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.259+0000 7fe600ceb700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 0x7fe5fc0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe601ced700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc15e220 tx=0x7fe5f40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4012590 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f40126f0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc0c8bb0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f4012ab0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.260+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5fc16b540 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.261+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5fc0c90d0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.261+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe5f401d460 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.261+0000 7fe5f97fa700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.262+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5f40842c0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.262+0000 7fe6014ec700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.262+0000 7fe6014ec700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 0x7fe5e80693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001da0 tx=0x7fe5ec015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.266+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5fc0c90d0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.464+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe5fc0c90d0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.465+0000 7fe5f97fa700 1 -- 172.21.15.33:0/1807583154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fe5fc0c90d0 con 0x7fe5fc0c7c50 2023-10-09T15:31:09.466 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:09.466 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 msgr2=0x7fe5e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 0x7fe5e80693e0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec001da0 tx=0x7fe5ec015000 comp rx=0 tx=0).stop 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 msgr2=0x7fe5fc0c80f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fe5fc15e220 tx=0x7fe5f40014a0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 shutdown_connections 2023-10-09T15:31:09.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e8066f30 0x7fe5e80693e0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5fc0c7c50 0x7fe5fc0c80f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5e4003a60 0x7fe5fc14dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 --2- 172.21.15.33:0/1807583154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5fc0b18a0 0x7fe5fc0b1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 >> 172.21.15.33:0/1807583154 conn(0x7fe5fc0703a0 msgr2=0x7fe5fc159310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 shutdown_connections 2023-10-09T15:31:09.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.467+0000 7fe6024ee700 1 -- 172.21.15.33:0/1807583154 wait complete. 2023-10-09T15:31:09.480 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-10-09T15:31:09.480 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:09.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.599+0000 7f8498ff5700 1 Processor -- start 2023-10-09T15:31:09.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.599+0000 7f8498ff5700 1 -- start start 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8498ff5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84940cb970 0x7f8494159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8498ff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849415a400 0x7f8494156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8498ff5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f849415ae40 con 0x7f84940cb5a0 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8498ff5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940ce0f0 con 0x7f84940cb970 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8498ff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940d13f0 con 0x7f849415a400 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84940cb970 0x7f8494159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f84940cb5a0 0x7f84940cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47974/0 (socket says 172.21.15.33:47974) 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849259c700 1 -- 172.21.15.33:0/2144203629 learned_addr learned my addr 172.21.15.33:0/2144203629 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8492d9d700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849415a400 0x7f8494156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 -- 172.21.15.33:0/2144203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849415a400 msgr2=0x7f8494156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849415a400 0x7f8494156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 -- 172.21.15.33:0/2144203629 >> v1:172.21.15.33:6789/0 conn(0x7f84940cb5a0 legacy=0x7f84940cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 -- 172.21.15.33:0/2144203629 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f849415ab60 con 0x7f84940cb970 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849159a700 1 -- 172.21.15.33:0/2144203629 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3096929428 0 0) 0x7f849415ae40 con 0x7f84940cb5a0 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f8491d9b700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb970 0x7f8494159ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f84880098e0 tx=0x7f84880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322061e98f7780b6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849159a700 1 -- 172.21.15.33:0/2144203629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488009e80 con 0x7f84940cb970 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849159a700 1 -- 172.21.15.33:0/2144203629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848800b860 con 0x7f84940cb970 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.600+0000 7f849159a700 1 -- 172.21.15.33:0/2144203629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848800bbe0 con 0x7f84940cb970 2023-10-09T15:31:09.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 -- 172.21.15.33:0/2144203629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb970 msgr2=0x7f8494159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb970 0x7f8494159ec0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f84880098e0 tx=0x7f84880091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 -- 172.21.15.33:0/2144203629 shutdown_connections 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f849415a400 0x7f8494156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 --2- 172.21.15.33:0/2144203629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb970 0x7f8494159ec0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 -- 172.21.15.33:0/2144203629 >> 172.21.15.33:0/2144203629 conn(0x7f8494070e30 msgr2=0x7f84940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 -- 172.21.15.33:0/2144203629 shutdown_connections 2023-10-09T15:31:09.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.601+0000 7f8498ff5700 1 -- 172.21.15.33:0/2144203629 wait complete. 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.602+0000 7f8498ff5700 1 Processor -- start 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.602+0000 7f8498ff5700 1 -- start start 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940cb970 0x7f849416cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849415a400 0x7f849415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849416d480 con 0x7f84940cb5a0 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b34b0 con 0x7f849415a400 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8498ff5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84940b3790 con 0x7f84940cb970 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42400/0 (socket says 172.21.15.33:42400) 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 -- 172.21.15.33:0/886344869 learned_addr learned my addr 172.21.15.33:0/886344869 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8491d9b700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940cb970 0x7f849416cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f8492d9d700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849415a400 0x7f849415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 -- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940cb970 msgr2=0x7f849416cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940cb970 0x7f849416cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 -- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849415a400 msgr2=0x7f849415dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849415a400 0x7f849415dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 -- 172.21.15.33:0/886344869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009420 con 0x7f84940cb5a0 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f849259c700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f848400c810 tx=0x7f8484007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.603+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484005b30 con 0x7f84940cb5a0 2023-10-09T15:31:09.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.604+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484005c90 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.604+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849416d670 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.604+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484007300 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.604+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f849416dc30 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.605+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f849404c3c0 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.605+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f848401b400 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.605+0000 7f84827fc700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.606+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84840840b0 con 0x7f84940cb5a0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.606+0000 7f8491d9b700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:09.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.606+0000 7f8491d9b700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 0x7f84740693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84880091e0 tx=0x7f8488017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:09.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.610+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84840513a0 con 0x7f84940cb5a0 2023-10-09T15:31:09.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.803+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f84940afa70 con 0x7f84940cb5a0 2023-10-09T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.804+0000 7f84827fc700 1 -- 172.21.15.33:0/886344869 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f84840549c0 con 0x7f84940cb5a0 2023-10-09T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:09.805 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 msgr2=0x7f84740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 0x7f84740693e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f84880091e0 tx=0x7f8488017000 comp rx=0 tx=0).stop 2023-10-09T15:31:09.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 msgr2=0x7f84940ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f848400c810 tx=0x7f8484007df0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 shutdown_connections 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8474066f30 0x7f84740693e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940cb5a0 0x7f84940ca370 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f849415a400 0x7f849415dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 --2- 172.21.15.33:0/886344869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940cb970 0x7f849416cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 >> 172.21.15.33:0/886344869 conn(0x7f8494070e30 msgr2=0x7f84940b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 shutdown_connections 2023-10-09T15:31:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:09.806+0000 7f8498ff5700 1 -- 172.21.15.33:0/886344869 wait complete. 2023-10-09T15:31:09.819 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-10-09T15:31:09.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-10-09T15:31:09.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-10-09T15:31:09.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-10-09T15:31:09.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-10-09T15:31:09.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-10-09T15:31:09.822 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-10-09T15:31:09.822 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-10-09T15:31:10.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.025+0000 7fcf2cbde700 1 Processor -- start 2023-10-09T15:31:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.026+0000 7fcf2cbde700 1 -- start start 2023-10-09T15:31:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7fcf2cbde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf281393f0 0x7fcf280cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7fcf2cbde700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf280cbb20 0x7fcf280c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7fcf2cbde700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf280c3380 con 0x7fcf28138bc0 2023-10-09T15:31:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7fcf2cbde700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf280cbfc0 con 0x7fcf280cbb20 2023-10-09T15:31:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7fcf2cbde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2806e010 con 0x7fcf281393f0 2023-10-09T15:31:10.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.027+0000 7f404dbab700 1 Processor -- start 2023-10-09T15:31:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7f404dbab700 1 -- start start 2023-10-09T15:31:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f404dbab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 0x7f4048160650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f404dbab700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4048156ad0 con 0x7f4048155670 2023-10-09T15:31:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f404dbab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f404806f6e0 con 0x7f4048155a40 2023-10-09T15:31:10.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f404dbab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4048155ec0 con 0x7f404806bd40 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf2659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf28138bc0 0x7fcf2806d570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42656/0 (socket says 172.21.15.33:42656) 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf2659c700 1 -- 172.21.15.33:0/4076627399 learned_addr learned my addr 172.21.15.33:0/4076627399 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 --2- 172.21.15.33:0/4076627399 >> v2:172.21.15.59:3300/0 conn(0x7fcf280cbb20 0x7fcf280c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf2559a700 1 -- 172.21.15.33:0/4076627399 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3289308817 0 0) 0x7fcf280c3380 con 0x7fcf28138bc0 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf2559a700 1 -- 172.21.15.33:0/4076627399 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf10007980 con 0x7fcf28138bc0 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 -- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf281393f0 msgr2=0x7fcf280cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 --2- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf281393f0 0x7fcf280cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 -- 172.21.15.33:0/4076627399 >> v1:172.21.15.59:6789/0 conn(0x7fcf28138bc0 legacy=0x7fcf2806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 -- 172.21.15.33:0/4076627399 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf280c2a50 con 0x7fcf280cbb20 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.028+0000 7fcf26d9d700 1 --2- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf280cbb20 0x7fcf280c3810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b990 tx=0x7fcf1c00a0f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c9f2c06198c2785 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7fcf2559a700 1 -- 172.21.15.33:0/4076627399 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00be80 con 0x7fcf280cbb20 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7fcf2559a700 1 -- 172.21.15.33:0/4076627399 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1c015d60 con 0x7fcf280cbb20 2023-10-09T15:31:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7fcf2559a700 1 -- 172.21.15.33:0/4076627399 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1c00ca50 con 0x7fcf280cbb20 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f404d3aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 0x7f4048160650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f403ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4048155a40 0x7f404806b630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42670/0 (socket says 172.21.15.33:42670) 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.029+0000 7f403ffff700 1 -- 172.21.15.33:0/3618692261 learned_addr learned my addr 172.21.15.33:0/3618692261 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f404d3aa700 1 -- 172.21.15.33:0/3618692261 >> v1:172.21.15.59:6789/0 conn(0x7f4048155a40 legacy=0x7f404806b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f404d3aa700 1 -- 172.21.15.33:0/3618692261 >> v1:172.21.15.33:6789/0 conn(0x7f4048155670 legacy=0x7f40480c7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f404d3aa700 1 -- 172.21.15.33:0/3618692261 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40481561a0 con 0x7f404806bd40 2023-10-09T15:31:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f404d3aa700 1 --2- 172.21.15.33:0/3618692261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 0x7f4048160650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f404000d080 tx=0x7f404000b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc1fc8e1a4fe857d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 -- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf280cbb20 msgr2=0x7fcf280c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf280cbb20 0x7fcf280c3810 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00b990 tx=0x7fcf1c00a0f0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 -- 172.21.15.33:0/4076627399 shutdown_connections 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf280cbb20 0x7fcf280c3810 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/4076627399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf281393f0 0x7fcf280cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 -- 172.21.15.33:0/4076627399 >> 172.21.15.33:0/4076627399 conn(0x7fcf280ccb60 msgr2=0x7fcf280ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f403f7fe700 1 -- 172.21.15.33:0/3618692261 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4040010070 con 0x7f404806bd40 2023-10-09T15:31:10.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f403f7fe700 1 -- 172.21.15.33:0/3618692261 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f404000b2e0 con 0x7f404806bd40 2023-10-09T15:31:10.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7f403f7fe700 1 -- 172.21.15.33:0/3618692261 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f404000dd60 con 0x7f404806bd40 2023-10-09T15:31:10.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.030+0000 7fcf2cbde700 1 -- 172.21.15.33:0/4076627399 shutdown_connections 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 -- 172.21.15.33:0/3618692261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 msgr2=0x7f4048160650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 --2- 172.21.15.33:0/3618692261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 0x7f4048160650 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f404000d080 tx=0x7f404000b990 comp rx=0 tx=0).stop 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 -- 172.21.15.33:0/3618692261 shutdown_connections 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 --2- 172.21.15.33:0/3618692261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f404806bd40 0x7f4048160650 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 -- 172.21.15.33:0/3618692261 >> 172.21.15.33:0/3618692261 conn(0x7f404806d130 msgr2=0x7f40480cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 -- 172.21.15.33:0/3618692261 shutdown_connections 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f404dbab700 1 -- 172.21.15.33:0/3618692261 wait complete. 2023-10-09T15:31:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f21be676700 1 Processor -- start 2023-10-09T15:31:10.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7fcf2cbde700 1 -- 172.21.15.33:0/4076627399 wait complete. 2023-10-09T15:31:10.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.032+0000 7f946c8c5700 1 Processor -- start 2023-10-09T15:31:10.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.032+0000 7f46e6f6e700 1 Processor -- start 2023-10-09T15:31:10.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.032+0000 7f46e6f6e700 1 -- start start 2023-10-09T15:31:10.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f404dbab700 1 Processor -- start 2023-10-09T15:31:10.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7fcf2cbde700 1 Processor -- start 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.031+0000 7f21be676700 1 -- start start 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21be676700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21b81508c0 0x7f21b8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21be676700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8158c80 con 0x7f21b815a7d0 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21be676700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21b8158f60 con 0x7f21b8150c90 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21be676700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21b815afc0 con 0x7f21b81508c0 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21b81508c0 0x7f21b8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21b81508c0 0x7f21b8158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42402/0 (socket says 172.21.15.33:42402) 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 -- 172.21.15.33:0/151873675 learned_addr learned my addr 172.21.15.33:0/151873675 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 -- 172.21.15.33:0/151873675 >> v1:172.21.15.59:6789/0 conn(0x7f21b8150c90 legacy=0x7f21b815a0c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T15:31:10.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 -- 172.21.15.33:0/151873675 >> v1:172.21.15.33:6789/0 conn(0x7f21b815a7d0 legacy=0x7f21b8154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f21b7fff700 1 -- 172.21.15.33:0/151873675 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b8159240 con 0x7f21b81508c0 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f21b7fff700 1 --2- 172.21.15.33:0/151873675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b8158650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d1a0 tx=0x7f21b000ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40339b9577898085 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f21b6ffd700 1 -- 172.21.15.33:0/151873675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b0010070 con 0x7f21b81508c0 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f21b6ffd700 1 -- 172.21.15.33:0/151873675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b000de80 con 0x7f21b81508c0 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f21b6ffd700 1 -- 172.21.15.33:0/151873675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21b000b320 con 0x7f21b81508c0 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f46e6f6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 0x7f46e0158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f46e6f6e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f46e015a7d0 0x7f46e00af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f46e6f6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e0158c80 con 0x7f46e0150c90 2023-10-09T15:31:10.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f46e6f6e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e015afc0 con 0x7f46e015a7d0 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f46e6f6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00af820 con 0x7f46e01508c0 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e4d0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 0x7f46e0158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e4d0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 0x7f46e0158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49870/0 (socket says 172.21.15.33:49870) 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e4d0a700 1 -- 172.21.15.33:0/1965894482 learned_addr learned my addr 172.21.15.33:0/1965894482 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 --2- 172.21.15.33:0/1965894482 >> v2:172.21.15.33:3300/0 conn(0x7f46e015a7d0 0x7f46e00af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 -- 172.21.15.33:0/1965894482 >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 msgr2=0x7f46e0158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 --2- 172.21.15.33:0/1965894482 >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 0x7f46e0158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 -- 172.21.15.33:0/1965894482 >> v1:172.21.15.59:6789/0 conn(0x7f46e0150c90 legacy=0x7f46e015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 -- 172.21.15.33:0/1965894482 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e0155710 con 0x7f46e015a7d0 2023-10-09T15:31:10.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f46e550b700 1 --2- 172.21.15.33:0/1965894482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e015a7d0 0x7f46e00af2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46e00aed00 tx=0x7f46d000d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca810d2e9328db1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f404dbab700 1 -- start start 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 0x7f4048154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4048155670 0x7f40481531d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4048153710 0x7f4048165750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480c41b0 con 0x7f4048153710 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40480c4490 con 0x7f404806bd40 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7f404dbab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40480c4770 con 0x7f4048155670 2023-10-09T15:31:10.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7f946c8c5700 1 -- start start 2023-10-09T15:31:10.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 0x7f4048154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.033+0000 7fcf2cbde700 1 -- start start 2023-10-09T15:31:10.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 0x7f4048154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49884/0 (socket says 172.21.15.33:49884) 2023-10-09T15:31:10.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 -- 172.21.15.33:0/1091654034 learned_addr learned my addr 172.21.15.33:0/1091654034 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf280cbb20 0x7fcf28133ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 0x7fcf280c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf28158cf0 0x7fcf28132c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c69c0 con 0x7fcf28138bc0 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c7800 con 0x7fcf28158cf0 2023-10-09T15:31:10.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fcf2cbde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf280c6bf0 con 0x7fcf280cbb20 2023-10-09T15:31:10.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f46df7fe700 1 -- 172.21.15.33:0/1965894482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d000d280 con 0x7f46e015a7d0 2023-10-09T15:31:10.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 0x7fcf280c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f46df7fe700 1 -- 172.21.15.33:0/1965894482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d00188d0 con 0x7f46e015a7d0 2023-10-09T15:31:10.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f46df7fe700 1 -- 172.21.15.33:0/1965894482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d0018c70 con 0x7f46e015a7d0 2023-10-09T15:31:10.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404d3aa700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4048153710 0x7f4048165750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 0x7fcf280c6480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42444/0 (socket says 172.21.15.33:42444) 2023-10-09T15:31:10.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 -- 172.21.15.33:0/527535166 learned_addr learned my addr 172.21.15.33:0/527535166 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946c8c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f946815da70 0x7f946815de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946c8c5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f94680cbf90 0x7f94680c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946c8c5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f946815e380 con 0x7f94680c3300 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946c8c5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946806c6a0 con 0x7f94680cbf90 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946c8c5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f946806cc20 con 0x7f946815da70 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 -- 172.21.15.33:0/527535166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf280cbb20 msgr2=0x7fcf28133ee0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf280cbb20 0x7fcf28133ee0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 -- 172.21.15.33:0/527535166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf28158cf0 msgr2=0x7fcf28132c10 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:10.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf28158cf0 0x7fcf28132c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 -- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4048155670 msgr2=0x7f40481531d0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:10.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fcf25d9b700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf1c00b4d0 con 0x7fcf28138bc0 2023-10-09T15:31:10.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4048155670 0x7f40481531d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 -- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4048153710 msgr2=0x7f4048165750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4048153710 0x7f4048165750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f404000bc30 con 0x7f404806bd40 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f404cba9700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 0x7f4048154670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f404400c5b0 tx=0x7f4044007f00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f946815da70 0x7f946815de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f946815da70 0x7f946815de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49906/0 (socket says 172.21.15.33:49906) 2023-10-09T15:31:10.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f946659c700 1 -- 172.21.15.33:0/2563953717 learned_addr learned my addr 172.21.15.33:0/2563953717 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7f9465d9b700 1 --2- 172.21.15.33:0/2563953717 >> v2:172.21.15.33:3300/0 conn(0x7f94680cbf90 0x7f94680c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fcf25d9b700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 0x7fcf280c6480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b580 tx=0x7fcf180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f946659c700 1 -- 172.21.15.33:0/2563953717 >> v2:172.21.15.33:3300/0 conn(0x7f94680cbf90 msgr2=0x7f94680c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f946659c700 1 --2- 172.21.15.33:0/2563953717 >> v2:172.21.15.33:3300/0 conn(0x7f94680cbf90 0x7f94680c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f946659c700 1 -- 172.21.15.33:0/2563953717 >> v1:172.21.15.33:6789/0 conn(0x7f94680c3300 legacy=0x7f946806d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f946659c700 1 -- 172.21.15.33:0/2563953717 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94680cc4d0 con 0x7f946815da70 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800f510 con 0x7fcf28138bc0 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1800f670 con 0x7fcf28138bc0 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf1800fa30 con 0x7fcf28138bc0 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 -- 172.21.15.33:0/1965894482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e015a7d0 msgr2=0x7f46e00af2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/1965894482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e015a7d0 0x7f46e00af2e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f46e00aed00 tx=0x7f46d000d630 comp rx=0 tx=0).stop 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 -- 172.21.15.33:0/1965894482 shutdown_connections 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/1965894482 >> v2:172.21.15.59:3300/0 conn(0x7f46e01508c0 0x7f46e0158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/1965894482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e015a7d0 0x7f46e00af2e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f46e6f6e700 1 -- 172.21.15.33:0/1965894482 >> 172.21.15.33:0/1965894482 conn(0x7f46e00cded0 msgr2=0x7f46e006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044011840 con 0x7f404806bd40 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40440119a0 con 0x7f404806bd40 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4044011b50 con 0x7f404806bd40 2023-10-09T15:31:10.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40480c4a50 con 0x7f404806bd40 2023-10-09T15:31:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f946659c700 1 --2- 172.21.15.33:0/2563953717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946815da70 0x7f946815de40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f946806a1a0 tx=0x7f9458009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f315b13e5dfc030c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4048152410 con 0x7f404806bd40 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fdc65b9f700 1 Processor -- start 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.034+0000 7fdc65b9f700 1 -- start start 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc65b9f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc600cfa50 0x7fdc600cfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc65b9f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 0x7fdc600b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc65b9f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc600cd130 con 0x7fdc600b1780 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc65b9f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600cda90 con 0x7fdc6006bfc0 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc65b9f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc600b2330 con 0x7fdc600cfa50 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc6539e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 0x7fdc600b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc6539e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 0x7fdc600b1bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42446/0 (socket says 172.21.15.33:42446) 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc6539e700 1 -- 172.21.15.33:0/3078909384 learned_addr learned my addr 172.21.15.33:0/3078909384 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.035+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3078909384 >> v2:172.21.15.59:3300/0 conn(0x7fdc600cfa50 0x7fdc600cfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3078909384 >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 msgr2=0x7fdc600b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3078909384 >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 0x7fdc600b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3078909384 >> v1:172.21.15.33:6789/0 conn(0x7fdc600b1780 legacy=0x7fdc6006b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3078909384 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc600cd3d0 con 0x7fdc600cfa50 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.036+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3078909384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc600cfe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc60089770 tx=0x7fdc4c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c08c34f3e7a33ee1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 -- 172.21.15.33:0/151873675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 msgr2=0x7f21b8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 --2- 172.21.15.33:0/151873675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b8158650 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f21b000d1a0 tx=0x7f21b000ba50 comp rx=0 tx=0).stop 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 -- 172.21.15.33:0/151873675 shutdown_connections 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 --2- 172.21.15.33:0/151873675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b8158650 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 -- 172.21.15.33:0/151873675 >> 172.21.15.33:0/151873675 conn(0x7f21b80cded0 msgr2=0x7f21b806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f66e89f4700 1 Processor -- start 2023-10-09T15:31:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f946559a700 1 -- 172.21.15.33:0/2563953717 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9458009e70 con 0x7f946815da70 2023-10-09T15:31:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f946559a700 1 -- 172.21.15.33:0/2563953717 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f945800b820 con 0x7f946815da70 2023-10-09T15:31:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 -- 172.21.15.33:0/151873675 shutdown_connections 2023-10-09T15:31:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f946559a700 1 -- 172.21.15.33:0/2563953717 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f945800bbc0 con 0x7f946815da70 2023-10-09T15:31:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f46e6f6e700 1 -- 172.21.15.33:0/1965894482 shutdown_connections 2023-10-09T15:31:10.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f66e89f4700 1 -- start start 2023-10-09T15:31:10.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf280c6ed0 con 0x7fcf28138bc0 2023-10-09T15:31:10.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf280c7490 con 0x7fcf28138bc0 2023-10-09T15:31:10.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fcf28138740 con 0x7fcf28138bc0 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 -- 172.21.15.33:0/2563953717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946815da70 msgr2=0x7f946815de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 --2- 172.21.15.33:0/2563953717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946815da70 0x7f946815de40 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f946806a1a0 tx=0x7f9458009250 comp rx=0 tx=0).stop 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 -- 172.21.15.33:0/2563953717 shutdown_connections 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 --2- 172.21.15.33:0/2563953717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f946815da70 0x7f946815de40 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 --2- 172.21.15.33:0/2563953717 >> v2:172.21.15.33:3300/0 conn(0x7f94680cbf90 0x7f94680c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 -- 172.21.15.33:0/2563953717 >> 172.21.15.33:0/2563953717 conn(0x7f94680ccb60 msgr2=0x7f94680ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 -- 172.21.15.33:0/2563953717 shutdown_connections 2023-10-09T15:31:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f946c8c5700 1 -- 172.21.15.33:0/2563953717 wait complete. 2023-10-09T15:31:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.038+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4044017020 con 0x7f404806bd40 2023-10-09T15:31:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f404804c3c0 con 0x7f404806bd40 2023-10-09T15:31:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf1801a400 con 0x7fcf28138bc0 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.037+0000 7f21be676700 1 -- 172.21.15.33:0/151873675 wait complete. 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f21be676700 1 Processor -- start 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e89f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 0x7f66e40c9400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e89f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66e4157810 0x7f66e40677b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e89f4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66e40c8100 con 0x7f66e4157440 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e89f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66e40c9940 con 0x7f66e4157810 2023-10-09T15:31:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e89f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c8360 con 0x7f66e415b340 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f66e4157440 0x7f66e40c79f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48026/0 (socket says 172.21.15.33:48026) 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f66e259c700 1 -- 172.21.15.33:0/567296214 learned_addr learned my addr 172.21.15.33:0/567296214 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403cff9700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4034066f30 0x7f40340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4044087950 con 0x7f404806bd40 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403cff9700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f403406f140 0x7f4034071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4034071c00 con 0x7f403406f140 2023-10-09T15:31:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f404408c220 con 0x7f404806bd40 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f403ffff700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4034066f30 0x7f40340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f946c8c5700 1 Processor -- start 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7fcf167fc700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf08066fb0 0x7fcf08069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf180840e0 con 0x7fcf28138bc0 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fcf2659c700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf08066fb0 0x7fcf08069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fcf167fc700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fcf0806f140 0x7fcf08071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fcf08071c00 con 0x7fcf0806f140 2023-10-09T15:31:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fcf18051330 con 0x7fcf28138bc0 2023-10-09T15:31:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f404d3aa700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f403406f140 0x7f4034071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fcf2659c700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf08066fb0 0x7fcf08069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf20005c50 tx=0x7fcf20001420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f66e1d9b700 1 --2- 172.21.15.33:0/567296214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 0x7f66e40c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f403ffff700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4034066f30 0x7f40340693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f40480c5de0 tx=0x7f4038004cc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fdc5f7fe700 1 -- 172.21.15.33:0/3078909384 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c033640 con 0x7fdc600cfa50 2023-10-09T15:31:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fdc5f7fe700 1 -- 172.21.15.33:0/3078909384 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c0337a0 con 0x7fdc600cfa50 2023-10-09T15:31:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7fdc5f7fe700 1 -- 172.21.15.33:0/3078909384 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c033b40 con 0x7fdc600cfa50 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f21be676700 1 -- start start 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b816ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21b8150c90 0x7f21b816bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21b815a7d0 0x7f21b81564e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b81516c0 con 0x7f21b81508c0 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b816c7c0 con 0x7f21b815a7d0 2023-10-09T15:31:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f21be676700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21b816caa0 con 0x7f21b8150c90 2023-10-09T15:31:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f66e1d9b700 1 -- 172.21.15.33:0/567296214 >> v2:172.21.15.59:3300/0 conn(0x7f66e4157810 msgr2=0x7f66e40677b0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-10-09T15:31:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f66e1d9b700 1 --2- 172.21.15.33:0/567296214 >> v2:172.21.15.59:3300/0 conn(0x7f66e4157810 0x7f66e40677b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f66e1d9b700 1 -- 172.21.15.33:0/567296214 >> v1:172.21.15.33:6789/0 conn(0x7f66e4157440 legacy=0x7f66e40c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f66e1d9b700 1 -- 172.21.15.33:0/567296214 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66e40c8640 con 0x7f66e415b340 2023-10-09T15:31:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f404d3aa700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f403406f140 0x7f4034071550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.040+0000 7f946c8c5700 1 -- start start 2023-10-09T15:31:10.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.039+0000 7f46e6f6e700 1 -- 172.21.15.33:0/1965894482 wait complete. 2023-10-09T15:31:10.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f46e6f6e700 1 Processor -- start 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fcf26d9d700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fcf0806f140 0x7fcf08071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 0x7f9468147f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94680cbf90 0x7f94680c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 0x7f9468161c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c8850 con 0x7f94680cbf90 2023-10-09T15:31:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9468148490 con 0x7f94680c3300 2023-10-09T15:31:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946c8c5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94680c8290 con 0x7f946815da70 2023-10-09T15:31:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f46e6f6e700 1 -- start start 2023-10-09T15:31:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f9466d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 0x7f9468161c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 0x7f9468147f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 0x7f9468147f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49914/0 (socket says 172.21.15.33:49914) 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f9466d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 0x7f9468161c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:56972/0 (socket says 172.21.15.33:56972) 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f946659c700 1 -- 172.21.15.33:0/247560846 learned_addr learned my addr 172.21.15.33:0/247560846 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f66e1d9b700 1 --2- 172.21.15.33:0/567296214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 0x7f66e40c9400 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66d40098e0 tx=0x7f66d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a863e5f1cb8dc639 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b816ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b816ba30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42464/0 (socket says 172.21.15.33:42464) 2023-10-09T15:31:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21b7fff700 1 -- 172.21.15.33:0/2906172780 learned_addr learned my addr 172.21.15.33:0/2906172780 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21b815a7d0 0x7f21b81564e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f9465d9b700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94680cbf90 0x7f94680c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3078909384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 msgr2=0x7fdc600cfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3078909384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc600cfe20 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fdc60089770 tx=0x7fdc4c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3078909384 shutdown_connections 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3078909384 >> v2:172.21.15.33:3300/0 conn(0x7fdc6006bfc0 0x7fdc600b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3078909384 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc600cfe20 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3078909384 >> 172.21.15.33:0/3078909384 conn(0x7fdc600d0590 msgr2=0x7fdc600d0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 -- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21b8150c90 msgr2=0x7f21b816bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21b8150c90 0x7f21b816bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 -- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 msgr2=0x7f21b816ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21b81508c0 0x7f21b816ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.041+0000 7f21bcc13700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b000bcf0 con 0x7f21b815a7d0 2023-10-09T15:31:10.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3078909384 shutdown_connections 2023-10-09T15:31:10.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7fcf26d9d700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fcf0806f140 0x7fcf08071550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9466d9d700 1 -- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 msgr2=0x7f9468147f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9466d9d700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 0x7f9468147f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9466d9d700 1 -- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94680cbf90 msgr2=0x7f94680c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9466d9d700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94680cbf90 0x7f94680c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9466d9d700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94580094f0 con 0x7f946815da70 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f946659c700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94680c3300 0x7f9468147f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f21bcc13700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21b815a7d0 0x7f21b81564e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21ac001eb0 tx=0x7f21ac007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f9465d9b700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94680cbf90 0x7f94680c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== osd.4 v2:172.21.15.59:6804/91143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f4034071c00 con 0x7f403406f140 2023-10-09T15:31:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3078909384 wait complete. 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011590 con 0x7f21b815a7d0 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21ac011710 con 0x7f21b815a7d0 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b816cd80 con 0x7f21b815a7d0 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21ac011ad0 con 0x7f21b815a7d0 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b816c4b0 con 0x7f21b815a7d0 2023-10-09T15:31:10.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e01508c0 0x7f46e0152b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 0x7f46e014dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e015a7d0 0x7f46e0067680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0156a70 con 0x7f46e01508c0 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0153080 con 0x7f46e015a7d0 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46e6f6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e014e140 con 0x7f46e0150c90 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.042+0000 7f46dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 0x7f46e014dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 0x7f46e014dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:56976/0 (socket says 172.21.15.33:56976) 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 -- 172.21.15.33:0/394730465 learned_addr learned my addr 172.21.15.33:0/394730465 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f21b804c3c0 con 0x7f21b815a7d0 2023-10-09T15:31:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f66e159a700 1 -- 172.21.15.33:0/567296214 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d4009e80 con 0x7f66e415b340 2023-10-09T15:31:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f66e159a700 1 -- 172.21.15.33:0/567296214 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66d400b760 con 0x7f66e415b340 2023-10-09T15:31:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f66e159a700 1 -- 172.21.15.33:0/567296214 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66d400bb20 con 0x7f66e415b340 2023-10-09T15:31:10.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== osd.0 v2:172.21.15.33:6808/90914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fcf08071c00 con 0x7fcf0806f140 2023-10-09T15:31:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f9466d9d700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 0x7f9468161c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f946000c810 tx=0x7f9460002620 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7fdc65b9f700 1 Processor -- start 2023-10-09T15:31:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460012630 con 0x7f946815da70 2023-10-09T15:31:10.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 -- 172.21.15.33:0/567296214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 msgr2=0x7f66e40c9400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 --2- 172.21.15.33:0/567296214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 0x7f66e40c9400 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f66d40098e0 tx=0x7f66d40091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 -- 172.21.15.33:0/394730465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e015a7d0 msgr2=0x7f46e0067680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46e015a7d0 0x7f46e0067680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 -- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e01508c0 msgr2=0x7f46e0152b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e01508c0 0x7f46e0152b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d000d8d0 con 0x7f46e0150c90 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dffff700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 0x7f46e014dc00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bbe0 tx=0x7f46d8009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80092e0 con 0x7f46e0150c90 2023-10-09T15:31:10.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800c7a0 con 0x7f46e0150c90 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.043+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e0155e60 con 0x7f46e0150c90 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800cb60 con 0x7f46e0150c90 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e0156420 con 0x7f46e0150c90 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9460012790 con 0x7f946815da70 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9460012b50 con 0x7f946815da70 2023-10-09T15:31:10.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f21ac01b3b0 con 0x7f21b815a7d0 2023-10-09T15:31:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f46e004c3c0 con 0x7f46e0150c90 2023-10-09T15:31:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 -- 172.21.15.33:0/567296214 shutdown_connections 2023-10-09T15:31:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 --2- 172.21.15.33:0/567296214 >> v2:172.21.15.59:3300/0 conn(0x7f66e4157810 0x7f66e40677b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 --2- 172.21.15.33:0/567296214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e415b340 0x7f66e40c9400 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 -- 172.21.15.33:0/567296214 >> 172.21.15.33:0/567296214 conn(0x7f66e40cde30 msgr2=0x7f66e40c9e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.044+0000 7f66e89f4700 1 -- 172.21.15.33:0/567296214 shutdown_connections 2023-10-09T15:31:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f66e89f4700 1 -- 172.21.15.33:0/567296214 wait complete. 2023-10-09T15:31:10.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f219ffff700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21a4066f30 0x7f21a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f21ac083940 con 0x7f21b815a7d0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f219ffff700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f21a406f0c0 0x7f21a40714d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f21a4071b80 con 0x7f21a406f0c0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f21b7fff700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21a4066f30 0x7f21a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.045+0000 7f21b77fe700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f21a406f0c0 0x7f21a40714d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f21b7fff700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21a4066f30 0x7f21a40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bcc0 tx=0x7f21b0019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f21b77fe700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f21a406f0c0 0x7f21a40714d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f46d8012070 con 0x7f46e0150c90 2023-10-09T15:31:10.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46cc066fb0 0x7f46cc069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f66e89f4700 1 Processor -- start 2023-10-09T15:31:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f46d8084520 con 0x7f46e0150c90 2023-10-09T15:31:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f46cc06f1c0 0x7f46cc0715d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f46cc071c80 con 0x7f46cc06f1c0 2023-10-09T15:31:10.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f46d8084850 con 0x7f46e0150c90 2023-10-09T15:31:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f21ac050bb0 con 0x7f21b815a7d0 2023-10-09T15:31:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f66e89f4700 1 -- start start 2023-10-09T15:31:10.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7fdc65b9f700 1 -- start start 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 0x7fdc600cbca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc600b1780 0x7fdc60068de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc60069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc6006a590 con 0x7fdc6006bfc0 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60069980 con 0x7fdc600cfa50 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc65b9f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc60069c60 con 0x7fdc600b1780 2023-10-09T15:31:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== osd.1 v2:172.21.15.33:6817/90915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f21a4071b80 con 0x7f21a406f0c0 2023-10-09T15:31:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94680c8570 con 0x7f946815da70 2023-10-09T15:31:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.046+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94681600d0 con 0x7f946815da70 2023-10-09T15:31:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f46e4d0a700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46cc066fb0 0x7f46cc069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc64b9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 0x7fdc600cbca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc64b9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 0x7fdc600cbca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42476/0 (socket says 172.21.15.33:42476) 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3281691683 learned_addr learned my addr 172.21.15.33:0/3281691683 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 0x7f66e40c47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4157810 0x7f66e40c7220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66e415b340 0x7f66e416baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40b3090 con 0x7f66e415b340 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c4cf0 con 0x7f66e4157440 2023-10-09T15:31:10.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7f66e89f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66e40c7f80 con 0x7f66e4157810 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc6539e700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc60069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.047+0000 7fdc5ffff700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc600b1780 0x7fdc60068de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc600b1780 msgr2=0x7fdc60068de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc600b1780 0x7fdc60068de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 msgr2=0x7fdc60069320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc600cfa50 0x7fdc60069320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 -- 172.21.15.33:0/3281691683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc4c009420 con 0x7fdc6006bfc0 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 0x7f66e40c47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 0x7f66e40c47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:49948/0 (socket says 172.21.15.33:49948) 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 -- 172.21.15.33:0/576430638 learned_addr learned my addr 172.21.15.33:0/576430638 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e2d9d700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66e415b340 0x7f66e416baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 -- 172.21.15.33:0/576430638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4157810 msgr2=0x7f66e40c7220 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66e4157810 0x7f66e40c7220 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 -- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66e415b340 msgr2=0x7f66e416baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66e415b340 0x7f66e416baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 -- 172.21.15.33:0/576430638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66d4009420 con 0x7f66e4157440 2023-10-09T15:31:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7f66e259c700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 0x7f66e40c47b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a420 tx=0x7f66dc001be0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.048+0000 7fdc64b9d700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 0x7fdc600cbca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c02d0f0 tx=0x7fdc4c038000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc014030 con 0x7f66e4157440 2023-10-09T15:31:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66dc00d070 con 0x7f66e4157440 2023-10-09T15:31:10.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66dc010380 con 0x7f66e4157440 2023-10-09T15:31:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f46e550b700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f46cc06f1c0 0x7f46cc0715d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c03fa50 con 0x7fdc6006bfc0 2023-10-09T15:31:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc60069f40 con 0x7fdc6006bfc0 2023-10-09T15:31:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc6015c380 con 0x7fdc6006bfc0 2023-10-09T15:31:10.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f946001b400 con 0x7f946815da70 2023-10-09T15:31:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f946804c3c0 con 0x7f946815da70 2023-10-09T15:31:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66e40c7760 con 0x7f66e4157440 2023-10-09T15:31:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66e40c7a40 con 0x7f66e4157440 2023-10-09T15:31:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f46e4d0a700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46cc066fb0 0x7f46cc069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46d4006d40 tx=0x7f46d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f94567fc700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9448066fb0 0x7f9448069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.049+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f94600848c0 con 0x7f946815da70 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.050+0000 7f946659c700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9448066fb0 0x7f9448069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.050+0000 7fac498c3700 1 Processor -- start 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.050+0000 7fac498c3700 1 -- start start 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.050+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc4c03fbb0 con 0x7fdc6006bfc0 2023-10-09T15:31:10.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.050+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc4c03c420 con 0x7fdc6006bfc0 2023-10-09T15:31:10.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f46e550b700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f46cc06f1c0 0x7f46cc0715d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f94567fc700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7f944806f140 0x7f9448071550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9448071c00 con 0x7f944806f140 2023-10-09T15:31:10.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9460051a90 con 0x7f946815da70 2023-10-09T15:31:10.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7f946659c700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9448066fb0 0x7f9448069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f945800c010 tx=0x7f9458016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.051+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f66dc017070 con 0x7f66e4157440 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7f66d27fc700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f66c4067000 0x7f66c40694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66dc015070 con 0x7f66e4157440 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7f66e1d9b700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f66c4067000 0x7f66c40694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fac498c3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac44157780 0x7fac440abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fac498c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac440b1410 0x7fac440b18b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fac498c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac440ac100 con 0x7fac441573b0 2023-10-09T15:31:10.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fac498c3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440b1df0 con 0x7fac44157780 2023-10-09T15:31:10.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fac498c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac440ac3e0 con 0x7fac440b1410 2023-10-09T15:31:10.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdc4c03c790 con 0x7fdc6006bfc0 2023-10-09T15:31:10.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.052+0000 7f66e1d9b700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f66c4067000 0x7f66c40694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66d40098e0 tx=0x7f66d4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac440b1410 0x7fac440b18b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac42ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fac441573b0 0x7fac440ae7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42684/0 (socket says 172.21.15.33:42684) 2023-10-09T15:31:10.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac42ffd700 1 -- 172.21.15.33:0/1996449793 learned_addr learned my addr 172.21.15.33:0/1996449793 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7f66e89f4700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f66e4155280 0x7f66e40c5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 --> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f66e40ccf90 con 0x7f66e4155280 2023-10-09T15:31:10.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7f9465d9b700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7f944806f140 0x7f9448071550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac41ffb700 1 -- 172.21.15.33:0/1996449793 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 709839093 0 0) 0x7fac440ac100 con 0x7fac441573b0 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac41ffb700 1 -- 172.21.15.33:0/1996449793 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac30003570 con 0x7fac441573b0 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 -- 172.21.15.33:0/1996449793 >> v2:172.21.15.33:3300/0 conn(0x7fac44157780 msgr2=0x7fac440abab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 --2- 172.21.15.33:0/1996449793 >> v2:172.21.15.33:3300/0 conn(0x7fac44157780 0x7fac440abab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 -- 172.21.15.33:0/1996449793 >> v1:172.21.15.59:6789/0 conn(0x7fac441573b0 legacy=0x7fac440ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 -- 172.21.15.33:0/1996449793 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac440ac6c0 con 0x7fac440b1410 2023-10-09T15:31:10.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fdc5cff9700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc44066fb0 0x7fdc44069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdc4c0a7d00 con 0x7fdc6006bfc0 2023-10-09T15:31:10.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== osd.3 v2:172.21.15.33:6800/90903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f46cc071c80 con 0x7f46cc06f1c0 2023-10-09T15:31:10.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.059+0000 7f66e2d9d700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f66e4155280 0x7f66e40c5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7f66e2d9d700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f66e4155280 0x7f66e40c5430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== osd.2 v2:172.21.15.33:6816/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f66e40ccf90 con 0x7f66e4155280 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.063+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 --> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f40480c45d0 con 0x7f403406f140 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7f9465d9b700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7f944806f140 0x7f9448071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== osd.5 v2:172.21.15.59:6800/91144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f9448071c00 con 0x7f944806f140 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac437fe700 1 --2- 172.21.15.33:0/1996449793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac440b1410 0x7fac440b18b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac440c9950 tx=0x7fac3c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fe46a007a4523146 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fac41ffb700 1 -- 172.21.15.33:0/1996449793 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c00e070 con 0x7fac440b1410 2023-10-09T15:31:10.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac41ffb700 1 -- 172.21.15.33:0/1996449793 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac3c00bb60 con 0x7fac440b1410 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac41ffb700 1 -- 172.21.15.33:0/1996449793 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac3c012430 con 0x7fac440b1410 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 -- 172.21.15.33:0/1996449793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac440b1410 msgr2=0x7fac440b18b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 --2- 172.21.15.33:0/1996449793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac440b1410 0x7fac440b18b0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fac440c9950 tx=0x7fac3c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 -- 172.21.15.33:0/1996449793 shutdown_connections 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 --2- 172.21.15.33:0/1996449793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac440b1410 0x7fac440b18b0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 --2- 172.21.15.33:0/1996449793 >> v2:172.21.15.33:3300/0 conn(0x7fac44157780 0x7fac440abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 -- 172.21.15.33:0/1996449793 >> 172.21.15.33:0/1996449793 conn(0x7fac440cc300 msgr2=0x7fac440cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fac498c3700 1 -- 172.21.15.33:0/1996449793 shutdown_connections 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.055+0000 7fac498c3700 1 -- 172.21.15.33:0/1996449793 wait complete. 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.056+0000 7fac498c3700 1 Processor -- start 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7fac498c3700 1 -- start start 2023-10-09T15:31:10.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7fac498c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 0x7fac4414d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7fac498c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac441573b0 0x7fac44151d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7fac498c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac44157780 0x7fac441420c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.064+0000 7fac498c3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac44152250 con 0x7fac440b1410 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac498c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac441428b0 con 0x7fac441573b0 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac498c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac44142600 con 0x7fac44157780 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 0x7fac4414d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 0x7fac4414d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42496/0 (socket says 172.21.15.33:42496) 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 -- 172.21.15.33:0/1759125034 learned_addr learned my addr 172.21.15.33:0/1759125034 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac427fc700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac441573b0 0x7fac44151d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac437fe700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac44157780 0x7fac441420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 -- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac44157780 msgr2=0x7fac441420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac44157780 0x7fac441420c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 -- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac441573b0 msgr2=0x7fac44151d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac441573b0 0x7fac44151d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 -- 172.21.15.33:0/1759125034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac3c009a20 con 0x7fac440b1410 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.065+0000 7fac42ffd700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 0x7fac4414d9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00c7c0 tx=0x7fac2c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.053+0000 7fdc5ffff700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc44066fb0 0x7fdc44069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.054+0000 7fdc5ffff700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc44066fb0 0x7fdc44069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc6016b210 tx=0x7fdc54009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.055+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7fdc400015f0 0x7fdc40003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.055+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 --> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fdc40006b90 con 0x7fdc400015f0 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.055+0000 7fdc6539e700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7fdc400015f0 0x7fdc40003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.055+0000 7fdc6539e700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7fdc400015f0 0x7fdc40003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.056+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== osd.7 v2:172.21.15.59:6816/91145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fdc40006b90 con 0x7fdc400015f0 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.066+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c005cd0 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.066+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac4414e0f0 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.066+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac4414e6b0 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.068+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2c005e30 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.068+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2c007320 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.069+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fac2c01b3b0 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.069+0000 7fac3affd700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac24066fb0 0x7fac24069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.069+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fac2c083c70 con 0x7fac440b1410 2023-10-09T15:31:10.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.069+0000 7fac427fc700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac24066fb0 0x7fac24069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.070+0000 7fac427fc700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac24066fb0 0x7fac24069460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac34009b40 tx=0x7fac340090f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.072+0000 7fac498c3700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7fac280015f0 0x7fac28003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.072+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 --> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fac28006b90 con 0x7fac280015f0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.072+0000 7fac437fe700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7fac280015f0 0x7fac28003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.072+0000 7fac437fe700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7fac280015f0 0x7fac28003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.073+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== osd.6 v2:172.21.15.59:6824/91188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fac28006b90 con 0x7fac280015f0 2023-10-09T15:31:10.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.074+0000 7f403cff9700 1 -- 172.21.15.33:0/1091654034 <== osd.4 v2:172.21.15.59:6804/91143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f40480c45d0 con 0x7f403406f140 2023-10-09T15:31:10.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.074+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 --> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f94680cc7b0 con 0x7f944806f140 2023-10-09T15:31:10.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.074+0000 7f94567fc700 1 -- 172.21.15.33:0/247560846 <== osd.5 v2:172.21.15.59:6800/91144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f94680cc7b0 con 0x7f944806f140 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7f944806f140 msgr2=0x7f9448071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7f944806f140 0x7f9448071550 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9448066fb0 msgr2=0x7f9448069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9448066fb0 0x7f9448069460 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f945800c010 tx=0x7f9458016000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 msgr2=0x7f9468161c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 --2- 172.21.15.33:0/247560846 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f946815da70 0x7f9468161c90 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f946000c810 tx=0x7f9460002620 comp rx=0 tx=0).stop 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f9466d9d700 1 -- 172.21.15.33:0/247560846 reap_dead start 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 shutdown_connections 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 >> 172.21.15.33:0/247560846 conn(0x7f94680ccb60 msgr2=0x7f94680c95d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 shutdown_connections 2023-10-09T15:31:10.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.075+0000 7f946c8c5700 1 -- 172.21.15.33:0/247560846 wait complete. 2023-10-09T15:31:10.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.076+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 --> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fcf2804c3c0 con 0x7fcf0806f140 2023-10-09T15:31:10.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.076+0000 7fcf167fc700 1 -- 172.21.15.33:0/527535166 <== osd.0 v2:172.21.15.33:6808/90914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fcf2804c3c0 con 0x7fcf0806f140 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fcf0806f140 msgr2=0x7fcf08071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fcf0806f140 0x7fcf08071550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf08066fb0 msgr2=0x7fcf08069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf08066fb0 0x7fcf08069460 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fcf20005c50 tx=0x7fcf20001420 comp rx=0 tx=0).stop 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 msgr2=0x7fcf280c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 --2- 172.21.15.33:0/527535166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf28138bc0 0x7fcf280c6480 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fcf1800b580 tx=0x7fcf180091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf26d9d700 1 -- 172.21.15.33:0/527535166 reap_dead start 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 shutdown_connections 2023-10-09T15:31:10.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.077+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 >> 172.21.15.33:0/527535166 conn(0x7fcf280ccb60 msgr2=0x7fcf2813b810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.078+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f403406f140 msgr2=0x7f4034071550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.078+0000 7f404dbab700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f403406f140 0x7f4034071550 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.079+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 --> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f21b8159520 con 0x7f21a406f0c0 2023-10-09T15:31:10.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.080+0000 7f219ffff700 1 -- 172.21.15.33:0/2906172780 <== osd.1 v2:172.21.15.33:6817/90915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f21b8159520 con 0x7f21a406f0c0 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f21a406f0c0 msgr2=0x7f21a40714d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f21a406f0c0 0x7f21a40714d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21a4066f30 msgr2=0x7f21a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21a4066f30 0x7f21a40693e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f21b000bcc0 tx=0x7f21b0019000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21b815a7d0 msgr2=0x7f21b81564e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 --2- 172.21.15.33:0/2906172780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21b815a7d0 0x7f21b81564e0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f21ac001eb0 tx=0x7f21ac007e20 comp rx=0 tx=0).stop 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21bcc13700 1 -- 172.21.15.33:0/2906172780 reap_dead start 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 shutdown_connections 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 >> 172.21.15.33:0/2906172780 conn(0x7f21b80cded0 msgr2=0x7f21b80c9000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.081+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 shutdown_connections 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.082+0000 7f21be676700 1 -- 172.21.15.33:0/2906172780 wait complete. 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.084+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 --> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fdc40005c80 con 0x7fdc400015f0 2023-10-09T15:31:10.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.084+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 shutdown_connections 2023-10-09T15:31:10.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.084+0000 7fcf2cbde700 1 -- 172.21.15.33:0/527535166 wait complete. 2023-10-09T15:31:10.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.084+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 --> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f46e0158f60 con 0x7f46cc06f1c0 2023-10-09T15:31:10.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.084+0000 7fdc5cff9700 1 -- 172.21.15.33:0/3281691683 <== osd.7 v2:172.21.15.59:6816/91145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fdc40005c80 con 0x7fdc400015f0 2023-10-09T15:31:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7fdc400015f0 msgr2=0x7fdc40003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7fdc400015f0 0x7fdc40003aa0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc44066fb0 msgr2=0x7fdc44069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc44066fb0 0x7fdc44069460 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fdc6016b210 tx=0x7fdc54009040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 msgr2=0x7fdc600cbca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 --2- 172.21.15.33:0/3281691683 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc6006bfc0 0x7fdc600cbca0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdc4c02d0f0 tx=0x7fdc4c038000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc6539e700 1 -- 172.21.15.33:0/3281691683 reap_dead start 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 shutdown_connections 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 >> 172.21.15.33:0/3281691683 conn(0x7fdc600d0590 msgr2=0x7fdc600c5330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 shutdown_connections 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.085+0000 7fdc65b9f700 1 -- 172.21.15.33:0/3281691683 wait complete. 2023-10-09T15:31:10.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4034066f30 msgr2=0x7f40340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4034066f30 0x7f40340693e0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f40480c5de0 tx=0x7f4038004cc0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 msgr2=0x7f4048154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 --2- 172.21.15.33:0/1091654034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f404806bd40 0x7f4048154670 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f404400c5b0 tx=0x7f4044007f00 comp rx=0 tx=0).stop 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404d3aa700 1 -- 172.21.15.33:0/1091654034 reap_dead start 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 shutdown_connections 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.086+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 >> 172.21.15.33:0/1091654034 conn(0x7f404806d130 msgr2=0x7f404806de50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.092+0000 7f46dcff9700 1 -- 172.21.15.33:0/394730465 <== osd.3 v2:172.21.15.33:6800/90903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f46e0158f60 con 0x7f46cc06f1c0 2023-10-09T15:31:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.092+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 --> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f66e404c3c0 con 0x7f66e4155280 2023-10-09T15:31:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.093+0000 7f66d27fc700 1 -- 172.21.15.33:0/576430638 <== osd.2 v2:172.21.15.33:6816/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f66e404c3c0 con 0x7f66e4155280 2023-10-09T15:31:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.094+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 shutdown_connections 2023-10-09T15:31:10.122 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:10.122 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f46cc06f1c0 msgr2=0x7f46cc0715d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f46cc06f1c0 0x7f46cc0715d0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46cc066fb0 msgr2=0x7f46cc069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46cc066fb0 0x7f46cc069460 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f46d4006d40 tx=0x7f46d4008040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 msgr2=0x7f46e014dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e6f6e700 1 --2- 172.21.15.33:0/394730465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e0150c90 0x7f46e014dc00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f46d800bbe0 tx=0x7f46d8009840 comp rx=0 tx=0).stop 2023-10-09T15:31:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.096+0000 7f46e550b700 1 -- 172.21.15.33:0/394730465 reap_dead start 2023-10-09T15:31:10.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.098+0000 7f404dbab700 1 -- 172.21.15.33:0/1091654034 wait complete. 2023-10-09T15:31:10.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.098+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 shutdown_connections 2023-10-09T15:31:10.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.098+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 >> 172.21.15.33:0/394730465 conn(0x7f46e00cded0 msgr2=0x7f46e014fa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.098+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 shutdown_connections 2023-10-09T15:31:10.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.098+0000 7f46e6f6e700 1 -- 172.21.15.33:0/394730465 wait complete. 2023-10-09T15:31:10.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.100+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 --> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fac28005c20 con 0x7fac280015f0 2023-10-09T15:31:10.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.101+0000 7fac3affd700 1 -- 172.21.15.33:0/1759125034 <== osd.6 v2:172.21.15.59:6824/91188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fac28005c20 con 0x7fac280015f0 2023-10-09T15:31:10.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f66e4155280 msgr2=0x7f66e40c5430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f66e4155280 0x7f66e40c5430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f66c4067000 msgr2=0x7f66c40694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f66c4067000 0x7f66c40694b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f66d40098e0 tx=0x7f66d4016000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 msgr2=0x7f66e40c47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e89f4700 1 --2- 172.21.15.33:0/576430638 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66e4157440 0x7f66e40c47b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00a420 tx=0x7f66dc001be0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.102+0000 7f66e2d9d700 1 -- 172.21.15.33:0/576430638 reap_dead start 2023-10-09T15:31:10.127 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2023-10-09T15:31:10.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T15:31:10.128 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T15:31:10.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.107+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 shutdown_connections 2023-10-09T15:31:10.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.107+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 >> 172.21.15.33:0/576430638 conn(0x7f66e40cde30 msgr2=0x7f66e4153080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.107+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 shutdown_connections 2023-10-09T15:31:10.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.107+0000 7f66e89f4700 1 -- 172.21.15.33:0/576430638 wait complete. 2023-10-09T15:31:10.130 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:10.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7fac280015f0 msgr2=0x7fac28003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7fac280015f0 0x7fac28003aa0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac24066fb0 msgr2=0x7fac24069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac24066fb0 0x7fac24069460 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fac34009b40 tx=0x7fac340090f0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 msgr2=0x7fac4414d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 --2- 172.21.15.33:0/1759125034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac440b1410 0x7fac4414d9f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fac2c00c7c0 tx=0x7fac2c007e00 comp rx=0 tx=0).stop 2023-10-09T15:31:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac437fe700 1 -- 172.21.15.33:0/1759125034 reap_dead start 2023-10-09T15:31:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 shutdown_connections 2023-10-09T15:31:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 >> 172.21.15.33:0/1759125034 conn(0x7fac440cc300 msgr2=0x7fac440cbb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 shutdown_connections 2023-10-09T15:31:10.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.111+0000 7fac498c3700 1 -- 172.21.15.33:0/1759125034 wait complete. 2023-10-09T15:31:10.133 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.133 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T15:31:10.133 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2023-10-09T15:31:10.134 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T15:31:10.135 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:10.135 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T15:31:10.135 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:10.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T15:31:10.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.370+0000 7fbe49015700 1 Processor -- start 2023-10-09T15:31:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.369+0000 7f805348e700 1 Processor -- start 2023-10-09T15:31:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.369+0000 7f805348e700 1 -- start start 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f805348e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f804c0b1cd0 0x7f804c0af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f805348e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f804c0afeb0 0x7f804c0cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f805348e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f804c167a60 con 0x7f804c0cb810 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f805348e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c0b0350 con 0x7f804c0afeb0 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f805348e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f804c167130 con 0x7f804c0b1cd0 2023-10-09T15:31:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f8050a29700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f804c0afeb0 0x7f804c0cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.370+0000 7fbe49015700 1 -- start start 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe49015700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbe4415da70 0x7fbe4415de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe49015700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbe440cbf90 0x7fbe440c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe49015700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbe4415e380 con 0x7fbe440c3300 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe49015700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4406c6a0 con 0x7fbe440cbf90 2023-10-09T15:31:10.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe49015700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbe4406cc20 con 0x7fbe4415da70 2023-10-09T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f8050a29700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f804c0afeb0 0x7f804c0cb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42506/0 (socket says 172.21.15.33:42506) 2023-10-09T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7f8050a29700 1 -- 172.21.15.33:0/1840416419 learned_addr learned my addr 172.21.15.33:0/1840416419 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe4259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbe440cbf90 0x7fbe440c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe4259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbe440cbf90 0x7fbe440c29b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42516/0 (socket says 172.21.15.33:42516) 2023-10-09T15:31:10.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.371+0000 7fbe4259c700 1 -- 172.21.15.33:0/4022163525 learned_addr learned my addr 172.21.15.33:0/4022163525 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8050a29700 1 -- 172.21.15.33:0/1840416419 >> v2:172.21.15.59:3300/0 conn(0x7f804c0b1cd0 msgr2=0x7f804c0af970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8050a29700 1 --2- 172.21.15.33:0/1840416419 >> v2:172.21.15.59:3300/0 conn(0x7f804c0b1cd0 0x7f804c0af970 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8050a29700 1 -- 172.21.15.33:0/1840416419 >> v1:172.21.15.59:6789/0 conn(0x7f804c0cb810 legacy=0x7f804c0870f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8050a29700 1 -- 172.21.15.33:0/1840416419 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f804c167410 con 0x7f804c0afeb0 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe4259c700 1 -- 172.21.15.33:0/4022163525 >> v2:172.21.15.59:3300/0 conn(0x7fbe4415da70 msgr2=0x7fbe4415de40 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T15:31:10.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe4259c700 1 --2- 172.21.15.33:0/4022163525 >> v2:172.21.15.59:3300/0 conn(0x7fbe4415da70 0x7fbe4415de40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe4259c700 1 -- 172.21.15.33:0/4022163525 >> v1:172.21.15.59:6789/0 conn(0x7fbe440c3300 legacy=0x7fbe4406d0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe4259c700 1 -- 172.21.15.33:0/4022163525 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe440cc4d0 con 0x7fbe440cbf90 2023-10-09T15:31:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8050a29700 1 --2- 172.21.15.33:0/1840416419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0afeb0 0x7f804c0cb2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f804c06fba0 tx=0x7f8048009ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45f4125d9df475e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe4259c700 1 --2- 172.21.15.33:0/4022163525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe440c29b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe4406a1a0 tx=0x7fbe34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e80cfd4bb967383 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fccc0aea700 1 Processor -- start 2023-10-09T15:31:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fccc0aea700 1 -- start start 2023-10-09T15:31:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe41d9b700 1 -- 172.21.15.33:0/4022163525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400b860 con 0x7fbe440cbf90 2023-10-09T15:31:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe41d9b700 1 -- 172.21.15.33:0/4022163525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe3400b9c0 con 0x7fbe440cbf90 2023-10-09T15:31:10.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7fbe41d9b700 1 -- 172.21.15.33:0/4022163525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3400bd60 con 0x7fbe440cbf90 2023-10-09T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.372+0000 7f8043fff700 1 -- 172.21.15.33:0/1840416419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804800c930 con 0x7f804c0afeb0 2023-10-09T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7f8043fff700 1 -- 172.21.15.33:0/1840416419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f804800ca90 con 0x7f804c0afeb0 2023-10-09T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7f8043fff700 1 -- 172.21.15.33:0/1840416419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804800ce30 con 0x7f804c0afeb0 2023-10-09T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7fbe49015700 1 -- 172.21.15.33:0/4022163525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 msgr2=0x7fbe440c29b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7fbe49015700 1 --2- 172.21.15.33:0/4022163525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe440c29b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fbe4406a1a0 tx=0x7fbe34009250 comp rx=0 tx=0).stop 2023-10-09T15:31:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7f805348e700 1 -- 172.21.15.33:0/1840416419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0afeb0 msgr2=0x7f804c0cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.373+0000 7f805348e700 1 --2- 172.21.15.33:0/1840416419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0afeb0 0x7f804c0cb2d0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f804c06fba0 tx=0x7f8048009ae0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f35161a0700 1 Processor -- start 2023-10-09T15:31:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fa46052f700 1 Processor -- start 2023-10-09T15:31:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 -- 172.21.15.33:0/1840416419 shutdown_connections 2023-10-09T15:31:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 --2- 172.21.15.33:0/1840416419 >> v2:172.21.15.59:3300/0 conn(0x7f804c0b1cd0 0x7f804c0af970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 --2- 172.21.15.33:0/1840416419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0afeb0 0x7f804c0cb2d0 secure :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f804c06fba0 tx=0x7f8048009ae0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 -- 172.21.15.33:0/1840416419 >> 172.21.15.33:0/1840416419 conn(0x7f804c0cc300 msgr2=0x7f804c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fa46052f700 1 -- start start 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccc0aea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccc0aea700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fccbc0af560 0x7fccbc15b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccc0aea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fccbc0af9d0 con 0x7fccbc15b750 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccc0aea700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fccbc0cb4d0 con 0x7fccbc0af560 2023-10-09T15:31:10.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccc0aea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc158000 con 0x7fccbc140e50 2023-10-09T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 -- 172.21.15.33:0/1840416419 shutdown_connections 2023-10-09T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fbe49015700 1 -- 172.21.15.33:0/4022163525 shutdown_connections 2023-10-09T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fbe49015700 1 --2- 172.21.15.33:0/4022163525 >> v2:172.21.15.59:3300/0 conn(0x7fbe4415da70 0x7fbe4415de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fbe49015700 1 --2- 172.21.15.33:0/4022163525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe440c29b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fbe49015700 1 -- 172.21.15.33:0/4022163525 >> 172.21.15.33:0/4022163525 conn(0x7fbe440ccb60 msgr2=0x7fbe440ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:57002/0 (socket says 172.21.15.33:57002) 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccb9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fccbc0af560 0x7fccbc15b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 -- 172.21.15.33:0/4025254137 learned_addr learned my addr 172.21.15.33:0/4025254137 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 -- 172.21.15.33:0/4025254137 >> v2:172.21.15.33:3300/0 conn(0x7fccbc0af560 msgr2=0x7fccbc15b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 --2- 172.21.15.33:0/4025254137 >> v2:172.21.15.33:3300/0 conn(0x7fccbc0af560 0x7fccbc15b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 -- 172.21.15.33:0/4025254137 >> v1:172.21.15.33:6789/0 conn(0x7fccbc15b750 legacy=0x7fccbc06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7fccba59c700 1 -- 172.21.15.33:0/4025254137 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccbc0cbd10 con 0x7fccbc140e50 2023-10-09T15:31:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fbe49015700 1 -- 172.21.15.33:0/4022163525 shutdown_connections 2023-10-09T15:31:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.374+0000 7f805348e700 1 -- 172.21.15.33:0/1840416419 wait complete. 2023-10-09T15:31:10.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fbe49015700 1 -- 172.21.15.33:0/4022163525 wait complete. 2023-10-09T15:31:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7f35161a0700 1 -- start start 2023-10-09T15:31:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fccba59c700 1 --2- 172.21.15.33:0/4025254137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009f20 tx=0x7fccb4009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2f06c8da90be9232 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fccb959a700 1 -- 172.21.15.33:0/4025254137 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb400e070 con 0x7fccbc140e50 2023-10-09T15:31:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fccb959a700 1 -- 172.21.15.33:0/4025254137 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccb400b990 con 0x7fccbc140e50 2023-10-09T15:31:10.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fccb959a700 1 -- 172.21.15.33:0/4025254137 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccb40092e0 con 0x7fccbc140e50 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fa46052f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 0x7fa458158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fa46052f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa458150c90 0x7fa4580af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fa46052f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa458158c80 con 0x7fa4581508c0 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fa46052f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa45815afc0 con 0x7fa458150c90 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7fa46052f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4580af820 con 0x7fa45815a7d0 2023-10-09T15:31:10.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.375+0000 7f805348e700 1 Processor -- start 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f35161a0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f351015b5e0 0x7f35100b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f35161a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 0x7f35100b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f35161a0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351015ef50 con 0x7f35100b0470 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f35161a0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351015e180 con 0x7f351015b5e0 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f35161a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f351015e380 con 0x7f351015b9b0 2023-10-09T15:31:10.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fa45e2cb700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa4581508c0 0x7fa45815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42728/0 (socket says 172.21.15.33:42728) 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fa45e2cb700 1 -- 172.21.15.33:0/2498339994 learned_addr learned my addr 172.21.15.33:0/2498339994 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fa45daca700 1 --2- 172.21.15.33:0/2498339994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 0x7fa458158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 -- 172.21.15.33:0/4025254137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 msgr2=0x7fccbc0af020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 --2- 172.21.15.33:0/4025254137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fccb4009f20 tx=0x7fccb4009840 comp rx=0 tx=0).stop 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 -- 172.21.15.33:0/4025254137 shutdown_connections 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 --2- 172.21.15.33:0/4025254137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc140e50 0x7fccbc0af020 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 --2- 172.21.15.33:0/4025254137 >> v2:172.21.15.33:3300/0 conn(0x7fccbc0af560 0x7fccbc15b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 -- 172.21.15.33:0/4025254137 >> 172.21.15.33:0/4025254137 conn(0x7fccbc0cded0 msgr2=0x7fccbc06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 -- 172.21.15.33:0/4025254137 shutdown_connections 2023-10-09T15:31:10.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7fccc0aea700 1 -- 172.21.15.33:0/4025254137 wait complete. 2023-10-09T15:31:10.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fbe49015700 1 Processor -- start 2023-10-09T15:31:10.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45eacc700 1 --2- 172.21.15.33:0/2498339994 >> v2:172.21.15.59:3300/0 conn(0x7fa458150c90 0x7fa4580af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fbe49015700 1 -- start start 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f350effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 0x7f35100b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f350effd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 0x7f35100b27d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:57026/0 (socket says 172.21.15.33:57026) 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f350effd700 1 -- 172.21.15.33:0/665004423 learned_addr learned my addr 172.21.15.33:0/665004423 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45daca700 1 -- 172.21.15.33:0/2498339994 >> v2:172.21.15.59:3300/0 conn(0x7fa458150c90 msgr2=0x7fa4580af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45daca700 1 --2- 172.21.15.33:0/2498339994 >> v2:172.21.15.59:3300/0 conn(0x7fa458150c90 0x7fa4580af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45daca700 1 -- 172.21.15.33:0/2498339994 >> v1:172.21.15.59:6789/0 conn(0x7fa4581508c0 legacy=0x7fa45815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.376+0000 7f805348e700 1 -- start start 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 0x7f804c17f760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f804c16f280 0x7f804c16afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c17fca0 con 0x7f804c0b1cd0 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f804c16ab10 con 0x7f804c0cb810 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805348e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f804c0acd50 con 0x7f804c16f280 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f8050a29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f8050a29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:50002/0 (socket says 172.21.15.33:50002) 2023-10-09T15:31:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f05886cc700 1 Processor -- start 2023-10-09T15:31:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f8050a29700 1 -- 172.21.15.33:0/4213979286 learned_addr learned my addr 172.21.15.33:0/4213979286 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45daca700 1 -- 172.21.15.33:0/2498339994 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa458158f60 con 0x7fa45815a7d0 2023-10-09T15:31:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f350f7fe700 1 --2- 172.21.15.33:0/665004423 >> v2:172.21.15.33:3300/0 conn(0x7f351015b5e0 0x7f35100b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7fa45daca700 1 --2- 172.21.15.33:0/2498339994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 0x7fa458158650 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e60 tx=0x7fa450009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c3a29bb6c2b614e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f805122a700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 0x7f804c17f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f8050a29700 1 -- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f804c16f280 msgr2=0x7f804c16afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f8050a29700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f804c16f280 0x7f804c16afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f8050a29700 1 -- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 msgr2=0x7f804c17f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f8050a29700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 0x7f804c17f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f8050a29700 1 -- 172.21.15.33:0/4213979286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8048009d80 con 0x7f804c0cb810 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f805122a700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 0x7f804c17f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f350f7fe700 1 -- 172.21.15.33:0/665004423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 msgr2=0x7f35100b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f350f7fe700 1 --2- 172.21.15.33:0/665004423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 0x7f35100b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f350f7fe700 1 -- 172.21.15.33:0/665004423 >> v1:172.21.15.33:6789/0 conn(0x7f35100b0470 legacy=0x7f35100ae350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f350f7fe700 1 -- 172.21.15.33:0/665004423 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351015e620 con 0x7f351015b5e0 2023-10-09T15:31:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fccc0aea700 1 Processor -- start 2023-10-09T15:31:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe440c3300 0x7fbe4413a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe4415f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 0x7fbe440c7410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe44160180 con 0x7fbe440cbf90 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4413b5f0 con 0x7fbe4415da70 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe49015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbe4413ab20 con 0x7fbe440c3300 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe4415f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe4415f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42538/0 (socket says 172.21.15.33:42538) 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe4259c700 1 -- 172.21.15.33:0/2065706652 learned_addr learned my addr 172.21.15.33:0/2065706652 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe4359e700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 0x7fbe440c7410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fbe42d9d700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe440c3300 0x7fbe4413a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 -- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe440c3300 msgr2=0x7fbe4413a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe440c3300 0x7fbe4413a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 -- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 msgr2=0x7fbe4415f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe4415f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7f350f7fe700 1 --2- 172.21.15.33:0/665004423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b5e0 0x7f35100b0cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f35040098e0 tx=0x7f35040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79dd6061825185ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 -- 172.21.15.33:0/2065706652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe340094f0 con 0x7fbe4415da70 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.377+0000 7f05886cc700 1 -- start start 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f05886cc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05800cbcb0 0x7f058006e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f05886cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f05886cc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05800acf40 con 0x7f05800cb8e0 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f05886cc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05800b20a0 con 0x7f05800cbcb0 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f05886cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0580156ee0 con 0x7f058006e930 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fa45d2c9700 1 -- 172.21.15.33:0/2498339994 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa45000e070 con 0x7fa45815a7d0 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fa45d2c9700 1 -- 172.21.15.33:0/2498339994 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa45000bbf0 con 0x7fa45815a7d0 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fa45d2c9700 1 -- 172.21.15.33:0/2498339994 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa450012430 con 0x7fa45815a7d0 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 -- 172.21.15.33:0/2498339994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 msgr2=0x7fa458158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 --2- 172.21.15.33:0/2498339994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 0x7fa458158650 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa450009e60 tx=0x7fa450009780 comp rx=0 tx=0).stop 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f350e7fc700 1 -- 172.21.15.33:0/665004423 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504009e80 con 0x7f351015b5e0 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0585c67700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05800cbcb0 0x7f058006e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:57060/0 (socket says 172.21.15.33:57060) 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 -- 172.21.15.33:0/2475396372 learned_addr learned my addr 172.21.15.33:0/2475396372 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f8050a29700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8048006fa0 tx=0x7f8048017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fbe4359e700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 0x7fbe440c7410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c490 tx=0x7fbe38007e20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe3800ce00 con 0x7fbe4415da70 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbe38011590 con 0x7fbe4415da70 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbe38011950 con 0x7fbe4415da70 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe4415fcb0 con 0x7fbe4415da70 2023-10-09T15:31:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f350e7fc700 1 -- 172.21.15.33:0/665004423 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400b820 con 0x7f351015b5e0 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f350e7fc700 1 -- 172.21.15.33:0/665004423 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400bbe0 con 0x7f351015b5e0 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 -- 172.21.15.33:0/2475396372 >> v2:172.21.15.59:3300/0 conn(0x7f05800cbcb0 msgr2=0x7f058006e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 --2- 172.21.15.33:0/2475396372 >> v2:172.21.15.59:3300/0 conn(0x7f05800cbcb0 0x7f058006e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 -- 172.21.15.33:0/2475396372 >> v1:172.21.15.33:6789/0 conn(0x7f05800cb8e0 legacy=0x7f05800ac830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f0586c69700 1 -- 172.21.15.33:0/2475396372 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0580156c00 con 0x7f058006e930 2023-10-09T15:31:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f0586c69700 1 --2- 172.21.15.33:0/2475396372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0578006260 tx=0x7f0578007d80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=709d4679088a54a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 -- 172.21.15.33:0/2498339994 shutdown_connections 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 --2- 172.21.15.33:0/2498339994 >> v2:172.21.15.59:3300/0 conn(0x7fa458150c90 0x7fa4580af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 --2- 172.21.15.33:0/2498339994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa45815a7d0 0x7fa458158650 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 -- 172.21.15.33:0/2498339994 >> 172.21.15.33:0/2498339994 conn(0x7fa4580cded0 msgr2=0x7fa45806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 -- 172.21.15.33:0/2498339994 shutdown_connections 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fa46052f700 1 -- 172.21.15.33:0/2498339994 wait complete. 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f804801d070 con 0x7f804c0cb810 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8048018df0 con 0x7f804c0cb810 2023-10-09T15:31:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8048021620 con 0x7f804c0cb810 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804c16fb00 con 0x7f804c0cb810 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804c16a4c0 con 0x7f804c0cb810 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.378+0000 7fccc0aea700 1 -- start start 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0af560 0x7fccbc15dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc15b750 0x7fccbc140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc161860 con 0x7fccbc0af560 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc160be0 con 0x7fccbc140e50 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.379+0000 7fccc0aea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fccbc160ec0 con 0x7fccbc15b750 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fccb9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fccb9d9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:50036/0 (socket says 172.21.15.33:50036) 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fccb9d9b700 1 -- 172.21.15.33:0/2324337805 learned_addr learned my addr 172.21.15.33:0/2324337805 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f804c0cb360 con 0x7f804c0cb810 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 -- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc15b750 msgr2=0x7fccbc140280 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc15b750 0x7fccbc140280 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 -- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0af560 msgr2=0x7fccbc15dd20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0af560 0x7fccbc15dd20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 -- 172.21.15.33:0/2324337805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccb4009ae0 con 0x7fccbc140e50 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f0585466700 1 -- 172.21.15.33:0/2475396372 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057800ecb0 con 0x7f058006e930 2023-10-09T15:31:10.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f0585466700 1 -- 172.21.15.33:0/2475396372 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057800ee10 con 0x7f058006e930 2023-10-09T15:31:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccb9d9b700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fccac00e930 tx=0x7fccac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f0585466700 1 -- 172.21.15.33:0/2475396372 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0578007280 con 0x7f058006e930 2023-10-09T15:31:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f05886cc700 1 -- 172.21.15.33:0/2475396372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 msgr2=0x7f05800ad6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f05886cc700 1 --2- 172.21.15.33:0/2475396372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0578006260 tx=0x7f0578007d80 comp rx=0 tx=0).stop 2023-10-09T15:31:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe4413b030 con 0x7fbe4415da70 2023-10-09T15:31:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fa46052f700 1 Processor -- start 2023-10-09T15:31:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac00eed0 con 0x7fccbc140e50 2023-10-09T15:31:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fa46052f700 1 -- start start 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fccac00c850 con 0x7fccbc140e50 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fccac00cbf0 con 0x7fccbc140e50 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccbc1611a0 con 0x7fccbc140e50 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccbc15e260 con 0x7fccbc140e50 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f35161a0700 1 -- 172.21.15.33:0/665004423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b5e0 msgr2=0x7f35100b0cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.380+0000 7f35161a0700 1 --2- 172.21.15.33:0/665004423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b5e0 0x7f35100b0cc0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f35040098e0 tx=0x7f35040091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f35161a0700 1 -- 172.21.15.33:0/665004423 shutdown_connections 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f35161a0700 1 --2- 172.21.15.33:0/665004423 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b5e0 0x7f35100b0cc0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f35161a0700 1 --2- 172.21.15.33:0/665004423 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f351015b9b0 0x7f35100b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.381+0000 7f35161a0700 1 -- 172.21.15.33:0/665004423 >> 172.21.15.33:0/665004423 conn(0x7f35100cded0 msgr2=0x7f351006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f05886cc700 1 -- 172.21.15.33:0/2475396372 shutdown_connections 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f05886cc700 1 --2- 172.21.15.33:0/2475396372 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058006e930 0x7f05800ad6b0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f05886cc700 1 --2- 172.21.15.33:0/2475396372 >> v2:172.21.15.59:3300/0 conn(0x7f05800cbcb0 0x7f058006e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f05886cc700 1 -- 172.21.15.33:0/2475396372 >> 172.21.15.33:0/2475396372 conn(0x7f05800cc300 msgr2=0x7f05800cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe200052b0 con 0x7fbe4415da70 2023-10-09T15:31:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f35161a0700 1 -- 172.21.15.33:0/665004423 shutdown_connections 2023-10-09T15:31:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7f35161a0700 1 -- 172.21.15.33:0/665004423 wait complete. 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4581508c0 0x7fa45813e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa458150c90 0x7fa45813eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816bb50 con 0x7fa45815a7d0 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816fd90 con 0x7fa458150c90 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.382+0000 7fa46052f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa45816f180 con 0x7fa4581508c0 2023-10-09T15:31:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbe38011d00 con 0x7fbe4415da70 2023-10-09T15:31:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42546/0 (socket says 172.21.15.33:42546) 2023-10-09T15:31:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 -- 172.21.15.33:0/1257298956 learned_addr learned my addr 172.21.15.33:0/1257298956 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fbe32ffd700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 0x7fbe28069480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 -- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4581508c0 msgr2=0x7fa45813e570 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4581508c0 0x7fa45813e570 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 -- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa458150c90 msgr2=0x7fa45813eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa458150c90 0x7fa45813eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fa45eacc700 1 -- 172.21.15.33:0/1257298956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa450009a20 con 0x7fa45815a7d0 2023-10-09T15:31:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcca00052b0 con 0x7fccbc140e50 2023-10-09T15:31:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.383+0000 7f05886cc700 1 -- 172.21.15.33:0/2475396372 shutdown_connections 2023-10-09T15:31:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7f05886cc700 1 -- 172.21.15.33:0/2475396372 wait complete. 2023-10-09T15:31:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fa45eacc700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa45400d890 tx=0x7fa454008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4540125f0 con 0x7fa45815a7d0 2023-10-09T15:31:10.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa454012750 con 0x7fa45815a7d0 2023-10-09T15:31:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa454012b10 con 0x7fa45815a7d0 2023-10-09T15:31:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fccac013470 con 0x7fccbc140e50 2023-10-09T15:31:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f80480219d0 con 0x7f804c0cb810 2023-10-09T15:31:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7f80417fa700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 0x7f8030069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8048085ed0 con 0x7f804c0cb810 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f805122a700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 0x7f8030069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7f35161a0700 1 Processor -- start 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.384+0000 7fccaa7fc700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 0x7fcca4069610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fccac0847b0 con 0x7fccbc140e50 2023-10-09T15:31:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7fccba59c700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 0x7fcca4069610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7fbe42d9d700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 0x7fbe28069480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f05886cc700 1 Processor -- start 2023-10-09T15:31:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f805122a700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 0x7f8030069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8044007990 tx=0x7f8044009780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f35161a0700 1 -- start start 2023-10-09T15:31:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa45816f4c0 con 0x7fa45815a7d0 2023-10-09T15:31:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa458171af0 con 0x7fa45815a7d0 2023-10-09T15:31:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7fbe42d9d700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 0x7fbe28069480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe440c8e10 tx=0x7fbe3c009780 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7fccba59c700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 0x7fcca4069610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccb4003440 tx=0x7fccb4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.385+0000 7f05886cc700 1 -- start start 2023-10-09T15:31:10.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35100b0470 0x7f3510149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 0x7f3510171f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3510148de0 con 0x7f351015b9b0 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35101481d0 con 0x7f351015b5e0 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f35161a0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35101484b0 con 0x7f35100b0470 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 0x7f3510171f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:50044/0 (socket says 172.21.15.33:50044) 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 -- 172.21.15.33:0/3176489050 learned_addr learned my addr 172.21.15.33:0/3176489050 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 0x7f3510171f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42552/0 (socket says 172.21.15.33:42552) 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f05886cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f05886cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 0x7f058014ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.386+0000 7f05886cc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05800cbcb0 0x7f0580150a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f05886cc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05801461e0 con 0x7f05800cbcb0 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f05886cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0580144270 con 0x7f058006e930 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f05886cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058014c710 con 0x7f05800cb8e0 2023-10-09T15:31:10.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa45804c3c0 con 0x7fa45815a7d0 2023-10-09T15:31:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:50058/0 (socket says 172.21.15.33:50058) 2023-10-09T15:31:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 -- 172.21.15.33:0/3633208173 learned_addr learned my addr 172.21.15.33:0/3633208173 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0585c67700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 0x7f058014ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 -- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35100b0470 msgr2=0x7f3510149270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35100b0470 0x7f3510149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 -- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 msgr2=0x7f3510171f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 0x7f3510171f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 -- 172.21.15.33:0/3176489050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3504009420 con 0x7f351015b5e0 2023-10-09T15:31:10.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f350effd700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f350000d860 tx=0x7f3500008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 -- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 msgr2=0x7f058014ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 0x7f058014ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 -- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05800cbcb0 msgr2=0x7f0580150a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05800cbcb0 0x7f0580150a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0586468700 1 -- 172.21.15.33:0/3633208173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0578005da0 con 0x7f058006e930 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7f0585c67700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 0x7f058014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:10.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.387+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa45401e460 con 0x7fa45815a7d0 2023-10-09T15:31:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7f0586468700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f057000b630 tx=0x7f05700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7fa44e7fc700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 0x7fa43c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbe38054910 con 0x7fbe4415da70 2023-10-09T15:31:10.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa454084bc0 con 0x7fa45815a7d0 2023-10-09T15:31:10.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7fa45e2cb700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 0x7fa43c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80480531d0 con 0x7f804c0cb810 2023-10-09T15:31:10.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.388+0000 7fa45e2cb700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 0x7fa43c0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4480096e0 tx=0x7fa448006be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35000125f0 con 0x7f351015b5e0 2023-10-09T15:31:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3510148790 con 0x7f351015b5e0 2023-10-09T15:31:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000f510 con 0x7f058006e930 2023-10-09T15:31:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35101497b0 con 0x7f351015b5e0 2023-10-09T15:31:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fccac051980 con 0x7fccbc140e50 2023-10-09T15:31:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.392+0000 7f68b97f9700 1 Processor -- start 2023-10-09T15:31:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.393+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05801458b0 con 0x7f058006e930 2023-10-09T15:31:10.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.393+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0580145e70 con 0x7f058006e930 2023-10-09T15:31:10.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.393+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f351004c3c0 con 0x7f351015b5e0 2023-10-09T15:31:10.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05801464c0 con 0x7f058006e930 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.393+0000 7f68b97f9700 1 -- start start 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b97f9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68b415da70 0x7f68b415de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b97f9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b406e0c0 con 0x7f68b40c3300 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b97f9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68b415e380 con 0x7f68b40cbf90 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b97f9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68b40c30c0 con 0x7f68b415da70 2023-10-09T15:31:10.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa454051e30 con 0x7fa45815a7d0 2023-10-09T15:31:10.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f68b40c3300 0x7f68b4167820 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48054/0 (socket says 172.21.15.33:48054) 2023-10-09T15:31:10.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b37fe700 1 -- 172.21.15.33:0/1607597382 learned_addr learned my addr 172.21.15.33:0/1607597382 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/1607597382 >> v2:172.21.15.59:3300/0 conn(0x7f68b415da70 0x7f68b415de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.394+0000 7f68b1ffb700 1 -- 172.21.15.33:0/1607597382 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855511927 0 0) 0x7f68b406e0c0 con 0x7f68b40c3300 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.395+0000 7f68b1ffb700 1 -- 172.21.15.33:0/1607597382 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f689c003570 con 0x7f68b40c3300 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.395+0000 7f68b2ffd700 1 -- 172.21.15.33:0/1607597382 >> v1:172.21.15.59:6789/0 conn(0x7f68b40cbf90 legacy=0x7f68b40c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.395+0000 7f68b2ffd700 1 -- 172.21.15.33:0/1607597382 >> v1:172.21.15.33:6789/0 conn(0x7f68b40c3300 legacy=0x7f68b4167820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.395+0000 7f68b2ffd700 1 -- 172.21.15.33:0/1607597382 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68b406cc20 con 0x7f68b415da70 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.395+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/1607597382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b415da70 0x7f68b415de40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f68a80098e0 tx=0x7f68a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bb33e1eda9b88ae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f68b1ffb700 1 -- 172.21.15.33:0/1607597382 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800b640 con 0x7f68b415da70 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057000f880 con 0x7f058006e930 2023-10-09T15:31:10.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057000fa10 con 0x7f058006e930 2023-10-09T15:31:10.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f68b1ffb700 1 -- 172.21.15.33:0/1607597382 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800b7a0 con 0x7f68b415da70 2023-10-09T15:31:10.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f68b1ffb700 1 -- 172.21.15.33:0/1607597382 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a800bb20 con 0x7f68b415da70 2023-10-09T15:31:10.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.398+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbe38050550 con 0x7fbe4415da70 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 -- 172.21.15.33:0/1607597382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b415da70 msgr2=0x7f68b415de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 --2- 172.21.15.33:0/1607597382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b415da70 0x7f68b415de40 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f68a80098e0 tx=0x7f68a80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 -- 172.21.15.33:0/1607597382 shutdown_connections 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 --2- 172.21.15.33:0/1607597382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b415da70 0x7f68b415de40 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 -- 172.21.15.33:0/1607597382 >> 172.21.15.33:0/1607597382 conn(0x7f68b40ccb60 msgr2=0x7f68b40ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 -- 172.21.15.33:0/1607597382 shutdown_connections 2023-10-09T15:31:10.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f68b97f9700 1 -- 172.21.15.33:0/1607597382 wait complete. 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f057000fb70 con 0x7f058006e930 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f05767fc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 0x7f05640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.399+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f05700846d0 con 0x7f058006e930 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.400+0000 7f0585c67700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 0x7f05640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.400+0000 7f0585c67700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 0x7f05640693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0580155870 tx=0x7f057c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f68b97f9700 1 Processor -- start 2023-10-09T15:31:10.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3500012960 con 0x7f351015b5e0 2023-10-09T15:31:10.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.397+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3500012ad0 con 0x7f351015b5e0 2023-10-09T15:31:10.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.400+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3500012c30 con 0x7f351015b5e0 2023-10-09T15:31:10.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f34f77fe700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f35000853f0 con 0x7f351015b5e0 2023-10-09T15:31:10.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f350f7fe700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f350f7fe700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 0x7f34fc0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35040098e0 tx=0x7f3504016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.401+0000 7f68b97f9700 1 -- start start 2023-10-09T15:31:10.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 0x7f68b416dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b40cbf90 0x7f68b4159af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b415fe70 con 0x7f68b415da70 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68b416e7b0 con 0x7f68b40c3300 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b97f9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68b416ea90 con 0x7f68b40cbf90 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b27fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b40cbf90 0x7f68b4159af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42568/0 (socket says 172.21.15.33:42568) 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b37fe700 1 -- 172.21.15.33:0/2689444051 learned_addr learned my addr 172.21.15.33:0/2689444051 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.402+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 0x7f68b416dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f398b418700 1 Processor -- start 2023-10-09T15:31:10.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 -- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b40cbf90 msgr2=0x7f68b4159af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b40cbf90 0x7f68b4159af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 -- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 msgr2=0x7f68b415a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 -- 172.21.15.33:0/2689444051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68a8009420 con 0x7f68b40c3300 2023-10-09T15:31:10.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b37fe700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:10.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f398b418700 1 -- start start 2023-10-09T15:31:10.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.403+0000 7f68b2ffd700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 0x7f68b416dcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68a8016000 tx=0x7f68a8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.404+0000 7f398b418700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f39840b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.404+0000 7f398b418700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f398415cf20 0x7f39840b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.404+0000 7f398b418700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f398415ad50 con 0x7f39840b0710 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.404+0000 7f398b418700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f398415a140 con 0x7f398415cf20 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.404+0000 7f398b418700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f398415a420 con 0x7f398415cb50 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39891b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f39840b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39899b5700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f39840b0710 0x7f39841536c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:42744/0 (socket says 172.21.15.33:42744) 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39899b5700 1 -- 172.21.15.33:0/3902957359 learned_addr learned my addr 172.21.15.33:0/3902957359 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 --2- 172.21.15.33:0/3902957359 >> v2:172.21.15.33:3300/0 conn(0x7f398415cf20 0x7f39840b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 -- 172.21.15.33:0/3902957359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 msgr2=0x7f39840b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 --2- 172.21.15.33:0/3902957359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f39840b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 -- 172.21.15.33:0/3902957359 >> v1:172.21.15.59:6789/0 conn(0x7f39840b0710 legacy=0x7f39841536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 -- 172.21.15.33:0/3902957359 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f398415a700 con 0x7f398415cf20 2023-10-09T15:31:10.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f39889b3700 1 --2- 172.21.15.33:0/3902957359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398415cf20 0x7f39840b27d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f39740098e0 tx=0x7f39740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6511301b029768b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f397bfff700 1 -- 172.21.15.33:0/3902957359 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3974009e80 con 0x7f398415cf20 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f397bfff700 1 -- 172.21.15.33:0/3902957359 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397400b860 con 0x7f398415cf20 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.405+0000 7f397bfff700 1 -- 172.21.15.33:0/3902957359 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397400bc20 con 0x7f398415cf20 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 -- 172.21.15.33:0/3902957359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398415cf20 msgr2=0x7f39840b27d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 --2- 172.21.15.33:0/3902957359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398415cf20 0x7f39840b27d0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f39740098e0 tx=0x7f39740091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 -- 172.21.15.33:0/3902957359 shutdown_connections 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 --2- 172.21.15.33:0/3902957359 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f39840b01d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 --2- 172.21.15.33:0/3902957359 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f398415cf20 0x7f39840b27d0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.406+0000 7f398b418700 1 -- 172.21.15.33:0/3902957359 >> 172.21.15.33:0/3902957359 conn(0x7f39840cded0 msgr2=0x7f398406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8000c90 con 0x7f68b40c3300 2023-10-09T15:31:10.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68a800b910 con 0x7f68b40c3300 2023-10-09T15:31:10.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68a8025670 con 0x7f68b40c3300 2023-10-09T15:31:10.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f398b418700 1 -- 172.21.15.33:0/3902957359 shutdown_connections 2023-10-09T15:31:10.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0570051a60 con 0x7f058006e930 2023-10-09T15:31:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.407+0000 7f398b418700 1 -- 172.21.15.33:0/3902957359 wait complete. 2023-10-09T15:31:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.409+0000 7f398b418700 1 Processor -- start 2023-10-09T15:31:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.409+0000 7f398b418700 1 -- start start 2023-10-09T15:31:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f398406b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f398415cf20 0x7f398406b820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39840af120 con 0x7f39840b0710 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398416ce50 con 0x7f398415cf20 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f398b418700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39840c43b0 con 0x7f398415cb50 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f39891b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f39891b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42572/0 (socket says 172.21.15.33:42572) 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f39891b4700 1 -- 172.21.15.33:0/3111730487 learned_addr learned my addr 172.21.15.33:0/3111730487 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f39889b3700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f398406b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.410+0000 7f39899b5700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f398415cf20 0x7f398406b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 -- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 msgr2=0x7f398406b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f398406b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 -- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f398415cf20 msgr2=0x7f398406b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f398415cf20 0x7f398406b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 -- 172.21.15.33:0/3111730487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3974009420 con 0x7f39840b0710 2023-10-09T15:31:10.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3500052660 con 0x7f351015b5e0 2023-10-09T15:31:10.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39891b4700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e190 tx=0x7f397c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c00ed20 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39840c37a0 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39840c3d60 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f397c00ee80 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.411+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f397c009a80 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.412+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39640052b0 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.413+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f397c014840 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.414+0000 7f39797fa700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.414+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f397c084c70 con 0x7f39840b0710 2023-10-09T15:31:10.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.414+0000 7f39889b3700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.414+0000 7f39889b3700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39740098e0 tx=0x7f3974017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.417+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68b415fb00 con 0x7f68b40c3300 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.417+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68b416e230 con 0x7f68b40c3300 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.418+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68b404c3c0 con 0x7f68b40c3300 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.418+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68a8023070 con 0x7f68b40c3300 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.419+0000 7f689affd700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 0x7f68a00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.419+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68a80854a0 con 0x7f68b40c3300 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.419+0000 7f68b27fc700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 0x7f68a00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.419+0000 7f68b27fc700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 0x7f68a00693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68b415e5d0 tx=0x7f68a4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:10.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.422+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f397c051ee0 con 0x7f39840b0710 2023-10-09T15:31:10.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.423+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68a80527c0 con 0x7f68b40c3300 2023-10-09T15:31:10.779 INFO:teuthology.orchestra.run.smithi033.stdout:55834574852 2023-10-09T15:31:10.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.776+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f804c16aca0 con 0x7f804c0cb810 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.777+0000 7f80417fa700 1 -- 172.21.15.33:0/4213979286 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8048026090 con 0x7f804c0cb810 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 msgr2=0x7f8030069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 0x7f8030069460 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8044007990 tx=0x7f8044009780 comp rx=0 tx=0).stop 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 msgr2=0x7f804c16ed40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8048006fa0 tx=0x7f8048017000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 shutdown_connections 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8030066fb0 0x7f8030069460 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f804c0b1cd0 0x7f804c17f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f804c16f280 0x7f804c16afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 --2- 172.21.15.33:0/4213979286 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f804c0cb810 0x7f804c16ed40 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 >> 172.21.15.33:0/4213979286 conn(0x7f804c0cc300 msgr2=0x7f804c06b440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 shutdown_connections 2023-10-09T15:31:10.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fcca0005560 con 0x7fccbc140e50 2023-10-09T15:31:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7f805348e700 1 -- 172.21.15.33:0/4213979286 wait complete. 2023-10-09T15:31:10.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.785+0000 7fccaa7fc700 1 -- 172.21.15.33:0/2324337805 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fccac054fa0 con 0x7fccbc140e50 2023-10-09T15:31:10.789 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 msgr2=0x7fcca4069610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 0x7fcca4069610 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccb4003440 tx=0x7fccb4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 msgr2=0x7fccbc13fd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fccac00e930 tx=0x7fccac0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 shutdown_connections 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcca4067160 0x7fcca4069610 secure :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fccb4003440 tx=0x7fccb4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.789+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fccbc0af560 0x7fccbc15dd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.790+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fccbc15b750 0x7fccbc140280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.790+0000 7fccc0aea700 1 --2- 172.21.15.33:0/2324337805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fccbc140e50 0x7fccbc13fd40 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.790+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 >> 172.21.15.33:0/2324337805 conn(0x7fccbc0cded0 msgr2=0x7fccbc0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.797+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 shutdown_connections 2023-10-09T15:31:10.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.797+0000 7fccc0aea700 1 -- 172.21.15.33:0/2324337805 wait complete. 2023-10-09T15:31:10.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.802+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fa458159270 con 0x7fa45815a7d0 2023-10-09T15:31:10.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.802+0000 7fa44e7fc700 1 -- 172.21.15.33:0/1257298956 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa454055450 con 0x7fa45815a7d0 2023-10-09T15:31:10.804 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2023-10-09T15:31:10.806 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 msgr2=0x7fa43c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 0x7fa43c0694b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4480096e0 tx=0x7fa448006be0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 msgr2=0x7fa4581715b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fa45400d890 tx=0x7fa454008040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 shutdown_connections 2023-10-09T15:31:10.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa43c067000 0x7fa43c0694b0 secure :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fa4480096e0 tx=0x7fa448006be0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa45815a7d0 0x7fa4581715b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4581508c0 0x7fa45813e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 --2- 172.21.15.33:0/1257298956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa458150c90 0x7fa45813eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 >> 172.21.15.33:0/1257298956 conn(0x7fa4580cded0 msgr2=0x7fa4580b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.806+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fbe20005830 con 0x7fbe4415da70 2023-10-09T15:31:10.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.807+0000 7fbe32ffd700 1 -- 172.21.15.33:0/2065706652 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbe38017070 con 0x7fbe4415da70 2023-10-09T15:31:10.809 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:10.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.810+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 msgr2=0x7fbe28069480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.810+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 0x7fbe28069480 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fbe440c8e10 tx=0x7fbe3c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:10.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.810+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 msgr2=0x7fbe440c7410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.810+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 0x7fbe440c7410 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fbe3800c490 tx=0x7fbe38007e20 comp rx=0 tx=0).stop 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3510148f20 con 0x7f351015b5e0 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 shutdown_connections 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbe28066fd0 0x7fbe28069480 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbe4415da70 0x7fbe440c7410 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbe440c3300 0x7fbe4413a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 --2- 172.21.15.33:0/2065706652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbe440cbf90 0x7fbe4415f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 >> 172.21.15.33:0/2065706652 conn(0x7fbe440ccb60 msgr2=0x7fbe4415b100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 shutdown_connections 2023-10-09T15:31:10.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 shutdown_connections 2023-10-09T15:31:10.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fbe49015700 1 -- 172.21.15.33:0/2065706652 wait complete. 2023-10-09T15:31:10.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.813+0000 7fa46052f700 1 -- 172.21.15.33:0/1257298956 wait complete. 2023-10-09T15:31:10.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.814+0000 7f34f77fe700 1 -- 172.21.15.33:0/3176489050 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3500055c80 con 0x7f351015b5e0 2023-10-09T15:31:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.818+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f058004c3c0 con 0x7f058006e930 2023-10-09T15:31:10.819 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.818+0000 7f05767fc700 1 -- 172.21.15.33:0/3633208173 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0570055080 con 0x7f058006e930 2023-10-09T15:31:10.820 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.2 2023-10-09T15:31:10.820 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.820+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 msgr2=0x7f34fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.820+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 0x7f34fc0693e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f35040098e0 tx=0x7f3504016000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.820+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 msgr2=0x7f3510171a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.820+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f350000d860 tx=0x7f3500008040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 shutdown_connections 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34fc066f30 0x7f34fc0693e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f351015b9b0 0x7f3510171f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35100b0470 0x7f3510149270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 --2- 172.21.15.33:0/3176489050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f351015b5e0 0x7f3510171a20 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f350000d860 tx=0x7f3500008040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.821+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 >> 172.21.15.33:0/3176489050 conn(0x7f35100cded0 msgr2=0x7f351006bcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.822+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 msgr2=0x7f05640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.822+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 0x7f05640693e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f0580155870 tx=0x7f057c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.822+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 msgr2=0x7f058014c0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.822+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f057000b630 tx=0x7f05700091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.824+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f3964005830 con 0x7f39840b0710 2023-10-09T15:31:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.824+0000 7f39797fa700 1 -- 172.21.15.33:0/3111730487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f397c055500 con 0x7f39840b0710 2023-10-09T15:31:10.825 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:10.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 shutdown_connections 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0564066f30 0x7f05640693e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05800cbcb0 0x7f0580150a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058006e930 0x7f058014c0a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 --2- 172.21.15.33:0/3633208173 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05800cb8e0 0x7f058014ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 >> 172.21.15.33:0/3633208173 conn(0x7f05800cc300 msgr2=0x7f058006ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 shutdown_connections 2023-10-09T15:31:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 shutdown_connections 2023-10-09T15:31:10.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.825+0000 7f05886cc700 1 -- 172.21.15.33:0/3633208173 wait complete. 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.826+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 msgr2=0x7f39680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.826+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 0x7f39680693e0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f39740098e0 tx=0x7f3974017000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.826+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 msgr2=0x7f398416c910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.826+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f397c00e190 tx=0x7f397c009920 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 shutdown_connections 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3968066f30 0x7f39680693e0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39840b0710 0x7f398416c910 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f398415cf20 0x7f398406b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 --2- 172.21.15.33:0/3111730487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f398415cb50 0x7f398406b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 >> 172.21.15.33:0/3111730487 conn(0x7f39840cded0 msgr2=0x7f39840cc740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 shutdown_connections 2023-10-09T15:31:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.827+0000 7f398b418700 1 -- 172.21.15.33:0/3111730487 wait complete. 2023-10-09T15:31:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.828+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f68b40ca9d0 con 0x7f68b40c3300 2023-10-09T15:31:10.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.828+0000 7f689affd700 1 -- 172.21.15.33:0/2689444051 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f68a8015020 con 0x7f68b40c3300 2023-10-09T15:31:10.829 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2023-10-09T15:31:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.832+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 msgr2=0x7f68a00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.832+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 0x7f68a00693e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f68b415e5d0 tx=0x7f68a4009040 comp rx=0 tx=0).stop 2023-10-09T15:31:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.832+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 msgr2=0x7f68b416dcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.832+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 0x7f68b416dcf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f68a8016000 tx=0x7f68a8017000 comp rx=0 tx=0).stop 2023-10-09T15:31:10.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f35161a0700 1 -- 172.21.15.33:0/3176489050 wait complete. 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 shutdown_connections 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68a0066f30 0x7f68a00693e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68b415da70 0x7f68b415a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68b40c3300 0x7f68b416dcf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 --2- 172.21.15.33:0/2689444051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68b40cbf90 0x7f68b4159af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 >> 172.21.15.33:0/2689444051 conn(0x7f68b40ccb60 msgr2=0x7f68b415aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 shutdown_connections 2023-10-09T15:31:10.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:10.833+0000 7f68b97f9700 1 -- 172.21.15.33:0/2689444051 wait complete. 2023-10-09T15:31:10.837 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574855 for osd.1 2023-10-09T15:31:10.838 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.4 2023-10-09T15:31:10.844 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.7 2023-10-09T15:31:10.850 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.6 2023-10-09T15:31:10.851 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574854 for osd.5 2023-10-09T15:31:10.854 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.0 2023-10-09T15:31:11.808 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-10-09T15:31:11.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-10-09T15:31:11.837 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-10-09T15:31:11.839 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-10-09T15:31:11.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-10-09T15:31:11.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-10-09T15:31:11.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-10-09T15:31:11.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-10-09T15:31:11.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.996+0000 7f5ebfac0700 1 Processor -- start 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.996+0000 7f5ebfac0700 1 -- start start 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebfac0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 0x7f5eb815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebfac0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb8160fb0 con 0x7f5eb815db00 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebfac0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb81603a0 con 0x7f5eb8161440 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebfac0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8160680 con 0x7f5eb80b0120 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebd85c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5eb815db00 0x7f5eb80b1b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38818/0 (socket says 172.21.15.33:38818) 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebd85c700 1 -- 172.21.15.33:0/2955418190 learned_addr learned my addr 172.21.15.33:0/2955418190 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:11.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.998+0000 7f5ebe05d700 1 --2- 172.21.15.33:0/2955418190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 0x7f5eb815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.999+0000 7f5ebe05d700 1 -- 172.21.15.33:0/2955418190 >> v1:172.21.15.59:6789/0 conn(0x7f5eb8161440 legacy=0x7f5eb80afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.999+0000 7f5ebe05d700 1 -- 172.21.15.33:0/2955418190 >> v1:172.21.15.33:6789/0 conn(0x7f5eb815db00 legacy=0x7f5eb80b1b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.999+0000 7f5ebe05d700 1 -- 172.21.15.33:0/2955418190 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb8160960 con 0x7f5eb80b0120 2023-10-09T15:31:12.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:11.999+0000 7f5ebe05d700 1 --2- 172.21.15.33:0/2955418190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 0x7f5eb815eee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009e90 tx=0x7f5eb0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=babac1fc8b431537 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.000+0000 7f5ebc85a700 1 -- 172.21.15.33:0/2955418190 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb000e070 con 0x7f5eb80b0120 2023-10-09T15:31:12.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.000+0000 7f5ebc85a700 1 -- 172.21.15.33:0/2955418190 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb000bbf0 con 0x7f5eb80b0120 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.000+0000 7f5ebc85a700 1 -- 172.21.15.33:0/2955418190 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb0012430 con 0x7f5eb80b0120 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.001+0000 7f5ebfac0700 1 -- 172.21.15.33:0/2955418190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 msgr2=0x7f5eb815eee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.001+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/2955418190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 0x7f5eb815eee0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f5eb0009e90 tx=0x7f5eb0009780 comp rx=0 tx=0).stop 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.002+0000 7f5ebfac0700 1 -- 172.21.15.33:0/2955418190 shutdown_connections 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.002+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/2955418190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb80b0120 0x7f5eb815eee0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.002+0000 7f5ebfac0700 1 -- 172.21.15.33:0/2955418190 >> 172.21.15.33:0/2955418190 conn(0x7f5eb806d170 msgr2=0x7f5eb80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.002+0000 7f5ebfac0700 1 -- 172.21.15.33:0/2955418190 shutdown_connections 2023-10-09T15:31:12.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.002+0000 7f5ebfac0700 1 -- 172.21.15.33:0/2955418190 wait complete. 2023-10-09T15:31:12.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.004+0000 7f5ebfac0700 1 Processor -- start 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.004+0000 7f5ebfac0700 1 -- start start 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb80b0120 0x7f5eb8151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb8161440 0x7f5eb8156090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8156a20 con 0x7f5eb81565d0 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8161950 con 0x7f5eb80b0120 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.005+0000 7f5ebfac0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb8161c30 con 0x7f5eb8161440 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52980/0 (socket says 172.21.15.33:52980) 2023-10-09T15:31:12.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 -- 172.21.15.33:0/209460020 learned_addr learned my addr 172.21.15.33:0/209460020 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebd05b700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb8161440 0x7f5eb8156090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 -- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb8161440 msgr2=0x7f5eb8156090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb8161440 0x7f5eb8156090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 -- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb80b0120 msgr2=0x7f5eb8151670 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb80b0120 0x7f5eb8151670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.006+0000 7f5ebe05d700 1 -- 172.21.15.33:0/209460020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0009a20 con 0x7f5eb81565d0 2023-10-09T15:31:12.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.007+0000 7f5ebe05d700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb0018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.010+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb001e640 con 0x7f5eb81565d0 2023-10-09T15:31:12.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.010+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5eb001e7a0 con 0x7f5eb81565d0 2023-10-09T15:31:12.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.010+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5eb001eb40 con 0x7f5eb81565d0 2023-10-09T15:31:12.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.010+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb8161f10 con 0x7f5eb81565d0 2023-10-09T15:31:12.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.010+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb8150190 con 0x7f5eb81565d0 2023-10-09T15:31:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.016+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e980052b0 con 0x7f5eb81565d0 2023-10-09T15:31:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.018+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5eb0024070 con 0x7f5eb81565d0 2023-10-09T15:31:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.019+0000 7f5eadffb700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 0x7f5e9c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.019+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5eb0086fd0 con 0x7f5eb81565d0 2023-10-09T15:31:12.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.020+0000 7f5ebd85c700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 0x7f5e9c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.020+0000 7f5ebd85c700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 0x7f5e9c069530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40058d0 tx=0x7f5eb4007ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.028+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5eb0054220 con 0x7f5eb81565d0 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.041+0000 7f47d09ed700 1 Processor -- start 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.041+0000 7f47d09ed700 1 -- start start 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.042+0000 7f47d09ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47cc0b1f90 0x7f47cc0af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.042+0000 7f47d09ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc15f4f0 0x7f47cc0afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.042+0000 7f47d09ed700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47cc0ad3d0 con 0x7f47cc161150 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.042+0000 7f47d09ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47cc0aed90 con 0x7f47cc0b1f90 2023-10-09T15:31:12.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.042+0000 7f47d09ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc15e1c0 con 0x7f47cc15f4f0 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47cc0b1f90 0x7f47cc0af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47cc0b1f90 0x7f47cc0af970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53064/0 (socket says 172.21.15.33:53064) 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 -- 172.21.15.33:0/536864431 learned_addr learned my addr 172.21.15.33:0/536864431 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47cad9d700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc15f4f0 0x7f47cc0afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 -- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc15f4f0 msgr2=0x7f47cc0afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc15f4f0 0x7f47cc0afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 -- 172.21.15.33:0/536864431 >> v1:172.21.15.33:6789/0 conn(0x7f47cc161150 legacy=0x7f47cc0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.043+0000 7f47c9d9b700 1 -- 172.21.15.33:0/536864431 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc0ad620 con 0x7f47cc0b1f90 2023-10-09T15:31:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.045+0000 7f47c9d9b700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc0b1f90 0x7f47cc0af970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009f20 tx=0x7f47c4009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba71903201a010e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.047+0000 7f47c959a700 1 -- 172.21.15.33:0/536864431 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c400e070 con 0x7f47cc0b1f90 2023-10-09T15:31:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.047+0000 7f47c959a700 1 -- 172.21.15.33:0/536864431 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c400ba40 con 0x7f47cc0b1f90 2023-10-09T15:31:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.047+0000 7f47c959a700 1 -- 172.21.15.33:0/536864431 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c40092e0 con 0x7f47cc0b1f90 2023-10-09T15:31:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 -- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc0b1f90 msgr2=0x7f47cc0af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc0b1f90 0x7f47cc0af970 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009f20 tx=0x7f47c4009840 comp rx=0 tx=0).stop 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 -- 172.21.15.33:0/536864431 shutdown_connections 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc15f4f0 0x7f47cc0afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 --2- 172.21.15.33:0/536864431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc0b1f90 0x7f47cc0af970 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 -- 172.21.15.33:0/536864431 >> 172.21.15.33:0/536864431 conn(0x7f47cc0cc300 msgr2=0x7f47cc0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 -- 172.21.15.33:0/536864431 shutdown_connections 2023-10-09T15:31:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.049+0000 7f47d09ed700 1 -- 172.21.15.33:0/536864431 wait complete. 2023-10-09T15:31:12.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.051+0000 7f47d09ed700 1 Processor -- start 2023-10-09T15:31:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.051+0000 7f47d09ed700 1 -- start start 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc15f4f0 0x7f47cc149650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc161150 0x7f47cc149b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc13bd00 con 0x7f47cc0b1f90 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc13b0f0 con 0x7f47cc15f4f0 2023-10-09T15:31:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47d09ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc13b3d0 con 0x7f47cc161150 2023-10-09T15:31:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47ca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52990/0 (socket says 172.21.15.33:52990) 2023-10-09T15:31:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47ca59c700 1 -- 172.21.15.33:0/1228624185 learned_addr learned my addr 172.21.15.33:0/1228624185 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.052+0000 7f47c9d9b700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc15f4f0 0x7f47cc149650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 -- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc161150 msgr2=0x7f47cc149b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc161150 0x7f47cc149b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 -- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc15f4f0 msgr2=0x7f47cc149650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc15f4f0 0x7f47cc149650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 -- 172.21.15.33:0/1228624185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47c4009ae0 con 0x7f47cc0b1f90 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ca59c700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b5e0 tx=0x7f47bc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.053+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00f510 con 0x7f47cc0b1f90 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.054+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47bc00f690 con 0x7f47cc0b1f90 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.054+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47bc00fa50 con 0x7f47cc0b1f90 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.054+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47cc13b6b0 con 0x7f47cc0b1f90 2023-10-09T15:31:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.054+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47cc148830 con 0x7f47cc0b1f90 2023-10-09T15:31:12.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.056+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47cc0adf10 con 0x7f47cc0b1f90 2023-10-09T15:31:12.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.057+0000 7fa77949f700 1 Processor -- start 2023-10-09T15:31:12.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.057+0000 7fa77949f700 1 -- start start 2023-10-09T15:31:12.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.057+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47bc01a400 con 0x7f47cc0b1f90 2023-10-09T15:31:12.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7f47ba7fc700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 0x7f47ac069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47bc084120 con 0x7f47cc0b1f90 2023-10-09T15:31:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa77949f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 0x7fa7740cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa77949f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 0x7fa7740cb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa77949f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa774167a60 con 0x7fa7740b1cd0 2023-10-09T15:31:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa77949f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa774167130 con 0x7fa7740b1880 2023-10-09T15:31:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa77949f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa774167410 con 0x7fa7740b0080 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa7737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 0x7fa7740cb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa7737fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 0x7fa7740cb810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53074/0 (socket says 172.21.15.33:53074) 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.058+0000 7fa7737fe700 1 -- 172.21.15.33:0/3492600829 learned_addr learned my addr 172.21.15.33:0/3492600829 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 --2- 172.21.15.33:0/3492600829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 0x7fa7740cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 -- 172.21.15.33:0/3492600829 >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 msgr2=0x7fa7740cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 --2- 172.21.15.33:0/3492600829 >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 0x7fa7740cb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 -- 172.21.15.33:0/3492600829 >> v1:172.21.15.59:6789/0 conn(0x7fa7740b1cd0 legacy=0x7fa7740af970 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 -- 172.21.15.33:0/3492600829 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7741676f0 con 0x7fa7740b0080 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa7727fc700 1 --2- 172.21.15.33:0/3492600829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 0x7fa7740cb2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009e60 tx=0x7fa76c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2ccd18e0e705054b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa771ffb700 1 -- 172.21.15.33:0/3492600829 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c00e070 con 0x7fa7740b0080 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa771ffb700 1 -- 172.21.15.33:0/3492600829 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76c00bbf0 con 0x7fa7740b0080 2023-10-09T15:31:12.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.059+0000 7fa771ffb700 1 -- 172.21.15.33:0/3492600829 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76c012430 con 0x7fa7740b0080 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.060+0000 7fa77949f700 1 -- 172.21.15.33:0/3492600829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 msgr2=0x7fa7740cb2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.060+0000 7fa77949f700 1 --2- 172.21.15.33:0/3492600829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 0x7fa7740cb2d0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fa76c009e60 tx=0x7fa76c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fa77949f700 1 -- 172.21.15.33:0/3492600829 shutdown_connections 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fa77949f700 1 --2- 172.21.15.33:0/3492600829 >> v2:172.21.15.59:3300/0 conn(0x7fa7740b1880 0x7fa7740cb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fa77949f700 1 --2- 172.21.15.33:0/3492600829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7740b0080 0x7fa7740cb2d0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fa77949f700 1 -- 172.21.15.33:0/3492600829 >> 172.21.15.33:0/3492600829 conn(0x7fa7740cc300 msgr2=0x7fa7740cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.060+0000 7fdadaec3700 1 Processor -- start 2023-10-09T15:31:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.060+0000 7fdadaec3700 1 -- start start 2023-10-09T15:31:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdadaec3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad40af970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdadaec3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdad415f4f0 0x7fdad40afeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdadaec3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdad40ad3d0 con 0x7fdad4161150 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdadaec3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdad40aed90 con 0x7fdad415f4f0 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdadaec3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad415e1c0 con 0x7fdad40b1f90 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdad8c5f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fdad4161150 0x7fdad40b1880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36696/0 (socket says 172.21.15.33:36696) 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7fdad8c5f700 1 -- 172.21.15.33:0/2395562664 learned_addr learned my addr 172.21.15.33:0/2395562664 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad9460700 1 --2- 172.21.15.33:0/2395562664 >> v2:172.21.15.59:3300/0 conn(0x7fdad415f4f0 0x7fdad40afeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad37fe700 1 -- 172.21.15.33:0/2395562664 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200529034 0 0) 0x7fdad40ad3d0 con 0x7fdad4161150 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad37fe700 1 -- 172.21.15.33:0/2395562664 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdabc003570 con 0x7fdad4161150 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad3fff700 1 --2- 172.21.15.33:0/2395562664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad40af970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fa77949f700 1 -- 172.21.15.33:0/3492600829 shutdown_connections 2023-10-09T15:31:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad3fff700 1 -- 172.21.15.33:0/2395562664 >> v2:172.21.15.59:3300/0 conn(0x7fdad415f4f0 msgr2=0x7fdad40afeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad3fff700 1 --2- 172.21.15.33:0/2395562664 >> v2:172.21.15.59:3300/0 conn(0x7fdad415f4f0 0x7fdad40afeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad3fff700 1 -- 172.21.15.33:0/2395562664 >> v1:172.21.15.59:6789/0 conn(0x7fdad4161150 legacy=0x7fdad40b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fdad3fff700 1 -- 172.21.15.33:0/2395562664 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad40ad620 con 0x7fdad40b1f90 2023-10-09T15:31:12.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7fa77949f700 1 -- 172.21.15.33:0/3492600829 wait complete. 2023-10-09T15:31:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.061+0000 7f47c9d9b700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 0x7f47ac069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.062+0000 7f47c9d9b700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 0x7f47ac069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009880 tx=0x7f47c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fdad3fff700 1 --2- 172.21.15.33:0/2395562664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad40af970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdac80098e0 tx=0x7fdac80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=62c3b410b1b82bd2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fdad37fe700 1 -- 172.21.15.33:0/2395562664 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac8011630 con 0x7fdad40b1f90 2023-10-09T15:31:12.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fdad37fe700 1 -- 172.21.15.33:0/2395562664 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac80117b0 con 0x7fdad40b1f90 2023-10-09T15:31:12.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fdad37fe700 1 -- 172.21.15.33:0/2395562664 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac8011b70 con 0x7fdad40b1f90 2023-10-09T15:31:12.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7f5eaf886700 1 Processor -- start 2023-10-09T15:31:12.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fa77949f700 1 Processor -- start 2023-10-09T15:31:12.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.064+0000 7fa77949f700 1 -- start start 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fdadaec3700 1 -- 172.21.15.33:0/2395562664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 msgr2=0x7fdad40af970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2395562664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad40af970 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fdac80098e0 tx=0x7fdac80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7740b1880 0x7fa77406ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7741835e0 0x7fa7741581b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa77406b7d0 con 0x7fa7740b0080 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa774155590 con 0x7fa7740b1880 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7fa77949f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa77417f3f0 con 0x7fa7741835e0 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fdadaec3700 1 -- 172.21.15.33:0/2395562664 shutdown_connections 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2395562664 >> v2:172.21.15.59:3300/0 conn(0x7fdad415f4f0 0x7fdad40afeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2395562664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad40af970 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fdadaec3700 1 -- 172.21.15.33:0/2395562664 >> 172.21.15.33:0/2395562664 conn(0x7fdad40cc300 msgr2=0x7fdad40cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fa772ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fa772ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52994/0 (socket says 172.21.15.33:52994) 2023-10-09T15:31:12.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fa772ffd700 1 -- 172.21.15.33:0/871766464 learned_addr learned my addr 172.21.15.33:0/871766464 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.065+0000 7f5eaf886700 1 -- start start 2023-10-09T15:31:12.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ea80ac830 0x7f5ea806e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80accd0 0x7f5ea806e930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea80b20a0 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ea8156ee0 con 0x7f5ea80ac830 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eaf886700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8156c00 con 0x7f5ea80accd0 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5ead622700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5ead622700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53006/0 (socket says 172.21.15.33:53006) 2023-10-09T15:31:12.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47bc054e00 con 0x7f47cc0b1f90 2023-10-09T15:31:12.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fa7727fc700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7740b1880 0x7fa77406ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fdadaec3700 1 -- 172.21.15.33:0/2395562664 shutdown_connections 2023-10-09T15:31:12.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7fa7737fe700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7741835e0 0x7fa7741581b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5ead622700 1 -- 172.21.15.33:0/2336407891 learned_addr learned my addr 172.21.15.33:0/2336407891 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eade23700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80accd0 0x7f5ea806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.066+0000 7f5eace21700 1 --2- 172.21.15.33:0/2336407891 >> v2:172.21.15.59:3300/0 conn(0x7f5ea80ac830 0x7f5ea806e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fdadaec3700 1 -- 172.21.15.33:0/2395562664 wait complete. 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 -- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7741835e0 msgr2=0x7fa7741581b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7741835e0 0x7fa7741581b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 -- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7740b1880 msgr2=0x7fa77406ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7740b1880 0x7fa77406ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 -- 172.21.15.33:0/871766464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa76c009a20 con 0x7fa7740b0080 2023-10-09T15:31:12.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7fa772ffd700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5e0 tx=0x7fa764009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 -- 172.21.15.33:0/2336407891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80accd0 msgr2=0x7f5ea806e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80accd0 0x7f5ea806e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 -- 172.21.15.33:0/2336407891 >> v2:172.21.15.59:3300/0 conn(0x7f5ea80ac830 msgr2=0x7f5ea806e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 --2- 172.21.15.33:0/2336407891 >> v2:172.21.15.59:3300/0 conn(0x7f5ea80ac830 0x7f5ea806e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 -- 172.21.15.33:0/2336407891 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea80abd50 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5ead622700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80ad440 tx=0x7f5ea000d040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8db5e69d0b991bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f6e8ceac700 1 Processor -- start 2023-10-09T15:31:12.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.068+0000 7f6e8ceac700 1 -- start start 2023-10-09T15:31:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.067+0000 7f5e9ffff700 1 -- 172.21.15.33:0/2336407891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea000ccd0 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.068+0000 7f5e9ffff700 1 -- 172.21.15.33:0/2336407891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea000ce30 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.068+0000 7f5e9ffff700 1 -- 172.21.15.33:0/2336407891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea0007d80 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.068+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400f510 con 0x7fa7740b0080 2023-10-09T15:31:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e8ceac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e880abab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e8ceac700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6e880b1410 0x7f6e880b1870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e8ceac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e880b1db0 con 0x7f6e88157920 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e8ceac700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e880acd10 con 0x7f6e880b1410 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e8ceac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e880ac100 con 0x7f6e88157550 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e85d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6e88157920 0x7f6e880ae7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36706/0 (socket says 172.21.15.33:36706) 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e85d9b700 1 -- 172.21.15.33:0/511846990 learned_addr learned my addr 172.21.15.33:0/511846990 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7f6e86d9d700 1 --2- 172.21.15.33:0/511846990 >> v2:172.21.15.33:3300/0 conn(0x7f6e880b1410 0x7f6e880b1870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f5eaf886700 1 -- 172.21.15.33:0/2336407891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 msgr2=0x7f5ea80cbcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80ad440 tx=0x7f5ea000d040 comp rx=0 tx=0).stop 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f6e86d9d700 1 -- 172.21.15.33:0/511846990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 msgr2=0x7f6e880abab0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f6e86d9d700 1 --2- 172.21.15.33:0/511846990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e880abab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f6e86d9d700 1 -- 172.21.15.33:0/511846990 >> v1:172.21.15.59:6789/0 conn(0x7f6e88157920 legacy=0x7f6e880ae7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f6e86d9d700 1 -- 172.21.15.33:0/511846990 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e880ac3e0 con 0x7f6e880b1410 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7f6e86d9d700 1 --2- 172.21.15.33:0/511846990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880b1410 0x7f6e880b1870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009e60 tx=0x7f6e80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c769608d90e1ae70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f6e8559a700 1 -- 172.21.15.33:0/511846990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8000e070 con 0x7f6e880b1410 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f6e8559a700 1 -- 172.21.15.33:0/511846990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e8000bbf0 con 0x7f6e880b1410 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f6e8559a700 1 -- 172.21.15.33:0/511846990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e80012430 con 0x7f6e880b1410 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.068+0000 7fdadaec3700 1 Processor -- start 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7fdadaec3700 1 -- start start 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad413ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 0x7fdad4140df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdad4161150 0x7fdad4141330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40a6430 con 0x7fdad415f4f0 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40a5820 con 0x7fdad4161150 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdadaec3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdad40a5b00 con 0x7fdad40b1f90 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 0x7fdad4140df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdad3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 0x7fdad4140df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53020/0 (socket says 172.21.15.33:53020) 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fdad3fff700 1 -- 172.21.15.33:0/2798807202 learned_addr learned my addr 172.21.15.33:0/2798807202 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad413ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 -- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdad4161150 msgr2=0x7fdad4141330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdad4161150 0x7fdad4141330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 -- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 msgr2=0x7fdad4140df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 0x7fdad4140df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.071+0000 7fdad8c5f700 1 -- 172.21.15.33:0/2798807202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdac8009420 con 0x7fdad40b1f90 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7fdad8c5f700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad413ff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c560 tx=0x7fdac4007d50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa76400f690 con 0x7fa7740b0080 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.069+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa76400fa50 con 0x7fa7740b0080 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa77417ff30 con 0x7fa7740b0080 2023-10-09T15:31:12.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.070+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa77417f8e0 con 0x7fa7740b0080 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa76401a400 con 0x7fa7740b0080 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f5eaf886700 1 -- 172.21.15.33:0/2336407891 shutdown_connections 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80accd0 0x7f5ea806e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2336407891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea80cbcb0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2336407891 >> v2:172.21.15.59:3300/0 conn(0x7f5ea80ac830 0x7f5ea806e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.072+0000 7f5eaf886700 1 -- 172.21.15.33:0/2336407891 >> 172.21.15.33:0/2336407891 conn(0x7f5ea80cc300 msgr2=0x7f5ea80cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f5eaf886700 1 -- 172.21.15.33:0/2336407891 shutdown_connections 2023-10-09T15:31:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f5eaf886700 1 -- 172.21.15.33:0/2336407891 wait complete. 2023-10-09T15:31:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 -- 172.21.15.33:0/511846990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880b1410 msgr2=0x7f6e880b1870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/511846990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880b1410 0x7f6e880b1870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6e80009e60 tx=0x7f6e80009780 comp rx=0 tx=0).stop 2023-10-09T15:31:12.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7fa75affd700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 0x7fa7600694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa764083da0 con 0x7fa7740b0080 2023-10-09T15:31:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 -- 172.21.15.33:0/511846990 shutdown_connections 2023-10-09T15:31:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/511846990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e880b1410 0x7f6e880b1870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/511846990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e880abab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7f6e8ceac700 1 -- 172.21.15.33:0/511846990 >> 172.21.15.33:0/511846990 conn(0x7f6e880cc300 msgr2=0x7f6e880cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.073+0000 7fa7727fc700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 0x7fa7600694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.074+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7540052b0 con 0x7fa7740b0080 2023-10-09T15:31:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.074+0000 7fa7727fc700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 0x7fa7600694b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b0480 tx=0x7fa76c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.074+0000 7f5eaf886700 1 Processor -- start 2023-10-09T15:31:12.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.074+0000 7f6e8ceac700 1 -- 172.21.15.33:0/511846990 shutdown_connections 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.074+0000 7f5eaf886700 1 -- start start 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 0x7f5ea8155100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 0x7f5ea81505c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea8152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea80c98b0 con 0x7f5ea80cb8e0 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea8155640 con 0x7f5ea80accd0 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eaf886700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ea816e240 con 0x7f5ea80ac830 2023-10-09T15:31:12.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5ead622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 0x7f5ea8155100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5ead622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 0x7f5ea8155100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:36836/0 (socket says 172.21.15.33:36836) 2023-10-09T15:31:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5ead622700 1 -- 172.21.15.33:0/2728000529 learned_addr learned my addr 172.21.15.33:0/2728000529 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.075+0000 7f6e8ceac700 1 -- 172.21.15.33:0/511846990 wait complete. 2023-10-09T15:31:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f6e8ceac700 1 Processor -- start 2023-10-09T15:31:12.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f6e8ceac700 1 -- start start 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.076+0000 7f5eace21700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 0x7f5ea81505c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 -- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 msgr2=0x7f5ea8155100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 0x7f5ea8155100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 -- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 msgr2=0x7f5ea8152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea8152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 -- 172.21.15.33:0/2728000529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ea0007790 con 0x7f5ea80accd0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.077+0000 7f5eace21700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 0x7f5ea81505c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400ea50 tx=0x7f5ea40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400c7f0 con 0x7f5ea80accd0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400c950 con 0x7f5ea80accd0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400cd10 con 0x7f5ea80accd0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ea816e520 con 0x7f5ea80accd0 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4005c00 con 0x7fdad40b1f90 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdac4005d80 con 0x7fdad40b1f90 2023-10-09T15:31:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdac4007320 con 0x7fdad40b1f90 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e8806abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e88157920 0x7f6e8806b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e8814e8f0 con 0x7f6e88157920 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88159530 con 0x7f6e880b1410 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8ceac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e88159810 con 0x7f6e88157550 2023-10-09T15:31:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53120/0 (socket says 172.21.15.33:53120) 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 -- 172.21.15.33:0/2657413796 learned_addr learned my addr 172.21.15.33:0/2657413796 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 -- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 msgr2=0x7f6e8806abe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e8806abe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 -- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e88157920 msgr2=0x7f6e8806b120 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e88157920 0x7f6e8806b120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f6e8659c700 1 -- 172.21.15.33:0/2657413796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e80009a20 con 0x7f6e880b1410 2023-10-09T15:31:12.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.078+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ea816eae0 con 0x7f5ea80accd0 2023-10-09T15:31:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.081+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdad40a5de0 con 0x7fdad40b1f90 2023-10-09T15:31:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.081+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad40a54d0 con 0x7fdad40b1f90 2023-10-09T15:31:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.081+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5ea4013680 con 0x7f5ea80accd0 2023-10-09T15:31:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.081+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e880052b0 con 0x7f5ea80accd0 2023-10-09T15:31:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.082+0000 7f6e8659c700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b600 tx=0x7f6e780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.082+0000 7f5e9d7fa700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 0x7f5e8c069530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.082+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ea40846f0 con 0x7f5ea80accd0 2023-10-09T15:31:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.082+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdad40b1a90 con 0x7fdad40b1f90 2023-10-09T15:31:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7f5ead622700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 0x7f5e8c069530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdac401b3b0 con 0x7fdad40b1f90 2023-10-09T15:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7fdad0ff9700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 0x7fdac00694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7fdad3fff700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 0x7fdac00694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdac4083920 con 0x7fdad40b1f90 2023-10-09T15:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.083+0000 7f5ead622700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 0x7f5e8c069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0003440 tx=0x7f5ea0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.084+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa764051170 con 0x7fa7740b0080 2023-10-09T15:31:12.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.084+0000 7fdad3fff700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 0x7fdac00694b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdac80091e0 tx=0x7fdac8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.089+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800f510 con 0x7f6e880b1410 2023-10-09T15:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.089+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e7800f670 con 0x7f6e880b1410 2023-10-09T15:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.089+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e88159af0 con 0x7f6e880b1410 2023-10-09T15:31:12.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.089+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e7800fa30 con 0x7f6e880b1410 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.089+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e88151760 con 0x7f6e880b1410 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.091+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6e7801a400 con 0x7f6e880b1410 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.091+0000 7f6e767fc700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 0x7f6e68069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.091+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6e78084080 con 0x7f6e880b1410 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.092+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdac4050c10 con 0x7fdad40b1f90 2023-10-09T15:31:12.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.092+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e8804c3c0 con 0x7f6e880b1410 2023-10-09T15:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.092+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ea4051960 con 0x7f5ea80accd0 2023-10-09T15:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.092+0000 7f6e85d9b700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 0x7f6e68069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.093+0000 7f6e85d9b700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 0x7f6e68069410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e880ca0a0 tx=0x7f6e7c006be0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.097+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6e78054d60 con 0x7f6e880b1410 2023-10-09T15:31:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.129+0000 7ff020c92700 1 Processor -- start 2023-10-09T15:31:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.129+0000 7ff020c92700 1 -- start start 2023-10-09T15:31:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff020c92700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff01c168f00 0x7ff01c0aff00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff020c92700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c167a60 con 0x7ff01c0b1f90 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff020c92700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff01c166e50 con 0x7ff01c0afb30 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff020c92700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff01c167130 con 0x7ff01c168f00 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff019d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff01c0b1f90 0x7ff01c0cb2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38846/0 (socket says 172.21.15.33:38846) 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.131+0000 7ff019d9b700 1 -- 172.21.15.33:0/988846028 learned_addr learned my addr 172.21.15.33:0/988846028 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.132+0000 7ff01ad9d700 1 --2- 172.21.15.33:0/988846028 >> v2:172.21.15.59:3300/0 conn(0x7ff01c168f00 0x7ff01c0aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.132+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2678664699 0 0) 0x7ff01c166e50 con 0x7ff01c0afb30 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff004003570 con 0x7ff01c0afb30 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820170714 0 0) 0x7ff01c167a60 con 0x7ff01c0b1f90 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01c166e50 con 0x7ff01c0b1f90 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3658650654 0 0) 0x7ff01c166e50 con 0x7ff01c0b1f90 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 >> v2:172.21.15.59:3300/0 conn(0x7ff01c168f00 msgr2=0x7ff01c0aff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 --2- 172.21.15.33:0/988846028 >> v2:172.21.15.59:3300/0 conn(0x7ff01c168f00 0x7ff01c0aff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 >> v1:172.21.15.59:6789/0 conn(0x7ff01c0afb30 legacy=0x7ff01c0b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c167410 con 0x7ff01c0b1f90 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7ff00c001470 con 0x7ff01c0b1f90 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 >> v1:172.21.15.33:6789/0 conn(0x7ff01c0b1f90 legacy=0x7ff01c0cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.133+0000 7ff01959a700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 0x7ff0040062a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01959a700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004006910 0x7ff004008d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01959a700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff004009400 0x7ff00400b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c167130 con 0x7ff004003ea0 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400c0f0 con 0x7ff004006910 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff00400c2b0 con 0x7ff004009400 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff019d9b700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004006910 0x7ff004008d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01ad9d700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff004009400 0x7ff00400b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.134+0000 7ff01a59c700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 0x7ff0040062a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 -- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff004009400 msgr2=0x7ff00400b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff004009400 0x7ff00400b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 -- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004006910 msgr2=0x7ff004008d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004006910 0x7ff004008d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 -- 172.21.15.33:0/988846028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c167410 con 0x7ff004003ea0 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.135+0000 7ff01a59c700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 0x7ff0040062a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff014002080 tx=0x7ff014001720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9c2e14a2ba1aee5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.136+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff014001a10 con 0x7ff004003ea0 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.136+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01400c8b0 con 0x7ff004003ea0 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.136+0000 7ff01959a700 1 -- 172.21.15.33:0/988846028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01400cc50 con 0x7ff004003ea0 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.136+0000 7ff01ad9d700 1 -- 172.21.15.33:0/988846028 reap_dead start 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 -- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 msgr2=0x7ff0040062a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 0x7ff0040062a0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff014002080 tx=0x7ff014001720 comp rx=0 tx=0).stop 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 -- 172.21.15.33:0/988846028 shutdown_connections 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 --2- 172.21.15.33:0/988846028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff004003ea0 0x7ff0040062a0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 -- 172.21.15.33:0/988846028 >> 172.21.15.33:0/988846028 conn(0x7ff01c0cc300 msgr2=0x7ff01c0cc700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 -- 172.21.15.33:0/988846028 shutdown_connections 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7ff020c92700 1 -- 172.21.15.33:0/988846028 wait complete. 2023-10-09T15:31:12.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7ff020c92700 1 Processor -- start 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7ff020c92700 1 -- start start 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.140+0000 7ff020c92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 0x7ff01c0a7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.140+0000 7ff020c92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 0x7ff01c179540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff020c92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff020c92700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c179ee0 con 0x7ff01c179a80 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff020c92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0a8d80 con 0x7ff004003ea0 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff020c92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff01c0a8170 con 0x7ff01c0a7c60 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53062/0 (socket says 172.21.15.33:53062) 2023-10-09T15:31:12.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 -- 172.21.15.33:0/1739874583 learned_addr learned my addr 172.21.15.33:0/1739874583 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01a59c700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 0x7ff01c0a7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff019d9b700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 0x7ff01c179540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 -- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 msgr2=0x7ff01c179540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 0x7ff01c179540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 -- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 msgr2=0x7ff01c0a7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 0x7ff01c0a7720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01ad9d700 1 -- 172.21.15.33:0/1739874583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff01c0a8450 con 0x7ff01c179a80 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.141+0000 7ff01a59c700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 0x7ff01c0a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7ff019d9b700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 0x7ff01c179540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:12.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7ff01ad9d700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff01c16a1b0 tx=0x7ff0100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7f579359e700 1 Processor -- start 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.137+0000 7f579359e700 1 -- start start 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.138+0000 7f579359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5794166260 0x7f579406e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.138+0000 7f579359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57940c7000 0x7f5794087300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.138+0000 7f579359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5794087ca0 con 0x7f5794087840 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.138+0000 7f579359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940c9d00 con 0x7f57940c7000 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.138+0000 7f579359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57940ca5a0 con 0x7f5794166260 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7f5791d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57940c7000 0x7f5794087300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7f5791d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57940c7000 0x7f5794087300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53052/0 (socket says 172.21.15.33:53052) 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7f5791d9b700 1 -- 172.21.15.33:0/2307317005 learned_addr learned my addr 172.21.15.33:0/2307317005 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7f579259c700 1 --2- 172.21.15.33:0/2307317005 >> v2:172.21.15.59:3300/0 conn(0x7f5794166260 0x7f579406e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.139+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 430302497 0 0) 0x7f5784001110 con 0x7f5794087840 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f577c007980 con 0x7f5794087840 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f5791d9b700 1 -- 172.21.15.33:0/2307317005 >> v2:172.21.15.59:3300/0 conn(0x7f5794166260 msgr2=0x7f579406e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f5791d9b700 1 --2- 172.21.15.33:0/2307317005 >> v2:172.21.15.59:3300/0 conn(0x7f5794166260 0x7f579406e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f5791d9b700 1 -- 172.21.15.33:0/2307317005 >> v1:172.21.15.33:6789/0 conn(0x7f5794087840 legacy=0x7f5794169e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f5791d9b700 1 -- 172.21.15.33:0/2307317005 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579406eef0 con 0x7f57940c7000 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.142+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1122811975 0 0) 0x7f577c007980 con 0x7f5794087840 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7f5791d9b700 1 --2- 172.21.15.33:0/2307317005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57940c7000 0x7f5794087300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57940677c0 tx=0x7f578c007510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa1ab993f8d4419 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.144+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784001600 con 0x7f57940c7000 2023-10-09T15:31:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000f770 con 0x7ff01c179a80 2023-10-09T15:31:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01000f8d0 con 0x7ff01c179a80 2023-10-09T15:31:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01000fc70 con 0x7ff01c179a80 2023-10-09T15:31:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff01c0a8730 con 0x7ff01c179a80 2023-10-09T15:31:12.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.143+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff01c1740c0 con 0x7ff01c179a80 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.144+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c014a70 con 0x7f57940c7000 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.144+0000 7f579159a700 1 -- 172.21.15.33:0/2307317005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c014e30 con 0x7f57940c7000 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.145+0000 7f579359e700 1 -- 172.21.15.33:0/2307317005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57940c7000 msgr2=0x7f5794087300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.145+0000 7f579359e700 1 --2- 172.21.15.33:0/2307317005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57940c7000 0x7f5794087300 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f57940677c0 tx=0x7f578c007510 comp rx=0 tx=0).stop 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.145+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff01c0a90f0 con 0x7ff01c179a80 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7f579359e700 1 -- 172.21.15.33:0/2307317005 shutdown_connections 2023-10-09T15:31:12.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7f579359e700 1 --2- 172.21.15.33:0/2307317005 >> v2:172.21.15.59:3300/0 conn(0x7f5794166260 0x7f579406e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7f579359e700 1 --2- 172.21.15.33:0/2307317005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57940c7000 0x7f5794087300 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7f579359e700 1 -- 172.21.15.33:0/2307317005 >> 172.21.15.33:0/2307317005 conn(0x7f579406d130 msgr2=0x7f57940cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.146+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff01001a030 con 0x7ff01c179a80 2023-10-09T15:31:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7ff00a7fc700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 0x7feffc0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.147+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff010018070 con 0x7ff01c179a80 2023-10-09T15:31:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.148+0000 7ff01a59c700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 0x7feffc0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.150+0000 7f579359e700 1 -- 172.21.15.33:0/2307317005 shutdown_connections 2023-10-09T15:31:12.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.150+0000 7ff01a59c700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 0x7feffc0694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0140013d0 tx=0x7ff014016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.152+0000 7f579359e700 1 -- 172.21.15.33:0/2307317005 wait complete. 2023-10-09T15:31:12.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.153+0000 7f579359e700 1 Processor -- start 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.154+0000 7f579359e700 1 -- start start 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5794087840 0x7f57940b07c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57940c7000 0x7f57940aeed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940b0330 con 0x7f5794166260 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57940af720 con 0x7f57940c7000 2023-10-09T15:31:12.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f579359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57940afa00 con 0x7f5794087840 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f5792d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f5792d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53066/0 (socket says 172.21.15.33:53066) 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.155+0000 7f5792d9d700 1 -- 172.21.15.33:0/1843828552 learned_addr learned my addr 172.21.15.33:0/1843828552 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5791d9b700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57940c7000 0x7f57940aeed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f579259c700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5794087840 0x7f57940b07c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff010051cf0 con 0x7ff01c179a80 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 -- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5794087840 msgr2=0x7f57940b07c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5794087840 0x7f57940b07c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 -- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57940c7000 msgr2=0x7f57940aeed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57940c7000 0x7f57940aeed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 -- 172.21.15.33:0/1843828552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f578c009ae0 con 0x7f5794166260 2023-10-09T15:31:12.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.156+0000 7f5792d9d700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5784007b60 tx=0x7f578400a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.157+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578400f070 con 0x7f5794166260 2023-10-09T15:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.157+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578400a2e0 con 0x7f5794166260 2023-10-09T15:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.157+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5784001ce0 con 0x7f5794166260 2023-10-09T15:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.157+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57940afce0 con 0x7f5794166260 2023-10-09T15:31:12.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.157+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57940b0d00 con 0x7f5794166260 2023-10-09T15:31:12.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.161+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5784003300 con 0x7f5794166260 2023-10-09T15:31:12.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.162+0000 7f57827fc700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 0x7f577c069820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.162+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5784084300 con 0x7f5794166260 2023-10-09T15:31:12.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.163+0000 7f579259c700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 0x7f577c069820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.163+0000 7f579259c700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 0x7f577c069820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5788007330 tx=0x7f5788007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.171+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57780052b0 con 0x7f5794166260 2023-10-09T15:31:12.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.180+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57840515d0 con 0x7f5794166260 2023-10-09T15:31:12.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.440+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f5e98005560 con 0x7f5eb81565d0 2023-10-09T15:31:12.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.456+0000 7f5eadffb700 1 -- 172.21.15.33:0/209460020 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5eb0057840 con 0x7f5eb81565d0 2023-10-09T15:31:12.459 INFO:teuthology.orchestra.run.smithi033.stdout:55834574853 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 msgr2=0x7f5e9c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 0x7f5e9c069530 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5eb40058d0 tx=0x7f5eb4007ac0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 msgr2=0x7f5eb8162710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f5eb00097c0 tx=0x7f5eb0018000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 shutdown_connections 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c067080 0x7f5e9c069530 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb81565d0 0x7f5eb8162710 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb80b0120 0x7f5eb8151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 --2- 172.21.15.33:0/209460020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb8161440 0x7f5eb8156090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.465+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 >> 172.21.15.33:0/209460020 conn(0x7f5eb806d170 msgr2=0x7f5eb8159870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.468+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 shutdown_connections 2023-10-09T15:31:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.468+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fdad40a5c40 con 0x7fdad40b1f90 2023-10-09T15:31:12.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.468+0000 7f5ebfac0700 1 -- 172.21.15.33:0/209460020 wait complete. 2023-10-09T15:31:12.469 INFO:teuthology.orchestra.run.smithi033.stdout:55834574856 2023-10-09T15:31:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.468+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f47cc04c3c0 con 0x7f47cc0b1f90 2023-10-09T15:31:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.468+0000 7f47ba7fc700 1 -- 172.21.15.33:0/1228624185 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f47bc054990 con 0x7f47cc0b1f90 2023-10-09T15:31:12.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.469+0000 7fdad0ff9700 1 -- 172.21.15.33:0/2798807202 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdad40a5c40 con 0x7fdad40b1f90 2023-10-09T15:31:12.470 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:12.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 msgr2=0x7fdac00694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 0x7fdac00694b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdac80091e0 tx=0x7fdac8017000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 msgr2=0x7fdad413ff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad413ff00 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdac400c560 tx=0x7fdac4007d50 comp rx=0 tx=0).stop 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 msgr2=0x7f47ac069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 0x7f47ac069460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f47c4009880 tx=0x7f47c4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 msgr2=0x7f47cc1482f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f47bc00b5e0 tx=0x7f47bc0090f0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 shutdown_connections 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac0067000 0x7fdac00694b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdad4161150 0x7fdad4141330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdad40b1f90 0x7fdad413ff00 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 --2- 172.21.15.33:0/2798807202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdad415f4f0 0x7fdad4140df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.477+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 >> 172.21.15.33:0/2798807202 conn(0x7fdad40cc300 msgr2=0x7fdad415ff10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 shutdown_connections 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47ac066fb0 0x7f47ac069460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47cc0b1f90 0x7f47cc1482f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47cc161150 0x7f47cc149b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 --2- 172.21.15.33:0/1228624185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47cc15f4f0 0x7f47cc149650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 >> 172.21.15.33:0/1228624185 conn(0x7f47cc0cc300 msgr2=0x7f47cc15e3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 shutdown_connections 2023-10-09T15:31:12.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7fdadaec3700 1 -- 172.21.15.33:0/2798807202 wait complete. 2023-10-09T15:31:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 shutdown_connections 2023-10-09T15:31:12.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.478+0000 7f47d09ed700 1 -- 172.21.15.33:0/1228624185 wait complete. 2023-10-09T15:31:12.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.486+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fa754005830 con 0x7fa7740b0080 2023-10-09T15:31:12.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.487+0000 7fa75affd700 1 -- 172.21.15.33:0/871766464 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fa764054790 con 0x7fa7740b0080 2023-10-09T15:31:12.491 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:12.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-10-09T15:31:12.492 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.490+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 msgr2=0x7fa7600694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.490+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 0x7fa7600694b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa7740b0480 tx=0x7fa76c018000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.490+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 msgr2=0x7fa7741830a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.490+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fa76400b5e0 tx=0x7fa764009120 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 shutdown_connections 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa760067000 0x7fa7600694b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7740b0080 0x7fa7741830a0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7741835e0 0x7fa7741581b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 --2- 172.21.15.33:0/871766464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7740b1880 0x7fa77406ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 >> 172.21.15.33:0/871766464 conn(0x7fa7740cc300 msgr2=0x7fa774166040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 shutdown_connections 2023-10-09T15:31:12.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.491+0000 7fa77949f700 1 -- 172.21.15.33:0/871766464 wait complete. 2023-10-09T15:31:12.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.496+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5e88005560 con 0x7f5ea80accd0 2023-10-09T15:31:12.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.497+0000 7f5e9d7fa700 1 -- 172.21.15.33:0/2728000529 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5ea4054f80 con 0x7f5ea80accd0 2023-10-09T15:31:12.498 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:12.500 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.4 2023-10-09T15:31:12.500 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.501 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574856 got 55834574856 for osd.1 2023-10-09T15:31:12.502 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.500+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 msgr2=0x7f5e8c069530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.500+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 0x7f5e8c069530 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0003440 tx=0x7f5ea0016000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.500+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 msgr2=0x7f5ea81505c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.500+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 0x7f5ea81505c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f5ea400ea50 tx=0x7f5ea40091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 shutdown_connections 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e8c067080 0x7f5e8c069530 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ea80cb8e0 0x7f5ea8152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ea80ac830 0x7f5ea8155100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 --2- 172.21.15.33:0/2728000529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ea80accd0 0x7f5ea81505c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 >> 172.21.15.33:0/2728000529 conn(0x7f5ea80cc300 msgr2=0x7f5ea806e2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 shutdown_connections 2023-10-09T15:31:12.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.501+0000 7f5eaf886700 1 -- 172.21.15.33:0/2728000529 wait complete. 2023-10-09T15:31:12.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.510+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f6e880ac6c0 con 0x7f6e880b1410 2023-10-09T15:31:12.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.510+0000 7f6e767fc700 1 -- 172.21.15.33:0/2657413796 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6e780548f0 con 0x7f6e880b1410 2023-10-09T15:31:12.511 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:12.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.513+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 msgr2=0x7f6e68069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.513+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 0x7f6e68069410 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f6e880ca0a0 tx=0x7f6e7c006be0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.513+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 msgr2=0x7f6e8814e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.513+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6e7800b600 tx=0x7f6e780091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.6 2023-10-09T15:31:12.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 shutdown_connections 2023-10-09T15:31:12.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6e68066f60 0x7f6e68069410 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6e88157920 0x7f6e8806b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6e880b1410 0x7f6e8814e3b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 --2- 172.21.15.33:0/2657413796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6e88157550 0x7f6e8806abe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.516 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.516 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.2 2023-10-09T15:31:12.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 >> 172.21.15.33:0/2657413796 conn(0x7f6e880cc300 msgr2=0x7f6e880cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 shutdown_connections 2023-10-09T15:31:12.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.514+0000 7f6e8ceac700 1 -- 172.21.15.33:0/2657413796 wait complete. 2023-10-09T15:31:12.517 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.527 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.7 2023-10-09T15:31:12.527 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.527+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7ff01c04c3c0 con 0x7ff01c179a80 2023-10-09T15:31:12.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.528+0000 7ff00a7fc700 1 -- 172.21.15.33:0/1739874583 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7ff010055310 con 0x7ff01c179a80 2023-10-09T15:31:12.529 INFO:teuthology.orchestra.run.smithi033.stdout:55834574855 2023-10-09T15:31:12.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 msgr2=0x7feffc0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 0x7feffc0694b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff0140013d0 tx=0x7ff014016000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 msgr2=0x7ff01c173b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff01c16a1b0 tx=0x7ff0100091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 shutdown_connections 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feffc067000 0x7feffc0694b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff01c179a80 0x7ff01c173b80 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff004003ea0 0x7ff01c0a7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 --2- 172.21.15.33:0/1739874583 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff01c0a7c60 0x7ff01c179540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 >> 172.21.15.33:0/1739874583 conn(0x7ff01c0cc300 msgr2=0x7ff01c0ada20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 shutdown_connections 2023-10-09T15:31:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.530+0000 7ff020c92700 1 -- 172.21.15.33:0/1739874583 wait complete. 2023-10-09T15:31:12.543 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.5 2023-10-09T15:31:12.543 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.549+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5778005560 con 0x7f5794166260 2023-10-09T15:31:12.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.549+0000 7f57827fc700 1 -- 172.21.15.33:0/1843828552 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5784054bf0 con 0x7f5794166260 2023-10-09T15:31:12.550 INFO:teuthology.orchestra.run.smithi033.stdout:55834574854 2023-10-09T15:31:12.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 msgr2=0x7f577c069820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 0x7f577c069820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f5788007330 tx=0x7f5788007040 comp rx=0 tx=0).stop 2023-10-09T15:31:12.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 msgr2=0x7f579406add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f5784007b60 tx=0x7f578400a470 comp rx=0 tx=0).stop 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 shutdown_connections 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f577c067370 0x7f577c069820 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5794166260 0x7f579406add0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5794087840 0x7f57940b07c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 --2- 172.21.15.33:0/1843828552 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57940c7000 0x7f57940aeed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 >> 172.21.15.33:0/1843828552 conn(0x7f579406d130 msgr2=0x7f5794164b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 shutdown_connections 2023-10-09T15:31:12.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.551+0000 7f579359e700 1 -- 172.21.15.33:0/1843828552 wait complete. 2023-10-09T15:31:12.564 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.0 2023-10-09T15:31:12.564 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:12.564 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T15:31:12.564 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.723+0000 7f4737275700 1 Processor -- start 2023-10-09T15:31:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.723+0000 7f4737275700 1 -- start start 2023-10-09T15:31:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4737275700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47300cb970 0x7f4730159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4737275700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473015ae40 con 0x7f473015a400 2023-10-09T15:31:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4737275700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f473015ab60 con 0x7f47300cb5a0 2023-10-09T15:31:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4737275700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47300ce0f0 con 0x7f47300cb970 2023-10-09T15:31:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4735812700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f473015a400 0x7f4730156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38878/0 (socket says 172.21.15.33:38878) 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4735812700 1 -- 172.21.15.33:0/2021739656 learned_addr learned my addr 172.21.15.33:0/2021739656 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f4734810700 1 --2- 172.21.15.33:0/2021739656 >> v2:172.21.15.59:3300/0 conn(0x7f47300cb970 0x7f4730159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616685067 0 0) 0x7f473015ae40 con 0x7f473015a400 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4718003570 con 0x7f473015a400 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1568518100 0 0) 0x7f4718003570 con 0x7f473015a400 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 >> v2:172.21.15.59:3300/0 conn(0x7f47300cb970 msgr2=0x7f4730159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 --2- 172.21.15.33:0/2021739656 >> v2:172.21.15.59:3300/0 conn(0x7f47300cb970 0x7f4730159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 >> v1:172.21.15.59:6789/0 conn(0x7f47300cb5a0 legacy=0x7f47300cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47300ccf00 con 0x7f473015a400 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f47200017f0 con 0x7f473015a400 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 >> v1:172.21.15.33:6789/0 conn(0x7f473015a400 legacy=0x7f4730156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 0x7f4718003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718004810 0x7f4718004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.724+0000 7f472ffff700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300ce0f0 con 0x7f4718003a60 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c0d0 con 0x7f4718004810 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f471800c290 con 0x7f47180051c0 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 0x7f4718003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4734810700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718004810 0x7f4718004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735812700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 -- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47180051c0 msgr2=0x7f471800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47180051c0 0x7f471800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 -- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718004810 msgr2=0x7f4718004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718004810 0x7f4718004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 -- 172.21.15.33:0/2021739656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4718003570 con 0x7f4718003a60 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735812700 1 -- 172.21.15.33:0/2021739656 reap_dead start 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f4735011700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 0x7f4718003e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47280018b0 tx=0x7f4728007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=696be38baea1dd34 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728012420 con 0x7f4718003a60 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47280125a0 con 0x7f4718003a60 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.725+0000 7f472ffff700 1 -- 172.21.15.33:0/2021739656 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4728012960 con 0x7f4718003a60 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 -- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 msgr2=0x7f4718003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 0x7f4718003e70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f47280018b0 tx=0x7f4728007d30 comp rx=0 tx=0).stop 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 -- 172.21.15.33:0/2021739656 shutdown_connections 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 --2- 172.21.15.33:0/2021739656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4718003a60 0x7f4718003e70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 -- 172.21.15.33:0/2021739656 >> 172.21.15.33:0/2021739656 conn(0x7f4730070e30 msgr2=0x7f47300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 -- 172.21.15.33:0/2021739656 shutdown_connections 2023-10-09T15:31:12.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.726+0000 7f4737275700 1 -- 172.21.15.33:0/2021739656 wait complete. 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.727+0000 7f4737275700 1 Processor -- start 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.727+0000 7f4737275700 1 -- start start 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718003a60 0x7f47301553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 0x7f4730152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47300c8aa0 con 0x7f47300c80f0 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4730155c00 con 0x7f4718003a60 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4730155ee0 con 0x7f4730151df0 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53092/0 (socket says 172.21.15.33:53092) 2023-10-09T15:31:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 -- 172.21.15.33:0/1835448042 learned_addr learned my addr 172.21.15.33:0/1835448042 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4735011700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718003a60 0x7f47301553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4735812700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 0x7f4730152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 -- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 msgr2=0x7f4730152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 0x7f4730152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 -- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718003a60 msgr2=0x7f47301553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718003a60 0x7f47301553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 -- 172.21.15.33:0/1835448042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47301561c0 con 0x7f47300c80f0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4735812700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 0x7f4730152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4734810700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4724011d40 tx=0x7f47240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f472400fac0 con 0x7f47300c80f0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f472400fc20 con 0x7f47300c80f0 2023-10-09T15:31:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473015c3e0 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4724014440 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.728+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47301527b0 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.729+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47301563b0 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.730+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4724014870 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.730+0000 7f472d7fa700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 0x7f471c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.730+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4724018030 con 0x7f47300c80f0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.730+0000 7f4735011700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 0x7f471c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.731+0000 7f4735011700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 0x7f471c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f473015b160 tx=0x7f4728015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:12.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.734+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47240521c0 con 0x7f47300c80f0 2023-10-09T15:31:12.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.922+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4730156050 con 0x7f471c066f30 2023-10-09T15:31:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.930+0000 7f472d7fa700 1 -- 172.21.15.33:0/1835448042 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264485 (secure 0 0 0) 0x7f4730156050 con 0x7f471c066f30 2023-10-09T15:31:12.934 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 msgr2=0x7f471c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 0x7f471c0693e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f473015b160 tx=0x7f4728015000 comp rx=0 tx=0).stop 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 msgr2=0x7f47300c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f4724011d40 tx=0x7f47240091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 shutdown_connections 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f471c066f30 0x7f471c0693e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4730151df0 0x7f4730152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4718003a60 0x7f47301553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 --2- 172.21.15.33:0/1835448042 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47300c80f0 0x7f47300c8560 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:12.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 >> 172.21.15.33:0/1835448042 conn(0x7f4730070e30 msgr2=0x7f47300ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:12.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 shutdown_connections 2023-10-09T15:31:12.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:12.933+0000 7f4737275700 1 -- 172.21.15.33:0/1835448042 wait complete. 2023-10-09T15:31:12.937 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:12.946 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":22,"stamp":"2023-10-09T15:31:11.237596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.581849"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682261+0000","last_change":"2023-10-09T15:30:59.675453+0000","last_active":"2023-10-09T15:30:59.682261+0000","last_peered":"2023-10-09T15:30:59.682261+0000","last_clean":"2023-10-09T15:30:59.682261+0000","last_became_active":"2023-10-09T15:30:59.675159+0000","last_became_peered":"2023-10-09T15:30:59.675159+0000","last_unstale":"2023-10-09T15:30:59.682261+0000","last_undegraded":"2023-10-09T15:30:59.682261+0000","last_fullsized":"2023-10-09T15:30:59.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670422+0000","last_change":"2023-10-09T15:30:59.666350+0000","last_active":"2023-10-09T15:30:59.670422+0000","last_peered":"2023-10-09T15:30:59.670422+0000","last_clean":"2023-10-09T15:30:59.670422+0000","last_became_active":"2023-10-09T15:30:59.665970+0000","last_became_peered":"2023-10-09T15:30:59.665970+0000","last_unstale":"2023-10-09T15:30:59.670422+0000","last_undegraded":"2023-10-09T15:30:59.670422+0000","last_fullsized":"2023-10-09T15:30:59.670422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669088+0000","last_change":"2023-10-09T15:30:59.663886+0000","last_active":"2023-10-09T15:30:59.669088+0000","last_peered":"2023-10-09T15:30:59.669088+0000","last_clean":"2023-10-09T15:30:59.669088+0000","last_became_active":"2023-10-09T15:30:59.663598+0000","last_became_peered":"2023-10-09T15:30:59.663598+0000","last_unstale":"2023-10-09T15:30:59.669088+0000","last_undegraded":"2023-10-09T15:30:59.669088+0000","last_fullsized":"2023-10-09T15:30:59.669088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672923+0000","last_change":"2023-10-09T15:30:59.666790+0000","last_active":"2023-10-09T15:30:59.672923+0000","last_peered":"2023-10-09T15:30:59.672923+0000","last_clean":"2023-10-09T15:30:59.672923+0000","last_became_active":"2023-10-09T15:30:59.666144+0000","last_became_peered":"2023-10-09T15:30:59.666144+0000","last_unstale":"2023-10-09T15:30:59.672923+0000","last_undegraded":"2023-10-09T15:30:59.672923+0000","last_fullsized":"2023-10-09T15:30:59.672923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679237+0000","last_change":"2023-10-09T15:30:59.670991+0000","last_active":"2023-10-09T15:30:59.679237+0000","last_peered":"2023-10-09T15:30:59.679237+0000","last_clean":"2023-10-09T15:30:59.679237+0000","last_became_active":"2023-10-09T15:30:59.670704+0000","last_became_peered":"2023-10-09T15:30:59.670704+0000","last_unstale":"2023-10-09T15:30:59.679237+0000","last_undegraded":"2023-10-09T15:30:59.679237+0000","last_fullsized":"2023-10-09T15:30:59.679237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675697+0000","last_change":"2023-10-09T15:30:59.667866+0000","last_active":"2023-10-09T15:30:59.675697+0000","last_peered":"2023-10-09T15:30:59.675697+0000","last_clean":"2023-10-09T15:30:59.675697+0000","last_became_active":"2023-10-09T15:30:59.667647+0000","last_became_peered":"2023-10-09T15:30:59.667647+0000","last_unstale":"2023-10-09T15:30:59.675697+0000","last_undegraded":"2023-10-09T15:30:59.675697+0000","last_fullsized":"2023-10-09T15:30:59.675697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679218+0000","last_change":"2023-10-09T15:30:59.670699+0000","last_active":"2023-10-09T15:30:59.679218+0000","last_peered":"2023-10-09T15:30:59.679218+0000","last_clean":"2023-10-09T15:30:59.679218+0000","last_became_active":"2023-10-09T15:30:59.670342+0000","last_became_peered":"2023-10-09T15:30:59.670342+0000","last_unstale":"2023-10-09T15:30:59.679218+0000","last_undegraded":"2023-10-09T15:30:59.679218+0000","last_fullsized":"2023-10-09T15:30:59.679218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679139+0000","last_change":"2023-10-09T15:30:59.670588+0000","last_active":"2023-10-09T15:30:59.679139+0000","last_peered":"2023-10-09T15:30:59.679139+0000","last_clean":"2023-10-09T15:30:59.679139+0000","last_became_active":"2023-10-09T15:30:59.670286+0000","last_became_peered":"2023-10-09T15:30:59.670286+0000","last_unstale":"2023-10-09T15:30:59.679139+0000","last_undegraded":"2023-10-09T15:30:59.679139+0000","last_fullsized":"2023-10-09T15:30:59.679139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682230+0000","last_change":"2023-10-09T15:30:59.674866+0000","last_active":"2023-10-09T15:30:59.682230+0000","last_peered":"2023-10-09T15:30:59.682230+0000","last_clean":"2023-10-09T15:30:59.682230+0000","last_became_active":"2023-10-09T15:30:59.674592+0000","last_became_peered":"2023-10-09T15:30:59.674592+0000","last_unstale":"2023-10-09T15:30:59.682230+0000","last_undegraded":"2023-10-09T15:30:59.682230+0000","last_fullsized":"2023-10-09T15:30:59.682230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:18.896209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677373+0000","last_change":"2023-10-09T15:30:59.670458+0000","last_active":"2023-10-09T15:30:59.677373+0000","last_peered":"2023-10-09T15:30:59.677373+0000","last_clean":"2023-10-09T15:30:59.677373+0000","last_became_active":"2023-10-09T15:30:59.670170+0000","last_became_peered":"2023-10-09T15:30:59.670170+0000","last_unstale":"2023-10-09T15:30:59.677373+0000","last_undegraded":"2023-10-09T15:30:59.677373+0000","last_fullsized":"2023-10-09T15:30:59.677373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677264+0000","last_change":"2023-10-09T15:30:59.672093+0000","last_active":"2023-10-09T15:30:59.677264+0000","last_peered":"2023-10-09T15:30:59.677264+0000","last_clean":"2023-10-09T15:30:59.677264+0000","last_became_active":"2023-10-09T15:30:59.671829+0000","last_became_peered":"2023-10-09T15:30:59.671829+0000","last_unstale":"2023-10-09T15:30:59.677264+0000","last_undegraded":"2023-10-09T15:30:59.677264+0000","last_fullsized":"2023-10-09T15:30:59.677264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674095+0000","last_change":"2023-10-09T15:30:59.652602+0000","last_active":"2023-10-09T15:30:59.674095+0000","last_peered":"2023-10-09T15:30:59.674095+0000","last_clean":"2023-10-09T15:30:59.674095+0000","last_became_active":"2023-10-09T15:30:59.652304+0000","last_became_peered":"2023-10-09T15:30:59.652304+0000","last_unstale":"2023-10-09T15:30:59.674095+0000","last_undegraded":"2023-10-09T15:30:59.674095+0000","last_fullsized":"2023-10-09T15:30:59.674095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:07.825038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.662644+0000","last_change":"2023-10-09T15:30:59.658543+0000","last_active":"2023-10-09T15:30:59.662644+0000","last_peered":"2023-10-09T15:30:59.662644+0000","last_clean":"2023-10-09T15:30:59.662644+0000","last_became_active":"2023-10-09T15:30:59.658260+0000","last_became_peered":"2023-10-09T15:30:59.658260+0000","last_unstale":"2023-10-09T15:30:59.662644+0000","last_undegraded":"2023-10-09T15:30:59.662644+0000","last_fullsized":"2023-10-09T15:30:59.662644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665749+0000","last_change":"2023-10-09T15:30:59.661916+0000","last_active":"2023-10-09T15:30:59.665749+0000","last_peered":"2023-10-09T15:30:59.665749+0000","last_clean":"2023-10-09T15:30:59.665749+0000","last_became_active":"2023-10-09T15:30:59.661612+0000","last_became_peered":"2023-10-09T15:30:59.661612+0000","last_unstale":"2023-10-09T15:30:59.665749+0000","last_undegraded":"2023-10-09T15:30:59.665749+0000","last_fullsized":"2023-10-09T15:30:59.665749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680476+0000","last_change":"2023-10-09T15:30:59.677507+0000","last_active":"2023-10-09T15:30:59.680476+0000","last_peered":"2023-10-09T15:30:59.680476+0000","last_clean":"2023-10-09T15:30:59.680476+0000","last_became_active":"2023-10-09T15:30:59.677142+0000","last_became_peered":"2023-10-09T15:30:59.677142+0000","last_unstale":"2023-10-09T15:30:59.680476+0000","last_undegraded":"2023-10-09T15:30:59.680476+0000","last_fullsized":"2023-10-09T15:30:59.680476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675582+0000","last_change":"2023-10-09T15:30:59.669137+0000","last_active":"2023-10-09T15:30:59.675582+0000","last_peered":"2023-10-09T15:30:59.675582+0000","last_clean":"2023-10-09T15:30:59.675582+0000","last_became_active":"2023-10-09T15:30:59.668871+0000","last_became_peered":"2023-10-09T15:30:59.668871+0000","last_unstale":"2023-10-09T15:30:59.675582+0000","last_undegraded":"2023-10-09T15:30:59.675582+0000","last_fullsized":"2023-10-09T15:30:59.675582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681093+0000","last_change":"2023-10-09T15:30:59.675035+0000","last_active":"2023-10-09T15:30:59.681093+0000","last_peered":"2023-10-09T15:30:59.681093+0000","last_clean":"2023-10-09T15:30:59.681093+0000","last_became_active":"2023-10-09T15:30:59.674718+0000","last_became_peered":"2023-10-09T15:30:59.674718+0000","last_unstale":"2023-10-09T15:30:59.681093+0000","last_undegraded":"2023-10-09T15:30:59.681093+0000","last_fullsized":"2023-10-09T15:30:59.681093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677089+0000","last_change":"2023-10-09T15:30:59.675915+0000","last_active":"2023-10-09T15:30:59.677089+0000","last_peered":"2023-10-09T15:30:59.677089+0000","last_clean":"2023-10-09T15:30:59.677089+0000","last_became_active":"2023-10-09T15:30:59.675642+0000","last_became_peered":"2023-10-09T15:30:59.675642+0000","last_unstale":"2023-10-09T15:30:59.677089+0000","last_undegraded":"2023-10-09T15:30:59.677089+0000","last_fullsized":"2023-10-09T15:30:59.677089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679359+0000","last_change":"2023-10-09T15:30:59.671221+0000","last_active":"2023-10-09T15:30:59.679359+0000","last_peered":"2023-10-09T15:30:59.679359+0000","last_clean":"2023-10-09T15:30:59.679359+0000","last_became_active":"2023-10-09T15:30:59.670944+0000","last_became_peered":"2023-10-09T15:30:59.670944+0000","last_unstale":"2023-10-09T15:30:59.679359+0000","last_undegraded":"2023-10-09T15:30:59.679359+0000","last_fullsized":"2023-10-09T15:30:59.679359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682812+0000","last_change":"2023-10-09T15:30:58.654623+0000","last_active":"2023-10-09T15:30:59.682812+0000","last_peered":"2023-10-09T15:30:59.682812+0000","last_clean":"2023-10-09T15:30:59.682812+0000","last_became_active":"2023-10-09T15:30:58.654351+0000","last_became_peered":"2023-10-09T15:30:58.654351+0000","last_unstale":"2023-10-09T15:30:59.682812+0000","last_undegraded":"2023-10-09T15:30:59.682812+0000","last_fullsized":"2023-10-09T15:30:59.682812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.660456+0000","last_change":"2023-10-09T15:30:59.656560+0000","last_active":"2023-10-09T15:30:59.660456+0000","last_peered":"2023-10-09T15:30:59.660456+0000","last_clean":"2023-10-09T15:30:59.660456+0000","last_became_active":"2023-10-09T15:30:59.656293+0000","last_became_peered":"2023-10-09T15:30:59.656293+0000","last_unstale":"2023-10-09T15:30:59.660456+0000","last_undegraded":"2023-10-09T15:30:59.660456+0000","last_fullsized":"2023-10-09T15:30:59.660456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679270+0000","last_change":"2023-10-09T15:30:58.659955+0000","last_active":"2023-10-09T15:30:59.679270+0000","last_peered":"2023-10-09T15:30:59.679270+0000","last_clean":"2023-10-09T15:30:59.679270+0000","last_became_active":"2023-10-09T15:30:58.659645+0000","last_became_peered":"2023-10-09T15:30:58.659645+0000","last_unstale":"2023-10-09T15:30:59.679270+0000","last_undegraded":"2023-10-09T15:30:59.679270+0000","last_fullsized":"2023-10-09T15:30:59.679270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675130+0000","last_change":"2023-10-09T15:30:59.667774+0000","last_active":"2023-10-09T15:30:59.675130+0000","last_peered":"2023-10-09T15:30:59.675130+0000","last_clean":"2023-10-09T15:30:59.675130+0000","last_became_active":"2023-10-09T15:30:59.667490+0000","last_became_peered":"2023-10-09T15:30:59.667490+0000","last_unstale":"2023-10-09T15:30:59.675130+0000","last_undegraded":"2023-10-09T15:30:59.675130+0000","last_fullsized":"2023-10-09T15:30:59.675130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680068+0000","last_change":"2023-10-09T15:30:58.658690+0000","last_active":"2023-10-09T15:30:59.680068+0000","last_peered":"2023-10-09T15:30:59.680068+0000","last_clean":"2023-10-09T15:30:59.680068+0000","last_became_active":"2023-10-09T15:30:58.658429+0000","last_became_peered":"2023-10-09T15:30:58.658429+0000","last_unstale":"2023-10-09T15:30:59.680068+0000","last_undegraded":"2023-10-09T15:30:59.680068+0000","last_fullsized":"2023-10-09T15:30:59.680068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681667+0000","last_change":"2023-10-09T15:30:59.678307+0000","last_active":"2023-10-09T15:30:59.681667+0000","last_peered":"2023-10-09T15:30:59.681667+0000","last_clean":"2023-10-09T15:30:59.681667+0000","last_became_active":"2023-10-09T15:30:59.678048+0000","last_became_peered":"2023-10-09T15:30:59.678048+0000","last_unstale":"2023-10-09T15:30:59.681667+0000","last_undegraded":"2023-10-09T15:30:59.681667+0000","last_fullsized":"2023-10-09T15:30:59.681667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681194+0000","last_change":"2023-10-09T15:30:58.661313+0000","last_active":"2023-10-09T15:30:59.681194+0000","last_peered":"2023-10-09T15:30:59.681194+0000","last_clean":"2023-10-09T15:30:59.681194+0000","last_became_active":"2023-10-09T15:30:58.661029+0000","last_became_peered":"2023-10-09T15:30:58.661029+0000","last_unstale":"2023-10-09T15:30:59.681194+0000","last_undegraded":"2023-10-09T15:30:59.681194+0000","last_fullsized":"2023-10-09T15:30:59.681194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:20.445789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681768+0000","last_change":"2023-10-09T15:30:59.679014+0000","last_active":"2023-10-09T15:30:59.681768+0000","last_peered":"2023-10-09T15:30:59.681768+0000","last_clean":"2023-10-09T15:30:59.681768+0000","last_became_active":"2023-10-09T15:30:59.678577+0000","last_became_peered":"2023-10-09T15:30:59.678577+0000","last_unstale":"2023-10-09T15:30:59.681768+0000","last_undegraded":"2023-10-09T15:30:59.681768+0000","last_fullsized":"2023-10-09T15:30:59.681768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681275+0000","last_change":"2023-10-09T15:30:58.656303+0000","last_active":"2023-10-09T15:30:59.681275+0000","last_peered":"2023-10-09T15:30:59.681275+0000","last_clean":"2023-10-09T15:30:59.681275+0000","last_became_active":"2023-10-09T15:30:58.655754+0000","last_became_peered":"2023-10-09T15:30:58.655754+0000","last_unstale":"2023-10-09T15:30:59.681275+0000","last_undegraded":"2023-10-09T15:30:59.681275+0000","last_fullsized":"2023-10-09T15:30:59.681275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677214+0000","last_change":"2023-10-09T15:30:59.661929+0000","last_active":"2023-10-09T15:30:59.677214+0000","last_peered":"2023-10-09T15:30:59.677214+0000","last_clean":"2023-10-09T15:30:59.677214+0000","last_became_active":"2023-10-09T15:30:59.661661+0000","last_became_peered":"2023-10-09T15:30:59.661661+0000","last_unstale":"2023-10-09T15:30:59.677214+0000","last_undegraded":"2023-10-09T15:30:59.677214+0000","last_fullsized":"2023-10-09T15:30:59.677214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:21.450587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678717+0000","last_change":"2023-10-09T15:30:58.651818+0000","last_active":"2023-10-09T15:30:59.678717+0000","last_peered":"2023-10-09T15:30:59.678717+0000","last_clean":"2023-10-09T15:30:59.678717+0000","last_became_active":"2023-10-09T15:30:58.651546+0000","last_became_peered":"2023-10-09T15:30:58.651546+0000","last_unstale":"2023-10-09T15:30:59.678717+0000","last_undegraded":"2023-10-09T15:30:59.678717+0000","last_fullsized":"2023-10-09T15:30:59.678717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665613+0000","last_change":"2023-10-09T15:30:59.660923+0000","last_active":"2023-10-09T15:30:59.665613+0000","last_peered":"2023-10-09T15:30:59.665613+0000","last_clean":"2023-10-09T15:30:59.665613+0000","last_became_active":"2023-10-09T15:30:59.660614+0000","last_became_peered":"2023-10-09T15:30:59.660614+0000","last_unstale":"2023-10-09T15:30:59.665613+0000","last_undegraded":"2023-10-09T15:30:59.665613+0000","last_fullsized":"2023-10-09T15:30:59.665613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.652963+0000","last_change":"2023-10-09T15:30:58.654565+0000","last_active":"2023-10-09T15:30:59.652963+0000","last_peered":"2023-10-09T15:30:59.652963+0000","last_clean":"2023-10-09T15:30:59.652963+0000","last_became_active":"2023-10-09T15:30:58.654100+0000","last_became_peered":"2023-10-09T15:30:58.654100+0000","last_unstale":"2023-10-09T15:30:59.652963+0000","last_undegraded":"2023-10-09T15:30:59.652963+0000","last_fullsized":"2023-10-09T15:30:59.652963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.663038+0000","last_change":"2023-10-09T15:30:59.659944+0000","last_active":"2023-10-09T15:30:59.663038+0000","last_peered":"2023-10-09T15:30:59.663038+0000","last_clean":"2023-10-09T15:30:59.663038+0000","last_became_active":"2023-10-09T15:30:59.659370+0000","last_became_peered":"2023-10-09T15:30:59.659370+0000","last_unstale":"2023-10-09T15:30:59.663038+0000","last_undegraded":"2023-10-09T15:30:59.663038+0000","last_fullsized":"2023-10-09T15:30:59.663038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657161+0000","last_change":"2023-10-09T15:30:58.663665+0000","last_active":"2023-10-09T15:30:59.657161+0000","last_peered":"2023-10-09T15:30:59.657161+0000","last_clean":"2023-10-09T15:30:59.657161+0000","last_became_active":"2023-10-09T15:30:58.663374+0000","last_became_peered":"2023-10-09T15:30:58.663374+0000","last_unstale":"2023-10-09T15:30:59.657161+0000","last_undegraded":"2023-10-09T15:30:59.657161+0000","last_fullsized":"2023-10-09T15:30:59.657161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668305+0000","last_change":"2023-10-09T15:30:59.662643+0000","last_active":"2023-10-09T15:30:59.668305+0000","last_peered":"2023-10-09T15:30:59.668305+0000","last_clean":"2023-10-09T15:30:59.668305+0000","last_became_active":"2023-10-09T15:30:59.662002+0000","last_became_peered":"2023-10-09T15:30:59.662002+0000","last_unstale":"2023-10-09T15:30:59.668305+0000","last_undegraded":"2023-10-09T15:30:59.668305+0000","last_fullsized":"2023-10-09T15:30:59.668305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648439+0000","last_change":"2023-10-09T15:30:58.657412+0000","last_active":"2023-10-09T15:30:59.648439+0000","last_peered":"2023-10-09T15:30:59.648439+0000","last_clean":"2023-10-09T15:30:59.648439+0000","last_became_active":"2023-10-09T15:30:58.657086+0000","last_became_peered":"2023-10-09T15:30:58.657086+0000","last_unstale":"2023-10-09T15:30:59.648439+0000","last_undegraded":"2023-10-09T15:30:59.648439+0000","last_fullsized":"2023-10-09T15:30:59.648439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678652+0000","last_change":"2023-10-09T15:30:59.672392+0000","last_active":"2023-10-09T15:30:59.678652+0000","last_peered":"2023-10-09T15:30:59.678652+0000","last_clean":"2023-10-09T15:30:59.678652+0000","last_became_active":"2023-10-09T15:30:59.671757+0000","last_became_peered":"2023-10-09T15:30:59.671757+0000","last_unstale":"2023-10-09T15:30:59.678652+0000","last_undegraded":"2023-10-09T15:30:59.678652+0000","last_fullsized":"2023-10-09T15:30:59.678652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658666+0000","last_change":"2023-10-09T15:30:58.657247+0000","last_active":"2023-10-09T15:30:59.658666+0000","last_peered":"2023-10-09T15:30:59.658666+0000","last_clean":"2023-10-09T15:30:59.658666+0000","last_became_active":"2023-10-09T15:30:58.656943+0000","last_became_peered":"2023-10-09T15:30:58.656943+0000","last_unstale":"2023-10-09T15:30:59.658666+0000","last_undegraded":"2023-10-09T15:30:59.658666+0000","last_fullsized":"2023-10-09T15:30:59.658666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675152+0000","last_change":"2023-10-09T15:30:59.667816+0000","last_active":"2023-10-09T15:30:59.675152+0000","last_peered":"2023-10-09T15:30:59.675152+0000","last_clean":"2023-10-09T15:30:59.675152+0000","last_became_active":"2023-10-09T15:30:59.667529+0000","last_became_peered":"2023-10-09T15:30:59.667529+0000","last_unstale":"2023-10-09T15:30:59.675152+0000","last_undegraded":"2023-10-09T15:30:59.675152+0000","last_fullsized":"2023-10-09T15:30:59.675152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682943+0000","last_change":"2023-10-09T15:30:58.661206+0000","last_active":"2023-10-09T15:30:59.682943+0000","last_peered":"2023-10-09T15:30:59.682943+0000","last_clean":"2023-10-09T15:30:59.682943+0000","last_became_active":"2023-10-09T15:30:58.660947+0000","last_became_peered":"2023-10-09T15:30:58.660947+0000","last_unstale":"2023-10-09T15:30:59.682943+0000","last_undegraded":"2023-10-09T15:30:59.682943+0000","last_fullsized":"2023-10-09T15:30:59.682943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682953+0000","last_change":"2023-10-09T15:30:59.670968+0000","last_active":"2023-10-09T15:30:59.682953+0000","last_peered":"2023-10-09T15:30:59.682953+0000","last_clean":"2023-10-09T15:30:59.682953+0000","last_became_active":"2023-10-09T15:30:59.670674+0000","last_became_peered":"2023-10-09T15:30:59.670674+0000","last_unstale":"2023-10-09T15:30:59.682953+0000","last_undegraded":"2023-10-09T15:30:59.682953+0000","last_fullsized":"2023-10-09T15:30:59.682953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:50.286664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.685943+0000","last_change":"2023-10-09T15:30:58.651540+0000","last_active":"2023-10-09T15:30:59.685943+0000","last_peered":"2023-10-09T15:30:59.685943+0000","last_clean":"2023-10-09T15:30:59.685943+0000","last_became_active":"2023-10-09T15:30:58.651207+0000","last_became_peered":"2023-10-09T15:30:58.651207+0000","last_unstale":"2023-10-09T15:30:59.685943+0000","last_undegraded":"2023-10-09T15:30:59.685943+0000","last_fullsized":"2023-10-09T15:30:59.685943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679374+0000","last_change":"2023-10-09T15:30:59.672317+0000","last_active":"2023-10-09T15:30:59.679374+0000","last_peered":"2023-10-09T15:30:59.679374+0000","last_clean":"2023-10-09T15:30:59.679374+0000","last_became_active":"2023-10-09T15:30:59.671578+0000","last_became_peered":"2023-10-09T15:30:59.671578+0000","last_unstale":"2023-10-09T15:30:59.679374+0000","last_undegraded":"2023-10-09T15:30:59.679374+0000","last_fullsized":"2023-10-09T15:30:59.679374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683332+0000","last_change":"2023-10-09T15:30:58.655428+0000","last_active":"2023-10-09T15:30:59.683332+0000","last_peered":"2023-10-09T15:30:59.683332+0000","last_clean":"2023-10-09T15:30:59.683332+0000","last_became_active":"2023-10-09T15:30:58.655117+0000","last_became_peered":"2023-10-09T15:30:58.655117+0000","last_unstale":"2023-10-09T15:30:59.683332+0000","last_undegraded":"2023-10-09T15:30:59.683332+0000","last_fullsized":"2023-10-09T15:30:59.683332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677001+0000","last_change":"2023-10-09T15:30:59.672831+0000","last_active":"2023-10-09T15:30:59.677001+0000","last_peered":"2023-10-09T15:30:59.677001+0000","last_clean":"2023-10-09T15:30:59.677001+0000","last_became_active":"2023-10-09T15:30:59.672528+0000","last_became_peered":"2023-10-09T15:30:59.672528+0000","last_unstale":"2023-10-09T15:30:59.677001+0000","last_undegraded":"2023-10-09T15:30:59.677001+0000","last_fullsized":"2023-10-09T15:30:59.677001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654038+0000","last_change":"2023-10-09T15:30:58.658373+0000","last_active":"2023-10-09T15:30:59.654038+0000","last_peered":"2023-10-09T15:30:59.654038+0000","last_clean":"2023-10-09T15:30:59.654038+0000","last_became_active":"2023-10-09T15:30:58.657565+0000","last_became_peered":"2023-10-09T15:30:58.657565+0000","last_unstale":"2023-10-09T15:30:59.654038+0000","last_undegraded":"2023-10-09T15:30:59.654038+0000","last_fullsized":"2023-10-09T15:30:59.654038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681399+0000","last_change":"2023-10-09T15:30:59.680133+0000","last_active":"2023-10-09T15:30:59.681399+0000","last_peered":"2023-10-09T15:30:59.681399+0000","last_clean":"2023-10-09T15:30:59.681399+0000","last_became_active":"2023-10-09T15:30:59.679719+0000","last_became_peered":"2023-10-09T15:30:59.679719+0000","last_unstale":"2023-10-09T15:30:59.681399+0000","last_undegraded":"2023-10-09T15:30:59.681399+0000","last_fullsized":"2023-10-09T15:30:59.681399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648962+0000","last_change":"2023-10-09T15:30:58.651661+0000","last_active":"2023-10-09T15:30:59.648962+0000","last_peered":"2023-10-09T15:30:59.648962+0000","last_clean":"2023-10-09T15:30:59.648962+0000","last_became_active":"2023-10-09T15:30:58.651305+0000","last_became_peered":"2023-10-09T15:30:58.651305+0000","last_unstale":"2023-10-09T15:30:59.648962+0000","last_undegraded":"2023-10-09T15:30:59.648962+0000","last_fullsized":"2023-10-09T15:30:59.648962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659671+0000","last_change":"2023-10-09T15:30:59.655537+0000","last_active":"2023-10-09T15:30:59.659671+0000","last_peered":"2023-10-09T15:30:59.659671+0000","last_clean":"2023-10-09T15:30:59.659671+0000","last_became_active":"2023-10-09T15:30:59.655224+0000","last_became_peered":"2023-10-09T15:30:59.655224+0000","last_unstale":"2023-10-09T15:30:59.659671+0000","last_undegraded":"2023-10-09T15:30:59.659671+0000","last_fullsized":"2023-10-09T15:30:59.659671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680601+0000","last_change":"2023-10-09T15:30:58.656284+0000","last_active":"2023-10-09T15:30:59.680601+0000","last_peered":"2023-10-09T15:30:59.680601+0000","last_clean":"2023-10-09T15:30:59.680601+0000","last_became_active":"2023-10-09T15:30:58.655961+0000","last_became_peered":"2023-10-09T15:30:58.655961+0000","last_unstale":"2023-10-09T15:30:59.680601+0000","last_undegraded":"2023-10-09T15:30:59.680601+0000","last_fullsized":"2023-10-09T15:30:59.680601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681315+0000","last_change":"2023-10-09T15:30:59.678338+0000","last_active":"2023-10-09T15:30:59.681315+0000","last_peered":"2023-10-09T15:30:59.681315+0000","last_clean":"2023-10-09T15:30:59.681315+0000","last_became_active":"2023-10-09T15:30:59.678037+0000","last_became_peered":"2023-10-09T15:30:59.678037+0000","last_unstale":"2023-10-09T15:30:59.681315+0000","last_undegraded":"2023-10-09T15:30:59.681315+0000","last_fullsized":"2023-10-09T15:30:59.681315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683056+0000","last_change":"2023-10-09T15:30:58.650299+0000","last_active":"2023-10-09T15:30:59.683056+0000","last_peered":"2023-10-09T15:30:59.683056+0000","last_clean":"2023-10-09T15:30:59.683056+0000","last_became_active":"2023-10-09T15:30:58.650000+0000","last_became_peered":"2023-10-09T15:30:58.650000+0000","last_unstale":"2023-10-09T15:30:59.683056+0000","last_undegraded":"2023-10-09T15:30:59.683056+0000","last_fullsized":"2023-10-09T15:30:59.683056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680986+0000","last_change":"2023-10-09T15:30:59.678288+0000","last_active":"2023-10-09T15:30:59.680986+0000","last_peered":"2023-10-09T15:30:59.680986+0000","last_clean":"2023-10-09T15:30:59.680986+0000","last_became_active":"2023-10-09T15:30:59.677944+0000","last_became_peered":"2023-10-09T15:30:59.677944+0000","last_unstale":"2023-10-09T15:30:59.680986+0000","last_undegraded":"2023-10-09T15:30:59.680986+0000","last_fullsized":"2023-10-09T15:30:59.680986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658167+0000","last_change":"2023-10-09T15:30:58.658451+0000","last_active":"2023-10-09T15:30:59.658167+0000","last_peered":"2023-10-09T15:30:59.658167+0000","last_clean":"2023-10-09T15:30:59.658167+0000","last_became_active":"2023-10-09T15:30:58.658175+0000","last_became_peered":"2023-10-09T15:30:58.658175+0000","last_unstale":"2023-10-09T15:30:59.658167+0000","last_undegraded":"2023-10-09T15:30:59.658167+0000","last_fullsized":"2023-10-09T15:30:59.658167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681686+0000","last_change":"2023-10-09T15:30:59.676593+0000","last_active":"2023-10-09T15:30:59.681686+0000","last_peered":"2023-10-09T15:30:59.681686+0000","last_clean":"2023-10-09T15:30:59.681686+0000","last_became_active":"2023-10-09T15:30:59.676207+0000","last_became_peered":"2023-10-09T15:30:59.676207+0000","last_unstale":"2023-10-09T15:30:59.681686+0000","last_undegraded":"2023-10-09T15:30:59.681686+0000","last_fullsized":"2023-10-09T15:30:59.681686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653922+0000","last_change":"2023-10-09T15:30:58.658074+0000","last_active":"2023-10-09T15:30:59.653922+0000","last_peered":"2023-10-09T15:30:59.653922+0000","last_clean":"2023-10-09T15:30:59.653922+0000","last_became_active":"2023-10-09T15:30:58.657593+0000","last_became_peered":"2023-10-09T15:30:58.657593+0000","last_unstale":"2023-10-09T15:30:59.653922+0000","last_undegraded":"2023-10-09T15:30:59.653922+0000","last_fullsized":"2023-10-09T15:30:59.653922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676703+0000","last_change":"2023-10-09T15:30:59.659550+0000","last_active":"2023-10-09T15:30:59.676703+0000","last_peered":"2023-10-09T15:30:59.676703+0000","last_clean":"2023-10-09T15:30:59.676703+0000","last_became_active":"2023-10-09T15:30:59.658537+0000","last_became_peered":"2023-10-09T15:30:59.658537+0000","last_unstale":"2023-10-09T15:30:59.676703+0000","last_undegraded":"2023-10-09T15:30:59.676703+0000","last_fullsized":"2023-10-09T15:30:59.676703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:26.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672420+0000","last_change":"2023-10-09T15:30:59.663481+0000","last_active":"2023-10-09T15:30:59.672420+0000","last_peered":"2023-10-09T15:30:59.672420+0000","last_clean":"2023-10-09T15:30:59.672420+0000","last_became_active":"2023-10-09T15:30:59.662876+0000","last_became_peered":"2023-10-09T15:30:59.662876+0000","last_unstale":"2023-10-09T15:30:59.672420+0000","last_undegraded":"2023-10-09T15:30:59.672420+0000","last_fullsized":"2023-10-09T15:30:59.672420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659902+0000","last_change":"2023-10-09T15:30:58.654763+0000","last_active":"2023-10-09T15:30:59.659902+0000","last_peered":"2023-10-09T15:30:59.659902+0000","last_clean":"2023-10-09T15:30:59.659902+0000","last_became_active":"2023-10-09T15:30:58.654402+0000","last_became_peered":"2023-10-09T15:30:58.654402+0000","last_unstale":"2023-10-09T15:30:59.659902+0000","last_undegraded":"2023-10-09T15:30:59.659902+0000","last_fullsized":"2023-10-09T15:30:59.659902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680417+0000","last_change":"2023-10-09T15:30:59.673338+0000","last_active":"2023-10-09T15:30:59.680417+0000","last_peered":"2023-10-09T15:30:59.680417+0000","last_clean":"2023-10-09T15:30:59.680417+0000","last_became_active":"2023-10-09T15:30:59.673073+0000","last_became_peered":"2023-10-09T15:30:59.673073+0000","last_unstale":"2023-10-09T15:30:59.680417+0000","last_undegraded":"2023-10-09T15:30:59.680417+0000","last_fullsized":"2023-10-09T15:30:59.680417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653750+0000","last_change":"2023-10-09T15:30:58.656757+0000","last_active":"2023-10-09T15:30:59.653750+0000","last_peered":"2023-10-09T15:30:59.653750+0000","last_clean":"2023-10-09T15:30:59.653750+0000","last_became_active":"2023-10-09T15:30:58.656177+0000","last_became_peered":"2023-10-09T15:30:58.656177+0000","last_unstale":"2023-10-09T15:30:59.653750+0000","last_undegraded":"2023-10-09T15:30:59.653750+0000","last_fullsized":"2023-10-09T15:30:59.653750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654959+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:59.654959+0000","last_peered":"2023-10-09T15:30:59.654959+0000","last_clean":"2023-10-09T15:30:59.654959+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:59.654959+0000","last_undegraded":"2023-10-09T15:30:59.654959+0000","last_fullsized":"2023-10-09T15:30:59.654959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665718+0000","last_change":"2023-10-09T15:30:59.660707+0000","last_active":"2023-10-09T15:30:59.665718+0000","last_peered":"2023-10-09T15:30:59.665718+0000","last_clean":"2023-10-09T15:30:59.665718+0000","last_became_active":"2023-10-09T15:30:59.660311+0000","last_became_peered":"2023-10-09T15:30:59.660311+0000","last_unstale":"2023-10-09T15:30:59.665718+0000","last_undegraded":"2023-10-09T15:30:59.665718+0000","last_fullsized":"2023-10-09T15:30:59.665718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654997+0000","last_change":"2023-10-09T15:30:58.658938+0000","last_active":"2023-10-09T15:30:59.654997+0000","last_peered":"2023-10-09T15:30:59.654997+0000","last_clean":"2023-10-09T15:30:59.654997+0000","last_became_active":"2023-10-09T15:30:58.658670+0000","last_became_peered":"2023-10-09T15:30:58.658670+0000","last_unstale":"2023-10-09T15:30:59.654997+0000","last_undegraded":"2023-10-09T15:30:59.654997+0000","last_fullsized":"2023-10-09T15:30:59.654997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657329+0000","last_change":"2023-10-09T15:30:58.659276+0000","last_active":"2023-10-09T15:30:59.657329+0000","last_peered":"2023-10-09T15:30:59.657329+0000","last_clean":"2023-10-09T15:30:59.657329+0000","last_became_active":"2023-10-09T15:30:58.659014+0000","last_became_peered":"2023-10-09T15:30:58.659014+0000","last_unstale":"2023-10-09T15:30:59.657329+0000","last_undegraded":"2023-10-09T15:30:59.657329+0000","last_fullsized":"2023-10-09T15:30:59.657329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669321+0000","last_change":"2023-10-09T15:30:59.662896+0000","last_active":"2023-10-09T15:30:59.669321+0000","last_peered":"2023-10-09T15:30:59.669321+0000","last_clean":"2023-10-09T15:30:59.669321+0000","last_became_active":"2023-10-09T15:30:59.662565+0000","last_became_peered":"2023-10-09T15:30:59.662565+0000","last_unstale":"2023-10-09T15:30:59.669321+0000","last_undegraded":"2023-10-09T15:30:59.669321+0000","last_fullsized":"2023-10-09T15:30:59.669321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T15:31:00.658977+0000","last_change":"2023-10-09T15:30:58.654960+0000","last_active":"2023-10-09T15:31:00.658977+0000","last_peered":"2023-10-09T15:31:00.658977+0000","last_clean":"2023-10-09T15:31:00.658977+0000","last_became_active":"2023-10-09T15:30:58.654642+0000","last_became_peered":"2023-10-09T15:30:58.654642+0000","last_unstale":"2023-10-09T15:31:00.658977+0000","last_undegraded":"2023-10-09T15:31:00.658977+0000","last_fullsized":"2023-10-09T15:31:00.658977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679337+0000","last_change":"2023-10-09T15:30:59.673541+0000","last_active":"2023-10-09T15:30:59.679337+0000","last_peered":"2023-10-09T15:30:59.679337+0000","last_clean":"2023-10-09T15:30:59.679337+0000","last_became_active":"2023-10-09T15:30:59.673264+0000","last_became_peered":"2023-10-09T15:30:59.673264+0000","last_unstale":"2023-10-09T15:30:59.679337+0000","last_undegraded":"2023-10-09T15:30:59.679337+0000","last_fullsized":"2023-10-09T15:30:59.679337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680182+0000","last_change":"2023-10-09T15:30:58.653278+0000","last_active":"2023-10-09T15:30:59.680182+0000","last_peered":"2023-10-09T15:30:59.680182+0000","last_clean":"2023-10-09T15:30:59.680182+0000","last_became_active":"2023-10-09T15:30:58.652915+0000","last_became_peered":"2023-10-09T15:30:58.652915+0000","last_unstale":"2023-10-09T15:30:59.680182+0000","last_undegraded":"2023-10-09T15:30:59.680182+0000","last_fullsized":"2023-10-09T15:30:59.680182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665653+0000","last_change":"2023-10-09T15:30:59.661222+0000","last_active":"2023-10-09T15:30:59.665653+0000","last_peered":"2023-10-09T15:30:59.665653+0000","last_clean":"2023-10-09T15:30:59.665653+0000","last_became_active":"2023-10-09T15:30:59.660941+0000","last_became_peered":"2023-10-09T15:30:59.660941+0000","last_unstale":"2023-10-09T15:30:59.665653+0000","last_undegraded":"2023-10-09T15:30:59.665653+0000","last_fullsized":"2023-10-09T15:30:59.665653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654786+0000","last_change":"2023-10-09T15:30:58.660025+0000","last_active":"2023-10-09T15:30:59.654786+0000","last_peered":"2023-10-09T15:30:59.654786+0000","last_clean":"2023-10-09T15:30:59.654786+0000","last_became_active":"2023-10-09T15:30:58.659194+0000","last_became_peered":"2023-10-09T15:30:58.659194+0000","last_unstale":"2023-10-09T15:30:59.654786+0000","last_undegraded":"2023-10-09T15:30:59.654786+0000","last_fullsized":"2023-10-09T15:30:59.654786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678479+0000","last_change":"2023-10-09T15:30:59.664311+0000","last_active":"2023-10-09T15:30:59.678479+0000","last_peered":"2023-10-09T15:30:59.678479+0000","last_clean":"2023-10-09T15:30:59.678479+0000","last_became_active":"2023-10-09T15:30:59.664084+0000","last_became_peered":"2023-10-09T15:30:59.664084+0000","last_unstale":"2023-10-09T15:30:59.678479+0000","last_undegraded":"2023-10-09T15:30:59.678479+0000","last_fullsized":"2023-10-09T15:30:59.678479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:34.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.655505+0000","last_change":"2023-10-09T15:30:58.658966+0000","last_active":"2023-10-09T15:30:59.655505+0000","last_peered":"2023-10-09T15:30:59.655505+0000","last_clean":"2023-10-09T15:30:59.655505+0000","last_became_active":"2023-10-09T15:30:58.658723+0000","last_became_peered":"2023-10-09T15:30:58.658723+0000","last_unstale":"2023-10-09T15:30:59.655505+0000","last_undegraded":"2023-10-09T15:30:59.655505+0000","last_fullsized":"2023-10-09T15:30:59.655505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670057+0000","last_change":"2023-10-09T15:30:59.662640+0000","last_active":"2023-10-09T15:30:59.670057+0000","last_peered":"2023-10-09T15:30:59.670057+0000","last_clean":"2023-10-09T15:30:59.670057+0000","last_became_active":"2023-10-09T15:30:59.662342+0000","last_became_peered":"2023-10-09T15:30:59.662342+0000","last_unstale":"2023-10-09T15:30:59.670057+0000","last_undegraded":"2023-10-09T15:30:59.670057+0000","last_fullsized":"2023-10-09T15:30:59.670057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.656826+0000","last_change":"2023-10-09T15:30:58.658056+0000","last_active":"2023-10-09T15:30:59.656826+0000","last_peered":"2023-10-09T15:30:59.656826+0000","last_clean":"2023-10-09T15:30:59.656826+0000","last_became_active":"2023-10-09T15:30:58.657777+0000","last_became_peered":"2023-10-09T15:30:58.657777+0000","last_unstale":"2023-10-09T15:30:59.656826+0000","last_undegraded":"2023-10-09T15:30:59.656826+0000","last_fullsized":"2023-10-09T15:30:59.656826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674709+0000","last_change":"2023-10-09T15:30:59.664936+0000","last_active":"2023-10-09T15:30:59.674709+0000","last_peered":"2023-10-09T15:30:59.674709+0000","last_clean":"2023-10-09T15:30:59.674709+0000","last_became_active":"2023-10-09T15:30:59.664631+0000","last_became_peered":"2023-10-09T15:30:59.664631+0000","last_unstale":"2023-10-09T15:30:59.674709+0000","last_undegraded":"2023-10-09T15:30:59.674709+0000","last_fullsized":"2023-10-09T15:30:59.674709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683165+0000","last_change":"2023-10-09T15:30:58.659699+0000","last_active":"2023-10-09T15:30:59.683165+0000","last_peered":"2023-10-09T15:30:59.683165+0000","last_clean":"2023-10-09T15:30:59.683165+0000","last_became_active":"2023-10-09T15:30:58.659378+0000","last_became_peered":"2023-10-09T15:30:58.659378+0000","last_unstale":"2023-10-09T15:30:59.683165+0000","last_undegraded":"2023-10-09T15:30:59.683165+0000","last_fullsized":"2023-10-09T15:30:59.683165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:49.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677259+0000","last_change":"2023-10-09T15:30:59.662826+0000","last_active":"2023-10-09T15:30:59.677259+0000","last_peered":"2023-10-09T15:30:59.677259+0000","last_clean":"2023-10-09T15:30:59.677259+0000","last_became_active":"2023-10-09T15:30:59.662503+0000","last_became_peered":"2023-10-09T15:30:59.662503+0000","last_unstale":"2023-10-09T15:30:59.677259+0000","last_undegraded":"2023-10-09T15:30:59.677259+0000","last_fullsized":"2023-10-09T15:30:59.677259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659777+0000","last_change":"2023-10-09T15:30:58.657426+0000","last_active":"2023-10-09T15:30:59.659777+0000","last_peered":"2023-10-09T15:30:59.659777+0000","last_clean":"2023-10-09T15:30:59.659777+0000","last_became_active":"2023-10-09T15:30:58.657154+0000","last_became_peered":"2023-10-09T15:30:58.657154+0000","last_unstale":"2023-10-09T15:30:59.659777+0000","last_undegraded":"2023-10-09T15:30:59.659777+0000","last_fullsized":"2023-10-09T15:30:59.659777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681135+0000","last_change":"2023-10-09T15:30:59.673642+0000","last_active":"2023-10-09T15:30:59.681135+0000","last_peered":"2023-10-09T15:30:59.681135+0000","last_clean":"2023-10-09T15:30:59.681135+0000","last_became_active":"2023-10-09T15:30:59.671999+0000","last_became_peered":"2023-10-09T15:30:59.671999+0000","last_unstale":"2023-10-09T15:30:59.681135+0000","last_undegraded":"2023-10-09T15:30:59.681135+0000","last_fullsized":"2023-10-09T15:30:59.681135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683681+0000","last_change":"2023-10-09T15:30:58.658112+0000","last_active":"2023-10-09T15:30:59.683681+0000","last_peered":"2023-10-09T15:30:59.683681+0000","last_clean":"2023-10-09T15:30:59.683681+0000","last_became_active":"2023-10-09T15:30:58.657790+0000","last_became_peered":"2023-10-09T15:30:58.657790+0000","last_unstale":"2023-10-09T15:30:59.683681+0000","last_undegraded":"2023-10-09T15:30:59.683681+0000","last_fullsized":"2023-10-09T15:30:59.683681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672943+0000","last_change":"2023-10-09T15:30:59.667024+0000","last_active":"2023-10-09T15:30:59.672943+0000","last_peered":"2023-10-09T15:30:59.672943+0000","last_clean":"2023-10-09T15:30:59.672943+0000","last_became_active":"2023-10-09T15:30:59.666511+0000","last_became_peered":"2023-10-09T15:30:59.666511+0000","last_unstale":"2023-10-09T15:30:59.672943+0000","last_undegraded":"2023-10-09T15:30:59.672943+0000","last_fullsized":"2023-10-09T15:30:59.672943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679463+0000","last_change":"2023-10-09T15:30:58.652304+0000","last_active":"2023-10-09T15:30:59.679463+0000","last_peered":"2023-10-09T15:30:59.679463+0000","last_clean":"2023-10-09T15:30:59.679463+0000","last_became_active":"2023-10-09T15:30:58.651797+0000","last_became_peered":"2023-10-09T15:30:58.651797+0000","last_unstale":"2023-10-09T15:30:59.679463+0000","last_undegraded":"2023-10-09T15:30:59.679463+0000","last_fullsized":"2023-10-09T15:30:59.679463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.688154+0000","last_change":"2023-10-09T15:30:59.681772+0000","last_active":"2023-10-09T15:30:59.688154+0000","last_peered":"2023-10-09T15:30:59.688154+0000","last_clean":"2023-10-09T15:30:59.688154+0000","last_became_active":"2023-10-09T15:30:59.681493+0000","last_became_peered":"2023-10-09T15:30:59.681493+0000","last_unstale":"2023-10-09T15:30:59.688154+0000","last_undegraded":"2023-10-09T15:30:59.688154+0000","last_fullsized":"2023-10-09T15:30:59.688154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659649+0000","last_change":"2023-10-09T15:30:59.655754+0000","last_active":"2023-10-09T15:30:59.659649+0000","last_peered":"2023-10-09T15:30:59.659649+0000","last_clean":"2023-10-09T15:30:59.659649+0000","last_became_active":"2023-10-09T15:30:59.655349+0000","last_became_peered":"2023-10-09T15:30:59.655349+0000","last_unstale":"2023-10-09T15:30:59.659649+0000","last_undegraded":"2023-10-09T15:30:59.659649+0000","last_fullsized":"2023-10-09T15:30:59.659649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676461+0000","last_change":"2023-10-09T15:30:59.671922+0000","last_active":"2023-10-09T15:30:59.676461+0000","last_peered":"2023-10-09T15:30:59.676461+0000","last_clean":"2023-10-09T15:30:59.676461+0000","last_became_active":"2023-10-09T15:30:59.671653+0000","last_became_peered":"2023-10-09T15:30:59.671653+0000","last_unstale":"2023-10-09T15:30:59.676461+0000","last_undegraded":"2023-10-09T15:30:59.676461+0000","last_fullsized":"2023-10-09T15:30:59.676461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675676+0000","last_change":"2023-10-09T15:30:59.667346+0000","last_active":"2023-10-09T15:30:59.675676+0000","last_peered":"2023-10-09T15:30:59.675676+0000","last_clean":"2023-10-09T15:30:59.675676+0000","last_became_active":"2023-10-09T15:30:59.666133+0000","last_became_peered":"2023-10-09T15:30:59.666133+0000","last_unstale":"2023-10-09T15:30:59.675676+0000","last_undegraded":"2023-10-09T15:30:59.675676+0000","last_fullsized":"2023-10-09T15:30:59.675676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665591+0000","last_change":"2023-10-09T15:30:59.659235+0000","last_active":"2023-10-09T15:30:59.665591+0000","last_peered":"2023-10-09T15:30:59.665591+0000","last_clean":"2023-10-09T15:30:59.665591+0000","last_became_active":"2023-10-09T15:30:59.658828+0000","last_became_peered":"2023-10-09T15:30:59.658828+0000","last_unstale":"2023-10-09T15:30:59.665591+0000","last_undegraded":"2023-10-09T15:30:59.665591+0000","last_fullsized":"2023-10-09T15:30:59.665591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683058+0000","last_change":"2023-10-09T15:30:59.675159+0000","last_active":"2023-10-09T15:30:59.683058+0000","last_peered":"2023-10-09T15:30:59.683058+0000","last_clean":"2023-10-09T15:30:59.683058+0000","last_became_active":"2023-10-09T15:30:59.674897+0000","last_became_peered":"2023-10-09T15:30:59.674897+0000","last_unstale":"2023-10-09T15:30:59.683058+0000","last_undegraded":"2023-10-09T15:30:59.683058+0000","last_fullsized":"2023-10-09T15:30:59.683058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668705+0000","last_change":"2023-10-09T15:30:59.662912+0000","last_active":"2023-10-09T15:30:59.668705+0000","last_peered":"2023-10-09T15:30:59.668705+0000","last_clean":"2023-10-09T15:30:59.668705+0000","last_became_active":"2023-10-09T15:30:59.662380+0000","last_became_peered":"2023-10-09T15:30:59.662380+0000","last_unstale":"2023-10-09T15:30:59.668705+0000","last_undegraded":"2023-10-09T15:30:59.668705+0000","last_fullsized":"2023-10-09T15:30:59.668705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677401+0000","last_change":"2023-10-09T15:30:59.673219+0000","last_active":"2023-10-09T15:30:59.677401+0000","last_peered":"2023-10-09T15:30:59.677401+0000","last_clean":"2023-10-09T15:30:59.677401+0000","last_became_active":"2023-10-09T15:30:59.672928+0000","last_became_peered":"2023-10-09T15:30:59.672928+0000","last_unstale":"2023-10-09T15:30:59.677401+0000","last_undegraded":"2023-10-09T15:30:59.677401+0000","last_fullsized":"2023-10-09T15:30:59.677401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683108+0000","last_change":"2023-10-09T15:30:59.678780+0000","last_active":"2023-10-09T15:30:59.683108+0000","last_peered":"2023-10-09T15:30:59.683108+0000","last_clean":"2023-10-09T15:30:59.683108+0000","last_became_active":"2023-10-09T15:30:59.678502+0000","last_became_peered":"2023-10-09T15:30:59.678502+0000","last_unstale":"2023-10-09T15:30:59.683108+0000","last_undegraded":"2023-10-09T15:30:59.683108+0000","last_fullsized":"2023-10-09T15:30:59.683108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675559+0000","last_change":"2023-10-09T15:30:59.668814+0000","last_active":"2023-10-09T15:30:59.675559+0000","last_peered":"2023-10-09T15:30:59.675559+0000","last_clean":"2023-10-09T15:30:59.675559+0000","last_became_active":"2023-10-09T15:30:59.668501+0000","last_became_peered":"2023-10-09T15:30:59.668501+0000","last_unstale":"2023-10-09T15:30:59.675559+0000","last_undegraded":"2023-10-09T15:30:59.675559+0000","last_fullsized":"2023-10-09T15:30:59.675559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683026+0000","last_change":"2023-10-09T15:30:59.674502+0000","last_active":"2023-10-09T15:30:59.683026+0000","last_peered":"2023-10-09T15:30:59.683026+0000","last_clean":"2023-10-09T15:30:59.683026+0000","last_became_active":"2023-10-09T15:30:59.674165+0000","last_became_peered":"2023-10-09T15:30:59.674165+0000","last_unstale":"2023-10-09T15:30:59.683026+0000","last_undegraded":"2023-10-09T15:30:59.683026+0000","last_fullsized":"2023-10-09T15:30:59.683026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680953+0000","last_change":"2023-10-09T15:30:59.675013+0000","last_active":"2023-10-09T15:30:59.680953+0000","last_peered":"2023-10-09T15:30:59.680953+0000","last_clean":"2023-10-09T15:30:59.680953+0000","last_became_active":"2023-10-09T15:30:59.674731+0000","last_became_peered":"2023-10-09T15:30:59.674731+0000","last_unstale":"2023-10-09T15:30:59.680953+0000","last_undegraded":"2023-10-09T15:30:59.680953+0000","last_fullsized":"2023-10-09T15:30:59.680953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677154+0000","last_change":"2023-10-09T15:30:59.674112+0000","last_active":"2023-10-09T15:30:59.677154+0000","last_peered":"2023-10-09T15:30:59.677154+0000","last_clean":"2023-10-09T15:30:59.677154+0000","last_became_active":"2023-10-09T15:30:59.673855+0000","last_became_peered":"2023-10-09T15:30:59.673855+0000","last_unstale":"2023-10-09T15:30:59.677154+0000","last_undegraded":"2023-10-09T15:30:59.677154+0000","last_fullsized":"2023-10-09T15:30:59.677154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.661031+0000","last_change":"2023-10-09T15:30:59.656928+0000","last_active":"2023-10-09T15:30:59.661031+0000","last_peered":"2023-10-09T15:30:59.661031+0000","last_clean":"2023-10-09T15:30:59.661031+0000","last_became_active":"2023-10-09T15:30:59.656505+0000","last_became_peered":"2023-10-09T15:30:59.656505+0000","last_unstale":"2023-10-09T15:30:59.661031+0000","last_undegraded":"2023-10-09T15:30:59.661031+0000","last_fullsized":"2023-10-09T15:30:59.661031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:12.953 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.106+0000 7fa50edcd700 1 Processor -- start 2023-10-09T15:31:13.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.106+0000 7fa50edcd700 1 -- start start 2023-10-09T15:31:13.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080b07d0 0x7fa5080ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa5080cf200 0x7fa5080cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5080b0ba0 0x7fa50806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50815a280 con 0x7fa5080b0ba0 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa50806e180 con 0x7fa5080cf200 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50edcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080cd540 con 0x7fa5080b07d0 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5080b0ba0 0x7fa50806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa5080b0ba0 0x7fa50806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53096/0 (socket says 172.21.15.33:53096) 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 -- 172.21.15.33:0/1721132205 learned_addr learned my addr 172.21.15.33:0/1721132205 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa507fff700 1 --2- 172.21.15.33:0/1721132205 >> v2:172.21.15.59:3300/0 conn(0x7fa5080cf200 0x7fa5080cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50cb69700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080b07d0 0x7fa5080ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 -- 172.21.15.33:0/1721132205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080b07d0 msgr2=0x7fa5080ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080b07d0 0x7fa5080ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 -- 172.21.15.33:0/1721132205 >> v2:172.21.15.59:3300/0 conn(0x7fa5080cf200 msgr2=0x7fa5080cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 --2- 172.21.15.33:0/1721132205 >> v2:172.21.15.59:3300/0 conn(0x7fa5080cf200 0x7fa5080cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 -- 172.21.15.33:0/1721132205 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa50806d850 con 0x7fa5080b0ba0 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.107+0000 7fa50d36a700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50806e610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa508064ed0 tx=0x7fa500009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d00057d64d33b5d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa5077fe700 1 -- 172.21.15.33:0/1721132205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50000e070 con 0x7fa5080b0ba0 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa5077fe700 1 -- 172.21.15.33:0/1721132205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50000bae0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa5077fe700 1 -- 172.21.15.33:0/1721132205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5000092e0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 -- 172.21.15.33:0/1721132205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 msgr2=0x7fa50806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50806e610 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fa508064ed0 tx=0x7fa500009840 comp rx=0 tx=0).stop 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 -- 172.21.15.33:0/1721132205 shutdown_connections 2023-10-09T15:31:13.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50806e610 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 --2- 172.21.15.33:0/1721132205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080b07d0 0x7fa5080ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 --2- 172.21.15.33:0/1721132205 >> v2:172.21.15.59:3300/0 conn(0x7fa5080cf200 0x7fa5080cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 -- 172.21.15.33:0/1721132205 >> 172.21.15.33:0/1721132205 conn(0x7fa50806ce80 msgr2=0x7fa5080ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:13.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 -- 172.21.15.33:0/1721132205 shutdown_connections 2023-10-09T15:31:13.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.108+0000 7fa50edcd700 1 -- 172.21.15.33:0/1721132205 wait complete. 2023-10-09T15:31:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.109+0000 7fa50edcd700 1 Processor -- start 2023-10-09T15:31:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.109+0000 7fa50edcd700 1 -- start start 2023-10-09T15:31:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5080b07d0 0x7fa5080c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 0x7fa50814afb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080981d0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa508098790 con 0x7fa5080b07d0 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50edcd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5080c5b00 con 0x7fa5080cf200 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa507fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa507fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53098/0 (socket says 172.21.15.33:53098) 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa507fff700 1 -- 172.21.15.33:0/3695386573 learned_addr learned my addr 172.21.15.33:0/3695386573 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50cb69700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5080b07d0 0x7fa5080c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.110+0000 7fa50d36a700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 0x7fa50814afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 -- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 msgr2=0x7fa50814afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 0x7fa50814afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 -- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5080b07d0 msgr2=0x7fa5080c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5080b07d0 0x7fa5080c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 -- 172.21.15.33:0/3695386573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa500009ae0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa50d36a700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 0x7fa50814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa507fff700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800d890 tx=0x7fa4f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f80125f0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f8012750 con 0x7fa5080b0ba0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f8012b10 con 0x7fa5080b0ba0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5080c8140 con 0x7fa5080b0ba0 2023-10-09T15:31:13.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.111+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa508098420 con 0x7fa5080b0ba0 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.112+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa508098900 con 0x7fa5080b0ba0 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.112+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa4f801e460 con 0x7fa5080b0ba0 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.113+0000 7fa504ff9700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.113+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4f8084ad0 con 0x7fa5080b0ba0 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.113+0000 7fa50cb69700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.113+0000 7fa50cb69700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006aa0 tx=0x7fa4f0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.117+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4f8051d40 con 0x7fa5080b0ba0 2023-10-09T15:31:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.309+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa50804c3c0 con 0x7fa4e8066f30 2023-10-09T15:31:13.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.316+0000 7fa504ff9700 1 -- 172.21.15.33:0/3695386573 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+264485 (secure 0 0 0) 0x7fa50804c3c0 con 0x7fa4e8066f30 2023-10-09T15:31:13.320 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 msgr2=0x7fa4e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 0x7fa4e80693e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0006aa0 tx=0x7fa4f0008040 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 msgr2=0x7fa50809a200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa4f800d890 tx=0x7fa4f8008040 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 shutdown_connections 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4e8066f30 0x7fa4e80693e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5080cf200 0x7fa50814afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5080b07d0 0x7fa5080c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 --2- 172.21.15.33:0/3695386573 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa5080b0ba0 0x7fa50809a200 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 >> 172.21.15.33:0/3695386573 conn(0x7fa50806ce80 msgr2=0x7fa5080c8b10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:13.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 shutdown_connections 2023-10-09T15:31:13.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.319+0000 7fa50edcd700 1 -- 172.21.15.33:0/3695386573 wait complete. 2023-10-09T15:31:13.323 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:13.332 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-10-09T15:31:13.238287+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381124,"kb_used_data":2820,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752593596,"statfs":{"total":773094113280,"available":770655842304,"internally_reserved":0,"allocated":2887680,"data_stored":1749569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003063"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682261+0000","last_change":"2023-10-09T15:30:59.675453+0000","last_active":"2023-10-09T15:30:59.682261+0000","last_peered":"2023-10-09T15:30:59.682261+0000","last_clean":"2023-10-09T15:30:59.682261+0000","last_became_active":"2023-10-09T15:30:59.675159+0000","last_became_peered":"2023-10-09T15:30:59.675159+0000","last_unstale":"2023-10-09T15:30:59.682261+0000","last_undegraded":"2023-10-09T15:30:59.682261+0000","last_fullsized":"2023-10-09T15:30:59.682261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670422+0000","last_change":"2023-10-09T15:30:59.666350+0000","last_active":"2023-10-09T15:30:59.670422+0000","last_peered":"2023-10-09T15:30:59.670422+0000","last_clean":"2023-10-09T15:30:59.670422+0000","last_became_active":"2023-10-09T15:30:59.665970+0000","last_became_peered":"2023-10-09T15:30:59.665970+0000","last_unstale":"2023-10-09T15:30:59.670422+0000","last_undegraded":"2023-10-09T15:30:59.670422+0000","last_fullsized":"2023-10-09T15:30:59.670422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669088+0000","last_change":"2023-10-09T15:30:59.663886+0000","last_active":"2023-10-09T15:30:59.669088+0000","last_peered":"2023-10-09T15:30:59.669088+0000","last_clean":"2023-10-09T15:30:59.669088+0000","last_became_active":"2023-10-09T15:30:59.663598+0000","last_became_peered":"2023-10-09T15:30:59.663598+0000","last_unstale":"2023-10-09T15:30:59.669088+0000","last_undegraded":"2023-10-09T15:30:59.669088+0000","last_fullsized":"2023-10-09T15:30:59.669088+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672923+0000","last_change":"2023-10-09T15:30:59.666790+0000","last_active":"2023-10-09T15:30:59.672923+0000","last_peered":"2023-10-09T15:30:59.672923+0000","last_clean":"2023-10-09T15:30:59.672923+0000","last_became_active":"2023-10-09T15:30:59.666144+0000","last_became_peered":"2023-10-09T15:30:59.666144+0000","last_unstale":"2023-10-09T15:30:59.672923+0000","last_undegraded":"2023-10-09T15:30:59.672923+0000","last_fullsized":"2023-10-09T15:30:59.672923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679237+0000","last_change":"2023-10-09T15:30:59.670991+0000","last_active":"2023-10-09T15:30:59.679237+0000","last_peered":"2023-10-09T15:30:59.679237+0000","last_clean":"2023-10-09T15:30:59.679237+0000","last_became_active":"2023-10-09T15:30:59.670704+0000","last_became_peered":"2023-10-09T15:30:59.670704+0000","last_unstale":"2023-10-09T15:30:59.679237+0000","last_undegraded":"2023-10-09T15:30:59.679237+0000","last_fullsized":"2023-10-09T15:30:59.679237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675697+0000","last_change":"2023-10-09T15:30:59.667866+0000","last_active":"2023-10-09T15:30:59.675697+0000","last_peered":"2023-10-09T15:30:59.675697+0000","last_clean":"2023-10-09T15:30:59.675697+0000","last_became_active":"2023-10-09T15:30:59.667647+0000","last_became_peered":"2023-10-09T15:30:59.667647+0000","last_unstale":"2023-10-09T15:30:59.675697+0000","last_undegraded":"2023-10-09T15:30:59.675697+0000","last_fullsized":"2023-10-09T15:30:59.675697+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679218+0000","last_change":"2023-10-09T15:30:59.670699+0000","last_active":"2023-10-09T15:30:59.679218+0000","last_peered":"2023-10-09T15:30:59.679218+0000","last_clean":"2023-10-09T15:30:59.679218+0000","last_became_active":"2023-10-09T15:30:59.670342+0000","last_became_peered":"2023-10-09T15:30:59.670342+0000","last_unstale":"2023-10-09T15:30:59.679218+0000","last_undegraded":"2023-10-09T15:30:59.679218+0000","last_fullsized":"2023-10-09T15:30:59.679218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:35.110907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679139+0000","last_change":"2023-10-09T15:30:59.670588+0000","last_active":"2023-10-09T15:30:59.679139+0000","last_peered":"2023-10-09T15:30:59.679139+0000","last_clean":"2023-10-09T15:30:59.679139+0000","last_became_active":"2023-10-09T15:30:59.670286+0000","last_became_peered":"2023-10-09T15:30:59.670286+0000","last_unstale":"2023-10-09T15:30:59.679139+0000","last_undegraded":"2023-10-09T15:30:59.679139+0000","last_fullsized":"2023-10-09T15:30:59.679139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682230+0000","last_change":"2023-10-09T15:30:59.674866+0000","last_active":"2023-10-09T15:30:59.682230+0000","last_peered":"2023-10-09T15:30:59.682230+0000","last_clean":"2023-10-09T15:30:59.682230+0000","last_became_active":"2023-10-09T15:30:59.674592+0000","last_became_peered":"2023-10-09T15:30:59.674592+0000","last_unstale":"2023-10-09T15:30:59.682230+0000","last_undegraded":"2023-10-09T15:30:59.682230+0000","last_fullsized":"2023-10-09T15:30:59.682230+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:13:18.896209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677373+0000","last_change":"2023-10-09T15:30:59.670458+0000","last_active":"2023-10-09T15:30:59.677373+0000","last_peered":"2023-10-09T15:30:59.677373+0000","last_clean":"2023-10-09T15:30:59.677373+0000","last_became_active":"2023-10-09T15:30:59.670170+0000","last_became_peered":"2023-10-09T15:30:59.670170+0000","last_unstale":"2023-10-09T15:30:59.677373+0000","last_undegraded":"2023-10-09T15:30:59.677373+0000","last_fullsized":"2023-10-09T15:30:59.677373+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677264+0000","last_change":"2023-10-09T15:30:59.672093+0000","last_active":"2023-10-09T15:30:59.677264+0000","last_peered":"2023-10-09T15:30:59.677264+0000","last_clean":"2023-10-09T15:30:59.677264+0000","last_became_active":"2023-10-09T15:30:59.671829+0000","last_became_peered":"2023-10-09T15:30:59.671829+0000","last_unstale":"2023-10-09T15:30:59.677264+0000","last_undegraded":"2023-10-09T15:30:59.677264+0000","last_fullsized":"2023-10-09T15:30:59.677264+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674095+0000","last_change":"2023-10-09T15:30:59.652602+0000","last_active":"2023-10-09T15:30:59.674095+0000","last_peered":"2023-10-09T15:30:59.674095+0000","last_clean":"2023-10-09T15:30:59.674095+0000","last_became_active":"2023-10-09T15:30:59.652304+0000","last_became_peered":"2023-10-09T15:30:59.652304+0000","last_unstale":"2023-10-09T15:30:59.674095+0000","last_undegraded":"2023-10-09T15:30:59.674095+0000","last_fullsized":"2023-10-09T15:30:59.674095+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:07.825038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.662644+0000","last_change":"2023-10-09T15:30:59.658543+0000","last_active":"2023-10-09T15:30:59.662644+0000","last_peered":"2023-10-09T15:30:59.662644+0000","last_clean":"2023-10-09T15:30:59.662644+0000","last_became_active":"2023-10-09T15:30:59.658260+0000","last_became_peered":"2023-10-09T15:30:59.658260+0000","last_unstale":"2023-10-09T15:30:59.662644+0000","last_undegraded":"2023-10-09T15:30:59.662644+0000","last_fullsized":"2023-10-09T15:30:59.662644+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665749+0000","last_change":"2023-10-09T15:30:59.661916+0000","last_active":"2023-10-09T15:30:59.665749+0000","last_peered":"2023-10-09T15:30:59.665749+0000","last_clean":"2023-10-09T15:30:59.665749+0000","last_became_active":"2023-10-09T15:30:59.661612+0000","last_became_peered":"2023-10-09T15:30:59.661612+0000","last_unstale":"2023-10-09T15:30:59.665749+0000","last_undegraded":"2023-10-09T15:30:59.665749+0000","last_fullsized":"2023-10-09T15:30:59.665749+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680476+0000","last_change":"2023-10-09T15:30:59.677507+0000","last_active":"2023-10-09T15:30:59.680476+0000","last_peered":"2023-10-09T15:30:59.680476+0000","last_clean":"2023-10-09T15:30:59.680476+0000","last_became_active":"2023-10-09T15:30:59.677142+0000","last_became_peered":"2023-10-09T15:30:59.677142+0000","last_unstale":"2023-10-09T15:30:59.680476+0000","last_undegraded":"2023-10-09T15:30:59.680476+0000","last_fullsized":"2023-10-09T15:30:59.680476+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675582+0000","last_change":"2023-10-09T15:30:59.669137+0000","last_active":"2023-10-09T15:30:59.675582+0000","last_peered":"2023-10-09T15:30:59.675582+0000","last_clean":"2023-10-09T15:30:59.675582+0000","last_became_active":"2023-10-09T15:30:59.668871+0000","last_became_peered":"2023-10-09T15:30:59.668871+0000","last_unstale":"2023-10-09T15:30:59.675582+0000","last_undegraded":"2023-10-09T15:30:59.675582+0000","last_fullsized":"2023-10-09T15:30:59.675582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681093+0000","last_change":"2023-10-09T15:30:59.675035+0000","last_active":"2023-10-09T15:30:59.681093+0000","last_peered":"2023-10-09T15:30:59.681093+0000","last_clean":"2023-10-09T15:30:59.681093+0000","last_became_active":"2023-10-09T15:30:59.674718+0000","last_became_peered":"2023-10-09T15:30:59.674718+0000","last_unstale":"2023-10-09T15:30:59.681093+0000","last_undegraded":"2023-10-09T15:30:59.681093+0000","last_fullsized":"2023-10-09T15:30:59.681093+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:39:49.394721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677089+0000","last_change":"2023-10-09T15:30:59.675915+0000","last_active":"2023-10-09T15:30:59.677089+0000","last_peered":"2023-10-09T15:30:59.677089+0000","last_clean":"2023-10-09T15:30:59.677089+0000","last_became_active":"2023-10-09T15:30:59.675642+0000","last_became_peered":"2023-10-09T15:30:59.675642+0000","last_unstale":"2023-10-09T15:30:59.677089+0000","last_undegraded":"2023-10-09T15:30:59.677089+0000","last_fullsized":"2023-10-09T15:30:59.677089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679359+0000","last_change":"2023-10-09T15:30:59.671221+0000","last_active":"2023-10-09T15:30:59.679359+0000","last_peered":"2023-10-09T15:30:59.679359+0000","last_clean":"2023-10-09T15:30:59.679359+0000","last_became_active":"2023-10-09T15:30:59.670944+0000","last_became_peered":"2023-10-09T15:30:59.670944+0000","last_unstale":"2023-10-09T15:30:59.679359+0000","last_undegraded":"2023-10-09T15:30:59.679359+0000","last_fullsized":"2023-10-09T15:30:59.679359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682812+0000","last_change":"2023-10-09T15:30:58.654623+0000","last_active":"2023-10-09T15:30:59.682812+0000","last_peered":"2023-10-09T15:30:59.682812+0000","last_clean":"2023-10-09T15:30:59.682812+0000","last_became_active":"2023-10-09T15:30:58.654351+0000","last_became_peered":"2023-10-09T15:30:58.654351+0000","last_unstale":"2023-10-09T15:30:59.682812+0000","last_undegraded":"2023-10-09T15:30:59.682812+0000","last_fullsized":"2023-10-09T15:30:59.682812+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.660456+0000","last_change":"2023-10-09T15:30:59.656560+0000","last_active":"2023-10-09T15:30:59.660456+0000","last_peered":"2023-10-09T15:30:59.660456+0000","last_clean":"2023-10-09T15:30:59.660456+0000","last_became_active":"2023-10-09T15:30:59.656293+0000","last_became_peered":"2023-10-09T15:30:59.656293+0000","last_unstale":"2023-10-09T15:30:59.660456+0000","last_undegraded":"2023-10-09T15:30:59.660456+0000","last_fullsized":"2023-10-09T15:30:59.660456+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679270+0000","last_change":"2023-10-09T15:30:58.659955+0000","last_active":"2023-10-09T15:30:59.679270+0000","last_peered":"2023-10-09T15:30:59.679270+0000","last_clean":"2023-10-09T15:30:59.679270+0000","last_became_active":"2023-10-09T15:30:58.659645+0000","last_became_peered":"2023-10-09T15:30:58.659645+0000","last_unstale":"2023-10-09T15:30:59.679270+0000","last_undegraded":"2023-10-09T15:30:59.679270+0000","last_fullsized":"2023-10-09T15:30:59.679270+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675130+0000","last_change":"2023-10-09T15:30:59.667774+0000","last_active":"2023-10-09T15:30:59.675130+0000","last_peered":"2023-10-09T15:30:59.675130+0000","last_clean":"2023-10-09T15:30:59.675130+0000","last_became_active":"2023-10-09T15:30:59.667490+0000","last_became_peered":"2023-10-09T15:30:59.667490+0000","last_unstale":"2023-10-09T15:30:59.675130+0000","last_undegraded":"2023-10-09T15:30:59.675130+0000","last_fullsized":"2023-10-09T15:30:59.675130+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680068+0000","last_change":"2023-10-09T15:30:58.658690+0000","last_active":"2023-10-09T15:30:59.680068+0000","last_peered":"2023-10-09T15:30:59.680068+0000","last_clean":"2023-10-09T15:30:59.680068+0000","last_became_active":"2023-10-09T15:30:58.658429+0000","last_became_peered":"2023-10-09T15:30:58.658429+0000","last_unstale":"2023-10-09T15:30:59.680068+0000","last_undegraded":"2023-10-09T15:30:59.680068+0000","last_fullsized":"2023-10-09T15:30:59.680068+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681667+0000","last_change":"2023-10-09T15:30:59.678307+0000","last_active":"2023-10-09T15:30:59.681667+0000","last_peered":"2023-10-09T15:30:59.681667+0000","last_clean":"2023-10-09T15:30:59.681667+0000","last_became_active":"2023-10-09T15:30:59.678048+0000","last_became_peered":"2023-10-09T15:30:59.678048+0000","last_unstale":"2023-10-09T15:30:59.681667+0000","last_undegraded":"2023-10-09T15:30:59.681667+0000","last_fullsized":"2023-10-09T15:30:59.681667+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681194+0000","last_change":"2023-10-09T15:30:58.661313+0000","last_active":"2023-10-09T15:30:59.681194+0000","last_peered":"2023-10-09T15:30:59.681194+0000","last_clean":"2023-10-09T15:30:59.681194+0000","last_became_active":"2023-10-09T15:30:58.661029+0000","last_became_peered":"2023-10-09T15:30:58.661029+0000","last_unstale":"2023-10-09T15:30:59.681194+0000","last_undegraded":"2023-10-09T15:30:59.681194+0000","last_fullsized":"2023-10-09T15:30:59.681194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:20.445789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681768+0000","last_change":"2023-10-09T15:30:59.679014+0000","last_active":"2023-10-09T15:30:59.681768+0000","last_peered":"2023-10-09T15:30:59.681768+0000","last_clean":"2023-10-09T15:30:59.681768+0000","last_became_active":"2023-10-09T15:30:59.678577+0000","last_became_peered":"2023-10-09T15:30:59.678577+0000","last_unstale":"2023-10-09T15:30:59.681768+0000","last_undegraded":"2023-10-09T15:30:59.681768+0000","last_fullsized":"2023-10-09T15:30:59.681768+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:31.203098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681275+0000","last_change":"2023-10-09T15:30:58.656303+0000","last_active":"2023-10-09T15:30:59.681275+0000","last_peered":"2023-10-09T15:30:59.681275+0000","last_clean":"2023-10-09T15:30:59.681275+0000","last_became_active":"2023-10-09T15:30:58.655754+0000","last_became_peered":"2023-10-09T15:30:58.655754+0000","last_unstale":"2023-10-09T15:30:59.681275+0000","last_undegraded":"2023-10-09T15:30:59.681275+0000","last_fullsized":"2023-10-09T15:30:59.681275+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677214+0000","last_change":"2023-10-09T15:30:59.661929+0000","last_active":"2023-10-09T15:30:59.677214+0000","last_peered":"2023-10-09T15:30:59.677214+0000","last_clean":"2023-10-09T15:30:59.677214+0000","last_became_active":"2023-10-09T15:30:59.661661+0000","last_became_peered":"2023-10-09T15:30:59.661661+0000","last_unstale":"2023-10-09T15:30:59.677214+0000","last_undegraded":"2023-10-09T15:30:59.677214+0000","last_fullsized":"2023-10-09T15:30:59.677214+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:21.450587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678717+0000","last_change":"2023-10-09T15:30:58.651818+0000","last_active":"2023-10-09T15:30:59.678717+0000","last_peered":"2023-10-09T15:30:59.678717+0000","last_clean":"2023-10-09T15:30:59.678717+0000","last_became_active":"2023-10-09T15:30:58.651546+0000","last_became_peered":"2023-10-09T15:30:58.651546+0000","last_unstale":"2023-10-09T15:30:59.678717+0000","last_undegraded":"2023-10-09T15:30:59.678717+0000","last_fullsized":"2023-10-09T15:30:59.678717+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665613+0000","last_change":"2023-10-09T15:30:59.660923+0000","last_active":"2023-10-09T15:30:59.665613+0000","last_peered":"2023-10-09T15:30:59.665613+0000","last_clean":"2023-10-09T15:30:59.665613+0000","last_became_active":"2023-10-09T15:30:59.660614+0000","last_became_peered":"2023-10-09T15:30:59.660614+0000","last_unstale":"2023-10-09T15:30:59.665613+0000","last_undegraded":"2023-10-09T15:30:59.665613+0000","last_fullsized":"2023-10-09T15:30:59.665613+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.652963+0000","last_change":"2023-10-09T15:30:58.654565+0000","last_active":"2023-10-09T15:30:59.652963+0000","last_peered":"2023-10-09T15:30:59.652963+0000","last_clean":"2023-10-09T15:30:59.652963+0000","last_became_active":"2023-10-09T15:30:58.654100+0000","last_became_peered":"2023-10-09T15:30:58.654100+0000","last_unstale":"2023-10-09T15:30:59.652963+0000","last_undegraded":"2023-10-09T15:30:59.652963+0000","last_fullsized":"2023-10-09T15:30:59.652963+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:12.963604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.663038+0000","last_change":"2023-10-09T15:30:59.659944+0000","last_active":"2023-10-09T15:30:59.663038+0000","last_peered":"2023-10-09T15:30:59.663038+0000","last_clean":"2023-10-09T15:30:59.663038+0000","last_became_active":"2023-10-09T15:30:59.659370+0000","last_became_peered":"2023-10-09T15:30:59.659370+0000","last_unstale":"2023-10-09T15:30:59.663038+0000","last_undegraded":"2023-10-09T15:30:59.663038+0000","last_fullsized":"2023-10-09T15:30:59.663038+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657161+0000","last_change":"2023-10-09T15:30:58.663665+0000","last_active":"2023-10-09T15:30:59.657161+0000","last_peered":"2023-10-09T15:30:59.657161+0000","last_clean":"2023-10-09T15:30:59.657161+0000","last_became_active":"2023-10-09T15:30:58.663374+0000","last_became_peered":"2023-10-09T15:30:58.663374+0000","last_unstale":"2023-10-09T15:30:59.657161+0000","last_undegraded":"2023-10-09T15:30:59.657161+0000","last_fullsized":"2023-10-09T15:30:59.657161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668305+0000","last_change":"2023-10-09T15:30:59.662643+0000","last_active":"2023-10-09T15:30:59.668305+0000","last_peered":"2023-10-09T15:30:59.668305+0000","last_clean":"2023-10-09T15:30:59.668305+0000","last_became_active":"2023-10-09T15:30:59.662002+0000","last_became_peered":"2023-10-09T15:30:59.662002+0000","last_unstale":"2023-10-09T15:30:59.668305+0000","last_undegraded":"2023-10-09T15:30:59.668305+0000","last_fullsized":"2023-10-09T15:30:59.668305+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648439+0000","last_change":"2023-10-09T15:30:58.657412+0000","last_active":"2023-10-09T15:30:59.648439+0000","last_peered":"2023-10-09T15:30:59.648439+0000","last_clean":"2023-10-09T15:30:59.648439+0000","last_became_active":"2023-10-09T15:30:58.657086+0000","last_became_peered":"2023-10-09T15:30:58.657086+0000","last_unstale":"2023-10-09T15:30:59.648439+0000","last_undegraded":"2023-10-09T15:30:59.648439+0000","last_fullsized":"2023-10-09T15:30:59.648439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678652+0000","last_change":"2023-10-09T15:30:59.672392+0000","last_active":"2023-10-09T15:30:59.678652+0000","last_peered":"2023-10-09T15:30:59.678652+0000","last_clean":"2023-10-09T15:30:59.678652+0000","last_became_active":"2023-10-09T15:30:59.671757+0000","last_became_peered":"2023-10-09T15:30:59.671757+0000","last_unstale":"2023-10-09T15:30:59.678652+0000","last_undegraded":"2023-10-09T15:30:59.678652+0000","last_fullsized":"2023-10-09T15:30:59.678652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658666+0000","last_change":"2023-10-09T15:30:58.657247+0000","last_active":"2023-10-09T15:30:59.658666+0000","last_peered":"2023-10-09T15:30:59.658666+0000","last_clean":"2023-10-09T15:30:59.658666+0000","last_became_active":"2023-10-09T15:30:58.656943+0000","last_became_peered":"2023-10-09T15:30:58.656943+0000","last_unstale":"2023-10-09T15:30:59.658666+0000","last_undegraded":"2023-10-09T15:30:59.658666+0000","last_fullsized":"2023-10-09T15:30:59.658666+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:41.413876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675152+0000","last_change":"2023-10-09T15:30:59.667816+0000","last_active":"2023-10-09T15:30:59.675152+0000","last_peered":"2023-10-09T15:30:59.675152+0000","last_clean":"2023-10-09T15:30:59.675152+0000","last_became_active":"2023-10-09T15:30:59.667529+0000","last_became_peered":"2023-10-09T15:30:59.667529+0000","last_unstale":"2023-10-09T15:30:59.675152+0000","last_undegraded":"2023-10-09T15:30:59.675152+0000","last_fullsized":"2023-10-09T15:30:59.675152+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682943+0000","last_change":"2023-10-09T15:30:58.661206+0000","last_active":"2023-10-09T15:30:59.682943+0000","last_peered":"2023-10-09T15:30:59.682943+0000","last_clean":"2023-10-09T15:30:59.682943+0000","last_became_active":"2023-10-09T15:30:58.660947+0000","last_became_peered":"2023-10-09T15:30:58.660947+0000","last_unstale":"2023-10-09T15:30:59.682943+0000","last_undegraded":"2023-10-09T15:30:59.682943+0000","last_fullsized":"2023-10-09T15:30:59.682943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.682953+0000","last_change":"2023-10-09T15:30:59.670968+0000","last_active":"2023-10-09T15:30:59.682953+0000","last_peered":"2023-10-09T15:30:59.682953+0000","last_clean":"2023-10-09T15:30:59.682953+0000","last_became_active":"2023-10-09T15:30:59.670674+0000","last_became_peered":"2023-10-09T15:30:59.670674+0000","last_unstale":"2023-10-09T15:30:59.682953+0000","last_undegraded":"2023-10-09T15:30:59.682953+0000","last_fullsized":"2023-10-09T15:30:59.682953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:50.286664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.685943+0000","last_change":"2023-10-09T15:30:58.651540+0000","last_active":"2023-10-09T15:30:59.685943+0000","last_peered":"2023-10-09T15:30:59.685943+0000","last_clean":"2023-10-09T15:30:59.685943+0000","last_became_active":"2023-10-09T15:30:58.651207+0000","last_became_peered":"2023-10-09T15:30:58.651207+0000","last_unstale":"2023-10-09T15:30:59.685943+0000","last_undegraded":"2023-10-09T15:30:59.685943+0000","last_fullsized":"2023-10-09T15:30:59.685943+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679374+0000","last_change":"2023-10-09T15:30:59.672317+0000","last_active":"2023-10-09T15:30:59.679374+0000","last_peered":"2023-10-09T15:30:59.679374+0000","last_clean":"2023-10-09T15:30:59.679374+0000","last_became_active":"2023-10-09T15:30:59.671578+0000","last_became_peered":"2023-10-09T15:30:59.671578+0000","last_unstale":"2023-10-09T15:30:59.679374+0000","last_undegraded":"2023-10-09T15:30:59.679374+0000","last_fullsized":"2023-10-09T15:30:59.679374+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:09.514863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683332+0000","last_change":"2023-10-09T15:30:58.655428+0000","last_active":"2023-10-09T15:30:59.683332+0000","last_peered":"2023-10-09T15:30:59.683332+0000","last_clean":"2023-10-09T15:30:59.683332+0000","last_became_active":"2023-10-09T15:30:58.655117+0000","last_became_peered":"2023-10-09T15:30:58.655117+0000","last_unstale":"2023-10-09T15:30:59.683332+0000","last_undegraded":"2023-10-09T15:30:59.683332+0000","last_fullsized":"2023-10-09T15:30:59.683332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:14:24.870125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677001+0000","last_change":"2023-10-09T15:30:59.672831+0000","last_active":"2023-10-09T15:30:59.677001+0000","last_peered":"2023-10-09T15:30:59.677001+0000","last_clean":"2023-10-09T15:30:59.677001+0000","last_became_active":"2023-10-09T15:30:59.672528+0000","last_became_peered":"2023-10-09T15:30:59.672528+0000","last_unstale":"2023-10-09T15:30:59.677001+0000","last_undegraded":"2023-10-09T15:30:59.677001+0000","last_fullsized":"2023-10-09T15:30:59.677001+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654038+0000","last_change":"2023-10-09T15:30:58.658373+0000","last_active":"2023-10-09T15:30:59.654038+0000","last_peered":"2023-10-09T15:30:59.654038+0000","last_clean":"2023-10-09T15:30:59.654038+0000","last_became_active":"2023-10-09T15:30:58.657565+0000","last_became_peered":"2023-10-09T15:30:58.657565+0000","last_unstale":"2023-10-09T15:30:59.654038+0000","last_undegraded":"2023-10-09T15:30:59.654038+0000","last_fullsized":"2023-10-09T15:30:59.654038+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681399+0000","last_change":"2023-10-09T15:30:59.680133+0000","last_active":"2023-10-09T15:30:59.681399+0000","last_peered":"2023-10-09T15:30:59.681399+0000","last_clean":"2023-10-09T15:30:59.681399+0000","last_became_active":"2023-10-09T15:30:59.679719+0000","last_became_peered":"2023-10-09T15:30:59.679719+0000","last_unstale":"2023-10-09T15:30:59.681399+0000","last_undegraded":"2023-10-09T15:30:59.681399+0000","last_fullsized":"2023-10-09T15:30:59.681399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.648962+0000","last_change":"2023-10-09T15:30:58.651661+0000","last_active":"2023-10-09T15:30:59.648962+0000","last_peered":"2023-10-09T15:30:59.648962+0000","last_clean":"2023-10-09T15:30:59.648962+0000","last_became_active":"2023-10-09T15:30:58.651305+0000","last_became_peered":"2023-10-09T15:30:58.651305+0000","last_unstale":"2023-10-09T15:30:59.648962+0000","last_undegraded":"2023-10-09T15:30:59.648962+0000","last_fullsized":"2023-10-09T15:30:59.648962+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659671+0000","last_change":"2023-10-09T15:30:59.655537+0000","last_active":"2023-10-09T15:30:59.659671+0000","last_peered":"2023-10-09T15:30:59.659671+0000","last_clean":"2023-10-09T15:30:59.659671+0000","last_became_active":"2023-10-09T15:30:59.655224+0000","last_became_peered":"2023-10-09T15:30:59.655224+0000","last_unstale":"2023-10-09T15:30:59.659671+0000","last_undegraded":"2023-10-09T15:30:59.659671+0000","last_fullsized":"2023-10-09T15:30:59.659671+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680601+0000","last_change":"2023-10-09T15:30:58.656284+0000","last_active":"2023-10-09T15:30:59.680601+0000","last_peered":"2023-10-09T15:30:59.680601+0000","last_clean":"2023-10-09T15:30:59.680601+0000","last_became_active":"2023-10-09T15:30:58.655961+0000","last_became_peered":"2023-10-09T15:30:58.655961+0000","last_unstale":"2023-10-09T15:30:59.680601+0000","last_undegraded":"2023-10-09T15:30:59.680601+0000","last_fullsized":"2023-10-09T15:30:59.680601+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681315+0000","last_change":"2023-10-09T15:30:59.678338+0000","last_active":"2023-10-09T15:30:59.681315+0000","last_peered":"2023-10-09T15:30:59.681315+0000","last_clean":"2023-10-09T15:30:59.681315+0000","last_became_active":"2023-10-09T15:30:59.678037+0000","last_became_peered":"2023-10-09T15:30:59.678037+0000","last_unstale":"2023-10-09T15:30:59.681315+0000","last_undegraded":"2023-10-09T15:30:59.681315+0000","last_fullsized":"2023-10-09T15:30:59.681315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:01.789153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683056+0000","last_change":"2023-10-09T15:30:58.650299+0000","last_active":"2023-10-09T15:30:59.683056+0000","last_peered":"2023-10-09T15:30:59.683056+0000","last_clean":"2023-10-09T15:30:59.683056+0000","last_became_active":"2023-10-09T15:30:58.650000+0000","last_became_peered":"2023-10-09T15:30:58.650000+0000","last_unstale":"2023-10-09T15:30:59.683056+0000","last_undegraded":"2023-10-09T15:30:59.683056+0000","last_fullsized":"2023-10-09T15:30:59.683056+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:15:38.068836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680986+0000","last_change":"2023-10-09T15:30:59.678288+0000","last_active":"2023-10-09T15:30:59.680986+0000","last_peered":"2023-10-09T15:30:59.680986+0000","last_clean":"2023-10-09T15:30:59.680986+0000","last_became_active":"2023-10-09T15:30:59.677944+0000","last_became_peered":"2023-10-09T15:30:59.677944+0000","last_unstale":"2023-10-09T15:30:59.680986+0000","last_undegraded":"2023-10-09T15:30:59.680986+0000","last_fullsized":"2023-10-09T15:30:59.680986+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.658167+0000","last_change":"2023-10-09T15:30:58.658451+0000","last_active":"2023-10-09T15:30:59.658167+0000","last_peered":"2023-10-09T15:30:59.658167+0000","last_clean":"2023-10-09T15:30:59.658167+0000","last_became_active":"2023-10-09T15:30:58.658175+0000","last_became_peered":"2023-10-09T15:30:58.658175+0000","last_unstale":"2023-10-09T15:30:59.658167+0000","last_undegraded":"2023-10-09T15:30:59.658167+0000","last_fullsized":"2023-10-09T15:30:59.658167+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681686+0000","last_change":"2023-10-09T15:30:59.676593+0000","last_active":"2023-10-09T15:30:59.681686+0000","last_peered":"2023-10-09T15:30:59.681686+0000","last_clean":"2023-10-09T15:30:59.681686+0000","last_became_active":"2023-10-09T15:30:59.676207+0000","last_became_peered":"2023-10-09T15:30:59.676207+0000","last_unstale":"2023-10-09T15:30:59.681686+0000","last_undegraded":"2023-10-09T15:30:59.681686+0000","last_fullsized":"2023-10-09T15:30:59.681686+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:29.834943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653922+0000","last_change":"2023-10-09T15:30:58.658074+0000","last_active":"2023-10-09T15:30:59.653922+0000","last_peered":"2023-10-09T15:30:59.653922+0000","last_clean":"2023-10-09T15:30:59.653922+0000","last_became_active":"2023-10-09T15:30:58.657593+0000","last_became_peered":"2023-10-09T15:30:58.657593+0000","last_unstale":"2023-10-09T15:30:59.653922+0000","last_undegraded":"2023-10-09T15:30:59.653922+0000","last_fullsized":"2023-10-09T15:30:59.653922+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676703+0000","last_change":"2023-10-09T15:30:59.659550+0000","last_active":"2023-10-09T15:30:59.676703+0000","last_peered":"2023-10-09T15:30:59.676703+0000","last_clean":"2023-10-09T15:30:59.676703+0000","last_became_active":"2023-10-09T15:30:59.658537+0000","last_became_peered":"2023-10-09T15:30:59.658537+0000","last_unstale":"2023-10-09T15:30:59.676703+0000","last_undegraded":"2023-10-09T15:30:59.676703+0000","last_fullsized":"2023-10-09T15:30:59.676703+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:26.121697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672420+0000","last_change":"2023-10-09T15:30:59.663481+0000","last_active":"2023-10-09T15:30:59.672420+0000","last_peered":"2023-10-09T15:30:59.672420+0000","last_clean":"2023-10-09T15:30:59.672420+0000","last_became_active":"2023-10-09T15:30:59.662876+0000","last_became_peered":"2023-10-09T15:30:59.662876+0000","last_unstale":"2023-10-09T15:30:59.672420+0000","last_undegraded":"2023-10-09T15:30:59.672420+0000","last_fullsized":"2023-10-09T15:30:59.672420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:19.257209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659902+0000","last_change":"2023-10-09T15:30:58.654763+0000","last_active":"2023-10-09T15:30:59.659902+0000","last_peered":"2023-10-09T15:30:59.659902+0000","last_clean":"2023-10-09T15:30:59.659902+0000","last_became_active":"2023-10-09T15:30:58.654402+0000","last_became_peered":"2023-10-09T15:30:58.654402+0000","last_unstale":"2023-10-09T15:30:59.659902+0000","last_undegraded":"2023-10-09T15:30:59.659902+0000","last_fullsized":"2023-10-09T15:30:59.659902+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:53.869474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680417+0000","last_change":"2023-10-09T15:30:59.673338+0000","last_active":"2023-10-09T15:30:59.680417+0000","last_peered":"2023-10-09T15:30:59.680417+0000","last_clean":"2023-10-09T15:30:59.680417+0000","last_became_active":"2023-10-09T15:30:59.673073+0000","last_became_peered":"2023-10-09T15:30:59.673073+0000","last_unstale":"2023-10-09T15:30:59.680417+0000","last_undegraded":"2023-10-09T15:30:59.680417+0000","last_fullsized":"2023-10-09T15:30:59.680417+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:36:54.301250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.653750+0000","last_change":"2023-10-09T15:30:58.656757+0000","last_active":"2023-10-09T15:30:59.653750+0000","last_peered":"2023-10-09T15:30:59.653750+0000","last_clean":"2023-10-09T15:30:59.653750+0000","last_became_active":"2023-10-09T15:30:58.656177+0000","last_became_peered":"2023-10-09T15:30:58.656177+0000","last_unstale":"2023-10-09T15:30:59.653750+0000","last_undegraded":"2023-10-09T15:30:59.653750+0000","last_fullsized":"2023-10-09T15:30:59.653750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":163,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654959+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:30:59.654959+0000","last_peered":"2023-10-09T15:30:59.654959+0000","last_clean":"2023-10-09T15:30:59.654959+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:30:59.654959+0000","last_undegraded":"2023-10-09T15:30:59.654959+0000","last_fullsized":"2023-10-09T15:30:59.654959+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665718+0000","last_change":"2023-10-09T15:30:59.660707+0000","last_active":"2023-10-09T15:30:59.665718+0000","last_peered":"2023-10-09T15:30:59.665718+0000","last_clean":"2023-10-09T15:30:59.665718+0000","last_became_active":"2023-10-09T15:30:59.660311+0000","last_became_peered":"2023-10-09T15:30:59.660311+0000","last_unstale":"2023-10-09T15:30:59.665718+0000","last_undegraded":"2023-10-09T15:30:59.665718+0000","last_fullsized":"2023-10-09T15:30:59.665718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654997+0000","last_change":"2023-10-09T15:30:58.658938+0000","last_active":"2023-10-09T15:30:59.654997+0000","last_peered":"2023-10-09T15:30:59.654997+0000","last_clean":"2023-10-09T15:30:59.654997+0000","last_became_active":"2023-10-09T15:30:58.658670+0000","last_became_peered":"2023-10-09T15:30:58.658670+0000","last_unstale":"2023-10-09T15:30:59.654997+0000","last_undegraded":"2023-10-09T15:30:59.654997+0000","last_fullsized":"2023-10-09T15:30:59.654997+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.657329+0000","last_change":"2023-10-09T15:30:58.659276+0000","last_active":"2023-10-09T15:30:59.657329+0000","last_peered":"2023-10-09T15:30:59.657329+0000","last_clean":"2023-10-09T15:30:59.657329+0000","last_became_active":"2023-10-09T15:30:58.659014+0000","last_became_peered":"2023-10-09T15:30:58.659014+0000","last_unstale":"2023-10-09T15:30:59.657329+0000","last_undegraded":"2023-10-09T15:30:59.657329+0000","last_fullsized":"2023-10-09T15:30:59.657329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.669321+0000","last_change":"2023-10-09T15:30:59.662896+0000","last_active":"2023-10-09T15:30:59.669321+0000","last_peered":"2023-10-09T15:30:59.669321+0000","last_clean":"2023-10-09T15:30:59.669321+0000","last_became_active":"2023-10-09T15:30:59.662565+0000","last_became_peered":"2023-10-09T15:30:59.662565+0000","last_unstale":"2023-10-09T15:30:59.669321+0000","last_undegraded":"2023-10-09T15:30:59.669321+0000","last_fullsized":"2023-10-09T15:30:59.669321+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":11,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-10-09T15:31:00.658977+0000","last_change":"2023-10-09T15:30:58.654960+0000","last_active":"2023-10-09T15:31:00.658977+0000","last_peered":"2023-10-09T15:31:00.658977+0000","last_clean":"2023-10-09T15:31:00.658977+0000","last_became_active":"2023-10-09T15:30:58.654642+0000","last_became_peered":"2023-10-09T15:30:58.654642+0000","last_unstale":"2023-10-09T15:31:00.658977+0000","last_undegraded":"2023-10-09T15:31:00.658977+0000","last_fullsized":"2023-10-09T15:31:00.658977+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679337+0000","last_change":"2023-10-09T15:30:59.673541+0000","last_active":"2023-10-09T15:30:59.679337+0000","last_peered":"2023-10-09T15:30:59.679337+0000","last_clean":"2023-10-09T15:30:59.679337+0000","last_became_active":"2023-10-09T15:30:59.673264+0000","last_became_peered":"2023-10-09T15:30:59.673264+0000","last_unstale":"2023-10-09T15:30:59.679337+0000","last_undegraded":"2023-10-09T15:30:59.679337+0000","last_fullsized":"2023-10-09T15:30:59.679337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680182+0000","last_change":"2023-10-09T15:30:58.653278+0000","last_active":"2023-10-09T15:30:59.680182+0000","last_peered":"2023-10-09T15:30:59.680182+0000","last_clean":"2023-10-09T15:30:59.680182+0000","last_became_active":"2023-10-09T15:30:58.652915+0000","last_became_peered":"2023-10-09T15:30:58.652915+0000","last_unstale":"2023-10-09T15:30:59.680182+0000","last_undegraded":"2023-10-09T15:30:59.680182+0000","last_fullsized":"2023-10-09T15:30:59.680182+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665653+0000","last_change":"2023-10-09T15:30:59.661222+0000","last_active":"2023-10-09T15:30:59.665653+0000","last_peered":"2023-10-09T15:30:59.665653+0000","last_clean":"2023-10-09T15:30:59.665653+0000","last_became_active":"2023-10-09T15:30:59.660941+0000","last_became_peered":"2023-10-09T15:30:59.660941+0000","last_unstale":"2023-10-09T15:30:59.665653+0000","last_undegraded":"2023-10-09T15:30:59.665653+0000","last_fullsized":"2023-10-09T15:30:59.665653+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:13.920004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.654786+0000","last_change":"2023-10-09T15:30:58.660025+0000","last_active":"2023-10-09T15:30:59.654786+0000","last_peered":"2023-10-09T15:30:59.654786+0000","last_clean":"2023-10-09T15:30:59.654786+0000","last_became_active":"2023-10-09T15:30:58.659194+0000","last_became_peered":"2023-10-09T15:30:58.659194+0000","last_unstale":"2023-10-09T15:30:59.654786+0000","last_undegraded":"2023-10-09T15:30:59.654786+0000","last_fullsized":"2023-10-09T15:30:59.654786+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:26:25.116899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.678479+0000","last_change":"2023-10-09T15:30:59.664311+0000","last_active":"2023-10-09T15:30:59.678479+0000","last_peered":"2023-10-09T15:30:59.678479+0000","last_clean":"2023-10-09T15:30:59.678479+0000","last_became_active":"2023-10-09T15:30:59.664084+0000","last_became_peered":"2023-10-09T15:30:59.664084+0000","last_unstale":"2023-10-09T15:30:59.678479+0000","last_undegraded":"2023-10-09T15:30:59.678479+0000","last_fullsized":"2023-10-09T15:30:59.678479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:34.544627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.655505+0000","last_change":"2023-10-09T15:30:58.658966+0000","last_active":"2023-10-09T15:30:59.655505+0000","last_peered":"2023-10-09T15:30:59.655505+0000","last_clean":"2023-10-09T15:30:59.655505+0000","last_became_active":"2023-10-09T15:30:58.658723+0000","last_became_peered":"2023-10-09T15:30:58.658723+0000","last_unstale":"2023-10-09T15:30:59.655505+0000","last_undegraded":"2023-10-09T15:30:59.655505+0000","last_fullsized":"2023-10-09T15:30:59.655505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:06.612748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.670057+0000","last_change":"2023-10-09T15:30:59.662640+0000","last_active":"2023-10-09T15:30:59.670057+0000","last_peered":"2023-10-09T15:30:59.670057+0000","last_clean":"2023-10-09T15:30:59.670057+0000","last_became_active":"2023-10-09T15:30:59.662342+0000","last_became_peered":"2023-10-09T15:30:59.662342+0000","last_unstale":"2023-10-09T15:30:59.670057+0000","last_undegraded":"2023-10-09T15:30:59.670057+0000","last_fullsized":"2023-10-09T15:30:59.670057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:38.107162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.656826+0000","last_change":"2023-10-09T15:30:58.658056+0000","last_active":"2023-10-09T15:30:59.656826+0000","last_peered":"2023-10-09T15:30:59.656826+0000","last_clean":"2023-10-09T15:30:59.656826+0000","last_became_active":"2023-10-09T15:30:58.657777+0000","last_became_peered":"2023-10-09T15:30:58.657777+0000","last_unstale":"2023-10-09T15:30:59.656826+0000","last_undegraded":"2023-10-09T15:30:59.656826+0000","last_fullsized":"2023-10-09T15:30:59.656826+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:14:06.820239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.674709+0000","last_change":"2023-10-09T15:30:59.664936+0000","last_active":"2023-10-09T15:30:59.674709+0000","last_peered":"2023-10-09T15:30:59.674709+0000","last_clean":"2023-10-09T15:30:59.674709+0000","last_became_active":"2023-10-09T15:30:59.664631+0000","last_became_peered":"2023-10-09T15:30:59.664631+0000","last_unstale":"2023-10-09T15:30:59.674709+0000","last_undegraded":"2023-10-09T15:30:59.674709+0000","last_fullsized":"2023-10-09T15:30:59.674709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683165+0000","last_change":"2023-10-09T15:30:58.659699+0000","last_active":"2023-10-09T15:30:59.683165+0000","last_peered":"2023-10-09T15:30:59.683165+0000","last_clean":"2023-10-09T15:30:59.683165+0000","last_became_active":"2023-10-09T15:30:58.659378+0000","last_became_peered":"2023-10-09T15:30:58.659378+0000","last_unstale":"2023-10-09T15:30:59.683165+0000","last_undegraded":"2023-10-09T15:30:59.683165+0000","last_fullsized":"2023-10-09T15:30:59.683165+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:31:49.281866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677259+0000","last_change":"2023-10-09T15:30:59.662826+0000","last_active":"2023-10-09T15:30:59.677259+0000","last_peered":"2023-10-09T15:30:59.677259+0000","last_clean":"2023-10-09T15:30:59.677259+0000","last_became_active":"2023-10-09T15:30:59.662503+0000","last_became_peered":"2023-10-09T15:30:59.662503+0000","last_unstale":"2023-10-09T15:30:59.677259+0000","last_undegraded":"2023-10-09T15:30:59.677259+0000","last_fullsized":"2023-10-09T15:30:59.677259+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:45.400730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659777+0000","last_change":"2023-10-09T15:30:58.657426+0000","last_active":"2023-10-09T15:30:59.659777+0000","last_peered":"2023-10-09T15:30:59.659777+0000","last_clean":"2023-10-09T15:30:59.659777+0000","last_became_active":"2023-10-09T15:30:58.657154+0000","last_became_peered":"2023-10-09T15:30:58.657154+0000","last_unstale":"2023-10-09T15:30:59.659777+0000","last_undegraded":"2023-10-09T15:30:59.659777+0000","last_fullsized":"2023-10-09T15:30:59.659777+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:03:30.294626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.681135+0000","last_change":"2023-10-09T15:30:59.673642+0000","last_active":"2023-10-09T15:30:59.681135+0000","last_peered":"2023-10-09T15:30:59.681135+0000","last_clean":"2023-10-09T15:30:59.681135+0000","last_became_active":"2023-10-09T15:30:59.671999+0000","last_became_peered":"2023-10-09T15:30:59.671999+0000","last_unstale":"2023-10-09T15:30:59.681135+0000","last_undegraded":"2023-10-09T15:30:59.681135+0000","last_fullsized":"2023-10-09T15:30:59.681135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683681+0000","last_change":"2023-10-09T15:30:58.658112+0000","last_active":"2023-10-09T15:30:59.683681+0000","last_peered":"2023-10-09T15:30:59.683681+0000","last_clean":"2023-10-09T15:30:59.683681+0000","last_became_active":"2023-10-09T15:30:58.657790+0000","last_became_peered":"2023-10-09T15:30:58.657790+0000","last_unstale":"2023-10-09T15:30:59.683681+0000","last_undegraded":"2023-10-09T15:30:59.683681+0000","last_fullsized":"2023-10-09T15:30:59.683681+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.672943+0000","last_change":"2023-10-09T15:30:59.667024+0000","last_active":"2023-10-09T15:30:59.672943+0000","last_peered":"2023-10-09T15:30:59.672943+0000","last_clean":"2023-10-09T15:30:59.672943+0000","last_became_active":"2023-10-09T15:30:59.666511+0000","last_became_peered":"2023-10-09T15:30:59.666511+0000","last_unstale":"2023-10-09T15:30:59.672943+0000","last_undegraded":"2023-10-09T15:30:59.672943+0000","last_fullsized":"2023-10-09T15:30:59.672943+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.679463+0000","last_change":"2023-10-09T15:30:58.652304+0000","last_active":"2023-10-09T15:30:59.679463+0000","last_peered":"2023-10-09T15:30:59.679463+0000","last_clean":"2023-10-09T15:30:59.679463+0000","last_became_active":"2023-10-09T15:30:58.651797+0000","last_became_peered":"2023-10-09T15:30:58.651797+0000","last_unstale":"2023-10-09T15:30:59.679463+0000","last_undegraded":"2023-10-09T15:30:59.679463+0000","last_fullsized":"2023-10-09T15:30:59.679463+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:57.628594+0000","last_clean_scrub_stamp":"2023-10-09T15:30:57.628594+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:33.539829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.688154+0000","last_change":"2023-10-09T15:30:59.681772+0000","last_active":"2023-10-09T15:30:59.688154+0000","last_peered":"2023-10-09T15:30:59.688154+0000","last_clean":"2023-10-09T15:30:59.688154+0000","last_became_active":"2023-10-09T15:30:59.681493+0000","last_became_peered":"2023-10-09T15:30:59.681493+0000","last_unstale":"2023-10-09T15:30:59.688154+0000","last_undegraded":"2023-10-09T15:30:59.688154+0000","last_fullsized":"2023-10-09T15:30:59.688154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:24.849853+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.659649+0000","last_change":"2023-10-09T15:30:59.655754+0000","last_active":"2023-10-09T15:30:59.659649+0000","last_peered":"2023-10-09T15:30:59.659649+0000","last_clean":"2023-10-09T15:30:59.659649+0000","last_became_active":"2023-10-09T15:30:59.655349+0000","last_became_peered":"2023-10-09T15:30:59.655349+0000","last_unstale":"2023-10-09T15:30:59.659649+0000","last_undegraded":"2023-10-09T15:30:59.659649+0000","last_fullsized":"2023-10-09T15:30:59.659649+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.676461+0000","last_change":"2023-10-09T15:30:59.671922+0000","last_active":"2023-10-09T15:30:59.676461+0000","last_peered":"2023-10-09T15:30:59.676461+0000","last_clean":"2023-10-09T15:30:59.676461+0000","last_became_active":"2023-10-09T15:30:59.671653+0000","last_became_peered":"2023-10-09T15:30:59.671653+0000","last_unstale":"2023-10-09T15:30:59.676461+0000","last_undegraded":"2023-10-09T15:30:59.676461+0000","last_fullsized":"2023-10-09T15:30:59.676461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:32.453971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675676+0000","last_change":"2023-10-09T15:30:59.667346+0000","last_active":"2023-10-09T15:30:59.675676+0000","last_peered":"2023-10-09T15:30:59.675676+0000","last_clean":"2023-10-09T15:30:59.675676+0000","last_became_active":"2023-10-09T15:30:59.666133+0000","last_became_peered":"2023-10-09T15:30:59.666133+0000","last_unstale":"2023-10-09T15:30:59.675676+0000","last_undegraded":"2023-10-09T15:30:59.675676+0000","last_fullsized":"2023-10-09T15:30:59.675676+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:42:38.505679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.665591+0000","last_change":"2023-10-09T15:30:59.659235+0000","last_active":"2023-10-09T15:30:59.665591+0000","last_peered":"2023-10-09T15:30:59.665591+0000","last_clean":"2023-10-09T15:30:59.665591+0000","last_became_active":"2023-10-09T15:30:59.658828+0000","last_became_peered":"2023-10-09T15:30:59.658828+0000","last_unstale":"2023-10-09T15:30:59.665591+0000","last_undegraded":"2023-10-09T15:30:59.665591+0000","last_fullsized":"2023-10-09T15:30:59.665591+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683058+0000","last_change":"2023-10-09T15:30:59.675159+0000","last_active":"2023-10-09T15:30:59.683058+0000","last_peered":"2023-10-09T15:30:59.683058+0000","last_clean":"2023-10-09T15:30:59.683058+0000","last_became_active":"2023-10-09T15:30:59.674897+0000","last_became_peered":"2023-10-09T15:30:59.674897+0000","last_unstale":"2023-10-09T15:30:59.683058+0000","last_undegraded":"2023-10-09T15:30:59.683058+0000","last_fullsized":"2023-10-09T15:30:59.683058+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:22:43.253344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.668705+0000","last_change":"2023-10-09T15:30:59.662912+0000","last_active":"2023-10-09T15:30:59.668705+0000","last_peered":"2023-10-09T15:30:59.668705+0000","last_clean":"2023-10-09T15:30:59.668705+0000","last_became_active":"2023-10-09T15:30:59.662380+0000","last_became_peered":"2023-10-09T15:30:59.662380+0000","last_unstale":"2023-10-09T15:30:59.668705+0000","last_undegraded":"2023-10-09T15:30:59.668705+0000","last_fullsized":"2023-10-09T15:30:59.668705+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677401+0000","last_change":"2023-10-09T15:30:59.673219+0000","last_active":"2023-10-09T15:30:59.677401+0000","last_peered":"2023-10-09T15:30:59.677401+0000","last_clean":"2023-10-09T15:30:59.677401+0000","last_became_active":"2023-10-09T15:30:59.672928+0000","last_became_peered":"2023-10-09T15:30:59.672928+0000","last_unstale":"2023-10-09T15:30:59.677401+0000","last_undegraded":"2023-10-09T15:30:59.677401+0000","last_fullsized":"2023-10-09T15:30:59.677401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683108+0000","last_change":"2023-10-09T15:30:59.678780+0000","last_active":"2023-10-09T15:30:59.683108+0000","last_peered":"2023-10-09T15:30:59.683108+0000","last_clean":"2023-10-09T15:30:59.683108+0000","last_became_active":"2023-10-09T15:30:59.678502+0000","last_became_peered":"2023-10-09T15:30:59.678502+0000","last_unstale":"2023-10-09T15:30:59.683108+0000","last_undegraded":"2023-10-09T15:30:59.683108+0000","last_fullsized":"2023-10-09T15:30:59.683108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:25.202239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.675559+0000","last_change":"2023-10-09T15:30:59.668814+0000","last_active":"2023-10-09T15:30:59.675559+0000","last_peered":"2023-10-09T15:30:59.675559+0000","last_clean":"2023-10-09T15:30:59.675559+0000","last_became_active":"2023-10-09T15:30:59.668501+0000","last_became_peered":"2023-10-09T15:30:59.668501+0000","last_unstale":"2023-10-09T15:30:59.675559+0000","last_undegraded":"2023-10-09T15:30:59.675559+0000","last_fullsized":"2023-10-09T15:30:59.675559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.683026+0000","last_change":"2023-10-09T15:30:59.674502+0000","last_active":"2023-10-09T15:30:59.683026+0000","last_peered":"2023-10-09T15:30:59.683026+0000","last_clean":"2023-10-09T15:30:59.683026+0000","last_became_active":"2023-10-09T15:30:59.674165+0000","last_became_peered":"2023-10-09T15:30:59.674165+0000","last_unstale":"2023-10-09T15:30:59.683026+0000","last_undegraded":"2023-10-09T15:30:59.683026+0000","last_fullsized":"2023-10-09T15:30:59.683026+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:47.741987+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.680953+0000","last_change":"2023-10-09T15:30:59.675013+0000","last_active":"2023-10-09T15:30:59.680953+0000","last_peered":"2023-10-09T15:30:59.680953+0000","last_clean":"2023-10-09T15:30:59.680953+0000","last_became_active":"2023-10-09T15:30:59.674731+0000","last_became_peered":"2023-10-09T15:30:59.674731+0000","last_unstale":"2023-10-09T15:30:59.680953+0000","last_undegraded":"2023-10-09T15:30:59.680953+0000","last_fullsized":"2023-10-09T15:30:59.680953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:07:57.076493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.677154+0000","last_change":"2023-10-09T15:30:59.674112+0000","last_active":"2023-10-09T15:30:59.677154+0000","last_peered":"2023-10-09T15:30:59.677154+0000","last_clean":"2023-10-09T15:30:59.677154+0000","last_became_active":"2023-10-09T15:30:59.673855+0000","last_became_peered":"2023-10-09T15:30:59.673855+0000","last_unstale":"2023-10-09T15:30:59.677154+0000","last_undegraded":"2023-10-09T15:30:59.677154+0000","last_fullsized":"2023-10-09T15:30:59.677154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:41:44.828116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":9,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-10-09T15:30:59.661031+0000","last_change":"2023-10-09T15:30:59.656928+0000","last_active":"2023-10-09T15:30:59.661031+0000","last_peered":"2023-10-09T15:30:59.661031+0000","last_clean":"2023-10-09T15:30:59.661031+0000","last_became_active":"2023-10-09T15:30:59.656505+0000","last_became_peered":"2023-10-09T15:30:59.656505+0000","last_unstale":"2023-10-09T15:30:59.661031+0000","last_undegraded":"2023-10-09T15:30:59.661031+0000","last_fullsized":"2023-10-09T15:30:59.661031+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:58.633392+0000","last_clean_scrub_stamp":"2023-10-09T15:30:58.633392+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:30:40.405852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298072,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073768,"statfs":{"total":96636764160,"available":96331538432,"internally_reserved":0,"allocated":802816,"data_stored":661576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67500000000000004}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.753}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56499999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574856,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297496,"kb_used_data":208,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074344,"statfs":{"total":96636764160,"available":96332128256,"internally_reserved":0,"allocated":212992,"data_stored":70814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47199999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55400000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.627}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72899999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84499999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80700000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78200000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298076,"kb_used_data":788,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073764,"statfs":{"total":96636764160,"available":96331534336,"internally_reserved":0,"allocated":806912,"data_stored":660621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.318}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48199999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52700000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59599999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574855,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297488,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074352,"statfs":{"total":96636764160,"available":96332136448,"internally_reserved":0,"allocated":204800,"data_stored":70654,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574853,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":72190,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32100000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.626}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.748}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297500,"kb_used_data":212,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074340,"statfs":{"total":96636764160,"available":96332124160,"internally_reserved":0,"allocated":217088,"data_stored":70780,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.879}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.379}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52600000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574855,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297492,"kb_used_data":204,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074348,"statfs":{"total":96636764160,"available":96332132352,"internally_reserved":0,"allocated":208896,"data_stored":70744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57799999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.71299999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76000000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:13.337 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T15:31:13.337 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-10-09T15:31:13.338 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-10-09T15:31:13.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-10-09T15:31:13.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.490+0000 7f817ff4a700 1 Processor -- start 2023-10-09T15:31:13.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.490+0000 7f817ff4a700 1 -- start start 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817ff4a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81780cb5a0 0x7f81780cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817ff4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f817815a5d0 0x7f8178156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817ff4a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817815ae40 con 0x7f81780cd9e0 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817ff4a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81780d13f0 con 0x7f81780cb5a0 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817ff4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817815ab60 con 0x7f817815a5d0 2023-10-09T15:31:13.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817dce6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f81780cb5a0 0x7f81780cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817d4e5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f81780cd9e0 0x7f8178159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38882/0 (socket says 172.21.15.33:38882) 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817d4e5700 1 -- 172.21.15.33:0/4228920936 learned_addr learned my addr 172.21.15.33:0/4228920936 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817e4e7700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f817815a5d0 0x7f8178156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817dce6700 1 -- 172.21.15.33:0/4228920936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f817815a5d0 msgr2=0x7f8178156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817dce6700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f817815a5d0 0x7f8178156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817dce6700 1 -- 172.21.15.33:0/4228920936 >> v1:172.21.15.33:6789/0 conn(0x7f81780cd9e0 legacy=0x7f8178159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.491+0000 7f817dce6700 1 -- 172.21.15.33:0/4228920936 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81780ccf00 con 0x7f81780cb5a0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817dce6700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81780cb5a0 0x7f81780cb970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8170009e90 tx=0x7f8170009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77dce809b099f416 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817cce4700 1 -- 172.21.15.33:0/4228920936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f817000e070 con 0x7f81780cb5a0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817cce4700 1 -- 172.21.15.33:0/4228920936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f817000bbf0 con 0x7f81780cb5a0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817cce4700 1 -- 172.21.15.33:0/4228920936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8170012430 con 0x7f81780cb5a0 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 -- 172.21.15.33:0/4228920936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81780cb5a0 msgr2=0x7f81780cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81780cb5a0 0x7f81780cb970 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f8170009e90 tx=0x7f8170009780 comp rx=0 tx=0).stop 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 -- 172.21.15.33:0/4228920936 shutdown_connections 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f817815a5d0 0x7f8178156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 --2- 172.21.15.33:0/4228920936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81780cb5a0 0x7f81780cb970 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 -- 172.21.15.33:0/4228920936 >> 172.21.15.33:0/4228920936 conn(0x7f8178070e30 msgr2=0x7f81780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 -- 172.21.15.33:0/4228920936 shutdown_connections 2023-10-09T15:31:13.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.492+0000 7f817ff4a700 1 -- 172.21.15.33:0/4228920936 wait complete. 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.493+0000 7f817ff4a700 1 Processor -- start 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 -- start start 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81780cb5a0 0x7f8178156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81780cd9e0 0x7f817815be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817815d5b0 con 0x7f817815a5d0 2023-10-09T15:31:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81780ca1f0 con 0x7f81780cd9e0 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817ff4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f817815c9a0 con 0x7f81780cb5a0 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817e4e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817e4e7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53114/0 (socket says 172.21.15.33:53114) 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.494+0000 7f817e4e7700 1 -- 172.21.15.33:0/775628588 learned_addr learned my addr 172.21.15.33:0/775628588 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817d4e5700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81780cd9e0 0x7f817815be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 -- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81780cb5a0 msgr2=0x7f8178156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817dce6700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81780cb5a0 0x7f8178156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81780cb5a0 0x7f8178156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 -- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81780cd9e0 msgr2=0x7f817815be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81780cd9e0 0x7f817815be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 -- 172.21.15.33:0/775628588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8170009a20 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817e4e7700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f816800e8d0 tx=0x7f81680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800ee70 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800c850 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f817815cc80 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800cc50 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.495+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817815d240 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.496+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f817815d760 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.496+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8168013680 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.497+0000 7f8175ffb700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 0x7f81640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.497+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8168084730 con 0x7f817815a5d0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.497+0000 7f817dce6700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 0x7f81640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.497+0000 7f817dce6700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 0x7f81640693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f81700097c0 tx=0x7f8170019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.501+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f817815d760 con 0x7f817815a5d0 2023-10-09T15:31:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.738+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f81781567d0 con 0x7f817815a5d0 2023-10-09T15:31:13.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.738+0000 7f8175ffb700 1 -- 172.21.15.33:0/775628588 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7f8168055430 con 0x7f817815a5d0 2023-10-09T15:31:13.740 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:13.740 INFO:teuthology.orchestra.run.smithi033.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-10-09T15:31:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 msgr2=0x7f81640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 0x7f81640693e0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f81700097c0 tx=0x7f8170019000 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 msgr2=0x7f817815c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f816800e8d0 tx=0x7f81680091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 shutdown_connections 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8164066f30 0x7f81640693e0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f817815a5d0 0x7f817815c370 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81780cb5a0 0x7f8178156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 --2- 172.21.15.33:0/775628588 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81780cd9e0 0x7f817815be30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 >> 172.21.15.33:0/775628588 conn(0x7f8178070e30 msgr2=0x7f81780b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 shutdown_connections 2023-10-09T15:31:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.740+0000 7f817ff4a700 1 -- 172.21.15.33:0/775628588 wait complete. 2023-10-09T15:31:13.753 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-10-09T15:31:13.753 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:13.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.872+0000 7f53f59e0700 1 Processor -- start 2023-10-09T15:31:13.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.872+0000 7f53f59e0700 1 -- start start 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.872+0000 7f53f59e0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53f00cb970 0x7f53f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.872+0000 7f53f59e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f015a400 0x7f53f0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.872+0000 7f53f59e0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53f015ae40 con 0x7f53f00cb5a0 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53f59e0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53f00ce0f0 con 0x7f53f00cb970 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53f59e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00d13f0 con 0x7f53f015a400 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f53f00cb970 0x7f53f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53eeffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f53f00cb5a0 0x7f53f00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38884/0 (socket says 172.21.15.33:38884) 2023-10-09T15:31:13.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53eeffd700 1 -- 172.21.15.33:0/1101612687 learned_addr learned my addr 172.21.15.33:0/1101612687 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ef7fe700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f015a400 0x7f53f0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 -- 172.21.15.33:0/1101612687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f015a400 msgr2=0x7f53f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f015a400 0x7f53f0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 -- 172.21.15.33:0/1101612687 >> v1:172.21.15.33:6789/0 conn(0x7f53f00cb5a0 legacy=0x7f53f00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 -- 172.21.15.33:0/1101612687 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53f015ab60 con 0x7f53f00cb970 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53edffb700 1 -- 172.21.15.33:0/1101612687 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3020471891 0 0) 0x7f53f015ae40 con 0x7f53f00cb5a0 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53ee7fc700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f0159ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53e40098e0 tx=0x7f53e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cb555079708b6e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53edffb700 1 -- 172.21.15.33:0/1101612687 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400b640 con 0x7f53f00cb970 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53edffb700 1 -- 172.21.15.33:0/1101612687 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400b7a0 con 0x7f53f00cb970 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.873+0000 7f53edffb700 1 -- 172.21.15.33:0/1101612687 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400bb40 con 0x7f53f00cb970 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 -- 172.21.15.33:0/1101612687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 msgr2=0x7f53f0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f0159ec0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f53e40098e0 tx=0x7f53e40091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 -- 172.21.15.33:0/1101612687 shutdown_connections 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f015a400 0x7f53f0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 --2- 172.21.15.33:0/1101612687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f0159ec0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 -- 172.21.15.33:0/1101612687 >> 172.21.15.33:0/1101612687 conn(0x7f53f0070e30 msgr2=0x7f53f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 -- 172.21.15.33:0/1101612687 shutdown_connections 2023-10-09T15:31:13.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.874+0000 7f53f59e0700 1 -- 172.21.15.33:0/1101612687 wait complete. 2023-10-09T15:31:13.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.875+0000 7f53f59e0700 1 Processor -- start 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.875+0000 7f53f59e0700 1 -- start start 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f00cb5a0 0x7f53f0150960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f015a400 0x7f53f00cef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f00b34b0 con 0x7f53f00cb970 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53f016d530 con 0x7f53f015a400 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53f59e0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53f016d810 con 0x7f53f00cb5a0 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53134/0 (socket says 172.21.15.33:53134) 2023-10-09T15:31:13.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 -- 172.21.15.33:0/3782017979 learned_addr learned my addr 172.21.15.33:0/3782017979 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ef7fe700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f015a400 0x7f53f00cef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53eeffd700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f00cb5a0 0x7f53f0150960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 -- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f00cb5a0 msgr2=0x7f53f0150960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f00cb5a0 0x7f53f0150960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 -- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f015a400 msgr2=0x7f53f00cef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f015a400 0x7f53f00cef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 -- 172.21.15.33:0/3782017979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e4009420 con 0x7f53f00cb970 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.876+0000 7f53ee7fc700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009f80 tx=0x7f53e4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.877+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e400b910 con 0x7f53f00cb970 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.877+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53e400ba70 con 0x7f53f00cb970 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.877+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53f016daf0 con 0x7f53f00cb970 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.877+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53e4024670 con 0x7f53f00cb970 2023-10-09T15:31:13.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.877+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53f0150ea0 con 0x7f53f00cb970 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.878+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53f004c3c0 con 0x7f53f00cb970 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.878+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f53e4024aa0 con 0x7f53f00cb970 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.878+0000 7f53d6ffd700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 0x7f53dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.879+0000 7f53eeffd700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 0x7f53dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.879+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f53e4085fa0 con 0x7f53f00cb970 2023-10-09T15:31:13.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.879+0000 7f53eeffd700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 0x7f53dc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53e0007fd0 tx=0x7f53e0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:13.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:13.883+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f53e4053210 con 0x7f53f00cb970 2023-10-09T15:31:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.079+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f53f00afa70 con 0x7f53f00cb970 2023-10-09T15:31:14.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.080+0000 7f53d6ffd700 1 -- 172.21.15.33:0/3782017979 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f53e405ae60 con 0x7f53f00cb970 2023-10-09T15:31:14.081 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:14.081 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 msgr2=0x7f53dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 0x7f53dc0693e0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f53e0007fd0 tx=0x7f53e0007d30 comp rx=0 tx=0).stop 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 msgr2=0x7f53f00ce9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f53e4009f80 tx=0x7f53e4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 shutdown_connections 2023-10-09T15:31:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f53dc066f30 0x7f53dc0693e0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f53f015a400 0x7f53f00cef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f53f00cb5a0 0x7f53f0150960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 --2- 172.21.15.33:0/3782017979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f53f00cb970 0x7f53f00ce9d0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 >> 172.21.15.33:0/3782017979 conn(0x7f53f0070e30 msgr2=0x7f53f00b1a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 shutdown_connections 2023-10-09T15:31:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.082+0000 7f53f59e0700 1 -- 172.21.15.33:0/3782017979 wait complete. 2023-10-09T15:31:14.095 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:14.095 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:14.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.215+0000 7f70d8d23700 1 Processor -- start 2023-10-09T15:31:14.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.216+0000 7f70d8d23700 1 -- start start 2023-10-09T15:31:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.216+0000 7f70d8d23700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70d406dc70 0x7f70d4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.216+0000 7f70d8d23700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d40ccfd0 con 0x7f70d4159530 2023-10-09T15:31:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.216+0000 7f70d8d23700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70d415a3d0 con 0x7f70d406e0e0 2023-10-09T15:31:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.216+0000 7f70d8d23700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70d415a6b0 con 0x7f70d406dc70 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f70d4159530 0x7f70d40ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38900/0 (socket says 172.21.15.33:38900) 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d1d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70d406dc70 0x7f70d4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d259c700 1 -- 172.21.15.33:0/1984626658 learned_addr learned my addr 172.21.15.33:0/1984626658 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1984626658 >> v1:172.21.15.59:6789/0 conn(0x7f70d406e0e0 legacy=0x7f70d40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1984626658 >> v1:172.21.15.33:6789/0 conn(0x7f70d4159530 legacy=0x7f70d40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1984626658 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d415a990 con 0x7f70d406dc70 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d1d9b700 1 --2- 172.21.15.33:0/1984626658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406dc70 0x7f70d4159900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70c80098e0 tx=0x7f70c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f8bcacba72f64fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d159a700 1 -- 172.21.15.33:0/1984626658 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c8009e80 con 0x7f70d406dc70 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d159a700 1 -- 172.21.15.33:0/1984626658 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c800b860 con 0x7f70d406dc70 2023-10-09T15:31:14.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.217+0000 7f70d159a700 1 -- 172.21.15.33:0/1984626658 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800bbe0 con 0x7f70d406dc70 2023-10-09T15:31:14.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 -- 172.21.15.33:0/1984626658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406dc70 msgr2=0x7f70d4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1984626658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406dc70 0x7f70d4159900 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f70c80098e0 tx=0x7f70c80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 -- 172.21.15.33:0/1984626658 shutdown_connections 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1984626658 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406dc70 0x7f70d4159900 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 -- 172.21.15.33:0/1984626658 >> 172.21.15.33:0/1984626658 conn(0x7f70d40703a0 msgr2=0x7f70d40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 -- 172.21.15.33:0/1984626658 shutdown_connections 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.218+0000 7f70d8d23700 1 -- 172.21.15.33:0/1984626658 wait complete. 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.219+0000 7f70d8d23700 1 Processor -- start 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.219+0000 7f70d8d23700 1 -- start start 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 0x7f70d41472b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d4159530 0x7f70d40b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d41477f0 con 0x7f70d406e0e0 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70d40c7f80 con 0x7f70d406dc70 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70d416aba0 con 0x7f70d4159530 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53150/0 (socket says 172.21.15.33:53150) 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1667451288 learned_addr learned my addr 172.21.15.33:0/1667451288 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d259c700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 0x7f70d41472b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d2d9d700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d4159530 0x7f70d40b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d4159530 msgr2=0x7f70d40b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d4159530 0x7f70d40b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 msgr2=0x7f70d41472b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 0x7f70d41472b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 -- 172.21.15.33:0/1667451288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c8009420 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d259c700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 0x7f70d41472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d1d9b700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f70d4089650 tx=0x7f70c8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c800bb20 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70c8025420 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70d40c7930 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70c80257c0 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.220+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70d416afd0 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.221+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70d40c7750 con 0x7f70d406e0e0 2023-10-09T15:31:14.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.222+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f70c8023070 con 0x7f70d406e0e0 2023-10-09T15:31:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.222+0000 7f70c27fc700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.222+0000 7f70d259c700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.222+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f70c8085ad0 con 0x7f70d406e0e0 2023-10-09T15:31:14.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.223+0000 7f70d259c700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 0x7f70b40693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f70d40b4d40 tx=0x7f70c4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.227+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70c8052d40 con 0x7f70d406e0e0 2023-10-09T15:31:14.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.422+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f70d404c3c0 con 0x7f70d406e0e0 2023-10-09T15:31:14.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.422+0000 7f70c27fc700 1 -- 172.21.15.33:0/1667451288 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f70c8056360 con 0x7f70d406e0e0 2023-10-09T15:31:14.423 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 msgr2=0x7f70b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 0x7f70b40693e0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f70d40b4d40 tx=0x7f70c4009040 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 msgr2=0x7f70d40b1b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f70d4089650 tx=0x7f70c8017000 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 shutdown_connections 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70b4066f30 0x7f70b40693e0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70d4159530 0x7f70d40b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70d406dc70 0x7f70d41472b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 --2- 172.21.15.33:0/1667451288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70d406e0e0 0x7f70d40b1b00 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 >> 172.21.15.33:0/1667451288 conn(0x7f70d40703a0 msgr2=0x7f70d4153f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 shutdown_connections 2023-10-09T15:31:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.424+0000 7f70d8d23700 1 -- 172.21.15.33:0/1667451288 wait complete. 2023-10-09T15:31:14.437 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.558+0000 7f8426c73700 1 Processor -- start 2023-10-09T15:31:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.558+0000 7f8426c73700 1 -- start start 2023-10-09T15:31:14.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426c73700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84200ceac0 0x7f84200af4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426c73700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84200ac840 con 0x7f8420157420 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426c73700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84200abf50 con 0x7f84200ceac0 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84200aea60 con 0x7f842006d250 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8425470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8426472700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84200ceac0 0x7f84200af4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8425470700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:36966/0 (socket says 172.21.15.33:36966) 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8425470700 1 -- 172.21.15.33:0/2653954144 learned_addr learned my addr 172.21.15.33:0/2653954144 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.559+0000 7f8424c6f700 1 -- 172.21.15.33:0/2653954144 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3143034604 0 0) 0x7f84200ac840 con 0x7f8420157420 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8425470700 1 -- 172.21.15.33:0/2653954144 >> v2:172.21.15.59:3300/0 conn(0x7f84200ceac0 msgr2=0x7f84200af4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:14.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8425470700 1 --2- 172.21.15.33:0/2653954144 >> v2:172.21.15.59:3300/0 conn(0x7f84200ceac0 0x7f84200af4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8425470700 1 -- 172.21.15.33:0/2653954144 >> v1:172.21.15.59:6789/0 conn(0x7f8420157420 legacy=0x7f84200b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8425470700 1 -- 172.21.15.33:0/2653954144 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84200ac1f0 con 0x7f842006d250 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8425470700 1 --2- 172.21.15.33:0/2653954144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84100099b0 tx=0x7f8410009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7297d8ae53c7abbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8424c6f700 1 -- 172.21.15.33:0/2653954144 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8410009ea0 con 0x7f842006d250 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8424c6f700 1 -- 172.21.15.33:0/2653954144 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f841000b860 con 0x7f842006d250 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8424c6f700 1 -- 172.21.15.33:0/2653954144 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f841000bc00 con 0x7f842006d250 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 -- 172.21.15.33:0/2653954144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 msgr2=0x7f84200aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 --2- 172.21.15.33:0/2653954144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f84100099b0 tx=0x7f8410009250 comp rx=0 tx=0).stop 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 -- 172.21.15.33:0/2653954144 shutdown_connections 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 --2- 172.21.15.33:0/2653954144 >> v2:172.21.15.59:3300/0 conn(0x7f84200ceac0 0x7f84200af4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 --2- 172.21.15.33:0/2653954144 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f842006d250 0x7f84200aefa0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.560+0000 7f8426c73700 1 -- 172.21.15.33:0/2653954144 >> 172.21.15.33:0/2653954144 conn(0x7f842006ce80 msgr2=0x7f84200ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.561+0000 7f8426c73700 1 -- 172.21.15.33:0/2653954144 shutdown_connections 2023-10-09T15:31:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.561+0000 7f8426c73700 1 -- 172.21.15.33:0/2653954144 wait complete. 2023-10-09T15:31:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 Processor -- start 2023-10-09T15:31:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 -- start start 2023-10-09T15:31:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f842006d250 0x7f8420099270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 0x7f8420143e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842009a9a0 con 0x7f8420157420 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842016e320 con 0x7f842006d250 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426c73700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8420144880 con 0x7f84200ceac0 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.562+0000 7f8426472700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53160/0 (socket says 172.21.15.33:53160) 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 -- 172.21.15.33:0/970499118 learned_addr learned my addr 172.21.15.33:0/970499118 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8425470700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 0x7f8420143e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8425c71700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f842006d250 0x7f8420099270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 -- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 msgr2=0x7f8420143e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 0x7f8420143e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 -- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f842006d250 msgr2=0x7f8420099270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f842006d250 0x7f8420099270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 -- 172.21.15.33:0/970499118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84100094f0 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8425470700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 0x7f8420143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426472700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f841800e930 tx=0x7f84180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418013680 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84180137e0 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842016de90 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8418013ba0 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.563+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8420144360 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.564+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842016e020 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.565+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f841800c460 con 0x7f8420157420 2023-10-09T15:31:14.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.565+0000 7f8415ffb700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 0x7f84040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.565+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8418084580 con 0x7f8420157420 2023-10-09T15:31:14.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.565+0000 7f8425c71700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 0x7f84040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.566+0000 7f8425c71700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 0x7f84040693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f841c001560 tx=0x7f841c0016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.569+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84180518b0 con 0x7f8420157420 2023-10-09T15:31:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.763+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f842004c3c0 con 0x7f8420157420 2023-10-09T15:31:14.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.763+0000 7f8415ffb700 1 -- 172.21.15.33:0/970499118 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8418054ed0 con 0x7f8420157420 2023-10-09T15:31:14.764 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 msgr2=0x7f84040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 0x7f84040693e0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f841c001560 tx=0x7f841c0016f0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 msgr2=0x7f8420155cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f841800e930 tx=0x7f84180091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 shutdown_connections 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8404066f30 0x7f84040693e0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8420157420 0x7f8420155cd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.765+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f842006d250 0x7f8420099270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.766+0000 7f8426c73700 1 --2- 172.21.15.33:0/970499118 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84200ceac0 0x7f8420143e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.766+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 >> 172.21.15.33:0/970499118 conn(0x7f842006ce80 msgr2=0x7f8420150f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.766+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 shutdown_connections 2023-10-09T15:31:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.766+0000 7f8426c73700 1 -- 172.21.15.33:0/970499118 wait complete. 2023-10-09T15:31:14.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.900+0000 7fc3f9bd7700 1 Processor -- start 2023-10-09T15:31:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.900+0000 7fc3f9bd7700 1 -- start start 2023-10-09T15:31:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f9bd7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3f4153dd0 0x7fc3f415de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f9bd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f40cea00 0x7fc3f40ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f9bd7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f415ac50 con 0x7fc3f4153a00 2023-10-09T15:31:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f9bd7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f415d010 con 0x7fc3f4153dd0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f9bd7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cf3e0 con 0x7fc3f40cea00 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3f4153dd0 0x7fc3f415de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3f4153dd0 0x7fc3f415de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53176/0 (socket says 172.21.15.33:53176) 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 -- 172.21.15.33:0/15431490 learned_addr learned my addr 172.21.15.33:0/15431490 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f93d6700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f40cea00 0x7fc3f40ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 -- 172.21.15.33:0/15431490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f40cea00 msgr2=0x7fc3f40ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f40cea00 0x7fc3f40ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 -- 172.21.15.33:0/15431490 >> v1:172.21.15.59:6789/0 conn(0x7fc3f4153a00 legacy=0x7fc3f415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.901+0000 7fc3f3fff700 1 -- 172.21.15.33:0/15431490 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f415af60 con 0x7fc3f4153dd0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f3fff700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153dd0 0x7fc3f415de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80099b0 tx=0x7fc3e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f0dbc8b01760fdf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f37fe700 1 -- 172.21.15.33:0/15431490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800b860 con 0x7fc3f4153dd0 2023-10-09T15:31:14.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f37fe700 1 -- 172.21.15.33:0/15431490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800b9c0 con 0x7fc3f4153dd0 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f37fe700 1 -- 172.21.15.33:0/15431490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800bd60 con 0x7fc3f4153dd0 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/15431490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153dd0 msgr2=0x7fc3f415de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153dd0 0x7fc3f415de50 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80099b0 tx=0x7fc3e8009250 comp rx=0 tx=0).stop 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/15431490 shutdown_connections 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f40cea00 0x7fc3f40ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/15431490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153dd0 0x7fc3f415de50 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/15431490 >> 172.21.15.33:0/15431490 conn(0x7fc3f40703a0 msgr2=0x7fc3f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/15431490 shutdown_connections 2023-10-09T15:31:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.902+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/15431490 wait complete. 2023-10-09T15:31:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.903+0000 7fc3f9bd7700 1 Processor -- start 2023-10-09T15:31:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 -- start start 2023-10-09T15:31:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3f40cea00 0x7fc3f41542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f4153dd0 0x7fc3f4150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cc2a0 con 0x7fc3f4153a00 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cb6d0 con 0x7fc3f40cea00 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.904+0000 7fc3f9bd7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f40cb970 con 0x7fc3f4153dd0 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53190/0 (socket says 172.21.15.33:53190) 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f8bd5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3f40cea00 0x7fc3f41542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 -- 172.21.15.33:0/944393529 learned_addr learned my addr 172.21.15.33:0/944393529 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f93d6700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f4153dd0 0x7fc3f4150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 -- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f4153dd0 msgr2=0x7fc3f4150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f4153dd0 0x7fc3f4150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 -- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3f40cea00 msgr2=0x7fc3f41542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3f40cea00 0x7fc3f41542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 -- 172.21.15.33:0/944393529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e80094f0 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f3fff700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80099b0 tx=0x7fc3e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e8011e40 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e8024440 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f40cbc50 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e80247e0 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.905+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f406de20 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.906+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3f406e010 con 0x7fc3f4153a00 2023-10-09T15:31:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.907+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc3e801a420 con 0x7fc3f4153a00 2023-10-09T15:31:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.907+0000 7fc3f0ff9700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 0x7fc3e00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.907+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc3e8086410 con 0x7fc3f4153a00 2023-10-09T15:31:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.907+0000 7fc3f8bd5700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 0x7fc3e00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.907+0000 7fc3f8bd5700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 0x7fc3e00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec007fd0 tx=0x7fc3ec000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:14.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:14.911+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3e8053680 con 0x7fc3f4153a00 2023-10-09T15:31:15.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.102+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc3f404c3c0 con 0x7fc3f4153a00 2023-10-09T15:31:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.103+0000 7fc3f0ff9700 1 -- 172.21.15.33:0/944393529 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc3e8056ca0 con 0x7fc3f4153a00 2023-10-09T15:31:15.104 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 msgr2=0x7fc3e00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 0x7fc3e00693e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec007fd0 tx=0x7fc3ec000f40 comp rx=0 tx=0).stop 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 msgr2=0x7fc3f406d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fc3e80099b0 tx=0x7fc3e8017000 comp rx=0 tx=0).stop 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 shutdown_connections 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3e0066f30 0x7fc3e00693e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3f4153dd0 0x7fc3f4150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3f40cea00 0x7fc3f41542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 --2- 172.21.15.33:0/944393529 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3f4153a00 0x7fc3f406d8e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 >> 172.21.15.33:0/944393529 conn(0x7fc3f40703a0 msgr2=0x7fc3f40d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 shutdown_connections 2023-10-09T15:31:15.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.105+0000 7fc3f9bd7700 1 -- 172.21.15.33:0/944393529 wait complete. 2023-10-09T15:31:15.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.235+0000 7ff12c38b700 1 Processor -- start 2023-10-09T15:31:15.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.235+0000 7ff12c38b700 1 -- start start 2023-10-09T15:31:15.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1240cb5a0 0x7ff1240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cd9e0 0x7ff124159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1240cde50 0x7ff12415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1240d13f0 con 0x7ff1240cde50 2023-10-09T15:31:15.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff12415a940 con 0x7ff1240cb5a0 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12c38b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12415ae40 con 0x7ff1240cd9e0 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12a928700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1240cde50 0x7ff12415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12a928700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1240cde50 0x7ff12415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53204/0 (socket says 172.21.15.33:53204) 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12a127700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff1240cb5a0 0x7ff1240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff12a928700 1 -- 172.21.15.33:0/1934382121 learned_addr learned my addr 172.21.15.33:0/1934382121 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:15.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.236+0000 7ff129926700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cd9e0 0x7ff124159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 -- 172.21.15.33:0/1934382121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cd9e0 msgr2=0x7ff124159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cd9e0 0x7ff124159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 -- 172.21.15.33:0/1934382121 >> v2:172.21.15.59:3300/0 conn(0x7ff1240cb5a0 msgr2=0x7ff1240cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 --2- 172.21.15.33:0/1934382121 >> v2:172.21.15.59:3300/0 conn(0x7ff1240cb5a0 0x7ff1240cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 -- 172.21.15.33:0/1934382121 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff12415ab60 con 0x7ff1240cde50 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff12a928700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1240cde50 0x7ff12415a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff124065120 tx=0x7ff114009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b0d2e7ef09cc7e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff129125700 1 -- 172.21.15.33:0/1934382121 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11400e070 con 0x7ff1240cde50 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff129125700 1 -- 172.21.15.33:0/1934382121 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff11400b930 con 0x7ff1240cde50 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.237+0000 7ff129125700 1 -- 172.21.15.33:0/1934382121 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1140092e0 con 0x7ff1240cde50 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 -- 172.21.15.33:0/1934382121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1240cde50 msgr2=0x7ff12415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1240cde50 0x7ff12415a400 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7ff124065120 tx=0x7ff114009840 comp rx=0 tx=0).stop 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 -- 172.21.15.33:0/1934382121 shutdown_connections 2023-10-09T15:31:15.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 --2- 172.21.15.33:0/1934382121 >> v2:172.21.15.59:3300/0 conn(0x7ff1240cb5a0 0x7ff1240cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1240cde50 0x7ff12415a400 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 --2- 172.21.15.33:0/1934382121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cd9e0 0x7ff124159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 -- 172.21.15.33:0/1934382121 >> 172.21.15.33:0/1934382121 conn(0x7ff124070e30 msgr2=0x7ff1240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 -- 172.21.15.33:0/1934382121 shutdown_connections 2023-10-09T15:31:15.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.238+0000 7ff12c38b700 1 -- 172.21.15.33:0/1934382121 wait complete. 2023-10-09T15:31:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.239+0000 7ff12c38b700 1 Processor -- start 2023-10-09T15:31:15.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.239+0000 7ff12c38b700 1 -- start start 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cb5a0 0x7ff124155c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1240cd9e0 0x7ff12415d220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124156c60 con 0x7ff124144250 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff124156530 con 0x7ff1240cd9e0 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff12415d920 con 0x7ff1240cb5a0 2023-10-09T15:31:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53212/0 (socket says 172.21.15.33:53212) 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 -- 172.21.15.33:0/2957063674 learned_addr learned my addr 172.21.15.33:0/2957063674 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a127700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cb5a0 0x7ff124155c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff129926700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1240cd9e0 0x7ff12415d220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 -- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cb5a0 msgr2=0x7ff124155c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cb5a0 0x7ff124155c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 -- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1240cd9e0 msgr2=0x7ff12415d220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1240cd9e0 0x7ff12415d220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 -- 172.21.15.33:0/2957063674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff114009ae0 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12a928700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ab0 tx=0x7ff114018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff114008ad0 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff114008c30 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff11401c410 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff12415dc00 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.240+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff12415e1c0 con 0x7ff124144250 2023-10-09T15:31:15.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.241+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff12404c3c0 con 0x7ff124144250 2023-10-09T15:31:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.242+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff114003040 con 0x7ff124144250 2023-10-09T15:31:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.242+0000 7ff1227fc700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.242+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff114085b50 con 0x7ff124144250 2023-10-09T15:31:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.242+0000 7ff12a127700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.243+0000 7ff12a127700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 0x7ff1100693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009db0 tx=0x7ff11c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.246+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff114052dc0 con 0x7ff124144250 2023-10-09T15:31:15.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.492+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff1240ccf00 con 0x7ff124144250 2023-10-09T15:31:15.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.492+0000 7ff1227fc700 1 -- 172.21.15.33:0/2957063674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7ff1140563e0 con 0x7ff124144250 2023-10-09T15:31:15.493 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:15.494 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:15.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 msgr2=0x7ff1100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 0x7ff1100693e0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff11c009db0 tx=0x7ff11c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 msgr2=0x7ff1241570f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7ff114009ab0 tx=0x7ff114018000 comp rx=0 tx=0).stop 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 shutdown_connections 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff110066f30 0x7ff1100693e0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff124144250 0x7ff1241570f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1240cb5a0 0x7ff124155c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 --2- 172.21.15.33:0/2957063674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1240cd9e0 0x7ff12415d220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.494+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 >> 172.21.15.33:0/2957063674 conn(0x7ff124070e30 msgr2=0x7ff1240c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.495+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 shutdown_connections 2023-10-09T15:31:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.495+0000 7ff12c38b700 1 -- 172.21.15.33:0/2957063674 wait complete. 2023-10-09T15:31:15.497 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:15.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.625+0000 7f410ca2c700 1 Processor -- start 2023-10-09T15:31:15.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.625+0000 7f410ca2c700 1 -- start start 2023-10-09T15:31:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410ca2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41080cb5a0 0x7f41080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410ca2c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f410815a5d0 0x7f4108156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410ca2c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f410815ae40 con 0x7f41080cd9e0 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410ca2c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41080d13f0 con 0x7f410815a5d0 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410ca2c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f410815ab60 con 0x7f41080cb5a0 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f4106d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f410815a5d0 0x7f4108156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f4105d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f41080cd9e0 0x7f4108159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38906/0 (socket says 172.21.15.33:38906) 2023-10-09T15:31:15.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f4105d9b700 1 -- 172.21.15.33:0/3506742539 learned_addr learned my addr 172.21.15.33:0/3506742539 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.626+0000 7f410659c700 1 --2- 172.21.15.33:0/3506742539 >> v2:172.21.15.59:3300/0 conn(0x7f41080cb5a0 0x7f41080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410559a700 1 -- 172.21.15.33:0/3506742539 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 920647084 0 0) 0x7f410815ae40 con 0x7f41080cd9e0 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410559a700 1 -- 172.21.15.33:0/3506742539 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40f4003570 con 0x7f41080cd9e0 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f4106d9d700 1 -- 172.21.15.33:0/3506742539 >> v2:172.21.15.59:3300/0 conn(0x7f41080cb5a0 msgr2=0x7f41080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f4106d9d700 1 --2- 172.21.15.33:0/3506742539 >> v2:172.21.15.59:3300/0 conn(0x7f41080cb5a0 0x7f41080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f4106d9d700 1 -- 172.21.15.33:0/3506742539 >> v1:172.21.15.33:6789/0 conn(0x7f41080cd9e0 legacy=0x7f4108159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f4106d9d700 1 -- 172.21.15.33:0/3506742539 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41080ccf00 con 0x7f410815a5d0 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f4106d9d700 1 --2- 172.21.15.33:0/3506742539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f410815a5d0 0x7f4108156e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9446bfe690a8cfc4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410559a700 1 -- 172.21.15.33:0/3506742539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8011630 con 0x7f410815a5d0 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410559a700 1 -- 172.21.15.33:0/3506742539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f8011790 con 0x7f410815a5d0 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410559a700 1 -- 172.21.15.33:0/3506742539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f8011b30 con 0x7f410815a5d0 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410ca2c700 1 -- 172.21.15.33:0/3506742539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f410815a5d0 msgr2=0x7f4108156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.627+0000 7f410ca2c700 1 --2- 172.21.15.33:0/3506742539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f410815a5d0 0x7f4108156e90 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f40f80098e0 tx=0x7f40f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 -- 172.21.15.33:0/3506742539 shutdown_connections 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 --2- 172.21.15.33:0/3506742539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f410815a5d0 0x7f4108156e90 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 --2- 172.21.15.33:0/3506742539 >> v2:172.21.15.59:3300/0 conn(0x7f41080cb5a0 0x7f41080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 -- 172.21.15.33:0/3506742539 >> 172.21.15.33:0/3506742539 conn(0x7f4108070e30 msgr2=0x7f41080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 -- 172.21.15.33:0/3506742539 shutdown_connections 2023-10-09T15:31:15.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.628+0000 7f410ca2c700 1 -- 172.21.15.33:0/3506742539 wait complete. 2023-10-09T15:31:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.629+0000 7f410ca2c700 1 Processor -- start 2023-10-09T15:31:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.629+0000 7f410ca2c700 1 -- start start 2023-10-09T15:31:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.629+0000 7f410ca2c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 0x7f41080ca030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.629+0000 7f410ca2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 0x7f41080b56b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b4400 con 0x7f41080cd9e0 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b5bf0 con 0x7f410815a5d0 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41080b4610 con 0x7f41080cb5a0 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53242/0 (socket says 172.21.15.33:53242) 2023-10-09T15:31:15.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 -- 172.21.15.33:0/4228094673 learned_addr learned my addr 172.21.15.33:0/4228094673 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4106d9d700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 0x7f41080b56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410659c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 0x7f41080ca030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 -- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 msgr2=0x7f41080ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 0x7f41080ca030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 -- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 msgr2=0x7f41080b56b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 0x7f41080b56b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 -- 172.21.15.33:0/4228094673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40f8009420 con 0x7f41080cd9e0 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4106d9d700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 0x7f41080b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410659c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 0x7f41080ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f4105d9b700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c7f0 tx=0x7f40f0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0005b30 con 0x7f41080cd9e0 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40f0005c90 con 0x7f41080cd9e0 2023-10-09T15:31:15.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41080b48f0 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40f0007340 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.630+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41080b4eb0 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.631+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f410804c3c0 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.632+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40f001b400 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.632+0000 7f40fe7fc700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.632+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40f0084030 con 0x7f41080cd9e0 2023-10-09T15:31:15.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.632+0000 7f410659c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.632+0000 7f410659c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 0x7f40e80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41000075e0 tx=0x7f41000097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.636+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40f00513d0 con 0x7f41080cd9e0 2023-10-09T15:31:15.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.834+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f41080cabc0 con 0x7f41080cd9e0 2023-10-09T15:31:15.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.835+0000 7f40fe7fc700 1 -- 172.21.15.33:0/4228094673 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f40f00076f0 con 0x7f41080cd9e0 2023-10-09T15:31:15.836 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:15.836 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 msgr2=0x7f40e80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 0x7f40e80693e0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f41000075e0 tx=0x7f41000097e0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 msgr2=0x7f41080b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f40f000c7f0 tx=0x7f40f0007e00 comp rx=0 tx=0).stop 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 shutdown_connections 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40e8066f30 0x7f40e80693e0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f410815a5d0 0x7f41080b56b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41080cb5a0 0x7f41080ca030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 --2- 172.21.15.33:0/4228094673 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41080cd9e0 0x7f41080b3ec0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.837+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 >> 172.21.15.33:0/4228094673 conn(0x7f4108070e30 msgr2=0x7f41080c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.838+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 shutdown_connections 2023-10-09T15:31:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.838+0000 7f410ca2c700 1 -- 172.21.15.33:0/4228094673 wait complete. 2023-10-09T15:31:15.851 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:15.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.972+0000 7fe17da43700 1 Processor -- start 2023-10-09T15:31:15.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.972+0000 7fe17da43700 1 -- start start 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe17da43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe17da43700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1780cc6f0 0x7fe17813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe17da43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17806d7b0 con 0x7fe178069a00 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe17da43700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17806a590 con 0x7fe1780cc6f0 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe17da43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17806f7d0 con 0x7fe1780cc320 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe1777fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe178069a00 0x7fe178069e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36760/0 (socket says 172.21.15.33:36760) 2023-10-09T15:31:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe1777fe700 1 -- 172.21.15.33:0/3503112559 learned_addr learned my addr 172.21.15.33:0/3503112559 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3503112559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.973+0000 7fe1767fc700 1 --2- 172.21.15.33:0/3503112559 >> v2:172.21.15.59:3300/0 conn(0x7fe1780cc6f0 0x7fe17813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe175ffb700 1 -- 172.21.15.33:0/3503112559 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 733251319 0 0) 0x7fe17806d7b0 con 0x7fe178069a00 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe175ffb700 1 -- 172.21.15.33:0/3503112559 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe164003570 con 0x7fe178069a00 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe176ffd700 1 -- 172.21.15.33:0/3503112559 >> v2:172.21.15.59:3300/0 conn(0x7fe1780cc6f0 msgr2=0x7fe17813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3503112559 >> v2:172.21.15.59:3300/0 conn(0x7fe1780cc6f0 0x7fe17813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe176ffd700 1 -- 172.21.15.33:0/3503112559 >> v1:172.21.15.59:6789/0 conn(0x7fe178069a00 legacy=0x7fe178069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe176ffd700 1 -- 172.21.15.33:0/3503112559 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17806e330 con 0x7fe1780cc320 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3503112559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17813c2a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098e0 tx=0x7fe1700091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=32fa9abe79a0ee28 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe175ffb700 1 -- 172.21.15.33:0/3503112559 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011630 con 0x7fe1780cc320 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe175ffb700 1 -- 172.21.15.33:0/3503112559 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe170011790 con 0x7fe1780cc320 2023-10-09T15:31:15.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.974+0000 7fe175ffb700 1 -- 172.21.15.33:0/3503112559 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011b30 con 0x7fe1780cc320 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 -- 172.21.15.33:0/3503112559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 msgr2=0x7fe17813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 --2- 172.21.15.33:0/3503112559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17813c2a0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe1700098e0 tx=0x7fe1700091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 -- 172.21.15.33:0/3503112559 shutdown_connections 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 --2- 172.21.15.33:0/3503112559 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17813c2a0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 --2- 172.21.15.33:0/3503112559 >> v2:172.21.15.59:3300/0 conn(0x7fe1780cc6f0 0x7fe17813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 -- 172.21.15.33:0/3503112559 >> 172.21.15.33:0/3503112559 conn(0x7fe178067f00 msgr2=0x7fe178068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 -- 172.21.15.33:0/3503112559 shutdown_connections 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.975+0000 7fe17da43700 1 -- 172.21.15.33:0/3503112559 wait complete. 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.976+0000 7fe17da43700 1 Processor -- start 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.976+0000 7fe17da43700 1 -- start start 2023-10-09T15:31:15.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17816ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780cc6f0 0x7fe17816d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178153040 con 0x7fe178069a00 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178154610 con 0x7fe1780cc6f0 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe17da43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178145900 con 0x7fe1780cc320 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53248/0 (socket says 172.21.15.33:53248) 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 -- 172.21.15.33:0/3305890221 learned_addr learned my addr 172.21.15.33:0/3305890221 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe1777fe700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780cc6f0 0x7fe17816d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe1767fc700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17816ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 -- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 msgr2=0x7fe17816ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17816ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 -- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780cc6f0 msgr2=0x7fe17816d360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780cc6f0 0x7fe17816d360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 -- 172.21.15.33:0/3305890221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe170009420 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.977+0000 7fe176ffd700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe170009ed0 tx=0x7fe170017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.978+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170011b10 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.978+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1700253f0 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.978+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1780aa4f0 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.978+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1700257b0 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.978+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1780aaab0 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.979+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17804c3c0 con 0x7fe178069a00 2023-10-09T15:31:15.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.979+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe170025ba0 con 0x7fe178069a00 2023-10-09T15:31:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.980+0000 7fe16effd700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 0x7fe1580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.980+0000 7fe1767fc700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 0x7fe1580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.980+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe170085ee0 con 0x7fe178069a00 2023-10-09T15:31:15.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.980+0000 7fe1767fc700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 0x7fe1580693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe178159d40 tx=0x7fe160008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:15.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:15.984+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe170053150 con 0x7fe178069a00 2023-10-09T15:31:16.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.176+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe17806da00 con 0x7fe178069a00 2023-10-09T15:31:16.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.177+0000 7fe16effd700 1 -- 172.21.15.33:0/3305890221 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe170056770 con 0x7fe178069a00 2023-10-09T15:31:16.178 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:16.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 msgr2=0x7fe1580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 0x7fe1580693e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe178159d40 tx=0x7fe160008040 comp rx=0 tx=0).stop 2023-10-09T15:31:16.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 msgr2=0x7fe1781453c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe170009ed0 tx=0x7fe170017000 comp rx=0 tx=0).stop 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 shutdown_connections 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe158066f30 0x7fe1580693e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe178069a00 0x7fe1781453c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1780cc6f0 0x7fe17816d360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 --2- 172.21.15.33:0/3305890221 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1780cc320 0x7fe17816ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 >> 172.21.15.33:0/3305890221 conn(0x7fe178067f00 msgr2=0x7fe17813a720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 shutdown_connections 2023-10-09T15:31:16.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.179+0000 7fe17da43700 1 -- 172.21.15.33:0/3305890221 wait complete. 2023-10-09T15:31:16.192 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.312+0000 7feb71a72700 1 Processor -- start 2023-10-09T15:31:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.312+0000 7feb71a72700 1 -- start start 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.313+0000 7feb71a72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.313+0000 7feb71a72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feb6c159c90 0x7feb6c0cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.313+0000 7feb71a72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb6c0c9310 con 0x7feb6c1598c0 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.313+0000 7feb71a72700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feb6c0ad990 con 0x7feb6c159c90 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.313+0000 7feb71a72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0ce090 con 0x7feb6c0c4580 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:37042/0 (socket says 172.21.15.33:37042) 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 -- 172.21.15.33:0/2853802931 learned_addr learned my addr 172.21.15.33:0/2853802931 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6bfff700 1 --2- 172.21.15.33:0/2853802931 >> v2:172.21.15.59:3300/0 conn(0x7feb6c159c90 0x7feb6c0cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 -- 172.21.15.33:0/2853802931 >> v2:172.21.15.59:3300/0 conn(0x7feb6c159c90 msgr2=0x7feb6c0cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:16.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 --2- 172.21.15.33:0/2853802931 >> v2:172.21.15.59:3300/0 conn(0x7feb6c159c90 0x7feb6c0cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6a7fc700 1 -- 172.21.15.33:0/2853802931 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 510467701 0 0) 0x7feb6c0c9310 con 0x7feb6c1598c0 2023-10-09T15:31:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 -- 172.21.15.33:0/2853802931 >> v1:172.21.15.59:6789/0 conn(0x7feb6c1598c0 legacy=0x7feb6c0c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 -- 172.21.15.33:0/2853802931 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb6c0c8cc0 con 0x7feb6c0c4580 2023-10-09T15:31:16.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6affd700 1 --2- 172.21.15.33:0/2853802931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e562d9bd6402650f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6a7fc700 1 -- 172.21.15.33:0/2853802931 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb60009ea0 con 0x7feb6c0c4580 2023-10-09T15:31:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6a7fc700 1 -- 172.21.15.33:0/2853802931 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb6000b860 con 0x7feb6c0c4580 2023-10-09T15:31:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.314+0000 7feb6a7fc700 1 -- 172.21.15.33:0/2853802931 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bc00 con 0x7feb6c0c4580 2023-10-09T15:31:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 -- 172.21.15.33:0/2853802931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 msgr2=0x7feb6c0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 --2- 172.21.15.33:0/2853802931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7feb600099b0 tx=0x7feb60009250 comp rx=0 tx=0).stop 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 -- 172.21.15.33:0/2853802931 shutdown_connections 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 --2- 172.21.15.33:0/2853802931 >> v2:172.21.15.59:3300/0 conn(0x7feb6c159c90 0x7feb6c0cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 --2- 172.21.15.33:0/2853802931 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c0c4580 0x7feb6c0cd460 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 -- 172.21.15.33:0/2853802931 >> 172.21.15.33:0/2853802931 conn(0x7feb6c088000 msgr2=0x7feb6c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 -- 172.21.15.33:0/2853802931 shutdown_connections 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.315+0000 7feb71a72700 1 -- 172.21.15.33:0/2853802931 wait complete. 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.316+0000 7feb71a72700 1 Processor -- start 2023-10-09T15:31:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.316+0000 7feb71a72700 1 -- start start 2023-10-09T15:31:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb6c0c4580 0x7feb6c0c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 0x7feb6c155880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0c62a0 con 0x7feb6c1598c0 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0b2320 con 0x7feb6c0c4580 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb71a72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb6c0c7fd0 con 0x7feb6c159c90 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53258/0 (socket says 172.21.15.33:53258) 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 -- 172.21.15.33:0/3599424864 learned_addr learned my addr 172.21.15.33:0/3599424864 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6bfff700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 0x7feb6c155880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6b7fe700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb6c0c4580 0x7feb6c0c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 -- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 msgr2=0x7feb6c155880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 0x7feb6c155880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 -- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb6c0c4580 msgr2=0x7feb6c0c7760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb6c0c4580 0x7feb6c0c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6affd700 1 -- 172.21.15.33:0/3599424864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb600094f0 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.317+0000 7feb6bfff700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 0x7feb6c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb6affd700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feb60009290 tx=0x7feb60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000baa0 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb60025420 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb6c0c82b0 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb6000bc00 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.318+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb6c0c8610 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.319+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb6c0b2490 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.319+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7feb60023070 con 0x7feb6c1598c0 2023-10-09T15:31:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.319+0000 7feb537fe700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.320+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feb60085be0 con 0x7feb6c1598c0 2023-10-09T15:31:16.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.320+0000 7feb6b7fe700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.320+0000 7feb6b7fe700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0011e0 tx=0x7feb5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.324+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feb60052e50 con 0x7feb6c1598c0 2023-10-09T15:31:16.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.518+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feb6c04c3c0 con 0x7feb6c1598c0 2023-10-09T15:31:16.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.519+0000 7feb537fe700 1 -- 172.21.15.33:0/3599424864 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7feb6002a020 con 0x7feb6c1598c0 2023-10-09T15:31:16.520 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:16.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 msgr2=0x7feb580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 0x7feb580693e0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7feb5c0011e0 tx=0x7feb5c009040 comp rx=0 tx=0).stop 2023-10-09T15:31:16.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 msgr2=0x7feb6c0adad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feb60009290 tx=0x7feb60017000 comp rx=0 tx=0).stop 2023-10-09T15:31:16.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 shutdown_connections 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feb58066f30 0x7feb580693e0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feb6c159c90 0x7feb6c155880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feb6c0c4580 0x7feb6c0c7760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 --2- 172.21.15.33:0/3599424864 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feb6c1598c0 0x7feb6c0adad0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 >> 172.21.15.33:0/3599424864 conn(0x7feb6c088000 msgr2=0x7feb6c156210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 shutdown_connections 2023-10-09T15:31:16.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.521+0000 7feb71a72700 1 -- 172.21.15.33:0/3599424864 wait complete. 2023-10-09T15:31:16.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:16.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.654+0000 7fce896e5700 1 Processor -- start 2023-10-09T15:31:16.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.654+0000 7fce896e5700 1 -- start start 2023-10-09T15:31:16.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce896e5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce84159550 0x7fce840ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce896e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8415dfd0 0x7fce840aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce896e5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce840acc00 con 0x7fce84159920 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce896e5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce840abff0 con 0x7fce84159550 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce896e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840ac2d0 con 0x7fce8415dfd0 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce83fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce84159550 0x7fce840ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce88ee4700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fce84159920 0x7fce840ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38908/0 (socket says 172.21.15.33:38908) 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.655+0000 7fce88ee4700 1 -- 172.21.15.33:0/1808014057 learned_addr learned my addr 172.21.15.33:0/1808014057 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce83fff700 1 -- 172.21.15.33:0/1808014057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8415dfd0 msgr2=0x7fce840aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce83fff700 1 --2- 172.21.15.33:0/1808014057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8415dfd0 0x7fce840aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce83fff700 1 -- 172.21.15.33:0/1808014057 >> v1:172.21.15.33:6789/0 conn(0x7fce84159920 legacy=0x7fce840ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce83fff700 1 -- 172.21.15.33:0/1808014057 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce840ac5b0 con 0x7fce84159550 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce83fff700 1 --2- 172.21.15.33:0/1808014057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840ceac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0098e0 tx=0x7fce6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46ced562cefc6533 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce82ffd700 1 -- 172.21.15.33:0/1808014057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c009e80 con 0x7fce84159550 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce82ffd700 1 -- 172.21.15.33:0/1808014057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c00b860 con 0x7fce84159550 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce82ffd700 1 -- 172.21.15.33:0/1808014057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00bbe0 con 0x7fce84159550 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 -- 172.21.15.33:0/1808014057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 msgr2=0x7fce840ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 --2- 172.21.15.33:0/1808014057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840ceac0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fce6c0098e0 tx=0x7fce6c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 -- 172.21.15.33:0/1808014057 shutdown_connections 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 --2- 172.21.15.33:0/1808014057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840ceac0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 --2- 172.21.15.33:0/1808014057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce8415dfd0 0x7fce840aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.656+0000 7fce896e5700 1 -- 172.21.15.33:0/1808014057 >> 172.21.15.33:0/1808014057 conn(0x7fce8406ce80 msgr2=0x7fce840ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.657+0000 7fce896e5700 1 -- 172.21.15.33:0/1808014057 shutdown_connections 2023-10-09T15:31:16.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.657+0000 7fce896e5700 1 -- 172.21.15.33:0/1808014057 wait complete. 2023-10-09T15:31:16.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 Processor -- start 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 -- start start 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce84159920 0x7fce840cbe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8415dfd0 0x7fce840cdb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce841560c0 con 0x7fce84159550 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce840cd090 con 0x7fce8415dfd0 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.658+0000 7fce896e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce840cc480 con 0x7fce84159920 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53282/0 (socket says 172.21.15.33:53282) 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 -- 172.21.15.33:0/3353131502 learned_addr learned my addr 172.21.15.33:0/3353131502 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:16.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce88ee4700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8415dfd0 0x7fce840cdb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce837fe700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce84159920 0x7fce840cbe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 -- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce84159920 msgr2=0x7fce840cbe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce84159920 0x7fce840cbe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 -- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8415dfd0 msgr2=0x7fce840cdb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8415dfd0 0x7fce840cdb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 -- 172.21.15.33:0/3353131502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c009420 con 0x7fce84159550 2023-10-09T15:31:16.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce83fff700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce8406ad70 tx=0x7fce6c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c00bbe0 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6c011420 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce840cc760 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6c011820 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.659+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce840ccd20 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.660+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce8404c3c0 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.661+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fce6c011c50 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.661+0000 7fce7bfff700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 0x7fce640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.661+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce6c085da0 con 0x7fce84159550 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.661+0000 7fce837fe700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 0x7fce640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.662+0000 7fce837fe700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 0x7fce640693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce840caf80 tx=0x7fce740091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.666+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce6c053010 con 0x7fce84159550 2023-10-09T15:31:16.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.857+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fce840cb2b0 con 0x7fce84159550 2023-10-09T15:31:16.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.857+0000 7fce7bfff700 1 -- 172.21.15.33:0/3353131502 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fce6c056630 con 0x7fce84159550 2023-10-09T15:31:16.858 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:16.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 msgr2=0x7fce640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 0x7fce640693e0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fce840caf80 tx=0x7fce740091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 msgr2=0x7fce840cd520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fce8406ad70 tx=0x7fce6c017000 comp rx=0 tx=0).stop 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 shutdown_connections 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce64066f30 0x7fce640693e0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce84159550 0x7fce840cd520 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce8415dfd0 0x7fce840cdb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 --2- 172.21.15.33:0/3353131502 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce84159920 0x7fce840cbe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 >> 172.21.15.33:0/3353131502 conn(0x7fce8406ce80 msgr2=0x7fce84154150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 shutdown_connections 2023-10-09T15:31:16.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.859+0000 7fce896e5700 1 -- 172.21.15.33:0/3353131502 wait complete. 2023-10-09T15:31:16.872 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.990+0000 7ff4d09f6700 1 Processor -- start 2023-10-09T15:31:16.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.990+0000 7ff4d09f6700 1 -- start start 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4d09f6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff4cc0cb5a0 0x7ff4cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4d09f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4d09f6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4cc15ae40 con 0x7ff4cc0cde50 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4d09f6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4cc0d13f0 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4d09f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc15ab60 con 0x7ff4cc0cd9e0 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff4cc0cb5a0 0x7ff4cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4cad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff4cc0cde50 0x7ff4cc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38910/0 (socket says 172.21.15.33:38910) 2023-10-09T15:31:16.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4cad9d700 1 -- 172.21.15.33:0/4186260310 learned_addr learned my addr 172.21.15.33:0/4186260310 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4c9d9b700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 -- 172.21.15.33:0/4186260310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 msgr2=0x7ff4cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 -- 172.21.15.33:0/4186260310 >> v1:172.21.15.33:6789/0 conn(0x7ff4cc0cde50 legacy=0x7ff4cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 -- 172.21.15.33:0/4186260310 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4cc0ccf00 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4c959a700 1 -- 172.21.15.33:0/4186260310 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 378221092 0 0) 0x7ff4cc15ae40 con 0x7ff4cc0cde50 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4ca59c700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc0cb970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0098e0 tx=0x7ff4bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fffec7d35fef741 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4c959a700 1 -- 172.21.15.33:0/4186260310 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc009e80 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4c959a700 1 -- 172.21.15.33:0/4186260310 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4bc00b860 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.991+0000 7ff4c959a700 1 -- 172.21.15.33:0/4186260310 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4bc00bbe0 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 -- 172.21.15.33:0/4186260310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc0cb5a0 msgr2=0x7ff4cc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc0cb970 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0098e0 tx=0x7ff4bc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 -- 172.21.15.33:0/4186260310 shutdown_connections 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc0cb970 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/4186260310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 -- 172.21.15.33:0/4186260310 >> 172.21.15.33:0/4186260310 conn(0x7ff4cc070e30 msgr2=0x7ff4cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 -- 172.21.15.33:0/4186260310 shutdown_connections 2023-10-09T15:31:16.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.992+0000 7ff4d09f6700 1 -- 172.21.15.33:0/4186260310 wait complete. 2023-10-09T15:31:16.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.993+0000 7ff4d09f6700 1 Processor -- start 2023-10-09T15:31:16.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.993+0000 7ff4d09f6700 1 -- start start 2023-10-09T15:31:16.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0b4f60 con 0x7ff4cc15c560 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0b3e20 con 0x7ff4cc0cb5a0 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4d09f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4cc0b4100 con 0x7ff4cc0cd9e0 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53302/0 (socket says 172.21.15.33:53302) 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 -- 172.21.15.33:0/563855796 learned_addr learned my addr 172.21.15.33:0/563855796 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4ca59c700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4c9d9b700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 -- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 msgr2=0x7ff4cc0b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc0b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 -- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4cc0cb5a0 msgr2=0x7ff4cc1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 -- 172.21.15.33:0/563855796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc009420 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.994+0000 7ff4cad9d700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400cbf0 tx=0x7ff4c40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.995+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400a8b0 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.995+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4c400aa10 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.995+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4cc0b43e0 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.995+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4c400add0 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.995+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4cc152930 con 0x7ff4cc15c560 2023-10-09T15:31:16.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.996+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4cc04c3c0 con 0x7ff4cc15c560 2023-10-09T15:31:17.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.996+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff4c4007300 con 0x7ff4cc15c560 2023-10-09T15:31:17.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.996+0000 7ff4ba7fc700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.997+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4c4084800 con 0x7ff4cc15c560 2023-10-09T15:31:17.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.997+0000 7ff4ca59c700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:16.997+0000 7ff4ca59c700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0091e0 tx=0x7ff4bc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.001+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4c4051af0 con 0x7ff4cc15c560 2023-10-09T15:31:17.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.247+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4cc0b50a0 con 0x7ff4cc15c560 2023-10-09T15:31:17.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.247+0000 7ff4ba7fc700 1 -- 172.21.15.33:0/563855796 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7ff4c4055110 con 0x7ff4cc15c560 2023-10-09T15:31:17.248 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:17.248 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:17.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 msgr2=0x7ff4ac0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 0x7ff4ac0693e0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0091e0 tx=0x7ff4bc017000 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 msgr2=0x7ff4cc154cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7ff4c400cbf0 tx=0x7ff4c40019b0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 shutdown_connections 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4ac066f30 0x7ff4ac0693e0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4cc15c560 0x7ff4cc154cf0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4cc0cb5a0 0x7ff4cc1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 --2- 172.21.15.33:0/563855796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4cc0cd9e0 0x7ff4cc0b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 >> 172.21.15.33:0/563855796 conn(0x7ff4cc070e30 msgr2=0x7ff4cc0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 shutdown_connections 2023-10-09T15:31:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.249+0000 7ff4d09f6700 1 -- 172.21.15.33:0/563855796 wait complete. 2023-10-09T15:31:17.252 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:17.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:17.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.381+0000 7f10c2a4c700 1 Processor -- start 2023-10-09T15:31:17.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.381+0000 7f10c2a4c700 1 -- start start 2023-10-09T15:31:17.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c2a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 0x7f10bc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c2a4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc0cd9e0 0x7f10bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c2a4c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10bc15ae40 con 0x7f10bc0cde50 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c2a4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f10bc0d13f0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c2a4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15ab60 con 0x7f10bc0cb5a0 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc0cd9e0 0x7f10bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 0x7f10bc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f10bc0cd9e0 0x7f10bc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53336/0 (socket says 172.21.15.33:53336) 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10c0fe9700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f10bc0cde50 0x7f10bc156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36776/0 (socket says 172.21.15.33:36776) 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bbfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 0x7f10bc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:37114/0 (socket says 172.21.15.33:37114) 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 -- 172.21.15.33:0/1738613968 learned_addr learned my addr 172.21.15.33:0/1738613968 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 -- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 msgr2=0x7f10bc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:17.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 0x7f10bc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 -- 172.21.15.33:0/1738613968 >> v1:172.21.15.59:6789/0 conn(0x7f10bc0cde50 legacy=0x7f10bc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 -- 172.21.15.33:0/1738613968 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10bc0ccf00 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.382+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc159ec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0099b0 tx=0x7f10ac009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8c94cf8fc93cc9b9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10baffd700 1 -- 172.21.15.33:0/1738613968 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac009ea0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10baffd700 1 -- 172.21.15.33:0/1738613968 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac00b860 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10baffd700 1 -- 172.21.15.33:0/1738613968 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00bc00 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 -- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cd9e0 msgr2=0x7f10bc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc159ec0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f10ac0099b0 tx=0x7f10ac009250 comp rx=0 tx=0).stop 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 -- 172.21.15.33:0/1738613968 shutdown_connections 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc0cb5a0 0x7f10bc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/1738613968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc159ec0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 -- 172.21.15.33:0/1738613968 >> 172.21.15.33:0/1738613968 conn(0x7f10bc070e30 msgr2=0x7f10bc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 -- 172.21.15.33:0/1738613968 shutdown_connections 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.383+0000 7f10c2a4c700 1 -- 172.21.15.33:0/1738613968 wait complete. 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.384+0000 7f10c2a4c700 1 Processor -- start 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 -- start start 2023-10-09T15:31:17.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cb5a0 0x7f10bc156390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc15b5b0 0x7f10bc0b11c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc15bec0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc1568d0 con 0x7f10bc0cb5a0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10c2a4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10bc157de0 con 0x7f10bc15b5b0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10bb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10bb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53318/0 (socket says 172.21.15.33:53318) 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10bb7fe700 1 -- 172.21.15.33:0/4281509874 learned_addr learned my addr 172.21.15.33:0/4281509874 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.385+0000 7f10bbfff700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cb5a0 0x7f10bc156390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10c0fe9700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc15b5b0 0x7f10bc0b11c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 -- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc15b5b0 msgr2=0x7f10bc0b11c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc15b5b0 0x7f10bc0b11c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 -- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cb5a0 msgr2=0x7f10bc156390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cb5a0 0x7f10bc156390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 -- 172.21.15.33:0/4281509874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ac0094f0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10bb7fe700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10ac006fd0 tx=0x7f10ac017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac00bbe0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10ac011420 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10bc0ca7c0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10ac0117c0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.386+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10bc157790 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.387+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10bc15b9b0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.387+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10ac011bf0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.388+0000 7f10a3fff700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.388+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10ac085ee0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.388+0000 7f10bbfff700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.388+0000 7f10bbfff700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 0x7f10a80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009d40 tx=0x7f10b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.392+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10ac053150 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.587+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10bc04c3c0 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.588+0000 7f10a3fff700 1 -- 172.21.15.33:0/4281509874 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f10ac056770 con 0x7f10bc0cd9e0 2023-10-09T15:31:17.589 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:17.589 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 msgr2=0x7f10a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 0x7f10a80693e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f10b0009d40 tx=0x7f10b0008040 comp rx=0 tx=0).stop 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 msgr2=0x7f10bc15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10ac006fd0 tx=0x7f10ac017000 comp rx=0 tx=0).stop 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 shutdown_connections 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10a8066f30 0x7f10a80693e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10bc15b5b0 0x7f10bc0b11c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10bc0cb5a0 0x7f10bc156390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 --2- 172.21.15.33:0/4281509874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10bc0cd9e0 0x7f10bc15b070 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 >> 172.21.15.33:0/4281509874 conn(0x7f10bc070e30 msgr2=0x7f10bc0c7020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:17.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 shutdown_connections 2023-10-09T15:31:17.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.590+0000 7f10c2a4c700 1 -- 172.21.15.33:0/4281509874 wait complete. 2023-10-09T15:31:17.603 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.721+0000 7f49e2aee700 1 Processor -- start 2023-10-09T15:31:17.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.721+0000 7f49e2aee700 1 -- start start 2023-10-09T15:31:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e2aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 0x7f49dc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e2aee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49dc0cef40 0x7f49dc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e2aee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49dc15afd0 con 0x7f49dc153c30 2023-10-09T15:31:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e2aee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49dc15b2b0 con 0x7f49dc0cef40 2023-10-09T15:31:17.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e2aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc15b590 con 0x7f49dc15de50 2023-10-09T15:31:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e22ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49dc0cef40 0x7f49dc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e12eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 0x7f49dc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e1aec700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f49dc153c30 0x7f49dc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36792/0 (socket says 172.21.15.33:36792) 2023-10-09T15:31:17.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.722+0000 7f49e1aec700 1 -- 172.21.15.33:0/463806866 learned_addr learned my addr 172.21.15.33:0/463806866 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e0aea700 1 -- 172.21.15.33:0/463806866 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787067919 0 0) 0x7f49dc15afd0 con 0x7f49dc153c30 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e0aea700 1 -- 172.21.15.33:0/463806866 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49c4003570 con 0x7f49dc153c30 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e22ed700 1 -- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 msgr2=0x7f49dc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e22ed700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 0x7f49dc0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e22ed700 1 -- 172.21.15.33:0/463806866 >> v1:172.21.15.59:6789/0 conn(0x7f49dc153c30 legacy=0x7f49dc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e22ed700 1 -- 172.21.15.33:0/463806866 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49dc15b870 con 0x7f49dc0cef40 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e12eb700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 0x7f49dc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:17.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e22ed700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc0cef40 0x7f49dc15c070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009e60 tx=0x7f49cc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=333d3679229261d5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e0aea700 1 -- 172.21.15.33:0/463806866 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00e070 con 0x7f49dc0cef40 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e0aea700 1 -- 172.21.15.33:0/463806866 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49cc00bab0 con 0x7f49dc0cef40 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.723+0000 7f49e0aea700 1 -- 172.21.15.33:0/463806866 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49cc00be30 con 0x7f49dc0cef40 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 -- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc0cef40 msgr2=0x7f49dc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc0cef40 0x7f49dc15c070 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f49cc009e60 tx=0x7f49cc009780 comp rx=0 tx=0).stop 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 -- 172.21.15.33:0/463806866 shutdown_connections 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc0cef40 0x7f49dc15c070 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 --2- 172.21.15.33:0/463806866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc15de50 0x7f49dc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 -- 172.21.15.33:0/463806866 >> 172.21.15.33:0/463806866 conn(0x7f49dc0703a0 msgr2=0x7f49dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:17.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 -- 172.21.15.33:0/463806866 shutdown_connections 2023-10-09T15:31:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.724+0000 7f49e2aee700 1 -- 172.21.15.33:0/463806866 wait complete. 2023-10-09T15:31:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.725+0000 7f49e2aee700 1 Processor -- start 2023-10-09T15:31:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.725+0000 7f49e2aee700 1 -- start start 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc0cef40 0x7f49dc0cc330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 0x7f49dc0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc16a710 con 0x7f49dc153c30 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc16a020 con 0x7f49dc15de50 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49dc0b3e10 con 0x7f49dc0cef40 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53330/0 (socket says 172.21.15.33:53330) 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e1aec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc0cef40 0x7f49dc0cc330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e22ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 0x7f49dc0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 -- 172.21.15.33:0/781563324 learned_addr learned my addr 172.21.15.33:0/781563324 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 -- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc0cef40 msgr2=0x7f49dc0cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc0cef40 0x7f49dc0cc330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 -- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 msgr2=0x7f49dc0c99d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 0x7f49dc0c99d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 -- 172.21.15.33:0/781563324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d0009420 con 0x7f49dc153c30 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e22ed700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 0x7f49dc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e12eb700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f49d000ec80 tx=0x7f49d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000c920 con 0x7f49dc153c30 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d000ca80 con 0x7f49dc153c30 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49cc009a20 con 0x7f49dc153c30 2023-10-09T15:31:17.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.726+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d000ce00 con 0x7f49dc153c30 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.727+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49dc0b43d0 con 0x7f49dc153c30 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.728+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49dc16a880 con 0x7f49dc153c30 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.728+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f49d0013680 con 0x7f49dc153c30 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.728+0000 7f49d9ffb700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.728+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49d0084910 con 0x7f49dc153c30 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.728+0000 7f49e1aec700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:17.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.729+0000 7f49e1aec700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 0x7f49c80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0c64f0 tx=0x7f49d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:17.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.733+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49d0051b80 con 0x7f49dc153c30 2023-10-09T15:31:17.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.970+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49dc04c3c0 con 0x7f49dc153c30 2023-10-09T15:31:17.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.971+0000 7f49d9ffb700 1 -- 172.21.15.33:0/781563324 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f49d00551a0 con 0x7f49dc153c30 2023-10-09T15:31:17.972 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:17.972 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 msgr2=0x7f49c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 0x7f49c80693e0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f49dc0c64f0 tx=0x7f49d4009040 comp rx=0 tx=0).stop 2023-10-09T15:31:17.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 msgr2=0x7f49dc0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f49d000ec80 tx=0x7f49d00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 shutdown_connections 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49c8066f30 0x7f49c80693e0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49dc15de50 0x7f49dc0c99d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49dc0cef40 0x7f49dc0cc330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 --2- 172.21.15.33:0/781563324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49dc153c30 0x7f49dc0b59c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 >> 172.21.15.33:0/781563324 conn(0x7f49dc0703a0 msgr2=0x7f49dc0638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 shutdown_connections 2023-10-09T15:31:17.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:17.973+0000 7f49e2aee700 1 -- 172.21.15.33:0/781563324 wait complete. 2023-10-09T15:31:17.976 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:18.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:30:59.054444+0000', 'modified': '2023-10-09T15:31:02.669760+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4279}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4279': {'gid': 4279, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6834/342703065', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 342703065}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 342703065}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:31:18.388 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:31:18.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T15:31:18.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.511+0000 7fc86da5e700 1 Processor -- start 2023-10-09T15:31:18.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.511+0000 7fc86da5e700 1 -- start start 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc86da5e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8680cb5a0 0x7fc8680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc86da5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc868156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc86da5e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc86815ae40 con 0x7fc8680cd9e0 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc86da5e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8680d13f0 con 0x7fc8680cb5a0 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc86da5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86815ab60 con 0x7fc86815a5d0 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc8667fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc8680cd9e0 0x7fc868159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38916/0 (socket says 172.21.15.33:38916) 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc8667fc700 1 -- 172.21.15.33:0/2049923995 learned_addr learned my addr 172.21.15.33:0/2049923995 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:18.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2049923995 >> v2:172.21.15.33:3300/0 conn(0x7fc8680cb5a0 0x7fc8680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc865ffb700 1 -- 172.21.15.33:0/2049923995 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1623397514 0 0) 0x7fc86815ae40 con 0x7fc8680cd9e0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc865ffb700 1 -- 172.21.15.33:0/2049923995 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc854003570 con 0x7fc8680cd9e0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc8677fe700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc868156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 -- 172.21.15.33:0/2049923995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 msgr2=0x7fc868156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc868156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 -- 172.21.15.33:0/2049923995 >> v1:172.21.15.33:6789/0 conn(0x7fc8680cd9e0 legacy=0x7fc868159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 -- 172.21.15.33:0/2049923995 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8680ccf00 con 0x7fc8680cb5a0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680cb970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc860009910 tx=0x7fc8600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8c3b1182c46d16 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc865ffb700 1 -- 172.21.15.33:0/2049923995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000b640 con 0x7fc8680cb5a0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc865ffb700 1 -- 172.21.15.33:0/2049923995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86000b7a0 con 0x7fc8680cb5a0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.512+0000 7fc865ffb700 1 -- 172.21.15.33:0/2049923995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000bb60 con 0x7fc8680cb5a0 2023-10-09T15:31:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 -- 172.21.15.33:0/2049923995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 msgr2=0x7fc8680cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680cb970 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fc860009910 tx=0x7fc8600091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 -- 172.21.15.33:0/2049923995 shutdown_connections 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc868156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 --2- 172.21.15.33:0/2049923995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680cb970 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 -- 172.21.15.33:0/2049923995 >> 172.21.15.33:0/2049923995 conn(0x7fc868070e30 msgr2=0x7fc8680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 -- 172.21.15.33:0/2049923995 shutdown_connections 2023-10-09T15:31:18.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.513+0000 7fc86da5e700 1 -- 172.21.15.33:0/2049923995 wait complete. 2023-10-09T15:31:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.514+0000 7fc86da5e700 1 Processor -- start 2023-10-09T15:31:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.514+0000 7fc86da5e700 1 -- start start 2023-10-09T15:31:18.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8680cd9e0 0x7fc8680c8e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc86816ac90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680c89b0 con 0x7fc8680cb5a0 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc86816b1d0 con 0x7fc8680cd9e0 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc86da5e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680c7da0 con 0x7fc86815a5d0 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53344/0 (socket says 172.21.15.33:53344) 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 -- 172.21.15.33:0/3273761449 learned_addr learned my addr 172.21.15.33:0/3273761449 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 -- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 msgr2=0x7fc86816ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc8677fe700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc86816ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc86816ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc8667fc700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8680cd9e0 0x7fc8680c8e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 -- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8680cd9e0 msgr2=0x7fc8680c8e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8680cd9e0 0x7fc8680c8e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.515+0000 7fc866ffd700 1 -- 172.21.15.33:0/3273761449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc860009420 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc86806ea60 tx=0x7fc860017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc85effd700 1 -- 172.21.15.33:0/3273761449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86001f070 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc85effd700 1 -- 172.21.15.33:0/3273761449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860000c90 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8680c8080 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc85effd700 1 -- 172.21.15.33:0/3273761449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86000bb60 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.516+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8680c8640 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.517+0000 7fc85effd700 1 -- 172.21.15.33:0/3273761449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc860023070 con 0x7fc8680cb5a0 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.517+0000 7fc85effd700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.518+0000 7fc85effd700 1 -- 172.21.15.33:0/3273761449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8600859e0 con 0x7fc8680cb5a0 2023-10-09T15:31:18.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.518+0000 7fc8667fc700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.518+0000 7fc8667fc700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 0x7fc8480693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8500058d0 tx=0x7fc850009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 Processor -- start 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 -- start start 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae41d00 0x562caae20a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae20f60 0x562caadf3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caad4ea70 con 0x562caadf7a50 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caad4c270 con 0x562caae41d00 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.520+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x562caad48060 con 0x562caae20f60 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53352/0 (socket says 172.21.15.33:53352) 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 -- 172.21.15.33:0/3315264002 learned_addr learned my addr 172.21.15.33:0/3315264002 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 -- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae20f60 msgr2=0x562caadf3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae20f60 0x562caadf3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 -- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae41d00 msgr2=0x562caae20a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae41d00 0x562caae20a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 -- 172.21.15.33:0/3315264002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562caabe2270 con 0x562caadf7a50 2023-10-09T15:31:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc866ffd700 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc860083fb0 tx=0x7fc860083e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ec96ab317fb66e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc847fff700 1 -- 172.21.15.33:0/3315264002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860056910 con 0x562caadf7a50 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc847fff700 1 -- 172.21.15.33:0/3315264002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860059b60 con 0x562caadf7a50 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.521+0000 7fc847fff700 1 -- 172.21.15.33:0/3315264002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86005d8b0 con 0x562caadf7a50 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- 172.21.15.33:0/3315264002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 msgr2=0x562caadf7e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fc860083fb0 tx=0x7fc860083e60 comp rx=0 tx=0).stop 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- 172.21.15.33:0/3315264002 shutdown_connections 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadf7e20 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae20f60 0x562caadf3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 --2- 172.21.15.33:0/3315264002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae41d00 0x562caae20a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- 172.21.15.33:0/3315264002 >> 172.21.15.33:0/3315264002 conn(0x562caadf9370 msgr2=0x562caadf9740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- 172.21.15.33:0/3315264002 shutdown_connections 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- 172.21.15.33:0/3315264002 wait complete. 2023-10-09T15:31:18.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.522+0000 7fc876d56b80 1 -- start start 2023-10-09T15:31:18.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 Processor -- start 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae38560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae41780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caacf3890 con 0x562caadf7a50 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caad0eea0 con 0x562caae20f60 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x562caabcae30 con 0x562caae41d00 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.523+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 10 client.0 _ll_register_callbacks cb 0x562caadbb110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53358/0 (socket says 172.21.15.33:53358) 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 -- 172.21.15.33:0/665461981 learned_addr learned my addr 172.21.15.33:0/665461981 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 -- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 msgr2=0x562caae41780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae41780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 -- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 msgr2=0x562caae38560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae38560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 -- 172.21.15.33:0/665461981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8680c8640 con 0x562caadf7a50 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc866ffd700 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc860009fb0 tx=0x7fc86006d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee4c94b5123f61e4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc86005d930 con 0x562caadf7a50 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc860056010 con 0x562caadf7a50 2023-10-09T15:31:18.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x562caadecb70 con 0x562caadf7a50 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc86005d630 con 0x562caadf7a50 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 10 client.4665 fetch_fsmap learned FSMap version 8 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x562caab84fe0 con 0x562caadf7a50 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x562caadecb70 con 0x562caadf7a50 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc860072280 con 0x562caadf7a50 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 10 client.4665 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 10 client.4665 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.524+0000 7fc876d56b80 20 client.4665 populate_metadata read hostname 'smithi033' 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caae39250 0x562caae39620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc876d56b80 4 client.4665 mds_command: new command op to 4279 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:31:18.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 --> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x562caadc9aa0 con 0x562caae39250 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc8667fc700 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caae39250 0x562caae39620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc8667fc700 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caae39250 0x562caae39620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4cbc56f18ef00b9e server_cookie=1628116a687ee0aa in_seq=0 out_seq=0 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.525+0000 7fc8457fa700 10 client.4665 ms_handle_connect on v2:172.21.15.59:6832/342703065 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc8457fa700 1 -- 172.21.15.33:0/665461981 <== mds.0 v2:172.21.15.59:6832/342703065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x562caadc9aa0 con 0x562caae39250 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc8457fa700 10 client.4665 handle_command_reply: tid=0 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 client.4665 shutdown 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 msgr2=0x562caae50ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fc860009fb0 tx=0x7fc86006d000 comp rx=0 tx=0).stop 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 shutdown_connections 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caae39250 0x562caae39620 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caae50ff0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae41780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 --2- 172.21.15.33:0/665461981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae38560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc8457fa700 0 client.4665 ms_handle_reset on v2:172.21.15.59:6832/342703065 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 >> 172.21.15.33:0/665461981 conn(0x562caadf9370 msgr2=0x562caadfabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 shutdown_connections 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 1 -- 172.21.15.33:0/665461981 wait complete. 2023-10-09T15:31:18.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.526+0000 7fc876d56b80 20 client.4665 trim_cache size 0 max 16384 2023-10-09T15:31:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.543+0000 7fc876d56b80 1 Processor -- start 2023-10-09T15:31:18.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.543+0000 7fc876d56b80 1 -- start start 2023-10-09T15:31:18.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae20830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae277e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caadfa9a0 con 0x562caadf7a50 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caadf7370 con 0x562caae20f60 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x562caae41af0 con 0x562caae41d00 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53370/0 (socket says 172.21.15.33:53370) 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 -- 172.21.15.33:0/2733344741 learned_addr learned my addr 172.21.15.33:0/2733344741 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc8667fc700 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae20830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc8677fe700 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae277e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 -- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 msgr2=0x562caae277e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae277e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 -- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 msgr2=0x562caae20830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae20830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 -- 172.21.15.33:0/2733344741 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x562caad16780 con 0x562caadf7a50 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc866ffd700 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc860052dc0 tx=0x7fc860071000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3907862155d0a7fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc85cff9700 1 -- 172.21.15.33:0/2733344741 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8600091a0 con 0x562caadf7a50 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc85cff9700 1 -- 172.21.15.33:0/2733344741 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc86005d8b0 con 0x562caadf7a50 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.544+0000 7fc85cff9700 1 -- 172.21.15.33:0/2733344741 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc860057090 con 0x562caadf7a50 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- 172.21.15.33:0/2733344741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 msgr2=0x562caadfad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fc860052dc0 tx=0x7fc860071000 comp rx=0 tx=0).stop 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- 172.21.15.33:0/2733344741 shutdown_connections 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caadf7a50 0x562caadfad40 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caae277e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 --2- 172.21.15.33:0/2733344741 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caae20f60 0x562caae20830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- 172.21.15.33:0/2733344741 >> 172.21.15.33:0/2733344741 conn(0x562caadf9370 msgr2=0x562caadf5b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- 172.21.15.33:0/2733344741 shutdown_connections 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- 172.21.15.33:0/2733344741 wait complete. 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 -- start start 2023-10-09T15:31:18.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.545+0000 7fc876d56b80 1 Processor -- start 2023-10-09T15:31:18.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caadf7a50 0x562caaea08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caadf4710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caae385a0 con 0x562caae20f60 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x562caae36730 con 0x562caadf7a50 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x562caadf60a0 con 0x562caae41d00 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc876d56b80 10 client.0 _ll_register_callbacks cb 0x562caadbb110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc8667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc8667fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53378/0 (socket says 172.21.15.33:53378) 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.546+0000 7fc8667fc700 1 -- 172.21.15.33:0/771644171 learned_addr learned my addr 172.21.15.33:0/771644171 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc866ffd700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caadf7a50 0x562caaea08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8677fe700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caadf4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 -- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 msgr2=0x562caadf4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caadf4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 -- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caadf7a50 msgr2=0x562caaea08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:18.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caadf7a50 0x562caaea08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 -- 172.21.15.33:0/771644171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8680c8640 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8667fc700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc8680caa60 tx=0x7fc850007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b1983b7e3dce18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc850017030 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc85000d660 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc860059b60 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc8500077c0 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 10 client.4671 fetch_fsmap learned FSMap version 8 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x562caacfd470 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc860059b60 con 0x562caae20f60 2023-10-09T15:31:18.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 8) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fc85001f070 con 0x562caae20f60 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 10 client.4671 fetch_fsmap finished waiting for FSMap version 8 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 10 client.4671 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.547+0000 7fc876d56b80 20 client.4671 populate_metadata read hostname 'smithi033' 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caaea3690 0x562caaea3a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 4 client.4671 mds_command: new command op to 4279 tid=0[{"prefix": "status"}] 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 --> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] -- command(tid 0: {"prefix": "status"}) v1 -- 0x562caaceae00 con 0x562caaea3690 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc866ffd700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caaea3690 0x562caaea3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc8457fa700 10 client.4671 ms_handle_connect on v2:172.21.15.59:6832/342703065 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc866ffd700 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caaea3690 0x562caaea3a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b243f49dcdd453b8 server_cookie=d7e57ff0d8d2bc9c in_seq=0 out_seq=0 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc8457fa700 1 -- 172.21.15.33:0/771644171 <== mds.0 v2:172.21.15.59:6832/342703065 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x562caaceae00 con 0x562caaea3690 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc8457fa700 10 client.4671 handle_command_reply: tid=0 2023-10-09T15:31:18.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 client.4671 shutdown 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 msgr2=0x562caadf5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fc8680caa60 tx=0x7fc850007000 comp rx=0 tx=0).stop 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 shutdown_connections 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:6832/342703065,v1:172.21.15.59:6834/342703065] conn(0x562caaea3690 0x562caaea3a60 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x562caae41d00 0x562caadf4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x562caadf7a50 0x562caaea08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 --2- 172.21.15.33:0/771644171 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x562caae20f60 0x562caadf5b60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc8457fa700 0 client.4671 ms_handle_reset on v2:172.21.15.59:6832/342703065 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 >> 172.21.15.33:0/771644171 conn(0x562caadf9370 msgr2=0x562caadf3c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 shutdown_connections 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.548+0000 7fc876d56b80 1 -- 172.21.15.33:0/771644171 wait complete. 2023-10-09T15:31:18.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc876d56b80 20 client.4671 trim_cache size 0 max 16384 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4279, 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 18.888878266999999, 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 8, 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 20, 2023-10-09T15:31:18.557 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 20, 2023-10-09T15:31:18.558 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 26.086541725 2023-10-09T15:31:18.558 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:31:18.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 msgr2=0x7fc8480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 0x7fc8480693e0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc8500058d0 tx=0x7fc850009040 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 msgr2=0x7fc8680c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc86806ea60 tx=0x7fc860017000 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 shutdown_connections 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc848066f30 0x7fc8480693e0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8680cb5a0 0x7fc8680c77c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc86815a5d0 0x7fc86816ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 --2- 172.21.15.33:0/3273761449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8680cd9e0 0x7fc8680c8e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:18.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 >> 172.21.15.33:0/3273761449 conn(0x7fc868070e30 msgr2=0x7fc8680b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:18.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 shutdown_connections 2023-10-09T15:31:18.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:18.549+0000 7fc86da5e700 1 -- 172.21.15.33:0/3273761449 wait complete. 2023-10-09T15:31:18.562 INFO:teuthology.run_tasks:Running task kclient... 2023-10-09T15:31:18.582 INFO:tasks.kclient:Mounting kernel clients... 2023-10-09T15:31:18.583 INFO:tasks.kclient:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-10-09T15:31:18.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.583 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:31:18.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-09T15:31:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2023-10-09T15:31:18.666 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:31:18.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.667 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:31:18.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-09T15:31:18.789 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2023-10-09T15:31:18.790 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:31:18.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.790 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:31:18.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.810 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-09T15:31:18.883 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-10-09T15:31:18.884 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:31:18.885 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.885 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:31:18.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:18.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-09T15:31:19.012 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-10-09T15:31:19.013 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:31:19.013 INFO:tasks.kclient:client.0 config is {'syntax': 'v1'} 2023-10-09T15:31:19.014 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:31:19.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.132+0000 7f7b82974700 1 Processor -- start 2023-10-09T15:31:19.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 -- start start 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7b7c0a8be0 0x7f7b7c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b7c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b7c0ce1a0 con 0x7f7b7c0ae780 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b7c0cd5d0 con 0x7f7b7c0a8be0 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b82974700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0cd870 con 0x7f7b7c06d280 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b80f11700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7b7c0ae780 0x7f7b7c0cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38918/0 (socket says 172.21.15.33:38918) 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.133+0000 7f7b80f11700 1 -- 172.21.15.33:0/2537601873 learned_addr learned my addr 172.21.15.33:0/2537601873 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2247560294 0 0) 0x7f7b7c0ce1a0 con 0x7f7b7c0ae780 2023-10-09T15:31:19.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7bfff700 1 --2- 172.21.15.33:0/2537601873 >> v2:172.21.15.59:3300/0 conn(0x7f7b7c0a8be0 0x7f7b7c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b68003570 con 0x7f7b7c0ae780 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7b7fe700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b7c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1613544325 0 0) 0x7f7b68003570 con 0x7f7b7c0ae780 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 msgr2=0x7f7b7c0b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b7c0b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 >> v2:172.21.15.59:3300/0 conn(0x7f7b7c0a8be0 msgr2=0x7f7b7c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 --2- 172.21.15.33:0/2537601873 >> v2:172.21.15.59:3300/0 conn(0x7f7b7c0a8be0 0x7f7b7c0a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c0cdb50 con 0x7f7b7c0ae780 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f7b740017f0 con 0x7f7b7c0ae780 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 >> v1:172.21.15.33:6789/0 conn(0x7f7b7c0ae780 legacy=0x7f7b7c0cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68003ae0 0x7f7b68003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b68004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b68004d50 0x7f7b680051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0cd5d0 con 0x7f7b68004d50 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0cd870 con 0x7f7b68003ae0 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b6800bb40 con 0x7f7b7c06d280 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b80f11700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b68004d50 0x7f7b680051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7bfff700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68003ae0 0x7f7b68003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.134+0000 7f7b7b7fe700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b68004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 -- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 msgr2=0x7f7b68004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c06d280 0x7f7b68004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 -- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68003ae0 msgr2=0x7f7b68003ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68003ae0 0x7f7b68003ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 -- 172.21.15.33:0/2537601873 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b68003570 con 0x7f7b68004d50 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b68004d50 0x7f7b680051c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a8a0 tx=0x7f7b74002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1aa95619dc028e84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b740070f0 con 0x7f7b68004d50 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b74007270 con 0x7f7b68004d50 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b7affd700 1 -- 172.21.15.33:0/2537601873 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b74007630 con 0x7f7b68004d50 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 -- 172.21.15.33:0/2537601873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b68004d50 msgr2=0x7f7b680051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 --2- 172.21.15.33:0/2537601873 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b68004d50 0x7f7b680051c0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f7b7400a8a0 tx=0x7f7b74002140 comp rx=0 tx=0).stop 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b80f11700 1 -- 172.21.15.33:0/2537601873 reap_dead start 2023-10-09T15:31:19.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 -- 172.21.15.33:0/2537601873 shutdown_connections 2023-10-09T15:31:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 -- 172.21.15.33:0/2537601873 >> 172.21.15.33:0/2537601873 conn(0x7f7b7c06ce80 msgr2=0x7f7b7c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 -- 172.21.15.33:0/2537601873 shutdown_connections 2023-10-09T15:31:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.135+0000 7f7b82974700 1 -- 172.21.15.33:0/2537601873 wait complete. 2023-10-09T15:31:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.136+0000 7f7b82974700 1 Processor -- start 2023-10-09T15:31:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 -- start start 2023-10-09T15:31:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68004d50 0x7f7b7c0abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c09b0d0 0x7f7b7c09b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0acec0 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c09ba80 con 0x7f7b68004d50 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.137+0000 7f7b82974700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b7c0a9da0 con 0x7f7b7c09b0d0 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53396/0 (socket says 172.21.15.33:53396) 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 -- 172.21.15.33:0/1109830194 learned_addr learned my addr 172.21.15.33:0/1109830194 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7bfff700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68004d50 0x7f7b7c0abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b80f11700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c09b0d0 0x7f7b7c09b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 -- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c09b0d0 msgr2=0x7f7b7c09b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c09b0d0 0x7f7b7c09b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 -- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68004d50 msgr2=0x7f7b7c0abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68004d50 0x7f7b7c0abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 -- 172.21.15.33:0/1109830194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b7c15a860 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b7b7fe700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b64011b10 tx=0x7f7b64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b64005c10 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b64005d70 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b7c0a9190 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b6400f980 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.138+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b7c0a9750 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.139+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b7c0a9ee0 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.140+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f7b6400fd70 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.140+0000 7f7b73fff700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 0x7f7b5c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.140+0000 7f7b7bfff700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 0x7f7b5c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.140+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b64084e50 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.140+0000 7f7b7bfff700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 0x7f7b5c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0090f0 tx=0x7f7b6c009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:19.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.144+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b7c0a9ee0 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.388+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7b7c0a9ee0 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.388+0000 7f7b73fff700 1 -- 172.21.15.33:0/1109830194 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7b7c0a9ee0 con 0x7f7b7c15a3f0 2023-10-09T15:31:19.389 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:31:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 msgr2=0x7f7b5c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 0x7f7b5c0693e0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7b6c0090f0 tx=0x7f7b6c009120 comp rx=0 tx=0).stop 2023-10-09T15:31:19.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 msgr2=0x7f7b7c0ac980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f7b64011b10 tx=0x7f7b64009120 comp rx=0 tx=0).stop 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 shutdown_connections 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b5c066f30 0x7f7b5c0693e0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b7c09b0d0 0x7f7b7c09b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b68004d50 0x7f7b7c0abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 --2- 172.21.15.33:0/1109830194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b7c15a3f0 0x7f7b7c0ac980 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 >> 172.21.15.33:0/1109830194 conn(0x7f7b7c06ce80 msgr2=0x7f7b7c0ca820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 shutdown_connections 2023-10-09T15:31:19.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:19.390+0000 7f7b82974700 1 -- 172.21.15.33:0/1109830194 wait complete. 2023-10-09T15:31:19.403 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T15:31:19.403 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:31:19.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:31:19.403 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:31:19.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:31:19.404 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T15:31:19.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T15:31:19.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:31:19.404 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:31:19.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.404 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:31:19.419 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:19.419 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:31:19.420 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:19.422 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:19.422 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:31:19.422 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:31:19.422 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:19.422 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42408sec preferred_lft 42408sec 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:19.423 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:19.424 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:31:19.424 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T15:31:19.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add name ceph-brx type bridge 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr flush dev ceph-brx 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set ceph-brx up 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T15:31:19.425 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:19.581 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.581 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:31:19.625 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:31:19.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.626 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:31:19.692 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:31:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:31:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:31:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:31:19.693 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:31:19.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:31:19.694 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:19.967 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.967 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:31:19.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:19.982 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2023-10-09T15:31:20.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:20.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:20.037 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:20.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:31:20.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-10-09T15:31:20.037 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:20.128 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-10-09T15:31:20.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:20.128 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:20.128 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-10-09T15:31:20.129 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:20.323 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:20.323 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:20.323 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:20.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:31:20.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T15:31:20.323 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:20.417 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:20.417 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:31:20.432 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:31:20.433 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:20.433 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:31:20.487 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:31:20.487 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:31:20.487 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:31:20.580 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:31:20.580 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:31:20.580 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:20.670 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:31:20.670 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:31:20.670 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:20.670 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:20.670 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:20.694 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:31:20.695 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:31:20.695 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:31:20.697 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:31:20.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:20.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:31:20.722 INFO:tasks.kclient:client.2 config is {'syntax': 'v1'} 2023-10-09T15:31:20.722 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:31:20.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.880+0000 7f9688a63700 1 Processor -- start 2023-10-09T15:31:20.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.880+0000 7f9688a63700 1 -- start start 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9688a63700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96840cb5a0 0x7f96840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9688a63700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f968415a5d0 0x7f9684156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9688a63700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f968415ae40 con 0x7f96840cd9e0 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9688a63700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96840d13f0 con 0x7f968415a5d0 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9688a63700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f968415ab60 con 0x7f96840cb5a0 2023-10-09T15:31:20.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f968415a5d0 0x7f9684156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f968415a5d0 0x7f9684156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36946/0 (socket says 172.21.15.33:36946) 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 -- 172.21.15.33:0/3558875802 learned_addr learned my addr 172.21.15.33:0/3558875802 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f968259c700 1 --2- 172.21.15.33:0/3558875802 >> v2:172.21.15.59:3300/0 conn(0x7f96840cb5a0 0x7f96840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 -- 172.21.15.33:0/3558875802 >> v2:172.21.15.59:3300/0 conn(0x7f96840cb5a0 msgr2=0x7f96840cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 --2- 172.21.15.33:0/3558875802 >> v2:172.21.15.59:3300/0 conn(0x7f96840cb5a0 0x7f96840cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 -- 172.21.15.33:0/3558875802 >> v1:172.21.15.59:6789/0 conn(0x7f96840cd9e0 legacy=0x7f9684159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 -- 172.21.15.33:0/3558875802 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96840ccf00 con 0x7f968415a5d0 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.881+0000 7f9682d9d700 1 --2- 172.21.15.33:0/3558875802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968415a5d0 0x7f9684156e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96740099b0 tx=0x7f9674009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c82bc67c46f5a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f968159a700 1 -- 172.21.15.33:0/3558875802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400b7e0 con 0x7f968415a5d0 2023-10-09T15:31:20.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f968159a700 1 -- 172.21.15.33:0/3558875802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967400b940 con 0x7f968415a5d0 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f968159a700 1 -- 172.21.15.33:0/3558875802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967400bce0 con 0x7f968415a5d0 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 -- 172.21.15.33:0/3558875802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968415a5d0 msgr2=0x7f9684156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 --2- 172.21.15.33:0/3558875802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968415a5d0 0x7f9684156e90 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f96740099b0 tx=0x7f9674009250 comp rx=0 tx=0).stop 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 -- 172.21.15.33:0/3558875802 shutdown_connections 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 --2- 172.21.15.33:0/3558875802 >> v2:172.21.15.59:3300/0 conn(0x7f96840cb5a0 0x7f96840cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 --2- 172.21.15.33:0/3558875802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f968415a5d0 0x7f9684156e90 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 -- 172.21.15.33:0/3558875802 >> 172.21.15.33:0/3558875802 conn(0x7f9684070e30 msgr2=0x7f96840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 -- 172.21.15.33:0/3558875802 shutdown_connections 2023-10-09T15:31:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.882+0000 7f9688a63700 1 -- 172.21.15.33:0/3558875802 wait complete. 2023-10-09T15:31:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.883+0000 7f9688a63700 1 Processor -- start 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.883+0000 7f9688a63700 1 -- start start 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96840cd9e0 0x7f96840c7e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f968415a5d0 0x7f96840c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840ca750 con 0x7f96840cb5a0 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96840c79f0 con 0x7f96840cd9e0 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9688a63700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96841520e0 con 0x7f968415a5d0 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f968259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f968259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36954/0 (socket says 172.21.15.33:36954) 2023-10-09T15:31:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f968259c700 1 -- 172.21.15.33:0/4294743934 learned_addr learned my addr 172.21.15.33:0/4294743934 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9681d9b700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96840cd9e0 0x7f96840c7e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.884+0000 7f9682d9d700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f968415a5d0 0x7f96840c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 -- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f968415a5d0 msgr2=0x7f96840c8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f968415a5d0 0x7f96840c8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 -- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96840cd9e0 msgr2=0x7f96840c7e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96840cd9e0 0x7f96840c7e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 -- 172.21.15.33:0/4294743934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96740094f0 con 0x7f96840cb5a0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f968259c700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e190 tx=0x7f967c009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c00ee30 con 0x7f96840cb5a0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f967c014420 con 0x7f96840cb5a0 2023-10-09T15:31:20.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96840c9bd0 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f967c0147e0 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.885+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96840ca190 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.886+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96840cbcf0 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.886+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f967c014b90 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.887+0000 7f967a7fc700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 0x7f96640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.887+0000 7f9681d9b700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 0x7f96640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.887+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f967c084d60 con 0x7f96840cb5a0 2023-10-09T15:31:20.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.887+0000 7f9681d9b700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 0x7f96640693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96840afbb0 tx=0x7f966c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:20.891+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f967c051fd0 con 0x7f96840cb5a0 2023-10-09T15:31:21.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.134+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f968404c3c0 con 0x7f96840cb5a0 2023-10-09T15:31:21.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.134+0000 7f967a7fc700 1 -- 172.21.15.33:0/4294743934 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f967c009a60 con 0x7f96840cb5a0 2023-10-09T15:31:21.135 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:31:21.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 msgr2=0x7f96640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:21.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 0x7f96640693e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f96840afbb0 tx=0x7f966c009040 comp rx=0 tx=0).stop 2023-10-09T15:31:21.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 msgr2=0x7f9684151ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:21.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f967c00e190 tx=0x7f967c009920 comp rx=0 tx=0).stop 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 shutdown_connections 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9664066f30 0x7f96640693e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96840cb5a0 0x7f9684151ba0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f968415a5d0 0x7f96840c8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 --2- 172.21.15.33:0/4294743934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96840cd9e0 0x7f96840c7e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 >> 172.21.15.33:0/4294743934 conn(0x7f9684070e30 msgr2=0x7f96840b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 shutdown_connections 2023-10-09T15:31:21.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:21.136+0000 7f9688a63700 1 -- 172.21.15.33:0/4294743934 wait complete. 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-10-09T15:31:21.149 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T15:31:21.150 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T15:31:21.150 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:31:21.150 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-10-09T15:31:21.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.150 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:31:21.165 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:21.165 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:31:21.166 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42406sec preferred_lft 42406sec 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:31:21.167 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link tentative 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.168 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:31:21.229 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:31:21.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.231 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:31:21.287 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:31:21.287 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:31:21.288 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:31:21.288 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:31:21.288 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:31:21.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.288 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:21.288 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:21.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:31:21.288 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:31:21.289 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:31:21.289 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:21.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.391 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:31:21.405 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:31:21.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.406 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list-id 2023-10-09T15:31:21.461 INFO:teuthology.orchestra.run.smithi033.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-10-09T15:31:21.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:21.462 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:21.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:31:21.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-10-09T15:31:21.462 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:21.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.552 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T15:31:21.584 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:21.584 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5a:40:b9:e1:ab:20 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::5840:b9ff:fee1:ab20/64 scope link 2023-10-09T15:31:21.585 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.602 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-10-09T15:31:21.678 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:21.678 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 5a:40:b9:e1:ab:20 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::5840:b9ff:fee1:ab20/64 scope link 2023-10-09T15:31:21.679 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:21.690 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-10-09T15:31:21.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.690 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:21.690 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-10-09T15:31:21.691 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:21.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:21.910 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:31:21.910 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:31:21.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.1 up 2023-10-09T15:31:21.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T15:31:21.911 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:31:21.992 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:21.992 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-10-09T15:31:22.007 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-10-09T15:31:22.007 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:22.007 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-10-09T15:31:22.061 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:31:22.062 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:31:22.062 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.2 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-09T15:31:22.142 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-09T15:31:22.142 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-09T15:31:22.143 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:22.151 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-09T15:31:22.151 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-09T15:31:22.151 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:22.151 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:22.151 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=2,mds_namespace=cephfs 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs". 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:31:22.174 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:31:22.175 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=2,mds_namespace=cephfs,key=2,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:31:22.176 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:31:22.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.176 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-10-09T15:31:22.242 INFO:tasks.kclient:client.1 config is {'syntax': 'v1'} 2023-10-09T15:31:22.242 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:31:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.400+0000 7f50ee5d5700 1 Processor -- start 2023-10-09T15:31:22.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.400+0000 7f50ee5d5700 1 -- start start 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ee5d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ee5d5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50e80cde50 0x7f50e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ee5d5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50e815ae40 con 0x7f50e80cd9e0 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ee5d5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50e80d13f0 con 0x7f50e80cde50 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ee5d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815ab60 con 0x7f50e80cb5a0 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ecb72700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50e80cde50 0x7f50e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50e77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f50e80cd9e0 0x7f50e8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48326/0 (socket says 172.21.15.33:48326) 2023-10-09T15:31:22.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50e77fe700 1 -- 172.21.15.33:0/2971123312 learned_addr learned my addr 172.21.15.33:0/2971123312 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.401+0000 7f50ecb72700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50e80cde50 0x7f50e8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36968/0 (socket says 172.21.15.33:36968) 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ecb72700 1 -- 172.21.15.33:0/2971123312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 msgr2=0x7f50e80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50e7fff700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ecb72700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ecb72700 1 -- 172.21.15.33:0/2971123312 >> v1:172.21.15.33:6789/0 conn(0x7f50e80cd9e0 legacy=0x7f50e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50e6ffd700 1 -- 172.21.15.33:0/2971123312 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356410933 0 0) 0x7f50e815ae40 con 0x7f50e80cd9e0 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ecb72700 1 -- 172.21.15.33:0/2971123312 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e80ccf00 con 0x7f50e80cde50 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ecb72700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cde50 0x7f50e8156e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009e60 tx=0x7f50e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a82ee8689e812d0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50e6ffd700 1 -- 172.21.15.33:0/2971123312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e000e070 con 0x7f50e80cde50 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50e6ffd700 1 -- 172.21.15.33:0/2971123312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50e000bc30 con 0x7f50e80cde50 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50e6ffd700 1 -- 172.21.15.33:0/2971123312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50e0012430 con 0x7f50e80cde50 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ee5d5700 1 -- 172.21.15.33:0/2971123312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cde50 msgr2=0x7f50e8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.402+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cde50 0x7f50e8156e90 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009e60 tx=0x7f50e0009780 comp rx=0 tx=0).stop 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 -- 172.21.15.33:0/2971123312 shutdown_connections 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cde50 0x7f50e8156e90 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/2971123312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 -- 172.21.15.33:0/2971123312 >> 172.21.15.33:0/2971123312 conn(0x7f50e8070e30 msgr2=0x7f50e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 -- 172.21.15.33:0/2971123312 shutdown_connections 2023-10-09T15:31:22.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.403+0000 7f50ee5d5700 1 -- 172.21.15.33:0/2971123312 wait complete. 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.404+0000 7f50ee5d5700 1 Processor -- start 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.404+0000 7f50ee5d5700 1 -- start start 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.404+0000 7f50ee5d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e815c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 0x7f50e8158e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e80c7cc0 con 0x7f50e80cd9e0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50e815cdd0 con 0x7f50e81589f0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50e81691b0 con 0x7f50e80cb5a0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36970/0 (socket says 172.21.15.33:36970) 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 -- 172.21.15.33:0/238058019 learned_addr learned my addr 172.21.15.33:0/238058019 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e7fff700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e815c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ecb72700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 0x7f50e8158e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 -- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 msgr2=0x7f50e815c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e815c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 -- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 msgr2=0x7f50e8158e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 0x7f50e8158e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 -- 172.21.15.33:0/238058019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50e0009a20 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ecb72700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 0x7f50e8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50e77fe700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c7e0 tx=0x7f50d0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0005b30 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50d0005c90 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50d0007300 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50e815d080 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.405+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50e815d640 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.406+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50e80c7e70 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.407+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50d00076b0 con 0x7f50e80cd9e0 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.407+0000 7f50dffff700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:22.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.407+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50d0083a90 con 0x7f50e80cd9e0 2023-10-09T15:31:22.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.407+0000 7f50e7fff700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:22.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.408+0000 7f50e7fff700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50e80cbe40 tx=0x7f50d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:22.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.411+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50e80c7e70 con 0x7f50e80cd9e0 2023-10-09T15:31:22.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.649+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f50e804c3c0 con 0x7f50e80cd9e0 2023-10-09T15:31:22.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.650+0000 7f50dffff700 1 -- 172.21.15.33:0/238058019 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f50d0017070 con 0x7f50e80cd9e0 2023-10-09T15:31:22.651 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 msgr2=0x7f50c80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 0x7f50c80693e0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f50e80cbe40 tx=0x7f50d8008040 comp rx=0 tx=0).stop 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 msgr2=0x7f50e815c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f50d000c7e0 tx=0x7f50d0007df0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 shutdown_connections 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f50c8066f30 0x7f50c80693e0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50e81589f0 0x7f50e8158e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50e80cb5a0 0x7f50e815c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 --2- 172.21.15.33:0/238058019 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50e80cd9e0 0x7f50e815c890 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:22.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 >> 172.21.15.33:0/238058019 conn(0x7f50e8070e30 msgr2=0x7f50e80b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:22.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 shutdown_connections 2023-10-09T15:31:22.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:22.652+0000 7f50ee5d5700 1 -- 172.21.15.33:0/238058019 wait complete. 2023-10-09T15:31:22.665 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T15:31:22.665 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:31:22.666 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:31:22.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.666 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:31:22.684 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:22.685 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42413sec preferred_lft 42413sec 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:22.686 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:31:22.686 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-10-09T15:31:22.687 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add name ceph-brx type bridge 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr flush dev ceph-brx 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set ceph-brx up 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-10-09T15:31:22.687 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:22.865 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.865 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:31:22.912 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:31:22.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.914 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:31:22.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:31:22.951 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:23.207 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.207 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:31:23.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.223 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-09T15:31:23.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.277 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:23.277 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:23.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:31:23.277 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-10-09T15:31:23.278 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:23.370 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-10-09T15:31:23.370 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-10-09T15:31:23.371 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:23.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.564 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:23.565 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:23.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:31:23.565 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.0 master ceph-brx 2023-10-09T15:31:23.565 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:23.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:23.658 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:31:23.673 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:31:23.674 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:23.674 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:31:23.728 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:31:23.728 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:31:23.728 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:31:23.824 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:31:23.824 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:31:23.824 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:23.901 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:31:23.901 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:31:23.901 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:23.901 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:23.901 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:31:23.923 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:31:23.924 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:31:23.927 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:31:23.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:23.927 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:31:23.952 INFO:tasks.kclient:client.3 config is {'syntax': 'v1'} 2023-10-09T15:31:23.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:31:24.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.084+0000 7ff68109f700 1 Processor -- start 2023-10-09T15:31:24.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.084+0000 7ff68109f700 1 -- start start 2023-10-09T15:31:24.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff68109f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff67c0cb970 0x7ff67c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff68109f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 0x7ff67c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff68109f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff67c15ae40 con 0x7ff67c0cb5a0 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff68109f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0ce0f0 con 0x7ff67c0cb970 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff68109f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff67c0d13f0 con 0x7ff67c15a400 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff67ad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff67c0cb5a0 0x7ff67c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48338/0 (socket says 172.21.15.33:48338) 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff67ad9d700 1 -- 172.21.15.33:0/2319626622 learned_addr learned my addr 172.21.15.33:0/2319626622 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.085+0000 7ff67a59c700 1 --2- 172.21.15.33:0/2319626622 >> v2:172.21.15.33:3300/0 conn(0x7ff67c0cb970 0x7ff67c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67b59e700 1 --2- 172.21.15.33:0/2319626622 >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 0x7ff67c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff679d9b700 1 -- 172.21.15.33:0/2319626622 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2236235733 0 0) 0x7ff67c15ae40 con 0x7ff67c0cb5a0 2023-10-09T15:31:24.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff679d9b700 1 -- 172.21.15.33:0/2319626622 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff668003570 con 0x7ff67c0cb5a0 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67a59c700 1 -- 172.21.15.33:0/2319626622 >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 msgr2=0x7ff67c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67a59c700 1 --2- 172.21.15.33:0/2319626622 >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 0x7ff67c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67a59c700 1 -- 172.21.15.33:0/2319626622 >> v1:172.21.15.33:6789/0 conn(0x7ff67c0cb5a0 legacy=0x7ff67c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67a59c700 1 -- 172.21.15.33:0/2319626622 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff67c15ab60 con 0x7ff67c0cb970 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67b59e700 1 --2- 172.21.15.33:0/2319626622 >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 0x7ff67c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff67a59c700 1 --2- 172.21.15.33:0/2319626622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c159ec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0ccdf0 tx=0x7ff6640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5459166df8a4c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff679d9b700 1 -- 172.21.15.33:0/2319626622 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011630 con 0x7ff67c0cb970 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff679d9b700 1 -- 172.21.15.33:0/2319626622 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff664011790 con 0x7ff67c0cb970 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff679d9b700 1 -- 172.21.15.33:0/2319626622 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011b30 con 0x7ff67c0cb970 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff68109f700 1 -- 172.21.15.33:0/2319626622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 msgr2=0x7ff67c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.086+0000 7ff68109f700 1 --2- 172.21.15.33:0/2319626622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c159ec0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7ff67c0ccdf0 tx=0x7ff6640091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 -- 172.21.15.33:0/2319626622 shutdown_connections 2023-10-09T15:31:24.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 --2- 172.21.15.33:0/2319626622 >> v2:172.21.15.59:3300/0 conn(0x7ff67c15a400 0x7ff67c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 --2- 172.21.15.33:0/2319626622 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c159ec0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 -- 172.21.15.33:0/2319626622 >> 172.21.15.33:0/2319626622 conn(0x7ff67c070e30 msgr2=0x7ff67c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:24.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 -- 172.21.15.33:0/2319626622 shutdown_connections 2023-10-09T15:31:24.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.087+0000 7ff68109f700 1 -- 172.21.15.33:0/2319626622 wait complete. 2023-10-09T15:31:24.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.088+0000 7ff68109f700 1 Processor -- start 2023-10-09T15:31:24.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.088+0000 7ff68109f700 1 -- start start 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 0x7ff67c168d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c15a400 0x7ff67c0b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c87b0 con 0x7ff67c0cb970 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0b3c30 con 0x7ff67c15a400 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff67c0c84d0 con 0x7ff67c0cb5a0 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36986/0 (socket says 172.21.15.33:36986) 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 -- 172.21.15.33:0/1764524143 learned_addr learned my addr 172.21.15.33:0/1764524143 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67b59e700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c15a400 0x7ff67c0b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67ad9d700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 0x7ff67c168d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 -- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 msgr2=0x7ff67c168d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 0x7ff67c168d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 -- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c15a400 msgr2=0x7ff67c0b0fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c15a400 0x7ff67c0b0fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 -- 172.21.15.33:0/1764524143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff664009420 con 0x7ff67c0cb970 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67ad9d700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 0x7ff67c168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff67a59c700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff67c06ea60 tx=0x7ff664017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664011b10 con 0x7ff67c0cb970 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6640233f0 con 0x7ff67c0cb970 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff664023790 con 0x7ff67c0cb970 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff67c0b35e0 con 0x7ff67c0cb970 2023-10-09T15:31:24.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.089+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff67c169290 con 0x7ff67c0cb970 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.090+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff67c04c3c0 con 0x7ff67c0cb970 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.091+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff6640193b0 con 0x7ff67c0cb970 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.091+0000 7ff672ffd700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.091+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff664085a80 con 0x7ff67c0cb970 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.091+0000 7ff67ad9d700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:24.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.092+0000 7ff67ad9d700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 0x7ff65c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff674005c50 tx=0x7ff674009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:24.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.095+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff664052cf0 con 0x7ff67c0cb970 2023-10-09T15:31:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.337+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff67c0ccf00 con 0x7ff67c0cb970 2023-10-09T15:31:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.337+0000 7ff672ffd700 1 -- 172.21.15.33:0/1764524143 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff664028070 con 0x7ff67c0cb970 2023-10-09T15:31:24.338 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:31:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 msgr2=0x7ff65c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 0x7ff65c0693e0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7ff674005c50 tx=0x7ff674009040 comp rx=0 tx=0).stop 2023-10-09T15:31:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 msgr2=0x7ff67c0b0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff67c06ea60 tx=0x7ff664017000 comp rx=0 tx=0).stop 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 shutdown_connections 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff65c066f30 0x7ff65c0693e0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff67c15a400 0x7ff67c0b0fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff67c0cb5a0 0x7ff67c168d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 --2- 172.21.15.33:0/1764524143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff67c0cb970 0x7ff67c0b0aa0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 >> 172.21.15.33:0/1764524143 conn(0x7ff67c070e30 msgr2=0x7ff67c0c6f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 shutdown_connections 2023-10-09T15:31:24.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:24.339+0000 7ff68109f700 1 -- 172.21.15.33:0/1764524143 wait complete. 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-10-09T15:31:24.352 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:31:24.353 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-10-09T15:31:24.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.353 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:24.369 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42411sec preferred_lft 42411sec 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.370 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link tentative 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.371 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:31:24.372 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:31:24.372 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link tentative 2023-10-09T15:31:24.372 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.372 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:31:24.434 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:31:24.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.436 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:31:24.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.492 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:24.493 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:24.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:31:24.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:31:24.493 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:31:24.493 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:24.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.596 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:31:24.611 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:31:24.611 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.611 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list-id 2023-10-09T15:31:24.666 INFO:teuthology.orchestra.run.smithi059.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-10-09T15:31:24.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.666 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:24.667 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:24.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:31:24.667 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-10-09T15:31:24.667 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:24.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.756 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T15:31:24.792 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether e6:7e:59:e7:f3:0c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::e47e:59ff:fee7:f30c/64 scope link tentative 2023-10-09T15:31:24.793 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-10-09T15:31:24.887 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:31:24.887 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether e6:7e:59:e7:f3:0c brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::e47e:59ff:fee7:f30c/64 scope link tentative 2023-10-09T15:31:24.888 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:31:24.900 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-10-09T15:31:24.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:24.900 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:24.900 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:24.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-10-09T15:31:24.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-10-09T15:31:24.900 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-10-09T15:31:24.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-10-09T15:31:24.901 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-10-09T15:31:24.901 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:25.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:25.131 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:31:25.131 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:31:25.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.1 up 2023-10-09T15:31:25.132 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set dev brx.1 master ceph-brx 2023-10-09T15:31:25.132 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:31:25.213 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:25.213 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-10-09T15:31:25.227 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-10-09T15:31:25.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:31:25.228 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-10-09T15:31:25.282 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:31:25.282 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:31:25.283 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.3 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-09T15:31:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-09T15:31:25.364 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-09T15:31:25.365 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:25.373 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-09T15:31:25.373 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-09T15:31:25.373 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:25.373 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:25.374 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=3,mds_namespace=cephfs 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs". 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:31:25.395 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:31:25.396 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=3,mds_namespace=cephfs,key=3,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:31:25.397 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:31:25.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:25.398 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-10-09T15:31:25.463 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-10-09T15:31:25.483 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:25.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.614+0000 7f07e5774700 1 Processor -- start 2023-10-09T15:31:25.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.614+0000 7f07e5774700 1 -- start start 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07e5774700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e00cb970 0x7f07e0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07e5774700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07e015a400 0x7f07e0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07e5774700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07e015ae40 con 0x7f07e00cb5a0 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07e5774700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07e00ce0f0 con 0x7f07e015a400 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07e5774700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00cbde0 con 0x7f07e00cb970 2023-10-09T15:31:25.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.615+0000 7f07df7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07e015a400 0x7f07e0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f07e015a400 0x7f07e0156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36994/0 (socket says 172.21.15.33:36994) 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 -- 172.21.15.33:0/2413781156 learned_addr learned my addr 172.21.15.33:0/2413781156 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07de7fc700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e00cb970 0x7f07e0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 -- 172.21.15.33:0/2413781156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e00cb970 msgr2=0x7f07e0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e00cb970 0x7f07e0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 -- 172.21.15.33:0/2413781156 >> v1:172.21.15.59:6789/0 conn(0x7f07e00cb5a0 legacy=0x7f07e00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 -- 172.21.15.33:0/2413781156 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07e015ab60 con 0x7f07e015a400 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07df7fe700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e015a400 0x7f07e0156e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009f50 tx=0x7f07d8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff521f34d3b8fc5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07ddffb700 1 -- 172.21.15.33:0/2413781156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d800e070 con 0x7f07e015a400 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07ddffb700 1 -- 172.21.15.33:0/2413781156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d800b9c0 con 0x7f07e015a400 2023-10-09T15:31:25.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.616+0000 7f07ddffb700 1 -- 172.21.15.33:0/2413781156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d80092e0 con 0x7f07e015a400 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 -- 172.21.15.33:0/2413781156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e015a400 msgr2=0x7f07e0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e015a400 0x7f07e0156e90 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f07d8009f50 tx=0x7f07d8009840 comp rx=0 tx=0).stop 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 -- 172.21.15.33:0/2413781156 shutdown_connections 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e015a400 0x7f07e0156e90 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 --2- 172.21.15.33:0/2413781156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e00cb970 0x7f07e0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 -- 172.21.15.33:0/2413781156 >> 172.21.15.33:0/2413781156 conn(0x7f07e0070e30 msgr2=0x7f07e00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:25.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 -- 172.21.15.33:0/2413781156 shutdown_connections 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.617+0000 7f07e5774700 1 -- 172.21.15.33:0/2413781156 wait complete. 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.618+0000 7f07e5774700 1 Processor -- start 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.618+0000 7f07e5774700 1 -- start start 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 0x7f07e016a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e015a400 0x7f07e00c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00b5950 con 0x7f07e00cb5a0 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07e016a890 con 0x7f07e00cb970 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07e5774700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07e00b4d40 con 0x7f07e015a400 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37000/0 (socket says 172.21.15.33:37000) 2023-10-09T15:31:25.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 -- 172.21.15.33:0/2435542382 learned_addr learned my addr 172.21.15.33:0/2435542382 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07df7fe700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e015a400 0x7f07e00c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07de7fc700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 0x7f07e016a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 -- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e015a400 msgr2=0x7f07e00c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e015a400 0x7f07e00c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 -- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 msgr2=0x7f07e016a350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 0x7f07e016a350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 -- 172.21.15.33:0/2435542382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07d8009ae0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07de7fc700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 0x7f07e016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.619+0000 7f07deffd700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c510 tx=0x7f07d000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.620+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011590 con 0x7f07e00cb5a0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.620+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07d0011710 con 0x7f07e00cb5a0 2023-10-09T15:31:25.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.620+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07e00b5020 con 0x7f07e00cb5a0 2023-10-09T15:31:25.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.620+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07d0011ad0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.620+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07e00b55e0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.621+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07e004c3c0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.621+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f07d001b3b0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.621+0000 7f07c6ffd700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.621+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f07d0083a60 con 0x7f07e00cb5a0 2023-10-09T15:31:25.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.621+0000 7f07de7fc700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.622+0000 7f07de7fc700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 0x7f07cc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e00c9920 tx=0x7f07d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.626+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f07d0050cd0 con 0x7f07e00cb5a0 2023-10-09T15:31:25.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.820+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f07e00b5c30 con 0x7f07e00cb5a0 2023-10-09T15:31:25.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.821+0000 7f07c6ffd700 1 -- 172.21.15.33:0/2435542382 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f07d0017070 con 0x7f07e00cb5a0 2023-10-09T15:31:25.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:25.822 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:25.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 msgr2=0x7f07cc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 0x7f07cc0693e0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f07e00c9920 tx=0x7f07d4008040 comp rx=0 tx=0).stop 2023-10-09T15:31:25.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 msgr2=0x7f07e00b46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f07d000c510 tx=0x7f07d000c8d0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 shutdown_connections 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07cc066f30 0x7f07cc0693e0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f07e00cb5a0 0x7f07e00b46a0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f07e015a400 0x7f07e00c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 --2- 172.21.15.33:0/2435542382 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f07e00cb970 0x7f07e016a350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 >> 172.21.15.33:0/2435542382 conn(0x7f07e0070e30 msgr2=0x7f07e00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 shutdown_connections 2023-10-09T15:31:25.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.823+0000 7f07e5774700 1 -- 172.21.15.33:0/2435542382 wait complete. 2023-10-09T15:31:25.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:25.836 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:25.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.958+0000 7f84c8f9b700 1 Processor -- start 2023-10-09T15:31:25.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.958+0000 7f84c8f9b700 1 -- start start 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.958+0000 7f84c8f9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84c40cc320 0x7f84c413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c8f9b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c406d7b0 con 0x7f84c406a110 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c8f9b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84c406e330 con 0x7f84c40cc6f0 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c8f9b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84c406a570 con 0x7f84c40cc320 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84c40cc320 0x7f84c413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c2d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f84c406a110 0x7f84c406e7c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48344/0 (socket says 172.21.15.33:48344) 2023-10-09T15:31:25.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c2d9d700 1 -- 172.21.15.33:0/4236839933 learned_addr learned my addr 172.21.15.33:0/4236839933 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 743562947 0 0) 0x7f84c406d7b0 con 0x7f84c406a110 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84b0003570 con 0x7f84c406a110 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1534601991 0 0) 0x7f84c406e330 con 0x7f84c40cc6f0 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c259c700 1 -- 172.21.15.33:0/4236839933 >> v1:172.21.15.59:6789/0 conn(0x7f84c40cc6f0 legacy=0x7f84c4069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c259c700 1 -- 172.21.15.33:0/4236839933 >> v1:172.21.15.33:6789/0 conn(0x7f84c406a110 legacy=0x7f84c406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c259c700 1 -- 172.21.15.33:0/4236839933 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84c406da00 con 0x7f84c40cc320 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c259c700 1 --2- 172.21.15.33:0/4236839933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c413c2a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009e60 tx=0x7f84bc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29814b2da8d8b186 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.959+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc00e070 con 0x7f84c40cc320 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84bc00bb60 con 0x7f84c40cc320 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c159a700 1 -- 172.21.15.33:0/4236839933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84bc012430 con 0x7f84c40cc320 2023-10-09T15:31:25.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 -- 172.21.15.33:0/4236839933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 msgr2=0x7f84c413c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/4236839933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c413c2a0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f84bc009e60 tx=0x7f84bc009780 comp rx=0 tx=0).stop 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 -- 172.21.15.33:0/4236839933 shutdown_connections 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/4236839933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c413c2a0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 -- 172.21.15.33:0/4236839933 >> 172.21.15.33:0/4236839933 conn(0x7f84c4067f00 msgr2=0x7f84c4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 -- 172.21.15.33:0/4236839933 shutdown_connections 2023-10-09T15:31:25.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.960+0000 7f84c8f9b700 1 -- 172.21.15.33:0/4236839933 wait complete. 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.961+0000 7f84c8f9b700 1 Processor -- start 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.961+0000 7f84c8f9b700 1 -- start start 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84c406a110 0x7f84c416ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c40cc6f0 0x7f84c40c7c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c4169c50 con 0x7f84c40cc320 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40c5990 con 0x7f84c40cc6f0 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c8f9b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84c40c5c70 con 0x7f84c406a110 2023-10-09T15:31:25.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37030/0 (socket says 172.21.15.33:37030) 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 -- 172.21.15.33:0/1007299247 learned_addr learned my addr 172.21.15.33:0/1007299247 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c259c700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84c406a110 0x7f84c416ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c2d9d700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c40cc6f0 0x7f84c40c7c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 -- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84c406a110 msgr2=0x7f84c416ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84c406a110 0x7f84c416ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 -- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c40cc6f0 msgr2=0x7f84c40c7c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c40cc6f0 0x7f84c40c7c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.962+0000 7f84c1d9b700 1 -- 172.21.15.33:0/1007299247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84bc009a20 con 0x7f84c40cc320 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84c1d9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c530 tx=0x7f84ac00c840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011590 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84ac011710 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c40c5f50 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84ac011ad0 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.963+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84c416b360 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.964+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84c404c3c0 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.964+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84ac01b3b0 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.965+0000 7f84ba7fc700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 0x7f84a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.965+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84ac0839c0 con 0x7f84c40cc320 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.965+0000 7f84c259c700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 0x7f84a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:25.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.965+0000 7f84c259c700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 0x7f84a40693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099f0 tx=0x7f84bc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:25.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:25.969+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84ac050c30 con 0x7f84c40cc320 2023-10-09T15:31:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.161+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f84c406dce0 con 0x7f84c40cc320 2023-10-09T15:31:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.162+0000 7f84ba7fc700 1 -- 172.21.15.33:0/1007299247 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f84ac017070 con 0x7f84c40cc320 2023-10-09T15:31:26.163 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 msgr2=0x7f84a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 0x7f84a40693e0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f84bc0099f0 tx=0x7f84bc019000 comp rx=0 tx=0).stop 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 msgr2=0x7f84c40ca600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f84ac00c530 tx=0x7f84ac00c840 comp rx=0 tx=0).stop 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 shutdown_connections 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84a4066f30 0x7f84a40693e0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84c40cc6f0 0x7f84c40c7c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84c406a110 0x7f84c416ae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 --2- 172.21.15.33:0/1007299247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84c40cc320 0x7f84c40ca600 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 >> 172.21.15.33:0/1007299247 conn(0x7f84c4067f00 msgr2=0x7f84c413b830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 shutdown_connections 2023-10-09T15:31:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.164+0000 7f84c8f9b700 1 -- 172.21.15.33:0/1007299247 wait complete. 2023-10-09T15:31:26.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:26.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.298+0000 7f85acf32700 1 Processor -- start 2023-10-09T15:31:26.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.298+0000 7f85acf32700 1 -- start start 2023-10-09T15:31:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85acf32700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85a8157930 0x7f85a80ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85acf32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85acf32700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85a80c32a0 con 0x7f85a80ccba0 2023-10-09T15:31:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85acf32700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85a80c9730 con 0x7f85a8157930 2023-10-09T15:31:26.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85acf32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80c4100 con 0x7f85a80ca2c0 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.299+0000 7f85a659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85a8157930 0x7f85a80ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85a8157930 0x7f85a80ab070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37034/0 (socket says 172.21.15.33:37034) 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 -- 172.21.15.33:0/1047823070 learned_addr learned my addr 172.21.15.33:0/1047823070 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a5d9b700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 -- 172.21.15.33:0/1047823070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 msgr2=0x7f85a80ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 -- 172.21.15.33:0/1047823070 >> v1:172.21.15.59:6789/0 conn(0x7f85a80ccba0 legacy=0x7f85a80c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 -- 172.21.15.33:0/1047823070 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85a80c34f0 con 0x7f85a8157930 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a5d9b700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a659c700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ab070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85980099b0 tx=0x7f8598009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ac50d6892ede59 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a559a700 1 -- 172.21.15.33:0/1047823070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800b820 con 0x7f85a8157930 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a559a700 1 -- 172.21.15.33:0/1047823070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f859800b980 con 0x7f85a8157930 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.300+0000 7f85a559a700 1 -- 172.21.15.33:0/1047823070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f859800bd20 con 0x7f85a8157930 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 -- 172.21.15.33:0/1047823070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 msgr2=0x7f85a80ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ab070 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f85980099b0 tx=0x7f8598009250 comp rx=0 tx=0).stop 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 -- 172.21.15.33:0/1047823070 shutdown_connections 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ab070 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 --2- 172.21.15.33:0/1047823070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 -- 172.21.15.33:0/1047823070 >> 172.21.15.33:0/1047823070 conn(0x7f85a8088000 msgr2=0x7f85a80883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 -- 172.21.15.33:0/1047823070 shutdown_connections 2023-10-09T15:31:26.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.301+0000 7f85acf32700 1 -- 172.21.15.33:0/1047823070 wait complete. 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.302+0000 7f85acf32700 1 Processor -- start 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.302+0000 7f85acf32700 1 -- start start 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.302+0000 7f85acf32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80b0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.302+0000 7f85acf32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85a80ccba0 0x7f85a8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.302+0000 7f85acf32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85acf32700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b39c0 con 0x7f85a8157930 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85acf32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b2db0 con 0x7f85a80ccba0 2023-10-09T15:31:26.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85acf32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85a80b3090 con 0x7f85a80ca2c0 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37040/0 (socket says 172.21.15.33:37040) 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 -- 172.21.15.33:0/1931722136 learned_addr learned my addr 172.21.15.33:0/1931722136 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a659c700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a5d9b700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85a80ccba0 0x7f85a8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 -- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 msgr2=0x7f85a80b0800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80b0800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 -- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85a80ccba0 msgr2=0x7f85a8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85a80ccba0 0x7f85a8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 -- 172.21.15.33:0/1931722136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85980094f0 con 0x7f85a8157930 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85a6d9d700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c930 tx=0x7f85a00026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0012630 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85a00127d0 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85a80b3370 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85a0012b90 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.303+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85a80b0d40 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.304+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85a804c3c0 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.305+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f85a001b400 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.305+0000 7f85967fc700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 0x7f85880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.305+0000 7f85a659c700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 0x7f85880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.305+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85a0084770 con 0x7f85a8157930 2023-10-09T15:31:26.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.306+0000 7f85a659c700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 0x7f85880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85980099b0 tx=0x7f8598016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.310+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85a0055470 con 0x7f85a8157930 2023-10-09T15:31:26.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.501+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f85a8063c00 con 0x7f85a8157930 2023-10-09T15:31:26.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.501+0000 7f85967fc700 1 -- 172.21.15.33:0/1931722136 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f85a0055000 con 0x7f85a8157930 2023-10-09T15:31:26.502 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 msgr2=0x7f85880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 0x7f85880693e0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f85980099b0 tx=0x7f8598016000 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 msgr2=0x7f85a80ae710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f85a000c930 tx=0x7f85a00026e0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 shutdown_connections 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8588066f30 0x7f85880693e0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85a8157930 0x7f85a80ae710 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85a80ca2c0 0x7f85a80b0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 --2- 172.21.15.33:0/1931722136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85a80ccba0 0x7f85a8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 >> 172.21.15.33:0/1931722136 conn(0x7f85a8088000 msgr2=0x7f85a8154d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 shutdown_connections 2023-10-09T15:31:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.503+0000 7f85acf32700 1 -- 172.21.15.33:0/1931722136 wait complete. 2023-10-09T15:31:26.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:26.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.637+0000 7f06cdcec700 1 Processor -- start 2023-10-09T15:31:26.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.637+0000 7f06cdcec700 1 -- start start 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.638+0000 7f06cdcec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 0x7f06c80c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.638+0000 7f06cdcec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.638+0000 7f06cdcec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06c80c9310 con 0x7f06c80cd460 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.638+0000 7f06cdcec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06c80ad990 con 0x7f06c81598c0 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.638+0000 7f06cdcec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80ce090 con 0x7f06c8159c90 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 0x7f06c80c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 0x7f06c80c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:46422/0 (socket says 172.21.15.33:46422) 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:41144/0 (socket says 172.21.15.33:41144) 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c7fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f06c80cd460 0x7f06c80cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36072/0 (socket says 172.21.15.33:36072) 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c77fe700 1 -- 172.21.15.33:0/3810977086 learned_addr learned my addr 172.21.15.33:0/3810977086 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 -- 172.21.15.33:0/3810977086 >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 msgr2=0x7f06c80c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 --2- 172.21.15.33:0/3810977086 >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 0x7f06c80c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 -- 172.21.15.33:0/3810977086 >> v1:172.21.15.59:6789/0 conn(0x7f06c80cd460 legacy=0x7f06c80cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 -- 172.21.15.33:0/3810977086 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06c80c8cc0 con 0x7f06c8159c90 2023-10-09T15:31:26.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c6ffd700 1 --2- 172.21.15.33:0/3810977086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0098e0 tx=0x7f06bc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=512340d87e60e1e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c67fc700 1 -- 172.21.15.33:0/3810977086 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00b640 con 0x7f06c8159c90 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c67fc700 1 -- 172.21.15.33:0/3810977086 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06bc00b7a0 con 0x7f06c8159c90 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.639+0000 7f06c67fc700 1 -- 172.21.15.33:0/3810977086 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06bc00bb40 con 0x7f06c8159c90 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 -- 172.21.15.33:0/3810977086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 msgr2=0x7f06c80c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 --2- 172.21.15.33:0/3810977086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f06bc0098e0 tx=0x7f06bc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 -- 172.21.15.33:0/3810977086 shutdown_connections 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 --2- 172.21.15.33:0/3810977086 >> v2:172.21.15.59:3300/0 conn(0x7f06c81598c0 0x7f06c80c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 --2- 172.21.15.33:0/3810977086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c8159c90 0x7f06c80c43b0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 -- 172.21.15.33:0/3810977086 >> 172.21.15.33:0/3810977086 conn(0x7f06c8088000 msgr2=0x7f06c80883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 -- 172.21.15.33:0/3810977086 shutdown_connections 2023-10-09T15:31:26.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.640+0000 7f06cdcec700 1 -- 172.21.15.33:0/3810977086 wait complete. 2023-10-09T15:31:26.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.641+0000 7f06cdcec700 1 Processor -- start 2023-10-09T15:31:26.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.641+0000 7f06cdcec700 1 -- start start 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c80cd460 0x7f06c80b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c81598c0 0x7f06c80afd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80adfc0 con 0x7f06c8159c90 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06c816ac60 con 0x7f06c81598c0 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06cdcec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06c80b2750 con 0x7f06c80cd460 2023-10-09T15:31:26.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37054/0 (socket says 172.21.15.33:37054) 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 -- 172.21.15.33:0/1359916157 learned_addr learned my addr 172.21.15.33:0/1359916157 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c77fe700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c80cd460 0x7f06c80b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c6ffd700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c81598c0 0x7f06c80afd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 -- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c80cd460 msgr2=0x7f06c80b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c80cd460 0x7f06c80b1c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 -- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c81598c0 msgr2=0x7f06c80afd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c81598c0 0x7f06c80afd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.642+0000 7f06c7fff700 1 -- 172.21.15.33:0/1359916157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06bc009420 con 0x7f06c8159c90 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06c7fff700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06c000cd00 tx=0x7f06c0001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000ce60 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c0005df0 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06c80b2a30 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c000ab00 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.643+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06c80b3e70 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.644+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06c80b2c20 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.644+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f06c00070f0 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.644+0000 7f06af7fe700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 0x7f06b4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.645+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06c0084520 con 0x7f06c8159c90 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.645+0000 7f06c77fe700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 0x7f06b4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.645+0000 7f06c77fe700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 0x7f06b4069410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006d40 tx=0x7f06b8009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.649+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06c0051810 con 0x7f06c8159c90 2023-10-09T15:31:26.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.840+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06c804c3c0 con 0x7f06c8159c90 2023-10-09T15:31:26.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.841+0000 7f06af7fe700 1 -- 172.21.15.33:0/1359916157 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06c0082e60 con 0x7f06c8159c90 2023-10-09T15:31:26.842 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 msgr2=0x7f06b4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 0x7f06b4069410 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f06b8006d40 tx=0x7f06b8009250 comp rx=0 tx=0).stop 2023-10-09T15:31:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 msgr2=0x7f06c80b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f06c000cd00 tx=0x7f06c0001b10 comp rx=0 tx=0).stop 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 shutdown_connections 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06b4066f60 0x7f06b4069410 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06c8159c90 0x7f06c80b0240 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06c80cd460 0x7f06c80b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 --2- 172.21.15.33:0/1359916157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06c81598c0 0x7f06c80afd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 >> 172.21.15.33:0/1359916157 conn(0x7f06c8088000 msgr2=0x7f06c80cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 shutdown_connections 2023-10-09T15:31:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.843+0000 7f06cdcec700 1 -- 172.21.15.33:0/1359916157 wait complete. 2023-10-09T15:31:26.856 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:26.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.974+0000 7fdbedca6700 1 Processor -- start 2023-10-09T15:31:26.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.974+0000 7fdbedca6700 1 -- start start 2023-10-09T15:31:26.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbedca6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbedca6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbe80cde50 0x7fdbe8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbedca6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbe815ae40 con 0x7fdbe80cd9e0 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbedca6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbe80d13f0 con 0x7fdbe80cde50 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbedca6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe815ab60 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdbe80cd9e0 0x7fdbe8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48348/0 (socket says 172.21.15.33:48348) 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe6ffd700 1 -- 172.21.15.33:0/3537072624 learned_addr learned my addr 172.21.15.33:0/3537072624 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/3537072624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe7fff700 1 --2- 172.21.15.33:0/3537072624 >> v2:172.21.15.59:3300/0 conn(0x7fdbe80cde50 0x7fdbe8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe67fc700 1 -- 172.21.15.33:0/3537072624 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 590081706 0 0) 0x7fdbe815ae40 con 0x7fdbe80cd9e0 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.975+0000 7fdbe67fc700 1 -- 172.21.15.33:0/3537072624 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbd0003570 con 0x7fdbe80cd9e0 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe77fe700 1 -- 172.21.15.33:0/3537072624 >> v2:172.21.15.59:3300/0 conn(0x7fdbe80cde50 msgr2=0x7fdbe8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/3537072624 >> v2:172.21.15.59:3300/0 conn(0x7fdbe80cde50 0x7fdbe8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe77fe700 1 -- 172.21.15.33:0/3537072624 >> v1:172.21.15.33:6789/0 conn(0x7fdbe80cd9e0 legacy=0x7fdbe8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe77fe700 1 -- 172.21.15.33:0/3537072624 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbe80ccf00 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/3537072624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe80cb970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80098e0 tx=0x7fdbd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f0f4661b36e91e19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe67fc700 1 -- 172.21.15.33:0/3537072624 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011630 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe67fc700 1 -- 172.21.15.33:0/3537072624 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbd8011790 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbe67fc700 1 -- 172.21.15.33:0/3537072624 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbd8011b30 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbedca6700 1 -- 172.21.15.33:0/3537072624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 msgr2=0x7fdbe80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.976+0000 7fdbedca6700 1 --2- 172.21.15.33:0/3537072624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe80cb970 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80098e0 tx=0x7fdbd80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 -- 172.21.15.33:0/3537072624 shutdown_connections 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 --2- 172.21.15.33:0/3537072624 >> v2:172.21.15.59:3300/0 conn(0x7fdbe80cde50 0x7fdbe8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 --2- 172.21.15.33:0/3537072624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe80cb970 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 -- 172.21.15.33:0/3537072624 >> 172.21.15.33:0/3537072624 conn(0x7fdbe8070e30 msgr2=0x7fdbe80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:26.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 -- 172.21.15.33:0/3537072624 shutdown_connections 2023-10-09T15:31:26.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.977+0000 7fdbedca6700 1 -- 172.21.15.33:0/3537072624 wait complete. 2023-10-09T15:31:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.978+0000 7fdbedca6700 1 Processor -- start 2023-10-09T15:31:26.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.978+0000 7fdbedca6700 1 -- start start 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.978+0000 7fdbedca6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe8155650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.978+0000 7fdbedca6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbe80cd9e0 0x7fdbe8155b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe80c86f0 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe81560d0 con 0x7fdbe80cd9e0 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbe816ea90 con 0x7fdbe80cb5a0 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37070/0 (socket says 172.21.15.33:37070) 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 -- 172.21.15.33:0/1374194212 learned_addr learned my addr 172.21.15.33:0/1374194212 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe6ffd700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbe80cd9e0 0x7fdbe8155b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe8155650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 -- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 msgr2=0x7fdbe8155650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe8155650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 -- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbe80cd9e0 msgr2=0x7fdbe8155b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbe80cd9e0 0x7fdbe8155b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 -- 172.21.15.33:0/1374194212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbd8009420 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbe7fff700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009e90 tx=0x7fdbe000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe000cb70 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbe000f040 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbe816dee0 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbe0014480 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.979+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbe816e720 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.980+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbe816ec20 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.981+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdbe0014830 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.981+0000 7fdbcf7fe700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 0x7fdbd4069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:26.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.981+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 0x7fdbd4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:26.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.981+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdbe0084eb0 con 0x7fdbe80c9ac0 2023-10-09T15:31:26.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.982+0000 7fdbe77fe700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 0x7fdbd4069410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80091e0 tx=0x7fdbd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:26.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:26.986+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdbe0052120 con 0x7fdbe80c9ac0 2023-10-09T15:31:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.181+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdbe804c3c0 con 0x7fdbe80c9ac0 2023-10-09T15:31:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.182+0000 7fdbcf7fe700 1 -- 172.21.15.33:0/1374194212 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fdbe0055740 con 0x7fdbe80c9ac0 2023-10-09T15:31:27.183 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:27.183 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 msgr2=0x7fdbd4069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 0x7fdbd4069410 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fdbd80091e0 tx=0x7fdbd8017000 comp rx=0 tx=0).stop 2023-10-09T15:31:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 msgr2=0x7fdbe80c9f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdbe0009e90 tx=0x7fdbe000b040 comp rx=0 tx=0).stop 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 shutdown_connections 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdbd4066f60 0x7fdbd4069410 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbe80c9ac0 0x7fdbe80c9f60 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbe80cb5a0 0x7fdbe8155650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 --2- 172.21.15.33:0/1374194212 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbe80cd9e0 0x7fdbe8155b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 >> 172.21.15.33:0/1374194212 conn(0x7fdbe8070e30 msgr2=0x7fdbe80b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 shutdown_connections 2023-10-09T15:31:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.184+0000 7fdbedca6700 1 -- 172.21.15.33:0/1374194212 wait complete. 2023-10-09T15:31:27.197 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:27.197 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.319+0000 7fa65747d700 1 Processor -- start 2023-10-09T15:31:27.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.320+0000 7fa65747d700 1 -- start start 2023-10-09T15:31:27.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.320+0000 7fa65747d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6500ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.320+0000 7fa65747d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6500ccfd0 con 0x7fa65006e0e0 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.320+0000 7fa65747d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6500cf0e0 con 0x7fa65006dc70 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.320+0000 7fa65747d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa65015a3d0 con 0x7fa650159530 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa655a1a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa65006e0e0 0x7fa6500cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48358/0 (socket says 172.21.15.33:48358) 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa655a1a700 1 -- 172.21.15.33:0/1645982034 learned_addr learned my addr 172.21.15.33:0/1645982034 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 673351369 0 0) 0x7fa6500ccfd0 con 0x7fa65006e0e0 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa638003570 con 0x7fa65006e0e0 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa655219700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6500ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 630138322 0 0) 0x7fa638003570 con 0x7fa65006e0e0 2023-10-09T15:31:27.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 msgr2=0x7fa6500ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6500ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 >> v1:172.21.15.59:6789/0 conn(0x7fa65006dc70 legacy=0x7fa650159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65015a6b0 con 0x7fa65006e0e0 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa6400017f0 con 0x7fa65006e0e0 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 >> v1:172.21.15.33:6789/0 conn(0x7fa65006e0e0 legacy=0x7fa6500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa638003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa638004810 0x7fa638004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6380051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa65015a3d0 con 0x7fa638003a90 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800bb60 con 0x7fa638004810 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa63800bd20 con 0x7fa650159530 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa655219700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa638003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa655a1a700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6380051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.321+0000 7fa654a18700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa638004810 0x7fa638004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 -- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 msgr2=0x7fa6380051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa650159530 0x7fa6380051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 -- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa638004810 msgr2=0x7fa638004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa638004810 0x7fa638004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 -- 172.21.15.33:0/1645982034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa638003570 con 0x7fa638003a90 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655219700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa638003ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa648009c00 tx=0x7fa6480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a1f9c1f7a13471 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800e710 con 0x7fa638003a90 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800e870 con 0x7fa638003a90 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa64ffff700 1 -- 172.21.15.33:0/1645982034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64800ec30 con 0x7fa638003a90 2023-10-09T15:31:27.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa65747d700 1 -- 172.21.15.33:0/1645982034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 msgr2=0x7fa638003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa65747d700 1 --2- 172.21.15.33:0/1645982034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa638003ea0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fa648009c00 tx=0x7fa6480091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa655a1a700 1 -- 172.21.15.33:0/1645982034 reap_dead start 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa65747d700 1 -- 172.21.15.33:0/1645982034 shutdown_connections 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.322+0000 7fa65747d700 1 -- 172.21.15.33:0/1645982034 >> 172.21.15.33:0/1645982034 conn(0x7fa6500703a0 msgr2=0x7fa6500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.323+0000 7fa65747d700 1 -- 172.21.15.33:0/1645982034 shutdown_connections 2023-10-09T15:31:27.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.323+0000 7fa65747d700 1 -- 172.21.15.33:0/1645982034 wait complete. 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.324+0000 7fa65747d700 1 Processor -- start 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.324+0000 7fa65747d700 1 -- start start 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.324+0000 7fa65747d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.324+0000 7fa65747d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 0x7fa6500b1270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 0x7fa6500b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b3f30 con 0x7fa638003a90 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b3600 con 0x7fa65014d500 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6500b38e0 con 0x7fa6500b4bb0 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37076/0 (socket says 172.21.15.33:37076) 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 -- 172.21.15.33:0/3423463034 learned_addr learned my addr 172.21.15.33:0/3423463034 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa654a18700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 0x7fa6500b1270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655a1a700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 0x7fa6500b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 -- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 msgr2=0x7fa6500b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 0x7fa6500b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 -- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 msgr2=0x7fa6500b1270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 0x7fa6500b1270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 -- 172.21.15.33:0/3423463034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500b3bc0 con 0x7fa638003a90 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655a1a700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 0x7fa6500b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa654a18700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 0x7fa6500b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:27.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa655219700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa63800bb30 tx=0x7fa64801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa648022070 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa64800ebf0 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa64801c6a0 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6500b3f30 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.325+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6500c8180 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.326+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6500b3740 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.327+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa64801ca90 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.327+0000 7fa64d7fa700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 0x7fa63c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.327+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa648085c30 con 0x7fa638003a90 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.327+0000 7fa654a18700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 0x7fa63c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.327+0000 7fa654a18700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 0x7fa63c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6500cec30 tx=0x7fa644009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.331+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa6500b3740 con 0x7fa638003a90 2023-10-09T15:31:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.525+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa6500b3740 con 0x7fa638003a90 2023-10-09T15:31:27.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.525+0000 7fa64d7fa700 1 -- 172.21.15.33:0/3423463034 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa6500b3740 con 0x7fa638003a90 2023-10-09T15:31:27.527 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 msgr2=0x7fa63c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 0x7fa63c0693e0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa6500cec30 tx=0x7fa644009040 comp rx=0 tx=0).stop 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 msgr2=0x7fa6500c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fa63800bb30 tx=0x7fa64801a000 comp rx=0 tx=0).stop 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 shutdown_connections 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa63c066f30 0x7fa63c0693e0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa638003a90 0x7fa6500c7c40 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6500b4bb0 0x7fa6500b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 --2- 172.21.15.33:0/3423463034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa65014d500 0x7fa6500b1270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 >> 172.21.15.33:0/3423463034 conn(0x7fa6500703a0 msgr2=0x7fa6500cf9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 shutdown_connections 2023-10-09T15:31:27.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.528+0000 7fa65747d700 1 -- 172.21.15.33:0/3423463034 wait complete. 2023-10-09T15:31:27.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:27.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.661+0000 7f58636be700 1 Processor -- start 2023-10-09T15:31:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 -- start start 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f585c159530 0x7f585c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 0x7f585c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f585c0ccfd0 con 0x7f585c06e0e0 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c0cf0e0 con 0x7f585c159530 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.662+0000 7f58636be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f585c15a3d0 con 0x7f585c06dc70 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f585c159530 0x7f585c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f585c159530 0x7f585c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37080/0 (socket says 172.21.15.33:37080) 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 -- 172.21.15.33:0/3364644537 learned_addr learned my addr 172.21.15.33:0/3364644537 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f5860c59700 1 --2- 172.21.15.33:0/3364644537 >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 0x7f585c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 -- 172.21.15.33:0/3364644537 >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 msgr2=0x7f585c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 --2- 172.21.15.33:0/3364644537 >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 0x7f585c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 -- 172.21.15.33:0/3364644537 >> v1:172.21.15.59:6789/0 conn(0x7f585c06e0e0 legacy=0x7f585c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 -- 172.21.15.33:0/3364644537 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f585c15a6b0 con 0x7f585c159530 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f5860c59700 1 --2- 172.21.15.33:0/3364644537 >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 0x7f585c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f586145a700 1 --2- 172.21.15.33:0/3364644537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0ceba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b66e0 tx=0x7f5854009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9992201a2aae46e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f585bfff700 1 -- 172.21.15.33:0/3364644537 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400b820 con 0x7f585c159530 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f585bfff700 1 -- 172.21.15.33:0/3364644537 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f585400b980 con 0x7f585c159530 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.663+0000 7f585bfff700 1 -- 172.21.15.33:0/3364644537 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f585400bd20 con 0x7f585c159530 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 -- 172.21.15.33:0/3364644537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 msgr2=0x7f585c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 --2- 172.21.15.33:0/3364644537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0ceba0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b66e0 tx=0x7f5854009250 comp rx=0 tx=0).stop 2023-10-09T15:31:27.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 -- 172.21.15.33:0/3364644537 shutdown_connections 2023-10-09T15:31:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 --2- 172.21.15.33:0/3364644537 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0ceba0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 --2- 172.21.15.33:0/3364644537 >> v2:172.21.15.59:3300/0 conn(0x7f585c06dc70 0x7f585c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 -- 172.21.15.33:0/3364644537 >> 172.21.15.33:0/3364644537 conn(0x7f585c0703a0 msgr2=0x7f585c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 -- 172.21.15.33:0/3364644537 shutdown_connections 2023-10-09T15:31:27.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.664+0000 7f58636be700 1 -- 172.21.15.33:0/3364644537 wait complete. 2023-10-09T15:31:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.665+0000 7f58636be700 1 Processor -- start 2023-10-09T15:31:27.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.665+0000 7f58636be700 1 -- start start 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585c06dc70 0x7f585c0b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585c06e0e0 0x7f585c14c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c151250 con 0x7f585c159530 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f585c0b39c0 con 0x7f585c06e0e0 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58636be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f585c150640 con 0x7f585c06dc70 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37084/0 (socket says 172.21.15.33:37084) 2023-10-09T15:31:27.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 -- 172.21.15.33:0/2399949492 learned_addr learned my addr 172.21.15.33:0/2399949492 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f586145a700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585c06dc70 0x7f585c0b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5860c59700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585c06e0e0 0x7f585c14c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 -- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585c06dc70 msgr2=0x7f585c0b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585c06dc70 0x7f585c0b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 -- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585c06e0e0 msgr2=0x7f585c14c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585c06e0e0 0x7f585c14c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 -- 172.21.15.33:0/2399949492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58540094f0 con 0x7f585c159530 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f5861c5b700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c960 tx=0x7f584c0026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.666+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c012630 con 0x7f585c159530 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.667+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f584c012790 con 0x7f585c159530 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.667+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f584c012b50 con 0x7f585c159530 2023-10-09T15:31:27.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.667+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f585c150920 con 0x7f585c159530 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.667+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f585c150ee0 con 0x7f585c159530 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.667+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f585c04c3c0 con 0x7f585c159530 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.668+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f584c01b400 con 0x7f585c159530 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.668+0000 7f58597fa700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 0x7f58480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.668+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f584c084820 con 0x7f585c159530 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.668+0000 7f586145a700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 0x7f58480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:27.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.669+0000 7f586145a700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 0x7f58480693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b66e0 tx=0x7f5854016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:27.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.672+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f584c051a90 con 0x7f585c159530 2023-10-09T15:31:27.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.862+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f585c151390 con 0x7f585c159530 2023-10-09T15:31:27.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.863+0000 7f58597fa700 1 -- 172.21.15.33:0/2399949492 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f584c0550b0 con 0x7f585c159530 2023-10-09T15:31:27.864 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 msgr2=0x7f58480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 0x7f58480693e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f585c0b66e0 tx=0x7f5854016000 comp rx=0 tx=0).stop 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 msgr2=0x7f585c0c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f584c00c960 tx=0x7f584c0026e0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 shutdown_connections 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5848066f30 0x7f58480693e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f585c159530 0x7f585c0c81c0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f585c06dc70 0x7f585c0b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 --2- 172.21.15.33:0/2399949492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f585c06e0e0 0x7f585c14c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 >> 172.21.15.33:0/2399949492 conn(0x7f585c0703a0 msgr2=0x7f585c0d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 shutdown_connections 2023-10-09T15:31:27.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.865+0000 7f58636be700 1 -- 172.21.15.33:0/2399949492 wait complete. 2023-10-09T15:31:27.878 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:27.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.999+0000 7ff835a7b700 1 Processor -- start 2023-10-09T15:31:28.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.999+0000 7ff835a7b700 1 -- start start 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.999+0000 7ff835a7b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff83006e0e0 0x7ff8300cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.999+0000 7ff835a7b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8300ccfd0 con 0x7ff83006dc70 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:27.999+0000 7ff835a7b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff83015a3d0 con 0x7ff830159530 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff835a7b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff83015a6b0 con 0x7ff83006e0e0 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff83006e0e0 0x7ff8300cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff826ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff83006dc70 0x7ff830159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48360/0 (socket says 172.21.15.33:48360) 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff826ffd700 1 -- 172.21.15.33:0/1674967313 learned_addr learned my addr 172.21.15.33:0/1674967313 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82ffff700 1 -- 172.21.15.33:0/1674967313 >> v1:172.21.15.59:6789/0 conn(0x7ff830159530 legacy=0x7ff8300ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82ffff700 1 -- 172.21.15.33:0/1674967313 >> v1:172.21.15.33:6789/0 conn(0x7ff83006dc70 legacy=0x7ff830159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82ffff700 1 -- 172.21.15.33:0/1674967313 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff83015a990 con 0x7ff83006e0e0 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82ffff700 1 --2- 172.21.15.33:0/1674967313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006e0e0 0x7ff8300cb6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff828009e60 tx=0x7ff828009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e6bfb2f6cf6983 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82effd700 1 -- 172.21.15.33:0/1674967313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff82800e070 con 0x7ff83006e0e0 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82effd700 1 -- 172.21.15.33:0/1674967313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff82800bc30 con 0x7ff83006e0e0 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.000+0000 7ff82effd700 1 -- 172.21.15.33:0/1674967313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff828012430 con 0x7ff83006e0e0 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 -- 172.21.15.33:0/1674967313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006e0e0 msgr2=0x7ff8300cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 --2- 172.21.15.33:0/1674967313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006e0e0 0x7ff8300cb6f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7ff828009e60 tx=0x7ff828009780 comp rx=0 tx=0).stop 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 -- 172.21.15.33:0/1674967313 shutdown_connections 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 --2- 172.21.15.33:0/1674967313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006e0e0 0x7ff8300cb6f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 -- 172.21.15.33:0/1674967313 >> 172.21.15.33:0/1674967313 conn(0x7ff8300703a0 msgr2=0x7ff8300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 -- 172.21.15.33:0/1674967313 shutdown_connections 2023-10-09T15:31:28.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.001+0000 7ff835a7b700 1 -- 172.21.15.33:0/1674967313 wait complete. 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.002+0000 7ff835a7b700 1 Processor -- start 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.002+0000 7ff835a7b700 1 -- start start 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 0x7ff830153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff830159530 0x7ff8301538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83016e180 con 0x7ff83006dc70 2023-10-09T15:31:28.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff83016d570 con 0x7ff830159530 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff835a7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff83016d850 con 0x7ff83006e0e0 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37100/0 (socket says 172.21.15.33:37100) 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 -- 172.21.15.33:0/3542190193 learned_addr learned my addr 172.21.15.33:0/3542190193 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff826ffd700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 0x7ff830153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82ffff700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff830159530 0x7ff8301538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 -- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 msgr2=0x7ff830153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 0x7ff830153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 -- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff830159530 msgr2=0x7ff8301538a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff830159530 0x7ff8301538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff82f7fe700 1 -- 172.21.15.33:0/3542190193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff828009a20 con 0x7ff83006dc70 2023-10-09T15:31:28.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.003+0000 7ff826ffd700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 0x7ff830153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff82f7fe700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c790 tx=0x7ff820007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820011590 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff820011710 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff83016db30 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff820011ad0 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.004+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8300c8a50 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.005+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff83004c3c0 con 0x7ff83006dc70 2023-10-09T15:31:28.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.005+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff82001b3b0 con 0x7ff83006dc70 2023-10-09T15:31:28.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.006+0000 7ff827fff700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.006+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff820083a50 con 0x7ff83006dc70 2023-10-09T15:31:28.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.006+0000 7ff826ffd700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.006+0000 7ff826ffd700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 0x7ff8100693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff830152020 tx=0x7ff818009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.010+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff820050cc0 con 0x7ff83006dc70 2023-10-09T15:31:28.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.202+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff83015ac70 con 0x7ff83006dc70 2023-10-09T15:31:28.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.203+0000 7ff827fff700 1 -- 172.21.15.33:0/3542190193 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff820017070 con 0x7ff83006dc70 2023-10-09T15:31:28.204 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 msgr2=0x7ff8100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 0x7ff8100693e0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff830152020 tx=0x7ff818009040 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 msgr2=0x7ff83014de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7ff82000c790 tx=0x7ff820007f40 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 shutdown_connections 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff810066f30 0x7ff8100693e0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff83006dc70 0x7ff83014de30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff830159530 0x7ff8301538a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 --2- 172.21.15.33:0/3542190193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff83006e0e0 0x7ff830153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 >> 172.21.15.33:0/3542190193 conn(0x7ff8300703a0 msgr2=0x7ff8300b0d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 shutdown_connections 2023-10-09T15:31:28.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.205+0000 7ff835a7b700 1 -- 172.21.15.33:0/3542190193 wait complete. 2023-10-09T15:31:28.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:28.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.336+0000 7fee96b29700 1 Processor -- start 2023-10-09T15:31:28.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.336+0000 7fee96b29700 1 -- start start 2023-10-09T15:31:28.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee96b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 0x7fee900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee96b29700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee900cd9e0 0x7fee90159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee96b29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee9015ae40 con 0x7fee900cde50 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee96b29700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee900d13f0 con 0x7fee900cd9e0 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee96b29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015ab60 con 0x7fee900cb5a0 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee8ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee900cd9e0 0x7fee90159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee8ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fee900cd9e0 0x7fee90159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37102/0 (socket says 172.21.15.33:37102) 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee8ffff700 1 -- 172.21.15.33:0/1688972671 learned_addr learned my addr 172.21.15.33:0/1688972671 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.337+0000 7fee948c5700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 0x7fee900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8ffff700 1 -- 172.21.15.33:0/1688972671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 msgr2=0x7fee900cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8ffff700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 0x7fee900cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8ffff700 1 -- 172.21.15.33:0/1688972671 >> v1:172.21.15.59:6789/0 conn(0x7fee900cde50 legacy=0x7fee90156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8ffff700 1 -- 172.21.15.33:0/1688972671 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee900ccf00 con 0x7fee900cd9e0 2023-10-09T15:31:28.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee948c5700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 0x7fee900cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8ffff700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cd9e0 0x7fee90159ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee80009f20 tx=0x7fee80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4322a10f206e86cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8f7fe700 1 -- 172.21.15.33:0/1688972671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8000e070 con 0x7fee900cd9e0 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8f7fe700 1 -- 172.21.15.33:0/1688972671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8000ba80 con 0x7fee900cd9e0 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee8f7fe700 1 -- 172.21.15.33:0/1688972671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee800092e0 con 0x7fee900cd9e0 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee96b29700 1 -- 172.21.15.33:0/1688972671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cd9e0 msgr2=0x7fee90159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.338+0000 7fee96b29700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cd9e0 0x7fee90159ec0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fee80009f20 tx=0x7fee80009840 comp rx=0 tx=0).stop 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 -- 172.21.15.33:0/1688972671 shutdown_connections 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cb5a0 0x7fee900cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 --2- 172.21.15.33:0/1688972671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cd9e0 0x7fee90159ec0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 -- 172.21.15.33:0/1688972671 >> 172.21.15.33:0/1688972671 conn(0x7fee90070e30 msgr2=0x7fee900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 -- 172.21.15.33:0/1688972671 shutdown_connections 2023-10-09T15:31:28.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.339+0000 7fee96b29700 1 -- 172.21.15.33:0/1688972671 wait complete. 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.340+0000 7fee96b29700 1 Processor -- start 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.340+0000 7fee96b29700 1 -- start start 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 0x7fee900ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 0x7fee9015c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee901538a0 con 0x7fee900cb5a0 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015b5c0 con 0x7fee9015b070 2023-10-09T15:31:28.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9015b8a0 con 0x7fee900cd9e0 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37110/0 (socket says 172.21.15.33:37110) 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 -- 172.21.15.33:0/2150899613 learned_addr learned my addr 172.21.15.33:0/2150899613 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee8ffff700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 0x7fee900ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee950c6700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 0x7fee9015c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 -- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 msgr2=0x7fee900ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 0x7fee900ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 -- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 msgr2=0x7fee9015c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 0x7fee9015c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 -- 172.21.15.33:0/2150899613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee80009ae0 con 0x7fee900cb5a0 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee8ffff700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 0x7fee900ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee950c6700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 0x7fee9015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:28.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee948c5700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e8d0 tx=0x7fee88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800ee70 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8800c5e0 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee9015bb80 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8800c980 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.341+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee9015c140 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.342+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee9004c3c0 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.343+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fee88013410 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.343+0000 7fee8cff9700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.343+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee88084400 con 0x7fee900cb5a0 2023-10-09T15:31:28.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.343+0000 7fee8ffff700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.344+0000 7fee8ffff700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 0x7fee700693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee80009880 tx=0x7fee80018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.348+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee88051670 con 0x7fee900cb5a0 2023-10-09T15:31:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.549+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee900cd1e0 con 0x7fee900cb5a0 2023-10-09T15:31:28.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.550+0000 7fee8cff9700 1 -- 172.21.15.33:0/2150899613 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fee88054c90 con 0x7fee900cb5a0 2023-10-09T15:31:28.550 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:28.551 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 msgr2=0x7fee700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 0x7fee700693e0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fee80009880 tx=0x7fee80018000 comp rx=0 tx=0).stop 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 msgr2=0x7fee90153360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fee8800e8d0 tx=0x7fee88008040 comp rx=0 tx=0).stop 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 shutdown_connections 2023-10-09T15:31:28.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee70066f30 0x7fee700693e0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee900cb5a0 0x7fee90153360 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee9015b070 0x7fee9015c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 --2- 172.21.15.33:0/2150899613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee900cd9e0 0x7fee900ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 >> 172.21.15.33:0/2150899613 conn(0x7fee90070e30 msgr2=0x7fee900b0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 shutdown_connections 2023-10-09T15:31:28.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.552+0000 7fee96b29700 1 -- 172.21.15.33:0/2150899613 wait complete. 2023-10-09T15:31:28.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:28.565 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.686+0000 7f8950e7f700 1 Processor -- start 2023-10-09T15:31:28.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.686+0000 7f8950e7f700 1 -- start start 2023-10-09T15:31:28.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8950e7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 0x7f894c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8950e7f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f894c06e0e0 0x7f894c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8950e7f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f894c0ccfd0 con 0x7f894c06dc70 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8950e7f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f894c0cf0e0 con 0x7f894c06e0e0 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8950e7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c15a3d0 con 0x7f894c159530 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f894ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f894c06e0e0 0x7f894c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8949d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f894c06dc70 0x7f894c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48368/0 (socket says 172.21.15.33:48368) 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f8949d9b700 1 -- 172.21.15.33:0/1415222794 learned_addr learned my addr 172.21.15.33:0/1415222794 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.687+0000 7f894a59c700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 0x7f894c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894ad9d700 1 -- 172.21.15.33:0/1415222794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 msgr2=0x7f894c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894ad9d700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 0x7f894c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894ad9d700 1 -- 172.21.15.33:0/1415222794 >> v1:172.21.15.33:6789/0 conn(0x7f894c06dc70 legacy=0x7f894c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894ad9d700 1 -- 172.21.15.33:0/1415222794 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f894c15a6b0 con 0x7f894c06e0e0 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894a59c700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 0x7f894c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894959a700 1 -- 172.21.15.33:0/1415222794 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4113358314 0 0) 0x7f894c0ccfd0 con 0x7f894c06dc70 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894ad9d700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c06e0e0 0x7f894c0cb6f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098e0 tx=0x7f893c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=843d29c4060fb1d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894959a700 1 -- 172.21.15.33:0/1415222794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c009e80 con 0x7f894c06e0e0 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894959a700 1 -- 172.21.15.33:0/1415222794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c00b860 con 0x7f894c06e0e0 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f894959a700 1 -- 172.21.15.33:0/1415222794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00bbe0 con 0x7f894c06e0e0 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f8950e7f700 1 -- 172.21.15.33:0/1415222794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c06e0e0 msgr2=0x7f894c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.688+0000 7f8950e7f700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c06e0e0 0x7f894c0cb6f0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f893c0098e0 tx=0x7f893c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 -- 172.21.15.33:0/1415222794 shutdown_connections 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c06e0e0 0x7f894c0cb6f0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 --2- 172.21.15.33:0/1415222794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c159530 0x7f894c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 -- 172.21.15.33:0/1415222794 >> 172.21.15.33:0/1415222794 conn(0x7f894c0703a0 msgr2=0x7f894c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 -- 172.21.15.33:0/1415222794 shutdown_connections 2023-10-09T15:31:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.689+0000 7f8950e7f700 1 -- 172.21.15.33:0/1415222794 wait complete. 2023-10-09T15:31:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.690+0000 7f8950e7f700 1 Processor -- start 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.690+0000 7f8950e7f700 1 -- start start 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 0x7f894c169960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c06e0e0 0x7f894c0ca5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c16a900 con 0x7f894c159530 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f894c0caae0 con 0x7f894c06dc70 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f894c16a060 con 0x7f894c06e0e0 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37126/0 (socket says 172.21.15.33:37126) 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 -- 172.21.15.33:0/465095530 learned_addr learned my addr 172.21.15.33:0/465095530 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8949d9b700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c06e0e0 0x7f894c0ca5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894a59c700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 0x7f894c169960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 -- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c06e0e0 msgr2=0x7f894c0ca5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c06e0e0 0x7f894c0ca5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 -- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 msgr2=0x7f894c169960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 0x7f894c169960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 -- 172.21.15.33:0/465095530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f893c009420 con 0x7f894c159530 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894a59c700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 0x7f894c169960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f894ad9d700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f893c0091e0 tx=0x7f893c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c00bbe0 con 0x7f894c159530 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f893c011420 con 0x7f894c159530 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f893c0117e0 con 0x7f894c159530 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f894c16a340 con 0x7f894c159530 2023-10-09T15:31:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.691+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f894c0c8a40 con 0x7f894c159530 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.692+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f894c0c8c30 con 0x7f894c159530 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.693+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f893c011c10 con 0x7f894c159530 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.693+0000 7f89427fc700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.693+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f893c0860e0 con 0x7f894c159530 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.693+0000 7f894a59c700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:28.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.694+0000 7f894a59c700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 0x7f892c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8944007640 tx=0x7f8944009850 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:28.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.697+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f893c0532b0 con 0x7f894c159530 2023-10-09T15:31:28.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.888+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f894c04c3c0 con 0x7f894c159530 2023-10-09T15:31:28.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.888+0000 7f89427fc700 1 -- 172.21.15.33:0/465095530 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f893c0568d0 con 0x7f894c159530 2023-10-09T15:31:28.890 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:28.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 msgr2=0x7f892c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 0x7f892c0693e0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8944007640 tx=0x7f8944009850 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 msgr2=0x7f894c145020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f893c0091e0 tx=0x7f893c017000 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 shutdown_connections 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f892c066f30 0x7f892c0693e0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f894c159530 0x7f894c145020 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f894c06dc70 0x7f894c169960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 --2- 172.21.15.33:0/465095530 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f894c06e0e0 0x7f894c0ca5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 >> 172.21.15.33:0/465095530 conn(0x7f894c0703a0 msgr2=0x7f894c154f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 shutdown_connections 2023-10-09T15:31:28.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:28.890+0000 7f8950e7f700 1 -- 172.21.15.33:0/465095530 wait complete. 2023-10-09T15:31:28.903 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:29.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.024+0000 7f50c0962700 1 Processor -- start 2023-10-09T15:31:29.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.024+0000 7f50c0962700 1 -- start start 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50bc159530 0x7f50bc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 0x7f50bc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06e0e0 0x7f50bc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc0ccfd0 con 0x7f50bc159530 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50bc0cf0e0 con 0x7f50bc06dc70 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50c0962700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc15a3d0 con 0x7f50bc06e0e0 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50ba59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50bc159530 0x7f50bc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50ba59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f50bc159530 0x7f50bc0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37128/0 (socket says 172.21.15.33:37128) 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.025+0000 7f50ba59c700 1 -- 172.21.15.33:0/2716130598 learned_addr learned my addr 172.21.15.33:0/2716130598 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50bad9d700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06e0e0 0x7f50bc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50b9d9b700 1 --2- 172.21.15.33:0/2716130598 >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 0x7f50bc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 -- 172.21.15.33:0/2716130598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06e0e0 msgr2=0x7f50bc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06e0e0 0x7f50bc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 -- 172.21.15.33:0/2716130598 >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 msgr2=0x7f50bc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2716130598 >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 0x7f50bc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 -- 172.21.15.33:0/2716130598 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50bc15a6b0 con 0x7f50bc159530 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50b9d9b700 1 --2- 172.21.15.33:0/2716130598 >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 0x7f50bc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc159530 0x7f50bc0ceba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b66e0 tx=0x7f50b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab5700690c92635 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50b959a700 1 -- 172.21.15.33:0/2716130598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b400b860 con 0x7f50bc159530 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50b959a700 1 -- 172.21.15.33:0/2716130598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50b400b9c0 con 0x7f50bc159530 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.026+0000 7f50b959a700 1 -- 172.21.15.33:0/2716130598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50b400bd60 con 0x7f50bc159530 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 -- 172.21.15.33:0/2716130598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc159530 msgr2=0x7f50bc0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc159530 0x7f50bc0ceba0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b66e0 tx=0x7f50b4009250 comp rx=0 tx=0).stop 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 -- 172.21.15.33:0/2716130598 shutdown_connections 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06e0e0 0x7f50bc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 --2- 172.21.15.33:0/2716130598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc159530 0x7f50bc0ceba0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 --2- 172.21.15.33:0/2716130598 >> v2:172.21.15.59:3300/0 conn(0x7f50bc06dc70 0x7f50bc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 -- 172.21.15.33:0/2716130598 >> 172.21.15.33:0/2716130598 conn(0x7f50bc0703a0 msgr2=0x7f50bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 -- 172.21.15.33:0/2716130598 shutdown_connections 2023-10-09T15:31:29.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.027+0000 7f50c0962700 1 -- 172.21.15.33:0/2716130598 wait complete. 2023-10-09T15:31:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 Processor -- start 2023-10-09T15:31:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 -- start start 2023-10-09T15:31:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06dc70 0x7f50bc148110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 0x7f50bc1562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b4b70 con 0x7f50bc06e0e0 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b56f0 con 0x7f50bc159530 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.028+0000 7f50c0962700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50bc0b4360 con 0x7f50bc06dc70 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37138/0 (socket says 172.21.15.33:37138) 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 -- 172.21.15.33:0/2821621140 learned_addr learned my addr 172.21.15.33:0/2821621140 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06dc70 0x7f50bc148110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50bad9d700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 0x7f50bc1562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 -- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06dc70 msgr2=0x7f50bc148110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06dc70 0x7f50bc148110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 -- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 msgr2=0x7f50bc1562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 0x7f50bc1562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 -- 172.21.15.33:0/2821621140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50b40094f0 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50bad9d700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 0x7f50bc1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b9d9b700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50a400c830 tx=0x7f50a4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011600 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50a4011760 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50a4011b20 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50bc0b5c50 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.029+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50bc0b4890 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.030+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50bc0b5de0 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.031+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f50a40193b0 con 0x7f50bc06e0e0 2023-10-09T15:31:29.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.031+0000 7f50b27fc700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.031+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f50a4084510 con 0x7f50bc06e0e0 2023-10-09T15:31:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.031+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.031+0000 7f50ba59c700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 0x7f509c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b66e0 tx=0x7f50b4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.035+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50a4051780 con 0x7f50bc06e0e0 2023-10-09T15:31:29.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.229+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f50bc15a990 con 0x7f50bc06e0e0 2023-10-09T15:31:29.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.229+0000 7f50b27fc700 1 -- 172.21.15.33:0/2821621140 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f50a4054da0 con 0x7f50bc06e0e0 2023-10-09T15:31:29.231 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.231+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 msgr2=0x7f509c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.231+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 0x7f509c0693e0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f50bc0b66e0 tx=0x7f50b4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 msgr2=0x7f50bc158330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f50a400c830 tx=0x7f50a4008040 comp rx=0 tx=0).stop 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 shutdown_connections 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f509c066f30 0x7f509c0693e0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f50bc159530 0x7f50bc1562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50bc06dc70 0x7f50bc148110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 --2- 172.21.15.33:0/2821621140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f50bc06e0e0 0x7f50bc158330 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 >> 172.21.15.33:0/2821621140 conn(0x7f50bc0703a0 msgr2=0x7f50bc15abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 shutdown_connections 2023-10-09T15:31:29.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.232+0000 7f50c0962700 1 -- 172.21.15.33:0/2821621140 wait complete. 2023-10-09T15:31:29.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.365+0000 7f12bf4bf700 1 Processor -- start 2023-10-09T15:31:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.365+0000 7f12bf4bf700 1 -- start start 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bf4bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12b8159530 0x7f12b80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bf4bf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80ccfd0 con 0x7f12b806e0e0 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bf4bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12b80cf0e0 con 0x7f12b806dc70 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bf4bf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12b815a3d0 con 0x7f12b8159530 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bda5c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f12b806e0e0 0x7f12b80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48380/0 (socket says 172.21.15.33:48380) 2023-10-09T15:31:29.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bd25b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12b8159530 0x7f12b80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.366+0000 7f12bda5c700 1 -- 172.21.15.33:0/2225014501 learned_addr learned my addr 172.21.15.33:0/2225014501 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.367+0000 7f12bd25b700 1 -- 172.21.15.33:0/2225014501 >> v1:172.21.15.59:6789/0 conn(0x7f12b806dc70 legacy=0x7f12b8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.367+0000 7f12bd25b700 1 -- 172.21.15.33:0/2225014501 >> v1:172.21.15.33:6789/0 conn(0x7f12b806e0e0 legacy=0x7f12b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.367+0000 7f12bd25b700 1 -- 172.21.15.33:0/2225014501 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b815a6b0 con 0x7f12b8159530 2023-10-09T15:31:29.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.367+0000 7f12bd25b700 1 --2- 172.21.15.33:0/2225014501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b80ceba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098e0 tx=0x7f12b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41b8808de91edb69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.369+0000 7f12b7fff700 1 -- 172.21.15.33:0/2225014501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b0009e80 con 0x7f12b8159530 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.369+0000 7f12b7fff700 1 -- 172.21.15.33:0/2225014501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b000b760 con 0x7f12b8159530 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.369+0000 7f12b7fff700 1 -- 172.21.15.33:0/2225014501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b000bae0 con 0x7f12b8159530 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 -- 172.21.15.33:0/2225014501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 msgr2=0x7f12b80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/2225014501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b80ceba0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f12b00098e0 tx=0x7f12b00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 -- 172.21.15.33:0/2225014501 shutdown_connections 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/2225014501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b80ceba0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 -- 172.21.15.33:0/2225014501 >> 172.21.15.33:0/2225014501 conn(0x7f12b80703a0 msgr2=0x7f12b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 -- 172.21.15.33:0/2225014501 shutdown_connections 2023-10-09T15:31:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.370+0000 7f12bf4bf700 1 -- 172.21.15.33:0/2225014501 wait complete. 2023-10-09T15:31:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.371+0000 7f12bf4bf700 1 Processor -- start 2023-10-09T15:31:29.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.371+0000 7f12bf4bf700 1 -- start start 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b806dc70 0x7f12b816e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b806e0e0 0x7f12b815c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b816dbd0 con 0x7f12b8159530 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12b816d5c0 con 0x7f12b806dc70 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bf4bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12b8152530 con 0x7f12b806e0e0 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bda5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bda5c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37148/0 (socket says 172.21.15.33:37148) 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bda5c700 1 -- 172.21.15.33:0/1347522005 learned_addr learned my addr 172.21.15.33:0/1347522005 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:29.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bd25b700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b806dc70 0x7f12b816e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.372+0000 7f12bca5a700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b806e0e0 0x7f12b815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 -- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b806e0e0 msgr2=0x7f12b815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b806e0e0 0x7f12b815c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 -- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b806dc70 msgr2=0x7f12b816e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b806dc70 0x7f12b816e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 -- 172.21.15.33:0/1347522005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12b0009420 con 0x7f12b8159530 2023-10-09T15:31:29.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.373+0000 7f12bda5c700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f12a8002230 tx=0x7f12a8001b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.374+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a800aa80 con 0x7f12b8159530 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.374+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12a800abe0 con 0x7f12b8159530 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.374+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12b816ab90 con 0x7f12b8159530 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.374+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12a80070f0 con 0x7f12b8159530 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.374+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12b816ae70 con 0x7f12b8159530 2023-10-09T15:31:29.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.375+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12b804c3c0 con 0x7f12b8159530 2023-10-09T15:31:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.376+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f12a80074a0 con 0x7f12b8159530 2023-10-09T15:31:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.376+0000 7f12b57fa700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 0x7f12a40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.376+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12a80849c0 con 0x7f12b8159530 2023-10-09T15:31:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.376+0000 7f12bd25b700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 0x7f12a40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.377+0000 7f12bd25b700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 0x7f12a40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12b00093f0 tx=0x7f12b0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.380+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a8051c30 con 0x7f12b8159530 2023-10-09T15:31:29.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.575+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12b815a990 con 0x7f12b8159530 2023-10-09T15:31:29.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.576+0000 7f12b57fa700 1 -- 172.21.15.33:0/1347522005 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f12a8055250 con 0x7f12b8159530 2023-10-09T15:31:29.577 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 msgr2=0x7f12a40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 0x7f12a40693e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f12b00093f0 tx=0x7f12b0016000 comp rx=0 tx=0).stop 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 msgr2=0x7f12b8145ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f12a8002230 tx=0x7f12a8001b90 comp rx=0 tx=0).stop 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 shutdown_connections 2023-10-09T15:31:29.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12a4066f30 0x7f12a40693e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12b8159530 0x7f12b8145ce0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12b806dc70 0x7f12b816e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 --2- 172.21.15.33:0/1347522005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12b806e0e0 0x7f12b815c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 >> 172.21.15.33:0/1347522005 conn(0x7f12b80703a0 msgr2=0x7f12b80d0850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 shutdown_connections 2023-10-09T15:31:29.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.578+0000 7f12bf4bf700 1 -- 172.21.15.33:0/1347522005 wait complete. 2023-10-09T15:31:29.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.709+0000 7fd3b341f700 1 Processor -- start 2023-10-09T15:31:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.709+0000 7fd3b341f700 1 -- start start 2023-10-09T15:31:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b341f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3ac153c30 0x7fd3ac15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b341f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac15de50 0x7fd3ac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b341f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ac15afd0 con 0x7fd3ac0cef40 2023-10-09T15:31:29.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b341f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ac15b2b0 con 0x7fd3ac153c30 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b341f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac15b590 con 0x7fd3ac15de50 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b241d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3ac153c30 0x7fd3ac15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b2c1e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd3ac0cef40 0x7fd3ac06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48384/0 (socket says 172.21.15.33:48384) 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b2c1e700 1 -- 172.21.15.33:0/1340676153 learned_addr learned my addr 172.21.15.33:0/1340676153 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b1c1c700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac15de50 0x7fd3ac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b241d700 1 -- 172.21.15.33:0/1340676153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac15de50 msgr2=0x7fd3ac0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b241d700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac15de50 0x7fd3ac0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b241d700 1 -- 172.21.15.33:0/1340676153 >> v1:172.21.15.33:6789/0 conn(0x7fd3ac0cef40 legacy=0x7fd3ac06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b241d700 1 -- 172.21.15.33:0/1340676153 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ac15b870 con 0x7fd3ac153c30 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.710+0000 7fd3b141b700 1 -- 172.21.15.33:0/1340676153 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3616338503 0 0) 0x7fd3ac15afd0 con 0x7fd3ac0cef40 2023-10-09T15:31:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b241d700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac153c30 0x7fd3ac15a5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098e0 tx=0x7fd3a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516d07d9d48a2d23 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b141b700 1 -- 172.21.15.33:0/1340676153 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400b640 con 0x7fd3ac153c30 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b141b700 1 -- 172.21.15.33:0/1340676153 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a400b7a0 con 0x7fd3ac153c30 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b141b700 1 -- 172.21.15.33:0/1340676153 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400bb40 con 0x7fd3ac153c30 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 -- 172.21.15.33:0/1340676153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac153c30 msgr2=0x7fd3ac15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac153c30 0x7fd3ac15a5e0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd3a40098e0 tx=0x7fd3a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 -- 172.21.15.33:0/1340676153 shutdown_connections 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac153c30 0x7fd3ac15a5e0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 --2- 172.21.15.33:0/1340676153 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac15de50 0x7fd3ac0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 -- 172.21.15.33:0/1340676153 >> 172.21.15.33:0/1340676153 conn(0x7fd3ac0703a0 msgr2=0x7fd3ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 -- 172.21.15.33:0/1340676153 shutdown_connections 2023-10-09T15:31:29.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.711+0000 7fd3b341f700 1 -- 172.21.15.33:0/1340676153 wait complete. 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.712+0000 7fd3b341f700 1 Processor -- start 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.712+0000 7fd3b341f700 1 -- start start 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac153c30 0x7fd3ac0b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 0x7fd3ac169b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b6150 con 0x7fd3ac0cef40 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b1bd0 con 0x7fd3ac15de50 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b341f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ac0b44b0 con 0x7fd3ac153c30 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b241d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b241d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37164/0 (socket says 172.21.15.33:37164) 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b241d700 1 -- 172.21.15.33:0/3798331754 learned_addr learned my addr 172.21.15.33:0/3798331754 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b1c1c700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac153c30 0x7fd3ac0b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.713+0000 7fd3b2c1e700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 0x7fd3ac169b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 -- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac153c30 msgr2=0x7fd3ac0b58e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac153c30 0x7fd3ac0b58e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 -- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 msgr2=0x7fd3ac169b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 0x7fd3ac169b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 -- 172.21.15.33:0/3798331754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a4009420 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b2c1e700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 0x7fd3ac169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b241d700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009f80 tx=0x7fd3a4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a400bb20 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3a4000c90 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ac151200 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3a4011650 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.714+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ac0b1580 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.715+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ac04c3c0 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.715+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd3a4011a00 con 0x7fd3ac0cef40 2023-10-09T15:31:29.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.716+0000 7fd3aa7fc700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 0x7fd3980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.716+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd3a4085b40 con 0x7fd3ac0cef40 2023-10-09T15:31:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.716+0000 7fd3b1c1c700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 0x7fd3980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:29.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.716+0000 7fd3b1c1c700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 0x7fd3980693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0ca560 tx=0x7fd3a00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:29.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.720+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3a4052db0 con 0x7fd3ac0cef40 2023-10-09T15:31:29.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.918+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd3ac15d9f0 con 0x7fd3ac0cef40 2023-10-09T15:31:29.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.919+0000 7fd3aa7fc700 1 -- 172.21.15.33:0/3798331754 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fd3a4029090 con 0x7fd3ac0cef40 2023-10-09T15:31:29.920 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:29.920 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:29.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 msgr2=0x7fd3980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 0x7fd3980693e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fd3ac0ca560 tx=0x7fd3a00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 msgr2=0x7fd3ac0b3f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3a4009f80 tx=0x7fd3a4017000 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 shutdown_connections 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd398066f30 0x7fd3980693e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3ac0cef40 0x7fd3ac0b3f70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3ac15de50 0x7fd3ac169b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 --2- 172.21.15.33:0/3798331754 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3ac153c30 0x7fd3ac0b58e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 >> 172.21.15.33:0/3798331754 conn(0x7fd3ac0703a0 msgr2=0x7fd3ac0c5d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 shutdown_connections 2023-10-09T15:31:29.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:29.921+0000 7fd3b341f700 1 -- 172.21.15.33:0/3798331754 wait complete. 2023-10-09T15:31:29.934 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:29.935 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:30.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.057+0000 7f34ec8ba700 1 Processor -- start 2023-10-09T15:31:30.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.057+0000 7f34ec8ba700 1 -- start start 2023-10-09T15:31:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34ec8ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e806abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34ec8ba700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34e813f780 0x7f34e813fc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34ec8ba700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34e806b290 con 0x7f34e80c7fb0 2023-10-09T15:31:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34ec8ba700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34e806bf10 con 0x7f34e813f780 2023-10-09T15:31:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34ec8ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8140140 con 0x7f34e80c7be0 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f34e813f780 0x7f34e813fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f34e80c7fb0 0x7f34e815a990 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48400/0 (socket says 172.21.15.33:48400) 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e659c700 1 -- 172.21.15.33:0/2524783760 learned_addr learned my addr 172.21.15.33:0/2524783760 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e6d9d700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e806abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 -- 172.21.15.33:0/2524783760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 msgr2=0x7f34e806abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e806abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 -- 172.21.15.33:0/2524783760 >> v1:172.21.15.33:6789/0 conn(0x7f34e80c7fb0 legacy=0x7f34e815a990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 -- 172.21.15.33:0/2524783760 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e806b570 con 0x7f34e813f780 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e5d9b700 1 -- 172.21.15.33:0/2524783760 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4268113250 0 0) 0x7f34e806b290 con 0x7f34e80c7fb0 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.058+0000 7f34e759e700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e813f780 0x7f34e813fc00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009e90 tx=0x7f34e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a5564646f0f2146 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34e5d9b700 1 -- 172.21.15.33:0/2524783760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e000e070 con 0x7f34e813f780 2023-10-09T15:31:30.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34e5d9b700 1 -- 172.21.15.33:0/2524783760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e000bbf0 con 0x7f34e813f780 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34e5d9b700 1 -- 172.21.15.33:0/2524783760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e0012430 con 0x7f34e813f780 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 -- 172.21.15.33:0/2524783760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e813f780 msgr2=0x7f34e813fc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e813f780 0x7f34e813fc00 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f34e0009e90 tx=0x7f34e0009780 comp rx=0 tx=0).stop 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 -- 172.21.15.33:0/2524783760 shutdown_connections 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e813f780 0x7f34e813fc00 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/2524783760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e806abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 -- 172.21.15.33:0/2524783760 >> 172.21.15.33:0/2524783760 conn(0x7f34e806d110 msgr2=0x7f34e80cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 -- 172.21.15.33:0/2524783760 shutdown_connections 2023-10-09T15:31:30.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.059+0000 7f34ec8ba700 1 -- 172.21.15.33:0/2524783760 wait complete. 2023-10-09T15:31:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.061+0000 7f34ec8ba700 1 Processor -- start 2023-10-09T15:31:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.061+0000 7f34ec8ba700 1 -- start start 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e8156d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e813f780 0x7f34e8166a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e80c6040 con 0x7f34e80c7fb0 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34e8157400 con 0x7f34e813f780 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34e81576e0 con 0x7f34e80c7be0 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37180/0 (socket says 172.21.15.33:37180) 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 -- 172.21.15.33:0/1866405819 learned_addr learned my addr 172.21.15.33:0/1866405819 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e6d9d700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e8156d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 -- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 msgr2=0x7f34e8156d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e8156d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e759e700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e813f780 0x7f34e8166a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 -- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e813f780 msgr2=0x7f34e8166a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e813f780 0x7f34e8166a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 -- 172.21.15.33:0/1866405819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0009a20 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34e659c700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c810 tx=0x7f34dc007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc005c00 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34dc005d60 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34e81579c0 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.062+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34dc007320 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.063+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34e8157f80 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.064+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34e81581a0 con 0x7f34e80c7fb0 2023-10-09T15:31:30.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.064+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f34dc01b400 con 0x7f34e80c7fb0 2023-10-09T15:31:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.064+0000 7f34ceffd700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.064+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34dc084050 con 0x7f34e80c7fb0 2023-10-09T15:31:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.064+0000 7f34e6d9d700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.065+0000 7f34e6d9d700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 0x7f34d40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f34e80cb580 tx=0x7f34d8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.068+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f34dc051340 con 0x7f34e80c7fb0 2023-10-09T15:31:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.261+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34e804c3c0 con 0x7f34e80c7fb0 2023-10-09T15:31:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.261+0000 7f34ceffd700 1 -- 172.21.15.33:0/1866405819 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34dc054960 con 0x7f34e80c7fb0 2023-10-09T15:31:30.263 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.263+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 msgr2=0x7f34d40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.263+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 0x7f34d40693e0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f34e80cb580 tx=0x7f34d8008040 comp rx=0 tx=0).stop 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.263+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 msgr2=0x7f34e80c5b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.263+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f34dc00c810 tx=0x7f34dc007db0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 shutdown_connections 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34d4066f30 0x7f34d40693e0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34e813f780 0x7f34e8166a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34e80c7be0 0x7f34e8156d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 --2- 172.21.15.33:0/1866405819 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34e80c7fb0 0x7f34e80c5b00 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 >> 172.21.15.33:0/1866405819 conn(0x7f34e806d110 msgr2=0x7f34e80c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 shutdown_connections 2023-10-09T15:31:30.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.264+0000 7f34ec8ba700 1 -- 172.21.15.33:0/1866405819 wait complete. 2023-10-09T15:31:30.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.397+0000 7ff088f7a700 1 Processor -- start 2023-10-09T15:31:30.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.398+0000 7ff088f7a700 1 -- start start 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.398+0000 7ff088f7a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 0x7ff084159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.398+0000 7ff088f7a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff08406e0e0 0x7ff0840cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.398+0000 7ff088f7a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0840ccfd0 con 0x7ff084159530 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff088f7a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08415a3d0 con 0x7ff08406e0e0 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff088f7a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff08415a6b0 con 0x7ff08406dc70 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff084159530 0x7ff0840ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48416/0 (socket says 172.21.15.33:48416) 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08259c700 1 -- 172.21.15.33:0/2086856074 learned_addr learned my addr 172.21.15.33:0/2086856074 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 --2- 172.21.15.33:0/2086856074 >> v2:172.21.15.33:3300/0 conn(0x7ff08406e0e0 0x7ff0840cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff081d9b700 1 --2- 172.21.15.33:0/2086856074 >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 0x7ff084159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08159a700 1 -- 172.21.15.33:0/2086856074 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1456844900 0 0) 0x7ff0840ccfd0 con 0x7ff084159530 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08159a700 1 -- 172.21.15.33:0/2086856074 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff070003570 con 0x7ff084159530 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 -- 172.21.15.33:0/2086856074 >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 msgr2=0x7ff084159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 --2- 172.21.15.33:0/2086856074 >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 0x7ff084159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 -- 172.21.15.33:0/2086856074 >> v1:172.21.15.33:6789/0 conn(0x7ff084159530 legacy=0x7ff0840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 -- 172.21.15.33:0/2086856074 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff08415a990 con 0x7ff08406e0e0 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff081d9b700 1 --2- 172.21.15.33:0/2086856074 >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 0x7ff084159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff082d9d700 1 --2- 172.21.15.33:0/2086856074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08406e0e0 0x7ff0840cb6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b66e0 tx=0x7ff07c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4450a91685d8b0ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08159a700 1 -- 172.21.15.33:0/2086856074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c00e070 con 0x7ff08406e0e0 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08159a700 1 -- 172.21.15.33:0/2086856074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c00bb60 con 0x7ff08406e0e0 2023-10-09T15:31:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.399+0000 7ff08159a700 1 -- 172.21.15.33:0/2086856074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c012430 con 0x7ff08406e0e0 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 -- 172.21.15.33:0/2086856074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08406e0e0 msgr2=0x7ff0840cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 --2- 172.21.15.33:0/2086856074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08406e0e0 0x7ff0840cb6f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7ff0840b66e0 tx=0x7ff07c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 -- 172.21.15.33:0/2086856074 shutdown_connections 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 --2- 172.21.15.33:0/2086856074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff08406e0e0 0x7ff0840cb6f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 --2- 172.21.15.33:0/2086856074 >> v2:172.21.15.59:3300/0 conn(0x7ff08406dc70 0x7ff084159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 -- 172.21.15.33:0/2086856074 >> 172.21.15.33:0/2086856074 conn(0x7ff0840703a0 msgr2=0x7ff0840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 -- 172.21.15.33:0/2086856074 shutdown_connections 2023-10-09T15:31:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.400+0000 7ff088f7a700 1 -- 172.21.15.33:0/2086856074 wait complete. 2023-10-09T15:31:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.401+0000 7ff088f7a700 1 Processor -- start 2023-10-09T15:31:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.401+0000 7ff088f7a700 1 -- start start 2023-10-09T15:31:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff08406dc70 0x7ff084150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff08406e0e0 0x7ff08415d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0840b4670 con 0x7ff084159530 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff084151270 con 0x7ff08406dc70 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff088f7a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff084151730 con 0x7ff08406e0e0 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37198/0 (socket says 172.21.15.33:37198) 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 -- 172.21.15.33:0/1793905353 learned_addr learned my addr 172.21.15.33:0/1793905353 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff081d9b700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff08406e0e0 0x7ff08415d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff08259c700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff08406dc70 0x7ff084150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 -- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff08406e0e0 msgr2=0x7ff08415d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff08406e0e0 0x7ff08415d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 -- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff08406dc70 msgr2=0x7ff084150d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff08406dc70 0x7ff084150d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 -- 172.21.15.33:0/1793905353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07c009a20 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff082d9d700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b6c0 tx=0x7ff07c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.402+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c027470 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.403+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07c0275f0 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.403+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0840b4060 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.403+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07c0279b0 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.403+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0840b4300 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.403+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0840b4820 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.404+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff07c024070 con 0x7ff084159530 2023-10-09T15:31:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.404+0000 7ff07a7fc700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 0x7ff0640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.404+0000 7ff08259c700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 0x7ff0640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.404+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff07c086e50 con 0x7ff084159530 2023-10-09T15:31:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.405+0000 7ff08259c700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 0x7ff0640693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff074007fd0 tx=0x7ff074009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.409+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0840b4820 con 0x7ff084159530 2023-10-09T15:31:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.602+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff0840b4820 con 0x7ff084159530 2023-10-09T15:31:30.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.602+0000 7ff07a7fc700 1 -- 172.21.15.33:0/1793905353 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff0840b4820 con 0x7ff084159530 2023-10-09T15:31:30.604 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.604+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 msgr2=0x7ff0640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.604+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 0x7ff0640693e0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7ff074007fd0 tx=0x7ff074009040 comp rx=0 tx=0).stop 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.604+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 msgr2=0x7ff08415d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.604+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7ff07c00b6c0 tx=0x7ff07c019000 comp rx=0 tx=0).stop 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 shutdown_connections 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066f30 0x7ff0640693e0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff084159530 0x7ff08415d900 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff08406dc70 0x7ff084150d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 --2- 172.21.15.33:0/1793905353 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff08406e0e0 0x7ff08415d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 >> 172.21.15.33:0/1793905353 conn(0x7ff0840703a0 msgr2=0x7ff084154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 shutdown_connections 2023-10-09T15:31:30.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.605+0000 7ff088f7a700 1 -- 172.21.15.33:0/1793905353 wait complete. 2023-10-09T15:31:30.617 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:30.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.740+0000 7f47f54aa700 1 Processor -- start 2023-10-09T15:31:30.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.740+0000 7f47f54aa700 1 -- start start 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.740+0000 7f47f54aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47f00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.740+0000 7f47f54aa700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f00ccfd0 con 0x7f47f006dc70 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47f54aa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f015a3d0 con 0x7f47f0159530 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47f54aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f015a6b0 con 0x7f47f006e0e0 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47ee7fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f47f006dc70 0x7f47f0159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48736/0 (socket says 172.21.15.33:48736) 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47ee7fc700 1 -- 172.21.15.33:0/170064393 learned_addr learned my addr 172.21.15.33:0/170064393 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47ef7fe700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47f00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3846702222 0 0) 0x7f47f00ccfd0 con 0x7f47f006dc70 2023-10-09T15:31:30.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc003570 con 0x7f47f006dc70 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3293563399 0 0) 0x7f47dc003570 con 0x7f47f006dc70 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 msgr2=0x7f47f00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47f00cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 >> v1:172.21.15.59:6789/0 conn(0x7f47f0159530 legacy=0x7f47f00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f015a990 con 0x7f47f006dc70 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f47d8001470 con 0x7f47f006dc70 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 >> v1:172.21.15.33:6789/0 conn(0x7f47f006dc70 legacy=0x7f47f0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47dc003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47dc004810 0x7f47dc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47dc0051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f015a6b0 con 0x7f47dc003a90 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc00bbc0 con 0x7f47dc004810 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47dc00bd80 con 0x7f47f006e0e0 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.741+0000 7f47eeffd700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47dc003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47ee7fc700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47dc004810 0x7f47dc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47ef7fe700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47dc0051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 -- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 msgr2=0x7f47dc0051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:30.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f006e0e0 0x7f47dc0051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 -- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47dc004810 msgr2=0x7f47dc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47dc004810 0x7f47dc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 -- 172.21.15.33:0/170064393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47dc003570 con 0x7f47dc003a90 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47eeffd700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47dc003ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47e80018b0 tx=0x7f47e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=309f5e681b61373c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8012420 con 0x7f47dc003a90 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8012580 con 0x7f47dc003a90 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47edffb700 1 -- 172.21.15.33:0/170064393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8012920 con 0x7f47dc003a90 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47f54aa700 1 -- 172.21.15.33:0/170064393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 msgr2=0x7f47dc003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47f54aa700 1 --2- 172.21.15.33:0/170064393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47dc003ea0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f47e80018b0 tx=0x7f47e8007d30 comp rx=0 tx=0).stop 2023-10-09T15:31:30.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.742+0000 7f47ef7fe700 1 -- 172.21.15.33:0/170064393 reap_dead start 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.743+0000 7f47f54aa700 1 -- 172.21.15.33:0/170064393 shutdown_connections 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.743+0000 7f47f54aa700 1 -- 172.21.15.33:0/170064393 >> 172.21.15.33:0/170064393 conn(0x7f47f00703a0 msgr2=0x7f47f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.743+0000 7f47f54aa700 1 -- 172.21.15.33:0/170064393 shutdown_connections 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.743+0000 7f47f54aa700 1 -- 172.21.15.33:0/170064393 wait complete. 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.744+0000 7f47f54aa700 1 Processor -- start 2023-10-09T15:31:30.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.744+0000 7f47f54aa700 1 -- start start 2023-10-09T15:31:30.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.744+0000 7f47f54aa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.744+0000 7f47f54aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 0x7f47f0152920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f0157ec0 0x7f47f00b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f0152e60 con 0x7f47dc003a90 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01530e0 con 0x7f47f0157ec0 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f01533c0 con 0x7f47f0154180 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34950/0 (socket says 172.21.15.33:34950) 2023-10-09T15:31:30.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 -- 172.21.15.33:0/3626329255 learned_addr learned my addr 172.21.15.33:0/3626329255 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47ee7fc700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 0x7f47f0152920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47ef7fe700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f0157ec0 0x7f47f00b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 -- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 msgr2=0x7f47f0152920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 0x7f47f0152920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 -- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f0157ec0 msgr2=0x7f47f00b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f0157ec0 0x7f47f00b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 -- 172.21.15.33:0/3626329255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f01536a0 con 0x7f47dc003a90 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47ee7fc700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 0x7f47f0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47eeffd700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c3f0 tx=0x7f47e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8001200 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8012c90 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47f0153980 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e8012e00 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.745+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f0158360 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.746+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f0153ea0 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.747+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f47e801f620 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.747+0000 7f47e6ffd700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 0x7f47d00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.747+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47e8085c50 con 0x7f47dc003a90 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.747+0000 7f47ee7fc700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 0x7f47d00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:30.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.747+0000 7f47ee7fc700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 0x7f47d00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000e10 tx=0x7f47d8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:30.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.751+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e808b020 con 0x7f47dc003a90 2023-10-09T15:31:30.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.944+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f47f0154e00 con 0x7f47dc003a90 2023-10-09T15:31:30.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.944+0000 7f47e6ffd700 1 -- 172.21.15.33:0/3626329255 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f47e8024020 con 0x7f47dc003a90 2023-10-09T15:31:30.945 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 msgr2=0x7f47d00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 0x7f47d00693e0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47d8000e10 tx=0x7f47d8009040 comp rx=0 tx=0).stop 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 msgr2=0x7f47f00c8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f47e800c3f0 tx=0x7f47e8015000 comp rx=0 tx=0).stop 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 shutdown_connections 2023-10-09T15:31:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47d0066f30 0x7f47d00693e0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47dc003a90 0x7f47f00c8a80 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f0157ec0 0x7f47f00b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 --2- 172.21.15.33:0/3626329255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f0154180 0x7f47f0152920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 >> 172.21.15.33:0/3626329255 conn(0x7f47f00703a0 msgr2=0x7f47f00d0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 shutdown_connections 2023-10-09T15:31:30.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:30.946+0000 7f47f54aa700 1 -- 172.21.15.33:0/3626329255 wait complete. 2023-10-09T15:31:31.020 INFO:tasks.cephfs_test_runner:Starting test: test_volume_create (tasks.cephfs.test_volumes.TestVolumes) That the volume can be created and then cleans up 2023-10-09T15:31:31.020 INFO:tasks.cephfs_test_runner:test_volume_create (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:31:31.020 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-09T15:31:31.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.139+0000 7ff9e489c700 1 Processor -- start 2023-10-09T15:31:31.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.139+0000 7ff9e489c700 1 -- start start 2023-10-09T15:31:31.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9e00cef40 0x7ff9e006d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e015afd0 con 0x7ff9e00cef40 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9e015b2b0 con 0x7ff9e015de50 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9e489c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e015b590 con 0x7ff9e0153c30 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9e00cef40 0x7ff9e006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9e00cef40 0x7ff9e006d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34962/0 (socket says 172.21.15.33:34962) 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 -- 172.21.15.33:0/272942738 learned_addr learned my addr 172.21.15.33:0/272942738 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9ded9d700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9de59c700 1 --2- 172.21.15.33:0/272942738 >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 -- 172.21.15.33:0/272942738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 msgr2=0x7ff9e015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:31.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 -- 172.21.15.33:0/272942738 >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 msgr2=0x7ff9e00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 --2- 172.21.15.33:0/272942738 >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9df59e700 1 -- 172.21.15.33:0/272942738 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9e015b870 con 0x7ff9e00cef40 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.140+0000 7ff9de59c700 1 --2- 172.21.15.33:0/272942738 >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9df59e700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e006d790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006e800 tx=0x7ff9d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa86c1da602aabc6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9ddd9b700 1 -- 172.21.15.33:0/272942738 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800b860 con 0x7ff9e00cef40 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9ddd9b700 1 -- 172.21.15.33:0/272942738 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d800b9c0 con 0x7ff9e00cef40 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9ddd9b700 1 -- 172.21.15.33:0/272942738 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d800bd60 con 0x7ff9e00cef40 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 -- 172.21.15.33:0/272942738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 msgr2=0x7ff9e006d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e006d790 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7ff9e006e800 tx=0x7ff9d8009250 comp rx=0 tx=0).stop 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 -- 172.21.15.33:0/272942738 shutdown_connections 2023-10-09T15:31:31.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e006d790 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 --2- 172.21.15.33:0/272942738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 --2- 172.21.15.33:0/272942738 >> v2:172.21.15.59:3300/0 conn(0x7ff9e015de50 0x7ff9e00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 -- 172.21.15.33:0/272942738 >> 172.21.15.33:0/272942738 conn(0x7ff9e00703a0 msgr2=0x7ff9e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:31.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 -- 172.21.15.33:0/272942738 shutdown_connections 2023-10-09T15:31:31.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.141+0000 7ff9e489c700 1 -- 172.21.15.33:0/272942738 wait complete. 2023-10-09T15:31:31.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 Processor -- start 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 -- start start 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e014cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e015de50 0x7ff9e00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e014d010 con 0x7ff9e00cef40 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e014ecd0 con 0x7ff9e015de50 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9e489c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9e00c8030 con 0x7ff9e0153c30 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.143+0000 7ff9ded9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34978/0 (socket says 172.21.15.33:34978) 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 -- 172.21.15.33:0/3718752803 learned_addr learned my addr 172.21.15.33:0/3718752803 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9de59c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e014cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9df59e700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e015de50 0x7ff9e00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 -- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 msgr2=0x7ff9e014cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e014cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 -- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e015de50 msgr2=0x7ff9e00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e015de50 0x7ff9e00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 -- 172.21.15.33:0/3718752803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9d80094f0 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9ded9d700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000e190 tx=0x7ff9d0009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d000ecd0 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9d000ee30 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9d0014670 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9e014ef40 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.144+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9e014d3a0 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.145+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9e014f3e0 con 0x7ff9e00cef40 2023-10-09T15:31:31.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.146+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff9d0014a20 con 0x7ff9e00cef40 2023-10-09T15:31:31.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.146+0000 7ff9d6ffd700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 0x7ff9c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:31.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.146+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9d0084bc0 con 0x7ff9e00cef40 2023-10-09T15:31:31.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.146+0000 7ff9de59c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 0x7ff9c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:31.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.146+0000 7ff9de59c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 0x7ff9c00693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:31.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.150+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9d0051e30 con 0x7ff9e00cef40 2023-10-09T15:31:31.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:31.423+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7ff9e004c3c0 con 0x7ff9e00cef40 2023-10-09T15:31:32.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.377+0000 7ff9d6ffd700 1 -- 172.21.15.33:0/3718752803 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff9d0009a60 con 0x7ff9e00cef40 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.379+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 msgr2=0x7ff9c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.379+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 0x7ff9c00693e0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7ff9c8006fd0 tx=0x7ff9c8008040 comp rx=0 tx=0).stop 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 msgr2=0x7ff9e00b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ff9d000e190 tx=0x7ff9d0009920 comp rx=0 tx=0).stop 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 shutdown_connections 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9c0066f30 0x7ff9c00693e0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9e00cef40 0x7ff9e00b32d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9e015de50 0x7ff9e00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 --2- 172.21.15.33:0/3718752803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9e0153c30 0x7ff9e014cad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 >> 172.21.15.33:0/3718752803 conn(0x7ff9e00703a0 msgr2=0x7ff9e015a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:32.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 shutdown_connections 2023-10-09T15:31:32.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.380+0000 7ff9e489c700 1 -- 172.21.15.33:0/3718752803 wait complete. 2023-10-09T15:31:32.395 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:31:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.524+0000 7f84dea87700 1 Processor -- start 2023-10-09T15:31:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.524+0000 7f84dea87700 1 -- start start 2023-10-09T15:31:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dea87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 0x7f84d80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dea87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dea87700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84d80ccfd0 con 0x7f84d806dc70 2023-10-09T15:31:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dea87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84d80cf0e0 con 0x7f84d8159530 2023-10-09T15:31:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dea87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d815a3d0 con 0x7f84d806e0e0 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dc823700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 0x7f84d80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58540/0 (socket says 172.21.15.33:58540) 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 -- 172.21.15.33:0/2848204831 learned_addr learned my addr 172.21.15.33:0/2848204831 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84d7fff700 1 --1- 172.21.15.33:0/2848204831 >> v1:172.21.15.59:6789/0 conn(0x7f84d806dc70 0x7f84d8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:33086/0 (socket says 172.21.15.33:33086) 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 -- 172.21.15.33:0/2848204831 >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 msgr2=0x7f84d80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 --2- 172.21.15.33:0/2848204831 >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 0x7f84d80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 -- 172.21.15.33:0/2848204831 >> v1:172.21.15.59:6789/0 conn(0x7f84d806dc70 legacy=0x7f84d8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dd024700 1 -- 172.21.15.33:0/2848204831 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d815a6b0 con 0x7f84d806e0e0 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.525+0000 7f84dc823700 1 --2- 172.21.15.33:0/2848204831 >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 0x7f84d80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dd024700 1 --2- 172.21.15.33:0/2848204831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84c80099b0 tx=0x7f84c8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f68345326e69efa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84d77fe700 1 -- 172.21.15.33:0/2848204831 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c8009ea0 con 0x7f84d806e0e0 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84d77fe700 1 -- 172.21.15.33:0/2848204831 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84c800b860 con 0x7f84d806e0e0 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84d77fe700 1 -- 172.21.15.33:0/2848204831 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84c800bc00 con 0x7f84d806e0e0 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 -- 172.21.15.33:0/2848204831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 msgr2=0x7f84d80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 --2- 172.21.15.33:0/2848204831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f84c80099b0 tx=0x7f84c8009250 comp rx=0 tx=0).stop 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 -- 172.21.15.33:0/2848204831 shutdown_connections 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 --2- 172.21.15.33:0/2848204831 >> v2:172.21.15.59:3300/0 conn(0x7f84d8159530 0x7f84d80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 --2- 172.21.15.33:0/2848204831 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d806e0e0 0x7f84d80cb6f0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 -- 172.21.15.33:0/2848204831 >> 172.21.15.33:0/2848204831 conn(0x7f84d80703a0 msgr2=0x7f84d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 -- 172.21.15.33:0/2848204831 shutdown_connections 2023-10-09T15:31:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.526+0000 7f84dea87700 1 -- 172.21.15.33:0/2848204831 wait complete. 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.527+0000 7f84dea87700 1 Processor -- start 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 -- start start 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 0x7f84d814d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 0x7f84d80b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d816e2a0 con 0x7f84d806dc70 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80d0f40 con 0x7f84d806e0e0 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dea87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84d80d0330 con 0x7f84d8159530 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dc823700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dc823700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34994/0 (socket says 172.21.15.33:34994) 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.528+0000 7f84dc823700 1 -- 172.21.15.33:0/3733162385 learned_addr learned my addr 172.21.15.33:0/3733162385 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dd024700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 0x7f84d80b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84d7fff700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 0x7f84d814d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 -- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 msgr2=0x7f84d80b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 0x7f84d80b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 -- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 msgr2=0x7f84d814d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 0x7f84d814d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 -- 172.21.15.33:0/3733162385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84d0009a20 con 0x7f84d806dc70 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dd024700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 0x7f84d80b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84d7fff700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 0x7f84d814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dc823700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c0c0 tx=0x7f84d000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d000cd60 con 0x7f84d806dc70 2023-10-09T15:31:32.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84c80094f0 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84d000f040 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84d0014690 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.529+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84d80d08f0 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.530+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84d80d1220 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.531+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f84d0014a00 con 0x7f84d806dc70 2023-10-09T15:31:32.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.531+0000 7f84d4ff9700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 0x7f84b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.531+0000 7f84d7fff700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 0x7f84b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.531+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84d0085420 con 0x7f84d806dc70 2023-10-09T15:31:32.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.532+0000 7f84d7fff700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 0x7f84b80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007fd0 tx=0x7f84c0007e10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:32.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.536+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84d0052690 con 0x7f84d806dc70 2023-10-09T15:31:32.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.730+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f84d804c3c0 con 0x7f84d806dc70 2023-10-09T15:31:32.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.734+0000 7f84d4ff9700 1 -- 172.21.15.33:0/3733162385 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84d0014cb0 con 0x7f84d806dc70 2023-10-09T15:31:32.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 msgr2=0x7f84b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 0x7f84b80693e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f84c0007fd0 tx=0x7f84c0007e10 comp rx=0 tx=0).stop 2023-10-09T15:31:32.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 msgr2=0x7f84d816dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:32.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f84d000c0c0 tx=0x7f84d000b040 comp rx=0 tx=0).stop 2023-10-09T15:31:32.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 shutdown_connections 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84b8066f30 0x7f84b80693e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84d806dc70 0x7f84d816dd60 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84d8159530 0x7f84d80b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 --2- 172.21.15.33:0/3733162385 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84d806e0e0 0x7f84d814d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 >> 172.21.15.33:0/3733162385 conn(0x7f84d80703a0 msgr2=0x7f84d815c9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 shutdown_connections 2023-10-09T15:31:32.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:32.736+0000 7f84dea87700 1 -- 172.21.15.33:0/3733162385 wait complete. 2023-10-09T15:31:32.749 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:31:32.749 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:31:32.789 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:31:32.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:31:32.841 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:31:32.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:31:32.841 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 -f 2023-10-09T15:31:32.877 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:31:32.877 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:32.877 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:31:32.932 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:31:32.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:31:32.933 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 -f 2023-10-09T15:31:32.971 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:31:32.971 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:32.971 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:31:33.029 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.2... 2023-10-09T15:31:33.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:31:33.030 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.2 -f 2023-10-09T15:31:33.063 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:31:33.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:33.063 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T15:31:33.119 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.3... 2023-10-09T15:31:33.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:31:33.119 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.3 -f 2023-10-09T15:31:33.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:31:33.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:31:33.156 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T15:31:33.213 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:31:33.213 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:33.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.331+0000 7f50a22f6700 1 Processor -- start 2023-10-09T15:31:33.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.331+0000 7f50a22f6700 1 -- start start 2023-10-09T15:31:33.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a22f6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f509c0cb5a0 0x7f509c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a22f6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f509c0cd9e0 0x7f509c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a22f6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f509c15ae40 con 0x7f509c15a400 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a22f6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c0d13f0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a22f6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f509c15ab60 con 0x7f509c0cb5a0 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f509b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f509c0cd9e0 0x7f509c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a0893700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f509c15a400 0x7f509c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48746/0 (socket says 172.21.15.33:48746) 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f50a0893700 1 -- 172.21.15.33:0/1674677245 learned_addr learned my addr 172.21.15.33:0/1674677245 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.332+0000 7f509bfff700 1 --2- 172.21.15.33:0/1674677245 >> v2:172.21.15.59:3300/0 conn(0x7f509c0cb5a0 0x7f509c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509b7fe700 1 -- 172.21.15.33:0/1674677245 >> v2:172.21.15.59:3300/0 conn(0x7f509c0cb5a0 msgr2=0x7f509c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509b7fe700 1 --2- 172.21.15.33:0/1674677245 >> v2:172.21.15.59:3300/0 conn(0x7f509c0cb5a0 0x7f509c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509b7fe700 1 -- 172.21.15.33:0/1674677245 >> v1:172.21.15.33:6789/0 conn(0x7f509c15a400 legacy=0x7f509c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509b7fe700 1 -- 172.21.15.33:0/1674677245 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f509c0ccf00 con 0x7f509c0cd9e0 2023-10-09T15:31:33.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509affd700 1 -- 172.21.15.33:0/1674677245 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 881204419 0 0) 0x7f509c15ae40 con 0x7f509c15a400 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509b7fe700 1 --2- 172.21.15.33:0/1674677245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c159ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50900098e0 tx=0x7f50900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=364b144e1d188389 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509affd700 1 -- 172.21.15.33:0/1674677245 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5090009e80 con 0x7f509c0cd9e0 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509affd700 1 -- 172.21.15.33:0/1674677245 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f509000b820 con 0x7f509c0cd9e0 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.333+0000 7f509affd700 1 -- 172.21.15.33:0/1674677245 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000bba0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 -- 172.21.15.33:0/1674677245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 msgr2=0x7f509c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 --2- 172.21.15.33:0/1674677245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c159ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f50900098e0 tx=0x7f50900091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 -- 172.21.15.33:0/1674677245 shutdown_connections 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 --2- 172.21.15.33:0/1674677245 >> v2:172.21.15.59:3300/0 conn(0x7f509c0cb5a0 0x7f509c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 --2- 172.21.15.33:0/1674677245 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c159ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 -- 172.21.15.33:0/1674677245 >> 172.21.15.33:0/1674677245 conn(0x7f509c070e30 msgr2=0x7f509c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 -- 172.21.15.33:0/1674677245 shutdown_connections 2023-10-09T15:31:33.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.334+0000 7f50a22f6700 1 -- 172.21.15.33:0/1674677245 wait complete. 2023-10-09T15:31:33.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.335+0000 7f50a22f6700 1 Processor -- start 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.335+0000 7f50a22f6700 1 -- start start 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 0x7f509c1524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c15a400 0x7f509c0c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c152a30 con 0x7f509c0cd9e0 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0b4510 con 0x7f509c15a400 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f509c0b3660 con 0x7f509c0cb5a0 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35014/0 (socket says 172.21.15.33:35014) 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 -- 172.21.15.33:0/3253937821 learned_addr learned my addr 172.21.15.33:0/3253937821 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:33.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a0893700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c15a400 0x7f509c0c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509bfff700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 0x7f509c1524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 -- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 msgr2=0x7f509c1524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 0x7f509c1524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 -- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c15a400 msgr2=0x7f509c0c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c15a400 0x7f509c0c9ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 -- 172.21.15.33:0/3253937821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5090009420 con 0x7f509c0cd9e0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509bfff700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 0x7f509c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f509b7fe700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f509c06ea60 tx=0x7f5090017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f509000bba0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5090011420 con 0x7f509c0cd9e0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f509c0b3900 con 0x7f509c0cd9e0 2023-10-09T15:31:33.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.336+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50900117e0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.337+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f509c0b3ec0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.337+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f509c0b4680 con 0x7f509c0cd9e0 2023-10-09T15:31:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.338+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5090011b50 con 0x7f509c0cd9e0 2023-10-09T15:31:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.338+0000 7f5083fff700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 0x7f50880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.338+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5090085f60 con 0x7f509c0cd9e0 2023-10-09T15:31:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.338+0000 7f509bfff700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 0x7f50880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.339+0000 7f509bfff700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 0x7f50880693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f508c006fd0 tx=0x7f508c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.342+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50900531d0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.581+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f509c04c3c0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.582+0000 7f5083fff700 1 -- 172.21.15.33:0/3253937821 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f50900567f0 con 0x7f509c0cd9e0 2023-10-09T15:31:33.583 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:33.583 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 msgr2=0x7f50880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 0x7f50880693e0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f508c006fd0 tx=0x7f508c008040 comp rx=0 tx=0).stop 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 msgr2=0x7f509c0b49a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f509c06ea60 tx=0x7f5090017000 comp rx=0 tx=0).stop 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 shutdown_connections 2023-10-09T15:31:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5088066f30 0x7f50880693e0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f509c15a400 0x7f509c0c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f509c0cb5a0 0x7f509c1524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 --2- 172.21.15.33:0/3253937821 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f509c0cd9e0 0x7f509c0b49a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 >> 172.21.15.33:0/3253937821 conn(0x7f509c070e30 msgr2=0x7f509c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 shutdown_connections 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.584+0000 7f50a22f6700 1 -- 172.21.15.33:0/3253937821 wait complete. 2023-10-09T15:31:33.586 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:33.597 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:33.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.715+0000 7f605a529700 1 Processor -- start 2023-10-09T15:31:33.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.715+0000 7f605a529700 1 -- start start 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f605a529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f605415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f605a529700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f605415de50 0x7f60540cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f605a529700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f605415afd0 con 0x7f60540cef40 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f605a529700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f605415b2b0 con 0x7f605415de50 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f605a529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f605415b590 con 0x7f6054153c30 2023-10-09T15:31:33.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6059d28700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f60540cef40 0x7f605406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48756/0 (socket says 172.21.15.33:48756) 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6059d28700 1 -- 172.21.15.33:0/3698233066 learned_addr learned my addr 172.21.15.33:0/3698233066 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6058d26700 1 --2- 172.21.15.33:0/3698233066 >> v2:172.21.15.59:3300/0 conn(0x7f605415de50 0x7f60540cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6059527700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f605415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1337171419 0 0) 0x7f605415afd0 con 0x7f60540cef40 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.716+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f603c003570 con 0x7f60540cef40 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3296482989 0 0) 0x7f603c003570 con 0x7f60540cef40 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 msgr2=0x7f605415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f605415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 >> v2:172.21.15.59:3300/0 conn(0x7f605415de50 msgr2=0x7f60540cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 --2- 172.21.15.33:0/3698233066 >> v2:172.21.15.59:3300/0 conn(0x7f605415de50 0x7f60540cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f605415b870 con 0x7f60540cef40 2023-10-09T15:31:33.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f60440017f0 con 0x7f60540cef40 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 >> v1:172.21.15.33:6789/0 conn(0x7f60540cef40 legacy=0x7f605406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c003a60 0x7f603c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f603c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f603c004d50 0x7f603c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605415b2b0 con 0x7f603c004d50 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f605415b590 con 0x7f603c003a60 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f603c00ba60 con 0x7f6054153c30 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f603c004d50 0x7f603c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059527700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c003a60 0x7f603c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6058d26700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f603c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 -- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 msgr2=0x7f603c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:33.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054153c30 0x7f603c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 -- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c003a60 msgr2=0x7f603c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f603c003a60 0x7f603c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 -- 172.21.15.33:0/3698233066 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f603c003570 con 0x7f603c004d50 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6059d28700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f603c004d50 0x7f603c0051c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f604400a970 tx=0x7f6044002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2701a1909c265094 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.717+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044012440 con 0x7f603c004d50 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60440125c0 con 0x7f603c004d50 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f6053fff700 1 -- 172.21.15.33:0/3698233066 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6044012980 con 0x7f603c004d50 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 -- 172.21.15.33:0/3698233066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f603c004d50 msgr2=0x7f603c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 --2- 172.21.15.33:0/3698233066 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f603c004d50 0x7f603c0051c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f604400a970 tx=0x7f6044002210 comp rx=0 tx=0).stop 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f6059d28700 1 -- 172.21.15.33:0/3698233066 reap_dead start 2023-10-09T15:31:33.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 -- 172.21.15.33:0/3698233066 shutdown_connections 2023-10-09T15:31:33.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 -- 172.21.15.33:0/3698233066 >> 172.21.15.33:0/3698233066 conn(0x7f60540703a0 msgr2=0x7f60540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:33.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 -- 172.21.15.33:0/3698233066 shutdown_connections 2023-10-09T15:31:33.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.718+0000 7f605a529700 1 -- 172.21.15.33:0/3698233066 wait complete. 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.719+0000 7f605a529700 1 Processor -- start 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.719+0000 7f605a529700 1 -- start start 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 0x7f60540c77b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 0x7f60540b1bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540c89a0 con 0x7f6054152190 2023-10-09T15:31:33.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60540b4550 con 0x7f60540b17a0 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f605a529700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60540b2110 con 0x7f6054151dc0 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6058d26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6058d26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35038/0 (socket says 172.21.15.33:35038) 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6058d26700 1 -- 172.21.15.33:0/1881292191 learned_addr learned my addr 172.21.15.33:0/1881292191 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6059d28700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 0x7f60540b1bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6059527700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 0x7f60540c77b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6058d26700 1 -- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 msgr2=0x7f60540c77b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.720+0000 7f6058d26700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 0x7f60540c77b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6058d26700 1 -- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 msgr2=0x7f60540b1bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6058d26700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 0x7f60540b1bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6058d26700 1 -- 172.21.15.33:0/1881292191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60540c7d90 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6059d28700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 0x7f60540b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6059527700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 0x7f60540c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f6058d26700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6048011b10 tx=0x7f60480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800f990 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f604800faf0 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60540c8070 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f604800fe70 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.721+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60540c8630 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.722+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f605404c3c0 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.722+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6048014650 con 0x7f6054152190 2023-10-09T15:31:33.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.723+0000 7f60517fa700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 0x7f60400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.723+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6048018030 con 0x7f6054152190 2023-10-09T15:31:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.723+0000 7f6059527700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 0x7f60400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.723+0000 7f6059527700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 0x7f60400693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f604c0093f0 tx=0x7f604c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:33.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.727+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6048055ca0 con 0x7f6054152190 2023-10-09T15:31:33.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.922+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f60540b6300 con 0x7f6054152190 2023-10-09T15:31:33.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.923+0000 7f60517fa700 1 -- 172.21.15.33:0/1881292191 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f6048022090 con 0x7f6054152190 2023-10-09T15:31:33.924 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:33.924 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.925+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 msgr2=0x7f60400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.925+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 0x7f60400693e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f604c0093f0 tx=0x7f604c008040 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.925+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 msgr2=0x7f60540c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.925+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f6048011b10 tx=0x7f60480091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 shutdown_connections 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6040066f30 0x7f60400693e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60540b17a0 0x7f60540b1bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6054151dc0 0x7f60540c77b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 --2- 172.21.15.33:0/1881292191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6054152190 0x7f60540c9d50 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 >> 172.21.15.33:0/1881292191 conn(0x7f60540703a0 msgr2=0x7f605415bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 shutdown_connections 2023-10-09T15:31:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:33.926+0000 7f605a529700 1 -- 172.21.15.33:0/1881292191 wait complete. 2023-10-09T15:31:33.939 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:30:56.925426+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:30:58.022424+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:31:33.939 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:34.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.059+0000 7f15a45e8700 1 Processor -- start 2023-10-09T15:31:34.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 -- start start 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06dc70 0x7f159c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f159c06e0e0 0x7f159c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f159c0ccfd0 con 0x7f159c159530 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f159c15a3d0 con 0x7f159c06e0e0 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.060+0000 7f15a45e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c15a6b0 con 0x7f159c06dc70 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2384700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f159c159530 0x7f159c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48762/0 (socket says 172.21.15.33:48762) 2023-10-09T15:31:34.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f159c06e0e0 0x7f159c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2384700 1 -- 172.21.15.33:0/1451743217 learned_addr learned my addr 172.21.15.33:0/1451743217 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a1b83700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06dc70 0x7f159c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 -- 172.21.15.33:0/1451743217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06dc70 msgr2=0x7f159c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06dc70 0x7f159c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 -- 172.21.15.33:0/1451743217 >> v1:172.21.15.33:6789/0 conn(0x7f159c159530 legacy=0x7f159c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 -- 172.21.15.33:0/1451743217 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f159c15a990 con 0x7f159c06e0e0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a1382700 1 -- 172.21.15.33:0/1451743217 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 333784345 0 0) 0x7f159c0ccfd0 con 0x7f159c159530 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a2b85700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06e0e0 0x7f159c0cb6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f158c009e60 tx=0x7f158c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be5e9fcb732223c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a1382700 1 -- 172.21.15.33:0/1451743217 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c00e070 con 0x7f159c06e0e0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a1382700 1 -- 172.21.15.33:0/1451743217 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f158c00bc30 con 0x7f159c06e0e0 2023-10-09T15:31:34.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.061+0000 7f15a1382700 1 -- 172.21.15.33:0/1451743217 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f158c012430 con 0x7f159c06e0e0 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 -- 172.21.15.33:0/1451743217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06e0e0 msgr2=0x7f159c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06e0e0 0x7f159c0cb6f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f158c009e60 tx=0x7f158c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 -- 172.21.15.33:0/1451743217 shutdown_connections 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06e0e0 0x7f159c0cb6f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 --2- 172.21.15.33:0/1451743217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06dc70 0x7f159c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 -- 172.21.15.33:0/1451743217 >> 172.21.15.33:0/1451743217 conn(0x7f159c0703a0 msgr2=0x7f159c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 -- 172.21.15.33:0/1451743217 shutdown_connections 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.062+0000 7f15a45e8700 1 -- 172.21.15.33:0/1451743217 wait complete. 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.063+0000 7f15a45e8700 1 Processor -- start 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.063+0000 7f15a45e8700 1 -- start start 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 0x7f159c0c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c159530 0x7f159c0b4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c16a530 con 0x7f159c06dc70 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0cab00 con 0x7f159c159530 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f159c0c86c0 con 0x7f159c06e0e0 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35048/0 (socket says 172.21.15.33:35048) 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 -- 172.21.15.33:0/4062307222 learned_addr learned my addr 172.21.15.33:0/4062307222 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2b85700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c159530 0x7f159c0b4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a1b83700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 0x7f159c0c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 -- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 msgr2=0x7f159c0c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 0x7f159c0c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 -- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c159530 msgr2=0x7f159c0b4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c159530 0x7f159c0b4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 -- 172.21.15.33:0/4062307222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158c009a20 con 0x7f159c06dc70 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a1b83700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 0x7f159c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a2384700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f159400c5b0 tx=0x7f1594001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594005b30 con 0x7f159c06dc70 2023-10-09T15:31:34.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1594005c90 con 0x7f159c06dc70 2023-10-09T15:31:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f159c169920 con 0x7f159c06dc70 2023-10-09T15:31:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.064+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1594007300 con 0x7f159c06dc70 2023-10-09T15:31:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.065+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f159c169ee0 con 0x7f159c06dc70 2023-10-09T15:31:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.065+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f159c04c3c0 con 0x7f159c06dc70 2023-10-09T15:31:34.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.066+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f159401b3b0 con 0x7f159c06dc70 2023-10-09T15:31:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.066+0000 7f159a7fc700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 0x7f15880693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.066+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1594083a60 con 0x7f159c06dc70 2023-10-09T15:31:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.066+0000 7f15a1b83700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 0x7f15880693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.067+0000 7f15a1b83700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 0x7f15880693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1590006fd0 tx=0x7f1590008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.070+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1594050cd0 con 0x7f159c06dc70 2023-10-09T15:31:34.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.262+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f159c15ac70 con 0x7f159c06dc70 2023-10-09T15:31:34.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.262+0000 7f159a7fc700 1 -- 172.21.15.33:0/4062307222 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1594017020 con 0x7f159c06dc70 2023-10-09T15:31:34.263 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 msgr2=0x7f15880693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 0x7f15880693e0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1590006fd0 tx=0x7f1590008040 comp rx=0 tx=0).stop 2023-10-09T15:31:34.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 msgr2=0x7f159c0ca5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f159400c5b0 tx=0x7f1594001070 comp rx=0 tx=0).stop 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 shutdown_connections 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1588066f30 0x7f15880693e0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f159c06dc70 0x7f159c0ca5c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f159c159530 0x7f159c0b4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 --2- 172.21.15.33:0/4062307222 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f159c06e0e0 0x7f159c0c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 >> 172.21.15.33:0/4062307222 conn(0x7f159c0703a0 msgr2=0x7f159c15bb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 shutdown_connections 2023-10-09T15:31:34.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.264+0000 7f15a45e8700 1 -- 172.21.15.33:0/4062307222 wait complete. 2023-10-09T15:31:34.277 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:31:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.398+0000 7fcf88b43700 1 Processor -- start 2023-10-09T15:31:34.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.398+0000 7fcf88b43700 1 -- start start 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf88b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf840c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf88b43700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf840cdb70 0x7fcf840c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf88b43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf840c9310 con 0x7fcf84159c90 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf88b43700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf840ad990 con 0x7fcf840cdb70 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf88b43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840ce090 con 0x7fcf841598c0 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf840cdb70 0x7fcf840c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcf840cdb70 0x7fcf840c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35056/0 (socket says 172.21.15.33:35056) 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 -- 172.21.15.33:0/233301050 learned_addr learned my addr 172.21.15.33:0/233301050 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:34.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf8259c700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf840c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 -- 172.21.15.33:0/233301050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 msgr2=0x7fcf840c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf840c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 -- 172.21.15.33:0/233301050 >> v1:172.21.15.59:6789/0 conn(0x7fcf84159c90 legacy=0x7fcf840cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.399+0000 7fcf82d9d700 1 -- 172.21.15.33:0/233301050 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf840c8cc0 con 0x7fcf840cdb70 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf82d9d700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c43b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0099b0 tx=0x7fcf7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b03bea5d1a4217d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf8159a700 1 -- 172.21.15.33:0/233301050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00b860 con 0x7fcf840cdb70 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf8159a700 1 -- 172.21.15.33:0/233301050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf7c00b9c0 con 0x7fcf840cdb70 2023-10-09T15:31:34.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf8159a700 1 -- 172.21.15.33:0/233301050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf7c00bd60 con 0x7fcf840cdb70 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 -- 172.21.15.33:0/233301050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 msgr2=0x7fcf840c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c43b0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fcf7c0099b0 tx=0x7fcf7c009250 comp rx=0 tx=0).stop 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 -- 172.21.15.33:0/233301050 shutdown_connections 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c43b0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 --2- 172.21.15.33:0/233301050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf840c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 -- 172.21.15.33:0/233301050 >> 172.21.15.33:0/233301050 conn(0x7fcf84088000 msgr2=0x7fcf840883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 -- 172.21.15.33:0/233301050 shutdown_connections 2023-10-09T15:31:34.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.400+0000 7fcf88b43700 1 -- 172.21.15.33:0/233301050 wait complete. 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.401+0000 7fcf88b43700 1 Processor -- start 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.401+0000 7fcf88b43700 1 -- start start 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf84156130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 0x7fcf840ac040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c6f30 con 0x7fcf840cdb70 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c7210 con 0x7fcf84159c90 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf88b43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840c74f0 con 0x7fcf841598c0 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf8259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35068/0 (socket says 172.21.15.33:35068) 2023-10-09T15:31:34.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf8259c700 1 -- 172.21.15.33:0/2739465330 learned_addr learned my addr 172.21.15.33:0/2739465330 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.402+0000 7fcf82d9d700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 0x7fcf840ac040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf81d9b700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf84156130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 -- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 msgr2=0x7fcf84156130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf84156130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 -- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 msgr2=0x7fcf840ac040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 0x7fcf840ac040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 -- 172.21.15.33:0/2739465330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf7c0094f0 con 0x7fcf840cdb70 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf82d9d700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 0x7fcf840ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf8259c700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e190 tx=0x7fcf74009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74014420 con 0x7fcf840cdb70 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74014580 con 0x7fcf840cdb70 2023-10-09T15:31:34.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf840c77d0 con 0x7fcf840cdb70 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74014940 con 0x7fcf840cdb70 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.403+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf840c6b90 con 0x7fcf840cdb70 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.404+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf8404c3c0 con 0x7fcf840cdb70 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.404+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcf74014cf0 con 0x7fcf840cdb70 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.405+0000 7fcf727fc700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.405+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf74084e10 con 0x7fcf840cdb70 2023-10-09T15:31:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.405+0000 7fcf81d9b700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.405+0000 7fcf81d9b700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 0x7fcf640693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf8406f210 tx=0x7fcf78009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.409+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf74052080 con 0x7fcf840cdb70 2023-10-09T15:31:34.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.602+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf840ad360 con 0x7fcf840cdb70 2023-10-09T15:31:34.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.602+0000 7fcf727fc700 1 -- 172.21.15.33:0/2739465330 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf74009a60 con 0x7fcf840cdb70 2023-10-09T15:31:34.603 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:31:34.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 msgr2=0x7fcf640693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 0x7fcf640693e0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fcf8406f210 tx=0x7fcf78009040 comp rx=0 tx=0).stop 2023-10-09T15:31:34.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 msgr2=0x7fcf840c6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fcf7400e190 tx=0x7fcf74009920 comp rx=0 tx=0).stop 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 shutdown_connections 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf64066f30 0x7fcf640693e0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf840cdb70 0x7fcf840c6650 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf84159c90 0x7fcf840ac040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 --2- 172.21.15.33:0/2739465330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf841598c0 0x7fcf84156130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 >> 172.21.15.33:0/2739465330 conn(0x7fcf84088000 msgr2=0x7fcf840cd3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 shutdown_connections 2023-10-09T15:31:34.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.604+0000 7fcf88b43700 1 -- 172.21.15.33:0/2739465330 wait complete. 2023-10-09T15:31:34.617 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:31:34.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.738+0000 7fc853b62700 1 Processor -- start 2023-10-09T15:31:34.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.738+0000 7fc853b62700 1 -- start start 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.738+0000 7fc853b62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc84c159530 0x7fc84c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.738+0000 7fc853b62700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc853b62700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc84c0ccfd0 con 0x7fc84c06dc70 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc853b62700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c0cf0e0 con 0x7fc84c06e0e0 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc853b62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84c15a3d0 con 0x7fc84c159530 2023-10-09T15:31:34.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8510fd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc84c06dc70 0x7fc84c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48774/0 (socket says 172.21.15.33:48774) 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35084/0 (socket says 172.21.15.33:35084) 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8510fd700 1 -- 172.21.15.33:0/45545810 learned_addr learned my addr 172.21.15.33:0/45545810 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8518fe700 1 --2- 172.21.15.33:0/45545810 >> v2:172.21.15.59:3300/0 conn(0x7fc84c159530 0x7fc84c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 -- 172.21.15.33:0/45545810 >> v2:172.21.15.59:3300/0 conn(0x7fc84c159530 msgr2=0x7fc84c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 --2- 172.21.15.33:0/45545810 >> v2:172.21.15.59:3300/0 conn(0x7fc84c159530 0x7fc84c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 -- 172.21.15.33:0/45545810 >> v1:172.21.15.33:6789/0 conn(0x7fc84c06dc70 legacy=0x7fc84c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 -- 172.21.15.33:0/45545810 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84c15a6b0 con 0x7fc84c06e0e0 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8508fc700 1 -- 172.21.15.33:0/45545810 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3078121541 0 0) 0x7fc84c0ccfd0 con 0x7fc84c06dc70 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8520ff700 1 --2- 172.21.15.33:0/45545810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc84c06d630 tx=0x7fc83c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97038077f1c2f122 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8508fc700 1 -- 172.21.15.33:0/45545810 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c00e070 con 0x7fc84c06e0e0 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8508fc700 1 -- 172.21.15.33:0/45545810 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83c00bb60 con 0x7fc84c06e0e0 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.739+0000 7fc8508fc700 1 -- 172.21.15.33:0/45545810 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83c012430 con 0x7fc84c06e0e0 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 -- 172.21.15.33:0/45545810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06e0e0 msgr2=0x7fc84c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 --2- 172.21.15.33:0/45545810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fc84c06d630 tx=0x7fc83c009780 comp rx=0 tx=0).stop 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 -- 172.21.15.33:0/45545810 shutdown_connections 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 --2- 172.21.15.33:0/45545810 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0cb6f0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 --2- 172.21.15.33:0/45545810 >> v2:172.21.15.59:3300/0 conn(0x7fc84c159530 0x7fc84c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 -- 172.21.15.33:0/45545810 >> 172.21.15.33:0/45545810 conn(0x7fc84c0703a0 msgr2=0x7fc84c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 -- 172.21.15.33:0/45545810 shutdown_connections 2023-10-09T15:31:34.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.740+0000 7fc853b62700 1 -- 172.21.15.33:0/45545810 wait complete. 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.741+0000 7fc853b62700 1 Processor -- start 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.741+0000 7fc853b62700 1 -- start start 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c159530 0x7fc84c0d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c1548a0 con 0x7fc84c06dc70 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c155fc0 con 0x7fc84c06e0e0 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc853b62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc84c0c79e0 con 0x7fc84c159530 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35094/0 (socket says 172.21.15.33:35094) 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 -- 172.21.15.33:0/3597731805 learned_addr learned my addr 172.21.15.33:0/3597731805 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 -- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c159530 msgr2=0x7fc84c0d0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c159530 0x7fc84c0d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 -- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c06e0e0 msgr2=0x7fc84c0c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 -- 172.21.15.33:0/3597731805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc83c009a20 con 0x7fc84c06dc70 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.742+0000 7fc8518fe700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e930 tx=0x7fc8440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.743+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400eed0 con 0x7fc84c06dc70 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.743+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc84400c850 con 0x7fc84c06dc70 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.743+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc84c156260 con 0x7fc84c06dc70 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.743+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc84400cbf0 con 0x7fc84c06dc70 2023-10-09T15:31:34.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.743+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc84c156820 con 0x7fc84c06dc70 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.744+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc84c04c3c0 con 0x7fc84c06dc70 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.744+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc844013470 con 0x7fc84c06dc70 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.744+0000 7fc849ffb700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 0x7fc8380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.745+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc844084720 con 0x7fc84c06dc70 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.745+0000 7fc8510fd700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 0x7fc8380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.745+0000 7fc8510fd700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 0x7fc8380693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8400011e0 tx=0x7fc8400079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.749+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc844051990 con 0x7fc84c06dc70 2023-10-09T15:31:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.941+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc84c15a990 con 0x7fc84c06dc70 2023-10-09T15:31:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.941+0000 7fc849ffb700 1 -- 172.21.15.33:0/3597731805 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc844054fb0 con 0x7fc84c06dc70 2023-10-09T15:31:34.942 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:31:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 msgr2=0x7fc8380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 0x7fc8380693e0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fc8400011e0 tx=0x7fc8400079d0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 msgr2=0x7fc84c143ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc84400e930 tx=0x7fc8440091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 shutdown_connections 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc838066f30 0x7fc8380693e0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84c06dc70 0x7fc84c143ce0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84c159530 0x7fc84c0d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 --2- 172.21.15.33:0/3597731805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc84c06e0e0 0x7fc84c0c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 >> 172.21.15.33:0/3597731805 conn(0x7fc84c0703a0 msgr2=0x7fc84c0d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 shutdown_connections 2023-10-09T15:31:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:34.943+0000 7fc853b62700 1 -- 172.21.15.33:0/3597731805 wait complete. 2023-10-09T15:31:34.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.074+0000 7f4c8cc1b700 1 Processor -- start 2023-10-09T15:31:35.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.074+0000 7f4c8cc1b700 1 -- start start 2023-10-09T15:31:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c8cc1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c88153c30 0x7f4c8815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c8cc1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c8cc1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c8815afd0 con 0x7f4c880cef40 2023-10-09T15:31:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c8cc1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c8815b2b0 con 0x7f4c88153c30 2023-10-09T15:31:35.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c8cc1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c8815b590 con 0x7f4c8815de50 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c877fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c88153c30 0x7f4c8815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c86ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58630/0 (socket says 172.21.15.33:58630) 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c87fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f4c880cef40 0x7f4c8806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:33102/0 (socket says 172.21.15.33:33102) 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.075+0000 7f4c86ffd700 1 -- 172.21.15.33:0/2016681474 learned_addr learned my addr 172.21.15.33:0/2016681474 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:35.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c877fe700 1 -- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 msgr2=0x7f4c880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c877fe700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c877fe700 1 -- 172.21.15.33:0/2016681474 >> v1:172.21.15.59:6789/0 conn(0x7f4c880cef40 legacy=0x7f4c8806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c877fe700 1 -- 172.21.15.33:0/2016681474 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c8815b870 con 0x7f4c88153c30 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c867fc700 1 -- 172.21.15.33:0/2016681474 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4128028028 0 0) 0x7f4c8815afd0 con 0x7f4c880cef40 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c86ffd700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c877fe700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c88153c30 0x7f4c8815a5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6c488b5c6c4a558e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c867fc700 1 -- 172.21.15.33:0/2016681474 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800b640 con 0x7f4c88153c30 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c867fc700 1 -- 172.21.15.33:0/2016681474 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c7800b7a0 con 0x7f4c88153c30 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.076+0000 7f4c867fc700 1 -- 172.21.15.33:0/2016681474 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c7800bb40 con 0x7f4c88153c30 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c88153c30 msgr2=0x7f4c8815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c88153c30 0x7f4c8815a5e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f4c780098e0 tx=0x7f4c780091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/2016681474 shutdown_connections 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c88153c30 0x7f4c8815a5e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/2016681474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c8815de50 0x7f4c880cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/2016681474 >> 172.21.15.33:0/2016681474 conn(0x7f4c880703a0 msgr2=0x7f4c880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/2016681474 shutdown_connections 2023-10-09T15:31:35.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.077+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/2016681474 wait complete. 2023-10-09T15:31:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.078+0000 7f4c8cc1b700 1 Processor -- start 2023-10-09T15:31:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.078+0000 7f4c8cc1b700 1 -- start start 2023-10-09T15:31:35.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c880cef40 0x7f4c880b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c88153c30 0x7f4c880c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880c8500 con 0x7f4c8815de50 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880b5720 con 0x7f4c880cef40 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c8cc1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c880b5a00 con 0x7f4c88153c30 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35104/0 (socket says 172.21.15.33:35104) 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 -- 172.21.15.33:0/795581077 learned_addr learned my addr 172.21.15.33:0/795581077 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c877fe700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c880cef40 0x7f4c880b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c86ffd700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c88153c30 0x7f4c880c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 -- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c88153c30 msgr2=0x7f4c880c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c88153c30 0x7f4c880c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 -- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c880cef40 msgr2=0x7f4c880b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c880cef40 0x7f4c880b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.079+0000 7f4c87fff700 1 -- 172.21.15.33:0/795581077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c7c0094f0 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c87fff700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000ccc0 tx=0x7f4c80001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80005df0 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8000a600 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c78009420 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8000a9c0 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.080+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c880b5fc0 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.081+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c880c8670 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.081+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4c800070f0 con 0x7f4c8815de50 2023-10-09T15:31:35.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.082+0000 7f4c6f7fe700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.082+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c800845b0 con 0x7f4c8815de50 2023-10-09T15:31:35.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.082+0000 7f4c877fe700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.082+0000 7f4c877fe700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c780093f0 tx=0x7f4c78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.086+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c880c8670 con 0x7f4c8815de50 2023-10-09T15:31:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.327+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4c880c8670 con 0x7f4c8815de50 2023-10-09T15:31:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.327+0000 7f4c6f7fe700 1 -- 172.21.15.33:0/795581077 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f4c880c8670 con 0x7f4c8815de50 2023-10-09T15:31:35.328 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:35.328 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 msgr2=0x7f4c740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 0x7f4c740693e0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4c780093f0 tx=0x7f4c78017000 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 msgr2=0x7f4c8813dd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f4c8000ccc0 tx=0x7f4c80001a70 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 shutdown_connections 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c74066f30 0x7f4c740693e0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c8815de50 0x7f4c8813dd50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c880cef40 0x7f4c880b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 --2- 172.21.15.33:0/795581077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c88153c30 0x7f4c880c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 >> 172.21.15.33:0/795581077 conn(0x7f4c880703a0 msgr2=0x7f4c880c6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 shutdown_connections 2023-10-09T15:31:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.329+0000 7f4c8cc1b700 1 -- 172.21.15.33:0/795581077 wait complete. 2023-10-09T15:31:35.332 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:35.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:35.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.461+0000 7f10d6d0d700 1 Processor -- start 2023-10-09T15:31:35.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.461+0000 7f10d6d0d700 1 -- start start 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10d6d0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 0x7f10d0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10d6d0d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d015ae40 con 0x7f10d00cb970 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10d6d0d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f10d015ab60 con 0x7f10d00cb5a0 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10d6d0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00ce0f0 con 0x7f10d015a5d0 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10cffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f10d00cb970 0x7f10d0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48788/0 (socket says 172.21.15.33:48788) 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.462+0000 7f10cffff700 1 -- 172.21.15.33:0/936202593 learned_addr learned my addr 172.21.15.33:0/936202593 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10d52aa700 1 --2- 172.21.15.33:0/936202593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 0x7f10d0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1368331832 0 0) 0x7f10d015ae40 con 0x7f10d00cb970 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10bc003570 con 0x7f10d00cb970 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924400065 0 0) 0x7f10d015ab60 con 0x7f10d00cb5a0 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f10d015ae40 con 0x7f10d00cb5a0 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10d52aa700 1 -- 172.21.15.33:0/936202593 >> v1:172.21.15.59:6789/0 conn(0x7f10d00cb5a0 legacy=0x7f10d00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2541407943 0 0) 0x7f10bc003570 con 0x7f10d00cb970 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10d52aa700 1 -- 172.21.15.33:0/936202593 >> v1:172.21.15.33:6789/0 conn(0x7f10d00cb970 legacy=0x7f10d0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10d52aa700 1 -- 172.21.15.33:0/936202593 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10d00ccf00 con 0x7f10d015a5d0 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10d52aa700 1 --2- 172.21.15.33:0/936202593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 0x7f10d0156e90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009910 tx=0x7f10c00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9558672568586613 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10b8001470 con 0x7f10d015a5d0 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c0011420 con 0x7f10d015a5d0 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.463+0000 7f10cf7fe700 1 -- 172.21.15.33:0/936202593 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c00117c0 con 0x7f10d015a5d0 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 -- 172.21.15.33:0/936202593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 msgr2=0x7f10d0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/936202593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 0x7f10d0156e90 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f10c0009910 tx=0x7f10c00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 -- 172.21.15.33:0/936202593 shutdown_connections 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/936202593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d015a5d0 0x7f10d0156e90 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 -- 172.21.15.33:0/936202593 >> 172.21.15.33:0/936202593 conn(0x7f10d0070e30 msgr2=0x7f10d00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:35.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 -- 172.21.15.33:0/936202593 shutdown_connections 2023-10-09T15:31:35.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.464+0000 7f10d6d0d700 1 -- 172.21.15.33:0/936202593 wait complete. 2023-10-09T15:31:35.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.465+0000 7f10d6d0d700 1 Processor -- start 2023-10-09T15:31:35.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.465+0000 7f10d6d0d700 1 -- start start 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d00cb970 0x7f10d00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 0x7f10d0152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00ca670 con 0x7f10d00cb5a0 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10d0152800 con 0x7f10d015a5d0 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d6d0d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f10d00c95d0 con 0x7f10d00cb970 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35116/0 (socket says 172.21.15.33:35116) 2023-10-09T15:31:35.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 -- 172.21.15.33:0/1265964649 learned_addr learned my addr 172.21.15.33:0/1265964649 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d52aa700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 0x7f10d0152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10cffff700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d00cb970 0x7f10d00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 -- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d00cb970 msgr2=0x7f10d00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d00cb970 0x7f10d00c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 -- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 msgr2=0x7f10d0152e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 0x7f10d0152e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d4aa9700 1 -- 172.21.15.33:0/1265964649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10c0009420 con 0x7f10d00cb5a0 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.466+0000 7f10d52aa700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 0x7f10d0152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:35.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10d4aa9700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10c800cb10 tx=0x7f10c8002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800a760 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10d00c98b0 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10c800a8c0 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10c800ac60 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.467+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10d00c9e70 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.468+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10d004c3c0 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.468+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f10c8012630 con 0x7f10d00cb5a0 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.468+0000 7f10ccff9700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 0x7f10b00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.469+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f10c8084920 con 0x7f10d00cb5a0 2023-10-09T15:31:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.469+0000 7f10cffff700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 0x7f10b00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.469+0000 7f10cffff700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 0x7f10b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10d015e070 tx=0x7f10b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.473+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f10c8051b90 con 0x7f10d00cb5a0 2023-10-09T15:31:35.621 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:31:35.623 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:31:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.668+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f10d00cbd90 con 0x7f10d00cb5a0 2023-10-09T15:31:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.669+0000 7f10ccff9700 1 -- 172.21.15.33:0/1265964649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f10c80551b0 con 0x7f10d00cb5a0 2023-10-09T15:31:35.670 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:35.670 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:35.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 msgr2=0x7f10b00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 0x7f10b00693e0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f10d015e070 tx=0x7f10b8009040 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 msgr2=0x7f10d01522c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10c800cb10 tx=0x7f10c8002820 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 shutdown_connections 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f10b0066f30 0x7f10b00693e0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f10d00cb5a0 0x7f10d01522c0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f10d015a5d0 0x7f10d0152e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 --2- 172.21.15.33:0/1265964649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f10d00cb970 0x7f10d00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 >> 172.21.15.33:0/1265964649 conn(0x7f10d0070e30 msgr2=0x7f10d00cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:35.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 shutdown_connections 2023-10-09T15:31:35.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.671+0000 7f10d6d0d700 1 -- 172.21.15.33:0/1265964649 wait complete. 2023-10-09T15:31:35.684 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:31:35.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:35.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.843+0000 7f45eabe5700 1 Processor -- start 2023-10-09T15:31:35.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.843+0000 7f45eabe5700 1 -- start start 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45eabe5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45e40a8d00 0x7f45e40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45eabe5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45e406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45eabe5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45e406e7f0 con 0x7f45e406e380 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45eabe5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45e40ae680 con 0x7f45e40a8d00 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45eabe5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40aeee0 con 0x7f45e40a90d0 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45e9182700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45e406e380 0x7f45e40cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48802/0 (socket says 172.21.15.33:48802) 2023-10-09T15:31:35.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.844+0000 7f45e9182700 1 -- 172.21.15.33:0/2748814186 learned_addr learned my addr 172.21.15.33:0/2748814186 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e8981700 1 --2- 172.21.15.33:0/2748814186 >> v2:172.21.15.59:3300/0 conn(0x7f45e40a8d00 0x7f45e40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e3fff700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45e406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3414134712 0 0) 0x7f45e406e7f0 con 0x7f45e406e380 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45d0003570 con 0x7f45e406e380 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 700777608 0 0) 0x7f45d0003570 con 0x7f45e406e380 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 msgr2=0x7f45e406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45e406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 >> v2:172.21.15.59:3300/0 conn(0x7f45e40a8d00 msgr2=0x7f45e40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 --2- 172.21.15.33:0/2748814186 >> v2:172.21.15.59:3300/0 conn(0x7f45e40a8d00 0x7f45e40cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e40cf490 con 0x7f45e406e380 2023-10-09T15:31:35.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f45cc001470 con 0x7f45e406e380 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 >> v1:172.21.15.33:6789/0 conn(0x7f45e406e380 legacy=0x7f45e40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d0003a60 0x7f45d0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45d0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d0004d50 0x7f45d00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40ae680 con 0x7f45d0004d50 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e40aeee0 con 0x7f45d0003a60 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45d000ba60 con 0x7f45e40a90d0 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d0004d50 0x7f45d00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e8981700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d0003a60 0x7f45d0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e3fff700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45d0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 -- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 msgr2=0x7f45d0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:35.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e40a90d0 0x7f45d0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 -- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d0003a60 msgr2=0x7f45d0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45d0003a60 0x7f45d0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.845+0000 7f45e9182700 1 -- 172.21.15.33:0/2748814186 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45d0003570 con 0x7f45d0004d50 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45e9182700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d0004d50 0x7f45d00051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c390 tx=0x7f45cc001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83398cf6e1c734e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc00cc00 con 0x7f45d0004d50 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc00cd80 con 0x7f45d0004d50 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45e37fe700 1 -- 172.21.15.33:0/2748814186 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc005b70 con 0x7f45d0004d50 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 -- 172.21.15.33:0/2748814186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d0004d50 msgr2=0x7f45d00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2748814186 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45d0004d50 0x7f45d00051c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f45cc00c390 tx=0x7f45cc001e90 comp rx=0 tx=0).stop 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45e9182700 1 -- 172.21.15.33:0/2748814186 reap_dead start 2023-10-09T15:31:35.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 -- 172.21.15.33:0/2748814186 shutdown_connections 2023-10-09T15:31:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 -- 172.21.15.33:0/2748814186 >> 172.21.15.33:0/2748814186 conn(0x7f45e406ce80 msgr2=0x7f45e40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 -- 172.21.15.33:0/2748814186 shutdown_connections 2023-10-09T15:31:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.846+0000 7f45eabe5700 1 -- 172.21.15.33:0/2748814186 wait complete. 2023-10-09T15:31:35.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.847+0000 7f45eabe5700 1 Processor -- start 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 -- start start 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e415dcf0 0x7f45e4099830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e4099d70 0x7f45e409a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e415e0c0 con 0x7f45e409aef0 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45e416a650 con 0x7f45e415dcf0 2023-10-09T15:31:35.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45eabe5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45e416a930 con 0x7f45e4099d70 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45e9182700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45e9182700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35134/0 (socket says 172.21.15.33:35134) 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45e9182700 1 -- 172.21.15.33:0/2385327719 learned_addr learned my addr 172.21.15.33:0/2385327719 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.848+0000 7f45e8981700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e415dcf0 0x7f45e4099830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e3fff700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e4099d70 0x7f45e409a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 -- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e4099d70 msgr2=0x7f45e409a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e4099d70 0x7f45e409a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 -- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e415dcf0 msgr2=0x7f45e4099830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e415dcf0 0x7f45e4099830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 -- 172.21.15.33:0/2385327719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45e416ac10 con 0x7f45e409aef0 2023-10-09T15:31:35.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e9182700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f45cc011000 tx=0x7f45cc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc022070 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45cc00cc00 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e416aef0 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45cc007320 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.849+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45e416a220 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.850+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45e404c3c0 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.851+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f45cc007690 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.851+0000 7f45e0ff9700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 0x7f45c40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.851+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f45cc084bd0 con 0x7f45e409aef0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.851+0000 7f45e8981700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 0x7f45c40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:35.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.851+0000 7f45e8981700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 0x7f45c40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0090f0 tx=0x7f45dc009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:35.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:35.855+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45cc051ef0 con 0x7f45e409aef0 2023-10-09T15:31:36.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.091+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45e40a86d0 con 0x7f45e409aef0 2023-10-09T15:31:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.092+0000 7f45e0ff9700 1 -- 172.21.15.33:0/2385327719 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f45cc017020 con 0x7f45e409aef0 2023-10-09T15:31:36.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:36.093 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:36.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 msgr2=0x7f45c40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 0x7f45c40693e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f45dc0090f0 tx=0x7f45dc009120 comp rx=0 tx=0).stop 2023-10-09T15:31:36.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 msgr2=0x7f45e409b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f45cc011000 tx=0x7f45cc015000 comp rx=0 tx=0).stop 2023-10-09T15:31:36.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 shutdown_connections 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45c4066f30 0x7f45c40693e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45e409aef0 0x7f45e409b370 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45e415dcf0 0x7f45e4099830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 --2- 172.21.15.33:0/2385327719 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45e4099d70 0x7f45e409a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 >> 172.21.15.33:0/2385327719 conn(0x7f45e406ce80 msgr2=0x7f45e415ed50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 shutdown_connections 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.094+0000 7f45eabe5700 1 -- 172.21.15.33:0/2385327719 wait complete. 2023-10-09T15:31:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:36.107 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:36.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.225+0000 7f4849e6e700 1 Processor -- start 2023-10-09T15:31:36.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.225+0000 7f4849e6e700 1 -- start start 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f4849e6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f4844156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f4849e6e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484415ae40 con 0x7f48440cb5a0 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f4849e6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484415ab60 con 0x7f48440cb970 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f4849e6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48440ce0f0 con 0x7f484415a5d0 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f48437fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f48440cb5a0 0x7f48440cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48804/0 (socket says 172.21.15.33:48804) 2023-10-09T15:31:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f48437fe700 1 -- 172.21.15.33:0/2888621375 learned_addr learned my addr 172.21.15.33:0/2888621375 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f4843fff700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f4844156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435246373 0 0) 0x7f484415ae40 con 0x7f48440cb5a0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.226+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f482c003570 con 0x7f48440cb5a0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 201907809 0 0) 0x7f482c003570 con 0x7f48440cb5a0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 msgr2=0x7f4844156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f4844156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 >> v1:172.21.15.59:6789/0 conn(0x7f48440cb970 legacy=0x7f4844159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48440ccf00 con 0x7f48440cb5a0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f4838001470 con 0x7f48440cb5a0 2023-10-09T15:31:36.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 >> v1:172.21.15.33:6789/0 conn(0x7f48440cb5a0 legacy=0x7f48440cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f482c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f482c004010 0x7f482c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f482c004d50 0x7f482c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440ce0f0 con 0x7f482c004d50 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00bbf0 con 0x7f482c004010 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c00bdb0 con 0x7f484415a5d0 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f482c004d50 0x7f482c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48437fe700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f482c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4842ffd700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f482c004010 0x7f482c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 -- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 msgr2=0x7f482c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484415a5d0 0x7f482c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 -- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f482c004010 msgr2=0x7f482c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f482c004010 0x7f482c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 -- 172.21.15.33:0/2888621375 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c003570 con 0x7f482c004d50 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f4843fff700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f482c004d50 0x7f482c0051c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f483c0094d0 tx=0x7f483c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b615593f8eda12d1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00ea90 con 0x7f482c004d50 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c00f040 con 0x7f482c004d50 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.227+0000 7f48427fc700 1 -- 172.21.15.33:0/2888621375 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c00ee20 con 0x7f482c004d50 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 -- 172.21.15.33:0/2888621375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f482c004d50 msgr2=0x7f482c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 --2- 172.21.15.33:0/2888621375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f482c004d50 0x7f482c0051c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f483c0094d0 tx=0x7f483c00b040 comp rx=0 tx=0).stop 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4843fff700 1 -- 172.21.15.33:0/2888621375 reap_dead start 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 -- 172.21.15.33:0/2888621375 shutdown_connections 2023-10-09T15:31:36.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 -- 172.21.15.33:0/2888621375 >> 172.21.15.33:0/2888621375 conn(0x7f4844070e30 msgr2=0x7f48440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 -- 172.21.15.33:0/2888621375 shutdown_connections 2023-10-09T15:31:36.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.228+0000 7f4849e6e700 1 -- 172.21.15.33:0/2888621375 wait complete. 2023-10-09T15:31:36.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.229+0000 7f4849e6e700 1 Processor -- start 2023-10-09T15:31:36.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.229+0000 7f4849e6e700 1 -- start start 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4844150100 0x7f48440b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 0x7f48440ceff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440cf9b0 con 0x7f48440cf530 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48440b5e00 con 0x7f48441504d0 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4849e6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48440b60e0 con 0x7f4844150100 2023-10-09T15:31:36.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35158/0 (socket says 172.21.15.33:35158) 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 -- 172.21.15.33:0/3627252433 learned_addr learned my addr 172.21.15.33:0/3627252433 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4842ffd700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 0x7f48440ceff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f48437fe700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4844150100 0x7f48440b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 -- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4844150100 msgr2=0x7f48440b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4844150100 0x7f48440b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 -- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 msgr2=0x7f48440ceff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.230+0000 7f4843fff700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 0x7f48440ceff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f4843fff700 1 -- 172.21.15.33:0/3627252433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4844151f70 con 0x7f48440cf530 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f4842ffd700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 0x7f48440ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:36.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f4843fff700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f482c0057d0 tx=0x7f483c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c01e640 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f483c01e7c0 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f483c01ebc0 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4844152250 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.231+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4844153cf0 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.232+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4844151dc0 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.232+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f483c003040 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.233+0000 7f482b7fe700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 0x7f48300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.233+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f483c086590 con 0x7f48440cf530 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.233+0000 7f48437fe700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 0x7f48300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.233+0000 7f48437fe700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 0x7f48300693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4838000e10 tx=0x7f4838009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.237+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f483c053800 con 0x7f48440cf530 2023-10-09T15:31:36.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.477+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f484404c3c0 con 0x7f48440cf530 2023-10-09T15:31:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.478+0000 7f482b7fe700 1 -- 172.21.15.33:0/3627252433 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+4585 (secure 0 0 0) 0x7f483c056e20 con 0x7f48440cf530 2023-10-09T15:31:36.479 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:36.479 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4226,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/235625566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":235625566},{"type":"v1","addr":"172.21.15.59:6835","nonce":235625566}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2413805211","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2413805211},{"type":"v1","addr":"172.21.15.33:6836","nonce":2413805211}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4289254994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4289254994},{"type":"v1","addr":"172.21.15.33:6837","nonce":4289254994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:30:59.054444+0000","modified":"2023-10-09T15:31:02.669760+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4279},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4279":{"gid":4279,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/342703065","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":342703065},{"type":"v1","addr":"172.21.15.59:6834","nonce":342703065}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 msgr2=0x7f48300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 0x7f48300693e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4838000e10 tx=0x7f4838009040 comp rx=0 tx=0).stop 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 msgr2=0x7f48440c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f482c0057d0 tx=0x7f483c01a000 comp rx=0 tx=0).stop 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 shutdown_connections 2023-10-09T15:31:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4830066f30 0x7f48300693e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48440cf530 0x7f48440c54b0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4844150100 0x7f48440b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 --2- 172.21.15.33:0/3627252433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48441504d0 0x7f48440ceff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 >> 172.21.15.33:0/3627252433 conn(0x7f4844070e30 msgr2=0x7f48440b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 shutdown_connections 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.480+0000 7f4849e6e700 1 -- 172.21.15.33:0/3627252433 wait complete. 2023-10-09T15:31:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 8 2023-10-09T15:31:36.493 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:36.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.611+0000 7f0629696700 1 Processor -- start 2023-10-09T15:31:36.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.611+0000 7f0629696700 1 -- start start 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06240cb5a0 0x7f06240cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06240cd9e0 0x7f0624159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06240cde50 0x7f062415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06240d13f0 con 0x7f06240cb5a0 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062415a940 con 0x7f06240cde50 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0629696700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062415ae40 con 0x7f06240cd9e0 2023-10-09T15:31:36.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06240cb5a0 0x7f06240cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f06240cb5a0 0x7f06240cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35162/0 (socket says 172.21.15.33:35162) 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 -- 172.21.15.33:0/886468100 learned_addr learned my addr 172.21.15.33:0/886468100 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f06227fc700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06240cd9e0 0x7f0624159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f06237fe700 1 --2- 172.21.15.33:0/886468100 >> v2:172.21.15.59:3300/0 conn(0x7f06240cde50 0x7f062415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 -- 172.21.15.33:0/886468100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06240cd9e0 msgr2=0x7f0624159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06240cd9e0 0x7f0624159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 -- 172.21.15.33:0/886468100 >> v2:172.21.15.59:3300/0 conn(0x7f06240cde50 msgr2=0x7f062415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 --2- 172.21.15.33:0/886468100 >> v2:172.21.15.59:3300/0 conn(0x7f06240cde50 0x7f062415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 -- 172.21.15.33:0/886468100 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062415ab60 con 0x7f06240cb5a0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0622ffd700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cb5a0 0x7f06240cb970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06240cbeb0 tx=0x7f0614009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=573d1f52feb3e713 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0621ffb700 1 -- 172.21.15.33:0/886468100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400b640 con 0x7f06240cb5a0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0621ffb700 1 -- 172.21.15.33:0/886468100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061400b7a0 con 0x7f06240cb5a0 2023-10-09T15:31:36.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.612+0000 7f0621ffb700 1 -- 172.21.15.33:0/886468100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061400bb40 con 0x7f06240cb5a0 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 -- 172.21.15.33:0/886468100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cb5a0 msgr2=0x7f06240cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cb5a0 0x7f06240cb970 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f06240cbeb0 tx=0x7f0614009250 comp rx=0 tx=0).stop 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 -- 172.21.15.33:0/886468100 shutdown_connections 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 --2- 172.21.15.33:0/886468100 >> v2:172.21.15.59:3300/0 conn(0x7f06240cde50 0x7f062415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cb5a0 0x7f06240cb970 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 --2- 172.21.15.33:0/886468100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06240cd9e0 0x7f0624159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 -- 172.21.15.33:0/886468100 >> 172.21.15.33:0/886468100 conn(0x7f0624070e30 msgr2=0x7f06240d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 -- 172.21.15.33:0/886468100 shutdown_connections 2023-10-09T15:31:36.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.613+0000 7f0629696700 1 -- 172.21.15.33:0/886468100 wait complete. 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.614+0000 7f0629696700 1 Processor -- start 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.614+0000 7f0629696700 1 -- start start 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06240cb5a0 0x7f0624141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0624157330 0x7f06240c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062415a0b0 con 0x7f06240cd9e0 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0624159010 con 0x7f06240cb5a0 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0629696700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06241592f0 con 0x7f0624157330 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35172/0 (socket says 172.21.15.33:35172) 2023-10-09T15:31:36.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 -- 172.21.15.33:0/3254878768 learned_addr learned my addr 172.21.15.33:0/3254878768 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f0622ffd700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06240cb5a0 0x7f0624141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06237fe700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0624157330 0x7f06240c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 -- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0624157330 msgr2=0x7f06240c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0624157330 0x7f06240c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 -- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06240cb5a0 msgr2=0x7f0624141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06240cb5a0 0x7f0624141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 -- 172.21.15.33:0/3254878768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06140094f0 con 0x7f06240cd9e0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.615+0000 7f06227fc700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f061800ec80 tx=0x7f06180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.616+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061800c9d0 con 0x7f06240cd9e0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.616+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061800cb30 con 0x7f06240cd9e0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.616+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06241595d0 con 0x7f06240cd9e0 2023-10-09T15:31:36.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.616+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0618013470 con 0x7f06240cd9e0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.616+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0624159b90 con 0x7f06240cd9e0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.617+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062404c3c0 con 0x7f06240cd9e0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.617+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0618013820 con 0x7f06240cd9e0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.617+0000 7f060affd700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.618+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06180848a0 con 0x7f06240cd9e0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.618+0000 7f0622ffd700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.618+0000 7f0622ffd700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 0x7f06100693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06240cbeb0 tx=0x7f0614017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.622+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0618051b10 con 0x7f06240cd9e0 2023-10-09T15:31:36.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.816+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f06240ccf00 con 0x7f06240cd9e0 2023-10-09T15:31:36.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.817+0000 7f060affd700 1 -- 172.21.15.33:0/3254878768 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0618055130 con 0x7f06240cd9e0 2023-10-09T15:31:36.818 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:36.818 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":20,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:00.654243+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:30:56.925426+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-10-09T15:30:58.022424+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 msgr2=0x7f06100693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 0x7f06100693e0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f06240cbeb0 tx=0x7f0614017000 comp rx=0 tx=0).stop 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 msgr2=0x7f0624156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f061800ec80 tx=0x7f06180091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 shutdown_connections 2023-10-09T15:31:36.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0610066f30 0x7f06100693e0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0624157330 0x7f06240c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06240cb5a0 0x7f0624141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 --2- 172.21.15.33:0/3254878768 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06240cd9e0 0x7f0624156df0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 >> 172.21.15.33:0/3254878768 conn(0x7f0624070e30 msgr2=0x7f06240d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 shutdown_connections 2023-10-09T15:31:36.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.819+0000 7f0629696700 1 -- 172.21.15.33:0/3254878768 wait complete. 2023-10-09T15:31:36.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:31:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.951+0000 7f3aa013c700 1 Processor -- start 2023-10-09T15:31:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.951+0000 7f3aa013c700 1 -- start start 2023-10-09T15:31:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3aa013c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3a98159850 0x7f3a980adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3aa013c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a980ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3aa013c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a980adb20 con 0x7f3a98159c20 2023-10-09T15:31:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3aa013c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a980ccdc0 con 0x7f3a98159850 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3aa013c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980acf10 con 0x7f3a980b1040 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3a9d6d7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3a98159c20 0x7f3a980b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48808/0 (socket says 172.21.15.33:48808) 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3a9d6d7700 1 -- 172.21.15.33:0/101866805 learned_addr learned my addr 172.21.15.33:0/101866805 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.952+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/101866805 >> v2:172.21.15.59:3300/0 conn(0x7f3a98159850 0x7f3a980adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a980ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 356722535 0 0) 0x7f3a980adb20 con 0x7f3a98159c20 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3a80003570 con 0x7f3a98159c20 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1917571808 0 0) 0x7f3a80003570 con 0x7f3a98159c20 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 msgr2=0x7f3a980ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a980ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 >> v2:172.21.15.59:3300/0 conn(0x7f3a98159850 msgr2=0x7f3a980adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 --2- 172.21.15.33:0/101866805 >> v2:172.21.15.59:3300/0 conn(0x7f3a98159850 0x7f3a980adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a980ad1f0 con 0x7f3a98159c20 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3a8c001470 con 0x7f3a98159c20 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 >> v1:172.21.15.33:6789/0 conn(0x7f3a98159c20 legacy=0x7f3a980b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a80003a60 0x7f3a80003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a80004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a80004d50 0x7f3a800051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980ccdc0 con 0x7f3a80004d50 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a980acf10 con 0x7f3a80003a60 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a8000dc70 con 0x7f3a980b1040 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a80004d50 0x7f3a800051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9d6d7700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a80004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a80003a60 0x7f3a80003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 -- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 msgr2=0x7f3a80004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a80004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 -- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a80003a60 msgr2=0x7f3a80003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a80003a60 0x7f3a80003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 -- 172.21.15.33:0/101866805 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a80003570 con 0x7f3a80004d50 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9d6d7700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a980b1040 0x7f3a80004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a80003a60 0x7f3a80003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.953+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a80004d50 0x7f3a800051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a98069a10 tx=0x7f3a880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9adea596b31a8d0d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800e680 con 0x7f3a80004d50 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a8800e7e0 con 0x7f3a80004d50 2023-10-09T15:31:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3a9ced6700 1 -- 172.21.15.33:0/101866805 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8800eba0 con 0x7f3a80004d50 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 -- 172.21.15.33:0/101866805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a80004d50 msgr2=0x7f3a800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 --2- 172.21.15.33:0/101866805 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a80004d50 0x7f3a800051c0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3a98069a10 tx=0x7f3a880091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3a9e6d9700 1 -- 172.21.15.33:0/101866805 reap_dead start 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 -- 172.21.15.33:0/101866805 shutdown_connections 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 -- 172.21.15.33:0/101866805 >> 172.21.15.33:0/101866805 conn(0x7f3a9806d170 msgr2=0x7f3a980cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 -- 172.21.15.33:0/101866805 shutdown_connections 2023-10-09T15:31:36.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.954+0000 7f3aa013c700 1 -- 172.21.15.33:0/101866805 wait complete. 2023-10-09T15:31:36.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.955+0000 7f3aa013c700 1 Processor -- start 2023-10-09T15:31:36.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.955+0000 7f3aa013c700 1 -- start start 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9814e8b0 0x7f3a980cbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 0x7f3a98155f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9814f070 con 0x7f3a9814a230 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a98150490 con 0x7f3a9814e8b0 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3aa013c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a9814ed90 con 0x7f3a9814df90 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35202/0 (socket says 172.21.15.33:35202) 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 -- 172.21.15.33:0/981293514 learned_addr learned my addr 172.21.15.33:0/981293514 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 0x7f3a98155f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 -- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 msgr2=0x7f3a98155f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9d6d7700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9814e8b0 0x7f3a980cbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 0x7f3a98155f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 -- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9814e8b0 msgr2=0x7f3a980cbac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9814e8b0 0x7f3a980cbac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9ded8700 1 -- 172.21.15.33:0/981293514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a98150710 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.956+0000 7f3a9e6d9700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 0x7f3a98155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3a9ded8700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a900102c0 tx=0x7f3a9000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a9000e070 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3a9000f040 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a981509f0 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a90015690 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.957+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a981511f0 con 0x7f3a9814a230 2023-10-09T15:31:36.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.958+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a98150f10 con 0x7f3a9814a230 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.958+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3a90003020 con 0x7f3a9814a230 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.959+0000 7f3a95ffb700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.959+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3a90084ec0 con 0x7f3a9814a230 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.959+0000 7f3a9d6d7700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.959+0000 7f3a9d6d7700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 0x7f3a840693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c001200 tx=0x7f3a8c001c90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:36.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:36.963+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3a98150f10 con 0x7f3a9814a230 2023-10-09T15:31:37.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.201+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3a9804c3c0 con 0x7f3a9814a230 2023-10-09T15:31:37.202 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:31:37.202+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:31:37.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.205+0000 7f3a95ffb700 1 -- 172.21.15.33:0/981293514 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v9) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3a90055bc0 con 0x7f3a9814a230 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 msgr2=0x7f3a840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 0x7f3a840693e0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3a8c001200 tx=0x7f3a8c001c90 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 msgr2=0x7f3a980cb580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f3a900102c0 tx=0x7f3a9000b040 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 shutdown_connections 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3a84066f30 0x7f3a840693e0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.207+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3a9814a230 0x7f3a980cb580 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.208+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3a9814df90 0x7f3a98155f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.208+0000 7f3aa013c700 1 --2- 172.21.15.33:0/981293514 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3a9814e8b0 0x7f3a980cbac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.208+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 >> 172.21.15.33:0/981293514 conn(0x7f3a9806d170 msgr2=0x7f3a980af220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:37.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.208+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 shutdown_connections 2023-10-09T15:31:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.208+0000 7f3aa013c700 1 -- 172.21.15.33:0/981293514 wait complete. 2023-10-09T15:31:37.210 INFO:tasks.ceph.mds.d.smithi059.stderr: -1765> 2023-10-09T15:31:03.463+0000 7f7247371700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:31:37.210 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:31:37.220 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:31:37.234 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:31:37.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 Processor -- start 2023-10-09T15:31:37.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 -- start start 2023-10-09T15:31:37.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 0x7f18a00c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18a00c9310 con 0x7f18a00cd460 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18a00ad990 con 0x7f18a01598c0 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.341+0000 7f18a6b1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00ce090 con 0x7f18a0159c90 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f18a48b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 0x7f18a00c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58780/0 (socket says 172.21.15.33:58780) 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f18a48b7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 0x7f18a00c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:40636/0 (socket says 172.21.15.33:40636) 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f18a50b8700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f18a00cd460 0x7f18a00cad70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:33112/0 (socket says 172.21.15.33:33112) 2023-10-09T15:31:37.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 -- 172.21.15.33:0/3127860859 learned_addr learned my addr 172.21.15.33:0/3127860859 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:37.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 -- 172.21.15.33:0/3127860859 >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 msgr2=0x7f18a00c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 --2- 172.21.15.33:0/3127860859 >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 0x7f18a00c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 -- 172.21.15.33:0/3127860859 >> v1:172.21.15.59:6789/0 conn(0x7f18a00cd460 legacy=0x7f18a00cad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 -- 172.21.15.33:0/3127860859 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a00c8cc0 con 0x7f18a0159c90 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189f7fe700 1 -- 172.21.15.33:0/3127860859 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2697316540 0 0) 0x7f18a00c9310 con 0x7f18a00cd460 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.342+0000 7f189ffff700 1 --2- 172.21.15.33:0/3127860859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18900099b0 tx=0x7f1890009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c80b367b10220e3d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f189f7fe700 1 -- 172.21.15.33:0/3127860859 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1890009ea0 con 0x7f18a0159c90 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f189f7fe700 1 -- 172.21.15.33:0/3127860859 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189000b860 con 0x7f18a0159c90 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f189f7fe700 1 -- 172.21.15.33:0/3127860859 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189000bc00 con 0x7f18a0159c90 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 -- 172.21.15.33:0/3127860859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 msgr2=0x7f18a00c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/3127860859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f18900099b0 tx=0x7f1890009250 comp rx=0 tx=0).stop 2023-10-09T15:31:37.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 -- 172.21.15.33:0/3127860859 shutdown_connections 2023-10-09T15:31:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/3127860859 >> v2:172.21.15.59:3300/0 conn(0x7f18a01598c0 0x7f18a00c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/3127860859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a00c43b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 -- 172.21.15.33:0/3127860859 >> 172.21.15.33:0/3127860859 conn(0x7f18a0088000 msgr2=0x7f18a00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 -- 172.21.15.33:0/3127860859 shutdown_connections 2023-10-09T15:31:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.343+0000 7f18a6b1b700 1 -- 172.21.15.33:0/3127860859 wait complete. 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.344+0000 7f18a6b1b700 1 Processor -- start 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 -- start start 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a01598c0 0x7f18a00b1dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a006e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b2d40 con 0x7f18a00cd460 2023-10-09T15:31:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b3020 con 0x7f18a01598c0 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a6b1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18a00b3300 con 0x7f18a0159c90 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a48b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a48b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35214/0 (socket says 172.21.15.33:35214) 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.345+0000 7f18a48b7700 1 -- 172.21.15.33:0/1266754799 learned_addr learned my addr 172.21.15.33:0/1266754799 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f189ffff700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a01598c0 0x7f18a00b1dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a50b8700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a006e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 -- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 msgr2=0x7f18a006e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a006e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 -- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a01598c0 msgr2=0x7f18a00b1dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a01598c0 0x7f18a00b1dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 -- 172.21.15.33:0/1266754799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18900094f0 con 0x7f18a00cd460 2023-10-09T15:31:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a48b7700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1898009ef0 tx=0x7f189800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f189800cc50 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f189800f040 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a00b35e0 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1898014480 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.346+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18a00b29d0 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.347+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18a004c3c0 con 0x7f18a00cd460 2023-10-09T15:31:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.347+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f18980147f0 con 0x7f18a00cd460 2023-10-09T15:31:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.348+0000 7f189cff9700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.348+0000 7f189ffff700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.348+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f1898085310 con 0x7f18a00cd460 2023-10-09T15:31:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.348+0000 7f189ffff700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18a015a0e0 tx=0x7f1890017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.352+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1898052530 con 0x7f18a00cd460 2023-10-09T15:31:37.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:37.592+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f18a00885e0 con 0x7f18a00cd460 2023-10-09T15:31:38.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.209+0000 7f189cff9700 1 -- 172.21.15.33:0/1266754799 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v10) v1 ==== 104+0+0 (secure 0 0 0) 0x7f1898055b50 con 0x7f18a00cd460 2023-10-09T15:31:38.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 msgr2=0x7f18800693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 0x7f18800693e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f18a015a0e0 tx=0x7f1890017000 comp rx=0 tx=0).stop 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 msgr2=0x7f18a01543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1898009ef0 tx=0x7f189800b040 comp rx=0 tx=0).stop 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 shutdown_connections 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1880066f30 0x7f18800693e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18a00cd460 0x7f18a01543d0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18a0159c90 0x7f18a006e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 --2- 172.21.15.33:0/1266754799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18a01598c0 0x7f18a00b1dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.211+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 >> 172.21.15.33:0/1266754799 conn(0x7f18a0088000 msgr2=0x7f18a0156380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.212+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 shutdown_connections 2023-10-09T15:31:38.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.212+0000 7f18a6b1b700 1 -- 172.21.15.33:0/1266754799 wait complete. 2023-10-09T15:31:38.227 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:31:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.354+0000 7fe618dbf700 1 Processor -- start 2023-10-09T15:31:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.354+0000 7fe618dbf700 1 -- start start 2023-10-09T15:31:38.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6140a8aa0 0x7fe6140a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe614088400 0x7fe6140b0830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe6140ae6f0 0x7fe6140aeb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140af090 con 0x7fe614088400 2023-10-09T15:31:38.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6140ce1c0 con 0x7fe6140ae6f0 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe618dbf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140cd5b0 con 0x7fe6140a8aa0 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe611d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe614088400 0x7fe6140b0830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe611d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe614088400 0x7fe6140b0830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35216/0 (socket says 172.21.15.33:35216) 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.355+0000 7fe611d9b700 1 -- 172.21.15.33:0/983327981 learned_addr learned my addr 172.21.15.33:0/983327981 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe612d9d700 1 --2- 172.21.15.33:0/983327981 >> v2:172.21.15.59:3300/0 conn(0x7fe6140ae6f0 0x7fe6140aeb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe61259c700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6140a8aa0 0x7fe6140a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 -- 172.21.15.33:0/983327981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6140a8aa0 msgr2=0x7fe6140a8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:38.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6140a8aa0 0x7fe6140a8e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 -- 172.21.15.33:0/983327981 >> v2:172.21.15.59:3300/0 conn(0x7fe6140ae6f0 msgr2=0x7fe6140aeb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 --2- 172.21.15.33:0/983327981 >> v2:172.21.15.59:3300/0 conn(0x7fe6140ae6f0 0x7fe6140aeb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 -- 172.21.15.33:0/983327981 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6140cd890 con 0x7fe614088400 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe611d9b700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe614088400 0x7fe6140b0830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe6140cc2d0 tx=0x7fe5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c297c699ea8f5a7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe61159a700 1 -- 172.21.15.33:0/983327981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00b860 con 0x7fe614088400 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe61159a700 1 -- 172.21.15.33:0/983327981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5fc00b9c0 con 0x7fe614088400 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.356+0000 7fe61159a700 1 -- 172.21.15.33:0/983327981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5fc00bd60 con 0x7fe614088400 2023-10-09T15:31:38.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 -- 172.21.15.33:0/983327981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe614088400 msgr2=0x7fe6140b0830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe614088400 0x7fe6140b0830 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe6140cc2d0 tx=0x7fe5fc009250 comp rx=0 tx=0).stop 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 -- 172.21.15.33:0/983327981 shutdown_connections 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 --2- 172.21.15.33:0/983327981 >> v2:172.21.15.59:3300/0 conn(0x7fe6140ae6f0 0x7fe6140aeb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe6140a8aa0 0x7fe6140a8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 --2- 172.21.15.33:0/983327981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe614088400 0x7fe6140b0830 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 -- 172.21.15.33:0/983327981 >> 172.21.15.33:0/983327981 conn(0x7fe614088000 msgr2=0x7fe6140ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 -- 172.21.15.33:0/983327981 shutdown_connections 2023-10-09T15:31:38.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.357+0000 7fe618dbf700 1 -- 172.21.15.33:0/983327981 wait complete. 2023-10-09T15:31:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 Processor -- start 2023-10-09T15:31:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 -- start start 2023-10-09T15:31:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6140ae6f0 0x7fe61409b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe61414f960 0x7fe61406d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61409bb30 con 0x7fe6140a8aa0 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61409c050 con 0x7fe6140ae6f0 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.358+0000 7fe618dbf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6140ab440 con 0x7fe61414f960 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35224/0 (socket says 172.21.15.33:35224) 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 -- 172.21.15.33:0/963607488 learned_addr learned my addr 172.21.15.33:0/963607488 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:38.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe611d9b700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6140ae6f0 0x7fe61409b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe612d9d700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe61414f960 0x7fe61406d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 -- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe61414f960 msgr2=0x7fe61406d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe61414f960 0x7fe61406d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 -- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6140ae6f0 msgr2=0x7fe61409b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6140ae6f0 0x7fe61409b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 -- 172.21.15.33:0/963607488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5fc0094f0 con 0x7fe6140a8aa0 2023-10-09T15:31:38.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe61259c700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c880 tx=0x7fe60c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c011600 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60c011760 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61409bd70 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60c011b00 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.359+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6140ab0d0 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.360+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe61404c3c0 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.361+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe60c018360 con 0x7fe6140a8aa0 2023-10-09T15:31:38.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.361+0000 7fe60a7fc700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 0x7fe5f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:38.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.361+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe60c0843c0 con 0x7fe6140a8aa0 2023-10-09T15:31:38.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.361+0000 7fe611d9b700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 0x7fe5f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:38.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.361+0000 7fe611d9b700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 0x7fe5f40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe6140cc2d0 tx=0x7fe5fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:38.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.365+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe60c055070 con 0x7fe6140a8aa0 2023-10-09T15:31:38.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:38.561+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe614067b20 con 0x7fe6140a8aa0 2023-10-09T15:31:39.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.392+0000 7fe60a7fc700 1 -- 172.21.15.33:0/963607488 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v22) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe60c054c00 con 0x7fe6140a8aa0 2023-10-09T15:31:39.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 msgr2=0x7fe5f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 0x7fe5f40693e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fe6140cc2d0 tx=0x7fe5fc017000 comp rx=0 tx=0).stop 2023-10-09T15:31:39.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 msgr2=0x7fe6140984a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe60c00c880 tx=0x7fe60c008040 comp rx=0 tx=0).stop 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 shutdown_connections 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5f4066f30 0x7fe5f40693e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe6140a8aa0 0x7fe6140984a0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe61414f960 0x7fe61406d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 --2- 172.21.15.33:0/963607488 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe6140ae6f0 0x7fe61409b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 >> 172.21.15.33:0/963607488 conn(0x7fe614088000 msgr2=0x7fe6140addb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 shutdown_connections 2023-10-09T15:31:39.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.396+0000 7fe618dbf700 1 -- 172.21.15.33:0/963607488 wait complete. 2023-10-09T15:31:39.399 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:31:39.412 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:31:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.541+0000 7f1e4d758700 1 Processor -- start 2023-10-09T15:31:39.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 -- start start 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e480cd770 0x7f1e480cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e481591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e480cf330 con 0x7f1e480cb880 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e480cead0 con 0x7f1e480cd770 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e4d758700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480cdbc0 con 0x7f1e480b04f0 2023-10-09T15:31:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.542+0000 7f1e467fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e480cd770 0x7f1e480cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e480cd770 0x7f1e480cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35230/0 (socket says 172.21.15.33:35230) 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 -- 172.21.15.33:0/4219219665 learned_addr learned my addr 172.21.15.33:0/4219219665 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e477fe700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e481591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 -- 172.21.15.33:0/4219219665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 msgr2=0x7f1e481591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e481591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 -- 172.21.15.33:0/4219219665 >> v1:172.21.15.59:6789/0 conn(0x7f1e480cb880 legacy=0x7f1e480cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 -- 172.21.15.33:0/4219219665 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e480cddd0 con 0x7f1e480cd770 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e467fc700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cd770 0x7f1e480cbc50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1e300099b0 tx=0x7f1e30009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce80820773b49c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e45ffb700 1 -- 172.21.15.33:0/4219219665 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30009ea0 con 0x7f1e480cd770 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e45ffb700 1 -- 172.21.15.33:0/4219219665 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000b860 con 0x7f1e480cd770 2023-10-09T15:31:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.543+0000 7f1e45ffb700 1 -- 172.21.15.33:0/4219219665 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e3000bc00 con 0x7f1e480cd770 2023-10-09T15:31:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 -- 172.21.15.33:0/4219219665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cd770 msgr2=0x7f1e480cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cd770 0x7f1e480cbc50 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f1e300099b0 tx=0x7f1e30009250 comp rx=0 tx=0).stop 2023-10-09T15:31:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 -- 172.21.15.33:0/4219219665 shutdown_connections 2023-10-09T15:31:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e481591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 --2- 172.21.15.33:0/4219219665 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cd770 0x7f1e480cbc50 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 -- 172.21.15.33:0/4219219665 >> 172.21.15.33:0/4219219665 conn(0x7f1e480703a0 msgr2=0x7f1e480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 -- 172.21.15.33:0/4219219665 shutdown_connections 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.544+0000 7f1e4d758700 1 -- 172.21.15.33:0/4219219665 wait complete. 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.545+0000 7f1e4d758700 1 Processor -- start 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.545+0000 7f1e4d758700 1 -- start start 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e480ae830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e480cd770 0x7f1e480c9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48169db0 con 0x7f1e480cb880 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e480aed70 con 0x7f1e480cd770 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e4d758700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e48159a40 con 0x7f1e480b04f0 2023-10-09T15:31:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35246/0 (socket says 172.21.15.33:35246) 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 -- 172.21.15.33:0/2875700907 learned_addr learned my addr 172.21.15.33:0/2875700907 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e477fe700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e480cd770 0x7f1e480c9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e46ffd700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e480ae830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 -- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 msgr2=0x7f1e480ae830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e480ae830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 -- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e480cd770 msgr2=0x7f1e480c9860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e480cd770 0x7f1e480c9860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 -- 172.21.15.33:0/2875700907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e300094f0 con 0x7f1e480cb880 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.546+0000 7f1e467fc700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1e48089650 tx=0x7f1e30017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.547+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30000d10 con 0x7f1e480cb880 2023-10-09T15:31:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.547+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e3000bbe0 con 0x7f1e480cb880 2023-10-09T15:31:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.547+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e4815a4a0 con 0x7f1e480cb880 2023-10-09T15:31:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.547+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e30011670 con 0x7f1e480cb880 2023-10-09T15:31:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.547+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e4815aa60 con 0x7f1e480cb880 2023-10-09T15:31:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.548+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e48169f20 con 0x7f1e480cb880 2023-10-09T15:31:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.548+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1e30011a20 con 0x7f1e480cb880 2023-10-09T15:31:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.549+0000 7f1e3effd700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 0x7f1e280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.549+0000 7f1e46ffd700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 0x7f1e280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.549+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f1e30085920 con 0x7f1e480cb880 2023-10-09T15:31:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.549+0000 7f1e46ffd700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 0x7f1e280693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e40003a80 tx=0x7f1e40007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:39.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.553+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e48169f20 con 0x7f1e480cb880 2023-10-09T15:31:39.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:39.750+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1e480b5ce0 con 0x7f1e480cb880 2023-10-09T15:31:40.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.397+0000 7f1e3effd700 1 -- 172.21.15.33:0/2875700907 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v23) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1e30052d70 con 0x7f1e480cb880 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.401+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 msgr2=0x7f1e280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.401+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 0x7f1e280693e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f1e40003a80 tx=0x7f1e40007ec0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.401+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 msgr2=0x7f1e4815b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.401+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f1e48089650 tx=0x7f1e30017000 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 shutdown_connections 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e28066f30 0x7f1e280693e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e480cd770 0x7f1e480c9860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e480b04f0 0x7f1e480ae830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 --2- 172.21.15.33:0/2875700907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e480cb880 0x7f1e4815b8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 >> 172.21.15.33:0/2875700907 conn(0x7f1e480703a0 msgr2=0x7f1e480b55d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:40.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 shutdown_connections 2023-10-09T15:31:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.402+0000 7f1e4d758700 1 -- 172.21.15.33:0/2875700907 wait complete. 2023-10-09T15:31:40.404 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:31:40.421 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:31:40.422 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:31:40.422 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:31:40.422 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:31:40.422 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:31:40.422 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:31:40.422 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:31:40.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:31:40.423 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:31:40.423 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:31:40.423 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:31:40.423 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:31:40.423 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:31:40.423 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:31:40.424 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:31:40.424 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:31:40.432 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:31:40.432 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:31:40.433 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:31:40.433 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:31:40.434 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:31:40.434 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:31:40.435 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:31:40.435 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:31:40.475 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:31:40.475 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:40.476 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:31:40.476 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:40.477 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:31:40.477 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:40.478 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:31:40.478 DEBUG:teuthology.parallel:result is None 2023-10-09T15:31:40.478 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:31:40.555 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:31:40.556 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:31:40.556 INFO:tasks.ceph.mds.c.smithi033.stderr:2023-10-09T15:31:40.556+0000 7f4c877a4700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T15:31:40.560 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:31:40.560 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:31:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.608+0000 7ff16f6e9700 1 Processor -- start 2023-10-09T15:31:40.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.608+0000 7ff16f6e9700 1 -- start start 2023-10-09T15:31:40.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16f6e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16f6e9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16815ae40 con 0x7ff1680cb5a0 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16f6e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff16815ab60 con 0x7ff16815a400 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16f6e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680ce0f0 con 0x7ff1680cb970 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16d485700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff1680cb5a0 0x7ff1680cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48826/0 (socket says 172.21.15.33:48826) 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16d485700 1 -- 172.21.15.33:0/1227020342 learned_addr learned my addr 172.21.15.33:0/1227020342 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16cc84700 1 --2- 172.21.15.33:0/1227020342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2147367051 0 0) 0x7ff16815ae40 con 0x7ff1680cb5a0 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff154003570 con 0x7ff1680cb5a0 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3587919743 0 0) 0x7ff16815ab60 con 0x7ff16815a400 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff16815ae40 con 0x7ff16815a400 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16cc84700 1 -- 172.21.15.33:0/1227020342 >> v1:172.21.15.59:6789/0 conn(0x7ff16815a400 legacy=0x7ff168156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16cc84700 1 -- 172.21.15.33:0/1227020342 >> v1:172.21.15.33:6789/0 conn(0x7ff1680cb5a0 legacy=0x7ff1680cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16cc84700 1 -- 172.21.15.33:0/1227020342 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680ccf00 con 0x7ff1680cb970 2023-10-09T15:31:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.609+0000 7ff16cc84700 1 --2- 172.21.15.33:0/1227020342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168159ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff158009910 tx=0x7ff1580091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4bd218546d2f9a4c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011630 con 0x7ff1680cb970 2023-10-09T15:31:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff158011790 con 0x7ff1680cb970 2023-10-09T15:31:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff15ffff700 1 -- 172.21.15.33:0/1227020342 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff158011b30 con 0x7ff1680cb970 2023-10-09T15:31:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 -- 172.21.15.33:0/1227020342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 msgr2=0x7ff168159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/1227020342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168159ec0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7ff158009910 tx=0x7ff1580091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 -- 172.21.15.33:0/1227020342 shutdown_connections 2023-10-09T15:31:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/1227020342 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168159ec0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 -- 172.21.15.33:0/1227020342 >> 172.21.15.33:0/1227020342 conn(0x7ff168070e30 msgr2=0x7ff1680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 -- 172.21.15.33:0/1227020342 shutdown_connections 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.610+0000 7ff16f6e9700 1 -- 172.21.15.33:0/1227020342 wait complete. 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.611+0000 7ff16f6e9700 1 Processor -- start 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.611+0000 7ff16f6e9700 1 -- start start 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff16815a400 0x7ff16815da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680cbde0 con 0x7ff1680cb5a0 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16815b3d0 con 0x7ff16815a400 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16f6e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b45e0 con 0x7ff1680cb970 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.612+0000 7ff16d485700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:40.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35262/0 (socket says 172.21.15.33:35262) 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 -- 172.21.15.33:0/693933427 learned_addr learned my addr 172.21.15.33:0/693933427 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16dc86700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff16815a400 0x7ff16815da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16cc84700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 -- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 msgr2=0x7ff168153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 -- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff16815a400 msgr2=0x7ff16815da30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff16815a400 0x7ff16815da30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 -- 172.21.15.33:0/693933427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff158009420 con 0x7ff1680cb5a0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16d485700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c790 tx=0x7ff164007ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164005b30 con 0x7ff1680cb5a0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff164005c90 con 0x7ff1680cb5a0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1680b5440 con 0x7ff1680cb5a0 2023-10-09T15:31:40.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff164007300 con 0x7ff1680cb5a0 2023-10-09T15:31:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.613+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1680b4830 con 0x7ff1680cb5a0 2023-10-09T15:31:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.614+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff16804c3c0 con 0x7ff1680cb5a0 2023-10-09T15:31:40.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.615+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7ff16401b3b0 con 0x7ff1680cb5a0 2023-10-09T15:31:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.615+0000 7ff15d7fa700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.615+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff164083660 con 0x7ff1680cb5a0 2023-10-09T15:31:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.615+0000 7ff16cc84700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:40.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.615+0000 7ff16cc84700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 0x7ff14c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff158009860 tx=0x7ff158017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:40.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.619+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff164054660 con 0x7ff1680cb5a0 2023-10-09T15:31:40.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:40.827+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7ff1680cc620 con 0x7ff1680cb5a0 2023-10-09T15:31:42.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.226+0000 7ff15d7fa700 1 -- 172.21.15.33:0/693933427 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) v1 ==== 97+0+0 (secure 0 0 0) 0x7ff164017080 con 0x7ff1680cb5a0 2023-10-09T15:31:42.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 msgr2=0x7ff14c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 0x7ff14c0693e0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7ff158009860 tx=0x7ff158017000 comp rx=0 tx=0).stop 2023-10-09T15:31:42.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 msgr2=0x7ff1680c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7ff16400c790 tx=0x7ff164007ea0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 shutdown_connections 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff14c066f30 0x7ff14c0693e0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1680cb5a0 0x7ff1680c77c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff16815a400 0x7ff16815da30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 --2- 172.21.15.33:0/693933427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1680cb970 0x7ff168153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 >> 172.21.15.33:0/693933427 conn(0x7ff168070e30 msgr2=0x7ff1680cd880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 shutdown_connections 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.229+0000 7ff16f6e9700 1 -- 172.21.15.33:0/693933427 wait complete. 2023-10-09T15:31:42.231 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:31:42.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:31:42.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.371+0000 7fefed5b0700 1 Processor -- start 2023-10-09T15:31:42.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.371+0000 7fefed5b0700 1 -- start start 2023-10-09T15:31:42.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefed5b0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fefe8153c30 0x7fefe815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefed5b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefe80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefed5b0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe815afd0 con 0x7fefe80cef40 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefed5b0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe815b2b0 con 0x7fefe8153c30 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefed5b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe815b590 con 0x7fefe815de50 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefecdaf700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fefe80cef40 0x7fefe806d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48964/0 (socket says 172.21.15.33:48964) 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefecdaf700 1 -- 172.21.15.33:0/2208415802 learned_addr learned my addr 172.21.15.33:0/2208415802 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefe77fe700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefe80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> v2:172.21.15.59:3300/0 conn(0x7fefe8153c30 0x7fefe815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 477927394 0 0) 0x7fefe815afd0 con 0x7fefe80cef40 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.372+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefd4003570 con 0x7fefe80cef40 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3219623208 0 0) 0x7fefd4003570 con 0x7fefe80cef40 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 msgr2=0x7fefe80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefe80cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 >> v2:172.21.15.59:3300/0 conn(0x7fefe8153c30 msgr2=0x7fefe815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/2208415802 >> v2:172.21.15.59:3300/0 conn(0x7fefe8153c30 0x7fefe815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe815b870 con 0x7fefe80cef40 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fefe00017f0 con 0x7fefe80cef40 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> v2:172.21.15.59:3300/0 conn(0x7fefe8153c30 0x7fefe815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 >> v1:172.21.15.33:6789/0 conn(0x7fefe80cef40 legacy=0x7fefe806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefd4003a60 0x7fefd4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefd4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefd4004d50 0x7fefd40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe815b2b0 con 0x7fefd4003a60 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe815b590 con 0x7fefd4004d50 2023-10-09T15:31:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefd400ba60 con 0x7fefe815de50 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefd4003a60 0x7fefd4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe77fe700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefd4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefecdaf700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefd4004d50 0x7fefd40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 -- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 msgr2=0x7fefd4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe815de50 0x7fefd4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 -- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefd4004d50 msgr2=0x7fefd40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefd4004d50 0x7fefd40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 -- 172.21.15.33:0/2208415802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd4003570 con 0x7fefd4003a60 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.373+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefd4003a60 0x7fefd4003e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009df0 tx=0x7fefd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89c0a2e1650ad287 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000e8c0 con 0x7fefd4003a60 2023-10-09T15:31:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd000ea20 con 0x7fefd4003a60 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefe6ffd700 1 -- 172.21.15.33:0/2208415802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd000edc0 con 0x7fefd4003a60 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 -- 172.21.15.33:0/2208415802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefd4003a60 msgr2=0x7fefd4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2208415802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefd4003a60 0x7fefd4003e70 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fefd0009df0 tx=0x7fefd00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefecdaf700 1 -- 172.21.15.33:0/2208415802 reap_dead start 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 -- 172.21.15.33:0/2208415802 shutdown_connections 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 -- 172.21.15.33:0/2208415802 >> 172.21.15.33:0/2208415802 conn(0x7fefe80703a0 msgr2=0x7fefe80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 -- 172.21.15.33:0/2208415802 shutdown_connections 2023-10-09T15:31:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.374+0000 7fefed5b0700 1 -- 172.21.15.33:0/2208415802 wait complete. 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.375+0000 7fefed5b0700 1 Processor -- start 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 -- start start 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 0x7fefe8154000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80c8fe0 0x7fefe80b4090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80c82b0 con 0x7fefe80b5a40 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80c8b50 con 0x7fefe80c8fe0 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefed5b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80b5fb0 con 0x7fefd4003a60 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefe77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefe77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42538/0 (socket says 172.21.15.33:42538) 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefe77fe700 1 -- 172.21.15.33:0/2886211028 learned_addr learned my addr 172.21.15.33:0/2886211028 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 0x7fefe8154000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.376+0000 7fefecdaf700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80c8fe0 0x7fefe80b4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 -- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 msgr2=0x7fefe8154000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 0x7fefe8154000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 -- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80c8fe0 msgr2=0x7fefe80b4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80c8fe0 0x7fefe80b4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 -- 172.21.15.33:0/2886211028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe80c8500 con 0x7fefe80b5a40 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 0x7fefe8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefe77fe700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefd8011d70 tx=0x7fefd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800fac0 con 0x7fefe80b5a40 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800fc20 con 0x7fefe80b5a40 2023-10-09T15:31:42.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe80c87e0 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8014440 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.377+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe8153650 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.378+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe804c3c0 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.378+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefd8014870 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.379+0000 7fefdffff700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 0x7fefc80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.379+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fefd8018030 con 0x7fefe80b5a40 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.379+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 0x7fefc80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.379+0000 7fefe7fff700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 0x7fefc80693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefd00091e0 tx=0x7fefd001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.383+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd80522b0 con 0x7fefe80b5a40 2023-10-09T15:31:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.656+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fefe80caef0 con 0x7fefe80b5a40 2023-10-09T15:31:42.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.656+0000 7fefdffff700 1 -- 172.21.15.33:0/2886211028 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fefd8022090 con 0x7fefe80b5a40 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:31:42.658 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.659 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.660 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.661 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.662 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:31:42.663 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.664 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:31:42.665 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:31:42.666 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.667 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.668 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:31:42.669 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:31:42.670 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mds", 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRlbgeQGRAA8f/qbe2YXyyUtD+Y9ZI9GA==", 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mds" 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.671 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-mgr", 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRloxCQGRAAjyMWPoFH0pOFQ8sIy6vPkw==", 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-mgr" 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-osd", 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRlyByQGRAA0JXPatRAlYvkbfGbCnQMPA==", 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-osd" 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.672 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd", 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRl9iSQGRAAqtMGDbpFB9hnmP/AkwgEnQ==", 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd" 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRlMC2QGRAAvqIzA7nE+zhXKq0Kvmp3EQ==", 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.673 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.bootstrap-rgw", 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQChHCRlhjWQGRAAQOPIwqBCaFilrBoV6mO9Bg==", 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile bootstrap-rgw" 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:31:42.674 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:42.675 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:31:42.676 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 msgr2=0x7fefc80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 0x7fefc80693e0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fefd00091e0 tx=0x7fefd001a000 comp rx=0 tx=0).stop 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 msgr2=0x7fefe80b3b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fefd8011d70 tx=0x7fefd80091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 shutdown_connections 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8066f30 0x7fefc80693e0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80c8fe0 0x7fefe80b4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefd4003a60 0x7fefe8154000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 --2- 172.21.15.33:0/2886211028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe80b5a40 0x7fefe80b3b50 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 >> 172.21.15.33:0/2886211028 conn(0x7fefe80703a0 msgr2=0x7fefe80c6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 shutdown_connections 2023-10-09T15:31:42.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.659+0000 7fefed5b0700 1 -- 172.21.15.33:0/2886211028 wait complete. 2023-10-09T15:31:42.678 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-10-09T15:31:42.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.798+0000 7f4854718700 1 Processor -- start 2023-10-09T15:31:42.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.798+0000 7f4854718700 1 -- start start 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4854718700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f484c1595d0 0x7f484c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4854718700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f484c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4854718700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f484c0c7f50 con 0x7f484c0675a0 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4854718700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f484c06bd00 con 0x7f484c1595d0 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4854718700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c06b740 con 0x7f484c067a40 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4851cb3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f484c0675a0 0x7f484c06acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48978/0 (socket says 172.21.15.33:48978) 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4851cb3700 1 -- 172.21.15.33:0/250338943 learned_addr learned my addr 172.21.15.33:0/250338943 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148658184 0 0) 0x7f484c0c7f50 con 0x7f484c0675a0 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f4852cb5700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f484c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4834003570 con 0x7f484c0675a0 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48524b4700 1 --2- 172.21.15.33:0/250338943 >> v2:172.21.15.59:3300/0 conn(0x7f484c1595d0 0x7f484c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4218863172 0 0) 0x7f4834003570 con 0x7f484c0675a0 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 msgr2=0x7f484c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f484c0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 >> v2:172.21.15.59:3300/0 conn(0x7f484c1595d0 msgr2=0x7f484c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 --2- 172.21.15.33:0/250338943 >> v2:172.21.15.59:3300/0 conn(0x7f484c1595d0 0x7f484c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c06ba20 con 0x7f484c0675a0 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f4840001470 con 0x7f484c0675a0 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 >> v1:172.21.15.33:6789/0 conn(0x7f484c0675a0 legacy=0x7f484c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834003a60 0x7f4834003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f4834004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4834004d50 0x7f48340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c06b740 con 0x7f4834004d50 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f483400ba60 con 0x7f4834003a60 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.799+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f483400bba0 con 0x7f484c067a40 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4834004d50 0x7f48340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f48524b4700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834003a60 0x7f4834003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4851cb3700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f4834004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 -- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 msgr2=0x7f4834004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f4834004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 -- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834003a60 msgr2=0x7f4834003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834003a60 0x7f4834003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 -- 172.21.15.33:0/250338943 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4834003570 con 0x7f4834004d50 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4851cb3700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c067a40 0x7f4834004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:42.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f4852cb5700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4834004d50 0x7f48340051c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f484400e210 tx=0x7f484400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8173a8979ab6929f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400ea60 con 0x7f4834004d50 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484400f040 con 0x7f4834004d50 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.800+0000 7f48514b2700 1 -- 172.21.15.33:0/250338943 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400ee10 con 0x7f4834004d50 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 -- 172.21.15.33:0/250338943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4834004d50 msgr2=0x7f48340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 --2- 172.21.15.33:0/250338943 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4834004d50 0x7f48340051c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f484400e210 tx=0x7f484400b040 comp rx=0 tx=0).stop 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4852cb5700 1 -- 172.21.15.33:0/250338943 reap_dead start 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 -- 172.21.15.33:0/250338943 shutdown_connections 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 -- 172.21.15.33:0/250338943 >> 172.21.15.33:0/250338943 conn(0x7f484c0cd400 msgr2=0x7f484c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 -- 172.21.15.33:0/250338943 shutdown_connections 2023-10-09T15:31:42.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.801+0000 7f4854718700 1 -- 172.21.15.33:0/250338943 wait complete. 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.802+0000 7f4854718700 1 Processor -- start 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.802+0000 7f4854718700 1 -- start start 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834004d50 0x7f484c0c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c14de10 0x7f484c15c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0b0b60 con 0x7f484c0c5480 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c6520 con 0x7f4834004d50 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484c0c5910 con 0x7f484c14de10 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42558/0 (socket says 172.21.15.33:42558) 2023-10-09T15:31:42.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 -- 172.21.15.33:0/1848145632 learned_addr learned my addr 172.21.15.33:0/1848145632 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f48524b4700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834004d50 0x7f484c0c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4851cb3700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c14de10 0x7f484c15c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 -- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c14de10 msgr2=0x7f484c15c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c14de10 0x7f484c15c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 -- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834004d50 msgr2=0x7f484c0c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834004d50 0x7f484c0c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 -- 172.21.15.33:0/1848145632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f484c0c5bf0 con 0x7f484c0c5480 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4852cb5700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4844016000 tx=0x7f484401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484400ee60 con 0x7f484c0c5480 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4844022070 con 0x7f484c0c5480 2023-10-09T15:31:42.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f484c0c5ed0 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4844027680 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.803+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f484c15c5f0 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.804+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f484c0c66d0 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.805+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4844024030 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.805+0000 7f484a7fc700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.805+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4844085c70 con 0x7f484c0c5480 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.805+0000 7f48524b4700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.806+0000 7f48524b4700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 0x7f48380693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f483c006f00 tx=0x7f483c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:42.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:42.809+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f484c0c66d0 con 0x7f484c0c5480 2023-10-09T15:31:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.082+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f484c06b4e0 con 0x7f484c0c5480 2023-10-09T15:31:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.086+0000 7f484a7fc700 1 -- 172.21.15.33:0/1848145632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f48440532e0 con 0x7f484c0c5480 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 msgr2=0x7f48380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 0x7f48380693e0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f483c006f00 tx=0x7f483c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 msgr2=0x7f484c16bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f4844016000 tx=0x7f484401a000 comp rx=0 tx=0).stop 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 shutdown_connections 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4838066f30 0x7f48380693e0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f484c0c5480 0x7f484c16bcd0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4834004d50 0x7f484c0c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 --2- 172.21.15.33:0/1848145632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f484c14de10 0x7f484c15c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 >> 172.21.15.33:0/1848145632 conn(0x7f484c0cd400 msgr2=0x7f484c0c2620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 shutdown_connections 2023-10-09T15:31:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.088+0000 7f4854718700 1 -- 172.21.15.33:0/1848145632 wait complete. 2023-10-09T15:31:43.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-10-09T15:31:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.220+0000 7fb616336700 1 Processor -- start 2023-10-09T15:31:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.220+0000 7fb616336700 1 -- start start 2023-10-09T15:31:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb616336700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 0x7fb61015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb616336700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 0x7fb6100cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb616336700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb61015afd0 con 0x7fb6100cef40 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb616336700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb61015b2b0 con 0x7fb61015de50 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb616336700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb61015b590 con 0x7fb610153c30 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb615b35700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb6100cef40 0x7fb61006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48992/0 (socket says 172.21.15.33:48992) 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb615b35700 1 -- 172.21.15.33:0/4184082637 learned_addr learned my addr 172.21.15.33:0/4184082637 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb615334700 1 --2- 172.21.15.33:0/4184082637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 0x7fb61015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb614b33700 1 --2- 172.21.15.33:0/4184082637 >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 0x7fb6100cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb60ffff700 1 -- 172.21.15.33:0/4184082637 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601550135 0 0) 0x7fb61015afd0 con 0x7fb6100cef40 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.221+0000 7fb60ffff700 1 -- 172.21.15.33:0/4184082637 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb5f8003570 con 0x7fb6100cef40 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb615334700 1 -- 172.21.15.33:0/4184082637 >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 msgr2=0x7fb6100cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb615334700 1 --2- 172.21.15.33:0/4184082637 >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 0x7fb6100cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb615334700 1 -- 172.21.15.33:0/4184082637 >> v1:172.21.15.33:6789/0 conn(0x7fb6100cef40 legacy=0x7fb61006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb615334700 1 -- 172.21.15.33:0/4184082637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb61015b870 con 0x7fb610153c30 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb614b33700 1 --2- 172.21.15.33:0/4184082637 >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 0x7fb6100cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb615334700 1 --2- 172.21.15.33:0/4184082637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 0x7fb61015a5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6080098e0 tx=0x7fb6080091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29f448db21e5cea3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb60ffff700 1 -- 172.21.15.33:0/4184082637 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011630 con 0x7fb610153c30 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb60ffff700 1 -- 172.21.15.33:0/4184082637 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb608011790 con 0x7fb610153c30 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb60ffff700 1 -- 172.21.15.33:0/4184082637 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb608011b30 con 0x7fb610153c30 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb616336700 1 -- 172.21.15.33:0/4184082637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 msgr2=0x7fb61015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.222+0000 7fb616336700 1 --2- 172.21.15.33:0/4184082637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 0x7fb61015a5e0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fb6080098e0 tx=0x7fb6080091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 -- 172.21.15.33:0/4184082637 shutdown_connections 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 --2- 172.21.15.33:0/4184082637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb610153c30 0x7fb61015a5e0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 --2- 172.21.15.33:0/4184082637 >> v2:172.21.15.59:3300/0 conn(0x7fb61015de50 0x7fb6100cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 -- 172.21.15.33:0/4184082637 >> 172.21.15.33:0/4184082637 conn(0x7fb6100703a0 msgr2=0x7fb6100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 -- 172.21.15.33:0/4184082637 shutdown_connections 2023-10-09T15:31:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.223+0000 7fb616336700 1 -- 172.21.15.33:0/4184082637 wait complete. 2023-10-09T15:31:43.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.224+0000 7fb616336700 1 Processor -- start 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.224+0000 7fb616336700 1 -- start start 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6100cef40 0x7fb6100c8d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb610153c30 0x7fb610151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100b42d0 con 0x7fb61015de50 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c95b0 con 0x7fb610153c30 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb616336700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6100c9890 con 0x7fb6100cef40 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42568/0 (socket says 172.21.15.33:42568) 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 -- 172.21.15.33:0/2048195586 learned_addr learned my addr 172.21.15.33:0/2048195586 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615334700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6100cef40 0x7fb6100c8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb614b33700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb610153c30 0x7fb610151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 -- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6100cef40 msgr2=0x7fb6100c8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6100cef40 0x7fb6100c8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 -- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb610153c30 msgr2=0x7fb610151c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb610153c30 0x7fb610151c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 -- 172.21.15.33:0/2048195586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb604009420 con 0x7fb61015de50 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb615b35700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb600001460 tx=0x7fb600001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.225+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000a870 con 0x7fb61015de50 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.226+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb60000a9d0 con 0x7fb61015de50 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.226+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb608009420 con 0x7fb61015de50 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.226+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb60000ad50 con 0x7fb61015de50 2023-10-09T15:31:43.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.226+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6100c9e50 con 0x7fb61015de50 2023-10-09T15:31:43.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.227+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb61004c3c0 con 0x7fb61015de50 2023-10-09T15:31:43.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.227+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb600007300 con 0x7fb61015de50 2023-10-09T15:31:43.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.227+0000 7fb60d7fa700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.227+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb600084580 con 0x7fb61015de50 2023-10-09T15:31:43.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.227+0000 7fb615334700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.228+0000 7fb615334700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 0x7fb5fc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6080091e0 tx=0x7fb608017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.232+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb600051a90 con 0x7fb61015de50 2023-10-09T15:31:43.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.506+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7fb6100caef0 con 0x7fb61015de50 2023-10-09T15:31:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.509+0000 7fb60d7fa700 1 -- 172.21.15.33:0/2048195586 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fb600084030 con 0x7fb61015de50 2023-10-09T15:31:43.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 msgr2=0x7fb5fc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 0x7fb5fc0693e0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb6080091e0 tx=0x7fb608017000 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 msgr2=0x7fb6100cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fb600001460 tx=0x7fb600001a40 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 shutdown_connections 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb5fc066f30 0x7fb5fc0693e0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb61015de50 0x7fb6100cc680 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6100cef40 0x7fb6100c8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 --2- 172.21.15.33:0/2048195586 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb610153c30 0x7fb610151c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 >> 172.21.15.33:0/2048195586 conn(0x7fb6100703a0 msgr2=0x7fb61015bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 shutdown_connections 2023-10-09T15:31:43.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.511+0000 7fb616336700 1 -- 172.21.15.33:0/2048195586 wait complete. 2023-10-09T15:31:43.524 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-10-09T15:31:43.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.643+0000 7fefea3d0700 1 Processor -- start 2023-10-09T15:31:43.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefea3d0700 1 -- start start 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefea3d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fefe415a7d0 0x7fefe4158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefea3d0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe4158c80 con 0x7fefe41508c0 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefea3d0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe4158f60 con 0x7fefe4150c90 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefea3d0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe415afc0 con 0x7fefe415a7d0 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefe37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fefe415a7d0 0x7fefe4158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.644+0000 7fefe3fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fefe41508c0 0x7fefe415a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49000/0 (socket says 172.21.15.33:49000) 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe3fff700 1 -- 172.21.15.33:0/1738844062 learned_addr learned my addr 172.21.15.33:0/1738844062 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe37fe700 1 -- 172.21.15.33:0/1738844062 >> v1:172.21.15.59:6789/0 conn(0x7fefe4150c90 legacy=0x7fefe4154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe37fe700 1 -- 172.21.15.33:0/1738844062 >> v1:172.21.15.33:6789/0 conn(0x7fefe41508c0 legacy=0x7fefe415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe2ffd700 1 -- 172.21.15.33:0/1738844062 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1530830396 0 0) 0x7fefe4158c80 con 0x7fefe41508c0 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe37fe700 1 -- 172.21.15.33:0/1738844062 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe4159240 con 0x7fefe415a7d0 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe37fe700 1 --2- 172.21.15.33:0/1738844062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe415a7d0 0x7fefe4158650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0098e0 tx=0x7fefcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57d62e167d8036b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe2ffd700 1 -- 172.21.15.33:0/1738844062 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc009e80 con 0x7fefe415a7d0 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe2ffd700 1 -- 172.21.15.33:0/1738844062 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefcc00b820 con 0x7fefe415a7d0 2023-10-09T15:31:43.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.645+0000 7fefe2ffd700 1 -- 172.21.15.33:0/1738844062 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00bba0 con 0x7fefe415a7d0 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 -- 172.21.15.33:0/1738844062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe415a7d0 msgr2=0x7fefe4158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 --2- 172.21.15.33:0/1738844062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe415a7d0 0x7fefe4158650 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0098e0 tx=0x7fefcc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 -- 172.21.15.33:0/1738844062 shutdown_connections 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 --2- 172.21.15.33:0/1738844062 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe415a7d0 0x7fefe4158650 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 -- 172.21.15.33:0/1738844062 >> 172.21.15.33:0/1738844062 conn(0x7fefe40cded0 msgr2=0x7fefe406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 -- 172.21.15.33:0/1738844062 shutdown_connections 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.646+0000 7fefea3d0700 1 -- 172.21.15.33:0/1738844062 wait complete. 2023-10-09T15:31:43.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.647+0000 7fefea3d0700 1 Processor -- start 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.647+0000 7fefea3d0700 1 -- start start 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe4150c90 0x7fefe40c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe415a7d0 0x7fefe4068670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe414f610 con 0x7fefe41508c0 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4155a60 con 0x7fefe4150c90 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe4155130 con 0x7fefe415a7d0 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42584/0 (socket says 172.21.15.33:42584) 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 -- 172.21.15.33:0/291962911 learned_addr learned my addr 172.21.15.33:0/291962911 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:43.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe37fe700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe4150c90 0x7fefe40c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe896d700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe415a7d0 0x7fefe4068670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 -- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe415a7d0 msgr2=0x7fefe4068670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe415a7d0 0x7fefe4068670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 -- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe4150c90 msgr2=0x7fefe40c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe4150c90 0x7fefe40c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 -- 172.21.15.33:0/291962911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefcc009420 con 0x7fefe41508c0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefe3fff700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c5b0 tx=0x7fefd4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4005b30 con 0x7fefe41508c0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd4005c90 con 0x7fefe41508c0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe4155410 con 0x7fefe41508c0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.648+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd4007300 con 0x7fefe41508c0 2023-10-09T15:31:43.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.649+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe4169a30 con 0x7fefe41508c0 2023-10-09T15:31:43.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.649+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe404c3c0 con 0x7fefe41508c0 2023-10-09T15:31:43.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.650+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fefd40076b0 con 0x7fefe41508c0 2023-10-09T15:31:43.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.650+0000 7fefdbfff700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 0x7fefc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:43.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.650+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fefd4083680 con 0x7fefe41508c0 2023-10-09T15:31:43.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.650+0000 7fefe37fe700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 0x7fefc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:43.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.651+0000 7fefe37fe700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 0x7fefc40693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0030c0 tx=0x7fefcc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:43.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.655+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd4050c40 con 0x7fefe41508c0 2023-10-09T15:31:43.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.927+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7fefe4159520 con 0x7fefe41508c0 2023-10-09T15:31:43.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.930+0000 7fefdbfff700 1 -- 172.21.15.33:0/291962911 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) v1 ==== 90+0+0 (secure 0 0 0) 0x7fefd4054260 con 0x7fefe41508c0 2023-10-09T15:31:43.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 msgr2=0x7fefc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 0x7fefc40693e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fefcc0030c0 tx=0x7fefcc016000 comp rx=0 tx=0).stop 2023-10-09T15:31:43.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 msgr2=0x7fefe414f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fefd400c5b0 tx=0x7fefd4001070 comp rx=0 tx=0).stop 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 shutdown_connections 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc4066f30 0x7fefc40693e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe41508c0 0x7fefe414f0d0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe415a7d0 0x7fefe4068670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 --2- 172.21.15.33:0/291962911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe4150c90 0x7fefe40c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 >> 172.21.15.33:0/291962911 conn(0x7fefe40cded0 msgr2=0x7fefe40675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 shutdown_connections 2023-10-09T15:31:43.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:43.932+0000 7fefea3d0700 1 -- 172.21.15.33:0/291962911 wait complete. 2023-10-09T15:31:43.945 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-10-09T15:31:44.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.065+0000 7f68cec4c700 1 Processor -- start 2023-10-09T15:31:44.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.065+0000 7f68cec4c700 1 -- start start 2023-10-09T15:31:44.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68c8153c30 0x7f68c815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68c815de50 0x7f68c80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c80cf3c0 con 0x7f68c815de50 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68c815afd0 con 0x7f68c8153c30 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cec4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c815b2b0 con 0x7f68c80cef40 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68c815de50 0x7f68c80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68c815de50 0x7f68c80cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42586/0 (socket says 172.21.15.33:42586) 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 -- 172.21.15.33:0/1291504406 learned_addr learned my addr 172.21.15.33:0/1291504406 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68ce44b700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cdc4a700 1 --2- 172.21.15.33:0/1291504406 >> v2:172.21.15.59:3300/0 conn(0x7f68c8153c30 0x7f68c815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 -- 172.21.15.33:0/1291504406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 msgr2=0x7f68c806d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c806d790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 -- 172.21.15.33:0/1291504406 >> v2:172.21.15.59:3300/0 conn(0x7f68c8153c30 msgr2=0x7f68c815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 --2- 172.21.15.33:0/1291504406 >> v2:172.21.15.59:3300/0 conn(0x7f68c8153c30 0x7f68c815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.066+0000 7f68cd449700 1 -- 172.21.15.33:0/1291504406 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c815b590 con 0x7f68c815de50 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cd449700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c80cea00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68c806ead0 tx=0x7f68bc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76bb4ea52b652e60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68ccc48700 1 -- 172.21.15.33:0/1291504406 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00b860 con 0x7f68c815de50 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68ccc48700 1 -- 172.21.15.33:0/1291504406 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68bc00b9c0 con 0x7f68c815de50 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68ccc48700 1 -- 172.21.15.33:0/1291504406 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68bc00bd60 con 0x7f68c815de50 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 -- 172.21.15.33:0/1291504406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 msgr2=0x7f68c80cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c80cea00 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f68c806ead0 tx=0x7f68bc009250 comp rx=0 tx=0).stop 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 -- 172.21.15.33:0/1291504406 shutdown_connections 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 --2- 172.21.15.33:0/1291504406 >> v2:172.21.15.59:3300/0 conn(0x7f68c8153c30 0x7f68c815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c806d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 --2- 172.21.15.33:0/1291504406 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c80cea00 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 -- 172.21.15.33:0/1291504406 >> 172.21.15.33:0/1291504406 conn(0x7f68c80703a0 msgr2=0x7f68c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:44.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 -- 172.21.15.33:0/1291504406 shutdown_connections 2023-10-09T15:31:44.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.067+0000 7f68cec4c700 1 -- 172.21.15.33:0/1291504406 wait complete. 2023-10-09T15:31:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 Processor -- start 2023-10-09T15:31:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 -- start start 2023-10-09T15:31:44.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c80b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c8153c30 0x7f68c8140be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80cce20 con 0x7f68c815de50 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80c85c0 con 0x7f68c8153c30 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68cec4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68c80c7c90 con 0x7f68c80cef40 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68ce44b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68ce44b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42592/0 (socket says 172.21.15.33:42592) 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.069+0000 7f68ce44b700 1 -- 172.21.15.33:0/3541504870 learned_addr learned my addr 172.21.15.33:0/3541504870 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68cdc4a700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c80b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68cd449700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c8153c30 0x7f68c8140be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 -- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 msgr2=0x7f68c80b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c80b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 -- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c8153c30 msgr2=0x7f68c8140be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c8153c30 0x7f68c8140be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 -- 172.21.15.33:0/3541504870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68bc0094f0 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68ce44b700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009fd0 tx=0x7f68b8009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b800ebf0 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68b800ed50 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c80c7f70 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68b8014670 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.070+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68c80b3a60 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.071+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68c80b3c50 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.071+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f68b80149e0 con 0x7f68c815de50 2023-10-09T15:31:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.072+0000 7f68c5ffb700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 0x7f68b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.072+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f68b8084850 con 0x7f68c815de50 2023-10-09T15:31:44.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.072+0000 7f68cdc4a700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 0x7f68b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.072+0000 7f68cdc4a700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 0x7f68b40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68c0006fd0 tx=0x7f68c0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.076+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68b8051e10 con 0x7f68c815de50 2023-10-09T15:31:44.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.349+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7f68c804c3c0 con 0x7f68c815de50 2023-10-09T15:31:44.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.353+0000 7f68c5ffb700 1 -- 172.21.15.33:0/3541504870 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f68b8055430 con 0x7f68c815de50 2023-10-09T15:31:44.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 msgr2=0x7f68b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 0x7f68b40693e0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f68c0006fd0 tx=0x7f68c0008040 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 msgr2=0x7f68c8141120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f68b8009fd0 tx=0x7f68b8009900 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 shutdown_connections 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4066f30 0x7f68b40693e0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68c815de50 0x7f68c8141120 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68c80cef40 0x7f68c80b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 --2- 172.21.15.33:0/3541504870 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68c8153c30 0x7f68c8140be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 >> 172.21.15.33:0/3541504870 conn(0x7f68c80703a0 msgr2=0x7f68c80d07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 shutdown_connections 2023-10-09T15:31:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.355+0000 7f68cec4c700 1 -- 172.21.15.33:0/3541504870 wait complete. 2023-10-09T15:31:44.368 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-10-09T15:31:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.487+0000 7f8d30ad6700 1 Processor -- start 2023-10-09T15:31:44.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.487+0000 7f8d30ad6700 1 -- start start 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d30ad6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d2c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d30ad6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c15afd0 con 0x7f8d2c0cf110 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d30ad6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d2c15b2b0 con 0x7f8d2c15de50 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d30ad6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c15b590 con 0x7f8d2c153c30 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d2bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8d2c0cf110 0x7f8d2c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49016/0 (socket says 172.21.15.33:49016) 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.488+0000 7f8d2bfff700 1 -- 172.21.15.33:0/2260838585 learned_addr learned my addr 172.21.15.33:0/2260838585 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d2c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1939684602 0 0) 0x7f8d2c15afd0 con 0x7f8d2c0cf110 2023-10-09T15:31:44.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d14003570 con 0x7f8d2c0cf110 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3818860754 0 0) 0x7f8d14003570 con 0x7f8d2c0cf110 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 msgr2=0x7f8d2c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d2c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 >> v1:172.21.15.59:6789/0 conn(0x7f8d2c15de50 legacy=0x7f8d2c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c15b870 con 0x7f8d2c0cf110 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8d240017f0 con 0x7f8d2c0cf110 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d2c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 >> v1:172.21.15.33:6789/0 conn(0x7f8d2c0cf110 legacy=0x7f8d2c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d14003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d14004080 0x7f8d14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004d50 0x7f8d140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c15b590 con 0x7f8d14004080 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1400bca0 con 0x7f8d14004d50 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d1400be60 con 0x7f8d2c153c30 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d14004080 0x7f8d14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d14003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2bfff700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004d50 0x7f8d140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 -- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 msgr2=0x7f8d14003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c153c30 0x7f8d14003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 -- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004d50 msgr2=0x7f8d140051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004d50 0x7f8d140051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2affd700 1 -- 172.21.15.33:0/2260838585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d14003570 con 0x7f8d14004080 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.489+0000 7f8d2bfff700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004d50 0x7f8d140051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d14004080 0x7f8d14004810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001880 tx=0x7f8d20007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=171dea027d654596 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20012420 con 0x7f8d14004080 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20012580 con 0x7f8d14004080 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d2a7fc700 1 -- 172.21.15.33:0/2260838585 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20012920 con 0x7f8d14004080 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2260838585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d14004080 msgr2=0x7f8d14004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2260838585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d14004080 0x7f8d14004810 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f8d20001880 tx=0x7f8d20007d30 comp rx=0 tx=0).stop 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d2bfff700 1 -- 172.21.15.33:0/2260838585 reap_dead start 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2260838585 shutdown_connections 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2260838585 >> 172.21.15.33:0/2260838585 conn(0x7f8d2c0703a0 msgr2=0x7f8d2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2260838585 shutdown_connections 2023-10-09T15:31:44.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.490+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2260838585 wait complete. 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 Processor -- start 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 -- start start 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 0x7f8d2c0b4130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c0cb380 0x7f8d2c0b1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0b4670 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c1522f0 con 0x7f8d14004080 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d30ad6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d2c0cbcf0 con 0x7f8d2c0cb380 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d2affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42614/0 (socket says 172.21.15.33:42614) 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.492+0000 7f8d2affd700 1 -- 172.21.15.33:0/2361702117 learned_addr learned my addr 172.21.15.33:0/2361702117 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 0x7f8d2c0b4130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 -- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c0cb380 msgr2=0x7f8d2c0b1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2bfff700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c0cb380 0x7f8d2c0b1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c0cb380 0x7f8d2c0b1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 -- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 msgr2=0x7f8d2c0b4130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 0x7f8d2c0b4130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 -- 172.21.15.33:0/2361702117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d2c0cbfd0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 0x7f8d2c0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d2affd700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400bc70 tx=0x7f8d20015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20012420 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d20001200 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d2c0cc2b0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d20012ea0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.493+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d2c0c8ca0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.494+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d2c04c3c0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.494+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8d20019030 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.495+0000 7f8d137fe700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.495+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8d20085750 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.495+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.495+0000 7f8d2b7fe700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 0x7f8d180693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006fa0 tx=0x7f8d1c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.499+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d20052d10 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.775+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f8d2c0b4670 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.778+0000 7f8d137fe700 1 -- 172.21.15.33:0/2361702117 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8d200220a0 con 0x7f8d2c0c82d0 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 msgr2=0x7f8d180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 0x7f8d180693e0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8d1c006fa0 tx=0x7f8d1c008040 comp rx=0 tx=0).stop 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 msgr2=0x7f8d2c151db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f8d1400bc70 tx=0x7f8d20015000 comp rx=0 tx=0).stop 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 shutdown_connections 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d18066f30 0x7f8d180693e0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d2c0cb380 0x7f8d2c0b1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d14004080 0x7f8d2c0b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 --2- 172.21.15.33:0/2361702117 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d2c0c82d0 0x7f8d2c151db0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 >> 172.21.15.33:0/2361702117 conn(0x7f8d2c0703a0 msgr2=0x7f8d2c15c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 shutdown_connections 2023-10-09T15:31:44.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.780+0000 7f8d30ad6700 1 -- 172.21.15.33:0/2361702117 wait complete. 2023-10-09T15:31:44.793 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-10-09T15:31:44.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.911+0000 7f4f1f67b700 1 Processor -- start 2023-10-09T15:31:44.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.911+0000 7f4f1f67b700 1 -- start start 2023-10-09T15:31:44.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1f67b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f18164860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1f67b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180aeee0 con 0x7f4f180a90d0 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1f67b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f180cf490 con 0x7f4f180a8d00 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1f67b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180ae680 con 0x7f4f1806e550 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1cc16700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4f180a90d0 0x7f4f1806de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49032/0 (socket says 172.21.15.33:49032) 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.912+0000 7f4f1cc16700 1 -- 172.21.15.33:0/3419052791 learned_addr learned my addr 172.21.15.33:0/3419052791 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f18164860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732316385 0 0) 0x7f4f180aeee0 con 0x7f4f180a90d0 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f00003570 con 0x7f4f180a90d0 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1297885561 0 0) 0x7f4f00003570 con 0x7f4f180a90d0 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 msgr2=0x7f4f18164860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f18164860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 >> v1:172.21.15.59:6789/0 conn(0x7f4f180a8d00 legacy=0x7f4f180cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f180cf1b0 con 0x7f4f180a90d0 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f4f0c0015f0 con 0x7f4f180a90d0 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 >> v1:172.21.15.33:6789/0 conn(0x7f4f180a90d0 legacy=0x7f4f1806de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00003a90 0x7f4f00003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f00004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f00004da0 0x7f4f000051f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f180ae680 con 0x7f4f00004da0 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0000bc50 con 0x7f4f00003a90 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f0000be10 con 0x7f4f1806e550 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f00004da0 0x7f4f000051f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1cc16700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f00004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1d417700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00003a90 0x7f4f00003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 msgr2=0x7f4f00004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f1806e550 0x7f4f00004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00003a90 msgr2=0x7f4f00003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f00003a90 0x7f4f00003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.913+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3419052791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f00003570 con 0x7f4f00004da0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f00004da0 0x7f4f000051f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806e950 tx=0x7f4f10008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=862c293361db56e9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000b4d0 con 0x7f4f00004da0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f1000d5d0 con 0x7f4f00004da0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f17fff700 1 -- 172.21.15.33:0/3419052791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f1000d990 con 0x7f4f00004da0 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3419052791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f00004da0 msgr2=0x7f4f000051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3419052791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f00004da0 0x7f4f000051f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f4f1806e950 tx=0x7f4f10008040 comp rx=0 tx=0).stop 2023-10-09T15:31:44.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3419052791 reap_dead start 2023-10-09T15:31:44.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3419052791 shutdown_connections 2023-10-09T15:31:44.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3419052791 >> 172.21.15.33:0/3419052791 conn(0x7f4f1806ce80 msgr2=0x7f4f180ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:44.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3419052791 shutdown_connections 2023-10-09T15:31:44.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.914+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3419052791 wait complete. 2023-10-09T15:31:44.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.916+0000 7f4f1f67b700 1 Processor -- start 2023-10-09T15:31:44.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.916+0000 7f4f1f67b700 1 -- start start 2023-10-09T15:31:44.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f18150a70 0x7f4f1809a230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f18150e40 0x7f4f1815db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1809ac80 con 0x7f4f1809a770 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1809af60 con 0x7f4f18150e40 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f1809b240 con 0x7f4f18150a70 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42636/0 (socket says 172.21.15.33:42636) 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3555583195 learned_addr learned my addr 172.21.15.33:0/3555583195 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1d417700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f18150a70 0x7f4f1809a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1cc16700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f18150e40 0x7f4f1815db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f18150a70 msgr2=0x7f4f1809a230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f18150a70 0x7f4f1809a230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f18150e40 msgr2=0x7f4f1815db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f18150e40 0x7f4f1815db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 -- 172.21.15.33:0/3555583195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f1809b520 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1dc18700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000bc20 tx=0x7f4f1001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f100147f0 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f10014950 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f180c34a0 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f10014d10 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.917+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f180982b0 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.918+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f1809b870 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.919+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f10025620 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.919+0000 7f4f157fa700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 0x7f4f040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.919+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4f10000e40 con 0x7f4f1809a770 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.919+0000 7f4f1d417700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 0x7f4f040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.920+0000 7f4f1d417700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 0x7f4f040693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4f180ca6f0 tx=0x7f4f08001a70 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:44.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:44.924+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f10052ec0 con 0x7f4f1809a770 2023-10-09T15:31:45.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.199+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f4f1809b6b0 con 0x7f4f1809a770 2023-10-09T15:31:45.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.203+0000 7f4f157fa700 1 -- 172.21.15.33:0/3555583195 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) v1 ==== 90+0+0 (secure 0 0 0) 0x7f4f1809b6b0 con 0x7f4f1809a770 2023-10-09T15:31:45.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 msgr2=0x7f4f040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 0x7f4f040693e0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f4f180ca6f0 tx=0x7f4f08001a70 comp rx=0 tx=0).stop 2023-10-09T15:31:45.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 msgr2=0x7f4f1815e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f4f0000bc20 tx=0x7f4f1001b000 comp rx=0 tx=0).stop 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 shutdown_connections 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f04066f30 0x7f4f040693e0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f1809a770 0x7f4f1815e090 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f18150a70 0x7f4f1809a230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 --2- 172.21.15.33:0/3555583195 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f18150e40 0x7f4f1815db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 >> 172.21.15.33:0/3555583195 conn(0x7f4f1806ce80 msgr2=0x7f4f180afcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 shutdown_connections 2023-10-09T15:31:45.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.205+0000 7f4f1f67b700 1 -- 172.21.15.33:0/3555583195 wait complete. 2023-10-09T15:31:45.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:45.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.336+0000 7f1a3e532700 1 Processor -- start 2023-10-09T15:31:45.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.336+0000 7f1a3e532700 1 -- start start 2023-10-09T15:31:45.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3e532700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a380cb5a0 0x7f1a380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3e532700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3e532700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a3815ae40 con 0x7f1a380cd9e0 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3e532700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a380d13f0 con 0x7f1a380cb5a0 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3e532700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a3815ab60 con 0x7f1a3815a5d0 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a37fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a380cb5a0 0x7f1a380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a37fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1a380cb5a0 0x7f1a380cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42652/0 (socket says 172.21.15.33:42652) 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a37fff700 1 -- 172.21.15.33:0/3056704482 learned_addr learned my addr 172.21.15.33:0/3056704482 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.337+0000 7f1a3cacf700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a37fff700 1 -- 172.21.15.33:0/3056704482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 msgr2=0x7f1a38156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a37fff700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a37fff700 1 -- 172.21.15.33:0/3056704482 >> v1:172.21.15.59:6789/0 conn(0x7f1a380cd9e0 legacy=0x7f1a38159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a37fff700 1 -- 172.21.15.33:0/3056704482 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a380ccf00 con 0x7f1a380cb5a0 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3cacf700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a37fff700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a380cb970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a200099e0 tx=0x7f1a20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dae5eaa76d8cfbf1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a36ffd700 1 -- 172.21.15.33:0/3056704482 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000b820 con 0x7f1a380cb5a0 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a36ffd700 1 -- 172.21.15.33:0/3056704482 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2000b980 con 0x7f1a380cb5a0 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a36ffd700 1 -- 172.21.15.33:0/3056704482 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a2000bd20 con 0x7f1a380cb5a0 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 -- 172.21.15.33:0/3056704482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 msgr2=0x7f1a380cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a380cb970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f1a200099e0 tx=0x7f1a20009250 comp rx=0 tx=0).stop 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 -- 172.21.15.33:0/3056704482 shutdown_connections 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 --2- 172.21.15.33:0/3056704482 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a380cb970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 -- 172.21.15.33:0/3056704482 >> 172.21.15.33:0/3056704482 conn(0x7f1a38070e30 msgr2=0x7f1a380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:45.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 -- 172.21.15.33:0/3056704482 shutdown_connections 2023-10-09T15:31:45.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.338+0000 7f1a3e532700 1 -- 172.21.15.33:0/3056704482 wait complete. 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.339+0000 7f1a3e532700 1 Processor -- start 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 -- start start 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a380cd9e0 0x7f1a380b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38155d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a381596c0 con 0x7f1a380cb5a0 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38158ab0 con 0x7f1a380cd9e0 2023-10-09T15:31:45.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.340+0000 7f1a3e532700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a38158d90 con 0x7f1a3815a5d0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42654/0 (socket says 172.21.15.33:42654) 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 -- 172.21.15.33:0/1524275697 learned_addr learned my addr 172.21.15.33:0/1524275697 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a3cacf700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38155d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a377fe700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a380cd9e0 0x7f1a380b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 -- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 msgr2=0x7f1a38155d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38155d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 -- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a380cd9e0 msgr2=0x7f1a380b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a380cd9e0 0x7f1a380b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 -- 172.21.15.33:0/1524275697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a200094f0 con 0x7f1a380cb5a0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a37fff700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009290 tx=0x7f1a20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20026480 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a2001f070 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a38159070 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a20026850 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.341+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a381586a0 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.342+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a3804c3c0 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.342+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1a2001a430 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.343+0000 7f1a2ffff700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.343+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1a20021070 con 0x7f1a380cb5a0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.343+0000 7f1a377fe700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.343+0000 7f1a377fe700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 0x7f1a180693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b5070 tx=0x7f1a28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.347+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1a20053750 con 0x7f1a380cb5a0 2023-10-09T15:31:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.540+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1a38159a50 con 0x7f1a380cb5a0 2023-10-09T15:31:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.540+0000 7f1a2ffff700 1 -- 172.21.15.33:0/1524275697 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f1a20056d70 con 0x7f1a380cb5a0 2023-10-09T15:31:45.541 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:45.541 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":28,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:42.223959+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 msgr2=0x7f1a180693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 0x7f1a180693e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f1a380b5070 tx=0x7f1a28009040 comp rx=0 tx=0).stop 2023-10-09T15:31:45.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 msgr2=0x7f1a38158160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f1a20009290 tx=0x7f1a20017000 comp rx=0 tx=0).stop 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 shutdown_connections 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a18066f30 0x7f1a180693e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1a380cb5a0 0x7f1a38158160 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1a3815a5d0 0x7f1a38155d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 --2- 172.21.15.33:0/1524275697 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1a380cd9e0 0x7f1a380b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 >> 172.21.15.33:0/1524275697 conn(0x7f1a38070e30 msgr2=0x7f1a380b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 shutdown_connections 2023-10-09T15:31:45.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.542+0000 7f1a3e532700 1 -- 172.21.15.33:0/1524275697 wait complete. 2023-10-09T15:31:45.555 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:31:45.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:31:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.677+0000 7f8345aee700 1 Processor -- start 2023-10-09T15:31:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.677+0000 7f8345aee700 1 -- start start 2023-10-09T15:31:45.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8345aee700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8340153c90 0x7f834015a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8345aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f834006db20 0x7f83400ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8345aee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f834015ada0 con 0x7f8340154060 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8345aee700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f834006ca80 con 0x7f8340153c90 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8345aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f834006cd60 con 0x7f834006db20 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8340153c90 0x7f834015a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8340153c90 0x7f834015a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42666/0 (socket says 172.21.15.33:42666) 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 -- 172.21.15.33:0/3288605842 learned_addr learned my addr 172.21.15.33:0/3288605842 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f833ffff700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f834006db20 0x7f83400ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 -- 172.21.15.33:0/3288605842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f834006db20 msgr2=0x7f83400ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f834006db20 0x7f83400ca7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 -- 172.21.15.33:0/3288605842 >> v1:172.21.15.59:6789/0 conn(0x7f8340154060 legacy=0x7f834006a2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.678+0000 7f8344aec700 1 -- 172.21.15.33:0/3288605842 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f834006d040 con 0x7f8340153c90 2023-10-09T15:31:45.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8344aec700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340153c90 0x7f834015a860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83380099b0 tx=0x7f8338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d7b65072a6077c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f833f7fe700 1 -- 172.21.15.33:0/3288605842 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800b820 con 0x7f8340153c90 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f833f7fe700 1 -- 172.21.15.33:0/3288605842 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f833800b980 con 0x7f8340153c90 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f833f7fe700 1 -- 172.21.15.33:0/3288605842 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f833800bd20 con 0x7f8340153c90 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 -- 172.21.15.33:0/3288605842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340153c90 msgr2=0x7f834015a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340153c90 0x7f834015a860 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f83380099b0 tx=0x7f8338009250 comp rx=0 tx=0).stop 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 -- 172.21.15.33:0/3288605842 shutdown_connections 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340153c90 0x7f834015a860 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 --2- 172.21.15.33:0/3288605842 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f834006db20 0x7f83400ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 -- 172.21.15.33:0/3288605842 >> 172.21.15.33:0/3288605842 conn(0x7f834006e720 msgr2=0x7f834006eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 -- 172.21.15.33:0/3288605842 shutdown_connections 2023-10-09T15:31:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.679+0000 7f8345aee700 1 -- 172.21.15.33:0/3288605842 wait complete. 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.680+0000 7f8345aee700 1 Processor -- start 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 -- start start 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f834006db20 0x7f8340169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8340153c90 0x7f8340151500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b0dd0 con 0x7f8340154060 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f834016a0b0 con 0x7f834006db20 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f8345aee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83400b04a0 con 0x7f8340153c90 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f83452ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.681+0000 7f83452ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42680/0 (socket says 172.21.15.33:42680) 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 -- 172.21.15.33:0/560118094 learned_addr learned my addr 172.21.15.33:0/560118094 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f833ffff700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8340153c90 0x7f8340151500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f8344aec700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f834006db20 0x7f8340169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 -- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8340153c90 msgr2=0x7f8340151500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8340153c90 0x7f8340151500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 -- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f834006db20 msgr2=0x7f8340169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f834006db20 0x7f8340169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 -- 172.21.15.33:0/560118094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83380094f0 con 0x7f8340154060 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f83452ed700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f832800b5e0 tx=0x7f8328009060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800f510 con 0x7f8340154060 2023-10-09T15:31:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f832800f670 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f832800fa30 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83400b0780 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.682+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83400b01a0 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.683+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83400b0f80 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.683+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f832801a400 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.684+0000 7f833cff9700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.684+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8328083bd0 con 0x7f8340154060 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.684+0000 7f8344aec700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:45.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.684+0000 7f8344aec700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83380099b0 tx=0x7f8338016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:45.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.688+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83400b0f80 con 0x7f8340154060 2023-10-09T15:31:45.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.880+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f83400b0f10 con 0x7f8340154060 2023-10-09T15:31:45.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.880+0000 7f833cff9700 1 -- 172.21.15.33:0/560118094 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v28) v1 ==== 93+0+10 (secure 0 0 0) 0x7f8328058e60 con 0x7f8340154060 2023-10-09T15:31:45.881 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 msgr2=0x7f83200693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 0x7f83200693e0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f83380099b0 tx=0x7f8338016000 comp rx=0 tx=0).stop 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 msgr2=0x7f834015e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f832800b5e0 tx=0x7f8328009060 comp rx=0 tx=0).stop 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 shutdown_connections 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8320066f30 0x7f83200693e0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8340154060 0x7f834015e4c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f834006db20 0x7f8340169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 --2- 172.21.15.33:0/560118094 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8340153c90 0x7f8340151500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 >> 172.21.15.33:0/560118094 conn(0x7f834006e720 msgr2=0x7f83400caa90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 shutdown_connections 2023-10-09T15:31:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:45.883+0000 7f8345aee700 1 -- 172.21.15.33:0/560118094 wait complete. 2023-10-09T15:31:45.896 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:31:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.014+0000 7fa62f721700 1 Processor -- start 2023-10-09T15:31:46.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.014+0000 7fa62f721700 1 -- start start 2023-10-09T15:31:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62f721700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280cb5a0 0x7fa6280cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62f721700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6280cd9e0 0x7fa628159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62f721700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa62815ae40 con 0x7fa6280cde50 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62f721700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6280d13f0 con 0x7fa6280cd9e0 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62f721700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa62815ab60 con 0x7fa6280cb5a0 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6280cd9e0 0x7fa628159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62dcbe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa6280cde50 0x7fa628156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49040/0 (socket says 172.21.15.33:49040) 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6280cd9e0 0x7fa628159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42694/0 (socket says 172.21.15.33:42694) 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62dcbe700 1 -- 172.21.15.33:0/4161100341 learned_addr learned my addr 172.21.15.33:0/4161100341 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62d4bd700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280cb5a0 0x7fa6280cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 -- 172.21.15.33:0/4161100341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280cb5a0 msgr2=0x7fa6280cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280cb5a0 0x7fa6280cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 -- 172.21.15.33:0/4161100341 >> v1:172.21.15.33:6789/0 conn(0x7fa6280cde50 legacy=0x7fa628156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa627fff700 1 -- 172.21.15.33:0/4161100341 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035010920 0 0) 0x7fa62815ae40 con 0x7fa6280cde50 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 -- 172.21.15.33:0/4161100341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6280ccf00 con 0x7fa6280cd9e0 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.015+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cd9e0 0x7fa628159ec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33cee870dac1bc1b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa627fff700 1 -- 172.21.15.33:0/4161100341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c009e80 con 0x7fa6280cd9e0 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa627fff700 1 -- 172.21.15.33:0/4161100341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa61c00b860 con 0x7fa6280cd9e0 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa627fff700 1 -- 172.21.15.33:0/4161100341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61c00bbe0 con 0x7fa6280cd9e0 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 -- 172.21.15.33:0/4161100341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cd9e0 msgr2=0x7fa628159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cd9e0 0x7fa628159ec0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fa61c0098e0 tx=0x7fa61c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 -- 172.21.15.33:0/4161100341 shutdown_connections 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280cb5a0 0x7fa6280cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 --2- 172.21.15.33:0/4161100341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cd9e0 0x7fa628159ec0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 -- 172.21.15.33:0/4161100341 >> 172.21.15.33:0/4161100341 conn(0x7fa628070e30 msgr2=0x7fa6280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 -- 172.21.15.33:0/4161100341 shutdown_connections 2023-10-09T15:31:46.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.016+0000 7fa62f721700 1 -- 172.21.15.33:0/4161100341 wait complete. 2023-10-09T15:31:46.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.017+0000 7fa62f721700 1 Processor -- start 2023-10-09T15:31:46.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.017+0000 7fa62f721700 1 -- start start 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 0x7fa6280c9ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280ca000 0x7fa6280b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b5320 con 0x7fa6280cb5a0 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b4710 con 0x7fa6280cd9e0 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62f721700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6280b49f0 con 0x7fa6280ca000 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62d4bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62d4bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42696/0 (socket says 172.21.15.33:42696) 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.018+0000 7fa62d4bd700 1 -- 172.21.15.33:0/3393779361 learned_addr learned my addr 172.21.15.33:0/3393779361 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 0x7fa6280c9ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62dcbe700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280ca000 0x7fa6280b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 -- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280ca000 msgr2=0x7fa6280b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280ca000 0x7fa6280b39a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 -- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 msgr2=0x7fa6280c9ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 0x7fa6280c9ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 -- 172.21.15.33:0/3393779361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c009420 con 0x7fa6280cb5a0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 0x7fa6280c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62d4bd700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e190 tx=0x7fa618009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa61800ee30 con 0x7fa6280cb5a0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa618014420 con 0x7fa6280cb5a0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6280b4cd0 con 0x7fa6280cb5a0 2023-10-09T15:31:46.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6180147e0 con 0x7fa6280cb5a0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.019+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa628156740 con 0x7fa6280cb5a0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.020+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62804c3c0 con 0x7fa6280cb5a0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.020+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa618014b90 con 0x7fa6280cb5a0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.021+0000 7fa6257fa700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 0x7fa6140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.021+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa618084a40 con 0x7fa6280cb5a0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.021+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 0x7fa6140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.021+0000 7fa62ccbc700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 0x7fa6140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b6240 tx=0x7fa61c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.026+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa618086e60 con 0x7fa6280cb5a0 2023-10-09T15:31:46.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.224+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa62815b9f0 con 0x7fa6280cb5a0 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.224+0000 7fa6257fa700 1 -- 172.21.15.33:0/3393779361 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v28) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa618052000 con 0x7fa6280cb5a0 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:31:46.225 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:31:46.226 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:31:46.226 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:31:46.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 msgr2=0x7fa6140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 0x7fa6140693e0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fa6280b6240 tx=0x7fa61c017000 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 msgr2=0x7fa628156200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fa61800e190 tx=0x7fa618009920 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 shutdown_connections 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614066f30 0x7fa6140693e0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6280cb5a0 0x7fa628156200 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6280ca000 0x7fa6280b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 --2- 172.21.15.33:0/3393779361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa6280cd9e0 0x7fa6280c9ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 >> 172.21.15.33:0/3393779361 conn(0x7fa628070e30 msgr2=0x7fa6280b11b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 shutdown_connections 2023-10-09T15:31:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.226+0000 7fa62f721700 1 -- 172.21.15.33:0/3393779361 wait complete. 2023-10-09T15:31:46.239 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:31:46.239 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:31:46.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 Processor -- start 2023-10-09T15:31:46.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 -- start start 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8f080a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080cced0 con 0x7f8f08088400 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f080cd140 con 0x7f8f080cee40 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f0ee6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080cd420 con 0x7f8f0806e2a0 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f07fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8f08088400 0x7f8f080a8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49042/0 (socket says 172.21.15.33:49042) 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.362+0000 7f8f07fff700 1 -- 172.21.15.33:0/2980097100 learned_addr learned my addr 172.21.15.33:0/2980097100 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f0cc08700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8f080a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1514421577 0 0) 0x7f8f080cced0 con 0x7f8f08088400 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ef4003570 con 0x7f8f08088400 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3163254816 0 0) 0x7f8ef4003570 con 0x7f8f08088400 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 msgr2=0x7f8f080a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8f080a8910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 >> v1:172.21.15.59:6789/0 conn(0x7f8f080cee40 legacy=0x7f8f080ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f080cd700 con 0x7f8f08088400 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8ef80017f0 con 0x7f8f08088400 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 >> v1:172.21.15.33:6789/0 conn(0x7f8f08088400 legacy=0x7f8f080a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4003a90 0x7f8ef4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8ef4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ef4004d50 0x7f8ef40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f080cd420 con 0x7f8ef4004d50 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef400bb10 con 0x7f8ef4003a90 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ef400bcd0 con 0x7f8f0806e2a0 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f0d409700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ef4004d50 0x7f8ef40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f0cc08700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4003a90 0x7f8ef4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f07fff700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8ef4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f0d409700 1 -- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 msgr2=0x7f8ef4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.363+0000 7f8f0d409700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0806e2a0 0x7f8ef4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0d409700 1 -- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4003a90 msgr2=0x7f8ef4003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0d409700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4003a90 0x7f8ef4003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0d409700 1 -- 172.21.15.33:0/2980097100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ef4003570 con 0x7f8ef4004d50 2023-10-09T15:31:46.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0d409700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ef4004d50 0x7f8ef40051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00019a0 tx=0x7f8ef0007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba1c17822c5b60d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000c5d0 con 0x7f8ef4004d50 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000c750 con 0x7f8ef4004d50 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f077fe700 1 -- 172.21.15.33:0/2980097100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef000cb10 con 0x7f8ef4004d50 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/2980097100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ef4004d50 msgr2=0x7f8ef40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/2980097100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ef4004d50 0x7f8ef40051c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8ef00019a0 tx=0x7f8ef0007d10 comp rx=0 tx=0).stop 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0d409700 1 -- 172.21.15.33:0/2980097100 reap_dead start 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/2980097100 shutdown_connections 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/2980097100 >> 172.21.15.33:0/2980097100 conn(0x7f8f08088000 msgr2=0x7f8f080ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/2980097100 shutdown_connections 2023-10-09T15:31:46.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.364+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/2980097100 wait complete. 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.365+0000 7f8f0ee6c700 1 Processor -- start 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 -- start start 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4004d50 0x7f8f0809b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0815a380 0x7f8f080b29c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815b700 con 0x7f8f080b2f00 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815aaf0 con 0x7f8ef4004d50 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0ee6c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f0815add0 con 0x7f8f0815a380 2023-10-09T15:31:46.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.366+0000 7f8f0d409700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42716/0 (socket says 172.21.15.33:42716) 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 -- 172.21.15.33:0/3635214060 learned_addr learned my addr 172.21.15.33:0/3635214060 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0cc08700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4004d50 0x7f8f0809b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f07fff700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0815a380 0x7f8f080b29c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 -- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0815a380 msgr2=0x7f8f080b29c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0815a380 0x7f8f080b29c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 -- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4004d50 msgr2=0x7f8f0809b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4004d50 0x7f8f0809b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 -- 172.21.15.33:0/3635214060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f0815b0b0 con 0x7f8f080b2f00 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0d409700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0003000 tx=0x7f8ef0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef0007af0 con 0x7f8f080b2f00 2023-10-09T15:31:46.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ef000c5d0 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f0815b390 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ef001e650 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.367+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f08152fb0 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.368+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f0815b870 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.368+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8ef0019030 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.369+0000 7f8f04ff9700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.369+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f8ef00854b0 con 0x7f8f080b2f00 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.369+0000 7f8f0cc08700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:46.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.369+0000 7f8f0cc08700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 0x7f8ee80693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006e50 tx=0x7f8f00009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:46.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.374+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ef0052b30 con 0x7f8f080b2f00 2023-10-09T15:31:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:46.569+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f8f0804c3c0 con 0x7f8f080b2f00 2023-10-09T15:31:47.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.421+0000 7f8f04ff9700 1 -- 172.21.15.33:0/3635214060 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v29) v1 ==== 138+0+0 (secure 0 0 0) 0x7f8ef0017020 con 0x7f8f080b2f00 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.424+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 msgr2=0x7f8ee80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 0x7f8ee80693e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f8f00006e50 tx=0x7f8f00009120 comp rx=0 tx=0).stop 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 msgr2=0x7f8f08152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f8ef0003000 tx=0x7f8ef0015000 comp rx=0 tx=0).stop 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 shutdown_connections 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ee8066f30 0x7f8ee80693e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f080b2f00 0x7f8f08152a70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ef4004d50 0x7f8f0809b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 --2- 172.21.15.33:0/3635214060 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f0815a380 0x7f8f080b29c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.425+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 >> 172.21.15.33:0/3635214060 conn(0x7f8f08088000 msgr2=0x7f8f08068ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.426+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 shutdown_connections 2023-10-09T15:31:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.426+0000 7f8f0ee6c700 1 -- 172.21.15.33:0/3635214060 wait complete. 2023-10-09T15:31:47.427 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:31:47.440 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:31:47.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.572+0000 7f158dfd1700 1 Processor -- start 2023-10-09T15:31:47.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.572+0000 7f158dfd1700 1 -- start start 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f158dfd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 0x7f15880ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f158dfd1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880ccfd0 con 0x7f158806dc70 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f158dfd1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f15880cf0e0 con 0x7f158806e0e0 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f158dfd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f158815a3d0 con 0x7f1588159530 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f1586ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f158806dc70 0x7f1588159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49056/0 (socket says 172.21.15.33:49056) 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f1586ffd700 1 -- 172.21.15.33:0/3105668605 learned_addr learned my addr 172.21.15.33:0/3105668605 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.573+0000 7f15877fe700 1 --2- 172.21.15.33:0/3105668605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 0x7f15880ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2615354434 0 0) 0x7f15880ccfd0 con 0x7f158806dc70 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1570003570 con 0x7f158806dc70 2023-10-09T15:31:47.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 879655354 0 0) 0x7f15880cf0e0 con 0x7f158806e0e0 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f15880ccfd0 con 0x7f158806e0e0 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15877fe700 1 -- 172.21.15.33:0/3105668605 >> v1:172.21.15.59:6789/0 conn(0x7f158806e0e0 legacy=0x7f15880cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15877fe700 1 -- 172.21.15.33:0/3105668605 >> v1:172.21.15.33:6789/0 conn(0x7f158806dc70 legacy=0x7f1588159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15877fe700 1 -- 172.21.15.33:0/3105668605 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f158815a6b0 con 0x7f1588159530 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15877fe700 1 --2- 172.21.15.33:0/3105668605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 0x7f15880ceba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1578009910 tx=0x7f15780091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=26d440c65680b65c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578011630 con 0x7f1588159530 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578011790 con 0x7f1588159530 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.574+0000 7f15867fc700 1 -- 172.21.15.33:0/3105668605 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578011b30 con 0x7f1588159530 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 -- 172.21.15.33:0/3105668605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 msgr2=0x7f15880ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 --2- 172.21.15.33:0/3105668605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 0x7f15880ceba0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f1578009910 tx=0x7f15780091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 -- 172.21.15.33:0/3105668605 shutdown_connections 2023-10-09T15:31:47.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 --2- 172.21.15.33:0/3105668605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1588159530 0x7f15880ceba0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 -- 172.21.15.33:0/3105668605 >> 172.21.15.33:0/3105668605 conn(0x7f15880703a0 msgr2=0x7f15880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:47.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 -- 172.21.15.33:0/3105668605 shutdown_connections 2023-10-09T15:31:47.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.575+0000 7f158dfd1700 1 -- 172.21.15.33:0/3105668605 wait complete. 2023-10-09T15:31:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.576+0000 7f158dfd1700 1 Processor -- start 2023-10-09T15:31:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.576+0000 7f158dfd1700 1 -- start start 2023-10-09T15:31:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:47.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158806e0e0 0x7f15880c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588159530 0x7f15880cd460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15880c9650 con 0x7f158806dc70 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15880c9930 con 0x7f1588159530 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15880c9c10 con 0x7f158806e0e0 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42726/0 (socket says 172.21.15.33:42726) 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 -- 172.21.15.33:0/2911925893 learned_addr learned my addr 172.21.15.33:0/2911925893 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 -- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158806e0e0 msgr2=0x7f15880c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158806e0e0 0x7f15880c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 -- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588159530 msgr2=0x7f15880cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588159530 0x7f15880cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 -- 172.21.15.33:0/2911925893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1578009420 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f15877fe700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1588089650 tx=0x7f1578017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f157801f070 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1578000bc0 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15880c9ef0 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.577+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1578025420 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.578+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15880b36c0 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.578+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f158804c3c0 con 0x7f158806dc70 2023-10-09T15:31:47.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.579+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f1578023070 con 0x7f158806dc70 2023-10-09T15:31:47.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.579+0000 7f156f7fe700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 0x7f15740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:47.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.579+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f1578085a80 con 0x7f158806dc70 2023-10-09T15:31:47.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.580+0000 7f1586ffd700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 0x7f15740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:47.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.580+0000 7f1586ffd700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 0x7f15740693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f157c0058d0 tx=0x7f157c0079f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:47.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.584+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1578052f90 con 0x7f158806dc70 2023-10-09T15:31:47.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:47.777+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f158815a990 con 0x7f158806dc70 2023-10-09T15:31:48.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.421+0000 7f156f7fe700 1 -- 172.21.15.33:0/2911925893 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v30) v1 ==== 170+0+0 (secure 0 0 0) 0x7f15780150d0 con 0x7f158806dc70 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 msgr2=0x7f15740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 0x7f15740693e0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f157c0058d0 tx=0x7f157c0079f0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 msgr2=0x7f158816c980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1588089650 tx=0x7f1578017000 comp rx=0 tx=0).stop 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 shutdown_connections 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1574066f30 0x7f15740693e0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f158806dc70 0x7f158816c980 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1588159530 0x7f15880cd460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 --2- 172.21.15.33:0/2911925893 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f158806e0e0 0x7f15880c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 >> 172.21.15.33:0/2911925893 conn(0x7f15880703a0 msgr2=0x7f158815e3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:48.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 shutdown_connections 2023-10-09T15:31:48.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.425+0000 7f158dfd1700 1 -- 172.21.15.33:0/2911925893 wait complete. 2023-10-09T15:31:48.433 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:31:48.447 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:31:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.570+0000 7fd926967700 1 Processor -- start 2023-10-09T15:31:48.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 -- start start 2023-10-09T15:31:48.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 0x7fd920159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9200ccfd0 con 0x7fd920159530 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92015a3d0 con 0x7fd92006e0e0 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.571+0000 7fd926967700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92015a6b0 con 0x7fd92006dc70 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd924f04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 0x7fd920159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd924f04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:47354/0 (socket says 172.21.15.33:47354) 2023-10-09T15:31:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd924f04700 1 -- 172.21.15.33:0/1496306511 learned_addr learned my addr 172.21.15.33:0/1496306511 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 -- 172.21.15.33:0/1496306511 >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 msgr2=0x7fd9200cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/1496306511 >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 -- 172.21.15.33:0/1496306511 >> v1:172.21.15.59:6789/0 conn(0x7fd920159530 legacy=0x7fd9200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 -- 172.21.15.33:0/1496306511 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92015a990 con 0x7fd92006dc70 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd924f04700 1 --2- 172.21.15.33:0/1496306511 >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.572+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/1496306511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 0x7fd920159900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9140098e0 tx=0x7fd9140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b284e9f29e257be7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd91effd700 1 -- 172.21.15.33:0/1496306511 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400b640 con 0x7fd92006dc70 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd91effd700 1 -- 172.21.15.33:0/1496306511 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91400b7a0 con 0x7fd92006dc70 2023-10-09T15:31:48.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd91effd700 1 -- 172.21.15.33:0/1496306511 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91400bb40 con 0x7fd92006dc70 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 -- 172.21.15.33:0/1496306511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 msgr2=0x7fd920159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 --2- 172.21.15.33:0/1496306511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 0x7fd920159900 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd9140098e0 tx=0x7fd9140091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 -- 172.21.15.33:0/1496306511 shutdown_connections 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 --2- 172.21.15.33:0/1496306511 >> v2:172.21.15.59:3300/0 conn(0x7fd92006e0e0 0x7fd9200cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 --2- 172.21.15.33:0/1496306511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006dc70 0x7fd920159900 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 -- 172.21.15.33:0/1496306511 >> 172.21.15.33:0/1496306511 conn(0x7fd9200703a0 msgr2=0x7fd9200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 -- 172.21.15.33:0/1496306511 shutdown_connections 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.573+0000 7fd926967700 1 -- 172.21.15.33:0/1496306511 wait complete. 2023-10-09T15:31:48.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.574+0000 7fd926967700 1 Processor -- start 2023-10-09T15:31:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.574+0000 7fd926967700 1 -- start start 2023-10-09T15:31:48.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 0x7fd9201535e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920159530 0x7fd9200b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92014e8c0 con 0x7fd92006dc70 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd920153150 con 0x7fd920159530 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd926967700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd920153b20 con 0x7fd92006e0e0 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42736/0 (socket says 172.21.15.33:42736) 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 -- 172.21.15.33:0/123359579 learned_addr learned my addr 172.21.15.33:0/123359579 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 0x7fd9201535e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd924f04700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920159530 0x7fd9200b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 -- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 msgr2=0x7fd9201535e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 0x7fd9201535e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 -- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920159530 msgr2=0x7fd9200b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.575+0000 7fd91ffff700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920159530 0x7fd9200b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd91ffff700 1 -- 172.21.15.33:0/123359579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd918009ae0 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 0x7fd9201535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd91ffff700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c5c0 tx=0x7fd910007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011590 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd914009420 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd910011900 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd920152820 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.576+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd910011a70 con 0x7fd92006dc70 2023-10-09T15:31:48.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.577+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd92004c3c0 con 0x7fd92006dc70 2023-10-09T15:31:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.577+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd91001b3b0 con 0x7fd92006dc70 2023-10-09T15:31:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.578+0000 7fd907fff700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.578+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd9100838c0 con 0x7fd92006dc70 2023-10-09T15:31:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.578+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:48.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.578+0000 7fd91f7fe700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 0x7fd90c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd920158e20 tx=0x7fd914017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:48.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.582+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd910050c40 con 0x7fd92006dc70 2023-10-09T15:31:48.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:48.825+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd92015ac70 con 0x7fd92006dc70 2023-10-09T15:31:49.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.446+0000 7fd907fff700 1 -- 172.21.15.33:0/123359579 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd910017070 con 0x7fd92006dc70 2023-10-09T15:31:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.452+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 msgr2=0x7fd90c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.452+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 0x7fd90c0693e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd920158e20 tx=0x7fd914017000 comp rx=0 tx=0).stop 2023-10-09T15:31:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.452+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 msgr2=0x7fd92014e380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.452+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fd91000c5c0 tx=0x7fd910007f30 comp rx=0 tx=0).stop 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 shutdown_connections 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd90c066f30 0x7fd90c0693e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd92006dc70 0x7fd92014e380 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd920159530 0x7fd9200b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 --2- 172.21.15.33:0/123359579 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd92006e0e0 0x7fd9201535e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.457+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 >> 172.21.15.33:0/123359579 conn(0x7fd9200703a0 msgr2=0x7fd92015ca90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.458+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 shutdown_connections 2023-10-09T15:31:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.458+0000 7fd926967700 1 -- 172.21.15.33:0/123359579 wait complete. 2023-10-09T15:31:49.460 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 4 and data pool 5 2023-10-09T15:31:49.472 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:49.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.592+0000 7f4458837700 1 Processor -- start 2023-10-09T15:31:49.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.592+0000 7f4458837700 1 -- start start 2023-10-09T15:31:49.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4458837700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44540a90d0 0x7f445406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4458837700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f445406e380 0x7f44540af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4458837700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44540aeee0 con 0x7f44540a8d00 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4458837700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f445406e820 con 0x7f445406e380 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4458837700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44540ae680 con 0x7f44540a90d0 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4452d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f445406e380 0x7f44540af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4452d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f445406e380 0x7f44540af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42750/0 (socket says 172.21.15.33:42750) 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.593+0000 7f4452d9d700 1 -- 172.21.15.33:0/2276238743 learned_addr learned my addr 172.21.15.33:0/2276238743 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4451d9b700 1 --2- 172.21.15.33:0/2276238743 >> v2:172.21.15.59:3300/0 conn(0x7f44540a90d0 0x7f445406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4452d9d700 1 -- 172.21.15.33:0/2276238743 >> v2:172.21.15.59:3300/0 conn(0x7f44540a90d0 msgr2=0x7f445406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:49.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4452d9d700 1 --2- 172.21.15.33:0/2276238743 >> v2:172.21.15.59:3300/0 conn(0x7f44540a90d0 0x7f445406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4452d9d700 1 -- 172.21.15.33:0/2276238743 >> v1:172.21.15.59:6789/0 conn(0x7f44540a8d00 legacy=0x7f44540cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4452d9d700 1 -- 172.21.15.33:0/2276238743 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44540cf490 con 0x7f445406e380 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4452d9d700 1 --2- 172.21.15.33:0/2276238743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445406e380 0x7f44540af370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f444c0099b0 tx=0x7f444c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=690cd455ee5f16dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f445159a700 1 -- 172.21.15.33:0/2276238743 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00b7e0 con 0x7f445406e380 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f445159a700 1 -- 172.21.15.33:0/2276238743 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c00b940 con 0x7f445406e380 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f445159a700 1 -- 172.21.15.33:0/2276238743 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00bce0 con 0x7f445406e380 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4458837700 1 -- 172.21.15.33:0/2276238743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445406e380 msgr2=0x7f44540af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.594+0000 7f4458837700 1 --2- 172.21.15.33:0/2276238743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445406e380 0x7f44540af370 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f444c0099b0 tx=0x7f444c009250 comp rx=0 tx=0).stop 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 -- 172.21.15.33:0/2276238743 shutdown_connections 2023-10-09T15:31:49.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 --2- 172.21.15.33:0/2276238743 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f445406e380 0x7f44540af370 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 --2- 172.21.15.33:0/2276238743 >> v2:172.21.15.59:3300/0 conn(0x7f44540a90d0 0x7f445406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 -- 172.21.15.33:0/2276238743 >> 172.21.15.33:0/2276238743 conn(0x7f445406ce80 msgr2=0x7f44540ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:49.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 -- 172.21.15.33:0/2276238743 shutdown_connections 2023-10-09T15:31:49.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.595+0000 7f4458837700 1 -- 172.21.15.33:0/2276238743 wait complete. 2023-10-09T15:31:49.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 Processor -- start 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 -- start start 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445406e380 0x7f4454157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 0x7f44541583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44540980f0 con 0x7f44540a90d0 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.596+0000 7f4458837700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f445415f5d0 con 0x7f445406e380 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4458837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4454158a90 con 0x7f44540a8d00 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42756/0 (socket says 172.21.15.33:42756) 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 -- 172.21.15.33:0/3286759088 learned_addr learned my addr 172.21.15.33:0/3286759088 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:49.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f445259c700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445406e380 0x7f4454157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4451d9b700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 0x7f44541583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 -- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 msgr2=0x7f44541583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 0x7f44541583f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 -- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445406e380 msgr2=0x7f4454157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445406e380 0x7f4454157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 -- 172.21.15.33:0/3286759088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f444c0094f0 con 0x7f44540a90d0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4451d9b700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 0x7f44541583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4452d9d700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f444c0030c0 tx=0x7f444c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c00b7e0 con 0x7f44540a90d0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f444c020070 con 0x7f44540a90d0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4454158d70 con 0x7f44540a90d0 2023-10-09T15:31:49.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f444c01b6a0 con 0x7f44540a90d0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.597+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4454098340 con 0x7f44540a90d0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.598+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f445404c3c0 con 0x7f44540a90d0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.599+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f444c022030 con 0x7f44540a90d0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.599+0000 7f444a7fc700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.599+0000 7f445259c700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.599+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f444c086480 con 0x7f44540a90d0 2023-10-09T15:31:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.600+0000 7f445259c700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 0x7f44340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f444400f430 tx=0x7f4444002ad0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.604+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f444c0536f0 con 0x7f44540a90d0 2023-10-09T15:31:49.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.798+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f445404c3c0 con 0x7f44540a90d0 2023-10-09T15:31:49.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.799+0000 7f444a7fc700 1 -- 172.21.15.33:0/3286759088 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f444c056d10 con 0x7f44540a90d0 2023-10-09T15:31:49.799 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:49.799 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:48.825833+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:49.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 msgr2=0x7f44340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 0x7f44340693e0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f444400f430 tx=0x7f4444002ad0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 msgr2=0x7f445416d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f444c0030c0 tx=0x7f444c016000 comp rx=0 tx=0).stop 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 shutdown_connections 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4434066f30 0x7f44340693e0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44540a90d0 0x7f445416d200 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f445406e380 0x7f4454157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 --2- 172.21.15.33:0/3286759088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44540a8d00 0x7f44541583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 >> 172.21.15.33:0/3286759088 conn(0x7f445406ce80 msgr2=0x7f44540cd280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 shutdown_connections 2023-10-09T15:31:49.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.801+0000 7f4458837700 1 -- 172.21.15.33:0/3286759088 wait complete. 2023-10-09T15:31:49.813 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:49.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 Processor -- start 2023-10-09T15:31:49.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 -- start start 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4570153c30 0x7f457015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457015afd0 con 0x7f45700cf110 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f457015b2b0 con 0x7f457015de50 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.933+0000 7f457505b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f457015b590 con 0x7f4570153c30 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4570153c30 0x7f457015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f457485a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45700cf110 0x7f457015c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:49072/0 (socket says 172.21.15.33:49072) 2023-10-09T15:31:49.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f457485a700 1 -- 172.21.15.33:0/1149507215 learned_addr learned my addr 172.21.15.33:0/1149507215 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456ffff700 1 -- 172.21.15.33:0/1149507215 >> v1:172.21.15.59:6789/0 conn(0x7f457015de50 legacy=0x7f45700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456ffff700 1 -- 172.21.15.33:0/1149507215 >> v1:172.21.15.33:6789/0 conn(0x7f45700cf110 legacy=0x7f457015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456ffff700 1 -- 172.21.15.33:0/1149507215 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f457015b870 con 0x7f4570153c30 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456effd700 1 -- 172.21.15.33:0/1149507215 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2826204781 0 0) 0x7f457015afd0 con 0x7f45700cf110 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456ffff700 1 --2- 172.21.15.33:0/1149507215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f457015a5e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f45600098e0 tx=0x7f45600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f85dc4d1c6f013 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456effd700 1 -- 172.21.15.33:0/1149507215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4560009e80 con 0x7f4570153c30 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456effd700 1 -- 172.21.15.33:0/1149507215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f456000b860 con 0x7f4570153c30 2023-10-09T15:31:49.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.934+0000 7f456effd700 1 -- 172.21.15.33:0/1149507215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f456000bbe0 con 0x7f4570153c30 2023-10-09T15:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 -- 172.21.15.33:0/1149507215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 msgr2=0x7f457015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 --2- 172.21.15.33:0/1149507215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f457015a5e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f45600098e0 tx=0x7f45600091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 -- 172.21.15.33:0/1149507215 shutdown_connections 2023-10-09T15:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 --2- 172.21.15.33:0/1149507215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f457015a5e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 -- 172.21.15.33:0/1149507215 >> 172.21.15.33:0/1149507215 conn(0x7f45700703a0 msgr2=0x7f45700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:49.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 -- 172.21.15.33:0/1149507215 shutdown_connections 2023-10-09T15:31:49.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.935+0000 7f457505b700 1 -- 172.21.15.33:0/1149507215 wait complete. 2023-10-09T15:31:49.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.936+0000 7f457505b700 1 Processor -- start 2023-10-09T15:31:49.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.936+0000 7f457505b700 1 -- start start 2023-10-09T15:31:49.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 0x7f45700b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457015de50 0x7f45700b5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45701605d0 con 0x7f4570153c30 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45700c87e0 con 0x7f457015de50 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457505b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45700b42d0 con 0x7f45700cf110 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42770/0 (socket says 172.21.15.33:42770) 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 -- 172.21.15.33:0/988845016 learned_addr learned my addr 172.21.15.33:0/988845016 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f457485a700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457015de50 0x7f45700b5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456ffff700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 0x7f45700b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 -- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 msgr2=0x7f45700b3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 0x7f45700b3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 -- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457015de50 msgr2=0x7f45700b5840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457015de50 0x7f45700b5840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 -- 172.21.15.33:0/988845016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4560009420 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456ffff700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 0x7f45700b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.937+0000 7f456f7fe700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f455800c510 tx=0x7f455800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.938+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011590 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.938+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4558011710 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.938+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4570160010 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.938+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4558011ad0 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.938+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45700c8470 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.939+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45700c82d0 con 0x7f4570153c30 2023-10-09T15:31:49.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.939+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f455801b3b0 con 0x7f4570153c30 2023-10-09T15:31:49.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.940+0000 7f4567fff700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 0x7f45500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:49.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.940+0000 7f456ffff700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 0x7f45500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:49.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.940+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4558083a60 con 0x7f4570153c30 2023-10-09T15:31:49.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.940+0000 7f456ffff700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 0x7f45500693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45600098e0 tx=0x7f4560017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:49.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:49.944+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45700c82d0 con 0x7f4570153c30 2023-10-09T15:31:50.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.140+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f457004c440 con 0x7f4570153c30 2023-10-09T15:31:50.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.140+0000 7f4567fff700 1 -- 172.21.15.33:0/988845016 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f4558017070 con 0x7f4570153c30 2023-10-09T15:31:50.140 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:50.141 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:48.825833+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:50.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 msgr2=0x7f45500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 0x7f45500693e0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f45600098e0 tx=0x7f4560017000 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 msgr2=0x7f4570153100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f455800c510 tx=0x7f455800c8d0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 shutdown_connections 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4550066f30 0x7f45500693e0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f457015de50 0x7f45700b5840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45700cf110 0x7f45700b3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 --2- 172.21.15.33:0/988845016 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4570153c30 0x7f4570153100 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.142+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 >> 172.21.15.33:0/988845016 conn(0x7f45700703a0 msgr2=0x7f45700c62e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.143+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 shutdown_connections 2023-10-09T15:31:50.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.143+0000 7f457505b700 1 -- 172.21.15.33:0/988845016 wait complete. 2023-10-09T15:31:50.155 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:31:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.277+0000 7f72ff72c700 1 Processor -- start 2023-10-09T15:31:50.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 -- start start 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72f8159530 0x7f72f80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f806dc70 0x7f72f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72f806e0e0 0x7f72f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80ccfd0 con 0x7f72f8159530 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72f80cf0e0 con 0x7f72f806e0e0 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72ff72c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f815a3d0 con 0x7f72f806dc70 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.278+0000 7f72fd4c8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72f8159530 0x7f72f80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72f8159530 0x7f72f80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42776/0 (socket says 172.21.15.33:42776) 2023-10-09T15:31:50.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 -- 172.21.15.33:0/269502361 learned_addr learned my addr 172.21.15.33:0/269502361 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fccc7700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f806dc70 0x7f72f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fdcc9700 1 --2- 172.21.15.33:0/269502361 >> v2:172.21.15.59:3300/0 conn(0x7f72f806e0e0 0x7f72f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 -- 172.21.15.33:0/269502361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f806dc70 msgr2=0x7f72f8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f806dc70 0x7f72f8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 -- 172.21.15.33:0/269502361 >> v2:172.21.15.59:3300/0 conn(0x7f72f806e0e0 msgr2=0x7f72f80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/269502361 >> v2:172.21.15.59:3300/0 conn(0x7f72f806e0e0 0x7f72f80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 -- 172.21.15.33:0/269502361 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f815a6b0 con 0x7f72f8159530 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f8159530 0x7f72f80ceba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f72f8089880 tx=0x7f72e8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=694674b07c15c0c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72f7fff700 1 -- 172.21.15.33:0/269502361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e800e070 con 0x7f72f8159530 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72f7fff700 1 -- 172.21.15.33:0/269502361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e800ba50 con 0x7f72f8159530 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.279+0000 7f72f7fff700 1 -- 172.21.15.33:0/269502361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e80092e0 con 0x7f72f8159530 2023-10-09T15:31:50.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 -- 172.21.15.33:0/269502361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f8159530 msgr2=0x7f72f80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f8159530 0x7f72f80ceba0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f72f8089880 tx=0x7f72e8009840 comp rx=0 tx=0).stop 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 -- 172.21.15.33:0/269502361 shutdown_connections 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 --2- 172.21.15.33:0/269502361 >> v2:172.21.15.59:3300/0 conn(0x7f72f806e0e0 0x7f72f80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f8159530 0x7f72f80ceba0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 --2- 172.21.15.33:0/269502361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f806dc70 0x7f72f8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 -- 172.21.15.33:0/269502361 >> 172.21.15.33:0/269502361 conn(0x7f72f80703a0 msgr2=0x7f72f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 -- 172.21.15.33:0/269502361 shutdown_connections 2023-10-09T15:31:50.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.280+0000 7f72ff72c700 1 -- 172.21.15.33:0/269502361 wait complete. 2023-10-09T15:31:50.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.281+0000 7f72ff72c700 1 Processor -- start 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.281+0000 7f72ff72c700 1 -- start start 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 0x7f72f80b4b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f8159530 0x7f72f80b50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f815bc40 con 0x7f72f806dc70 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72f80c80f0 con 0x7f72f806e0e0 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72ff72c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72f81523a0 con 0x7f72f8159530 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42778/0 (socket says 172.21.15.33:42778) 2023-10-09T15:31:50.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 -- 172.21.15.33:0/3302186792 learned_addr learned my addr 172.21.15.33:0/3302186792 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fccc7700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 0x7f72f80b4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 -- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f8159530 msgr2=0x7f72f80b50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fdcc9700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f8159530 0x7f72f80b50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f8159530 0x7f72f80b50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 -- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 msgr2=0x7f72f80b4b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 0x7f72f80b4b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 -- 172.21.15.33:0/3302186792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72e8009ae0 con 0x7f72f806dc70 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fccc7700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 0x7f72f80b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.282+0000 7f72fd4c8700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009430 tx=0x7f72e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.283+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e8008ae0 con 0x7f72f806dc70 2023-10-09T15:31:50.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.283+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72e8008c60 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.283+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72f815be50 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.283+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72e801c410 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.283+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72f815c410 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.284+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72f80c7ec0 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.284+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f72e8003040 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.284+0000 7f72f57fa700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 0x7f72e4069460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.285+0000 7f72fccc7700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 0x7f72e4069460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.285+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72e8085d60 con 0x7f72f806dc70 2023-10-09T15:31:50.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.285+0000 7f72fccc7700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 0x7f72e4069460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c6490 tx=0x7f72ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:50.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.289+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72f80c7ec0 con 0x7f72f806dc70 2023-10-09T15:31:50.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:50.533+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f72f80c7ec0 con 0x7f72f806dc70 2023-10-09T15:31:51.405 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:31:51.405+0000 7f21286aa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:31:51.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.453+0000 7f72f57fa700 1 -- 172.21.15.33:0/3302186792 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v15) v1 ==== 118+0+0 (secure 0 0 0) 0x7f72f80c7ec0 con 0x7f72f806dc70 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 msgr2=0x7f72e4069460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 0x7f72e4069460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f72f80c6490 tx=0x7f72ec008040 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 msgr2=0x7f72f8151e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f72e8009430 tx=0x7f72e8018000 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 shutdown_connections 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f72e4066fb0 0x7f72e4069460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72f806dc70 0x7f72f8151e60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72f8159530 0x7f72f80b50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 --2- 172.21.15.33:0/3302186792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72f806e0e0 0x7f72f80b4b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.455+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 >> 172.21.15.33:0/3302186792 conn(0x7f72f80703a0 msgr2=0x7f72f80d0fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:51.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.456+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 shutdown_connections 2023-10-09T15:31:51.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.456+0000 7f72ff72c700 1 -- 172.21.15.33:0/3302186792 wait complete. 2023-10-09T15:31:51.469 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:31:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.599+0000 7f57a9685700 1 Processor -- start 2023-10-09T15:31:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.599+0000 7f57a9685700 1 -- start start 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a9685700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57a4153a00 0x7f57a4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a9685700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 0x7f57a415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a9685700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a415af60 con 0x7f57a40cea00 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a9685700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a415d010 con 0x7f57a4153a00 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a9685700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a415b240 con 0x7f57a415de50 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57a4153a00 0x7f57a4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57a4153a00 0x7f57a4153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51504/0 (socket says 172.21.15.33:51504) 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a3fff700 1 -- 172.21.15.33:0/1633447705 learned_addr learned my addr 172.21.15.33:0/1633447705 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.600+0000 7f57a37fe700 1 --2- 172.21.15.33:0/1633447705 >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 0x7f57a415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a3fff700 1 -- 172.21.15.33:0/1633447705 >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 msgr2=0x7f57a415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a3fff700 1 --2- 172.21.15.33:0/1633447705 >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 0x7f57a415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a3fff700 1 -- 172.21.15.33:0/1633447705 >> v1:172.21.15.59:6789/0 conn(0x7f57a40cea00 legacy=0x7f57a40cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a3fff700 1 -- 172.21.15.33:0/1633447705 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a415b520 con 0x7f57a4153a00 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a37fe700 1 --2- 172.21.15.33:0/1633447705 >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 0x7f57a415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a3fff700 1 --2- 172.21.15.33:0/1633447705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4153dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b3070 tx=0x7f5794009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e6a41c34a5ebfec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a2ffd700 1 -- 172.21.15.33:0/1633447705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400b860 con 0x7f57a4153a00 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a2ffd700 1 -- 172.21.15.33:0/1633447705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400b9c0 con 0x7f57a4153a00 2023-10-09T15:31:51.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.601+0000 7f57a2ffd700 1 -- 172.21.15.33:0/1633447705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f579400bd60 con 0x7f57a4153a00 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 -- 172.21.15.33:0/1633447705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 msgr2=0x7f57a4153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 --2- 172.21.15.33:0/1633447705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4153dd0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b3070 tx=0x7f5794009250 comp rx=0 tx=0).stop 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 -- 172.21.15.33:0/1633447705 shutdown_connections 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 --2- 172.21.15.33:0/1633447705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4153dd0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 --2- 172.21.15.33:0/1633447705 >> v2:172.21.15.59:3300/0 conn(0x7f57a415de50 0x7f57a415a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 -- 172.21.15.33:0/1633447705 >> 172.21.15.33:0/1633447705 conn(0x7f57a40703a0 msgr2=0x7f57a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 -- 172.21.15.33:0/1633447705 shutdown_connections 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.602+0000 7f57a9685700 1 -- 172.21.15.33:0/1633447705 wait complete. 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.603+0000 7f57a9685700 1 Processor -- start 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.603+0000 7f57a9685700 1 -- start start 2023-10-09T15:31:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57a40cea00 0x7f57a40ccdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a415de50 0x7f57a41500c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a40c90c0 con 0x7f57a4153a00 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4151c00 con 0x7f57a415de50 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a4153470 con 0x7f57a40cea00 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51510/0 (socket says 172.21.15.33:51510) 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 -- 172.21.15.33:0/1566661318 learned_addr learned my addr 172.21.15.33:0/1566661318 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a8e84700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a415de50 0x7f57a41500c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a3fff700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57a40cea00 0x7f57a40ccdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 -- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57a40cea00 msgr2=0x7f57a40ccdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57a40cea00 0x7f57a40ccdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 -- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a415de50 msgr2=0x7f57a41500c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a415de50 0x7f57a41500c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 -- 172.21.15.33:0/1566661318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57940094f0 con 0x7f57a4153a00 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a37fe700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f578c00e8d0 tx=0x7f578c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c013410 con 0x7f57a4153a00 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c013570 con 0x7f57a4153a00 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a4150600 con 0x7f57a4153a00 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.604+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f578c013910 con 0x7f57a4153a00 2023-10-09T15:31:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.605+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a4152180 con 0x7f57a4153a00 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.605+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a40c8e90 con 0x7f57a4153a00 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.606+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f578c013d00 con 0x7f57a4153a00 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.606+0000 7f579bfff700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 0x7f57840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.606+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f578c084360 con 0x7f57a4153a00 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.606+0000 7f57a3fff700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 0x7f57840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.607+0000 7f57a3fff700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 0x7f57840693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b3070 tx=0x7f5794017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.611+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57a40c8e90 con 0x7f57a4153a00 2023-10-09T15:31:51.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:51.851+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f57a40c8e90 con 0x7f57a4153a00 2023-10-09T15:31:52.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.454+0000 7f579bfff700 1 -- 172.21.15.33:0/1566661318 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f57a40c8e90 con 0x7f57a4153a00 2023-10-09T15:31:52.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 msgr2=0x7f57840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 0x7f57840693e0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f57a40b3070 tx=0x7f5794017000 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 msgr2=0x7f57a4152f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f578c00e8d0 tx=0x7f578c008040 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 shutdown_connections 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5784066f30 0x7f57840693e0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57a415de50 0x7f57a41500c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57a40cea00 0x7f57a40ccdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 --2- 172.21.15.33:0/1566661318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57a4153a00 0x7f57a4152f30 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.456+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 >> 172.21.15.33:0/1566661318 conn(0x7f57a40703a0 msgr2=0x7f57a4158130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.457+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 shutdown_connections 2023-10-09T15:31:52.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.457+0000 7f57a9685700 1 -- 172.21.15.33:0/1566661318 wait complete. 2023-10-09T15:31:52.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.595+0000 7f662dedd700 1 Processor -- start 2023-10-09T15:31:52.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.595+0000 7f662dedd700 1 -- start start 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f662dedd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6628159850 0x7f66280adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f662dedd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280adb20 con 0x7f6628159c20 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f662dedd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66280acf10 con 0x7f66280b1040 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f662dedd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66280ccdc0 con 0x7f6628159850 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66277fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6628159850 0x7f66280adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f6626ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6628159c20 0x7f66280b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41162/0 (socket says 172.21.15.33:41162) 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f6626ffd700 1 -- 172.21.15.33:0/3412413188 learned_addr learned my addr 172.21.15.33:0/3412413188 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66277fe700 1 -- 172.21.15.33:0/3412413188 >> v1:172.21.15.59:6789/0 conn(0x7f66280b1040 legacy=0x7f66280c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66277fe700 1 -- 172.21.15.33:0/3412413188 >> v1:172.21.15.33:6789/0 conn(0x7f6628159c20 legacy=0x7f66280b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66277fe700 1 -- 172.21.15.33:0/3412413188 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66280ad1f0 con 0x7f6628159850 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66267fc700 1 -- 172.21.15.33:0/3412413188 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3287305137 0 0) 0x7f66280adb20 con 0x7f6628159c20 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66277fe700 1 --2- 172.21.15.33:0/3412413188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6628159850 0x7f66280adfb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66180098e0 tx=0x7f66180091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e56e48a341102597 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66267fc700 1 -- 172.21.15.33:0/3412413188 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6618009e80 con 0x7f6628159850 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66267fc700 1 -- 172.21.15.33:0/3412413188 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f661800b820 con 0x7f6628159850 2023-10-09T15:31:52.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.596+0000 7f66267fc700 1 -- 172.21.15.33:0/3412413188 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800bba0 con 0x7f6628159850 2023-10-09T15:31:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 -- 172.21.15.33:0/3412413188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6628159850 msgr2=0x7f66280adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 --2- 172.21.15.33:0/3412413188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6628159850 0x7f66280adfb0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66180098e0 tx=0x7f66180091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 -- 172.21.15.33:0/3412413188 shutdown_connections 2023-10-09T15:31:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 --2- 172.21.15.33:0/3412413188 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6628159850 0x7f66280adfb0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 -- 172.21.15.33:0/3412413188 >> 172.21.15.33:0/3412413188 conn(0x7f662806d170 msgr2=0x7f66280cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 -- 172.21.15.33:0/3412413188 shutdown_connections 2023-10-09T15:31:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.597+0000 7f662dedd700 1 -- 172.21.15.33:0/3412413188 wait complete. 2023-10-09T15:31:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.598+0000 7f662dedd700 1 Processor -- start 2023-10-09T15:31:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.598+0000 7f662dedd700 1 -- start start 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6628159850 0x7f662816a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 0x7f6628154c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c7f70 con 0x7f66280b1040 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662816aae0 con 0x7f6628159c20 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f662dedd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66280c7c90 con 0x7f6628159850 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51522/0 (socket says 172.21.15.33:51522) 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 -- 172.21.15.33:0/2345230904 learned_addr learned my addr 172.21.15.33:0/2345230904 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f6627fff700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 0x7f6628154c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f6626ffd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6628159850 0x7f662816a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 -- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6628159850 msgr2=0x7f662816a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6628159850 0x7f662816a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 -- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 msgr2=0x7f6628154c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 0x7f6628154c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f66277fe700 1 -- 172.21.15.33:0/2345230904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6618009420 con 0x7f66280b1040 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.599+0000 7f6627fff700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 0x7f6628154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f66277fe700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66180030c0 tx=0x7f6618016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661800ba90 con 0x7f66280b1040 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6618020070 con 0x7f66280b1040 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66280ab0d0 con 0x7f66280b1040 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f661801b6a0 con 0x7f66280b1040 2023-10-09T15:31:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.600+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66281551c0 con 0x7f66280b1040 2023-10-09T15:31:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.601+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66280aaf30 con 0x7f66280b1040 2023-10-09T15:31:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.601+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6618022030 con 0x7f66280b1040 2023-10-09T15:31:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.602+0000 7f660f7fe700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 0x7f66140693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.602+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f66180865d0 con 0x7f66280b1040 2023-10-09T15:31:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.602+0000 7f6626ffd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 0x7f66140693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.602+0000 7f6626ffd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 0x7f66140693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f662806a760 tx=0x7f661c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.606+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f66280aaf30 con 0x7f66280b1040 2023-10-09T15:31:52.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.843+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f66280aaf30 con 0x7f66280b1040 2023-10-09T15:31:52.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.844+0000 7f660f7fe700 1 -- 172.21.15.33:0/2345230904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f66280aaf30 con 0x7f66280b1040 2023-10-09T15:31:52.844 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:52.844 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3683481332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3683481332},{"type":"v1","addr":"172.21.15.59:6835","nonce":3683481332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:31:52.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 msgr2=0x7f66140693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 0x7f66140693e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f662806a760 tx=0x7f661c009040 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 msgr2=0x7f66280c1480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f66180030c0 tx=0x7f6618016000 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 shutdown_connections 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6614066f30 0x7f66140693e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66280b1040 0x7f66280c1480 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6628159c20 0x7f6628154c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 --2- 172.21.15.33:0/2345230904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6628159850 0x7f662816a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.845+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 >> 172.21.15.33:0/2345230904 conn(0x7f662806d170 msgr2=0x7f66280adfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:52.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.846+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 shutdown_connections 2023-10-09T15:31:52.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.846+0000 7f662dedd700 1 -- 172.21.15.33:0/2345230904 wait complete. 2023-10-09T15:31:52.847 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2023-10-09T15:31:52.858 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:31:52.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.976+0000 7f6844ef5700 1 Processor -- start 2023-10-09T15:31:52.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.976+0000 7f6844ef5700 1 -- start start 2023-10-09T15:31:52.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f6844ef5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 0x7f684015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f6844ef5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f684015de50 0x7f68400cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f6844ef5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f684015afd0 con 0x7f68400cef40 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f6844ef5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f684015b2b0 con 0x7f684015de50 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f6844ef5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684015b590 con 0x7f6840153c30 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f684015de50 0x7f68400cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f68400cef40 0x7f684006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41172/0 (socket says 172.21.15.33:41172) 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683ffff700 1 -- 172.21.15.33:0/811147330 learned_addr learned my addr 172.21.15.33:0/811147330 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683f7fe700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 0x7f684015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683effd700 1 -- 172.21.15.33:0/811147330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 msgr2=0x7f684015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683effd700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 0x7f684015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683effd700 1 -- 172.21.15.33:0/811147330 >> v1:172.21.15.33:6789/0 conn(0x7f68400cef40 legacy=0x7f684006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683effd700 1 -- 172.21.15.33:0/811147330 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f684015b870 con 0x7f684015de50 2023-10-09T15:31:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.977+0000 7f683f7fe700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 0x7f684015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f683effd700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f684015de50 0x7f68400cea00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f68340098e0 tx=0x7f68340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39e415a6f30375f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f683e7fc700 1 -- 172.21.15.33:0/811147330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6834009e80 con 0x7f684015de50 2023-10-09T15:31:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f683e7fc700 1 -- 172.21.15.33:0/811147330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f683400b860 con 0x7f684015de50 2023-10-09T15:31:52.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f683e7fc700 1 -- 172.21.15.33:0/811147330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f683400bbe0 con 0x7f684015de50 2023-10-09T15:31:52.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 -- 172.21.15.33:0/811147330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f684015de50 msgr2=0x7f68400cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f684015de50 0x7f68400cea00 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f68340098e0 tx=0x7f68340091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 -- 172.21.15.33:0/811147330 shutdown_connections 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6840153c30 0x7f684015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 --2- 172.21.15.33:0/811147330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f684015de50 0x7f68400cea00 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 -- 172.21.15.33:0/811147330 >> 172.21.15.33:0/811147330 conn(0x7f68400703a0 msgr2=0x7f68400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 -- 172.21.15.33:0/811147330 shutdown_connections 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.978+0000 7f6844ef5700 1 -- 172.21.15.33:0/811147330 wait complete. 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 Processor -- start 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 -- start start 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6840153c30 0x7f684016d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684015de50 0x7f68400b3520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400c7f80 con 0x7f68400cef40 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68400cb600 con 0x7f6840153c30 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f6844ef5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f684016d9c0 con 0x7f684015de50 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f683f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f683f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51542/0 (socket says 172.21.15.33:51542) 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.980+0000 7f683f7fe700 1 -- 172.21.15.33:0/3982002335 learned_addr learned my addr 172.21.15.33:0/3982002335 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683effd700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6840153c30 0x7f684016d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683ffff700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684015de50 0x7f68400b3520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 -- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684015de50 msgr2=0x7f68400b3520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684015de50 0x7f68400b3520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 -- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6840153c30 msgr2=0x7f684016d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6840153c30 0x7f684016d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 -- 172.21.15.33:0/3982002335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6834009420 con 0x7f68400cef40 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f683f7fe700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f683000c830 tx=0x7f6830008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830011600 con 0x7f68400cef40 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6830011760 con 0x7f68400cef40 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684016dca0 con 0x7f68400cef40 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6830011b20 con 0x7f68400cef40 2023-10-09T15:31:52.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.981+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68400b3a60 con 0x7f68400cef40 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.982+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68400cb420 con 0x7f68400cef40 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.983+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f683000a3e0 con 0x7f68400cef40 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.983+0000 7f68277fe700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 0x7f682c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.983+0000 7f683effd700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 0x7f682c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.983+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68300849f0 con 0x7f68400cef40 2023-10-09T15:31:52.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.983+0000 7f683effd700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 0x7f682c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68340091e0 tx=0x7f6834017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:52.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:52.987+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6830051c60 con 0x7f68400cef40 2023-10-09T15:31:53.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.183+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f684016e1c0 con 0x7f68400cef40 2023-10-09T15:31:53.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.183+0000 7f68277fe700 1 -- 172.21.15.33:0/3982002335 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f684016e1c0 con 0x7f68400cef40 2023-10-09T15:31:53.183 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:53.184 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":32,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:31:50.428285+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":30,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 msgr2=0x7f682c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 0x7f682c0693e0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f68340091e0 tx=0x7f6834017000 comp rx=0 tx=0).stop 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 msgr2=0x7f68400b5d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f683000c830 tx=0x7f6830008040 comp rx=0 tx=0).stop 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 shutdown_connections 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f682c066f30 0x7f682c0693e0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68400cef40 0x7f68400b5d40 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f684015de50 0x7f68400b3520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 --2- 172.21.15.33:0/3982002335 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6840153c30 0x7f684016d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 >> 172.21.15.33:0/3982002335 conn(0x7f68400703a0 msgr2=0x7f68400c5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:53.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 shutdown_connections 2023-10-09T15:31:53.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.186+0000 7f6844ef5700 1 -- 172.21.15.33:0/3982002335 wait complete. 2023-10-09T15:31:53.198 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:31:53.198 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 Processor -- start 2023-10-09T15:31:53.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 -- start start 2023-10-09T15:31:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fae900cb5a0 0x7fae900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 0x7fae90159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae9015ae40 con 0x7fae9015a400 2023-10-09T15:31:53.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae900d13f0 con 0x7fae900cb5a0 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.318+0000 7fae96acc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae9015ab60 con 0x7fae900cd9e0 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fae900cb5a0 0x7fae900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae95069700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fae9015a400 0x7fae90156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41186/0 (socket says 172.21.15.33:41186) 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae95069700 1 -- 172.21.15.33:0/127155694 learned_addr learned my addr 172.21.15.33:0/127155694 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8ffff700 1 --2- 172.21.15.33:0/127155694 >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 0x7fae90159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 -- 172.21.15.33:0/127155694 >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 msgr2=0x7fae90159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 --2- 172.21.15.33:0/127155694 >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 0x7fae90159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 -- 172.21.15.33:0/127155694 >> v1:172.21.15.33:6789/0 conn(0x7fae9015a400 legacy=0x7fae90156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8f7fe700 1 -- 172.21.15.33:0/127155694 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1714092904 0 0) 0x7fae9015ae40 con 0x7fae9015a400 2023-10-09T15:31:53.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 -- 172.21.15.33:0/127155694 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae900ccf00 con 0x7fae900cb5a0 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8ffff700 1 --2- 172.21.15.33:0/127155694 >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 0x7fae90159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae94868700 1 --2- 172.21.15.33:0/127155694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900cb970 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae800098e0 tx=0x7fae800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd55672c6e7e67c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8f7fe700 1 -- 172.21.15.33:0/127155694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80009e80 con 0x7fae900cb5a0 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8f7fe700 1 -- 172.21.15.33:0/127155694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae8000b820 con 0x7fae900cb5a0 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.319+0000 7fae8f7fe700 1 -- 172.21.15.33:0/127155694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae8000bba0 con 0x7fae900cb5a0 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 -- 172.21.15.33:0/127155694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 msgr2=0x7fae900cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 --2- 172.21.15.33:0/127155694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900cb970 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fae800098e0 tx=0x7fae800091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 -- 172.21.15.33:0/127155694 shutdown_connections 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 --2- 172.21.15.33:0/127155694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900cb970 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 --2- 172.21.15.33:0/127155694 >> v2:172.21.15.59:3300/0 conn(0x7fae900cd9e0 0x7fae90159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 -- 172.21.15.33:0/127155694 >> 172.21.15.33:0/127155694 conn(0x7fae90070e30 msgr2=0x7fae900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:53.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 -- 172.21.15.33:0/127155694 shutdown_connections 2023-10-09T15:31:53.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.320+0000 7fae96acc700 1 -- 172.21.15.33:0/127155694 wait complete. 2023-10-09T15:31:53.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.321+0000 7fae96acc700 1 Processor -- start 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.321+0000 7fae96acc700 1 -- start start 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900cd9e0 0x7fae9015d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 0x7fae9015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae9015b3a0 con 0x7fae900cb5a0 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae90155260 con 0x7fae9015a400 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae96acc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae90155540 con 0x7fae900cd9e0 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51562/0 (socket says 172.21.15.33:51562) 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 -- 172.21.15.33:0/1240708318 learned_addr learned my addr 172.21.15.33:0/1240708318 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae95069700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 0x7fae9015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae8ffff700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900cd9e0 0x7fae9015d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 -- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900cd9e0 msgr2=0x7fae9015d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900cd9e0 0x7fae9015d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 -- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 msgr2=0x7fae9015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 0x7fae9015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 -- 172.21.15.33:0/1240708318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae80009420 con 0x7fae900cb5a0 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae95069700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 0x7fae9015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.322+0000 7fae94868700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae9006ea60 tx=0x7fae80017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.323+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011420 con 0x7fae900cb5a0 2023-10-09T15:31:53.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.323+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae800115a0 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.323+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae90155820 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.323+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae80011960 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.323+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae900b4e80 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.324+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae9004c3c0 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.324+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fae80011cd0 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.325+0000 7fae8cff9700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 0x7fae7c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.325+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fae80086120 con 0x7fae900cb5a0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.325+0000 7fae8ffff700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 0x7fae7c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.325+0000 7fae8ffff700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 0x7fae7c0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae9015e440 tx=0x7fae84006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.329+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fae80053390 con 0x7fae900cb5a0 2023-10-09T15:31:53.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.518+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fae900cd1e0 con 0x7fae7c066f30 2023-10-09T15:31:53.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.525+0000 7fae8cff9700 1 -- 172.21.15.33:0/1240708318 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253777 (secure 0 0 0) 0x7fae900cd1e0 con 0x7fae7c066f30 2023-10-09T15:31:53.528 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 msgr2=0x7fae7c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 0x7fae7c0693e0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fae9015e440 tx=0x7fae84006f90 comp rx=0 tx=0).stop 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 msgr2=0x7fae900b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fae9006ea60 tx=0x7fae80017000 comp rx=0 tx=0).stop 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 shutdown_connections 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fae7c066f30 0x7fae7c0693e0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fae900cb5a0 0x7fae900b34b0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fae9015a400 0x7fae9015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 --2- 172.21.15.33:0/1240708318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fae900cd9e0 0x7fae9015d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 >> 172.21.15.33:0/1240708318 conn(0x7fae90070e30 msgr2=0x7fae900b0990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 shutdown_connections 2023-10-09T15:31:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.528+0000 7fae96acc700 1 -- 172.21.15.33:0/1240708318 wait complete. 2023-10-09T15:31:53.531 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:53.540 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T15:31:53.246830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381976,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592744,"statfs":{"total":773094113280,"available":770654969856,"internally_reserved":0,"allocated":3760128,"data_stored":2131608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829874"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419685+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839982+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426044+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:10.567630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.422834+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418049+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:34.766857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417812+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:04.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426008+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425553+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839619+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420342+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425556+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:22.214958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419878+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425445+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425427+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420846+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417068+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417329+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:02.097241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417095+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:18.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839608+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419678+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418303+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:16.506625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420869+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420245+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419851+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420484+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417730+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:34.996041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.424798+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419969+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-09T15:31:43.295106+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:31:43.295106+0000","last_peered":"2023-10-09T15:31:43.295106+0000","last_clean":"2023-10-09T15:31:43.295106+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:31:43.295106+0000","last_undegraded":"2023-10-09T15:31:43.295106+0000","last_fullsized":"2023-10-09T15:31:43.295106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":709068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:53.545 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.700+0000 7fea00f72700 1 Processor -- start 2023-10-09T15:31:53.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.700+0000 7fea00f72700 1 -- start start 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fea00f72700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9fc15d440 0x7fe9fc0aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fea00f72700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9fc15df20 0x7fe9fc06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fea00f72700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9fc15a750 con 0x7fe9fc06c6a0 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fea00f72700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc06d080 con 0x7fe9fc15d440 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fea00f72700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9fc15e3a0 con 0x7fe9fc15df20 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fe9fa59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9fc15d440 0x7fe9fc0aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fe9fa59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9fc15d440 0x7fe9fc0aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51568/0 (socket says 172.21.15.33:51568) 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fe9fa59c700 1 -- 172.21.15.33:0/2349871936 learned_addr learned my addr 172.21.15.33:0/2349871936 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:53.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.701+0000 7fe9fad9d700 1 --2- 172.21.15.33:0/2349871936 >> v2:172.21.15.59:3300/0 conn(0x7fe9fc15df20 0x7fe9fc06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9fa59c700 1 -- 172.21.15.33:0/2349871936 >> v2:172.21.15.59:3300/0 conn(0x7fe9fc15df20 msgr2=0x7fe9fc06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9fa59c700 1 --2- 172.21.15.33:0/2349871936 >> v2:172.21.15.59:3300/0 conn(0x7fe9fc15df20 0x7fe9fc06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9fa59c700 1 -- 172.21.15.33:0/2349871936 >> v1:172.21.15.59:6789/0 conn(0x7fe9fc06c6a0 legacy=0x7fe9fc15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9fa59c700 1 -- 172.21.15.33:0/2349871936 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9fc159e40 con 0x7fe9fc15d440 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9fa59c700 1 --2- 172.21.15.33:0/2349871936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15d440 0x7fe9fc0aec90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af1d0 tx=0x7fe9ec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9907c83d37e769 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9f959a700 1 -- 172.21.15.33:0/2349871936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec009e70 con 0x7fe9fc15d440 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9f959a700 1 -- 172.21.15.33:0/2349871936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9ec00b860 con 0x7fe9fc15d440 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fe9f959a700 1 -- 172.21.15.33:0/2349871936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9ec00bc00 con 0x7fe9fc15d440 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fea00f72700 1 -- 172.21.15.33:0/2349871936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15d440 msgr2=0x7fe9fc0aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.702+0000 7fea00f72700 1 --2- 172.21.15.33:0/2349871936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15d440 0x7fe9fc0aec90 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af1d0 tx=0x7fe9ec009250 comp rx=0 tx=0).stop 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 -- 172.21.15.33:0/2349871936 shutdown_connections 2023-10-09T15:31:53.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 --2- 172.21.15.33:0/2349871936 >> v2:172.21.15.59:3300/0 conn(0x7fe9fc15df20 0x7fe9fc06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 --2- 172.21.15.33:0/2349871936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15d440 0x7fe9fc0aec90 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 -- 172.21.15.33:0/2349871936 >> 172.21.15.33:0/2349871936 conn(0x7fe9fc06f190 msgr2=0x7fe9fc0ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 -- 172.21.15.33:0/2349871936 shutdown_connections 2023-10-09T15:31:53.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.703+0000 7fea00f72700 1 -- 172.21.15.33:0/2349871936 wait complete. 2023-10-09T15:31:53.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 Processor -- start 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 -- start start 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc06c6a0 0x7fe9fc14b6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 0x7fe9fc0b0410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14a430 con 0x7fe9fc15df20 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc0ae7b0 con 0x7fe9fc06c6a0 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.704+0000 7fea00f72700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9fc14bc20 con 0x7fe9fc15d440 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51570/0 (socket says 172.21.15.33:51570) 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 -- 172.21.15.33:0/1588863003 learned_addr learned my addr 172.21.15.33:0/1588863003 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:53.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fa59c700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc06c6a0 0x7fe9fc14b6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9f9d9b700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 0x7fe9fc0b0410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 -- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 msgr2=0x7fe9fc0b0410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 0x7fe9fc0b0410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 -- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc06c6a0 msgr2=0x7fe9fc14b6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc06c6a0 0x7fe9fc14b6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 -- 172.21.15.33:0/1588863003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0094f0 con 0x7fe9fc15df20 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9f9d9b700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 0x7fe9fc0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9fad9d700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009ef0 tx=0x7fe9f400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f400cc20 con 0x7fe9fc15df20 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f400f040 con 0x7fe9fc15df20 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9fc14b250 con 0x7fe9fc15df20 2023-10-09T15:31:53.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4014480 con 0x7fe9fc15df20 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.705+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9fc14a6c0 con 0x7fe9fc15df20 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.706+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9fc14b3e0 con 0x7fe9fc15df20 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.707+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe9f4014830 con 0x7fe9fc15df20 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.707+0000 7fe9ea7fc700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.707+0000 7fe9fa59c700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.707+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9f4084ee0 con 0x7fe9fc15df20 2023-10-09T15:31:53.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.708+0000 7fe9fa59c700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 0x7fe9dc0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af1d0 tx=0x7fe9ec017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:53.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.712+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9f4052150 con 0x7fe9fc15df20 2023-10-09T15:31:53.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.901+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe9fc04c430 con 0x7fe9dc066f30 2023-10-09T15:31:53.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.908+0000 7fe9ea7fc700 1 -- 172.21.15.33:0/1588863003 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253777 (secure 0 0 0) 0x7fe9fc04c430 con 0x7fe9dc066f30 2023-10-09T15:31:53.911 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 msgr2=0x7fe9dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 0x7fe9dc0693e0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc0af1d0 tx=0x7fe9ec017000 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 msgr2=0x7fe9fc0b0950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe9f4009ef0 tx=0x7fe9f400b040 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 shutdown_connections 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9dc066f30 0x7fe9dc0693e0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9fc15df20 0x7fe9fc0b0950 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9fc06c6a0 0x7fe9fc14b6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 --2- 172.21.15.33:0/1588863003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9fc15d440 0x7fe9fc0b0410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:53.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 >> 172.21.15.33:0/1588863003 conn(0x7fe9fc06f190 msgr2=0x7fe9fc14e8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 shutdown_connections 2023-10-09T15:31:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:53.911+0000 7fea00f72700 1 -- 172.21.15.33:0/1588863003 wait complete. 2023-10-09T15:31:53.914 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:53.923 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T15:31:53.246830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381976,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592744,"statfs":{"total":773094113280,"available":770654969856,"internally_reserved":0,"allocated":3760128,"data_stored":2131608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829874"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419685+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839982+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426044+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:10.567630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.422834+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418049+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:34.766857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417812+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:04.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426008+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425553+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839619+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420342+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425556+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:22.214958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419878+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425445+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425427+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420846+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417068+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417329+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:02.097241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417095+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:18.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839608+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419678+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418303+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:16.506625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420869+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420245+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419851+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420484+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417730+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:34.996041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.424798+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419969+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-09T15:31:43.295106+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:31:43.295106+0000","last_peered":"2023-10-09T15:31:43.295106+0000","last_clean":"2023-10-09T15:31:43.295106+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:31:43.295106+0000","last_undegraded":"2023-10-09T15:31:43.295106+0000","last_fullsized":"2023-10-09T15:31:43.295106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":709068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:53.928 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.083+0000 7f6ee0d90700 1 Processor -- start 2023-10-09T15:31:54.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.083+0000 7f6ee0d90700 1 -- start start 2023-10-09T15:31:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6ee0d90700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6edc15de50 0x7f6edc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6ee0d90700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc0cf3c0 con 0x7f6edc153c30 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6ee0d90700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6edc15afd0 con 0x7f6edc0cef40 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6ee0d90700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6edc15b2b0 con 0x7f6edc15de50 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edb7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6edc153c30 0x7f6edc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41188/0 (socket says 172.21.15.33:41188) 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edaffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6edc15de50 0x7f6edc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edb7fe700 1 -- 172.21.15.33:0/56333540 learned_addr learned my addr 172.21.15.33:0/56333540 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6eda7fc700 1 -- 172.21.15.33:0/56333540 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4284314741 0 0) 0x7f6edc0cf3c0 con 0x7f6edc153c30 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6eda7fc700 1 -- 172.21.15.33:0/56333540 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ec4003570 con 0x7f6edc153c30 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edaffd700 1 -- 172.21.15.33:0/56333540 >> v1:172.21.15.59:6789/0 conn(0x7f6edc0cef40 legacy=0x7f6edc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edaffd700 1 -- 172.21.15.33:0/56333540 >> v1:172.21.15.33:6789/0 conn(0x7f6edc153c30 legacy=0x7f6edc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edaffd700 1 -- 172.21.15.33:0/56333540 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6edc15b590 con 0x7f6edc15de50 2023-10-09T15:31:54.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.084+0000 7f6edaffd700 1 --2- 172.21.15.33:0/56333540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0cea00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aacce3dfb7d7f97e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6eda7fc700 1 -- 172.21.15.33:0/56333540 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000b640 con 0x7f6edc15de50 2023-10-09T15:31:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6eda7fc700 1 -- 172.21.15.33:0/56333540 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed000b7a0 con 0x7f6edc15de50 2023-10-09T15:31:54.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6eda7fc700 1 -- 172.21.15.33:0/56333540 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed000bb40 con 0x7f6edc15de50 2023-10-09T15:31:54.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 -- 172.21.15.33:0/56333540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 msgr2=0x7f6edc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/56333540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0cea00 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f6ed00098e0 tx=0x7f6ed00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 -- 172.21.15.33:0/56333540 shutdown_connections 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/56333540 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0cea00 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 -- 172.21.15.33:0/56333540 >> 172.21.15.33:0/56333540 conn(0x7f6edc0703a0 msgr2=0x7f6edc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 -- 172.21.15.33:0/56333540 shutdown_connections 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.085+0000 7f6ee0d90700 1 -- 172.21.15.33:0/56333540 wait complete. 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.086+0000 7f6ee0d90700 1 Processor -- start 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.086+0000 7f6ee0d90700 1 -- start start 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc0cef40 0x7f6edc1519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 0x7f6edc0d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b32d0 con 0x7f6edc15de50 2023-10-09T15:31:54.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b34e0 con 0x7f6edc153c30 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6ee0d90700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6edc0b37c0 con 0x7f6edc0cef40 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6edbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51586/0 (socket says 172.21.15.33:51586) 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6edbfff700 1 -- 172.21.15.33:0/607403967 learned_addr learned my addr 172.21.15.33:0/607403967 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6edaffd700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 0x7f6edc0d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.087+0000 7f6edb7fe700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc0cef40 0x7f6edc1519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 -- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc0cef40 msgr2=0x7f6edc1519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc0cef40 0x7f6edc1519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 -- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 msgr2=0x7f6edc0d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 0x7f6edc0d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 -- 172.21.15.33:0/607403967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ed0009420 con 0x7f6edc15de50 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edaffd700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 0x7f6edc0d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6edbfff700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c840 tx=0x7f6ed4001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4012630 con 0x7f6edc15de50 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ed40127b0 con 0x7f6edc15de50 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6edc0b3aa0 con 0x7f6edc15de50 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ed4012b70 con 0x7f6edc15de50 2023-10-09T15:31:54.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.088+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6edc0b40e0 con 0x7f6edc15de50 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.089+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6edc15dac0 con 0x7f6edc15de50 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.089+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ed4003030 con 0x7f6edc15de50 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.090+0000 7f6ec37fe700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 0x7f6ec80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.090+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ed40844f0 con 0x7f6edc15de50 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.090+0000 7f6edb7fe700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 0x7f6ec80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.090+0000 7f6edb7fe700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 0x7f6ec80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0058d0 tx=0x7f6ecc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.094+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ed4051760 con 0x7f6edc15de50 2023-10-09T15:31:54.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.282+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6edc0b4270 con 0x7f6ec8066f30 2023-10-09T15:31:54.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.289+0000 7f6ec37fe700 1 -- 172.21.15.33:0/607403967 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253777 (secure 0 0 0) 0x7f6edc0b4270 con 0x7f6ec8066f30 2023-10-09T15:31:54.292 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 msgr2=0x7f6ec80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 0x7f6ec80693e0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f6ecc0058d0 tx=0x7f6ecc009040 comp rx=0 tx=0).stop 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 msgr2=0x7f6edc0d0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6ed400c840 tx=0x7f6ed4001670 comp rx=0 tx=0).stop 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 shutdown_connections 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ec8066f30 0x7f6ec80693e0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6edc15de50 0x7f6edc0d0990 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6edc0cef40 0x7f6edc1519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 --2- 172.21.15.33:0/607403967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6edc153c30 0x7f6edc0d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 >> 172.21.15.33:0/607403967 conn(0x7f6edc0703a0 msgr2=0x7f6edc153030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:54.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 shutdown_connections 2023-10-09T15:31:54.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.292+0000 7f6ee0d90700 1 -- 172.21.15.33:0/607403967 wait complete. 2023-10-09T15:31:54.295 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:54.304 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T15:31:53.246830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381976,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592744,"statfs":{"total":773094113280,"available":770654969856,"internally_reserved":0,"allocated":3760128,"data_stored":2131608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829874"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419685+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839982+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426044+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:10.567630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.422834+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418049+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:34.766857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417812+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:04.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426008+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425553+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839619+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420342+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425556+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:22.214958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419878+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425445+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425427+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420846+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417068+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417329+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:02.097241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417095+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:18.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839608+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419678+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418303+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:16.506625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420869+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420245+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419851+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420484+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417730+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:34.996041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.424798+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419969+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-09T15:31:43.295106+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:31:43.295106+0000","last_peered":"2023-10-09T15:31:43.295106+0000","last_clean":"2023-10-09T15:31:43.295106+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:31:43.295106+0000","last_undegraded":"2023-10-09T15:31:43.295106+0000","last_fullsized":"2023-10-09T15:31:43.295106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":709068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:54.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3f is not active+clean 2023-10-09T15:31:54.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.309 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3e is not active+clean 2023-10-09T15:31:54.309 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3d is not active+clean 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3c is not active+clean 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3b is not active+clean 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3a is not active+clean 2023-10-09T15:31:54.310 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.39 is not active+clean 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.38 is not active+clean 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.37 is not active+clean 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.36 is not active+clean 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.35 is not active+clean 2023-10-09T15:31:54.311 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.34 is not active+clean 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.33 is not active+clean 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.32 is not active+clean 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.31 is not active+clean 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.30 is not active+clean 2023-10-09T15:31:54.312 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2f is not active+clean 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2e is not active+clean 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2d is not active+clean 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2c is not active+clean 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.313 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2b is not active+clean 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2a is not active+clean 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.29 is not active+clean 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.28 is not active+clean 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.27 is not active+clean 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.314 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.26 is not active+clean 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.25 is not active+clean 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.24 is not active+clean 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.23 is not active+clean 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.22 is not active+clean 2023-10-09T15:31:54.315 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.21 is not active+clean 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.20 is not active+clean 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1e is not active+clean 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1f is not active+clean 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.419685+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1f is not active+clean 2023-10-09T15:31:54.316 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1e is not active+clean 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.839982+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1c is not active+clean 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1d is not active+clean 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.426044+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:50:10.567630+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1d is not active+clean 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1c is not active+clean 2023-10-09T15:31:54.317 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.422834+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1a is not active+clean 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1b is not active+clean 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.418049+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:56:34.766857+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1b is not active+clean 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1a is not active+clean 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417812+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:03:04.174621+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.318 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.18 is not active+clean 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.19 is not active+clean 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.426008+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.19 is not active+clean 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.18 is not active+clean 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417070+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.16 is not active+clean 2023-10-09T15:31:54.319 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.17 is not active+clean 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.425553+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.17 is not active+clean 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.16 is not active+clean 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.839619+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.14 is not active+clean 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.15 is not active+clean 2023-10-09T15:31:54.320 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.420342+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.15 is not active+clean 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.14 is not active+clean 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.425556+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.12 is not active+clean 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.13 is not active+clean 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417070+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:58:22.214958+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.13 is not active+clean 2023-10-09T15:31:54.321 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.12 is not active+clean 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.419878+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.10 is not active+clean 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.11 is not active+clean 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.425445+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.11 is not active+clean 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.322 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.10 is not active+clean 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.425427+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.e is not active+clean 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.f is not active+clean 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.420846+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.f is not active+clean 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.e is not active+clean 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417068+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.323 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.c is not active+clean 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.d is not active+clean 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417329+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:37:02.097241+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.d is not active+clean 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.c is not active+clean 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417095+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:43:18.178999+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.a is not active+clean 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.324 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.b is not active+clean 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.839608+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.b is not active+clean 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.a is not active+clean 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.419678+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.8 is not active+clean 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.9 is not active+clean 2023-10-09T15:31:54.325 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.418303+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:46:16.506625+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.9 is not active+clean 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.8 is not active+clean 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.420869+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.6 is not active+clean 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.7 is not active+clean 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.420245+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:54.326 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.7 is not active+clean 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.6 is not active+clean 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.839075+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.5 is not active+clean 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.4 is not active+clean 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.419851+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.2 is not active+clean 2023-10-09T15:31:54.327 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.3 is not active+clean 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.839075+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.3 is not active+clean 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.2 is not active+clean 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.420484+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.0 is not active+clean 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.1 is not active+clean 2023-10-09T15:31:54.328 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.417730+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:00:34.996041+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.1 is not active+clean 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.0 is not active+clean 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.424798+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 5.4 is not active+clean 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:31:48.414032+0000', 'last_change': '2023-10-09T15:31:48.414032+0000', 'last_active': '2023-10-09T15:31:48.414032+0000', 'last_peered': '2023-10-09T15:31:48.414032+0000', 'last_clean': '2023-10-09T15:31:48.414032+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:48.414032+0000', 'last_undegraded': '2023-10-09T15:31:48.414032+0000', 'last_fullsized': '2023-10-09T15:31:48.414032+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:48.414032+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:PG 4.5 is not active+clean 2023-10-09T15:31:54.329 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:31:47.409526+0000', 'last_change': '2023-10-09T15:31:47.419969+0000', 'last_active': '2023-10-09T15:31:47.409526+0000', 'last_peered': '2023-10-09T15:31:47.409526+0000', 'last_clean': '2023-10-09T15:31:47.409526+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:31:47.409526+0000', 'last_undegraded': '2023-10-09T15:31:47.409526+0000', 'last_fullsized': '2023-10-09T15:31:47.409526+0000', 'mapping_epoch': 29, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 29, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'last_clean_scrub_stamp': '2023-10-09T15:31:47.409526+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:31:54.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T15:31:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.462+0000 7f04b827a700 1 Processor -- start 2023-10-09T15:31:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.463+0000 7f04b827a700 1 -- start start 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b827a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b00cb970 0x7f04b0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b827a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f04b015a400 0x7f04b0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b827a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04b015ae40 con 0x7f04b00cb5a0 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b827a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04b00ce0f0 con 0x7f04b015a400 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b827a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00cbde0 con 0x7f04b00cb970 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6016700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f04b00cb5a0 0x7f04b00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41194/0 (socket says 172.21.15.33:41194) 2023-10-09T15:31:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6016700 1 -- 172.21.15.33:0/933750275 learned_addr learned my addr 172.21.15.33:0/933750275 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 --2- 172.21.15.33:0/933750275 >> v2:172.21.15.33:3300/0 conn(0x7f04b015a400 0x7f04b0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b5815700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b00cb970 0x7f04b0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 -- 172.21.15.33:0/933750275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b00cb970 msgr2=0x7f04b0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b00cb970 0x7f04b0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 -- 172.21.15.33:0/933750275 >> v1:172.21.15.33:6789/0 conn(0x7f04b00cb5a0 legacy=0x7f04b00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 -- 172.21.15.33:0/933750275 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b015ab60 con 0x7f04b015a400 2023-10-09T15:31:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.464+0000 7f04b6817700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b015a400 0x7f04b0156e90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009e90 tx=0x7f04a8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7ccc74e4b324673 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.465+0000 7f04b5014700 1 -- 172.21.15.33:0/933750275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a800e070 con 0x7f04b015a400 2023-10-09T15:31:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.465+0000 7f04b5014700 1 -- 172.21.15.33:0/933750275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a800bbf0 con 0x7f04b015a400 2023-10-09T15:31:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.465+0000 7f04b5014700 1 -- 172.21.15.33:0/933750275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a8012430 con 0x7f04b015a400 2023-10-09T15:31:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 -- 172.21.15.33:0/933750275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b015a400 msgr2=0x7f04b0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b015a400 0x7f04b0156e90 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f04a8009e90 tx=0x7f04a8009780 comp rx=0 tx=0).stop 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 -- 172.21.15.33:0/933750275 shutdown_connections 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b015a400 0x7f04b0156e90 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 --2- 172.21.15.33:0/933750275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b00cb970 0x7f04b0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 -- 172.21.15.33:0/933750275 >> 172.21.15.33:0/933750275 conn(0x7f04b0070e30 msgr2=0x7f04b00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 -- 172.21.15.33:0/933750275 shutdown_connections 2023-10-09T15:31:54.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.466+0000 7f04b827a700 1 -- 172.21.15.33:0/933750275 wait complete. 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.467+0000 7f04b827a700 1 Processor -- start 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.467+0000 7f04b827a700 1 -- start start 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00cb5a0 0x7f04b00b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 0x7f04b00c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00b5950 con 0x7f04b00cb970 2023-10-09T15:31:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04b016a890 con 0x7f04b00cb5a0 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b827a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04b00b4d40 con 0x7f04b015a400 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51600/0 (socket says 172.21.15.33:51600) 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 -- 172.21.15.33:0/2117122483 learned_addr learned my addr 172.21.15.33:0/2117122483 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b6016700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00cb5a0 0x7f04b00b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b6817700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 0x7f04b00c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 -- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 msgr2=0x7f04b00c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 0x7f04b00c9b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 -- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00cb5a0 msgr2=0x7f04b00b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00cb5a0 0x7f04b00b46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b5815700 1 -- 172.21.15.33:0/2117122483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04a8009a20 con 0x7f04b00cb970 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.468+0000 7f04b6817700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 0x7f04b00c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04b5815700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04a000ecb0 tx=0x7f04a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000c920 con 0x7f04b00cb970 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04a000ca80 con 0x7f04b00cb970 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04b00b5020 con 0x7f04b00cb970 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04a000ce20 con 0x7f04b00cb970 2023-10-09T15:31:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.469+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04b00b55e0 con 0x7f04b00cb970 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.470+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f04b00b5ac0 con 0x7f04b00cb970 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.470+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f04a0013680 con 0x7f04b00cb970 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.471+0000 7f04a67fc700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 0x7f04940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.471+0000 7f04b6016700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 0x7f04940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.471+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f04a0084830 con 0x7f04b00cb970 2023-10-09T15:31:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.471+0000 7f04b6016700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 0x7f04940693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f04ac001950 tx=0x7f04ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.475+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04a0051aa0 con 0x7f04b00cb970 2023-10-09T15:31:54.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.748+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f04b004c3c0 con 0x7f04b00cb970 2023-10-09T15:31:54.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.748+0000 7f04a67fc700 1 -- 172.21.15.33:0/2117122483 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+2723 (secure 0 0 0) 0x7f04a0084020 con 0x7f04b00cb970 2023-10-09T15:31:54.748 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:54.748 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":73,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":32,"num_osds":8,"num_up_osds":8,"osd_up_since":1696865452,"num_in_osds":8,"osd_in_since":1696865443,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2439143424,"bytes_avail":770654969856,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":16,"id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"a","status":"up:active","gid":4938}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-10-09T15:31:49.245876+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T15:31:54.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 msgr2=0x7f04940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 0x7f04940693e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f04ac001950 tx=0x7f04ac009040 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 msgr2=0x7f04b016a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f04a000ecb0 tx=0x7f04a00091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 shutdown_connections 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0494066f30 0x7f04940693e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04b015a400 0x7f04b00c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f04b00cb5a0 0x7f04b00b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 --2- 172.21.15.33:0/2117122483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04b00cb970 0x7f04b016a350 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 >> 172.21.15.33:0/2117122483 conn(0x7f04b0070e30 msgr2=0x7f04b00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 shutdown_connections 2023-10-09T15:31:54.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.750+0000 7f04b827a700 1 -- 172.21.15.33:0/2117122483 wait complete. 2023-10-09T15:31:54.762 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T15:31:54.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:54.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.881+0000 7fd2a63f0700 1 Processor -- start 2023-10-09T15:31:54.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.881+0000 7fd2a63f0700 1 -- start start 2023-10-09T15:31:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a63f0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd2a0153c30 0x7fd2a015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a63f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 0x7fd2a00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a63f0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2a00cf3c0 con 0x7fd2a00cef40 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a63f0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a015afd0 con 0x7fd2a0153c30 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a63f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2a015b2b0 con 0x7fd2a015de50 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a53ee700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd2a0153c30 0x7fd2a015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a5bef700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd2a00cef40 0x7fd2a006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41198/0 (socket says 172.21.15.33:41198) 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a5bef700 1 -- 172.21.15.33:0/3414928950 learned_addr learned my addr 172.21.15.33:0/3414928950 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a4bed700 1 --2- 172.21.15.33:0/3414928950 >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 0x7fd2a00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3414928950 >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 msgr2=0x7fd2a00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a53ee700 1 --2- 172.21.15.33:0/3414928950 >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 0x7fd2a00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3414928950 >> v1:172.21.15.33:6789/0 conn(0x7fd2a00cef40 legacy=0x7fd2a006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3414928950 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2a015b590 con 0x7fd2a0153c30 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.882+0000 7fd2a4bed700 1 --2- 172.21.15.33:0/3414928950 >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 0x7fd2a00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a53ee700 1 --2- 172.21.15.33:0/3414928950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a0153c30 0x7fd2a015a5e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00713a0 tx=0x7fd29c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7763fa49abfbfa1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd297fff700 1 -- 172.21.15.33:0/3414928950 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00b6b0 con 0x7fd2a0153c30 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd297fff700 1 -- 172.21.15.33:0/3414928950 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c00b810 con 0x7fd2a0153c30 2023-10-09T15:31:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd297fff700 1 -- 172.21.15.33:0/3414928950 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00bbb0 con 0x7fd2a0153c30 2023-10-09T15:31:54.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3414928950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a0153c30 msgr2=0x7fd2a015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3414928950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a0153c30 0x7fd2a015a5e0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fd2a00713a0 tx=0x7fd29c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3414928950 shutdown_connections 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3414928950 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a0153c30 0x7fd2a015a5e0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3414928950 >> v2:172.21.15.59:3300/0 conn(0x7fd2a015de50 0x7fd2a00cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3414928950 >> 172.21.15.33:0/3414928950 conn(0x7fd2a00703a0 msgr2=0x7fd2a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3414928950 shutdown_connections 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.883+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3414928950 wait complete. 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.884+0000 7fd2a63f0700 1 Processor -- start 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 -- start start 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2a0153c30 0x7fd2a0150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2a015de50 0x7fd2a006d790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a0150690 con 0x7fd2a00cef40 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00cd440 con 0x7fd2a0153c30 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a63f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a00cd8d0 con 0x7fd2a015de50 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.885+0000 7fd2a53ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51618/0 (socket says 172.21.15.33:51618) 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3372022603 learned_addr learned my addr 172.21.15.33:0/3372022603 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2a015de50 msgr2=0x7fd2a006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2a015de50 0x7fd2a006d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2a0153c30 msgr2=0x7fd2a0150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2a0153c30 0x7fd2a0150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 -- 172.21.15.33:0/3372022603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd29c009420 con 0x7fd2a00cef40 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a53ee700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00b0e0 tx=0x7fd29c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c00bb90 con 0x7fd2a00cef40 2023-10-09T15:31:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd29c026450 con 0x7fd2a00cef40 2023-10-09T15:31:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd29c0267d0 con 0x7fd2a00cef40 2023-10-09T15:31:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a00cc830 con 0x7fd2a00cef40 2023-10-09T15:31:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.886+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a00ccdf0 con 0x7fd2a00cef40 2023-10-09T15:31:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.887+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a004c3c0 con 0x7fd2a00cef40 2023-10-09T15:31:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.888+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd29c011420 con 0x7fd2a00cef40 2023-10-09T15:31:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.888+0000 7fd2957fa700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.888+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd29c085fb0 con 0x7fd2a00cef40 2023-10-09T15:31:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.888+0000 7fd2a4bed700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:54.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.888+0000 7fd2a4bed700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:54.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:54.892+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd29c053220 con 0x7fd2a00cef40 2023-10-09T15:31:55.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.083+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd2a00caef0 con 0x7fd284066f30 2023-10-09T15:31:55.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.090+0000 7fd2957fa700 1 -- 172.21.15.33:0/3372022603 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+253777 (secure 0 0 0) 0x7fd2a00caef0 con 0x7fd284066f30 2023-10-09T15:31:55.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 msgr2=0x7fd2840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 0x7fd2840693e0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fd290006fd0 tx=0x7fd290008040 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 msgr2=0x7fd2a00c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fd29c00b0e0 tx=0x7fd29c017000 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 shutdown_connections 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd284066f30 0x7fd2840693e0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2a00cef40 0x7fd2a00c9fa0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd2a015de50 0x7fd2a006d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 --2- 172.21.15.33:0/3372022603 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2a0153c30 0x7fd2a0150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 >> 172.21.15.33:0/3372022603 conn(0x7fd2a00703a0 msgr2=0x7fd2a0152f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 shutdown_connections 2023-10-09T15:31:55.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:55.093+0000 7fd2a63f0700 1 -- 172.21.15.33:0/3372022603 wait complete. 2023-10-09T15:31:55.096 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:55.105 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2023-10-09T15:31:53.246830+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2381976,"kb_used_data":3672,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592744,"statfs":{"total":773094113280,"available":770654969856,"internally_reserved":0,"allocated":3760128,"data_stored":2131608,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.829874"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419685+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839982+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426044+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:10.567630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.422834+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418049+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:34.766857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417812+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:03:04.174621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.426008+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425553+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839619+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420342+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425556+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417070+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:22.214958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419878+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425445+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.425427+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420846+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417068+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:33.882581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417329+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:02.097241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417095+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:18.178999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839608+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419678+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.418303+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:16.506625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420869+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420245+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419851+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.839075+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.420484+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.417730+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:34.996041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.424798+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:31:48.414032+0000","last_change":"2023-10-09T15:31:48.414032+0000","last_active":"2023-10-09T15:31:48.414032+0000","last_peered":"2023-10-09T15:31:48.414032+0000","last_clean":"2023-10-09T15:31:48.414032+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:48.414032+0000","last_undegraded":"2023-10-09T15:31:48.414032+0000","last_fullsized":"2023-10-09T15:31:48.414032+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:31:47.409526+0000","last_change":"2023-10-09T15:31:47.419969+0000","last_active":"2023-10-09T15:31:47.409526+0000","last_peered":"2023-10-09T15:31:47.409526+0000","last_clean":"2023-10-09T15:31:47.409526+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:31:47.409526+0000","last_undegraded":"2023-10-09T15:31:47.409526+0000","last_fullsized":"2023-10-09T15:31:47.409526+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":169,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-10-09T15:31:43.295106+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:31:43.295106+0000","last_peered":"2023-10-09T15:31:43.295106+0000","last_clean":"2023-10-09T15:31:43.295106+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:31:43.295106+0000","last_undegraded":"2023-10-09T15:31:43.295106+0000","last_fullsized":"2023-10-09T15:31:43.295106+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298184,"kb_used_data":896,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073656,"statfs":{"total":96636764160,"available":96331423744,"internally_reserved":0,"allocated":917504,"data_stored":710079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61099999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55900000000000005}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57299999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67900000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56100000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40000000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.377}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297592,"kb_used_data":304,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074248,"statfs":{"total":96636764160,"available":96332029952,"internally_reserved":0,"allocated":311296,"data_stored":113906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84799999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90600000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298180,"kb_used_data":892,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073660,"statfs":{"total":96636764160,"available":96331427840,"internally_reserved":0,"allocated":913408,"data_stored":709068,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.78700000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36499999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34699999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574861,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34799999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45800000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.502}]}]},{"osd":4,"up_from":13,"seq":55834574862,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61399999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45600000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.437}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67400000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297604,"kb_used_data":316,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074236,"statfs":{"total":96636764160,"available":96332017664,"internally_reserved":0,"allocated":323584,"data_stored":119711,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.374}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57899999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46999999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:58.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:31:58.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.245+0000 7f54a3fff700 1 Processor -- start 2023-10-09T15:31:58.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.245+0000 7f54a3fff700 1 -- start start 2023-10-09T15:31:58.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.245+0000 7f54a3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f54a4153c30 0x7f54a415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.245+0000 7f54a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54a415de50 0x7f54a40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f54a40cf3c0 con 0x7f54a40cef40 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a3fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a415afd0 con 0x7f54a415de50 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a3fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54a415b2b0 con 0x7f54a4153c30 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54a415de50 0x7f54a40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f54a415de50 0x7f54a40cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51634/0 (socket says 172.21.15.33:51634) 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 -- 172.21.15.33:0/2810515058 learned_addr learned my addr 172.21.15.33:0/2810515058 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a2ffd700 1 --2- 172.21.15.33:0/2810515058 >> v2:172.21.15.59:3300/0 conn(0x7f54a4153c30 0x7f54a415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 -- 172.21.15.33:0/2810515058 >> v2:172.21.15.59:3300/0 conn(0x7f54a4153c30 msgr2=0x7f54a415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 --2- 172.21.15.33:0/2810515058 >> v2:172.21.15.59:3300/0 conn(0x7f54a4153c30 0x7f54a415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 -- 172.21.15.33:0/2810515058 >> v1:172.21.15.59:6789/0 conn(0x7f54a40cef40 legacy=0x7f54a406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 -- 172.21.15.33:0/2810515058 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a415b590 con 0x7f54a415de50 2023-10-09T15:31:58.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f549a7fc700 1 --2- 172.21.15.33:0/2810515058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a40cea00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f54a406ead0 tx=0x7f548c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ecfbb4f94e72aeb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a27fc700 1 -- 172.21.15.33:0/2810515058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c009e70 con 0x7f54a415de50 2023-10-09T15:31:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a27fc700 1 -- 172.21.15.33:0/2810515058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f548c00b860 con 0x7f54a415de50 2023-10-09T15:31:58.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.246+0000 7f54a27fc700 1 -- 172.21.15.33:0/2810515058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f548c00bc00 con 0x7f54a415de50 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 -- 172.21.15.33:0/2810515058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 msgr2=0x7f54a40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 --2- 172.21.15.33:0/2810515058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a40cea00 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f54a406ead0 tx=0x7f548c009250 comp rx=0 tx=0).stop 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 -- 172.21.15.33:0/2810515058 shutdown_connections 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 --2- 172.21.15.33:0/2810515058 >> v2:172.21.15.59:3300/0 conn(0x7f54a4153c30 0x7f54a415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 --2- 172.21.15.33:0/2810515058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a40cea00 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 -- 172.21.15.33:0/2810515058 >> 172.21.15.33:0/2810515058 conn(0x7f54a40703a0 msgr2=0x7f54a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 -- 172.21.15.33:0/2810515058 shutdown_connections 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.247+0000 7f54a3fff700 1 -- 172.21.15.33:0/2810515058 wait complete. 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.248+0000 7f54a3fff700 1 Processor -- start 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.248+0000 7f54a3fff700 1 -- start start 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54a40cef40 0x7f54a4151fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54a4153c30 0x7f54a414fbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a416af30 con 0x7f54a415de50 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c75e0 con 0x7f54a40cef40 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54a40c78c0 con 0x7f54a4153c30 2023-10-09T15:31:58.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51640/0 (socket says 172.21.15.33:51640) 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a37fe700 1 -- 172.21.15.33:0/3861600927 learned_addr learned my addr 172.21.15.33:0/3861600927 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.249+0000 7f54a2ffd700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54a40cef40 0x7f54a4151fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f549a7fc700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54a4153c30 0x7f54a414fbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 -- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54a4153c30 msgr2=0x7f54a414fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54a4153c30 0x7f54a414fbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 -- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54a40cef40 msgr2=0x7f54a4151fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54a40cef40 0x7f54a4151fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 -- 172.21.15.33:0/3861600927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0094f0 con 0x7f54a415de50 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a37fe700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c840 tx=0x7f549c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c012630 con 0x7f54a415de50 2023-10-09T15:31:58.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f549c0127b0 con 0x7f54a415de50 2023-10-09T15:31:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54a40c7ba0 con 0x7f54a415de50 2023-10-09T15:31:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f549c012b70 con 0x7f54a415de50 2023-10-09T15:31:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.250+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a416b260 con 0x7f54a415de50 2023-10-09T15:31:58.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.251+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54a40c80c0 con 0x7f54a415de50 2023-10-09T15:31:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.252+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f549c003030 con 0x7f54a415de50 2023-10-09T15:31:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.252+0000 7f549b7fe700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 0x7f54840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.252+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f549c0844f0 con 0x7f54a415de50 2023-10-09T15:31:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.252+0000 7f54a2ffd700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 0x7f54840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.252+0000 7f54a2ffd700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 0x7f54840693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5494006f00 tx=0x7f5494008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.256+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f54a40c80c0 con 0x7f54a415de50 2023-10-09T15:31:58.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.447+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f54a40c7750 con 0x7f5484066f30 2023-10-09T15:31:58.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.455+0000 7f549b7fe700 1 -- 172.21.15.33:0/3861600927 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270684 (secure 0 0 0) 0x7f54a40c7750 con 0x7f5484066f30 2023-10-09T15:31:58.458 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 msgr2=0x7f54840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 0x7f54840693e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f5494006f00 tx=0x7f5494008040 comp rx=0 tx=0).stop 2023-10-09T15:31:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 msgr2=0x7f54a4150110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f549c00c840 tx=0x7f549c001670 comp rx=0 tx=0).stop 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 shutdown_connections 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5484066f30 0x7f54840693e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f54a415de50 0x7f54a4150110 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f54a40cef40 0x7f54a4151fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 --2- 172.21.15.33:0/3861600927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f54a4153c30 0x7f54a414fbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 >> 172.21.15.33:0/3861600927 conn(0x7f54a40703a0 msgr2=0x7f54a40c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 shutdown_connections 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.459+0000 7f54a3fff700 1 -- 172.21.15.33:0/3861600927 wait complete. 2023-10-09T15:31:58.461 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:31:58.471 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":57,"stamp":"2023-10-09T15:31:57.247925+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":189,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2382340,"kb_used_data":4036,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752592380,"statfs":{"total":773094113280,"available":770654597120,"internally_reserved":0,"allocated":4132864,"data_stored":2296473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":36,"apply_latency_ms":36,"commit_latency_ns":36000000,"apply_latency_ns":36000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002135"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454164+0000","last_change":"2023-10-09T15:31:49.441374+0000","last_active":"2023-10-09T15:31:49.454164+0000","last_peered":"2023-10-09T15:31:49.454164+0000","last_clean":"2023-10-09T15:31:49.454164+0000","last_became_active":"2023-10-09T15:31:49.441097+0000","last_became_peered":"2023-10-09T15:31:49.441097+0000","last_unstale":"2023-10-09T15:31:49.454164+0000","last_undegraded":"2023-10-09T15:31:49.454164+0000","last_fullsized":"2023-10-09T15:31:49.454164+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:00.978037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.448726+0000","last_change":"2023-10-09T15:31:49.443308+0000","last_active":"2023-10-09T15:31:49.448726+0000","last_peered":"2023-10-09T15:31:49.448726+0000","last_clean":"2023-10-09T15:31:49.448726+0000","last_became_active":"2023-10-09T15:31:49.443053+0000","last_became_peered":"2023-10-09T15:31:49.443053+0000","last_unstale":"2023-10-09T15:31:49.448726+0000","last_undegraded":"2023-10-09T15:31:49.448726+0000","last_fullsized":"2023-10-09T15:31:49.448726+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:47.782984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454964+0000","last_change":"2023-10-09T15:31:49.446511+0000","last_active":"2023-10-09T15:31:49.454964+0000","last_peered":"2023-10-09T15:31:49.454964+0000","last_clean":"2023-10-09T15:31:49.454964+0000","last_became_active":"2023-10-09T15:31:49.446198+0000","last_became_peered":"2023-10-09T15:31:49.446198+0000","last_unstale":"2023-10-09T15:31:49.454964+0000","last_undegraded":"2023-10-09T15:31:49.454964+0000","last_fullsized":"2023-10-09T15:31:49.454964+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:51.765401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459731+0000","last_change":"2023-10-09T15:31:49.452699+0000","last_active":"2023-10-09T15:31:49.459731+0000","last_peered":"2023-10-09T15:31:49.459731+0000","last_clean":"2023-10-09T15:31:49.459731+0000","last_became_active":"2023-10-09T15:31:49.451764+0000","last_became_peered":"2023-10-09T15:31:49.451764+0000","last_unstale":"2023-10-09T15:31:49.459731+0000","last_undegraded":"2023-10-09T15:31:49.459731+0000","last_fullsized":"2023-10-09T15:31:49.459731+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:35.783470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453121+0000","last_change":"2023-10-09T15:31:49.441067+0000","last_active":"2023-10-09T15:31:49.453121+0000","last_peered":"2023-10-09T15:31:49.453121+0000","last_clean":"2023-10-09T15:31:49.453121+0000","last_became_active":"2023-10-09T15:31:49.440824+0000","last_became_peered":"2023-10-09T15:31:49.440824+0000","last_unstale":"2023-10-09T15:31:49.453121+0000","last_undegraded":"2023-10-09T15:31:49.453121+0000","last_fullsized":"2023-10-09T15:31:49.453121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:26.173889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453197+0000","last_change":"2023-10-09T15:31:49.442584+0000","last_active":"2023-10-09T15:31:49.453197+0000","last_peered":"2023-10-09T15:31:49.453197+0000","last_clean":"2023-10-09T15:31:49.453197+0000","last_became_active":"2023-10-09T15:31:49.442306+0000","last_became_peered":"2023-10-09T15:31:49.442306+0000","last_unstale":"2023-10-09T15:31:49.453197+0000","last_undegraded":"2023-10-09T15:31:49.453197+0000","last_fullsized":"2023-10-09T15:31:49.453197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:51.765401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.463336+0000","last_change":"2023-10-09T15:31:49.459648+0000","last_active":"2023-10-09T15:31:49.463336+0000","last_peered":"2023-10-09T15:31:49.463336+0000","last_clean":"2023-10-09T15:31:49.463336+0000","last_became_active":"2023-10-09T15:31:49.459341+0000","last_became_peered":"2023-10-09T15:31:49.459341+0000","last_unstale":"2023-10-09T15:31:49.463336+0000","last_undegraded":"2023-10-09T15:31:49.463336+0000","last_fullsized":"2023-10-09T15:31:49.463336+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:48.477912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.458704+0000","last_change":"2023-10-09T15:31:49.454325+0000","last_active":"2023-10-09T15:31:49.458704+0000","last_peered":"2023-10-09T15:31:49.458704+0000","last_clean":"2023-10-09T15:31:49.458704+0000","last_became_active":"2023-10-09T15:31:49.454060+0000","last_became_peered":"2023-10-09T15:31:49.454060+0000","last_unstale":"2023-10-09T15:31:49.458704+0000","last_undegraded":"2023-10-09T15:31:49.458704+0000","last_fullsized":"2023-10-09T15:31:49.458704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:41.715972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455873+0000","last_change":"2023-10-09T15:31:49.445433+0000","last_active":"2023-10-09T15:31:49.455873+0000","last_peered":"2023-10-09T15:31:49.455873+0000","last_clean":"2023-10-09T15:31:49.455873+0000","last_became_active":"2023-10-09T15:31:49.444672+0000","last_became_peered":"2023-10-09T15:31:49.444672+0000","last_unstale":"2023-10-09T15:31:49.455873+0000","last_undegraded":"2023-10-09T15:31:49.455873+0000","last_fullsized":"2023-10-09T15:31:49.455873+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:40.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459090+0000","last_change":"2023-10-09T15:31:49.452093+0000","last_active":"2023-10-09T15:31:49.459090+0000","last_peered":"2023-10-09T15:31:49.459090+0000","last_clean":"2023-10-09T15:31:49.459090+0000","last_became_active":"2023-10-09T15:31:49.451814+0000","last_became_peered":"2023-10-09T15:31:49.451814+0000","last_unstale":"2023-10-09T15:31:49.459090+0000","last_undegraded":"2023-10-09T15:31:49.459090+0000","last_fullsized":"2023-10-09T15:31:49.459090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:18.735721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455667+0000","last_change":"2023-10-09T15:31:49.453100+0000","last_active":"2023-10-09T15:31:49.455667+0000","last_peered":"2023-10-09T15:31:49.455667+0000","last_clean":"2023-10-09T15:31:49.455667+0000","last_became_active":"2023-10-09T15:31:49.452820+0000","last_became_peered":"2023-10-09T15:31:49.452820+0000","last_unstale":"2023-10-09T15:31:49.455667+0000","last_undegraded":"2023-10-09T15:31:49.455667+0000","last_fullsized":"2023-10-09T15:31:49.455667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:53.910274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.446579+0000","last_change":"2023-10-09T15:31:49.442045+0000","last_active":"2023-10-09T15:31:49.446579+0000","last_peered":"2023-10-09T15:31:49.446579+0000","last_clean":"2023-10-09T15:31:49.446579+0000","last_became_active":"2023-10-09T15:31:49.441774+0000","last_became_peered":"2023-10-09T15:31:49.441774+0000","last_unstale":"2023-10-09T15:31:49.446579+0000","last_undegraded":"2023-10-09T15:31:49.446579+0000","last_fullsized":"2023-10-09T15:31:49.446579+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:19.012855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453156+0000","last_change":"2023-10-09T15:31:49.444828+0000","last_active":"2023-10-09T15:31:49.453156+0000","last_peered":"2023-10-09T15:31:49.453156+0000","last_clean":"2023-10-09T15:31:49.453156+0000","last_became_active":"2023-10-09T15:31:49.444558+0000","last_became_peered":"2023-10-09T15:31:49.444558+0000","last_unstale":"2023-10-09T15:31:49.453156+0000","last_undegraded":"2023-10-09T15:31:49.453156+0000","last_fullsized":"2023-10-09T15:31:49.453156+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:59.194672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.447585+0000","last_change":"2023-10-09T15:31:49.438888+0000","last_active":"2023-10-09T15:31:49.447585+0000","last_peered":"2023-10-09T15:31:49.447585+0000","last_clean":"2023-10-09T15:31:49.447585+0000","last_became_active":"2023-10-09T15:31:49.438601+0000","last_became_peered":"2023-10-09T15:31:49.438601+0000","last_unstale":"2023-10-09T15:31:49.447585+0000","last_undegraded":"2023-10-09T15:31:49.447585+0000","last_fullsized":"2023-10-09T15:31:49.447585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:12.811409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459790+0000","last_change":"2023-10-09T15:31:49.455690+0000","last_active":"2023-10-09T15:31:49.459790+0000","last_peered":"2023-10-09T15:31:49.459790+0000","last_clean":"2023-10-09T15:31:49.459790+0000","last_became_active":"2023-10-09T15:31:49.455401+0000","last_became_peered":"2023-10-09T15:31:49.455401+0000","last_unstale":"2023-10-09T15:31:49.459790+0000","last_undegraded":"2023-10-09T15:31:49.459790+0000","last_fullsized":"2023-10-09T15:31:49.459790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:30.425127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455476+0000","last_change":"2023-10-09T15:31:49.452942+0000","last_active":"2023-10-09T15:31:49.455476+0000","last_peered":"2023-10-09T15:31:49.455476+0000","last_clean":"2023-10-09T15:31:49.455476+0000","last_became_active":"2023-10-09T15:31:49.452638+0000","last_became_peered":"2023-10-09T15:31:49.452638+0000","last_unstale":"2023-10-09T15:31:49.455476+0000","last_undegraded":"2023-10-09T15:31:49.455476+0000","last_fullsized":"2023-10-09T15:31:49.455476+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:50:10.735378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.461317+0000","last_change":"2023-10-09T15:31:49.459525+0000","last_active":"2023-10-09T15:31:49.461317+0000","last_peered":"2023-10-09T15:31:49.461317+0000","last_clean":"2023-10-09T15:31:49.461317+0000","last_became_active":"2023-10-09T15:31:49.459204+0000","last_became_peered":"2023-10-09T15:31:49.459204+0000","last_unstale":"2023-10-09T15:31:49.461317+0000","last_undegraded":"2023-10-09T15:31:49.461317+0000","last_fullsized":"2023-10-09T15:31:49.461317+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:31.331480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.451590+0000","last_change":"2023-10-09T15:31:49.446027+0000","last_active":"2023-10-09T15:31:49.451590+0000","last_peered":"2023-10-09T15:31:49.451590+0000","last_clean":"2023-10-09T15:31:49.451590+0000","last_became_active":"2023-10-09T15:31:49.445764+0000","last_became_peered":"2023-10-09T15:31:49.445764+0000","last_unstale":"2023-10-09T15:31:49.451590+0000","last_undegraded":"2023-10-09T15:31:49.451590+0000","last_fullsized":"2023-10-09T15:31:49.451590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:29.793496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453863+0000","last_change":"2023-10-09T15:31:49.445488+0000","last_active":"2023-10-09T15:31:49.453863+0000","last_peered":"2023-10-09T15:31:49.453863+0000","last_clean":"2023-10-09T15:31:49.453863+0000","last_became_active":"2023-10-09T15:31:49.445212+0000","last_became_peered":"2023-10-09T15:31:49.445212+0000","last_unstale":"2023-10-09T15:31:49.453863+0000","last_undegraded":"2023-10-09T15:31:49.453863+0000","last_fullsized":"2023-10-09T15:31:49.453863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:49.340665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453345+0000","last_change":"2023-10-09T15:31:49.441771+0000","last_active":"2023-10-09T15:31:49.453345+0000","last_peered":"2023-10-09T15:31:49.453345+0000","last_clean":"2023-10-09T15:31:49.453345+0000","last_became_active":"2023-10-09T15:31:49.441469+0000","last_became_peered":"2023-10-09T15:31:49.441469+0000","last_unstale":"2023-10-09T15:31:49.453345+0000","last_undegraded":"2023-10-09T15:31:49.453345+0000","last_fullsized":"2023-10-09T15:31:49.453345+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:42.607566+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.445297+0000","last_change":"2023-10-09T15:31:49.438340+0000","last_active":"2023-10-09T15:31:49.445297+0000","last_peered":"2023-10-09T15:31:49.445297+0000","last_clean":"2023-10-09T15:31:49.445297+0000","last_became_active":"2023-10-09T15:31:49.438049+0000","last_became_peered":"2023-10-09T15:31:49.438049+0000","last_unstale":"2023-10-09T15:31:49.445297+0000","last_undegraded":"2023-10-09T15:31:49.445297+0000","last_fullsized":"2023-10-09T15:31:49.445297+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.744965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.445659+0000","last_change":"2023-10-09T15:31:49.439345+0000","last_active":"2023-10-09T15:31:49.445659+0000","last_peered":"2023-10-09T15:31:49.445659+0000","last_clean":"2023-10-09T15:31:49.445659+0000","last_became_active":"2023-10-09T15:31:49.439079+0000","last_became_peered":"2023-10-09T15:31:49.439079+0000","last_unstale":"2023-10-09T15:31:49.445659+0000","last_undegraded":"2023-10-09T15:31:49.445659+0000","last_fullsized":"2023-10-09T15:31:49.445659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:31.331480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455498+0000","last_change":"2023-10-09T15:31:49.448506+0000","last_active":"2023-10-09T15:31:49.455498+0000","last_peered":"2023-10-09T15:31:49.455498+0000","last_clean":"2023-10-09T15:31:49.455498+0000","last_became_active":"2023-10-09T15:31:49.448213+0000","last_became_peered":"2023-10-09T15:31:49.448213+0000","last_unstale":"2023-10-09T15:31:49.455498+0000","last_undegraded":"2023-10-09T15:31:49.455498+0000","last_fullsized":"2023-10-09T15:31:49.455498+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.744965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.447443+0000","last_change":"2023-10-09T15:31:49.443800+0000","last_active":"2023-10-09T15:31:49.447443+0000","last_peered":"2023-10-09T15:31:49.447443+0000","last_clean":"2023-10-09T15:31:49.447443+0000","last_became_active":"2023-10-09T15:31:49.443531+0000","last_became_peered":"2023-10-09T15:31:49.443531+0000","last_unstale":"2023-10-09T15:31:49.447443+0000","last_undegraded":"2023-10-09T15:31:49.447443+0000","last_fullsized":"2023-10-09T15:31:49.447443+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:08.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460311+0000","last_change":"2023-10-09T15:31:49.456154+0000","last_active":"2023-10-09T15:31:49.460311+0000","last_peered":"2023-10-09T15:31:49.460311+0000","last_clean":"2023-10-09T15:31:49.460311+0000","last_became_active":"2023-10-09T15:31:49.455899+0000","last_became_peered":"2023-10-09T15:31:49.455899+0000","last_unstale":"2023-10-09T15:31:49.460311+0000","last_undegraded":"2023-10-09T15:31:49.460311+0000","last_fullsized":"2023-10-09T15:31:49.460311+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:53.910274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455392+0000","last_change":"2023-10-09T15:31:49.447852+0000","last_active":"2023-10-09T15:31:49.455392+0000","last_peered":"2023-10-09T15:31:49.455392+0000","last_clean":"2023-10-09T15:31:49.455392+0000","last_became_active":"2023-10-09T15:31:49.447558+0000","last_became_peered":"2023-10-09T15:31:49.447558+0000","last_unstale":"2023-10-09T15:31:49.455392+0000","last_undegraded":"2023-10-09T15:31:49.455392+0000","last_fullsized":"2023-10-09T15:31:49.455392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.571266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460237+0000","last_change":"2023-10-09T15:31:49.454305+0000","last_active":"2023-10-09T15:31:49.460237+0000","last_peered":"2023-10-09T15:31:49.460237+0000","last_clean":"2023-10-09T15:31:49.460237+0000","last_became_active":"2023-10-09T15:31:49.454081+0000","last_became_peered":"2023-10-09T15:31:49.454081+0000","last_unstale":"2023-10-09T15:31:49.460237+0000","last_undegraded":"2023-10-09T15:31:49.460237+0000","last_fullsized":"2023-10-09T15:31:49.460237+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:31.331480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.447570+0000","last_change":"2023-10-09T15:31:49.445574+0000","last_active":"2023-10-09T15:31:49.447570+0000","last_peered":"2023-10-09T15:31:49.447570+0000","last_clean":"2023-10-09T15:31:49.447570+0000","last_became_active":"2023-10-09T15:31:49.445023+0000","last_became_peered":"2023-10-09T15:31:49.445023+0000","last_unstale":"2023-10-09T15:31:49.447570+0000","last_undegraded":"2023-10-09T15:31:49.447570+0000","last_fullsized":"2023-10-09T15:31:49.447570+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:41.715972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459892+0000","last_change":"2023-10-09T15:31:49.445176+0000","last_active":"2023-10-09T15:31:49.459892+0000","last_peered":"2023-10-09T15:31:49.459892+0000","last_clean":"2023-10-09T15:31:49.459892+0000","last_became_active":"2023-10-09T15:31:49.444871+0000","last_became_peered":"2023-10-09T15:31:49.444871+0000","last_unstale":"2023-10-09T15:31:49.459892+0000","last_undegraded":"2023-10-09T15:31:49.459892+0000","last_fullsized":"2023-10-09T15:31:49.459892+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:48.477912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459743+0000","last_change":"2023-10-09T15:31:49.455800+0000","last_active":"2023-10-09T15:31:49.459743+0000","last_peered":"2023-10-09T15:31:49.459743+0000","last_clean":"2023-10-09T15:31:49.459743+0000","last_became_active":"2023-10-09T15:31:49.455432+0000","last_became_peered":"2023-10-09T15:31:49.455432+0000","last_unstale":"2023-10-09T15:31:49.459743+0000","last_undegraded":"2023-10-09T15:31:49.459743+0000","last_fullsized":"2023-10-09T15:31:49.459743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:35.783470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454385+0000","last_change":"2023-10-09T15:31:49.437953+0000","last_active":"2023-10-09T15:31:49.454385+0000","last_peered":"2023-10-09T15:31:49.454385+0000","last_clean":"2023-10-09T15:31:49.454385+0000","last_became_active":"2023-10-09T15:31:49.437666+0000","last_became_peered":"2023-10-09T15:31:49.437666+0000","last_unstale":"2023-10-09T15:31:49.454385+0000","last_undegraded":"2023-10-09T15:31:49.454385+0000","last_fullsized":"2023-10-09T15:31:49.454385+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:48.477912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455592+0000","last_change":"2023-10-09T15:31:49.453773+0000","last_active":"2023-10-09T15:31:49.455592+0000","last_peered":"2023-10-09T15:31:49.455592+0000","last_clean":"2023-10-09T15:31:49.455592+0000","last_became_active":"2023-10-09T15:31:49.453469+0000","last_became_peered":"2023-10-09T15:31:49.453469+0000","last_unstale":"2023-10-09T15:31:49.455592+0000","last_undegraded":"2023-10-09T15:31:49.455592+0000","last_fullsized":"2023-10-09T15:31:49.455592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:18:56.888720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454772+0000","last_change":"2023-10-09T15:31:49.447386+0000","last_active":"2023-10-09T15:31:49.454772+0000","last_peered":"2023-10-09T15:31:49.454772+0000","last_clean":"2023-10-09T15:31:49.454772+0000","last_became_active":"2023-10-09T15:31:49.447126+0000","last_became_peered":"2023-10-09T15:31:49.447126+0000","last_unstale":"2023-10-09T15:31:49.454772+0000","last_undegraded":"2023-10-09T15:31:49.454772+0000","last_fullsized":"2023-10-09T15:31:49.454772+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:00.978037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"31'4","reported_seq":14,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.461023+0000","last_change":"2023-10-09T15:31:48.434769+0000","last_active":"2023-10-09T15:31:49.461023+0000","last_peered":"2023-10-09T15:31:49.461023+0000","last_clean":"2023-10-09T15:31:49.461023+0000","last_became_active":"2023-10-09T15:31:48.434249+0000","last_became_peered":"2023-10-09T15:31:48.434249+0000","last_unstale":"2023-10-09T15:31:49.461023+0000","last_undegraded":"2023-10-09T15:31:49.461023+0000","last_fullsized":"2023-10-09T15:31:49.461023+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.458875+0000","last_change":"2023-10-09T15:31:49.446359+0000","last_active":"2023-10-09T15:31:49.458875+0000","last_peered":"2023-10-09T15:31:49.458875+0000","last_clean":"2023-10-09T15:31:49.458875+0000","last_became_active":"2023-10-09T15:31:49.446105+0000","last_became_peered":"2023-10-09T15:31:49.446105+0000","last_unstale":"2023-10-09T15:31:49.458875+0000","last_undegraded":"2023-10-09T15:31:49.458875+0000","last_fullsized":"2023-10-09T15:31:49.458875+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:48.447077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455816+0000","last_change":"2023-10-09T15:31:48.434886+0000","last_active":"2023-10-09T15:31:49.455816+0000","last_peered":"2023-10-09T15:31:49.455816+0000","last_clean":"2023-10-09T15:31:49.455816+0000","last_became_active":"2023-10-09T15:31:48.434612+0000","last_became_peered":"2023-10-09T15:31:48.434612+0000","last_unstale":"2023-10-09T15:31:49.455816+0000","last_undegraded":"2023-10-09T15:31:49.455816+0000","last_fullsized":"2023-10-09T15:31:49.455816+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.445562+0000","last_change":"2023-10-09T15:31:49.442801+0000","last_active":"2023-10-09T15:31:49.445562+0000","last_peered":"2023-10-09T15:31:49.445562+0000","last_clean":"2023-10-09T15:31:49.445562+0000","last_became_active":"2023-10-09T15:31:49.442544+0000","last_became_peered":"2023-10-09T15:31:49.442544+0000","last_unstale":"2023-10-09T15:31:49.445562+0000","last_undegraded":"2023-10-09T15:31:49.445562+0000","last_fullsized":"2023-10-09T15:31:49.445562+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:03:35.783470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.461747+0000","last_change":"2023-10-09T15:31:48.442490+0000","last_active":"2023-10-09T15:31:49.461747+0000","last_peered":"2023-10-09T15:31:49.461747+0000","last_clean":"2023-10-09T15:31:49.461747+0000","last_became_active":"2023-10-09T15:31:48.442211+0000","last_became_peered":"2023-10-09T15:31:48.442211+0000","last_unstale":"2023-10-09T15:31:49.461747+0000","last_undegraded":"2023-10-09T15:31:49.461747+0000","last_fullsized":"2023-10-09T15:31:49.461747+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:36:59.973532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460173+0000","last_change":"2023-10-09T15:31:49.453538+0000","last_active":"2023-10-09T15:31:49.460173+0000","last_peered":"2023-10-09T15:31:49.460173+0000","last_clean":"2023-10-09T15:31:49.460173+0000","last_became_active":"2023-10-09T15:31:49.452601+0000","last_became_peered":"2023-10-09T15:31:49.452601+0000","last_unstale":"2023-10-09T15:31:49.460173+0000","last_undegraded":"2023-10-09T15:31:49.460173+0000","last_fullsized":"2023-10-09T15:31:49.460173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:40.123625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460764+0000","last_change":"2023-10-09T15:31:48.446487+0000","last_active":"2023-10-09T15:31:49.460764+0000","last_peered":"2023-10-09T15:31:49.460764+0000","last_clean":"2023-10-09T15:31:49.460764+0000","last_became_active":"2023-10-09T15:31:48.446167+0000","last_became_peered":"2023-10-09T15:31:48.446167+0000","last_unstale":"2023-10-09T15:31:49.460764+0000","last_undegraded":"2023-10-09T15:31:49.460764+0000","last_fullsized":"2023-10-09T15:31:49.460764+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:20:56.201672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455489+0000","last_change":"2023-10-09T15:31:49.453224+0000","last_active":"2023-10-09T15:31:49.455489+0000","last_peered":"2023-10-09T15:31:49.455489+0000","last_clean":"2023-10-09T15:31:49.455489+0000","last_became_active":"2023-10-09T15:31:49.452903+0000","last_became_peered":"2023-10-09T15:31:49.452903+0000","last_unstale":"2023-10-09T15:31:49.455489+0000","last_undegraded":"2023-10-09T15:31:49.455489+0000","last_fullsized":"2023-10-09T15:31:49.455489+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:34.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.462177+0000","last_change":"2023-10-09T15:31:48.441979+0000","last_active":"2023-10-09T15:31:49.462177+0000","last_peered":"2023-10-09T15:31:49.462177+0000","last_clean":"2023-10-09T15:31:49.462177+0000","last_became_active":"2023-10-09T15:31:48.441618+0000","last_became_peered":"2023-10-09T15:31:48.441618+0000","last_unstale":"2023-10-09T15:31:49.462177+0000","last_undegraded":"2023-10-09T15:31:49.462177+0000","last_fullsized":"2023-10-09T15:31:49.462177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.446526+0000","last_change":"2023-10-09T15:31:49.441655+0000","last_active":"2023-10-09T15:31:49.446526+0000","last_peered":"2023-10-09T15:31:49.446526+0000","last_clean":"2023-10-09T15:31:49.446526+0000","last_became_active":"2023-10-09T15:31:49.441332+0000","last_became_peered":"2023-10-09T15:31:49.441332+0000","last_unstale":"2023-10-09T15:31:49.446526+0000","last_undegraded":"2023-10-09T15:31:49.446526+0000","last_fullsized":"2023-10-09T15:31:49.446526+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:15:06.552963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.462079+0000","last_change":"2023-10-09T15:31:48.443241+0000","last_active":"2023-10-09T15:31:49.462079+0000","last_peered":"2023-10-09T15:31:49.462079+0000","last_clean":"2023-10-09T15:31:49.462079+0000","last_became_active":"2023-10-09T15:31:48.442927+0000","last_became_peered":"2023-10-09T15:31:48.442927+0000","last_unstale":"2023-10-09T15:31:49.462079+0000","last_undegraded":"2023-10-09T15:31:49.462079+0000","last_fullsized":"2023-10-09T15:31:49.462079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:08.749800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.456010+0000","last_change":"2023-10-09T15:31:49.445892+0000","last_active":"2023-10-09T15:31:49.456010+0000","last_peered":"2023-10-09T15:31:49.456010+0000","last_clean":"2023-10-09T15:31:49.456010+0000","last_became_active":"2023-10-09T15:31:49.444423+0000","last_became_peered":"2023-10-09T15:31:49.444423+0000","last_unstale":"2023-10-09T15:31:49.456010+0000","last_undegraded":"2023-10-09T15:31:49.456010+0000","last_fullsized":"2023-10-09T15:31:49.456010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:32.744149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.433833+0000","last_change":"2023-10-09T15:31:48.443102+0000","last_active":"2023-10-09T15:31:49.433833+0000","last_peered":"2023-10-09T15:31:49.433833+0000","last_clean":"2023-10-09T15:31:49.433833+0000","last_became_active":"2023-10-09T15:31:48.442827+0000","last_became_peered":"2023-10-09T15:31:48.442827+0000","last_unstale":"2023-10-09T15:31:49.433833+0000","last_undegraded":"2023-10-09T15:31:49.433833+0000","last_fullsized":"2023-10-09T15:31:49.433833+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:42.740459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459888+0000","last_change":"2023-10-09T15:31:49.452611+0000","last_active":"2023-10-09T15:31:49.459888+0000","last_peered":"2023-10-09T15:31:49.459888+0000","last_clean":"2023-10-09T15:31:49.459888+0000","last_became_active":"2023-10-09T15:31:49.452323+0000","last_became_peered":"2023-10-09T15:31:49.452323+0000","last_unstale":"2023-10-09T15:31:49.459888+0000","last_undegraded":"2023-10-09T15:31:49.459888+0000","last_fullsized":"2023-10-09T15:31:49.459888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:49.638643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.432851+0000","last_change":"2023-10-09T15:31:48.430957+0000","last_active":"2023-10-09T15:31:49.432851+0000","last_peered":"2023-10-09T15:31:49.432851+0000","last_clean":"2023-10-09T15:31:49.432851+0000","last_became_active":"2023-10-09T15:31:48.430490+0000","last_became_peered":"2023-10-09T15:31:48.430490+0000","last_unstale":"2023-10-09T15:31:49.432851+0000","last_undegraded":"2023-10-09T15:31:49.432851+0000","last_fullsized":"2023-10-09T15:31:49.432851+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:01.256184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.448619+0000","last_change":"2023-10-09T15:31:49.442681+0000","last_active":"2023-10-09T15:31:49.448619+0000","last_peered":"2023-10-09T15:31:49.448619+0000","last_clean":"2023-10-09T15:31:49.448619+0000","last_became_active":"2023-10-09T15:31:49.442477+0000","last_became_peered":"2023-10-09T15:31:49.442477+0000","last_unstale":"2023-10-09T15:31:49.448619+0000","last_undegraded":"2023-10-09T15:31:49.448619+0000","last_fullsized":"2023-10-09T15:31:49.448619+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:12.811409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.433733+0000","last_change":"2023-10-09T15:31:48.442922+0000","last_active":"2023-10-09T15:31:49.433733+0000","last_peered":"2023-10-09T15:31:49.433733+0000","last_clean":"2023-10-09T15:31:49.433733+0000","last_became_active":"2023-10-09T15:31:48.442601+0000","last_became_peered":"2023-10-09T15:31:48.442601+0000","last_unstale":"2023-10-09T15:31:49.433733+0000","last_undegraded":"2023-10-09T15:31:49.433733+0000","last_fullsized":"2023-10-09T15:31:49.433733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:47.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.451932+0000","last_change":"2023-10-09T15:31:49.445245+0000","last_active":"2023-10-09T15:31:49.451932+0000","last_peered":"2023-10-09T15:31:49.451932+0000","last_clean":"2023-10-09T15:31:49.451932+0000","last_became_active":"2023-10-09T15:31:49.445004+0000","last_became_peered":"2023-10-09T15:31:49.445004+0000","last_unstale":"2023-10-09T15:31:49.451932+0000","last_undegraded":"2023-10-09T15:31:49.451932+0000","last_fullsized":"2023-10-09T15:31:49.451932+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:08.812547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.431203+0000","last_change":"2023-10-09T15:31:48.445897+0000","last_active":"2023-10-09T15:31:49.431203+0000","last_peered":"2023-10-09T15:31:49.431203+0000","last_clean":"2023-10-09T15:31:49.431203+0000","last_became_active":"2023-10-09T15:31:48.445553+0000","last_became_peered":"2023-10-09T15:31:48.445553+0000","last_unstale":"2023-10-09T15:31:49.431203+0000","last_undegraded":"2023-10-09T15:31:49.431203+0000","last_fullsized":"2023-10-09T15:31:49.431203+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.456143+0000","last_change":"2023-10-09T15:31:49.447297+0000","last_active":"2023-10-09T15:31:49.456143+0000","last_peered":"2023-10-09T15:31:49.456143+0000","last_clean":"2023-10-09T15:31:49.456143+0000","last_became_active":"2023-10-09T15:31:49.446991+0000","last_became_peered":"2023-10-09T15:31:49.446991+0000","last_unstale":"2023-10-09T15:31:49.456143+0000","last_undegraded":"2023-10-09T15:31:49.456143+0000","last_fullsized":"2023-10-09T15:31:49.456143+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:41.715972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"31'3","reported_seq":13,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459846+0000","last_change":"2023-10-09T15:31:48.433763+0000","last_active":"2023-10-09T15:31:49.459846+0000","last_peered":"2023-10-09T15:31:49.459846+0000","last_clean":"2023-10-09T15:31:49.459846+0000","last_became_active":"2023-10-09T15:31:48.433512+0000","last_became_peered":"2023-10-09T15:31:48.433512+0000","last_unstale":"2023-10-09T15:31:49.459846+0000","last_undegraded":"2023-10-09T15:31:49.459846+0000","last_fullsized":"2023-10-09T15:31:49.459846+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:54.563294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454946+0000","last_change":"2023-10-09T15:31:49.446203+0000","last_active":"2023-10-09T15:31:49.454946+0000","last_peered":"2023-10-09T15:31:49.454946+0000","last_clean":"2023-10-09T15:31:49.454946+0000","last_became_active":"2023-10-09T15:31:49.445825+0000","last_became_peered":"2023-10-09T15:31:49.445825+0000","last_unstale":"2023-10-09T15:31:49.454946+0000","last_undegraded":"2023-10-09T15:31:49.454946+0000","last_fullsized":"2023-10-09T15:31:49.454946+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:24.819321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"31'6","reported_seq":16,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.463589+0000","last_change":"2023-10-09T15:31:48.441655+0000","last_active":"2023-10-09T15:31:49.463589+0000","last_peered":"2023-10-09T15:31:49.463589+0000","last_clean":"2023-10-09T15:31:49.463589+0000","last_became_active":"2023-10-09T15:31:48.441339+0000","last_became_peered":"2023-10-09T15:31:48.441339+0000","last_unstale":"2023-10-09T15:31:49.463589+0000","last_undegraded":"2023-10-09T15:31:49.463589+0000","last_fullsized":"2023-10-09T15:31:49.463589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:31.739644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460203+0000","last_change":"2023-10-09T15:31:49.453951+0000","last_active":"2023-10-09T15:31:49.460203+0000","last_peered":"2023-10-09T15:31:49.460203+0000","last_clean":"2023-10-09T15:31:49.460203+0000","last_became_active":"2023-10-09T15:31:49.452271+0000","last_became_peered":"2023-10-09T15:31:49.452271+0000","last_unstale":"2023-10-09T15:31:49.460203+0000","last_undegraded":"2023-10-09T15:31:49.460203+0000","last_fullsized":"2023-10-09T15:31:49.460203+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:18:56.888720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.463594+0000","last_change":"2023-10-09T15:31:48.430766+0000","last_active":"2023-10-09T15:31:49.463594+0000","last_peered":"2023-10-09T15:31:49.463594+0000","last_clean":"2023-10-09T15:31:49.463594+0000","last_became_active":"2023-10-09T15:31:48.430439+0000","last_became_peered":"2023-10-09T15:31:48.430439+0000","last_unstale":"2023-10-09T15:31:49.463594+0000","last_undegraded":"2023-10-09T15:31:49.463594+0000","last_fullsized":"2023-10-09T15:31:49.463594+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:10.389757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.447508+0000","last_change":"2023-10-09T15:31:49.440935+0000","last_active":"2023-10-09T15:31:49.447508+0000","last_peered":"2023-10-09T15:31:49.447508+0000","last_clean":"2023-10-09T15:31:49.447508+0000","last_became_active":"2023-10-09T15:31:49.440675+0000","last_became_peered":"2023-10-09T15:31:49.440675+0000","last_unstale":"2023-10-09T15:31:49.447508+0000","last_undegraded":"2023-10-09T15:31:49.447508+0000","last_fullsized":"2023-10-09T15:31:49.447508+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:53.910274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.440196+0000","last_change":"2023-10-09T15:31:48.438504+0000","last_active":"2023-10-09T15:31:49.440196+0000","last_peered":"2023-10-09T15:31:49.440196+0000","last_clean":"2023-10-09T15:31:49.440196+0000","last_became_active":"2023-10-09T15:31:48.438190+0000","last_became_peered":"2023-10-09T15:31:48.438190+0000","last_unstale":"2023-10-09T15:31:49.440196+0000","last_undegraded":"2023-10-09T15:31:49.440196+0000","last_fullsized":"2023-10-09T15:31:49.440196+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455573+0000","last_change":"2023-10-09T15:31:49.453523+0000","last_active":"2023-10-09T15:31:49.455573+0000","last_peered":"2023-10-09T15:31:49.455573+0000","last_clean":"2023-10-09T15:31:49.455573+0000","last_became_active":"2023-10-09T15:31:49.453161+0000","last_became_peered":"2023-10-09T15:31:49.453161+0000","last_unstale":"2023-10-09T15:31:49.455573+0000","last_undegraded":"2023-10-09T15:31:49.455573+0000","last_fullsized":"2023-10-09T15:31:49.455573+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:30.425127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.433917+0000","last_change":"2023-10-09T15:31:48.441923+0000","last_active":"2023-10-09T15:31:49.433917+0000","last_peered":"2023-10-09T15:31:49.433917+0000","last_clean":"2023-10-09T15:31:49.433917+0000","last_became_active":"2023-10-09T15:31:48.441636+0000","last_became_peered":"2023-10-09T15:31:48.441636+0000","last_unstale":"2023-10-09T15:31:49.433917+0000","last_undegraded":"2023-10-09T15:31:49.433917+0000","last_fullsized":"2023-10-09T15:31:49.433917+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:54.563294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.458712+0000","last_change":"2023-10-09T15:31:49.444791+0000","last_active":"2023-10-09T15:31:49.458712+0000","last_peered":"2023-10-09T15:31:49.458712+0000","last_clean":"2023-10-09T15:31:49.458712+0000","last_became_active":"2023-10-09T15:31:49.444504+0000","last_became_peered":"2023-10-09T15:31:49.444504+0000","last_unstale":"2023-10-09T15:31:49.458712+0000","last_undegraded":"2023-10-09T15:31:49.458712+0000","last_fullsized":"2023-10-09T15:31:49.458712+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.744965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"31'8","reported_seq":18,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.461546+0000","last_change":"2023-10-09T15:31:48.442116+0000","last_active":"2023-10-09T15:31:49.461546+0000","last_peered":"2023-10-09T15:31:49.461546+0000","last_clean":"2023-10-09T15:31:49.461546+0000","last_became_active":"2023-10-09T15:31:48.441848+0000","last_became_peered":"2023-10-09T15:31:48.441848+0000","last_unstale":"2023-10-09T15:31:49.461546+0000","last_undegraded":"2023-10-09T15:31:49.461546+0000","last_fullsized":"2023-10-09T15:31:49.461546+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:28.393670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.448035+0000","last_change":"2023-10-09T15:31:49.444711+0000","last_active":"2023-10-09T15:31:49.448035+0000","last_peered":"2023-10-09T15:31:49.448035+0000","last_clean":"2023-10-09T15:31:49.448035+0000","last_became_active":"2023-10-09T15:31:49.444295+0000","last_became_peered":"2023-10-09T15:31:49.444295+0000","last_unstale":"2023-10-09T15:31:49.448035+0000","last_undegraded":"2023-10-09T15:31:49.448035+0000","last_fullsized":"2023-10-09T15:31:49.448035+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:37:00.978037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460397+0000","last_change":"2023-10-09T15:31:48.444228+0000","last_active":"2023-10-09T15:31:49.460397+0000","last_peered":"2023-10-09T15:31:49.460397+0000","last_clean":"2023-10-09T15:31:49.460397+0000","last_became_active":"2023-10-09T15:31:48.443924+0000","last_became_peered":"2023-10-09T15:31:48.443924+0000","last_unstale":"2023-10-09T15:31:49.460397+0000","last_undegraded":"2023-10-09T15:31:49.460397+0000","last_fullsized":"2023-10-09T15:31:49.460397+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:21:23.503889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454851+0000","last_change":"2023-10-09T15:31:49.447006+0000","last_active":"2023-10-09T15:31:49.454851+0000","last_peered":"2023-10-09T15:31:49.454851+0000","last_clean":"2023-10-09T15:31:49.454851+0000","last_became_active":"2023-10-09T15:31:49.446745+0000","last_became_peered":"2023-10-09T15:31:49.446745+0000","last_unstale":"2023-10-09T15:31:49.454851+0000","last_undegraded":"2023-10-09T15:31:49.454851+0000","last_fullsized":"2023-10-09T15:31:49.454851+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:18.735721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.462112+0000","last_change":"2023-10-09T15:31:48.432486+0000","last_active":"2023-10-09T15:31:49.462112+0000","last_peered":"2023-10-09T15:31:49.462112+0000","last_clean":"2023-10-09T15:31:49.462112+0000","last_became_active":"2023-10-09T15:31:48.432190+0000","last_became_peered":"2023-10-09T15:31:48.432190+0000","last_unstale":"2023-10-09T15:31:49.462112+0000","last_undegraded":"2023-10-09T15:31:49.462112+0000","last_fullsized":"2023-10-09T15:31:49.462112+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:35:23.924400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460331+0000","last_change":"2023-10-09T15:31:49.452779+0000","last_active":"2023-10-09T15:31:49.460331+0000","last_peered":"2023-10-09T15:31:49.460331+0000","last_clean":"2023-10-09T15:31:49.460331+0000","last_became_active":"2023-10-09T15:31:49.452412+0000","last_became_peered":"2023-10-09T15:31:49.452412+0000","last_unstale":"2023-10-09T15:31:49.460331+0000","last_undegraded":"2023-10-09T15:31:49.460331+0000","last_fullsized":"2023-10-09T15:31:49.460331+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:48.477912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"31'1","reported_seq":11,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.463591+0000","last_change":"2023-10-09T15:31:48.444331+0000","last_active":"2023-10-09T15:31:49.463591+0000","last_peered":"2023-10-09T15:31:49.463591+0000","last_clean":"2023-10-09T15:31:49.463591+0000","last_became_active":"2023-10-09T15:31:48.444015+0000","last_became_peered":"2023-10-09T15:31:48.444015+0000","last_unstale":"2023-10-09T15:31:49.463591+0000","last_undegraded":"2023-10-09T15:31:49.463591+0000","last_fullsized":"2023-10-09T15:31:49.463591+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453585+0000","last_change":"2023-10-09T15:31:49.446998+0000","last_active":"2023-10-09T15:31:49.453585+0000","last_peered":"2023-10-09T15:31:49.453585+0000","last_clean":"2023-10-09T15:31:49.453585+0000","last_became_active":"2023-10-09T15:31:49.446741+0000","last_became_peered":"2023-10-09T15:31:49.446741+0000","last_unstale":"2023-10-09T15:31:49.453585+0000","last_undegraded":"2023-10-09T15:31:49.453585+0000","last_fullsized":"2023-10-09T15:31:49.453585+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:20:09.754306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.433483+0000","last_change":"2023-10-09T15:31:48.441940+0000","last_active":"2023-10-09T15:31:49.433483+0000","last_peered":"2023-10-09T15:31:49.433483+0000","last_clean":"2023-10-09T15:31:49.433483+0000","last_became_active":"2023-10-09T15:31:48.441640+0000","last_became_peered":"2023-10-09T15:31:48.441640+0000","last_unstale":"2023-10-09T15:31:49.433483+0000","last_undegraded":"2023-10-09T15:31:49.433483+0000","last_fullsized":"2023-10-09T15:31:49.433483+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:55.034239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453519+0000","last_change":"2023-10-09T15:31:49.446392+0000","last_active":"2023-10-09T15:31:49.453519+0000","last_peered":"2023-10-09T15:31:49.453519+0000","last_clean":"2023-10-09T15:31:49.453519+0000","last_became_active":"2023-10-09T15:31:49.445960+0000","last_became_peered":"2023-10-09T15:31:49.445960+0000","last_unstale":"2023-10-09T15:31:49.453519+0000","last_undegraded":"2023-10-09T15:31:49.453519+0000","last_fullsized":"2023-10-09T15:31:49.453519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:56.038744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.459830+0000","last_change":"2023-10-09T15:31:48.433252+0000","last_active":"2023-10-09T15:31:49.459830+0000","last_peered":"2023-10-09T15:31:49.459830+0000","last_clean":"2023-10-09T15:31:49.459830+0000","last_became_active":"2023-10-09T15:31:48.432998+0000","last_became_peered":"2023-10-09T15:31:48.432998+0000","last_unstale":"2023-10-09T15:31:49.459830+0000","last_undegraded":"2023-10-09T15:31:49.459830+0000","last_fullsized":"2023-10-09T15:31:49.459830+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453141+0000","last_change":"2023-10-09T15:31:49.441809+0000","last_active":"2023-10-09T15:31:49.453141+0000","last_peered":"2023-10-09T15:31:49.453141+0000","last_clean":"2023-10-09T15:31:49.453141+0000","last_became_active":"2023-10-09T15:31:49.441590+0000","last_became_peered":"2023-10-09T15:31:49.441590+0000","last_unstale":"2023-10-09T15:31:49.453141+0000","last_undegraded":"2023-10-09T15:31:49.453141+0000","last_fullsized":"2023-10-09T15:31:49.453141+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:27.384489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.432244+0000","last_change":"2023-10-09T15:31:48.434141+0000","last_active":"2023-10-09T15:31:49.432244+0000","last_peered":"2023-10-09T15:31:49.432244+0000","last_clean":"2023-10-09T15:31:49.432244+0000","last_became_active":"2023-10-09T15:31:48.433862+0000","last_became_peered":"2023-10-09T15:31:48.433862+0000","last_unstale":"2023-10-09T15:31:49.432244+0000","last_undegraded":"2023-10-09T15:31:49.432244+0000","last_fullsized":"2023-10-09T15:31:49.432244+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:58.190167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.447743+0000","last_change":"2023-10-09T15:31:49.438737+0000","last_active":"2023-10-09T15:31:49.447743+0000","last_peered":"2023-10-09T15:31:49.447743+0000","last_clean":"2023-10-09T15:31:49.447743+0000","last_became_active":"2023-10-09T15:31:49.438502+0000","last_became_peered":"2023-10-09T15:31:49.438502+0000","last_unstale":"2023-10-09T15:31:49.447743+0000","last_undegraded":"2023-10-09T15:31:49.447743+0000","last_fullsized":"2023-10-09T15:31:49.447743+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:11.884776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.434675+0000","last_change":"2023-10-09T15:31:48.435779+0000","last_active":"2023-10-09T15:31:49.434675+0000","last_peered":"2023-10-09T15:31:49.434675+0000","last_clean":"2023-10-09T15:31:49.434675+0000","last_became_active":"2023-10-09T15:31:48.435528+0000","last_became_peered":"2023-10-09T15:31:48.435528+0000","last_unstale":"2023-10-09T15:31:49.434675+0000","last_undegraded":"2023-10-09T15:31:49.434675+0000","last_fullsized":"2023-10-09T15:31:49.434675+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:40:01.493469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.463319+0000","last_change":"2023-10-09T15:31:49.459590+0000","last_active":"2023-10-09T15:31:49.463319+0000","last_peered":"2023-10-09T15:31:49.463319+0000","last_clean":"2023-10-09T15:31:49.463319+0000","last_became_active":"2023-10-09T15:31:49.459284+0000","last_became_peered":"2023-10-09T15:31:49.459284+0000","last_unstale":"2023-10-09T15:31:49.463319+0000","last_undegraded":"2023-10-09T15:31:49.463319+0000","last_fullsized":"2023-10-09T15:31:49.463319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:18.735721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.438102+0000","last_change":"2023-10-09T15:31:48.438647+0000","last_active":"2023-10-09T15:31:49.438102+0000","last_peered":"2023-10-09T15:31:49.438102+0000","last_clean":"2023-10-09T15:31:49.438102+0000","last_became_active":"2023-10-09T15:31:48.438135+0000","last_became_peered":"2023-10-09T15:31:48.438135+0000","last_unstale":"2023-10-09T15:31:49.438102+0000","last_undegraded":"2023-10-09T15:31:49.438102+0000","last_fullsized":"2023-10-09T15:31:49.438102+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:47.442571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.453005+0000","last_change":"2023-10-09T15:31:49.443791+0000","last_active":"2023-10-09T15:31:49.453005+0000","last_peered":"2023-10-09T15:31:49.453005+0000","last_clean":"2023-10-09T15:31:49.453005+0000","last_became_active":"2023-10-09T15:31:49.443513+0000","last_became_peered":"2023-10-09T15:31:49.443513+0000","last_unstale":"2023-10-09T15:31:49.453005+0000","last_undegraded":"2023-10-09T15:31:49.453005+0000","last_fullsized":"2023-10-09T15:31:49.453005+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:05.461157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"31'2","reported_seq":12,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.460953+0000","last_change":"2023-10-09T15:31:48.437866+0000","last_active":"2023-10-09T15:31:49.460953+0000","last_peered":"2023-10-09T15:31:49.460953+0000","last_clean":"2023-10-09T15:31:49.460953+0000","last_became_active":"2023-10-09T15:31:48.437537+0000","last_became_peered":"2023-10-09T15:31:48.437537+0000","last_unstale":"2023-10-09T15:31:49.460953+0000","last_undegraded":"2023-10-09T15:31:49.460953+0000","last_fullsized":"2023-10-09T15:31:49.460953+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:25.169383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.461525+0000","last_change":"2023-10-09T15:31:49.458891+0000","last_active":"2023-10-09T15:31:49.461525+0000","last_peered":"2023-10-09T15:31:49.461525+0000","last_clean":"2023-10-09T15:31:49.461525+0000","last_became_active":"2023-10-09T15:31:49.458254+0000","last_became_peered":"2023-10-09T15:31:49.458254+0000","last_unstale":"2023-10-09T15:31:49.461525+0000","last_undegraded":"2023-10-09T15:31:49.461525+0000","last_fullsized":"2023-10-09T15:31:49.461525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:49.340665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-10-09T15:31:50.487273+0000","last_change":"2023-10-09T15:31:48.439885+0000","last_active":"2023-10-09T15:31:50.487273+0000","last_peered":"2023-10-09T15:31:50.487273+0000","last_clean":"2023-10-09T15:31:50.487273+0000","last_became_active":"2023-10-09T15:31:48.439523+0000","last_became_peered":"2023-10-09T15:31:48.439523+0000","last_unstale":"2023-10-09T15:31:50.487273+0000","last_undegraded":"2023-10-09T15:31:50.487273+0000","last_fullsized":"2023-10-09T15:31:50.487273+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454723+0000","last_change":"2023-10-09T15:31:49.445116+0000","last_active":"2023-10-09T15:31:49.454723+0000","last_peered":"2023-10-09T15:31:49.454723+0000","last_clean":"2023-10-09T15:31:49.454723+0000","last_became_active":"2023-10-09T15:31:49.444839+0000","last_became_peered":"2023-10-09T15:31:49.444839+0000","last_unstale":"2023-10-09T15:31:49.454723+0000","last_undegraded":"2023-10-09T15:31:49.454723+0000","last_fullsized":"2023-10-09T15:31:49.454723+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:20:48.447077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.440663+0000","last_change":"2023-10-09T15:31:48.444285+0000","last_active":"2023-10-09T15:31:49.440663+0000","last_peered":"2023-10-09T15:31:49.440663+0000","last_clean":"2023-10-09T15:31:49.440663+0000","last_became_active":"2023-10-09T15:31:48.444019+0000","last_became_peered":"2023-10-09T15:31:48.444019+0000","last_unstale":"2023-10-09T15:31:49.440663+0000","last_undegraded":"2023-10-09T15:31:49.440663+0000","last_fullsized":"2023-10-09T15:31:49.440663+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:26.379983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454016+0000","last_change":"2023-10-09T15:31:49.438746+0000","last_active":"2023-10-09T15:31:49.454016+0000","last_peered":"2023-10-09T15:31:49.454016+0000","last_clean":"2023-10-09T15:31:49.454016+0000","last_became_active":"2023-10-09T15:31:49.438469+0000","last_became_peered":"2023-10-09T15:31:49.438469+0000","last_unstale":"2023-10-09T15:31:49.454016+0000","last_undegraded":"2023-10-09T15:31:49.454016+0000","last_fullsized":"2023-10-09T15:31:49.454016+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:55.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.430337+0000","last_change":"2023-10-09T15:31:48.432726+0000","last_active":"2023-10-09T15:31:49.430337+0000","last_peered":"2023-10-09T15:31:49.430337+0000","last_clean":"2023-10-09T15:31:49.430337+0000","last_became_active":"2023-10-09T15:31:48.432457+0000","last_became_peered":"2023-10-09T15:31:48.432457+0000","last_unstale":"2023-10-09T15:31:49.430337+0000","last_undegraded":"2023-10-09T15:31:49.430337+0000","last_fullsized":"2023-10-09T15:31:49.430337+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:41.603061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.454616+0000","last_change":"2023-10-09T15:31:49.443984+0000","last_active":"2023-10-09T15:31:49.454616+0000","last_peered":"2023-10-09T15:31:49.454616+0000","last_clean":"2023-10-09T15:31:49.454616+0000","last_became_active":"2023-10-09T15:31:49.443739+0000","last_became_peered":"2023-10-09T15:31:49.443739+0000","last_unstale":"2023-10-09T15:31:49.454616+0000","last_undegraded":"2023-10-09T15:31:49.454616+0000","last_fullsized":"2023-10-09T15:31:49.454616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:55.567800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.440101+0000","last_change":"2023-10-09T15:31:48.437817+0000","last_active":"2023-10-09T15:31:49.440101+0000","last_peered":"2023-10-09T15:31:49.440101+0000","last_clean":"2023-10-09T15:31:49.440101+0000","last_became_active":"2023-10-09T15:31:48.437526+0000","last_became_peered":"2023-10-09T15:31:48.437526+0000","last_unstale":"2023-10-09T15:31:49.440101+0000","last_undegraded":"2023-10-09T15:31:49.440101+0000","last_fullsized":"2023-10-09T15:31:49.440101+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:41:35.040070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.448760+0000","last_change":"2023-10-09T15:31:49.444509+0000","last_active":"2023-10-09T15:31:49.448760+0000","last_peered":"2023-10-09T15:31:49.448760+0000","last_clean":"2023-10-09T15:31:49.448760+0000","last_became_active":"2023-10-09T15:31:49.444266+0000","last_became_peered":"2023-10-09T15:31:49.444266+0000","last_unstale":"2023-10-09T15:31:49.448760+0000","last_undegraded":"2023-10-09T15:31:49.448760+0000","last_fullsized":"2023-10-09T15:31:49.448760+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:55:19.012855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.434693+0000","last_change":"2023-10-09T15:31:48.434967+0000","last_active":"2023-10-09T15:31:49.434693+0000","last_peered":"2023-10-09T15:31:49.434693+0000","last_clean":"2023-10-09T15:31:49.434693+0000","last_became_active":"2023-10-09T15:31:48.434698+0000","last_became_peered":"2023-10-09T15:31:48.434698+0000","last_unstale":"2023-10-09T15:31:49.434693+0000","last_undegraded":"2023-10-09T15:31:49.434693+0000","last_fullsized":"2023-10-09T15:31:49.434693+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:04.456652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.455747+0000","last_change":"2023-10-09T15:31:49.446086+0000","last_active":"2023-10-09T15:31:49.455747+0000","last_peered":"2023-10-09T15:31:49.455747+0000","last_clean":"2023-10-09T15:31:49.455747+0000","last_became_active":"2023-10-09T15:31:49.445803+0000","last_became_peered":"2023-10-09T15:31:49.445803+0000","last_unstale":"2023-10-09T15:31:49.455747+0000","last_undegraded":"2023-10-09T15:31:49.455747+0000","last_fullsized":"2023-10-09T15:31:49.455747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:34.950947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.435583+0000","last_change":"2023-10-09T15:31:48.443359+0000","last_active":"2023-10-09T15:31:49.435583+0000","last_peered":"2023-10-09T15:31:49.435583+0000","last_clean":"2023-10-09T15:31:49.435583+0000","last_became_active":"2023-10-09T15:31:48.443054+0000","last_became_peered":"2023-10-09T15:31:48.443054+0000","last_unstale":"2023-10-09T15:31:49.435583+0000","last_undegraded":"2023-10-09T15:31:49.435583+0000","last_fullsized":"2023-10-09T15:31:49.435583+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:41:35.040070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":9,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.458660+0000","last_change":"2023-10-09T15:31:49.454254+0000","last_active":"2023-10-09T15:31:49.458660+0000","last_peered":"2023-10-09T15:31:49.458660+0000","last_clean":"2023-10-09T15:31:49.458660+0000","last_became_active":"2023-10-09T15:31:49.453961+0000","last_became_peered":"2023-10-09T15:31:49.453961+0000","last_unstale":"2023-10-09T15:31:49.458660+0000","last_undegraded":"2023-10-09T15:31:49.458660+0000","last_fullsized":"2023-10-09T15:31:49.458660+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:48.414032+0000","last_clean_scrub_stamp":"2023-10-09T15:31:48.414032+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:24.819321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.434020+0000","last_change":"2023-10-09T15:31:48.426899+0000","last_active":"2023-10-09T15:31:49.434020+0000","last_peered":"2023-10-09T15:31:49.434020+0000","last_clean":"2023-10-09T15:31:49.434020+0000","last_became_active":"2023-10-09T15:31:48.426614+0000","last_became_peered":"2023-10-09T15:31:48.426614+0000","last_unstale":"2023-10-09T15:31:49.434020+0000","last_undegraded":"2023-10-09T15:31:49.434020+0000","last_fullsized":"2023-10-09T15:31:49.434020+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:31:47.409526+0000","last_clean_scrub_stamp":"2023-10-09T15:31:47.409526+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:10.880270+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":172,"reported_epoch":31,"state":"active+clean","last_fresh":"2023-10-09T15:31:49.440280+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:31:49.440280+0000","last_peered":"2023-10-09T15:31:49.440280+0000","last_clean":"2023-10-09T15:31:49.440280+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:31:49.440280+0000","last_undegraded":"2023-10-09T15:31:49.440280+0000","last_fullsized":"2023-10-09T15:31:49.440280+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":729475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64900000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66600000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50700000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41999999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68200000000000005}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56299999999999994}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.315},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.27300000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.40100000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.52600000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.51700000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.56999999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":728374,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.441}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70899999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.623}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.75700000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.76900000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297644,"kb_used_data":356,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074196,"statfs":{"total":96636764160,"available":96331976704,"internally_reserved":0,"allocated":364544,"data_stored":139087,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35599999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32200000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53200000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52300000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56000000000000005}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66100000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574862,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297656,"kb_used_data":368,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074184,"statfs":{"total":96636764160,"available":96331964416,"internally_reserved":0,"allocated":376832,"data_stored":140575,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27900000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46500000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47999999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44700000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54600000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139121,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.66800000000000004}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64300000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54000000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56399999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.628}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.751}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297648,"kb_used_data":360,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94074192,"statfs":{"total":96636764160,"available":96331972608,"internally_reserved":0,"allocated":368640,"data_stored":139661,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.43099999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.64200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.49099999999999999},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.092000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.59799999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.164999999999999,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.66600000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.623}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.73899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.76000000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:31:58.476 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:31:58.476 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:31:58.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.638+0000 7faf4c0bf700 1 Processor -- start 2023-10-09T15:31:58.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 -- start start 2023-10-09T15:31:58.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf44159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf4406e0e0 0x7faf440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf440ccfd0 con 0x7faf44159530 2023-10-09T15:31:58.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf4415a3d0 con 0x7faf4406e0e0 2023-10-09T15:31:58.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.639+0000 7faf4c0bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4415a6b0 con 0x7faf4406dc70 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf4406e0e0 0x7faf440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf4406e0e0 0x7faf440cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51644/0 (socket says 172.21.15.33:51644) 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 -- 172.21.15.33:0/2908745241 learned_addr learned my addr 172.21.15.33:0/2908745241 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4965a700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf44159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 -- 172.21.15.33:0/2908745241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 msgr2=0x7faf44159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf44159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 -- 172.21.15.33:0/2908745241 >> v1:172.21.15.59:6789/0 conn(0x7faf44159530 legacy=0x7faf440ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 -- 172.21.15.33:0/2908745241 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf4415a990 con 0x7faf4406e0e0 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4965a700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf44159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf4a65c700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf440cb6f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf340099b0 tx=0x7faf34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251b9d9bdba2cacf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf48e59700 1 -- 172.21.15.33:0/2908745241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400b860 con 0x7faf4406e0e0 2023-10-09T15:31:58.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf48e59700 1 -- 172.21.15.33:0/2908745241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3400b9c0 con 0x7faf4406e0e0 2023-10-09T15:31:58.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.640+0000 7faf48e59700 1 -- 172.21.15.33:0/2908745241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf3400bd60 con 0x7faf4406e0e0 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 -- 172.21.15.33:0/2908745241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 msgr2=0x7faf440cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf440cb6f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7faf340099b0 tx=0x7faf34009250 comp rx=0 tx=0).stop 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 -- 172.21.15.33:0/2908745241 shutdown_connections 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf440cb6f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/2908745241 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf44159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 -- 172.21.15.33:0/2908745241 >> 172.21.15.33:0/2908745241 conn(0x7faf440703a0 msgr2=0x7faf440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 -- 172.21.15.33:0/2908745241 shutdown_connections 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.641+0000 7faf4c0bf700 1 -- 172.21.15.33:0/2908745241 wait complete. 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.642+0000 7faf4c0bf700 1 Processor -- start 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.642+0000 7faf4c0bf700 1 -- start start 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf4416cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf44159530 0x7faf440b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf440c97d0 con 0x7faf4406e0e0 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf4416d5b0 con 0x7faf44159530 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4c0bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf4416d890 con 0x7faf4406dc70 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51652/0 (socket says 172.21.15.33:51652) 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 -- 172.21.15.33:0/4133096546 learned_addr learned my addr 172.21.15.33:0/4133096546 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4a65c700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf44159530 0x7faf440b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf49e5b700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf4416cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 -- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 msgr2=0x7faf4416cfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf4416cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 -- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf44159530 msgr2=0x7faf440b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf44159530 0x7faf440b1a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 -- 172.21.15.33:0/4133096546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf340094f0 con 0x7faf4406e0e0 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf4965a700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c830 tx=0x7faf38008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.643+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011600 con 0x7faf4406e0e0 2023-10-09T15:31:58.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.644+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf38011760 con 0x7faf4406e0e0 2023-10-09T15:31:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.644+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf38011b20 con 0x7faf4406e0e0 2023-10-09T15:31:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.644+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf4416db70 con 0x7faf4406e0e0 2023-10-09T15:31:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.644+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf440b1f80 con 0x7faf4406e0e0 2023-10-09T15:31:58.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.645+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf4404c3c0 con 0x7faf4406e0e0 2023-10-09T15:31:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.645+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faf3800a3e0 con 0x7faf4406e0e0 2023-10-09T15:31:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.645+0000 7faf41ffb700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.646+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf38084a40 con 0x7faf4406e0e0 2023-10-09T15:31:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.646+0000 7faf49e5b700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:58.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.646+0000 7faf49e5b700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 0x7faf300693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007fd0 tx=0x7faf3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:58.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.650+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf38086e60 con 0x7faf4406e0e0 2023-10-09T15:31:58.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.923+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faf440c9910 con 0x7faf4406e0e0 2023-10-09T15:31:58.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.926+0000 7faf41ffb700 1 -- 172.21.15.33:0/4133096546 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7faf380150e0 con 0x7faf4406e0e0 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 msgr2=0x7faf300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 0x7faf300693e0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7faf3c007fd0 tx=0x7faf3c009040 comp rx=0 tx=0).stop 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 msgr2=0x7faf44153ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7faf3800c830 tx=0x7faf38008040 comp rx=0 tx=0).stop 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 shutdown_connections 2023-10-09T15:31:58.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf30066f30 0x7faf300693e0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf44159530 0x7faf440b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf4406dc70 0x7faf4416cfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 --2- 172.21.15.33:0/4133096546 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf4406e0e0 0x7faf44153ba0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 >> 172.21.15.33:0/4133096546 conn(0x7faf440703a0 msgr2=0x7faf440cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 shutdown_connections 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:58.929+0000 7faf4c0bf700 1 -- 172.21.15.33:0/4133096546 wait complete. 2023-10-09T15:31:58.930 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:31:58.940 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:31:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.059+0000 7fe54547c700 1 Processor -- start 2023-10-09T15:31:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.059+0000 7fe54547c700 1 -- start start 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe5401594d0 0x7fe5400cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5400cb1a0 0x7fe5400cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5401598a0 0x7fe5400ccfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54015e010 con 0x7fe5401594d0 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe54015d420 con 0x7fe5401598a0 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe54547c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015d6e0 con 0x7fe5400cb1a0 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe5401594d0 0x7fe5400cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe5401594d0 0x7fe5400cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51668/0 (socket says 172.21.15.33:51668) 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 -- 172.21.15.33:0/1063168267 learned_addr learned my addr 172.21.15.33:0/1063168267 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 -- 172.21.15.33:0/1063168267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5400cb1a0 msgr2=0x7fe5400cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53f7fe700 1 --2- 172.21.15.33:0/1063168267 >> v2:172.21.15.59:3300/0 conn(0x7fe5401598a0 0x7fe5400ccfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 --2- 172.21.15.33:0/1063168267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5400cb1a0 0x7fe5400cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 -- 172.21.15.33:0/1063168267 >> v2:172.21.15.59:3300/0 conn(0x7fe5401598a0 msgr2=0x7fe5400ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 --2- 172.21.15.33:0/1063168267 >> v2:172.21.15.59:3300/0 conn(0x7fe5401598a0 0x7fe5400ccfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.060+0000 7fe53effd700 1 -- 172.21.15.33:0/1063168267 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe54015d9c0 con 0x7fe5401594d0 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe53effd700 1 --2- 172.21.15.33:0/1063168267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400cea70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe540065130 tx=0x7fe530009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bf3361a08fe566e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe53dffb700 1 -- 172.21.15.33:0/1063168267 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000b860 con 0x7fe5401594d0 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe53dffb700 1 -- 172.21.15.33:0/1063168267 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53000b9c0 con 0x7fe5401594d0 2023-10-09T15:31:59.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe53dffb700 1 -- 172.21.15.33:0/1063168267 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53000bd60 con 0x7fe5401594d0 2023-10-09T15:31:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 -- 172.21.15.33:0/1063168267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 msgr2=0x7fe5400cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 --2- 172.21.15.33:0/1063168267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400cea70 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe540065130 tx=0x7fe530009250 comp rx=0 tx=0).stop 2023-10-09T15:31:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 -- 172.21.15.33:0/1063168267 shutdown_connections 2023-10-09T15:31:59.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 --2- 172.21.15.33:0/1063168267 >> v2:172.21.15.59:3300/0 conn(0x7fe5401598a0 0x7fe5400ccfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 --2- 172.21.15.33:0/1063168267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400cea70 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 --2- 172.21.15.33:0/1063168267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5400cb1a0 0x7fe5400cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 -- 172.21.15.33:0/1063168267 >> 172.21.15.33:0/1063168267 conn(0x7fe5400703a0 msgr2=0x7fe540070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 -- 172.21.15.33:0/1063168267 shutdown_connections 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.061+0000 7fe54547c700 1 -- 172.21.15.33:0/1063168267 wait complete. 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 Processor -- start 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 -- start start 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5400cb1a0 0x7fe540148b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5401598a0 0x7fe540159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015cb10 con 0x7fe5401594d0 2023-10-09T15:31:59.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015bc80 con 0x7fe5400cb1a0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe54547c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe54015bf00 con 0x7fe5401598a0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe53e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe53e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51674/0 (socket says 172.21.15.33:51674) 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.063+0000 7fe53e7fc700 1 -- 172.21.15.33:0/238802174 learned_addr learned my addr 172.21.15.33:0/238802174 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53f7fe700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5401598a0 0x7fe540159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53effd700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5400cb1a0 0x7fe540148b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 -- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5401598a0 msgr2=0x7fe540159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5401598a0 0x7fe540159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 -- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5400cb1a0 msgr2=0x7fe540148b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5400cb1a0 0x7fe540148b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 -- 172.21.15.33:0/238802174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5300094f0 con 0x7fe5401594d0 2023-10-09T15:31:59.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe53e7fc700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b810 tx=0x7fe534009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400f5f0 con 0x7fe5401594d0 2023-10-09T15:31:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe53400f770 con 0x7fe5401594d0 2023-10-09T15:31:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe54015c1e0 con 0x7fe5401594d0 2023-10-09T15:31:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe53400fb30 con 0x7fe5401594d0 2023-10-09T15:31:59.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.064+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe54015c7a0 con 0x7fe5401594d0 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.065+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe54015cc80 con 0x7fe5401594d0 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.066+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe534010480 con 0x7fe5401594d0 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.066+0000 7fe526ffd700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.066+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe534084490 con 0x7fe5401594d0 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.066+0000 7fe53effd700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.066+0000 7fe53effd700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe540065130 tx=0x7fe530017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.070+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe534051780 con 0x7fe5401594d0 2023-10-09T15:31:59.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.306+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe54004c3c0 con 0x7fe5401594d0 2023-10-09T15:31:59.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.307+0000 7fe526ffd700 1 -- 172.21.15.33:0/238802174 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 16 v16) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fe534054da0 con 0x7fe5401594d0 2023-10-09T15:31:59.307 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:31:59.307 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":16,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4852,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/3683481332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3683481332},{"type":"v1","addr":"172.21.15.59:6835","nonce":3683481332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:31:59.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 msgr2=0x7fe52c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 0x7fe52c0693e0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fe540065130 tx=0x7fe530017000 comp rx=0 tx=0).stop 2023-10-09T15:31:59.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 msgr2=0x7fe5400b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fe53400b810 tx=0x7fe534009250 comp rx=0 tx=0).stop 2023-10-09T15:31:59.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 shutdown_connections 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe52c066f30 0x7fe52c0693e0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5401598a0 0x7fe540159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5400cb1a0 0x7fe540148b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 --2- 172.21.15.33:0/238802174 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5401594d0 0x7fe5400b59d0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 >> 172.21.15.33:0/238802174 conn(0x7fe5400703a0 msgr2=0x7fe540149b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 shutdown_connections 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.309+0000 7fe54547c700 1 -- 172.21.15.33:0/238802174 wait complete. 2023-10-09T15:31:59.310 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 16 2023-10-09T15:31:59.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 16, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:31:48.826151+0000', 'modified': '2023-10-09T15:31:52.451884+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4938}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4938': {'gid': 4938, 'name': 'a', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.33:6836/3091408111', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6834', 'nonce': 3091408111}, {'type': 'v1', 'addr': '172.21.15.33:6836', 'nonce': 3091408111}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:31:59.723 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:31:59.723 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T15:31:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.847+0000 7faa4ccbe700 1 Processor -- start 2023-10-09T15:31:59.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.847+0000 7faa4ccbe700 1 -- start start 2023-10-09T15:31:59.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4ccbe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa480cb970 0x7faa48159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4ccbe700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4815ae40 con 0x7faa480cb5a0 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4ccbe700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa4815ab60 con 0x7faa4815a400 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4ccbe700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa480ce0f0 con 0x7faa480cb970 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faa480cb5a0 0x7faa480cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41200/0 (socket says 172.21.15.33:41200) 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.848+0000 7faa4659c700 1 -- 172.21.15.33:0/1808124742 learned_addr learned my addr 172.21.15.33:0/1808124742 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 304142815 0 0) 0x7faa4815ae40 con 0x7faa480cb5a0 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa34003570 con 0x7faa480cb5a0 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 --2- 172.21.15.33:0/1808124742 >> v2:172.21.15.59:3300/0 conn(0x7faa480cb970 0x7faa48159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3794285511 0 0) 0x7faa34003570 con 0x7faa480cb5a0 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 >> v2:172.21.15.59:3300/0 conn(0x7faa480cb970 msgr2=0x7faa48159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 --2- 172.21.15.33:0/1808124742 >> v2:172.21.15.59:3300/0 conn(0x7faa480cb970 0x7faa48159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 >> v1:172.21.15.59:6789/0 conn(0x7faa4815a400 legacy=0x7faa48156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480ccf00 con 0x7faa480cb5a0 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7faa400017f0 con 0x7faa480cb5a0 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 >> v1:172.21.15.33:6789/0 conn(0x7faa480cb5a0 legacy=0x7faa480cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34003a60 0x7faa34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 0x7faa34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa340051c0 0x7faa3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480ce0f0 con 0x7faa34004810 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa3400c0d0 con 0x7faa34003a60 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa3400c290 con 0x7faa340051c0 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 0x7faa34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa4659c700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34003a60 0x7faa34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa46d9d700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa340051c0 0x7faa3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 -- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa340051c0 msgr2=0x7faa3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa340051c0 0x7faa3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 -- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34003a60 msgr2=0x7faa34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34003a60 0x7faa34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa45d9b700 1 -- 172.21.15.33:0/1808124742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa34003570 con 0x7faa34004810 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa46d9d700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa340051c0 0x7faa3400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.849+0000 7faa46d9d700 1 -- 172.21.15.33:0/1808124742 reap_dead start 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa45d9b700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 0x7faa34004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa30009c00 tx=0x7faa300091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89dbdbe15b4e413 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000e710 con 0x7faa34004810 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa3000e870 con 0x7faa34004810 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4559a700 1 -- 172.21.15.33:0/1808124742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa3000ec30 con 0x7faa34004810 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 -- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 msgr2=0x7faa34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 0x7faa34004c80 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7faa30009c00 tx=0x7faa300091a0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 -- 172.21.15.33:0/1808124742 shutdown_connections 2023-10-09T15:31:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/1808124742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa34004810 0x7faa34004c80 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 -- 172.21.15.33:0/1808124742 >> 172.21.15.33:0/1808124742 conn(0x7faa48070e30 msgr2=0x7faa480d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 -- 172.21.15.33:0/1808124742 shutdown_connections 2023-10-09T15:31:59.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.850+0000 7faa4ccbe700 1 -- 172.21.15.33:0/1808124742 wait complete. 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.851+0000 7faa4ccbe700 1 Processor -- start 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.851+0000 7faa4ccbe700 1 -- start start 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34004810 0x7faa480af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4816e000 0x7faa48152b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa480afb10 con 0x7faa48159600 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa4816db70 con 0x7faa34004810 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4ccbe700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa48159aa0 con 0x7faa4816e000 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa46d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa46d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51704/0 (socket says 172.21.15.33:51704) 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa46d9d700 1 -- 172.21.15.33:0/2058328881 learned_addr learned my addr 172.21.15.33:0/2058328881 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4816e000 0x7faa48152b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.852+0000 7faa4659c700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34004810 0x7faa480af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 -- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4816e000 msgr2=0x7faa48152b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4816e000 0x7faa48152b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 -- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34004810 msgr2=0x7faa480af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34004810 0x7faa480af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 -- 172.21.15.33:0/2058328881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa480af830 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa46d9d700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa480d1750 tx=0x7faa38009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa3e7fc700 1 -- 172.21.15.33:0/2058328881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa38014480 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa3e7fc700 1 -- 172.21.15.33:0/2058328881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa380145e0 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa4816d520 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa3e7fc700 1 -- 172.21.15.33:0/2058328881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa380149a0 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.853+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa480c7870 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.855+0000 7faa3e7fc700 1 -- 172.21.15.33:0/2058328881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faa380133e0 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.855+0000 7faa3e7fc700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 0x7faa280693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.855+0000 7faa3e7fc700 1 -- 172.21.15.33:0/2058328881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa38083e10 con 0x7faa48159600 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.855+0000 7faa4659c700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 0x7faa280693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.856+0000 7faa4659c700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 0x7faa280693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa400013d0 tx=0x7faa40006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.857+0000 7faa55fb6b80 1 Processor -- start 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.857+0000 7faa55fb6b80 1 -- start start 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 0x563c26ac5e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac1cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26a1ca70 con 0x563c26b0fd00 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26a1a270 con 0x563c26ac5a50 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c26a16060 con 0x563c26aeef60 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51720/0 (socket says 172.21.15.33:51720) 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 -- 172.21.15.33:0/3367931663 learned_addr learned my addr 172.21.15.33:0/3367931663 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa4659c700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 0x563c26ac5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa46d9d700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac1cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 -- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 msgr2=0x563c26ac1cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac1cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 -- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 msgr2=0x563c26ac5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 0x563c26ac5e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 -- 172.21.15.33:0/3367931663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c268b0270 con 0x563c26b0fd00 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa4659c700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 0x563c26ac5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.858+0000 7faa45d9b700 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa30006af0 tx=0x7faa3001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d946169babf2fb3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa277fe700 1 -- 172.21.15.33:0/3367931663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa30022070 con 0x563c26b0fd00 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa277fe700 1 -- 172.21.15.33:0/3367931663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30023040 con 0x563c26b0fd00 2023-10-09T15:31:59.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa277fe700 1 -- 172.21.15.33:0/3367931663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa300095b0 con 0x563c26b0fd00 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 -- 172.21.15.33:0/3367931663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 msgr2=0x563c26aeea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7faa30006af0 tx=0x7faa3001a000 comp rx=0 tx=0).stop 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 -- 172.21.15.33:0/3367931663 shutdown_connections 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac1cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26ac5a50 0x563c26ac5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/3367931663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26b0fd00 0x563c26aeea20 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 -- 172.21.15.33:0/3367931663 >> 172.21.15.33:0/3367931663 conn(0x563c26ac7370 msgr2=0x563c26ac7740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 -- 172.21.15.33:0/3367931663 shutdown_connections 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.859+0000 7faa55fb6b80 1 -- 172.21.15.33:0/3367931663 wait complete. 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.860+0000 7faa55fb6b80 1 -- start start 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.860+0000 7faa55fb6b80 1 Processor -- start 2023-10-09T15:31:59.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b03c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b1fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c269c1890 con 0x563c26ac5a50 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c269dcea0 con 0x563c26b0fd00 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c26898e30 con 0x563c26aeef60 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa55fb6b80 10 client.0 _ll_register_callbacks cb 0x563c26a89110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51730/0 (socket says 172.21.15.33:51730) 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 -- 172.21.15.33:0/2282199201 learned_addr learned my addr 172.21.15.33:0/2282199201 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 -- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 msgr2=0x563c26b03c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b03c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa46d9d700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b1fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 -- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 msgr2=0x563c26b1fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b1fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 -- 172.21.15.33:0/2282199201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa34003570 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa4659c700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faa40007b70 tx=0x7faa40018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81ec061e555d6f7b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.861+0000 7faa24ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40014ea0 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa400223f0 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563c26abab70 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa400227c0 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 10 client.5151 fetch_fsmap learned FSMap version 16 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563c26852fe0 con 0x563c26ac5a50 2023-10-09T15:31:59.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563c26abab70 con 0x563c26ac5a50 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa40022920 con 0x563c26ac5a50 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 10 client.5151 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 10 client.5151 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 20 client.5151 populate_metadata read hostname 'smithi033' 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b042b0 0x563c26af4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 4 client.5151 mds_command: new command op to 4938 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 --> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563c26a97aa0 con 0x563c26b042b0 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.862+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b042b0 0x563c26af4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa24ff9700 10 client.5151 ms_handle_connect on v2:172.21.15.33:6834/3091408111 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b042b0 0x563c26af4ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97ae77bd9fb6fc68 server_cookie=b2d4d8991c5fabda in_seq=0 out_seq=0 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa24ff9700 1 -- 172.21.15.33:0/2282199201 <== mds.0 v2:172.21.15.33:6834/3091408111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563c26a97aa0 con 0x563c26b042b0 2023-10-09T15:31:59.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa24ff9700 10 client.5151 handle_command_reply: tid=0 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 client.5151 shutdown 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 msgr2=0x563c26b0a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7faa40007b70 tx=0x7faa40018000 comp rx=0 tx=0).stop 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 shutdown_connections 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b042b0 0x563c26af4ee0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b0a080 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b1fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa24ff9700 0 client.5151 ms_handle_reset on v2:172.21.15.33:6834/3091408111 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2282199201 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b03c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 >> 172.21.15.33:0/2282199201 conn(0x563c26ac7370 msgr2=0x563c26b0b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 shutdown_connections 2023-10-09T15:31:59.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.863+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2282199201 wait complete. 2023-10-09T15:31:59.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.864+0000 7faa55fb6b80 20 client.5151 trim_cache size 0 max 16384 2023-10-09T15:31:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.881+0000 7faa55fb6b80 1 Processor -- start 2023-10-09T15:31:59.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.881+0000 7faa55fb6b80 1 -- start start 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.881+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.881+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.881+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26ac7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26aebae0 con 0x563c26ac5a50 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26b2eab0 con 0x563c26b0fd00 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c26b200a0 con 0x563c26aeef60 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51746/0 (socket says 172.21.15.33:51746) 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 -- 172.21.15.33:0/13696416 learned_addr learned my addr 172.21.15.33:0/13696416 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 -- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 msgr2=0x563c26b683d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 -- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 msgr2=0x563c26ac7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26ac7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 -- 172.21.15.33:0/13696416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563c269e4780 con 0x563c26ac5a50 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa4659c700 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faa40022fd0 tx=0x7faa40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28d8e7a3cd3c4cf5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa27fff700 1 -- 172.21.15.33:0/13696416 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40004cd0 con 0x563c26ac5a50 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa27fff700 1 -- 172.21.15.33:0/13696416 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa40014a10 con 0x563c26ac5a50 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.882+0000 7faa27fff700 1 -- 172.21.15.33:0/13696416 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa40022a10 con 0x563c26ac5a50 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- 172.21.15.33:0/13696416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 msgr2=0x563c26b02f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7faa40022fd0 tx=0x7faa40019000 comp rx=0 tx=0).stop 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- 172.21.15.33:0/13696416 shutdown_connections 2023-10-09T15:31:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b02f20 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26ac7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/13696416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26b683d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- 172.21.15.33:0/13696416 >> 172.21.15.33:0/13696416 conn(0x563c26ac7370 msgr2=0x563c26ac1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- 172.21.15.33:0/13696416 shutdown_connections 2023-10-09T15:31:59.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- 172.21.15.33:0/13696416 wait complete. 2023-10-09T15:31:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 -- start start 2023-10-09T15:31:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.883+0000 7faa55fb6b80 1 Processor -- start 2023-10-09T15:31:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac7b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b0ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26b074e0 con 0x563c26ac5a50 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563c26b68da0 con 0x563c26b0fd00 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563c26b07290 con 0x563c26aeef60 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa55fb6b80 10 client.0 _ll_register_callbacks cb 0x563c26a89110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa4659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51750/0 (socket says 172.21.15.33:51750) 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.884+0000 7faa4659c700 1 -- 172.21.15.33:0/2199343894 learned_addr learned my addr 172.21.15.33:0/2199343894 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa46d9d700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b0ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 -- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 msgr2=0x563c26ac7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 -- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 msgr2=0x563c26b0ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b0ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 -- 172.21.15.33:0/2199343894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563c26852fe0 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa4659c700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faa40001860 tx=0x7faa40036040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d383b025873784ca server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa400229d0 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa4003d650 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7faa30023040 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=16) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa4003da20 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 10 client.5157 fetch_fsmap learned FSMap version 16 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=16,monmap=2+}) v3 -- 0x563c269cb470 con 0x563c26ac5a50 2023-10-09T15:31:59.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30023040 con 0x563c26ac5a50 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 16) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa4003db80 con 0x563c26ac5a50 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 10 client.5157 fetch_fsmap finished waiting for FSMap version 16 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 10 client.5157 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 20 client.5157 populate_metadata read hostname 'smithi033' 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b02660 0x563c26b67430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 4 client.5157 mds_command: new command op to 4938 tid=0[{"prefix": "status"}] 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.885+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 --> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563c269b8e00 con 0x563c26b02660 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b02660 0x563c26b67430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa24ff9700 10 client.5157 ms_handle_connect on v2:172.21.15.33:6834/3091408111 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa45d9b700 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b02660 0x563c26b67430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78ecb0aa12d3d36c server_cookie=57505953daf12e71 in_seq=0 out_seq=0 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa24ff9700 1 -- 172.21.15.33:0/2199343894 <== mds.0 v2:172.21.15.33:6834/3091408111 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+318 (crc 0 0 0) 0x563c269b8e00 con 0x563c26b02660 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa24ff9700 10 client.5157 handle_command_reply: tid=0 2023-10-09T15:31:59.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 client.5157 shutdown 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 msgr2=0x563c26b683d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7faa40001860 tx=0x7faa40036040 comp rx=0 tx=0).stop 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 shutdown_connections 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:6834/3091408111,v1:172.21.15.33:6836/3091408111] conn(0x563c26b02660 0x563c26b67430 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563c26ac5a50 0x563c26b683d0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa24ff9700 0 client.5157 ms_handle_reset on v2:172.21.15.33:6834/3091408111 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563c26b0fd00 0x563c26b0ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 --2- 172.21.15.33:0/2199343894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563c26aeef60 0x563c26ac7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 >> 172.21.15.33:0/2199343894 conn(0x563c26ac7370 msgr2=0x563c26ac8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 shutdown_connections 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 1 -- 172.21.15.33:0/2199343894 wait complete. 2023-10-09T15:31:59.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.886+0000 7faa55fb6b80 20 client.5157 trim_cache size 0 max 16384 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 4938, 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.444315969, 2023-10-09T15:31:59.893 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 16, 2023-10-09T15:31:59.894 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 32, 2023-10-09T15:31:59.894 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 32, 2023-10-09T15:31:59.894 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 19.32818129 2023-10-09T15:31:59.894 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:31:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 msgr2=0x7faa280693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 0x7faa280693e0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7faa400013d0 tx=0x7faa40006040 comp rx=0 tx=0).stop 2023-10-09T15:31:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 msgr2=0x7faa48154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:31:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7faa480d1750 tx=0x7faa38009040 comp rx=0 tx=0).stop 2023-10-09T15:31:59.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 shutdown_connections 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa28066f30 0x7faa280693e0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa48159600 0x7faa48154d10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa34004810 0x7faa480af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 --2- 172.21.15.33:0/2058328881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa4816e000 0x7faa48152b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 >> 172.21.15.33:0/2058328881 conn(0x7faa48070e30 msgr2=0x7faa480d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 shutdown_connections 2023-10-09T15:31:59.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:31:59.887+0000 7faa4ccbe700 1 -- 172.21.15.33:0/2058328881 wait complete. 2023-10-09T15:31:59.899 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:32:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.018+0000 7fb166fa5700 1 Processor -- start 2023-10-09T15:32:00.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.018+0000 7fb166fa5700 1 -- start start 2023-10-09T15:32:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb166fa5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1600cb970 0x7fb160159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb166fa5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16015ae40 con 0x7fb16015a400 2023-10-09T15:32:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb166fa5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb16015ab60 con 0x7fb1600cb5a0 2023-10-09T15:32:00.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb166fa5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1600ce0f0 con 0x7fb1600cb970 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb165542700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb16015a400 0x7fb160156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41212/0 (socket says 172.21.15.33:41212) 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb165542700 1 -- 172.21.15.33:0/1452217318 learned_addr learned my addr 172.21.15.33:0/1452217318 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb15ffff700 1 --2- 172.21.15.33:0/1452217318 >> v2:172.21.15.59:3300/0 conn(0x7fb1600cb970 0x7fb160159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2603233454 0 0) 0x7fb16015ae40 con 0x7fb16015a400 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.019+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb14c003570 con 0x7fb16015a400 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15ffff700 1 -- 172.21.15.33:0/1452217318 >> v1:172.21.15.59:6789/0 conn(0x7fb1600cb5a0 legacy=0x7fb1600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15ffff700 1 -- 172.21.15.33:0/1452217318 >> v1:172.21.15.33:6789/0 conn(0x7fb16015a400 legacy=0x7fb160156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2260255308 0 0) 0x7fb16015ab60 con 0x7fb1600cb5a0 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15ffff700 1 -- 172.21.15.33:0/1452217318 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1600ccf00 con 0x7fb1600cb970 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15ffff700 1 --2- 172.21.15.33:0/1452217318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb160159ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e60 tx=0x7fb150009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c94518b1099f151b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:00.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb15000e070 con 0x7fb1600cb970 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb15000b850 con 0x7fb1600cb970 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb15f7fe700 1 -- 172.21.15.33:0/1452217318 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb158001470 con 0x7fb1600cb970 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb166fa5700 1 -- 172.21.15.33:0/1452217318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 msgr2=0x7fb160159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.020+0000 7fb166fa5700 1 --2- 172.21.15.33:0/1452217318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb160159ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fb150009e60 tx=0x7fb150009780 comp rx=0 tx=0).stop 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.021+0000 7fb166fa5700 1 -- 172.21.15.33:0/1452217318 shutdown_connections 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.021+0000 7fb166fa5700 1 --2- 172.21.15.33:0/1452217318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb160159ec0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.021+0000 7fb166fa5700 1 -- 172.21.15.33:0/1452217318 >> 172.21.15.33:0/1452217318 conn(0x7fb160070e30 msgr2=0x7fb1600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.021+0000 7fb166fa5700 1 -- 172.21.15.33:0/1452217318 shutdown_connections 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.021+0000 7fb166fa5700 1 -- 172.21.15.33:0/1452217318 wait complete. 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 Processor -- start 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 -- start start 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb1600b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16015a400 0x7fb160159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1601579f0 con 0x7fb1600cb5a0 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb160157cd0 con 0x7fb1600cb970 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.022+0000 7fb166fa5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb160157fb0 con 0x7fb16015a400 2023-10-09T15:32:00.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51756/0 (socket says 172.21.15.33:51756) 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 -- 172.21.15.33:0/655620912 learned_addr learned my addr 172.21.15.33:0/655620912 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb165542700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16015a400 0x7fb160159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb15ffff700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb1600b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 -- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16015a400 msgr2=0x7fb160159a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16015a400 0x7fb160159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 -- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 msgr2=0x7fb1600b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb1600b5e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 -- 172.21.15.33:0/655620912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb150009a20 con 0x7fb1600cb5a0 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb164d41700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c7e0 tx=0x7fb148007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:00.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148012700 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb148012880 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb148012c40 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb160158290 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.023+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1600b63b0 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.024+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb16004c3c0 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.025+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb14801b400 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.025+0000 7fb15cff9700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.025+0000 7fb15ffff700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.025+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb148084120 con 0x7fb1600cb5a0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.026+0000 7fb15ffff700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 0x7fb1400693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1500099f0 tx=0x7fb150017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:00.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.029+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb148051370 con 0x7fb1600cb5a0 2023-10-09T15:32:00.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.267+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb1600b34b0 con 0x7fb1600cb5a0 2023-10-09T15:32:00.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.268+0000 7fb15cff9700 1 -- 172.21.15.33:0/655620912 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb148054990 con 0x7fb1600cb5a0 2023-10-09T15:32:00.267 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 msgr2=0x7fb1400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 0x7fb1400693e0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fb1500099f0 tx=0x7fb150017000 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 msgr2=0x7fb1600b5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb14800c7e0 tx=0x7fb148007df0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 shutdown_connections 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.269+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb140066f30 0x7fb1400693e0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1600cb5a0 0x7fb1600b5100 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb16015a400 0x7fb160159a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 --2- 172.21.15.33:0/655620912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1600cb970 0x7fb1600b5e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:00.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 >> 172.21.15.33:0/655620912 conn(0x7fb160070e30 msgr2=0x7fb160155c40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:00.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 shutdown_connections 2023-10-09T15:32:00.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:00.270+0000 7fb166fa5700 1 -- 172.21.15.33:0/655620912 wait complete. 2023-10-09T15:32:00.281 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:32:00.282 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:00.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.282 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.298 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42367sec preferred_lft 42367sec 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.299 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.300 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:32:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:32:00.301 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:00.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.301 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:32:00.362 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:32:00.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.364 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:32:00.420 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:32:00.420 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:32:00.420 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:32:00.420 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:32:00.420 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:32:00.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:32:00.421 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:32:00.522 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.522 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:32:00.537 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:32:00.537 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:32:00.537 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:00.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:32:00.603 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:00.603 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:00.657 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:00.658 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:00.658 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:00.712 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:32:00.712 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:32:00.712 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:00.793 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:00.793 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:00.794 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:00.802 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:00.802 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:00.802 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:00.802 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:00.802 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:00.824 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:00.824 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:00.825 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:00.825 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:00.825 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:00.825 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:32:00.825 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:32:00.826 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:32:00.827 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:32:00.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:00.828 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:00.893 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:32:01.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.053+0000 7f4e0cd7c700 1 Processor -- start 2023-10-09T15:32:01.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.053+0000 7f4e0cd7c700 1 -- start start 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0cd7c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4e080cb970 0x7f4e08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0cd7c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e0815a400 0x7f4e08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0cd7c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e0815ae40 con 0x7f4e080cb5a0 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0cd7c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e080ce0f0 con 0x7f4e0815a400 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0cd7c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e080d13f0 con 0x7f4e080cb970 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e0815a400 0x7f4e08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4e0815a400 0x7f4e08156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54812/0 (socket says 172.21.15.33:54812) 2023-10-09T15:32:01.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 -- 172.21.15.33:0/38262901 learned_addr learned my addr 172.21.15.33:0/38262901 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e05d9b700 1 --2- 172.21.15.33:0/38262901 >> v2:172.21.15.59:3300/0 conn(0x7f4e080cb970 0x7f4e08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 -- 172.21.15.33:0/38262901 >> v2:172.21.15.59:3300/0 conn(0x7f4e080cb970 msgr2=0x7f4e08159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 --2- 172.21.15.33:0/38262901 >> v2:172.21.15.59:3300/0 conn(0x7f4e080cb970 0x7f4e08159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 -- 172.21.15.33:0/38262901 >> v1:172.21.15.59:6789/0 conn(0x7f4e080cb5a0 legacy=0x7f4e080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 -- 172.21.15.33:0/38262901 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e0815ab60 con 0x7f4e0815a400 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e06d9d700 1 --2- 172.21.15.33:0/38262901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e0815a400 0x7f4e08156e90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e080d1780 tx=0x7f4e00009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a08753b226f4f94e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0559a700 1 -- 172.21.15.33:0/38262901 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e0000e070 con 0x7f4e0815a400 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0559a700 1 -- 172.21.15.33:0/38262901 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e0000ba20 con 0x7f4e0815a400 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.054+0000 7f4e0559a700 1 -- 172.21.15.33:0/38262901 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e000092e0 con 0x7f4e0815a400 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/38262901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e0815a400 msgr2=0x7f4e08156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/38262901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e0815a400 0x7f4e08156e90 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f4e080d1780 tx=0x7f4e00009840 comp rx=0 tx=0).stop 2023-10-09T15:32:01.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/38262901 shutdown_connections 2023-10-09T15:32:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/38262901 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e0815a400 0x7f4e08156e90 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/38262901 >> v2:172.21.15.59:3300/0 conn(0x7f4e080cb970 0x7f4e08159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/38262901 >> 172.21.15.33:0/38262901 conn(0x7f4e08070e30 msgr2=0x7f4e080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/38262901 shutdown_connections 2023-10-09T15:32:01.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.055+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/38262901 wait complete. 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.056+0000 7f4e0cd7c700 1 Processor -- start 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.056+0000 7f4e0cd7c700 1 -- start start 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e080cb5a0 0x7f4e080b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0815a400 0x7f4e080c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e0816cae0 con 0x7f4e080cb970 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e080b3790 con 0x7f4e080cb5a0 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e0cd7c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e081699c0 con 0x7f4e0815a400 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54826/0 (socket says 172.21.15.33:54826) 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 -- 172.21.15.33:0/4042887800 learned_addr learned my addr 172.21.15.33:0/4042887800 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 -- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0815a400 msgr2=0x7f4e080c8810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0815a400 0x7f4e080c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 -- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e080cb5a0 msgr2=0x7f4e080b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e080cb5a0 0x7f4e080b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.057+0000 7f4e05d9b700 1 -- 172.21.15.33:0/4042887800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e00009ae0 con 0x7f4e080cb970 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4e05d9b700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4df000ec80 tx=0x7f4df00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000c9d0 con 0x7f4e080cb970 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000cb50 con 0x7f4e080cb970 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0013470 con 0x7f4e080cb970 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e08169ca0 con 0x7f4e080cb970 2023-10-09T15:32:01.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.058+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e0816a260 con 0x7f4e080cb970 2023-10-09T15:32:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.059+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e0816cc50 con 0x7f4e080cb970 2023-10-09T15:32:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.059+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4df0013860 con 0x7f4e080cb970 2023-10-09T15:32:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.059+0000 7f4dfe7fc700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.060+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4df0084900 con 0x7f4e080cb970 2023-10-09T15:32:01.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.060+0000 7f4e0659c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:01.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.060+0000 7f4e0659c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 0x7f4de80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4e080cfbb0 tx=0x7f4df8007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:01.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.064+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4e0816cc50 con 0x7f4e080cb970 2023-10-09T15:32:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.303+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f4e0816cc20 con 0x7f4e080cb970 2023-10-09T15:32:01.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.303+0000 7f4dfe7fc700 1 -- 172.21.15.33:0/4042887800 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v16) v1 ==== 53+0+73 (secure 0 0 0) 0x7f4df0051b70 con 0x7f4e080cb970 2023-10-09T15:32:01.303 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:32:01.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 msgr2=0x7f4de80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 0x7f4de80693e0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f4e080cfbb0 tx=0x7f4df8007b40 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 msgr2=0x7f4e080b5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4df000ec80 tx=0x7f4df00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 shutdown_connections 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4de8066f30 0x7f4de80693e0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4e0815a400 0x7f4e080c8810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4e080cb5a0 0x7f4e080b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 --2- 172.21.15.33:0/4042887800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4e080cb970 0x7f4e080b5eb0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 >> 172.21.15.33:0/4042887800 conn(0x7f4e08070e30 msgr2=0x7f4e080b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:01.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.305+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 shutdown_connections 2023-10-09T15:32:01.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:01.306+0000 7f4e0cd7c700 1 -- 172.21.15.33:0/4042887800 wait complete. 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:32:01.318 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:01.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.319 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:32:01.337 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:32:01.338 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42375sec preferred_lft 42375sec 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:01.339 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:01.340 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:32:01.341 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:32:01.341 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:01.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.341 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:32:01.407 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:32:01.408 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.409 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:32:01.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:32:01.470 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:32:01.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.583 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:32:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:32:01.599 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:32:01.600 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:01.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.600 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:32:01.667 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:01.667 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:01.722 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:01.723 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:01.723 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:01.777 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:32:01.778 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:32:01.778 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:01.859 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:01.860 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:01.860 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:01.868 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:32:01.891 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:32:01.893 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:32:01.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:01.894 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:01.958 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:32:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.096+0000 7f838f315700 1 Processor -- start 2023-10-09T15:32:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.096+0000 7f838f315700 1 -- start start 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838f315700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f838806c6a0 0x7f838806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838f315700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880af670 con 0x7f83880aa740 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838f315700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f83880aa2b0 con 0x7f8388159940 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838f315700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f838806d080 con 0x7f838806c6a0 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838d8b2700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f83880aa740 0x7f83880aab90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51410/0 (socket says 172.21.15.33:51410) 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.097+0000 7f838d8b2700 1 -- 172.21.15.33:0/3594706019 learned_addr learned my addr 172.21.15.33:0/3594706019 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f838c8b0700 1 --2- 172.21.15.33:0/3594706019 >> v2:172.21.15.59:3300/0 conn(0x7f838806c6a0 0x7f838806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f8387fff700 1 -- 172.21.15.33:0/3594706019 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2963904804 0 0) 0x7f8380001490 con 0x7f83880aa740 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f8387fff700 1 -- 172.21.15.33:0/3594706019 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8370003570 con 0x7f83880aa740 2023-10-09T15:32:02.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f838c8b0700 1 -- 172.21.15.33:0/3594706019 >> v1:172.21.15.59:6789/0 conn(0x7f8388159940 legacy=0x7f83880b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f838c8b0700 1 -- 172.21.15.33:0/3594706019 >> v1:172.21.15.33:6789/0 conn(0x7f83880aa740 legacy=0x7f83880aab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f838c8b0700 1 -- 172.21.15.33:0/3594706019 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83880b12a0 con 0x7f838806c6a0 2023-10-09T15:32:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f838c8b0700 1 --2- 172.21.15.33:0/3594706019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f838806cb40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f837c0098e0 tx=0x7f837c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=78585655fdb8ba8c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f8387fff700 1 -- 172.21.15.33:0/3594706019 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00b640 con 0x7f838806c6a0 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f8387fff700 1 -- 172.21.15.33:0/3594706019 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f837c00b7a0 con 0x7f838806c6a0 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.098+0000 7f8387fff700 1 -- 172.21.15.33:0/3594706019 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f837c00bb40 con 0x7f838806c6a0 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 -- 172.21.15.33:0/3594706019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 msgr2=0x7f838806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 --2- 172.21.15.33:0/3594706019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f838806cb40 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f837c0098e0 tx=0x7f837c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 -- 172.21.15.33:0/3594706019 shutdown_connections 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 --2- 172.21.15.33:0/3594706019 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f838806cb40 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 -- 172.21.15.33:0/3594706019 >> 172.21.15.33:0/3594706019 conn(0x7f83880cd3e0 msgr2=0x7f83880cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:02.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 -- 172.21.15.33:0/3594706019 shutdown_connections 2023-10-09T15:32:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.099+0000 7f838f315700 1 -- 172.21.15.33:0/3594706019 wait complete. 2023-10-09T15:32:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.100+0000 7f838f315700 1 Processor -- start 2023-10-09T15:32:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.100+0000 7f838f315700 1 -- start start 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f8388157e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83880aa740 0x7f83880c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83881697f0 con 0x7f8388159940 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8388169a70 con 0x7f838806c6a0 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838f315700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83880c2c40 con 0x7f83880aa740 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54830/0 (socket says 172.21.15.33:54830) 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 -- 172.21.15.33:0/3565894346 learned_addr learned my addr 172.21.15.33:0/3565894346 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:02.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d0b1700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f8388157e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838c8b0700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83880aa740 0x7f83880c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 -- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83880aa740 msgr2=0x7f83880c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83880aa740 0x7f83880c2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 -- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 msgr2=0x7f8388157e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f8388157e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d8b2700 1 -- 172.21.15.33:0/3565894346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f837c009420 con 0x7f8388159940 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.101+0000 7f838d0b1700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f8388157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f838d8b2700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f838000cd00 tx=0x7f8380001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f838000ab70 con 0x7f8388159940 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f838000acd0 con 0x7f8388159940 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83880c2f20 con 0x7f8388159940 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8380007300 con 0x7f8388159940 2023-10-09T15:32:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.102+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83881583d0 con 0x7f8388159940 2023-10-09T15:32:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.103+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83880c3440 con 0x7f8388159940 2023-10-09T15:32:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.103+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f83800076b0 con 0x7f8388159940 2023-10-09T15:32:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.104+0000 7f83857fa700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.104+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8380084800 con 0x7f8388159940 2023-10-09T15:32:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.104+0000 7f838d0b1700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:02.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.104+0000 7f838d0b1700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 0x7f83740693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f838815e210 tx=0x7f8378009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:02.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.108+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f83880c3440 con 0x7f8388159940 2023-10-09T15:32:02.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:02.351+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f83880af670 con 0x7f8388159940 2023-10-09T15:32:03.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.213+0000 7f83857fa700 1 -- 172.21.15.33:0/3565894346 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v17) v1 ==== 136+0+0 (secure 0 0 0) 0x7f83880af670 con 0x7f8388159940 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 msgr2=0x7f83740693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 0x7f83740693e0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f838815e210 tx=0x7f8378009040 comp rx=0 tx=0).stop 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 msgr2=0x7f8388068aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f838000cd00 tx=0x7f8380001ad0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 shutdown_connections 2023-10-09T15:32:03.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8374066f30 0x7f83740693e0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8388159940 0x7f8388068aa0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f838806c6a0 0x7f8388157e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 --2- 172.21.15.33:0/3565894346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f83880aa740 0x7f83880c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 >> 172.21.15.33:0/3565894346 conn(0x7f83880cd3e0 msgr2=0x7f8388067680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 shutdown_connections 2023-10-09T15:32:03.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.216+0000 7f838f315700 1 -- 172.21.15.33:0/3565894346 wait complete. 2023-10-09T15:32:03.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:32:03.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 Processor -- start 2023-10-09T15:32:03.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 -- start start 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140cf200 0x7fdb140c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb140b0ba0 0x7fdb1406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb1415a280 con 0x7fdb140b07d0 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb1406e180 con 0x7fdb140b0ba0 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.357+0000 7fdb19368700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1406d850 con 0x7fdb140cf200 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb140b0ba0 0x7fdb1406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdb140b0ba0 0x7fdb1406e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54840/0 (socket says 172.21.15.33:54840) 2023-10-09T15:32:03.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 -- 172.21.15.33:0/3264637095 learned_addr learned my addr 172.21.15.33:0/3264637095 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb127fc700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140cf200 0x7fdb140c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 -- 172.21.15.33:0/3264637095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140cf200 msgr2=0x7fdb140c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140cf200 0x7fdb140c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 -- 172.21.15.33:0/3264637095 >> v1:172.21.15.59:6789/0 conn(0x7fdb140b07d0 legacy=0x7fdb140ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 -- 172.21.15.33:0/3264637095 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb1406db30 con 0x7fdb140b0ba0 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb137fe700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140b0ba0 0x7fdb1406e610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009f20 tx=0x7fdb0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2a14db16d65b25a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb11ffb700 1 -- 172.21.15.33:0/3264637095 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c00e070 con 0x7fdb140b0ba0 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb11ffb700 1 -- 172.21.15.33:0/3264637095 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c00ba80 con 0x7fdb140b0ba0 2023-10-09T15:32:03.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.358+0000 7fdb11ffb700 1 -- 172.21.15.33:0/3264637095 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0092e0 con 0x7fdb140b0ba0 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 -- 172.21.15.33:0/3264637095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140b0ba0 msgr2=0x7fdb1406e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140b0ba0 0x7fdb1406e610 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c009f20 tx=0x7fdb0c009840 comp rx=0 tx=0).stop 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 -- 172.21.15.33:0/3264637095 shutdown_connections 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140b0ba0 0x7fdb1406e610 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 --2- 172.21.15.33:0/3264637095 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140cf200 0x7fdb140c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 -- 172.21.15.33:0/3264637095 >> 172.21.15.33:0/3264637095 conn(0x7fdb1406ce80 msgr2=0x7fdb140ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 -- 172.21.15.33:0/3264637095 shutdown_connections 2023-10-09T15:32:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.359+0000 7fdb19368700 1 -- 172.21.15.33:0/3264637095 wait complete. 2023-10-09T15:32:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.360+0000 7fdb19368700 1 Processor -- start 2023-10-09T15:32:03.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.360+0000 7fdb19368700 1 -- start start 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 0x7fdb14168f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb140b0ba0 0x7fdb14156c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb1416a450 con 0x7fdb140cf200 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14169840 con 0x7fdb140b0ba0 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb19368700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb14169b20 con 0x7fdb140b07d0 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54848/0 (socket says 172.21.15.33:54848) 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 -- 172.21.15.33:0/1563572208 learned_addr learned my addr 172.21.15.33:0/1563572208 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb127fc700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb140b0ba0 0x7fdb14156c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb12ffd700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 0x7fdb14168f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 -- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 msgr2=0x7fdb14168f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 0x7fdb14168f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 -- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb140b0ba0 msgr2=0x7fdb14156c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb140b0ba0 0x7fdb14156c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 -- 172.21.15.33:0/1563572208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c009ae0 con 0x7fdb140cf200 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb12ffd700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 0x7fdb14168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.361+0000 7fdb137fe700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb1406af10 tx=0x7fdb0c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0092e0 con 0x7fdb140cf200 2023-10-09T15:32:03.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0c008dd0 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c0266b0 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb14169e00 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb14169440 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.362+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb14169600 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.363+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdb0c003040 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.363+0000 7fdb0affd700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 0x7fdaf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.363+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdb0c086230 con 0x7fdb140cf200 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.363+0000 7fdb12ffd700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 0x7fdaf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.364+0000 7fdb12ffd700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 0x7fdaf40693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb04001850 tx=0x7fdb04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.368+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb14169600 con 0x7fdb140cf200 2023-10-09T15:32:03.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.591+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb14071230 con 0x7fdaf4066f30 2023-10-09T15:32:03.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.592+0000 7fdb0affd700 1 -- 172.21.15.33:0/1563572208 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fdb14071230 con 0x7fdaf4066f30 2023-10-09T15:32:03.592 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:32:03.592 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:03.593 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:32:03.593 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:03.593 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 msgr2=0x7fdaf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 0x7fdaf40693e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdb04001850 tx=0x7fdb04009040 comp rx=0 tx=0).stop 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 msgr2=0x7fdb141571d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fdb1406af10 tx=0x7fdb0c018000 comp rx=0 tx=0).stop 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 shutdown_connections 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaf4066f30 0x7fdaf40693e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb140cf200 0x7fdb141571d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb140b07d0 0x7fdb14168f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 --2- 172.21.15.33:0/1563572208 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb140b0ba0 0x7fdb14156c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 >> 172.21.15.33:0/1563572208 conn(0x7fdb1406ce80 msgr2=0x7fdb140cd620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:03.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 shutdown_connections 2023-10-09T15:32:03.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.595+0000 7fdb19368700 1 -- 172.21.15.33:0/1563572208 wait complete. 2023-10-09T15:32:03.607 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:32:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.728+0000 7fc8953b2700 1 Processor -- start 2023-10-09T15:32:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 -- start start 2023-10-09T15:32:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 0x7fc8900c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc890159c90 0x7fc8900c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8900cd460 0x7fc8900cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900ad990 con 0x7fc8900cd460 2023-10-09T15:32:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8900c9310 con 0x7fc8901598c0 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc8953b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8900cde40 con 0x7fc890159c90 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.729+0000 7fc88f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8900cd460 0x7fc8900cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8900cd460 0x7fc8900cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54858/0 (socket says 172.21.15.33:54858) 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 -- 172.21.15.33:0/3306789703 learned_addr learned my addr 172.21.15.33:0/3306789703 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88e7fc700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc890159c90 0x7fc8900c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88effd700 1 --2- 172.21.15.33:0/3306789703 >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 0x7fc8900c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 -- 172.21.15.33:0/3306789703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc890159c90 msgr2=0x7fc8900c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc890159c90 0x7fc8900c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 -- 172.21.15.33:0/3306789703 >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 msgr2=0x7fc8900c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 --2- 172.21.15.33:0/3306789703 >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 0x7fc8900c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 -- 172.21.15.33:0/3306789703 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8900ce090 con 0x7fc8900cd460 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88effd700 1 --2- 172.21.15.33:0/3306789703 >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 0x7fc8900c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88f7fe700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900cd900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc89006ab90 tx=0x7fc880009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6792de96185ccbd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88dffb700 1 -- 172.21.15.33:0/3306789703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc880009e70 con 0x7fc8900cd460 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88dffb700 1 -- 172.21.15.33:0/3306789703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88000b860 con 0x7fc8900cd460 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.730+0000 7fc88dffb700 1 -- 172.21.15.33:0/3306789703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88000bc00 con 0x7fc8900cd460 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 -- 172.21.15.33:0/3306789703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 msgr2=0x7fc8900cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900cd900 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fc89006ab90 tx=0x7fc880009250 comp rx=0 tx=0).stop 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 -- 172.21.15.33:0/3306789703 shutdown_connections 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3306789703 >> v2:172.21.15.59:3300/0 conn(0x7fc8901598c0 0x7fc8900c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900cd900 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3306789703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc890159c90 0x7fc8900c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 -- 172.21.15.33:0/3306789703 >> 172.21.15.33:0/3306789703 conn(0x7fc890088000 msgr2=0x7fc8900883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:03.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 -- 172.21.15.33:0/3306789703 shutdown_connections 2023-10-09T15:32:03.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.731+0000 7fc8953b2700 1 -- 172.21.15.33:0/3306789703 wait complete. 2023-10-09T15:32:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.732+0000 7fc8953b2700 1 Processor -- start 2023-10-09T15:32:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.732+0000 7fc8953b2700 1 -- start start 2023-10-09T15:32:03.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8901598c0 0x7fc890155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc890159c90 0x7fc8900c9e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8901697f0 con 0x7fc8900cd460 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc890169ad0 con 0x7fc890159c90 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc8953b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc890169db0 con 0x7fc8901598c0 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54874/0 (socket says 172.21.15.33:54874) 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 -- 172.21.15.33:0/3650115045 learned_addr learned my addr 172.21.15.33:0/3650115045 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:03.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88e7fc700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8901598c0 0x7fc890155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88f7fe700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc890159c90 0x7fc8900c9e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 -- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8901598c0 msgr2=0x7fc890155b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8901598c0 0x7fc890155b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 -- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc890159c90 msgr2=0x7fc8900c9e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc890159c90 0x7fc8900c9e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 -- 172.21.15.33:0/3650115045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8800094f0 con 0x7fc8900cd460 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc88effd700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc88800d1d0 tx=0x7fc888009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.733+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88800dd10 con 0x7fc8900cd460 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.734+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88800f040 con 0x7fc8900cd460 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.734+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc89016a090 con 0x7fc8900cd460 2023-10-09T15:32:03.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.734+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888015670 con 0x7fc8900cd460 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.734+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8901694e0 con 0x7fc8900cd460 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.734+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8900aebf0 con 0x7fc8900cd460 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.735+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc888015a60 con 0x7fc8900cd460 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.735+0000 7fc886ffd700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 0x7fc8700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.735+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc888084880 con 0x7fc8900cd460 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.735+0000 7fc88e7fc700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 0x7fc8700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.736+0000 7fc88e7fc700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 0x7fc8700693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8900caa50 tx=0x7fc8780091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:03.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.740+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc88804e5a0 con 0x7fc8900cd460 2023-10-09T15:32:03.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.934+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc89004c3c0 con 0x7fc8900cd460 2023-10-09T15:32:03.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.935+0000 7fc886ffd700 1 -- 172.21.15.33:0/3650115045 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc88801a0c0 con 0x7fc8900cd460 2023-10-09T15:32:03.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 msgr2=0x7fc8700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 0x7fc8700693e0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fc8900caa50 tx=0x7fc8780091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 msgr2=0x7fc8900b23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc88800d1d0 tx=0x7fc888009a90 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 shutdown_connections 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc870066f30 0x7fc8700693e0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8900cd460 0x7fc8900b23b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc890159c90 0x7fc8900c9e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 --2- 172.21.15.33:0/3650115045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8901598c0 0x7fc890155b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.936+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 >> 172.21.15.33:0/3650115045 conn(0x7fc890088000 msgr2=0x7fc8900883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.937+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 shutdown_connections 2023-10-09T15:32:03.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:03.937+0000 7fc8953b2700 1 -- 172.21.15.33:0/3650115045 wait complete. 2023-10-09T15:32:03.949 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000864443 2023-10-09T15:32:04.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.070+0000 7f851fd50700 1 Processor -- start 2023-10-09T15:32:04.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.070+0000 7f851fd50700 1 -- start start 2023-10-09T15:32:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851fd50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 0x7f8518159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851fd50700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f851806e0e0 0x7f85180cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851fd50700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85180ccfd0 con 0x7f8518159530 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851fd50700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851815a3d0 con 0x7f851806e0e0 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851fd50700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851815a6b0 con 0x7f851806dc70 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f851806e0e0 0x7f85180cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f851806e0e0 0x7f85180cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54876/0 (socket says 172.21.15.33:54876) 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 -- 172.21.15.33:0/3417204746 learned_addr learned my addr 172.21.15.33:0/3417204746 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851d2eb700 1 --2- 172.21.15.33:0/3417204746 >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 0x7f8518159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 -- 172.21.15.33:0/3417204746 >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 msgr2=0x7f8518159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 --2- 172.21.15.33:0/3417204746 >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 0x7f8518159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:04.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 -- 172.21.15.33:0/3417204746 >> v1:172.21.15.59:6789/0 conn(0x7f8518159530 legacy=0x7f85180ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 -- 172.21.15.33:0/3417204746 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851815a990 con 0x7f851806e0e0 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851d2eb700 1 --2- 172.21.15.33:0/3417204746 >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 0x7f8518159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851e2ed700 1 --2- 172.21.15.33:0/3417204746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f85180cb6f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85180b66e0 tx=0x7f8510009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=841135f2fb98094 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.071+0000 7f851caea700 1 -- 172.21.15.33:0/3417204746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000b860 con 0x7f851806e0e0 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851caea700 1 -- 172.21.15.33:0/3417204746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f851000b9c0 con 0x7f851806e0e0 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851caea700 1 -- 172.21.15.33:0/3417204746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f851000bd60 con 0x7f851806e0e0 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 -- 172.21.15.33:0/3417204746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 msgr2=0x7f85180cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:04.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 --2- 172.21.15.33:0/3417204746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f85180cb6f0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f85180b66e0 tx=0x7f8510009250 comp rx=0 tx=0).stop 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 -- 172.21.15.33:0/3417204746 shutdown_connections 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 --2- 172.21.15.33:0/3417204746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f85180cb6f0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 --2- 172.21.15.33:0/3417204746 >> v2:172.21.15.59:3300/0 conn(0x7f851806dc70 0x7f8518159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 -- 172.21.15.33:0/3417204746 >> 172.21.15.33:0/3417204746 conn(0x7f85180703a0 msgr2=0x7f85180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 -- 172.21.15.33:0/3417204746 shutdown_connections 2023-10-09T15:32:04.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.072+0000 7f851fd50700 1 -- 172.21.15.33:0/3417204746 wait complete. 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.073+0000 7f851fd50700 1 Processor -- start 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.073+0000 7f851fd50700 1 -- start start 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f851806dc70 0x7f85180b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8518159530 0x7f851815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180b2370 con 0x7f851806e0e0 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85180b1760 con 0x7f8518159530 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851fd50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85180b1a40 con 0x7f851806dc70 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54888/0 (socket says 172.21.15.33:54888) 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 -- 172.21.15.33:0/2330675599 learned_addr learned my addr 172.21.15.33:0/2330675599 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851e2ed700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8518159530 0x7f851815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851daec700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f851806dc70 0x7f85180b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 -- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f851806dc70 msgr2=0x7f85180b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f851806dc70 0x7f85180b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 -- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8518159530 msgr2=0x7f851815d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8518159530 0x7f851815d570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.074+0000 7f851d2eb700 1 -- 172.21.15.33:0/2330675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85100094f0 con 0x7f851806e0e0 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f851d2eb700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c830 tx=0x7f850c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c011600 con 0x7f851806e0e0 2023-10-09T15:32:04.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c011760 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85180b1d20 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c011b20 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.075+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85180b54b0 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.076+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851804c3c0 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.076+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f850c018360 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.077+0000 7f8515ffb700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.077+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f850c084560 con 0x7f851806e0e0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.077+0000 7f851daec700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:04.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.077+0000 7f851daec700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 0x7f85040693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8508007fd0 tx=0x7f8508001650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:04.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.081+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f850c051730 con 0x7f851806e0e0 2023-10-09T15:32:04.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:04.303+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000864443", "target": ["mon-mgr", ""]}) v1 -- 0x7f851815ac70 con 0x7f8504066f30 2023-10-09T15:32:05.732 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:32:05.735 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:32:07.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.240+0000 7f8515ffb700 1 -- 172.21.15.33:0/2330675599 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f851815ac70 con 0x7f8504066f30 2023-10-09T15:32:07.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.245+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 msgr2=0x7f85040693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.245+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 0x7f85040693e0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f8508007fd0 tx=0x7f8508001650 comp rx=0 tx=0).stop 2023-10-09T15:32:07.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.245+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 msgr2=0x7f851814e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.245+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f850c00c830 tx=0x7f850c008040 comp rx=0 tx=0).stop 2023-10-09T15:32:07.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 shutdown_connections 2023-10-09T15:32:07.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8504066f30 0x7f85040693e0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8518159530 0x7f851815d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f851806dc70 0x7f85180b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 --2- 172.21.15.33:0/2330675599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f851806e0e0 0x7f851814e020 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.246+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 >> 172.21.15.33:0/2330675599 conn(0x7f85180703a0 msgr2=0x7f85180cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:07.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.247+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 shutdown_connections 2023-10-09T15:32:07.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.247+0000 7f851fd50700 1 -- 172.21.15.33:0/2330675599 wait complete. 2023-10-09T15:32:07.249 INFO:teuthology.orchestra.run.smithi033.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T15:32:07.266 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:32:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.392+0000 7f6cf277e700 1 Processor -- start 2023-10-09T15:32:07.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.392+0000 7f6cf277e700 1 -- start start 2023-10-09T15:32:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf277e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 0x7f6cec15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf277e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6cec15de50 0x7f6cec0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf277e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6cec0cf3c0 con 0x7f6cec0cef40 2023-10-09T15:32:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf277e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec15afd0 con 0x7f6cec15de50 2023-10-09T15:32:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf277e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6cec15b2b0 con 0x7f6cec153c30 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf0f7b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6cec15de50 0x7f6cec0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf1f7d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6cec0cef40 0x7f6cec06d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51426/0 (socket says 172.21.15.33:51426) 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf1f7d700 1 -- 172.21.15.33:0/1201751334 learned_addr learned my addr 172.21.15.33:0/1201751334 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf177c700 1 --2- 172.21.15.33:0/1201751334 >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 0x7f6cec15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf0f7b700 1 -- 172.21.15.33:0/1201751334 >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 msgr2=0x7f6cec15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:07.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf0f7b700 1 --2- 172.21.15.33:0/1201751334 >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 0x7f6cec15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cf0f7b700 1 -- 172.21.15.33:0/1201751334 >> v1:172.21.15.33:6789/0 conn(0x7f6cec0cef40 legacy=0x7f6cec06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.393+0000 7f6cebfff700 1 -- 172.21.15.33:0/1201751334 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412133077 0 0) 0x7f6cec0cf3c0 con 0x7f6cec0cef40 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf0f7b700 1 -- 172.21.15.33:0/1201751334 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cec15b590 con 0x7f6cec15de50 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf177c700 1 --2- 172.21.15.33:0/1201751334 >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 0x7f6cec15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf0f7b700 1 --2- 172.21.15.33:0/1201751334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec15de50 0x7f6cec0cea00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6cec06ead0 tx=0x7f6ce00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3a06d14e434c10c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cebfff700 1 -- 172.21.15.33:0/1201751334 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000b6b0 con 0x7f6cec15de50 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cebfff700 1 -- 172.21.15.33:0/1201751334 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce000b810 con 0x7f6cec15de50 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cebfff700 1 -- 172.21.15.33:0/1201751334 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce000bbb0 con 0x7f6cec15de50 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 -- 172.21.15.33:0/1201751334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec15de50 msgr2=0x7f6cec0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 --2- 172.21.15.33:0/1201751334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec15de50 0x7f6cec0cea00 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f6cec06ead0 tx=0x7f6ce00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 -- 172.21.15.33:0/1201751334 shutdown_connections 2023-10-09T15:32:07.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 --2- 172.21.15.33:0/1201751334 >> v2:172.21.15.59:3300/0 conn(0x7f6cec153c30 0x7f6cec15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 --2- 172.21.15.33:0/1201751334 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec15de50 0x7f6cec0cea00 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 -- 172.21.15.33:0/1201751334 >> 172.21.15.33:0/1201751334 conn(0x7f6cec0703a0 msgr2=0x7f6cec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 -- 172.21.15.33:0/1201751334 shutdown_connections 2023-10-09T15:32:07.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.394+0000 7f6cf277e700 1 -- 172.21.15.33:0/1201751334 wait complete. 2023-10-09T15:32:07.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 Processor -- start 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 -- start start 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cec153c30 0x7f6cec0b5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cec15de50 0x7f6cec0c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0b4870 con 0x7f6cec0cef40 2023-10-09T15:32:07.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec0b56b0 con 0x7f6cec153c30 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.396+0000 7f6cf277e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cec13e810 con 0x7f6cec15de50 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54904/0 (socket says 172.21.15.33:54904) 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 -- 172.21.15.33:0/841274701 learned_addr learned my addr 172.21.15.33:0/841274701 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf0f7b700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cec153c30 0x7f6cec0b5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf1f7d700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cec15de50 0x7f6cec0c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 -- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cec15de50 msgr2=0x7f6cec0c9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cec15de50 0x7f6cec0c9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 -- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cec153c30 msgr2=0x7f6cec0b5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cec153c30 0x7f6cec0b5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 -- 172.21.15.33:0/841274701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0009420 con 0x7f6cec0cef40 2023-10-09T15:32:07.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf177c700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c880 tx=0x7f6ce4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011600 con 0x7f6cec0cef40 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ce4011760 con 0x7f6cec0cef40 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cec0b4aa0 con 0x7f6cec0cef40 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ce4011b00 con 0x7f6cec0cef40 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.397+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cec0b5060 con 0x7f6cec0cef40 2023-10-09T15:32:07.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.398+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cec04c3c0 con 0x7f6cec0cef40 2023-10-09T15:32:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.399+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f6ce4018350 con 0x7f6cec0cef40 2023-10-09T15:32:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.399+0000 7f6ce97fa700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 0x7f6cd80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.399+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f6ce40847b0 con 0x7f6cec0cef40 2023-10-09T15:32:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.399+0000 7f6cf0f7b700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 0x7f6cd80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.400+0000 7f6cf0f7b700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 0x7f6cd80693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00091e0 tx=0x7f6ce0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.404+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ce4055130 con 0x7f6cec0cef40 2023-10-09T15:32:07.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.624+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6cec0caef0 con 0x7f6cd8066f30 2023-10-09T15:32:07.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.626+0000 7f6ce97fa700 1 -- 172.21.15.33:0/841274701 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+96 (secure 0 0 0) 0x7f6cec0caef0 con 0x7f6cd8066f30 2023-10-09T15:32:07.626 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:32:07.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:07.626 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:32:07.626 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:07.626 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:07.627 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000864443" 2023-10-09T15:32:07.627 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:07.627 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:32:07.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 msgr2=0x7f6cd80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 0x7f6cd80693e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6ce00091e0 tx=0x7f6ce0017000 comp rx=0 tx=0).stop 2023-10-09T15:32:07.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 msgr2=0x7f6cec13e2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ce400c880 tx=0x7f6ce4008040 comp rx=0 tx=0).stop 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 shutdown_connections 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6cd8066f30 0x7f6cd80693e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6cec0cef40 0x7f6cec13e2d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6cec15de50 0x7f6cec0c9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 --2- 172.21.15.33:0/841274701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6cec153c30 0x7f6cec0b5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.627+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 >> 172.21.15.33:0/841274701 conn(0x7f6cec0703a0 msgr2=0x7f6cec0cd340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:07.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.628+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 shutdown_connections 2023-10-09T15:32:07.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.628+0000 7f6cf277e700 1 -- 172.21.15.33:0/841274701 wait complete. 2023-10-09T15:32:07.639 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool ls detail --format=json 2023-10-09T15:32:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.761+0000 7f40ec135700 1 Processor -- start 2023-10-09T15:32:07.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.761+0000 7f40ec135700 1 -- start start 2023-10-09T15:32:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40ec135700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40e406e0e0 0x7f40e40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40ec135700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e40ccfd0 con 0x7f40e406dc70 2023-10-09T15:32:07.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40ec135700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40e415a3d0 con 0x7f40e4159530 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40ec135700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e415a6b0 con 0x7f40e406e0e0 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40e96d0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f40e406dc70 0x7f40e4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51428/0 (socket says 172.21.15.33:51428) 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40e96d0700 1 -- 172.21.15.33:0/250058671 learned_addr learned my addr 172.21.15.33:0/250058671 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40ea6d2700 1 --2- 172.21.15.33:0/250058671 >> v2:172.21.15.59:3300/0 conn(0x7f40e406e0e0 0x7f40e40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3765987233 0 0) 0x7f40e40ccfd0 con 0x7f40e406dc70 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.762+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f40cc003570 con 0x7f40e406dc70 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3162021346 0 0) 0x7f40cc003570 con 0x7f40e406dc70 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 >> v2:172.21.15.59:3300/0 conn(0x7f40e406e0e0 msgr2=0x7f40e40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 --2- 172.21.15.33:0/250058671 >> v2:172.21.15.59:3300/0 conn(0x7f40e406e0e0 0x7f40e40cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 >> v1:172.21.15.59:6789/0 conn(0x7f40e4159530 legacy=0x7f40e40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e415a990 con 0x7f40e406dc70 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f40d8001470 con 0x7f40e406dc70 2023-10-09T15:32:07.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 >> v1:172.21.15.33:6789/0 conn(0x7f40e406dc70 legacy=0x7f40e4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc003a60 0x7f40cc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 0x7f40cc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40cc0051c0 0x7f40cc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e415a6b0 con 0x7f40cc004810 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc00c0d0 con 0x7f40cc003a60 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40cc00c290 con 0x7f40cc0051c0 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 0x7f40cc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40ea6d2700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40cc0051c0 0x7f40cc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e9ed1700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc003a60 0x7f40cc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 -- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40cc0051c0 msgr2=0x7f40cc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40cc0051c0 0x7f40cc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 -- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc003a60 msgr2=0x7f40cc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc003a60 0x7f40cc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 -- 172.21.15.33:0/250058671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40cc003570 con 0x7f40cc004810 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40ea6d2700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40cc0051c0 0x7f40cc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40ea6d2700 1 -- 172.21.15.33:0/250058671 reap_dead start 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e96d0700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 0x7f40cc004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c3c0 tx=0x7f40d8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb3bdf49c2cca15 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800cc90 con 0x7f40cc004810 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d800cdf0 con 0x7f40cc004810 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.763+0000 7f40e8ecf700 1 -- 172.21.15.33:0/250058671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8005b50 con 0x7f40cc004810 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 -- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 msgr2=0x7f40cc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 0x7f40cc004c80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f40d800c3c0 tx=0x7f40d8001e50 comp rx=0 tx=0).stop 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 -- 172.21.15.33:0/250058671 shutdown_connections 2023-10-09T15:32:07.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 --2- 172.21.15.33:0/250058671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40cc004810 0x7f40cc004c80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 -- 172.21.15.33:0/250058671 >> 172.21.15.33:0/250058671 conn(0x7f40e40703a0 msgr2=0x7f40e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:07.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 -- 172.21.15.33:0/250058671 shutdown_connections 2023-10-09T15:32:07.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.764+0000 7f40ec135700 1 -- 172.21.15.33:0/250058671 wait complete. 2023-10-09T15:32:07.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.765+0000 7f40ec135700 1 Processor -- start 2023-10-09T15:32:07.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.765+0000 7f40ec135700 1 -- start start 2023-10-09T15:32:07.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 0x7f40e40b4f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40e4153680 0x7f40e4153b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4154060 con 0x7f40e414c6b0 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b39c0 con 0x7f40cc004810 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ec135700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40b5570 con 0x7f40e4153680 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54918/0 (socket says 172.21.15.33:54918) 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 -- 172.21.15.33:0/1912527894 learned_addr learned my addr 172.21.15.33:0/1912527894 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40ea6d2700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40e4153680 0x7f40e4153b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e9ed1700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 0x7f40e40b4f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 -- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40e4153680 msgr2=0x7f40e4153b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40e4153680 0x7f40e4153b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 -- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 msgr2=0x7f40e40b4f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 0x7f40e40b4f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 -- 172.21.15.33:0/1912527894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e40b5850 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e9ed1700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 0x7f40e40b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.766+0000 7f40e96d0700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00c0a0 tx=0x7f40d8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.767+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d8022070 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.767+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40d8004e80 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.767+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40b5b30 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.767+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40d800cc90 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.767+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e40b60f0 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.768+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40b62e0 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.768+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f40d801e430 con 0x7f40e414c6b0 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.769+0000 7f40e1ffb700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 0x7f40d0069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:07.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.769+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f40d8085c90 con 0x7f40e414c6b0 2023-10-09T15:32:07.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.769+0000 7f40e9ed1700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 0x7f40d0069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:07.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.769+0000 7f40e9ed1700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 0x7f40d0069410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000f80 tx=0x7f40d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:07.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.773+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40d80b75a0 con 0x7f40e414c6b0 2023-10-09T15:32:07.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.965+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool ls", "detail": "detail", "format": "json"} v 0) v1 -- 0x7f40e404c3c0 con 0x7f40e414c6b0 2023-10-09T15:32:07.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.966+0000 7f40e1ffb700 1 -- 172.21.15.33:0/1912527894 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls", "detail": "detail", "format": "json"}]=0 v35) v1 ==== 97+0+8050 (secure 0 0 0) 0x7f40d80170a0 con 0x7f40e414c6b0 2023-10-09T15:32:07.966 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:07.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 msgr2=0x7f40d0069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 0x7f40d0069410 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f40d4000f80 tx=0x7f40d4009040 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 msgr2=0x7f40e40b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f40cc00c0a0 tx=0x7f40d8015000 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 shutdown_connections 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40d0066f60 0x7f40d0069410 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40e4153680 0x7f40e4153b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40cc004810 0x7f40e40b4f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 --2- 172.21.15.33:0/1912527894 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40e414c6b0 0x7f40e40b3480 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 >> 172.21.15.33:0/1912527894 conn(0x7f40e40703a0 msgr2=0x7f40e414e460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 shutdown_connections 2023-10-09T15:32:07.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:07.968+0000 7f40ec135700 1 -- 172.21.15.33:0/1912527894 wait complete. 2023-10-09T15:32:07.980 INFO:teuthology.orchestra.run.smithi033.stdout:[{"pool_id":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool_id":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool_id":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool_id":6,"pool_name":"cephfs.volume_0000000000864443.meta","create_time":"2023-10-09T15:32:04.334726+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000864443"}}},{"pool_id":7,"pool_name":"cephfs.volume_0000000000864443.data","create_time":"2023-10-09T15:32:05.265179+0000","flags":163841,"flags_names":"hashpspool,creating,bulk","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"volume_0000000000864443"}}}] 2023-10-09T15:32:07.980 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs get volume_0000000000864443 --format=json 2023-10-09T15:32:08.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.101+0000 7fe972307700 1 Processor -- start 2023-10-09T15:32:08.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.101+0000 7fe972307700 1 -- start start 2023-10-09T15:32:08.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.101+0000 7fe972307700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 0x7fe96c0cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe972307700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0aeee0 con 0x7fe96c06e550 2023-10-09T15:32:08.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe972307700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe96c0cf490 con 0x7fe96c0a90d0 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe972307700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c0ae680 con 0x7fe96c0a8d00 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe9708a4700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe96c06e550 0x7fe96c0af370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51438/0 (socket says 172.21.15.33:51438) 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe9708a4700 1 -- 172.21.15.33:0/2546760752 learned_addr learned my addr 172.21.15.33:0/2546760752 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96bfff700 1 --2- 172.21.15.33:0/2546760752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 0x7fe96c0cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4052142739 0 0) 0x7fe96c0aeee0 con 0x7fe96c06e550 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe954003570 con 0x7fe96c06e550 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3198889186 0 0) 0x7fe96c0cf490 con 0x7fe96c0a90d0 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96bfff700 1 -- 172.21.15.33:0/2546760752 >> v1:172.21.15.59:6789/0 conn(0x7fe96c0a90d0 legacy=0x7fe96c06de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96bfff700 1 -- 172.21.15.33:0/2546760752 >> v1:172.21.15.33:6789/0 conn(0x7fe96c06e550 legacy=0x7fe96c0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96bfff700 1 -- 172.21.15.33:0/2546760752 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe96c0ce330 con 0x7fe96c0a8d00 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96bfff700 1 --2- 172.21.15.33:0/2546760752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 0x7fe96c0cddf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009900 tx=0x7fe95c009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a32d29c3476f8fef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.102+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c005c10 con 0x7fe96c0a8d00 2023-10-09T15:32:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe95c005d70 con 0x7fe96c0a8d00 2023-10-09T15:32:08.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe96affd700 1 -- 172.21.15.33:0/2546760752 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe95c006260 con 0x7fe96c0a8d00 2023-10-09T15:32:08.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 -- 172.21.15.33:0/2546760752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 msgr2=0x7fe96c0cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 --2- 172.21.15.33:0/2546760752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 0x7fe96c0cddf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009900 tx=0x7fe95c009120 comp rx=0 tx=0).stop 2023-10-09T15:32:08.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 -- 172.21.15.33:0/2546760752 shutdown_connections 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 --2- 172.21.15.33:0/2546760752 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c0a8d00 0x7fe96c0cddf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 -- 172.21.15.33:0/2546760752 >> 172.21.15.33:0/2546760752 conn(0x7fe96c06ce80 msgr2=0x7fe96c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 -- 172.21.15.33:0/2546760752 shutdown_connections 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.103+0000 7fe972307700 1 -- 172.21.15.33:0/2546760752 wait complete. 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.104+0000 7fe972307700 1 Processor -- start 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.104+0000 7fe972307700 1 -- start start 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c06e550 0x7fe96c09bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 0x7fe96c14a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c09b7b0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c09aba0 con 0x7fe96c0a8d00 2023-10-09T15:32:08.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe972307700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe96c09ae80 con 0x7fe96c06e550 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe9708a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe9708a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54924/0 (socket says 172.21.15.33:54924) 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe9708a4700 1 -- 172.21.15.33:0/2795613859 learned_addr learned my addr 172.21.15.33:0/2795613859 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe96bfff700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c06e550 0x7fe96c09bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.105+0000 7fe96b7fe700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 0x7fe96c14a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 -- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c06e550 msgr2=0x7fe96c09bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c06e550 0x7fe96c09bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 -- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 msgr2=0x7fe96c14a260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 0x7fe96c14a260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 -- 172.21.15.33:0/2795613859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe95c0093c0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe96b7fe700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 0x7fe96c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe9708a4700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe964001460 tx=0x7fe964001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400a950 con 0x7fe96c0a90d0 2023-10-09T15:32:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe96400aab0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe96c09b160 con 0x7fe96c0a90d0 2023-10-09T15:32:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe96400ae30 con 0x7fe96c0a90d0 2023-10-09T15:32:08.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.106+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe96c14a7a0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.107+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96c04c3c0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.107+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fe964007300 con 0x7fe96c0a90d0 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.108+0000 7fe953fff700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 0x7fe9580693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.108+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fe964084db0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.108+0000 7fe96bfff700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 0x7fe9580693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.108+0000 7fe96bfff700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 0x7fe9580693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009160 tx=0x7fe95c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.112+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe964051c90 con 0x7fe96c0a90d0 2023-10-09T15:32:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.360+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs get", "fs_name": "volume_0000000000864443", "format": "json"} v 0) v1 -- 0x7fe96c069d80 con 0x7fe96c0a90d0 2023-10-09T15:32:08.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.361+0000 7fe953fff700 1 -- 172.21.15.33:0/2795613859 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs get", "fs_name": "volume_0000000000864443", "format": "json"}]=0 v20) v1 ==== 110+0+1844 (secure 0 0 0) 0x7fe9640552b0 con 0x7fe96c0a90d0 2023-10-09T15:32:08.361 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:08.361 INFO:teuthology.orchestra.run.smithi033.stdout:{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:06.238449+0000","modified":"2023-10-09T15:32:08.245073+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4852},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4852":{"gid":4852,"name":"d","rank":0,"incarnation":18,"state":"up:active","state_seq":8,"addr":"172.21.15.59:6835/3683481332","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":3683481332},{"type":"v1","addr":"172.21.15.59:6835","nonce":3683481332}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"volume_0000000000864443","balancer":"","standby_count_wanted":1},"id":3} 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 msgr2=0x7fe9580693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 0x7fe9580693e0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fe95c009160 tx=0x7fe95c016000 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 msgr2=0x7fe96c16a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7fe964001460 tx=0x7fe964001a40 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 shutdown_connections 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe958066f30 0x7fe9580693e0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe96c0a90d0 0x7fe96c16a430 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe96c06e550 0x7fe96c09bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 --2- 172.21.15.33:0/2795613859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe96c0a8d00 0x7fe96c14a260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 >> 172.21.15.33:0/2795613859 conn(0x7fe96c06ce80 msgr2=0x7fe96c0cd900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 shutdown_connections 2023-10-09T15:32:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.363+0000 7fe972307700 1 -- 172.21.15.33:0/2795613859 wait complete. 2023-10-09T15:32:08.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000864443 --yes-i-really-mean-it 2023-10-09T15:32:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.497+0000 7fcc15a6e700 1 Processor -- start 2023-10-09T15:32:08.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.497+0000 7fcc15a6e700 1 -- start start 2023-10-09T15:32:08.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc10153a00 0x7fcc10153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 0x7fcc1015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcc100cea00 0x7fcc100cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc100cf3c0 con 0x7fcc10153a00 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc1015af60 con 0x7fcc100cea00 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc15a6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc1015b240 con 0x7fcc1015de50 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc10153a00 0x7fcc10153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc10153a00 0x7fcc10153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54940/0 (socket says 172.21.15.33:54940) 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 -- 172.21.15.33:0/1456442916 learned_addr learned my addr 172.21.15.33:0/1456442916 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc1526d700 1 --2- 172.21.15.33:0/1456442916 >> v2:172.21.15.59:3300/0 conn(0x7fcc100cea00 0x7fcc100cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc0ffff700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 0x7fcc1015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 -- 172.21.15.33:0/1456442916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 msgr2=0x7fcc1015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:08.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 0x7fcc1015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 -- 172.21.15.33:0/1456442916 >> v2:172.21.15.59:3300/0 conn(0x7fcc100cea00 msgr2=0x7fcc100cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/1456442916 >> v2:172.21.15.59:3300/0 conn(0x7fcc100cea00 0x7fcc100cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc14a6c700 1 -- 172.21.15.33:0/1456442916 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc1015b520 con 0x7fcc10153a00 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.498+0000 7fcc0ffff700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 0x7fcc1015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc10153dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc000099b0 tx=0x7fcc00009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9cb4f6e1e6cfb27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc0f7fe700 1 -- 172.21.15.33:0/1456442916 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc00009ea0 con 0x7fcc10153a00 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc0f7fe700 1 -- 172.21.15.33:0/1456442916 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc0000b820 con 0x7fcc10153a00 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc0f7fe700 1 -- 172.21.15.33:0/1456442916 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc0000bbc0 con 0x7fcc10153a00 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 -- 172.21.15.33:0/1456442916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 msgr2=0x7fcc10153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc10153dd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fcc000099b0 tx=0x7fcc00009250 comp rx=0 tx=0).stop 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 -- 172.21.15.33:0/1456442916 shutdown_connections 2023-10-09T15:32:08.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/1456442916 >> v2:172.21.15.59:3300/0 conn(0x7fcc100cea00 0x7fcc100cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc10153dd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/1456442916 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc1015de50 0x7fcc1015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 -- 172.21.15.33:0/1456442916 >> 172.21.15.33:0/1456442916 conn(0x7fcc100703a0 msgr2=0x7fcc100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:08.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 -- 172.21.15.33:0/1456442916 shutdown_connections 2023-10-09T15:32:08.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.499+0000 7fcc15a6e700 1 -- 172.21.15.33:0/1456442916 wait complete. 2023-10-09T15:32:08.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.500+0000 7fcc15a6e700 1 Processor -- start 2023-10-09T15:32:08.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 -- start start 2023-10-09T15:32:08.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc100cea00 0x7fcc1013ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 0x7fcc100b5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc10140500 con 0x7fcc10153a00 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100cbae0 con 0x7fcc1015de50 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc15a6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc100b60c0 con 0x7fcc100cea00 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc0ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.501+0000 7fcc0ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54944/0 (socket says 172.21.15.33:54944) 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 -- 172.21.15.33:0/481850676 learned_addr learned my addr 172.21.15.33:0/481850676 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc100cea00 0x7fcc1013ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc1526d700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 0x7fcc100b5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 -- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc100cea00 msgr2=0x7fcc1013ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc100cea00 0x7fcc1013ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 -- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 msgr2=0x7fcc100b5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 0x7fcc100b5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 -- 172.21.15.33:0/481850676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc000094f0 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc1526d700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 0x7fcc100b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0ffff700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d860 tx=0x7fcc04008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc040125f0 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc04012750 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc100cb1b0 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc04012af0 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.502+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc100cb770 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.503+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc100cbc70 con 0x7fcc10153a00 2023-10-09T15:32:08.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.504+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcc04014430 con 0x7fcc10153a00 2023-10-09T15:32:08.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.504+0000 7fcc0cff9700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 0x7fcbfc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:08.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.504+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 6603+0+0 (secure 0 0 0) 0x7fcc04084c50 con 0x7fcc10153a00 2023-10-09T15:32:08.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.504+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 0x7fcbfc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:08.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.505+0000 7fcc14a6c700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 0x7fcbfc0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc000099b0 tx=0x7fcc00017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:08.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.508+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc0408a020 con 0x7fcc10153a00 2023-10-09T15:32:08.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:08.732+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000864443", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fcc1004c3c0 con 0x7fcbfc066f30 2023-10-09T15:32:08.735 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:32:08.736+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:32:08.765 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:32:11.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.748+0000 7fcc0cff9700 1 -- 172.21.15.33:0/481850676 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fcc1004c3c0 con 0x7fcbfc066f30 2023-10-09T15:32:11.749 INFO:teuthology.orchestra.run.smithi033.stdout:metadata pool: cephfs.volume_0000000000864443.meta data pool: ['cephfs.volume_0000000000864443.data'] removed 2023-10-09T15:32:11.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 msgr2=0x7fcbfc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:11.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 0x7fcbfc0693e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fcc000099b0 tx=0x7fcc00017000 comp rx=0 tx=0).stop 2023-10-09T15:32:11.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 msgr2=0x7fcc100c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fcc0400d860 tx=0x7fcc04008040 comp rx=0 tx=0).stop 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 shutdown_connections 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbfc066f30 0x7fcbfc0693e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc1015de50 0x7fcc100b5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc100cea00 0x7fcc1013ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 --2- 172.21.15.33:0/481850676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc10153a00 0x7fcc100c75e0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 >> 172.21.15.33:0/481850676 conn(0x7fcc100703a0 msgr2=0x7fcc1015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 shutdown_connections 2023-10-09T15:32:11.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:11.751+0000 7fcc15a6e700 1 -- 172.21.15.33:0/481850676 wait complete. 2023-10-09T15:32:11.768 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:32:11.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:11.809 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:11.854 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:32:11.854 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:32:11.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:32:11.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:11.900 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:32:11.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:11.900 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:32:11.916 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:32:11.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:32:11.917 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:11.963 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:32:11.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:11.963 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:32:11.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.100+0000 7f8e8b840700 1 Processor -- start 2023-10-09T15:32:12.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.100+0000 7f8e8b840700 1 -- start start 2023-10-09T15:32:12.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e8b840700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e840cb5a0 0x7f8e840cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e8b840700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 0x7f8e84159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e8b840700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e8415ae40 con 0x7f8e8415a400 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e8b840700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e840d13f0 con 0x7f8e840cb5a0 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e8b840700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8415ab60 con 0x7f8e840cd9e0 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e840cb5a0 0x7f8e840cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e840cb5a0 0x7f8e840cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60948/0 (socket says 172.21.15.33:60948) 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 -- 172.21.15.33:0/3933362487 learned_addr learned my addr 172.21.15.33:0/3933362487 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e88ddb700 1 --2- 172.21.15.33:0/3933362487 >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 0x7f8e84159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 -- 172.21.15.33:0/3933362487 >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 msgr2=0x7f8e84159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 --2- 172.21.15.33:0/3933362487 >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 0x7f8e84159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 -- 172.21.15.33:0/3933362487 >> v1:172.21.15.59:6789/0 conn(0x7f8e8415a400 legacy=0x7f8e84156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 -- 172.21.15.33:0/3933362487 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840ccf00 con 0x7f8e840cb5a0 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e88ddb700 1 --2- 172.21.15.33:0/3933362487 >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 0x7f8e84159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.101+0000 7f8e895dc700 1 --2- 172.21.15.33:0/3933362487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cb5a0 0x7f8e840cb970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e800099b0 tx=0x7f8e80009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d246fcaf1bf8e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e7bfff700 1 -- 172.21.15.33:0/3933362487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000b7e0 con 0x7f8e840cb5a0 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e7bfff700 1 -- 172.21.15.33:0/3933362487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8000b940 con 0x7f8e840cb5a0 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e7bfff700 1 -- 172.21.15.33:0/3933362487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8000bce0 con 0x7f8e840cb5a0 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 -- 172.21.15.33:0/3933362487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cb5a0 msgr2=0x7f8e840cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 --2- 172.21.15.33:0/3933362487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cb5a0 0x7f8e840cb970 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f8e800099b0 tx=0x7f8e80009250 comp rx=0 tx=0).stop 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 -- 172.21.15.33:0/3933362487 shutdown_connections 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 --2- 172.21.15.33:0/3933362487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cb5a0 0x7f8e840cb970 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 --2- 172.21.15.33:0/3933362487 >> v2:172.21.15.59:3300/0 conn(0x7f8e840cd9e0 0x7f8e84159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 -- 172.21.15.33:0/3933362487 >> 172.21.15.33:0/3933362487 conn(0x7f8e84070e30 msgr2=0x7f8e840d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 -- 172.21.15.33:0/3933362487 shutdown_connections 2023-10-09T15:32:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.102+0000 7f8e8b840700 1 -- 172.21.15.33:0/3933362487 wait complete. 2023-10-09T15:32:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.103+0000 7f8e8b840700 1 Processor -- start 2023-10-09T15:32:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.103+0000 7f8e8b840700 1 -- start start 2023-10-09T15:32:12.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 0x7f8e84157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8415a400 0x7f8e840b4580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e840ca4e0 con 0x7f8e840cd9e0 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84157c10 con 0x7f8e8415a400 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e8b840700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e84158430 con 0x7f8e840cb5a0 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e88ddb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e88ddb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60960/0 (socket says 172.21.15.33:60960) 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e88ddb700 1 -- 172.21.15.33:0/546855896 learned_addr learned my addr 172.21.15.33:0/546855896 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e89ddd700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8415a400 0x7f8e840b4580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.104+0000 7f8e895dc700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 0x7f8e84157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 -- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 msgr2=0x7f8e84157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 0x7f8e84157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 -- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8415a400 msgr2=0x7f8e840b4580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8415a400 0x7f8e840b4580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 -- 172.21.15.33:0/546855896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e800094f0 con 0x7f8e840cd9e0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e895dc700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 0x7f8e84157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e88ddb700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c830 tx=0x7f8e74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74011600 con 0x7f8e840cd9e0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74011760 con 0x7f8e840cd9e0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74011b20 con 0x7f8e840cd9e0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e84158710 con 0x7f8e840cd9e0 2023-10-09T15:32:12.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.105+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e84152330 con 0x7f8e840cd9e0 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.106+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e84158c30 con 0x7f8e840cd9e0 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.106+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8e7400a3e0 con 0x7f8e840cd9e0 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.107+0000 7f8e797fa700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 0x7f8e680693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.107+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8e74084ae0 con 0x7f8e840cd9e0 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.107+0000 7f8e895dc700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 0x7f8e680693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.107+0000 7f8e895dc700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 0x7f8e680693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e800099b0 tx=0x7f8e80016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.111+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e84158c30 con 0x7f8e840cd9e0 2023-10-09T15:32:12.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.350+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e84158c30 con 0x7f8e840cd9e0 2023-10-09T15:32:12.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.350+0000 7f8e797fa700 1 -- 172.21.15.33:0/546855896 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f8e84158c30 con 0x7f8e840cd9e0 2023-10-09T15:32:12.351 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:12.351 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1132357598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1132357598},{"type":"v1","addr":"172.21.15.59:6835","nonce":1132357598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:32:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 msgr2=0x7f8e680693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 0x7f8e680693e0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8e800099b0 tx=0x7f8e80016000 comp rx=0 tx=0).stop 2023-10-09T15:32:12.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 msgr2=0x7f8e840c9fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c830 tx=0x7f8e74008040 comp rx=0 tx=0).stop 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 shutdown_connections 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e68066f30 0x7f8e680693e0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e8415a400 0x7f8e840b4580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e840cb5a0 0x7f8e84157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 --2- 172.21.15.33:0/546855896 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e840cd9e0 0x7f8e840c9fa0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 >> 172.21.15.33:0/546855896 conn(0x7f8e84070e30 msgr2=0x7f8e840b0a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 shutdown_connections 2023-10-09T15:32:12.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.352+0000 7f8e8b840700 1 -- 172.21.15.33:0/546855896 wait complete. 2023-10-09T15:32:12.355 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2023-10-09T15:32:12.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:12.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.486+0000 7fd21c7b4700 1 Processor -- start 2023-10-09T15:32:12.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.486+0000 7fd21c7b4700 1 -- start start 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.487+0000 7fd21c7b4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd2140a8d00 0x7fd2140cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.487+0000 7fd21c7b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd2140a90d0 0x7fd21406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.487+0000 7fd21c7b4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2140aeee0 con 0x7fd21406e380 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.487+0000 7fd21c7b4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd21406e820 con 0x7fd2140a8d00 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.487+0000 7fd21c7b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2140ae680 con 0x7fd2140a90d0 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd2140a8d00 0x7fd2140cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21ad51700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd21406e380 0x7fd2140cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56192/0 (socket says 172.21.15.33:56192) 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21ad51700 1 -- 172.21.15.33:0/1844340800 learned_addr learned my addr 172.21.15.33:0/1844340800 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:12.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd219d4f700 1 --2- 172.21.15.33:0/1844340800 >> v2:172.21.15.59:3300/0 conn(0x7fd2140a90d0 0x7fd21406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 -- 172.21.15.33:0/1844340800 >> v2:172.21.15.59:3300/0 conn(0x7fd2140a90d0 msgr2=0x7fd21406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 --2- 172.21.15.33:0/1844340800 >> v2:172.21.15.59:3300/0 conn(0x7fd2140a90d0 0x7fd21406de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 -- 172.21.15.33:0/1844340800 >> v1:172.21.15.33:6789/0 conn(0x7fd21406e380 legacy=0x7fd2140cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 -- 172.21.15.33:0/1844340800 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2140cf490 con 0x7fd2140a8d00 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21954e700 1 -- 172.21.15.33:0/1844340800 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419947639 0 0) 0x7fd2140aeee0 con 0x7fd21406e380 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21a550700 1 --2- 172.21.15.33:0/1844340800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a8d00 0x7fd2140cddf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098d0 tx=0x7fd20c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9bd411c690a29a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21954e700 1 -- 172.21.15.33:0/1844340800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c009e70 con 0x7fd2140a8d00 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21954e700 1 -- 172.21.15.33:0/1844340800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20c005c10 con 0x7fd2140a8d00 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.488+0000 7fd21954e700 1 -- 172.21.15.33:0/1844340800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20c00b610 con 0x7fd2140a8d00 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1844340800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a8d00 msgr2=0x7fd2140cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1844340800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a8d00 0x7fd2140cddf0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fd20c0098d0 tx=0x7fd20c009120 comp rx=0 tx=0).stop 2023-10-09T15:32:12.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1844340800 shutdown_connections 2023-10-09T15:32:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1844340800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a8d00 0x7fd2140cddf0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1844340800 >> v2:172.21.15.59:3300/0 conn(0x7fd2140a90d0 0x7fd21406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1844340800 >> 172.21.15.33:0/1844340800 conn(0x7fd21406ce80 msgr2=0x7fd2140ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1844340800 shutdown_connections 2023-10-09T15:32:12.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.489+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1844340800 wait complete. 2023-10-09T15:32:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.490+0000 7fd21c7b4700 1 Processor -- start 2023-10-09T15:32:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.490+0000 7fd21c7b4700 1 -- start start 2023-10-09T15:32:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd21406e380 0x7fd2140b2440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2140a8d00 0x7fd21414b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b3d10 con 0x7fd2140a90d0 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b2c70 con 0x7fd2140a8d00 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2140b2f50 con 0x7fd21406e380 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60980/0 (socket says 172.21.15.33:60980) 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 -- 172.21.15.33:0/1810266070 learned_addr learned my addr 172.21.15.33:0/1810266070 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21a550700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd21406e380 0x7fd2140b2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd219d4f700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2140a8d00 0x7fd21414b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 -- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd21406e380 msgr2=0x7fd2140b2440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd21406e380 0x7fd2140b2440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 -- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2140a8d00 msgr2=0x7fd21414b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2140a8d00 0x7fd21414b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 -- 172.21.15.33:0/1810266070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd20c0093c0 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21ad51700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cc90 tx=0x7fd204001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400a870 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd20400a9d0 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2140b3230 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd20400ad90 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.491+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2140b37f0 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.492+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2140b3a10 con 0x7fd2140a90d0 2023-10-09T15:32:12.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.493+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd204007300 con 0x7fd2140a90d0 2023-10-09T15:32:12.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.493+0000 7fd2127fc700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 0x7fd2000693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.493+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd204084850 con 0x7fd2140a90d0 2023-10-09T15:32:12.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.493+0000 7fd21a550700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 0x7fd2000693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.494+0000 7fd21a550700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 0x7fd2000693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009160 tx=0x7fd20c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.497+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd204051af0 con 0x7fd2140a90d0 2023-10-09T15:32:12.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.696+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd21404c3c0 con 0x7fd2140a90d0 2023-10-09T15:32:12.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.697+0000 7fd2127fc700 1 -- 172.21.15.33:0/1810266070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7fd204055110 con 0x7fd2140a90d0 2023-10-09T15:32:12.698 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:12.698 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:11.742810+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3683481332":"2023-10-10T15:32:08.736122+0000","172.21.15.59:6833/3683481332":"2023-10-10T15:32:08.736122+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:12.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 msgr2=0x7fd2000693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 0x7fd2000693e0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fd20c009160 tx=0x7fd20c016000 comp rx=0 tx=0).stop 2023-10-09T15:32:12.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 msgr2=0x7fd21409ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7fd20400cc90 tx=0x7fd204001a20 comp rx=0 tx=0).stop 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 shutdown_connections 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd200066f30 0x7fd2000693e0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd2140a90d0 0x7fd21409ade0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd21406e380 0x7fd2140b2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 --2- 172.21.15.33:0/1810266070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd2140a8d00 0x7fd21414b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 >> 172.21.15.33:0/1810266070 conn(0x7fd21406ce80 msgr2=0x7fd2140af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 shutdown_connections 2023-10-09T15:32:12.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.699+0000 7fd21c7b4700 1 -- 172.21.15.33:0/1810266070 wait complete. 2023-10-09T15:32:12.712 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:31:46.599926+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '31', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:31:47.807057+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:32:12.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:32:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.834+0000 7f05656e9700 1 Processor -- start 2023-10-09T15:32:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.834+0000 7f05656e9700 1 -- start start 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f05656e9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0560153a00 0x7f0560153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f05656e9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05600cea00 0x7f05600cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f05656e9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056015ac50 con 0x7f056015de50 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f05656e9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056015d010 con 0x7f0560153a00 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f05656e9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05600cf3c0 con 0x7f05600cea00 2023-10-09T15:32:12.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0560153a00 0x7f0560153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0560153a00 0x7f0560153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60994/0 (socket says 172.21.15.33:60994) 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 -- 172.21.15.33:0/3790951319 learned_addr learned my addr 172.21.15.33:0/3790951319 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f0564ee8700 1 --2- 172.21.15.33:0/3790951319 >> v2:172.21.15.59:3300/0 conn(0x7f05600cea00 0x7f05600cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 -- 172.21.15.33:0/3790951319 >> v2:172.21.15.59:3300/0 conn(0x7f05600cea00 msgr2=0x7f05600cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 --2- 172.21.15.33:0/3790951319 >> v2:172.21.15.59:3300/0 conn(0x7f05600cea00 0x7f05600cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 -- 172.21.15.33:0/3790951319 >> v1:172.21.15.59:6789/0 conn(0x7f056015de50 legacy=0x7f056015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 -- 172.21.15.33:0/3790951319 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056015af60 con 0x7f0560153a00 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.835+0000 7f055ffff700 1 --2- 172.21.15.33:0/3790951319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f0560153dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05600d03e0 tx=0x7f0550009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be356fa75397cd37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f055effd700 1 -- 172.21.15.33:0/3790951319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000b820 con 0x7f0560153a00 2023-10-09T15:32:12.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f055effd700 1 -- 172.21.15.33:0/3790951319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055000b980 con 0x7f0560153a00 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f055effd700 1 -- 172.21.15.33:0/3790951319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055000bd20 con 0x7f0560153a00 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 -- 172.21.15.33:0/3790951319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 msgr2=0x7f0560153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 --2- 172.21.15.33:0/3790951319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f0560153dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f05600d03e0 tx=0x7f0550009250 comp rx=0 tx=0).stop 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 -- 172.21.15.33:0/3790951319 shutdown_connections 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 --2- 172.21.15.33:0/3790951319 >> v2:172.21.15.59:3300/0 conn(0x7f05600cea00 0x7f05600cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 --2- 172.21.15.33:0/3790951319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f0560153dd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 -- 172.21.15.33:0/3790951319 >> 172.21.15.33:0/3790951319 conn(0x7f05600703a0 msgr2=0x7f05600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 -- 172.21.15.33:0/3790951319 shutdown_connections 2023-10-09T15:32:12.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.836+0000 7f05656e9700 1 -- 172.21.15.33:0/3790951319 wait complete. 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.837+0000 7f05656e9700 1 Processor -- start 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 -- start start 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 0x7f0560151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 0x7f0560151ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600cc780 con 0x7f0560153a00 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05600c8ba0 con 0x7f056015de50 2023-10-09T15:32:12.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f05656e9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05600b32d0 con 0x7f05600cea00 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f055f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f055f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32768/0 (socket says 172.21.15.33:32768) 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f055f7fe700 1 -- 172.21.15.33:0/3857438774 learned_addr learned my addr 172.21.15.33:0/3857438774 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f055ffff700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 0x7f0560151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.838+0000 7f0564ee8700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 0x7f0560151ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 -- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 msgr2=0x7f0560151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 0x7f0560151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 -- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 msgr2=0x7f0560151ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 0x7f0560151ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 -- 172.21.15.33:0/3857438774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05500094f0 con 0x7f0560153a00 2023-10-09T15:32:12.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055ffff700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 0x7f0560151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f0564ee8700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 0x7f0560151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f055f7fe700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f054800c5d0 tx=0x7f0548007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011590 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0548011710 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0548011ad0 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05600cbee0 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.839+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05600cc4a0 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.840+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056004c3c0 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.840+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f054801c460 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.841+0000 7f0557fff700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.841+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0548084330 con 0x7f0560153a00 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.841+0000 7f055ffff700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:12.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.841+0000 7f055ffff700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 0x7f05400693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05600d03e0 tx=0x7f0550016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:12.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:12.845+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0548051550 con 0x7f0560153a00 2023-10-09T15:32:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.038+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f05600caef0 con 0x7f0560153a00 2023-10-09T15:32:13.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.038+0000 7f0557fff700 1 -- 172.21.15.33:0/3857438774 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v39) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0548054b70 con 0x7f0560153a00 2023-10-09T15:32:13.039 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:32:13.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 msgr2=0x7f05400693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 0x7f05400693e0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05600d03e0 tx=0x7f0550016000 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 msgr2=0x7f05600cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f054800c5d0 tx=0x7f0548007f60 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 shutdown_connections 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0540066f30 0x7f05400693e0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056015de50 0x7f0560151ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05600cea00 0x7f0560151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 --2- 172.21.15.33:0/3857438774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0560153a00 0x7f05600cb5e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.040+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 >> 172.21.15.33:0/3857438774 conn(0x7f05600703a0 msgr2=0x7f0560152c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.041+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 shutdown_connections 2023-10-09T15:32:13.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.041+0000 7f05656e9700 1 -- 172.21.15.33:0/3857438774 wait complete. 2023-10-09T15:32:13.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:32:13.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.174+0000 7fd76beee700 1 Processor -- start 2023-10-09T15:32:13.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.174+0000 7fd76beee700 1 -- start start 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd76beee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd764159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd76beee700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7640ccfd0 con 0x7fd764159530 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd76beee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd76415a3d0 con 0x7fd76406e0e0 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd76beee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd76415a6b0 con 0x7fd76406dc70 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd769c8a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd764159530 0x7fd7640ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56204/0 (socket says 172.21.15.33:56204) 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd769c8a700 1 -- 172.21.15.33:0/42125127 learned_addr learned my addr 172.21.15.33:0/42125127 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:13.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1620803978 0 0) 0x7fd7640ccfd0 con 0x7fd764159530 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd750003570 con 0x7fd764159530 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd769489700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd764159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 853481713 0 0) 0x7fd750003570 con 0x7fd764159530 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 msgr2=0x7fd764159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd764159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 >> v1:172.21.15.59:6789/0 conn(0x7fd76406e0e0 legacy=0x7fd7640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76415a990 con 0x7fd764159530 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fd760001470 con 0x7fd764159530 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 >> v1:172.21.15.33:6789/0 conn(0x7fd764159530 legacy=0x7fd7640ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750003a90 0x7fd750003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd750004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.175+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd76415a6b0 con 0x7fd750004d50 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd75000bb70 con 0x7fd750003a90 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd75000bd30 con 0x7fd76406dc70 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd769c8a700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750003a90 0x7fd750003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd769489700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd750004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 -- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 msgr2=0x7fd750004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76406dc70 0x7fd750004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 -- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750003a90 msgr2=0x7fd750003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:13.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd750003a90 0x7fd750003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 -- 172.21.15.33:0/42125127 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd750003570 con 0x7fd750004d50 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd76a48b700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd75c001fc0 tx=0x7fd75c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b44161bb900e15 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c001980 con 0x7fd750004d50 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75c00c8b0 con 0x7fd750004d50 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.176+0000 7fd768c88700 1 -- 172.21.15.33:0/42125127 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75c00cc50 con 0x7fd750004d50 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 -- 172.21.15.33:0/42125127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd750004d50 msgr2=0x7fd7500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 --2- 172.21.15.33:0/42125127 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd750004d50 0x7fd7500051c0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fd75c001fc0 tx=0x7fd75c001670 comp rx=0 tx=0).stop 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76a48b700 1 -- 172.21.15.33:0/42125127 reap_dead start 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 -- 172.21.15.33:0/42125127 shutdown_connections 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 -- 172.21.15.33:0/42125127 >> 172.21.15.33:0/42125127 conn(0x7fd7640703a0 msgr2=0x7fd7640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 -- 172.21.15.33:0/42125127 shutdown_connections 2023-10-09T15:32:13.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.177+0000 7fd76beee700 1 -- 172.21.15.33:0/42125127 wait complete. 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.178+0000 7fd76beee700 1 Processor -- start 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.178+0000 7fd76beee700 1 -- start start 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76414d370 0x7fd7640c9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76416b280 0x7fd76414d9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640c7790 con 0x7fd7640ca640 2023-10-09T15:32:13.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640c8310 con 0x7fd76414d370 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7640ca1f0 con 0x7fd76416b280 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32794/0 (socket says 172.21.15.33:32794) 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 -- 172.21.15.33:0/3539334480 learned_addr learned my addr 172.21.15.33:0/3539334480 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76a48b700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76416b280 0x7fd76414d9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769c8a700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76414d370 0x7fd7640c9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 -- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76416b280 msgr2=0x7fd76414d9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76416b280 0x7fd76414d9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 -- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76414d370 msgr2=0x7fd7640c9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76414d370 0x7fd7640c9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 -- 172.21.15.33:0/3539334480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd76414d740 con 0x7fd7640ca640 2023-10-09T15:32:13.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd769489700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd754011b10 tx=0x7fd7540091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400f9f0 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd75400fb50 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd75400fed0 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.179+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7640c79e0 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.180+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7640c7fa0 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.181+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7640c84a0 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.181+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd754014650 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.181+0000 7fd759ffb700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 0x7fd7480693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.182+0000 7fd769c8a700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 0x7fd7480693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.182+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd754018030 con 0x7fd7640ca640 2023-10-09T15:32:13.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.182+0000 7fd769c8a700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 0x7fd7480693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd760001620 tx=0x7fd760009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.186+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd754052260 con 0x7fd7640ca640 2023-10-09T15:32:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.380+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd76404c3c0 con 0x7fd7640ca640 2023-10-09T15:32:13.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.380+0000 7fd759ffb700 1 -- 172.21.15.33:0/3539334480 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v39) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd754022020 con 0x7fd7640ca640 2023-10-09T15:32:13.381 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:32:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 msgr2=0x7fd7480693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 0x7fd7480693e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fd760001620 tx=0x7fd760009040 comp rx=0 tx=0).stop 2023-10-09T15:32:13.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 msgr2=0x7fd76416ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fd754011b10 tx=0x7fd7540091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 shutdown_connections 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd748066f30 0x7fd7480693e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd76416b280 0x7fd76414d9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd76414d370 0x7fd7640c9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 --2- 172.21.15.33:0/3539334480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd7640ca640 0x7fd76416ad40 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 >> 172.21.15.33:0/3539334480 conn(0x7fd7640703a0 msgr2=0x7fd7640c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 shutdown_connections 2023-10-09T15:32:13.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.382+0000 7fd76beee700 1 -- 172.21.15.33:0/3539334480 wait complete. 2023-10-09T15:32:13.395 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:32:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.519+0000 7f2c2605f700 1 Processor -- start 2023-10-09T15:32:13.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.519+0000 7f2c2605f700 1 -- start start 2023-10-09T15:32:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c2605f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c2605f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c200ccfd0 con 0x7f2c2006dc70 2023-10-09T15:32:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c2605f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c2015a3d0 con 0x7f2c20159530 2023-10-09T15:32:13.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c2605f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c2015a6b0 con 0x7f2c2006e0e0 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2c2006dc70 0x7f2c20159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56206/0 (socket says 172.21.15.33:56206) 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1effd700 1 -- 172.21.15.33:0/314115709 learned_addr learned my addr 172.21.15.33:0/314115709 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1ffff700 1 --2- 172.21.15.33:0/314115709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3656980669 0 0) 0x7f2c200ccfd0 con 0x7f2c2006dc70 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c08003570 con 0x7f2c2006dc70 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47060479 0 0) 0x7f2c2015a3d0 con 0x7f2c20159530 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2c200ccfd0 con 0x7f2c20159530 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1ffff700 1 -- 172.21.15.33:0/314115709 >> v1:172.21.15.59:6789/0 conn(0x7f2c20159530 legacy=0x7f2c200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1ffff700 1 -- 172.21.15.33:0/314115709 >> v1:172.21.15.33:6789/0 conn(0x7f2c2006dc70 legacy=0x7f2c20159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1ffff700 1 -- 172.21.15.33:0/314115709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c2015a990 con 0x7f2c2006e0e0 2023-10-09T15:32:13.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.520+0000 7f2c1ffff700 1 --2- 172.21.15.33:0/314115709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cb6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009e90 tx=0x7f2c18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25cc240e6376401d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1800e070 con 0x7f2c2006e0e0 2023-10-09T15:32:13.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1800bb80 con 0x7f2c2006e0e0 2023-10-09T15:32:13.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c1e7fc700 1 -- 172.21.15.33:0/314115709 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18012430 con 0x7f2c2006e0e0 2023-10-09T15:32:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 -- 172.21.15.33:0/314115709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 msgr2=0x7f2c200cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 --2- 172.21.15.33:0/314115709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cb6f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f2c18009e90 tx=0x7f2c18009780 comp rx=0 tx=0).stop 2023-10-09T15:32:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 -- 172.21.15.33:0/314115709 shutdown_connections 2023-10-09T15:32:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 --2- 172.21.15.33:0/314115709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cb6f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 -- 172.21.15.33:0/314115709 >> 172.21.15.33:0/314115709 conn(0x7f2c200703a0 msgr2=0x7f2c200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 -- 172.21.15.33:0/314115709 shutdown_connections 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.521+0000 7f2c2605f700 1 -- 172.21.15.33:0/314115709 wait complete. 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.522+0000 7f2c2605f700 1 Processor -- start 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.522+0000 7f2c2605f700 1 -- start start 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2006dc70 0x7f2c20153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c88d0 con 0x7f2c20159530 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c8bb0 con 0x7f2c2006dc70 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c2605f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c200c8e90 con 0x7f2c2006e0e0 2023-10-09T15:32:13.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32800/0 (socket says 172.21.15.33:32800) 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c1ffff700 1 -- 172.21.15.33:0/1514015487 learned_addr learned my addr 172.21.15.33:0/1514015487 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c1effd700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.523+0000 7f2c1f7fe700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2006dc70 0x7f2c20153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 -- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 msgr2=0x7f2c200cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 -- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2006dc70 msgr2=0x7f2c20153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2006dc70 0x7f2c20153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 -- 172.21.15.33:0/1514015487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c18009a20 con 0x7f2c20159530 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c1ffff700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c18013000 tx=0x7f2c18019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c18012e00 con 0x7f2c20159530 2023-10-09T15:32:13.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1801d630 con 0x7f2c20159530 2023-10-09T15:32:13.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c200c9170 con 0x7f2c20159530 2023-10-09T15:32:13.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1801d9f0 con 0x7f2c20159530 2023-10-09T15:32:13.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.524+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c20153f90 con 0x7f2c20159530 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.525+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c20154120 con 0x7f2c20159530 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.525+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f2c18024070 con 0x7f2c20159530 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.526+0000 7f2c077fe700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.526+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2c18086d70 con 0x7f2c20159530 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.526+0000 7f2c1f7fe700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.526+0000 7f2c1f7fe700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 0x7f2c0c0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c100037e0 tx=0x7f2c10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.530+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c18054040 con 0x7f2c20159530 2023-10-09T15:32:13.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.721+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f2c200c8a10 con 0x7f2c20159530 2023-10-09T15:32:13.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.722+0000 7f2c077fe700 1 -- 172.21.15.33:0/1514015487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v39) v1 ==== 100+0+11 (secure 0 0 0) 0x7f2c200c8a10 con 0x7f2c20159530 2023-10-09T15:32:13.723 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:32:13.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.723+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 msgr2=0x7f2c0c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.723+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 0x7f2c0c0693e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f2c100037e0 tx=0x7f2c10009040 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.723+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 msgr2=0x7f2c200cd8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.723+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2c18013000 tx=0x7f2c18019000 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 shutdown_connections 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c0c066f30 0x7f2c0c0693e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c20159530 0x7f2c200cd8a0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c2006dc70 0x7f2c20153a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 --2- 172.21.15.33:0/1514015487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c2006e0e0 0x7f2c200cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 >> 172.21.15.33:0/1514015487 conn(0x7f2c200703a0 msgr2=0x7f2c20154fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 shutdown_connections 2023-10-09T15:32:13.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.724+0000 7f2c2605f700 1 -- 172.21.15.33:0/1514015487 wait complete. 2023-10-09T15:32:13.736 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.855+0000 7f35ff1bc700 1 Processor -- start 2023-10-09T15:32:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.855+0000 7f35ff1bc700 1 -- start start 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35ff1bc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f35f80cb5a0 0x7f35f80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35ff1bc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f815ae40 con 0x7f35f815a5d0 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35ff1bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35f815ab60 con 0x7f35f80cd9e0 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35ff1bc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35f80d13f0 con 0x7f35f80cb5a0 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fcf58700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f35f80cb5a0 0x7f35f80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fd759700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f35f815a5d0 0x7f35f8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56222/0 (socket says 172.21.15.33:56222) 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fd759700 1 -- 172.21.15.33:0/1191398466 learned_addr learned my addr 172.21.15.33:0/1191398466 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35f77fe700 1 -- 172.21.15.33:0/1191398466 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2375831010 0 0) 0x7f35f815ae40 con 0x7f35f815a5d0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35f77fe700 1 -- 172.21.15.33:0/1191398466 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f35e4003570 con 0x7f35f815a5d0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fcf58700 1 -- 172.21.15.33:0/1191398466 >> v1:172.21.15.59:6789/0 conn(0x7f35f80cd9e0 legacy=0x7f35f8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fcf58700 1 -- 172.21.15.33:0/1191398466 >> v1:172.21.15.33:6789/0 conn(0x7f35f815a5d0 legacy=0x7f35f8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fcf58700 1 -- 172.21.15.33:0/1191398466 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35f80ccf00 con 0x7f35f80cb5a0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35fcf58700 1 --2- 172.21.15.33:0/1191398466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f80cb5a0 0x7f35f80cb970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009910 tx=0x7f35e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98954268fc235568 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35f77fe700 1 -- 172.21.15.33:0/1191398466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000b640 con 0x7f35f80cb5a0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.856+0000 7f35f77fe700 1 -- 172.21.15.33:0/1191398466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35e000b7a0 con 0x7f35f80cb5a0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35f77fe700 1 -- 172.21.15.33:0/1191398466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35e000bb60 con 0x7f35f80cb5a0 2023-10-09T15:32:13.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 -- 172.21.15.33:0/1191398466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f80cb5a0 msgr2=0x7f35f80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/1191398466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f80cb5a0 0x7f35f80cb970 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f35e0009910 tx=0x7f35e00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 -- 172.21.15.33:0/1191398466 shutdown_connections 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/1191398466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f80cb5a0 0x7f35f80cb970 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 -- 172.21.15.33:0/1191398466 >> 172.21.15.33:0/1191398466 conn(0x7f35f8070e30 msgr2=0x7f35f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 -- 172.21.15.33:0/1191398466 shutdown_connections 2023-10-09T15:32:13.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.857+0000 7f35ff1bc700 1 -- 172.21.15.33:0/1191398466 wait complete. 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.858+0000 7f35ff1bc700 1 Processor -- start 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.858+0000 7f35ff1bc700 1 -- start start 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f80cb5a0 0x7f35f80c9c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f80cd9e0 0x7f35f80b5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80c8f10 con 0x7f35f815a5d0 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80b4720 con 0x7f35f80cd9e0 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35ff1bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35f80ca140 con 0x7f35f80cb5a0 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32814/0 (socket says 172.21.15.33:32814) 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 -- 172.21.15.33:0/2643480243 learned_addr learned my addr 172.21.15.33:0/2643480243 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 -- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f80cb5a0 msgr2=0x7f35f80c9c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f80cb5a0 0x7f35f80c9c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 -- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f80cd9e0 msgr2=0x7f35f80b5e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f80cd9e0 0x7f35f80b5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.859+0000 7f35fd759700 1 -- 172.21.15.33:0/2643480243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35e0009420 con 0x7f35f815a5d0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35fd759700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f35f00010e0 tx=0x7f35f0007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f0005c00 con 0x7f35f815a5d0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35f0005d60 con 0x7f35f815a5d0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35f80c9120 con 0x7f35f815a5d0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35f00072e0 con 0x7f35f815a5d0 2023-10-09T15:32:13.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.860+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35f80c96e0 con 0x7f35f815a5d0 2023-10-09T15:32:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.861+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35f80b44a0 con 0x7f35f815a5d0 2023-10-09T15:32:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.861+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f35f0012400 con 0x7f35f815a5d0 2023-10-09T15:32:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.862+0000 7f35f4ff9700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:13.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.862+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f35f0083950 con 0x7f35f815a5d0 2023-10-09T15:32:13.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.862+0000 7f35fcf58700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:13.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.862+0000 7f35fcf58700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 0x7f35d80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35e00091e0 tx=0x7f35e0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:13.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:13.866+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35f004b5a0 con 0x7f35f815a5d0 2023-10-09T15:32:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.107+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f35f80cd1e0 con 0x7f35f815a5d0 2023-10-09T15:32:14.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.108+0000 7f35f4ff9700 1 -- 172.21.15.33:0/2643480243 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f35f0017070 con 0x7f35f815a5d0 2023-10-09T15:32:14.109 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:14.109 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1132357598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1132357598},{"type":"v1","addr":"172.21.15.59:6835","nonce":1132357598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 msgr2=0x7f35d80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 0x7f35d80693e0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f35e00091e0 tx=0x7f35e0017000 comp rx=0 tx=0).stop 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 msgr2=0x7f35f8150000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f35f00010e0 tx=0x7f35f0007dd0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 shutdown_connections 2023-10-09T15:32:14.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f35d8066f30 0x7f35d80693e0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35f815a5d0 0x7f35f8150000 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35f80cb5a0 0x7f35f80c9c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 --2- 172.21.15.33:0/2643480243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f35f80cd9e0 0x7f35f80b5e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 >> 172.21.15.33:0/2643480243 conn(0x7f35f8070e30 msgr2=0x7f35f80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 shutdown_connections 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.110+0000 7f35ff1bc700 1 -- 172.21.15.33:0/2643480243 wait complete. 2023-10-09T15:32:14.112 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2023-10-09T15:32:14.123 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.241+0000 7f0691a97700 1 Processor -- start 2023-10-09T15:32:14.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.241+0000 7f0691a97700 1 -- start start 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691a97700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f068c153c30 0x7f068c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691a97700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c15afd0 con 0x7f068c0cf110 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691a97700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f068c15b2b0 con 0x7f068c15de50 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691a97700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f068c15b590 con 0x7f068c153c30 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0690a95700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f068c153c30 0x7f068c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691296700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f068c0cf110 0x7f068c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56234/0 (socket says 172.21.15.33:56234) 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0691296700 1 -- 172.21.15.33:0/3519016375 learned_addr learned my addr 172.21.15.33:0/3519016375 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0690a95700 1 -- 172.21.15.33:0/3519016375 >> v1:172.21.15.59:6789/0 conn(0x7f068c15de50 legacy=0x7f068c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0690a95700 1 -- 172.21.15.33:0/3519016375 >> v1:172.21.15.33:6789/0 conn(0x7f068c0cf110 legacy=0x7f068c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f0690a95700 1 -- 172.21.15.33:0/3519016375 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f068c15b870 con 0x7f068c153c30 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.242+0000 7f068b7fe700 1 -- 172.21.15.33:0/3519016375 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2158130531 0 0) 0x7f068c15afd0 con 0x7f068c0cf110 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0690a95700 1 --2- 172.21.15.33:0/3519016375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c153c30 0x7f068c15a5e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f067c0098e0 tx=0x7f067c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8bf576f9110c38c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f068b7fe700 1 -- 172.21.15.33:0/3519016375 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c009e80 con 0x7f068c153c30 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f068b7fe700 1 -- 172.21.15.33:0/3519016375 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c00b820 con 0x7f068c153c30 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f068b7fe700 1 -- 172.21.15.33:0/3519016375 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00bba0 con 0x7f068c153c30 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 -- 172.21.15.33:0/3519016375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c153c30 msgr2=0x7f068c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 --2- 172.21.15.33:0/3519016375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c153c30 0x7f068c15a5e0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f067c0098e0 tx=0x7f067c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 -- 172.21.15.33:0/3519016375 shutdown_connections 2023-10-09T15:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 --2- 172.21.15.33:0/3519016375 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c153c30 0x7f068c15a5e0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 -- 172.21.15.33:0/3519016375 >> 172.21.15.33:0/3519016375 conn(0x7f068c0703a0 msgr2=0x7f068c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 -- 172.21.15.33:0/3519016375 shutdown_connections 2023-10-09T15:32:14.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.243+0000 7f0691a97700 1 -- 172.21.15.33:0/3519016375 wait complete. 2023-10-09T15:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.244+0000 7f0691a97700 1 Processor -- start 2023-10-09T15:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 -- start start 2023-10-09T15:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 0x7f068c0b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 0x7f068c169870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0b3b20 con 0x7f068c0cf110 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0b3e00 con 0x7f068c15de50 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0691a97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f068c0b40e0 con 0x7f068c153c30 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0690a95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0690a95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32836/0 (socket says 172.21.15.33:32836) 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.245+0000 7f0690a95700 1 -- 172.21.15.33:0/1999971727 learned_addr learned my addr 172.21.15.33:0/1999971727 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f068bfff700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 0x7f068c0b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0691296700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 0x7f068c169870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 -- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 msgr2=0x7f068c0b4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 0x7f068c0b4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 -- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 msgr2=0x7f068c169870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 0x7f068c169870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 -- 172.21.15.33:0/1999971727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f067c009420 con 0x7f068c0cf110 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f068bfff700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 0x7f068c0b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0691296700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 0x7f068c169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0690a95700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f067c0030c0 tx=0x7f067c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c00bae0 con 0x7f068c0cf110 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f067c020070 con 0x7f068c0cf110 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f068c0b43c0 con 0x7f068c0cf110 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f067c01b6a0 con 0x7f068c0cf110 2023-10-09T15:32:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.246+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f068c0b3810 con 0x7f068c0cf110 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.247+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f068c04c3c0 con 0x7f068c0cf110 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.248+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f067c022030 con 0x7f068c0cf110 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.248+0000 7f0688ff9700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.248+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f067c0865d0 con 0x7f068c0cf110 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.248+0000 7f068bfff700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.248+0000 7f068bfff700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 0x7f06780693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0680006fd0 tx=0x7f0680008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.252+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f067c0537f0 con 0x7f068c0cf110 2023-10-09T15:32:14.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.446+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f068c04c3c0 con 0x7f068c0cf110 2023-10-09T15:32:14.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.447+0000 7f0688ff9700 1 -- 172.21.15.33:0/1999971727 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7f067c056e10 con 0x7f068c0cf110 2023-10-09T15:32:14.448 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:14.448 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:11.742810+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3683481332":"2023-10-10T15:32:08.736122+0000","172.21.15.59:6833/3683481332":"2023-10-10T15:32:08.736122+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 msgr2=0x7f06780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 0x7f06780693e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f0680006fd0 tx=0x7f0680008040 comp rx=0 tx=0).stop 2023-10-09T15:32:14.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 msgr2=0x7f068c0b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f067c0030c0 tx=0x7f067c016000 comp rx=0 tx=0).stop 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 shutdown_connections 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0678066f30 0x7f06780693e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f068c0cf110 0x7f068c0b32d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f068c15de50 0x7f068c169870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 --2- 172.21.15.33:0/1999971727 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f068c153c30 0x7f068c0b4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 >> 172.21.15.33:0/1999971727 conn(0x7f068c0703a0 msgr2=0x7f068c0c6600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 shutdown_connections 2023-10-09T15:32:14.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.449+0000 7f0691a97700 1 -- 172.21.15.33:0/1999971727 wait complete. 2023-10-09T15:32:14.462 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:32:14.462 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:14.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.580+0000 7f37cf32d700 1 Processor -- start 2023-10-09T15:32:14.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.580+0000 7f37cf32d700 1 -- start start 2023-10-09T15:32:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cf32d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37c80cb5a0 0x7f37c80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cf32d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c815ae40 con 0x7f37c815a5d0 2023-10-09T15:32:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cf32d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37c815ab60 con 0x7f37c80cd9e0 2023-10-09T15:32:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cf32d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37c80d13f0 con 0x7f37c80cb5a0 2023-10-09T15:32:14.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cd0c9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37c80cb5a0 0x7f37c80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cd8ca700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f37c815a5d0 0x7f37c8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56248/0 (socket says 172.21.15.33:56248) 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.581+0000 7f37cd8ca700 1 -- 172.21.15.33:0/3283741889 learned_addr learned my addr 172.21.15.33:0/3283741889 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37c7fff700 1 -- 172.21.15.33:0/3283741889 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 764506646 0 0) 0x7f37c815ae40 con 0x7f37c815a5d0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37c7fff700 1 -- 172.21.15.33:0/3283741889 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37b0003570 con 0x7f37c815a5d0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cd0c9700 1 -- 172.21.15.33:0/3283741889 >> v1:172.21.15.59:6789/0 conn(0x7f37c80cd9e0 legacy=0x7f37c8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cd0c9700 1 -- 172.21.15.33:0/3283741889 >> v1:172.21.15.33:6789/0 conn(0x7f37c815a5d0 legacy=0x7f37c8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cd0c9700 1 -- 172.21.15.33:0/3283741889 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c80ccf00 con 0x7f37c80cb5a0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cd0c9700 1 --2- 172.21.15.33:0/3283741889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c80cb5a0 0x7f37c80cb970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009910 tx=0x7f37b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e896ee78f7ac9ab1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37c7fff700 1 -- 172.21.15.33:0/3283741889 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8011630 con 0x7f37c80cb5a0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37c7fff700 1 -- 172.21.15.33:0/3283741889 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37b8011790 con 0x7f37c80cb5a0 2023-10-09T15:32:14.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37c7fff700 1 -- 172.21.15.33:0/3283741889 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37b8011b50 con 0x7f37c80cb5a0 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cf32d700 1 -- 172.21.15.33:0/3283741889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c80cb5a0 msgr2=0x7f37c80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cf32d700 1 --2- 172.21.15.33:0/3283741889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c80cb5a0 0x7f37c80cb970 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f37b8009910 tx=0x7f37b80091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cf32d700 1 -- 172.21.15.33:0/3283741889 shutdown_connections 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cf32d700 1 --2- 172.21.15.33:0/3283741889 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c80cb5a0 0x7f37c80cb970 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.582+0000 7f37cf32d700 1 -- 172.21.15.33:0/3283741889 >> 172.21.15.33:0/3283741889 conn(0x7f37c8070e30 msgr2=0x7f37c80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.583+0000 7f37cf32d700 1 -- 172.21.15.33:0/3283741889 shutdown_connections 2023-10-09T15:32:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.583+0000 7f37cf32d700 1 -- 172.21.15.33:0/3283741889 wait complete. 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.584+0000 7f37cf32d700 1 Processor -- start 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.584+0000 7f37cf32d700 1 -- start start 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c80cb5a0 0x7f37c8151120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c80cd9e0 0x7f37c80c6530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80b4a10 con 0x7f37c815a5d0 2023-10-09T15:32:14.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80b4cf0 con 0x7f37c80cb5a0 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37c80b4fd0 con 0x7f37c80cd9e0 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32852/0 (socket says 172.21.15.33:32852) 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 -- 172.21.15.33:0/2192045543 learned_addr learned my addr 172.21.15.33:0/2192045543 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd0c9700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c80cb5a0 0x7f37c8151120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cc8c8700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c80cd9e0 0x7f37c80c6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 -- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c80cd9e0 msgr2=0x7f37c80c6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c80cd9e0 0x7f37c80c6530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 -- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c80cb5a0 msgr2=0x7f37c8151120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c80cb5a0 0x7f37c8151120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 -- 172.21.15.33:0/2192045543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37b8009420 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cd8ca700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f37c0001460 tx=0x7f37c0001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000a950 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c000aab0 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37c80b52b0 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c000ae30 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.585+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37c8151660 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.586+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37c804c3c0 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.587+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f37c0007300 con 0x7f37c815a5d0 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.587+0000 7f37c57fa700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 0x7f37b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.587+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f37c00849c0 con 0x7f37c815a5d0 2023-10-09T15:32:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.587+0000 7f37cd0c9700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 0x7f37b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.588+0000 7f37cd0c9700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 0x7f37b40693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37b80030c0 tx=0x7f37b8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.591+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37c0051c60 con 0x7f37c815a5d0 2023-10-09T15:32:14.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.830+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f37c80cd1e0 con 0x7f37c815a5d0 2023-10-09T15:32:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.831+0000 7f37c57fa700 1 -- 172.21.15.33:0/2192045543 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4597 (secure 0 0 0) 0x7f37c006a210 con 0x7f37c815a5d0 2023-10-09T15:32:14.832 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:14.832 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1132357598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1132357598},{"type":"v1","addr":"172.21.15.59:6835","nonce":1132357598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:32:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 msgr2=0x7f37b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 0x7f37b40693e0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f37b80030c0 tx=0x7f37b8016000 comp rx=0 tx=0).stop 2023-10-09T15:32:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 msgr2=0x7f37c80c6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f37c0001460 tx=0x7f37c0001a40 comp rx=0 tx=0).stop 2023-10-09T15:32:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 shutdown_connections 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37b4066f30 0x7f37b40693e0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37c815a5d0 0x7f37c80c6a70 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37c80cb5a0 0x7f37c8151120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 --2- 172.21.15.33:0/2192045543 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37c80cd9e0 0x7f37c80c6530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 >> 172.21.15.33:0/2192045543 conn(0x7f37c8070e30 msgr2=0x7f37c80cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 shutdown_connections 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.833+0000 7f37cf32d700 1 -- 172.21.15.33:0/2192045543 wait complete. 2023-10-09T15:32:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2023-10-09T15:32:14.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:14.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.964+0000 7fd689942700 1 Processor -- start 2023-10-09T15:32:14.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.964+0000 7fd689942700 1 -- start start 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689942700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689942700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6840c6d50 con 0x7fd684140e40 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689942700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6840c7030 con 0x7fd68406de50 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840c7310 con 0x7fd684140a70 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689141700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd688940700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd683fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd684140e40 0x7fd6840c7df0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:32890/0 (socket says 172.21.15.33:32890) 2023-10-09T15:32:14.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd689141700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:38448/0 (socket says 172.21.15.33:38448) 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd683fff700 1 -- 172.21.15.33:0/982489217 learned_addr learned my addr 172.21.15.33:0/982489217 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.965+0000 7fd688940700 1 --2- 172.21.15.33:0/982489217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:46908/0 (socket says 172.21.15.33:46908) 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd688940700 1 -- 172.21.15.33:0/982489217 >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 msgr2=0x7fd6840aeef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd688940700 1 --2- 172.21.15.33:0/982489217 >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd688940700 1 -- 172.21.15.33:0/982489217 >> v1:172.21.15.59:6789/0 conn(0x7fd684140e40 legacy=0x7fd6840c7df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd688940700 1 -- 172.21.15.33:0/982489217 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6840c75f0 con 0x7fd684140a70 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd689141700 1 --2- 172.21.15.33:0/982489217 >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd688940700 1 --2- 172.21.15.33:0/982489217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098e0 tx=0x7fd6740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f5eecec84af9ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd6837fe700 1 -- 172.21.15.33:0/982489217 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400b640 con 0x7fd684140a70 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd6837fe700 1 -- 172.21.15.33:0/982489217 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400b7a0 con 0x7fd684140a70 2023-10-09T15:32:14.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.966+0000 7fd6837fe700 1 -- 172.21.15.33:0/982489217 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400bb40 con 0x7fd684140a70 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 -- 172.21.15.33:0/982489217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 msgr2=0x7fd6840c6770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 --2- 172.21.15.33:0/982489217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fd6740098e0 tx=0x7fd6740091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 -- 172.21.15.33:0/982489217 shutdown_connections 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 --2- 172.21.15.33:0/982489217 >> v2:172.21.15.59:3300/0 conn(0x7fd68406de50 0x7fd6840aeef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 --2- 172.21.15.33:0/982489217 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140a70 0x7fd6840c6770 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 -- 172.21.15.33:0/982489217 >> 172.21.15.33:0/982489217 conn(0x7fd68406d170 msgr2=0x7fd6840cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 -- 172.21.15.33:0/982489217 shutdown_connections 2023-10-09T15:32:14.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.967+0000 7fd689942700 1 -- 172.21.15.33:0/982489217 wait complete. 2023-10-09T15:32:14.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.968+0000 7fd689942700 1 Processor -- start 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.968+0000 7fd689942700 1 -- start start 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68406de50 0x7fd68413d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140e40 0x7fd6840c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68413d930 con 0x7fd684140a70 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd684158ee0 con 0x7fd68406de50 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841588b0 con 0x7fd684140e40 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32856/0 (socket says 172.21.15.33:32856) 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 -- 172.21.15.33:0/1784127242 learned_addr learned my addr 172.21.15.33:0/1784127242 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:14.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd689141700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140e40 0x7fd6840c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd688940700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68406de50 0x7fd68413d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 -- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140e40 msgr2=0x7fd6840c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140e40 0x7fd6840c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 -- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68406de50 msgr2=0x7fd68413d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68406de50 0x7fd68413d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 -- 172.21.15.33:0/1784127242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009a20 con 0x7fd684140a70 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.969+0000 7fd683fff700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c590 tx=0x7fd678001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.970+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678005b80 con 0x7fd684140a70 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.970+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd678005ce0 con 0x7fd684140a70 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.970+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd674009420 con 0x7fd684140a70 2023-10-09T15:32:14.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.970+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd678004ad0 con 0x7fd684140a70 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.970+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6840cb250 con 0x7fd684140a70 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.971+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684159070 con 0x7fd684140a70 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.971+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd6780070d0 con 0x7fd684140a70 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.971+0000 7fd680ff9700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 0x7fd670069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.972+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd678083770 con 0x7fd684140a70 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.972+0000 7fd688940700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 0x7fd670069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:14.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.972+0000 7fd688940700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 0x7fd670069410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6740093f0 tx=0x7fd674017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:14.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:14.976+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd67804b5a0 con 0x7fd684140a70 2023-10-09T15:32:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.216+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd68404c3c0 con 0x7fd684140a70 2023-10-09T15:32:15.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.216+0000 7fd680ff9700 1 -- 172.21.15.33:0/1784127242 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) v1 ==== 94+0+4597 (secure 0 0 0) 0x7fd678050a50 con 0x7fd684140a70 2023-10-09T15:32:15.217 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:15.217 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":22,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1132357598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1132357598},{"type":"v1","addr":"172.21.15.59:6835","nonce":1132357598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:31:48.826151+0000","modified":"2023-10-09T15:31:52.451884+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4938},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4938":{"gid":4938,"name":"a","rank":0,"incarnation":12,"state":"up:active","state_seq":4,"addr":"172.21.15.33:6836/3091408111","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3091408111},{"type":"v1","addr":"172.21.15.33:6836","nonce":3091408111}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":2}]} 2023-10-09T15:32:15.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 msgr2=0x7fd670069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 0x7fd670069410 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fd6740093f0 tx=0x7fd674017000 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 msgr2=0x7fd6840c31e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd67800c590 tx=0x7fd678001070 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 shutdown_connections 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f60 0x7fd670069410 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd684140e40 0x7fd6840c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68406de50 0x7fd68413d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 --2- 172.21.15.33:0/1784127242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd684140a70 0x7fd6840c31e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 >> 172.21.15.33:0/1784127242 conn(0x7fd68406d170 msgr2=0x7fd6840b19c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 shutdown_connections 2023-10-09T15:32:15.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.218+0000 7fd689942700 1 -- 172.21.15.33:0/1784127242 wait complete. 2023-10-09T15:32:15.221 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 22 2023-10-09T15:32:15.231 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:15.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.349+0000 7f96ccc24700 1 Processor -- start 2023-10-09T15:32:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.349+0000 7f96ccc24700 1 -- start start 2023-10-09T15:32:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.350+0000 7f96ccc24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 0x7f96c80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.350+0000 7f96ccc24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.350+0000 7f96ccc24700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96c80ce1a0 con 0x7f96c80a8be0 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.350+0000 7f96ccc24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96c80cd5d0 con 0x7f96c80aee90 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.350+0000 7f96ccc24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c80cd870 con 0x7f96c806d280 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 0x7f96c80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c659c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f96c80a8be0 0x7f96c80ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:32896/0 (socket says 172.21.15.33:32896) 2023-10-09T15:32:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:46930/0 (socket says 172.21.15.33:46930) 2023-10-09T15:32:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c659c700 1 -- 172.21.15.33:0/387821487 learned_addr learned my addr 172.21.15.33:0/387821487 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c5d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 0x7f96c80a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:38470/0 (socket says 172.21.15.33:38470) 2023-10-09T15:32:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 -- 172.21.15.33:0/387821487 >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 msgr2=0x7f96c80a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c559a700 1 -- 172.21.15.33:0/387821487 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3068815975 0 0) 0x7f96c80ce1a0 con 0x7f96c80a8be0 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 --2- 172.21.15.33:0/387821487 >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 0x7f96c80a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 -- 172.21.15.33:0/387821487 >> v1:172.21.15.59:6789/0 conn(0x7f96c80a8be0 legacy=0x7f96c80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 -- 172.21.15.33:0/387821487 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c80cdb50 con 0x7f96c806d280 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c6d9d700 1 --2- 172.21.15.33:0/387821487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96b80098e0 tx=0x7f96b80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=643f609a68c26996 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c559a700 1 -- 172.21.15.33:0/387821487 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800b6d0 con 0x7f96c806d280 2023-10-09T15:32:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c559a700 1 -- 172.21.15.33:0/387821487 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96b800b830 con 0x7f96c806d280 2023-10-09T15:32:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.351+0000 7f96c559a700 1 -- 172.21.15.33:0/387821487 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96b800bbd0 con 0x7f96c806d280 2023-10-09T15:32:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 -- 172.21.15.33:0/387821487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 msgr2=0x7f96c80b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 --2- 172.21.15.33:0/387821487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f96b80098e0 tx=0x7f96b80091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 -- 172.21.15.33:0/387821487 shutdown_connections 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 --2- 172.21.15.33:0/387821487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c806d280 0x7f96c80b08c0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 --2- 172.21.15.33:0/387821487 >> v2:172.21.15.59:3300/0 conn(0x7f96c80aee90 0x7f96c80a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 -- 172.21.15.33:0/387821487 >> 172.21.15.33:0/387821487 conn(0x7f96c806ce80 msgr2=0x7f96c80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 -- 172.21.15.33:0/387821487 shutdown_connections 2023-10-09T15:32:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.352+0000 7f96ccc24700 1 -- 172.21.15.33:0/387821487 wait complete. 2023-10-09T15:32:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.353+0000 7f96ccc24700 1 Processor -- start 2023-10-09T15:32:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.353+0000 7f96ccc24700 1 -- start start 2023-10-09T15:32:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c80a8be0 0x7f96c815dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c80aee90 0x7f96c80cb950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c8157310 con 0x7f96c806d280 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815d8b0 con 0x7f96c80a8be0 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96ccc24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96c815cca0 con 0x7f96c80aee90 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32870/0 (socket says 172.21.15.33:32870) 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 -- 172.21.15.33:0/1955062941 learned_addr learned my addr 172.21.15.33:0/1955062941 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c6d9d700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c80aee90 0x7f96c80cb950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c5d9b700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c80a8be0 0x7f96c815dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 -- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c80aee90 msgr2=0x7f96c80cb950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c80aee90 0x7f96c80cb950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 -- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c80a8be0 msgr2=0x7f96c815dd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c80a8be0 0x7f96c815dd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 -- 172.21.15.33:0/1955062941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96b8009420 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.354+0000 7f96c659c700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f96c000cd50 tx=0x7f96c0001af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.355+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000ce50 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.355+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c000aac0 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.355+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c000ae80 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.355+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96c815cf80 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.355+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96c815d540 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.356+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96c804c3c0 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.356+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f96c0012610 con 0x7f96c806d280 2023-10-09T15:32:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.357+0000 7f96be7fc700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 0x7f96a80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.357+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f96c0084870 con 0x7f96c806d280 2023-10-09T15:32:15.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.357+0000 7f96c5d9b700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 0x7f96a80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.357+0000 7f96c5d9b700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 0x7f96a80693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96c80a8740 tx=0x7f96b0009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.361+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96c0051b10 con 0x7f96c806d280 2023-10-09T15:32:15.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.557+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96c80a8770 con 0x7f96c806d280 2023-10-09T15:32:15.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.558+0000 7f96be7fc700 1 -- 172.21.15.33:0/1955062941 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v39) v1 ==== 74+0+15431 (secure 0 0 0) 0x7f96c0055130 con 0x7f96c806d280 2023-10-09T15:32:15.559 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:15.559 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":39,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:11.742810+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:31:46.599926+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-10-09T15:31:47.807057+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/3683481332":"2023-10-10T15:32:08.736122+0000","172.21.15.59:6833/3683481332":"2023-10-10T15:32:08.736122+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:15.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 msgr2=0x7f96a80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 0x7f96a80693e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f96c80a8740 tx=0x7f96b0009120 comp rx=0 tx=0).stop 2023-10-09T15:32:15.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 msgr2=0x7f96c815c6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f96c000cd50 tx=0x7f96c0001af0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 shutdown_connections 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96a8066f30 0x7f96a80693e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96c806d280 0x7f96c815c6c0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96c80aee90 0x7f96c80cb950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 --2- 172.21.15.33:0/1955062941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96c80a8be0 0x7f96c815dd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 >> 172.21.15.33:0/1955062941 conn(0x7f96c806ce80 msgr2=0x7f96c80ce480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 shutdown_connections 2023-10-09T15:32:15.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.560+0000 7f96ccc24700 1 -- 172.21.15.33:0/1955062941 wait complete. 2023-10-09T15:32:15.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:32:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.692+0000 7fd68f59e700 1 Processor -- start 2023-10-09T15:32:15.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.692+0000 7fd68f59e700 1 -- start start 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd6900c30b0 0x7fd6900cc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68f59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900c9560 con 0x7fd6900b0890 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68f59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6900cd200 con 0x7fd6900ccdc0 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6900b0c60 con 0x7fd6900c30b0 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68e59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd6900b0890 0x7fd6900c3fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56250/0 (socket says 172.21.15.33:56250) 2023-10-09T15:32:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.693+0000 7fd68e59c700 1 -- 172.21.15.33:0/2972201605 learned_addr learned my addr 172.21.15.33:0/2972201605 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3316451709 0 0) 0x7fd6900c9560 con 0x7fd6900b0890 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68dd9b700 1 --2- 172.21.15.33:0/2972201605 >> v2:172.21.15.59:3300/0 conn(0x7fd6900c30b0 0x7fd6900cc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd67c003570 con 0x7fd6900b0890 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3416164274 0 0) 0x7fd67c003570 con 0x7fd6900b0890 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 >> v2:172.21.15.59:3300/0 conn(0x7fd6900c30b0 msgr2=0x7fd6900cc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 --2- 172.21.15.33:0/2972201605 >> v2:172.21.15.59:3300/0 conn(0x7fd6900c30b0 0x7fd6900cc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 >> v1:172.21.15.59:6789/0 conn(0x7fd6900ccdc0 legacy=0x7fd6900c99f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6901579b0 con 0x7fd6900b0890 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fd6800017f0 con 0x7fd6900b0890 2023-10-09T15:32:15.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 >> v1:172.21.15.33:6789/0 conn(0x7fd6900b0890 legacy=0x7fd6900c3fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd67c003a60 0x7fd67c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c004810 0x7fd67c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 0x7fd67c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6900b0c60 con 0x7fd67c0051c0 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c00c0d0 con 0x7fd67c003a60 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd67c00c290 con 0x7fd67c004810 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68dd9b700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c004810 0x7fd67c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68e59c700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd67c003a60 0x7fd67c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 0x7fd67c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c004810 msgr2=0x7fd67c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:15.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c004810 0x7fd67c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd67c003a60 msgr2=0x7fd67c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd67c003a60 0x7fd67c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.694+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2972201605 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c003570 con 0x7fd67c0051c0 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2972201605 reap_dead start 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 0x7fd67c00ba60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6880018b0 tx=0x7fd688007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8c73f19fefbf7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012420 con 0x7fd67c0051c0 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688012580 con 0x7fd67c0051c0 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68d59a700 1 -- 172.21.15.33:0/2972201605 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012920 con 0x7fd67c0051c0 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 -- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 msgr2=0x7fd67c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 0x7fd67c00ba60 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7fd6880018b0 tx=0x7fd688007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:15.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 -- 172.21.15.33:0/2972201605 shutdown_connections 2023-10-09T15:32:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2972201605 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd67c0051c0 0x7fd67c00ba60 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 -- 172.21.15.33:0/2972201605 >> 172.21.15.33:0/2972201605 conn(0x7fd690097590 msgr2=0x7fd69006ce80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 -- 172.21.15.33:0/2972201605 shutdown_connections 2023-10-09T15:32:15.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.695+0000 7fd68f59e700 1 -- 172.21.15.33:0/2972201605 wait complete. 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.696+0000 7fd68f59e700 1 Processor -- start 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.696+0000 7fd68f59e700 1 -- start start 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 0x7fd6900c7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 0x7fd690147dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6901516c0 con 0x7fd69006efb0 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006eb20 con 0x7fd69006d7b0 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd69006dc20 con 0x7fd67c0051c0 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32888/0 (socket says 172.21.15.33:32888) 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.697+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2330841441 learned_addr learned my addr 172.21.15.33:0/2330841441 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68dd9b700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 0x7fd690147dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68e59c700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 0x7fd6900c7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 msgr2=0x7fd6900c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 0x7fd6900c7b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 msgr2=0x7fd690147dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 0x7fd690147dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 -- 172.21.15.33:0/2330841441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd690148300 con 0x7fd69006efb0 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68dd9b700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 0x7fd690147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68e59c700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 0x7fd6900c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68ed9d700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c3f0 tx=0x7fd688015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688012420 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd688001200 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd69006de90 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd688006a30 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.698+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd69006e4d0 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.699+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd69006ecb0 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.699+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd688007030 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.700+0000 7fd6867fc700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.700+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fd688085470 con 0x7fd69006efb0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.700+0000 7fd68e59c700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:15.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.700+0000 7fd68e59c700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd680001190 tx=0x7fd680006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:15.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.704+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd688052690 con 0x7fd69006efb0 2023-10-09T15:32:15.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.942+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fd69004c3c0 con 0x7fd69006efb0 2023-10-09T15:32:15.943 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:32:15.943+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:32:15.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.948+0000 7fd6867fc700 1 -- 172.21.15.33:0/2330841441 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v23) v1 ==== 161+0+0 (secure 0 0 0) 0x7fd688017090 con 0x7fd69006efb0 2023-10-09T15:32:15.950 INFO:tasks.ceph.mds.a.smithi033.stderr: -1288> 2023-10-09T15:31:51.405+0000 7f21286aa700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 msgr2=0x7fd6700693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 0x7fd6700693e0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd680001190 tx=0x7fd680006040 comp rx=0 tx=0).stop 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 msgr2=0x7fd6900af310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7fd68800c3f0 tx=0x7fd688015000 comp rx=0 tx=0).stop 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 shutdown_connections 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd670066f30 0x7fd6700693e0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd69006efb0 0x7fd6900af310 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd67c0051c0 0x7fd6900c7b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 --2- 172.21.15.33:0/2330841441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd69006d7b0 0x7fd690147dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 >> 172.21.15.33:0/2330841441 conn(0x7fd690097590 msgr2=0x7fd6900ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 shutdown_connections 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:15.952+0000 7fd68f59e700 1 -- 172.21.15.33:0/2330841441 wait complete. 2023-10-09T15:32:15.954 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:32:15.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:32:15.974 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:32:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.087+0000 7fb05549b700 1 Processor -- start 2023-10-09T15:32:16.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.087+0000 7fb05549b700 1 -- start start 2023-10-09T15:32:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb050159530 0x7fb0500ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb05006dc70 0x7fb050159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500ccfd0 con 0x7fb05006dc70 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0500cf0e0 con 0x7fb050159530 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb05549b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb05015a3d0 con 0x7fb05006e0e0 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb05006dc70 0x7fb050159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb05006dc70 0x7fb050159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32920/0 (socket says 172.21.15.33:32920) 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 -- 172.21.15.33:0/388279553 learned_addr learned my addr 172.21.15.33:0/388279553 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04effd700 1 --2- 172.21.15.33:0/388279553 >> v2:172.21.15.59:3300/0 conn(0x7fb050159530 0x7fb0500ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04f7fe700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 -- 172.21.15.33:0/388279553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 msgr2=0x7fb0500cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:16.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 -- 172.21.15.33:0/388279553 >> v2:172.21.15.59:3300/0 conn(0x7fb050159530 msgr2=0x7fb0500ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/388279553 >> v2:172.21.15.59:3300/0 conn(0x7fb050159530 0x7fb0500ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 -- 172.21.15.33:0/388279553 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb05015a6b0 con 0x7fb05006dc70 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.088+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb050159900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb05006d630 tx=0x7fb038009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692d8987348b8a27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb04dffb700 1 -- 172.21.15.33:0/388279553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800b640 con 0x7fb05006dc70 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb04dffb700 1 -- 172.21.15.33:0/388279553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03800b7a0 con 0x7fb05006dc70 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb04dffb700 1 -- 172.21.15.33:0/388279553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03800bb60 con 0x7fb05006dc70 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 -- 172.21.15.33:0/388279553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 msgr2=0x7fb050159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb050159900 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fb05006d630 tx=0x7fb038009250 comp rx=0 tx=0).stop 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 -- 172.21.15.33:0/388279553 shutdown_connections 2023-10-09T15:32:16.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 --2- 172.21.15.33:0/388279553 >> v2:172.21.15.59:3300/0 conn(0x7fb050159530 0x7fb0500ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 --2- 172.21.15.33:0/388279553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb050159900 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 -- 172.21.15.33:0/388279553 >> 172.21.15.33:0/388279553 conn(0x7fb0500703a0 msgr2=0x7fb0500707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 -- 172.21.15.33:0/388279553 shutdown_connections 2023-10-09T15:32:16.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.089+0000 7fb05549b700 1 -- 172.21.15.33:0/388279553 wait complete. 2023-10-09T15:32:16.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.090+0000 7fb05549b700 1 Processor -- start 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.090+0000 7fb05549b700 1 -- start start 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500b2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 0x7fb050154a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb05014e800 con 0x7fb05006dc70 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500b5040 con 0x7fb050159530 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb05549b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0500b26c0 con 0x7fb05006e0e0 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32930/0 (socket says 172.21.15.33:32930) 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 -- 172.21.15.33:0/360420716 learned_addr learned my addr 172.21.15.33:0/360420716 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04f7fe700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 0x7fb050154a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 -- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 msgr2=0x7fb0500b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 -- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 msgr2=0x7fb050154a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 0x7fb050154a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04effd700 1 -- 172.21.15.33:0/360420716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0380094f0 con 0x7fb05006dc70 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04f7fe700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 0x7fb050154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.091+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb04effd700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb04800e930 tx=0x7fb0480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:16.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800eed0 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb04800c850 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0500b4430 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb04800cbf0 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.092+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0500b49f0 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.093+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb05004c3c0 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.094+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb048013470 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.095+0000 7fb046ffd700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.095+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fb048084f70 con 0x7fb05006dc70 2023-10-09T15:32:16.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.095+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.095+0000 7fb04e7fc700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 0x7fb0300693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb05006d630 tx=0x7fb038017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:16.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.098+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0480521b0 con 0x7fb05006dc70 2023-10-09T15:32:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.342+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb050155820 con 0x7fb05006dc70 2023-10-09T15:32:16.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.949+0000 7fb046ffd700 1 -- 172.21.15.33:0/360420716 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v24) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb0480557d0 con 0x7fb05006dc70 2023-10-09T15:32:16.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 msgr2=0x7fb0300693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 0x7fb0300693e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb05006d630 tx=0x7fb038017000 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 msgr2=0x7fb05014e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fb04800e930 tx=0x7fb0480091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 shutdown_connections 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb030066f30 0x7fb0300693e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb05006dc70 0x7fb05014e2c0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb050159530 0x7fb050154a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 --2- 172.21.15.33:0/360420716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb05006e0e0 0x7fb0500b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 >> 172.21.15.33:0/360420716 conn(0x7fb0500703a0 msgr2=0x7fb0500d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:16.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 shutdown_connections 2023-10-09T15:32:16.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:16.952+0000 7fb05549b700 1 -- 172.21.15.33:0/360420716 wait complete. 2023-10-09T15:32:16.968 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:32:17.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.139+0000 7f0da9de6700 1 Processor -- start 2023-10-09T15:32:17.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.139+0000 7f0da9de6700 1 -- start start 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.140+0000 7f0da9de6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0da40cce90 0x7f0da40cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.140+0000 7f0da9de6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.140+0000 7f0da9de6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0da415d570 con 0x7f0da4159fb0 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.140+0000 7f0da9de6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0da415e180 con 0x7f0da40cce90 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.140+0000 7f0da9de6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40cd870 con 0x7f0da40cb440 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da95e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0da40cce90 0x7f0da40cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da95e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:47000/0 (socket says 172.21.15.33:47000) 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da95e5700 1 -- 172.21.15.33:0/1985716352 learned_addr learned my addr 172.21.15.33:0/1985716352 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da8de4700 1 --1- 172.21.15.33:0/1985716352 >> v1:172.21.15.59:6789/0 conn(0x7f0da4159fb0 0x7f0da415a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:32932/0 (socket says 172.21.15.33:32932) 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 -- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 msgr2=0x7f0da40cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 -- 172.21.15.33:0/1985716352 >> v1:172.21.15.59:6789/0 conn(0x7f0da4159fb0 legacy=0x7f0da415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da37fe700 1 -- 172.21.15.33:0/1985716352 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3458798526 0 0) 0x7f0da415d570 con 0x7f0da4159fb0 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 -- 172.21.15.33:0/1985716352 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0da415d850 con 0x7f0da40cce90 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da95e5700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da3fff700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da40cce90 0x7f0da40cd330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d940098e0 tx=0x7f0d940091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c51dfce0d3155513 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.141+0000 7f0da37fe700 1 -- 172.21.15.33:0/1985716352 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400b640 con 0x7f0da40cce90 2023-10-09T15:32:17.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da37fe700 1 -- 172.21.15.33:0/1985716352 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d9400b7a0 con 0x7f0da40cce90 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da37fe700 1 -- 172.21.15.33:0/1985716352 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d9400bb40 con 0x7f0da40cce90 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 -- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da40cce90 msgr2=0x7f0da40cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da40cce90 0x7f0da40cd330 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f0d940098e0 tx=0x7f0d940091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 -- 172.21.15.33:0/1985716352 shutdown_connections 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cb440 0x7f0da40cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 --2- 172.21.15.33:0/1985716352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da40cce90 0x7f0da40cd330 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 -- 172.21.15.33:0/1985716352 >> 172.21.15.33:0/1985716352 conn(0x7f0da40703a0 msgr2=0x7f0da40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 -- 172.21.15.33:0/1985716352 shutdown_connections 2023-10-09T15:32:17.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.142+0000 7f0da9de6700 1 -- 172.21.15.33:0/1985716352 wait complete. 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.143+0000 7f0da9de6700 1 Processor -- start 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.143+0000 7f0da9de6700 1 -- start start 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cce90 0x7f0da414de90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da4159fb0 0x7f0da40c5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da416a710 con 0x7f0da40cb440 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0da40c6960 con 0x7f0da4159fb0 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da9de6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0da4169b00 con 0x7f0da40cce90 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da8de4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da8de4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32944/0 (socket says 172.21.15.33:32944) 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.144+0000 7f0da8de4700 1 -- 172.21.15.33:0/3070247434 learned_addr learned my addr 172.21.15.33:0/3070247434 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da3fff700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cce90 0x7f0da414de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da95e5700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da4159fb0 0x7f0da40c5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 -- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cce90 msgr2=0x7f0da414de90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cce90 0x7f0da414de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 -- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da4159fb0 msgr2=0x7f0da40c5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da4159fb0 0x7f0da40c5d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 -- 172.21.15.33:0/3070247434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d9c009ae0 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da8de4700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c5e0 tx=0x7f0d8c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c005a70 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d8c005bd0 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d94009420 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8c0070d0 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.145+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0da416a0c0 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.146+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0da404c3c0 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.146+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d8c007480 con 0x7f0da40cb440 2023-10-09T15:32:17.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.147+0000 7f0da0ff9700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 0x7f0d840693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.147+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f0d8c083a30 con 0x7f0da40cb440 2023-10-09T15:32:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.147+0000 7f0da3fff700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 0x7f0d840693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:17.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.147+0000 7f0da3fff700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 0x7f0d840693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0da415c960 tx=0x7f0d94017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:17.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.151+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d8c04b5a0 con 0x7f0da40cb440 2023-10-09T15:32:17.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.347+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f0da40c8f40 con 0x7f0da40cb440 2023-10-09T15:32:17.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.956+0000 7f0da0ff9700 1 -- 172.21.15.33:0/3070247434 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v41) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0d8c017070 con 0x7f0da40cb440 2023-10-09T15:32:17.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 msgr2=0x7f0d840693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 0x7f0d840693e0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f0da415c960 tx=0x7f0d94017000 comp rx=0 tx=0).stop 2023-10-09T15:32:17.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 msgr2=0x7f0da40c7600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:17.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c00c5e0 tx=0x7f0d8c001040 comp rx=0 tx=0).stop 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 shutdown_connections 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d84066f30 0x7f0d840693e0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0da40cb440 0x7f0da40c7600 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0da4159fb0 0x7f0da40c5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 --2- 172.21.15.33:0/3070247434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0da40cce90 0x7f0da414de90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 >> 172.21.15.33:0/3070247434 conn(0x7f0da40703a0 msgr2=0x7f0da414f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 shutdown_connections 2023-10-09T15:32:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:17.959+0000 7f0da9de6700 1 -- 172.21.15.33:0/3070247434 wait complete. 2023-10-09T15:32:17.962 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:32:17.976 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:32:18.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.102+0000 7fddddcf8700 1 Processor -- start 2023-10-09T15:32:18.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.102+0000 7fddddcf8700 1 -- start start 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddddcf8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fddd80c8c70 0x7fddd80c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddddcf8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd815d9f0 con 0x7fddd8067e50 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddddcf8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd815d3c0 con 0x7fddd815de80 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddddcf8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd815a8f0 con 0x7fddd80c8c70 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fddd8067e50 0x7fddd8068220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56270/0 (socket says 172.21.15.33:56270) 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd77fe700 1 -- 172.21.15.33:0/938140906 learned_addr learned my addr 172.21.15.33:0/938140906 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd7fff700 1 --2- 172.21.15.33:0/938140906 >> v2:172.21.15.33:3300/0 conn(0x7fddd80c8c70 0x7fddd80c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:18.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd67fc700 1 -- 172.21.15.33:0/938140906 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 124990704 0 0) 0x7fddd815d9f0 con 0x7fddd8067e50 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd67fc700 1 -- 172.21.15.33:0/938140906 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003570 con 0x7fddd8067e50 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd7fff700 1 -- 172.21.15.33:0/938140906 >> v1:172.21.15.59:6789/0 conn(0x7fddd815de80 legacy=0x7fddd8159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd7fff700 1 -- 172.21.15.33:0/938140906 >> v1:172.21.15.33:6789/0 conn(0x7fddd8067e50 legacy=0x7fddd8068220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd7fff700 1 -- 172.21.15.33:0/938140906 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd815abd0 con 0x7fddd80c8c70 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd7fff700 1 --2- 172.21.15.33:0/938140906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd80c9090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009e60 tx=0x7fddd0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dbe6e6b8b8f9c92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd67fc700 1 -- 172.21.15.33:0/938140906 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd000e070 con 0x7fddd80c8c70 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd67fc700 1 -- 172.21.15.33:0/938140906 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddd000bb60 con 0x7fddd80c8c70 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.103+0000 7fddd67fc700 1 -- 172.21.15.33:0/938140906 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddd0012430 con 0x7fddd80c8c70 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 -- 172.21.15.33:0/938140906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 msgr2=0x7fddd80c9090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 --2- 172.21.15.33:0/938140906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd80c9090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fddd0009e60 tx=0x7fddd0009780 comp rx=0 tx=0).stop 2023-10-09T15:32:18.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 -- 172.21.15.33:0/938140906 shutdown_connections 2023-10-09T15:32:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 --2- 172.21.15.33:0/938140906 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd80c9090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 -- 172.21.15.33:0/938140906 >> 172.21.15.33:0/938140906 conn(0x7fddd80ce4a0 msgr2=0x7fddd80ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 -- 172.21.15.33:0/938140906 shutdown_connections 2023-10-09T15:32:18.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.104+0000 7fddddcf8700 1 -- 172.21.15.33:0/938140906 wait complete. 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.105+0000 7fddddcf8700 1 Processor -- start 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.105+0000 7fddddcf8700 1 -- start start 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 0x7fddd8156c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd815de80 0x7fddd815bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c4b00 con 0x7fddd80c8c70 2023-10-09T15:32:18.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c3a60 con 0x7fddd8067e50 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddddcf8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd80c3d40 con 0x7fddd815de80 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32956/0 (socket says 172.21.15.33:32956) 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 -- 172.21.15.33:0/3740964796 learned_addr learned my addr 172.21.15.33:0/3740964796 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd77fe700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 0x7fddd8156c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd7fff700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd815de80 0x7fddd815bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 -- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd815de80 msgr2=0x7fddd815bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd815de80 0x7fddd815bde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 -- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 msgr2=0x7fddd8156c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 0x7fddd8156c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd6ffd700 1 -- 172.21.15.33:0/3740964796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd0009a20 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.106+0000 7fddd77fe700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 0x7fddd8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddd6ffd700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c590 tx=0x7fddcc00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011590 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0116f0 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd80c4020 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc011ab0 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.107+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd80c45e0 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.108+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd80c47d0 con 0x7fddd80c8c70 2023-10-09T15:32:18.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.108+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fddcc01b3b0 con 0x7fddd80c8c70 2023-10-09T15:32:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.109+0000 7fddbf7fe700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 0x7fddc40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.109+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(41..41 src has 1..41) v4 ==== 5439+0+0 (secure 0 0 0) 0x7fddcc0839d0 con 0x7fddd80c8c70 2023-10-09T15:32:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.109+0000 7fddd77fe700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 0x7fddc40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:18.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.109+0000 7fddd77fe700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 0x7fddc40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc8007fd0 tx=0x7fddc8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:18.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.113+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fddcc050d50 con 0x7fddd80c8c70 2023-10-09T15:32:18.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.306+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fddd804c3c0 con 0x7fddd80c8c70 2023-10-09T15:32:18.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.959+0000 7fddbf7fe700 1 -- 172.21.15.33:0/3740964796 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v42) v1 ==== 169+0+0 (secure 0 0 0) 0x7fddcc017020 con 0x7fddd80c8c70 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 msgr2=0x7fddc40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 0x7fddc40693e0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fddc8007fd0 tx=0x7fddc8009040 comp rx=0 tx=0).stop 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 msgr2=0x7fddd8152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00c590 tx=0x7fddcc00c950 comp rx=0 tx=0).stop 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 shutdown_connections 2023-10-09T15:32:18.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fddc4066f30 0x7fddc40693e0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddd815de80 0x7fddd815bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddd8067e50 0x7fddd8156c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 --2- 172.21.15.33:0/3740964796 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fddd80c8c70 0x7fddd8152850 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 >> 172.21.15.33:0/3740964796 conn(0x7fddd80ce4a0 msgr2=0x7fddd8068220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 shutdown_connections 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:18.963+0000 7fddddcf8700 1 -- 172.21.15.33:0/3740964796 wait complete. 2023-10-09T15:32:18.965 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:32:18.981 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:32:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.119+0000 7f89605a4700 1 Processor -- start 2023-10-09T15:32:19.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.119+0000 7f89605a4700 1 -- start start 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f895813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f89580cc6f0 0x7f895813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8958069a00 0x7f8958069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895806d7b0 con 0x7f8958069a00 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f895806e330 con 0x7f89580cc6f0 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f89605a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895806da00 con 0x7f89580cc320 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f895eb41700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8958069a00 0x7f8958069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f895eb41700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8958069a00 0x7f8958069e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32968/0 (socket says 172.21.15.33:32968) 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f895eb41700 1 -- 172.21.15.33:0/1943358487 learned_addr learned my addr 172.21.15.33:0/1943358487 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f895db3f700 1 --2- 172.21.15.33:0/1943358487 >> v2:172.21.15.59:3300/0 conn(0x7f89580cc6f0 0x7f895813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.120+0000 7f895e340700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f895813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 -- 172.21.15.33:0/1943358487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 msgr2=0x7f895813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f895813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 -- 172.21.15.33:0/1943358487 >> v2:172.21.15.59:3300/0 conn(0x7f89580cc6f0 msgr2=0x7f895813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 --2- 172.21.15.33:0/1943358487 >> v2:172.21.15.59:3300/0 conn(0x7f89580cc6f0 0x7f895813c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 -- 172.21.15.33:0/1943358487 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f895806dce0 con 0x7f8958069a00 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895e340700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f895813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895eb41700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f8958069e80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f895806bb70 tx=0x7f8950009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8de198ca7468271d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895d33e700 1 -- 172.21.15.33:0/1943358487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f895000e070 con 0x7f8958069a00 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895d33e700 1 -- 172.21.15.33:0/1943358487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f895000ba20 con 0x7f8958069a00 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f895d33e700 1 -- 172.21.15.33:0/1943358487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89500092e0 con 0x7f8958069a00 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f89605a4700 1 -- 172.21.15.33:0/1943358487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 msgr2=0x7f8958069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.121+0000 7f89605a4700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f8958069e80 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f895806bb70 tx=0x7f8950009840 comp rx=0 tx=0).stop 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 -- 172.21.15.33:0/1943358487 shutdown_connections 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f8958069e80 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 --2- 172.21.15.33:0/1943358487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f895813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 --2- 172.21.15.33:0/1943358487 >> v2:172.21.15.59:3300/0 conn(0x7f89580cc6f0 0x7f895813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 -- 172.21.15.33:0/1943358487 >> 172.21.15.33:0/1943358487 conn(0x7f8958067f00 msgr2=0x7f8958068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 -- 172.21.15.33:0/1943358487 shutdown_connections 2023-10-09T15:32:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.122+0000 7f89605a4700 1 -- 172.21.15.33:0/1943358487 wait complete. 2023-10-09T15:32:19.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.123+0000 7f89605a4700 1 Processor -- start 2023-10-09T15:32:19.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.123+0000 7f89605a4700 1 -- start start 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f89580afc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89580cc6f0 0x7f89580b01c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895816acc0 con 0x7f8958069a00 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f895816a040 con 0x7f89580cc6f0 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f89605a4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f895816a320 con 0x7f89580cc320 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32970/0 (socket says 172.21.15.33:32970) 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 -- 172.21.15.33:0/855619229 learned_addr learned my addr 172.21.15.33:0/855619229 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895db3f700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f89580afc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895eb41700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89580cc6f0 0x7f89580b01c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 -- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 msgr2=0x7f89580afc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f89580afc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 -- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89580cc6f0 msgr2=0x7f89580b01c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89580cc6f0 0x7f89580b01c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 -- 172.21.15.33:0/855619229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8950009ae0 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f895e340700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f895400e8d0 tx=0x7f8954008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.124+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954013410 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.125+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8954013570 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.125+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f895816a600 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.125+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8954013910 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.125+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f895813b530 con 0x7f8958069a00 2023-10-09T15:32:19.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.126+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f895816aaa0 con 0x7f8958069a00 2023-10-09T15:32:19.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.126+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8954013d00 con 0x7f8958069a00 2023-10-09T15:32:19.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.126+0000 7f894e7fc700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 0x7f893c0694b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.126+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8954083ea0 con 0x7f8958069a00 2023-10-09T15:32:19.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.126+0000 7f895db3f700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 0x7f893c0694b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.127+0000 7f895db3f700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 0x7f893c0694b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8958153800 tx=0x7f89480091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.131+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89540513b0 con 0x7f8958069a00 2023-10-09T15:32:19.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.325+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f895804c3c0 con 0x7f8958069a00 2023-10-09T15:32:19.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.328+0000 7f894e7fc700 1 -- 172.21.15.33:0/855619229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7f89540549d0 con 0x7f8958069a00 2023-10-09T15:32:19.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 msgr2=0x7f893c0694b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 0x7f893c0694b0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f8958153800 tx=0x7f89480091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 msgr2=0x7f895813aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f895400e8d0 tx=0x7f8954008040 comp rx=0 tx=0).stop 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 shutdown_connections 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f893c067000 0x7f893c0694b0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8958069a00 0x7f895813aff0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89580cc6f0 0x7f89580b01c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 --2- 172.21.15.33:0/855619229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89580cc320 0x7f89580afc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 >> 172.21.15.33:0/855619229 conn(0x7f8958067f00 msgr2=0x7f89580b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 shutdown_connections 2023-10-09T15:32:19.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.330+0000 7f89605a4700 1 -- 172.21.15.33:0/855619229 wait complete. 2023-10-09T15:32:19.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create' 2023-10-09T15:32:19.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.461+0000 7f9b22248700 1 Processor -- start 2023-10-09T15:32:19.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.461+0000 7f9b22248700 1 -- start start 2023-10-09T15:32:19.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.462+0000 7f9b22248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.462+0000 7f9b22248700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 0x7f9b1c06d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.462+0000 7f9b22248700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b1c0cec30 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.462+0000 7f9b22248700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b1c06e220 con 0x7f9b1c15a8c0 2023-10-09T15:32:19.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.462+0000 7f9b22248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0ce930 con 0x7f9b1c0b2980 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b20a45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 0x7f9b1c06d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:47040/0 (socket says 172.21.15.33:47040) 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21a47700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f9b1c06ddd0 0x7f9b1c15d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:32950/0 (socket says 172.21.15.33:32950) 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b20a45700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 0x7f9b1c06d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:38620/0 (socket says 172.21.15.33:38620) 2023-10-09T15:32:19.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 -- 172.21.15.33:0/2474890 learned_addr learned my addr 172.21.15.33:0/2474890 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 -- 172.21.15.33:0/2474890 >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 msgr2=0x7f9b1c06d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 --2- 172.21.15.33:0/2474890 >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 0x7f9b1c06d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 -- 172.21.15.33:0/2474890 >> v1:172.21.15.59:6789/0 conn(0x7f9b1c06ddd0 legacy=0x7f9b1c15d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 -- 172.21.15.33:0/2474890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b1c0d00d0 con 0x7f9b1c0b2980 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b21246700 1 --2- 172.21.15.33:0/2474890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b140099b0 tx=0x7f9b14009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5e27c10b8f7fbcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b1bfff700 1 -- 172.21.15.33:0/2474890 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14009ea0 con 0x7f9b1c0b2980 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b1bfff700 1 -- 172.21.15.33:0/2474890 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400b860 con 0x7f9b1c0b2980 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.463+0000 7f9b1bfff700 1 -- 172.21.15.33:0/2474890 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400bc00 con 0x7f9b1c0b2980 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 -- 172.21.15.33:0/2474890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 msgr2=0x7f9b1c0cce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 --2- 172.21.15.33:0/2474890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9b140099b0 tx=0x7f9b14009250 comp rx=0 tx=0).stop 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 -- 172.21.15.33:0/2474890 shutdown_connections 2023-10-09T15:32:19.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 --2- 172.21.15.33:0/2474890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c0b2980 0x7f9b1c0cce00 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 --2- 172.21.15.33:0/2474890 >> v2:172.21.15.59:3300/0 conn(0x7f9b1c15a8c0 0x7f9b1c06d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 -- 172.21.15.33:0/2474890 >> 172.21.15.33:0/2474890 conn(0x7f9b1c0703a0 msgr2=0x7f9b1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:19.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 -- 172.21.15.33:0/2474890 shutdown_connections 2023-10-09T15:32:19.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.464+0000 7f9b22248700 1 -- 172.21.15.33:0/2474890 wait complete. 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.465+0000 7f9b22248700 1 Processor -- start 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.465+0000 7f9b22248700 1 -- start start 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c0b2980 0x7f9b1c0b1290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c15a8c0 0x7f9b1c0b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c148670 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b4930 con 0x7f9b1c0b2980 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b22248700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b1c0b4c10 con 0x7f9b1c15a8c0 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32984/0 (socket says 172.21.15.33:32984) 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 -- 172.21.15.33:0/1383758626 learned_addr learned my addr 172.21.15.33:0/1383758626 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21a47700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c15a8c0 0x7f9b1c0b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b20a45700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c0b2980 0x7f9b1c0b1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 -- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c15a8c0 msgr2=0x7f9b1c0b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c15a8c0 0x7f9b1c0b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 -- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c0b2980 msgr2=0x7f9b1c0b1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c0b2980 0x7f9b1c0b1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.466+0000 7f9b21246700 1 -- 172.21.15.33:0/1383758626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b140094f0 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b21246700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0cea70 tx=0x7f9b14017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14000d10 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1400bbe0 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b14011650 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c0b4ef0 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.467+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b1c0b45e0 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.468+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b1c0b5520 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.468+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9b14011a80 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.469+0000 7f9b197fa700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.469+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f9b14085b00 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.469+0000 7f9b20a45700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.469+0000 7f9b20a45700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 0x7f9b080693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0b00d0 tx=0x7f9b100091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.473+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9b14053010 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.743+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]} v 0) v1 -- 0x7f9b1c04c3c0 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.972+0000 7f9b197fa700 1 -- 172.21.15.33:0/1383758626 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_create"]}]=0 v93) v1 ==== 135+0+0 (secure 0 0 0) 0x7f9b14056630 con 0x7f9b1c06ddd0 2023-10-09T15:32:19.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 msgr2=0x7f9b080693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 0x7f9b080693e0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0b00d0 tx=0x7f9b100091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 msgr2=0x7f9b1c148130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:19.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c0cea70 tx=0x7f9b14017000 comp rx=0 tx=0).stop 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 shutdown_connections 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9b08066f30 0x7f9b080693e0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9b1c06ddd0 0x7f9b1c148130 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9b1c15a8c0 0x7f9b1c0b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 --2- 172.21.15.33:0/1383758626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9b1c0b2980 0x7f9b1c0b1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 >> 172.21.15.33:0/1383758626 conn(0x7f9b1c0703a0 msgr2=0x7f9b1c0cb6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 shutdown_connections 2023-10-09T15:32:19.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:19.974+0000 7f9b22248700 1 -- 172.21.15.33:0/1383758626 wait complete. 2023-10-09T15:32:19.988 INFO:tasks.cephfs_test_runner:That the volume can be created and then cleans up ... ok 2023-10-09T15:32:19.988 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command 2023-10-09T15:32:19.988 INFO:tasks.cephfs_test_runner:test_volume_info (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:32:19.988 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-09T15:32:20.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.107+0000 7f31dc57b700 1 Processor -- start 2023-10-09T15:32:20.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.107+0000 7f31dc57b700 1 -- start start 2023-10-09T15:32:20.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dc57b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb970 0x7f31d4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dc57b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31d415a400 0x7f31d4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dc57b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31d415ae40 con 0x7f31d40cb5a0 2023-10-09T15:32:20.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dc57b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31d40ce0f0 con 0x7f31d415a400 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dc57b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40cbde0 con 0x7f31d40cb970 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31d415a400 0x7f31d4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31d415a400 0x7f31d4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32988/0 (socket says 172.21.15.33:32988) 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 -- 172.21.15.33:0/787352103 learned_addr learned my addr 172.21.15.33:0/787352103 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31d9b16700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb970 0x7f31d4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 -- 172.21.15.33:0/787352103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb970 msgr2=0x7f31d4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb970 0x7f31d4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 -- 172.21.15.33:0/787352103 >> v1:172.21.15.59:6789/0 conn(0x7f31d40cb5a0 legacy=0x7f31d40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 -- 172.21.15.33:0/787352103 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d415ab60 con 0x7f31d415a400 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31dab18700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d415a400 0x7f31d4156e90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0099e0 tx=0x7f31cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16e97fa01bd1f63 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:20.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.108+0000 7f31d9315700 1 -- 172.21.15.33:0/787352103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00b820 con 0x7f31d415a400 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31d9315700 1 -- 172.21.15.33:0/787352103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc00b980 con 0x7f31d415a400 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31d9315700 1 -- 172.21.15.33:0/787352103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc00bd20 con 0x7f31d415a400 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 -- 172.21.15.33:0/787352103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d415a400 msgr2=0x7f31d4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d415a400 0x7f31d4156e90 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f31cc0099e0 tx=0x7f31cc009250 comp rx=0 tx=0).stop 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 -- 172.21.15.33:0/787352103 shutdown_connections 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d415a400 0x7f31d4156e90 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 --2- 172.21.15.33:0/787352103 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb970 0x7f31d4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 -- 172.21.15.33:0/787352103 >> 172.21.15.33:0/787352103 conn(0x7f31d4070e30 msgr2=0x7f31d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 -- 172.21.15.33:0/787352103 shutdown_connections 2023-10-09T15:32:20.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.109+0000 7f31dc57b700 1 -- 172.21.15.33:0/787352103 wait complete. 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.110+0000 7f31dc57b700 1 Processor -- start 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.110+0000 7f31dc57b700 1 -- start start 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb5a0 0x7f31d40b46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d415a400 0x7f31d40c9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b5950 con 0x7f31d40cb970 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31d416a890 con 0x7f31d415a400 2023-10-09T15:32:20.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dc57b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31d40b4d40 con 0x7f31d40cb5a0 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32994/0 (socket says 172.21.15.33:32994) 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 -- 172.21.15.33:0/2134196679 learned_addr learned my addr 172.21.15.33:0/2134196679 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 -- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb5a0 msgr2=0x7f31d40b46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb5a0 0x7f31d40b46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31dab18700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d415a400 0x7f31d40c9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 -- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d415a400 msgr2=0x7f31d40c9b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d415a400 0x7f31d40c9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.111+0000 7f31d9b16700 1 -- 172.21.15.33:0/2134196679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31cc0094f0 con 0x7f31d40cb970 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31d9b16700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d8c0 tx=0x7f31c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800de60 con 0x7f31d40cb970 2023-10-09T15:32:20.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31c800b780 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31d40b5020 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31c800bb20 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.112+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31d40b55e0 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.113+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31d404c3c0 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.113+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f31c801e460 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.114+0000 7f31d27fc700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 0x7f31c00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.114+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f31c8084920 con 0x7f31d40cb970 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.114+0000 7f31da317700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 0x7f31c00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:20.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.114+0000 7f31da317700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 0x7f31c00693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001cf0 tx=0x7f31c4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:20.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.118+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f31c8051e30 con 0x7f31d40cb970 2023-10-09T15:32:20.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.392+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f31d40b0600 con 0x7f31d40cb970 2023-10-09T15:32:20.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.974+0000 7f31d27fc700 1 -- 172.21.15.33:0/2134196679 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v94) v1 ==== 136+0+0 (secure 0 0 0) 0x7f31c8055450 con 0x7f31d40cb970 2023-10-09T15:32:20.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 msgr2=0x7f31c00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 0x7f31c00693e0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f31c4001cf0 tx=0x7f31c4007ec0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 msgr2=0x7f31d416a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f31c800d8c0 tx=0x7f31c8008040 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 shutdown_connections 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f31c0066f30 0x7f31c00693e0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31d415a400 0x7f31d40c9b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31d40cb5a0 0x7f31d40b46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 --2- 172.21.15.33:0/2134196679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31d40cb970 0x7f31d416a350 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 >> 172.21.15.33:0/2134196679 conn(0x7f31d4070e30 msgr2=0x7f31d40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 shutdown_connections 2023-10-09T15:32:20.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:20.976+0000 7f31dc57b700 1 -- 172.21.15.33:0/2134196679 wait complete. 2023-10-09T15:32:20.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:32:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.114+0000 7f8458c43700 1 Processor -- start 2023-10-09T15:32:21.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.114+0000 7f8458c43700 1 -- start start 2023-10-09T15:32:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8458c43700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84540684e0 0x7f84540cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8458c43700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84540cd780 0x7f845415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8458c43700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8454068320 con 0x7f84540cc910 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8458c43700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845415ae00 con 0x7f84540684e0 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8458c43700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845415a560 con 0x7f84540cd780 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.115+0000 7f8451d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84540684e0 0x7f84540cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84540684e0 0x7f84540cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58392/0 (socket says 172.21.15.33:58392) 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 -- 172.21.15.33:0/2655100007 learned_addr learned my addr 172.21.15.33:0/2655100007 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8452d9d700 1 --2- 172.21.15.33:0/2655100007 >> v2:172.21.15.59:3300/0 conn(0x7f84540cd780 0x7f845415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 -- 172.21.15.33:0/2655100007 >> v2:172.21.15.59:3300/0 conn(0x7f84540cd780 msgr2=0x7f845415dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 --2- 172.21.15.33:0/2655100007 >> v2:172.21.15.59:3300/0 conn(0x7f84540cd780 0x7f845415dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 -- 172.21.15.33:0/2655100007 >> v1:172.21.15.59:6789/0 conn(0x7f84540cc910 legacy=0x7f8454159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 -- 172.21.15.33:0/2655100007 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f845415a840 con 0x7f84540684e0 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f8451d9b700 1 --2- 172.21.15.33:0/2655100007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f84540cd240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f84540ac220 tx=0x7f843c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efdda423411364f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f845159a700 1 -- 172.21.15.33:0/2655100007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00b820 con 0x7f84540684e0 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f845159a700 1 -- 172.21.15.33:0/2655100007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f843c00b980 con 0x7f84540684e0 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.116+0000 7f845159a700 1 -- 172.21.15.33:0/2655100007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f843c00bd20 con 0x7f84540684e0 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 -- 172.21.15.33:0/2655100007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 msgr2=0x7f84540cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 --2- 172.21.15.33:0/2655100007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f84540cd240 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f84540ac220 tx=0x7f843c009250 comp rx=0 tx=0).stop 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 -- 172.21.15.33:0/2655100007 shutdown_connections 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 --2- 172.21.15.33:0/2655100007 >> v2:172.21.15.59:3300/0 conn(0x7f84540cd780 0x7f845415dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 --2- 172.21.15.33:0/2655100007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f84540cd240 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 -- 172.21.15.33:0/2655100007 >> 172.21.15.33:0/2655100007 conn(0x7f845406d7b0 msgr2=0x7f845406dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 -- 172.21.15.33:0/2655100007 shutdown_connections 2023-10-09T15:32:21.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.117+0000 7f8458c43700 1 -- 172.21.15.33:0/2655100007 wait complete. 2023-10-09T15:32:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.118+0000 7f8458c43700 1 Processor -- start 2023-10-09T15:32:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.118+0000 7f8458c43700 1 -- start start 2023-10-09T15:32:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84540cc910 0x7f84540c2180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84540cd780 0x7f84540c26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540af410 con 0x7f84540684e0 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540c2c00 con 0x7f84540cd780 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540ae890 con 0x7f84540cc910 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58406/0 (socket says 172.21.15.33:58406) 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 -- 172.21.15.33:0/3546251877 learned_addr learned my addr 172.21.15.33:0/3546251877 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8452d9d700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84540cd780 0x7f84540c26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8451d9b700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84540cc910 0x7f84540c2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 -- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84540cc910 msgr2=0x7f84540c2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84540cc910 0x7f84540c2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 -- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84540cd780 msgr2=0x7f84540c26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84540cd780 0x7f84540c26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 -- 172.21.15.33:0/3546251877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843c0094f0 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f845259c700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f844400c950 tx=0x7f8444002760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400a7e0 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f844400a940 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84540aeb70 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844400ad00 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.119+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84540af130 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.120+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f845404c3c0 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.121+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8444012630 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.121+0000 7f844a7fc700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.121+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f8444084710 con 0x7f84540684e0 2023-10-09T15:32:21.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.121+0000 7f8451d9b700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.122+0000 7f8451d9b700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 0x7f84340693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84540ac220 tx=0x7f843c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.125+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8444051c20 con 0x7f84540684e0 2023-10-09T15:32:21.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.321+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f8454067dd0 con 0x7f84540684e0 2023-10-09T15:32:21.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.324+0000 7f844a7fc700 1 -- 172.21.15.33:0/3546251877 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7f844400ae60 con 0x7f84540684e0 2023-10-09T15:32:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 msgr2=0x7f84340693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 0x7f84340693e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f84540ac220 tx=0x7f843c016000 comp rx=0 tx=0).stop 2023-10-09T15:32:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 msgr2=0x7f8454163740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f844400c950 tx=0x7f8444002760 comp rx=0 tx=0).stop 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 shutdown_connections 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8434066f30 0x7f84340693e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84540684e0 0x7f8454163740 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84540cd780 0x7f84540c26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 --2- 172.21.15.33:0/3546251877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84540cc910 0x7f84540c2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 >> 172.21.15.33:0/3546251877 conn(0x7f845406d7b0 msgr2=0x7f84540ab8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 shutdown_connections 2023-10-09T15:32:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.326+0000 7f8458c43700 1 -- 172.21.15.33:0/3546251877 wait complete. 2023-10-09T15:32:21.339 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:32:21.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:21.375 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:21.423 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:32:21.423 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:32:21.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:21.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.542+0000 7f0d1f117700 1 Processor -- start 2023-10-09T15:32:21.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.542+0000 7f0d1f117700 1 -- start start 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1f117700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0d180cb5a0 0x7f0d180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1f117700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0d180cd9e0 0x7f0d18159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1f117700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d1815ae40 con 0x7f0d1815a400 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1f117700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d180d13f0 con 0x7f0d180cb5a0 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1f117700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d1815ab60 con 0x7f0d180cd9e0 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1ceb3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0d180cb5a0 0x7f0d180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1d6b4700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0d1815a400 0x7f0d18156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44240/0 (socket says 172.21.15.33:44240) 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.543+0000 7f0d1d6b4700 1 -- 172.21.15.33:0/1717839452 learned_addr learned my addr 172.21.15.33:0/1717839452 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d17fff700 1 --2- 172.21.15.33:0/1717839452 >> v2:172.21.15.59:3300/0 conn(0x7f0d180cd9e0 0x7f0d18159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d1ceb3700 1 -- 172.21.15.33:0/1717839452 >> v2:172.21.15.59:3300/0 conn(0x7f0d180cd9e0 msgr2=0x7f0d18159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/1717839452 >> v2:172.21.15.59:3300/0 conn(0x7f0d180cd9e0 0x7f0d18159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d1ceb3700 1 -- 172.21.15.33:0/1717839452 >> v1:172.21.15.33:6789/0 conn(0x7f0d1815a400 legacy=0x7f0d18156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d177fe700 1 -- 172.21.15.33:0/1717839452 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1627123923 0 0) 0x7f0d1815ae40 con 0x7f0d1815a400 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d1ceb3700 1 -- 172.21.15.33:0/1717839452 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d180ccf00 con 0x7f0d180cb5a0 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/1717839452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cb5a0 0x7f0d180cb970 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098e0 tx=0x7f0d000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5425822984a8cb6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d177fe700 1 -- 172.21.15.33:0/1717839452 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d00009e80 con 0x7f0d180cb5a0 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d177fe700 1 -- 172.21.15.33:0/1717839452 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d0000b820 con 0x7f0d180cb5a0 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.544+0000 7f0d177fe700 1 -- 172.21.15.33:0/1717839452 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0000bba0 con 0x7f0d180cb5a0 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 -- 172.21.15.33:0/1717839452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cb5a0 msgr2=0x7f0d180cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 --2- 172.21.15.33:0/1717839452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cb5a0 0x7f0d180cb970 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f0d000098e0 tx=0x7f0d000091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 -- 172.21.15.33:0/1717839452 shutdown_connections 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 --2- 172.21.15.33:0/1717839452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cb5a0 0x7f0d180cb970 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 --2- 172.21.15.33:0/1717839452 >> v2:172.21.15.59:3300/0 conn(0x7f0d180cd9e0 0x7f0d18159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 -- 172.21.15.33:0/1717839452 >> 172.21.15.33:0/1717839452 conn(0x7f0d18070e30 msgr2=0x7f0d180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:21.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 -- 172.21.15.33:0/1717839452 shutdown_connections 2023-10-09T15:32:21.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.545+0000 7f0d1f117700 1 -- 172.21.15.33:0/1717839452 wait complete. 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.546+0000 7f0d1f117700 1 Processor -- start 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.546+0000 7f0d1f117700 1 -- start start 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 0x7f0d181533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d1815a400 0x7f0d180c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d180c6e50 con 0x7f0d180cd9e0 2023-10-09T15:32:21.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d181597f0 con 0x7f0d1815a400 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d18152f20 con 0x7f0d180cb5a0 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58426/0 (socket says 172.21.15.33:58426) 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 -- 172.21.15.33:0/2735291775 learned_addr learned my addr 172.21.15.33:0/2735291775 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1d6b4700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d1815a400 0x7f0d180c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 0x7f0d181533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 -- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 msgr2=0x7f0d181533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 0x7f0d181533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 -- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d1815a400 msgr2=0x7f0d180c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d1815a400 0x7f0d180c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 -- 172.21.15.33:0/2735291775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d00009420 con 0x7f0d180cd9e0 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 0x7f0d181533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:21.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d17fff700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800e190 tx=0x7f0d08009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800ed80 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d08014420 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d18152310 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.547+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d0800eee0 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.548+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d181528d0 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.548+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d1804c3c0 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.549+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0d08014a70 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.549+0000 7f0d14ff9700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.549+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 5025+0+0 (secure 0 0 0) 0x7f0d08084a10 con 0x7f0d180cd9e0 2023-10-09T15:32:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.549+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.550+0000 7f0d1ceb3700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 0x7f0cf80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d000093f0 tx=0x7f0d00017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.554+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d08051f20 con 0x7f0d180cd9e0 2023-10-09T15:32:21.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.794+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0d18153060 con 0x7f0d180cd9e0 2023-10-09T15:32:21.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.795+0000 7f0d14ff9700 1 -- 172.21.15.33:0/2735291775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f0d08009a60 con 0x7f0d180cd9e0 2023-10-09T15:32:21.796 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:21.796 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":24,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/4195987879","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":4195987879},{"type":"v1","addr":"172.21.15.59:6834","nonce":4195987879}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":4846,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3544976732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3544976732},{"type":"v1","addr":"172.21.15.33:6837","nonce":3544976732}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":5050,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1132357598","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1132357598},{"type":"v1","addr":"172.21.15.59:6835","nonce":1132357598}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5298,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2107903456","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2107903456},{"type":"v1","addr":"172.21.15.33:6836","nonce":2107903456}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[]} 2023-10-09T15:32:21.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 msgr2=0x7f0cf80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 0x7f0cf80693e0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f0d000093f0 tx=0x7f0d00017000 comp rx=0 tx=0).stop 2023-10-09T15:32:21.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 msgr2=0x7f0d18157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0d0800e190 tx=0x7f0d08009920 comp rx=0 tx=0).stop 2023-10-09T15:32:21.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 shutdown_connections 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0cf8066f30 0x7f0cf80693e0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d1815a400 0x7f0d180c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d180cb5a0 0x7f0d181533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 --2- 172.21.15.33:0/2735291775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d180cd9e0 0x7f0d18157830 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 >> 172.21.15.33:0/2735291775 conn(0x7f0d18070e30 msgr2=0x7f0d18154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 shutdown_connections 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.797+0000 7f0d1f117700 1 -- 172.21.15.33:0/2735291775 wait complete. 2023-10-09T15:32:21.799 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 24 2023-10-09T15:32:21.810 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:32:21.810 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:32:21.811 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:32:21.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:21.811 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:32:21.811 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:32:21.811 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:32:21.811 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:21.811 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:32:21.811 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:32:21.812 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:32:21.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:21.812 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:32:21.812 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:32:21.812 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:32:21.812 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:21.820 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:32:21.820 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:32:21.821 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:32:21.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:32:21.823 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:32:21.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:32:21.824 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:32:21.824 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:32:21.862 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:32:21.862 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:21.862 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:32:21.862 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:21.866 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:32:21.866 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:21.867 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:32:21.867 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:21.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:32:21.937 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:32:21.937 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:32:21.950 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:32:21.951 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:32:21.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.993+0000 7fd1db6b2700 1 Processor -- start 2023-10-09T15:32:21.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.994+0000 7fd1db6b2700 1 -- start start 2023-10-09T15:32:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1db6b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd1d40cd260 0x7fd1d40c4730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:21.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1db6b2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d40c3690 con 0x7fd1d40c4c70 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1db6b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1d40c3970 con 0x7fd1d40cce90 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1db6b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1d40c3c50 con 0x7fd1d40cd260 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d9c4f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd1d40c4c70 0x7fd1d40b12d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44262/0 (socket says 172.21.15.33:44262) 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d9c4f700 1 -- 172.21.15.33:0/2561857920 learned_addr learned my addr 172.21.15.33:0/2561857920 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2561857920 >> v2:172.21.15.59:3300/0 conn(0x7fd1d40cd260 0x7fd1d40c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1cbfff700 1 -- 172.21.15.33:0/2561857920 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2800571666 0 0) 0x7fd1d40c3690 con 0x7fd1d40c4c70 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1cbfff700 1 -- 172.21.15.33:0/2561857920 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd1c0003570 con 0x7fd1d40c4c70 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d8c4d700 1 -- 172.21.15.33:0/2561857920 >> v1:172.21.15.59:6789/0 conn(0x7fd1d40cce90 legacy=0x7fd1d40cc150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d8c4d700 1 -- 172.21.15.33:0/2561857920 >> v1:172.21.15.33:6789/0 conn(0x7fd1d40c4c70 legacy=0x7fd1d40b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d8c4d700 1 -- 172.21.15.33:0/2561857920 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1d40c3f30 con 0x7fd1d40cd260 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.995+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2561857920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d40c4730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40098e0 tx=0x7fd1c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c4568a4d0cac33 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:21.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1cbfff700 1 -- 172.21.15.33:0/2561857920 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400b640 con 0x7fd1d40cd260 2023-10-09T15:32:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1cbfff700 1 -- 172.21.15.33:0/2561857920 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1c400b7a0 con 0x7fd1d40cd260 2023-10-09T15:32:21.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1cbfff700 1 -- 172.21.15.33:0/2561857920 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1c400bb40 con 0x7fd1d40cd260 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2561857920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 msgr2=0x7fd1d40c4730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2561857920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d40c4730 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fd1c40098e0 tx=0x7fd1c40091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2561857920 shutdown_connections 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2561857920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d40c4730 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2561857920 >> 172.21.15.33:0/2561857920 conn(0x7fd1d406ce80 msgr2=0x7fd1d40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2561857920 shutdown_connections 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.996+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2561857920 wait complete. 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.997+0000 7fd1db6b2700 1 Processor -- start 2023-10-09T15:32:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.997+0000 7fd1db6b2700 1 -- start start 2023-10-09T15:32:22.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 0x7fd1d406d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d414df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d406ecc0 con 0x7fd1d40c4c70 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d406e0b0 con 0x7fd1d40cd260 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1db6b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1d406e390 con 0x7fd1d40cce90 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1d944e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1d944e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58472/0 (socket says 172.21.15.33:58472) 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.998+0000 7fd1d944e700 1 -- 172.21.15.33:0/2227104549 learned_addr learned my addr 172.21.15.33:0/2227104549 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 0x7fd1d406d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:22.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d9c4f700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d414df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 -- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 msgr2=0x7fd1d406d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 0x7fd1d406d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 -- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 msgr2=0x7fd1d414df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d414df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 -- 172.21.15.33:0/2227104549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c4009420 con 0x7fd1d40c4c70 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 0x7fd1d406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d9c4f700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1d944e700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c7c0 tx=0x7fd1d0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011590 con 0x7fd1d40c4c70 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1d0011710 con 0x7fd1d40c4c70 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1d406e670 con 0x7fd1d40c4c70 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1d0011ad0 con 0x7fd1d40c4c70 2023-10-09T15:32:22.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:21.999+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1d406dda0 con 0x7fd1d40c4c70 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.000+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1d404c3c0 con 0x7fd1d40c4c70 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.000+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd1d001b3b0 con 0x7fd1d40c4c70 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.001+0000 7fd1c97fa700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.001+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5025+0+0 (secure 0 0 0) 0x7fd1d0083790 con 0x7fd1d40c4c70 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.001+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:22.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.001+0000 7fd1d8c4d700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 0x7fd1b80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40b0720 tx=0x7fd1c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:22.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.005+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1d0050d50 con 0x7fd1d40c4c70 2023-10-09T15:32:22.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:22.222+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fd1d4070850 con 0x7fd1d40c4c70 2023-10-09T15:32:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.210+0000 7fd1c97fa700 1 -- 172.21.15.33:0/2227104549 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v47) v1 ==== 97+0+0 (secure 0 0 0) 0x7fd1d0017020 con 0x7fd1d40c4c70 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.213+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 msgr2=0x7fd1b80693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.213+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 0x7fd1b80693e0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd1d40b0720 tx=0x7fd1c4017000 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.213+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 msgr2=0x7fd1d415dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.213+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fd1d000c7c0 tx=0x7fd1d0007f70 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 shutdown_connections 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1b8066f30 0x7fd1b80693e0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1d40c4c70 0x7fd1d415dc50 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1d40cd260 0x7fd1d414df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 --2- 172.21.15.33:0/2227104549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1d40cce90 0x7fd1d406d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 >> 172.21.15.33:0/2227104549 conn(0x7fd1d406ce80 msgr2=0x7fd1d4067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 shutdown_connections 2023-10-09T15:32:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.214+0000 7fd1db6b2700 1 -- 172.21.15.33:0/2227104549 wait complete. 2023-10-09T15:32:23.216 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:32:23.229 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:32:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 Processor -- start 2023-10-09T15:32:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 -- start start 2023-10-09T15:32:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 0x7f57000cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f570015ae40 con 0x7f57000cde50 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57000d13f0 con 0x7f57000cb5a0 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.355+0000 7f5705c7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f570015ab60 con 0x7f57000cd9e0 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56ff7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 0x7f57000cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56fffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f57000cde50 0x7f5700156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:35584/0 (socket says 172.21.15.33:35584) 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:43486/0 (socket says 172.21.15.33:43486) 2023-10-09T15:32:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56fffff700 1 -- 172.21.15.33:0/549941895 learned_addr learned my addr 172.21.15.33:0/549941895 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 -- 172.21.15.33:0/549941895 >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 msgr2=0x7f57000cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 --2- 172.21.15.33:0/549941895 >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 0x7f57000cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 -- 172.21.15.33:0/549941895 >> v1:172.21.15.59:6789/0 conn(0x7f57000cde50 legacy=0x7f5700156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 -- 172.21.15.33:0/549941895 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57000ccf00 con 0x7f57000cd9e0 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56ff7fe700 1 --2- 172.21.15.33:0/549941895 >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 0x7f57000cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.356+0000 7f56feffd700 1 --2- 172.21.15.33:0/549941895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56f40098e0 tx=0x7f56f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9fd45d01defd5811 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f56fe7fc700 1 -- 172.21.15.33:0/549941895 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400b640 con 0x7f57000cd9e0 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f56fe7fc700 1 -- 172.21.15.33:0/549941895 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f400b7a0 con 0x7f57000cd9e0 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f56fe7fc700 1 -- 172.21.15.33:0/549941895 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f400bb40 con 0x7f57000cd9e0 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 -- 172.21.15.33:0/549941895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 msgr2=0x7f5700159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 --2- 172.21.15.33:0/549941895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f56f40098e0 tx=0x7f56f40091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 -- 172.21.15.33:0/549941895 shutdown_connections 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 --2- 172.21.15.33:0/549941895 >> v2:172.21.15.59:3300/0 conn(0x7f57000cb5a0 0x7f57000cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 --2- 172.21.15.33:0/549941895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700159ec0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 -- 172.21.15.33:0/549941895 >> 172.21.15.33:0/549941895 conn(0x7f5700070e30 msgr2=0x7f57000d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 -- 172.21.15.33:0/549941895 shutdown_connections 2023-10-09T15:32:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.357+0000 7f5705c7b700 1 -- 172.21.15.33:0/549941895 wait complete. 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.358+0000 7f5705c7b700 1 Processor -- start 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 -- start start 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57000cb5a0 0x7f5700154bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57001597f0 con 0x7f5700155150 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57001582a0 con 0x7f57000cb5a0 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f5705c7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5700159c80 con 0x7f57000cd9e0 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f56fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f56fffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58484/0 (socket says 172.21.15.33:58484) 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.359+0000 7f56fffff700 1 -- 172.21.15.33:0/2537354202 learned_addr learned my addr 172.21.15.33:0/2537354202 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56feffd700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56ff7fe700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57000cb5a0 0x7f5700154bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 -- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 msgr2=0x7f5700157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 -- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57000cb5a0 msgr2=0x7f5700154bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57000cb5a0 0x7f5700154bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 -- 172.21.15.33:0/2537354202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f0009420 con 0x7f5700155150 2023-10-09T15:32:23.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56fffff700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f56f800cbc0 tx=0x7f56f80019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800a7e0 con 0x7f5700155150 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f800a940 con 0x7f5700155150 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f4009420 con 0x7f5700155150 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56f800acc0 con 0x7f5700155150 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.360+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57001591a0 con 0x7f5700155150 2023-10-09T15:32:23.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.361+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57001599a0 con 0x7f5700155150 2023-10-09T15:32:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.362+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f56f8007300 con 0x7f5700155150 2023-10-09T15:32:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.362+0000 7f56e77fe700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 0x7f56ec0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.362+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f56f8084490 con 0x7f5700155150 2023-10-09T15:32:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.362+0000 7f56ff7fe700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 0x7f56ec0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.362+0000 7f56ff7fe700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 0x7f56ec0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57000c9570 tx=0x7f56f00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.366+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f56f8051a40 con 0x7f5700155150 2023-10-09T15:32:23.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.640+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f570004c3c0 con 0x7f5700155150 2023-10-09T15:32:23.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.640+0000 7f56e77fe700 1 -- 172.21.15.33:0/2537354202 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f56f8055060 con 0x7f5700155150 2023-10-09T15:32:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:23.641 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:32:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:32:23.641 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:32:23.642 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.643 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:23.644 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.645 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.646 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.647 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:32:23.648 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.650 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.651 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:23.652 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.653 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.654 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.655 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:23.656 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:32:23.656 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.642+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 msgr2=0x7f56ec0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.642+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 0x7f56ec0693e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f57000c9570 tx=0x7f56f00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.642+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 msgr2=0x7f57001579d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.642+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f56f800cbc0 tx=0x7f56f80019c0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 shutdown_connections 2023-10-09T15:32:23.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f56ec066f30 0x7f56ec0693e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5700155150 0x7f57001579d0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57000cb5a0 0x7f5700154bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 --2- 172.21.15.33:0/2537354202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57000cd9e0 0x7f5700157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 >> 172.21.15.33:0/2537354202 conn(0x7f5700070e30 msgr2=0x7f57000b54c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 shutdown_connections 2023-10-09T15:32:23.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.643+0000 7f5705c7b700 1 -- 172.21.15.33:0/2537354202 wait complete. 2023-10-09T15:32:23.658 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:23.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.777+0000 7f5bfe25a700 1 Processor -- start 2023-10-09T15:32:23.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.777+0000 7f5bfe25a700 1 -- start start 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bfe25a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf80cb970 0x7f5bf8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bfe25a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5bf8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bfe25a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf815ae40 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bfe25a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80ce0f0 con 0x7f5bf80cb970 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bfe25a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80d13f0 con 0x7f5bf815a400 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5bf80cb5a0 0x7f5bf80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44266/0 (socket says 172.21.15.33:44266) 2023-10-09T15:32:23.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf77fe700 1 -- 172.21.15.33:0/4187206316 learned_addr learned my addr 172.21.15.33:0/4187206316 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:23.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf7fff700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5bf8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf6ffd700 1 --2- 172.21.15.33:0/4187206316 >> v2:172.21.15.59:3300/0 conn(0x7f5bf80cb970 0x7f5bf8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3978470659 0 0) 0x7f5bf815ae40 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.778+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be0003570 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 871278606 0 0) 0x7f5be0003570 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 msgr2=0x7f5bf8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5bf8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 >> v2:172.21.15.59:3300/0 conn(0x7f5bf80cb970 msgr2=0x7f5bf8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 --2- 172.21.15.33:0/4187206316 >> v2:172.21.15.59:3300/0 conn(0x7f5bf80cb970 0x7f5bf8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf815ab60 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5be8001470 con 0x7f5bf80cb5a0 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 >> v1:172.21.15.33:6789/0 conn(0x7f5bf80cb5a0 legacy=0x7f5bf80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be0003ae0 0x7f5be0003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5be0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be0004d50 0x7f5be00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80ce0f0 con 0x7f5be0003ae0 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be000bb10 con 0x7f5be0004d50 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be000bc50 con 0x7f5bf815a400 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be0003ae0 0x7f5be0003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf6ffd700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5be0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf7fff700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be0004d50 0x7f5be00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 -- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 msgr2=0x7f5be0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf815a400 0x7f5be0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 -- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be0004d50 msgr2=0x7f5be00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be0004d50 0x7f5be00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf77fe700 1 -- 172.21.15.33:0/4187206316 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be0003570 con 0x7f5be0003ae0 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.779+0000 7f5bf7fff700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be0004d50 0x7f5be00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be0003ae0 0x7f5be0003ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c300 tx=0x7f5be8001dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b92a91144e993f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800cb90 con 0x7f5be0003ae0 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800cd10 con 0x7f5be0003ae0 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bf67fc700 1 -- 172.21.15.33:0/4187206316 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8005b70 con 0x7f5be0003ae0 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 -- 172.21.15.33:0/4187206316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be0003ae0 msgr2=0x7f5be0003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/4187206316 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be0003ae0 0x7f5be0003ef0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c300 tx=0x7f5be8001dc0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bf7fff700 1 -- 172.21.15.33:0/4187206316 reap_dead start 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 -- 172.21.15.33:0/4187206316 shutdown_connections 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 -- 172.21.15.33:0/4187206316 >> 172.21.15.33:0/4187206316 conn(0x7f5bf8070e30 msgr2=0x7f5bf80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 -- 172.21.15.33:0/4187206316 shutdown_connections 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.780+0000 7f5bfe25a700 1 -- 172.21.15.33:0/4187206316 wait complete. 2023-10-09T15:32:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 Processor -- start 2023-10-09T15:32:23.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 -- start start 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be0003ae0 0x7f5bf8151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf80c8a20 0x7f5bf81556e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8151ab0 con 0x7f5bf816a6f0 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815c080 con 0x7f5bf80c8a20 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bfe25a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf80c90c0 con 0x7f5be0003ae0 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.782+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58496/0 (socket says 172.21.15.33:58496) 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 -- 172.21.15.33:0/3169335449 learned_addr learned my addr 172.21.15.33:0/3169335449 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf7fff700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf80c8a20 0x7f5bf81556e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be0003ae0 0x7f5bf8151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 -- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be0003ae0 msgr2=0x7f5bf8151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be0003ae0 0x7f5bf8151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 -- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf80c8a20 msgr2=0x7f5bf81556e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf80c8a20 0x7f5bf81556e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 -- 172.21.15.33:0/3169335449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80c8e90 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bf6ffd700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5bec011d70 tx=0x7f5bec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec00fa40 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec00fba0 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf815c410 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec014440 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.783+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf815c9c0 con 0x7f5bf816a6f0 2023-10-09T15:32:23.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.784+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf804c3c0 con 0x7f5bf816a6f0 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.785+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5bec014870 con 0x7f5bf816a6f0 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.785+0000 7f5bdf7fe700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.785+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5bec018030 con 0x7f5bf816a6f0 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.785+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.785+0000 7f5bf77fe700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5be8015040 tx=0x7f5be8012000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:23.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.789+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5bec052180 con 0x7f5bf816a6f0 2023-10-09T15:32:23.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.986+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bf80cde10 con 0x7f5bf816a6f0 2023-10-09T15:32:23.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.987+0000 7f5bdf7fe700 1 -- 172.21.15.33:0/3169335449 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f5bec022090 con 0x7f5bf816a6f0 2023-10-09T15:32:23.988 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:23.988 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":47,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:23.207667+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 msgr2=0x7f5be40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 0x7f5be40693e0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f5be8015040 tx=0x7f5be8012000 comp rx=0 tx=0).stop 2023-10-09T15:32:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 msgr2=0x7f5bf80c84e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5bec011d70 tx=0x7f5bec0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 shutdown_connections 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5be4066f30 0x7f5be40693e0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf80c8a20 0x7f5bf81556e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be0003ae0 0x7f5bf8151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 --2- 172.21.15.33:0/3169335449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf816a6f0 0x7f5bf80c84e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 >> 172.21.15.33:0/3169335449 conn(0x7f5bf8070e30 msgr2=0x7f5bf80b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 shutdown_connections 2023-10-09T15:32:23.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:23.989+0000 7f5bfe25a700 1 -- 172.21.15.33:0/3169335449 wait complete. 2023-10-09T15:32:24.002 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:32:24.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:32:24.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 Processor -- start 2023-10-09T15:32:24.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 -- start start 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 0x7fd270159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd27006e0e0 0x7fd2700cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2700ccfd0 con 0x7fd270159530 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27015a3d0 con 0x7fd27006e0e0 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.124+0000 7fd2757dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd27015a6b0 con 0x7fd27006dc70 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd27006e0e0 0x7fd2700cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd27006e0e0 0x7fd2700cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58498/0 (socket says 172.21.15.33:58498) 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 -- 172.21.15.33:0/1094959711 learned_addr learned my addr 172.21.15.33:0/1094959711 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd270159530 0x7fd2700ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44274/0 (socket says 172.21.15.33:44274) 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26e7fc700 1 --2- 172.21.15.33:0/1094959711 >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 0x7fd270159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 -- 172.21.15.33:0/1094959711 >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 msgr2=0x7fd270159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 --2- 172.21.15.33:0/1094959711 >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 0x7fd270159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 -- 172.21.15.33:0/1094959711 >> v1:172.21.15.33:6789/0 conn(0x7fd270159530 legacy=0x7fd2700ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26dffb700 1 -- 172.21.15.33:0/1094959711 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 334469028 0 0) 0x7fd2700ccfd0 con 0x7fd270159530 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 -- 172.21.15.33:0/1094959711 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd27015a990 con 0x7fd27006e0e0 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26e7fc700 1 --2- 172.21.15.33:0/1094959711 >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 0x7fd270159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26f7fe700 1 --2- 172.21.15.33:0/1094959711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd27006e0e0 0x7fd2700cb6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd2700b66e0 tx=0x7fd260009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47b5e703cfcce1aa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26dffb700 1 -- 172.21.15.33:0/1094959711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000e070 con 0x7fd27006e0e0 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26dffb700 1 -- 172.21.15.33:0/1094959711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd26000ba50 con 0x7fd27006e0e0 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.125+0000 7fd26dffb700 1 -- 172.21.15.33:0/1094959711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600092e0 con 0x7fd27006e0e0 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 -- 172.21.15.33:0/1094959711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd27006e0e0 msgr2=0x7fd2700cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 --2- 172.21.15.33:0/1094959711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd27006e0e0 0x7fd2700cb6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd2700b66e0 tx=0x7fd260009840 comp rx=0 tx=0).stop 2023-10-09T15:32:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 -- 172.21.15.33:0/1094959711 shutdown_connections 2023-10-09T15:32:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 --2- 172.21.15.33:0/1094959711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd27006e0e0 0x7fd2700cb6f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 --2- 172.21.15.33:0/1094959711 >> v2:172.21.15.59:3300/0 conn(0x7fd27006dc70 0x7fd270159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 -- 172.21.15.33:0/1094959711 >> 172.21.15.33:0/1094959711 conn(0x7fd2700703a0 msgr2=0x7fd2700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 -- 172.21.15.33:0/1094959711 shutdown_connections 2023-10-09T15:32:24.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.126+0000 7fd2757dc700 1 -- 172.21.15.33:0/1094959711 wait complete. 2023-10-09T15:32:24.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.127+0000 7fd2757dc700 1 Processor -- start 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.127+0000 7fd2757dc700 1 -- start start 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27006dc70 0x7fd27015da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27006e0e0 0x7fd27013df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27015dfb0 con 0x7fd270159530 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd27013dc60 con 0x7fd27006dc70 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd2757dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2700b5500 con 0x7fd27006e0e0 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58508/0 (socket says 172.21.15.33:58508) 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 -- 172.21.15.33:0/950710041 learned_addr learned my addr 172.21.15.33:0/950710041 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26effd700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27006dc70 0x7fd27015da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26e7fc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27006e0e0 0x7fd27013df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 -- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27006e0e0 msgr2=0x7fd27013df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27006e0e0 0x7fd27013df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 -- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27006dc70 msgr2=0x7fd27015da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27006dc70 0x7fd27015da70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 -- 172.21.15.33:0/950710041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd260009ae0 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.128+0000 7fd26f7fe700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd270089650 tx=0x7fd260018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.129+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd26000be60 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.129+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd260008ce0 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.129+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2700b48f0 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.129+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2600266b0 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.129+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2700b4eb0 con 0x7fd270159530 2023-10-09T15:32:24.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.130+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd27004c3c0 con 0x7fd270159530 2023-10-09T15:32:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.130+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd260003040 con 0x7fd270159530 2023-10-09T15:32:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.130+0000 7fd266ffd700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.130+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fd260085db0 con 0x7fd270159530 2023-10-09T15:32:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.131+0000 7fd26effd700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.131+0000 7fd26effd700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 0x7fd2500693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd268007180 tx=0x7fd268007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.135+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd260053370 con 0x7fd270159530 2023-10-09T15:32:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.328+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd27015ac70 con 0x7fd270159530 2023-10-09T15:32:24.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.328+0000 7fd266ffd700 1 -- 172.21.15.33:0/950710041 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v47) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd260056990 con 0x7fd270159530 2023-10-09T15:32:24.329 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 msgr2=0x7fd2500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 0x7fd2500693e0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd268007180 tx=0x7fd268007ef0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 msgr2=0x7fd2700cb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fd270089650 tx=0x7fd260018000 comp rx=0 tx=0).stop 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 shutdown_connections 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd250066f30 0x7fd2500693e0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd270159530 0x7fd2700cb430 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd27006dc70 0x7fd27015da70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 --2- 172.21.15.33:0/950710041 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd27006e0e0 0x7fd27013df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 >> 172.21.15.33:0/950710041 conn(0x7fd2700703a0 msgr2=0x7fd270154980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 shutdown_connections 2023-10-09T15:32:24.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.330+0000 7fd2757dc700 1 -- 172.21.15.33:0/950710041 wait complete. 2023-10-09T15:32:24.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:32:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.461+0000 7fa166f79700 1 Processor -- start 2023-10-09T15:32:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.461+0000 7fa166f79700 1 -- start start 2023-10-09T15:32:24.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166f79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa16015de50 0x7fa1600cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166f79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa16015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166f79700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1600cf3c0 con 0x7fa160153c30 2023-10-09T15:32:24.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166f79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16015afd0 con 0x7fa16015de50 2023-10-09T15:32:24.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166f79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16015b2b0 con 0x7fa1600cef40 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa165f77700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa160153c30 0x7fa16015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44288/0 (socket says 172.21.15.33:44288) 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa165f77700 1 -- 172.21.15.33:0/2278522533 learned_addr learned my addr 172.21.15.33:0/2278522533 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa165776700 1 --2- 172.21.15.33:0/2278522533 >> v2:172.21.15.59:3300/0 conn(0x7fa16015de50 0x7fa1600cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa166778700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa16015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1218583241 0 0) 0x7fa1600cf3c0 con 0x7fa160153c30 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.462+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa14c003570 con 0x7fa160153c30 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 911672319 0 0) 0x7fa14c003570 con 0x7fa160153c30 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 msgr2=0x7fa16015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa16015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 >> v2:172.21.15.59:3300/0 conn(0x7fa16015de50 msgr2=0x7fa1600cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 --2- 172.21.15.33:0/2278522533 >> v2:172.21.15.59:3300/0 conn(0x7fa16015de50 0x7fa1600cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16015b590 con 0x7fa160153c30 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa15c001470 con 0x7fa160153c30 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 >> v1:172.21.15.33:6789/0 conn(0x7fa160153c30 legacy=0x7fa16015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c003a60 0x7fa14c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa14c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16015afd0 con 0x7fa14c003a60 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16015b2b0 con 0x7fa14c004d50 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa14c00ba60 con 0x7fa1600cef40 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c003a60 0x7fa14c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165776700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa14c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa166778700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 -- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 msgr2=0x7fa14c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa1600cef40 0x7fa14c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 -- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c004d50 msgr2=0x7fa14c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa14c004d50 0x7fa14c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 -- 172.21.15.33:0/2278522533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa14c003570 con 0x7fa14c003a60 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa165f77700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c003a60 0x7fa14c003e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c3c0 tx=0x7fa160159c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5952d7c1369056a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c00cc30 con 0x7fa14c003a60 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c00cd90 con 0x7fa14c003a60 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.463+0000 7fa164f75700 1 -- 172.21.15.33:0/2278522533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c005b70 con 0x7fa14c003a60 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 -- 172.21.15.33:0/2278522533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c003a60 msgr2=0x7fa14c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 --2- 172.21.15.33:0/2278522533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa14c003a60 0x7fa14c003e70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00c3c0 tx=0x7fa160159c60 comp rx=0 tx=0).stop 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166778700 1 -- 172.21.15.33:0/2278522533 reap_dead start 2023-10-09T15:32:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 -- 172.21.15.33:0/2278522533 shutdown_connections 2023-10-09T15:32:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 -- 172.21.15.33:0/2278522533 >> 172.21.15.33:0/2278522533 conn(0x7fa1600703a0 msgr2=0x7fa1600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 -- 172.21.15.33:0/2278522533 shutdown_connections 2023-10-09T15:32:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.464+0000 7fa166f79700 1 -- 172.21.15.33:0/2278522533 wait complete. 2023-10-09T15:32:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.465+0000 7fa166f79700 1 Processor -- start 2023-10-09T15:32:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.465+0000 7fa166f79700 1 -- start start 2023-10-09T15:32:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa14c003a60 0x7fa1600cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1600b0d80 0x7fa160169fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cb110 con 0x7fa1600b11f0 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600cb6d0 con 0x7fa1600b0d80 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166f79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa160153590 con 0x7fa14c003a60 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58538/0 (socket says 172.21.15.33:58538) 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 -- 172.21.15.33:0/1480660923 learned_addr learned my addr 172.21.15.33:0/1480660923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa165f77700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa14c003a60 0x7fa1600cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa165776700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1600b0d80 0x7fa160169fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 -- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa14c003a60 msgr2=0x7fa1600cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa14c003a60 0x7fa1600cbb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 -- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1600b0d80 msgr2=0x7fa160169fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1600b0d80 0x7fa160169fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 -- 172.21.15.33:0/1480660923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16016ab40 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.466+0000 7fa166778700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa1580094d0 tx=0x7fa15800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.467+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800e040 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.467+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15800f040 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.467+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16016ae20 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.467+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15800fdf0 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.467+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600cc0a0 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.468+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600cb520 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.468+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fa158015640 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.469+0000 7fa155ffb700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.469+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa158084ba0 con 0x7fa1600b11f0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.469+0000 7fa165f77700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.469+0000 7fa165f77700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 0x7fa1440693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa16016e720 tx=0x7fa15c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.473+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa158052160 con 0x7fa1600b11f0 2023-10-09T15:32:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.667+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fa16004c3c0 con 0x7fa1600b11f0 2023-10-09T15:32:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.667+0000 7fa155ffb700 1 -- 172.21.15.33:0/1480660923 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v47) v1 ==== 84+0+65 (secure 0 0 0) 0x7fa158023060 con 0x7fa1600b11f0 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:24.669 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 msgr2=0x7fa1440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 0x7fa1440693e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fa16016e720 tx=0x7fa15c015000 comp rx=0 tx=0).stop 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 msgr2=0x7fa16016a500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa1580094d0 tx=0x7fa15800b040 comp rx=0 tx=0).stop 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 shutdown_connections 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa144066f30 0x7fa1440693e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1600b11f0 0x7fa16016a500 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa14c003a60 0x7fa1600cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 --2- 172.21.15.33:0/1480660923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1600b0d80 0x7fa160169fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 >> 172.21.15.33:0/1480660923 conn(0x7fa1600703a0 msgr2=0x7fa1600d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:24.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 shutdown_connections 2023-10-09T15:32:24.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.670+0000 7fa166f79700 1 -- 172.21.15.33:0/1480660923 wait complete. 2023-10-09T15:32:24.682 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:32:24.683 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:32:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.804+0000 7efe915fb700 1 Processor -- start 2023-10-09T15:32:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.804+0000 7efe915fb700 1 -- start start 2023-10-09T15:32:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efe8c142f70 0x7efe8c0cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 0x7efe8c0d0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe8c0d08b0 0x7efe8c0ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c0b6500 con 0x7efe8c0d08b0 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe8c0d0ce0 con 0x7efe8c142f70 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe915fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0b5610 con 0x7efe8c0cc9f0 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe8b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe8c0d08b0 0x7efe8c0ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe8b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efe8c0d08b0 0x7efe8c0ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58546/0 (socket says 172.21.15.33:58546) 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe8b7fe700 1 -- 172.21.15.33:0/3263105923 learned_addr learned my addr 172.21.15.33:0/3263105923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe8affd700 1 --2- 172.21.15.33:0/3263105923 >> v2:172.21.15.59:3300/0 conn(0x7efe8c142f70 0x7efe8c0cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.805+0000 7efe8a7fc700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 0x7efe8c0d0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 -- 172.21.15.33:0/3263105923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 msgr2=0x7efe8c0d0370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 0x7efe8c0d0370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 -- 172.21.15.33:0/3263105923 >> v2:172.21.15.59:3300/0 conn(0x7efe8c142f70 msgr2=0x7efe8c0cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/3263105923 >> v2:172.21.15.59:3300/0 conn(0x7efe8c142f70 0x7efe8c0cc4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 -- 172.21.15.33:0/3263105923 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c0b58f0 con 0x7efe8c0d08b0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8a7fc700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 0x7efe8c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0d08b0 0x7efe8c0ccf80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0891d0 tx=0x7efe84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b283ca790abee7c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe89ffb700 1 -- 172.21.15.33:0/3263105923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400e070 con 0x7efe8c0d08b0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe89ffb700 1 -- 172.21.15.33:0/3263105923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400ba50 con 0x7efe8c0d08b0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe89ffb700 1 -- 172.21.15.33:0/3263105923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840092e0 con 0x7efe8c0d08b0 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 -- 172.21.15.33:0/3263105923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0d08b0 msgr2=0x7efe8c0ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0d08b0 0x7efe8c0ccf80 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7efe8c0891d0 tx=0x7efe84009840 comp rx=0 tx=0).stop 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 -- 172.21.15.33:0/3263105923 shutdown_connections 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 --2- 172.21.15.33:0/3263105923 >> v2:172.21.15.59:3300/0 conn(0x7efe8c142f70 0x7efe8c0cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c0d08b0 0x7efe8c0ccf80 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 --2- 172.21.15.33:0/3263105923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0cc9f0 0x7efe8c0d0370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 -- 172.21.15.33:0/3263105923 >> 172.21.15.33:0/3263105923 conn(0x7efe8c0703a0 msgr2=0x7efe8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.806+0000 7efe915fb700 1 -- 172.21.15.33:0/3263105923 shutdown_connections 2023-10-09T15:32:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.807+0000 7efe915fb700 1 -- 172.21.15.33:0/3263105923 wait complete. 2023-10-09T15:32:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 Processor -- start 2023-10-09T15:32:24.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 -- start start 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 0x7efe8c15c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0d08b0 0x7efe8c15dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c15d8f0 con 0x7efe8c142f70 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c0cc700 con 0x7efe8c0cc9f0 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.808+0000 7efe915fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe8c15cce0 con 0x7efe8c0d08b0 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58554/0 (socket says 172.21.15.33:58554) 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 -- 172.21.15.33:0/81862761 learned_addr learned my addr 172.21.15.33:0/81862761 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8a7fc700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0d08b0 0x7efe8c15dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8affd700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 0x7efe8c15c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 -- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0d08b0 msgr2=0x7efe8c15dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0d08b0 0x7efe8c15dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 -- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 msgr2=0x7efe8c15c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 0x7efe8c15c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 -- 172.21.15.33:0/81862761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe84009ae0 con 0x7efe8c142f70 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8affd700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 0x7efe8c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe8b7fe700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efe8c089530 tx=0x7efe84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840032f0 con 0x7efe8c142f70 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe84008e80 con 0x7efe8c142f70 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8c15cfc0 con 0x7efe8c142f70 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe840266b0 con 0x7efe8c142f70 2023-10-09T15:32:24.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.809+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8c15d580 con 0x7efe8c142f70 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.810+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8c04c3c0 con 0x7efe8c142f70 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.811+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7efe84003040 con 0x7efe8c142f70 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.811+0000 7efe82ffd700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.811+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 4853+0+0 (secure 0 0 0) 0x7efe84086290 con 0x7efe8c142f70 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.811+0000 7efe8affd700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:24.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.811+0000 7efe8affd700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe7c006fd0 tx=0x7efe7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:24.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:24.815+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efe84053850 con 0x7efe8c142f70 2023-10-09T15:32:25.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.009+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7efe8c0b5bd0 con 0x7efe8c142f70 2023-10-09T15:32:25.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.219+0000 7efe82ffd700 1 -- 172.21.15.33:0/81862761 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v48) v1 ==== 138+0+0 (secure 0 0 0) 0x7efe84009940 con 0x7efe8c142f70 2023-10-09T15:32:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 msgr2=0x7efe6c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7efe7c006fd0 tx=0x7efe7c008040 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 msgr2=0x7efe8c0cc1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7efe8c089530 tx=0x7efe84018000 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 shutdown_connections 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efe6c066f30 0x7efe6c0693e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efe8c142f70 0x7efe8c0cc1c0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efe8c0cc9f0 0x7efe8c15c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 --2- 172.21.15.33:0/81862761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efe8c0d08b0 0x7efe8c15dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.222+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 >> 172.21.15.33:0/81862761 conn(0x7efe8c0703a0 msgr2=0x7efe8c0d0100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.223+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 shutdown_connections 2023-10-09T15:32:25.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.223+0000 7efe915fb700 1 -- 172.21.15.33:0/81862761 wait complete. 2023-10-09T15:32:25.227 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:32:25.238 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:32:25.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.364+0000 7f9e36075700 1 Processor -- start 2023-10-09T15:32:25.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.364+0000 7f9e36075700 1 -- start start 2023-10-09T15:32:25.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e36075700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e300cb3f0 0x7f9e30159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e36075700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300ccfa0 con 0x7f9e30159380 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e36075700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e300cb880 con 0x7f9e300cea00 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e36075700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e300cbb60 con 0x7f9e300cb3f0 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e35073700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9e30159380 0x7f9e3015dc00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44304/0 (socket says 172.21.15.33:44304) 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.365+0000 7f9e35073700 1 -- 172.21.15.33:0/1790292255 learned_addr learned my addr 172.21.15.33:0/1790292255 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e34872700 1 --2- 172.21.15.33:0/1790292255 >> v2:172.21.15.59:3300/0 conn(0x7f9e300cb3f0 0x7f9e30159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2252522248 0 0) 0x7f9e300ccfa0 con 0x7f9e30159380 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e18003570 con 0x7f9e30159380 2023-10-09T15:32:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2634866191 0 0) 0x7f9e18003570 con 0x7f9e30159380 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 >> v2:172.21.15.59:3300/0 conn(0x7f9e300cb3f0 msgr2=0x7f9e30159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 --2- 172.21.15.33:0/1790292255 >> v2:172.21.15.59:3300/0 conn(0x7f9e300cb3f0 0x7f9e30159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 >> v1:172.21.15.59:6789/0 conn(0x7f9e300cea00 legacy=0x7f9e300b0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300cbe40 con 0x7f9e30159380 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f9e200017f0 con 0x7f9e30159380 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 >> v1:172.21.15.33:6789/0 conn(0x7f9e30159380 legacy=0x7f9e3015dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 0x7f9e18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18004810 0x7f9e18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180051c0 0x7f9e1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300cbb60 con 0x7f9e18003a60 2023-10-09T15:32:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1800c160 con 0x7f9e180051c0 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e1800c320 con 0x7f9e18004810 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e35073700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 0x7f9e18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e34872700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18004810 0x7f9e18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e35874700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180051c0 0x7f9e1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e35073700 1 -- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18004810 msgr2=0x7f9e18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e35073700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18004810 0x7f9e18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.366+0000 7f9e35073700 1 -- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180051c0 msgr2=0x7f9e1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e35073700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180051c0 0x7f9e1800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e35073700 1 -- 172.21.15.33:0/1790292255 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e18003570 con 0x7f9e18003a60 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e35874700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e180051c0 0x7f9e1800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e35874700 1 -- 172.21.15.33:0/1790292255 reap_dead start 2023-10-09T15:32:25.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e35073700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 0x7f9e18003e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a930 tx=0x7f9e200021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5556dfd81fa99a92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200070d0 con 0x7f9e18003a60 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e20007230 con 0x7f9e18003a60 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e2ffff700 1 -- 172.21.15.33:0/1790292255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e200075d0 con 0x7f9e18003a60 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 -- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 msgr2=0x7f9e18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 0x7f9e18003e70 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a930 tx=0x7f9e200021d0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 -- 172.21.15.33:0/1790292255 shutdown_connections 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 --2- 172.21.15.33:0/1790292255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e18003a60 0x7f9e18003e70 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 -- 172.21.15.33:0/1790292255 >> 172.21.15.33:0/1790292255 conn(0x7f9e300703a0 msgr2=0x7f9e300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.367+0000 7f9e36075700 1 -- 172.21.15.33:0/1790292255 shutdown_connections 2023-10-09T15:32:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.368+0000 7f9e36075700 1 -- 172.21.15.33:0/1790292255 wait complete. 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.369+0000 7f9e36075700 1 Processor -- start 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.369+0000 7f9e36075700 1 -- start start 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.369+0000 7f9e36075700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18003a60 0x7f9e30149310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.369+0000 7f9e36075700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e300c75e0 0x7f9e300c7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.369+0000 7f9e36075700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e36075700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300c8cb0 con 0x7f9e3015b9c0 2023-10-09T15:32:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e36075700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3015c340 con 0x7f9e300c75e0 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e36075700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3015b1d0 con 0x7f9e18003a60 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58570/0 (socket says 172.21.15.33:58570) 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 -- 172.21.15.33:0/3401771032 learned_addr learned my addr 172.21.15.33:0/3401771032 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35073700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18003a60 0x7f9e30149310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e34872700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e300c75e0 0x7f9e300c7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 -- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18003a60 msgr2=0x7f9e30149310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18003a60 0x7f9e30149310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 -- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e300c75e0 msgr2=0x7f9e300c7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e300c75e0 0x7f9e300c7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 -- 172.21.15.33:0/3401771032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300c80a0 con 0x7f9e3015b9c0 2023-10-09T15:32:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e35874700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e300c7560 tx=0x7f9e28009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28018070 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e28006820 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e300c8380 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28006ba0 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.370+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e300c8940 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.371+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e300c9040 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.372+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f9e28007030 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.372+0000 7f9e2d7fa700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.372+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9e28084520 con 0x7f9e3015b9c0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.372+0000 7f9e35073700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 0x7f9e1c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:25.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.373+0000 7f9e35073700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a3f0 tx=0x7f9e20016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:25.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.376+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e280518d0 con 0x7f9e3015b9c0 2023-10-09T15:32:25.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:25.571+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9e300c9040 con 0x7f9e3015b9c0 2023-10-09T15:32:26.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.229+0000 7f9e2d7fa700 1 -- 172.21.15.33:0/3401771032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v49) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9e300c9040 con 0x7f9e3015b9c0 2023-10-09T15:32:26.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 msgr2=0x7f9e1c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a3f0 tx=0x7f9e20016000 comp rx=0 tx=0).stop 2023-10-09T15:32:26.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 msgr2=0x7f9e3015be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f9e300c7560 tx=0x7f9e28009040 comp rx=0 tx=0).stop 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 shutdown_connections 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c066f30 0x7f9e1c0693e0 secure :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a3f0 tx=0x7f9e20016000 comp rx=0 tx=0).stop 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3015b9c0 0x7f9e3015be00 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e18003a60 0x7f9e30149310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 --2- 172.21.15.33:0/3401771032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e300c75e0 0x7f9e300c7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.235+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 >> 172.21.15.33:0/3401771032 conn(0x7f9e300703a0 msgr2=0x7f9e30149d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:26.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.237+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 shutdown_connections 2023-10-09T15:32:26.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.238+0000 7f9e36075700 1 -- 172.21.15.33:0/3401771032 wait complete. 2023-10-09T15:32:26.246 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:32:26.262 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:32:26.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.389+0000 7fd0688db700 1 Processor -- start 2023-10-09T15:32:26.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.389+0000 7fd0688db700 1 -- start start 2023-10-09T15:32:26.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd0688db700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd064159530 0x7fd0640ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd0688db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd06406dc70 0x7fd064159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd0688db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0640ccfd0 con 0x7fd06406e0e0 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd0688db700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0640cf0e0 con 0x7fd064159530 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd0688db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06415a3d0 con 0x7fd06406dc70 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd064159530 0x7fd0640ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd064159530 0x7fd0640ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58582/0 (socket says 172.21.15.33:58582) 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 -- 172.21.15.33:0/2792274501 learned_addr learned my addr 172.21.15.33:0/2792274501 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd061d9b700 1 --2- 172.21.15.33:0/2792274501 >> v2:172.21.15.59:3300/0 conn(0x7fd06406dc70 0x7fd064159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 -- 172.21.15.33:0/2792274501 >> v2:172.21.15.59:3300/0 conn(0x7fd06406dc70 msgr2=0x7fd064159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 --2- 172.21.15.33:0/2792274501 >> v2:172.21.15.59:3300/0 conn(0x7fd06406dc70 0x7fd064159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 -- 172.21.15.33:0/2792274501 >> v1:172.21.15.59:6789/0 conn(0x7fd06406e0e0 legacy=0x7fd0640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 -- 172.21.15.33:0/2792274501 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd06415a6b0 con 0x7fd064159530 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.390+0000 7fd06259c700 1 --2- 172.21.15.33:0/2792274501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd064159530 0x7fd0640ceba0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0640b66e0 tx=0x7fd054009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7504b4853bf49ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd06159a700 1 -- 172.21.15.33:0/2792274501 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05400e070 con 0x7fd064159530 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd06159a700 1 -- 172.21.15.33:0/2792274501 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05400ba20 con 0x7fd064159530 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd06159a700 1 -- 172.21.15.33:0/2792274501 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0540092e0 con 0x7fd064159530 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 -- 172.21.15.33:0/2792274501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd064159530 msgr2=0x7fd0640ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 --2- 172.21.15.33:0/2792274501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd064159530 0x7fd0640ceba0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fd0640b66e0 tx=0x7fd054009840 comp rx=0 tx=0).stop 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 -- 172.21.15.33:0/2792274501 shutdown_connections 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 --2- 172.21.15.33:0/2792274501 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd064159530 0x7fd0640ceba0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 --2- 172.21.15.33:0/2792274501 >> v2:172.21.15.59:3300/0 conn(0x7fd06406dc70 0x7fd064159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 -- 172.21.15.33:0/2792274501 >> 172.21.15.33:0/2792274501 conn(0x7fd0640703a0 msgr2=0x7fd0640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 -- 172.21.15.33:0/2792274501 shutdown_connections 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.391+0000 7fd0688db700 1 -- 172.21.15.33:0/2792274501 wait complete. 2023-10-09T15:32:26.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.392+0000 7fd0688db700 1 Processor -- start 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.392+0000 7fd0688db700 1 -- start start 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06406e0e0 0x7fd06414c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd064159530 0x7fd06415c6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd064152300 con 0x7fd06406dc70 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06415e980 con 0x7fd06406e0e0 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd0688db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06415ec60 con 0x7fd064159530 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58584/0 (socket says 172.21.15.33:58584) 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 -- 172.21.15.33:0/1446162930 learned_addr learned my addr 172.21.15.33:0/1446162930 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:26.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 -- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd064159530 msgr2=0x7fd06415c6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd064159530 0x7fd06415c6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 -- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06406e0e0 msgr2=0x7fd06414c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06406e0e0 0x7fd06414c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.393+0000 7fd06259c700 1 -- 172.21.15.33:0/1446162930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd054009ae0 con 0x7fd06406dc70 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd06259c700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0540072f0 tx=0x7fd054018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054008a00 con 0x7fd06406dc70 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd054008b80 con 0x7fd06406dc70 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd054025460 con 0x7fd06406dc70 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd06415ef40 con 0x7fd06406dc70 2023-10-09T15:32:26.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.394+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd06415e5c0 con 0x7fd06406dc70 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.395+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0641524b0 con 0x7fd06406dc70 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.395+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd054003040 con 0x7fd06406dc70 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.396+0000 7fd05a7fc700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.396+0000 7fd061d9b700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 0x7fd0440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.396+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fd054085880 con 0x7fd06406dc70 2023-10-09T15:32:26.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.396+0000 7fd061d9b700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009bb0 tx=0x7fd04c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:26.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.400+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd054052b50 con 0x7fd06406dc70 2023-10-09T15:32:26.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:26.640+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fd06404c3c0 con 0x7fd06406dc70 2023-10-09T15:32:27.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.230+0000 7fd05a7fc700 1 -- 172.21.15.33:0/1446162930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v26) v1 ==== 172+0+0 (secure 0 0 0) 0x7fd054009940 con 0x7fd06406dc70 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 msgr2=0x7fd0440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009bb0 tx=0x7fd04c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 msgr2=0x7fd06415e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0540072f0 tx=0x7fd054018000 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 shutdown_connections 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd044066f30 0x7fd0440693e0 secure :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd04c009bb0 tx=0x7fd04c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd06406dc70 0x7fd06415e080 secure :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fd0540072f0 tx=0x7fd054018000 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd064159530 0x7fd06415c6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 --2- 172.21.15.33:0/1446162930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd06406e0e0 0x7fd06414c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.239+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 >> 172.21.15.33:0/1446162930 conn(0x7fd0640703a0 msgr2=0x7fd064154750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:27.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.247+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 shutdown_connections 2023-10-09T15:32:27.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.248+0000 7fd0688db700 1 -- 172.21.15.33:0/1446162930 wait complete. 2023-10-09T15:32:27.259 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 8 and data pool 9 2023-10-09T15:32:27.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.394+0000 7fcab70a7700 1 Processor -- start 2023-10-09T15:32:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.394+0000 7fcab70a7700 1 -- start start 2023-10-09T15:32:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab70a7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcab015de50 0x7fcab00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab70a7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab00cf3c0 con 0x7fcab0153c30 2023-10-09T15:32:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab70a7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcab015afd0 con 0x7fcab00cef40 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab70a7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcab015b2b0 con 0x7fcab015de50 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab60a5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcab0153c30 0x7fcab015a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44308/0 (socket says 172.21.15.33:44308) 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab60a5700 1 -- 172.21.15.33:0/4218658146 learned_addr learned my addr 172.21.15.33:0/4218658146 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab58a4700 1 --2- 172.21.15.33:0/4218658146 >> v2:172.21.15.59:3300/0 conn(0x7fcab015de50 0x7fcab00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 830394433 0 0) 0x7fcab00cf3c0 con 0x7fcab0153c30 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fca98003570 con 0x7fcab0153c30 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.395+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3634077014 0 0) 0x7fcab015afd0 con 0x7fcab00cef40 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcab00cf3c0 con 0x7fcab00cef40 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3047967109 0 0) 0x7fca98003570 con 0x7fcab0153c30 2023-10-09T15:32:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 >> v2:172.21.15.59:3300/0 conn(0x7fcab015de50 msgr2=0x7fcab00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 --2- 172.21.15.33:0/4218658146 >> v2:172.21.15.59:3300/0 conn(0x7fcab015de50 0x7fcab00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 >> v1:172.21.15.59:6789/0 conn(0x7fcab00cef40 legacy=0x7fcab015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab015b590 con 0x7fcab0153c30 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fcaa00017f0 con 0x7fcab0153c30 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 >> v1:172.21.15.33:6789/0 conn(0x7fcab0153c30 legacy=0x7fcab015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98003c40 0x7fca98004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca98004810 0x7fca98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 0x7fca9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab015b2b0 con 0x7fca98005210 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9800c130 con 0x7fca98004810 2023-10-09T15:32:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca9800c2c0 con 0x7fca98003c40 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 0x7fca9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab58a4700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca98004810 0x7fca98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab60a5700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98003c40 0x7fca98004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 -- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98003c40 msgr2=0x7fca98004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98003c40 0x7fca98004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 -- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca98004810 msgr2=0x7fca98004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fca98004810 0x7fca98004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 -- 172.21.15.33:0/4218658146 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca98003570 con 0x7fca98005210 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 -- 172.21.15.33:0/4218658146 reap_dead start 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab68a6700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 0x7fca9800ba60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001a40 tx=0x7fcaa8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20598c242c9992e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800c590 con 0x7fca98005210 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa800c6f0 con 0x7fca98005210 2023-10-09T15:32:27.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.396+0000 7fcab50a3700 1 -- 172.21.15.33:0/4218658146 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800ca90 con 0x7fca98005210 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 -- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 msgr2=0x7fca9800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 0x7fca9800ba60 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001a40 tx=0x7fcaa8007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 -- 172.21.15.33:0/4218658146 shutdown_connections 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 --2- 172.21.15.33:0/4218658146 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fca98005210 0x7fca9800ba60 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 -- 172.21.15.33:0/4218658146 >> 172.21.15.33:0/4218658146 conn(0x7fcab00703a0 msgr2=0x7fcab00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 -- 172.21.15.33:0/4218658146 shutdown_connections 2023-10-09T15:32:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.397+0000 7fcab70a7700 1 -- 172.21.15.33:0/4218658146 wait complete. 2023-10-09T15:32:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.398+0000 7fcab70a7700 1 Processor -- start 2023-10-09T15:32:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.398+0000 7fcab70a7700 1 -- start start 2023-10-09T15:32:27.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98005210 0x7fcab016a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcab00b4d50 0x7fcab01450a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab016ab40 con 0x7fcab00cc720 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00cd0c0 con 0x7fcab00b4d50 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab70a7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcab00b5dd0 con 0x7fca98005210 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58596/0 (socket says 172.21.15.33:58596) 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 -- 172.21.15.33:0/3423494705 learned_addr learned my addr 172.21.15.33:0/3423494705 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab60a5700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98005210 0x7fcab016a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab58a4700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcab00b4d50 0x7fcab01450a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 -- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98005210 msgr2=0x7fcab016a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98005210 0x7fcab016a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 -- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcab00b4d50 msgr2=0x7fcab01450a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcab00b4d50 0x7fcab01450a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 -- 172.21.15.33:0/3423494705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcab00b6260 con 0x7fcab00cc720 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.399+0000 7fcab68a6700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001a40 tx=0x7fcaa8014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa800ce40 con 0x7fcab00cc720 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcaa8007250 con 0x7fcab00cc720 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcab01455e0 con 0x7fcab00cc720 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcaa8007610 con 0x7fcab00cc720 2023-10-09T15:32:27.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcab00b54a0 con 0x7fcab00cc720 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.400+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcab004c3c0 con 0x7fcab00cc720 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.401+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcaa8013640 con 0x7fcab00cc720 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.401+0000 7fcaae7fc700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.402+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcaa8085e40 con 0x7fcab00cc720 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.402+0000 7fcab60a5700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.402+0000 7fcab60a5700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0001780 tx=0x7fcaa0006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.406+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcaa80530b0 con 0x7fcab00cc720 2023-10-09T15:32:27.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.603+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcab004c3c0 con 0x7fcab00cc720 2023-10-09T15:32:27.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.604+0000 7fcaae7fc700 1 -- 172.21.15.33:0/3423494705 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+15315 (secure 0 0 0) 0x7fcaa80566d0 con 0x7fcab00cc720 2023-10-09T15:32:27.605 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:27.605 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:26.642368+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 msgr2=0x7fca9c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 0x7fca9c0693e0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fcaa0001780 tx=0x7fcaa0006040 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 msgr2=0x7fcab00ccb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fcaa8001a40 tx=0x7fcaa8014000 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 shutdown_connections 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fca9c066f30 0x7fca9c0693e0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcab00cc720 0x7fcab00ccb80 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fca98005210 0x7fcab016a600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 --2- 172.21.15.33:0/3423494705 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcab00b4d50 0x7fcab01450a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 >> 172.21.15.33:0/3423494705 conn(0x7fcab00703a0 msgr2=0x7fcab00c6690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 shutdown_connections 2023-10-09T15:32:27.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.606+0000 7fcab70a7700 1 -- 172.21.15.33:0/3423494705 wait complete. 2023-10-09T15:32:27.620 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.737+0000 7f71af71d700 1 Processor -- start 2023-10-09T15:32:27.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.737+0000 7f71af71d700 1 -- start start 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71af71d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f71a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71af71d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a815ae40 con 0x7f71a80cb970 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71af71d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71a815ab60 con 0x7f71a80cb5a0 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71af71d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80ce0f0 con 0x7f71a815a5d0 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71accb8700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f71a80cb970 0x7f71a8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44312/0 (socket says 172.21.15.33:44312) 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.738+0000 7f71accb8700 1 -- 172.21.15.33:0/758890939 learned_addr learned my addr 172.21.15.33:0/758890939 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71adcba700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f71a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2039556431 0 0) 0x7f71a815ae40 con 0x7f71a80cb970 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7190003570 con 0x7f71a80cb970 2023-10-09T15:32:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4173249868 0 0) 0x7f7190003570 con 0x7f71a80cb970 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 msgr2=0x7f71a8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f71a8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 >> v1:172.21.15.59:6789/0 conn(0x7f71a80cb5a0 legacy=0x7f71a80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80ccf00 con 0x7f71a80cb970 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f719c001470 con 0x7f71a80cb970 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 >> v1:172.21.15.33:6789/0 conn(0x7f71a80cb970 legacy=0x7f71a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f7190003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7190004010 0x7f7190004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7190004d50 0x7f71900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80ce0f0 con 0x7f7190004010 2023-10-09T15:32:27.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f719000bbf0 con 0x7f7190004d50 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f719000bdb0 con 0x7f71a815a5d0 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7190004010 0x7f7190004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71ad4b9700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f7190003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71adcba700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7190004d50 0x7f71900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 -- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 msgr2=0x7f7190003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f71a815a5d0 0x7f7190003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 -- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7190004d50 msgr2=0x7f71900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7190004d50 0x7f71900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.739+0000 7f71accb8700 1 -- 172.21.15.33:0/758890939 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7190003570 con 0x7f7190004010 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71accb8700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7190004010 0x7f7190004810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c390 tx=0x7f719c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae4383eeec0a3007 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c00cc60 con 0x7f7190004010 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f719c00cdc0 con 0x7f7190004010 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71a7fff700 1 -- 172.21.15.33:0/758890939 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f719c005b50 con 0x7f7190004010 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 -- 172.21.15.33:0/758890939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7190004010 msgr2=0x7f7190004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 --2- 172.21.15.33:0/758890939 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7190004010 0x7f7190004810 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f719c00c390 tx=0x7f719c001e50 comp rx=0 tx=0).stop 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71adcba700 1 -- 172.21.15.33:0/758890939 reap_dead start 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 -- 172.21.15.33:0/758890939 shutdown_connections 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 -- 172.21.15.33:0/758890939 >> 172.21.15.33:0/758890939 conn(0x7f71a8070e30 msgr2=0x7f71a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 -- 172.21.15.33:0/758890939 shutdown_connections 2023-10-09T15:32:27.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.740+0000 7f71af71d700 1 -- 172.21.15.33:0/758890939 wait complete. 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 Processor -- start 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 -- start start 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7190004010 0x7f71a80c9f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71a816aa20 0x7f71a8159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b4d70 con 0x7f71a8159890 2023-10-09T15:32:27.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b4440 con 0x7f71a816aa20 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.742+0000 7f71af71d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71a80b4720 con 0x7f7190004010 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58620/0 (socket says 172.21.15.33:58620) 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 -- 172.21.15.33:0/1871647130 learned_addr learned my addr 172.21.15.33:0/1871647130 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71ad4b9700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7190004010 0x7f71a80c9f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71accb8700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71a816aa20 0x7f71a8159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 -- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7190004010 msgr2=0x7f71a80c9f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7190004010 0x7f71a80c9f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 -- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71a816aa20 msgr2=0x7f71a8159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71a816aa20 0x7f71a8159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 -- 172.21.15.33:0/1871647130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71a80b4a00 con 0x7f71a8159890 2023-10-09T15:32:27.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71adcba700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71a8064ad0 tx=0x7f71a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0013750 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71a00138b0 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71a0013c50 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71a80b4110 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.743+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71a816a520 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.744+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71a80b4ee0 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.745+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f71a0014650 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.745+0000 7f71a57fa700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 0x7f71940693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.745+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f71a0084af0 con 0x7f71a8159890 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.745+0000 7f71ad4b9700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 0x7f71940693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:27.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.746+0000 7f71ad4b9700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 0x7f71940693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7198002fa0 tx=0x7f7198001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:27.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.750+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f71a0051de0 con 0x7f71a8159890 2023-10-09T15:32:27.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.947+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71a804c3c0 con 0x7f71a8159890 2023-10-09T15:32:27.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.948+0000 7f71a57fa700 1 -- 172.21.15.33:0/1871647130 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) v1 ==== 74+0+15315 (secure 0 0 0) 0x7f71a0022090 con 0x7f71a8159890 2023-10-09T15:32:27.949 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:27.949 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:26.642368+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 msgr2=0x7f71940693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 0x7f71940693e0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f7198002fa0 tx=0x7f7198001640 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 msgr2=0x7f71a8169da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f71a8064ad0 tx=0x7f71a00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 shutdown_connections 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7194066f30 0x7f71940693e0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f71a8159890 0x7f71a8169da0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7190004010 0x7f71a80c9f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 --2- 172.21.15.33:0/1871647130 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f71a816aa20 0x7f71a8159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 >> 172.21.15.33:0/1871647130 conn(0x7f71a8070e30 msgr2=0x7f71a80b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 shutdown_connections 2023-10-09T15:32:27.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:27.950+0000 7f71af71d700 1 -- 172.21.15.33:0/1871647130 wait complete. 2023-10-09T15:32:27.963 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:32:28.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.084+0000 7f4f689cc700 1 Processor -- start 2023-10-09T15:32:28.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.084+0000 7f4f689cc700 1 -- start start 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f689cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 0x7f4f64159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f689cc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640ccfd0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f689cc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6415a3d0 con 0x7f4f64159530 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f689cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6415a6b0 con 0x7f4f6406dc70 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f62d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4f6406e0e0 0x7f4f640cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:44316/0 (socket says 172.21.15.33:44316) 2023-10-09T15:32:28.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f62d9d700 1 -- 172.21.15.33:0/920345465 learned_addr learned my addr 172.21.15.33:0/920345465 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.085+0000 7f4f61d9b700 1 --2- 172.21.15.33:0/920345465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 0x7f4f64159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 151062034 0 0) 0x7f4f640ccfd0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f50003570 con 0x7f4f6406e0e0 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f61d9b700 1 -- 172.21.15.33:0/920345465 >> v1:172.21.15.59:6789/0 conn(0x7f4f64159530 legacy=0x7f4f640ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f61d9b700 1 -- 172.21.15.33:0/920345465 >> v1:172.21.15.33:6789/0 conn(0x7f4f6406e0e0 legacy=0x7f4f640cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1665812511 0 0) 0x7f4f6415a3d0 con 0x7f4f64159530 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f61d9b700 1 -- 172.21.15.33:0/920345465 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6415a990 con 0x7f4f6406dc70 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f61d9b700 1 --2- 172.21.15.33:0/920345465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 0x7f4f64159900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009910 tx=0x7f4f4c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=808fcb82beb6eaa3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00b680 con 0x7f4f6406dc70 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c00b7e0 con 0x7f4f6406dc70 2023-10-09T15:32:28.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.086+0000 7f4f6159a700 1 -- 172.21.15.33:0/920345465 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00bba0 con 0x7f4f6406dc70 2023-10-09T15:32:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 -- 172.21.15.33:0/920345465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 msgr2=0x7f4f64159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 --2- 172.21.15.33:0/920345465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 0x7f4f64159900 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f4f4c009910 tx=0x7f4f4c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 -- 172.21.15.33:0/920345465 shutdown_connections 2023-10-09T15:32:28.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 --2- 172.21.15.33:0/920345465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f6406dc70 0x7f4f64159900 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 -- 172.21.15.33:0/920345465 >> 172.21.15.33:0/920345465 conn(0x7f4f640703a0 msgr2=0x7f4f640707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 -- 172.21.15.33:0/920345465 shutdown_connections 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.087+0000 7f4f689cc700 1 -- 172.21.15.33:0/920345465 wait complete. 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.088+0000 7f4f689cc700 1 Processor -- start 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.088+0000 7f4f689cc700 1 -- start start 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6406dc70 0x7f4f64140800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 0x7f4f640c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640ca2f0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c99c0 con 0x7f4f6406dc70 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f689cc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640c9ca0 con 0x7f4f64159530 2023-10-09T15:32:28.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58630/0 (socket says 172.21.15.33:58630) 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 -- 172.21.15.33:0/3380327739 learned_addr learned my addr 172.21.15.33:0/3380327739 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f6259c700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6406dc70 0x7f4f64140800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f62d9d700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 0x7f4f640c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 -- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 msgr2=0x7f4f640c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 0x7f4f640c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 -- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6406dc70 msgr2=0x7f4f64140800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6406dc70 0x7f4f64140800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 -- 172.21.15.33:0/3380327739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f4c009420 con 0x7f4f6406e0e0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f62d9d700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 0x7f4f640c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f61d9b700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4f64089650 tx=0x7f4f4c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.089+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c00bb60 con 0x7f4f6406e0e0 2023-10-09T15:32:28.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.090+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f4c027450 con 0x7f4f6406e0e0 2023-10-09T15:32:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.090+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640c9f80 con 0x7f4f6406e0e0 2023-10-09T15:32:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.090+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f4c0277f0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.090+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f641531d0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.090+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6404c3c0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.091+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f4f4c01a430 con 0x7f4f6406e0e0 2023-10-09T15:32:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.091+0000 7f4f5a7fc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.091+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(50..50 src has 1..50) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f4c086560 con 0x7f4f6406e0e0 2023-10-09T15:32:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.091+0000 7f4f6259c700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:28.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.092+0000 7f4f6259c700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 0x7f4f440693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f54003a90 tx=0x7f4f54007ce0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:28.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.096+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f4c0537d0 con 0x7f4f6406e0e0 2023-10-09T15:32:28.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:28.337+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4f6415ac70 con 0x7f4f6406e0e0 2023-10-09T15:32:29.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.256+0000 7f4f5a7fc700 1 -- 172.21.15.33:0/3380327739 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v29) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4f4c056df0 con 0x7f4f6406e0e0 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 msgr2=0x7f4f440693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 0x7f4f440693e0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f4f54003a90 tx=0x7f4f54007ce0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 msgr2=0x7f4f640c6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f4f64089650 tx=0x7f4f4c017000 comp rx=0 tx=0).stop 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 shutdown_connections 2023-10-09T15:32:29.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f44066f30 0x7f4f440693e0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.259+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f64159530 0x7f4f640c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.260+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f6406dc70 0x7f4f64140800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.260+0000 7f4f689cc700 1 --2- 172.21.15.33:0/3380327739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f6406e0e0 0x7f4f640c6450 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.260+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 >> 172.21.15.33:0/3380327739 conn(0x7f4f640703a0 msgr2=0x7f4f640cec10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.260+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 shutdown_connections 2023-10-09T15:32:29.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.260+0000 7f4f689cc700 1 -- 172.21.15.33:0/3380327739 wait complete. 2023-10-09T15:32:29.275 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:32:29.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.403+0000 7f8fca64d700 1 Processor -- start 2023-10-09T15:32:29.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.403+0000 7f8fca64d700 1 -- start start 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fca64d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fc4159530 0x7f8fc40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fca64d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fc406dc70 0x7f8fc4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fca64d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8fc40ccfd0 con 0x7f8fc406e0e0 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fca64d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc40cf0e0 con 0x7f8fc406dc70 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fca64d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fc415a3d0 con 0x7f8fc4159530 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fc37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fc406dc70 0x7f8fc4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fc37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fc406dc70 0x7f8fc4159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58632/0 (socket says 172.21.15.33:58632) 2023-10-09T15:32:29.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.404+0000 7f8fc37fe700 1 -- 172.21.15.33:0/3703900475 learned_addr learned my addr 172.21.15.33:0/3703900475 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc3fff700 1 --2- 172.21.15.33:0/3703900475 >> v2:172.21.15.59:3300/0 conn(0x7f8fc4159530 0x7f8fc40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc37fe700 1 -- 172.21.15.33:0/3703900475 >> v2:172.21.15.59:3300/0 conn(0x7f8fc4159530 msgr2=0x7f8fc40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/3703900475 >> v2:172.21.15.59:3300/0 conn(0x7f8fc4159530 0x7f8fc40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc37fe700 1 -- 172.21.15.33:0/3703900475 >> v1:172.21.15.59:6789/0 conn(0x7f8fc406e0e0 legacy=0x7f8fc40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc37fe700 1 -- 172.21.15.33:0/3703900475 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fc415a6b0 con 0x7f8fc406dc70 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/3703900475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4159900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da85f803b8a72dcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc2ffd700 1 -- 172.21.15.33:0/3703900475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00b860 con 0x7f8fc406dc70 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc2ffd700 1 -- 172.21.15.33:0/3703900475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fac00b9c0 con 0x7f8fc406dc70 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.405+0000 7f8fc2ffd700 1 -- 172.21.15.33:0/3703900475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fac00bd60 con 0x7f8fc406dc70 2023-10-09T15:32:29.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 -- 172.21.15.33:0/3703900475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 msgr2=0x7f8fc4159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 --2- 172.21.15.33:0/3703900475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4159900 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fac009250 comp rx=0 tx=0).stop 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 -- 172.21.15.33:0/3703900475 shutdown_connections 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 --2- 172.21.15.33:0/3703900475 >> v2:172.21.15.59:3300/0 conn(0x7f8fc4159530 0x7f8fc40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 --2- 172.21.15.33:0/3703900475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4159900 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 -- 172.21.15.33:0/3703900475 >> 172.21.15.33:0/3703900475 conn(0x7f8fc40703a0 msgr2=0x7f8fc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 -- 172.21.15.33:0/3703900475 shutdown_connections 2023-10-09T15:32:29.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.406+0000 7f8fca64d700 1 -- 172.21.15.33:0/3703900475 wait complete. 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.407+0000 7f8fca64d700 1 Processor -- start 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.407+0000 7f8fca64d700 1 -- start start 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 0x7f8fc415da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4159530 0x7f8fc4151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc416e210 con 0x7f8fc406dc70 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc4153a90 con 0x7f8fc406e0e0 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fca64d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fc416d600 con 0x7f8fc4159530 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58640/0 (socket says 172.21.15.33:58640) 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 -- 172.21.15.33:0/503925070 learned_addr learned my addr 172.21.15.33:0/503925070 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 0x7f8fc415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc8bea700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4159530 0x7f8fc4151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 -- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4159530 msgr2=0x7f8fc4151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4159530 0x7f8fc4151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 -- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 msgr2=0x7f8fc415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 0x7f8fc415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 -- 172.21.15.33:0/503925070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fac0094f0 con 0x7f8fc406dc70 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 0x7f8fc415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.408+0000 7f8fc3fff700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d860 tx=0x7f8fb4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:29.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.409+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009610 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.409+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fb4009770 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.409+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fc416d8e0 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.409+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fb4009b30 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.409+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fc416dea0 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.410+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fc404c3c0 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.410+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f8fb401e460 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.410+0000 7f8fbbfff700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 0x7f8fa40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.410+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8fb4084ba0 con 0x7f8fc406dc70 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.411+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 0x7f8fa40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:29.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.411+0000 7f8fc37fe700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 0x7f8fa40693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:29.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.415+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fb4051e10 con 0x7f8fc406dc70 2023-10-09T15:32:29.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:29.653+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8fc415a990 con 0x7f8fc406dc70 2023-10-09T15:32:30.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.258+0000 7f8fbbfff700 1 -- 172.21.15.33:0/503925070 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8fb4055430 con 0x7f8fc406dc70 2023-10-09T15:32:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 msgr2=0x7f8fa40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 0x7f8fa40693e0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f8fc406d630 tx=0x7f8fac017000 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 msgr2=0x7f8fc4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8fb400d860 tx=0x7f8fb4008040 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 shutdown_connections 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fa4066f30 0x7f8fa40693e0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fc406dc70 0x7f8fc4153550 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fc4159530 0x7f8fc4151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 --2- 172.21.15.33:0/503925070 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fc406e0e0 0x7f8fc415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.260+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 >> 172.21.15.33:0/503925070 conn(0x7f8fc40703a0 msgr2=0x7f8fc40cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:30.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.261+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 shutdown_connections 2023-10-09T15:32:30.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.261+0000 7f8fca64d700 1 -- 172.21.15.33:0/503925070 wait complete. 2023-10-09T15:32:30.276 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:30.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.399+0000 7f5cc8c35700 1 Processor -- start 2023-10-09T15:32:30.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.399+0000 7f5cc8c35700 1 -- start start 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc8c35700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5cc40cb970 0x7f5cc4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc8c35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc8c35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cc415ae40 con 0x7f5cc40cb5a0 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc8c35700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cc40ce0f0 con 0x7f5cc40cb970 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc8c35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40d13f0 con 0x7f5cc415a400 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5cc40cb970 0x7f5cc4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5cc40cb970 0x7f5cc4159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58648/0 (socket says 172.21.15.33:58648) 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/2088028483 learned_addr learned my addr 172.21.15.33:0/2088028483 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc2d9d700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/2088028483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 msgr2=0x7f5cc4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/2088028483 >> v1:172.21.15.59:6789/0 conn(0x7f5cc40cb5a0 legacy=0x7f5cc40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/2088028483 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc415ab60 con 0x7f5cc40cb970 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.400+0000 7f5cc1d9b700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc4159ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80099b0 tx=0x7f5cb8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb6168d382cfd86 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc159a700 1 -- 172.21.15.33:0/2088028483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8009ea0 con 0x7f5cc40cb970 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc159a700 1 -- 172.21.15.33:0/2088028483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800b860 con 0x7f5cc40cb970 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc159a700 1 -- 172.21.15.33:0/2088028483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb800bc00 con 0x7f5cc40cb970 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 -- 172.21.15.33:0/2088028483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 msgr2=0x7f5cc4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc4159ec0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80099b0 tx=0x7f5cb8009250 comp rx=0 tx=0).stop 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 -- 172.21.15.33:0/2088028483 shutdown_connections 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/2088028483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc4159ec0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 -- 172.21.15.33:0/2088028483 >> 172.21.15.33:0/2088028483 conn(0x7f5cc4070e30 msgr2=0x7f5cc40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 -- 172.21.15.33:0/2088028483 shutdown_connections 2023-10-09T15:32:30.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.401+0000 7f5cc8c35700 1 -- 172.21.15.33:0/2088028483 wait complete. 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.402+0000 7f5cc8c35700 1 Processor -- start 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.402+0000 7f5cc8c35700 1 -- start start 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc40cb5a0 0x7f5cc414e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc41527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c66f0 con 0x7f5cc40cb970 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5ae0 con 0x7f5cc40cb5a0 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc8c35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cc40c5dc0 con 0x7f5cc415a400 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58652/0 (socket says 172.21.15.33:58652) 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/773919199 learned_addr learned my addr 172.21.15.33:0/773919199 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc259c700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc40cb5a0 0x7f5cc414e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc2d9d700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc41527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 msgr2=0x7f5cc41527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc41527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc40cb5a0 msgr2=0x7f5cc414e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc40cb5a0 0x7f5cc414e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.403+0000 7f5cc1d9b700 1 -- 172.21.15.33:0/773919199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cb80094f0 con 0x7f5cc40cb970 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cc1d9b700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5cc406ea60 tx=0x7f5cb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8000d10 con 0x7f5cc40cb970 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cb800bbe0 con 0x7f5cc40cb970 2023-10-09T15:32:30.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cc40c60a0 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cb8011670 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.404+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cc414e6c0 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.405+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cc404c3c0 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.405+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f5cb8011aa0 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.405+0000 7f5cb27fc700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.406+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5cb8085d90 con 0x7f5cc40cb970 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.406+0000 7f5cc259c700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.406+0000 7f5cc259c700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4003a80 tx=0x7f5cb4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.410+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cb8053000 con 0x7f5cc40cb970 2023-10-09T15:32:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.647+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5cc4089700 con 0x7f5cc40cb970 2023-10-09T15:32:30.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.647+0000 7f5cb27fc700 1 -- 172.21.15.33:0/773919199 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f5cb8056620 con 0x7f5cc40cb970 2023-10-09T15:32:30.648 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:30.648 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 msgr2=0x7f5ca40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 0x7f5ca40693e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f5cb4003a80 tx=0x7f5cb4007ec0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 msgr2=0x7f5cc40c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5cc406ea60 tx=0x7f5cb8017000 comp rx=0 tx=0).stop 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 shutdown_connections 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ca4066f30 0x7f5ca40693e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cc415a400 0x7f5cc41527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cc40cb5a0 0x7f5cc414e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 --2- 172.21.15.33:0/773919199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cc40cb970 0x7f5cc40c6b80 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 >> 172.21.15.33:0/773919199 conn(0x7f5cc4070e30 msgr2=0x7f5cc40b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 shutdown_connections 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.649+0000 7f5cc8c35700 1 -- 172.21.15.33:0/773919199 wait complete. 2023-10-09T15:32:30.651 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2023-10-09T15:32:30.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.780+0000 7f0cadc84700 1 Processor -- start 2023-10-09T15:32:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.780+0000 7f0cadc84700 1 -- start start 2023-10-09T15:32:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cadc84700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ca80cf110 0x7f0ca8164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cadc84700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca815afd0 con 0x7f0ca815de50 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cadc84700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ca815b2b0 con 0x7f0ca8153c30 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cadc84700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ca815b590 con 0x7f0ca80cf110 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ca80cf110 0x7f0ca8164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0ca7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0ca815de50 0x7f0ca80cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36428/0 (socket says 172.21.15.33:36428) 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0ca80cf110 0x7f0ca8164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41154/0 (socket says 172.21.15.33:41154) 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0ca7fff700 1 -- 172.21.15.33:0/2924943631 learned_addr learned my addr 172.21.15.33:0/2924943631 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 -- 172.21.15.33:0/2924943631 >> v1:172.21.15.59:6789/0 conn(0x7f0ca8153c30 legacy=0x7f0ca815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 -- 172.21.15.33:0/2924943631 >> v1:172.21.15.33:6789/0 conn(0x7f0ca815de50 legacy=0x7f0ca80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 -- 172.21.15.33:0/2924943631 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca815b870 con 0x7f0ca80cf110 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0ca77fe700 1 -- 172.21.15.33:0/2924943631 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 889435408 0 0) 0x7f0ca815afd0 con 0x7f0ca815de50 2023-10-09T15:32:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.781+0000 7f0cad483700 1 --2- 172.21.15.33:0/2924943631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca80cf110 0x7f0ca8164600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e60 tx=0x7f0ca0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e6abfbeeafa8b10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0ca77fe700 1 -- 172.21.15.33:0/2924943631 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca000e070 con 0x7f0ca80cf110 2023-10-09T15:32:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0ca77fe700 1 -- 172.21.15.33:0/2924943631 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ca000bc30 con 0x7f0ca80cf110 2023-10-09T15:32:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0ca77fe700 1 -- 172.21.15.33:0/2924943631 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ca0012430 con 0x7f0ca80cf110 2023-10-09T15:32:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 -- 172.21.15.33:0/2924943631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca80cf110 msgr2=0x7f0ca8164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2924943631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca80cf110 0x7f0ca8164600 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f0ca0009e60 tx=0x7f0ca0009780 comp rx=0 tx=0).stop 2023-10-09T15:32:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 -- 172.21.15.33:0/2924943631 shutdown_connections 2023-10-09T15:32:30.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2924943631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca80cf110 0x7f0ca8164600 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 -- 172.21.15.33:0/2924943631 >> 172.21.15.33:0/2924943631 conn(0x7f0ca80703a0 msgr2=0x7f0ca80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 -- 172.21.15.33:0/2924943631 shutdown_connections 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.782+0000 7f0cadc84700 1 -- 172.21.15.33:0/2924943631 wait complete. 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.783+0000 7f0cadc84700 1 Processor -- start 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.783+0000 7f0cadc84700 1 -- start start 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 0x7f0ca81693c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 0x7f0ca80b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b4480 con 0x7f0ca8153c30 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b3870 con 0x7f0ca815de50 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0cadc84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ca80b3b50 con 0x7f0ca80cf110 2023-10-09T15:32:30.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0ca7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0ca7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41162/0 (socket says 172.21.15.33:41162) 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.784+0000 7f0ca7fff700 1 -- 172.21.15.33:0/2513486684 learned_addr learned my addr 172.21.15.33:0/2513486684 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 -- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 msgr2=0x7f0ca81693c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cacc82700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 0x7f0ca81693c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cad483700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 0x7f0ca80b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 0x7f0ca81693c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 -- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 msgr2=0x7f0ca80b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 0x7f0ca80b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 -- 172.21.15.33:0/2513486684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ca0009a20 con 0x7f0ca8153c30 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cacc82700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 0x7f0ca81693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cad483700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 0x7f0ca80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:30.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca7fff700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c5b0 tx=0x7f0c94001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94005b30 con 0x7f0ca8153c30 2023-10-09T15:32:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c94005c90 con 0x7f0ca8153c30 2023-10-09T15:32:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c94007300 con 0x7f0ca8153c30 2023-10-09T15:32:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ca80b3e30 con 0x7f0ca8153c30 2023-10-09T15:32:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.785+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ca80c7310 con 0x7f0ca8153c30 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.786+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ca80b45f0 con 0x7f0ca8153c30 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.786+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f0c9401b3b0 con 0x7f0ca8153c30 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.787+0000 7f0ca4ff9700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 0x7f0c8c069410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.787+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0c94083a40 con 0x7f0ca8153c30 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.787+0000 7f0cacc82700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 0x7f0c8c069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:30.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.787+0000 7f0cacc82700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 0x7f0c8c069410 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8070fb0 tx=0x7f0c9c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:30.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.791+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0c94085e60 con 0x7f0ca8153c30 2023-10-09T15:32:30.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.986+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ca804c3c0 con 0x7f0ca8153c30 2023-10-09T15:32:30.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.986+0000 7f0ca4ff9700 1 -- 172.21.15.33:0/2513486684 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f0c94017090 con 0x7f0ca8153c30 2023-10-09T15:32:30.987 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:30.988 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":51,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:28.239977+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 msgr2=0x7f0c8c069410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 0x7f0c8c069410 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8070fb0 tx=0x7f0c9c009040 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 msgr2=0x7f0ca8158df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0c9400c5b0 tx=0x7f0c94001070 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 shutdown_connections 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0c8c066f60 0x7f0c8c069410 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0ca815de50 0x7f0ca80b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0ca80cf110 0x7f0ca81693c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 --2- 172.21.15.33:0/2513486684 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0ca8153c30 0x7f0ca8158df0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.988+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 >> 172.21.15.33:0/2513486684 conn(0x7f0ca80703a0 msgr2=0x7f0ca80cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.989+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 shutdown_connections 2023-10-09T15:32:30.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:30.989+0000 7f0cadc84700 1 -- 172.21.15.33:0/2513486684 wait complete. 2023-10-09T15:32:31.002 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:32:31.002 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:32:31.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.120+0000 7f91f7928700 1 Processor -- start 2023-10-09T15:32:31.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.120+0000 7f91f7928700 1 -- start start 2023-10-09T15:32:31.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.121+0000 7f91f7928700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91f00af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.121+0000 7f91f7928700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00ce9d0 con 0x7f91f0159c80 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.121+0000 7f91f7928700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91f00afc30 con 0x7f91f00af790 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.121+0000 7f91f7928700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00aff10 con 0x7f91f01598b0 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.121+0000 7f91f4ec3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f91f0159c80 0x7f91f00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36432/0 (socket says 172.21.15.33:36432) 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f4ec3700 1 -- 172.21.15.33:0/3079712291 learned_addr learned my addr 172.21.15.33:0/3079712291 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91f00af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3066875728 0 0) 0x7f91f00ce9d0 con 0x7f91f0159c80 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91d8003570 con 0x7f91f0159c80 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2937397517 0 0) 0x7f91d8003570 con 0x7f91f0159c80 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 msgr2=0x7f91f00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91f00af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 >> v1:172.21.15.59:6789/0 conn(0x7f91f00af790 legacy=0x7f91f0163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00ce380 con 0x7f91f0159c80 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f91e4001470 con 0x7f91f0159c80 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 >> v1:172.21.15.33:6789/0 conn(0x7f91f0159c80 legacy=0x7f91f00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d8003a90 0x7f91d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8004810 0x7f91d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91d80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00aff10 con 0x7f91d8003a90 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91d800bb60 con 0x7f91d8004810 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91d800bd20 con 0x7f91f01598b0 2023-10-09T15:32:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d8003a90 0x7f91d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f4ec3700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8004810 0x7f91d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f5ec5700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91d80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f56c4700 1 -- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 msgr2=0x7f91d80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.122+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01598b0 0x7f91d80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f56c4700 1 -- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8004810 msgr2=0x7f91d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8004810 0x7f91d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f56c4700 1 -- 172.21.15.33:0/3079712291 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91d8003570 con 0x7f91d8003a90 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f4ec3700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8004810 0x7f91d8004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d8003a90 0x7f91d8003ea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f91e000e210 tx=0x7f91e000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cebad0b55ad09982 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000eac0 con 0x7f91d8003a90 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e000f040 con 0x7f91d8003a90 2023-10-09T15:32:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91effff700 1 -- 172.21.15.33:0/3079712291 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e000ee70 con 0x7f91d8003a90 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 -- 172.21.15.33:0/3079712291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d8003a90 msgr2=0x7f91d8003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 --2- 172.21.15.33:0/3079712291 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91d8003a90 0x7f91d8003ea0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f91e000e210 tx=0x7f91e000b040 comp rx=0 tx=0).stop 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f5ec5700 1 -- 172.21.15.33:0/3079712291 reap_dead start 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 -- 172.21.15.33:0/3079712291 shutdown_connections 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 -- 172.21.15.33:0/3079712291 >> 172.21.15.33:0/3079712291 conn(0x7f91f0070e30 msgr2=0x7f91f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 -- 172.21.15.33:0/3079712291 shutdown_connections 2023-10-09T15:32:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.123+0000 7f91f7928700 1 -- 172.21.15.33:0/3079712291 wait complete. 2023-10-09T15:32:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 Processor -- start 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 -- start start 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8003a90 0x7f91f00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01502c0 0x7f91f0150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f0151730 con 0x7f91f0150c70 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91f016a290 con 0x7f91d8003a90 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.125+0000 7f91f7928700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91f00b4fb0 con 0x7f91f01502c0 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41172/0 (socket says 172.21.15.33:41172) 2023-10-09T15:32:31.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 -- 172.21.15.33:0/3907075442 learned_addr learned my addr 172.21.15.33:0/3907075442 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8003a90 0x7f91f00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f4ec3700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01502c0 0x7f91f0150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 -- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01502c0 msgr2=0x7f91f0150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01502c0 0x7f91f0150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 -- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8003a90 msgr2=0x7f91f00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8003a90 0x7f91f00c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 -- 172.21.15.33:0/3907075442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91f00b43a0 con 0x7f91f0150c70 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f5ec5700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ce260 tx=0x7f91e8009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e800ee40 con 0x7f91f0150c70 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91e8013420 con 0x7f91f0150c70 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91f00b4680 con 0x7f91f0150c70 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91e80137e0 con 0x7f91f0150c70 2023-10-09T15:32:31.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.126+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91f00b4c40 con 0x7f91f0150c70 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.127+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91f004c3c0 con 0x7f91f0150c70 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.128+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f91e8013b90 con 0x7f91f0150c70 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.128+0000 7f91ed7fa700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 0x7f91dc0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.128+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f91e8084150 con 0x7f91f0150c70 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.128+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 0x7f91dc0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.129+0000 7f91f56c4700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 0x7f91dc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f91e000afd0 tx=0x7f91e001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.132+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f91e80513c0 con 0x7f91f0150c70 2023-10-09T15:32:31.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.329+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f91f00ce660 con 0x7f91dc066f30 2023-10-09T15:32:31.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.337+0000 7f91ed7fa700 1 -- 172.21.15.33:0/3907075442 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289358 (secure 0 0 0) 0x7f91f00ce660 con 0x7f91dc066f30 2023-10-09T15:32:31.341 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 msgr2=0x7f91dc0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 0x7f91dc0693e0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f91e000afd0 tx=0x7f91e001a000 comp rx=0 tx=0).stop 2023-10-09T15:32:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 msgr2=0x7f91f00c8370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f91f00ce260 tx=0x7f91e8009040 comp rx=0 tx=0).stop 2023-10-09T15:32:31.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 shutdown_connections 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f91dc066f30 0x7f91dc0693e0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f91f0150c70 0x7f91f00c8370 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f91d8003a90 0x7f91f00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 --2- 172.21.15.33:0/3907075442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f91f01502c0 0x7f91f0150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 >> 172.21.15.33:0/3907075442 conn(0x7f91f0070e30 msgr2=0x7f91f00cfb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.340+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 shutdown_connections 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.341+0000 7f91f7928700 1 -- 172.21.15.33:0/3907075442 wait complete. 2023-10-09T15:32:31.344 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:32:31.353 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-09T15:32:31.254995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384196,"kb_used_data":5892,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590524,"statfs":{"total":773094113280,"available":770652696576,"internally_reserved":0,"allocated":6033408,"data_stored":3192785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002164"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.265719+0000","last_change":"2023-10-09T15:32:27.251498+0000","last_active":"2023-10-09T15:32:27.265719+0000","last_peered":"2023-10-09T15:32:27.265719+0000","last_clean":"2023-10-09T15:32:27.265719+0000","last_became_active":"2023-10-09T15:32:27.251195+0000","last_became_peered":"2023-10-09T15:32:27.251195+0000","last_unstale":"2023-10-09T15:32:27.265719+0000","last_undegraded":"2023-10-09T15:32:27.265719+0000","last_fullsized":"2023-10-09T15:32:27.265719+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:37.768583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.246829+0000","last_change":"2023-10-09T15:32:27.246829+0000","last_active":"2023-10-09T15:32:27.246829+0000","last_peered":"2023-10-09T15:32:27.246829+0000","last_clean":"2023-10-09T15:32:27.246829+0000","last_became_active":"2023-10-09T15:32:27.246562+0000","last_became_peered":"2023-10-09T15:32:27.246562+0000","last_unstale":"2023-10-09T15:32:27.246829+0000","last_undegraded":"2023-10-09T15:32:27.246829+0000","last_fullsized":"2023-10-09T15:32:27.246829+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:28.915560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.248145+0000","last_change":"2023-10-09T15:32:27.248145+0000","last_active":"2023-10-09T15:32:27.248145+0000","last_peered":"2023-10-09T15:32:27.248145+0000","last_clean":"2023-10-09T15:32:27.248145+0000","last_became_active":"2023-10-09T15:32:27.247875+0000","last_became_peered":"2023-10-09T15:32:27.247875+0000","last_unstale":"2023-10-09T15:32:27.248145+0000","last_undegraded":"2023-10-09T15:32:27.248145+0000","last_fullsized":"2023-10-09T15:32:27.248145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:07.812009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253703+0000","last_change":"2023-10-09T15:32:27.253703+0000","last_active":"2023-10-09T15:32:27.253703+0000","last_peered":"2023-10-09T15:32:27.253703+0000","last_clean":"2023-10-09T15:32:27.253703+0000","last_became_active":"2023-10-09T15:32:27.253442+0000","last_became_peered":"2023-10-09T15:32:27.253442+0000","last_unstale":"2023-10-09T15:32:27.253703+0000","last_undegraded":"2023-10-09T15:32:27.253703+0000","last_fullsized":"2023-10-09T15:32:27.253703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254791+0000","last_change":"2023-10-09T15:32:27.251165+0000","last_active":"2023-10-09T15:32:27.254791+0000","last_peered":"2023-10-09T15:32:27.254791+0000","last_clean":"2023-10-09T15:32:27.254791+0000","last_became_active":"2023-10-09T15:32:27.250423+0000","last_became_peered":"2023-10-09T15:32:27.250423+0000","last_unstale":"2023-10-09T15:32:27.254791+0000","last_undegraded":"2023-10-09T15:32:27.254791+0000","last_fullsized":"2023-10-09T15:32:27.254791+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:40.492727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255691+0000","last_change":"2023-10-09T15:32:27.255691+0000","last_active":"2023-10-09T15:32:27.255691+0000","last_peered":"2023-10-09T15:32:27.255691+0000","last_clean":"2023-10-09T15:32:27.255691+0000","last_became_active":"2023-10-09T15:32:27.255404+0000","last_became_peered":"2023-10-09T15:32:27.255404+0000","last_unstale":"2023-10-09T15:32:27.255691+0000","last_undegraded":"2023-10-09T15:32:27.255691+0000","last_fullsized":"2023-10-09T15:32:27.255691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:56:54.342600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255874+0000","last_change":"2023-10-09T15:32:27.253848+0000","last_active":"2023-10-09T15:32:27.255874+0000","last_peered":"2023-10-09T15:32:27.255874+0000","last_clean":"2023-10-09T15:32:27.255874+0000","last_became_active":"2023-10-09T15:32:27.253574+0000","last_became_peered":"2023-10-09T15:32:27.253574+0000","last_unstale":"2023-10-09T15:32:27.255874+0000","last_undegraded":"2023-10-09T15:32:27.255874+0000","last_fullsized":"2023-10-09T15:32:27.255874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.608321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242940+0000","last_change":"2023-10-09T15:32:27.242940+0000","last_active":"2023-10-09T15:32:27.242940+0000","last_peered":"2023-10-09T15:32:27.242940+0000","last_clean":"2023-10-09T15:32:27.242940+0000","last_became_active":"2023-10-09T15:32:27.242664+0000","last_became_peered":"2023-10-09T15:32:27.242664+0000","last_unstale":"2023-10-09T15:32:27.242940+0000","last_undegraded":"2023-10-09T15:32:27.242940+0000","last_fullsized":"2023-10-09T15:32:27.242940+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:02.373494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252547+0000","last_change":"2023-10-09T15:32:27.248451+0000","last_active":"2023-10-09T15:32:27.252547+0000","last_peered":"2023-10-09T15:32:27.252547+0000","last_clean":"2023-10-09T15:32:27.252547+0000","last_became_active":"2023-10-09T15:32:27.248183+0000","last_became_peered":"2023-10-09T15:32:27.248183+0000","last_unstale":"2023-10-09T15:32:27.252547+0000","last_undegraded":"2023-10-09T15:32:27.252547+0000","last_fullsized":"2023-10-09T15:32:27.252547+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.578838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.244188+0000","last_change":"2023-10-09T15:32:27.244188+0000","last_active":"2023-10-09T15:32:27.244188+0000","last_peered":"2023-10-09T15:32:27.244188+0000","last_clean":"2023-10-09T15:32:27.244188+0000","last_became_active":"2023-10-09T15:32:27.243910+0000","last_became_peered":"2023-10-09T15:32:27.243910+0000","last_unstale":"2023-10-09T15:32:27.244188+0000","last_undegraded":"2023-10-09T15:32:27.244188+0000","last_fullsized":"2023-10-09T15:32:27.244188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.578838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.250291+0000","last_change":"2023-10-09T15:32:27.250291+0000","last_active":"2023-10-09T15:32:27.250291+0000","last_peered":"2023-10-09T15:32:27.250291+0000","last_clean":"2023-10-09T15:32:27.250291+0000","last_became_active":"2023-10-09T15:32:27.249961+0000","last_became_peered":"2023-10-09T15:32:27.249961+0000","last_unstale":"2023-10-09T15:32:27.250291+0000","last_undegraded":"2023-10-09T15:32:27.250291+0000","last_fullsized":"2023-10-09T15:32:27.250291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:43.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256645+0000","last_change":"2023-10-09T15:32:27.256645+0000","last_active":"2023-10-09T15:32:27.256645+0000","last_peered":"2023-10-09T15:32:27.256645+0000","last_clean":"2023-10-09T15:32:27.256645+0000","last_became_active":"2023-10-09T15:32:27.256334+0000","last_became_peered":"2023-10-09T15:32:27.256334+0000","last_unstale":"2023-10-09T15:32:27.256645+0000","last_undegraded":"2023-10-09T15:32:27.256645+0000","last_fullsized":"2023-10-09T15:32:27.256645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:07.812009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255216+0000","last_change":"2023-10-09T15:32:27.253730+0000","last_active":"2023-10-09T15:32:27.255216+0000","last_peered":"2023-10-09T15:32:27.255216+0000","last_clean":"2023-10-09T15:32:27.255216+0000","last_became_active":"2023-10-09T15:32:27.253455+0000","last_became_peered":"2023-10-09T15:32:27.253455+0000","last_unstale":"2023-10-09T15:32:27.255216+0000","last_undegraded":"2023-10-09T15:32:27.255216+0000","last_fullsized":"2023-10-09T15:32:27.255216+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:55.025340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253762+0000","last_change":"2023-10-09T15:32:27.251635+0000","last_active":"2023-10-09T15:32:27.253762+0000","last_peered":"2023-10-09T15:32:27.253762+0000","last_clean":"2023-10-09T15:32:27.253762+0000","last_became_active":"2023-10-09T15:32:27.251334+0000","last_became_peered":"2023-10-09T15:32:27.251334+0000","last_unstale":"2023-10-09T15:32:27.253762+0000","last_undegraded":"2023-10-09T15:32:27.253762+0000","last_fullsized":"2023-10-09T15:32:27.253762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:30.837035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251360+0000","last_change":"2023-10-09T15:32:27.244566+0000","last_active":"2023-10-09T15:32:27.251360+0000","last_peered":"2023-10-09T15:32:27.251360+0000","last_clean":"2023-10-09T15:32:27.251360+0000","last_became_active":"2023-10-09T15:32:27.244134+0000","last_became_peered":"2023-10-09T15:32:27.244134+0000","last_unstale":"2023-10-09T15:32:27.251360+0000","last_undegraded":"2023-10-09T15:32:27.251360+0000","last_fullsized":"2023-10-09T15:32:27.251360+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:16.022623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255796+0000","last_change":"2023-10-09T15:32:27.255796+0000","last_active":"2023-10-09T15:32:27.255796+0000","last_peered":"2023-10-09T15:32:27.255796+0000","last_clean":"2023-10-09T15:32:27.255796+0000","last_became_active":"2023-10-09T15:32:27.255477+0000","last_became_peered":"2023-10-09T15:32:27.255477+0000","last_unstale":"2023-10-09T15:32:27.255796+0000","last_undegraded":"2023-10-09T15:32:27.255796+0000","last_fullsized":"2023-10-09T15:32:27.255796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:48.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.243358+0000","last_change":"2023-10-09T15:32:27.243358+0000","last_active":"2023-10-09T15:32:27.243358+0000","last_peered":"2023-10-09T15:32:27.243358+0000","last_clean":"2023-10-09T15:32:27.243358+0000","last_became_active":"2023-10-09T15:32:27.243072+0000","last_became_peered":"2023-10-09T15:32:27.243072+0000","last_unstale":"2023-10-09T15:32:27.243358+0000","last_undegraded":"2023-10-09T15:32:27.243358+0000","last_fullsized":"2023-10-09T15:32:27.243358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:12.506816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254913+0000","last_change":"2023-10-09T15:32:27.254913+0000","last_active":"2023-10-09T15:32:27.254913+0000","last_peered":"2023-10-09T15:32:27.254913+0000","last_clean":"2023-10-09T15:32:27.254913+0000","last_became_active":"2023-10-09T15:32:27.254712+0000","last_became_peered":"2023-10-09T15:32:27.254712+0000","last_unstale":"2023-10-09T15:32:27.254913+0000","last_undegraded":"2023-10-09T15:32:27.254913+0000","last_fullsized":"2023-10-09T15:32:27.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:03.678186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254944+0000","last_change":"2023-10-09T15:32:27.250988+0000","last_active":"2023-10-09T15:32:27.254944+0000","last_peered":"2023-10-09T15:32:27.254944+0000","last_clean":"2023-10-09T15:32:27.254944+0000","last_became_active":"2023-10-09T15:32:27.250548+0000","last_became_peered":"2023-10-09T15:32:27.250548+0000","last_unstale":"2023-10-09T15:32:27.254944+0000","last_undegraded":"2023-10-09T15:32:27.254944+0000","last_fullsized":"2023-10-09T15:32:27.254944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:44:24.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.249941+0000","last_change":"2023-10-09T15:32:27.249941+0000","last_active":"2023-10-09T15:32:27.249941+0000","last_peered":"2023-10-09T15:32:27.249941+0000","last_clean":"2023-10-09T15:32:27.249941+0000","last_became_active":"2023-10-09T15:32:27.249684+0000","last_became_peered":"2023-10-09T15:32:27.249684+0000","last_unstale":"2023-10-09T15:32:27.249941+0000","last_undegraded":"2023-10-09T15:32:27.249941+0000","last_fullsized":"2023-10-09T15:32:27.249941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:03.594685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255109+0000","last_change":"2023-10-09T15:32:27.255109+0000","last_active":"2023-10-09T15:32:27.255109+0000","last_peered":"2023-10-09T15:32:27.255109+0000","last_clean":"2023-10-09T15:32:27.255109+0000","last_became_active":"2023-10-09T15:32:27.254395+0000","last_became_peered":"2023-10-09T15:32:27.254395+0000","last_unstale":"2023-10-09T15:32:27.255109+0000","last_undegraded":"2023-10-09T15:32:27.255109+0000","last_fullsized":"2023-10-09T15:32:27.255109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:18.017508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253456+0000","last_change":"2023-10-09T15:32:27.253456+0000","last_active":"2023-10-09T15:32:27.253456+0000","last_peered":"2023-10-09T15:32:27.253456+0000","last_clean":"2023-10-09T15:32:27.253456+0000","last_became_active":"2023-10-09T15:32:27.253165+0000","last_became_peered":"2023-10-09T15:32:27.253165+0000","last_unstale":"2023-10-09T15:32:27.253456+0000","last_undegraded":"2023-10-09T15:32:27.253456+0000","last_fullsized":"2023-10-09T15:32:27.253456+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:57.737525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252816+0000","last_change":"2023-10-09T15:32:27.252816+0000","last_active":"2023-10-09T15:32:27.252816+0000","last_peered":"2023-10-09T15:32:27.252816+0000","last_clean":"2023-10-09T15:32:27.252816+0000","last_became_active":"2023-10-09T15:32:27.252534+0000","last_became_peered":"2023-10-09T15:32:27.252534+0000","last_unstale":"2023-10-09T15:32:27.252816+0000","last_undegraded":"2023-10-09T15:32:27.252816+0000","last_fullsized":"2023-10-09T15:32:27.252816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255310+0000","last_change":"2023-10-09T15:32:27.251223+0000","last_active":"2023-10-09T15:32:27.255310+0000","last_peered":"2023-10-09T15:32:27.255310+0000","last_clean":"2023-10-09T15:32:27.255310+0000","last_became_active":"2023-10-09T15:32:27.250939+0000","last_became_peered":"2023-10-09T15:32:27.250939+0000","last_unstale":"2023-10-09T15:32:27.255310+0000","last_undegraded":"2023-10-09T15:32:27.255310+0000","last_fullsized":"2023-10-09T15:32:27.255310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:18.403967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254817+0000","last_change":"2023-10-09T15:32:27.251255+0000","last_active":"2023-10-09T15:32:27.254817+0000","last_peered":"2023-10-09T15:32:27.254817+0000","last_clean":"2023-10-09T15:32:27.254817+0000","last_became_active":"2023-10-09T15:32:27.250966+0000","last_became_peered":"2023-10-09T15:32:27.250966+0000","last_unstale":"2023-10-09T15:32:27.254817+0000","last_undegraded":"2023-10-09T15:32:27.254817+0000","last_fullsized":"2023-10-09T15:32:27.254817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:22.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.250316+0000","last_change":"2023-10-09T15:32:27.250316+0000","last_active":"2023-10-09T15:32:27.250316+0000","last_peered":"2023-10-09T15:32:27.250316+0000","last_clean":"2023-10-09T15:32:27.250316+0000","last_became_active":"2023-10-09T15:32:27.250028+0000","last_became_peered":"2023-10-09T15:32:27.250028+0000","last_unstale":"2023-10-09T15:32:27.250316+0000","last_undegraded":"2023-10-09T15:32:27.250316+0000","last_fullsized":"2023-10-09T15:32:27.250316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:48.610416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255774+0000","last_change":"2023-10-09T15:32:27.255774+0000","last_active":"2023-10-09T15:32:27.255774+0000","last_peered":"2023-10-09T15:32:27.255774+0000","last_clean":"2023-10-09T15:32:27.255774+0000","last_became_active":"2023-10-09T15:32:27.255198+0000","last_became_peered":"2023-10-09T15:32:27.255198+0000","last_unstale":"2023-10-09T15:32:27.255774+0000","last_undegraded":"2023-10-09T15:32:27.255774+0000","last_fullsized":"2023-10-09T15:32:27.255774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.265882+0000","last_change":"2023-10-09T15:32:27.254160+0000","last_active":"2023-10-09T15:32:27.265882+0000","last_peered":"2023-10-09T15:32:27.265882+0000","last_clean":"2023-10-09T15:32:27.265882+0000","last_became_active":"2023-10-09T15:32:27.253905+0000","last_became_peered":"2023-10-09T15:32:27.253905+0000","last_unstale":"2023-10-09T15:32:27.265882+0000","last_undegraded":"2023-10-09T15:32:27.265882+0000","last_fullsized":"2023-10-09T15:32:27.265882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:12.961794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255610+0000","last_change":"2023-10-09T15:32:27.255610+0000","last_active":"2023-10-09T15:32:27.255610+0000","last_peered":"2023-10-09T15:32:27.255610+0000","last_clean":"2023-10-09T15:32:27.255610+0000","last_became_active":"2023-10-09T15:32:27.255303+0000","last_became_peered":"2023-10-09T15:32:27.255303+0000","last_unstale":"2023-10-09T15:32:27.255610+0000","last_undegraded":"2023-10-09T15:32:27.255610+0000","last_fullsized":"2023-10-09T15:32:27.255610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:31.071810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247526+0000","last_change":"2023-10-09T15:32:27.247526+0000","last_active":"2023-10-09T15:32:27.247526+0000","last_peered":"2023-10-09T15:32:27.247526+0000","last_clean":"2023-10-09T15:32:27.247526+0000","last_became_active":"2023-10-09T15:32:27.246011+0000","last_became_peered":"2023-10-09T15:32:27.246011+0000","last_unstale":"2023-10-09T15:32:27.247526+0000","last_undegraded":"2023-10-09T15:32:27.247526+0000","last_fullsized":"2023-10-09T15:32:27.247526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252093+0000","last_change":"2023-10-09T15:32:27.247508+0000","last_active":"2023-10-09T15:32:27.252093+0000","last_peered":"2023-10-09T15:32:27.252093+0000","last_clean":"2023-10-09T15:32:27.252093+0000","last_became_active":"2023-10-09T15:32:27.247322+0000","last_became_peered":"2023-10-09T15:32:27.247322+0000","last_unstale":"2023-10-09T15:32:27.252093+0000","last_undegraded":"2023-10-09T15:32:27.252093+0000","last_fullsized":"2023-10-09T15:32:27.252093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:14.155030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254911+0000","last_change":"2023-10-09T15:32:27.254911+0000","last_active":"2023-10-09T15:32:27.254911+0000","last_peered":"2023-10-09T15:32:27.254911+0000","last_clean":"2023-10-09T15:32:27.254911+0000","last_became_active":"2023-10-09T15:32:27.254640+0000","last_became_peered":"2023-10-09T15:32:27.254640+0000","last_unstale":"2023-10-09T15:32:27.254911+0000","last_undegraded":"2023-10-09T15:32:27.254911+0000","last_fullsized":"2023-10-09T15:32:27.254911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:59:32.927546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257908+0000","last_change":"2023-10-09T15:32:27.257908+0000","last_active":"2023-10-09T15:32:27.257908+0000","last_peered":"2023-10-09T15:32:27.257908+0000","last_clean":"2023-10-09T15:32:27.257908+0000","last_became_active":"2023-10-09T15:32:27.257638+0000","last_became_peered":"2023-10-09T15:32:27.257638+0000","last_unstale":"2023-10-09T15:32:27.257908+0000","last_undegraded":"2023-10-09T15:32:27.257908+0000","last_fullsized":"2023-10-09T15:32:27.257908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257790+0000","last_change":"2023-10-09T15:32:26.246783+0000","last_active":"2023-10-09T15:32:27.257790+0000","last_peered":"2023-10-09T15:32:27.257790+0000","last_clean":"2023-10-09T15:32:27.257790+0000","last_became_active":"2023-10-09T15:32:26.246534+0000","last_became_peered":"2023-10-09T15:32:26.246534+0000","last_unstale":"2023-10-09T15:32:27.257790+0000","last_undegraded":"2023-10-09T15:32:27.257790+0000","last_fullsized":"2023-10-09T15:32:27.257790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:07.833909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256476+0000","last_change":"2023-10-09T15:32:27.256476+0000","last_active":"2023-10-09T15:32:27.256476+0000","last_peered":"2023-10-09T15:32:27.256476+0000","last_clean":"2023-10-09T15:32:27.256476+0000","last_became_active":"2023-10-09T15:32:27.256147+0000","last_became_peered":"2023-10-09T15:32:27.256147+0000","last_unstale":"2023-10-09T15:32:27.256476+0000","last_undegraded":"2023-10-09T15:32:27.256476+0000","last_fullsized":"2023-10-09T15:32:27.256476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.608321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231191+0000","last_change":"2023-10-09T15:32:26.246290+0000","last_active":"2023-10-09T15:32:27.231191+0000","last_peered":"2023-10-09T15:32:27.231191+0000","last_clean":"2023-10-09T15:32:27.231191+0000","last_became_active":"2023-10-09T15:32:26.246030+0000","last_became_peered":"2023-10-09T15:32:26.246030+0000","last_unstale":"2023-10-09T15:32:27.231191+0000","last_undegraded":"2023-10-09T15:32:27.231191+0000","last_fullsized":"2023-10-09T15:32:27.231191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:33.349406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.249197+0000","last_change":"2023-10-09T15:32:27.249197+0000","last_active":"2023-10-09T15:32:27.249197+0000","last_peered":"2023-10-09T15:32:27.249197+0000","last_clean":"2023-10-09T15:32:27.249197+0000","last_became_active":"2023-10-09T15:32:27.248813+0000","last_became_peered":"2023-10-09T15:32:27.248813+0000","last_unstale":"2023-10-09T15:32:27.249197+0000","last_undegraded":"2023-10-09T15:32:27.249197+0000","last_fullsized":"2023-10-09T15:32:27.249197+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:49.661494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.248771+0000","last_change":"2023-10-09T15:32:26.237441+0000","last_active":"2023-10-09T15:32:27.248771+0000","last_peered":"2023-10-09T15:32:27.248771+0000","last_clean":"2023-10-09T15:32:27.248771+0000","last_became_active":"2023-10-09T15:32:26.237098+0000","last_became_peered":"2023-10-09T15:32:26.237098+0000","last_unstale":"2023-10-09T15:32:27.248771+0000","last_undegraded":"2023-10-09T15:32:27.248771+0000","last_fullsized":"2023-10-09T15:32:27.248771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252902+0000","last_change":"2023-10-09T15:32:27.252902+0000","last_active":"2023-10-09T15:32:27.252902+0000","last_peered":"2023-10-09T15:32:27.252902+0000","last_clean":"2023-10-09T15:32:27.252902+0000","last_became_active":"2023-10-09T15:32:27.252567+0000","last_became_peered":"2023-10-09T15:32:27.252567+0000","last_unstale":"2023-10-09T15:32:27.252902+0000","last_undegraded":"2023-10-09T15:32:27.252902+0000","last_fullsized":"2023-10-09T15:32:27.252902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:53.531180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256239+0000","last_change":"2023-10-09T15:32:26.249406+0000","last_active":"2023-10-09T15:32:27.256239+0000","last_peered":"2023-10-09T15:32:27.256239+0000","last_clean":"2023-10-09T15:32:27.256239+0000","last_became_active":"2023-10-09T15:32:26.249064+0000","last_became_peered":"2023-10-09T15:32:26.249064+0000","last_unstale":"2023-10-09T15:32:27.256239+0000","last_undegraded":"2023-10-09T15:32:27.256239+0000","last_fullsized":"2023-10-09T15:32:27.256239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:42.640798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253386+0000","last_change":"2023-10-09T15:32:27.253386+0000","last_active":"2023-10-09T15:32:27.253386+0000","last_peered":"2023-10-09T15:32:27.253386+0000","last_clean":"2023-10-09T15:32:27.253386+0000","last_became_active":"2023-10-09T15:32:27.253085+0000","last_became_peered":"2023-10-09T15:32:27.253085+0000","last_unstale":"2023-10-09T15:32:27.253386+0000","last_undegraded":"2023-10-09T15:32:27.253386+0000","last_fullsized":"2023-10-09T15:32:27.253386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:03.737536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252343+0000","last_change":"2023-10-09T15:32:26.240992+0000","last_active":"2023-10-09T15:32:27.252343+0000","last_peered":"2023-10-09T15:32:27.252343+0000","last_clean":"2023-10-09T15:32:27.252343+0000","last_became_active":"2023-10-09T15:32:26.240730+0000","last_became_peered":"2023-10-09T15:32:26.240730+0000","last_unstale":"2023-10-09T15:32:27.252343+0000","last_undegraded":"2023-10-09T15:32:27.252343+0000","last_fullsized":"2023-10-09T15:32:27.252343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.398619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253811+0000","last_change":"2023-10-09T15:32:27.253811+0000","last_active":"2023-10-09T15:32:27.253811+0000","last_peered":"2023-10-09T15:32:27.253811+0000","last_clean":"2023-10-09T15:32:27.253811+0000","last_became_active":"2023-10-09T15:32:27.249394+0000","last_became_peered":"2023-10-09T15:32:27.249394+0000","last_unstale":"2023-10-09T15:32:27.253811+0000","last_undegraded":"2023-10-09T15:32:27.253811+0000","last_fullsized":"2023-10-09T15:32:27.253811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:24.364274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.235853+0000","last_change":"2023-10-09T15:32:26.242618+0000","last_active":"2023-10-09T15:32:27.235853+0000","last_peered":"2023-10-09T15:32:27.235853+0000","last_clean":"2023-10-09T15:32:27.235853+0000","last_became_active":"2023-10-09T15:32:26.242329+0000","last_became_peered":"2023-10-09T15:32:26.242329+0000","last_unstale":"2023-10-09T15:32:27.235853+0000","last_undegraded":"2023-10-09T15:32:27.235853+0000","last_fullsized":"2023-10-09T15:32:27.235853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:13:16.764829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255291+0000","last_change":"2023-10-09T15:32:27.249621+0000","last_active":"2023-10-09T15:32:27.255291+0000","last_peered":"2023-10-09T15:32:27.255291+0000","last_clean":"2023-10-09T15:32:27.255291+0000","last_became_active":"2023-10-09T15:32:27.249354+0000","last_became_peered":"2023-10-09T15:32:27.249354+0000","last_unstale":"2023-10-09T15:32:27.255291+0000","last_undegraded":"2023-10-09T15:32:27.255291+0000","last_fullsized":"2023-10-09T15:32:27.255291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:41.287760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251196+0000","last_change":"2023-10-09T15:32:26.246669+0000","last_active":"2023-10-09T15:32:26.251196+0000","last_peered":"2023-10-09T15:32:26.251196+0000","last_clean":"2023-10-09T15:32:26.251196+0000","last_became_active":"2023-10-09T15:32:26.246357+0000","last_became_peered":"2023-10-09T15:32:26.246357+0000","last_unstale":"2023-10-09T15:32:26.251196+0000","last_undegraded":"2023-10-09T15:32:26.251196+0000","last_fullsized":"2023-10-09T15:32:26.251196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:54.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245237+0000","last_change":"2023-10-09T15:32:27.245237+0000","last_active":"2023-10-09T15:32:27.245237+0000","last_peered":"2023-10-09T15:32:27.245237+0000","last_clean":"2023-10-09T15:32:27.245237+0000","last_became_active":"2023-10-09T15:32:27.244926+0000","last_became_peered":"2023-10-09T15:32:27.244926+0000","last_unstale":"2023-10-09T15:32:27.245237+0000","last_undegraded":"2023-10-09T15:32:27.245237+0000","last_fullsized":"2023-10-09T15:32:27.245237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:47.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232308+0000","last_change":"2023-10-09T15:32:26.247534+0000","last_active":"2023-10-09T15:32:27.232308+0000","last_peered":"2023-10-09T15:32:27.232308+0000","last_clean":"2023-10-09T15:32:27.232308+0000","last_became_active":"2023-10-09T15:32:26.247240+0000","last_became_peered":"2023-10-09T15:32:26.247240+0000","last_unstale":"2023-10-09T15:32:27.232308+0000","last_undegraded":"2023-10-09T15:32:27.232308+0000","last_fullsized":"2023-10-09T15:32:27.232308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253072+0000","last_change":"2023-10-09T15:32:27.247194+0000","last_active":"2023-10-09T15:32:27.253072+0000","last_peered":"2023-10-09T15:32:27.253072+0000","last_clean":"2023-10-09T15:32:27.253072+0000","last_became_active":"2023-10-09T15:32:27.245107+0000","last_became_peered":"2023-10-09T15:32:27.245107+0000","last_unstale":"2023-10-09T15:32:27.253072+0000","last_undegraded":"2023-10-09T15:32:27.253072+0000","last_fullsized":"2023-10-09T15:32:27.253072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:12.446889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251093+0000","last_change":"2023-10-09T15:32:26.247981+0000","last_active":"2023-10-09T15:32:26.251093+0000","last_peered":"2023-10-09T15:32:26.251093+0000","last_clean":"2023-10-09T15:32:26.251093+0000","last_became_active":"2023-10-09T15:32:26.247687+0000","last_became_peered":"2023-10-09T15:32:26.247687+0000","last_unstale":"2023-10-09T15:32:26.251093+0000","last_undegraded":"2023-10-09T15:32:26.251093+0000","last_fullsized":"2023-10-09T15:32:26.251093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:54.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259020+0000","last_change":"2023-10-09T15:32:27.259020+0000","last_active":"2023-10-09T15:32:27.259020+0000","last_peered":"2023-10-09T15:32:27.259020+0000","last_clean":"2023-10-09T15:32:27.259020+0000","last_became_active":"2023-10-09T15:32:27.258447+0000","last_became_peered":"2023-10-09T15:32:27.258447+0000","last_unstale":"2023-10-09T15:32:27.259020+0000","last_undegraded":"2023-10-09T15:32:27.259020+0000","last_fullsized":"2023-10-09T15:32:27.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:46.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251265+0000","last_change":"2023-10-09T15:32:26.249979+0000","last_active":"2023-10-09T15:32:26.251265+0000","last_peered":"2023-10-09T15:32:26.251265+0000","last_clean":"2023-10-09T15:32:26.251265+0000","last_became_active":"2023-10-09T15:32:26.249683+0000","last_became_peered":"2023-10-09T15:32:26.249683+0000","last_unstale":"2023-10-09T15:32:26.251265+0000","last_undegraded":"2023-10-09T15:32:26.251265+0000","last_fullsized":"2023-10-09T15:32:26.251265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:06.806661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245675+0000","last_change":"2023-10-09T15:32:27.245675+0000","last_active":"2023-10-09T15:32:27.245675+0000","last_peered":"2023-10-09T15:32:27.245675+0000","last_clean":"2023-10-09T15:32:27.245675+0000","last_became_active":"2023-10-09T15:32:27.242474+0000","last_became_peered":"2023-10-09T15:32:27.242474+0000","last_unstale":"2023-10-09T15:32:27.245675+0000","last_undegraded":"2023-10-09T15:32:27.245675+0000","last_fullsized":"2023-10-09T15:32:27.245675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:30.837035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259498+0000","last_change":"2023-10-09T15:32:26.252248+0000","last_active":"2023-10-09T15:32:27.259498+0000","last_peered":"2023-10-09T15:32:27.259498+0000","last_clean":"2023-10-09T15:32:27.259498+0000","last_became_active":"2023-10-09T15:32:26.252005+0000","last_became_peered":"2023-10-09T15:32:26.252005+0000","last_unstale":"2023-10-09T15:32:27.259498+0000","last_undegraded":"2023-10-09T15:32:27.259498+0000","last_fullsized":"2023-10-09T15:32:27.259498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:15.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259655+0000","last_change":"2023-10-09T15:32:27.259655+0000","last_active":"2023-10-09T15:32:27.259655+0000","last_peered":"2023-10-09T15:32:27.259655+0000","last_clean":"2023-10-09T15:32:27.259655+0000","last_became_active":"2023-10-09T15:32:27.259093+0000","last_became_peered":"2023-10-09T15:32:27.259093+0000","last_unstale":"2023-10-09T15:32:27.259655+0000","last_undegraded":"2023-10-09T15:32:27.259655+0000","last_fullsized":"2023-10-09T15:32:27.259655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:30.021691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259965+0000","last_change":"2023-10-09T15:32:26.245094+0000","last_active":"2023-10-09T15:32:27.259965+0000","last_peered":"2023-10-09T15:32:27.259965+0000","last_clean":"2023-10-09T15:32:27.259965+0000","last_became_active":"2023-10-09T15:32:26.244825+0000","last_became_peered":"2023-10-09T15:32:26.244825+0000","last_unstale":"2023-10-09T15:32:27.259965+0000","last_undegraded":"2023-10-09T15:32:27.259965+0000","last_fullsized":"2023-10-09T15:32:27.259965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254597+0000","last_change":"2023-10-09T15:32:27.254597+0000","last_active":"2023-10-09T15:32:27.254597+0000","last_peered":"2023-10-09T15:32:27.254597+0000","last_clean":"2023-10-09T15:32:27.254597+0000","last_became_active":"2023-10-09T15:32:27.254165+0000","last_became_peered":"2023-10-09T15:32:27.254165+0000","last_unstale":"2023-10-09T15:32:27.254597+0000","last_undegraded":"2023-10-09T15:32:27.254597+0000","last_fullsized":"2023-10-09T15:32:27.254597+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254136+0000","last_change":"2023-10-09T15:32:26.247747+0000","last_active":"2023-10-09T15:32:27.254136+0000","last_peered":"2023-10-09T15:32:27.254136+0000","last_clean":"2023-10-09T15:32:27.254136+0000","last_became_active":"2023-10-09T15:32:26.247477+0000","last_became_peered":"2023-10-09T15:32:26.247477+0000","last_unstale":"2023-10-09T15:32:27.254136+0000","last_undegraded":"2023-10-09T15:32:27.254136+0000","last_fullsized":"2023-10-09T15:32:27.254136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:17.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247495+0000","last_change":"2023-10-09T15:32:27.247495+0000","last_active":"2023-10-09T15:32:27.247495+0000","last_peered":"2023-10-09T15:32:27.247495+0000","last_clean":"2023-10-09T15:32:27.247495+0000","last_became_active":"2023-10-09T15:32:27.245461+0000","last_became_peered":"2023-10-09T15:32:27.245461+0000","last_unstale":"2023-10-09T15:32:27.247495+0000","last_undegraded":"2023-10-09T15:32:27.247495+0000","last_fullsized":"2023-10-09T15:32:27.247495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:48.610416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232186+0000","last_change":"2023-10-09T15:32:26.249383+0000","last_active":"2023-10-09T15:32:27.232186+0000","last_peered":"2023-10-09T15:32:27.232186+0000","last_clean":"2023-10-09T15:32:27.232186+0000","last_became_active":"2023-10-09T15:32:26.249138+0000","last_became_peered":"2023-10-09T15:32:26.249138+0000","last_unstale":"2023-10-09T15:32:27.232186+0000","last_undegraded":"2023-10-09T15:32:27.232186+0000","last_fullsized":"2023-10-09T15:32:27.232186+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:27.748252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252939+0000","last_change":"2023-10-09T15:32:27.249282+0000","last_active":"2023-10-09T15:32:27.252939+0000","last_peered":"2023-10-09T15:32:27.252939+0000","last_clean":"2023-10-09T15:32:27.252939+0000","last_became_active":"2023-10-09T15:32:27.249024+0000","last_became_peered":"2023-10-09T15:32:27.249024+0000","last_unstale":"2023-10-09T15:32:27.252939+0000","last_undegraded":"2023-10-09T15:32:27.252939+0000","last_fullsized":"2023-10-09T15:32:27.252939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:43.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.252473+0000","last_change":"2023-10-09T15:32:26.249433+0000","last_active":"2023-10-09T15:32:26.252473+0000","last_peered":"2023-10-09T15:32:26.252473+0000","last_clean":"2023-10-09T15:32:26.252473+0000","last_became_active":"2023-10-09T15:32:26.249093+0000","last_became_peered":"2023-10-09T15:32:26.249093+0000","last_unstale":"2023-10-09T15:32:26.252473+0000","last_undegraded":"2023-10-09T15:32:26.252473+0000","last_fullsized":"2023-10-09T15:32:26.252473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:29.831687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252943+0000","last_change":"2023-10-09T15:32:27.252943+0000","last_active":"2023-10-09T15:32:27.252943+0000","last_peered":"2023-10-09T15:32:27.252943+0000","last_clean":"2023-10-09T15:32:27.252943+0000","last_became_active":"2023-10-09T15:32:27.252646+0000","last_became_peered":"2023-10-09T15:32:27.252646+0000","last_unstale":"2023-10-09T15:32:27.252943+0000","last_undegraded":"2023-10-09T15:32:27.252943+0000","last_fullsized":"2023-10-09T15:32:27.252943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257847+0000","last_change":"2023-10-09T15:32:26.251734+0000","last_active":"2023-10-09T15:32:27.257847+0000","last_peered":"2023-10-09T15:32:27.257847+0000","last_clean":"2023-10-09T15:32:27.257847+0000","last_became_active":"2023-10-09T15:32:26.251448+0000","last_became_peered":"2023-10-09T15:32:26.251448+0000","last_unstale":"2023-10-09T15:32:27.257847+0000","last_undegraded":"2023-10-09T15:32:27.257847+0000","last_fullsized":"2023-10-09T15:32:27.257847+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:15.558970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247791+0000","last_change":"2023-10-09T15:32:27.247791+0000","last_active":"2023-10-09T15:32:27.247791+0000","last_peered":"2023-10-09T15:32:27.247791+0000","last_clean":"2023-10-09T15:32:27.247791+0000","last_became_active":"2023-10-09T15:32:27.245608+0000","last_became_peered":"2023-10-09T15:32:27.245608+0000","last_unstale":"2023-10-09T15:32:27.247791+0000","last_undegraded":"2023-10-09T15:32:27.247791+0000","last_fullsized":"2023-10-09T15:32:27.247791+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:19.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231342+0000","last_change":"2023-10-09T15:32:26.250327+0000","last_active":"2023-10-09T15:32:27.231342+0000","last_peered":"2023-10-09T15:32:27.231342+0000","last_clean":"2023-10-09T15:32:27.231342+0000","last_became_active":"2023-10-09T15:32:26.249794+0000","last_became_peered":"2023-10-09T15:32:26.249794+0000","last_unstale":"2023-10-09T15:32:27.231342+0000","last_undegraded":"2023-10-09T15:32:27.231342+0000","last_fullsized":"2023-10-09T15:32:27.231342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:18.762642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254207+0000","last_change":"2023-10-09T15:32:27.254207+0000","last_active":"2023-10-09T15:32:27.254207+0000","last_peered":"2023-10-09T15:32:27.254207+0000","last_clean":"2023-10-09T15:32:27.254207+0000","last_became_active":"2023-10-09T15:32:27.253957+0000","last_became_peered":"2023-10-09T15:32:27.253957+0000","last_unstale":"2023-10-09T15:32:27.254207+0000","last_undegraded":"2023-10-09T15:32:27.254207+0000","last_fullsized":"2023-10-09T15:32:27.254207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254834+0000","last_change":"2023-10-09T15:32:26.241435+0000","last_active":"2023-10-09T15:32:27.254834+0000","last_peered":"2023-10-09T15:32:27.254834+0000","last_clean":"2023-10-09T15:32:27.254834+0000","last_became_active":"2023-10-09T15:32:26.241183+0000","last_became_peered":"2023-10-09T15:32:26.241183+0000","last_unstale":"2023-10-09T15:32:27.254834+0000","last_undegraded":"2023-10-09T15:32:27.254834+0000","last_fullsized":"2023-10-09T15:32:27.254834+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:37.218806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242625+0000","last_change":"2023-10-09T15:32:27.242625+0000","last_active":"2023-10-09T15:32:27.242625+0000","last_peered":"2023-10-09T15:32:27.242625+0000","last_clean":"2023-10-09T15:32:27.242625+0000","last_became_active":"2023-10-09T15:32:27.242323+0000","last_became_peered":"2023-10-09T15:32:27.242323+0000","last_unstale":"2023-10-09T15:32:27.242625+0000","last_undegraded":"2023-10-09T15:32:27.242625+0000","last_fullsized":"2023-10-09T15:32:27.242625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:35.347119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242868+0000","last_change":"2023-10-09T15:32:26.250096+0000","last_active":"2023-10-09T15:32:27.242868+0000","last_peered":"2023-10-09T15:32:27.242868+0000","last_clean":"2023-10-09T15:32:27.242868+0000","last_became_active":"2023-10-09T15:32:26.249780+0000","last_became_peered":"2023-10-09T15:32:26.249780+0000","last_unstale":"2023-10-09T15:32:27.242868+0000","last_undegraded":"2023-10-09T15:32:27.242868+0000","last_fullsized":"2023-10-09T15:32:27.242868+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:11.441541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259845+0000","last_change":"2023-10-09T15:32:27.259845+0000","last_active":"2023-10-09T15:32:27.259845+0000","last_peered":"2023-10-09T15:32:27.259845+0000","last_clean":"2023-10-09T15:32:27.259845+0000","last_became_active":"2023-10-09T15:32:27.259582+0000","last_became_peered":"2023-10-09T15:32:27.259582+0000","last_unstale":"2023-10-09T15:32:27.259845+0000","last_undegraded":"2023-10-09T15:32:27.259845+0000","last_fullsized":"2023-10-09T15:32:27.259845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:34.354754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.245793+0000","last_change":"2023-10-09T15:32:26.243856+0000","last_active":"2023-10-09T15:32:26.245793+0000","last_peered":"2023-10-09T15:32:26.245793+0000","last_clean":"2023-10-09T15:32:26.245793+0000","last_became_active":"2023-10-09T15:32:26.243323+0000","last_became_peered":"2023-10-09T15:32:26.243323+0000","last_unstale":"2023-10-09T15:32:26.245793+0000","last_undegraded":"2023-10-09T15:32:26.245793+0000","last_fullsized":"2023-10-09T15:32:26.245793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254421+0000","last_change":"2023-10-09T15:32:27.254421+0000","last_active":"2023-10-09T15:32:27.254421+0000","last_peered":"2023-10-09T15:32:27.254421+0000","last_clean":"2023-10-09T15:32:27.254421+0000","last_became_active":"2023-10-09T15:32:27.253833+0000","last_became_peered":"2023-10-09T15:32:27.253833+0000","last_unstale":"2023-10-09T15:32:27.254421+0000","last_undegraded":"2023-10-09T15:32:27.254421+0000","last_fullsized":"2023-10-09T15:32:27.254421+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:48.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.244590+0000","last_change":"2023-10-09T15:32:26.247351+0000","last_active":"2023-10-09T15:32:27.244590+0000","last_peered":"2023-10-09T15:32:27.244590+0000","last_clean":"2023-10-09T15:32:27.244590+0000","last_became_active":"2023-10-09T15:32:26.247073+0000","last_became_peered":"2023-10-09T15:32:26.247073+0000","last_unstale":"2023-10-09T15:32:27.244590+0000","last_undegraded":"2023-10-09T15:32:27.244590+0000","last_fullsized":"2023-10-09T15:32:27.244590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:26.578685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255942+0000","last_change":"2023-10-09T15:32:27.255942+0000","last_active":"2023-10-09T15:32:27.255942+0000","last_peered":"2023-10-09T15:32:27.255942+0000","last_clean":"2023-10-09T15:32:27.255942+0000","last_became_active":"2023-10-09T15:32:27.255221+0000","last_became_peered":"2023-10-09T15:32:27.255221+0000","last_unstale":"2023-10-09T15:32:27.255942+0000","last_undegraded":"2023-10-09T15:32:27.255942+0000","last_fullsized":"2023-10-09T15:32:27.255942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.242005+0000","last_change":"2023-10-09T15:32:26.240055+0000","last_active":"2023-10-09T15:32:26.242005+0000","last_peered":"2023-10-09T15:32:26.242005+0000","last_clean":"2023-10-09T15:32:26.242005+0000","last_became_active":"2023-10-09T15:32:26.239784+0000","last_became_peered":"2023-10-09T15:32:26.239784+0000","last_unstale":"2023-10-09T15:32:26.242005+0000","last_undegraded":"2023-10-09T15:32:26.242005+0000","last_fullsized":"2023-10-09T15:32:26.242005+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.398619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256933+0000","last_change":"2023-10-09T15:32:27.256933+0000","last_active":"2023-10-09T15:32:27.256933+0000","last_peered":"2023-10-09T15:32:27.256933+0000","last_clean":"2023-10-09T15:32:27.256933+0000","last_became_active":"2023-10-09T15:32:27.256602+0000","last_became_peered":"2023-10-09T15:32:27.256602+0000","last_unstale":"2023-10-09T15:32:27.256933+0000","last_undegraded":"2023-10-09T15:32:27.256933+0000","last_fullsized":"2023-10-09T15:32:27.256933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251339+0000","last_change":"2023-10-09T15:32:26.247816+0000","last_active":"2023-10-09T15:32:26.251339+0000","last_peered":"2023-10-09T15:32:26.251339+0000","last_clean":"2023-10-09T15:32:26.251339+0000","last_became_active":"2023-10-09T15:32:26.247542+0000","last_became_peered":"2023-10-09T15:32:26.247542+0000","last_unstale":"2023-10-09T15:32:26.251339+0000","last_undegraded":"2023-10-09T15:32:26.251339+0000","last_fullsized":"2023-10-09T15:32:26.251339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:15.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253337+0000","last_change":"2023-10-09T15:32:27.253337+0000","last_active":"2023-10-09T15:32:27.253337+0000","last_peered":"2023-10-09T15:32:27.253337+0000","last_clean":"2023-10-09T15:32:27.253337+0000","last_became_active":"2023-10-09T15:32:27.253025+0000","last_became_peered":"2023-10-09T15:32:27.253025+0000","last_unstale":"2023-10-09T15:32:27.253337+0000","last_undegraded":"2023-10-09T15:32:27.253337+0000","last_fullsized":"2023-10-09T15:32:27.253337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254109+0000","last_change":"2023-10-09T15:32:26.247329+0000","last_active":"2023-10-09T15:32:27.254109+0000","last_peered":"2023-10-09T15:32:27.254109+0000","last_clean":"2023-10-09T15:32:27.254109+0000","last_became_active":"2023-10-09T15:32:26.247042+0000","last_became_peered":"2023-10-09T15:32:26.247042+0000","last_unstale":"2023-10-09T15:32:27.254109+0000","last_undegraded":"2023-10-09T15:32:27.254109+0000","last_fullsized":"2023-10-09T15:32:27.254109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256653+0000","last_change":"2023-10-09T15:32:27.256653+0000","last_active":"2023-10-09T15:32:27.256653+0000","last_peered":"2023-10-09T15:32:27.256653+0000","last_clean":"2023-10-09T15:32:27.256653+0000","last_became_active":"2023-10-09T15:32:27.256266+0000","last_became_peered":"2023-10-09T15:32:27.256266+0000","last_unstale":"2023-10-09T15:32:27.256653+0000","last_undegraded":"2023-10-09T15:32:27.256653+0000","last_fullsized":"2023-10-09T15:32:27.256653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:19.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.245768+0000","last_change":"2023-10-09T15:32:26.243993+0000","last_active":"2023-10-09T15:32:26.245768+0000","last_peered":"2023-10-09T15:32:26.245768+0000","last_clean":"2023-10-09T15:32:26.245768+0000","last_became_active":"2023-10-09T15:32:26.242544+0000","last_became_peered":"2023-10-09T15:32:26.242544+0000","last_unstale":"2023-10-09T15:32:26.245768+0000","last_undegraded":"2023-10-09T15:32:26.245768+0000","last_fullsized":"2023-10-09T15:32:26.245768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:26.601551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245812+0000","last_change":"2023-10-09T15:32:27.245812+0000","last_active":"2023-10-09T15:32:27.245812+0000","last_peered":"2023-10-09T15:32:27.245812+0000","last_clean":"2023-10-09T15:32:27.245812+0000","last_became_active":"2023-10-09T15:32:27.242031+0000","last_became_peered":"2023-10-09T15:32:27.242031+0000","last_unstale":"2023-10-09T15:32:27.245812+0000","last_undegraded":"2023-10-09T15:32:27.245812+0000","last_fullsized":"2023-10-09T15:32:27.245812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:55.711086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232272+0000","last_change":"2023-10-09T15:32:26.245577+0000","last_active":"2023-10-09T15:32:27.232272+0000","last_peered":"2023-10-09T15:32:27.232272+0000","last_clean":"2023-10-09T15:32:27.232272+0000","last_became_active":"2023-10-09T15:32:26.245228+0000","last_became_peered":"2023-10-09T15:32:26.245228+0000","last_unstale":"2023-10-09T15:32:27.232272+0000","last_undegraded":"2023-10-09T15:32:27.232272+0000","last_fullsized":"2023-10-09T15:32:27.232272+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:24.556359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252829+0000","last_change":"2023-10-09T15:32:27.252829+0000","last_active":"2023-10-09T15:32:27.252829+0000","last_peered":"2023-10-09T15:32:27.252829+0000","last_clean":"2023-10-09T15:32:27.252829+0000","last_became_active":"2023-10-09T15:32:27.252547+0000","last_became_peered":"2023-10-09T15:32:27.252547+0000","last_unstale":"2023-10-09T15:32:27.252829+0000","last_undegraded":"2023-10-09T15:32:27.252829+0000","last_fullsized":"2023-10-09T15:32:27.252829+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:33.585830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251209+0000","last_change":"2023-10-09T15:32:26.246747+0000","last_active":"2023-10-09T15:32:26.251209+0000","last_peered":"2023-10-09T15:32:26.251209+0000","last_clean":"2023-10-09T15:32:26.251209+0000","last_became_active":"2023-10-09T15:32:26.246329+0000","last_became_peered":"2023-10-09T15:32:26.246329+0000","last_unstale":"2023-10-09T15:32:26.251209+0000","last_undegraded":"2023-10-09T15:32:26.251209+0000","last_fullsized":"2023-10-09T15:32:26.251209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:15.558970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.246917+0000","last_change":"2023-10-09T15:32:27.246917+0000","last_active":"2023-10-09T15:32:27.246917+0000","last_peered":"2023-10-09T15:32:27.246917+0000","last_clean":"2023-10-09T15:32:27.246917+0000","last_became_active":"2023-10-09T15:32:27.246641+0000","last_became_peered":"2023-10-09T15:32:27.246641+0000","last_unstale":"2023-10-09T15:32:27.246917+0000","last_undegraded":"2023-10-09T15:32:27.246917+0000","last_fullsized":"2023-10-09T15:32:27.246917+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:45.195626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251450+0000","last_change":"2023-10-09T15:32:26.247343+0000","last_active":"2023-10-09T15:32:26.251450+0000","last_peered":"2023-10-09T15:32:26.251450+0000","last_clean":"2023-10-09T15:32:26.251450+0000","last_became_active":"2023-10-09T15:32:26.247013+0000","last_became_peered":"2023-10-09T15:32:26.247013+0000","last_unstale":"2023-10-09T15:32:26.251450+0000","last_undegraded":"2023-10-09T15:32:26.251450+0000","last_fullsized":"2023-10-09T15:32:26.251450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252729+0000","last_change":"2023-10-09T15:32:27.252729+0000","last_active":"2023-10-09T15:32:27.252729+0000","last_peered":"2023-10-09T15:32:27.252729+0000","last_clean":"2023-10-09T15:32:27.252729+0000","last_became_active":"2023-10-09T15:32:27.252425+0000","last_became_peered":"2023-10-09T15:32:27.252425+0000","last_unstale":"2023-10-09T15:32:27.252729+0000","last_undegraded":"2023-10-09T15:32:27.252729+0000","last_fullsized":"2023-10-09T15:32:27.252729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.233882+0000","last_change":"2023-10-09T15:32:26.244639+0000","last_active":"2023-10-09T15:32:27.233882+0000","last_peered":"2023-10-09T15:32:27.233882+0000","last_clean":"2023-10-09T15:32:27.233882+0000","last_became_active":"2023-10-09T15:32:26.244336+0000","last_became_peered":"2023-10-09T15:32:26.244336+0000","last_unstale":"2023-10-09T15:32:27.233882+0000","last_undegraded":"2023-10-09T15:32:27.233882+0000","last_fullsized":"2023-10-09T15:32:27.233882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:35.420161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251536+0000","last_change":"2023-10-09T15:32:27.251536+0000","last_active":"2023-10-09T15:32:27.251536+0000","last_peered":"2023-10-09T15:32:27.251536+0000","last_clean":"2023-10-09T15:32:27.251536+0000","last_became_active":"2023-10-09T15:32:27.251287+0000","last_became_peered":"2023-10-09T15:32:27.251287+0000","last_unstale":"2023-10-09T15:32:27.251536+0000","last_undegraded":"2023-10-09T15:32:27.251536+0000","last_fullsized":"2023-10-09T15:32:27.251536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:12.446889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251502+0000","last_change":"2023-10-09T15:32:26.248000+0000","last_active":"2023-10-09T15:32:26.251502+0000","last_peered":"2023-10-09T15:32:26.251502+0000","last_clean":"2023-10-09T15:32:26.251502+0000","last_became_active":"2023-10-09T15:32:26.247698+0000","last_became_peered":"2023-10-09T15:32:26.247698+0000","last_unstale":"2023-10-09T15:32:26.251502+0000","last_undegraded":"2023-10-09T15:32:26.251502+0000","last_fullsized":"2023-10-09T15:32:26.251502+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:35.420161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.241555+0000","last_change":"2023-10-09T15:32:27.241555+0000","last_active":"2023-10-09T15:32:27.241555+0000","last_peered":"2023-10-09T15:32:27.241555+0000","last_clean":"2023-10-09T15:32:27.241555+0000","last_became_active":"2023-10-09T15:32:27.240098+0000","last_became_peered":"2023-10-09T15:32:27.240098+0000","last_unstale":"2023-10-09T15:32:27.241555+0000","last_undegraded":"2023-10-09T15:32:27.241555+0000","last_fullsized":"2023-10-09T15:32:27.241555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:34.536894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.248478+0000","last_change":"2023-10-09T15:32:26.245581+0000","last_active":"2023-10-09T15:32:26.248478+0000","last_peered":"2023-10-09T15:32:26.248478+0000","last_clean":"2023-10-09T15:32:26.248478+0000","last_became_active":"2023-10-09T15:32:26.245313+0000","last_became_peered":"2023-10-09T15:32:26.245313+0000","last_unstale":"2023-10-09T15:32:26.248478+0000","last_undegraded":"2023-10-09T15:32:26.248478+0000","last_fullsized":"2023-10-09T15:32:26.248478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:02.672838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251313+0000","last_change":"2023-10-09T15:32:27.251313+0000","last_active":"2023-10-09T15:32:27.251313+0000","last_peered":"2023-10-09T15:32:27.251313+0000","last_clean":"2023-10-09T15:32:27.251313+0000","last_became_active":"2023-10-09T15:32:27.250989+0000","last_became_peered":"2023-10-09T15:32:27.250989+0000","last_unstale":"2023-10-09T15:32:27.251313+0000","last_undegraded":"2023-10-09T15:32:27.251313+0000","last_fullsized":"2023-10-09T15:32:27.251313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:31.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231234+0000","last_change":"2023-10-09T15:32:26.243361+0000","last_active":"2023-10-09T15:32:27.231234+0000","last_peered":"2023-10-09T15:32:27.231234+0000","last_clean":"2023-10-09T15:32:27.231234+0000","last_became_active":"2023-10-09T15:32:26.243062+0000","last_became_peered":"2023-10-09T15:32:26.243062+0000","last_unstale":"2023-10-09T15:32:27.231234+0000","last_undegraded":"2023-10-09T15:32:27.231234+0000","last_fullsized":"2023-10-09T15:32:27.231234+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:19.933530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.240955+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:26.240955+0000","last_peered":"2023-10-09T15:32:26.240955+0000","last_clean":"2023-10-09T15:32:26.240955+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:26.240955+0000","last_undegraded":"2023-10-09T15:32:26.240955+0000","last_fullsized":"2023-10-09T15:32:26.240955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1200128,"data_stored":841584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53100000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.79700000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.88}]},{"osd":5,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.89700000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":251056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7.3419999999999996,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":251146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.221},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.434}]},{"osd":5,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.35599999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298464,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073376,"statfs":{"total":96636764160,"available":96331137024,"internally_reserved":0,"allocated":1204224,"data_stored":842503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.2009999999999996,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.39500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":610304,"data_stored":252592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.372},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.44}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.092000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.164999999999999,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.749}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:32:31.360 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:32:31.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.512+0000 7fc70f1cf700 1 Processor -- start 2023-10-09T15:32:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.512+0000 7fc70f1cf700 1 -- start start 2023-10-09T15:32:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 0x7fc7080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 0x7fc708159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc7080cde50 0x7fc70815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7080d13f0 con 0x7fc7080cde50 2023-10-09T15:32:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70815a940 con 0x7fc7080cd9e0 2023-10-09T15:32:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70f1cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815ae40 con 0x7fc7080cb5a0 2023-10-09T15:32:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70d76c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc7080cde50 0x7fc70815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70d76c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc7080cde50 0x7fc70815a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41182/0 (socket says 172.21.15.33:41182) 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.513+0000 7fc70d76c700 1 -- 172.21.15.33:0/3740620314 learned_addr learned my addr 172.21.15.33:0/3740620314 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70cf6b700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 0x7fc7080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc707fff700 1 --2- 172.21.15.33:0/3740620314 >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 0x7fc708159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 -- 172.21.15.33:0/3740620314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 msgr2=0x7fc7080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 0x7fc7080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 -- 172.21.15.33:0/3740620314 >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 msgr2=0x7fc708159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 --2- 172.21.15.33:0/3740620314 >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 0x7fc708159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 -- 172.21.15.33:0/3740620314 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc70815ab60 con 0x7fc7080cde50 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70cf6b700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 0x7fc7080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc707fff700 1 --2- 172.21.15.33:0/3740620314 >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 0x7fc708159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70d76c700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cde50 0x7fc70815a400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc70806ea90 tx=0x7fc6f8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c8fea27e681cf6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc7077fe700 1 -- 172.21.15.33:0/3740620314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800b820 con 0x7fc7080cde50 2023-10-09T15:32:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc7077fe700 1 -- 172.21.15.33:0/3740620314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f800b980 con 0x7fc7080cde50 2023-10-09T15:32:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc7077fe700 1 -- 172.21.15.33:0/3740620314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f800bd20 con 0x7fc7080cde50 2023-10-09T15:32:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70f1cf700 1 -- 172.21.15.33:0/3740620314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cde50 msgr2=0x7fc70815a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.514+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cde50 0x7fc70815a400 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc70806ea90 tx=0x7fc6f8009250 comp rx=0 tx=0).stop 2023-10-09T15:32:31.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 -- 172.21.15.33:0/3740620314 shutdown_connections 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cde50 0x7fc70815a400 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/3740620314 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080cb5a0 0x7fc7080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/3740620314 >> v2:172.21.15.59:3300/0 conn(0x7fc7080cd9e0 0x7fc708159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 -- 172.21.15.33:0/3740620314 >> 172.21.15.33:0/3740620314 conn(0x7fc708070e30 msgr2=0x7fc7080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 -- 172.21.15.33:0/3740620314 shutdown_connections 2023-10-09T15:32:31.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.515+0000 7fc70f1cf700 1 -- 172.21.15.33:0/3740620314 wait complete. 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.516+0000 7fc70f1cf700 1 Processor -- start 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.516+0000 7fc70f1cf700 1 -- start start 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7080cb5a0 0x7fc7081560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080c7d00 0x7fc708159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc708159ea0 con 0x7fc7080cd9e0 2023-10-09T15:32:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815c1b0 con 0x7fc7080cb5a0 2023-10-09T15:32:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc70815c490 con 0x7fc7080c7d00 2023-10-09T15:32:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41194/0 (socket says 172.21.15.33:41194) 2023-10-09T15:32:31.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 -- 172.21.15.33:0/601336462 learned_addr learned my addr 172.21.15.33:0/601336462 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70cf6b700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7080cb5a0 0x7fc7081560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70d76c700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080c7d00 0x7fc708159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 -- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080c7d00 msgr2=0x7fc708159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080c7d00 0x7fc708159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 -- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7080cb5a0 msgr2=0x7fc7081560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7080cb5a0 0x7fc7081560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 -- 172.21.15.33:0/601336462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f80094f0 con 0x7fc7080cd9e0 2023-10-09T15:32:31.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc707fff700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c830 tx=0x7fc6fc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011600 con 0x7fc7080cd9e0 2023-10-09T15:32:31.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6fc011760 con 0x7fc7080cd9e0 2023-10-09T15:32:31.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc70815c770 con 0x7fc7080cd9e0 2023-10-09T15:32:31.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.517+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6fc011b20 con 0x7fc7080cd9e0 2023-10-09T15:32:31.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.518+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc70815dec0 con 0x7fc7080cd9e0 2023-10-09T15:32:31.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.518+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc70804c3c0 con 0x7fc7080cd9e0 2023-10-09T15:32:31.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.519+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fc6fc018360 con 0x7fc7080cd9e0 2023-10-09T15:32:31.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.519+0000 7fc704ff9700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.519+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc6fc0844c0 con 0x7fc7080cd9e0 2023-10-09T15:32:31.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.519+0000 7fc70cf6b700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.520+0000 7fc70cf6b700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 0x7fc6f40693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc700007fd0 tx=0x7fc7000077c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.524+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc6fc051730 con 0x7fc7080cd9e0 2023-10-09T15:32:31.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.711+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc7080ccf00 con 0x7fc6f4066f30 2023-10-09T15:32:31.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.720+0000 7fc704ff9700 1 -- 172.21.15.33:0/601336462 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289358 (secure 0 0 0) 0x7fc7080ccf00 con 0x7fc6f4066f30 2023-10-09T15:32:31.723 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:31.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 msgr2=0x7fc6f40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 0x7fc6f40693e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fc700007fd0 tx=0x7fc7000077c0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 msgr2=0x7fc7080c77c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fc6fc00c830 tx=0x7fc6fc008040 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 shutdown_connections 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc6f4066f30 0x7fc6f40693e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc7080c7d00 0x7fc708159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc7080cb5a0 0x7fc7081560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 --2- 172.21.15.33:0/601336462 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc7080cd9e0 0x7fc7080c77c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 >> 172.21.15.33:0/601336462 conn(0x7fc708070e30 msgr2=0x7fc7080c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:31.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 shutdown_connections 2023-10-09T15:32:31.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.723+0000 7fc70f1cf700 1 -- 172.21.15.33:0/601336462 wait complete. 2023-10-09T15:32:31.727 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:32:31.736 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-10-09T15:32:31.254995+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":120,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2384196,"kb_used_data":5892,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752590524,"statfs":{"total":773094113280,"available":770652696576,"internally_reserved":0,"allocated":6033408,"data_stored":3192785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":34,"apply_latency_ms":34,"commit_latency_ns":34000000,"apply_latency_ns":34000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.002164"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.265719+0000","last_change":"2023-10-09T15:32:27.251498+0000","last_active":"2023-10-09T15:32:27.265719+0000","last_peered":"2023-10-09T15:32:27.265719+0000","last_clean":"2023-10-09T15:32:27.265719+0000","last_became_active":"2023-10-09T15:32:27.251195+0000","last_became_peered":"2023-10-09T15:32:27.251195+0000","last_unstale":"2023-10-09T15:32:27.265719+0000","last_undegraded":"2023-10-09T15:32:27.265719+0000","last_fullsized":"2023-10-09T15:32:27.265719+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:37.768583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.246829+0000","last_change":"2023-10-09T15:32:27.246829+0000","last_active":"2023-10-09T15:32:27.246829+0000","last_peered":"2023-10-09T15:32:27.246829+0000","last_clean":"2023-10-09T15:32:27.246829+0000","last_became_active":"2023-10-09T15:32:27.246562+0000","last_became_peered":"2023-10-09T15:32:27.246562+0000","last_unstale":"2023-10-09T15:32:27.246829+0000","last_undegraded":"2023-10-09T15:32:27.246829+0000","last_fullsized":"2023-10-09T15:32:27.246829+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:28.915560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.248145+0000","last_change":"2023-10-09T15:32:27.248145+0000","last_active":"2023-10-09T15:32:27.248145+0000","last_peered":"2023-10-09T15:32:27.248145+0000","last_clean":"2023-10-09T15:32:27.248145+0000","last_became_active":"2023-10-09T15:32:27.247875+0000","last_became_peered":"2023-10-09T15:32:27.247875+0000","last_unstale":"2023-10-09T15:32:27.248145+0000","last_undegraded":"2023-10-09T15:32:27.248145+0000","last_fullsized":"2023-10-09T15:32:27.248145+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:07.812009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253703+0000","last_change":"2023-10-09T15:32:27.253703+0000","last_active":"2023-10-09T15:32:27.253703+0000","last_peered":"2023-10-09T15:32:27.253703+0000","last_clean":"2023-10-09T15:32:27.253703+0000","last_became_active":"2023-10-09T15:32:27.253442+0000","last_became_peered":"2023-10-09T15:32:27.253442+0000","last_unstale":"2023-10-09T15:32:27.253703+0000","last_undegraded":"2023-10-09T15:32:27.253703+0000","last_fullsized":"2023-10-09T15:32:27.253703+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254791+0000","last_change":"2023-10-09T15:32:27.251165+0000","last_active":"2023-10-09T15:32:27.254791+0000","last_peered":"2023-10-09T15:32:27.254791+0000","last_clean":"2023-10-09T15:32:27.254791+0000","last_became_active":"2023-10-09T15:32:27.250423+0000","last_became_peered":"2023-10-09T15:32:27.250423+0000","last_unstale":"2023-10-09T15:32:27.254791+0000","last_undegraded":"2023-10-09T15:32:27.254791+0000","last_fullsized":"2023-10-09T15:32:27.254791+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:03:40.492727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255691+0000","last_change":"2023-10-09T15:32:27.255691+0000","last_active":"2023-10-09T15:32:27.255691+0000","last_peered":"2023-10-09T15:32:27.255691+0000","last_clean":"2023-10-09T15:32:27.255691+0000","last_became_active":"2023-10-09T15:32:27.255404+0000","last_became_peered":"2023-10-09T15:32:27.255404+0000","last_unstale":"2023-10-09T15:32:27.255691+0000","last_undegraded":"2023-10-09T15:32:27.255691+0000","last_fullsized":"2023-10-09T15:32:27.255691+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:56:54.342600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255874+0000","last_change":"2023-10-09T15:32:27.253848+0000","last_active":"2023-10-09T15:32:27.255874+0000","last_peered":"2023-10-09T15:32:27.255874+0000","last_clean":"2023-10-09T15:32:27.255874+0000","last_became_active":"2023-10-09T15:32:27.253574+0000","last_became_peered":"2023-10-09T15:32:27.253574+0000","last_unstale":"2023-10-09T15:32:27.255874+0000","last_undegraded":"2023-10-09T15:32:27.255874+0000","last_fullsized":"2023-10-09T15:32:27.255874+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.608321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242940+0000","last_change":"2023-10-09T15:32:27.242940+0000","last_active":"2023-10-09T15:32:27.242940+0000","last_peered":"2023-10-09T15:32:27.242940+0000","last_clean":"2023-10-09T15:32:27.242940+0000","last_became_active":"2023-10-09T15:32:27.242664+0000","last_became_peered":"2023-10-09T15:32:27.242664+0000","last_unstale":"2023-10-09T15:32:27.242940+0000","last_undegraded":"2023-10-09T15:32:27.242940+0000","last_fullsized":"2023-10-09T15:32:27.242940+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:02.373494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252547+0000","last_change":"2023-10-09T15:32:27.248451+0000","last_active":"2023-10-09T15:32:27.252547+0000","last_peered":"2023-10-09T15:32:27.252547+0000","last_clean":"2023-10-09T15:32:27.252547+0000","last_became_active":"2023-10-09T15:32:27.248183+0000","last_became_peered":"2023-10-09T15:32:27.248183+0000","last_unstale":"2023-10-09T15:32:27.252547+0000","last_undegraded":"2023-10-09T15:32:27.252547+0000","last_fullsized":"2023-10-09T15:32:27.252547+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.578838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.244188+0000","last_change":"2023-10-09T15:32:27.244188+0000","last_active":"2023-10-09T15:32:27.244188+0000","last_peered":"2023-10-09T15:32:27.244188+0000","last_clean":"2023-10-09T15:32:27.244188+0000","last_became_active":"2023-10-09T15:32:27.243910+0000","last_became_peered":"2023-10-09T15:32:27.243910+0000","last_unstale":"2023-10-09T15:32:27.244188+0000","last_undegraded":"2023-10-09T15:32:27.244188+0000","last_fullsized":"2023-10-09T15:32:27.244188+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:48:17.578838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.250291+0000","last_change":"2023-10-09T15:32:27.250291+0000","last_active":"2023-10-09T15:32:27.250291+0000","last_peered":"2023-10-09T15:32:27.250291+0000","last_clean":"2023-10-09T15:32:27.250291+0000","last_became_active":"2023-10-09T15:32:27.249961+0000","last_became_peered":"2023-10-09T15:32:27.249961+0000","last_unstale":"2023-10-09T15:32:27.250291+0000","last_undegraded":"2023-10-09T15:32:27.250291+0000","last_fullsized":"2023-10-09T15:32:27.250291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:43.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256645+0000","last_change":"2023-10-09T15:32:27.256645+0000","last_active":"2023-10-09T15:32:27.256645+0000","last_peered":"2023-10-09T15:32:27.256645+0000","last_clean":"2023-10-09T15:32:27.256645+0000","last_became_active":"2023-10-09T15:32:27.256334+0000","last_became_peered":"2023-10-09T15:32:27.256334+0000","last_unstale":"2023-10-09T15:32:27.256645+0000","last_undegraded":"2023-10-09T15:32:27.256645+0000","last_fullsized":"2023-10-09T15:32:27.256645+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:07.812009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255216+0000","last_change":"2023-10-09T15:32:27.253730+0000","last_active":"2023-10-09T15:32:27.255216+0000","last_peered":"2023-10-09T15:32:27.255216+0000","last_clean":"2023-10-09T15:32:27.255216+0000","last_became_active":"2023-10-09T15:32:27.253455+0000","last_became_peered":"2023-10-09T15:32:27.253455+0000","last_unstale":"2023-10-09T15:32:27.255216+0000","last_undegraded":"2023-10-09T15:32:27.255216+0000","last_fullsized":"2023-10-09T15:32:27.255216+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:55.025340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253762+0000","last_change":"2023-10-09T15:32:27.251635+0000","last_active":"2023-10-09T15:32:27.253762+0000","last_peered":"2023-10-09T15:32:27.253762+0000","last_clean":"2023-10-09T15:32:27.253762+0000","last_became_active":"2023-10-09T15:32:27.251334+0000","last_became_peered":"2023-10-09T15:32:27.251334+0000","last_unstale":"2023-10-09T15:32:27.253762+0000","last_undegraded":"2023-10-09T15:32:27.253762+0000","last_fullsized":"2023-10-09T15:32:27.253762+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:30.837035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251360+0000","last_change":"2023-10-09T15:32:27.244566+0000","last_active":"2023-10-09T15:32:27.251360+0000","last_peered":"2023-10-09T15:32:27.251360+0000","last_clean":"2023-10-09T15:32:27.251360+0000","last_became_active":"2023-10-09T15:32:27.244134+0000","last_became_peered":"2023-10-09T15:32:27.244134+0000","last_unstale":"2023-10-09T15:32:27.251360+0000","last_undegraded":"2023-10-09T15:32:27.251360+0000","last_fullsized":"2023-10-09T15:32:27.251360+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:16.022623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255796+0000","last_change":"2023-10-09T15:32:27.255796+0000","last_active":"2023-10-09T15:32:27.255796+0000","last_peered":"2023-10-09T15:32:27.255796+0000","last_clean":"2023-10-09T15:32:27.255796+0000","last_became_active":"2023-10-09T15:32:27.255477+0000","last_became_peered":"2023-10-09T15:32:27.255477+0000","last_unstale":"2023-10-09T15:32:27.255796+0000","last_undegraded":"2023-10-09T15:32:27.255796+0000","last_fullsized":"2023-10-09T15:32:27.255796+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:48.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.243358+0000","last_change":"2023-10-09T15:32:27.243358+0000","last_active":"2023-10-09T15:32:27.243358+0000","last_peered":"2023-10-09T15:32:27.243358+0000","last_clean":"2023-10-09T15:32:27.243358+0000","last_became_active":"2023-10-09T15:32:27.243072+0000","last_became_peered":"2023-10-09T15:32:27.243072+0000","last_unstale":"2023-10-09T15:32:27.243358+0000","last_undegraded":"2023-10-09T15:32:27.243358+0000","last_fullsized":"2023-10-09T15:32:27.243358+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:12.506816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254913+0000","last_change":"2023-10-09T15:32:27.254913+0000","last_active":"2023-10-09T15:32:27.254913+0000","last_peered":"2023-10-09T15:32:27.254913+0000","last_clean":"2023-10-09T15:32:27.254913+0000","last_became_active":"2023-10-09T15:32:27.254712+0000","last_became_peered":"2023-10-09T15:32:27.254712+0000","last_unstale":"2023-10-09T15:32:27.254913+0000","last_undegraded":"2023-10-09T15:32:27.254913+0000","last_fullsized":"2023-10-09T15:32:27.254913+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:03.678186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254944+0000","last_change":"2023-10-09T15:32:27.250988+0000","last_active":"2023-10-09T15:32:27.254944+0000","last_peered":"2023-10-09T15:32:27.254944+0000","last_clean":"2023-10-09T15:32:27.254944+0000","last_became_active":"2023-10-09T15:32:27.250548+0000","last_became_peered":"2023-10-09T15:32:27.250548+0000","last_unstale":"2023-10-09T15:32:27.254944+0000","last_undegraded":"2023-10-09T15:32:27.254944+0000","last_fullsized":"2023-10-09T15:32:27.254944+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:44:24.182186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.249941+0000","last_change":"2023-10-09T15:32:27.249941+0000","last_active":"2023-10-09T15:32:27.249941+0000","last_peered":"2023-10-09T15:32:27.249941+0000","last_clean":"2023-10-09T15:32:27.249941+0000","last_became_active":"2023-10-09T15:32:27.249684+0000","last_became_peered":"2023-10-09T15:32:27.249684+0000","last_unstale":"2023-10-09T15:32:27.249941+0000","last_undegraded":"2023-10-09T15:32:27.249941+0000","last_fullsized":"2023-10-09T15:32:27.249941+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:03.594685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255109+0000","last_change":"2023-10-09T15:32:27.255109+0000","last_active":"2023-10-09T15:32:27.255109+0000","last_peered":"2023-10-09T15:32:27.255109+0000","last_clean":"2023-10-09T15:32:27.255109+0000","last_became_active":"2023-10-09T15:32:27.254395+0000","last_became_peered":"2023-10-09T15:32:27.254395+0000","last_unstale":"2023-10-09T15:32:27.255109+0000","last_undegraded":"2023-10-09T15:32:27.255109+0000","last_fullsized":"2023-10-09T15:32:27.255109+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:18.017508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253456+0000","last_change":"2023-10-09T15:32:27.253456+0000","last_active":"2023-10-09T15:32:27.253456+0000","last_peered":"2023-10-09T15:32:27.253456+0000","last_clean":"2023-10-09T15:32:27.253456+0000","last_became_active":"2023-10-09T15:32:27.253165+0000","last_became_peered":"2023-10-09T15:32:27.253165+0000","last_unstale":"2023-10-09T15:32:27.253456+0000","last_undegraded":"2023-10-09T15:32:27.253456+0000","last_fullsized":"2023-10-09T15:32:27.253456+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:57.737525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252816+0000","last_change":"2023-10-09T15:32:27.252816+0000","last_active":"2023-10-09T15:32:27.252816+0000","last_peered":"2023-10-09T15:32:27.252816+0000","last_clean":"2023-10-09T15:32:27.252816+0000","last_became_active":"2023-10-09T15:32:27.252534+0000","last_became_peered":"2023-10-09T15:32:27.252534+0000","last_unstale":"2023-10-09T15:32:27.252816+0000","last_undegraded":"2023-10-09T15:32:27.252816+0000","last_fullsized":"2023-10-09T15:32:27.252816+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255310+0000","last_change":"2023-10-09T15:32:27.251223+0000","last_active":"2023-10-09T15:32:27.255310+0000","last_peered":"2023-10-09T15:32:27.255310+0000","last_clean":"2023-10-09T15:32:27.255310+0000","last_became_active":"2023-10-09T15:32:27.250939+0000","last_became_peered":"2023-10-09T15:32:27.250939+0000","last_unstale":"2023-10-09T15:32:27.255310+0000","last_undegraded":"2023-10-09T15:32:27.255310+0000","last_fullsized":"2023-10-09T15:32:27.255310+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:18.403967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254817+0000","last_change":"2023-10-09T15:32:27.251255+0000","last_active":"2023-10-09T15:32:27.254817+0000","last_peered":"2023-10-09T15:32:27.254817+0000","last_clean":"2023-10-09T15:32:27.254817+0000","last_became_active":"2023-10-09T15:32:27.250966+0000","last_became_peered":"2023-10-09T15:32:27.250966+0000","last_unstale":"2023-10-09T15:32:27.254817+0000","last_undegraded":"2023-10-09T15:32:27.254817+0000","last_fullsized":"2023-10-09T15:32:27.254817+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:22.644256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.250316+0000","last_change":"2023-10-09T15:32:27.250316+0000","last_active":"2023-10-09T15:32:27.250316+0000","last_peered":"2023-10-09T15:32:27.250316+0000","last_clean":"2023-10-09T15:32:27.250316+0000","last_became_active":"2023-10-09T15:32:27.250028+0000","last_became_peered":"2023-10-09T15:32:27.250028+0000","last_unstale":"2023-10-09T15:32:27.250316+0000","last_undegraded":"2023-10-09T15:32:27.250316+0000","last_fullsized":"2023-10-09T15:32:27.250316+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:48.610416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255774+0000","last_change":"2023-10-09T15:32:27.255774+0000","last_active":"2023-10-09T15:32:27.255774+0000","last_peered":"2023-10-09T15:32:27.255774+0000","last_clean":"2023-10-09T15:32:27.255774+0000","last_became_active":"2023-10-09T15:32:27.255198+0000","last_became_peered":"2023-10-09T15:32:27.255198+0000","last_unstale":"2023-10-09T15:32:27.255774+0000","last_undegraded":"2023-10-09T15:32:27.255774+0000","last_fullsized":"2023-10-09T15:32:27.255774+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.265882+0000","last_change":"2023-10-09T15:32:27.254160+0000","last_active":"2023-10-09T15:32:27.265882+0000","last_peered":"2023-10-09T15:32:27.265882+0000","last_clean":"2023-10-09T15:32:27.265882+0000","last_became_active":"2023-10-09T15:32:27.253905+0000","last_became_peered":"2023-10-09T15:32:27.253905+0000","last_unstale":"2023-10-09T15:32:27.265882+0000","last_undegraded":"2023-10-09T15:32:27.265882+0000","last_fullsized":"2023-10-09T15:32:27.265882+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:00:12.961794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255610+0000","last_change":"2023-10-09T15:32:27.255610+0000","last_active":"2023-10-09T15:32:27.255610+0000","last_peered":"2023-10-09T15:32:27.255610+0000","last_clean":"2023-10-09T15:32:27.255610+0000","last_became_active":"2023-10-09T15:32:27.255303+0000","last_became_peered":"2023-10-09T15:32:27.255303+0000","last_unstale":"2023-10-09T15:32:27.255610+0000","last_undegraded":"2023-10-09T15:32:27.255610+0000","last_fullsized":"2023-10-09T15:32:27.255610+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:05:31.071810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247526+0000","last_change":"2023-10-09T15:32:27.247526+0000","last_active":"2023-10-09T15:32:27.247526+0000","last_peered":"2023-10-09T15:32:27.247526+0000","last_clean":"2023-10-09T15:32:27.247526+0000","last_became_active":"2023-10-09T15:32:27.246011+0000","last_became_peered":"2023-10-09T15:32:27.246011+0000","last_unstale":"2023-10-09T15:32:27.247526+0000","last_undegraded":"2023-10-09T15:32:27.247526+0000","last_fullsized":"2023-10-09T15:32:27.247526+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252093+0000","last_change":"2023-10-09T15:32:27.247508+0000","last_active":"2023-10-09T15:32:27.252093+0000","last_peered":"2023-10-09T15:32:27.252093+0000","last_clean":"2023-10-09T15:32:27.252093+0000","last_became_active":"2023-10-09T15:32:27.247322+0000","last_became_peered":"2023-10-09T15:32:27.247322+0000","last_unstale":"2023-10-09T15:32:27.252093+0000","last_undegraded":"2023-10-09T15:32:27.252093+0000","last_fullsized":"2023-10-09T15:32:27.252093+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:42:14.155030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254911+0000","last_change":"2023-10-09T15:32:27.254911+0000","last_active":"2023-10-09T15:32:27.254911+0000","last_peered":"2023-10-09T15:32:27.254911+0000","last_clean":"2023-10-09T15:32:27.254911+0000","last_became_active":"2023-10-09T15:32:27.254640+0000","last_became_peered":"2023-10-09T15:32:27.254640+0000","last_unstale":"2023-10-09T15:32:27.254911+0000","last_undegraded":"2023-10-09T15:32:27.254911+0000","last_fullsized":"2023-10-09T15:32:27.254911+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:59:32.927546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257908+0000","last_change":"2023-10-09T15:32:27.257908+0000","last_active":"2023-10-09T15:32:27.257908+0000","last_peered":"2023-10-09T15:32:27.257908+0000","last_clean":"2023-10-09T15:32:27.257908+0000","last_became_active":"2023-10-09T15:32:27.257638+0000","last_became_peered":"2023-10-09T15:32:27.257638+0000","last_unstale":"2023-10-09T15:32:27.257908+0000","last_undegraded":"2023-10-09T15:32:27.257908+0000","last_fullsized":"2023-10-09T15:32:27.257908+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"50'4","reported_seq":13,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257790+0000","last_change":"2023-10-09T15:32:26.246783+0000","last_active":"2023-10-09T15:32:27.257790+0000","last_peered":"2023-10-09T15:32:27.257790+0000","last_clean":"2023-10-09T15:32:27.257790+0000","last_became_active":"2023-10-09T15:32:26.246534+0000","last_became_peered":"2023-10-09T15:32:26.246534+0000","last_unstale":"2023-10-09T15:32:27.257790+0000","last_undegraded":"2023-10-09T15:32:27.257790+0000","last_fullsized":"2023-10-09T15:32:27.257790+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:07.833909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256476+0000","last_change":"2023-10-09T15:32:27.256476+0000","last_active":"2023-10-09T15:32:27.256476+0000","last_peered":"2023-10-09T15:32:27.256476+0000","last_clean":"2023-10-09T15:32:27.256476+0000","last_became_active":"2023-10-09T15:32:27.256147+0000","last_became_peered":"2023-10-09T15:32:27.256147+0000","last_unstale":"2023-10-09T15:32:27.256476+0000","last_undegraded":"2023-10-09T15:32:27.256476+0000","last_fullsized":"2023-10-09T15:32:27.256476+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:31:41.608321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231191+0000","last_change":"2023-10-09T15:32:26.246290+0000","last_active":"2023-10-09T15:32:27.231191+0000","last_peered":"2023-10-09T15:32:27.231191+0000","last_clean":"2023-10-09T15:32:27.231191+0000","last_became_active":"2023-10-09T15:32:26.246030+0000","last_became_peered":"2023-10-09T15:32:26.246030+0000","last_unstale":"2023-10-09T15:32:27.231191+0000","last_undegraded":"2023-10-09T15:32:27.231191+0000","last_fullsized":"2023-10-09T15:32:27.231191+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:33.349406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.249197+0000","last_change":"2023-10-09T15:32:27.249197+0000","last_active":"2023-10-09T15:32:27.249197+0000","last_peered":"2023-10-09T15:32:27.249197+0000","last_clean":"2023-10-09T15:32:27.249197+0000","last_became_active":"2023-10-09T15:32:27.248813+0000","last_became_peered":"2023-10-09T15:32:27.248813+0000","last_unstale":"2023-10-09T15:32:27.249197+0000","last_undegraded":"2023-10-09T15:32:27.249197+0000","last_fullsized":"2023-10-09T15:32:27.249197+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:49.661494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.248771+0000","last_change":"2023-10-09T15:32:26.237441+0000","last_active":"2023-10-09T15:32:27.248771+0000","last_peered":"2023-10-09T15:32:27.248771+0000","last_clean":"2023-10-09T15:32:27.248771+0000","last_became_active":"2023-10-09T15:32:26.237098+0000","last_became_peered":"2023-10-09T15:32:26.237098+0000","last_unstale":"2023-10-09T15:32:27.248771+0000","last_undegraded":"2023-10-09T15:32:27.248771+0000","last_fullsized":"2023-10-09T15:32:27.248771+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252902+0000","last_change":"2023-10-09T15:32:27.252902+0000","last_active":"2023-10-09T15:32:27.252902+0000","last_peered":"2023-10-09T15:32:27.252902+0000","last_clean":"2023-10-09T15:32:27.252902+0000","last_became_active":"2023-10-09T15:32:27.252567+0000","last_became_peered":"2023-10-09T15:32:27.252567+0000","last_unstale":"2023-10-09T15:32:27.252902+0000","last_undegraded":"2023-10-09T15:32:27.252902+0000","last_fullsized":"2023-10-09T15:32:27.252902+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:20:53.531180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256239+0000","last_change":"2023-10-09T15:32:26.249406+0000","last_active":"2023-10-09T15:32:27.256239+0000","last_peered":"2023-10-09T15:32:27.256239+0000","last_clean":"2023-10-09T15:32:27.256239+0000","last_became_active":"2023-10-09T15:32:26.249064+0000","last_became_peered":"2023-10-09T15:32:26.249064+0000","last_unstale":"2023-10-09T15:32:27.256239+0000","last_undegraded":"2023-10-09T15:32:27.256239+0000","last_fullsized":"2023-10-09T15:32:27.256239+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:42.640798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253386+0000","last_change":"2023-10-09T15:32:27.253386+0000","last_active":"2023-10-09T15:32:27.253386+0000","last_peered":"2023-10-09T15:32:27.253386+0000","last_clean":"2023-10-09T15:32:27.253386+0000","last_became_active":"2023-10-09T15:32:27.253085+0000","last_became_peered":"2023-10-09T15:32:27.253085+0000","last_unstale":"2023-10-09T15:32:27.253386+0000","last_undegraded":"2023-10-09T15:32:27.253386+0000","last_fullsized":"2023-10-09T15:32:27.253386+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:03.737536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"50'1","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252343+0000","last_change":"2023-10-09T15:32:26.240992+0000","last_active":"2023-10-09T15:32:27.252343+0000","last_peered":"2023-10-09T15:32:27.252343+0000","last_clean":"2023-10-09T15:32:27.252343+0000","last_became_active":"2023-10-09T15:32:26.240730+0000","last_became_peered":"2023-10-09T15:32:26.240730+0000","last_unstale":"2023-10-09T15:32:27.252343+0000","last_undegraded":"2023-10-09T15:32:27.252343+0000","last_fullsized":"2023-10-09T15:32:27.252343+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.398619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253811+0000","last_change":"2023-10-09T15:32:27.253811+0000","last_active":"2023-10-09T15:32:27.253811+0000","last_peered":"2023-10-09T15:32:27.253811+0000","last_clean":"2023-10-09T15:32:27.253811+0000","last_became_active":"2023-10-09T15:32:27.249394+0000","last_became_peered":"2023-10-09T15:32:27.249394+0000","last_unstale":"2023-10-09T15:32:27.253811+0000","last_undegraded":"2023-10-09T15:32:27.253811+0000","last_fullsized":"2023-10-09T15:32:27.253811+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:24.364274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.235853+0000","last_change":"2023-10-09T15:32:26.242618+0000","last_active":"2023-10-09T15:32:27.235853+0000","last_peered":"2023-10-09T15:32:27.235853+0000","last_clean":"2023-10-09T15:32:27.235853+0000","last_became_active":"2023-10-09T15:32:26.242329+0000","last_became_peered":"2023-10-09T15:32:26.242329+0000","last_unstale":"2023-10-09T15:32:27.235853+0000","last_undegraded":"2023-10-09T15:32:27.235853+0000","last_fullsized":"2023-10-09T15:32:27.235853+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:13:16.764829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255291+0000","last_change":"2023-10-09T15:32:27.249621+0000","last_active":"2023-10-09T15:32:27.255291+0000","last_peered":"2023-10-09T15:32:27.255291+0000","last_clean":"2023-10-09T15:32:27.255291+0000","last_became_active":"2023-10-09T15:32:27.249354+0000","last_became_peered":"2023-10-09T15:32:27.249354+0000","last_unstale":"2023-10-09T15:32:27.255291+0000","last_undegraded":"2023-10-09T15:32:27.255291+0000","last_fullsized":"2023-10-09T15:32:27.255291+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:41.287760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251196+0000","last_change":"2023-10-09T15:32:26.246669+0000","last_active":"2023-10-09T15:32:26.251196+0000","last_peered":"2023-10-09T15:32:26.251196+0000","last_clean":"2023-10-09T15:32:26.251196+0000","last_became_active":"2023-10-09T15:32:26.246357+0000","last_became_peered":"2023-10-09T15:32:26.246357+0000","last_unstale":"2023-10-09T15:32:26.251196+0000","last_undegraded":"2023-10-09T15:32:26.251196+0000","last_fullsized":"2023-10-09T15:32:26.251196+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:54.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245237+0000","last_change":"2023-10-09T15:32:27.245237+0000","last_active":"2023-10-09T15:32:27.245237+0000","last_peered":"2023-10-09T15:32:27.245237+0000","last_clean":"2023-10-09T15:32:27.245237+0000","last_became_active":"2023-10-09T15:32:27.244926+0000","last_became_peered":"2023-10-09T15:32:27.244926+0000","last_unstale":"2023-10-09T15:32:27.245237+0000","last_undegraded":"2023-10-09T15:32:27.245237+0000","last_fullsized":"2023-10-09T15:32:27.245237+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:47.323542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232308+0000","last_change":"2023-10-09T15:32:26.247534+0000","last_active":"2023-10-09T15:32:27.232308+0000","last_peered":"2023-10-09T15:32:27.232308+0000","last_clean":"2023-10-09T15:32:27.232308+0000","last_became_active":"2023-10-09T15:32:26.247240+0000","last_became_peered":"2023-10-09T15:32:26.247240+0000","last_unstale":"2023-10-09T15:32:27.232308+0000","last_undegraded":"2023-10-09T15:32:27.232308+0000","last_fullsized":"2023-10-09T15:32:27.232308+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253072+0000","last_change":"2023-10-09T15:32:27.247194+0000","last_active":"2023-10-09T15:32:27.253072+0000","last_peered":"2023-10-09T15:32:27.253072+0000","last_clean":"2023-10-09T15:32:27.253072+0000","last_became_active":"2023-10-09T15:32:27.245107+0000","last_became_peered":"2023-10-09T15:32:27.245107+0000","last_unstale":"2023-10-09T15:32:27.253072+0000","last_undegraded":"2023-10-09T15:32:27.253072+0000","last_fullsized":"2023-10-09T15:32:27.253072+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:12.446889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251093+0000","last_change":"2023-10-09T15:32:26.247981+0000","last_active":"2023-10-09T15:32:26.251093+0000","last_peered":"2023-10-09T15:32:26.251093+0000","last_clean":"2023-10-09T15:32:26.251093+0000","last_became_active":"2023-10-09T15:32:26.247687+0000","last_became_peered":"2023-10-09T15:32:26.247687+0000","last_unstale":"2023-10-09T15:32:26.251093+0000","last_undegraded":"2023-10-09T15:32:26.251093+0000","last_fullsized":"2023-10-09T15:32:26.251093+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:54.705738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259020+0000","last_change":"2023-10-09T15:32:27.259020+0000","last_active":"2023-10-09T15:32:27.259020+0000","last_peered":"2023-10-09T15:32:27.259020+0000","last_clean":"2023-10-09T15:32:27.259020+0000","last_became_active":"2023-10-09T15:32:27.258447+0000","last_became_peered":"2023-10-09T15:32:27.258447+0000","last_unstale":"2023-10-09T15:32:27.259020+0000","last_undegraded":"2023-10-09T15:32:27.259020+0000","last_fullsized":"2023-10-09T15:32:27.259020+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:46.297452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251265+0000","last_change":"2023-10-09T15:32:26.249979+0000","last_active":"2023-10-09T15:32:26.251265+0000","last_peered":"2023-10-09T15:32:26.251265+0000","last_clean":"2023-10-09T15:32:26.251265+0000","last_became_active":"2023-10-09T15:32:26.249683+0000","last_became_peered":"2023-10-09T15:32:26.249683+0000","last_unstale":"2023-10-09T15:32:26.251265+0000","last_undegraded":"2023-10-09T15:32:26.251265+0000","last_fullsized":"2023-10-09T15:32:26.251265+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:06.806661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245675+0000","last_change":"2023-10-09T15:32:27.245675+0000","last_active":"2023-10-09T15:32:27.245675+0000","last_peered":"2023-10-09T15:32:27.245675+0000","last_clean":"2023-10-09T15:32:27.245675+0000","last_became_active":"2023-10-09T15:32:27.242474+0000","last_became_peered":"2023-10-09T15:32:27.242474+0000","last_unstale":"2023-10-09T15:32:27.245675+0000","last_undegraded":"2023-10-09T15:32:27.245675+0000","last_fullsized":"2023-10-09T15:32:27.245675+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:30.837035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"50'3","reported_seq":12,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259498+0000","last_change":"2023-10-09T15:32:26.252248+0000","last_active":"2023-10-09T15:32:27.259498+0000","last_peered":"2023-10-09T15:32:27.259498+0000","last_clean":"2023-10-09T15:32:27.259498+0000","last_became_active":"2023-10-09T15:32:26.252005+0000","last_became_peered":"2023-10-09T15:32:26.252005+0000","last_unstale":"2023-10-09T15:32:27.259498+0000","last_undegraded":"2023-10-09T15:32:27.259498+0000","last_fullsized":"2023-10-09T15:32:27.259498+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:15.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259655+0000","last_change":"2023-10-09T15:32:27.259655+0000","last_active":"2023-10-09T15:32:27.259655+0000","last_peered":"2023-10-09T15:32:27.259655+0000","last_clean":"2023-10-09T15:32:27.259655+0000","last_became_active":"2023-10-09T15:32:27.259093+0000","last_became_peered":"2023-10-09T15:32:27.259093+0000","last_unstale":"2023-10-09T15:32:27.259655+0000","last_undegraded":"2023-10-09T15:32:27.259655+0000","last_fullsized":"2023-10-09T15:32:27.259655+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:30.021691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"50'6","reported_seq":16,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259965+0000","last_change":"2023-10-09T15:32:26.245094+0000","last_active":"2023-10-09T15:32:27.259965+0000","last_peered":"2023-10-09T15:32:27.259965+0000","last_clean":"2023-10-09T15:32:27.259965+0000","last_became_active":"2023-10-09T15:32:26.244825+0000","last_became_peered":"2023-10-09T15:32:26.244825+0000","last_unstale":"2023-10-09T15:32:27.259965+0000","last_undegraded":"2023-10-09T15:32:27.259965+0000","last_fullsized":"2023-10-09T15:32:27.259965+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254597+0000","last_change":"2023-10-09T15:32:27.254597+0000","last_active":"2023-10-09T15:32:27.254597+0000","last_peered":"2023-10-09T15:32:27.254597+0000","last_clean":"2023-10-09T15:32:27.254597+0000","last_became_active":"2023-10-09T15:32:27.254165+0000","last_became_peered":"2023-10-09T15:32:27.254165+0000","last_unstale":"2023-10-09T15:32:27.254597+0000","last_undegraded":"2023-10-09T15:32:27.254597+0000","last_fullsized":"2023-10-09T15:32:27.254597+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:27.584033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254136+0000","last_change":"2023-10-09T15:32:26.247747+0000","last_active":"2023-10-09T15:32:27.254136+0000","last_peered":"2023-10-09T15:32:27.254136+0000","last_clean":"2023-10-09T15:32:27.254136+0000","last_became_active":"2023-10-09T15:32:26.247477+0000","last_became_peered":"2023-10-09T15:32:26.247477+0000","last_unstale":"2023-10-09T15:32:27.254136+0000","last_undegraded":"2023-10-09T15:32:27.254136+0000","last_fullsized":"2023-10-09T15:32:27.254136+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:17.012160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247495+0000","last_change":"2023-10-09T15:32:27.247495+0000","last_active":"2023-10-09T15:32:27.247495+0000","last_peered":"2023-10-09T15:32:27.247495+0000","last_clean":"2023-10-09T15:32:27.247495+0000","last_became_active":"2023-10-09T15:32:27.245461+0000","last_became_peered":"2023-10-09T15:32:27.245461+0000","last_unstale":"2023-10-09T15:32:27.247495+0000","last_undegraded":"2023-10-09T15:32:27.247495+0000","last_fullsized":"2023-10-09T15:32:27.247495+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:38:48.610416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232186+0000","last_change":"2023-10-09T15:32:26.249383+0000","last_active":"2023-10-09T15:32:27.232186+0000","last_peered":"2023-10-09T15:32:27.232186+0000","last_clean":"2023-10-09T15:32:27.232186+0000","last_became_active":"2023-10-09T15:32:26.249138+0000","last_became_peered":"2023-10-09T15:32:26.249138+0000","last_unstale":"2023-10-09T15:32:27.232186+0000","last_undegraded":"2023-10-09T15:32:27.232186+0000","last_fullsized":"2023-10-09T15:32:27.232186+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:27.748252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":9,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252939+0000","last_change":"2023-10-09T15:32:27.249282+0000","last_active":"2023-10-09T15:32:27.252939+0000","last_peered":"2023-10-09T15:32:27.252939+0000","last_clean":"2023-10-09T15:32:27.252939+0000","last_became_active":"2023-10-09T15:32:27.249024+0000","last_became_peered":"2023-10-09T15:32:27.249024+0000","last_unstale":"2023-10-09T15:32:27.252939+0000","last_undegraded":"2023-10-09T15:32:27.252939+0000","last_fullsized":"2023-10-09T15:32:27.252939+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:43.646146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.252473+0000","last_change":"2023-10-09T15:32:26.249433+0000","last_active":"2023-10-09T15:32:26.252473+0000","last_peered":"2023-10-09T15:32:26.252473+0000","last_clean":"2023-10-09T15:32:26.252473+0000","last_became_active":"2023-10-09T15:32:26.249093+0000","last_became_peered":"2023-10-09T15:32:26.249093+0000","last_unstale":"2023-10-09T15:32:26.252473+0000","last_undegraded":"2023-10-09T15:32:26.252473+0000","last_fullsized":"2023-10-09T15:32:26.252473+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:29.831687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252943+0000","last_change":"2023-10-09T15:32:27.252943+0000","last_active":"2023-10-09T15:32:27.252943+0000","last_peered":"2023-10-09T15:32:27.252943+0000","last_clean":"2023-10-09T15:32:27.252943+0000","last_became_active":"2023-10-09T15:32:27.252646+0000","last_became_peered":"2023-10-09T15:32:27.252646+0000","last_unstale":"2023-10-09T15:32:27.252943+0000","last_undegraded":"2023-10-09T15:32:27.252943+0000","last_fullsized":"2023-10-09T15:32:27.252943+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"50'8","reported_seq":17,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.257847+0000","last_change":"2023-10-09T15:32:26.251734+0000","last_active":"2023-10-09T15:32:27.257847+0000","last_peered":"2023-10-09T15:32:27.257847+0000","last_clean":"2023-10-09T15:32:27.257847+0000","last_became_active":"2023-10-09T15:32:26.251448+0000","last_became_peered":"2023-10-09T15:32:26.251448+0000","last_unstale":"2023-10-09T15:32:27.257847+0000","last_undegraded":"2023-10-09T15:32:27.257847+0000","last_fullsized":"2023-10-09T15:32:27.257847+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:15.558970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.247791+0000","last_change":"2023-10-09T15:32:27.247791+0000","last_active":"2023-10-09T15:32:27.247791+0000","last_peered":"2023-10-09T15:32:27.247791+0000","last_clean":"2023-10-09T15:32:27.247791+0000","last_became_active":"2023-10-09T15:32:27.245608+0000","last_became_peered":"2023-10-09T15:32:27.245608+0000","last_unstale":"2023-10-09T15:32:27.247791+0000","last_undegraded":"2023-10-09T15:32:27.247791+0000","last_fullsized":"2023-10-09T15:32:27.247791+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:19.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231342+0000","last_change":"2023-10-09T15:32:26.250327+0000","last_active":"2023-10-09T15:32:27.231342+0000","last_peered":"2023-10-09T15:32:27.231342+0000","last_clean":"2023-10-09T15:32:27.231342+0000","last_became_active":"2023-10-09T15:32:26.249794+0000","last_became_peered":"2023-10-09T15:32:26.249794+0000","last_unstale":"2023-10-09T15:32:27.231342+0000","last_undegraded":"2023-10-09T15:32:27.231342+0000","last_fullsized":"2023-10-09T15:32:27.231342+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:18.762642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254207+0000","last_change":"2023-10-09T15:32:27.254207+0000","last_active":"2023-10-09T15:32:27.254207+0000","last_peered":"2023-10-09T15:32:27.254207+0000","last_clean":"2023-10-09T15:32:27.254207+0000","last_became_active":"2023-10-09T15:32:27.253957+0000","last_became_peered":"2023-10-09T15:32:27.253957+0000","last_unstale":"2023-10-09T15:32:27.254207+0000","last_undegraded":"2023-10-09T15:32:27.254207+0000","last_fullsized":"2023-10-09T15:32:27.254207+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:39.006639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254834+0000","last_change":"2023-10-09T15:32:26.241435+0000","last_active":"2023-10-09T15:32:27.254834+0000","last_peered":"2023-10-09T15:32:27.254834+0000","last_clean":"2023-10-09T15:32:27.254834+0000","last_became_active":"2023-10-09T15:32:26.241183+0000","last_became_peered":"2023-10-09T15:32:26.241183+0000","last_unstale":"2023-10-09T15:32:27.254834+0000","last_undegraded":"2023-10-09T15:32:27.254834+0000","last_fullsized":"2023-10-09T15:32:27.254834+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:37.218806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242625+0000","last_change":"2023-10-09T15:32:27.242625+0000","last_active":"2023-10-09T15:32:27.242625+0000","last_peered":"2023-10-09T15:32:27.242625+0000","last_clean":"2023-10-09T15:32:27.242625+0000","last_became_active":"2023-10-09T15:32:27.242323+0000","last_became_peered":"2023-10-09T15:32:27.242323+0000","last_unstale":"2023-10-09T15:32:27.242625+0000","last_undegraded":"2023-10-09T15:32:27.242625+0000","last_fullsized":"2023-10-09T15:32:27.242625+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:35.347119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"50'1","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.242868+0000","last_change":"2023-10-09T15:32:26.250096+0000","last_active":"2023-10-09T15:32:27.242868+0000","last_peered":"2023-10-09T15:32:27.242868+0000","last_clean":"2023-10-09T15:32:27.242868+0000","last_became_active":"2023-10-09T15:32:26.249780+0000","last_became_peered":"2023-10-09T15:32:26.249780+0000","last_unstale":"2023-10-09T15:32:27.242868+0000","last_undegraded":"2023-10-09T15:32:27.242868+0000","last_fullsized":"2023-10-09T15:32:27.242868+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:11.441541+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.259845+0000","last_change":"2023-10-09T15:32:27.259845+0000","last_active":"2023-10-09T15:32:27.259845+0000","last_peered":"2023-10-09T15:32:27.259845+0000","last_clean":"2023-10-09T15:32:27.259845+0000","last_became_active":"2023-10-09T15:32:27.259582+0000","last_became_peered":"2023-10-09T15:32:27.259582+0000","last_unstale":"2023-10-09T15:32:27.259845+0000","last_undegraded":"2023-10-09T15:32:27.259845+0000","last_fullsized":"2023-10-09T15:32:27.259845+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:34.354754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.245793+0000","last_change":"2023-10-09T15:32:26.243856+0000","last_active":"2023-10-09T15:32:26.245793+0000","last_peered":"2023-10-09T15:32:26.245793+0000","last_clean":"2023-10-09T15:32:26.245793+0000","last_became_active":"2023-10-09T15:32:26.243323+0000","last_became_peered":"2023-10-09T15:32:26.243323+0000","last_unstale":"2023-10-09T15:32:26.245793+0000","last_undegraded":"2023-10-09T15:32:26.245793+0000","last_fullsized":"2023-10-09T15:32:26.245793+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254421+0000","last_change":"2023-10-09T15:32:27.254421+0000","last_active":"2023-10-09T15:32:27.254421+0000","last_peered":"2023-10-09T15:32:27.254421+0000","last_clean":"2023-10-09T15:32:27.254421+0000","last_became_active":"2023-10-09T15:32:27.253833+0000","last_became_peered":"2023-10-09T15:32:27.253833+0000","last_unstale":"2023-10-09T15:32:27.254421+0000","last_undegraded":"2023-10-09T15:32:27.254421+0000","last_fullsized":"2023-10-09T15:32:27.254421+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:48.250068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.244590+0000","last_change":"2023-10-09T15:32:26.247351+0000","last_active":"2023-10-09T15:32:27.244590+0000","last_peered":"2023-10-09T15:32:27.244590+0000","last_clean":"2023-10-09T15:32:27.244590+0000","last_became_active":"2023-10-09T15:32:26.247073+0000","last_became_peered":"2023-10-09T15:32:26.247073+0000","last_unstale":"2023-10-09T15:32:27.244590+0000","last_undegraded":"2023-10-09T15:32:27.244590+0000","last_fullsized":"2023-10-09T15:32:27.244590+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:26.578685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.255942+0000","last_change":"2023-10-09T15:32:27.255942+0000","last_active":"2023-10-09T15:32:27.255942+0000","last_peered":"2023-10-09T15:32:27.255942+0000","last_clean":"2023-10-09T15:32:27.255942+0000","last_became_active":"2023-10-09T15:32:27.255221+0000","last_became_peered":"2023-10-09T15:32:27.255221+0000","last_unstale":"2023-10-09T15:32:27.255942+0000","last_undegraded":"2023-10-09T15:32:27.255942+0000","last_fullsized":"2023-10-09T15:32:27.255942+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.242005+0000","last_change":"2023-10-09T15:32:26.240055+0000","last_active":"2023-10-09T15:32:26.242005+0000","last_peered":"2023-10-09T15:32:26.242005+0000","last_clean":"2023-10-09T15:32:26.242005+0000","last_became_active":"2023-10-09T15:32:26.239784+0000","last_became_peered":"2023-10-09T15:32:26.239784+0000","last_unstale":"2023-10-09T15:32:26.242005+0000","last_undegraded":"2023-10-09T15:32:26.242005+0000","last_fullsized":"2023-10-09T15:32:26.242005+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.398619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256933+0000","last_change":"2023-10-09T15:32:27.256933+0000","last_active":"2023-10-09T15:32:27.256933+0000","last_peered":"2023-10-09T15:32:27.256933+0000","last_clean":"2023-10-09T15:32:27.256933+0000","last_became_active":"2023-10-09T15:32:27.256602+0000","last_became_peered":"2023-10-09T15:32:27.256602+0000","last_unstale":"2023-10-09T15:32:27.256933+0000","last_undegraded":"2023-10-09T15:32:27.256933+0000","last_fullsized":"2023-10-09T15:32:27.256933+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:30.495279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251339+0000","last_change":"2023-10-09T15:32:26.247816+0000","last_active":"2023-10-09T15:32:26.251339+0000","last_peered":"2023-10-09T15:32:26.251339+0000","last_clean":"2023-10-09T15:32:26.251339+0000","last_became_active":"2023-10-09T15:32:26.247542+0000","last_became_peered":"2023-10-09T15:32:26.247542+0000","last_unstale":"2023-10-09T15:32:26.251339+0000","last_undegraded":"2023-10-09T15:32:26.251339+0000","last_fullsized":"2023-10-09T15:32:26.251339+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:15.017275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.253337+0000","last_change":"2023-10-09T15:32:27.253337+0000","last_active":"2023-10-09T15:32:27.253337+0000","last_peered":"2023-10-09T15:32:27.253337+0000","last_clean":"2023-10-09T15:32:27.253337+0000","last_became_active":"2023-10-09T15:32:27.253025+0000","last_became_peered":"2023-10-09T15:32:27.253025+0000","last_unstale":"2023-10-09T15:32:27.253337+0000","last_undegraded":"2023-10-09T15:32:27.253337+0000","last_fullsized":"2023-10-09T15:32:27.253337+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"50'2","reported_seq":11,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.254109+0000","last_change":"2023-10-09T15:32:26.247329+0000","last_active":"2023-10-09T15:32:27.254109+0000","last_peered":"2023-10-09T15:32:27.254109+0000","last_clean":"2023-10-09T15:32:27.254109+0000","last_became_active":"2023-10-09T15:32:26.247042+0000","last_became_peered":"2023-10-09T15:32:26.247042+0000","last_unstale":"2023-10-09T15:32:27.254109+0000","last_undegraded":"2023-10-09T15:32:27.254109+0000","last_fullsized":"2023-10-09T15:32:27.254109+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:39.801406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.256653+0000","last_change":"2023-10-09T15:32:27.256653+0000","last_active":"2023-10-09T15:32:27.256653+0000","last_peered":"2023-10-09T15:32:27.256653+0000","last_clean":"2023-10-09T15:32:27.256653+0000","last_became_active":"2023-10-09T15:32:27.256266+0000","last_became_peered":"2023-10-09T15:32:27.256266+0000","last_unstale":"2023-10-09T15:32:27.256653+0000","last_undegraded":"2023-10-09T15:32:27.256653+0000","last_fullsized":"2023-10-09T15:32:27.256653+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:19.767989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.245768+0000","last_change":"2023-10-09T15:32:26.243993+0000","last_active":"2023-10-09T15:32:26.245768+0000","last_peered":"2023-10-09T15:32:26.245768+0000","last_clean":"2023-10-09T15:32:26.245768+0000","last_became_active":"2023-10-09T15:32:26.242544+0000","last_became_peered":"2023-10-09T15:32:26.242544+0000","last_unstale":"2023-10-09T15:32:26.245768+0000","last_undegraded":"2023-10-09T15:32:26.245768+0000","last_fullsized":"2023-10-09T15:32:26.245768+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:26.601551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.245812+0000","last_change":"2023-10-09T15:32:27.245812+0000","last_active":"2023-10-09T15:32:27.245812+0000","last_peered":"2023-10-09T15:32:27.245812+0000","last_clean":"2023-10-09T15:32:27.245812+0000","last_became_active":"2023-10-09T15:32:27.242031+0000","last_became_peered":"2023-10-09T15:32:27.242031+0000","last_unstale":"2023-10-09T15:32:27.245812+0000","last_undegraded":"2023-10-09T15:32:27.245812+0000","last_fullsized":"2023-10-09T15:32:27.245812+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:09:55.711086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.232272+0000","last_change":"2023-10-09T15:32:26.245577+0000","last_active":"2023-10-09T15:32:27.232272+0000","last_peered":"2023-10-09T15:32:27.232272+0000","last_clean":"2023-10-09T15:32:27.232272+0000","last_became_active":"2023-10-09T15:32:26.245228+0000","last_became_peered":"2023-10-09T15:32:26.245228+0000","last_unstale":"2023-10-09T15:32:27.232272+0000","last_undegraded":"2023-10-09T15:32:27.232272+0000","last_fullsized":"2023-10-09T15:32:27.232272+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:24.556359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252829+0000","last_change":"2023-10-09T15:32:27.252829+0000","last_active":"2023-10-09T15:32:27.252829+0000","last_peered":"2023-10-09T15:32:27.252829+0000","last_clean":"2023-10-09T15:32:27.252829+0000","last_became_active":"2023-10-09T15:32:27.252547+0000","last_became_peered":"2023-10-09T15:32:27.252547+0000","last_unstale":"2023-10-09T15:32:27.252829+0000","last_undegraded":"2023-10-09T15:32:27.252829+0000","last_fullsized":"2023-10-09T15:32:27.252829+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:29:33.585830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251209+0000","last_change":"2023-10-09T15:32:26.246747+0000","last_active":"2023-10-09T15:32:26.251209+0000","last_peered":"2023-10-09T15:32:26.251209+0000","last_clean":"2023-10-09T15:32:26.251209+0000","last_became_active":"2023-10-09T15:32:26.246329+0000","last_became_peered":"2023-10-09T15:32:26.246329+0000","last_unstale":"2023-10-09T15:32:26.251209+0000","last_undegraded":"2023-10-09T15:32:26.251209+0000","last_fullsized":"2023-10-09T15:32:26.251209+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:49:15.558970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.246917+0000","last_change":"2023-10-09T15:32:27.246917+0000","last_active":"2023-10-09T15:32:27.246917+0000","last_peered":"2023-10-09T15:32:27.246917+0000","last_clean":"2023-10-09T15:32:27.246917+0000","last_became_active":"2023-10-09T15:32:27.246641+0000","last_became_peered":"2023-10-09T15:32:27.246641+0000","last_unstale":"2023-10-09T15:32:27.246917+0000","last_undegraded":"2023-10-09T15:32:27.246917+0000","last_fullsized":"2023-10-09T15:32:27.246917+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:45.195626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251450+0000","last_change":"2023-10-09T15:32:26.247343+0000","last_active":"2023-10-09T15:32:26.251450+0000","last_peered":"2023-10-09T15:32:26.251450+0000","last_clean":"2023-10-09T15:32:26.251450+0000","last_became_active":"2023-10-09T15:32:26.247013+0000","last_became_peered":"2023-10-09T15:32:26.247013+0000","last_unstale":"2023-10-09T15:32:26.251450+0000","last_undegraded":"2023-10-09T15:32:26.251450+0000","last_fullsized":"2023-10-09T15:32:26.251450+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:26:40.282412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.252729+0000","last_change":"2023-10-09T15:32:27.252729+0000","last_active":"2023-10-09T15:32:27.252729+0000","last_peered":"2023-10-09T15:32:27.252729+0000","last_clean":"2023-10-09T15:32:27.252729+0000","last_became_active":"2023-10-09T15:32:27.252425+0000","last_became_peered":"2023-10-09T15:32:27.252425+0000","last_unstale":"2023-10-09T15:32:27.252729+0000","last_undegraded":"2023-10-09T15:32:27.252729+0000","last_fullsized":"2023-10-09T15:32:27.252729+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:22:56.876210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.233882+0000","last_change":"2023-10-09T15:32:26.244639+0000","last_active":"2023-10-09T15:32:27.233882+0000","last_peered":"2023-10-09T15:32:27.233882+0000","last_clean":"2023-10-09T15:32:27.233882+0000","last_became_active":"2023-10-09T15:32:26.244336+0000","last_became_peered":"2023-10-09T15:32:26.244336+0000","last_unstale":"2023-10-09T15:32:27.233882+0000","last_undegraded":"2023-10-09T15:32:27.233882+0000","last_fullsized":"2023-10-09T15:32:27.233882+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:35.420161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251536+0000","last_change":"2023-10-09T15:32:27.251536+0000","last_active":"2023-10-09T15:32:27.251536+0000","last_peered":"2023-10-09T15:32:27.251536+0000","last_clean":"2023-10-09T15:32:27.251536+0000","last_became_active":"2023-10-09T15:32:27.251287+0000","last_became_peered":"2023-10-09T15:32:27.251287+0000","last_unstale":"2023-10-09T15:32:27.251536+0000","last_undegraded":"2023-10-09T15:32:27.251536+0000","last_fullsized":"2023-10-09T15:32:27.251536+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:12.446889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.251502+0000","last_change":"2023-10-09T15:32:26.248000+0000","last_active":"2023-10-09T15:32:26.251502+0000","last_peered":"2023-10-09T15:32:26.251502+0000","last_clean":"2023-10-09T15:32:26.251502+0000","last_became_active":"2023-10-09T15:32:26.247698+0000","last_became_peered":"2023-10-09T15:32:26.247698+0000","last_unstale":"2023-10-09T15:32:26.251502+0000","last_undegraded":"2023-10-09T15:32:26.251502+0000","last_fullsized":"2023-10-09T15:32:26.251502+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:35.420161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.241555+0000","last_change":"2023-10-09T15:32:27.241555+0000","last_active":"2023-10-09T15:32:27.241555+0000","last_peered":"2023-10-09T15:32:27.241555+0000","last_clean":"2023-10-09T15:32:27.241555+0000","last_became_active":"2023-10-09T15:32:27.240098+0000","last_became_peered":"2023-10-09T15:32:27.240098+0000","last_unstale":"2023-10-09T15:32:27.241555+0000","last_undegraded":"2023-10-09T15:32:27.241555+0000","last_fullsized":"2023-10-09T15:32:27.241555+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:06:34.536894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":9,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.248478+0000","last_change":"2023-10-09T15:32:26.245581+0000","last_active":"2023-10-09T15:32:26.248478+0000","last_peered":"2023-10-09T15:32:26.248478+0000","last_clean":"2023-10-09T15:32:26.248478+0000","last_became_active":"2023-10-09T15:32:26.245313+0000","last_became_peered":"2023-10-09T15:32:26.245313+0000","last_unstale":"2023-10-09T15:32:26.248478+0000","last_undegraded":"2023-10-09T15:32:26.248478+0000","last_fullsized":"2023-10-09T15:32:26.248478+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:02.672838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":8,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.251313+0000","last_change":"2023-10-09T15:32:27.251313+0000","last_active":"2023-10-09T15:32:27.251313+0000","last_peered":"2023-10-09T15:32:27.251313+0000","last_clean":"2023-10-09T15:32:27.251313+0000","last_became_active":"2023-10-09T15:32:27.250989+0000","last_became_peered":"2023-10-09T15:32:27.250989+0000","last_unstale":"2023-10-09T15:32:27.251313+0000","last_undegraded":"2023-10-09T15:32:27.251313+0000","last_fullsized":"2023-10-09T15:32:27.251313+0000","mapping_epoch":49,"log_start":"0'0","ondisk_log_start":"0'0","created":49,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:26.219990+0000","last_clean_scrub_stamp":"2023-10-09T15:32:26.219990+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:42:31.717295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":50,"state":"active+clean","last_fresh":"2023-10-09T15:32:27.231234+0000","last_change":"2023-10-09T15:32:26.243361+0000","last_active":"2023-10-09T15:32:27.231234+0000","last_peered":"2023-10-09T15:32:27.231234+0000","last_clean":"2023-10-09T15:32:27.231234+0000","last_became_active":"2023-10-09T15:32:26.243062+0000","last_became_peered":"2023-10-09T15:32:26.243062+0000","last_unstale":"2023-10-09T15:32:27.231234+0000","last_undegraded":"2023-10-09T15:32:27.231234+0000","last_fullsized":"2023-10-09T15:32:27.231234+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":48,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:25.214642+0000","last_clean_scrub_stamp":"2023-10-09T15:32:25.214642+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:19.933530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":49,"state":"active+clean","last_fresh":"2023-10-09T15:32:26.240955+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:26.240955+0000","last_peered":"2023-10-09T15:32:26.240955+0000","last_clean":"2023-10-09T15:32:26.240955+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:26.240955+0000","last_undegraded":"2023-10-09T15:32:26.240955+0000","last_fullsized":"2023-10-09T15:32:26.240955+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298460,"kb_used_data":1172,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073380,"statfs":{"total":96636764160,"available":96331141120,"internally_reserved":0,"allocated":1200128,"data_stored":841584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.496,"15min":0.496},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.53100000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.79200000000000004,"5min":0.79200000000000004,"15min":0.79200000000000004},"last":0.69699999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.71499999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.83999999999999997},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.79700000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.88}]},{"osd":5,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.85999999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.89700000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.93000000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297872,"kb_used_data":584,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073968,"statfs":{"total":96636764160,"available":96331743232,"internally_reserved":0,"allocated":598016,"data_stored":251056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.439}]},{"osd":1,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.379,"5min":1.379,"15min":1.379},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":1.3999999999999999,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":7.3419999999999996,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.58299999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.4399999999999999,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.59499999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"min":{"1min":0.47799999999999998,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.88500000000000001,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.60899999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297876,"kb_used_data":588,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073964,"statfs":{"total":96636764160,"available":96331739136,"internally_reserved":0,"allocated":602112,"data_stored":251146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":1.512,"5min":1.512,"15min":1.512},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":1.286,"5min":1.286,"15min":1.286},"last":0.221},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.30199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.46000000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.623,"15min":0.623},"min":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.434}]},{"osd":5,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.4410000000000001,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.1850000000000001,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.35599999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.878,"5min":0.878,"15min":0.878},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":5.5010000000000003,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"min":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":1.258,"5min":1.258,"15min":1.258},"last":0.41599999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.88600000000000001},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":5.5819999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.63200000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298464,"kb_used_data":1176,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073376,"statfs":{"total":96636764160,"available":96331137024,"internally_reserved":0,"allocated":1204224,"data_stored":842503,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":1.2869999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.432,"5min":0.432,"15min":0.432},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.40400000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":4.2009999999999996,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.48299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":4.5190000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":4.5890000000000004,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.35499999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.196,"5min":1.196,"15min":1.196},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.69599999999999995,"15min":0.69599999999999995},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.508,"5min":1.508,"15min":1.508},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.0509999999999999,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.64800000000000002,"15min":0.64800000000000002},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":0.92300000000000004,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.39500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":0.95899999999999996,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"min":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":1.238,"5min":1.238,"15min":1.238},"last":0.503}]},{"osd":7,"last update":"Mon Oct 9 15:31:56 2023","interfaces":[{"interface":"back","average":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"min":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"max":{"1min":0.94699999999999995,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.51400000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.24099999999999999,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.34300000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.29699999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.436,"5min":0.436,"15min":0.436},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.36099999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.44,"5min":0.44,"15min":0.44},"max":{"1min":0.93899999999999995,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.56000000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.5189999999999999,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:31:55 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.407,"5min":1.407,"15min":1.407},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"min":{"1min":0.49199999999999999,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.55100000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574869,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.40400000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.53700000000000003},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.64400000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.42199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.68500000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.61199999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.629}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297884,"kb_used_data":596,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073956,"statfs":{"total":96636764160,"available":96331730944,"internally_reserved":0,"allocated":610304,"data_stored":252592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.372},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.46300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":2.879,"5min":2.879,"15min":2.879},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.78100000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.499},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.38900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.60799999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.42599999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.90300000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.48199999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.68899999999999995,"15min":0.68899999999999995},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.58299999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55800000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297880,"kb_used_data":592,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073960,"statfs":{"total":96636764160,"available":96331735040,"internally_reserved":0,"allocated":606208,"data_stored":251680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.87,"5min":0.87,"15min":0.87},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.79300000000000004},"last":0.52300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.44}]},{"osd":2,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.046,"5min":1.046,"15min":1.046},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":11.055,"5min":11.055,"15min":11.055},"last":0.46400000000000002},{"interface":"front","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":11.092000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":1.0700000000000001,"5min":1.0700000000000001,"15min":1.0700000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":11.164999999999999,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.628},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.61199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.67900000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.749}]},{"osd":7,"last update":"Mon Oct 9 15:31:53 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.622,"15min":0.622},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.65700000000000003,"15min":0.65700000000000003},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.006,"5min":1.006,"15min":1.006},"last":0.73199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:32:31.742 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:32:31.742 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:32:31.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.902+0000 7f3b53937700 1 Processor -- start 2023-10-09T15:32:31.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.902+0000 7f3b53937700 1 -- start start 2023-10-09T15:32:31.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b53937700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b4c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b53937700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b4c06e0e0 0x7f3b4c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b53937700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4c0ccfd0 con 0x7f3b4c159530 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b53937700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4c15a3d0 con 0x7f3b4c06e0e0 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b53937700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15a6b0 con 0x7f3b4c06dc70 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b516d3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b4c159530 0x7f3b4c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36436/0 (socket says 172.21.15.33:36436) 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b516d3700 1 -- 172.21.15.33:0/209987601 learned_addr learned my addr 172.21.15.33:0/209987601 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/209987601 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c06e0e0 0x7f3b4c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.903+0000 7f3b50ed2700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b4c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1871362642 0 0) 0x7f3b4c0ccfd0 con 0x7f3b4c159530 2023-10-09T15:32:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b34003570 con 0x7f3b4c159530 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3043491940 0 0) 0x7f3b34003570 con 0x7f3b4c159530 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 msgr2=0x7f3b4c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b4c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c06e0e0 msgr2=0x7f3b4c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 --2- 172.21.15.33:0/209987601 >> v2:172.21.15.59:3300/0 conn(0x7f3b4c06e0e0 0x7f3b4c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c15a990 con 0x7f3b4c159530 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3b440017f0 con 0x7f3b4c159530 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 >> v1:172.21.15.33:6789/0 conn(0x7f3b4c159530 legacy=0x7f3b4c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b34003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b34003fe0 0x7f3b34004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b340051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15a3d0 con 0x7f3b34004d50 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15a6b0 con 0x7f3b34003fe0 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b3400ba90 con 0x7f3b4c06dc70 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b340051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b516d3700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b34003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b50ed2700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b34003fe0 0x7f3b34004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 -- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 msgr2=0x7f3b34003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c06dc70 0x7f3b34003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 -- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b34003fe0 msgr2=0x7f3b34004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b34003fe0 0x7f3b34004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.904+0000 7f3b51ed4700 1 -- 172.21.15.33:0/209987601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b34003570 con 0x7f3b34004d50 2023-10-09T15:32:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b340051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0cacd0 tx=0x7f3b3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bd816a2200d1748 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00e6b0 con 0x7f3b34004d50 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b3c00e810 con 0x7f3b34004d50 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b4bfff700 1 -- 172.21.15.33:0/209987601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b3c00ebd0 con 0x7f3b34004d50 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 -- 172.21.15.33:0/209987601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 msgr2=0x7f3b340051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 --2- 172.21.15.33:0/209987601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b340051c0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f3b4c0cacd0 tx=0x7f3b3c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b51ed4700 1 -- 172.21.15.33:0/209987601 reap_dead start 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 -- 172.21.15.33:0/209987601 shutdown_connections 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 -- 172.21.15.33:0/209987601 >> 172.21.15.33:0/209987601 conn(0x7f3b4c0703a0 msgr2=0x7f3b4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 -- 172.21.15.33:0/209987601 shutdown_connections 2023-10-09T15:32:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.905+0000 7f3b53937700 1 -- 172.21.15.33:0/209987601 wait complete. 2023-10-09T15:32:31.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.906+0000 7f3b53937700 1 Processor -- start 2023-10-09T15:32:31.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.906+0000 7f3b53937700 1 -- start start 2023-10-09T15:32:31.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c0d0160 0x7f3b4c0d05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c15d9e0 0x7f3b4c15de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c0d0b10 con 0x7f3b34004d50 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15ed20 con 0x7f3b4c15d9e0 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b53937700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4c15e760 con 0x7f3b4c0d0160 2023-10-09T15:32:31.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b516d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b516d3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41208/0 (socket says 172.21.15.33:41208) 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.907+0000 7f3b516d3700 1 -- 172.21.15.33:0/2468757465 learned_addr learned my addr 172.21.15.33:0/2468757465 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b51ed4700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c15d9e0 0x7f3b4c15de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b50ed2700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c0d0160 0x7f3b4c0d05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 -- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c0d0160 msgr2=0x7f3b4c0d05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c0d0160 0x7f3b4c0d05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 -- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c15d9e0 msgr2=0x7f3b4c15de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c15d9e0 0x7f3b4c15de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 -- 172.21.15.33:0/2468757465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4c15ea40 con 0x7f3b34004d50 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b516d3700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b44001920 tx=0x7f3b4c0ccf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4400acd0 con 0x7f3b34004d50 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4400ae50 con 0x7f3b34004d50 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b4c0c8bf0 con 0x7f3b34004d50 2023-10-09T15:32:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b44013640 con 0x7f3b34004d50 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.908+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b4c147580 con 0x7f3b34004d50 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.909+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b4c0c9110 con 0x7f3b34004d50 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.910+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b440139f0 con 0x7f3b34004d50 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.910+0000 7f3b497fa700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 0x7f3b380693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.910+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b440852d0 con 0x7f3b34004d50 2023-10-09T15:32:31.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.910+0000 7f3b50ed2700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 0x7f3b380693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.910+0000 7f3b50ed2700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 0x7f3b380693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006f00 tx=0x7f3b400091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:31.914+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b4c0c9110 con 0x7f3b34004d50 2023-10-09T15:32:32.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.188+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3b4c0c9110 con 0x7f3b34004d50 2023-10-09T15:32:32.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.192+0000 7f3b497fa700 1 -- 172.21.15.33:0/2468757465 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3b4c0c9110 con 0x7f3b34004d50 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 msgr2=0x7f3b380693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 0x7f3b380693e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f3b40006f00 tx=0x7f3b400091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 msgr2=0x7f3b4c147040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3b44001920 tx=0x7f3b4c0ccf40 comp rx=0 tx=0).stop 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 shutdown_connections 2023-10-09T15:32:32.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b38066f30 0x7f3b380693e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b34004d50 0x7f3b4c147040 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b4c15d9e0 0x7f3b4c15de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 --2- 172.21.15.33:0/2468757465 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b4c0d0160 0x7f3b4c0d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 >> 172.21.15.33:0/2468757465 conn(0x7f3b4c0703a0 msgr2=0x7f3b4c158510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 shutdown_connections 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.194+0000 7f3b53937700 1 -- 172.21.15.33:0/2468757465 wait complete. 2023-10-09T15:32:32.196 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:32:32.207 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.325+0000 7fcbcab1d700 1 Processor -- start 2023-10-09T15:32:32.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.325+0000 7fcbcab1d700 1 -- start start 2023-10-09T15:32:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbcab1d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbc4153c30 0x7fcbc415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbcab1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 0x7fcbc40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbcab1d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc415afd0 con 0x7fcbc40cef40 2023-10-09T15:32:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbcab1d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc415b2b0 con 0x7fcbc4153c30 2023-10-09T15:32:32.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbcab1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc415b590 con 0x7fcbc415de50 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbc931a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 0x7fcbc40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbc9b1b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcbc4153c30 0x7fcbc415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbca31c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcbc40cef40 0x7fcbc406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:54168/0 (socket says 172.21.15.33:54168) 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.326+0000 7fcbca31c700 1 -- 172.21.15.33:0/1021027188 learned_addr learned my addr 172.21.15.33:0/1021027188 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc9b1b700 1 -- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 msgr2=0x7fcbc40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 0x7fcbc40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc9b1b700 1 -- 172.21.15.33:0/1021027188 >> v1:172.21.15.59:6789/0 conn(0x7fcbc40cef40 legacy=0x7fcbc406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc9b1b700 1 -- 172.21.15.33:0/1021027188 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc415b870 con 0x7fcbc4153c30 2023-10-09T15:32:32.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc931a700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 0x7fcbc40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc4153c30 0x7fcbc415a5e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40098e0 tx=0x7fcbb40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=809f4f1eb38bc9cb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc8b19700 1 -- 172.21.15.33:0/1021027188 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400b640 con 0x7fcbc4153c30 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc8b19700 1 -- 172.21.15.33:0/1021027188 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb400b7a0 con 0x7fcbc4153c30 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.327+0000 7fcbc8b19700 1 -- 172.21.15.33:0/1021027188 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb400bb40 con 0x7fcbc4153c30 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 -- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc4153c30 msgr2=0x7fcbc415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc4153c30 0x7fcbc415a5e0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40098e0 tx=0x7fcbb40091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 -- 172.21.15.33:0/1021027188 shutdown_connections 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc4153c30 0x7fcbc415a5e0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/1021027188 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc415de50 0x7fcbc40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 -- 172.21.15.33:0/1021027188 >> 172.21.15.33:0/1021027188 conn(0x7fcbc40703a0 msgr2=0x7fcbc40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 -- 172.21.15.33:0/1021027188 shutdown_connections 2023-10-09T15:32:32.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.328+0000 7fcbcab1d700 1 -- 172.21.15.33:0/1021027188 wait complete. 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.329+0000 7fcbcab1d700 1 Processor -- start 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.329+0000 7fcbcab1d700 1 -- start start 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.329+0000 7fcbcab1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 0x7fcbc4149050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.329+0000 7fcbcab1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.329+0000 7fcbcab1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc415de50 0x7fcbc40c8b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbcab1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40cc560 con 0x7fcbc4153c30 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbcab1d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40cd350 con 0x7fcbc415de50 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbcab1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc40cc740 con 0x7fcbc40cef40 2023-10-09T15:32:32.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41216/0 (socket says 172.21.15.33:41216) 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 -- 172.21.15.33:0/2200202081 learned_addr learned my addr 172.21.15.33:0/2200202081 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 0x7fcbc4149050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbca31c700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc415de50 0x7fcbc40c8b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 -- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 msgr2=0x7fcbc4149050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 0x7fcbc4149050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 -- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc415de50 msgr2=0x7fcbc40c8b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc415de50 0x7fcbc40c8b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 -- 172.21.15.33:0/2200202081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb8009420 con 0x7fcbc4153c30 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 0x7fcbc4149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc931a700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800ec80 tx=0x7fcbb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800c9d0 con 0x7fcbc4153c30 2023-10-09T15:32:32.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbb800cb30 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbb800ceb0 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.330+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb4009420 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.331+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc40ccd00 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.331+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc404c3c0 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.332+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcbb8013680 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.332+0000 7fcbc1ffb700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.332+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcbb8084a00 con 0x7fcbc4153c30 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.332+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:32.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.333+0000 7fcbc9b1b700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 0x7fcbb00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40093f0 tx=0x7fcbb4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:32.337 INFO:tasks.ceph.mds.b.smithi059.stderr:2023-10-09T15:32:32.333+0000 7f5e0840b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:32:32.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.337+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcbb8051c70 con 0x7fcbc4153c30 2023-10-09T15:32:32.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.574+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcbc40cd490 con 0x7fcbc4153c30 2023-10-09T15:32:32.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.574+0000 7fcbc1ffb700 1 -- 172.21.15.33:0/2200202081 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 30 v30) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fcbb8017090 con 0x7fcbc4153c30 2023-10-09T15:32:32.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:32.575 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":30,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.576+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 msgr2=0x7fcbb00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.576+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 0x7fcbb00693e0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fcbb40093f0 tx=0x7fcbb4017000 comp rx=0 tx=0).stop 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.576+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 msgr2=0x7fcbc40c8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.576+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcbb800ec80 tx=0x7fcbb80091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 shutdown_connections 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcbb0066f30 0x7fcbb00693e0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcbc415de50 0x7fcbc40c8b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcbc40cef40 0x7fcbc4149050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 --2- 172.21.15.33:0/2200202081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcbc4153c30 0x7fcbc40c8650 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 >> 172.21.15.33:0/2200202081 conn(0x7fcbc40703a0 msgr2=0x7fcbc40b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 shutdown_connections 2023-10-09T15:32:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:32.577+0000 7fcbcab1d700 1 -- 172.21.15.33:0/2200202081 wait complete. 2023-10-09T15:32:32.579 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 30 2023-10-09T15:32:32.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 30, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:32:26.642767+0000', 'modified': '2023-10-09T15:32:30.256774+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5376}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5376': {'gid': 5376, 'name': 'b', 'rank': 0, 'incarnation': 26, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/2234768428', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2234768428}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2234768428}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:32:32.992 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:32:32.992 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T15:32:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.115+0000 7f3b4f372700 1 Processor -- start 2023-10-09T15:32:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 -- start start 2023-10-09T15:32:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b480b07d0 0x7f3b480ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b480c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b4815a280 con 0x7f3b480cf200 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b4806e180 con 0x7f3b480b07d0 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.116+0000 7f3b4f372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b4806d850 con 0x7f3b480b0ba0 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4c90d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b480cf200 0x7f3b4806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36446/0 (socket says 172.21.15.33:36446) 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4c90d700 1 -- 172.21.15.33:0/4254348394 learned_addr learned my addr 172.21.15.33:0/4254348394 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/4254348394 >> v2:172.21.15.59:3300/0 conn(0x7f3b480b07d0 0x7f3b480ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b480c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505174290 0 0) 0x7f3b4815a280 con 0x7f3b480cf200 2023-10-09T15:32:33.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b34003570 con 0x7f3b480cf200 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 -- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 msgr2=0x7f3b480c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b480c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 -- 172.21.15.33:0/4254348394 >> v1:172.21.15.33:6789/0 conn(0x7f3b480cf200 legacy=0x7f3b4806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2827660935 0 0) 0x7f3b34003570 con 0x7f3b480cf200 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 -- 172.21.15.33:0/4254348394 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b4806db30 con 0x7f3b480b07d0 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480b07d0 0x7f3b480ccac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b440098d0 tx=0x7f3b44009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d827e80f674c7131 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.117+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38001470 con 0x7f3b480b07d0 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b44011420 con 0x7f3b480b07d0 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b3ffff700 1 -- 172.21.15.33:0/4254348394 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b440117c0 con 0x7f3b480b07d0 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 -- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480b07d0 msgr2=0x7f3b480ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480b07d0 0x7f3b480ccac0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f3b440098d0 tx=0x7f3b44009120 comp rx=0 tx=0).stop 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 -- 172.21.15.33:0/4254348394 shutdown_connections 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b480c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 --2- 172.21.15.33:0/4254348394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480b07d0 0x7f3b480ccac0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 -- 172.21.15.33:0/4254348394 >> 172.21.15.33:0/4254348394 conn(0x7f3b4806ce80 msgr2=0x7f3b480ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 -- 172.21.15.33:0/4254348394 shutdown_connections 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.118+0000 7f3b4f372700 1 -- 172.21.15.33:0/4254348394 wait complete. 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.119+0000 7f3b4f372700 1 Processor -- start 2023-10-09T15:32:33.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.119+0000 7f3b4f372700 1 -- start start 2023-10-09T15:32:33.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b481554b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480cf200 0x7f3b4816dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48069820 con 0x7f3b480b07d0 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48068f80 con 0x7f3b480cf200 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4f372700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b48069260 con 0x7f3b480b0ba0 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41232/0 (socket says 172.21.15.33:41232) 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1383435449 learned_addr learned my addr 172.21.15.33:0/1383435449 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480cf200 0x7f3b4816dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.120+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b481554b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 msgr2=0x7f3b481554b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b481554b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480cf200 msgr2=0x7f3b4816dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480cf200 0x7f3b4816dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1383435449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b440093c0 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b440030c0 tx=0x7f3b44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b3d7fa700 1 -- 172.21.15.33:0/1383435449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4401cb30 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b3d7fa700 1 -- 172.21.15.33:0/1383435449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4401cc90 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b48069540 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b3d7fa700 1 -- 172.21.15.33:0/1383435449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4401a6a0 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.121+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b48159220 con 0x7f3b480b07d0 2023-10-09T15:32:33.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.123+0000 7f3b3d7fa700 1 -- 172.21.15.33:0/1383435449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f3b4401aa50 con 0x7f3b480b07d0 2023-10-09T15:32:33.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.123+0000 7f3b3d7fa700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 0x7f3b2c0693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.123+0000 7f3b3d7fa700 1 -- 172.21.15.33:0/1383435449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b44086000 con 0x7f3b480b07d0 2023-10-09T15:32:33.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.123+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 0x7f3b2c0693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.124+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 0x7f3b2c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b48069c10 tx=0x7f3b38001aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.125+0000 7f3b5866ab80 1 Processor -- start 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.125+0000 7f3b5866ab80 1 -- start start 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d1726ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d1723fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1719aa70 con 0x560d17243a50 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17198270 con 0x560d1726cf60 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17194060 con 0x560d1728dd00 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41242/0 (socket says 172.21.15.33:41242) 2023-10-09T15:32:33.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 -- 172.21.15.33:0/864237493 learned_addr learned my addr 172.21.15.33:0/864237493 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d1726ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d1723fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 -- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 msgr2=0x560d1726ca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d1726ca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 -- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 msgr2=0x560d1723fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d1723fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 -- 172.21.15.33:0/864237493 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d1702e270 con 0x560d17243a50 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d1723fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b44056890 tx=0x7f3b44008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7587c57a738773b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b327fc700 1 -- 172.21.15.33:0/864237493 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4405a180 con 0x560d17243a50 2023-10-09T15:32:33.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b327fc700 1 -- 172.21.15.33:0/864237493 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4405ded0 con 0x560d17243a50 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.126+0000 7f3b327fc700 1 -- 172.21.15.33:0/864237493 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4401ce00 con 0x560d17243a50 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 -- 172.21.15.33:0/864237493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 msgr2=0x560d17243e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f3b44056890 tx=0x7f3b44008040 comp rx=0 tx=0).stop 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 -- 172.21.15.33:0/864237493 shutdown_connections 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17243e20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d1723fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/864237493 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d1726ca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 -- 172.21.15.33:0/864237493 >> 172.21.15.33:0/864237493 conn(0x560d17245370 msgr2=0x560d17245740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 -- 172.21.15.33:0/864237493 shutdown_connections 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.127+0000 7f3b5866ab80 1 -- 172.21.15.33:0/864237493 wait complete. 2023-10-09T15:32:33.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.128+0000 7f3b5866ab80 1 -- start start 2023-10-09T15:32:33.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.128+0000 7f3b5866ab80 1 Processor -- start 2023-10-09T15:32:33.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d17240670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d17240bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1713f890 con 0x560d17243a50 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1715aea0 con 0x560d1726cf60 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17016e30 con 0x560d1728dd00 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 10 client.0 _ll_register_callbacks cb 0x560d17207110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41248/0 (socket says 172.21.15.33:41248) 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1707763934 learned_addr learned my addr 172.21.15.33:0/1707763934 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d17240bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d17240670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 msgr2=0x560d17240bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d17240bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 msgr2=0x560d17240670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d17240670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 -- 172.21.15.33:0/1707763934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b48159220 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b44084600 tx=0x7f3b44059000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c069132d6332e7dc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b277fe700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4405a180 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b4401ce00 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x560d17238b70 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b44053640 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 10 client.5496 fetch_fsmap learned FSMap version 30 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.129+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x560d16fd0fe0 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x560d17238b70 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3b4406d170 con 0x560d17243a50 2023-10-09T15:32:33.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 10 client.5496 fetch_fsmap finished waiting for FSMap version 30 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 10 client.5496 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 20 client.5496 populate_metadata read hostname 'smithi033' 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1729a3b0 0x560d1729a780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 4 client.5496 mds_command: new command op to 5376 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 --> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x560d17215aa0 con 0x560d1729a3b0 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1729a3b0 0x560d1729a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1729a3b0 0x560d1729a780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=35ef87b2a9ae8d5e server_cookie=64cd3f1f2aa2cb9a in_seq=0 out_seq=0 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.130+0000 7f3b277fe700 10 client.5496 ms_handle_connect on v2:172.21.15.59:6833/2234768428 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b277fe700 1 -- 172.21.15.33:0/1707763934 <== mds.0 v2:172.21.15.59:6833/2234768428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x560d17215aa0 con 0x560d1729a3b0 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b277fe700 10 client.5496 handle_command_reply: tid=0 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 client.5496 shutdown 2023-10-09T15:32:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 msgr2=0x560d1728d330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3b44084600 tx=0x7f3b44059000 comp rx=0 tx=0).stop 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 shutdown_connections 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1729a3b0 0x560d1729a780 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d1728d330 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b277fe700 0 client.5496 ms_handle_reset on v2:172.21.15.59:6833/2234768428 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d17240bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/1707763934 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1726cf60 0x560d17240670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 >> 172.21.15.33:0/1707763934 conn(0x560d17245370 msgr2=0x560d17289550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.131+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 shutdown_connections 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.132+0000 7f3b5866ab80 1 -- 172.21.15.33:0/1707763934 wait complete. 2023-10-09T15:32:33.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.132+0000 7f3b5866ab80 20 client.5496 trim_cache size 0 max 16384 2023-10-09T15:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 Processor -- start 2023-10-09T15:32:33.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 -- start start 2023-10-09T15:32:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1726cf60 0x560d1723edf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1728dd00 0x560d17243fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17299340 con 0x560d17243a50 2023-10-09T15:32:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d17246140 con 0x560d1728dd00 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d17299d40 con 0x560d1726cf60 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41252/0 (socket says 172.21.15.33:41252) 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.149+0000 7f3b4d10e700 1 -- 172.21.15.33:0/154440193 learned_addr learned my addr 172.21.15.33:0/154440193 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1728dd00 0x560d17243fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1726cf60 0x560d1723edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 -- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1726cf60 msgr2=0x560d1723edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1726cf60 0x560d1723edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 -- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1728dd00 msgr2=0x560d17243fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1728dd00 0x560d17243fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 -- 172.21.15.33:0/154440193 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x560d17162780 con 0x560d17243a50 2023-10-09T15:32:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b44055520 tx=0x7f3b4406b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1c7caf5409f6114 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b32ffd700 1 -- 172.21.15.33:0/154440193 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4405a180 con 0x560d17243a50 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b32ffd700 1 -- 172.21.15.33:0/154440193 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4401ce00 con 0x560d17243a50 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b32ffd700 1 -- 172.21.15.33:0/154440193 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b4406d170 con 0x560d17243a50 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b5866ab80 1 -- 172.21.15.33:0/154440193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 msgr2=0x560d17246c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f3b44055520 tx=0x7f3b4406b040 comp rx=0 tx=0).stop 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.150+0000 7f3b5866ab80 1 -- 172.21.15.33:0/154440193 shutdown_connections 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d17243a50 0x560d17246c20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d1728dd00 0x560d17243fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/154440193 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1726cf60 0x560d1723edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 -- 172.21.15.33:0/154440193 >> 172.21.15.33:0/154440193 conn(0x560d17245370 msgr2=0x560d17285990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 -- 172.21.15.33:0/154440193 shutdown_connections 2023-10-09T15:32:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 -- 172.21.15.33:0/154440193 wait complete. 2023-10-09T15:32:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 -- start start 2023-10-09T15:32:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.151+0000 7f3b5866ab80 1 Processor -- start 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d17243a50 0x560d172d57d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d172444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d1728d1b0 con 0x560d1726cf60 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x560d172e9220 con 0x560d17243a50 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x560d172ea080 con 0x560d1728dd00 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b5866ab80 10 client.0 _ll_register_callbacks cb 0x560d17207110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b4c90d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b4d10e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d17243a50 0x560d172d57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b4c90d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41254/0 (socket says 172.21.15.33:41254) 2023-10-09T15:32:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b4c90d700 1 -- 172.21.15.33:0/4276026966 learned_addr learned my addr 172.21.15.33:0/4276026966 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.152+0000 7f3b4d90f700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d172444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 -- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 msgr2=0x560d172444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d172444e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 -- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d17243a50 msgr2=0x560d172d57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d17243a50 0x560d172d57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 -- 172.21.15.33:0/4276026966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b48159220 con 0x560d1726cf60 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4c90d700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b38001ed0 tx=0x7f3b38013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b895b965f97cab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b38022db0 con 0x560d1726cf60 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3b3801b040 con 0x560d1726cf60 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3b4405ded0 con 0x560d1726cf60 2023-10-09T15:32:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3b3802dd20 con 0x560d1726cf60 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 10 client.5502 fetch_fsmap learned FSMap version 30 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=2+}) v3 -- 0x560d17149470 con 0x560d1726cf60 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b4405ded0 con 0x560d1726cf60 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 30) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f3b380133f0 con 0x560d1726cf60 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 10 client.5502 fetch_fsmap finished waiting for FSMap version 30 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 10 client.5502 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 20 client.5502 populate_metadata read hostname 'smithi033' 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1726f5f0 0x560d1726f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 4 client.5502 mds_command: new command op to 5376 tid=0[{"prefix": "status"}] 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 --> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] -- command(tid 0: {"prefix": "status"}) v1 -- 0x560d17136e00 con 0x560d1726f5f0 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.153+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1726f5f0 0x560d1726f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b4d10e700 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1726f5f0 0x560d1726f9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b398c47316d3be0 server_cookie=55821a4b4b119aa2 in_seq=0 out_seq=0 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b277fe700 10 client.5502 ms_handle_connect on v2:172.21.15.59:6833/2234768428 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b277fe700 1 -- 172.21.15.33:0/4276026966 <== mds.0 v2:172.21.15.59:6833/2234768428 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x560d17136e00 con 0x560d1726f5f0 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b277fe700 10 client.5502 handle_command_reply: tid=0 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 client.5502 shutdown 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 msgr2=0x560d17243fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f3b38001ed0 tx=0x7f3b38013000 comp rx=0 tx=0).stop 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 shutdown_connections 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:6833/2234768428,v1:172.21.15.59:6835/2234768428] conn(0x560d1726f5f0 0x560d1726f9c0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x560d1728dd00 0x560d172444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b277fe700 0 client.5502 ms_handle_reset on v2:172.21.15.59:6833/2234768428 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x560d17243a50 0x560d172d57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 --2- 172.21.15.33:0/4276026966 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x560d1726cf60 0x560d17243fa0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 >> 172.21.15.33:0/4276026966 conn(0x560d17245370 msgr2=0x560d172856d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 shutdown_connections 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.154+0000 7f3b5866ab80 1 -- 172.21.15.33:0/4276026966 wait complete. 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b5866ab80 20 client.5502 trim_cache size 0 max 16384 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5376, 2023-10-09T15:32:33.163 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9272385080000003, 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 30, 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 51, 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 51, 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.20274036 2023-10-09T15:32:33.164 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 msgr2=0x7f3b2c0693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 0x7f3b2c0693e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f3b48069c10 tx=0x7f3b38001aa0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 msgr2=0x7f3b48158ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f3b440030c0 tx=0x7f3b44016000 comp rx=0 tx=0).stop 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 shutdown_connections 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b2c066f30 0x7f3b2c0693e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b480b07d0 0x7f3b48158ce0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b480cf200 0x7f3b4816dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 --2- 172.21.15.33:0/1383435449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b480b0ba0 0x7f3b481554b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 >> 172.21.15.33:0/1383435449 conn(0x7f3b4806ce80 msgr2=0x7f3b480c3d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 shutdown_connections 2023-10-09T15:32:33.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.155+0000 7f3b4f372700 1 -- 172.21.15.33:0/1383435449 wait complete. 2023-10-09T15:32:33.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:32:33.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.286+0000 7fd59e5af700 1 Processor -- start 2023-10-09T15:32:33.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.286+0000 7fd59e5af700 1 -- start start 2023-10-09T15:32:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59e5af700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd5980cb970 0x7fd598159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59e5af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 0x7fd598156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59e5af700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd59815ae40 con 0x7fd5980cb5a0 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59e5af700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5980ce0f0 con 0x7fd5980cb970 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59e5af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5980d13f0 con 0x7fd59815a400 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd597fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd5980cb5a0 0x7fd5980cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36454/0 (socket says 172.21.15.33:36454) 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd597fff700 1 -- 172.21.15.33:0/3400787646 learned_addr learned my addr 172.21.15.33:0/3400787646 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3400787646 >> v2:172.21.15.33:3300/0 conn(0x7fd5980cb970 0x7fd598159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd596ffd700 1 -- 172.21.15.33:0/3400787646 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 357417025 0 0) 0x7fd59815ae40 con 0x7fd5980cb5a0 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd59cb4c700 1 --2- 172.21.15.33:0/3400787646 >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 0x7fd598156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd596ffd700 1 -- 172.21.15.33:0/3400787646 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd584003570 con 0x7fd5980cb5a0 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.287+0000 7fd5977fe700 1 -- 172.21.15.33:0/3400787646 >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 msgr2=0x7fd598156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3400787646 >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 0x7fd598156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd5977fe700 1 -- 172.21.15.33:0/3400787646 >> v1:172.21.15.33:6789/0 conn(0x7fd5980cb5a0 legacy=0x7fd5980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd5977fe700 1 -- 172.21.15.33:0/3400787646 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd59815ab60 con 0x7fd5980cb970 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59cb4c700 1 --2- 172.21.15.33:0/3400787646 >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 0x7fd598156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3400787646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb970 0x7fd598159ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd5980ccdf0 tx=0x7fd5880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c002d3e7f3440cdc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd596ffd700 1 -- 172.21.15.33:0/3400787646 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011630 con 0x7fd5980cb970 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd596ffd700 1 -- 172.21.15.33:0/3400787646 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd588011790 con 0x7fd5980cb970 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd596ffd700 1 -- 172.21.15.33:0/3400787646 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd588011b30 con 0x7fd5980cb970 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 -- 172.21.15.33:0/3400787646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb970 msgr2=0x7fd598159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3400787646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb970 0x7fd598159ec0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fd5980ccdf0 tx=0x7fd5880091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 -- 172.21.15.33:0/3400787646 shutdown_connections 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3400787646 >> v2:172.21.15.59:3300/0 conn(0x7fd59815a400 0x7fd598156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3400787646 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb970 0x7fd598159ec0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 -- 172.21.15.33:0/3400787646 >> 172.21.15.33:0/3400787646 conn(0x7fd598070e30 msgr2=0x7fd5980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 -- 172.21.15.33:0/3400787646 shutdown_connections 2023-10-09T15:32:33.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.288+0000 7fd59e5af700 1 -- 172.21.15.33:0/3400787646 wait complete. 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 Processor -- start 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 -- start start 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5980cb970 0x7fd5981558f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd59815a400 0x7fd5980c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598152d70 con 0x7fd5980cb5a0 2023-10-09T15:32:33.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd598154850 con 0x7fd5980cb970 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.290+0000 7fd59e5af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd598154b30 con 0x7fd59815a400 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41280/0 (socket says 172.21.15.33:41280) 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 -- 172.21.15.33:0/3663398018 learned_addr learned my addr 172.21.15.33:0/3663398018 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd59cb4c700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd59815a400 0x7fd5980c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 -- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd59815a400 msgr2=0x7fd5980c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd59815a400 0x7fd5980c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 -- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5980cb970 msgr2=0x7fd5981558f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5980cb970 0x7fd5981558f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5980cb970 0x7fd5981558f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 -- 172.21.15.33:0/3663398018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd588009420 con 0x7fd5980cb5a0 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd597fff700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c7c0 tx=0x7fd580007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580005b30 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd580005c90 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd598154e10 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd580007340 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.291+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5981553d0 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.292+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5981555f0 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.293+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fd58001b400 con 0x7fd5980cb5a0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.293+0000 7fd58ffff700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 0x7fd5780693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.293+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 0x7fd5780693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:33.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.293+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd580083ff0 con 0x7fd5980cb5a0 2023-10-09T15:32:33.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.294+0000 7fd5977fe700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 0x7fd5780693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5981562d0 tx=0x7fd588017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:33.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.297+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5800512e0 con 0x7fd5980cb5a0 2023-10-09T15:32:33.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.540+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd59804c3c0 con 0x7fd5980cb5a0 2023-10-09T15:32:33.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.540+0000 7fd58ffff700 1 -- 172.21.15.33:0/3663398018 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd580054900 con 0x7fd5980cb5a0 2023-10-09T15:32:33.541 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:32:33.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 msgr2=0x7fd5780693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 0x7fd5780693e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fd5981562d0 tx=0x7fd588017000 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 msgr2=0x7fd5980af430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fd58000c7c0 tx=0x7fd580007e00 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 shutdown_connections 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.542+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd578066f30 0x7fd5780693e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd5980cb5a0 0x7fd5980af430 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd59815a400 0x7fd5980c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 --2- 172.21.15.33:0/3663398018 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5980cb970 0x7fd5981558f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 >> 172.21.15.33:0/3663398018 conn(0x7fd598070e30 msgr2=0x7fd5980b0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 shutdown_connections 2023-10-09T15:32:33.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:33.543+0000 7fd59e5af700 1 -- 172.21.15.33:0/3663398018 wait complete. 2023-10-09T15:32:33.555 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:32:33.555 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:32:33.556 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:33.556 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.556 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:33.572 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42334sec preferred_lft 42334sec 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:33.573 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:32:33.574 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.575 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:33.575 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:32:33.575 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:32:33.575 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:33.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.575 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:32:33.635 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:32:33.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.637 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:32:33.694 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:32:33.695 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:32:33.695 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:32:33.695 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:32:33.695 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:32:33.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.695 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:32:33.695 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:32:33.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:32:33.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:32:33.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:32:33.696 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:32:33.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.797 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:32:33.812 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:32:33.812 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:32:33.812 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:33.812 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:33.812 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:32:33.877 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:33.877 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:33.931 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:32:33.932 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:33.932 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:33.986 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:32:33.986 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:32:33.986 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:34.066 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:34.066 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:34.066 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:34.075 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:34.075 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:34.075 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:34.075 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:34.075 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:34.098 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:32:34.098 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:32:34.098 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:32:34.098 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:34.098 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:34.099 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:32:34.099 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:32:34.099 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:32:34.100 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:32:34.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:34.166 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:32:34.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.325+0000 7fdbb3a23700 1 Processor -- start 2023-10-09T15:32:34.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 -- start start 2023-10-09T15:32:34.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdbac0cb5a0 0x7fdbac0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbac15ae40 con 0x7fdbac0cde50 2023-10-09T15:32:34.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbac0d13f0 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.326+0000 7fdbb3a23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac15ab60 con 0x7fdbac0cd9e0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdbac0cb5a0 0x7fdbac0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdbac0cb5a0 0x7fdbac0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41290/0 (socket says 172.21.15.33:41290) 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 -- 172.21.15.33:0/679582150 learned_addr learned my addr 172.21.15.33:0/679582150 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb0fbe700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 -- 172.21.15.33:0/679582150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 msgr2=0x7fdbac159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 -- 172.21.15.33:0/679582150 >> v1:172.21.15.59:6789/0 conn(0x7fdbac0cde50 legacy=0x7fdbac156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 -- 172.21.15.33:0/679582150 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbac0ccf00 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac0cb970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009f20 tx=0x7fdb9c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ddaac14a76229b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbabfff700 1 -- 172.21.15.33:0/679582150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c00e070 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbabfff700 1 -- 172.21.15.33:0/679582150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb9c00ba40 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.327+0000 7fdbabfff700 1 -- 172.21.15.33:0/679582150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb9c0092e0 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 -- 172.21.15.33:0/679582150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0cb5a0 msgr2=0x7fdbac0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac0cb970 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009f20 tx=0x7fdb9c009840 comp rx=0 tx=0).stop 2023-10-09T15:32:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 -- 172.21.15.33:0/679582150 shutdown_connections 2023-10-09T15:32:34.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac0cb970 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/679582150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 -- 172.21.15.33:0/679582150 >> 172.21.15.33:0/679582150 conn(0x7fdbac070e30 msgr2=0x7fdbac0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 -- 172.21.15.33:0/679582150 shutdown_connections 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.328+0000 7fdbb3a23700 1 -- 172.21.15.33:0/679582150 wait complete. 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.329+0000 7fdbb3a23700 1 Processor -- start 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.329+0000 7fdbb3a23700 1 -- start start 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac0b5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac16afc0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac16b2a0 con 0x7fdbac0cb5a0 2023-10-09T15:32:34.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb3a23700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbac16b580 con 0x7fdbac0cd9e0 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41292/0 (socket says 172.21.15.33:41292) 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 -- 172.21.15.33:0/1831138219 learned_addr learned my addr 172.21.15.33:0/1831138219 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb0fbe700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac0b5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 -- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 msgr2=0x7fdbac0b5ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac0b5ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 -- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 msgr2=0x7fdbac153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 -- 172.21.15.33:0/1831138219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb9c009ae0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb0fbe700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.330+0000 7fdbb1fc0700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdba400b4e0 tx=0x7fdba4006f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.331+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400f5e0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.331+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba400f740 con 0x7fdbac0b61e0 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.331+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbac16b860 con 0x7fdbac0b61e0 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.331+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400fb00 con 0x7fdbac0b61e0 2023-10-09T15:32:34.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.331+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbac1537a0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.332+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbac04c3c0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.332+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fdba401a400 con 0x7fdbac0b61e0 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.332+0000 7fdba97fa700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.332+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdba40840f0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.333+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:34.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.333+0000 7fdbb17bf700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 0x7fdb980693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009880 tx=0x7fdb9c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:34.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.337+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdba40513e0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.576+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdbac0cd1e0 con 0x7fdbac0b61e0 2023-10-09T15:32:34.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.577+0000 7fdba97fa700 1 -- 172.21.15.33:0/1831138219 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v30) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdba4054a00 con 0x7fdbac0b61e0 2023-10-09T15:32:34.578 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 msgr2=0x7fdb980693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 0x7fdb980693e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fdb9c009880 tx=0x7fdb9c017000 comp rx=0 tx=0).stop 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 msgr2=0x7fdbac0cf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fdba400b4e0 tx=0x7fdba4006f90 comp rx=0 tx=0).stop 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 shutdown_connections 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98066f30 0x7fdb980693e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbac0b61e0 0x7fdbac0cf290 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbac0cb5a0 0x7fdbac153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 --2- 172.21.15.33:0/1831138219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdbac0cd9e0 0x7fdbac0b5ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 >> 172.21.15.33:0/1831138219 conn(0x7fdbac070e30 msgr2=0x7fdbac0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 shutdown_connections 2023-10-09T15:32:34.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:34.579+0000 7fdbb3a23700 1 -- 172.21.15.33:0/1831138219 wait complete. 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:32:34.592 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:34.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.593 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:32:34.611 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:32:34.612 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42341sec preferred_lft 42341sec 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:32:34.613 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:32:34.614 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:32:34.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.615 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:32:34.681 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:32:34.682 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.682 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:32:34.742 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.742 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:32:34.743 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:32:34.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:32:34.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:32:34.743 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:32:34.743 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:32:34.853 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.853 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:32:34.868 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:32:34.868 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:32:34.869 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:34.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:34.869 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:32:34.935 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:34.935 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:34.991 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:32:34.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:32:34.991 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:35.046 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:32:35.046 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:32:35.046 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:35.128 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:35.129 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:35.129 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:35.137 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:35.138 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:35.138 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:35.138 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:35.138 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:35.159 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:32:35.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:32:35.159 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:32:35.159 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:32:35.160 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:32:35.160 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:32:35.160 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:32:35.160 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:32:35.161 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:32:35.161 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:35.161 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:35.227 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:32:35.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.357+0000 7fb57567d700 1 Processor -- start 2023-10-09T15:32:35.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 -- start start 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb570156480 0x7fb570157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb5700c7b30 0x7fb57006b780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb5700ae140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57006b2f0 con 0x7fb570156480 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb57006ace0 con 0x7fb5700c7b30 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.358+0000 7fb57567d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5700c8310 con 0x7fb57006bcc0 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb570156480 0x7fb570157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb570156480 0x7fb570157710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41304/0 (socket says 172.21.15.33:41304) 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 -- 172.21.15.33:0/3938001322 learned_addr learned my addr 172.21.15.33:0/3938001322 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56e7fc700 1 --2- 172.21.15.33:0/3938001322 >> v2:172.21.15.59:3300/0 conn(0x7fb5700c7b30 0x7fb57006b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56f7fe700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb5700ae140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 -- 172.21.15.33:0/3938001322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 msgr2=0x7fb5700ae140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb5700ae140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 -- 172.21.15.33:0/3938001322 >> v2:172.21.15.59:3300/0 conn(0x7fb5700c7b30 msgr2=0x7fb57006b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 --2- 172.21.15.33:0/3938001322 >> v2:172.21.15.59:3300/0 conn(0x7fb5700c7b30 0x7fb57006b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 -- 172.21.15.33:0/3938001322 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5700c85f0 con 0x7fb570156480 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56effd700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570157710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb57006dfb0 tx=0x7fb560009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52bf05622afa0fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56dffb700 1 -- 172.21.15.33:0/3938001322 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56000e070 con 0x7fb570156480 2023-10-09T15:32:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56dffb700 1 -- 172.21.15.33:0/3938001322 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56000b970 con 0x7fb570156480 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.359+0000 7fb56dffb700 1 -- 172.21.15.33:0/3938001322 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5600092e0 con 0x7fb570156480 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 -- 172.21.15.33:0/3938001322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 msgr2=0x7fb570157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570157710 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb57006dfb0 tx=0x7fb560009840 comp rx=0 tx=0).stop 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 -- 172.21.15.33:0/3938001322 shutdown_connections 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb5700ae140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 --2- 172.21.15.33:0/3938001322 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570157710 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 --2- 172.21.15.33:0/3938001322 >> v2:172.21.15.59:3300/0 conn(0x7fb5700c7b30 0x7fb57006b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 -- 172.21.15.33:0/3938001322 >> 172.21.15.33:0/3938001322 conn(0x7fb57006d170 msgr2=0x7fb5700cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 -- 172.21.15.33:0/3938001322 shutdown_connections 2023-10-09T15:32:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.360+0000 7fb57567d700 1 -- 172.21.15.33:0/3938001322 wait complete. 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.361+0000 7fb57567d700 1 Processor -- start 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.361+0000 7fb57567d700 1 -- start start 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb570150040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5700c7b30 0x7fb5701509f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57016a200 con 0x7fb570156480 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57016a4e0 con 0x7fb5700c7b30 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb57567d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb57016a7c0 con 0x7fb57006bcc0 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41314/0 (socket says 172.21.15.33:41314) 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 -- 172.21.15.33:0/3541433620 learned_addr learned my addr 172.21.15.33:0/3541433620 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56e7fc700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5700c7b30 0x7fb5701509f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56effd700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb570150040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 -- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 msgr2=0x7fb570150040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb570150040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 -- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5700c7b30 msgr2=0x7fb5701509f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5700c7b30 0x7fb5701509f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 -- 172.21.15.33:0/3541433620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560009ae0 con 0x7fb570156480 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.362+0000 7fb56f7fe700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ea20 tx=0x7fb5680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.363+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800ee60 con 0x7fb570156480 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.363+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56800c7f0 con 0x7fb570156480 2023-10-09T15:32:35.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.363+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57016aaa0 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.363+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56800cbb0 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.363+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb570150580 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.364+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57016a340 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.364+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fb568013470 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.364+0000 7fb566ffd700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 0x7fb5500693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.364+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb5680846c0 con 0x7fb570156480 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.365+0000 7fb56effd700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 0x7fb5500693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.365+0000 7fb56effd700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 0x7fb5500693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb560009880 tx=0x7fb560018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.369+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb57016a340 con 0x7fb570156480 2023-10-09T15:32:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:35.610+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb57016a340 con 0x7fb570156480 2023-10-09T15:32:35.838 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:32:35.841 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:32:36.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.276+0000 7fb566ffd700 1 -- 172.21.15.33:0/3541433620 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v31) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb57016a340 con 0x7fb570156480 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 msgr2=0x7fb5500693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 0x7fb5500693e0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb560009880 tx=0x7fb560018000 comp rx=0 tx=0).stop 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 msgr2=0x7fb570150f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb56800ea20 tx=0x7fb5680091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 shutdown_connections 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb550066f30 0x7fb5500693e0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb570156480 0x7fb570150f30 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb57006bcc0 0x7fb570150040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 --2- 172.21.15.33:0/3541433620 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb5700c7b30 0x7fb5701509f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 >> 172.21.15.33:0/3541433620 conn(0x7fb57006d170 msgr2=0x7fb5700cb8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.278+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 shutdown_connections 2023-10-09T15:32:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.279+0000 7fb57567d700 1 -- 172.21.15.33:0/3541433620 wait complete. 2023-10-09T15:32:36.292 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:32:36.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.412+0000 7f41da6e3700 1 Processor -- start 2023-10-09T15:32:36.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.412+0000 7f41da6e3700 1 -- start start 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41da6e3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41d40cb5a0 0x7f41d40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41da6e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40cd9e0 0x7f41d4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41da6e3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41d415ae40 con 0x7f41d40cde50 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41da6e3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41d40d13f0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41da6e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d415ab60 con 0x7f41d40cd9e0 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41d3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41d40cb5a0 0x7f41d40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41d8c80700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f41d40cde50 0x7f41d4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36464/0 (socket says 172.21.15.33:36464) 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.413+0000 7f41d8c80700 1 -- 172.21.15.33:0/3877102124 learned_addr learned my addr 172.21.15.33:0/3877102124 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d37fe700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40cd9e0 0x7f41d4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d3fff700 1 -- 172.21.15.33:0/3877102124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40cd9e0 msgr2=0x7f41d4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d3fff700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40cd9e0 0x7f41d4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d3fff700 1 -- 172.21.15.33:0/3877102124 >> v1:172.21.15.33:6789/0 conn(0x7f41d40cde50 legacy=0x7f41d4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d2ffd700 1 -- 172.21.15.33:0/3877102124 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 701234358 0 0) 0x7f41d415ae40 con 0x7f41d40cde50 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d3fff700 1 -- 172.21.15.33:0/3877102124 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41d40ccf00 con 0x7f41d40cb5a0 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d3fff700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d40cb970 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0098e0 tx=0x7f41bc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7c53f664ea384f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d2ffd700 1 -- 172.21.15.33:0/3877102124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc009e80 con 0x7f41d40cb5a0 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d2ffd700 1 -- 172.21.15.33:0/3877102124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00b860 con 0x7f41d40cb5a0 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.414+0000 7f41d2ffd700 1 -- 172.21.15.33:0/3877102124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00bbe0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 -- 172.21.15.33:0/3877102124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 msgr2=0x7f41d40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d40cb970 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f41bc0098e0 tx=0x7f41bc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 -- 172.21.15.33:0/3877102124 shutdown_connections 2023-10-09T15:32:36.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d40cb970 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 --2- 172.21.15.33:0/3877102124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40cd9e0 0x7f41d4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 -- 172.21.15.33:0/3877102124 >> 172.21.15.33:0/3877102124 conn(0x7f41d4070e30 msgr2=0x7f41d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:36.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 -- 172.21.15.33:0/3877102124 shutdown_connections 2023-10-09T15:32:36.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.415+0000 7f41da6e3700 1 -- 172.21.15.33:0/3877102124 wait complete. 2023-10-09T15:32:36.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.416+0000 7f41da6e3700 1 Processor -- start 2023-10-09T15:32:36.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.416+0000 7f41da6e3700 1 -- start start 2023-10-09T15:32:36.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d40cd9e0 0x7f41d40c9e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40ca3c0 0x7f41d4157810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b44a0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b3890 con 0x7f41d40cd9e0 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41d40b3b70 con 0x7f41d40ca3c0 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41336/0 (socket says 172.21.15.33:41336) 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 -- 172.21.15.33:0/593584086 learned_addr learned my addr 172.21.15.33:0/593584086 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 -- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40ca3c0 msgr2=0x7f41d4157810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40ca3c0 0x7f41d4157810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d37fe700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d40cd9e0 0x7f41d40c9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 -- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d40cd9e0 msgr2=0x7f41d40c9e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d40cd9e0 0x7f41d40c9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 -- 172.21.15.33:0/593584086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc009420 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41d3fff700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41d406ea60 tx=0x7f41bc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00b9d0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00bb50 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41d40b3e50 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.417+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc025670 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.418+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41d41516f0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.418+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41d404c3c0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.419+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7f41bc023070 con 0x7f41d40cb5a0 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.419+0000 7f41cbfff700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.419+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41bc085bc0 con 0x7f41d40cb5a0 2023-10-09T15:32:36.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.419+0000 7f41d37fe700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.420+0000 7f41d37fe700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 0x7f41b40693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f41d40afe40 tx=0x7f41c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.424+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41bc052d90 con 0x7f41d40cb5a0 2023-10-09T15:32:36.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.646+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f41d40b45e0 con 0x7f41b4066f30 2023-10-09T15:32:36.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.648+0000 7f41cbfff700 1 -- 172.21.15.33:0/593584086 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f41c4009710 con 0x7f41b4066f30 2023-10-09T15:32:36.648 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:32:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:32:36.649 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:36.649 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 msgr2=0x7f41b40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 0x7f41b40693e0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f41d40afe40 tx=0x7f41c4008040 comp rx=0 tx=0).stop 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 msgr2=0x7f41d41511b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f41d406ea60 tx=0x7f41bc017000 comp rx=0 tx=0).stop 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 shutdown_connections 2023-10-09T15:32:36.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b4066f30 0x7f41b40693e0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41d40cb5a0 0x7f41d41511b0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41d40ca3c0 0x7f41d4157810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 --2- 172.21.15.33:0/593584086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41d40cd9e0 0x7f41d40c9e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 >> 172.21.15.33:0/593584086 conn(0x7f41d4070e30 msgr2=0x7f41d40b07e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 shutdown_connections 2023-10-09T15:32:36.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.650+0000 7f41da6e3700 1 -- 172.21.15.33:0/593584086 wait complete. 2023-10-09T15:32:36.663 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:32:36.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 Processor -- start 2023-10-09T15:32:36.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 -- start start 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce04159530 0x7fce040ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0406dc70 0x7fce04159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce040ccfd0 con 0x7fce0406e0e0 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce040cf0e0 con 0x7fce04159530 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.784+0000 7fce096e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415a3d0 con 0x7fce0406dc70 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce04159530 0x7fce040ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce04159530 0x7fce040ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41338/0 (socket says 172.21.15.33:41338) 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 -- 172.21.15.33:0/1148797840 learned_addr learned my addr 172.21.15.33:0/1148797840 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fcdfa7fc700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0406dc70 0x7fce04159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 -- 172.21.15.33:0/1148797840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0406dc70 msgr2=0x7fce04159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0406dc70 0x7fce04159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 -- 172.21.15.33:0/1148797840 >> v1:172.21.15.59:6789/0 conn(0x7fce0406e0e0 legacy=0x7fce040cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 -- 172.21.15.33:0/1148797840 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce0415a6b0 con 0x7fce04159530 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce04159530 0x7fce040ceba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40099b0 tx=0x7fcdf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b131596f7bca99 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce027fc700 1 -- 172.21.15.33:0/1148797840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400b860 con 0x7fce04159530 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce027fc700 1 -- 172.21.15.33:0/1148797840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf400b9c0 con 0x7fce04159530 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.785+0000 7fce027fc700 1 -- 172.21.15.33:0/1148797840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf400bd60 con 0x7fce04159530 2023-10-09T15:32:36.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 -- 172.21.15.33:0/1148797840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce04159530 msgr2=0x7fce040ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce04159530 0x7fce040ceba0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40099b0 tx=0x7fcdf4009250 comp rx=0 tx=0).stop 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 -- 172.21.15.33:0/1148797840 shutdown_connections 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce04159530 0x7fce040ceba0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 --2- 172.21.15.33:0/1148797840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0406dc70 0x7fce04159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 -- 172.21.15.33:0/1148797840 >> 172.21.15.33:0/1148797840 conn(0x7fce040703a0 msgr2=0x7fce040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 -- 172.21.15.33:0/1148797840 shutdown_connections 2023-10-09T15:32:36.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.786+0000 7fce096e2700 1 -- 172.21.15.33:0/1148797840 wait complete. 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.787+0000 7fce096e2700 1 Processor -- start 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.787+0000 7fce096e2700 1 -- start start 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 0x7fce0414a710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce04159530 0x7fce040c8130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0414ac50 con 0x7fce0406e0e0 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce0415e690 con 0x7fce0406dc70 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce096e2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce040c7ca0 con 0x7fce04159530 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41342/0 (socket says 172.21.15.33:41342) 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 -- 172.21.15.33:0/1506304261 learned_addr learned my addr 172.21.15.33:0/1506304261 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 0x7fce0414a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce037fe700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce04159530 0x7fce040c8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 -- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce04159530 msgr2=0x7fce040c8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce04159530 0x7fce040c8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 -- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 msgr2=0x7fce0414a710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 0x7fce0414a710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 -- 172.21.15.33:0/1506304261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf40094f0 con 0x7fce0406e0e0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 0x7fce0414a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.788+0000 7fcdfa7fc700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00d890 tx=0x7fcdec008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec0125f0 con 0x7fce0406e0e0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdec012750 con 0x7fce0406e0e0 2023-10-09T15:32:36.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0415e0d0 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdec012ad0 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce040c7930 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.789+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce040c7750 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.790+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fcdec01e460 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.790+0000 7fcdfb7fe700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.790+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdec084b90 con 0x7fce0406e0e0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.790+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:36.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.791+0000 7fce02ffd700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 0x7fcde40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40099b0 tx=0x7fcdf4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:36.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.795+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdec055890 con 0x7fce0406e0e0 2023-10-09T15:32:36.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.988+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fce040c7de0 con 0x7fce0406e0e0 2023-10-09T15:32:36.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.988+0000 7fcdfb7fe700 1 -- 172.21.15.33:0/1506304261 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fcdec055420 con 0x7fce0406e0e0 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.990+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 msgr2=0x7fcde40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.990+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 0x7fcde40693e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fcdf40099b0 tx=0x7fcdf4017000 comp rx=0 tx=0).stop 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.990+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 msgr2=0x7fce040b4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.990+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fcdec00d890 tx=0x7fcdec008040 comp rx=0 tx=0).stop 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 shutdown_connections 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcde4066f30 0x7fcde40693e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce04159530 0x7fce040c8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce0406dc70 0x7fce0414a710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 --2- 172.21.15.33:0/1506304261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce0406e0e0 0x7fce040b4930 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:36.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 >> 172.21.15.33:0/1506304261 conn(0x7fce040703a0 msgr2=0x7fce0415af00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:36.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 shutdown_connections 2023-10-09T15:32:36.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:36.991+0000 7fce096e2700 1 -- 172.21.15.33:0/1506304261 wait complete. 2023-10-09T15:32:37.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000406266 2023-10-09T15:32:37.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.124+0000 7faee341b700 1 Processor -- start 2023-10-09T15:32:37.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 -- start start 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 0x7faedc0af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 0x7faedc06d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faedc06e9d0 0x7faedc06ee50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc0af490 con 0x7faedc06e9d0 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faedc06f390 con 0x7faedc0c2ac0 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.125+0000 7faee341b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc1562a0 con 0x7faedc0af0c0 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faedc06e9d0 0x7faedc06ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faedc06e9d0 0x7faedc06ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41344/0 (socket says 172.21.15.33:41344) 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 -- 172.21.15.33:0/2847527675 learned_addr learned my addr 172.21.15.33:0/2847527675 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee09b6700 1 --2- 172.21.15.33:0/2847527675 >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 0x7faedc06d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee11b7700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 0x7faedc0af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 -- 172.21.15.33:0/2847527675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 msgr2=0x7faedc0af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 0x7faedc0af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 -- 172.21.15.33:0/2847527675 >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 msgr2=0x7faedc06d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 --2- 172.21.15.33:0/2847527675 >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 0x7faedc06d3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 -- 172.21.15.33:0/2847527675 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0c8050 con 0x7faedc06e9d0 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee09b6700 1 --2- 172.21.15.33:0/2847527675 >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 0x7faedc06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee11b7700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 0x7faedc0af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:37.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faee19b8700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc06ee50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faedc06faf0 tx=0x7faed4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00596e4bdd853e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faed3fff700 1 -- 172.21.15.33:0/2847527675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed400e070 con 0x7faedc06e9d0 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faed3fff700 1 -- 172.21.15.33:0/2847527675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed400ba50 con 0x7faedc06e9d0 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.126+0000 7faed3fff700 1 -- 172.21.15.33:0/2847527675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40092e0 con 0x7faedc06e9d0 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 -- 172.21.15.33:0/2847527675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 msgr2=0x7faedc06ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc06ee50 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7faedc06faf0 tx=0x7faed4009840 comp rx=0 tx=0).stop 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 -- 172.21.15.33:0/2847527675 shutdown_connections 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc06ee50 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 --2- 172.21.15.33:0/2847527675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0af0c0 0x7faedc0af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 --2- 172.21.15.33:0/2847527675 >> v2:172.21.15.59:3300/0 conn(0x7faedc0c2ac0 0x7faedc06d3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 -- 172.21.15.33:0/2847527675 >> 172.21.15.33:0/2847527675 conn(0x7faedc0ccb60 msgr2=0x7faedc0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:37.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 -- 172.21.15.33:0/2847527675 shutdown_connections 2023-10-09T15:32:37.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.127+0000 7faee341b700 1 -- 172.21.15.33:0/2847527675 wait complete. 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.128+0000 7faee341b700 1 Processor -- start 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.128+0000 7faee341b700 1 -- start start 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faedc0af0c0 0x7faedc0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 0x7faedc0b0b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5e30 con 0x7faedc06e9d0 2023-10-09T15:32:37.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5260 con 0x7faedc0af0c0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee341b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faedc0c5500 con 0x7faedc0c2ac0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41360/0 (socket says 172.21.15.33:41360) 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 -- 172.21.15.33:0/3198395868 learned_addr learned my addr 172.21.15.33:0/3198395868 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee09b6700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faedc0af0c0 0x7faedc0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee19b8700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 0x7faedc0b0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 -- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 msgr2=0x7faedc0b0b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 0x7faedc0b0b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 -- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faedc0af0c0 msgr2=0x7faedc0c62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faedc0af0c0 0x7faedc0c62c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee11b7700 1 -- 172.21.15.33:0/3198395868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faed4009ae0 con 0x7faedc06e9d0 2023-10-09T15:32:37.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.129+0000 7faee19b8700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 0x7faedc0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faee11b7700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faed8009fa0 tx=0x7faed8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed8005a00 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed8005b60 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faedc0c57e0 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed80116d0 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.130+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faedc0afde0 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.131+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faedc0b28f0 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.131+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7faed8011ac0 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.131+0000 7faed17fa700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.131+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faed8086050 con 0x7faedc06e9d0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.132+0000 7faee09b6700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.132+0000 7faee09b6700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faedc148b10 tx=0x7faecc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.136+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faed80532c0 con 0x7faedc06e9d0 2023-10-09T15:32:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.359+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000406266", "target": ["mon-mgr", ""]}) v1 -- 0x7faedc04c3c0 con 0x7faec0066f30 2023-10-09T15:32:37.364 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:32:37.363+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:32:37.364 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:32:37.363+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:32:37.364 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:32:37.363+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:32:37.364 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:32:37.363+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:32:37.364 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:32:37.363+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:32:37.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.381+0000 7faed17fa700 1 -- 172.21.15.33:0/3198395868 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7faedc04c3c0 con 0x7faec0066f30 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 msgr2=0x7faec00693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 0x7faec00693e0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7faedc148b10 tx=0x7faecc008040 comp rx=0 tx=0).stop 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 msgr2=0x7faedc147f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7faed8009fa0 tx=0x7faed8008040 comp rx=0 tx=0).stop 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 shutdown_connections 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faec0066f30 0x7faec00693e0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faedc06e9d0 0x7faedc147f60 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faedc0c2ac0 0x7faedc0b0b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 --2- 172.21.15.33:0/3198395868 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faedc0af0c0 0x7faedc0c62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 >> 172.21.15.33:0/3198395868 conn(0x7faedc0ccb60 msgr2=0x7faedc150a50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:37.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 shutdown_connections 2023-10-09T15:32:37.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.383+0000 7faee341b700 1 -- 172.21.15.33:0/3198395868 wait complete. 2023-10-09T15:32:37.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T15:32:37.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.516+0000 7fec18bcc700 1 Processor -- start 2023-10-09T15:32:37.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.516+0000 7fec18bcc700 1 -- start start 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec18bcc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fec1406e0e0 0x7fec140cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec18bcc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec140ccfd0 con 0x7fec14159530 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec18bcc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1415a3d0 con 0x7fec1406dc70 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec18bcc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1415a6b0 con 0x7fec1406e0e0 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec1259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fec14159530 0x7fec140ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36474/0 (socket says 172.21.15.33:36474) 2023-10-09T15:32:37.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec1259c700 1 -- 172.21.15.33:0/84840375 learned_addr learned my addr 172.21.15.33:0/84840375 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec12d9d700 1 --2- 172.21.15.33:0/84840375 >> v2:172.21.15.59:3300/0 conn(0x7fec1406e0e0 0x7fec140cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 418417102 0 0) 0x7fec140ccfd0 con 0x7fec14159530 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec00003570 con 0x7fec14159530 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 553511490 0 0) 0x7fec00003570 con 0x7fec14159530 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec12d9d700 1 -- 172.21.15.33:0/84840375 >> v1:172.21.15.59:6789/0 conn(0x7fec1406dc70 legacy=0x7fec14159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec12d9d700 1 -- 172.21.15.33:0/84840375 >> v1:172.21.15.33:6789/0 conn(0x7fec14159530 legacy=0x7fec140ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.517+0000 7fec12d9d700 1 -- 172.21.15.33:0/84840375 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1415a990 con 0x7fec1406e0e0 2023-10-09T15:32:37.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec12d9d700 1 --2- 172.21.15.33:0/84840375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406e0e0 0x7fec140cb6f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0098e0 tx=0x7fec0c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9347ec22e0a28dbc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec040017f0 con 0x7fec1406e0e0 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0c011420 con 0x7fec1406e0e0 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec1159a700 1 -- 172.21.15.33:0/84840375 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0c0117c0 con 0x7fec1406e0e0 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 -- 172.21.15.33:0/84840375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406e0e0 msgr2=0x7fec140cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 --2- 172.21.15.33:0/84840375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406e0e0 0x7fec140cb6f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fec0c0098e0 tx=0x7fec0c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 -- 172.21.15.33:0/84840375 shutdown_connections 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 --2- 172.21.15.33:0/84840375 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406e0e0 0x7fec140cb6f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 -- 172.21.15.33:0/84840375 >> 172.21.15.33:0/84840375 conn(0x7fec140703a0 msgr2=0x7fec140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 -- 172.21.15.33:0/84840375 shutdown_connections 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.518+0000 7fec18bcc700 1 -- 172.21.15.33:0/84840375 wait complete. 2023-10-09T15:32:37.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.519+0000 7fec18bcc700 1 Processor -- start 2023-10-09T15:32:37.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 -- start start 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 0x7fec140c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 0x7fec140b5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec14154330 con 0x7fec1406e0e0 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec140c78a0 con 0x7fec1406dc70 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec18bcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec140c7b80 con 0x7fec14159530 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec11d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec11d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41380/0 (socket says 172.21.15.33:41380) 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.520+0000 7fec11d9b700 1 -- 172.21.15.33:0/3601319834 learned_addr learned my addr 172.21.15.33:0/3601319834 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec1259c700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 0x7fec140c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec12d9d700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 0x7fec140b5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 -- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 msgr2=0x7fec140b5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 0x7fec140b5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 -- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 msgr2=0x7fec140c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 0x7fec140c8940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 -- 172.21.15.33:0/3601319834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec0c009420 con 0x7fec1406e0e0 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec1259c700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 0x7fec140c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec12d9d700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 0x7fec140b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:37.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec11d9b700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011590 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febfc011710 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec140c7e60 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febfc011ad0 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.521+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec140c8420 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.522+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec140c8640 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.522+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7febfc01b3b0 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.523+0000 7fec0a7fc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 0x7febf40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.523+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febfc083a70 con 0x7fec1406e0e0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.523+0000 7fec1259c700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 0x7febf40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:37.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.523+0000 7fec1259c700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 0x7febf40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec040019a0 tx=0x7fec04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:37.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.527+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febfc050ce0 con 0x7fec1406e0e0 2023-10-09T15:32:37.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.748+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fec1404c3c0 con 0x7febf4066f30 2023-10-09T15:32:37.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.751+0000 7fec0a7fc700 1 -- 172.21.15.33:0/3601319834 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+528 (secure 0 0 0) 0x7fec1404c3c0 con 0x7febf4066f30 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "mon_addrs": [ 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.33:6789", 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6789", 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6790" 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "pending_subvolume_deletions": 0, 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "pools": { 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "data": [ 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:37.752 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365997129728, 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_data", 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 0 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": [ 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365997129728, 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_metadata", 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 65536 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:32:37.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:37.754 INFO:teuthology.orchestra.run.smithi033.stdout: "used_size": 0 2023-10-09T15:32:37.754 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:32:37.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 msgr2=0x7febf40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 0x7febf40693e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fec040019a0 tx=0x7fec04009040 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 msgr2=0x7fec14153df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7febfc00c4e0 tx=0x7febfc00c8a0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 shutdown_connections 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7febf4066f30 0x7febf40693e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fec14159530 0x7fec140b5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fec1406dc70 0x7fec140c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 --2- 172.21.15.33:0/3601319834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fec1406e0e0 0x7fec14153df0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 >> 172.21.15.33:0/3601319834 conn(0x7fec140703a0 msgr2=0x7fec140b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 shutdown_connections 2023-10-09T15:32:37.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:37.753+0000 7fec18bcc700 1 -- 172.21.15.33:0/3601319834 wait complete. 2023-10-09T15:32:37.765 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:32:37.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:37.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:37.843 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:32:37.843 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:32:37.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:32:37.843 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:32:37.889 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:32:37.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:37.890 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:32:37.904 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:32:37.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:32:37.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:32:37.947 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:32:37.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:32:37.948 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:32:38.006 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.124+0000 7fbad98c7700 1 Processor -- start 2023-10-09T15:32:38.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.124+0000 7fbad98c7700 1 -- start start 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad98c7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbad40cb970 0x7fbad4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad98c7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad415ae40 con 0x7fbad40cb5a0 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad98c7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbad415ab60 con 0x7fbad415a400 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad98c7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbad40ce0f0 con 0x7fbad40cb970 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad2ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbad40cb5a0 0x7fbad40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36484/0 (socket says 172.21.15.33:36484) 2023-10-09T15:32:38.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad2ffd700 1 -- 172.21.15.33:0/1740962793 learned_addr learned my addr 172.21.15.33:0/1740962793 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2119601227 0 0) 0x7fbad415ae40 con 0x7fbad40cb5a0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbac0003570 con 0x7fbad40cb5a0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad27fc700 1 --2- 172.21.15.33:0/1740962793 >> v2:172.21.15.59:3300/0 conn(0x7fbad40cb970 0x7fbad4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 427972752 0 0) 0x7fbac0003570 con 0x7fbad40cb5a0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 >> v2:172.21.15.59:3300/0 conn(0x7fbad40cb970 msgr2=0x7fbad4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 --2- 172.21.15.33:0/1740962793 >> v2:172.21.15.59:3300/0 conn(0x7fbad40cb970 0x7fbad4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 >> v1:172.21.15.59:6789/0 conn(0x7fbad415a400 legacy=0x7fbad4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40ccf00 con 0x7fbad40cb5a0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fbac40017f0 con 0x7fbad40cb5a0 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 >> v1:172.21.15.33:6789/0 conn(0x7fbad40cb5a0 legacy=0x7fbad40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbac0003a60 0x7fbac0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac0004810 0x7fbac0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 0x7fbac000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40ce0f0 con 0x7fbac00051c0 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbac000c0d0 con 0x7fbac0003a60 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.125+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbac000c290 con 0x7fbac0004810 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 0x7fbac000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad27fc700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac0004810 0x7fbac0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad2ffd700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbac0003a60 0x7fbac0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 -- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac0004810 msgr2=0x7fbac0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac0004810 0x7fbac0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 -- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbac0003a60 msgr2=0x7fbac0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbac0003a60 0x7fbac0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 -- 172.21.15.33:0/1740962793 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbac0003570 con 0x7fbac00051c0 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 -- 172.21.15.33:0/1740962793 reap_dead start 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad37fe700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 0x7fbac000ba60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0018b0 tx=0x7fbacc007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7595b5e3195b7d79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012420 con 0x7fbac00051c0 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbacc012580 con 0x7fbac00051c0 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.126+0000 7fbad1ffb700 1 -- 172.21.15.33:0/1740962793 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbacc012920 con 0x7fbac00051c0 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 -- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 msgr2=0x7fbac000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 0x7fbac000ba60 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fbacc0018b0 tx=0x7fbacc007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 -- 172.21.15.33:0/1740962793 shutdown_connections 2023-10-09T15:32:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1740962793 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbac00051c0 0x7fbac000ba60 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 -- 172.21.15.33:0/1740962793 >> 172.21.15.33:0/1740962793 conn(0x7fbad4070e30 msgr2=0x7fbad40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 -- 172.21.15.33:0/1740962793 shutdown_connections 2023-10-09T15:32:38.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.127+0000 7fbad98c7700 1 -- 172.21.15.33:0/1740962793 wait complete. 2023-10-09T15:32:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.128+0000 7fbad98c7700 1 Processor -- start 2023-10-09T15:32:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.128+0000 7fbad98c7700 1 -- start start 2023-10-09T15:32:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac00051c0 0x7fbad40b0f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad416ac60 0x7fbad415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad4153320 con 0x7fbad416caf0 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbad416e010 con 0x7fbad416ac60 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad98c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbad40c9550 con 0x7fbac00051c0 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41412/0 (socket says 172.21.15.33:41412) 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 -- 172.21.15.33:0/1193690442 learned_addr learned my addr 172.21.15.33:0/1193690442 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad2ffd700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac00051c0 0x7fbad40b0f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad37fe700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad416ac60 0x7fbad415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 -- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac00051c0 msgr2=0x7fbad40b0f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac00051c0 0x7fbad40b0f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 -- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad416ac60 msgr2=0x7fbad415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad416ac60 0x7fbad415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 -- 172.21.15.33:0/1193690442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbad40c9810 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbad27fc700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006ac0 tx=0x7fbabc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.129+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00f940 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.130+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbabc00faa0 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.130+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbabc00fe20 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.130+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbad416d770 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.130+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbad416dd30 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.130+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbad40c99a0 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.131+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 5) v1 ==== 84740+0+0 (secure 0 0 0) 0x7fbabc014650 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.131+0000 7fbacaffd700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.131+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbabc018030 con 0x7fbad416caf0 2023-10-09T15:32:38.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.131+0000 7fbad2ffd700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.132+0000 7fbad2ffd700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbad40c75e0 tx=0x7fbac40021d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.136+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbabc052160 con 0x7fbad416caf0 2023-10-09T15:32:38.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.288+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbabc052530 con 0x7fbad416caf0 2023-10-09T15:32:38.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.377+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbad4089590 con 0x7fbad416caf0 2023-10-09T15:32:38.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.378+0000 7fbacaffd700 1 -- 172.21.15.33:0/1193690442 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fbabc055bf0 con 0x7fbad416caf0 2023-10-09T15:32:38.379 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:38.379 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 msgr2=0x7fbab40693e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 0x7fbab40693e0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fbad40c75e0 tx=0x7fbac40021d0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 msgr2=0x7fbad416d090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fbabc006ac0 tx=0x7fbabc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 shutdown_connections 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbab4066f30 0x7fbab40693e0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbad416ac60 0x7fbad415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbac00051c0 0x7fbad40b0f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 --2- 172.21.15.33:0/1193690442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbad416caf0 0x7fbad416d090 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 >> 172.21.15.33:0/1193690442 conn(0x7fbad4070e30 msgr2=0x7fbad40c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 shutdown_connections 2023-10-09T15:32:38.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.380+0000 7fbad98c7700 1 -- 172.21.15.33:0/1193690442 wait complete. 2023-10-09T15:32:38.383 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2023-10-09T15:32:38.393 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:38.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.511+0000 7fce102dc700 1 Processor -- start 2023-10-09T15:32:38.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.511+0000 7fce102dc700 1 -- start start 2023-10-09T15:32:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce102dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fce08156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce102dc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0815ae40 con 0x7fce080cb970 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce102dc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce0815ab60 con 0x7fce080cb5a0 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce102dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce080ce0f0 con 0x7fce0815a5d0 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d877700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fce080cb970 0x7fce08159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36494/0 (socket says 172.21.15.33:36494) 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d877700 1 -- 172.21.15.33:0/2907393090 learned_addr learned my addr 172.21.15.33:0/2907393090 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0e879700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fce08156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 566397847 0 0) 0x7fce0815ae40 con 0x7fce080cb970 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcdf4003570 con 0x7fce080cb970 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 280748282 0 0) 0x7fcdf4003570 con 0x7fce080cb970 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 msgr2=0x7fce08156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fce08156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.512+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 >> v1:172.21.15.59:6789/0 conn(0x7fce080cb5a0 legacy=0x7fce080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce080ccf00 con 0x7fce080cb970 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fcdf8001470 con 0x7fce080cb970 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 >> v1:172.21.15.33:6789/0 conn(0x7fce080cb970 legacy=0x7fce08159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4003a90 0x7fcdf4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf4004810 0x7fcdf4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fcdf40051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080ce0f0 con 0x7fcdf4004810 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400bb60 con 0x7fcdf4003a90 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcdf400bd20 con 0x7fce0815a5d0 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf4004810 0x7fcdf4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0e078700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4003a90 0x7fcdf4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0e879700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fcdf40051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 -- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 msgr2=0x7fcdf40051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815a5d0 0x7fcdf40051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 -- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4003a90 msgr2=0x7fcdf4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4003a90 0x7fcdf4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 -- 172.21.15.33:0/2907393090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdf4003570 con 0x7fcdf4004810 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d877700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf4004810 0x7fcdf4004c80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c3c0 tx=0x7fcdf8001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3894706cd07103d8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800cc90 con 0x7fcdf4004810 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf800cdf0 con 0x7fcdf4004810 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.513+0000 7fce0d076700 1 -- 172.21.15.33:0/2907393090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8005b50 con 0x7fcdf4004810 2023-10-09T15:32:38.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 -- 172.21.15.33:0/2907393090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf4004810 msgr2=0x7fcdf4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 --2- 172.21.15.33:0/2907393090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcdf4004810 0x7fcdf4004c80 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c3c0 tx=0x7fcdf8001e50 comp rx=0 tx=0).stop 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce0e879700 1 -- 172.21.15.33:0/2907393090 reap_dead start 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 -- 172.21.15.33:0/2907393090 shutdown_connections 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 -- 172.21.15.33:0/2907393090 >> 172.21.15.33:0/2907393090 conn(0x7fce08070e30 msgr2=0x7fce080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 -- 172.21.15.33:0/2907393090 shutdown_connections 2023-10-09T15:32:38.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.514+0000 7fce102dc700 1 -- 172.21.15.33:0/2907393090 wait complete. 2023-10-09T15:32:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.515+0000 7fce102dc700 1 Processor -- start 2023-10-09T15:32:38.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.515+0000 7fce102dc700 1 -- start start 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 0x7fce0815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815dab0 0x7fce081581f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce080afb00 con 0x7fce08151df0 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce08157860 con 0x7fcdf4004810 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce102dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce08154570 con 0x7fce0815dab0 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41426/0 (socket says 172.21.15.33:41426) 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 -- 172.21.15.33:0/1372288688 learned_addr learned my addr 172.21.15.33:0/1372288688 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0e879700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815dab0 0x7fce081581f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0e078700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 0x7fce0815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 -- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815dab0 msgr2=0x7fce081581f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815dab0 0x7fce081581f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 -- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 msgr2=0x7fce0815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 0x7fce0815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 -- 172.21.15.33:0/1372288688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce08154b30 con 0x7fce08151df0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0e078700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 0x7fce0815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.516+0000 7fce0d877700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c9b0 tx=0x7fcdf8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.517+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf800cc90 con 0x7fce08151df0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.517+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdf80072e0 con 0x7fce08151df0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.517+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdf8007680 con 0x7fce08151df0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.517+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce0815bfa0 con 0x7fce08151df0 2023-10-09T15:32:38.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.517+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce08157d90 con 0x7fce08151df0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.518+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce08154cc0 con 0x7fce08151df0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.518+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fcdf8019030 con 0x7fce08151df0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.518+0000 7fcdfe7fc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 0x7fcdec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.518+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcdf8085980 con 0x7fce08151df0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.518+0000 7fce0e078700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 0x7fcdec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.519+0000 7fce0e078700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 0x7fcdec069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce04007bc0 tx=0x7fce04009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.523+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcdf8052c00 con 0x7fce08151df0 2023-10-09T15:32:38.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.716+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fce080afae0 con 0x7fce08151df0 2023-10-09T15:32:38.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.717+0000 7fcdfe7fc700 1 -- 172.21.15.33:0/1372288688 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7fcdf8017090 con 0x7fce08151df0 2023-10-09T15:32:38.718 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:38.718 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":51,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:28.239977+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 msgr2=0x7fcdec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 0x7fcdec069470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fce04007bc0 tx=0x7fce04009040 comp rx=0 tx=0).stop 2023-10-09T15:32:38.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 msgr2=0x7fce0815d570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fcdf800c9b0 tx=0x7fcdf8015000 comp rx=0 tx=0).stop 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 shutdown_connections 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcdec066fc0 0x7fcdec069470 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce0815dab0 0x7fce081581f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcdf4004810 0x7fce0815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 --2- 172.21.15.33:0/1372288688 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce08151df0 0x7fce0815d570 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 >> 172.21.15.33:0/1372288688 conn(0x7fce08070e30 msgr2=0x7fce080b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 shutdown_connections 2023-10-09T15:32:38.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.719+0000 7fce102dc700 1 -- 172.21.15.33:0/1372288688 wait complete. 2023-10-09T15:32:38.732 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:32:25.040140+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '50', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:32:25.602211+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '51', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:32:38.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:32:38.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.853+0000 7fb4a7b26700 1 Processor -- start 2023-10-09T15:32:38.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.853+0000 7fb4a7b26700 1 -- start start 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a7b26700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4a0157930 0x7fb4a00ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a7b26700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4a00cd2b0 0x7fb4a00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a7b26700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4a00c32a0 con 0x7fb4a00ca2c0 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a7b26700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00c9730 con 0x7fb4a0157930 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a7b26700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4a00c4100 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a58c2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb4a0157930 0x7fb4a00ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a50c1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb4a00ca2c0 0x7fb4a00ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36504/0 (socket says 172.21.15.33:36504) 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.854+0000 7fb4a50c1700 1 -- 172.21.15.33:0/4127225470 learned_addr learned my addr 172.21.15.33:0/4127225470 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:38.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a60c3700 1 --2- 172.21.15.33:0/4127225470 >> v2:172.21.15.59:3300/0 conn(0x7fb4a00cd2b0 0x7fb4a00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a58c2700 1 -- 172.21.15.33:0/4127225470 >> v2:172.21.15.59:3300/0 conn(0x7fb4a00cd2b0 msgr2=0x7fb4a00ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4127225470 >> v2:172.21.15.59:3300/0 conn(0x7fb4a00cd2b0 0x7fb4a00ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a58c2700 1 -- 172.21.15.33:0/4127225470 >> v1:172.21.15.33:6789/0 conn(0x7fb4a00ca2c0 legacy=0x7fb4a00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a48c0700 1 -- 172.21.15.33:0/4127225470 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2484751255 0 0) 0x7fb4a00c32a0 con 0x7fb4a00ca2c0 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a58c2700 1 -- 172.21.15.33:0/4127225470 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4a00c34f0 con 0x7fb4a0157930 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4127225470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a0157930 0x7fb4a00ab070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00650d0 tx=0x7fb490009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebd2abd1f8d5e4bc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a48c0700 1 -- 172.21.15.33:0/4127225470 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb49000e070 con 0x7fb4a0157930 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a48c0700 1 -- 172.21.15.33:0/4127225470 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb49000bc30 con 0x7fb4a0157930 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.855+0000 7fb4a48c0700 1 -- 172.21.15.33:0/4127225470 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb490012430 con 0x7fb4a0157930 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4127225470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a0157930 msgr2=0x7fb4a00ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4127225470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a0157930 0x7fb4a00ab070 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00650d0 tx=0x7fb490009780 comp rx=0 tx=0).stop 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4127225470 shutdown_connections 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4127225470 >> v2:172.21.15.59:3300/0 conn(0x7fb4a00cd2b0 0x7fb4a00ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4127225470 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a0157930 0x7fb4a00ab070 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4127225470 >> 172.21.15.33:0/4127225470 conn(0x7fb4a0088000 msgr2=0x7fb4a00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4127225470 shutdown_connections 2023-10-09T15:32:38.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.856+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4127225470 wait complete. 2023-10-09T15:32:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.857+0000 7fb4a7b26700 1 Processor -- start 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.857+0000 7fb4a7b26700 1 -- start start 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 0x7fb4a01540f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a0157930 0x7fb4a00af110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00af650 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00b3ae0 con 0x7fb4a0157930 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4a00b2c50 con 0x7fb4a00ca2c0 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41438/0 (socket says 172.21.15.33:41438) 2023-10-09T15:32:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 -- 172.21.15.33:0/4216871009 learned_addr learned my addr 172.21.15.33:0/4216871009 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 0x7fb4a01540f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a60c3700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a0157930 0x7fb4a00af110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 -- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 msgr2=0x7fb4a01540f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 0x7fb4a01540f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 -- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a0157930 msgr2=0x7fb4a00af110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a0157930 0x7fb4a00af110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 -- 172.21.15.33:0/4216871009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb490009a20 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 0x7fb4a01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a50c1700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c5b0 tx=0x7fb494001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494005b30 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb494005c90 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb494007300 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.858+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4a00b2ed0 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.859+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4a00b3510 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.860+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4a00b3c20 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.860+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb49401b3b0 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.860+0000 7fb49dffb700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 0x7fb48c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.860+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb494083a90 con 0x7fb4a00cd2b0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.860+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 0x7fb48c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:38.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.861+0000 7fb4a58c2700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 0x7fb48c069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00650d0 tx=0x7fb490019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:38.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:38.864+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb494050d10 con 0x7fb4a00cd2b0 2023-10-09T15:32:39.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.060+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb4a004c3c0 con 0x7fb4a00cd2b0 2023-10-09T15:32:39.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.061+0000 7fb49dffb700 1 -- 172.21.15.33:0/4216871009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v51) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb4940170a0 con 0x7fb4a00cd2b0 2023-10-09T15:32:39.062 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:32:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 msgr2=0x7fb48c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 0x7fb48c069470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fb4a00650d0 tx=0x7fb490019000 comp rx=0 tx=0).stop 2023-10-09T15:32:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 msgr2=0x7fb4a00aebd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb49400c5b0 tx=0x7fb494001070 comp rx=0 tx=0).stop 2023-10-09T15:32:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 shutdown_connections 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb48c066fc0 0x7fb48c069470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4a0157930 0x7fb4a00af110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4a00ca2c0 0x7fb4a01540f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 --2- 172.21.15.33:0/4216871009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4a00cd2b0 0x7fb4a00aebd0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 >> 172.21.15.33:0/4216871009 conn(0x7fb4a0088000 msgr2=0x7fb4a00c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 shutdown_connections 2023-10-09T15:32:39.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.063+0000 7fb4a7b26700 1 -- 172.21.15.33:0/4216871009 wait complete. 2023-10-09T15:32:39.076 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:32:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.198+0000 7f0548eaf700 1 Processor -- start 2023-10-09T15:32:39.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.198+0000 7f0548eaf700 1 -- start start 2023-10-09T15:32:39.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0548eaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0544159970 0x7f05440686a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0548eaf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0544068350 con 0x7f05440c9ab0 2023-10-09T15:32:39.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0548eaf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0544067740 con 0x7f05440cbbc0 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0548eaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0544067a20 con 0x7f0544159970 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0542d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f05440c9ab0 0x7f05440c7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36516/0 (socket says 172.21.15.33:36516) 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f0542d9d700 1 -- 172.21.15.33:0/3319677546 learned_addr learned my addr 172.21.15.33:0/3319677546 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054259c700 1 --2- 172.21.15.33:0/3319677546 >> v2:172.21.15.59:3300/0 conn(0x7f0544159970 0x7f05440686a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054159a700 1 -- 172.21.15.33:0/3319677546 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 149770679 0 0) 0x7f0544068350 con 0x7f05440c9ab0 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054159a700 1 -- 172.21.15.33:0/3319677546 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0530003570 con 0x7f05440c9ab0 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054259c700 1 -- 172.21.15.33:0/3319677546 >> v1:172.21.15.59:6789/0 conn(0x7f05440cbbc0 legacy=0x7f05440c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054259c700 1 -- 172.21.15.33:0/3319677546 >> v1:172.21.15.33:6789/0 conn(0x7f05440c9ab0 legacy=0x7f05440c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.199+0000 7f054259c700 1 -- 172.21.15.33:0/3319677546 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0544067d00 con 0x7f0544159970 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f054259c700 1 --2- 172.21.15.33:0/3319677546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544159970 0x7f05440686a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05340098e0 tx=0x7f05340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=54fe4316ae0a5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f054159a700 1 -- 172.21.15.33:0/3319677546 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400b640 con 0x7f0544159970 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f054159a700 1 -- 172.21.15.33:0/3319677546 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053400b7a0 con 0x7f0544159970 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f054159a700 1 -- 172.21.15.33:0/3319677546 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053400bb20 con 0x7f0544159970 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 -- 172.21.15.33:0/3319677546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544159970 msgr2=0x7f05440686a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3319677546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544159970 0x7f05440686a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f05340098e0 tx=0x7f05340091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 -- 172.21.15.33:0/3319677546 shutdown_connections 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3319677546 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0544159970 0x7f05440686a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 -- 172.21.15.33:0/3319677546 >> 172.21.15.33:0/3319677546 conn(0x7f054406e250 msgr2=0x7f05440cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 -- 172.21.15.33:0/3319677546 shutdown_connections 2023-10-09T15:32:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.200+0000 7f0548eaf700 1 -- 172.21.15.33:0/3319677546 wait complete. 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.201+0000 7f0548eaf700 1 Processor -- start 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 -- start start 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05440c9ab0 0x7f054414c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440cbbc0 0x7f054415ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05440b0780 con 0x7f0544159970 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0544159d40 con 0x7f05440cbbc0 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0548eaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f054415a880 con 0x7f05440c9ab0 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0542d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0542d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41452/0 (socket says 172.21.15.33:41452) 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.202+0000 7f0542d9d700 1 -- 172.21.15.33:0/3139903001 learned_addr learned my addr 172.21.15.33:0/3139903001 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f054259c700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05440c9ab0 0x7f054414c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0541d9b700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440cbbc0 0x7f054415ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 -- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05440c9ab0 msgr2=0x7f054414c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05440c9ab0 0x7f054414c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 -- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440cbbc0 msgr2=0x7f054415ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440cbbc0 0x7f054415ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 -- 172.21.15.33:0/3139903001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0534009420 con 0x7f0544159970 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0542d9d700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f053c001460 tx=0x7f053c001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00a890 con 0x7f0544159970 2023-10-09T15:32:39.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f053c00a9f0 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0544159f50 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f053c00ad70 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.203+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f054415a510 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.204+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f054404c3c0 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.204+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f053c007300 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.205+0000 7f053a7fc700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 0x7f0524069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.205+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f053c0849d0 con 0x7f0544159970 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.205+0000 7f054259c700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 0x7f0524069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.205+0000 7f054259c700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 0x7f0524069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05340093f0 tx=0x7f0534017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.209+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f053c051c40 con 0x7f0544159970 2023-10-09T15:32:39.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.404+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0544067fe0 con 0x7f0544159970 2023-10-09T15:32:39.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.404+0000 7f053a7fc700 1 -- 172.21.15.33:0/3139903001 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v51) v1 ==== 104+0+11 (secure 0 0 0) 0x7f053c055260 con 0x7f0544159970 2023-10-09T15:32:39.405 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:32:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 msgr2=0x7f0524069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 0x7f0524069470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f05340093f0 tx=0x7f0534017000 comp rx=0 tx=0).stop 2023-10-09T15:32:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 msgr2=0x7f0544153590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f053c001460 tx=0x7f053c001ae0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 shutdown_connections 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0524066fc0 0x7f0524069470 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0544159970 0x7f0544153590 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05440c9ab0 0x7f054414c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 --2- 172.21.15.33:0/3139903001 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05440cbbc0 0x7f054415ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 >> 172.21.15.33:0/3139903001 conn(0x7f054406e250 msgr2=0x7f0544156190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 shutdown_connections 2023-10-09T15:32:39.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.406+0000 7f0548eaf700 1 -- 172.21.15.33:0/3139903001 wait complete. 2023-10-09T15:32:39.419 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:32:39.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.540+0000 7f202c59c700 1 Processor -- start 2023-10-09T15:32:39.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.540+0000 7f202c59c700 1 -- start start 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202c59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f20240ca2c0 0x7f20240ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202c59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f20240ccba0 0x7f20240cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202c59c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20240c32a0 con 0x7f2024157930 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202c59c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240c9730 con 0x7f20240ccba0 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202c59c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20240cd560 con 0x7f20240ca2c0 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202a338700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2024157930 0x7f20240ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36528/0 (socket says 172.21.15.33:36528) 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202a338700 1 -- 172.21.15.33:0/224820300 learned_addr learned my addr 172.21.15.33:0/224820300 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.541+0000 7f202ab39700 1 --2- 172.21.15.33:0/224820300 >> v2:172.21.15.33:3300/0 conn(0x7f20240ccba0 0x7f20240cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029b37700 1 --2- 172.21.15.33:0/224820300 >> v2:172.21.15.59:3300/0 conn(0x7f20240ca2c0 0x7f20240ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029336700 1 -- 172.21.15.33:0/224820300 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 156958923 0 0) 0x7f20240c32a0 con 0x7f2024157930 2023-10-09T15:32:39.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029336700 1 -- 172.21.15.33:0/224820300 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f200c003570 con 0x7f2024157930 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f202ab39700 1 -- 172.21.15.33:0/224820300 >> v2:172.21.15.59:3300/0 conn(0x7f20240ca2c0 msgr2=0x7f20240ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f202ab39700 1 --2- 172.21.15.33:0/224820300 >> v2:172.21.15.59:3300/0 conn(0x7f20240ca2c0 0x7f20240ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f202ab39700 1 -- 172.21.15.33:0/224820300 >> v1:172.21.15.33:6789/0 conn(0x7f2024157930 legacy=0x7f20240ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f202ab39700 1 -- 172.21.15.33:0/224820300 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20240c4100 con 0x7f20240ccba0 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f202ab39700 1 --2- 172.21.15.33:0/224820300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f20240cd020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f20240677c0 tx=0x7f201c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bedde9bebac51f2f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029336700 1 -- 172.21.15.33:0/224820300 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c011630 con 0x7f20240ccba0 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029336700 1 -- 172.21.15.33:0/224820300 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201c011790 con 0x7f20240ccba0 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.542+0000 7f2029336700 1 -- 172.21.15.33:0/224820300 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201c011b30 con 0x7f20240ccba0 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 -- 172.21.15.33:0/224820300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 msgr2=0x7f20240cd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 --2- 172.21.15.33:0/224820300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f20240cd020 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f20240677c0 tx=0x7f201c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 -- 172.21.15.33:0/224820300 shutdown_connections 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 --2- 172.21.15.33:0/224820300 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f20240cd020 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 --2- 172.21.15.33:0/224820300 >> v2:172.21.15.59:3300/0 conn(0x7f20240ca2c0 0x7f20240ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 -- 172.21.15.33:0/224820300 >> 172.21.15.33:0/224820300 conn(0x7f2024088000 msgr2=0x7f20240883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 -- 172.21.15.33:0/224820300 shutdown_connections 2023-10-09T15:32:39.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.543+0000 7f202c59c700 1 -- 172.21.15.33:0/224820300 wait complete. 2023-10-09T15:32:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.544+0000 7f202c59c700 1 Processor -- start 2023-10-09T15:32:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.544+0000 7f202c59c700 1 -- start start 2023-10-09T15:32:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20240ca2c0 0x7f20240addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 0x7f20240b02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202406e700 con 0x7f20240ccba0 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f202406de40 con 0x7f20240ca2c0 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f202406e0b0 con 0x7f2024157930 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41468/0 (socket says 172.21.15.33:41468) 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 -- 172.21.15.33:0/1372262497 learned_addr learned my addr 172.21.15.33:0/1372262497 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202a338700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20240ca2c0 0x7f20240addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202ab39700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 0x7f20240b02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 -- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 msgr2=0x7f20240b02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 0x7f20240b02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 -- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20240ca2c0 msgr2=0x7f20240addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20240ca2c0 0x7f20240addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 -- 172.21.15.33:0/1372262497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f201c009420 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202ab39700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 0x7f20240b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f2029b37700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f201800d8c0 tx=0x7f2018008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800de60 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f201800b780 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f202406e390 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f201800bb20 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.545+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20240b0d40 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.546+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f202406e8b0 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.547+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f201801e460 con 0x7f20240ccba0 2023-10-09T15:32:39.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.547+0000 7f20227fc700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.547+0000 7f202a338700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.547+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2018084c00 con 0x7f20240ccba0 2023-10-09T15:32:39.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.548+0000 7f202a338700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 0x7f2010069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2014005c50 tx=0x7f2014009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.552+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f202406e8b0 con 0x7f20240ccba0 2023-10-09T15:32:39.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.743+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f202406a530 con 0x7f20240ccba0 2023-10-09T15:32:39.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.743+0000 7f20227fc700 1 -- 172.21.15.33:0/1372262497 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v51) v1 ==== 100+0+11 (secure 0 0 0) 0x7f201808a020 con 0x7f20240ccba0 2023-10-09T15:32:39.744 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 msgr2=0x7f2010069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 0x7f2010069470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2014005c50 tx=0x7f2014009040 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 msgr2=0x7f2024151fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f201800d8c0 tx=0x7f2018008040 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 shutdown_connections 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2010066fc0 0x7f2010069470 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2024157930 0x7f20240b02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f20240ca2c0 0x7f20240addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 --2- 172.21.15.33:0/1372262497 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f20240ccba0 0x7f2024151fc0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 >> 172.21.15.33:0/1372262497 conn(0x7f2024088000 msgr2=0x7f20241554c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 shutdown_connections 2023-10-09T15:32:39.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.745+0000 7f202c59c700 1 -- 172.21.15.33:0/1372262497 wait complete. 2023-10-09T15:32:39.758 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.876+0000 7f3df4361700 1 Processor -- start 2023-10-09T15:32:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.876+0000 7f3df4361700 1 -- start start 2023-10-09T15:32:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df4361700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dec0cb970 0x7f3dec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df4361700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec15ae40 con 0x7f3dec15a400 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df4361700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dec15ab60 con 0x7f3dec0cb5a0 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df4361700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dec0ce0f0 con 0x7f3dec0cb970 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df18fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dec0cb970 0x7f3dec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df28fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3dec15a400 0x7f3dec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36532/0 (socket says 172.21.15.33:36532) 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.877+0000 7f3df28fe700 1 -- 172.21.15.33:0/2539841998 learned_addr learned my addr 172.21.15.33:0/2539841998 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df18fc700 1 -- 172.21.15.33:0/2539841998 >> v1:172.21.15.59:6789/0 conn(0x7f3dec0cb5a0 legacy=0x7f3dec0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df18fc700 1 -- 172.21.15.33:0/2539841998 >> v1:172.21.15.33:6789/0 conn(0x7f3dec15a400 legacy=0x7f3dec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df18fc700 1 -- 172.21.15.33:0/2539841998 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dec0ccf00 con 0x7f3dec0cb970 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df18fc700 1 --2- 172.21.15.33:0/2539841998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec0cb970 0x7f3dec159ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3de00098e0 tx=0x7f3de00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ad7bdffe897aba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df10fb700 1 -- 172.21.15.33:0/2539841998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de0009e80 con 0x7f3dec0cb970 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df10fb700 1 -- 172.21.15.33:0/2539841998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de000b860 con 0x7f3dec0cb970 2023-10-09T15:32:39.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df10fb700 1 -- 172.21.15.33:0/2539841998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de000bbe0 con 0x7f3dec0cb970 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df4361700 1 -- 172.21.15.33:0/2539841998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec0cb970 msgr2=0x7f3dec159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.878+0000 7f3df4361700 1 --2- 172.21.15.33:0/2539841998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec0cb970 0x7f3dec159ec0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f3de00098e0 tx=0x7f3de00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.879+0000 7f3df4361700 1 -- 172.21.15.33:0/2539841998 shutdown_connections 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.879+0000 7f3df4361700 1 --2- 172.21.15.33:0/2539841998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec0cb970 0x7f3dec159ec0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.879+0000 7f3df4361700 1 -- 172.21.15.33:0/2539841998 >> 172.21.15.33:0/2539841998 conn(0x7f3dec070e30 msgr2=0x7f3dec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.879+0000 7f3df4361700 1 -- 172.21.15.33:0/2539841998 shutdown_connections 2023-10-09T15:32:39.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.879+0000 7f3df4361700 1 -- 172.21.15.33:0/2539841998 wait complete. 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 Processor -- start 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 -- start start 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dec0cb5a0 0x7f3dec153d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 0x7f3dec15d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec154260 con 0x7f3dec15a400 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec156de0 con 0x7f3dec0cb970 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.880+0000 7f3df4361700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dec1570c0 con 0x7f3dec0cb5a0 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41478/0 (socket says 172.21.15.33:41478) 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 -- 172.21.15.33:0/2053962829 learned_addr learned my addr 172.21.15.33:0/2053962829 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df18fc700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 0x7f3dec15d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df20fd700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dec0cb5a0 0x7f3dec153d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 -- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dec0cb5a0 msgr2=0x7f3dec153d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dec0cb5a0 0x7f3dec153d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 -- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 msgr2=0x7f3dec15d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 0x7f3dec15d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:39.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 -- 172.21.15.33:0/2053962829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3de0009420 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df18fc700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 0x7f3dec15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df28fe700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c560 tx=0x7f3de4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de4005b30 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3de4005c90 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dec1573a0 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3de40072e0 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.881+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dec157ba0 con 0x7f3dec15a400 2023-10-09T15:32:39.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.882+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dec04c3c0 con 0x7f3dec15a400 2023-10-09T15:32:39.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.883+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f3de4007690 con 0x7f3dec15a400 2023-10-09T15:32:39.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.883+0000 7f3dea7fc700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 0x7f3dd8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:39.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.883+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3de40838b0 con 0x7f3dec15a400 2023-10-09T15:32:39.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.883+0000 7f3df20fd700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 0x7f3dd8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:39.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.884+0000 7f3df20fd700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 0x7f3dd8069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc007fd0 tx=0x7f3ddc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:39.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:39.887+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3de404b5a0 con 0x7f3dec15a400 2023-10-09T15:32:40.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.127+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3dec15e0a0 con 0x7f3dec15a400 2023-10-09T15:32:40.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.127+0000 7f3dea7fc700 1 -- 172.21.15.33:0/2053962829 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4594 (secure 0 0 0) 0x7f3de4017090 con 0x7f3dec15a400 2023-10-09T15:32:40.128 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:40.128 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:40.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 msgr2=0x7f3dd8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 0x7f3dd8069470 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f3ddc007fd0 tx=0x7f3ddc009040 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 msgr2=0x7f3dec15d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f3de400c560 tx=0x7f3de4007f60 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 shutdown_connections 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dd8066fc0 0x7f3dd8069470 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dec15a400 0x7f3dec15d700 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dec0cb5a0 0x7f3dec153d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 --2- 172.21.15.33:0/2053962829 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dec0cb970 0x7f3dec15d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 >> 172.21.15.33:0/2053962829 conn(0x7f3dec070e30 msgr2=0x7f3dec0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 shutdown_connections 2023-10-09T15:32:40.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.129+0000 7f3df4361700 1 -- 172.21.15.33:0/2053962829 wait complete. 2023-10-09T15:32:40.132 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2023-10-09T15:32:40.142 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.261+0000 7f76e672d700 1 Processor -- start 2023-10-09T15:32:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.261+0000 7f76e672d700 1 -- start start 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e672d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76e0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e672d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e015ae40 con 0x7f76e015a400 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e672d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76e015ab60 con 0x7f76e00cb5a0 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e672d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00ce0f0 con 0x7f76e00cb970 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e4cca700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f76e015a400 0x7f76e0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36538/0 (socket says 172.21.15.33:36538) 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e4cca700 1 -- 172.21.15.33:0/3079224837 learned_addr learned my addr 172.21.15.33:0/3079224837 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:40.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76df7fe700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76e0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075258461 0 0) 0x7f76e015ae40 con 0x7f76e015a400 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76cc003570 con 0x7f76e015a400 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3807461411 0 0) 0x7f76cc003570 con 0x7f76e015a400 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 msgr2=0x7f76e0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76e0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 >> v1:172.21.15.59:6789/0 conn(0x7f76e00cb5a0 legacy=0x7f76e00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e00ccf00 con 0x7f76e015a400 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f76d80017f0 con 0x7f76e015a400 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 >> v1:172.21.15.33:6789/0 conn(0x7f76e015a400 legacy=0x7f76e0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76cc003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc004010 0x7f76cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76cc004d50 0x7f76cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00ce0f0 con 0x7f76cc004d50 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc00bbf0 con 0x7f76cc004010 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76cc00bdb0 con 0x7f76e00cb970 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.262+0000 7f76e4cca700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76cc004d50 0x7f76cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76dffff700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76cc003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76df7fe700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc004010 0x7f76cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 -- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 msgr2=0x7f76cc003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00cb970 0x7f76cc003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 -- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc004010 msgr2=0x7f76cc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76cc004010 0x7f76cc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 -- 172.21.15.33:0/3079224837 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76cc003570 con 0x7f76cc004d50 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e4cca700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76cc004d50 0x7f76cc0051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f76d800a900 tx=0x7f76d80021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c90a24324d77ee8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80070d0 con 0x7f76cc004d50 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76d8007230 con 0x7f76cc004d50 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76deffd700 1 -- 172.21.15.33:0/3079224837 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76d80075f0 con 0x7f76cc004d50 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e672d700 1 -- 172.21.15.33:0/3079224837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76cc004d50 msgr2=0x7f76cc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.263+0000 7f76e672d700 1 --2- 172.21.15.33:0/3079224837 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76cc004d50 0x7f76cc0051c0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f76d800a900 tx=0x7f76d80021d0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.264+0000 7f76e4cca700 1 -- 172.21.15.33:0/3079224837 reap_dead start 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.264+0000 7f76e672d700 1 -- 172.21.15.33:0/3079224837 shutdown_connections 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.264+0000 7f76e672d700 1 -- 172.21.15.33:0/3079224837 >> 172.21.15.33:0/3079224837 conn(0x7f76e0070e30 msgr2=0x7f76e00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.264+0000 7f76e672d700 1 -- 172.21.15.33:0/3079224837 shutdown_connections 2023-10-09T15:32:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.264+0000 7f76e672d700 1 -- 172.21.15.33:0/3079224837 wait complete. 2023-10-09T15:32:40.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.265+0000 7f76e672d700 1 Processor -- start 2023-10-09T15:32:40.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.265+0000 7f76e672d700 1 -- start start 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e0153470 0x7f76e015b860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00c9080 0x7f76e00c94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00cbde0 con 0x7f76e01530a0 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76e00c9a30 con 0x7f76e0153470 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76e015ca10 con 0x7f76e00c9080 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41490/0 (socket says 172.21.15.33:41490) 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 -- 172.21.15.33:0/3256187484 learned_addr learned my addr 172.21.15.33:0/3256187484 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76df7fe700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e0153470 0x7f76e015b860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e4cca700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00c9080 0x7f76e00c94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 -- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00c9080 msgr2=0x7f76e00c94f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00c9080 0x7f76e00c94f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 -- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e0153470 msgr2=0x7f76e015b860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e0153470 0x7f76e015b860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 -- 172.21.15.33:0/3256187484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76e016a250 con 0x7f76e01530a0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76dffff700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c8002950 tx=0x7f76c8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800f8d0 con 0x7f76e01530a0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800fa30 con 0x7f76e01530a0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76e015be90 con 0x7f76e01530a0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800fdf0 con 0x7f76e01530a0 2023-10-09T15:32:40.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.266+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76e015c450 con 0x7f76e01530a0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.267+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76e004c3c0 con 0x7f76e01530a0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.268+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f76c8013600 con 0x7f76e01530a0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.268+0000 7f76d7fff700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 0x7f76c0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.268+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76c8084a00 con 0x7f76e01530a0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.268+0000 7f76df7fe700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 0x7f76c0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.269+0000 7f76df7fe700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 0x7f76c0069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c9dd0 tx=0x7f76d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.272+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76c8051d30 con 0x7f76e01530a0 2023-10-09T15:32:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.465+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76e01540b0 con 0x7f76e01530a0 2023-10-09T15:32:40.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.466+0000 7f76d7fff700 1 -- 172.21.15.33:0/3256187484 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f76c8055350 con 0x7f76e01530a0 2023-10-09T15:32:40.467 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:40.467 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":51,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:28.239977+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 msgr2=0x7f76c0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 0x7f76c0069470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f76e00c9dd0 tx=0x7f76d0008040 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 msgr2=0x7f76e015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7f76c8002950 tx=0x7f76c8007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 shutdown_connections 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76c0066fc0 0x7f76c0069470 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76e01530a0 0x7f76e015b320 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76e00c9080 0x7f76e00c94f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 --2- 172.21.15.33:0/3256187484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76e0153470 0x7f76e015b860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 >> 172.21.15.33:0/3256187484 conn(0x7f76e0070e30 msgr2=0x7f76e00b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 shutdown_connections 2023-10-09T15:32:40.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.468+0000 7f76e672d700 1 -- 172.21.15.33:0/3256187484 wait complete. 2023-10-09T15:32:40.482 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:32:40.482 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.599+0000 7fbf90a54700 1 Processor -- start 2023-10-09T15:32:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.599+0000 7fbf90a54700 1 -- start start 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf90a54700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbf8c067e00 0x7fbf8c068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf90a54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf8c15d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf90a54700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbf8c0687b0 con 0x7fbf8c153d20 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf90a54700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbf8c15e280 con 0x7fbf8c067e00 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf90a54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c06b7a0 con 0x7fbf8c15d290 2023-10-09T15:32:40.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf8ad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbf8c153d20 0x7fbf8c06b090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36552/0 (socket says 172.21.15.33:36552) 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.600+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/2291738269 learned_addr learned my addr 172.21.15.33:0/2291738269 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1328624302 0 0) 0x7fbf8c0687b0 con 0x7fbf8c153d20 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8a59c700 1 --2- 172.21.15.33:0/2291738269 >> v2:172.21.15.59:3300/0 conn(0x7fbf8c067e00 0x7fbf8c068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbf78003570 con 0x7fbf8c153d20 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8b59e700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf8c15d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2121403907 0 0) 0x7fbf78003570 con 0x7fbf8c153d20 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 msgr2=0x7fbf8c15d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf8c15d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 >> v2:172.21.15.59:3300/0 conn(0x7fbf8c067e00 msgr2=0x7fbf8c068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 --2- 172.21.15.33:0/2291738269 >> v2:172.21.15.59:3300/0 conn(0x7fbf8c067e00 0x7fbf8c068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c15dfa0 con 0x7fbf8c153d20 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fbf840017f0 con 0x7fbf8c153d20 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 >> v1:172.21.15.33:6789/0 conn(0x7fbf8c153d20 legacy=0x7fbf8c06b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf78003ae0 0x7fbf78003ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78004810 0x7fbf78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf780051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c15e280 con 0x7fbf78003ae0 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c06b7a0 con 0x7fbf78004810 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf7800bb10 con 0x7fbf8c15d290 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf78003ae0 0x7fbf78003ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8a59c700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78004810 0x7fbf78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8b59e700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf780051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 msgr2=0x7fbf780051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c15d290 0x7fbf780051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78004810 msgr2=0x7fbf78004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78004810 0x7fbf78004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.601+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/2291738269 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf78003570 con 0x7fbf78003ae0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf78003ae0 0x7fbf78003ef0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400a8a0 tx=0x7fbf84002140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd94cf7ff3354aa7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840070f0 con 0x7fbf78003ae0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84007270 con 0x7fbf78003ae0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf89d9b700 1 -- 172.21.15.33:0/2291738269 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84007630 con 0x7fbf78003ae0 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 -- 172.21.15.33:0/2291738269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf78003ae0 msgr2=0x7fbf78003ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 --2- 172.21.15.33:0/2291738269 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf78003ae0 0x7fbf78003ef0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400a8a0 tx=0x7fbf84002140 comp rx=0 tx=0).stop 2023-10-09T15:32:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf8b59e700 1 -- 172.21.15.33:0/2291738269 reap_dead start 2023-10-09T15:32:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 -- 172.21.15.33:0/2291738269 shutdown_connections 2023-10-09T15:32:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 -- 172.21.15.33:0/2291738269 >> 172.21.15.33:0/2291738269 conn(0x7fbf8c0cca00 msgr2=0x7fbf8c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 -- 172.21.15.33:0/2291738269 shutdown_connections 2023-10-09T15:32:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.602+0000 7fbf90a54700 1 -- 172.21.15.33:0/2291738269 wait complete. 2023-10-09T15:32:40.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 Processor -- start 2023-10-09T15:32:40.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 -- start start 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 0x7fbf8c14e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c157f50 0x7fbf8c1583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 0x7fbf8c0b0380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c0b1270 con 0x7fbf8c0aff10 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c158900 con 0x7fbf78003ae0 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf90a54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbf8c155ad0 con 0x7fbf8c157f50 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.604+0000 7fbf8b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 0x7fbf8c0b0380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 0x7fbf8c14e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 0x7fbf8c0b0380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41502/0 (socket says 172.21.15.33:41502) 2023-10-09T15:32:40.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8b59e700 1 -- 172.21.15.33:0/3437693533 learned_addr learned my addr 172.21.15.33:0/3437693533 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8a59c700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c157f50 0x7fbf8c1583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c157f50 msgr2=0x7fbf8c1583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c157f50 0x7fbf8c1583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 msgr2=0x7fbf8c0b0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 0x7fbf8c0b0380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 -- 172.21.15.33:0/3437693533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf8c0b0cb0 con 0x7fbf78003ae0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf8ad9d700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 0x7fbf8c14e870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400a870 tx=0x7fbf84016000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf84007070 con 0x7fbf78003ae0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf84000f40 con 0x7fbf78003ae0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf8c0b0f90 con 0x7fbf78003ae0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf840016f0 con 0x7fbf78003ae0 2023-10-09T15:32:40.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.605+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf8c0abe50 con 0x7fbf78003ae0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.606+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf8c1555c0 con 0x7fbf78003ae0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.607+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fbf84025020 con 0x7fbf78003ae0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.607+0000 7fbf82ffd700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 0x7fbf6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.607+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbf84086ad0 con 0x7fbf78003ae0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.607+0000 7fbf8a59c700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 0x7fbf6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.608+0000 7fbf8a59c700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 0x7fbf6c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c158c60 tx=0x7fbf740091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.612+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbf84053d50 con 0x7fbf78003ae0 2023-10-09T15:32:40.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.850+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbf8c1555c0 con 0x7fbf78003ae0 2023-10-09T15:32:40.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.852+0000 7fbf82ffd700 1 -- 172.21.15.33:0/3437693533 <== mon.1 v2:172.21.15.59:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fbf8c1555c0 con 0x7fbf78003ae0 2023-10-09T15:32:40.852 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:40.852 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:40.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 msgr2=0x7fbf6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 0x7fbf6c069470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fbf8c158c60 tx=0x7fbf740091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 msgr2=0x7fbf8c14e870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 0x7fbf8c14e870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fbf8400a870 tx=0x7fbf84016000 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 shutdown_connections 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbf6c066fc0 0x7fbf6c069470 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbf8c0aff10 0x7fbf8c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbf78003ae0 0x7fbf8c14e870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 --2- 172.21.15.33:0/3437693533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbf8c157f50 0x7fbf8c1583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 >> 172.21.15.33:0/3437693533 conn(0x7fbf8c0cca00 msgr2=0x7fbf8c14f7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 shutdown_connections 2023-10-09T15:32:40.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.853+0000 7fbf90a54700 1 -- 172.21.15.33:0/3437693533 wait complete. 2023-10-09T15:32:40.856 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2023-10-09T15:32:40.866 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:40.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.984+0000 7fc0fb0d4700 1 Processor -- start 2023-10-09T15:32:40.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.984+0000 7fc0fb0d4700 1 -- start start 2023-10-09T15:32:40.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fb0d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fb0d4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc0f40cf110 0x7fc0f415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fb0d4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0f415afd0 con 0x7fc0f415de50 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fb0d4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0f415b2b0 con 0x7fc0f40cf110 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fb0d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f415b590 con 0x7fc0f4153c30 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0f98d1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc0f415de50 0x7fc0f40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50840/0 (socket says 172.21.15.33:50840) 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0f98d1700 1 -- 172.21.15.33:0/3277985670 learned_addr learned my addr 172.21.15.33:0/3277985670 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fa8d3700 1 --2- 172.21.15.33:0/3277985670 >> v2:172.21.15.59:3300/0 conn(0x7fc0f40cf110 0x7fc0f415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0fa0d2700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0f90d0700 1 -- 172.21.15.33:0/3277985670 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2386622562 0 0) 0x7fc0f415afd0 con 0x7fc0f415de50 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.985+0000 7fc0f90d0700 1 -- 172.21.15.33:0/3277985670 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0dc003570 con 0x7fc0f415de50 2023-10-09T15:32:40.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa8d3700 1 -- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 msgr2=0x7fc0f415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa8d3700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa8d3700 1 -- 172.21.15.33:0/3277985670 >> v1:172.21.15.33:6789/0 conn(0x7fc0f415de50 legacy=0x7fc0f40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa8d3700 1 -- 172.21.15.33:0/3277985670 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f415b870 con 0x7fc0f40cf110 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa0d2700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fa8d3700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f40cf110 0x7fc0f415c070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0098e0 tx=0x7fc0ec0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2b6afa764b1777f1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0f90d0700 1 -- 172.21.15.33:0/3277985670 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec011630 con 0x7fc0f40cf110 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0f90d0700 1 -- 172.21.15.33:0/3277985670 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0ec011790 con 0x7fc0f40cf110 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0f90d0700 1 -- 172.21.15.33:0/3277985670 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0ec011b30 con 0x7fc0f40cf110 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f40cf110 msgr2=0x7fc0f415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.986+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f40cf110 0x7fc0f415c070 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fc0ec0098e0 tx=0x7fc0ec0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/3277985670 shutdown_connections 2023-10-09T15:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f40cf110 0x7fc0f415c070 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/3277985670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/3277985670 >> 172.21.15.33:0/3277985670 conn(0x7fc0f40703a0 msgr2=0x7fc0f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/3277985670 shutdown_connections 2023-10-09T15:32:40.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.987+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/3277985670 wait complete. 2023-10-09T15:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 Processor -- start 2023-10-09T15:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 -- start start 2023-10-09T15:32:40.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f40c8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f415de50 0x7fc0f40b3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f40b59a0 con 0x7fc0f40cf110 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f4146560 con 0x7fc0f415de50 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.988+0000 7fc0fb0d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f416d350 con 0x7fc0f4153c30 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34590/0 (socket says 172.21.15.33:34590) 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 -- 172.21.15.33:0/89796190 learned_addr learned my addr 172.21.15.33:0/89796190 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0f98d1700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f40c8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa8d3700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f415de50 0x7fc0f40b3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 -- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 msgr2=0x7fc0f40c8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f40c8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 -- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f415de50 msgr2=0x7fc0f40b3ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f415de50 0x7fc0f40b3ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 -- 172.21.15.33:0/89796190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e4009a20 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fa0d2700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c1a0 tx=0x7fc0e400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e400cde0 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0e400f040 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0e4014690 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0ec009420 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.989+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0f416a7c0 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.990+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0f415dab0 con 0x7fc0f40cf110 2023-10-09T15:32:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.990+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc0e4014a00 con 0x7fc0f40cf110 2023-10-09T15:32:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.991+0000 7fc0f27fc700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 0x7fc0e0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.991+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc0e4085540 con 0x7fc0f40cf110 2023-10-09T15:32:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.991+0000 7fc0f98d1700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 0x7fc0e0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.991+0000 7fc0f98d1700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 0x7fc0e0069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ce6b0 tx=0x7fc0e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:40.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:40.995+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0e40526b0 con 0x7fc0f40cf110 2023-10-09T15:32:41.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.230+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc0f40cfbe0 con 0x7fc0f40cf110 2023-10-09T15:32:41.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.230+0000 7fc0f27fc700 1 -- 172.21.15.33:0/89796190 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) v1 ==== 94+0+4594 (secure 0 0 0) 0x7fc0e4014cb0 con 0x7fc0f40cf110 2023-10-09T15:32:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:41.232 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":31,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:26.642767+0000","modified":"2023-10-09T15:32:30.256774+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5376},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5376":{"gid":5376,"name":"b","rank":0,"incarnation":26,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2234768428","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2234768428},{"type":"v1","addr":"172.21.15.59:6835","nonce":2234768428}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":4}]} 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.232+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 msgr2=0x7fc0e0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.232+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 0x7fc0e0069470 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fc0f40ce6b0 tx=0x7fc0e8009040 comp rx=0 tx=0).stop 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.232+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 msgr2=0x7fc0f4146020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.232+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fc0e400c1a0 tx=0x7fc0e400b040 comp rx=0 tx=0).stop 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 shutdown_connections 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc0e0066fc0 0x7fc0e0069470 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0f40cf110 0x7fc0f4146020 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0f415de50 0x7fc0f40b3ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 --2- 172.21.15.33:0/89796190 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0f4153c30 0x7fc0f40c8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 >> 172.21.15.33:0/89796190 conn(0x7fc0f40703a0 msgr2=0x7fc0f4070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 shutdown_connections 2023-10-09T15:32:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.233+0000 7fc0fb0d4700 1 -- 172.21.15.33:0/89796190 wait complete. 2023-10-09T15:32:41.235 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 31 2023-10-09T15:32:41.246 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.364+0000 7f2853a36700 1 Processor -- start 2023-10-09T15:32:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.364+0000 7f2853a36700 1 -- start start 2023-10-09T15:32:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2853a36700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f284c1579d0 0x7f284c1629e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2853a36700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c158210 con 0x7f284c0b1b20 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2853a36700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c0cb290 con 0x7f284c157600 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2853a36700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0cb850 con 0x7f284c1579d0 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2851fd3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f284c1579d0 0x7f284c1629e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2850fd1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f284c0b1b20 0x7f284c15f2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50850/0 (socket says 172.21.15.33:50850) 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2850fd1700 1 -- 172.21.15.33:0/897503835 learned_addr learned my addr 172.21.15.33:0/897503835 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2851fd3700 1 -- 172.21.15.33:0/897503835 >> v1:172.21.15.59:6789/0 conn(0x7f284c157600 legacy=0x7f284c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2851fd3700 1 -- 172.21.15.33:0/897503835 >> v1:172.21.15.33:6789/0 conn(0x7f284c0b1b20 legacy=0x7f284c15f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f284bfff700 1 -- 172.21.15.33:0/897503835 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554202623 0 0) 0x7f284c158210 con 0x7f284c0b1b20 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2851fd3700 1 -- 172.21.15.33:0/897503835 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c0cb570 con 0x7f284c1579d0 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f2851fd3700 1 --2- 172.21.15.33:0/897503835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c1579d0 0x7f284c1629e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f28440098e0 tx=0x7f28440091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b300c0f7210cf1d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.365+0000 7f284bfff700 1 -- 172.21.15.33:0/897503835 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2844009e80 con 0x7f284c1579d0 2023-10-09T15:32:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f284bfff700 1 -- 172.21.15.33:0/897503835 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f284400b820 con 0x7f284c1579d0 2023-10-09T15:32:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f284bfff700 1 -- 172.21.15.33:0/897503835 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284400bba0 con 0x7f284c1579d0 2023-10-09T15:32:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 -- 172.21.15.33:0/897503835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c1579d0 msgr2=0x7f284c1629e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 --2- 172.21.15.33:0/897503835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c1579d0 0x7f284c1629e0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f28440098e0 tx=0x7f28440091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 -- 172.21.15.33:0/897503835 shutdown_connections 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 --2- 172.21.15.33:0/897503835 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c1579d0 0x7f284c1629e0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 -- 172.21.15.33:0/897503835 >> 172.21.15.33:0/897503835 conn(0x7f284c06d170 msgr2=0x7f284c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 -- 172.21.15.33:0/897503835 shutdown_connections 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.366+0000 7f2853a36700 1 -- 172.21.15.33:0/897503835 wait complete. 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.367+0000 7f2853a36700 1 Processor -- start 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.367+0000 7f2853a36700 1 -- start start 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f284c0b1b20 0x7f284c0adb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 0x7f284c1451c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c143fa0 con 0x7f284c157600 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c143390 con 0x7f284c1579d0 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2853a36700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c143670 con 0x7f284c0b1b20 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2850fd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2850fd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34606/0 (socket says 172.21.15.33:34606) 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2850fd1700 1 -- 172.21.15.33:0/3470344411 learned_addr learned my addr 172.21.15.33:0/3470344411 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f2851fd3700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 0x7f284c1451c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.368+0000 7f28517d2700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f284c0b1b20 0x7f284c0adb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 -- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f284c0b1b20 msgr2=0x7f284c0adb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f284c0b1b20 0x7f284c0adb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 -- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 msgr2=0x7f284c1451c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 0x7f284c1451c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 -- 172.21.15.33:0/3470344411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2844009420 con 0x7f284c157600 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2851fd3700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 0x7f284c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2850fd1700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f284000c7e0 tx=0x7f2840007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840005b30 con 0x7f284c157600 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2840005c90 con 0x7f284c157600 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f284c143950 con 0x7f284c157600 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2840007300 con 0x7f284c157600 2023-10-09T15:32:41.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.369+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c0ae0c0 con 0x7f284c157600 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.370+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c144150 con 0x7f284c157600 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.370+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f284001b400 con 0x7f284c157600 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.371+0000 7f28497fa700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 0x7f2838069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.371+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2840084000 con 0x7f284c157600 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.371+0000 7f28517d2700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 0x7f2838069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.371+0000 7f28517d2700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 0x7f2838069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f283c007fd0 tx=0x7f283c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.375+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f284c144150 con 0x7f284c157600 2023-10-09T15:32:41.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.568+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f284c04c3c0 con 0x7f284c157600 2023-10-09T15:32:41.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.569+0000 7f28497fa700 1 -- 172.21.15.33:0/3470344411 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v51) v1 ==== 74+0+15302 (secure 0 0 0) 0x7f2840054d90 con 0x7f284c157600 2023-10-09T15:32:41.570 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:41.570 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":51,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:28.239977+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:25.040140+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"50","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:25.602211+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"51","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:41.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.570+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 msgr2=0x7f2838069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.570+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 0x7f2838069470 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f283c007fd0 tx=0x7f283c009040 comp rx=0 tx=0).stop 2023-10-09T15:32:41.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.570+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 msgr2=0x7f284c144430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.570+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f284000c7e0 tx=0x7f2840007df0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 shutdown_connections 2023-10-09T15:32:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2838066fc0 0x7f2838069470 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f284c1579d0 0x7f284c1451c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f284c0b1b20 0x7f284c0adb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 --2- 172.21.15.33:0/3470344411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f284c157600 0x7f284c144430 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 >> 172.21.15.33:0/3470344411 conn(0x7f284c06d170 msgr2=0x7f284c0c8320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:41.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 shutdown_connections 2023-10-09T15:32:41.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.571+0000 7f2853a36700 1 -- 172.21.15.33:0/3470344411 wait complete. 2023-10-09T15:32:41.584 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:32:41.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.702+0000 7f3160385700 1 Processor -- start 2023-10-09T15:32:41.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.702+0000 7f3160385700 1 -- start start 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.703+0000 7f3160385700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31580cb970 0x7f3158159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.703+0000 7f3160385700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 0x7f3158156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.703+0000 7f3160385700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f315815ae40 con 0x7f31580cb5a0 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.703+0000 7f3160385700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31580ce0f0 con 0x7f31580cb970 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.703+0000 7f3160385700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31580d13f0 con 0x7f315815a400 2023-10-09T15:32:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f31580cb970 0x7f3158159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315e922700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 0x7f3158156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315e121700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f31580cb5a0 0x7f31580cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:41904/0 (socket says 172.21.15.33:41904) 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315e121700 1 -- 172.21.15.33:0/1045473633 learned_addr learned my addr 172.21.15.33:0/1045473633 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 --2- 172.21.15.33:0/1045473633 >> v2:172.21.15.59:3300/0 conn(0x7f31580cb970 0x7f3158159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:52678/0 (socket says 172.21.15.33:52678) 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315e922700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 0x7f3158156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:56984/0 (socket says 172.21.15.33:56984) 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 -- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 msgr2=0x7f3158156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 0x7f3158156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 -- 172.21.15.33:0/1045473633 >> v1:172.21.15.59:6789/0 conn(0x7f31580cb5a0 legacy=0x7f31580cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d11f700 1 -- 172.21.15.33:0/1045473633 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1020691580 0 0) 0x7f315815ae40 con 0x7f31580cb5a0 2023-10-09T15:32:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 -- 172.21.15.33:0/1045473633 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f315815ab60 con 0x7f31580cb970 2023-10-09T15:32:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d920700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31580cb970 0x7f3158159ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f314c0098e0 tx=0x7f314c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=76f8efb9c6a33c0c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d11f700 1 -- 172.21.15.33:0/1045473633 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00b640 con 0x7f31580cb970 2023-10-09T15:32:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.704+0000 7f315d11f700 1 -- 172.21.15.33:0/1045473633 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f314c00b7a0 con 0x7f31580cb970 2023-10-09T15:32:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f315d11f700 1 -- 172.21.15.33:0/1045473633 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f314c00bb40 con 0x7f31580cb970 2023-10-09T15:32:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 -- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31580cb970 msgr2=0x7f3158159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31580cb970 0x7f3158159ec0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f314c0098e0 tx=0x7f314c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 -- 172.21.15.33:0/1045473633 shutdown_connections 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f315815a400 0x7f3158156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 --2- 172.21.15.33:0/1045473633 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f31580cb970 0x7f3158159ec0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 -- 172.21.15.33:0/1045473633 >> 172.21.15.33:0/1045473633 conn(0x7f3158070e30 msgr2=0x7f31580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 -- 172.21.15.33:0/1045473633 shutdown_connections 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.705+0000 7f3160385700 1 -- 172.21.15.33:0/1045473633 wait complete. 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.706+0000 7f3160385700 1 Processor -- start 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.706+0000 7f3160385700 1 -- start start 2023-10-09T15:32:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31580cb970 0x7f3158157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315815a400 0x7f31581555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315815dec0 con 0x7f31580cb5a0 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f315815d4f0 con 0x7f315815a400 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f3160385700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3158158430 con 0x7f31580cb970 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34616/0 (socket says 172.21.15.33:34616) 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 -- 172.21.15.33:0/3861532679 learned_addr learned my addr 172.21.15.33:0/3861532679 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315d920700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31580cb970 0x7f3158157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e922700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315815a400 0x7f31581555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 -- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31580cb970 msgr2=0x7f3158157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31580cb970 0x7f3158157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 -- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315815a400 msgr2=0x7f31581555b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315815a400 0x7f31581555b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.707+0000 7f315e121700 1 -- 172.21.15.33:0/3861532679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314c009420 con 0x7f31580cb5a0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f315e121700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f315000c7e0 tx=0x7f3150007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150005b30 con 0x7f31580cb5a0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3150005c90 con 0x7f31580cb5a0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f315815cbc0 con 0x7f31580cb5a0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3150007300 con 0x7f31580cb5a0 2023-10-09T15:32:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.708+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f315815d180 con 0x7f31580cb5a0 2023-10-09T15:32:41.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.709+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f315804c3c0 con 0x7f31580cb5a0 2023-10-09T15:32:41.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.709+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f31500076b0 con 0x7f31580cb5a0 2023-10-09T15:32:41.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.710+0000 7f31567fc700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 0x7f3144069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:41.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.710+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3150083ad0 con 0x7f31580cb5a0 2023-10-09T15:32:41.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.710+0000 7f315d920700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 0x7f3144069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:41.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.710+0000 7f315d920700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 0x7f3144069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f314c0093f0 tx=0x7f314c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:41.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.714+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3150050c50 con 0x7f31580cb5a0 2023-10-09T15:32:41.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.957+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f315815d7d0 con 0x7f31580cb5a0 2023-10-09T15:32:41.958 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:32:41.957+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:32:41.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.963+0000 7f31567fc700 1 -- 172.21.15.33:0/3861532679 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v32) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3150017090 con 0x7f31580cb5a0 2023-10-09T15:32:41.964 INFO:tasks.ceph.mds.b.smithi059.stderr: -1793> 2023-10-09T15:32:32.333+0000 7f5e0840b700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:32:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 msgr2=0x7f3144069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 0x7f3144069470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f314c0093f0 tx=0x7f314c017000 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 msgr2=0x7f315815d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f315000c7e0 tx=0x7f3150007df0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 shutdown_connections 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3144066fc0 0x7f3144069470 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31580cb5a0 0x7f315815d980 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f315815a400 0x7f31581555b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 --2- 172.21.15.33:0/3861532679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31580cb970 0x7f3158157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 >> 172.21.15.33:0/3861532679 conn(0x7f3158070e30 msgr2=0x7f31580b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 shutdown_connections 2023-10-09T15:32:41.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:41.965+0000 7f3160385700 1 -- 172.21.15.33:0/3861532679 wait complete. 2023-10-09T15:32:41.968 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:32:41.978 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:32:41.988 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:32:42.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 Processor -- start 2023-10-09T15:32:42.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 -- start start 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f123406dc70 0x7f1234159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12340ccfd0 con 0x7f123406e0e0 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f123415a3d0 con 0x7f1234159530 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.100+0000 7f12397d0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f123415a6b0 con 0x7f123406dc70 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f12337fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f123406e0e0 0x7f12340cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50862/0 (socket says 172.21.15.33:50862) 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f12337fe700 1 -- 172.21.15.33:0/3558832580 learned_addr learned my addr 172.21.15.33:0/3558832580 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f12327fc700 1 --2- 172.21.15.33:0/3558832580 >> v2:172.21.15.59:3300/0 conn(0x7f123406dc70 0x7f1234159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773701942 0 0) 0x7f12340ccfd0 con 0x7f123406e0e0 2023-10-09T15:32:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1220003570 con 0x7f123406e0e0 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 17065039 0 0) 0x7f1220003570 con 0x7f123406e0e0 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 >> v2:172.21.15.59:3300/0 conn(0x7f123406dc70 msgr2=0x7f1234159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 --2- 172.21.15.33:0/3558832580 >> v2:172.21.15.59:3300/0 conn(0x7f123406dc70 0x7f1234159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 >> v1:172.21.15.59:6789/0 conn(0x7f1234159530 legacy=0x7f12340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123415a990 con 0x7f123406e0e0 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f122c0017f0 con 0x7f123406e0e0 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 >> v1:172.21.15.33:6789/0 conn(0x7f123406e0e0 legacy=0x7f12340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220003a60 0x7f1220003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200051c0 0x7f122000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f123415a6b0 con 0x7f1220004810 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f122000c0d0 con 0x7f12200051c0 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f122000c290 con 0x7f1220003a60 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f12327fc700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.101+0000 7f1232ffd700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220003a60 0x7f1220003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12337fe700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200051c0 0x7f122000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 -- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220003a60 msgr2=0x7f1220003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220003a60 0x7f1220003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 -- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200051c0 msgr2=0x7f122000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12200051c0 0x7f122000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 -- 172.21.15.33:0/3558832580 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220003570 con 0x7f1220004810 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12337fe700 1 -- 172.21.15.33:0/3558832580 reap_dead start 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12327fc700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 0x7f1220004c80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f121c009c00 tx=0x7f121c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8480fb064dbef531 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00e710 con 0x7f1220004810 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f121c00e870 con 0x7f1220004810 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f1231ffb700 1 -- 172.21.15.33:0/3558832580 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f121c00ec30 con 0x7f1220004810 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12397d0700 1 -- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 msgr2=0x7f1220004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12397d0700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 0x7f1220004c80 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f121c009c00 tx=0x7f121c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12397d0700 1 -- 172.21.15.33:0/3558832580 shutdown_connections 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12397d0700 1 --2- 172.21.15.33:0/3558832580 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1220004810 0x7f1220004c80 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.102+0000 7f12397d0700 1 -- 172.21.15.33:0/3558832580 >> 172.21.15.33:0/3558832580 conn(0x7f12340703a0 msgr2=0x7f12340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.103+0000 7f12397d0700 1 -- 172.21.15.33:0/3558832580 shutdown_connections 2023-10-09T15:32:42.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.103+0000 7f12397d0700 1 -- 172.21.15.33:0/3558832580 wait complete. 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.104+0000 7f12397d0700 1 Processor -- start 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.104+0000 7f12397d0700 1 -- start start 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.104+0000 7f12397d0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220004810 0x7f123414f7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.104+0000 7f12397d0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 0x7f123415e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.104+0000 7f12397d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12397d0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b4830 con 0x7f12340b42b0 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12397d0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b4b10 con 0x7f12340b3e40 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12397d0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12340b4df0 con 0x7f1220004810 2023-10-09T15:32:42.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34636/0 (socket says 172.21.15.33:34636) 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 -- 172.21.15.33:0/438599466 learned_addr learned my addr 172.21.15.33:0/438599466 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f1232ffd700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220004810 0x7f123414f7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12327fc700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 0x7f123415e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 -- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220004810 msgr2=0x7f123414f7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220004810 0x7f123414f7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 -- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 msgr2=0x7f123415e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 0x7f123415e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 -- 172.21.15.33:0/438599466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12340c80c0 con 0x7f12340b42b0 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12327fc700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 0x7f123415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12337fe700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f123406e990 tx=0x7f122c001330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c00ebc0 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122c00ed60 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12340c7ce0 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122c013670 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.105+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12340b5860 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.106+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f123404c3c0 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.107+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f122c0139e0 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.107+0000 7f122affd700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.107+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f122c084bd0 con 0x7f12340b42b0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.108+0000 7f1232ffd700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.108+0000 7f1232ffd700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 0x7f1214069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1224003b80 tx=0x7f1224007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:42.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.112+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f122c051e00 con 0x7f12340b42b0 2023-10-09T15:32:42.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.357+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f123415ac70 con 0x7f12340b42b0 2023-10-09T15:32:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.962+0000 7f122affd700 1 -- 172.21.15.33:0/438599466 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7f122c055420 con 0x7f12340b42b0 2023-10-09T15:32:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 msgr2=0x7f1214069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 0x7f1214069470 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f1224003b80 tx=0x7f1224007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 msgr2=0x7f123415ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f123406e990 tx=0x7f122c001330 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 shutdown_connections 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1214066fc0 0x7f1214069470 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12340b42b0 0x7f123415ee50 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1220004810 0x7f123414f7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 --2- 172.21.15.33:0/438599466 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12340b3e40 0x7f123415e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 >> 172.21.15.33:0/438599466 conn(0x7f12340703a0 msgr2=0x7f12340cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 shutdown_connections 2023-10-09T15:32:42.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:42.964+0000 7f12397d0700 1 -- 172.21.15.33:0/438599466 wait complete. 2023-10-09T15:32:42.979 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:32:43.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.104+0000 7fea0b550700 1 Processor -- start 2023-10-09T15:32:43.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.104+0000 7fea0b550700 1 -- start start 2023-10-09T15:32:43.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea0b550700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea040cd770 0x7fea040cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:43.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea0b550700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040cf330 con 0x7fea040cb880 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea0b550700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea040cddd0 con 0x7fea040b04f0 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea0b550700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea040cead0 con 0x7fea040cd770 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea092ec700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fea040cb880 0x7fea040cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50872/0 (socket says 172.21.15.33:50872) 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea08aeb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea040cd770 0x7fea040cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea092ec700 1 -- 172.21.15.33:0/1220271215 learned_addr learned my addr 172.21.15.33:0/1220271215 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea03fff700 1 -- 172.21.15.33:0/1220271215 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2474685864 0 0) 0x7fea040cf330 con 0x7fea040cb880 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea03fff700 1 -- 172.21.15.33:0/1220271215 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9ec003570 con 0x7fea040cb880 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea08aeb700 1 -- 172.21.15.33:0/1220271215 >> v1:172.21.15.59:6789/0 conn(0x7fea040b04f0 legacy=0x7fea041591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea08aeb700 1 -- 172.21.15.33:0/1220271215 >> v1:172.21.15.33:6789/0 conn(0x7fea040cb880 legacy=0x7fea040cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:43.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.105+0000 7fea08aeb700 1 -- 172.21.15.33:0/1220271215 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea040cece0 con 0x7fea040cd770 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea08aeb700 1 --2- 172.21.15.33:0/1220271215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea040cbc50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098e0 tx=0x7fe9f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=858671b4650e4e89 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea03fff700 1 -- 172.21.15.33:0/1220271215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011630 con 0x7fea040cd770 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea03fff700 1 -- 172.21.15.33:0/1220271215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f8011790 con 0x7fea040cd770 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea03fff700 1 -- 172.21.15.33:0/1220271215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f8011b30 con 0x7fea040cd770 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 -- 172.21.15.33:0/1220271215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 msgr2=0x7fea040cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 --2- 172.21.15.33:0/1220271215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea040cbc50 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7fe9f80098e0 tx=0x7fe9f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 -- 172.21.15.33:0/1220271215 shutdown_connections 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 --2- 172.21.15.33:0/1220271215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea040cbc50 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 -- 172.21.15.33:0/1220271215 >> 172.21.15.33:0/1220271215 conn(0x7fea040703a0 msgr2=0x7fea040707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 -- 172.21.15.33:0/1220271215 shutdown_connections 2023-10-09T15:32:43.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.106+0000 7fea0b550700 1 -- 172.21.15.33:0/1220271215 wait complete. 2023-10-09T15:32:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.107+0000 7fea0b550700 1 Processor -- start 2023-10-09T15:32:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.107+0000 7fea0b550700 1 -- start start 2023-10-09T15:32:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 0x7fea04153d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 0x7fea04169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:43.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea041571a0 con 0x7fea040cd770 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea040b6490 con 0x7fea040cb880 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.108+0000 7fea0b550700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea04169eb0 con 0x7fea040b04f0 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34652/0 (socket says 172.21.15.33:34652) 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 -- 172.21.15.33:0/4288364125 learned_addr learned my addr 172.21.15.33:0/4288364125 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea092ec700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 0x7fea04153d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea08aeb700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 0x7fea04169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 -- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 msgr2=0x7fea04153d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 0x7fea04153d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:43.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 -- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 msgr2=0x7fea04169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 0x7fea04169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 -- 172.21.15.33:0/4288364125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9f8009420 con 0x7fea040cd770 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea08aeb700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 0x7fea04169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea092ec700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 0x7fea04153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea09aed700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c5e0 tx=0x7fe9f4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011590 con 0x7fea040cd770 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9f4011710 con 0x7fea040cd770 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea0415b9b0 con 0x7fea040cd770 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9f4011ad0 con 0x7fea040cd770 2023-10-09T15:32:43.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.109+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea040b5e40 con 0x7fea040cd770 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.110+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea0404c3c0 con 0x7fea040cd770 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.110+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe9f401c460 con 0x7fea040cd770 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.111+0000 7fea017fa700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 0x7fe9f0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.111+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(52..52 src has 1..52) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe9f4084280 con 0x7fea040cd770 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.111+0000 7fea092ec700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 0x7fe9f0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.111+0000 7fea092ec700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 0x7fe9f0069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005c50 tx=0x7fe9fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.115+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9f40514b0 con 0x7fea040cd770 2023-10-09T15:32:43.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:43.313+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fea040ce680 con 0x7fea040cd770 2023-10-09T15:32:44.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.318+0000 7fea017fa700 1 -- 172.21.15.33:0/4288364125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v53) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe9f4054ad0 con 0x7fea040cd770 2023-10-09T15:32:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 msgr2=0x7fe9f0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 0x7fe9f0069470 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fe9fc005c50 tx=0x7fe9fc009040 comp rx=0 tx=0).stop 2023-10-09T15:32:44.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 msgr2=0x7fea0415ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fe9f400c5e0 tx=0x7fe9f4007f60 comp rx=0 tx=0).stop 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 shutdown_connections 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9f0066fc0 0x7fe9f0069470 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea040cd770 0x7fea0415ae40 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea040b04f0 0x7fea04153d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 --2- 172.21.15.33:0/4288364125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea040cb880 0x7fea04169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 >> 172.21.15.33:0/4288364125 conn(0x7fea040703a0 msgr2=0x7fea0406d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 shutdown_connections 2023-10-09T15:32:44.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.322+0000 7fea0b550700 1 -- 172.21.15.33:0/4288364125 wait complete. 2023-10-09T15:32:44.325 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:32:44.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:32:44.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.467+0000 7f5668e21700 1 Processor -- start 2023-10-09T15:32:44.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.467+0000 7f5668e21700 1 -- start start 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5668e21700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5664159940 0x7f56640b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5668e21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f56640aa740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5668e21700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56640af670 con 0x7f56640b0e00 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5668e21700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56640aa2b0 con 0x7f5664159940 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5668e21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56640b12a0 con 0x7f566406cdb0 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5661d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f56640b0e00 0x7f566406c6a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50888/0 (socket says 172.21.15.33:50888) 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5661d9b700 1 -- 172.21.15.33:0/1516715054 learned_addr learned my addr 172.21.15.33:0/1516715054 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:44.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f5662d9d700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f56640aa740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> v2:172.21.15.59:3300/0 conn(0x7f5664159940 0x7f56640b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3512314913 0 0) 0x7f5658001110 con 0x7f56640b0e00 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f564c003570 con 0x7f56640b0e00 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1726885583 0 0) 0x7f564c003570 con 0x7f56640b0e00 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 msgr2=0x7f56640aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f56640aa740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 >> v2:172.21.15.59:3300/0 conn(0x7f5664159940 msgr2=0x7f56640b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 --2- 172.21.15.33:0/1516715054 >> v2:172.21.15.59:3300/0 conn(0x7f5664159940 0x7f56640b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5664159d10 con 0x7f56640b0e00 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5658001600 con 0x7f56640b0e00 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.468+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> v2:172.21.15.59:3300/0 conn(0x7f5664159940 0x7f56640b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 >> v1:172.21.15.33:6789/0 conn(0x7f56640b0e00 legacy=0x7f566406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f564c003a60 0x7f564c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c004810 0x7f564c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f564c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56640aa2b0 con 0x7f564c003a60 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56640b12a0 con 0x7f564c004810 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f564c00ba60 con 0x7f566406cdb0 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f564c003a60 0x7f564c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f5661d9b700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c004810 0x7f564c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f5662d9d700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f564c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 -- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 msgr2=0x7f564c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f566406cdb0 0x7f564c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 -- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c004810 msgr2=0x7f564c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c004810 0x7f564c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 -- 172.21.15.33:0/1516715054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f564c003570 con 0x7f564c003a60 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f5661d9b700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f564c004810 0x7f564c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566259c700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f564c003a60 0x7f564c003e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5654009e10 tx=0x7f5654009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af38b3aaaa62fd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5654005a00 con 0x7f564c003a60 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5654005b60 con 0x7f564c003a60 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.469+0000 7f566159a700 1 -- 172.21.15.33:0/1516715054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565400e920 con 0x7f564c003a60 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 -- 172.21.15.33:0/1516715054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f564c003a60 msgr2=0x7f564c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 --2- 172.21.15.33:0/1516715054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f564c003a60 0x7f564c003e70 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f5654009e10 tx=0x7f5654009120 comp rx=0 tx=0).stop 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5662d9d700 1 -- 172.21.15.33:0/1516715054 reap_dead start 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 -- 172.21.15.33:0/1516715054 shutdown_connections 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 -- 172.21.15.33:0/1516715054 >> 172.21.15.33:0/1516715054 conn(0x7f56640cd3e0 msgr2=0x7f56640cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 -- 172.21.15.33:0/1516715054 shutdown_connections 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.470+0000 7f5668e21700 1 -- 172.21.15.33:0/1516715054 wait complete. 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.471+0000 7f5668e21700 1 Processor -- start 2023-10-09T15:32:44.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.471+0000 7f5668e21700 1 -- start start 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f564c003a60 0x7f56640abfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 0x7f56641560b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56640ac590 con 0x7f5664153f70 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56640ac870 con 0x7f566416d900 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5668e21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f566416d100 con 0x7f564c003a60 2023-10-09T15:32:44.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34668/0 (socket says 172.21.15.33:34668) 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 -- 172.21.15.33:0/1646024667 learned_addr learned my addr 172.21.15.33:0/1646024667 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f566259c700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f564c003a60 0x7f56640abfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5661d9b700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 0x7f56641560b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 -- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f564c003a60 msgr2=0x7f56640abfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f564c003a60 0x7f56640abfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 -- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 msgr2=0x7f56641560b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 0x7f56641560b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 -- 172.21.15.33:0/1646024667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f566416d3e0 con 0x7f5664153f70 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5661d9b700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 0x7f56641560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.472+0000 7f5662d9d700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f566406c320 tx=0x7f565c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:44.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.473+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c00e070 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.473+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f565c011c30 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.473+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56641565f0 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.473+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f565c016470 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.473+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56641543f0 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.474+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f566416cf60 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.474+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f565c0168a0 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.474+0000 7f56527fc700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 0x7f5644069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.475+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f565c084fe0 con 0x7f5664153f70 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.475+0000 7f566259c700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 0x7f5644069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:44.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.475+0000 7f566259c700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 0x7f5644069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5654009160 tx=0x7f5654019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:44.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.479+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f566416cf60 con 0x7f5664153f70 2023-10-09T15:32:44.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:44.671+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f566416cf60 con 0x7f5664153f70 2023-10-09T15:32:45.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.324+0000 7f56527fc700 1 -- 172.21.15.33:0/1646024667 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v54) v1 ==== 169+0+0 (secure 0 0 0) 0x7f566416cf60 con 0x7f5664153f70 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 msgr2=0x7f5644069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 0x7f5644069470 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f5654009160 tx=0x7f5654019000 comp rx=0 tx=0).stop 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 msgr2=0x7f56640675a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f566406c320 tx=0x7f565c00b040 comp rx=0 tx=0).stop 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 shutdown_connections 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5644066fc0 0x7f5644069470 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5664153f70 0x7f56640675a0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f564c003a60 0x7f56640abfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 --2- 172.21.15.33:0/1646024667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f566416d900 0x7f56641560b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 >> 172.21.15.33:0/1646024667 conn(0x7f56640cd3e0 msgr2=0x7f5664068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 shutdown_connections 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.328+0000 7f5668e21700 1 -- 172.21.15.33:0/1646024667 wait complete. 2023-10-09T15:32:45.330 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:32:45.344 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:32:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.473+0000 7f8e3a518700 1 Processor -- start 2023-10-09T15:32:45.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.473+0000 7f8e3a518700 1 -- start start 2023-10-09T15:32:45.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e3a518700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 0x7f8e3406a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e3a518700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 0x7f8e3406d500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e3a518700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e3406d070 con 0x7f8e34159b10 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e3a518700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3406af80 con 0x7f8e34159ee0 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e3a518700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e340b0030 con 0x7f8e3406aae0 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e337fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 0x7f8e3406a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 0x7f8e3406d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e33fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8e34159b10 0x7f8e340af920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:41934/0 (socket says 172.21.15.33:41934) 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e33fff700 1 -- 172.21.15.33:0/3724492630 learned_addr learned my addr 172.21.15.33:0/3724492630 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 -- 172.21.15.33:0/3724492630 >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 msgr2=0x7f8e3406a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 --2- 172.21.15.33:0/3724492630 >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 0x7f8e3406a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 -- 172.21.15.33:0/3724492630 >> v1:172.21.15.59:6789/0 conn(0x7f8e34159b10 legacy=0x7f8e340af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 -- 172.21.15.33:0/3724492630 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e340c9270 con 0x7f8e3406aae0 2023-10-09T15:32:45.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e337fe700 1 --2- 172.21.15.33:0/3724492630 >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 0x7f8e3406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:45.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.474+0000 7f8e38ab5700 1 --2- 172.21.15.33:0/3724492630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 0x7f8e3406d500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a301876fe6c1e91f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e32ffd700 1 -- 172.21.15.33:0/3724492630 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00e070 con 0x7f8e3406aae0 2023-10-09T15:32:45.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e32ffd700 1 -- 172.21.15.33:0/3724492630 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00bb60 con 0x7f8e3406aae0 2023-10-09T15:32:45.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e32ffd700 1 -- 172.21.15.33:0/3724492630 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c012430 con 0x7f8e3406aae0 2023-10-09T15:32:45.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 -- 172.21.15.33:0/3724492630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 msgr2=0x7f8e3406d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 --2- 172.21.15.33:0/3724492630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 0x7f8e3406d500 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c009e60 tx=0x7f8e2c009780 comp rx=0 tx=0).stop 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 -- 172.21.15.33:0/3724492630 shutdown_connections 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 --2- 172.21.15.33:0/3724492630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e3406aae0 0x7f8e3406d500 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 --2- 172.21.15.33:0/3724492630 >> v2:172.21.15.59:3300/0 conn(0x7f8e34159ee0 0x7f8e3406a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 -- 172.21.15.33:0/3724492630 >> 172.21.15.33:0/3724492630 conn(0x7f8e340ccb60 msgr2=0x7f8e340ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 -- 172.21.15.33:0/3724492630 shutdown_connections 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.475+0000 7f8e3a518700 1 -- 172.21.15.33:0/3724492630 wait complete. 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.476+0000 7f8e3a518700 1 Processor -- start 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 -- start start 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3406aae0 0x7f8e340c6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e34159b10 0x7f8e340cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3416b380 con 0x7f8e34159ee0 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3416a770 con 0x7f8e3406aae0 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e3a518700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e3416aa50 con 0x7f8e34159b10 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e38ab5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e38ab5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34682/0 (socket says 172.21.15.33:34682) 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.477+0000 7f8e38ab5700 1 -- 172.21.15.33:0/891075625 learned_addr learned my addr 172.21.15.33:0/891075625 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e337fe700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e34159b10 0x7f8e340cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e33fff700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3406aae0 0x7f8e340c6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 -- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e34159b10 msgr2=0x7f8e340cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e34159b10 0x7f8e340cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 -- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3406aae0 msgr2=0x7f8e340c6420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3406aae0 0x7f8e340c6420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 -- 172.21.15.33:0/891075625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e28009420 con 0x7f8e34159ee0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e38ab5700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8e3406a3a0 tx=0x7f8e2c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c027470 con 0x7f8e34159ee0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c0275f0 con 0x7f8e34159ee0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c009a20 con 0x7f8e34159ee0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c0279b0 con 0x7f8e34159ee0 2023-10-09T15:32:45.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.478+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e3416b010 con 0x7f8e34159ee0 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.479+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e3416b530 con 0x7f8e34159ee0 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.480+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8e2c024070 con 0x7f8e34159ee0 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.480+0000 7f8e1bfff700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 0x7f8e20069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.480+0000 7f8e33fff700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 0x7f8e20069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.480+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8e2c086c20 con 0x7f8e34159ee0 2023-10-09T15:32:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.481+0000 7f8e33fff700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 0x7f8e20069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e24007fd0 tx=0x7f8e24009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.485+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e3416b530 con 0x7f8e34159ee0 2023-10-09T15:32:45.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.678+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8e3416b530 con 0x7f8e34159ee0 2023-10-09T15:32:45.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.681+0000 7f8e1bfff700 1 -- 172.21.15.33:0/891075625 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8e3416b530 con 0x7f8e34159ee0 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 msgr2=0x7f8e20069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 0x7f8e20069470 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f8e24007fd0 tx=0x7f8e24009040 comp rx=0 tx=0).stop 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 msgr2=0x7f8e340cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f8e3406a3a0 tx=0x7f8e2c019000 comp rx=0 tx=0).stop 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 shutdown_connections 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e20066fc0 0x7f8e20069470 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e34159ee0 0x7f8e340cbf70 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e3406aae0 0x7f8e340c6420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 --2- 172.21.15.33:0/891075625 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e34159b10 0x7f8e340cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.683+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 >> 172.21.15.33:0/891075625 conn(0x7f8e340ccb60 msgr2=0x7f8e34158d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.684+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 shutdown_connections 2023-10-09T15:32:45.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.684+0000 7f8e3a518700 1 -- 172.21.15.33:0/891075625 wait complete. 2023-10-09T15:32:45.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info' 2023-10-09T15:32:45.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.815+0000 7f57c993c700 1 Processor -- start 2023-10-09T15:32:45.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.815+0000 7f57c993c700 1 -- start start 2023-10-09T15:32:45.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c993c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cb5a0 0x7f57c40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c993c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57c40cde50 0x7f57c4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c993c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c415ae40 con 0x7f57c40cd9e0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c993c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c40d13f0 con 0x7f57c40cde50 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c993c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c415ab60 con 0x7f57c40cb5a0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c27fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f57c40cd9e0 0x7f57c4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50896/0 (socket says 172.21.15.33:50896) 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57c40cde50 0x7f57c4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c27fc700 1 -- 172.21.15.33:0/866383981 learned_addr learned my addr 172.21.15.33:0/866383981 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c2ffd700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cb5a0 0x7f57c40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c1ffb700 1 -- 172.21.15.33:0/866383981 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1156344315 0 0) 0x7f57c415ae40 con 0x7f57c40cd9e0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c1ffb700 1 -- 172.21.15.33:0/866383981 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f57b0003570 con 0x7f57c40cd9e0 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c37fe700 1 -- 172.21.15.33:0/866383981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cb5a0 msgr2=0x7f57c40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c37fe700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cb5a0 0x7f57c40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c37fe700 1 -- 172.21.15.33:0/866383981 >> v1:172.21.15.33:6789/0 conn(0x7f57c40cd9e0 legacy=0x7f57c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.816+0000 7f57c37fe700 1 -- 172.21.15.33:0/866383981 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c40ccf00 con 0x7f57c40cde50 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c37fe700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40cde50 0x7f57c4156e90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f57b40098e0 tx=0x7f57b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c5a84aac40fa23b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c1ffb700 1 -- 172.21.15.33:0/866383981 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011630 con 0x7f57c40cde50 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c1ffb700 1 -- 172.21.15.33:0/866383981 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b4011790 con 0x7f57c40cde50 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c1ffb700 1 -- 172.21.15.33:0/866383981 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4011b30 con 0x7f57c40cde50 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 -- 172.21.15.33:0/866383981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40cde50 msgr2=0x7f57c4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40cde50 0x7f57c4156e90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f57b40098e0 tx=0x7f57b40091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 -- 172.21.15.33:0/866383981 shutdown_connections 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c40cde50 0x7f57c4156e90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 --2- 172.21.15.33:0/866383981 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cb5a0 0x7f57c40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 -- 172.21.15.33:0/866383981 >> 172.21.15.33:0/866383981 conn(0x7f57c4070e30 msgr2=0x7f57c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:45.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 -- 172.21.15.33:0/866383981 shutdown_connections 2023-10-09T15:32:45.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.817+0000 7f57c993c700 1 -- 172.21.15.33:0/866383981 wait complete. 2023-10-09T15:32:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 Processor -- start 2023-10-09T15:32:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 -- start start 2023-10-09T15:32:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 0x7f57c40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cd9e0 0x7f57c40a6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c4156df0 con 0x7f57c4169610 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40c8ca0 con 0x7f57c40cb5a0 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.819+0000 7f57c993c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40c8f80 con 0x7f57c40cd9e0 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34702/0 (socket says 172.21.15.33:34702) 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 -- 172.21.15.33:0/612572630 learned_addr learned my addr 172.21.15.33:0/612572630 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c27fc700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cd9e0 0x7f57c40a6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c2ffd700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 0x7f57c40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 -- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cd9e0 msgr2=0x7f57c40a6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cd9e0 0x7f57c40a6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 -- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 msgr2=0x7f57c40c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 0x7f57c40c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 -- 172.21.15.33:0/612572630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57b4009420 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c2ffd700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 0x7f57c40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c37fe700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f57c406ea60 tx=0x7f57b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b40253f0 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57b4025570 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57b4025930 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c40c9260 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.820+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c4156300 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.821+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c404c3c0 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.822+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f57b4025d20 con 0x7f57c4169610 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.822+0000 7f57baffd700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 0x7f57a4069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:45.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.822+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f57b4085d70 con 0x7f57c4169610 2023-10-09T15:32:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.822+0000 7f57c2ffd700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 0x7f57a4069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.823+0000 7f57c2ffd700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 0x7f57a4069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f57c40af6e0 tx=0x7f57bc00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:45.827+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f57b40532f0 con 0x7f57c4169610 2023-10-09T15:32:46.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.108+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]} v 0) v1 -- 0x7f57c40cd1e0 con 0x7f57c4169610 2023-10-09T15:32:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.324+0000 7f57baffd700 1 -- 172.21.15.33:0/612572630 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info"]}]=0 v119) v1 ==== 133+0+0 (secure 0 0 0) 0x7f57b40150c0 con 0x7f57c4169610 2023-10-09T15:32:46.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 msgr2=0x7f57a4069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 0x7f57a4069470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f57c40af6e0 tx=0x7f57bc00b040 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 msgr2=0x7f57c4169ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f57c406ea60 tx=0x7f57b4017000 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 shutdown_connections 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f57a4066fc0 0x7f57a4069470 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57c4169610 0x7f57c4169ab0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57c40cb5a0 0x7f57c40c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 --2- 172.21.15.33:0/612572630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57c40cd9e0 0x7f57c40a6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 >> 172.21.15.33:0/612572630 conn(0x7f57c4070e30 msgr2=0x7f57c40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 shutdown_connections 2023-10-09T15:32:46.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.326+0000 7f57c993c700 1 -- 172.21.15.33:0/612572630 wait complete. 2023-10-09T15:32:46.339 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command ... ok 2023-10-09T15:32:46.340 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) Tests the pending_subvolume_deletions in 'fs volume info' command 2023-10-09T15:32:46.340 INFO:tasks.cephfs_test_runner:test_volume_info_pending_subvol_deletions (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:32:46.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-09T15:32:46.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.458+0000 7f26a6b8c700 1 Processor -- start 2023-10-09T15:32:46.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.458+0000 7f26a6b8c700 1 -- start start 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a6b8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f26a00b1b20 0x7f26a015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a6b8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f26a0161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a6b8c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26a0158210 con 0x7f26a0157600 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a6b8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26a00cb850 con 0x7f26a00b1b20 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a6b8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00cb290 con 0x7f26a01579d0 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a4928700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f26a0157600 0x7f26a00b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50910/0 (socket says 172.21.15.33:50910) 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a4928700 1 -- 172.21.15.33:0/1896476308 learned_addr learned my addr 172.21.15.33:0/1896476308 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:46.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f26a5129700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f26a0161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> v2:172.21.15.59:3300/0 conn(0x7f26a00b1b20 0x7f26a015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 554039116 0 0) 0x7f26a0158210 con 0x7f26a0157600 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.459+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f268c003570 con 0x7f26a0157600 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3676475188 0 0) 0x7f268c003570 con 0x7f26a0157600 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 msgr2=0x7f26a0161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f26a0161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 >> v2:172.21.15.59:3300/0 conn(0x7f26a00b1b20 msgr2=0x7f26a015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 --2- 172.21.15.33:0/1896476308 >> v2:172.21.15.59:3300/0 conn(0x7f26a00b1b20 0x7f26a015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a00cb570 con 0x7f26a0157600 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f2688001470 con 0x7f26a0157600 2023-10-09T15:32:46.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> v2:172.21.15.59:3300/0 conn(0x7f26a00b1b20 0x7f26a015f2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f26a5129700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f26a0161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 >> v1:172.21.15.33:6789/0 conn(0x7f26a0157600 legacy=0x7f26a00b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f268c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f268c003fa0 0x7f268c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c004d50 0x7f268c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00cb850 con 0x7f268c003fa0 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00cb290 con 0x7f268c004d50 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f268c00ba60 con 0x7f26a01579d0 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f268c003fa0 0x7f268c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f26a4928700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f268c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f26a5129700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c004d50 0x7f268c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 -- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 msgr2=0x7f268c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f26a01579d0 0x7f268c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 -- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c004d50 msgr2=0x7f268c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c004d50 0x7f268c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 -- 172.21.15.33:0/1896476308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2698009420 con 0x7f268c003fa0 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f26a5129700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f268c004d50 0x7f268c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.460+0000 7f269ffff700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f268c003fa0 0x7f268c004810 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f269000e3c0 tx=0x7f269000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1107f43ffe84ea7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f269000ec70 con 0x7f268c003fa0 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f269000f040 con 0x7f268c003fa0 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f269f7fe700 1 -- 172.21.15.33:0/1896476308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2690014480 con 0x7f268c003fa0 2023-10-09T15:32:46.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 -- 172.21.15.33:0/1896476308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f268c003fa0 msgr2=0x7f268c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/1896476308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f268c003fa0 0x7f268c004810 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f269000e3c0 tx=0x7f269000b040 comp rx=0 tx=0).stop 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a5129700 1 -- 172.21.15.33:0/1896476308 reap_dead start 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 -- 172.21.15.33:0/1896476308 shutdown_connections 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 -- 172.21.15.33:0/1896476308 >> 172.21.15.33:0/1896476308 conn(0x7f26a006d170 msgr2=0x7f26a00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 -- 172.21.15.33:0/1896476308 shutdown_connections 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.461+0000 7f26a6b8c700 1 -- 172.21.15.33:0/1896476308 wait complete. 2023-10-09T15:32:46.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.462+0000 7f26a6b8c700 1 Processor -- start 2023-10-09T15:32:46.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.462+0000 7f26a6b8c700 1 -- start start 2023-10-09T15:32:46.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 0x7f26a006b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 0x7f26a00c5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00c5590 con 0x7f26a00c2f70 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26a00c57c0 con 0x7f26a0167450 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a6b8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26a01678c0 con 0x7f268c003fa0 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a5129700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a5129700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34712/0 (socket says 172.21.15.33:34712) 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a5129700 1 -- 172.21.15.33:0/494729613 learned_addr learned my addr 172.21.15.33:0/494729613 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f269ffff700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 0x7f26a00c5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a4928700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 0x7f26a006b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.463+0000 7f26a5129700 1 -- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 msgr2=0x7f26a006b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a5129700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 0x7f26a006b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a5129700 1 -- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 msgr2=0x7f26a00c5050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a5129700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 0x7f26a00c5050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a5129700 1 -- 172.21.15.33:0/494729613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26a0154310 con 0x7f26a00c2f70 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f269ffff700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 0x7f26a00c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a4928700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 0x7f26a006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a5129700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f26a006f520 tx=0x7f2698008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698015670 con 0x7f26a00c2f70 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26980157f0 con 0x7f26a00c2f70 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2698015bb0 con 0x7f26a00c2f70 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26a01545f0 con 0x7f26a00c2f70 2023-10-09T15:32:46.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.464+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26a0154bb0 con 0x7f26a00c2f70 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.465+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26a004c3c0 con 0x7f26a00c2f70 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.465+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f269801f410 con 0x7f26a00c2f70 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.466+0000 7f269cff9700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 0x7f2680069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.466+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2698084130 con 0x7f26a00c2f70 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.466+0000 7f26a4928700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 0x7f2680069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.466+0000 7f26a4928700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 0x7f2680069470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2688007e70 tx=0x7f2688009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:46.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.470+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f26980516b0 con 0x7f26a00c2f70 2023-10-09T15:32:46.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:46.745+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f26a006b900 con 0x7f26a00c2f70 2023-10-09T15:32:47.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.328+0000 7f269cff9700 1 -- 172.21.15.33:0/494729613 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v120) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2698054cd0 con 0x7f26a00c2f70 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.330+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 msgr2=0x7f2680069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.330+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 0x7f2680069470 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f2688007e70 tx=0x7f2688009040 comp rx=0 tx=0).stop 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 msgr2=0x7f26a00ac830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f26a006f520 tx=0x7f2698008040 comp rx=0 tx=0).stop 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 shutdown_connections 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2680066fc0 0x7f2680069470 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f26a00c2f70 0x7f26a00ac830 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f268c003fa0 0x7f26a006b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 --2- 172.21.15.33:0/494729613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f26a0167450 0x7f26a00c5050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 >> 172.21.15.33:0/494729613 conn(0x7f26a006d170 msgr2=0x7f26a00c1530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:47.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 shutdown_connections 2023-10-09T15:32:47.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.331+0000 7f26a6b8c700 1 -- 172.21.15.33:0/494729613 wait complete. 2023-10-09T15:32:47.345 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:32:47.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.468+0000 7f1cdb4c7700 1 Processor -- start 2023-10-09T15:32:47.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.468+0000 7f1cdb4c7700 1 -- start start 2023-10-09T15:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cdb4c7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cd4159530 0x7f1cd40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cdb4c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 0x7f1cd4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cdb4c7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cd40ccfd0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cdb4c7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd40cf0e0 con 0x7f1cd4159530 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cdb4c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd415a3d0 con 0x7f1cd406dc70 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cd9263700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cd4159530 0x7f1cd40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cd9a64700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1cd406e0e0 0x7f1cd40cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50922/0 (socket says 172.21.15.33:50922) 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.469+0000 7f1cd9a64700 1 -- 172.21.15.33:0/3218665478 learned_addr learned my addr 172.21.15.33:0/3218665478 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd8a62700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 0x7f1cd4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd9263700 1 -- 172.21.15.33:0/3218665478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 msgr2=0x7f1cd4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd9263700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 0x7f1cd4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd9263700 1 -- 172.21.15.33:0/3218665478 >> v1:172.21.15.33:6789/0 conn(0x7f1cd406e0e0 legacy=0x7f1cd40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd9263700 1 -- 172.21.15.33:0/3218665478 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd415a6b0 con 0x7f1cd4159530 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1ccbfff700 1 -- 172.21.15.33:0/3218665478 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4200565617 0 0) 0x7f1cd40ccfd0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd8a62700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 0x7f1cd4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cd9263700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4159530 0x7f1cd40ceba0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00098e0 tx=0x7f1cd00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add8e5373e002669 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1ccbfff700 1 -- 172.21.15.33:0/3218665478 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0009e80 con 0x7f1cd4159530 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1ccbfff700 1 -- 172.21.15.33:0/3218665478 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cd000b860 con 0x7f1cd4159530 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1ccbfff700 1 -- 172.21.15.33:0/3218665478 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cd000bbe0 con 0x7f1cd4159530 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/3218665478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4159530 msgr2=0x7f1cd40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4159530 0x7f1cd40ceba0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00098e0 tx=0x7f1cd00091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/3218665478 shutdown_connections 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd4159530 0x7f1cd40ceba0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/3218665478 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd406dc70 0x7f1cd4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.470+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/3218665478 >> 172.21.15.33:0/3218665478 conn(0x7f1cd40703a0 msgr2=0x7f1cd40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.471+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/3218665478 shutdown_connections 2023-10-09T15:32:47.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.471+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/3218665478 wait complete. 2023-10-09T15:32:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 Processor -- start 2023-10-09T15:32:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- start start 2023-10-09T15:32:47.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd406dc70 0x7f1cd40c99e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd4159530 0x7f1cd40c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c9f20 con 0x7f1cd406e0e0 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd4149760 con 0x7f1cd406dc70 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd40c7cd0 con 0x7f1cd4159530 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34734/0 (socket says 172.21.15.33:34734) 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 -- 172.21.15.33:0/2165927747 learned_addr learned my addr 172.21.15.33:0/2165927747 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd9a64700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd4159530 0x7f1cd40c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd9263700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd406dc70 0x7f1cd40c99e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 -- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd4159530 msgr2=0x7f1cd40c7790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd4159530 0x7f1cd40c7790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 -- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd406dc70 msgr2=0x7f1cd40c99e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd406dc70 0x7f1cd40c99e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 -- 172.21.15.33:0/2165927747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd0009420 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cd8a62700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c830 tx=0x7f1cc4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4011600 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc4011760 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd40c7ee0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc4011b20 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.473+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd40c8270 con 0x7f1cd406e0e0 2023-10-09T15:32:47.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.474+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd40c88a0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.475+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1cc400a3e0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.475+0000 7f1cc97fa700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 0x7f1cb8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.475+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1cc4084870 con 0x7f1cd406e0e0 2023-10-09T15:32:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.475+0000 7f1cd9263700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 0x7f1cb8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.475+0000 7f1cd9263700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 0x7f1cb8069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00091e0 tx=0x7f1cd0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.479+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cc4051ce0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.672+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f1cd404c3c0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.676+0000 7f1cc97fa700 1 -- 172.21.15.33:0/2165927747 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1cc40150c0 con 0x7f1cd406e0e0 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 msgr2=0x7f1cb8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 0x7f1cb8069470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1cd00091e0 tx=0x7f1cd0017000 comp rx=0 tx=0).stop 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 msgr2=0x7f1cd4149220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f1cc400c830 tx=0x7f1cc4008040 comp rx=0 tx=0).stop 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 shutdown_connections 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cb8066fc0 0x7f1cb8069470 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cd4159530 0x7f1cd40c7790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cd406dc70 0x7f1cd40c99e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 --2- 172.21.15.33:0/2165927747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cd406e0e0 0x7f1cd4149220 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 >> 172.21.15.33:0/2165927747 conn(0x7f1cd40703a0 msgr2=0x7f1cd415abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:47.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 shutdown_connections 2023-10-09T15:32:47.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.678+0000 7f1cdb4c7700 1 -- 172.21.15.33:0/2165927747 wait complete. 2023-10-09T15:32:47.691 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:32:47.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:47.731 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:32:47.779 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:32:47.779 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:32:47.779 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:32:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.897+0000 7f5074bd6700 1 Processor -- start 2023-10-09T15:32:47.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.897+0000 7f5074bd6700 1 -- start start 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f5074bd6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f50700a8d00 0x7f50700cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f5074bd6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700aeee0 con 0x7f50700a90d0 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f5074bd6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50700cf490 con 0x7f507006e550 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f5074bd6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700ae680 con 0x7f50700a8d00 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f506dd9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f50700a90d0 0x7f507006de40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50930/0 (socket says 172.21.15.33:50930) 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.898+0000 7f506dd9b700 1 -- 172.21.15.33:0/3841887818 learned_addr learned my addr 172.21.15.33:0/3841887818 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506e59c700 1 --2- 172.21.15.33:0/3841887818 >> v2:172.21.15.59:3300/0 conn(0x7f50700a8d00 0x7f50700cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4083471878 0 0) 0x7f50700aeee0 con 0x7f50700a90d0 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f505c003570 con 0x7f50700a90d0 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3259911978 0 0) 0x7f50700cf490 con 0x7f507006e550 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f50700aeee0 con 0x7f507006e550 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 508164494 0 0) 0x7f505c003570 con 0x7f50700a90d0 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 >> v2:172.21.15.59:3300/0 conn(0x7f50700a8d00 msgr2=0x7f50700cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 --2- 172.21.15.33:0/3841887818 >> v2:172.21.15.59:3300/0 conn(0x7f50700a8d00 0x7f50700cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 >> v1:172.21.15.59:6789/0 conn(0x7f507006e550 legacy=0x7f50700af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700ce330 con 0x7f50700a90d0 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f50580015f0 con 0x7f50700a90d0 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 >> v1:172.21.15.33:6789/0 conn(0x7f50700a90d0 legacy=0x7f507006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c003bf0 0x7f505c003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 0x7f505c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505c0051c0 0x7f505c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700ae680 con 0x7f505c004810 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c0b0 con 0x7f505c003bf0 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f505c00c270 con 0x7f505c0051c0 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506e59c700 1 --2- 172.21.15.33:0/3841887818 >> v2:172.21.15.59:3300/0 conn(0x7f50700a8d00 0x7f50700cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506dd9b700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 0x7f505c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506e59c700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c003bf0 0x7f505c003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.899+0000 7f506ed9d700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505c0051c0 0x7f505c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 -- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505c0051c0 msgr2=0x7f505c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f505c0051c0 0x7f505c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 -- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c003bf0 msgr2=0x7f505c003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c003bf0 0x7f505c003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506ed9d700 1 -- 172.21.15.33:0/3841887818 reap_dead start 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 -- 172.21.15.33:0/3841887818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f505c003570 con 0x7f505c004810 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506e59c700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c003bf0 0x7f505c003fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506dd9b700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 0x7f505c004c80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f505800c2a0 tx=0x7f50580078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c722495c1b7c49a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f505800cb70 con 0x7f505c004810 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f505800ccf0 con 0x7f505c004810 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f506d59a700 1 -- 172.21.15.33:0/3841887818 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5058007320 con 0x7f505c004810 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f5074bd6700 1 -- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 msgr2=0x7f505c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f5074bd6700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 0x7f505c004c80 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f505800c2a0 tx=0x7f50580078a0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f5074bd6700 1 -- 172.21.15.33:0/3841887818 shutdown_connections 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f5074bd6700 1 --2- 172.21.15.33:0/3841887818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f505c004810 0x7f505c004c80 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.900+0000 7f5074bd6700 1 -- 172.21.15.33:0/3841887818 >> 172.21.15.33:0/3841887818 conn(0x7f507006ce80 msgr2=0x7f50700ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.901+0000 7f5074bd6700 1 -- 172.21.15.33:0/3841887818 shutdown_connections 2023-10-09T15:32:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.901+0000 7f5074bd6700 1 -- 172.21.15.33:0/3841887818 wait complete. 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 Processor -- start 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 -- start start 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c004810 0x7f50701559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 0x7f50700b2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50701601e0 con 0x7f507015f820 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50700b3120 con 0x7f505c004810 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.902+0000 7f5074bd6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f507015f390 con 0x7f50700b2770 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34760/0 (socket says 172.21.15.33:34760) 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 -- 172.21.15.33:0/1051836009 learned_addr learned my addr 172.21.15.33:0/1051836009 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506e59c700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c004810 0x7f50701559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506dd9b700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 0x7f50700b2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 -- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 msgr2=0x7f50700b2be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 0x7f50700b2be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 -- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c004810 msgr2=0x7f50701559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c004810 0x7f50701559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 -- 172.21.15.33:0/1051836009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f507015e780 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506dd9b700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 0x7f50700b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f506ed9d700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5060000f80 tx=0x7f5060009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506000ee70 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f50600032e0 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f50600016e0 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f507015ea60 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.903+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f507015f020 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.904+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507015f500 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.905+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5060001ad0 con 0x7f507015f820 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.905+0000 7f50667fc700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 0x7f5050069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:47.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.905+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5060084190 con 0x7f507015f820 2023-10-09T15:32:47.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.905+0000 7f506e59c700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 0x7f5050069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:47.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.905+0000 7f506e59c700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 0x7f5050069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5070066170 tx=0x7f5068008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:47.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:47.909+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50600517d0 con 0x7f507015f820 2023-10-09T15:32:48.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.149+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f507015f500 con 0x7f507015f820 2023-10-09T15:32:48.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.149+0000 7f50667fc700 1 -- 172.21.15.33:0/1051836009 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f5060054df0 con 0x7f507015f820 2023-10-09T15:32:48.149 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:48.149 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":33,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5075,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1871624618","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1871624618},{"type":"v1","addr":"172.21.15.59:6835","nonce":1871624618}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":33},{"gid":5361,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1360953448","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1360953448},{"type":"v1","addr":"172.21.15.33:6836","nonce":1360953448}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5364,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1126839739","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1126839739},{"type":"v1","addr":"172.21.15.33:6837","nonce":1126839739}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25},{"gid":5373,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/808921568","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":808921568},{"type":"v1","addr":"172.21.15.59:6834","nonce":808921568}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":25}],"filesystems":[]} 2023-10-09T15:32:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 msgr2=0x7f5050069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 0x7f5050069470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f5070066170 tx=0x7f5068008040 comp rx=0 tx=0).stop 2023-10-09T15:32:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 msgr2=0x7f507015fca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:48.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f5060000f80 tx=0x7f5060009040 comp rx=0 tx=0).stop 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 shutdown_connections 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5050066fc0 0x7f5050069470 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f507015f820 0x7f507015fca0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f505c004810 0x7f50701559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 --2- 172.21.15.33:0/1051836009 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50700b2770 0x7f50700b2be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 >> 172.21.15.33:0/1051836009 conn(0x7f507006ce80 msgr2=0x7f50700682f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 shutdown_connections 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:48.151+0000 7f5074bd6700 1 -- 172.21.15.33:0/1051836009 wait complete. 2023-10-09T15:32:48.152 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 33 2023-10-09T15:32:48.163 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:32:48.164 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:32:48.164 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:32:48.164 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:48.164 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:32:48.164 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:32:48.164 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:32:48.164 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:48.165 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:32:48.165 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:32:48.165 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:32:48.165 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:48.165 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:32:48.165 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:32:48.166 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:32:48.166 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:32:48.174 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:32:48.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:32:48.176 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:32:48.177 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:32:48.178 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:32:48.178 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:32:48.216 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:32:48.216 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:48.219 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:32:48.219 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:48.219 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:32:48.220 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:48.292 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:32:48.304 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:32:48.304 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:32:51.005 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2023-10-09T15:32:54.173 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:32:54.174 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:32:54.177 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:32:54.177 DEBUG:teuthology.parallel:result is None 2023-10-09T15:32:54.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:32:54.265 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:32:54.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.313+0000 7f2a8f98a700 1 Processor -- start 2023-10-09T15:32:54.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.313+0000 7f2a8f98a700 1 -- start start 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8f98a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 0x7f2a880af020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8f98a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 0x7f2a880cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8f98a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a88158000 con 0x7f2a880af560 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8f98a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a880cb4d0 con 0x7f2a88140e50 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8f98a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880cbd10 con 0x7f2a8815b920 2023-10-09T15:32:54.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8cf25700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2a880af560 0x7f2a8815b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50848/0 (socket says 172.21.15.33:50848) 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8cf25700 1 -- 172.21.15.33:0/964305120 learned_addr learned my addr 172.21.15.33:0/964305120 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8d726700 1 --2- 172.21.15.33:0/964305120 >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 0x7f2a880af020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.314+0000 7f2a8df27700 1 --2- 172.21.15.33:0/964305120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 0x7f2a880cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8df27700 1 -- 172.21.15.33:0/964305120 >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 msgr2=0x7f2a880af020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8df27700 1 --2- 172.21.15.33:0/964305120 >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 0x7f2a880af020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8df27700 1 -- 172.21.15.33:0/964305120 >> v1:172.21.15.33:6789/0 conn(0x7f2a880af560 legacy=0x7f2a8815b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8df27700 1 -- 172.21.15.33:0/964305120 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a880af9b0 con 0x7f2a8815b920 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8d726700 1 --2- 172.21.15.33:0/964305120 >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 0x7f2a880af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:32:54.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.315+0000 7f2a8df27700 1 --2- 172.21.15.33:0/964305120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 0x7f2a880cc1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009e60 tx=0x7f2a80009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f7f23e6721f8d0e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a7ffff700 1 -- 172.21.15.33:0/964305120 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a8000e070 con 0x7f2a8815b920 2023-10-09T15:32:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a7ffff700 1 -- 172.21.15.33:0/964305120 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a8000bb60 con 0x7f2a8815b920 2023-10-09T15:32:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a7ffff700 1 -- 172.21.15.33:0/964305120 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80012430 con 0x7f2a8815b920 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 -- 172.21.15.33:0/964305120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 msgr2=0x7f2a880cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/964305120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 0x7f2a880cc1a0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2a80009e60 tx=0x7f2a80009780 comp rx=0 tx=0).stop 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 -- 172.21.15.33:0/964305120 shutdown_connections 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/964305120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a8815b920 0x7f2a880cc1a0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/964305120 >> v2:172.21.15.59:3300/0 conn(0x7f2a88140e50 0x7f2a880af020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.318+0000 7f2a8f98a700 1 -- 172.21.15.33:0/964305120 >> 172.21.15.33:0/964305120 conn(0x7f2a880cded0 msgr2=0x7f2a8806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.319+0000 7f2a8f98a700 1 -- 172.21.15.33:0/964305120 shutdown_connections 2023-10-09T15:32:54.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.319+0000 7f2a8f98a700 1 -- 172.21.15.33:0/964305120 wait complete. 2023-10-09T15:32:54.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.320+0000 7f2a8f98a700 1 Processor -- start 2023-10-09T15:32:54.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.320+0000 7f2a8f98a700 1 -- start start 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a880af560 0x7f2a880c7b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a88140e50 0x7f2a880a5ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880a6420 con 0x7f2a8815b920 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a88169970 con 0x7f2a88140e50 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8f98a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a880a6630 con 0x7f2a880af560 2023-10-09T15:32:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36890/0 (socket says 172.21.15.33:36890) 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 -- 172.21.15.33:0/196435234 learned_addr learned my addr 172.21.15.33:0/196435234 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8d726700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a880af560 0x7f2a880c7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8cf25700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a88140e50 0x7f2a880a5ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 -- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a880af560 msgr2=0x7f2a880c7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a880af560 0x7f2a880c7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 -- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a88140e50 msgr2=0x7f2a880a5ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a88140e50 0x7f2a880a5ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 -- 172.21.15.33:0/196435234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a84009420 con 0x7f2a8815b920 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.321+0000 7f2a8df27700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2a880cbe50 tx=0x7f2a80019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.322+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80012ea0 con 0x7f2a8815b920 2023-10-09T15:32:54.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.322+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a80027470 con 0x7f2a8815b920 2023-10-09T15:32:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.322+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a80009a20 con 0x7f2a8815b920 2023-10-09T15:32:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.322+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a80027850 con 0x7f2a8815b920 2023-10-09T15:32:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.322+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a880a6bf0 con 0x7f2a8815b920 2023-10-09T15:32:54.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.323+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a88169b30 con 0x7f2a8815b920 2023-10-09T15:32:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.323+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2a80024070 con 0x7f2a8815b920 2023-10-09T15:32:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.323+0000 7f2a7d7fa700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.323+0000 7f2a8d726700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.323+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(58..58 src has 1..58) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2a80086d50 con 0x7f2a8815b920 2023-10-09T15:32:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.324+0000 7f2a8d726700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a881574f0 tx=0x7f2a840091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:54.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.328+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a800542d0 con 0x7f2a8815b920 2023-10-09T15:32:54.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:54.537+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2a8804c3c0 con 0x7f2a8815b920 2023-10-09T15:32:55.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.326+0000 7f2a7d7fa700 1 -- 172.21.15.33:0/196435234 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v59) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2a800578f0 con 0x7f2a8815b920 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 msgr2=0x7f2a6c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 0x7f2a6c069470 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f2a881574f0 tx=0x7f2a840091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 msgr2=0x7f2a8813fdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f2a880cbe50 tx=0x7f2a80019000 comp rx=0 tx=0).stop 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 shutdown_connections 2023-10-09T15:32:55.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a6c066fc0 0x7f2a6c069470 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a8815b920 0x7f2a8813fdb0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a880af560 0x7f2a880c7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 --2- 172.21.15.33:0/196435234 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a88140e50 0x7f2a880a5ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 >> 172.21.15.33:0/196435234 conn(0x7f2a880cded0 msgr2=0x7f2a880675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 shutdown_connections 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.329+0000 7f2a8f98a700 1 -- 172.21.15.33:0/196435234 wait complete. 2023-10-09T15:32:55.330 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:32:55.343 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:32:55.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.470+0000 7fc290af1700 1 Processor -- start 2023-10-09T15:32:55.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.470+0000 7fc290af1700 1 -- start start 2023-10-09T15:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc290af1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc28c0cb5a0 0x7fc28c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc290af1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc28c0cd9e0 0x7fc28c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc290af1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc28c15ae40 con 0x7fc28c15a400 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc290af1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c0d13f0 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc290af1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc28c15ab60 con 0x7fc28c0cb5a0 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc28c0cd9e0 0x7fc28c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc28ad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc28c15a400 0x7fc28c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50864/0 (socket says 172.21.15.33:50864) 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc28ad9d700 1 -- 172.21.15.33:0/412572536 learned_addr learned my addr 172.21.15.33:0/412572536 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc28a59c700 1 --2- 172.21.15.33:0/412572536 >> v2:172.21.15.59:3300/0 conn(0x7fc28c0cb5a0 0x7fc28c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 -- 172.21.15.33:0/412572536 >> v2:172.21.15.59:3300/0 conn(0x7fc28c0cb5a0 msgr2=0x7fc28c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 --2- 172.21.15.33:0/412572536 >> v2:172.21.15.59:3300/0 conn(0x7fc28c0cb5a0 0x7fc28c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 -- 172.21.15.33:0/412572536 >> v1:172.21.15.33:6789/0 conn(0x7fc28c15a400 legacy=0x7fc28c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc28959a700 1 -- 172.21.15.33:0/412572536 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 998888741 0 0) 0x7fc28c15ae40 con 0x7fc28c15a400 2023-10-09T15:32:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 -- 172.21.15.33:0/412572536 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc28c0ccf00 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc289d9b700 1 --2- 172.21.15.33:0/412572536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c159ec0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc2740098e0 tx=0x7fc2740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=533c1e6fd2f88c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.471+0000 7fc28959a700 1 -- 172.21.15.33:0/412572536 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274009e80 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc28959a700 1 -- 172.21.15.33:0/412572536 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27400b820 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc28959a700 1 -- 172.21.15.33:0/412572536 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27400bba0 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 -- 172.21.15.33:0/412572536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 msgr2=0x7fc28c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 --2- 172.21.15.33:0/412572536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c159ec0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fc2740098e0 tx=0x7fc2740091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 -- 172.21.15.33:0/412572536 shutdown_connections 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 --2- 172.21.15.33:0/412572536 >> v2:172.21.15.59:3300/0 conn(0x7fc28c0cb5a0 0x7fc28c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 --2- 172.21.15.33:0/412572536 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c159ec0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 -- 172.21.15.33:0/412572536 >> 172.21.15.33:0/412572536 conn(0x7fc28c070e30 msgr2=0x7fc28c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 -- 172.21.15.33:0/412572536 shutdown_connections 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.472+0000 7fc290af1700 1 -- 172.21.15.33:0/412572536 wait complete. 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.473+0000 7fc290af1700 1 Processor -- start 2023-10-09T15:32:55.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.473+0000 7fc290af1700 1 -- start start 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc28c0cb5a0 0x7fc28c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc28c15a400 0x7fc28c15d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0b6330 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0c8a30 con 0x7fc28c0cb5a0 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc290af1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc28c0c8ff0 con 0x7fc28c15a400 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36904/0 (socket says 172.21.15.33:36904) 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 -- 172.21.15.33:0/510020124 learned_addr learned my addr 172.21.15.33:0/510020124 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc28ad9d700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc28c15a400 0x7fc28c15d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 -- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc28c15a400 msgr2=0x7fc28c15d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc28a59c700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc28c0cb5a0 0x7fc28c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc28c15a400 0x7fc28c15d810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 -- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc28c0cb5a0 msgr2=0x7fc28c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc28c0cb5a0 0x7fc28c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.474+0000 7fc289d9b700 1 -- 172.21.15.33:0/510020124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc274009420 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc289d9b700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc27400b3c0 tx=0x7fc274017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27401f070 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc274000bc0 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc28c0b58e0 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc274025420 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.475+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc28c0b5c70 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.476+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc28c15b610 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.476+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fc274023070 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.476+0000 7fc2827fc700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 0x7fc26c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.477+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc274085760 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.477+0000 7fc28a59c700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 0x7fc26c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.477+0000 7fc28a59c700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 0x7fc26c069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006fd0 tx=0x7fc27c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.481+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc274052d30 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.752+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fc28c0c9130 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.752+0000 7fc2827fc700 1 -- 172.21.15.33:0/510020124 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fc274015090 con 0x7fc28c0cd9e0 2023-10-09T15:32:55.752 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:55.752 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:32:55.752 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:32:55.752 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:32:55.753 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:32:55.756 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.757 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.758 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.759 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:32:55.761 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:55.762 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:32:55.764 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:32:55.765 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:32:55.766 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 msgr2=0x7fc26c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 0x7fc26c069470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fc27c006fd0 tx=0x7fc27c008040 comp rx=0 tx=0).stop 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 msgr2=0x7fc28c153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fc27400b3c0 tx=0x7fc274017000 comp rx=0 tx=0).stop 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 shutdown_connections 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc26c066fc0 0x7fc26c069470 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc28c15a400 0x7fc28c15d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc28c0cb5a0 0x7fc28c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 --2- 172.21.15.33:0/510020124 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc28c0cd9e0 0x7fc28c153140 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 >> 172.21.15.33:0/510020124 conn(0x7fc28c070e30 msgr2=0x7fc28c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 shutdown_connections 2023-10-09T15:32:55.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.754+0000 7fc290af1700 1 -- 172.21.15.33:0/510020124 wait complete. 2023-10-09T15:32:55.769 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:55.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.889+0000 7f2aab310700 1 Processor -- start 2023-10-09T15:32:55.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.889+0000 7f2aab310700 1 -- start start 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aab310700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2aa40cb970 0x7f2aa4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aab310700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 0x7f2aa4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aab310700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aa415ae40 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aab310700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40ce0f0 con 0x7f2aa40cb970 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aab310700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aa40d13f0 con 0x7f2aa415a400 2023-10-09T15:32:55.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2aa40cb970 0x7f2aa4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa90ac700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2aa40cb5a0 0x7f2aa40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50866/0 (socket says 172.21.15.33:50866) 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa90ac700 1 -- 172.21.15.33:0/786828030 learned_addr learned my addr 172.21.15.33:0/786828030 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa98ad700 1 --2- 172.21.15.33:0/786828030 >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 0x7f2aa4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 -- 172.21.15.33:0/786828030 >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 msgr2=0x7f2aa4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 --2- 172.21.15.33:0/786828030 >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 0x7f2aa4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 -- 172.21.15.33:0/786828030 >> v1:172.21.15.33:6789/0 conn(0x7f2aa40cb5a0 legacy=0x7f2aa40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa3fff700 1 -- 172.21.15.33:0/786828030 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4078558891 0 0) 0x7f2aa415ae40 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 -- 172.21.15.33:0/786828030 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aa415ab60 con 0x7f2aa40cb970 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa98ad700 1 --2- 172.21.15.33:0/786828030 >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 0x7f2aa4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:55.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.890+0000 7f2aa88ab700 1 --2- 172.21.15.33:0/786828030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb970 0x7f2aa4159ec0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ccdf0 tx=0x7f2a980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea670d12fd7e4311 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aa3fff700 1 -- 172.21.15.33:0/786828030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800b6b0 con 0x7f2aa40cb970 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aa3fff700 1 -- 172.21.15.33:0/786828030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9800b810 con 0x7f2aa40cb970 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aa3fff700 1 -- 172.21.15.33:0/786828030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9800bbb0 con 0x7f2aa40cb970 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 -- 172.21.15.33:0/786828030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb970 msgr2=0x7f2aa4159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 --2- 172.21.15.33:0/786828030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb970 0x7f2aa4159ec0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ccdf0 tx=0x7f2a980091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 -- 172.21.15.33:0/786828030 shutdown_connections 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 --2- 172.21.15.33:0/786828030 >> v2:172.21.15.59:3300/0 conn(0x7f2aa415a400 0x7f2aa4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 --2- 172.21.15.33:0/786828030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb970 0x7f2aa4159ec0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 -- 172.21.15.33:0/786828030 >> 172.21.15.33:0/786828030 conn(0x7f2aa4070e30 msgr2=0x7f2aa40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 -- 172.21.15.33:0/786828030 shutdown_connections 2023-10-09T15:32:55.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.891+0000 7f2aab310700 1 -- 172.21.15.33:0/786828030 wait complete. 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.892+0000 7f2aab310700 1 Processor -- start 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.892+0000 7f2aab310700 1 -- start start 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa40cb970 0x7f2aa40c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa415a400 0x7f2aa416a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4152ab0 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4154e80 con 0x7f2aa415a400 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aab310700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa4154270 con 0x7f2aa40cb970 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aa90ac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aa90ac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36916/0 (socket says 172.21.15.33:36916) 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.893+0000 7f2aa90ac700 1 -- 172.21.15.33:0/3600974483 learned_addr learned my addr 172.21.15.33:0/3600974483 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 -- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa40cb970 msgr2=0x7f2aa40c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa40cb970 0x7f2aa40c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 -- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa415a400 msgr2=0x7f2aa416a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa415a400 0x7f2aa416a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:55.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 -- 172.21.15.33:0/3600974483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a98009420 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa90ac700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c7e0 tx=0x7f2a9c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c005b30 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a9c005c90 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa4154550 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a9c007300 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.894+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa4154b10 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.895+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa404c3c0 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.895+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2a9c01b400 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.896+0000 7f2aa17fa700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 0x7f2a90069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.896+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2a9c083cb0 con 0x7f2aa40cb5a0 2023-10-09T15:32:55.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.896+0000 7f2aa88ab700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 0x7f2a90069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:55.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.896+0000 7f2aa88ab700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 0x7f2a90069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ca8e0 tx=0x7f2a98017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:55.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:55.900+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a9c051300 con 0x7f2aa40cb5a0 2023-10-09T15:32:56.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.096+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2aa40ccf00 con 0x7f2aa40cb5a0 2023-10-09T15:32:56.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.096+0000 7f2aa17fa700 1 -- 172.21.15.33:0/3600974483 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v59) v1 ==== 74+0+12086 (secure 0 0 0) 0x7f2a9c054920 con 0x7f2aa40cb5a0 2023-10-09T15:32:56.096 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:56.096 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:55.319321+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":49,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 msgr2=0x7f2a90069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 0x7f2a90069470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f2aa40ca8e0 tx=0x7f2a98017000 comp rx=0 tx=0).stop 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 msgr2=0x7f2aa40af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2a9c00c7e0 tx=0x7f2a9c007df0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 shutdown_connections 2023-10-09T15:32:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a90066fc0 0x7f2a90069470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aa40cb5a0 0x7f2aa40af4c0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aa415a400 0x7f2aa416a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 --2- 172.21.15.33:0/3600974483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aa40cb970 0x7f2aa40c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 >> 172.21.15.33:0/3600974483 conn(0x7f2aa4070e30 msgr2=0x7f2aa40b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 shutdown_connections 2023-10-09T15:32:56.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.099+0000 7f2aab310700 1 -- 172.21.15.33:0/3600974483 wait complete. 2023-10-09T15:32:56.111 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:32:56.111 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:32:56.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.234+0000 7f0905a88700 1 Processor -- start 2023-10-09T15:32:56.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.234+0000 7f0905a88700 1 -- start start 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f0905a88700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f090006dc70 0x7f0900159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f0905a88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f090006e0e0 0x7f09000cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f0905a88700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09000ccfd0 con 0x7f0900159530 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f0905a88700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090015a3d0 con 0x7f090006dc70 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f0905a88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090015a6b0 con 0x7f090006e0e0 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f08feffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f090006dc70 0x7f0900159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f08feffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f090006dc70 0x7f0900159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36920/0 (socket says 172.21.15.33:36920) 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f08feffd700 1 -- 172.21.15.33:0/3507436616 learned_addr learned my addr 172.21.15.33:0/3507436616 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:56.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.235+0000 7f08fffff700 1 --2- 172.21.15.33:0/3507436616 >> v2:172.21.15.59:3300/0 conn(0x7f090006e0e0 0x7f09000cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08feffd700 1 -- 172.21.15.33:0/3507436616 >> v2:172.21.15.59:3300/0 conn(0x7f090006e0e0 msgr2=0x7f09000cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08feffd700 1 --2- 172.21.15.33:0/3507436616 >> v2:172.21.15.59:3300/0 conn(0x7f090006e0e0 0x7f09000cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08feffd700 1 -- 172.21.15.33:0/3507436616 >> v1:172.21.15.59:6789/0 conn(0x7f0900159530 legacy=0x7f09000ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08feffd700 1 -- 172.21.15.33:0/3507436616 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090015a990 con 0x7f090006dc70 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08feffd700 1 --2- 172.21.15.33:0/3507436616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006dc70 0x7f0900159900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09000cf2b0 tx=0x7f08f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=462f7001100831e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08fe7fc700 1 -- 172.21.15.33:0/3507436616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f4009e70 con 0x7f090006dc70 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08fe7fc700 1 -- 172.21.15.33:0/3507436616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f400b860 con 0x7f090006dc70 2023-10-09T15:32:56.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f08fe7fc700 1 -- 172.21.15.33:0/3507436616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bc00 con 0x7f090006dc70 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 -- 172.21.15.33:0/3507436616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006dc70 msgr2=0x7f0900159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 --2- 172.21.15.33:0/3507436616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006dc70 0x7f0900159900 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f09000cf2b0 tx=0x7f08f4009250 comp rx=0 tx=0).stop 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 -- 172.21.15.33:0/3507436616 shutdown_connections 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 --2- 172.21.15.33:0/3507436616 >> v2:172.21.15.59:3300/0 conn(0x7f090006e0e0 0x7f09000cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 --2- 172.21.15.33:0/3507436616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006dc70 0x7f0900159900 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.236+0000 7f0905a88700 1 -- 172.21.15.33:0/3507436616 >> 172.21.15.33:0/3507436616 conn(0x7f09000703a0 msgr2=0x7f09000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.237+0000 7f0905a88700 1 -- 172.21.15.33:0/3507436616 shutdown_connections 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.237+0000 7f0905a88700 1 -- 172.21.15.33:0/3507436616 wait complete. 2023-10-09T15:32:56.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.238+0000 7f0905a88700 1 Processor -- start 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.238+0000 7f0905a88700 1 -- start start 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.238+0000 7f0905a88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006dc70 0x7f090014e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.238+0000 7f0905a88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0900159530 0x7f0900152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090014eb50 con 0x7f090006e0e0 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000b3480 con 0x7f0900159530 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000b3720 con 0x7f090006dc70 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36924/0 (socket says 172.21.15.33:36924) 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 -- 172.21.15.33:0/953843086 learned_addr learned my addr 172.21.15.33:0/953843086 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08fffff700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0900159530 0x7f0900152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08ff7fe700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006dc70 0x7f090014e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 -- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006dc70 msgr2=0x7f090014e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006dc70 0x7f090014e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 -- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0900159530 msgr2=0x7f0900152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0900159530 0x7f0900152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 -- 172.21.15.33:0/953843086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08f40094f0 con 0x7f090006e0e0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08feffd700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0900089650 tx=0x7f08f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f400bbe0 con 0x7f090006e0e0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f4011420 con 0x7f090006e0e0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f40117e0 con 0x7f090006e0e0 2023-10-09T15:32:56.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09000b3a00 con 0x7f090006e0e0 2023-10-09T15:32:56.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.239+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000b3fc0 con 0x7f090006e0e0 2023-10-09T15:32:56.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.240+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f090004c3c0 con 0x7f090006e0e0 2023-10-09T15:32:56.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.241+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f08f4011c10 con 0x7f090006e0e0 2023-10-09T15:32:56.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.241+0000 7f08e77fe700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 0x7f08ec069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.241+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f08f4085a70 con 0x7f090006e0e0 2023-10-09T15:32:56.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.241+0000 7f08ff7fe700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 0x7f08ec069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.242+0000 7f08ff7fe700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 0x7f08ec069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f08f00039e0 tx=0x7f08f0007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.245+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08f4053040 con 0x7f090006e0e0 2023-10-09T15:32:56.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.441+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f090015ac70 con 0x7f090006e0e0 2023-10-09T15:32:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.442+0000 7f08e77fe700 1 -- 172.21.15.33:0/953843086 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v59) v1 ==== 93+0+10 (secure 0 0 0) 0x7f08f4056660 con 0x7f090006e0e0 2023-10-09T15:32:56.442 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:32:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 msgr2=0x7f08ec069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 0x7f08ec069470 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f08f00039e0 tx=0x7f08f0007ec0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 msgr2=0x7f09000b0fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0900089650 tx=0x7f08f4017000 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 shutdown_connections 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec066fc0 0x7f08ec069470 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0900159530 0x7f0900152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006dc70 0x7f090014e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 --2- 172.21.15.33:0/953843086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f090006e0e0 0x7f09000b0fb0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 >> 172.21.15.33:0/953843086 conn(0x7f09000703a0 msgr2=0x7f09000d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 shutdown_connections 2023-10-09T15:32:56.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.444+0000 7f0905a88700 1 -- 172.21.15.33:0/953843086 wait complete. 2023-10-09T15:32:56.456 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:32:56.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.575+0000 7ff780446700 1 Processor -- start 2023-10-09T15:32:56.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.575+0000 7ff780446700 1 -- start start 2023-10-09T15:32:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff780446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff7781599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff780446700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff778067a10 0x7ff7780c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff780446700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7780c7f50 con 0x7ff7780675a0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff780446700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff77806bd00 con 0x7ff778067a10 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff780446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff77806b740 con 0x7ff7781595d0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d9e1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff7780675a0 0x7ff77806acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50880/0 (socket says 172.21.15.33:50880) 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d9e1700 1 -- 172.21.15.33:0/3157897811 learned_addr learned my addr 172.21.15.33:0/3157897811 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3157897811 >> v2:172.21.15.59:3300/0 conn(0x7ff778067a10 0x7ff7780c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359627706 0 0) 0x7ff7780c7f50 con 0x7ff7780675a0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77e1e2700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff7781599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff760003570 con 0x7ff7780675a0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 905504002 0 0) 0x7ff760003570 con 0x7ff7780675a0 2023-10-09T15:32:56.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 msgr2=0x7ff7781599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff7781599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 >> v2:172.21.15.59:3300/0 conn(0x7ff778067a10 msgr2=0x7ff7780c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 --2- 172.21.15.33:0/3157897811 >> v2:172.21.15.59:3300/0 conn(0x7ff778067a10 0x7ff7780c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff77806ba20 con 0x7ff7780675a0 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7ff76c001470 con 0x7ff7780675a0 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 >> v1:172.21.15.33:6789/0 conn(0x7ff7780675a0 legacy=0x7ff77806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff760003a60 0x7ff760003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff760004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff760004d50 0x7ff7600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff77806b740 con 0x7ff760004d50 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff76000ba60 con 0x7ff760003a60 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.576+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff76000bba0 con 0x7ff7781595d0 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff760004d50 0x7ff7600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e1e2700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff760003a60 0x7ff760003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77d9e1700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff760004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 msgr2=0x7ff760004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7781595d0 0x7ff760004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff760003a60 msgr2=0x7ff760003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff760003a60 0x7ff760003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3157897811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff760003570 con 0x7ff760004d50 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff760004d50 0x7ff7600051c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e210 tx=0x7ff77000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f3e24e554d98322 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000ea60 con 0x7ff760004d50 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77000f040 con 0x7ff760004d50 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.577+0000 7ff77d1e0700 1 -- 172.21.15.33:0/3157897811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77000ee10 con 0x7ff760004d50 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 -- 172.21.15.33:0/3157897811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff760004d50 msgr2=0x7ff7600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 --2- 172.21.15.33:0/3157897811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff760004d50 0x7ff7600051c0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e210 tx=0x7ff77000b040 comp rx=0 tx=0).stop 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3157897811 reap_dead start 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 -- 172.21.15.33:0/3157897811 shutdown_connections 2023-10-09T15:32:56.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 -- 172.21.15.33:0/3157897811 >> 172.21.15.33:0/3157897811 conn(0x7ff7780cd400 msgr2=0x7ff7780cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 -- 172.21.15.33:0/3157897811 shutdown_connections 2023-10-09T15:32:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.578+0000 7ff780446700 1 -- 172.21.15.33:0/3157897811 wait complete. 2023-10-09T15:32:56.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.579+0000 7ff780446700 1 Processor -- start 2023-10-09T15:32:56.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.579+0000 7ff780446700 1 -- start start 2023-10-09T15:32:56.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff760004d50 0x7ff77815c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7780b0ac0 0x7ff7780c6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7781548f0 con 0x7ff7780c6a60 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c6090 con 0x7ff7780b0ac0 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff780446700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7780c5480 con 0x7ff760004d50 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36942/0 (socket says 172.21.15.33:36942) 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3496074614 learned_addr learned my addr 172.21.15.33:0/3496074614 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e1e2700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff760004d50 0x7ff77815c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77d9e1700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7780b0ac0 0x7ff7780c6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff760004d50 msgr2=0x7ff77815c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff760004d50 0x7ff77815c6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7780b0ac0 msgr2=0x7ff7780c6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7780b0ac0 0x7ff7780c6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 -- 172.21.15.33:0/3496074614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7780c5760 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff77e9e3700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e800 tx=0x7ff77001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.580+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77001d630 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.581+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff77001d7b0 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.581+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7780c5a40 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.581+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff77001db70 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.581+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff77815cbe0 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.582+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7780c6220 con 0x7ff7780c6a60 2023-10-09T15:32:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.582+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff770003040 con 0x7ff7780c6a60 2023-10-09T15:32:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.583+0000 7ff7767fc700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 0x7ff764069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.583+0000 7ff77e1e2700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 0x7ff764069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.583+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff770085380 con 0x7ff7780c6a60 2023-10-09T15:32:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.583+0000 7ff77e1e2700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 0x7ff764069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff768006f00 tx=0x7ff7680091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.587+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff770052900 con 0x7ff7780c6a60 2023-10-09T15:32:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.785+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7ff77804c3c0 con 0x7ff7780c6a60 2023-10-09T15:32:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.785+0000 7ff7767fc700 1 -- 172.21.15.33:0/3496074614 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v59) v1 ==== 84+0+65 (secure 0 0 0) 0x7ff770018060 con 0x7ff7780c6a60 2023-10-09T15:32:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:56.785 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:32:56.785 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:32:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:32:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:32:56.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:32:56.786 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:32:56.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 msgr2=0x7ff764069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 0x7ff764069470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff768006f00 tx=0x7ff7680091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 msgr2=0x7ff7781599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7ff77000e800 tx=0x7ff77001a000 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 shutdown_connections 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff764066fc0 0x7ff764069470 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7780c6a60 0x7ff7781599a0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff760004d50 0x7ff77815c6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 --2- 172.21.15.33:0/3496074614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7780b0ac0 0x7ff7780c6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 >> 172.21.15.33:0/3496074614 conn(0x7ff7780cd400 msgr2=0x7ff778154b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.787+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 shutdown_connections 2023-10-09T15:32:56.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.788+0000 7ff780446700 1 -- 172.21.15.33:0/3496074614 wait complete. 2023-10-09T15:32:56.799 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:32:56.799 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:32:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.923+0000 7f003e79f700 1 Processor -- start 2023-10-09T15:32:56.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.923+0000 7f003e79f700 1 -- start start 2023-10-09T15:32:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003e79f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0038159800 0x7f00380b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003e79f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b1d40 0x7f00380b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003e79f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00380b0c80 con 0x7f00380b24f0 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003e79f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00380d10d0 con 0x7f0038159800 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003e79f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380b0f60 con 0x7f00380b1d40 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003cf9c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0038159800 0x7f00380b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003d79d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f00380b24f0 0x7f00381590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50882/0 (socket says 172.21.15.33:50882) 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.924+0000 7f003d79d700 1 -- 172.21.15.33:0/1050150547 learned_addr learned my addr 172.21.15.33:0/1050150547 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003df9e700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b1d40 0x7f00380b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003cf9c700 1 -- 172.21.15.33:0/1050150547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b1d40 msgr2=0x7f00380b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003cf9c700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b1d40 0x7f00380b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003cf9c700 1 -- 172.21.15.33:0/1050150547 >> v1:172.21.15.33:6789/0 conn(0x7f00380b24f0 legacy=0x7f00381590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003cf9c700 1 -- 172.21.15.33:0/1050150547 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00380b1240 con 0x7f0038159800 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f0037fff700 1 -- 172.21.15.33:0/1050150547 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1352388678 0 0) 0x7f00380b0c80 con 0x7f00380b24f0 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003cf9c700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038159800 0x7f00380b0580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f002c0098e0 tx=0x7f002c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=723c1460c3cd4476 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f0037fff700 1 -- 172.21.15.33:0/1050150547 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c009e80 con 0x7f0038159800 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f0037fff700 1 -- 172.21.15.33:0/1050150547 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002c00b860 con 0x7f0038159800 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f0037fff700 1 -- 172.21.15.33:0/1050150547 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002c00bbe0 con 0x7f0038159800 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 -- 172.21.15.33:0/1050150547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038159800 msgr2=0x7f00380b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038159800 0x7f00380b0580 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f002c0098e0 tx=0x7f002c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 -- 172.21.15.33:0/1050150547 shutdown_connections 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b1d40 0x7f00380b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 --2- 172.21.15.33:0/1050150547 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0038159800 0x7f00380b0580 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.925+0000 7f003e79f700 1 -- 172.21.15.33:0/1050150547 >> 172.21.15.33:0/1050150547 conn(0x7f00380703a0 msgr2=0x7f00380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.926+0000 7f003e79f700 1 -- 172.21.15.33:0/1050150547 shutdown_connections 2023-10-09T15:32:56.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.926+0000 7f003e79f700 1 -- 172.21.15.33:0/1050150547 wait complete. 2023-10-09T15:32:56.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.927+0000 7f003e79f700 1 Processor -- start 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.927+0000 7f003e79f700 1 -- start start 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b24f0 0x7f0038153680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0038159800 0x7f00380a8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038169a10 con 0x7f00380b1d40 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0038154220 con 0x7f0038159800 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00380a7bb0 con 0x7f00380b24f0 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36970/0 (socket says 172.21.15.33:36970) 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 -- 172.21.15.33:0/1853648105 learned_addr learned my addr 172.21.15.33:0/1853648105 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003cf9c700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b24f0 0x7f0038153680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003df9e700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0038159800 0x7f00380a8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 -- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b24f0 msgr2=0x7f0038153680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b24f0 0x7f0038153680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 -- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0038159800 msgr2=0x7f00380a8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0038159800 0x7f00380a8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 -- 172.21.15.33:0/1853648105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f002c009420 con 0x7f00380b1d40 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003d79d700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f002800cd80 tx=0x7f0028001ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002800ab10 con 0x7f00380b1d40 2023-10-09T15:32:56.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002800ac70 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00380a7e90 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00280070f0 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.928+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00380a8220 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.929+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00380d0ca0 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.930+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f00280074e0 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.930+0000 7f00357fa700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 0x7f0024069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.930+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(59..59 src has 1..59) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0028084730 con 0x7f00380b1d40 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.930+0000 7f003cf9c700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 0x7f0024069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:56.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.931+0000 7f003cf9c700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 0x7f0024069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f002c0091e0 tx=0x7f002c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:56.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:56.935+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0028051d80 con 0x7f00380b1d40 2023-10-09T15:32:57.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.127+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f003804c3c0 con 0x7f00380b1d40 2023-10-09T15:32:57.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.331+0000 7f00357fa700 1 -- 172.21.15.33:0/1853648105 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v60) v1 ==== 138+0+0 (secure 0 0 0) 0x7f00280553a0 con 0x7f00380b1d40 2023-10-09T15:32:57.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 msgr2=0x7f0024069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:57.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 0x7f0024069470 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f002c0091e0 tx=0x7f002c017000 comp rx=0 tx=0).stop 2023-10-09T15:32:57.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 msgr2=0x7f003815baf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:57.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f002800cd80 tx=0x7f0028001ae0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 shutdown_connections 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0024066fc0 0x7f0024069470 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00380b1d40 0x7f003815baf0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0038159800 0x7f00380a8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 --2- 172.21.15.33:0/1853648105 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00380b24f0 0x7f0038153680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 >> 172.21.15.33:0/1853648105 conn(0x7f00380703a0 msgr2=0x7f0038155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 shutdown_connections 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.334+0000 7f003e79f700 1 -- 172.21.15.33:0/1853648105 wait complete. 2023-10-09T15:32:57.335 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:32:57.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:32:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.475+0000 7f8af1ca0700 1 Processor -- start 2023-10-09T15:32:57.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.475+0000 7f8af1ca0700 1 -- start start 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af1ca0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8aec13fb20 0x7f8aec15a930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af1ca0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 0x7f8aec0c7990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af1ca0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8aec15ae70 con 0x7f8aec06aaa0 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af1ca0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec06af60 con 0x7f8aec13fb20 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af1ca0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8aec06b240 con 0x7f8aec13fef0 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af0c9e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8aec13fb20 0x7f8aec15a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af0c9e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8aec13fb20 0x7f8aec15a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36972/0 (socket says 172.21.15.33:36972) 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8af0c9e700 1 -- 172.21.15.33:0/2709837760 learned_addr learned my addr 172.21.15.33:0/2709837760 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:57.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.476+0000 7f8aebfff700 1 --2- 172.21.15.33:0/2709837760 >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 0x7f8aec0c7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af0c9e700 1 -- 172.21.15.33:0/2709837760 >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 msgr2=0x7f8aec0c7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af0c9e700 1 --2- 172.21.15.33:0/2709837760 >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 0x7f8aec0c7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af0c9e700 1 -- 172.21.15.33:0/2709837760 >> v1:172.21.15.59:6789/0 conn(0x7f8aec06aaa0 legacy=0x7f8aec0c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af0c9e700 1 -- 172.21.15.33:0/2709837760 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8aec06b520 con 0x7f8aec13fb20 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8aebfff700 1 --2- 172.21.15.33:0/2709837760 >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 0x7f8aec0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af0c9e700 1 --2- 172.21.15.33:0/2709837760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec13fb20 0x7f8aec15a930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06a5e0 tx=0x7f8ae400ba50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce85e3a73635a79a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8aeb7fe700 1 -- 172.21.15.33:0/2709837760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4010070 con 0x7f8aec13fb20 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8aeb7fe700 1 -- 172.21.15.33:0/2709837760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae400de50 con 0x7f8aec13fb20 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8aeb7fe700 1 -- 172.21.15.33:0/2709837760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae400b320 con 0x7f8aec13fb20 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 -- 172.21.15.33:0/2709837760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec13fb20 msgr2=0x7f8aec15a930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/2709837760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec13fb20 0x7f8aec15a930 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f8aec06a5e0 tx=0x7f8ae400ba50 comp rx=0 tx=0).stop 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 -- 172.21.15.33:0/2709837760 shutdown_connections 2023-10-09T15:32:57.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/2709837760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec13fb20 0x7f8aec15a930 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/2709837760 >> v2:172.21.15.59:3300/0 conn(0x7f8aec13fef0 0x7f8aec0c7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 -- 172.21.15.33:0/2709837760 >> 172.21.15.33:0/2709837760 conn(0x7f8aec06d170 msgr2=0x7f8aec0cc130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:57.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.477+0000 7f8af1ca0700 1 -- 172.21.15.33:0/2709837760 shutdown_connections 2023-10-09T15:32:57.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.478+0000 7f8af1ca0700 1 -- 172.21.15.33:0/2709837760 wait complete. 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 Processor -- start 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 -- start start 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aec13fb20 0x7f8aec0ac880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aec13fef0 0x7f8aec06de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec1563b0 con 0x7f8aec06aaa0 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0ad1d0 con 0x7f8aec13fef0 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.479+0000 7f8af1ca0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8aec0ad4b0 con 0x7f8aec13fb20 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36988/0 (socket says 172.21.15.33:36988) 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 -- 172.21.15.33:0/512974321 learned_addr learned my addr 172.21.15.33:0/512974321 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af149f700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aec13fef0 0x7f8aec06de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8aebfff700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aec13fb20 0x7f8aec0ac880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 -- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aec13fb20 msgr2=0x7f8aec0ac880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aec13fb20 0x7f8aec0ac880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 -- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aec13fef0 msgr2=0x7f8aec06de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aec13fef0 0x7f8aec06de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:57.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 -- 172.21.15.33:0/512974321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae400bcf0 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af0c9e700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8aec071320 tx=0x7f8ae4019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4009ca0 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ae4009e20 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8aec0ad790 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ae4014680 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.480+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8aec0add50 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.481+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8aec04c3c0 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.482+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8ae4014a30 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.482+0000 7f8ae8ff9700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 0x7f8ad8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.482+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8ae4087cc0 con 0x7f8aec06aaa0 2023-10-09T15:32:57.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.482+0000 7f8aebfff700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 0x7f8ad8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:57.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.483+0000 7f8aebfff700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 0x7f8ad8069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0b1fd0 tx=0x7f8ae0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:57.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.487+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ae408e080 con 0x7f8aec06aaa0 2023-10-09T15:32:57.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:57.680+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8aec15ae70 con 0x7f8aec06aaa0 2023-10-09T15:32:57.716 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2023-10-09T15:32:58.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.340+0000 7f8ae8ff9700 1 -- 172.21.15.33:0/512974321 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v61) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8aec15ae70 con 0x7f8aec06aaa0 2023-10-09T15:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.347+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 msgr2=0x7f8ad8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.347+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 0x7f8ad8069470 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8aec0b1fd0 tx=0x7f8ae0008040 comp rx=0 tx=0).stop 2023-10-09T15:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.347+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 msgr2=0x7f8aec155e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.347+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8aec071320 tx=0x7f8ae4019000 comp rx=0 tx=0).stop 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 shutdown_connections 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ad8066fc0 0x7f8ad8069470 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8aec06aaa0 0x7f8aec155e70 secure :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f8aec071320 tx=0x7f8ae4019000 comp rx=0 tx=0).stop 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8aec13fef0 0x7f8aec06de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 --2- 172.21.15.33:0/512974321 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8aec13fb20 0x7f8aec0ac880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.348+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 >> 172.21.15.33:0/512974321 conn(0x7f8aec06d170 msgr2=0x7f8aec13c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.349+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 shutdown_connections 2023-10-09T15:32:58.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.349+0000 7f8af1ca0700 1 -- 172.21.15.33:0/512974321 wait complete. 2023-10-09T15:32:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:32:58.367 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:32:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.489+0000 7f1ab0819700 1 Processor -- start 2023-10-09T15:32:58.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.489+0000 7f1ab0819700 1 -- start start 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.490+0000 7f1ab0819700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1aac157930 0x7f1aac0ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.490+0000 7f1ab0819700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1aac0cd2b0 0x7f1aac0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.490+0000 7f1ab0819700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1aac0c32a0 con 0x7f1aac0ca2c0 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.490+0000 7f1ab0819700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0c9730 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.490+0000 7f1ab0819700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1aac0c4100 con 0x7f1aac157930 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1aac0cd2b0 0x7f1aac0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa9d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1aac0ca2c0 0x7f1aac0ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50898/0 (socket says 172.21.15.33:50898) 2023-10-09T15:32:58.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa9d9b700 1 -- 172.21.15.33:0/3143396563 learned_addr learned my addr 172.21.15.33:0/3143396563 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaa59c700 1 --2- 172.21.15.33:0/3143396563 >> v2:172.21.15.59:3300/0 conn(0x7f1aac157930 0x7f1aac0ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 -- 172.21.15.33:0/3143396563 >> v2:172.21.15.59:3300/0 conn(0x7f1aac157930 msgr2=0x7f1aac0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 --2- 172.21.15.33:0/3143396563 >> v2:172.21.15.59:3300/0 conn(0x7f1aac157930 0x7f1aac0ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 -- 172.21.15.33:0/3143396563 >> v1:172.21.15.33:6789/0 conn(0x7f1aac0ca2c0 legacy=0x7f1aac0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa959a700 1 -- 172.21.15.33:0/3143396563 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906290766 0 0) 0x7f1aac0c32a0 con 0x7f1aac0ca2c0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 -- 172.21.15.33:0/3143396563 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1aac0c34f0 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aaad9d700 1 --2- 172.21.15.33:0/3143396563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0ca730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1aac06ab90 tx=0x7f1a9c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a847d46566760fa5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa959a700 1 -- 172.21.15.33:0/3143396563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c00e070 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa959a700 1 -- 172.21.15.33:0/3143396563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a9c00bb60 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.491+0000 7f1aa959a700 1 -- 172.21.15.33:0/3143396563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a9c012430 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 -- 172.21.15.33:0/3143396563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 msgr2=0x7f1aac0ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 --2- 172.21.15.33:0/3143396563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0ca730 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f1aac06ab90 tx=0x7f1a9c009780 comp rx=0 tx=0).stop 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 -- 172.21.15.33:0/3143396563 shutdown_connections 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 --2- 172.21.15.33:0/3143396563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0ca730 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 --2- 172.21.15.33:0/3143396563 >> v2:172.21.15.59:3300/0 conn(0x7f1aac157930 0x7f1aac0ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 -- 172.21.15.33:0/3143396563 >> 172.21.15.33:0/3143396563 conn(0x7f1aac088000 msgr2=0x7f1aac0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 -- 172.21.15.33:0/3143396563 shutdown_connections 2023-10-09T15:32:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.492+0000 7f1ab0819700 1 -- 172.21.15.33:0/3143396563 wait complete. 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.493+0000 7f1ab0819700 1 Processor -- start 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.493+0000 7f1ab0819700 1 -- start start 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 0x7f1aac153760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 0x7f1aac0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b1f90 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b16f0 con 0x7f1aac0ca2c0 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1ab0819700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1aac0b19d0 con 0x7f1aac157930 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37018/0 (socket says 172.21.15.33:37018) 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 -- 172.21.15.33:0/4228200285 learned_addr learned my addr 172.21.15.33:0/4228200285 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aaad9d700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 0x7f1aac0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aaa59c700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 0x7f1aac153760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 -- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 msgr2=0x7f1aac0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 0x7f1aac0cb3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 -- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 msgr2=0x7f1aac153760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 0x7f1aac153760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 -- 172.21.15.33:0/4228200285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a9c009a20 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aaad9d700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 0x7f1aac0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aaa59c700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 0x7f1aac153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.494+0000 7f1aa9d9b700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c5b0 tx=0x7f1a94001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.495+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94005b30 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.495+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a94005c90 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.495+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1aac0b1cb0 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.495+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1a94007300 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.495+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1aac0b1330 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.496+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1aac0c6580 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.496+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1a9401b3b0 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.497+0000 7f1aa27fc700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 0x7f1a8c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.497+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f1a94083a20 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.497+0000 7f1aaa59c700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 0x7f1a8c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.497+0000 7f1aaa59c700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 0x7f1a8c069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009d80 tx=0x7f1aa4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.501+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1aac0c6580 con 0x7f1aac0cd2b0 2023-10-09T15:32:58.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:58.739+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1aac0c6960 con 0x7f1aac0cd2b0 2023-10-09T15:32:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.340+0000 7f1aa27fc700 1 -- 172.21.15.33:0/4228200285 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1aac0c6960 con 0x7f1aac0cd2b0 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 msgr2=0x7f1a8c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 0x7f1a8c069470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009d80 tx=0x7f1aa4008040 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 msgr2=0x7f1aac0c6c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1a9400c5b0 tx=0x7f1a94001070 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 shutdown_connections 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1a8c066fc0 0x7f1a8c069470 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1aac157930 0x7f1aac0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1aac0ca2c0 0x7f1aac153760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 --2- 172.21.15.33:0/4228200285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1aac0cd2b0 0x7f1aac0c6c40 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.345+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 >> 172.21.15.33:0/4228200285 conn(0x7f1aac088000 msgr2=0x7f1aac154e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.346+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 shutdown_connections 2023-10-09T15:32:59.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.347+0000 7f1ab0819700 1 -- 172.21.15.33:0/4228200285 wait complete. 2023-10-09T15:32:59.347 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 10 and data pool 11 2023-10-09T15:32:59.370 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:59.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.492+0000 7fb69eaf6700 1 Processor -- start 2023-10-09T15:32:59.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.492+0000 7fb69eaf6700 1 -- start start 2023-10-09T15:32:59.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69eaf6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6980cf110 0x7fb698164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69eaf6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69815afd0 con 0x7fb69815de50 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69eaf6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb69815b2b0 con 0x7fb698153c30 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69eaf6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69815b590 con 0x7fb6980cf110 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69d2f3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb69815de50 0x7fb6980cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50900/0 (socket says 172.21.15.33:50900) 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69d2f3700 1 -- 172.21.15.33:0/838721746 learned_addr learned my addr 172.21.15.33:0/838721746 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106118883 0 0) 0x7fb69815afd0 con 0x7fb69815de50 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/838721746 >> v2:172.21.15.59:3300/0 conn(0x7fb6980cf110 0x7fb698164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.493+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb684003570 con 0x7fb69815de50 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3605919585 0 0) 0x7fb684003570 con 0x7fb69815de50 2023-10-09T15:32:59.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 >> v2:172.21.15.59:3300/0 conn(0x7fb6980cf110 msgr2=0x7fb698164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 --2- 172.21.15.33:0/838721746 >> v2:172.21.15.59:3300/0 conn(0x7fb6980cf110 0x7fb698164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 >> v1:172.21.15.59:6789/0 conn(0x7fb698153c30 legacy=0x7fb69815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69815b870 con 0x7fb69815de50 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fb694001470 con 0x7fb69815de50 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 >> v1:172.21.15.33:6789/0 conn(0x7fb69815de50 legacy=0x7fb6980cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 0x7fb684003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb684004810 0x7fb684004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840052e0 0x7fb68400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69815b590 con 0x7fb684003a60 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68400c190 con 0x7fb684004810 2023-10-09T15:32:59.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68400c350 con 0x7fb6840052e0 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 0x7fb684003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69d2f3700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb684004810 0x7fb684004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840052e0 0x7fb68400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 -- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840052e0 msgr2=0x7fb68400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840052e0 0x7fb68400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 -- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb684004810 msgr2=0x7fb684004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb684004810 0x7fb684004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 -- 172.21.15.33:0/838721746 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb684003570 con 0x7fb684003a60 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6840052e0 0x7fb68400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69e2f5700 1 -- 172.21.15.33:0/838721746 reap_dead start 2023-10-09T15:32:59.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.494+0000 7fb69daf4700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 0x7fb684003e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb6880018b0 tx=0x7fb688007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e108ced88e79bd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688012420 con 0x7fb684003a60 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6880125a0 con 0x7fb684003a60 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69caf2700 1 -- 172.21.15.33:0/838721746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb688012960 con 0x7fb684003a60 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 -- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 msgr2=0x7fb684003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 0x7fb684003e70 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fb6880018b0 tx=0x7fb688007d30 comp rx=0 tx=0).stop 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 -- 172.21.15.33:0/838721746 shutdown_connections 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/838721746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb684003a60 0x7fb684003e70 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 -- 172.21.15.33:0/838721746 >> 172.21.15.33:0/838721746 conn(0x7fb6980703a0 msgr2=0x7fb6980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 -- 172.21.15.33:0/838721746 shutdown_connections 2023-10-09T15:32:59.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.495+0000 7fb69eaf6700 1 -- 172.21.15.33:0/838721746 wait complete. 2023-10-09T15:32:59.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.496+0000 7fb69eaf6700 1 Processor -- start 2023-10-09T15:32:59.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.496+0000 7fb69eaf6700 1 -- start start 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb684003a60 0x7fb69814ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6980cca00 0x7fb69814b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980c84e0 con 0x7fb6980b1880 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980b2210 con 0x7fb6980cca00 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69eaf6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6980c81d0 con 0x7fb684003a60 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37040/0 (socket says 172.21.15.33:37040) 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 -- 172.21.15.33:0/85327487 learned_addr learned my addr 172.21.15.33:0/85327487 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69daf4700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb684003a60 0x7fb69814ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69d2f3700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6980cca00 0x7fb69814b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 -- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb684003a60 msgr2=0x7fb69814ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb684003a60 0x7fb69814ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 -- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6980cca00 msgr2=0x7fb69814b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6980cca00 0x7fb69814b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.497+0000 7fb69e2f5700 1 -- 172.21.15.33:0/85327487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb698150810 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb69e2f5700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb69815d1c0 tx=0x7fb690009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690007ea0 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb69000f050 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb690014410 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb698150af0 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.498+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb698150520 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.499+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb698151010 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.499+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fb690003040 con 0x7fb6980b1880 2023-10-09T15:32:59.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.500+0000 7fb68dffb700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 0x7fb67c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.500+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb6900846f0 con 0x7fb6980b1880 2023-10-09T15:32:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.500+0000 7fb69daf4700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 0x7fb67c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.500+0000 7fb69daf4700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 0x7fb67c069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb69816d0b0 tx=0x7fb688015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.504+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb698151010 con 0x7fb6980b1880 2023-10-09T15:32:59.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.698+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb698151010 con 0x7fb6980b1880 2023-10-09T15:32:59.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.698+0000 7fb68dffb700 1 -- 172.21.15.33:0/85327487 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fb698151010 con 0x7fb6980b1880 2023-10-09T15:32:59.699 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:32:59.699 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":62,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:58.739970+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 msgr2=0x7fb67c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 0x7fb67c069470 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fb69816d0b0 tx=0x7fb688015000 comp rx=0 tx=0).stop 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 msgr2=0x7fb6980b1cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fb69815d1c0 tx=0x7fb690009850 comp rx=0 tx=0).stop 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 shutdown_connections 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb67c066fc0 0x7fb67c069470 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6980b1880 0x7fb6980b1cd0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb684003a60 0x7fb69814ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 --2- 172.21.15.33:0/85327487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6980cca00 0x7fb69814b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 >> 172.21.15.33:0/85327487 conn(0x7fb6980703a0 msgr2=0x7fb6980d0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:59.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 shutdown_connections 2023-10-09T15:32:59.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.701+0000 7fb69eaf6700 1 -- 172.21.15.33:0/85327487 wait complete. 2023-10-09T15:32:59.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:32:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.831+0000 7fa4d60fb700 1 Processor -- start 2023-10-09T15:32:59.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.831+0000 7fa4d60fb700 1 -- start start 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4d60fb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d01595d0 0x7fa4d01599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4d60fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d00675a0 0x7fa4d006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4d60fb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4d00c7f50 con 0x7fa4d006b230 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4d60fb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4d006bd00 con 0x7fa4d01595d0 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4d60fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d006b740 con 0x7fa4d00675a0 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4cf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d01595d0 0x7fa4d01599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.832+0000 7fa4cf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa4d01595d0 0x7fa4d01599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37048/0 (socket says 172.21.15.33:37048) 2023-10-09T15:32:59.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/1130869963 learned_addr learned my addr 172.21.15.33:0/1130869963 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4ceffd700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d00675a0 0x7fa4d006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/1130869963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d00675a0 msgr2=0x7fa4d006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d00675a0 0x7fa4d006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/1130869963 >> v1:172.21.15.59:6789/0 conn(0x7fa4d006b230 legacy=0x7fa4d00c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/1130869963 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d006ba20 con 0x7fa4d01595d0 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4cf7fe700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d01595d0 0x7fa4d01599a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00099b0 tx=0x7fa4c0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7a183ac1b13ccdb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4ce7fc700 1 -- 172.21.15.33:0/1130869963 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c0009ea0 con 0x7fa4d01595d0 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4ce7fc700 1 -- 172.21.15.33:0/1130869963 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c000b860 con 0x7fa4d01595d0 2023-10-09T15:32:59.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.833+0000 7fa4ce7fc700 1 -- 172.21.15.33:0/1130869963 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000bc00 con 0x7fa4d01595d0 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 -- 172.21.15.33:0/1130869963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d01595d0 msgr2=0x7fa4d01599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d01595d0 0x7fa4d01599a0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fa4c00099b0 tx=0x7fa4c0009250 comp rx=0 tx=0).stop 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 -- 172.21.15.33:0/1130869963 shutdown_connections 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d01595d0 0x7fa4d01599a0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/1130869963 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d00675a0 0x7fa4d006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 -- 172.21.15.33:0/1130869963 >> 172.21.15.33:0/1130869963 conn(0x7fa4d00cd400 msgr2=0x7fa4d00cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 -- 172.21.15.33:0/1130869963 shutdown_connections 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.834+0000 7fa4d60fb700 1 -- 172.21.15.33:0/1130869963 wait complete. 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.835+0000 7fa4d60fb700 1 Processor -- start 2023-10-09T15:32:59.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.835+0000 7fa4d60fb700 1 -- start start 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d006b230 0x7fa4d0146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d01595d0 0x7fa4d00c44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015c320 con 0x7fa4d00675a0 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d015b860 con 0x7fa4d006b230 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4d0156c70 con 0x7fa4d01595d0 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37052/0 (socket says 172.21.15.33:37052) 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/2522919191 learned_addr learned my addr 172.21.15.33:0/2522919191 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d01595d0 msgr2=0x7fa4d00c44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cffff700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d01595d0 0x7fa4d00c44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d01595d0 0x7fa4d00c44b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d006b230 msgr2=0x7fa4d0146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4ceffd700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d006b230 0x7fa4d0146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d006b230 0x7fa4d0146e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 -- 172.21.15.33:0/2522919191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4c00094f0 con 0x7fa4d00675a0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4cf7fe700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006fd0 tx=0x7fa4c0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c000bbe0 con 0x7fa4d00675a0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c0011420 con 0x7fa4d00675a0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4d00b0b30 con 0x7fa4d00675a0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.836+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c00117c0 con 0x7fa4d00675a0 2023-10-09T15:32:59.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.837+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4d015bd60 con 0x7fa4d00675a0 2023-10-09T15:32:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.837+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4d004c3c0 con 0x7fa4d00675a0 2023-10-09T15:32:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.838+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fa4c0011bf0 con 0x7fa4d00675a0 2023-10-09T15:32:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.838+0000 7fa4b77fe700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 0x7fa4bc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:32:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.838+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa4c0085db0 con 0x7fa4d00675a0 2023-10-09T15:32:59.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.838+0000 7fa4ceffd700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 0x7fa4bc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:32:59.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.839+0000 7fa4ceffd700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 0x7fa4bc069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40093f0 tx=0x7fa4c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:32:59.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:32:59.843+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa4c0053030 con 0x7fa4d00675a0 2023-10-09T15:33:00.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.037+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa4d00c7be0 con 0x7fa4d00675a0 2023-10-09T15:33:00.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.038+0000 7fa4b77fe700 1 -- 172.21.15.33:0/2522919191 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v62) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fa4c0056650 con 0x7fa4d00675a0 2023-10-09T15:33:00.038 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:00.038 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":62,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:32:58.739970+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:33:00.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 msgr2=0x7fa4bc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:00.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 0x7fa4bc069470 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fa4c40093f0 tx=0x7fa4c4008040 comp rx=0 tx=0).stop 2023-10-09T15:33:00.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 msgr2=0x7fa4d015b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fa4c0006fd0 tx=0x7fa4c0017000 comp rx=0 tx=0).stop 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 shutdown_connections 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4bc066fc0 0x7fa4bc069470 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa4d00675a0 0x7fa4d015b320 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa4d01595d0 0x7fa4d00c44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 --2- 172.21.15.33:0/2522919191 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa4d006b230 0x7fa4d0146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 >> 172.21.15.33:0/2522919191 conn(0x7fa4d00cd400 msgr2=0x7fa4d0158730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 shutdown_connections 2023-10-09T15:33:00.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.040+0000 7fa4d60fb700 1 -- 172.21.15.33:0/2522919191 wait complete. 2023-10-09T15:33:00.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:33:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.174+0000 7f5dcb6c2700 1 Processor -- start 2023-10-09T15:33:00.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 -- start start 2023-10-09T15:33:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5dc41598c0 0x7f5dc40c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5dc4159c90 0x7f5dc40c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40ad990 con 0x7f5dc4159c90 2023-10-09T15:33:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dc40c9310 con 0x7f5dc41598c0 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.175+0000 7f5dcb6c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40cde20 con 0x7f5dc40cd460 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5dc4159c90 0x7f5dc40c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5dc4159c90 0x7f5dc40c43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37062/0 (socket says 172.21.15.33:37062) 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/2675169189 learned_addr learned my addr 172.21.15.33:0/2675169189 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc9c5f700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/2675169189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 msgr2=0x7f5dc40cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40cd8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc945e700 1 --2- 172.21.15.33:0/2675169189 >> v2:172.21.15.59:3300/0 conn(0x7f5dc41598c0 0x7f5dc40c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/2675169189 >> v2:172.21.15.59:3300/0 conn(0x7f5dc41598c0 msgr2=0x7f5dc40c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/2675169189 >> v2:172.21.15.59:3300/0 conn(0x7f5dc41598c0 0x7f5dc40c3e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/2675169189 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dc40ce090 con 0x7f5dc4159c90 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c43b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5dc406ab90 tx=0x7f5db8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7573452c6fb98515 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc3fff700 1 -- 172.21.15.33:0/2675169189 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800b860 con 0x7f5dc4159c90 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc3fff700 1 -- 172.21.15.33:0/2675169189 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db800b9c0 con 0x7f5dc4159c90 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.176+0000 7f5dc3fff700 1 -- 172.21.15.33:0/2675169189 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800bd60 con 0x7f5dc4159c90 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/2675169189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc4159c90 msgr2=0x7f5dc40c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c43b0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f5dc406ab90 tx=0x7f5db8009250 comp rx=0 tx=0).stop 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/2675169189 shutdown_connections 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/2675169189 >> v2:172.21.15.59:3300/0 conn(0x7f5dc41598c0 0x7f5dc40c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/2675169189 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c43b0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/2675169189 >> 172.21.15.33:0/2675169189 conn(0x7f5dc4088000 msgr2=0x7f5dc40883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/2675169189 shutdown_connections 2023-10-09T15:33:00.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.177+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/2675169189 wait complete. 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.178+0000 7f5dcb6c2700 1 Processor -- start 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.178+0000 7f5dcb6c2700 1 -- start start 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c55b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc4149960 con 0x7f5dc41598c0 2023-10-09T15:33:00.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40b3fd0 con 0x7f5dc4159c90 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dcb6c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dc40c5af0 con 0x7f5dc40cd460 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37074/0 (socket says 172.21.15.33:37074) 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/1436478013 learned_addr learned my addr 172.21.15.33:0/1436478013 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 msgr2=0x7f5dc40c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc945e700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc9c5f700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c55b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40c7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc4159c90 msgr2=0x7f5dc40c55b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c55b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 -- 172.21.15.33:0/1436478013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5db80094f0 con 0x7f5dc41598c0 2023-10-09T15:33:00.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.179+0000 7f5dc8c5d700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5db8006fd0 tx=0x7f5db8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.180+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db800bcd0 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.180+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5db801a660 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.180+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dc40c8350 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.180+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5db801aa20 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.180+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dc40b3980 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.181+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dc404c3c0 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.181+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5db801b430 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.181+0000 7f5dc17fa700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 0x7f5db0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.182+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5db8086430 con 0x7f5dc41598c0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.182+0000 7f5dc945e700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 0x7f5db0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:00.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.182+0000 7f5dc945e700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 0x7f5db0069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc008920 tx=0x7f5dbc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:00.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.186+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5db8053760 con 0x7f5dc41598c0 2023-10-09T15:33:00.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:00.428+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f5dc40686c0 con 0x7f5dc41598c0 2023-10-09T15:33:01.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.364+0000 7f5dc17fa700 1 -- 172.21.15.33:0/1436478013 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v39) v1 ==== 118+0+0 (secure 0 0 0) 0x7f5db8056d80 con 0x7f5dc41598c0 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.366+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 msgr2=0x7f5db0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.366+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 0x7f5db0069470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc008920 tx=0x7f5dbc008040 comp rx=0 tx=0).stop 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.366+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 msgr2=0x7f5dc4149420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.366+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f5db8006fd0 tx=0x7f5db8017000 comp rx=0 tx=0).stop 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 shutdown_connections 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5db0066fc0 0x7f5db0069470 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5dc4159c90 0x7f5dc40c55b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5dc40cd460 0x7f5dc40c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 --2- 172.21.15.33:0/1436478013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5dc41598c0 0x7f5dc4149420 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 >> 172.21.15.33:0/1436478013 conn(0x7f5dc4088000 msgr2=0x7f5dc4067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 shutdown_connections 2023-10-09T15:33:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.367+0000 7f5dcb6c2700 1 -- 172.21.15.33:0/1436478013 wait complete. 2023-10-09T15:33:01.382 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:33:01.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.510+0000 7fea34226700 1 Processor -- start 2023-10-09T15:33:01.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.511+0000 7fea34226700 1 -- start start 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.511+0000 7fea34226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea2c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.511+0000 7fea34226700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0c32a0 con 0x7fea2c157930 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.511+0000 7fea34226700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea2c0c4100 con 0x7fea2c0ccba0 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.511+0000 7fea34226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0c9730 con 0x7fea2c0ca2c0 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea31fc2700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fea2c157930 0x7fea2c0ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60412/0 (socket says 172.21.15.33:60412) 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea31fc2700 1 -- 172.21.15.33:0/2416510890 learned_addr learned my addr 172.21.15.33:0/2416510890 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea317c1700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea2c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3695415311 0 0) 0x7fea2c0c32a0 con 0x7fea2c157930 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea14003570 con 0x7fea2c157930 2023-10-09T15:33:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3451221782 0 0) 0x7fea14003570 con 0x7fea2c157930 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 msgr2=0x7fea2c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea2c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 >> v1:172.21.15.59:6789/0 conn(0x7fea2c0ccba0 legacy=0x7fea2c0c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0c34f0 con 0x7fea2c157930 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fea1c0017f0 con 0x7fea2c157930 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 >> v1:172.21.15.33:6789/0 conn(0x7fea2c157930 legacy=0x7fea2c0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea14003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea14003fd0 0x7fea14004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea14004d50 0x7fea140051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0c9730 con 0x7fea14004d50 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea1400bb40 con 0x7fea14003fd0 2023-10-09T15:33:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea1400bd00 con 0x7fea2c0ca2c0 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea327c3700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea14004d50 0x7fea140051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea14003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.512+0000 7fea317c1700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea14003fd0 0x7fea14004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 -- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 msgr2=0x7fea14003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea14003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 -- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea14003fd0 msgr2=0x7fea14004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea14003fd0 0x7fea14004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 -- 172.21.15.33:0/2416510890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea14003570 con 0x7fea14004d50 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c0ca2c0 0x7fea14003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea317c1700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea14003fd0 0x7fea14004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea14004d50 0x7fea140051c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fea240019a0 tx=0x7fea24007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99faefc5eb3e0ab9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400c5d0 con 0x7fea14004d50 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea2400c750 con 0x7fea14004d50 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea30fc0700 1 -- 172.21.15.33:0/2416510890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea2400cb10 con 0x7fea14004d50 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea34226700 1 -- 172.21.15.33:0/2416510890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea14004d50 msgr2=0x7fea140051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea34226700 1 --2- 172.21.15.33:0/2416510890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea14004d50 0x7fea140051c0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fea240019a0 tx=0x7fea24007d10 comp rx=0 tx=0).stop 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.513+0000 7fea327c3700 1 -- 172.21.15.33:0/2416510890 reap_dead start 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.514+0000 7fea34226700 1 -- 172.21.15.33:0/2416510890 shutdown_connections 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.514+0000 7fea34226700 1 -- 172.21.15.33:0/2416510890 >> 172.21.15.33:0/2416510890 conn(0x7fea2c088000 msgr2=0x7fea2c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.514+0000 7fea34226700 1 -- 172.21.15.33:0/2416510890 shutdown_connections 2023-10-09T15:33:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.514+0000 7fea34226700 1 -- 172.21.15.33:0/2416510890 wait complete. 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 Processor -- start 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 -- start start 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 0x7fea2c0c5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea2c0b12a0 0x7fea2c0c6140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0af6f0 con 0x7fea2c1526e0 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0af970 con 0x7fea2c0b12a0 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.515+0000 7fea34226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea2c0c6770 con 0x7fea2c152310 2023-10-09T15:33:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43178/0 (socket says 172.21.15.33:43178) 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 -- 172.21.15.33:0/2774928260 learned_addr learned my addr 172.21.15.33:0/2774928260 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 0x7fea2c0c5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea317c1700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea2c0b12a0 0x7fea2c0c6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 -- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 msgr2=0x7fea2c0c5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 0x7fea2c0c5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 -- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea2c0b12a0 msgr2=0x7fea2c0c6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea2c0b12a0 0x7fea2c0c6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 -- 172.21.15.33:0/2774928260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c0c6a50 con 0x7fea2c1526e0 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 0x7fea2c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea327c3700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bb10 tx=0x7fea24015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24023070 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea24012e90 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea24007af0 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea2c0c6d30 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.516+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea2c0acd10 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.517+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea2c0c6f20 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.518+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fea24019070 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.518+0000 7fea29ffb700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 0x7fea18069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.518+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea240853f0 con 0x7fea2c1526e0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.518+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 0x7fea18069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.519+0000 7fea31fc2700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 0x7fea18069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0012e0 tx=0x7fea1c0014d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:01.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.523+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea24052730 con 0x7fea2c1526e0 2023-10-09T15:33:01.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:01.759+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fea2c04c3c0 con 0x7fea2c1526e0 2023-10-09T15:33:02.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.368+0000 7fea29ffb700 1 -- 172.21.15.33:0/2774928260 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v40) v1 ==== 122+0+0 (secure 0 0 0) 0x7fea240170c0 con 0x7fea2c1526e0 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 msgr2=0x7fea18069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 0x7fea18069470 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fea1c0012e0 tx=0x7fea1c0014d0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 msgr2=0x7fea2c0ac7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fea1400bb10 tx=0x7fea24015000 comp rx=0 tx=0).stop 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 shutdown_connections 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea18066fc0 0x7fea18069470 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea2c1526e0 0x7fea2c0ac7d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea2c152310 0x7fea2c0c5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 --2- 172.21.15.33:0/2774928260 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea2c0b12a0 0x7fea2c0c6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 >> 172.21.15.33:0/2774928260 conn(0x7fea2c088000 msgr2=0x7fea2c154280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:02.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 shutdown_connections 2023-10-09T15:33:02.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.371+0000 7fea34226700 1 -- 172.21.15.33:0/2774928260 wait complete. 2023-10-09T15:33:02.384 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:33:02.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.506+0000 7f0a5d746700 1 Processor -- start 2023-10-09T15:33:02.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.506+0000 7f0a5d746700 1 -- start start 2023-10-09T15:33:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a5d746700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a580cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a5d746700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5815afd0 con 0x7f0a58153c30 2023-10-09T15:33:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a5d746700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a5815b2b0 con 0x7f0a580cef40 2023-10-09T15:33:02.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a5d746700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815b590 con 0x7f0a5815de50 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a57fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0a58153c30 0x7f0a5815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60420/0 (socket says 172.21.15.33:60420) 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a57fff700 1 -- 172.21.15.33:0/1695752240 learned_addr learned my addr 172.21.15.33:0/1695752240 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2820564322 0 0) 0x7f0a5815afd0 con 0x7f0a58153c30 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a577fe700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a580cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.507+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0a40003570 con 0x7f0a58153c30 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3544768634 0 0) 0x7f0a40003570 con 0x7f0a58153c30 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 msgr2=0x7f0a580cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a580cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 >> v1:172.21.15.59:6789/0 conn(0x7f0a580cef40 legacy=0x7f0a5815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a5815b870 con 0x7f0a58153c30 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a577fe700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a580cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0a4c001470 con 0x7f0a58153c30 2023-10-09T15:33:02.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 >> v1:172.21.15.33:6789/0 conn(0x7f0a58153c30 legacy=0x7f0a5815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a40003a90 0x7f0a40003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a40004810 0x7f0a40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a40005250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a5815b590 con 0x7f0a40003a90 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4000bc20 con 0x7f0a40004810 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a4000bde0 con 0x7f0a5815de50 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a40003a90 0x7f0a40003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a577fe700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a40004810 0x7f0a40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a5cf45700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a40005250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 -- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 msgr2=0x7f0a40005250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a40005250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 -- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a40004810 msgr2=0x7f0a40004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:02.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a40004810 0x7f0a40004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 -- 172.21.15.33:0/1695752240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a40003570 con 0x7f0a40003a90 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a5cf45700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a5815de50 0x7f0a40005250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a57fff700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a40003a90 0x7f0a40003ea0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c3c0 tx=0x7f0a4c001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f903358a9f6273a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c00cc90 con 0x7f0a40003a90 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4c00cdf0 con 0x7f0a40003a90 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.508+0000 7f0a56ffd700 1 -- 172.21.15.33:0/1695752240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4c005b50 con 0x7f0a40003a90 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 -- 172.21.15.33:0/1695752240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a40003a90 msgr2=0x7f0a40003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 --2- 172.21.15.33:0/1695752240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a40003a90 0x7f0a40003ea0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f0a4c00c3c0 tx=0x7f0a4c001e50 comp rx=0 tx=0).stop 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5cf45700 1 -- 172.21.15.33:0/1695752240 reap_dead start 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 -- 172.21.15.33:0/1695752240 shutdown_connections 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 -- 172.21.15.33:0/1695752240 >> 172.21.15.33:0/1695752240 conn(0x7f0a580703a0 msgr2=0x7f0a580707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 -- 172.21.15.33:0/1695752240 shutdown_connections 2023-10-09T15:33:02.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.509+0000 7f0a5d746700 1 -- 172.21.15.33:0/1695752240 wait complete. 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.510+0000 7f0a5d746700 1 Processor -- start 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.510+0000 7f0a5d746700 1 -- start start 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 0x7f0a580ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 0x7f0a580b5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580ca490 con 0x7f0a580b32d0 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580c79b0 con 0x7f0a580b5410 2023-10-09T15:33:02.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5d746700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a580ccfe0 con 0x7f0a40003a90 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a577fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43196/0 (socket says 172.21.15.33:43196) 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a577fe700 1 -- 172.21.15.33:0/861856806 learned_addr learned my addr 172.21.15.33:0/861856806 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a5cf45700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 0x7f0a580b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.511+0000 7f0a57fff700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 0x7f0a580ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 -- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 msgr2=0x7f0a580ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 0x7f0a580ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 -- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 msgr2=0x7f0a580b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 0x7f0a580b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 -- 172.21.15.33:0/861856806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a580c7680 con 0x7f0a580b32d0 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a5cf45700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 0x7f0a580b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:02.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a57fff700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 0x7f0a580ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a577fe700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a48011990 tx=0x7f0a48008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800c070 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a4800f6d0 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a580b5dc0 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a4800fa90 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.512+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a580cd540 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.513+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a580c7b40 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.513+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f0a48015460 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.514+0000 7f0a3ffff700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 0x7f0a44069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.514+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0a48084c40 con 0x7f0a580b32d0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.514+0000 7f0a57fff700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 0x7f0a44069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.514+0000 7f0a57fff700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 0x7f0a44069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a580aff10 tx=0x7f0a4c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.518+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a48051cb0 con 0x7f0a580b32d0 2023-10-09T15:33:02.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.757+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a5804c3c0 con 0x7f0a580b32d0 2023-10-09T15:33:02.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.758+0000 7f0a3ffff700 1 -- 172.21.15.33:0/861856806 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f0a48022090 con 0x7f0a580b32d0 2023-10-09T15:33:02.758 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:02.758 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:33:02.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 msgr2=0x7f0a44069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 0x7f0a44069470 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f0a580aff10 tx=0x7f0a4c015000 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 msgr2=0x7f0a580b4ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f0a48011990 tx=0x7f0a48008040 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 shutdown_connections 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0a44066fc0 0x7f0a44069470 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a580b5410 0x7f0a580b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a40003a90 0x7f0a580ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 --2- 172.21.15.33:0/861856806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a580b32d0 0x7f0a580b4ed0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 >> 172.21.15.33:0/861856806 conn(0x7f0a580703a0 msgr2=0x7f0a580709e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:02.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.760+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 shutdown_connections 2023-10-09T15:33:02.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.761+0000 7f0a5d746700 1 -- 172.21.15.33:0/861856806 wait complete. 2023-10-09T15:33:02.762 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 40 2023-10-09T15:33:02.772 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:33:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.891+0000 7f9f9a589700 1 Processor -- start 2023-10-09T15:33:02.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.891+0000 7f9f9a589700 1 -- start start 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f9a589700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 0x7f9f9415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f9a589700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9f941579d0 0x7f9f94161800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f9a589700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f94158210 con 0x7f9f94157600 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f9a589700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f940cb850 con 0x7f9f941579d0 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f9a589700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940cb290 con 0x7f9f940b1b20 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f93fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9f94157600 0x7f9f940b1410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60424/0 (socket says 172.21.15.33:60424) 2023-10-09T15:33:02.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f93fff700 1 -- 172.21.15.33:0/414573557 learned_addr learned my addr 172.21.15.33:0/414573557 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f937fe700 1 --2- 172.21.15.33:0/414573557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 0x7f9f9415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.892+0000 7f9f98b26700 1 --2- 172.21.15.33:0/414573557 >> v2:172.21.15.59:3300/0 conn(0x7f9f941579d0 0x7f9f94161800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747739869 0 0) 0x7f9f94158210 con 0x7f9f94157600 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9f80003570 con 0x7f9f94157600 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f937fe700 1 -- 172.21.15.33:0/414573557 >> v2:172.21.15.59:3300/0 conn(0x7f9f941579d0 msgr2=0x7f9f94161800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f937fe700 1 --2- 172.21.15.33:0/414573557 >> v2:172.21.15.59:3300/0 conn(0x7f9f941579d0 0x7f9f94161800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f937fe700 1 -- 172.21.15.33:0/414573557 >> v1:172.21.15.33:6789/0 conn(0x7f9f94157600 legacy=0x7f9f940b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1751739605 0 0) 0x7f9f80003570 con 0x7f9f94157600 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f937fe700 1 -- 172.21.15.33:0/414573557 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f940cb570 con 0x7f9f940b1b20 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f937fe700 1 --2- 172.21.15.33:0/414573557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 0x7f9f9415f2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f840098e0 tx=0x7f9f840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1d0f064996900eda server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f7c001470 con 0x7f9f940b1b20 2023-10-09T15:33:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f84011420 con 0x7f9f940b1b20 2023-10-09T15:33:02.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.893+0000 7f9f92ffd700 1 -- 172.21.15.33:0/414573557 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f840117a0 con 0x7f9f940b1b20 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 -- 172.21.15.33:0/414573557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 msgr2=0x7f9f9415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 --2- 172.21.15.33:0/414573557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 0x7f9f9415f2b0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9f840098e0 tx=0x7f9f840091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 -- 172.21.15.33:0/414573557 shutdown_connections 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 --2- 172.21.15.33:0/414573557 >> v2:172.21.15.59:3300/0 conn(0x7f9f941579d0 0x7f9f94161800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 --2- 172.21.15.33:0/414573557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f940b1b20 0x7f9f9415f2b0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 -- 172.21.15.33:0/414573557 >> 172.21.15.33:0/414573557 conn(0x7f9f9406d170 msgr2=0x7f9f940cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:02.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 -- 172.21.15.33:0/414573557 shutdown_connections 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.894+0000 7f9f9a589700 1 -- 172.21.15.33:0/414573557 wait complete. 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.895+0000 7f9f9a589700 1 Processor -- start 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.895+0000 7f9f9a589700 1 -- start start 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 0x7f9f94156420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f94157600 0x7f9f940b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f94156960 con 0x7f9f941579d0 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940af200 con 0x7f9f940b1b20 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f9a589700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f940b0060 con 0x7f9f94157600 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43210/0 (socket says 172.21.15.33:43210) 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 -- 172.21.15.33:0/479135307 learned_addr learned my addr 172.21.15.33:0/479135307 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:02.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f937fe700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f94157600 0x7f9f940b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f93fff700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 0x7f9f94156420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 -- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f94157600 msgr2=0x7f9f940b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f94157600 0x7f9f940b04f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 -- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 msgr2=0x7f9f94156420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 0x7f9f94156420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 -- 172.21.15.33:0/479135307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f84009420 con 0x7f9f941579d0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f93fff700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 0x7f9f94156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.896+0000 7f9f98b26700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009ec0 tx=0x7f9f8c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.897+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c00cc20 con 0x7f9f941579d0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.897+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f8c00f040 con 0x7f9f941579d0 2023-10-09T15:33:02.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.897+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f940c8530 con 0x7f9f941579d0 2023-10-09T15:33:02.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.897+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9f8c014480 con 0x7f9f941579d0 2023-10-09T15:33:02.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.897+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f940af730 con 0x7f9f941579d0 2023-10-09T15:33:02.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.898+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f9404c3c0 con 0x7f9f941579d0 2023-10-09T15:33:02.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.898+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f9f8c014810 con 0x7f9f941579d0 2023-10-09T15:33:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.899+0000 7f9f8bfff700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 0x7f9f74069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.899+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9f8c0851a0 con 0x7f9f941579d0 2023-10-09T15:33:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.899+0000 7f9f93fff700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 0x7f9f74069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:02.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.899+0000 7f9f93fff700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 0x7f9f74069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c007ba0 tx=0x7f9f7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:02.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:02.903+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9f8c052310 con 0x7f9f941579d0 2023-10-09T15:33:03.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.095+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9f9406d6b0 con 0x7f9f941579d0 2023-10-09T15:33:03.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.096+0000 7f9f8bfff700 1 -- 172.21.15.33:0/479135307 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v63) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f9f8c055930 con 0x7f9f941579d0 2023-10-09T15:33:03.096 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:03.096 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":63,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:33:00.336914+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 msgr2=0x7f9f74069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 0x7f9f74069470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9f7c007ba0 tx=0x7f9f7c009040 comp rx=0 tx=0).stop 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 msgr2=0x7f9f94169f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c009ec0 tx=0x7f9f8c00b040 comp rx=0 tx=0).stop 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 shutdown_connections 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9f74066fc0 0x7f9f74069470 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9f941579d0 0x7f9f94169f10 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9f940b1b20 0x7f9f94156420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 --2- 172.21.15.33:0/479135307 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9f94157600 0x7f9f940b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 >> 172.21.15.33:0/479135307 conn(0x7f9f9406d170 msgr2=0x7f9f940c1eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:03.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 shutdown_connections 2023-10-09T15:33:03.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.098+0000 7f9f9a589700 1 -- 172.21.15.33:0/479135307 wait complete. 2023-10-09T15:33:03.110 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:33:03.110 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:33:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.229+0000 7f423e2f4700 1 Processor -- start 2023-10-09T15:33:03.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.229+0000 7f423e2f4700 1 -- start start 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423e2f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f42380cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423e2f4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423815ae40 con 0x7f42380cde50 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423e2f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f423815ab60 con 0x7f42380cd9e0 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423e2f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42380d13f0 con 0x7f42380cb5a0 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423c891700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f42380cde50 0x7f4238156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60430/0 (socket says 172.21.15.33:60430) 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f423c891700 1 -- 172.21.15.33:0/1975496531 learned_addr learned my addr 172.21.15.33:0/1975496531 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4237fff700 1 --2- 172.21.15.33:0/1975496531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f42380cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1394574215 0 0) 0x7f423815ae40 con 0x7f42380cde50 2023-10-09T15:33:03.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4220003570 con 0x7f42380cde50 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 774520098 0 0) 0x7f423815ab60 con 0x7f42380cd9e0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f423815ae40 con 0x7f42380cd9e0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.230+0000 7f4237fff700 1 -- 172.21.15.33:0/1975496531 >> v1:172.21.15.59:6789/0 conn(0x7f42380cd9e0 legacy=0x7f4238159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4237fff700 1 -- 172.21.15.33:0/1975496531 >> v1:172.21.15.33:6789/0 conn(0x7f42380cde50 legacy=0x7f4238156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4237fff700 1 -- 172.21.15.33:0/1975496531 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42380ccf00 con 0x7f42380cb5a0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4237fff700 1 --2- 172.21.15.33:0/1975496531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f42380cb970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4228009910 tx=0x7f42280091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1f832a763aa54bbb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011630 con 0x7f42380cb5a0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4228011790 con 0x7f42380cb5a0 2023-10-09T15:33:03.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f4236ffd700 1 -- 172.21.15.33:0/1975496531 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4228011b30 con 0x7f42380cb5a0 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f423e2f4700 1 -- 172.21.15.33:0/1975496531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 msgr2=0x7f42380cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.231+0000 7f423e2f4700 1 --2- 172.21.15.33:0/1975496531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f42380cb970 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4228009910 tx=0x7f42280091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.232+0000 7f423e2f4700 1 -- 172.21.15.33:0/1975496531 shutdown_connections 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.232+0000 7f423e2f4700 1 --2- 172.21.15.33:0/1975496531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f42380cb970 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.232+0000 7f423e2f4700 1 -- 172.21.15.33:0/1975496531 >> 172.21.15.33:0/1975496531 conn(0x7f4238070e30 msgr2=0x7f42380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.232+0000 7f423e2f4700 1 -- 172.21.15.33:0/1975496531 shutdown_connections 2023-10-09T15:33:03.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.232+0000 7f423e2f4700 1 -- 172.21.15.33:0/1975496531 wait complete. 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.233+0000 7f423e2f4700 1 Processor -- start 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.233+0000 7f423e2f4700 1 -- start start 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f4238169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 0x7f423815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380c96c0 con 0x7f42380cd9e0 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42380c79f0 con 0x7f42380c98e0 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423816a9b0 con 0x7f42380cb5a0 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43222/0 (socket says 172.21.15.33:43222) 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 -- 172.21.15.33:0/3295548776 learned_addr learned my addr 172.21.15.33:0/3295548776 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:03.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f4237fff700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f4238169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423c891700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 0x7f423815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 -- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 msgr2=0x7f4238169970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f4238169970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 -- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 msgr2=0x7f423815b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 0x7f423815b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 -- 172.21.15.33:0/3295548776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4228009420 con 0x7f42380cd9e0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423c891700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 0x7f423815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f42377fe700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c7c0 tx=0x7f422c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c010510 con 0x7f42380cd9e0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f422c010670 con 0x7f42380cd9e0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4238169eb0 con 0x7f42380cd9e0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f422c010a10 con 0x7f42380cd9e0 2023-10-09T15:33:03.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.234+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423816a3f0 con 0x7f42380cd9e0 2023-10-09T15:33:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.235+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42380c77a0 con 0x7f42380cd9e0 2023-10-09T15:33:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.236+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f422c01b3b0 con 0x7f42380cd9e0 2023-10-09T15:33:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.236+0000 7f421ffff700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 0x7f4224069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.236+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f422c083ed0 con 0x7f42380cd9e0 2023-10-09T15:33:03.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.236+0000 7f4237fff700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 0x7f4224069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.237+0000 7f4237fff700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 0x7f4224069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4228009860 tx=0x7f4228017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.241+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f422c051050 con 0x7f42380cd9e0 2023-10-09T15:33:03.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.432+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f42380cd1e0 con 0x7f4224066fc0 2023-10-09T15:33:03.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.440+0000 7f421ffff700 1 -- 172.21.15.33:0/3295548776 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278465 (secure 0 0 0) 0x7f42380cd1e0 con 0x7f4224066fc0 2023-10-09T15:33:03.443 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 msgr2=0x7f4224069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 0x7f4224069470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4228009860 tx=0x7f4228017000 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 msgr2=0x7f42381531f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f422c00c7c0 tx=0x7f422c007e10 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 shutdown_connections 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4224066fc0 0x7f4224069470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42380c98e0 0x7f423815b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42380cb5a0 0x7f4238169970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 --2- 172.21.15.33:0/3295548776 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42380cd9e0 0x7f42381531f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 >> 172.21.15.33:0/3295548776 conn(0x7f4238070e30 msgr2=0x7f42380b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 shutdown_connections 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.443+0000 7f423e2f4700 1 -- 172.21.15.33:0/3295548776 wait complete. 2023-10-09T15:33:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:33:03.455 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-10-09T15:33:03.261301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3630933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930607"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339489+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:51.501644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334730+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337790+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:41:48.104773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:05.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.479832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341086+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:58.690370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335029+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337826+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:34.701023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333466+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:31.673693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339166+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338460+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:02.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336916+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334615+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337635+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:55.470612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335346+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337563+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:16.301964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338929+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:01.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337383+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:11.259519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336318+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341759+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:50.397311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336765+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:55.871208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336434+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341361+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:38.918346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341075+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:19.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339136+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334630+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336917+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337278+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:53.168220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T15:32:55.912868+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:55.912868+0000","last_peered":"2023-10-09T15:32:55.912868+0000","last_clean":"2023-10-09T15:32:55.912868+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:55.912868+0000","last_undegraded":"2023-10-09T15:32:55.912868+0000","last_fullsized":"2023-10-09T15:32:55.912868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":896769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.754,"15min":0.754},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.44600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.35799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81899999999999995,"5min":1.379,"15min":1.379},"last":0.432},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.88600000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.83299999999999996,"15min":0.875},"min":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.87,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92300000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.215,"15min":0.215},"max":{"1min":0.52000000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.433},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":1.512,"15min":1.512},"last":0.312}]},{"osd":2,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":1.286,"15min":1.286},"last":0.248},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60999999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.222,"15min":1.222},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.752,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":1.258,"15min":1.258},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83399999999999996,"15min":0.86799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":895758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53100000000000003,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60099999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64200000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.55000000000000004,"15min":0.58099999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55400000000000005,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64300000000000002,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89000000000000001,"5min":1.196,"15min":1.196},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":1.508,"15min":1.508},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84999999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":1.238,"15min":1.238},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83699999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.252},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51500000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64900000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.436,"15min":0.436},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90800000000000003,"5min":1.407,"15min":1.407},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80900000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.501}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.81999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.752},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":2.879,"15min":2.879},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81399999999999995,"5min":0.87,"15min":0.87},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.95399999999999996,"15min":1.0149999999999999},"min":{"1min":0.42899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95599999999999996,"5min":11.055,"15min":11.055},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.99199999999999999,"15min":1.044},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1640000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.98699999999999999,"15min":1.042},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1000000000000001,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.438},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:33:03.461 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:33:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.614+0000 7f44eac2b700 1 Processor -- start 2023-10-09T15:33:03.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.614+0000 7f44eac2b700 1 -- start start 2023-10-09T15:33:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44eac2b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 0x7f44e406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44eac2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44eac2b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44e40aeee0 con 0x7f44e40a8d00 2023-10-09T15:33:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44eac2b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44e406e820 con 0x7f44e40a90d0 2023-10-09T15:33:03.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44eac2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40ae680 con 0x7f44e406e380 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44e91c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 0x7f44e406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.615+0000 7f44e89c7700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f44e40a8d00 0x7f44e40cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:57366/0 (socket says 172.21.15.33:57366) 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 0x7f44e406de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:51292/0 (socket says 172.21.15.33:51292) 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:39638/0 (socket says 172.21.15.33:39638) 2023-10-09T15:33:03.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e89c7700 1 -- 172.21.15.33:0/2005449113 learned_addr learned my addr 172.21.15.33:0/2005449113 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 -- 172.21.15.33:0/2005449113 >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 msgr2=0x7f44e406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 --2- 172.21.15.33:0/2005449113 >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 0x7f44e406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 -- 172.21.15.33:0/2005449113 >> v1:172.21.15.59:6789/0 conn(0x7f44e40a8d00 legacy=0x7f44e40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 -- 172.21.15.33:0/2005449113 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44e40cf490 con 0x7f44e406e380 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e91c8700 1 --2- 172.21.15.33:0/2005449113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44d40098e0 tx=0x7f44d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1a1ede5bd8b5b70a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e37fe700 1 -- 172.21.15.33:0/2005449113 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400b640 con 0x7f44e406e380 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e37fe700 1 -- 172.21.15.33:0/2005449113 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d400b7a0 con 0x7f44e406e380 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.616+0000 7f44e37fe700 1 -- 172.21.15.33:0/2005449113 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d400bb40 con 0x7f44e406e380 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 -- 172.21.15.33:0/2005449113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 msgr2=0x7f44e40af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 --2- 172.21.15.33:0/2005449113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f44d40098e0 tx=0x7f44d40091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 -- 172.21.15.33:0/2005449113 shutdown_connections 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 --2- 172.21.15.33:0/2005449113 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e40af370 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 --2- 172.21.15.33:0/2005449113 >> v2:172.21.15.59:3300/0 conn(0x7f44e40a90d0 0x7f44e406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 -- 172.21.15.33:0/2005449113 >> 172.21.15.33:0/2005449113 conn(0x7f44e406ce80 msgr2=0x7f44e40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 -- 172.21.15.33:0/2005449113 shutdown_connections 2023-10-09T15:33:03.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.617+0000 7f44eac2b700 1 -- 172.21.15.33:0/2005449113 wait complete. 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.618+0000 7f44eac2b700 1 Processor -- start 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.618+0000 7f44eac2b700 1 -- start start 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e4157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e40a90d0 0x7f44e415a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b21f0 con 0x7f44e40a8d00 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44e40b16b0 con 0x7f44e40a90d0 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44eac2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44e4157930 con 0x7f44e406e380 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43228/0 (socket says 172.21.15.33:43228) 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 -- 172.21.15.33:0/1375413166 learned_addr learned my addr 172.21.15.33:0/1375413166 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e89c7700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e4157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e91c8700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e40a90d0 0x7f44e415a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 -- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 msgr2=0x7f44e4157230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e4157230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 -- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e40a90d0 msgr2=0x7f44e415a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e40a90d0 0x7f44e415a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 -- 172.21.15.33:0/1375413166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44d4009420 con 0x7f44e40a8d00 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.619+0000 7f44e3fff700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ec50 tx=0x7f44d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.620+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800c850 con 0x7f44e40a8d00 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.620+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f44d800c9b0 con 0x7f44e40a8d00 2023-10-09T15:33:03.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.620+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44e4157c10 con 0x7f44e40a8d00 2023-10-09T15:33:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.620+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f44d800cd30 con 0x7f44e40a8d00 2023-10-09T15:33:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.620+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44e40b1e80 con 0x7f44e40a8d00 2023-10-09T15:33:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.621+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44e40b2360 con 0x7f44e40a8d00 2023-10-09T15:33:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.621+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f44d8013680 con 0x7f44e40a8d00 2023-10-09T15:33:03.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.621+0000 7f44e0ff9700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 0x7f44d0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.621+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44d8084ae0 con 0x7f44e40a8d00 2023-10-09T15:33:03.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.622+0000 7f44e89c7700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 0x7f44d0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.622+0000 7f44e89c7700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 0x7f44d0069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44dc005ca0 tx=0x7f44dc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.626+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f44d8051d60 con 0x7f44e40a8d00 2023-10-09T15:33:03.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.812+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f44e404c3c0 con 0x7f44d0066fc0 2023-10-09T15:33:03.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.819+0000 7f44e0ff9700 1 -- 172.21.15.33:0/1375413166 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278465 (secure 0 0 0) 0x7f44e404c3c0 con 0x7f44d0066fc0 2023-10-09T15:33:03.822 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 msgr2=0x7f44d0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 0x7f44d0069470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f44dc005ca0 tx=0x7f44dc009040 comp rx=0 tx=0).stop 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 msgr2=0x7f44e4155aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f44d800ec50 tx=0x7f44d8009120 comp rx=0 tx=0).stop 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 shutdown_connections 2023-10-09T15:33:03.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f44d0066fc0 0x7f44d0069470 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44e40a90d0 0x7f44e415a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44e406e380 0x7f44e4157230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 --2- 172.21.15.33:0/1375413166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44e40a8d00 0x7f44e4155aa0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 >> 172.21.15.33:0/1375413166 conn(0x7f44e406ce80 msgr2=0x7f44e40cc420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 shutdown_connections 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.823+0000 7f44eac2b700 1 -- 172.21.15.33:0/1375413166 wait complete. 2023-10-09T15:33:03.825 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:33:03.834 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-10-09T15:33:03.261301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3630933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930607"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339489+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:51.501644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334730+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337790+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:41:48.104773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:05.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.479832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341086+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:58.690370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335029+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337826+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:34.701023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333466+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:31.673693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339166+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338460+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:02.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336916+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334615+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337635+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:55.470612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335346+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337563+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:16.301964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338929+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:01.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337383+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:11.259519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336318+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341759+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:50.397311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336765+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:55.871208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336434+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341361+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:38.918346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341075+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:19.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339136+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334630+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336917+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337278+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:53.168220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T15:32:55.912868+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:55.912868+0000","last_peered":"2023-10-09T15:32:55.912868+0000","last_clean":"2023-10-09T15:32:55.912868+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:55.912868+0000","last_undegraded":"2023-10-09T15:32:55.912868+0000","last_fullsized":"2023-10-09T15:32:55.912868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":896769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.754,"15min":0.754},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.44600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.35799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81899999999999995,"5min":1.379,"15min":1.379},"last":0.432},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.88600000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.83299999999999996,"15min":0.875},"min":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.87,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92300000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.215,"15min":0.215},"max":{"1min":0.52000000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.433},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":1.512,"15min":1.512},"last":0.312}]},{"osd":2,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":1.286,"15min":1.286},"last":0.248},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60999999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.222,"15min":1.222},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.752,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":1.258,"15min":1.258},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83399999999999996,"15min":0.86799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":895758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53100000000000003,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60099999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64200000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.55000000000000004,"15min":0.58099999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55400000000000005,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64300000000000002,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89000000000000001,"5min":1.196,"15min":1.196},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":1.508,"15min":1.508},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84999999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":1.238,"15min":1.238},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83699999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.252},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51500000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64900000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.436,"15min":0.436},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90800000000000003,"5min":1.407,"15min":1.407},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80900000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.501}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.81999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.752},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":2.879,"15min":2.879},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81399999999999995,"5min":0.87,"15min":0.87},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.95399999999999996,"15min":1.0149999999999999},"min":{"1min":0.42899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95599999999999996,"5min":11.055,"15min":11.055},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.99199999999999999,"15min":1.044},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1640000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.98699999999999999,"15min":1.042},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1000000000000001,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.438},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:33:03.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:33:03.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.994+0000 7f5594103700 1 Processor -- start 2023-10-09T15:33:03.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.995+0000 7f5594103700 1 -- start start 2023-10-09T15:33:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.995+0000 7f5594103700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f558c0cb970 0x7f558c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.995+0000 7f5594103700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c15ae40 con 0x7f558c15a400 2023-10-09T15:33:03.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.995+0000 7f5594103700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f558c15ab60 con 0x7f558c0cb5a0 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f5594103700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f558c0ce0f0 con 0x7f558c0cb970 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f55926a0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f558c15a400 0x7f558c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60438/0 (socket says 172.21.15.33:60438) 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f55926a0700 1 -- 172.21.15.33:0/3219954145 learned_addr learned my addr 172.21.15.33:0/3219954145 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f559169e700 1 --2- 172.21.15.33:0/3219954145 >> v2:172.21.15.59:3300/0 conn(0x7f558c0cb970 0x7f558c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2522051805 0 0) 0x7f558c15ae40 con 0x7f558c15a400 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5574003570 con 0x7f558c15a400 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4046572683 0 0) 0x7f5574003570 con 0x7f558c15a400 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f559169e700 1 -- 172.21.15.33:0/3219954145 >> v1:172.21.15.59:6789/0 conn(0x7f558c0cb5a0 legacy=0x7f558c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f559169e700 1 -- 172.21.15.33:0/3219954145 >> v1:172.21.15.33:6789/0 conn(0x7f558c15a400 legacy=0x7f558c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f559169e700 1 -- 172.21.15.33:0/3219954145 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f558c0ccf00 con 0x7f558c0cb970 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.996+0000 7f559169e700 1 --2- 172.21.15.33:0/3219954145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c0cb970 0x7f558c159ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55800098e0 tx=0x7f55800091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9027796f5e8f8824 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:03.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55840017f0 con 0x7f558c0cb970 2023-10-09T15:33:03.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5580011420 con 0x7f558c0cb970 2023-10-09T15:33:03.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5590e9d700 1 -- 172.21.15.33:0/3219954145 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55800117c0 con 0x7f558c0cb970 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 -- 172.21.15.33:0/3219954145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c0cb970 msgr2=0x7f558c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 --2- 172.21.15.33:0/3219954145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c0cb970 0x7f558c159ec0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f55800098e0 tx=0x7f55800091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 -- 172.21.15.33:0/3219954145 shutdown_connections 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 --2- 172.21.15.33:0/3219954145 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c0cb970 0x7f558c159ec0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 -- 172.21.15.33:0/3219954145 >> 172.21.15.33:0/3219954145 conn(0x7f558c070e30 msgr2=0x7f558c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:04.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 -- 172.21.15.33:0/3219954145 shutdown_connections 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.997+0000 7f5594103700 1 -- 172.21.15.33:0/3219954145 wait complete. 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.998+0000 7f5594103700 1 Processor -- start 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.998+0000 7f5594103700 1 -- start start 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f558c0cb970 0x7f558c0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 0x7f558c0b21a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c15b1a0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f558c15b480 con 0x7f558c15a400 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5594103700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f558c15b760 con 0x7f558c0cb970 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5591e9f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5591e9f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43230/0 (socket says 172.21.15.33:43230) 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5591e9f700 1 -- 172.21.15.33:0/351191856 learned_addr learned my addr 172.21.15.33:0/351191856 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5591e9f700 1 -- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f558c0cb970 msgr2=0x7f558c0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:03.999+0000 7f5591e9f700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f558c0cb970 0x7f558c0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f55926a0700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 0x7f558c0b21a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5591e9f700 1 -- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 msgr2=0x7f558c0b21a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5591e9f700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 0x7f558c0b21a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5591e9f700 1 -- 172.21.15.33:0/351191856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5580009420 con 0x7f558c0cb5a0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f55926a0700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 0x7f558c0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5591e9f700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c590 tx=0x7f557c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011590 con 0x7f558c0cb5a0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f557c0116f0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f558c15ba40 con 0x7f558c0cb5a0 2023-10-09T15:33:04.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f557c011ab0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.000+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f558c1519b0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.001+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f558c151bd0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.001+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f557c01b3b0 con 0x7f558c0cb5a0 2023-10-09T15:33:04.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.002+0000 7f5589ffb700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 0x7f5578069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.002+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f557c083b00 con 0x7f558c0cb5a0 2023-10-09T15:33:04.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.002+0000 7f559169e700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 0x7f5578069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.002+0000 7f559169e700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 0x7f5578069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f558c0ca740 tx=0x7f5580016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.006+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f557c050d80 con 0x7f558c0cb5a0 2023-10-09T15:33:04.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.196+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f558c15b5f0 con 0x7f5578066fc0 2023-10-09T15:33:04.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.204+0000 7f5589ffb700 1 -- 172.21.15.33:0/351191856 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278465 (secure 0 0 0) 0x7f558c15b5f0 con 0x7f5578066fc0 2023-10-09T15:33:04.207 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:04.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 msgr2=0x7f5578069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 0x7f5578069470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f558c0ca740 tx=0x7f5580016000 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 msgr2=0x7f558c15d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f557c00c590 tx=0x7f557c00c950 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 shutdown_connections 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5578066fc0 0x7f5578069470 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f558c0cb5a0 0x7f558c15d6d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f558c15a400 0x7f558c0b21a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 --2- 172.21.15.33:0/351191856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f558c0cb970 0x7f558c0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 >> 172.21.15.33:0/351191856 conn(0x7f558c070e30 msgr2=0x7f558c0cf3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 shutdown_connections 2023-10-09T15:33:04.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.207+0000 7f5594103700 1 -- 172.21.15.33:0/351191856 wait complete. 2023-10-09T15:33:04.211 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:33:04.219 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-10-09T15:33:03.261301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3630933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930607"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339489+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:51.501644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334730+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337790+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:41:48.104773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:05.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.479832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341086+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:58.690370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335029+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337826+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:34.701023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333466+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:31.673693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339166+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338460+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:02.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336916+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334615+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337635+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:55.470612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335346+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337563+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:16.301964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338929+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:01.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337383+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:11.259519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336318+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341759+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:50.397311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336765+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:55.871208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336434+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341361+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:38.918346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341075+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:19.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339136+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334630+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336917+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337278+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:53.168220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T15:32:55.912868+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:55.912868+0000","last_peered":"2023-10-09T15:32:55.912868+0000","last_clean":"2023-10-09T15:32:55.912868+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:55.912868+0000","last_undegraded":"2023-10-09T15:32:55.912868+0000","last_fullsized":"2023-10-09T15:32:55.912868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":896769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.754,"15min":0.754},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.44600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.35799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81899999999999995,"5min":1.379,"15min":1.379},"last":0.432},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.88600000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.83299999999999996,"15min":0.875},"min":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.87,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92300000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.215,"15min":0.215},"max":{"1min":0.52000000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.433},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":1.512,"15min":1.512},"last":0.312}]},{"osd":2,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":1.286,"15min":1.286},"last":0.248},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60999999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.222,"15min":1.222},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.752,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":1.258,"15min":1.258},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83399999999999996,"15min":0.86799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":895758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53100000000000003,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60099999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64200000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.55000000000000004,"15min":0.58099999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55400000000000005,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64300000000000002,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89000000000000001,"5min":1.196,"15min":1.196},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":1.508,"15min":1.508},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84999999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":1.238,"15min":1.238},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83699999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.252},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51500000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64900000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.436,"15min":0.436},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90800000000000003,"5min":1.407,"15min":1.407},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80900000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.501}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.81999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.752},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":2.879,"15min":2.879},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81399999999999995,"5min":0.87,"15min":0.87},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.95399999999999996,"15min":1.0149999999999999},"min":{"1min":0.42899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95599999999999996,"5min":11.055,"15min":11.055},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.99199999999999999,"15min":1.044},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1640000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.98699999999999999,"15min":1.042},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1000000000000001,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.438},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:33:04.224 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-10-09T15:33:04.224 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-10-09T15:33:04.225 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.226 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-10-09T15:33:04.227 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.228 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-10-09T15:33:04.229 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-10-09T15:33:04.230 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-10-09T15:33:04.231 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339489+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:33:51.501644+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341777+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-10-09T15:33:04.232 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.334730+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337790+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:41:48.104773+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.233 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.333004+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:40:05.502458+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339004+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:33:33.479832+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-10-09T15:33:04.234 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339163+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341086+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:24:58.690370+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.335029+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:33:04.235 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337826+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:18:34.701023+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.333466+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:05:31.673693+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.236 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339163+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339166+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.338460+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:43:02.823633+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.237 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.336916+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.334615+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-10-09T15:33:04.238 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337635+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:38:55.470612+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.335346+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.239 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337563+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:10:16.301964+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.338929+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:42:01.296272+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337383+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:08:11.259519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.240 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.336318+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341759+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:38:50.397311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-10-09T15:33:04.241 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.336765+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:08:55.871208+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.336434+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-10-09T15:33:04.242 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341361+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:47:38.918346+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341777+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.341075+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:39:19.716754+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-10-09T15:33:04.243 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.339136+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.334630+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-10-09T15:33:04.244 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.336917+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:34:50.329281+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-10-09T15:33:04.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-10-09T15:32:58.330732+0000', 'last_change': '2023-10-09T15:32:58.330732+0000', 'last_active': '2023-10-09T15:32:58.330732+0000', 'last_peered': '2023-10-09T15:32:58.330732+0000', 'last_clean': '2023-10-09T15:32:58.330732+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:58.330732+0000', 'last_undegraded': '2023-10-09T15:32:58.330732+0000', 'last_fullsized': '2023-10-09T15:32:58.330732+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:58.330732+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-10-09T15:33:04.245 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-10-09T15:33:04.245 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:32:57.326328+0000', 'last_change': '2023-10-09T15:32:57.337278+0000', 'last_active': '2023-10-09T15:32:57.326328+0000', 'last_peered': '2023-10-09T15:32:57.326328+0000', 'last_clean': '2023-10-09T15:32:57.326328+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:32:57.326328+0000', 'last_undegraded': '2023-10-09T15:32:57.326328+0000', 'last_fullsized': '2023-10-09T15:32:57.326328+0000', 'mapping_epoch': 60, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 60, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'last_clean_scrub_stamp': '2023-10-09T15:32:57.326328+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:24:53.168220+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:33:04.245 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T15:33:04.318 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:33:04.318+0000 7f3286db2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:33:04.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.377+0000 7f866359e700 1 Processor -- start 2023-10-09T15:33:04.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.378+0000 7f866359e700 1 -- start start 2023-10-09T15:33:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.378+0000 7f866359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86640b05a0 0x7f86640b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86640cec90 0x7f86640c89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640c3ad0 0x7f86640c3f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86640c4490 con 0x7f86640b05a0 2023-10-09T15:33:04.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f866406e560 con 0x7f86640cec90 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866406e260 con 0x7f86640c3ad0 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86640b05a0 0x7f86640b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f86640b05a0 0x7f86640b0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43232/0 (socket says 172.21.15.33:43232) 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f8661d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86640cec90 0x7f86640c89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 -- 172.21.15.33:0/2311513557 learned_addr learned my addr 172.21.15.33:0/2311513557 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f8662d9d700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640c3ad0 0x7f86640c3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 -- 172.21.15.33:0/2311513557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640c3ad0 msgr2=0x7f86640c3f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640c3ad0 0x7f86640c3f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 -- 172.21.15.33:0/2311513557 >> v2:172.21.15.59:3300/0 conn(0x7f86640cec90 msgr2=0x7f86640c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 --2- 172.21.15.33:0/2311513557 >> v2:172.21.15.59:3300/0 conn(0x7f86640cec90 0x7f86640c89b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 -- 172.21.15.33:0/2311513557 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640c8ef0 con 0x7f86640b05a0 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866259c700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640b05a0 0x7f86640b0970 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f86640b0eb0 tx=0x7f8654009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d2fd8052b982d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866159a700 1 -- 172.21.15.33:0/2311513557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654005c10 con 0x7f86640b05a0 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866159a700 1 -- 172.21.15.33:0/2311513557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8654005d70 con 0x7f86640b05a0 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.379+0000 7f866159a700 1 -- 172.21.15.33:0/2311513557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654006260 con 0x7f86640b05a0 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 -- 172.21.15.33:0/2311513557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640b05a0 msgr2=0x7f86640b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640b05a0 0x7f86640b0970 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f86640b0eb0 tx=0x7f8654009220 comp rx=0 tx=0).stop 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 -- 172.21.15.33:0/2311513557 shutdown_connections 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640c3ad0 0x7f86640c3f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 --2- 172.21.15.33:0/2311513557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640b05a0 0x7f86640b0970 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 --2- 172.21.15.33:0/2311513557 >> v2:172.21.15.59:3300/0 conn(0x7f86640cec90 0x7f86640c89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 -- 172.21.15.33:0/2311513557 >> 172.21.15.33:0/2311513557 conn(0x7f8664088000 msgr2=0x7f86640ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:04.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 -- 172.21.15.33:0/2311513557 shutdown_connections 2023-10-09T15:33:04.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.380+0000 7f866359e700 1 -- 172.21.15.33:0/2311513557 wait complete. 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.381+0000 7f866359e700 1 Processor -- start 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.381+0000 7f866359e700 1 -- start start 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640b05a0 0x7f86640c5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 0x7f866415a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c6610 con 0x7f86640c3ad0 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664157480 con 0x7f86640cec90 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c5a00 con 0x7f86640b05a0 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43242/0 (socket says 172.21.15.33:43242) 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 -- 172.21.15.33:0/894851704 learned_addr learned my addr 172.21.15.33:0/894851704 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8662d9d700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 0x7f866415a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f866259c700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640b05a0 0x7f86640c5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 -- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640b05a0 msgr2=0x7f86640c5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640b05a0 0x7f86640c5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 -- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 msgr2=0x7f866415a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 0x7f866415a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 -- 172.21.15.33:0/894851704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8654009480 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8662d9d700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 0x7f866415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.382+0000 7f8661d9b700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f865800ec50 tx=0x7f86580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.383+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865800c9d0 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.383+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865800cb30 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.383+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640c5ce0 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.383+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8658013470 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.383+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640c62a0 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.384+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640c6780 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.384+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8658013820 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.384+0000 7f86527fc700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 0x7f8644069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.384+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8658084650 con 0x7f86640c3ad0 2023-10-09T15:33:04.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.385+0000 7f866259c700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 0x7f8644069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.385+0000 7f866259c700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 0x7f8644069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8654009260 tx=0x7f8654016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.389+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86580518d0 con 0x7f86640c3ad0 2023-10-09T15:33:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.662+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f866404c3c0 con 0x7f86640c3ad0 2023-10-09T15:33:04.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.663+0000 7f86527fc700 1 -- 172.21.15.33:0/894851704 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1530 (secure 0 0 0) 0x7f8658054ef0 con 0x7f86640c3ad0 2023-10-09T15:33:04.663 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:04.663 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":143,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":63,"num_osds":8,"num_up_osds":8,"osd_up_since":1696865452,"num_in_osds":8,"osd_in_since":1696865443,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2442399744,"bytes_avail":770651713536,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":40,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"a","status":"up:active","gid":5718}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-10-09T15:32:09.250259+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T15:33:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 msgr2=0x7f8644069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 0x7f8644069470 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f8654009260 tx=0x7f8654016000 comp rx=0 tx=0).stop 2023-10-09T15:33:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 msgr2=0x7f86640b36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f865800ec50 tx=0x7f86580091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 shutdown_connections 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8644066fc0 0x7f8644069470 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86640cec90 0x7f866415a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86640b05a0 0x7f86640c5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 --2- 172.21.15.33:0/894851704 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86640c3ad0 0x7f86640b36b0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 >> 172.21.15.33:0/894851704 conn(0x7f8664088000 msgr2=0x7f866406d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 shutdown_connections 2023-10-09T15:33:04.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.665+0000 7f866359e700 1 -- 172.21.15.33:0/894851704 wait complete. 2023-10-09T15:33:04.677 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T15:33:04.677 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:33:04.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.796+0000 7f636efee700 1 Processor -- start 2023-10-09T15:33:04.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.796+0000 7f636efee700 1 -- start start 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636efee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f63680cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636efee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63680cef40 0x7f636815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636efee700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f636815afd0 con 0x7f6368153c30 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636efee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f636815b2b0 con 0x7f63680cef40 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636efee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f636815b590 con 0x7f636815de50 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636e7ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f63680cef40 0x7f636815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636d7eb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f63680cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636dfec700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f6368153c30 0x7f636815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:57386/0 (socket says 172.21.15.33:57386) 2023-10-09T15:33:04.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.797+0000 7f636dfec700 1 -- 172.21.15.33:0/2767967533 learned_addr learned my addr 172.21.15.33:0/2767967533 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:04.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636e7ed700 1 -- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 msgr2=0x7f63680cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:04.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636e7ed700 1 --2- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f63680cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636e7ed700 1 -- 172.21.15.33:0/2767967533 >> v1:172.21.15.59:6789/0 conn(0x7f6368153c30 legacy=0x7f636815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636e7ed700 1 -- 172.21.15.33:0/2767967533 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f636815b870 con 0x7f63680cef40 2023-10-09T15:33:04.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636e7ed700 1 --2- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63680cef40 0x7f636815c070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63600098e0 tx=0x7f63600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a00d2cbb01c11c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636cfea700 1 -- 172.21.15.33:0/2767967533 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000b640 con 0x7f63680cef40 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636cfea700 1 -- 172.21.15.33:0/2767967533 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f636000b7a0 con 0x7f63680cef40 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636cfea700 1 -- 172.21.15.33:0/2767967533 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f636000bb40 con 0x7f63680cef40 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636efee700 1 -- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63680cef40 msgr2=0x7f636815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.798+0000 7f636efee700 1 --2- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63680cef40 0x7f636815c070 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f63600098e0 tx=0x7f63600091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 -- 172.21.15.33:0/2767967533 shutdown_connections 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 --2- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f63680cef40 0x7f636815c070 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 --2- 172.21.15.33:0/2767967533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f63680cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 -- 172.21.15.33:0/2767967533 >> 172.21.15.33:0/2767967533 conn(0x7f63680703a0 msgr2=0x7f63680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 -- 172.21.15.33:0/2767967533 shutdown_connections 2023-10-09T15:33:04.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.799+0000 7f636efee700 1 -- 172.21.15.33:0/2767967533 wait complete. 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 Processor -- start 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 -- start start 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6368153c30 0x7f63681519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f6368151f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680cb240 con 0x7f63680cef40 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63680cb4e0 con 0x7f6368153c30 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.800+0000 7f636efee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63680cb7c0 con 0x7f636815de50 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43254/0 (socket says 172.21.15.33:43254) 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 -- 172.21.15.33:0/1091289158 learned_addr learned my addr 172.21.15.33:0/1091289158 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636e7ed700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f6368151f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636d7eb700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6368153c30 0x7f63681519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 -- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 msgr2=0x7f6368151f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f6368151f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 -- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6368153c30 msgr2=0x7f63681519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6368153c30 0x7f63681519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 -- 172.21.15.33:0/1091289158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6360009420 con 0x7f63680cef40 2023-10-09T15:33:04.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636dfec700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f635800cd30 tx=0x7f6358001ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800ce30 con 0x7f63680cef40 2023-10-09T15:33:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6358004bb0 con 0x7f63680cef40 2023-10-09T15:33:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63680cbaa0 con 0x7f63680cef40 2023-10-09T15:33:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.801+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f635800aac0 con 0x7f63680cef40 2023-10-09T15:33:04.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.802+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f636815fb20 con 0x7f63680cef40 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.803+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f636804c3c0 con 0x7f63680cef40 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.803+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f63580070f0 con 0x7f63680cef40 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.803+0000 7f6365ffb700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 0x7f6354069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.803+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f63580841c0 con 0x7f63680cef40 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.803+0000 7f636d7eb700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 0x7f6354069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:04.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.804+0000 7f636d7eb700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 0x7f6354069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f635c009db0 tx=0x7f635c0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:04.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.807+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f63580514c0 con 0x7f63680cef40 2023-10-09T15:33:04.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:04.995+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f63680caef0 con 0x7f6354066fc0 2023-10-09T15:33:05.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.003+0000 7f6365ffb700 1 -- 172.21.15.33:0/1091289158 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278465 (secure 0 0 0) 0x7f63680caef0 con 0x7f6354066fc0 2023-10-09T15:33:05.006 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 msgr2=0x7f6354069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 0x7f6354069470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f635c009db0 tx=0x7f635c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 msgr2=0x7f636815f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f635800cd30 tx=0x7f6358001ad0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 shutdown_connections 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6354066fc0 0x7f6354069470 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63680cef40 0x7f636815f5e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f636815de50 0x7f6368151f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 --2- 172.21.15.33:0/1091289158 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6368153c30 0x7f63681519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 >> 172.21.15.33:0/1091289158 conn(0x7f63680703a0 msgr2=0x7f63680c5d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 shutdown_connections 2023-10-09T15:33:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:05.006+0000 7f636efee700 1 -- 172.21.15.33:0/1091289158 wait complete. 2023-10-09T15:33:05.009 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:33:05.018 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2023-10-09T15:33:03.261301+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":12,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385156,"kb_used_data":6852,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589564,"statfs":{"total":773094113280,"available":770651713536,"internally_reserved":0,"allocated":7016448,"data_stored":3630933,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.930607"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339489+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:51.501644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334730+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337790+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:41:48.104773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:05.502458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339004+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:33.479832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341086+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:24:58.690370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335029+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337826+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:34.701023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.333466+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:31.673693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339163+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339166+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338460+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:02.823633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336916+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334615+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337635+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:55.470612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.335346+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337563+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:16.301964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.338929+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:01.296272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337383+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:11.259519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336318+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:17.670752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341759+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:50.397311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336765+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:08:55.871208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336434+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341361+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:47:38.918346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341777+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:12.373564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.341075+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:19.716754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.339136+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.334630+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.336917+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.329281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-10-09T15:32:58.330732+0000","last_change":"2023-10-09T15:32:58.330732+0000","last_active":"2023-10-09T15:32:58.330732+0000","last_peered":"2023-10-09T15:32:58.330732+0000","last_clean":"2023-10-09T15:32:58.330732+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:58.330732+0000","last_undegraded":"2023-10-09T15:32:58.330732+0000","last_fullsized":"2023-10-09T15:32:58.330732+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:32:57.326328+0000","last_change":"2023-10-09T15:32:57.337278+0000","last_active":"2023-10-09T15:32:57.326328+0000","last_peered":"2023-10-09T15:32:57.326328+0000","last_clean":"2023-10-09T15:32:57.326328+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:32:57.326328+0000","last_undegraded":"2023-10-09T15:32:57.326328+0000","last_fullsized":"2023-10-09T15:32:57.326328+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:53.168220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":197,"reported_epoch":59,"state":"active+clean","last_fresh":"2023-10-09T15:32:55.912868+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:55.912868+0000","last_peered":"2023-10-09T15:32:55.912868+0000","last_clean":"2023-10-09T15:32:55.912868+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:55.912868+0000","last_undegraded":"2023-10-09T15:32:55.912868+0000","last_fullsized":"2023-10-09T15:32:55.912868+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298580,"kb_used_data":1292,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073260,"statfs":{"total":96636764160,"available":96331018240,"internally_reserved":0,"allocated":1323008,"data_stored":896769,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.754,"15min":0.754},"last":0.67700000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55000000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.71599999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.44600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.64500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.69899999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.82499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.84599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.873}]}]},{"osd":6,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.35799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.495},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.32500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81899999999999995,"5min":1.379,"15min":1.379},"last":0.432},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46600000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.88600000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.83299999999999996,"15min":0.875},"min":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.87,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.52000000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.38},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92300000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.40200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.54300000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.67000000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574878,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.215,"15min":0.215},"max":{"1min":0.52000000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.433},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":1.512,"15min":1.512},"last":0.312}]},{"osd":2,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":1.286,"15min":1.286},"last":0.248},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.35399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60999999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.222,"15min":1.222},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.497}]},{"osd":5,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.752,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56699999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":1.258,"15min":1.258},"last":0.59599999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.627,"5min":0.83399999999999996,"15min":0.86799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.42299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574876,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298576,"kb_used_data":1288,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073264,"statfs":{"total":96636764160,"available":96331022336,"internally_reserved":0,"allocated":1318912,"data_stored":895758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53100000000000003,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60099999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64200000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.372},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.55000000000000004,"15min":0.58099999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.38500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55400000000000005,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.443}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64300000000000002,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89000000000000001,"5min":1.196,"15min":1.196},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":1.508,"15min":1.508},"last":0.48199999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.48999999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84999999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":1.238,"15min":1.238},"last":0.60699999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83699999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.53500000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574877,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.252},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51500000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.30199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64900000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.439,"5min":0.436,"15min":0.436},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38200000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.45000000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.45800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.53900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90800000000000003,"5min":1.407,"15min":1.407},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80900000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56299999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574875,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"min":{"1min":0.21099999999999999,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":1.2270000000000001,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":1.123,"5min":1.123,"15min":1.123},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":17.085999999999999,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.375}]},{"osd":1,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":9.6600000000000001,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.442,"5min":0.442,"15min":0.442},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":1.3049999999999999,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.501}]},{"osd":2,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.821,"5min":1.821,"15min":1.821},"min":{"1min":0.253,"5min":0.253,"15min":0.253},"max":{"1min":16.937999999999999,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.89200000000000002,"5min":0.89200000000000002,"15min":0.89200000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":10.451000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.52700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.3220000000000001,"5min":1.3220000000000001,"15min":1.3220000000000001},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":17.02,"5min":17.02,"15min":17.02},"last":0.70799999999999996},{"interface":"front","average":{"1min":1.0329999999999999,"5min":1.0329999999999999,"15min":1.0329999999999999},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":9.6969999999999992,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.78500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.621,"15min":0.621},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.2549999999999999,"5min":1.2549999999999999,"15min":1.2549999999999999},"last":0.77000000000000002},{"interface":"front","average":{"1min":1.357,"5min":1.357,"15min":1.357},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":16.984999999999999,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.63300000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.0580000000000001,"5min":1.0580000000000001,"15min":1.0580000000000001},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":9.7319999999999993,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.278,"5min":1.278,"15min":1.278},"last":0.81999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:31:54 2023","interfaces":[{"interface":"back","average":{"1min":1.403,"5min":1.403,"15min":1.403},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":17.053999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.73999999999999999},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.0649999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":9.6029999999999998,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.83599999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574876,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.752},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.85699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":2.879,"15min":2.879},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.77200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.628},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.68100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.80000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.82899999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.84499999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.89400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.86899999999999999},{"interface":"front","average":{"1min":0.622,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.88100000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574877,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298000,"kb_used_data":712,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073840,"statfs":{"total":96636764160,"available":96331612160,"internally_reserved":0,"allocated":729088,"data_stored":306401,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81399999999999995,"5min":0.87,"15min":0.87},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.56799999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.47199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.95399999999999996,"15min":1.0149999999999999},"min":{"1min":0.42899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95599999999999996,"5min":11.055,"15min":11.055},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.99199999999999999,"15min":1.044},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1640000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.45100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.98699999999999999,"15min":1.042},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1000000000000001,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.438},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.498}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:33:05.932 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:33:05.935 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:33:08.024 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:33:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.158+0000 7fd586586700 1 Processor -- start 2023-10-09T15:33:08.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.158+0000 7fd586586700 1 -- start start 2023-10-09T15:33:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd586586700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd580159c80 0x7fd5800cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd586586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd5800cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd586586700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5800ce9d0 con 0x7fd5801598b0 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd586586700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5800af960 con 0x7fd580159c80 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd586586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5800afc30 con 0x7fd5800cfe70 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd57f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd580159c80 0x7fd5800cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd57ffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd5801598b0 0x7fd5800af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:57392/0 (socket says 172.21.15.33:57392) 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.159+0000 7fd584b23700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd5800cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd57ffff700 1 -- 172.21.15.33:0/2467456088 learned_addr learned my addr 172.21.15.33:0/2467456088 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd584b23700 1 -- 172.21.15.33:0/2467456088 >> v2:172.21.15.59:3300/0 conn(0x7fd580159c80 msgr2=0x7fd5800cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd584b23700 1 --2- 172.21.15.33:0/2467456088 >> v2:172.21.15.59:3300/0 conn(0x7fd580159c80 0x7fd5800cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd584b23700 1 -- 172.21.15.33:0/2467456088 >> v1:172.21.15.59:6789/0 conn(0x7fd5801598b0 legacy=0x7fd5800af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd584b23700 1 -- 172.21.15.33:0/2467456088 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800aff10 con 0x7fd5800cfe70 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd584b23700 1 --2- 172.21.15.33:0/2467456088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd5800cbc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e60 tx=0x7fd578009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7ece1cb6a047bc37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd57effd700 1 -- 172.21.15.33:0/2467456088 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57800e070 con 0x7fd5800cfe70 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd57effd700 1 -- 172.21.15.33:0/2467456088 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd57800bb60 con 0x7fd5800cfe70 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.160+0000 7fd57effd700 1 -- 172.21.15.33:0/2467456088 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578012430 con 0x7fd5800cfe70 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 -- 172.21.15.33:0/2467456088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 msgr2=0x7fd5800cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 --2- 172.21.15.33:0/2467456088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd5800cbc30 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fd578009e60 tx=0x7fd578009780 comp rx=0 tx=0).stop 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 -- 172.21.15.33:0/2467456088 shutdown_connections 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 --2- 172.21.15.33:0/2467456088 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd5800cbc30 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 --2- 172.21.15.33:0/2467456088 >> v2:172.21.15.59:3300/0 conn(0x7fd580159c80 0x7fd5800cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 -- 172.21.15.33:0/2467456088 >> 172.21.15.33:0/2467456088 conn(0x7fd580070e30 msgr2=0x7fd5800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 -- 172.21.15.33:0/2467456088 shutdown_connections 2023-10-09T15:33:08.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.161+0000 7fd586586700 1 -- 172.21.15.33:0/2467456088 wait complete. 2023-10-09T15:33:08.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.162+0000 7fd586586700 1 Processor -- start 2023-10-09T15:33:08.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.162+0000 7fd586586700 1 -- start start 2023-10-09T15:33:08.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd580153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5801598b0 0x7fd580169b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58016aab0 con 0x7fd580159c80 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd58015a4f0 con 0x7fd5801598b0 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd586586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58016a4f0 con 0x7fd5800cfe70 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43266/0 (socket says 172.21.15.33:43266) 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 -- 172.21.15.33:0/3906880576 learned_addr learned my addr 172.21.15.33:0/3906880576 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:08.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd57ffff700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd580153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd57f7fe700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5801598b0 0x7fd580169b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 -- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 msgr2=0x7fd580153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd580153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 -- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5801598b0 msgr2=0x7fd580169b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5801598b0 0x7fd580169b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.163+0000 7fd584b23700 1 -- 172.21.15.33:0/3906880576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd578009a20 con 0x7fd580159c80 2023-10-09T15:33:08.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd584b23700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd5800898f0 tx=0x7fd578019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578012e60 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd578027470 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd58016a7d0 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd578027810 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.164+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5800b60a0 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.165+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd58004c3c0 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.165+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd578024070 con 0x7fd580159c80 2023-10-09T15:33:08.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.166+0000 7fd567fff700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 0x7fd56c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.166+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd578086f80 con 0x7fd580159c80 2023-10-09T15:33:08.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.166+0000 7fd57ffff700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 0x7fd56c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.166+0000 7fd57ffff700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 0x7fd56c069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd574007130 tx=0x7fd574007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.170+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd578054200 con 0x7fd580159c80 2023-10-09T15:33:08.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.365+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd58015a630 con 0x7fd56c066fc0 2023-10-09T15:33:08.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.373+0000 7fd567fff700 1 -- 172.21.15.33:0/3906880576 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289172 (secure 0 0 0) 0x7fd58015a630 con 0x7fd56c066fc0 2023-10-09T15:33:08.376 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 msgr2=0x7fd56c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 0x7fd56c069470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fd574007130 tx=0x7fd574007eb0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 msgr2=0x7fd58016acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fd5800898f0 tx=0x7fd578019000 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 shutdown_connections 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd56c066fc0 0x7fd56c069470 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd580159c80 0x7fd58016acb0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd5800cfe70 0x7fd580153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 --2- 172.21.15.33:0/3906880576 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd5801598b0 0x7fd580169b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 >> 172.21.15.33:0/3906880576 conn(0x7fd580070e30 msgr2=0x7fd5800b21d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:08.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 shutdown_connections 2023-10-09T15:33:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.376+0000 7fd586586700 1 -- 172.21.15.33:0/3906880576 wait complete. 2023-10-09T15:33:08.381 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:33:08.388 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2023-10-09T15:33:07.262293+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2385508,"kb_used_data":7204,"kb_used_omap":0,"kb_used_meta":2378240,"kb_avail":752589212,"statfs":{"total":773094113280,"available":770651353088,"internally_reserved":0,"allocated":7376896,"data_stored":3790057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2435317760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":38,"apply_latency_ms":38,"commit_latency_ns":38000000,"apply_latency_ns":38000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001877"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.373366+0000","last_change":"2023-10-09T15:32:59.367529+0000","last_active":"2023-10-09T15:32:59.373366+0000","last_peered":"2023-10-09T15:32:59.373366+0000","last_clean":"2023-10-09T15:32:59.373366+0000","last_became_active":"2023-10-09T15:32:59.366987+0000","last_became_peered":"2023-10-09T15:32:59.366987+0000","last_unstale":"2023-10-09T15:32:59.373366+0000","last_undegraded":"2023-10-09T15:32:59.373366+0000","last_fullsized":"2023-10-09T15:32:59.373366+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:40:09.798091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368669+0000","last_change":"2023-10-09T15:32:59.358679+0000","last_active":"2023-10-09T15:32:59.368669+0000","last_peered":"2023-10-09T15:32:59.368669+0000","last_clean":"2023-10-09T15:32:59.368669+0000","last_became_active":"2023-10-09T15:32:59.357704+0000","last_became_peered":"2023-10-09T15:32:59.357704+0000","last_unstale":"2023-10-09T15:32:59.368669+0000","last_undegraded":"2023-10-09T15:32:59.368669+0000","last_fullsized":"2023-10-09T15:32:59.368669+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:08:06.219223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366471+0000","last_change":"2023-10-09T15:32:59.363125+0000","last_active":"2023-10-09T15:32:59.366471+0000","last_peered":"2023-10-09T15:32:59.366471+0000","last_clean":"2023-10-09T15:32:59.366471+0000","last_became_active":"2023-10-09T15:32:59.362801+0000","last_became_peered":"2023-10-09T15:32:59.362801+0000","last_unstale":"2023-10-09T15:32:59.366471+0000","last_undegraded":"2023-10-09T15:32:59.366471+0000","last_fullsized":"2023-10-09T15:32:59.366471+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:19.565200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368336+0000","last_change":"2023-10-09T15:32:59.365470+0000","last_active":"2023-10-09T15:32:59.368336+0000","last_peered":"2023-10-09T15:32:59.368336+0000","last_clean":"2023-10-09T15:32:59.368336+0000","last_became_active":"2023-10-09T15:32:59.365251+0000","last_became_peered":"2023-10-09T15:32:59.365251+0000","last_unstale":"2023-10-09T15:32:59.368336+0000","last_undegraded":"2023-10-09T15:32:59.368336+0000","last_fullsized":"2023-10-09T15:32:59.368336+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:18.675156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.359201+0000","last_change":"2023-10-09T15:32:59.354180+0000","last_active":"2023-10-09T15:32:59.359201+0000","last_peered":"2023-10-09T15:32:59.359201+0000","last_clean":"2023-10-09T15:32:59.359201+0000","last_became_active":"2023-10-09T15:32:59.353840+0000","last_became_peered":"2023-10-09T15:32:59.353840+0000","last_unstale":"2023-10-09T15:32:59.359201+0000","last_undegraded":"2023-10-09T15:32:59.359201+0000","last_fullsized":"2023-10-09T15:32:59.359201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:03.828037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368625+0000","last_change":"2023-10-09T15:32:59.357448+0000","last_active":"2023-10-09T15:32:59.368625+0000","last_peered":"2023-10-09T15:32:59.368625+0000","last_clean":"2023-10-09T15:32:59.368625+0000","last_became_active":"2023-10-09T15:32:59.356792+0000","last_became_peered":"2023-10-09T15:32:59.356792+0000","last_unstale":"2023-10-09T15:32:59.368625+0000","last_undegraded":"2023-10-09T15:32:59.368625+0000","last_fullsized":"2023-10-09T15:32:59.368625+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:13.377968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361431+0000","last_change":"2023-10-09T15:32:59.354053+0000","last_active":"2023-10-09T15:32:59.361431+0000","last_peered":"2023-10-09T15:32:59.361431+0000","last_clean":"2023-10-09T15:32:59.361431+0000","last_became_active":"2023-10-09T15:32:59.353761+0000","last_became_peered":"2023-10-09T15:32:59.353761+0000","last_unstale":"2023-10-09T15:32:59.361431+0000","last_undegraded":"2023-10-09T15:32:59.361431+0000","last_fullsized":"2023-10-09T15:32:59.361431+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:12:19.115120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369234+0000","last_change":"2023-10-09T15:32:59.361000+0000","last_active":"2023-10-09T15:32:59.369234+0000","last_peered":"2023-10-09T15:32:59.369234+0000","last_clean":"2023-10-09T15:32:59.369234+0000","last_became_active":"2023-10-09T15:32:59.360581+0000","last_became_peered":"2023-10-09T15:32:59.360581+0000","last_unstale":"2023-10-09T15:32:59.369234+0000","last_undegraded":"2023-10-09T15:32:59.369234+0000","last_fullsized":"2023-10-09T15:32:59.369234+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:04.156392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369389+0000","last_change":"2023-10-09T15:32:59.367726+0000","last_active":"2023-10-09T15:32:59.369389+0000","last_peered":"2023-10-09T15:32:59.369389+0000","last_clean":"2023-10-09T15:32:59.369389+0000","last_became_active":"2023-10-09T15:32:59.367354+0000","last_became_peered":"2023-10-09T15:32:59.367354+0000","last_unstale":"2023-10-09T15:32:59.369389+0000","last_undegraded":"2023-10-09T15:32:59.369389+0000","last_fullsized":"2023-10-09T15:32:59.369389+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:38:56.475016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365230+0000","last_change":"2023-10-09T15:32:59.360138+0000","last_active":"2023-10-09T15:32:59.365230+0000","last_peered":"2023-10-09T15:32:59.365230+0000","last_clean":"2023-10-09T15:32:59.365230+0000","last_became_active":"2023-10-09T15:32:59.359837+0000","last_became_peered":"2023-10-09T15:32:59.359837+0000","last_unstale":"2023-10-09T15:32:59.365230+0000","last_undegraded":"2023-10-09T15:32:59.365230+0000","last_fullsized":"2023-10-09T15:32:59.365230+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:02.300676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368973+0000","last_change":"2023-10-09T15:32:59.364165+0000","last_active":"2023-10-09T15:32:59.368973+0000","last_peered":"2023-10-09T15:32:59.368973+0000","last_clean":"2023-10-09T15:32:59.368973+0000","last_became_active":"2023-10-09T15:32:59.363839+0000","last_became_peered":"2023-10-09T15:32:59.363839+0000","last_unstale":"2023-10-09T15:32:59.368973+0000","last_undegraded":"2023-10-09T15:32:59.368973+0000","last_fullsized":"2023-10-09T15:32:59.368973+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:32.678097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360843+0000","last_change":"2023-10-09T15:32:59.358726+0000","last_active":"2023-10-09T15:32:59.360843+0000","last_peered":"2023-10-09T15:32:59.360843+0000","last_clean":"2023-10-09T15:32:59.360843+0000","last_became_active":"2023-10-09T15:32:59.358249+0000","last_became_peered":"2023-10-09T15:32:59.358249+0000","last_unstale":"2023-10-09T15:32:59.360843+0000","last_undegraded":"2023-10-09T15:32:59.360843+0000","last_fullsized":"2023-10-09T15:32:59.360843+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:51.401715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366644+0000","last_change":"2023-10-09T15:32:59.364646+0000","last_active":"2023-10-09T15:32:59.366644+0000","last_peered":"2023-10-09T15:32:59.366644+0000","last_clean":"2023-10-09T15:32:59.366644+0000","last_became_active":"2023-10-09T15:32:59.364003+0000","last_became_peered":"2023-10-09T15:32:59.364003+0000","last_unstale":"2023-10-09T15:32:59.366644+0000","last_undegraded":"2023-10-09T15:32:59.366644+0000","last_fullsized":"2023-10-09T15:32:59.366644+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:47.797139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360993+0000","last_change":"2023-10-09T15:32:59.355205+0000","last_active":"2023-10-09T15:32:59.360993+0000","last_peered":"2023-10-09T15:32:59.360993+0000","last_clean":"2023-10-09T15:32:59.360993+0000","last_became_active":"2023-10-09T15:32:59.354920+0000","last_became_peered":"2023-10-09T15:32:59.354920+0000","last_unstale":"2023-10-09T15:32:59.360993+0000","last_undegraded":"2023-10-09T15:32:59.360993+0000","last_fullsized":"2023-10-09T15:32:59.360993+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:44.617558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361684+0000","last_change":"2023-10-09T15:32:59.356693+0000","last_active":"2023-10-09T15:32:59.361684+0000","last_peered":"2023-10-09T15:32:59.361684+0000","last_clean":"2023-10-09T15:32:59.361684+0000","last_became_active":"2023-10-09T15:32:59.356446+0000","last_became_peered":"2023-10-09T15:32:59.356446+0000","last_unstale":"2023-10-09T15:32:59.361684+0000","last_undegraded":"2023-10-09T15:32:59.361684+0000","last_fullsized":"2023-10-09T15:32:59.361684+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:21.926503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365643+0000","last_change":"2023-10-09T15:32:59.358171+0000","last_active":"2023-10-09T15:32:59.365643+0000","last_peered":"2023-10-09T15:32:59.365643+0000","last_clean":"2023-10-09T15:32:59.365643+0000","last_became_active":"2023-10-09T15:32:59.357856+0000","last_became_peered":"2023-10-09T15:32:59.357856+0000","last_unstale":"2023-10-09T15:32:59.365643+0000","last_undegraded":"2023-10-09T15:32:59.365643+0000","last_fullsized":"2023-10-09T15:32:59.365643+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:07.152496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369665+0000","last_change":"2023-10-09T15:32:59.368582+0000","last_active":"2023-10-09T15:32:59.369665+0000","last_peered":"2023-10-09T15:32:59.369665+0000","last_clean":"2023-10-09T15:32:59.369665+0000","last_became_active":"2023-10-09T15:32:59.367017+0000","last_became_peered":"2023-10-09T15:32:59.367017+0000","last_unstale":"2023-10-09T15:32:59.369665+0000","last_undegraded":"2023-10-09T15:32:59.369665+0000","last_fullsized":"2023-10-09T15:32:59.369665+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:18:35.705427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360763+0000","last_change":"2023-10-09T15:32:59.358290+0000","last_active":"2023-10-09T15:32:59.360763+0000","last_peered":"2023-10-09T15:32:59.360763+0000","last_clean":"2023-10-09T15:32:59.360763+0000","last_became_active":"2023-10-09T15:32:59.358069+0000","last_became_peered":"2023-10-09T15:32:59.358069+0000","last_unstale":"2023-10-09T15:32:59.360763+0000","last_undegraded":"2023-10-09T15:32:59.360763+0000","last_fullsized":"2023-10-09T15:32:59.360763+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:27:13.377968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369240+0000","last_change":"2023-10-09T15:32:59.359564+0000","last_active":"2023-10-09T15:32:59.369240+0000","last_peered":"2023-10-09T15:32:59.369240+0000","last_clean":"2023-10-09T15:32:59.369240+0000","last_became_active":"2023-10-09T15:32:59.359289+0000","last_became_peered":"2023-10-09T15:32:59.359289+0000","last_unstale":"2023-10-09T15:32:59.369240+0000","last_undegraded":"2023-10-09T15:32:59.369240+0000","last_fullsized":"2023-10-09T15:32:59.369240+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:32.608327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361636+0000","last_change":"2023-10-09T15:32:59.355960+0000","last_active":"2023-10-09T15:32:59.361636+0000","last_peered":"2023-10-09T15:32:59.361636+0000","last_clean":"2023-10-09T15:32:59.361636+0000","last_became_active":"2023-10-09T15:32:59.355697+0000","last_became_peered":"2023-10-09T15:32:59.355697+0000","last_unstale":"2023-10-09T15:32:59.361636+0000","last_undegraded":"2023-10-09T15:32:59.361636+0000","last_fullsized":"2023-10-09T15:32:59.361636+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:51.633850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365177+0000","last_change":"2023-10-09T15:32:59.358810+0000","last_active":"2023-10-09T15:32:59.365177+0000","last_peered":"2023-10-09T15:32:59.365177+0000","last_clean":"2023-10-09T15:32:59.365177+0000","last_became_active":"2023-10-09T15:32:59.358480+0000","last_became_peered":"2023-10-09T15:32:59.358480+0000","last_unstale":"2023-10-09T15:32:59.365177+0000","last_undegraded":"2023-10-09T15:32:59.365177+0000","last_fullsized":"2023-10-09T15:32:59.365177+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:08:00.822952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366440+0000","last_change":"2023-10-09T15:32:59.360316+0000","last_active":"2023-10-09T15:32:59.366440+0000","last_peered":"2023-10-09T15:32:59.366440+0000","last_clean":"2023-10-09T15:32:59.366440+0000","last_became_active":"2023-10-09T15:32:59.360015+0000","last_became_peered":"2023-10-09T15:32:59.360015+0000","last_unstale":"2023-10-09T15:32:59.366440+0000","last_undegraded":"2023-10-09T15:32:59.366440+0000","last_fullsized":"2023-10-09T15:32:59.366440+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:52.506048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368498+0000","last_change":"2023-10-09T15:32:59.360473+0000","last_active":"2023-10-09T15:32:59.368498+0000","last_peered":"2023-10-09T15:32:59.368498+0000","last_clean":"2023-10-09T15:32:59.368498+0000","last_became_active":"2023-10-09T15:32:59.360171+0000","last_became_peered":"2023-10-09T15:32:59.360171+0000","last_unstale":"2023-10-09T15:32:59.368498+0000","last_undegraded":"2023-10-09T15:32:59.368498+0000","last_fullsized":"2023-10-09T15:32:59.368498+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:28.306406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369064+0000","last_change":"2023-10-09T15:32:59.360081+0000","last_active":"2023-10-09T15:32:59.369064+0000","last_peered":"2023-10-09T15:32:59.369064+0000","last_clean":"2023-10-09T15:32:59.369064+0000","last_became_active":"2023-10-09T15:32:59.359806+0000","last_became_peered":"2023-10-09T15:32:59.359806+0000","last_unstale":"2023-10-09T15:32:59.369064+0000","last_undegraded":"2023-10-09T15:32:59.369064+0000","last_fullsized":"2023-10-09T15:32:59.369064+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:37:58.710926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368232+0000","last_change":"2023-10-09T15:32:59.364384+0000","last_active":"2023-10-09T15:32:59.368232+0000","last_peered":"2023-10-09T15:32:59.368232+0000","last_clean":"2023-10-09T15:32:59.368232+0000","last_became_active":"2023-10-09T15:32:59.364094+0000","last_became_peered":"2023-10-09T15:32:59.364094+0000","last_unstale":"2023-10-09T15:32:59.368232+0000","last_undegraded":"2023-10-09T15:32:59.368232+0000","last_fullsized":"2023-10-09T15:32:59.368232+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:16.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360791+0000","last_change":"2023-10-09T15:32:59.357176+0000","last_active":"2023-10-09T15:32:59.360791+0000","last_peered":"2023-10-09T15:32:59.360791+0000","last_clean":"2023-10-09T15:32:59.360791+0000","last_became_active":"2023-10-09T15:32:59.356537+0000","last_became_peered":"2023-10-09T15:32:59.356537+0000","last_unstale":"2023-10-09T15:32:59.360791+0000","last_undegraded":"2023-10-09T15:32:59.360791+0000","last_fullsized":"2023-10-09T15:32:59.360791+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:34:17.409908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366489+0000","last_change":"2023-10-09T15:32:59.363238+0000","last_active":"2023-10-09T15:32:59.366489+0000","last_peered":"2023-10-09T15:32:59.366489+0000","last_clean":"2023-10-09T15:32:59.366489+0000","last_became_active":"2023-10-09T15:32:59.362989+0000","last_became_peered":"2023-10-09T15:32:59.362989+0000","last_unstale":"2023-10-09T15:32:59.366489+0000","last_undegraded":"2023-10-09T15:32:59.366489+0000","last_fullsized":"2023-10-09T15:32:59.366489+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:00.774733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365201+0000","last_change":"2023-10-09T15:32:59.359588+0000","last_active":"2023-10-09T15:32:59.365201+0000","last_peered":"2023-10-09T15:32:59.365201+0000","last_clean":"2023-10-09T15:32:59.365201+0000","last_became_active":"2023-10-09T15:32:59.359330+0000","last_became_peered":"2023-10-09T15:32:59.359330+0000","last_unstale":"2023-10-09T15:32:59.365201+0000","last_undegraded":"2023-10-09T15:32:59.365201+0000","last_fullsized":"2023-10-09T15:32:59.365201+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:15.480326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366560+0000","last_change":"2023-10-09T15:32:59.362830+0000","last_active":"2023-10-09T15:32:59.366560+0000","last_peered":"2023-10-09T15:32:59.366560+0000","last_clean":"2023-10-09T15:32:59.366560+0000","last_became_active":"2023-10-09T15:32:59.362585+0000","last_became_peered":"2023-10-09T15:32:59.362585+0000","last_unstale":"2023-10-09T15:32:59.366560+0000","last_undegraded":"2023-10-09T15:32:59.366560+0000","last_fullsized":"2023-10-09T15:32:59.366560+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:22:51.730269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360755+0000","last_change":"2023-10-09T15:32:59.355581+0000","last_active":"2023-10-09T15:32:59.360755+0000","last_peered":"2023-10-09T15:32:59.360755+0000","last_clean":"2023-10-09T15:32:59.360755+0000","last_became_active":"2023-10-09T15:32:59.355244+0000","last_became_peered":"2023-10-09T15:32:59.355244+0000","last_unstale":"2023-10-09T15:32:59.360755+0000","last_undegraded":"2023-10-09T15:32:59.360755+0000","last_fullsized":"2023-10-09T15:32:59.360755+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:54:25.826061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361453+0000","last_change":"2023-10-09T15:32:59.357538+0000","last_active":"2023-10-09T15:32:59.361453+0000","last_peered":"2023-10-09T15:32:59.361453+0000","last_clean":"2023-10-09T15:32:59.361453+0000","last_became_active":"2023-10-09T15:32:59.357252+0000","last_became_peered":"2023-10-09T15:32:59.357252+0000","last_unstale":"2023-10-09T15:32:59.361453+0000","last_undegraded":"2023-10-09T15:32:59.361453+0000","last_fullsized":"2023-10-09T15:32:59.361453+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:15:47.797139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.370494+0000","last_change":"2023-10-09T15:32:59.364740+0000","last_active":"2023-10-09T15:32:59.370494+0000","last_peered":"2023-10-09T15:32:59.370494+0000","last_clean":"2023-10-09T15:32:59.370494+0000","last_became_active":"2023-10-09T15:32:59.364475+0000","last_became_peered":"2023-10-09T15:32:59.364475+0000","last_unstale":"2023-10-09T15:32:59.370494+0000","last_undegraded":"2023-10-09T15:32:59.370494+0000","last_fullsized":"2023-10-09T15:32:59.370494+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:47.243587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.373406+0000","last_change":"2023-10-09T15:32:59.369275+0000","last_active":"2023-10-09T15:32:59.373406+0000","last_peered":"2023-10-09T15:32:59.373406+0000","last_clean":"2023-10-09T15:32:59.373406+0000","last_became_active":"2023-10-09T15:32:59.368991+0000","last_became_peered":"2023-10-09T15:32:59.368991+0000","last_unstale":"2023-10-09T15:32:59.373406+0000","last_undegraded":"2023-10-09T15:32:59.373406+0000","last_fullsized":"2023-10-09T15:32:59.373406+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:24:48.650811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"62'4","reported_seq":14,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368812+0000","last_change":"2023-10-09T15:32:58.362864+0000","last_active":"2023-10-09T15:32:59.368812+0000","last_peered":"2023-10-09T15:32:59.368812+0000","last_clean":"2023-10-09T15:32:59.368812+0000","last_became_active":"2023-10-09T15:32:58.362601+0000","last_became_peered":"2023-10-09T15:32:58.362601+0000","last_unstale":"2023-10-09T15:32:59.368812+0000","last_undegraded":"2023-10-09T15:32:59.368812+0000","last_fullsized":"2023-10-09T15:32:59.368812+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:15:06.148092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369361+0000","last_change":"2023-10-09T15:32:59.367501+0000","last_active":"2023-10-09T15:32:59.369361+0000","last_peered":"2023-10-09T15:32:59.369361+0000","last_clean":"2023-10-09T15:32:59.369361+0000","last_became_active":"2023-10-09T15:32:59.367005+0000","last_became_peered":"2023-10-09T15:32:59.367005+0000","last_unstale":"2023-10-09T15:32:59.369361+0000","last_undegraded":"2023-10-09T15:32:59.369361+0000","last_fullsized":"2023-10-09T15:32:59.369361+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:17.306368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.359414+0000","last_change":"2023-10-09T15:32:58.352128+0000","last_active":"2023-10-09T15:32:59.359414+0000","last_peered":"2023-10-09T15:32:59.359414+0000","last_clean":"2023-10-09T15:32:59.359414+0000","last_became_active":"2023-10-09T15:32:58.351855+0000","last_became_peered":"2023-10-09T15:32:58.351855+0000","last_unstale":"2023-10-09T15:32:59.359414+0000","last_undegraded":"2023-10-09T15:32:59.359414+0000","last_fullsized":"2023-10-09T15:32:59.359414+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:03.151988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369398+0000","last_change":"2023-10-09T15:32:59.362533+0000","last_active":"2023-10-09T15:32:59.369398+0000","last_peered":"2023-10-09T15:32:59.369398+0000","last_clean":"2023-10-09T15:32:59.369398+0000","last_became_active":"2023-10-09T15:32:59.362227+0000","last_became_peered":"2023-10-09T15:32:59.362227+0000","last_unstale":"2023-10-09T15:32:59.369398+0000","last_undegraded":"2023-10-09T15:32:59.369398+0000","last_fullsized":"2023-10-09T15:32:59.369398+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:09.983021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369535+0000","last_change":"2023-10-09T15:32:58.356166+0000","last_active":"2023-10-09T15:32:59.369535+0000","last_peered":"2023-10-09T15:32:59.369535+0000","last_clean":"2023-10-09T15:32:59.369535+0000","last_became_active":"2023-10-09T15:32:58.355894+0000","last_became_peered":"2023-10-09T15:32:58.355894+0000","last_unstale":"2023-10-09T15:32:59.369535+0000","last_undegraded":"2023-10-09T15:32:59.369535+0000","last_fullsized":"2023-10-09T15:32:59.369535+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:55.621096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368953+0000","last_change":"2023-10-09T15:32:59.362435+0000","last_active":"2023-10-09T15:32:59.368953+0000","last_peered":"2023-10-09T15:32:59.368953+0000","last_clean":"2023-10-09T15:32:59.368953+0000","last_became_active":"2023-10-09T15:32:59.362140+0000","last_became_peered":"2023-10-09T15:32:59.362140+0000","last_unstale":"2023-10-09T15:32:59.368953+0000","last_undegraded":"2023-10-09T15:32:59.368953+0000","last_fullsized":"2023-10-09T15:32:59.368953+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:16.727108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.358782+0000","last_change":"2023-10-09T15:32:58.359496+0000","last_active":"2023-10-09T15:32:59.358782+0000","last_peered":"2023-10-09T15:32:59.358782+0000","last_clean":"2023-10-09T15:32:59.358782+0000","last_became_active":"2023-10-09T15:32:58.359173+0000","last_became_peered":"2023-10-09T15:32:58.359173+0000","last_unstale":"2023-10-09T15:32:59.358782+0000","last_undegraded":"2023-10-09T15:32:59.358782+0000","last_fullsized":"2023-10-09T15:32:59.358782+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:28.843863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368193+0000","last_change":"2023-10-09T15:32:59.364442+0000","last_active":"2023-10-09T15:32:59.368193+0000","last_peered":"2023-10-09T15:32:59.368193+0000","last_clean":"2023-10-09T15:32:59.368193+0000","last_became_active":"2023-10-09T15:32:59.364031+0000","last_became_peered":"2023-10-09T15:32:59.364031+0000","last_unstale":"2023-10-09T15:32:59.368193+0000","last_undegraded":"2023-10-09T15:32:59.368193+0000","last_fullsized":"2023-10-09T15:32:59.368193+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:56.772889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366517+0000","last_change":"2023-10-09T15:32:58.357607+0000","last_active":"2023-10-09T15:32:59.366517+0000","last_peered":"2023-10-09T15:32:59.366517+0000","last_clean":"2023-10-09T15:32:59.366517+0000","last_became_active":"2023-10-09T15:32:58.357263+0000","last_became_peered":"2023-10-09T15:32:58.357263+0000","last_unstale":"2023-10-09T15:32:59.366517+0000","last_undegraded":"2023-10-09T15:32:59.366517+0000","last_fullsized":"2023-10-09T15:32:59.366517+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:34:15.722704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365801+0000","last_change":"2023-10-09T15:32:59.364119+0000","last_active":"2023-10-09T15:32:59.365801+0000","last_peered":"2023-10-09T15:32:59.365801+0000","last_clean":"2023-10-09T15:32:59.365801+0000","last_became_active":"2023-10-09T15:32:59.363816+0000","last_became_peered":"2023-10-09T15:32:59.363816+0000","last_unstale":"2023-10-09T15:32:59.365801+0000","last_undegraded":"2023-10-09T15:32:59.365801+0000","last_fullsized":"2023-10-09T15:32:59.365801+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:51.633850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.354377+0000","last_change":"2023-10-09T15:32:58.359678+0000","last_active":"2023-10-09T15:32:59.354377+0000","last_peered":"2023-10-09T15:32:59.354377+0000","last_clean":"2023-10-09T15:32:59.354377+0000","last_became_active":"2023-10-09T15:32:58.359308+0000","last_became_peered":"2023-10-09T15:32:58.359308+0000","last_unstale":"2023-10-09T15:32:59.354377+0000","last_undegraded":"2023-10-09T15:32:59.354377+0000","last_fullsized":"2023-10-09T15:32:59.354377+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361146+0000","last_change":"2023-10-09T15:32:59.356804+0000","last_active":"2023-10-09T15:32:59.361146+0000","last_peered":"2023-10-09T15:32:59.361146+0000","last_clean":"2023-10-09T15:32:59.361146+0000","last_became_active":"2023-10-09T15:32:59.356553+0000","last_became_peered":"2023-10-09T15:32:59.356553+0000","last_unstale":"2023-10-09T15:32:59.361146+0000","last_undegraded":"2023-10-09T15:32:59.361146+0000","last_fullsized":"2023-10-09T15:32:59.361146+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:24:54.172624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.350747+0000","last_change":"2023-10-09T15:32:58.346836+0000","last_active":"2023-10-09T15:32:59.350747+0000","last_peered":"2023-10-09T15:32:59.350747+0000","last_clean":"2023-10-09T15:32:59.350747+0000","last_became_active":"2023-10-09T15:32:58.346515+0000","last_became_peered":"2023-10-09T15:32:58.346515+0000","last_unstale":"2023-10-09T15:32:59.350747+0000","last_undegraded":"2023-10-09T15:32:59.350747+0000","last_fullsized":"2023-10-09T15:32:59.350747+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:51.819415+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365903+0000","last_change":"2023-10-09T15:32:59.360438+0000","last_active":"2023-10-09T15:32:59.365903+0000","last_peered":"2023-10-09T15:32:59.365903+0000","last_clean":"2023-10-09T15:32:59.365903+0000","last_became_active":"2023-10-09T15:32:59.360166+0000","last_became_peered":"2023-10-09T15:32:59.360166+0000","last_unstale":"2023-10-09T15:32:59.365903+0000","last_undegraded":"2023-10-09T15:32:59.365903+0000","last_fullsized":"2023-10-09T15:32:59.365903+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:16.279625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.339540+0000","last_change":"2023-10-09T15:32:58.352431+0000","last_active":"2023-10-09T15:32:59.339540+0000","last_peered":"2023-10-09T15:32:59.339540+0000","last_clean":"2023-10-09T15:32:59.339540+0000","last_became_active":"2023-10-09T15:32:58.351993+0000","last_became_peered":"2023-10-09T15:32:58.351993+0000","last_unstale":"2023-10-09T15:32:59.339540+0000","last_undegraded":"2023-10-09T15:32:59.339540+0000","last_fullsized":"2023-10-09T15:32:59.339540+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:44:50.874327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360808+0000","last_change":"2023-10-09T15:32:59.357360+0000","last_active":"2023-10-09T15:32:59.360808+0000","last_peered":"2023-10-09T15:32:59.360808+0000","last_clean":"2023-10-09T15:32:59.360808+0000","last_became_active":"2023-10-09T15:32:59.356922+0000","last_became_peered":"2023-10-09T15:32:59.356922+0000","last_unstale":"2023-10-09T15:32:59.360808+0000","last_undegraded":"2023-10-09T15:32:59.360808+0000","last_fullsized":"2023-10-09T15:32:59.360808+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:24.622053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.350480+0000","last_change":"2023-10-09T15:32:58.350483+0000","last_active":"2023-10-09T15:32:59.350480+0000","last_peered":"2023-10-09T15:32:59.350480+0000","last_clean":"2023-10-09T15:32:59.350480+0000","last_became_active":"2023-10-09T15:32:58.350182+0000","last_became_peered":"2023-10-09T15:32:58.350182+0000","last_unstale":"2023-10-09T15:32:59.350480+0000","last_undegraded":"2023-10-09T15:32:59.350480+0000","last_fullsized":"2023-10-09T15:32:59.350480+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:26.379500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.373422+0000","last_change":"2023-10-09T15:32:59.369310+0000","last_active":"2023-10-09T15:32:59.373422+0000","last_peered":"2023-10-09T15:32:59.373422+0000","last_clean":"2023-10-09T15:32:59.373422+0000","last_became_active":"2023-10-09T15:32:59.369001+0000","last_became_peered":"2023-10-09T15:32:59.369001+0000","last_unstale":"2023-10-09T15:32:59.373422+0000","last_undegraded":"2023-10-09T15:32:59.373422+0000","last_fullsized":"2023-10-09T15:32:59.373422+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:22.928405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.342431+0000","last_change":"2023-10-09T15:32:58.357763+0000","last_active":"2023-10-09T15:32:59.342431+0000","last_peered":"2023-10-09T15:32:59.342431+0000","last_clean":"2023-10-09T15:32:59.342431+0000","last_became_active":"2023-10-09T15:32:58.357289+0000","last_became_peered":"2023-10-09T15:32:58.357289+0000","last_unstale":"2023-10-09T15:32:59.342431+0000","last_undegraded":"2023-10-09T15:32:59.342431+0000","last_fullsized":"2023-10-09T15:32:59.342431+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:30:06.453457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369368+0000","last_change":"2023-10-09T15:32:59.361938+0000","last_active":"2023-10-09T15:32:59.369368+0000","last_peered":"2023-10-09T15:32:59.369368+0000","last_clean":"2023-10-09T15:32:59.369368+0000","last_became_active":"2023-10-09T15:32:59.361528+0000","last_became_peered":"2023-10-09T15:32:59.361528+0000","last_unstale":"2023-10-09T15:32:59.369368+0000","last_undegraded":"2023-10-09T15:32:59.369368+0000","last_fullsized":"2023-10-09T15:32:59.369368+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:20.130277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"62'3","reported_seq":13,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366789+0000","last_change":"2023-10-09T15:32:58.357893+0000","last_active":"2023-10-09T15:32:59.366789+0000","last_peered":"2023-10-09T15:32:59.366789+0000","last_clean":"2023-10-09T15:32:59.366789+0000","last_became_active":"2023-10-09T15:32:58.357610+0000","last_became_peered":"2023-10-09T15:32:58.357610+0000","last_unstale":"2023-10-09T15:32:59.366789+0000","last_undegraded":"2023-10-09T15:32:59.366789+0000","last_fullsized":"2023-10-09T15:32:59.366789+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:27.302002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360813+0000","last_change":"2023-10-09T15:32:59.354512+0000","last_active":"2023-10-09T15:32:59.360813+0000","last_peered":"2023-10-09T15:32:59.360813+0000","last_clean":"2023-10-09T15:32:59.360813+0000","last_became_active":"2023-10-09T15:32:59.354193+0000","last_became_peered":"2023-10-09T15:32:59.354193+0000","last_unstale":"2023-10-09T15:32:59.360813+0000","last_undegraded":"2023-10-09T15:32:59.360813+0000","last_fullsized":"2023-10-09T15:32:59.360813+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:06:03.182552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"62'6","reported_seq":16,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.371730+0000","last_change":"2023-10-09T15:32:58.341972+0000","last_active":"2023-10-09T15:32:59.371730+0000","last_peered":"2023-10-09T15:32:59.371730+0000","last_clean":"2023-10-09T15:32:59.371730+0000","last_became_active":"2023-10-09T15:32:58.341623+0000","last_became_peered":"2023-10-09T15:32:58.341623+0000","last_unstale":"2023-10-09T15:32:59.371730+0000","last_undegraded":"2023-10-09T15:32:59.371730+0000","last_fullsized":"2023-10-09T15:32:59.371730+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:36.526616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368559+0000","last_change":"2023-10-09T15:32:59.361507+0000","last_active":"2023-10-09T15:32:59.368559+0000","last_peered":"2023-10-09T15:32:59.368559+0000","last_clean":"2023-10-09T15:32:59.368559+0000","last_became_active":"2023-10-09T15:32:59.361238+0000","last_became_peered":"2023-10-09T15:32:59.361238+0000","last_unstale":"2023-10-09T15:32:59.368559+0000","last_undegraded":"2023-10-09T15:32:59.368559+0000","last_fullsized":"2023-10-09T15:32:59.368559+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:40:06.506862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.359744+0000","last_change":"2023-10-09T15:32:58.351616+0000","last_active":"2023-10-09T15:32:59.359744+0000","last_peered":"2023-10-09T15:32:59.359744+0000","last_clean":"2023-10-09T15:32:59.359744+0000","last_became_active":"2023-10-09T15:32:58.351327+0000","last_became_peered":"2023-10-09T15:32:58.351327+0000","last_unstale":"2023-10-09T15:32:59.359744+0000","last_undegraded":"2023-10-09T15:32:59.359744+0000","last_fullsized":"2023-10-09T15:32:59.359744+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.362461+0000","last_change":"2023-10-09T15:32:59.359069+0000","last_active":"2023-10-09T15:32:59.362461+0000","last_peered":"2023-10-09T15:32:59.362461+0000","last_clean":"2023-10-09T15:32:59.362461+0000","last_became_active":"2023-10-09T15:32:59.358785+0000","last_became_peered":"2023-10-09T15:32:59.358785+0000","last_unstale":"2023-10-09T15:32:59.362461+0000","last_undegraded":"2023-10-09T15:32:59.362461+0000","last_fullsized":"2023-10-09T15:32:59.362461+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:39.417209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.344070+0000","last_change":"2023-10-09T15:32:58.353621+0000","last_active":"2023-10-09T15:32:59.344070+0000","last_peered":"2023-10-09T15:32:59.344070+0000","last_clean":"2023-10-09T15:32:59.344070+0000","last_became_active":"2023-10-09T15:32:58.353306+0000","last_became_peered":"2023-10-09T15:32:58.353306+0000","last_unstale":"2023-10-09T15:32:59.344070+0000","last_undegraded":"2023-10-09T15:32:59.344070+0000","last_fullsized":"2023-10-09T15:32:59.344070+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:15:00.021898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.361603+0000","last_change":"2023-10-09T15:32:59.358252+0000","last_active":"2023-10-09T15:32:59.361603+0000","last_peered":"2023-10-09T15:32:59.361603+0000","last_clean":"2023-10-09T15:32:59.361603+0000","last_became_active":"2023-10-09T15:32:59.357976+0000","last_became_peered":"2023-10-09T15:32:59.357976+0000","last_unstale":"2023-10-09T15:32:59.361603+0000","last_undegraded":"2023-10-09T15:32:59.361603+0000","last_fullsized":"2023-10-09T15:32:59.361603+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:17:24.622053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.341647+0000","last_change":"2023-10-09T15:32:58.357089+0000","last_active":"2023-10-09T15:32:59.341647+0000","last_peered":"2023-10-09T15:32:59.341647+0000","last_clean":"2023-10-09T15:32:59.341647+0000","last_became_active":"2023-10-09T15:32:58.356516+0000","last_became_peered":"2023-10-09T15:32:58.356516+0000","last_unstale":"2023-10-09T15:32:59.341647+0000","last_undegraded":"2023-10-09T15:32:59.341647+0000","last_fullsized":"2023-10-09T15:32:59.341647+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:03.151988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.358463+0000","last_change":"2023-10-09T15:32:59.353935+0000","last_active":"2023-10-09T15:32:59.358463+0000","last_peered":"2023-10-09T15:32:59.358463+0000","last_clean":"2023-10-09T15:32:59.358463+0000","last_became_active":"2023-10-09T15:32:59.353171+0000","last_became_peered":"2023-10-09T15:32:59.353171+0000","last_unstale":"2023-10-09T15:32:59.358463+0000","last_undegraded":"2023-10-09T15:32:59.358463+0000","last_fullsized":"2023-10-09T15:32:59.358463+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:41:49.109177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"62'8","reported_seq":18,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369705+0000","last_change":"2023-10-09T15:32:58.353047+0000","last_active":"2023-10-09T15:32:59.369705+0000","last_peered":"2023-10-09T15:32:59.369705+0000","last_clean":"2023-10-09T15:32:59.369705+0000","last_became_active":"2023-10-09T15:32:58.352715+0000","last_became_peered":"2023-10-09T15:32:58.352715+0000","last_unstale":"2023-10-09T15:32:59.369705+0000","last_undegraded":"2023-10-09T15:32:59.369705+0000","last_fullsized":"2023-10-09T15:32:59.369705+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:12.594537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365769+0000","last_change":"2023-10-09T15:32:59.362980+0000","last_active":"2023-10-09T15:32:59.365769+0000","last_peered":"2023-10-09T15:32:59.365769+0000","last_clean":"2023-10-09T15:32:59.365769+0000","last_became_active":"2023-10-09T15:32:59.362743+0000","last_became_peered":"2023-10-09T15:32:59.362743+0000","last_unstale":"2023-10-09T15:32:59.365769+0000","last_undegraded":"2023-10-09T15:32:59.365769+0000","last_fullsized":"2023-10-09T15:32:59.365769+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:08:06.219223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.367112+0000","last_change":"2023-10-09T15:32:58.355603+0000","last_active":"2023-10-09T15:32:59.367112+0000","last_peered":"2023-10-09T15:32:59.367112+0000","last_clean":"2023-10-09T15:32:59.367112+0000","last_became_active":"2023-10-09T15:32:58.355307+0000","last_became_peered":"2023-10-09T15:32:58.355307+0000","last_unstale":"2023-10-09T15:32:59.367112+0000","last_undegraded":"2023-10-09T15:32:59.367112+0000","last_fullsized":"2023-10-09T15:32:59.367112+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:05.643231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.373342+0000","last_change":"2023-10-09T15:32:59.367998+0000","last_active":"2023-10-09T15:32:59.373342+0000","last_peered":"2023-10-09T15:32:59.373342+0000","last_clean":"2023-10-09T15:32:59.373342+0000","last_became_active":"2023-10-09T15:32:59.367268+0000","last_became_peered":"2023-10-09T15:32:59.367268+0000","last_unstale":"2023-10-09T15:32:59.373342+0000","last_undegraded":"2023-10-09T15:32:59.373342+0000","last_fullsized":"2023-10-09T15:32:59.373342+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:28.139169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368055+0000","last_change":"2023-10-09T15:32:58.353771+0000","last_active":"2023-10-09T15:32:59.368055+0000","last_peered":"2023-10-09T15:32:59.368055+0000","last_clean":"2023-10-09T15:32:59.368055+0000","last_became_active":"2023-10-09T15:32:58.353492+0000","last_became_peered":"2023-10-09T15:32:58.353492+0000","last_unstale":"2023-10-09T15:32:59.368055+0000","last_undegraded":"2023-10-09T15:32:59.368055+0000","last_fullsized":"2023-10-09T15:32:59.368055+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:14:46.048288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360825+0000","last_change":"2023-10-09T15:32:59.358502+0000","last_active":"2023-10-09T15:32:59.360825+0000","last_peered":"2023-10-09T15:32:59.360825+0000","last_clean":"2023-10-09T15:32:59.360825+0000","last_became_active":"2023-10-09T15:32:59.357936+0000","last_became_peered":"2023-10-09T15:32:59.357936+0000","last_unstale":"2023-10-09T15:32:59.360825+0000","last_undegraded":"2023-10-09T15:32:59.360825+0000","last_fullsized":"2023-10-09T15:32:59.360825+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:20.130277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"62'1","reported_seq":11,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.354455+0000","last_change":"2023-10-09T15:32:58.354130+0000","last_active":"2023-10-09T15:32:59.354455+0000","last_peered":"2023-10-09T15:32:59.354455+0000","last_clean":"2023-10-09T15:32:59.354455+0000","last_became_active":"2023-10-09T15:32:58.353855+0000","last_became_peered":"2023-10-09T15:32:58.353855+0000","last_unstale":"2023-10-09T15:32:59.354455+0000","last_undegraded":"2023-10-09T15:32:59.354455+0000","last_fullsized":"2023-10-09T15:32:59.354455+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:06:02.178148+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.365866+0000","last_change":"2023-10-09T15:32:59.363760+0000","last_active":"2023-10-09T15:32:59.365866+0000","last_peered":"2023-10-09T15:32:59.365866+0000","last_clean":"2023-10-09T15:32:59.365866+0000","last_became_active":"2023-10-09T15:32:59.363480+0000","last_became_peered":"2023-10-09T15:32:59.363480+0000","last_unstale":"2023-10-09T15:32:59.365866+0000","last_undegraded":"2023-10-09T15:32:59.365866+0000","last_fullsized":"2023-10-09T15:32:59.365866+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:02.813756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.352282+0000","last_change":"2023-10-09T15:32:58.360344+0000","last_active":"2023-10-09T15:32:59.352282+0000","last_peered":"2023-10-09T15:32:59.352282+0000","last_clean":"2023-10-09T15:32:59.352282+0000","last_became_active":"2023-10-09T15:32:58.360026+0000","last_became_peered":"2023-10-09T15:32:58.360026+0000","last_unstale":"2023-10-09T15:32:59.352282+0000","last_undegraded":"2023-10-09T15:32:59.352282+0000","last_fullsized":"2023-10-09T15:32:59.352282+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:14.475922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366541+0000","last_change":"2023-10-09T15:32:59.362331+0000","last_active":"2023-10-09T15:32:59.366541+0000","last_peered":"2023-10-09T15:32:59.366541+0000","last_clean":"2023-10-09T15:32:59.366541+0000","last_became_active":"2023-10-09T15:32:59.362010+0000","last_became_peered":"2023-10-09T15:32:59.362010+0000","last_unstale":"2023-10-09T15:32:59.366541+0000","last_undegraded":"2023-10-09T15:32:59.366541+0000","last_fullsized":"2023-10-09T15:32:59.366541+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.580695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.344182+0000","last_change":"2023-10-09T15:32:58.359457+0000","last_active":"2023-10-09T15:32:59.344182+0000","last_peered":"2023-10-09T15:32:59.344182+0000","last_clean":"2023-10-09T15:32:59.344182+0000","last_became_active":"2023-10-09T15:32:58.359141+0000","last_became_peered":"2023-10-09T15:32:58.359141+0000","last_unstale":"2023-10-09T15:32:59.344182+0000","last_undegraded":"2023-10-09T15:32:59.344182+0000","last_fullsized":"2023-10-09T15:32:59.344182+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:37:28.391873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.362095+0000","last_change":"2023-10-09T15:32:59.357644+0000","last_active":"2023-10-09T15:32:59.362095+0000","last_peered":"2023-10-09T15:32:59.362095+0000","last_clean":"2023-10-09T15:32:59.362095+0000","last_became_active":"2023-10-09T15:32:59.357306+0000","last_became_peered":"2023-10-09T15:32:59.357306+0000","last_unstale":"2023-10-09T15:32:59.362095+0000","last_undegraded":"2023-10-09T15:32:59.362095+0000","last_fullsized":"2023-10-09T15:32:59.362095+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:45.033366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.341783+0000","last_change":"2023-10-09T15:32:58.350546+0000","last_active":"2023-10-09T15:32:59.341783+0000","last_peered":"2023-10-09T15:32:59.341783+0000","last_clean":"2023-10-09T15:32:59.341783+0000","last_became_active":"2023-10-09T15:32:58.350028+0000","last_became_peered":"2023-10-09T15:32:58.350028+0000","last_unstale":"2023-10-09T15:32:59.341783+0000","last_undegraded":"2023-10-09T15:32:59.341783+0000","last_fullsized":"2023-10-09T15:32:59.341783+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:31.603923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.362245+0000","last_change":"2023-10-09T15:32:59.355231+0000","last_active":"2023-10-09T15:32:59.362245+0000","last_peered":"2023-10-09T15:32:59.362245+0000","last_clean":"2023-10-09T15:32:59.362245+0000","last_became_active":"2023-10-09T15:32:59.354982+0000","last_became_peered":"2023-10-09T15:32:59.354982+0000","last_unstale":"2023-10-09T15:32:59.362245+0000","last_undegraded":"2023-10-09T15:32:59.362245+0000","last_fullsized":"2023-10-09T15:32:59.362245+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:28.386944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.343330+0000","last_change":"2023-10-09T15:32:58.351239+0000","last_active":"2023-10-09T15:32:59.343330+0000","last_peered":"2023-10-09T15:32:59.343330+0000","last_clean":"2023-10-09T15:32:59.343330+0000","last_became_active":"2023-10-09T15:32:58.350997+0000","last_became_peered":"2023-10-09T15:32:58.350997+0000","last_unstale":"2023-10-09T15:32:59.343330+0000","last_undegraded":"2023-10-09T15:32:59.343330+0000","last_fullsized":"2023-10-09T15:32:59.343330+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:31.603923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.359656+0000","last_change":"2023-10-09T15:32:59.352156+0000","last_active":"2023-10-09T15:32:59.359656+0000","last_peered":"2023-10-09T15:32:59.359656+0000","last_clean":"2023-10-09T15:32:59.359656+0000","last_became_active":"2023-10-09T15:32:59.351866+0000","last_became_peered":"2023-10-09T15:32:59.351866+0000","last_unstale":"2023-10-09T15:32:59.359656+0000","last_undegraded":"2023-10-09T15:32:59.359656+0000","last_fullsized":"2023-10-09T15:32:59.359656+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:29.151376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.362246+0000","last_change":"2023-10-09T15:32:58.352549+0000","last_active":"2023-10-09T15:32:59.362246+0000","last_peered":"2023-10-09T15:32:59.362246+0000","last_clean":"2023-10-09T15:32:59.362246+0000","last_became_active":"2023-10-09T15:32:58.352166+0000","last_became_peered":"2023-10-09T15:32:58.352166+0000","last_unstale":"2023-10-09T15:32:59.362246+0000","last_undegraded":"2023-10-09T15:32:59.362246+0000","last_fullsized":"2023-10-09T15:32:59.362246+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:43.613154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.359098+0000","last_change":"2023-10-09T15:32:59.354118+0000","last_active":"2023-10-09T15:32:59.359098+0000","last_peered":"2023-10-09T15:32:59.359098+0000","last_clean":"2023-10-09T15:32:59.359098+0000","last_became_active":"2023-10-09T15:32:59.353844+0000","last_became_peered":"2023-10-09T15:32:59.353844+0000","last_unstale":"2023-10-09T15:32:59.359098+0000","last_undegraded":"2023-10-09T15:32:59.359098+0000","last_fullsized":"2023-10-09T15:32:59.359098+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:00.216921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.341635+0000","last_change":"2023-10-09T15:32:58.357312+0000","last_active":"2023-10-09T15:32:59.341635+0000","last_peered":"2023-10-09T15:32:59.341635+0000","last_clean":"2023-10-09T15:32:59.341635+0000","last_became_active":"2023-10-09T15:32:58.356724+0000","last_became_peered":"2023-10-09T15:32:58.356724+0000","last_unstale":"2023-10-09T15:32:59.341635+0000","last_undegraded":"2023-10-09T15:32:59.341635+0000","last_fullsized":"2023-10-09T15:32:59.341635+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:08:05.214819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.373450+0000","last_change":"2023-10-09T15:32:59.370191+0000","last_active":"2023-10-09T15:32:59.373450+0000","last_peered":"2023-10-09T15:32:59.373450+0000","last_clean":"2023-10-09T15:32:59.373450+0000","last_became_active":"2023-10-09T15:32:59.369937+0000","last_became_peered":"2023-10-09T15:32:59.369937+0000","last_unstale":"2023-10-09T15:32:59.373450+0000","last_undegraded":"2023-10-09T15:32:59.373450+0000","last_fullsized":"2023-10-09T15:32:59.373450+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:09.769595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.340360+0000","last_change":"2023-10-09T15:32:58.352362+0000","last_active":"2023-10-09T15:32:59.340360+0000","last_peered":"2023-10-09T15:32:59.340360+0000","last_clean":"2023-10-09T15:32:59.340360+0000","last_became_active":"2023-10-09T15:32:58.352088+0000","last_became_peered":"2023-10-09T15:32:58.352088+0000","last_unstale":"2023-10-09T15:32:59.340360+0000","last_undegraded":"2023-10-09T15:32:59.340360+0000","last_fullsized":"2023-10-09T15:32:59.340360+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:49.123845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368929+0000","last_change":"2023-10-09T15:32:59.359885+0000","last_active":"2023-10-09T15:32:59.368929+0000","last_peered":"2023-10-09T15:32:59.368929+0000","last_clean":"2023-10-09T15:32:59.368929+0000","last_became_active":"2023-10-09T15:32:59.359597+0000","last_became_peered":"2023-10-09T15:32:59.359597+0000","last_unstale":"2023-10-09T15:32:59.368929+0000","last_undegraded":"2023-10-09T15:32:59.368929+0000","last_fullsized":"2023-10-09T15:32:59.368929+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:54.722360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.342881+0000","last_change":"2023-10-09T15:32:58.353878+0000","last_active":"2023-10-09T15:32:59.342881+0000","last_peered":"2023-10-09T15:32:59.342881+0000","last_clean":"2023-10-09T15:32:59.342881+0000","last_became_active":"2023-10-09T15:32:58.353568+0000","last_became_peered":"2023-10-09T15:32:58.353568+0000","last_unstale":"2023-10-09T15:32:59.342881+0000","last_undegraded":"2023-10-09T15:32:59.342881+0000","last_fullsized":"2023-10-09T15:32:59.342881+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:46.239183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.366505+0000","last_change":"2023-10-09T15:32:59.365565+0000","last_active":"2023-10-09T15:32:59.366505+0000","last_peered":"2023-10-09T15:32:59.366505+0000","last_clean":"2023-10-09T15:32:59.366505+0000","last_became_active":"2023-10-09T15:32:59.365135+0000","last_became_peered":"2023-10-09T15:32:59.365135+0000","last_unstale":"2023-10-09T15:32:59.366505+0000","last_undegraded":"2023-10-09T15:32:59.366505+0000","last_fullsized":"2023-10-09T15:32:59.366505+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:08:12.263923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.340627+0000","last_change":"2023-10-09T15:32:58.357854+0000","last_active":"2023-10-09T15:32:59.340627+0000","last_peered":"2023-10-09T15:32:59.340627+0000","last_clean":"2023-10-09T15:32:59.340627+0000","last_became_active":"2023-10-09T15:32:58.357590+0000","last_became_peered":"2023-10-09T15:32:58.357590+0000","last_unstale":"2023-10-09T15:32:59.340627+0000","last_undegraded":"2023-10-09T15:32:59.340627+0000","last_fullsized":"2023-10-09T15:32:59.340627+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:33:34.784524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.368892+0000","last_change":"2023-10-09T15:32:59.359009+0000","last_active":"2023-10-09T15:32:59.368892+0000","last_peered":"2023-10-09T15:32:59.368892+0000","last_clean":"2023-10-09T15:32:59.368892+0000","last_became_active":"2023-10-09T15:32:59.357919+0000","last_became_peered":"2023-10-09T15:32:59.357919+0000","last_unstale":"2023-10-09T15:32:59.368892+0000","last_undegraded":"2023-10-09T15:32:59.368892+0000","last_fullsized":"2023-10-09T15:32:59.368892+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:42:02.300676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.349506+0000","last_change":"2023-10-09T15:32:58.343890+0000","last_active":"2023-10-09T15:32:59.349506+0000","last_peered":"2023-10-09T15:32:59.349506+0000","last_clean":"2023-10-09T15:32:59.349506+0000","last_became_active":"2023-10-09T15:32:58.343570+0000","last_became_peered":"2023-10-09T15:32:58.343570+0000","last_unstale":"2023-10-09T15:32:59.349506+0000","last_undegraded":"2023-10-09T15:32:59.349506+0000","last_fullsized":"2023-10-09T15:32:59.349506+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:37:06.302058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.367073+0000","last_change":"2023-10-09T15:32:59.364665+0000","last_active":"2023-10-09T15:32:59.367073+0000","last_peered":"2023-10-09T15:32:59.367073+0000","last_clean":"2023-10-09T15:32:59.367073+0000","last_became_active":"2023-10-09T15:32:59.364308+0000","last_became_peered":"2023-10-09T15:32:59.364308+0000","last_unstale":"2023-10-09T15:32:59.367073+0000","last_undegraded":"2023-10-09T15:32:59.367073+0000","last_fullsized":"2023-10-09T15:32:59.367073+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:25:20.374995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.349969+0000","last_change":"2023-10-09T15:32:58.353780+0000","last_active":"2023-10-09T15:32:59.349969+0000","last_peered":"2023-10-09T15:32:59.349969+0000","last_clean":"2023-10-09T15:32:59.349969+0000","last_became_active":"2023-10-09T15:32:58.353349+0000","last_became_peered":"2023-10-09T15:32:58.353349+0000","last_unstale":"2023-10-09T15:32:59.349969+0000","last_undegraded":"2023-10-09T15:32:59.349969+0000","last_fullsized":"2023-10-09T15:32:59.349969+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:38.007149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.369428+0000","last_change":"2023-10-09T15:32:59.364239+0000","last_active":"2023-10-09T15:32:59.369428+0000","last_peered":"2023-10-09T15:32:59.369428+0000","last_clean":"2023-10-09T15:32:59.369428+0000","last_became_active":"2023-10-09T15:32:59.363948+0000","last_became_peered":"2023-10-09T15:32:59.363948+0000","last_unstale":"2023-10-09T15:32:59.369428+0000","last_undegraded":"2023-10-09T15:32:59.369428+0000","last_fullsized":"2023-10-09T15:32:59.369428+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:18.675156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":10,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.343059+0000","last_change":"2023-10-09T15:32:58.355291+0000","last_active":"2023-10-09T15:32:59.343059+0000","last_peered":"2023-10-09T15:32:59.343059+0000","last_clean":"2023-10-09T15:32:59.343059+0000","last_became_active":"2023-10-09T15:32:58.354985+0000","last_became_peered":"2023-10-09T15:32:58.354985+0000","last_unstale":"2023-10-09T15:32:59.343059+0000","last_undegraded":"2023-10-09T15:32:59.343059+0000","last_fullsized":"2023-10-09T15:32:59.343059+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:00:18.429880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":9,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.362340+0000","last_change":"2023-10-09T15:32:59.356034+0000","last_active":"2023-10-09T15:32:59.362340+0000","last_peered":"2023-10-09T15:32:59.362340+0000","last_clean":"2023-10-09T15:32:59.362340+0000","last_became_active":"2023-10-09T15:32:59.355726+0000","last_became_peered":"2023-10-09T15:32:59.355726+0000","last_unstale":"2023-10-09T15:32:59.362340+0000","last_undegraded":"2023-10-09T15:32:59.362340+0000","last_fullsized":"2023-10-09T15:32:59.362340+0000","mapping_epoch":61,"log_start":"0'0","ondisk_log_start":"0'0","created":61,"last_epoch_clean":62,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:58.330732+0000","last_clean_scrub_stamp":"2023-10-09T15:32:58.330732+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:03.266932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"62'2","reported_seq":12,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.360626+0000","last_change":"2023-10-09T15:32:58.354952+0000","last_active":"2023-10-09T15:32:59.360626+0000","last_peered":"2023-10-09T15:32:59.360626+0000","last_clean":"2023-10-09T15:32:59.360626+0000","last_became_active":"2023-10-09T15:32:58.354649+0000","last_became_peered":"2023-10-09T15:32:58.354649+0000","last_unstale":"2023-10-09T15:32:59.360626+0000","last_undegraded":"2023-10-09T15:32:59.360626+0000","last_fullsized":"2023-10-09T15:32:59.360626+0000","mapping_epoch":60,"log_start":"0'0","ondisk_log_start":"0'0","created":60,"last_epoch_clean":61,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:32:57.326328+0000","last_clean_scrub_stamp":"2023-10-09T15:32:57.326328+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:25:34.843874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":200,"reported_epoch":62,"state":"active+clean","last_fresh":"2023-10-09T15:32:59.349369+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:32:59.349369+0000","last_peered":"2023-10-09T15:32:59.349369+0000","last_clean":"2023-10-09T15:32:59.349369+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:32:59.349369+0000","last_undegraded":"2023-10-09T15:32:59.349369+0000","last_fullsized":"2023-10-09T15:32:59.349369+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574878,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298624,"kb_used_data":1336,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073216,"statfs":{"total":96636764160,"available":96330973184,"internally_reserved":0,"allocated":1368064,"data_stored":916671,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.50700000000000001,"15min":0.499},"min":{"1min":0.35299999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.70899999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53500000000000003,"15min":0.52900000000000003},"min":{"1min":0.39300000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.749,"5min":0.754,"15min":0.754},"last":0.53700000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.51500000000000001,"15min":0.50900000000000001},"min":{"1min":0.36799999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57999999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.53200000000000003,"15min":0.52400000000000002},"min":{"1min":0.36399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55000000000000004,"15min":0.54500000000000004},"min":{"1min":0.44600000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.72099999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.56100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.46800000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"last":0.51700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.53800000000000003,"15min":0.52400000000000002},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.89000000000000001,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.55000000000000004,"15min":0.53600000000000003},"min":{"1min":0.38300000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88,"5min":0.88,"15min":0.88},"last":0.504}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.59599999999999997,"15min":0.58699999999999997},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.59099999999999997,"15min":0.57699999999999996},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.92200000000000004,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.374}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.65400000000000003,"15min":0.64200000000000002},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.73499999999999999,"5min":0.65400000000000003,"15min":0.64000000000000001},"min":{"1min":0.54600000000000004,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.93000000000000005,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.55200000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574878,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":325807,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.498,"15min":0.48599999999999999},"min":{"1min":0.35799999999999998,"5min":0.252,"15min":0.252},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.90400000000000003,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.52700000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.56799999999999995,"15min":0.57299999999999995},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.81899999999999995,"5min":1.379,"15min":1.379},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54700000000000004,"15min":0.54100000000000004},"min":{"1min":0.41399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.72199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60899999999999999,"15min":0.61399999999999999},"min":{"1min":0.36899999999999999,"5min":0.308,"15min":0.308},"max":{"1min":0.88600000000000001,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.83299999999999996,"15min":0.875},"min":{"1min":0.36599999999999999,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.87,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.625,"15min":0.63100000000000001},"min":{"1min":0.38,"5min":0.38,"15min":0.38},"max":{"1min":0.85199999999999998,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.65600000000000003,"15min":0.65800000000000003},"min":{"1min":0.40200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.92300000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.58799999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40000000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.93600000000000005,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.57399999999999995,"15min":0.56399999999999995},"min":{"1min":0.40500000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.85499999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.60199999999999998,"15min":0.59799999999999998},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.83399999999999996},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.64300000000000002,"15min":0.64100000000000001},"min":{"1min":0.49199999999999999,"5min":0.47799999999999998,"15min":0.47799999999999998},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.749}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.67700000000000005,"5min":0.66000000000000003,"15min":0.65700000000000003},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.004,"5min":1.004,"15min":1.004},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.67800000000000005,"15min":0.67100000000000004},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.86699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574879,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298056,"kb_used_data":768,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073784,"statfs":{"total":96636764160,"available":96331554816,"internally_reserved":0,"allocated":786432,"data_stored":327839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.35299999999999998,"15min":0.35899999999999999},"min":{"1min":0.223,"5min":0.215,"15min":0.215},"max":{"1min":0.52000000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.39200000000000002,"15min":0.40000000000000002},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.54800000000000004,"5min":1.512,"15min":1.512},"last":0.34599999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.38,"15min":0.38600000000000001},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.56399999999999995,"5min":1.286,"15min":1.286},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.41699999999999998,"15min":0.42099999999999999},"min":{"1min":0.30199999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.59699999999999998,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.27100000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.44900000000000001,"15min":0.45400000000000001},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.63400000000000001,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.311},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.45900000000000002,"15min":0.46300000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.60999999999999999,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60699999999999998,"15min":0.61699999999999999},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.752,"5min":1.222,"15min":1.222},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.628,"15min":0.64000000000000001},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.83499999999999996,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.40100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.628,"15min":0.63700000000000001},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.752,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.621},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.61699999999999999,"15min":0.629},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80500000000000005,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.42699999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.82499999999999996,"15min":0.85999999999999999},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.84199999999999997,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.67600000000000005,"15min":0.68500000000000005},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.877,"5min":1.258,"15min":1.258},"last":0.48499999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:32:53 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.66800000000000004,"15min":0.67400000000000004},"min":{"1min":0.48499999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.94999999999999996,"5min":0.997,"15min":0.997},"last":0.441},{"interface":"front","average":{"1min":0.627,"5min":0.83399999999999996,"15min":0.86799999999999999},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.86599999999999999,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.63900000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574877,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298612,"kb_used_data":1324,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073228,"statfs":{"total":96636764160,"available":96330985472,"internally_reserved":0,"allocated":1355776,"data_stored":915072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.53100000000000003,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.34300000000000003},{"interface":"front","average":{"1min":0.39500000000000002,"5min":0.42399999999999999,"15min":0.42899999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.60099999999999998,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.371}]},{"osd":2,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.39900000000000002,"15min":0.40200000000000002},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.64200000000000002,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.36499999999999999,"5min":0.55000000000000004,"15min":0.58099999999999996},"min":{"1min":0.25800000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.57299999999999995,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.32500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.55800000000000005,"15min":0.59299999999999997},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.55400000000000005,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.44800000000000001,"5min":0.64600000000000002,"15min":0.67900000000000005},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.41499999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.64300000000000002,"15min":0.65700000000000003},"min":{"1min":0.432,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.89000000000000001,"5min":1.196,"15min":1.196},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79000000000000004,"5min":1.508,"15min":1.508},"last":0.49199999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.63,"15min":0.64100000000000001},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76300000000000001,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.64000000000000001,"15min":0.64500000000000002},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.878,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.53000000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":0.84999999999999998,"5min":0.95899999999999996,"15min":0.95899999999999996},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.68799999999999994,"15min":0.69999999999999996},"min":{"1min":0.46500000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.76200000000000001,"5min":1.238,"15min":1.238},"last":0.627}]},{"osd":7,"last update":"Mon Oct 9 15:32:57 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.71499999999999997,"15min":0.72699999999999998},"min":{"1min":0.505,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":0.83699999999999997,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.67100000000000004,"15min":0.68100000000000005},"min":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.83999999999999997,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574878,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298048,"kb_used_data":760,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073792,"statfs":{"total":96636764160,"available":96331563008,"internally_reserved":0,"allocated":778240,"data_stored":327251,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"min":{"1min":0.20000000000000001,"5min":0.187,"15min":0.187},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.373},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.51500000000000001,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.45400000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36199999999999999},"min":{"1min":0.25600000000000001,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.64900000000000002,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.55200000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.35899999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54800000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.436,"15min":0.436},"min":{"1min":0.315,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.66200000000000003,"15min":0.67000000000000004},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.876,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.61499999999999999},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.85399999999999998,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.59199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.60799999999999998,"15min":0.61399999999999999},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.745,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.437},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.69399999999999995,"15min":0.71199999999999997},"min":{"1min":0.433,"5min":0.433,"15min":0.433},"max":{"1min":0.83899999999999997,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.68799999999999994,"15min":0.69899999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.96099999999999997,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.621,"5min":0.65800000000000003,"15min":0.66400000000000003},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":0.92200000000000004,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.57999999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:32:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.68600000000000005,"15min":0.69699999999999995},"min":{"1min":0.48099999999999998,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":0.90800000000000003,"5min":1.407,"15min":1.407},"last":0.624},{"interface":"front","average":{"1min":0.627,"5min":0.66100000000000003,"15min":0.66700000000000004},"min":{"1min":0.51400000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":0.80900000000000005,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53400000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574876,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298044,"kb_used_data":756,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073796,"statfs":{"total":96636764160,"available":96331567104,"internally_reserved":0,"allocated":774144,"data_stored":325827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33700000000000002,"5min":0.374,"15min":0.38},"min":{"1min":0.246,"5min":0.21099999999999999,"15min":0.21099999999999999},"max":{"1min":0.57499999999999996,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.96699999999999997,"15min":1.071},"min":{"1min":0.255,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.52600000000000002,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.376}]},{"osd":1,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.71799999999999997,"15min":0.77800000000000002},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.48699999999999999,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.377,"5min":0.42899999999999999,"15min":0.437},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63300000000000001,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.35699999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":1.5349999999999999,"15min":1.7250000000000001},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.68100000000000005,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.79500000000000004,"15min":0.85899999999999999},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.59599999999999997,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.40300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":1.173,"15min":1.272},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.93600000000000005,"5min":17.02,"15min":17.02},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.998,"15min":1.0209999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":5.3630000000000004,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.86799999999999999,"5min":0.67000000000000004,"15min":0.63700000000000001},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":5.3460000000000001,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.204,"15min":1.306},"min":{"1min":0.42199999999999999,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.879,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.48199999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.97099999999999997,"15min":1.0289999999999999},"min":{"1min":0.44600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.96799999999999997,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.68300000000000005,"15min":0.68400000000000005},"min":{"1min":0.498,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":0.86499999999999999,"5min":1.278,"15min":1.278},"last":0.50800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:32:59 2023","interfaces":[{"interface":"back","average":{"1min":0.65700000000000003,"5min":1.2529999999999999,"15min":1.353},"min":{"1min":0.46700000000000003,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.98999999999999999,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.98499999999999999,"15min":1.038},"min":{"1min":0.48999999999999999,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.91400000000000003,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.58999999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574877,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298040,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073800,"statfs":{"total":96636764160,"available":96331571200,"internally_reserved":0,"allocated":770048,"data_stored":325785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.40300000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.76900000000000002,"5min":0.83699999999999997,"15min":0.83699999999999997},"last":0.34899999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.67600000000000005,"15min":0.68200000000000005},"min":{"1min":0.42699999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.91900000000000004,"5min":2.879,"15min":2.879},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56999999999999995,"15min":0.56599999999999995},"min":{"1min":0.45700000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.36199999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.57299999999999995,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.48199999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54000000000000004,"15min":0.53900000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.75,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.60299999999999998,"15min":0.60599999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83499999999999996,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.505}]},{"osd":5,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.32000000000000001,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.79600000000000004,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.44},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.624,"15min":0.63200000000000001},"min":{"1min":0.374,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.82499999999999996,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.627}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.57699999999999996,"15min":0.57799999999999996},"min":{"1min":0.32200000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.873,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.68000000000000005,"15min":0.68600000000000005},"min":{"1min":0.48599999999999999,"5min":0.433,"15min":0.433},"max":{"1min":0.84899999999999998,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.52000000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.626,"15min":0.63400000000000001},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.86599999999999999,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.66300000000000003,"15min":0.67000000000000004},"min":{"1min":0.47199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.879,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.55300000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574878,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298040,"kb_used_data":752,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073800,"statfs":{"total":96636764160,"available":96331571200,"internally_reserved":0,"allocated":770048,"data_stored":325805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81399999999999995,"5min":0.87,"15min":0.87},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.54200000000000004,"15min":0.53500000000000003},"min":{"1min":0.39100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.165,"5min":1.165,"15min":1.165},"last":0.61699999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.55300000000000005,"15min":0.53700000000000003},"min":{"1min":0.41199999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":2.089,"5min":2.089,"15min":2.089},"last":0.629},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.76600000000000001,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.95399999999999996,"15min":1.0149999999999999},"min":{"1min":0.42899999999999999,"5min":0.376,"15min":0.376},"max":{"1min":0.95599999999999996,"5min":11.055,"15min":11.055},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.99199999999999999,"15min":1.044},"min":{"1min":0.41899999999999998,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":2.1640000000000001,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.55900000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65600000000000003,"5min":0.98699999999999999,"15min":1.042},"min":{"1min":0.44,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":1.1000000000000001,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.622,"15min":0.60699999999999998},"min":{"1min":0.49299999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":2.2000000000000002,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.60099999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56100000000000005,"15min":0.54900000000000004},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.59299999999999997,"15min":0.59099999999999997},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.0569999999999999,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.41099999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.36799999999999999,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":2.2349999999999999,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.624,"5min":0.61299999999999999,"15min":0.61099999999999999},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.86299999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.432}]},{"osd":7,"last update":"Mon Oct 9 15:32:54 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.627,"15min":0.623},"min":{"1min":0.36899999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":1.016,"5min":1.016,"15min":1.016},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.67800000000000005,"15min":0.66400000000000003},"min":{"1min":0.45800000000000002,"5min":0.45800000000000002,"15min":0.45800000000000002},"max":{"1min":2.9359999999999999,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.65300000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:33:08.394 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:33:08.395 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:33:08.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.555+0000 7fd8fe10f700 1 Processor -- start 2023-10-09T15:33:08.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.555+0000 7fd8fe10f700 1 -- start start 2023-10-09T15:33:08.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8fe10f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f8159530 0x7fd8f80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8fe10f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 0x7fd8f8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8fe10f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f80ccfd0 con 0x7fd8f806e0e0 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8fe10f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f80cf0e0 con 0x7fd8f8159530 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8fe10f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f815a3d0 con 0x7fd8f806dc70 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f8159530 0x7fd8f80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 0x7fd8f8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f8159530 0x7fd8f80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:51380/0 (socket says 172.21.15.33:51380) 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 -- 172.21.15.33:0/2441986124 learned_addr learned my addr 172.21.15.33:0/2441986124 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 0x7fd8f8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:39698/0 (socket says 172.21.15.33:39698) 2023-10-09T15:33:08.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f7fff700 1 --1- 172.21.15.33:0/2441986124 >> v1:172.21.15.59:6789/0 conn(0x7fd8f806e0e0 0x7fd8f80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:57398/0 (socket says 172.21.15.33:57398) 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 -- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 msgr2=0x7fd8f8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 0x7fd8f8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 -- 172.21.15.33:0/2441986124 >> v1:172.21.15.59:6789/0 conn(0x7fd8f806e0e0 legacy=0x7fd8f80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.556+0000 7fd8f77fe700 1 -- 172.21.15.33:0/2441986124 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f815a6b0 con 0x7fd8f8159530 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f8159530 0x7fd8f80ceba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009f20 tx=0x7fd8e8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f3459fbbf2e12c04 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8f67fc700 1 -- 172.21.15.33:0/2441986124 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800e070 con 0x7fd8f8159530 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8f67fc700 1 -- 172.21.15.33:0/2441986124 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800b9d0 con 0x7fd8f8159530 2023-10-09T15:33:08.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8f67fc700 1 -- 172.21.15.33:0/2441986124 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80092e0 con 0x7fd8f8159530 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 -- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f8159530 msgr2=0x7fd8f80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f8159530 0x7fd8f80ceba0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009f20 tx=0x7fd8e8009840 comp rx=0 tx=0).stop 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 -- 172.21.15.33:0/2441986124 shutdown_connections 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f8159530 0x7fd8f80ceba0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/2441986124 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806dc70 0x7fd8f8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 -- 172.21.15.33:0/2441986124 >> 172.21.15.33:0/2441986124 conn(0x7fd8f80703a0 msgr2=0x7fd8f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 -- 172.21.15.33:0/2441986124 shutdown_connections 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.557+0000 7fd8fe10f700 1 -- 172.21.15.33:0/2441986124 wait complete. 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 Processor -- start 2023-10-09T15:33:08.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 -- start start 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 0x7fd8f80c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806e0e0 0x7fd8f81475e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c9390 con 0x7fd8f8159530 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c8780 con 0x7fd8f806dc70 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8fe10f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c8a60 con 0x7fd8f806e0e0 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.559+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43272/0 (socket says 172.21.15.33:43272) 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 -- 172.21.15.33:0/1619212112 learned_addr learned my addr 172.21.15.33:0/1619212112 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f6ffd700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806e0e0 0x7fd8f81475e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 0x7fd8f80c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 -- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806e0e0 msgr2=0x7fd8f81475e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806e0e0 0x7fd8f81475e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 -- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 msgr2=0x7fd8f80c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 0x7fd8f80c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 -- 172.21.15.33:0/1619212112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e8009ae0 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 0x7fd8f80c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c590 tx=0x7fd8f0007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0005a70 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0005bf0 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f80c8d40 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f00070d0 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.560+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f80b5750 con 0x7fd8f8159530 2023-10-09T15:33:08.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.561+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f80c9540 con 0x7fd8f8159530 2023-10-09T15:33:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.562+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fd8f00074c0 con 0x7fd8f8159530 2023-10-09T15:33:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.562+0000 7fd8ef7fe700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 0x7fd8d8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.562+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8f0083850 con 0x7fd8f8159530 2023-10-09T15:33:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.562+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 0x7fd8d8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.563+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 0x7fd8d8069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009880 tx=0x7fd8e8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.566+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f80c9540 con 0x7fd8f8159530 2023-10-09T15:33:08.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.845+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fd8f804c3c0 con 0x7fd8f8159530 2023-10-09T15:33:08.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.850+0000 7fd8ef7fe700 1 -- 172.21.15.33:0/1619212112 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7fd8f00170e0 con 0x7fd8f8159530 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 msgr2=0x7fd8d8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 0x7fd8d8069470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009880 tx=0x7fd8e8018000 comp rx=0 tx=0).stop 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 msgr2=0x7fd8f80b5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c590 tx=0x7fd8f0007ec0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 shutdown_connections 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8066fc0 0x7fd8d8069470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f8159530 0x7fd8f80b5210 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f806dc70 0x7fd8f80c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 --2- 172.21.15.33:0/1619212112 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f806e0e0 0x7fd8f81475e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 >> 172.21.15.33:0/1619212112 conn(0x7fd8f80703a0 msgr2=0x7fd8f8153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 shutdown_connections 2023-10-09T15:33:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.853+0000 7fd8fe10f700 1 -- 172.21.15.33:0/1619212112 wait complete. 2023-10-09T15:33:08.854 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:33:08.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:33:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 Processor -- start 2023-10-09T15:33:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 -- start start 2023-10-09T15:33:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f868c0cb5a0 0x7f868c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0cd9e0 0x7f868c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f868c15ae40 con 0x7f868c0cde50 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f868c0d13f0 con 0x7f868c0cb5a0 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.985+0000 7f86920a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c15ab60 con 0x7f868c0cd9e0 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f868c0cde50 0x7f868c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60452/0 (socket says 172.21.15.33:60452) 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868bfff700 1 -- 172.21.15.33:0/3975242272 learned_addr learned my addr 172.21.15.33:0/3975242272 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 --2- 172.21.15.33:0/3975242272 >> v2:172.21.15.59:3300/0 conn(0x7f868c0cb5a0 0x7f868c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868affd700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0cd9e0 0x7f868c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3691390646 0 0) 0x7f868c15ae40 con 0x7f868c0cde50 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8674003570 con 0x7f868c0cde50 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3851308155 0 0) 0x7f8674003570 con 0x7f868c0cde50 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 -- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0cd9e0 msgr2=0x7f868c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0cd9e0 0x7f868c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 -- 172.21.15.33:0/3975242272 >> v1:172.21.15.33:6789/0 conn(0x7f868c0cde50 legacy=0x7f868c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 -- 172.21.15.33:0/3975242272 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f868c0ccf00 con 0x7f868c0cb5a0 2023-10-09T15:33:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868b7fe700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c0cb970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098e0 tx=0x7f867c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31b736972016ff8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.986+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86840017f0 con 0x7f868c0cb5a0 2023-10-09T15:33:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867c011420 con 0x7f868c0cb5a0 2023-10-09T15:33:08.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f868a7fc700 1 -- 172.21.15.33:0/3975242272 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867c0117c0 con 0x7f868c0cb5a0 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 -- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 msgr2=0x7f868c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c0cb970 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f867c0098e0 tx=0x7f867c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 -- 172.21.15.33:0/3975242272 shutdown_connections 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c0cb970 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 --2- 172.21.15.33:0/3975242272 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c0cd9e0 0x7f868c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 -- 172.21.15.33:0/3975242272 >> 172.21.15.33:0/3975242272 conn(0x7f868c070e30 msgr2=0x7f868c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:08.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 -- 172.21.15.33:0/3975242272 shutdown_connections 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.987+0000 7f86920a5700 1 -- 172.21.15.33:0/3975242272 wait complete. 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.988+0000 7f86920a5700 1 Processor -- start 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.988+0000 7f86920a5700 1 -- start start 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c16a250 0x7f868c15c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c15b930 con 0x7f868c0cd9e0 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868c169560 con 0x7f868c0cb5a0 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f86920a5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f868c169dc0 con 0x7f868c16a250 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43286/0 (socket says 172.21.15.33:43286) 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 -- 172.21.15.33:0/486759968 learned_addr learned my addr 172.21.15.33:0/486759968 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868b7fe700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868bfff700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c16a250 0x7f868c15c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 -- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c16a250 msgr2=0x7f868c15c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c16a250 0x7f868c15c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 -- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 msgr2=0x7f868c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868affd700 1 -- 172.21.15.33:0/486759968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c009420 con 0x7f868c0cd9e0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.989+0000 7f868b7fe700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f868affd700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f868000ec80 tx=0x7f86800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f868000c9d0 con 0x7f868c0cd9e0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f868000cb30 con 0x7f868c0cd9e0 2023-10-09T15:33:08.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f868c0afc50 con 0x7f868c0cd9e0 2023-10-09T15:33:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680013470 con 0x7f868c0cd9e0 2023-10-09T15:33:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.990+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f868c169770 con 0x7f868c0cd9e0 2023-10-09T15:33:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.991+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868c04c3c0 con 0x7f868c0cd9e0 2023-10-09T15:33:08.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.991+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8680013820 con 0x7f868c0cd9e0 2023-10-09T15:33:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.992+0000 7f86737fe700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 0x7f8678069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.992+0000 7f868b7fe700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 0x7f8678069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.992+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f86800849d0 con 0x7f868c0cd9e0 2023-10-09T15:33:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.992+0000 7f868b7fe700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 0x7f8678069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f868c0cad70 tx=0x7f867c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:08.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:08.996+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8680051c50 con 0x7f868c0cd9e0 2023-10-09T15:33:09.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.235+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f868c169f00 con 0x7f868c0cd9e0 2023-10-09T15:33:09.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.236+0000 7f86737fe700 1 -- 172.21.15.33:0/486759968 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f8680017090 con 0x7f868c0cd9e0 2023-10-09T15:33:09.236 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:33:09.236 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":40,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:33:09.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 msgr2=0x7f8678069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 0x7f8678069470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f868c0cad70 tx=0x7f867c016000 comp rx=0 tx=0).stop 2023-10-09T15:33:09.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 msgr2=0x7f868c0af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f868000ec80 tx=0x7f86800091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 shutdown_connections 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8678066fc0 0x7f8678069470 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f868c16a250 0x7f868c15c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f868c0cb5a0 0x7f868c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 --2- 172.21.15.33:0/486759968 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f868c0cd9e0 0x7f868c0af710 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 >> 172.21.15.33:0/486759968 conn(0x7f868c070e30 msgr2=0x7f868c0c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 shutdown_connections 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.238+0000 7f86920a5700 1 -- 172.21.15.33:0/486759968 wait complete. 2023-10-09T15:33:09.239 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 40 2023-10-09T15:33:09.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 40, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:32:58.740361+0000', 'modified': '2023-10-09T15:33:02.363339+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5718}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5718': {'gid': 5718, 'name': 'a', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6837/2608740394', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6836', 'nonce': 2608740394}, {'type': 'v1', 'addr': '172.21.15.33:6837', 'nonce': 2608740394}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:33:09.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:33:09.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T15:33:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.776+0000 7fdaee3b4700 1 Processor -- start 2023-10-09T15:33:09.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.776+0000 7fdaee3b4700 1 -- start start 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdaee3b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdae81597e0 0x7fdae80ad010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdaee3b4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdae80ad550 0x7fdae815bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdaee3b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae815cbc0 con 0x7fdae815c4a0 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdaee3b4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae815b440 con 0x7fdae80ad550 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdaee3b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae80ad9f0 con 0x7fdae81597e0 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdae77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdae80ad550 0x7fdae815bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdae77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdae80ad550 0x7fdae815bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43298/0 (socket says 172.21.15.33:43298) 2023-10-09T15:33:09.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.777+0000 7fdae77fe700 1 -- 172.21.15.33:0/1252583666 learned_addr learned my addr 172.21.15.33:0/1252583666 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae7fff700 1 --2- 172.21.15.33:0/1252583666 >> v2:172.21.15.59:3300/0 conn(0x7fdae81597e0 0x7fdae80ad010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae77fe700 1 -- 172.21.15.33:0/1252583666 >> v2:172.21.15.59:3300/0 conn(0x7fdae81597e0 msgr2=0x7fdae80ad010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae77fe700 1 --2- 172.21.15.33:0/1252583666 >> v2:172.21.15.59:3300/0 conn(0x7fdae81597e0 0x7fdae80ad010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae77fe700 1 -- 172.21.15.33:0/1252583666 >> v1:172.21.15.59:6789/0 conn(0x7fdae815c4a0 legacy=0x7fdae8159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae77fe700 1 -- 172.21.15.33:0/1252583666 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae815cea0 con 0x7fdae80ad550 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae77fe700 1 --2- 172.21.15.33:0/1252583666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae80ad550 0x7fdae815bf60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdae80cc2d0 tx=0x7fdad0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=758b4d6042de8036 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae6ffd700 1 -- 172.21.15.33:0/1252583666 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000b860 con 0x7fdae80ad550 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae6ffd700 1 -- 172.21.15.33:0/1252583666 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad000b9c0 con 0x7fdae80ad550 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.778+0000 7fdae6ffd700 1 -- 172.21.15.33:0/1252583666 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad000bd60 con 0x7fdae80ad550 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 -- 172.21.15.33:0/1252583666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae80ad550 msgr2=0x7fdae815bf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/1252583666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae80ad550 0x7fdae815bf60 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdae80cc2d0 tx=0x7fdad0009250 comp rx=0 tx=0).stop 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 -- 172.21.15.33:0/1252583666 shutdown_connections 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/1252583666 >> v2:172.21.15.59:3300/0 conn(0x7fdae81597e0 0x7fdae80ad010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/1252583666 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae80ad550 0x7fdae815bf60 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 -- 172.21.15.33:0/1252583666 >> 172.21.15.33:0/1252583666 conn(0x7fdae806d170 msgr2=0x7fdae80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 -- 172.21.15.33:0/1252583666 shutdown_connections 2023-10-09T15:33:09.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.779+0000 7fdaee3b4700 1 -- 172.21.15.33:0/1252583666 wait complete. 2023-10-09T15:33:09.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.780+0000 7fdaee3b4700 1 Processor -- start 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.780+0000 7fdaee3b4700 1 -- start start 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae80ad550 0x7fdae814ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae815c4a0 0x7fdae815e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae81443e0 con 0x7fdae81597e0 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae816a950 con 0x7fdae80ad550 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae8169d40 con 0x7fdae815c4a0 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43306/0 (socket says 172.21.15.33:43306) 2023-10-09T15:33:09.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 -- 172.21.15.33:0/3701656203 learned_addr learned my addr 172.21.15.33:0/3701656203 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae80ad550 0x7fdae814ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaec951700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae815c4a0 0x7fdae815e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 -- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae815c4a0 msgr2=0x7fdae815e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae815c4a0 0x7fdae815e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 -- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae80ad550 msgr2=0x7fdae814ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae80ad550 0x7fdae814ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 -- 172.21.15.33:0/3701656203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdad00094f0 con 0x7fdae81597e0 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdae806d610 tx=0x7fdad0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdadffff700 1 -- 172.21.15.33:0/3701656203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0024440 con 0x7fdae81597e0 2023-10-09T15:33:09.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdadffff700 1 -- 172.21.15.33:0/3701656203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad00245c0 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae816a020 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdadffff700 1 -- 172.21.15.33:0/3701656203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad0024980 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.781+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae816a5e0 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.783+0000 7fdadffff700 1 -- 172.21.15.33:0/3701656203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fdad001a420 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.783+0000 7fdadffff700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 0x7fdac8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.783+0000 7fdadffff700 1 -- 172.21.15.33:0/3701656203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdad0086290 con 0x7fdae81597e0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.783+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 0x7fdac8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.784+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 0x7fdac8069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdad8006fd0 tx=0x7fdad8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.785+0000 7fdaf76acb80 1 Processor -- start 2023-10-09T15:33:09.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 -- start start 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b050e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b079a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713afa7a70 con 0x55713b079f60 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713afa5270 con 0x55713b050a50 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55713afa1060 con 0x55713b09ad00 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.786+0000 7fdaec951700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43314/0 (socket says 172.21.15.33:43314) 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 -- 172.21.15.33:0/3504994961 learned_addr learned my addr 172.21.15.33:0/3504994961 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b050e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b079a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 -- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 msgr2=0x55713b079a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b079a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 -- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 msgr2=0x55713b050e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b050e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 -- 172.21.15.33:0/3504994961 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713ae3b270 con 0x55713b079f60 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdaec951700 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fdae0002b40 tx=0x7fdae00015f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfa2ec2963f4e5f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdadd7fa700 1 -- 172.21.15.33:0/3504994961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000e860 con 0x55713b079f60 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdadd7fa700 1 -- 172.21.15.33:0/3504994961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdae000e9c0 con 0x55713b079f60 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.787+0000 7fdadd7fa700 1 -- 172.21.15.33:0/3504994961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdae000ed40 con 0x55713b079f60 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3504994961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 msgr2=0x55713b04ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7fdae0002b40 tx=0x7fdae00015f0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3504994961 shutdown_connections 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ccf0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b050e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3504994961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b079a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3504994961 >> 172.21.15.33:0/3504994961 conn(0x55713b052370 msgr2=0x55713b052740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3504994961 shutdown_connections 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3504994961 wait complete. 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.788+0000 7fdaf76acb80 1 -- start start 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 Processor -- start 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b079f60 0x55713b0762f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b090e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713af4c890 con 0x55713b050a50 2023-10-09T15:33:09.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713af67ea0 con 0x55713b079f60 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55713ae23e30 con 0x55713b09ad00 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdaf76acb80 10 client.0 _ll_register_callbacks cb 0x55713b014110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.789+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43318/0 (socket says 172.21.15.33:43318) 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 -- 172.21.15.33:0/1141509875 learned_addr learned my addr 172.21.15.33:0/1141509875 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae77fe700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b079f60 0x55713b0762f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdaec951700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b090e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 -- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 msgr2=0x55713b090e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b090e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 -- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b079f60 msgr2=0x55713b0762f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b079f60 0x55713b0762f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 -- 172.21.15.33:0/1141509875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae000f040 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdae7fff700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdad8016be0 tx=0x7fdad8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23eff6a32e935c47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad8010e80 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55713b045b70 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdad80107e0 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdad8014ce0 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdaf76acb80 10 client.5859 fetch_fsmap learned FSMap version 40 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55713adddfe0 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55713b045b70 con 0x55713b050a50 2023-10-09T15:33:09.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.790+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdad802b440 con 0x55713b050a50 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 10 client.5859 fetch_fsmap finished waiting for FSMap version 40 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 10 client.5859 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 20 client.5859 populate_metadata read hostname 'smithi033' 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07e030 0x55713b07e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 4 client.5859 mds_command: new command op to 5718 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 --> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55713b022aa0 con 0x55713b07e030 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdae77fe700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07e030 0x55713b07e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdac67fc700 10 client.5859 ms_handle_connect on v2:172.21.15.33:6836/2608740394 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdae77fe700 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07e030 0x55713b07e400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2c65d01f6eeef872 server_cookie=1d95aaeca3bb0f82 in_seq=0 out_seq=0 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdac67fc700 1 -- 172.21.15.33:0/1141509875 <== mds.0 v2:172.21.15.33:6836/2608740394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55713b022aa0 con 0x55713b07e030 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdac67fc700 10 client.5859 handle_command_reply: tid=0 2023-10-09T15:33:09.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.791+0000 7fdaf76acb80 1 client.5859 shutdown 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 msgr2=0x55713b09a560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fdad8016be0 tx=0x7fdad8017000 comp rx=0 tx=0).stop 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 shutdown_connections 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07e030 0x55713b07e400 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b050a50 0x55713b09a560 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b090e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/1141509875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b079f60 0x55713b0762f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdac67fc700 0 client.5859 ms_handle_reset on v2:172.21.15.33:6836/2608740394 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 >> 172.21.15.33:0/1141509875 conn(0x55713b052370 msgr2=0x55713b04d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 shutdown_connections 2023-10-09T15:33:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 1 -- 172.21.15.33:0/1141509875 wait complete. 2023-10-09T15:33:09.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.792+0000 7fdaf76acb80 20 client.5859 trim_cache size 0 max 16384 2023-10-09T15:33:09.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 Processor -- start 2023-10-09T15:33:09.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 -- start start 2023-10-09T15:33:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b04c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b07f2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b093490 con 0x55713b079f60 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b093ca0 con 0x55713b050a50 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.809+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55713b0919b0 con 0x55713b09ad00 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43328/0 (socket says 172.21.15.33:43328) 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 -- 172.21.15.33:0/2335902162 learned_addr learned my addr 172.21.15.33:0/2335902162 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdaec951700 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b07f2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae7fff700 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b04c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 -- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 msgr2=0x55713b07f2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b07f2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 -- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 msgr2=0x55713b04c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b04c4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 -- 172.21.15.33:0/2335902162 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55713af6f780 con 0x55713b079f60 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdae77fe700 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdad0056ed0 tx=0x7fdad0026040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b41ec8e9d1df923 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdaddffb700 1 -- 172.21.15.33:0/2335902162 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad00860b0 con 0x55713b079f60 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdaddffb700 1 -- 172.21.15.33:0/2335902162 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad00571d0 con 0x55713b079f60 2023-10-09T15:33:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.810+0000 7fdaddffb700 1 -- 172.21.15.33:0/2335902162 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad005a420 con 0x55713b079f60 2023-10-09T15:33:09.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 -- 172.21.15.33:0/2335902162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 msgr2=0x55713b04ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fdad0056ed0 tx=0x7fdad0026040 comp rx=0 tx=0).stop 2023-10-09T15:33:09.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 -- 172.21.15.33:0/2335902162 shutdown_connections 2023-10-09T15:33:09.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b07f2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b04c4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/2335902162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b04ca10 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 -- 172.21.15.33:0/2335902162 >> 172.21.15.33:0/2335902162 conn(0x55713b052370 msgr2=0x55713b052740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 -- 172.21.15.33:0/2335902162 shutdown_connections 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.811+0000 7fdaf76acb80 1 -- 172.21.15.33:0/2335902162 wait complete. 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 -- start start 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 Processor -- start 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b08d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b098390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b098e80 con 0x55713b079f60 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55713b08db60 con 0x55713b050a50 2023-10-09T15:33:09.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.812+0000 7fdaf76acb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55713b07c950 con 0x55713b09ad00 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaf76acb80 10 client.0 _ll_register_callbacks cb 0x55713b014110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43336/0 (socket says 172.21.15.33:43336) 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 -- 172.21.15.33:0/3102786274 learned_addr learned my addr 172.21.15.33:0/3102786274 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b08d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaec951700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b098390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 -- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 msgr2=0x55713b098390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b098390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 -- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 msgr2=0x55713b08d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b08d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 -- 172.21.15.33:0/3102786274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdad005c040 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaec951700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b098390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdae77fe700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdad0057160 tx=0x7fdad006b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c2c7ad967bb3b1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdac67fc700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad005e170 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdad005a420 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fdae000e9c0 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fdad002b340 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaf76acb80 10 client.5865 fetch_fsmap learned FSMap version 40 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=40,monmap=2+}) v3 -- 0x55713af56470 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.813+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad0076080 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 40) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fdad0057430 con 0x55713b079f60 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 10 client.5865 fetch_fsmap finished waiting for FSMap version 40 2023-10-09T15:33:09.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 10 client.5865 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 20 client.5865 populate_metadata read hostname 'smithi033' 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07cf70 0x55713b04c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 4 client.5865 mds_command: new command op to 5718 tid=0[{"prefix": "status"}] 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 --> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55713af43e00 con 0x55713b07cf70 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07cf70 0x55713b04c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdac67fc700 10 client.5865 ms_handle_connect on v2:172.21.15.33:6836/2608740394 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdae7fff700 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07cf70 0x55713b04c4d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c42b296f4ab120cb server_cookie=38d6a96fc6c207fa in_seq=0 out_seq=0 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdac67fc700 1 -- 172.21.15.33:0/3102786274 <== mds.0 v2:172.21.15.33:6836/2608740394 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+319 (crc 0 0 0) 0x55713af43e00 con 0x55713b07cf70 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdac67fc700 10 client.5865 handle_command_reply: tid=0 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 1 client.5865 shutdown 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 msgr2=0x55713b0fcea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.814+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdad0057160 tx=0x7fdad006b000 comp rx=0 tx=0).stop 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 shutdown_connections 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:6836/2608740394,v1:172.21.15.33:6837/2608740394] conn(0x55713b07cf70 0x55713b04c4d0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55713b09ad00 0x55713b098390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdac67fc700 0 client.5865 ms_handle_reset on v2:172.21.15.33:6836/2608740394 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55713b050a50 0x55713b08d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 --2- 172.21.15.33:0/3102786274 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55713b079f60 0x55713b0fcea0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 >> 172.21.15.33:0/3102786274 conn(0x55713b052370 msgr2=0x55713b0a6830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 shutdown_connections 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 1 -- 172.21.15.33:0/3102786274 wait complete. 2023-10-09T15:33:09.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaf76acb80 20 client.5865 trim_cache size 0 max 16384 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 5718, 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.477766529, 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 40, 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 63, 2023-10-09T15:33:09.822 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 63, 2023-10-09T15:33:09.823 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 15.547765627 2023-10-09T15:33:09.823 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:33:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 msgr2=0x7fdac8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 0x7fdac8069470 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fdad8006fd0 tx=0x7fdad8008040 comp rx=0 tx=0).stop 2023-10-09T15:33:09.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 msgr2=0x7fdae8143ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdae806d610 tx=0x7fdad0017000 comp rx=0 tx=0).stop 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 shutdown_connections 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdac8066fc0 0x7fdac8069470 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae815c4a0 0x7fdae815e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdae80ad550 0x7fdae814ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 --2- 172.21.15.33:0/3701656203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae81597e0 0x7fdae8143ea0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 >> 172.21.15.33:0/3701656203 conn(0x7fdae806d170 msgr2=0x7fdae8157970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 shutdown_connections 2023-10-09T15:33:09.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.815+0000 7fdaee3b4700 1 -- 172.21.15.33:0/3701656203 wait complete. 2023-10-09T15:33:09.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:33:09.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.946+0000 7fcc95b9e700 1 Processor -- start 2023-10-09T15:33:09.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.946+0000 7fcc95b9e700 1 -- start start 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc95b9e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc90159940 0x7fcc9006d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc95b9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9006dd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc95b9e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc900b3270 con 0x7fcc90159570 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc95b9e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc900b3550 con 0x7fcc90159940 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc95b9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900b3830 con 0x7fcc9015dea0 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc90159940 0x7fcc9006d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcc90159940 0x7fcc9006d7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43348/0 (socket says 172.21.15.33:43348) 2023-10-09T15:33:09.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 -- 172.21.15.33:0/3952434384 learned_addr learned my addr 172.21.15.33:0/3952434384 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc9539d700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9006dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 -- 172.21.15.33:0/3952434384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 msgr2=0x7fcc9006dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9006dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 -- 172.21.15.33:0/3952434384 >> v1:172.21.15.59:6789/0 conn(0x7fcc90159570 legacy=0x7fcc900b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 -- 172.21.15.33:0/3952434384 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc900b3b10 con 0x7fcc90159940 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8ffff700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159940 0x7fcc9006d7c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0099b0 tx=0x7fcc7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bb550806a9bb6c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.947+0000 7fcc8f7fe700 1 -- 172.21.15.33:0/3952434384 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00b860 con 0x7fcc90159940 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc8f7fe700 1 -- 172.21.15.33:0/3952434384 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc7c00b9c0 con 0x7fcc90159940 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc8f7fe700 1 -- 172.21.15.33:0/3952434384 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc7c00bd60 con 0x7fcc90159940 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 -- 172.21.15.33:0/3952434384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159940 msgr2=0x7fcc9006d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159940 0x7fcc9006d7c0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0099b0 tx=0x7fcc7c009250 comp rx=0 tx=0).stop 2023-10-09T15:33:09.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 -- 172.21.15.33:0/3952434384 shutdown_connections 2023-10-09T15:33:09.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9006dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/3952434384 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159940 0x7fcc9006d7c0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 -- 172.21.15.33:0/3952434384 >> 172.21.15.33:0/3952434384 conn(0x7fcc900703a0 msgr2=0x7fcc900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:09.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 -- 172.21.15.33:0/3952434384 shutdown_connections 2023-10-09T15:33:09.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.948+0000 7fcc95b9e700 1 -- 172.21.15.33:0/3952434384 wait complete. 2023-10-09T15:33:09.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.949+0000 7fcc95b9e700 1 Processor -- start 2023-10-09T15:33:09.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.949+0000 7fcc95b9e700 1 -- start start 2023-10-09T15:33:09.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc90159940 0x7fcc900cdfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9016d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900c5960 con 0x7fcc90159570 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900c5c40 con 0x7fcc90159940 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc95b9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc900c5f20 con 0x7fcc9015dea0 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc94b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc94b9c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43356/0 (socket says 172.21.15.33:43356) 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc94b9c700 1 -- 172.21.15.33:0/2431391951 learned_addr learned my addr 172.21.15.33:0/2431391951 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc8ffff700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc90159940 0x7fcc900cdfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.950+0000 7fcc9539d700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9016d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 -- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 msgr2=0x7fcc9016d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9016d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 -- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc90159940 msgr2=0x7fcc900cdfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc90159940 0x7fcc900cdfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 -- 172.21.15.33:0/2431391951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc7c0094f0 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc94b9c700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c590 tx=0x7fcc8400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011590 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcc84011710 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc900c6200 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcc84011ad0 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.951+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc901448d0 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.952+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc9004c3c0 con 0x7fcc90159570 2023-10-09T15:33:09.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.952+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fcc8401b3b0 con 0x7fcc90159570 2023-10-09T15:33:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.953+0000 7fcc8cff9700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 0x7fcc74069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.953+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcc840839c0 con 0x7fcc90159570 2023-10-09T15:33:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.953+0000 7fcc8ffff700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 0x7fcc74069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:09.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.953+0000 7fcc8ffff700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 0x7fcc74069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0099b0 tx=0x7fcc7c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:09.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:09.957+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcc84050c40 con 0x7fcc90159570 2023-10-09T15:33:10.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.196+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fcc900b3df0 con 0x7fcc90159570 2023-10-09T15:33:10.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.197+0000 7fcc8cff9700 1 -- 172.21.15.33:0/2431391951 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7fcc84017070 con 0x7fcc90159570 2023-10-09T15:33:10.197 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.198+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 msgr2=0x7fcc74069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.198+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 0x7fcc74069470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fcc7c0099b0 tx=0x7fcc7c017000 comp rx=0 tx=0).stop 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 msgr2=0x7fcc90144390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7fcc8400c590 tx=0x7fcc8400c8a0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 shutdown_connections 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcc74066fc0 0x7fcc74069470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcc90159570 0x7fcc90144390 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcc9015dea0 0x7fcc9016d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 --2- 172.21.15.33:0/2431391951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcc90159940 0x7fcc900cdfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 >> 172.21.15.33:0/2431391951 conn(0x7fcc900703a0 msgr2=0x7fcc90156a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 shutdown_connections 2023-10-09T15:33:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.199+0000 7fcc95b9e700 1 -- 172.21.15.33:0/2431391951 wait complete. 2023-10-09T15:33:10.210 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:33:10.211 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:33:10.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.212 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:33:10.227 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:33:10.227 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:33:10.227 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:33:10.227 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:10.228 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42297sec preferred_lft 42297sec 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:33:10.229 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:33:10.230 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:10.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.231 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:33:10.291 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:33:10.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.293 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:33:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:33:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:33:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:33:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:33:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:33:10.350 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:33:10.350 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:33:10.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.452 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:33:10.467 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:33:10.467 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:33:10.467 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:33:10.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:33:10.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:33:10.532 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:33:10.586 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:33:10.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:33:10.587 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:33:10.641 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:33:10.641 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:33:10.641 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:33:10.722 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:33:10.723 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:33:10.723 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:33:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:33:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:33:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:33:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:33:10.731 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:33:10.753 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:33:10.753 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:33:10.753 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:33:10.753 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:33:10.753 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:33:10.754 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:33:10.754 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:33:10.754 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:33:10.755 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:33:10.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:10.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:33:10.821 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:33:10.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 Processor -- start 2023-10-09T15:33:10.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 -- start start 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 0x7ff0780ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780cf200 0x7ff0780cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff07815a280 con 0x7ff0780b0ba0 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff07806e180 con 0x7ff0780cf200 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.980+0000 7ff07db69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780cd540 con 0x7ff0780b07d0 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780cf200 0x7ff0780cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff077fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff0780b0ba0 0x7ff07806e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52930/0 (socket says 172.21.15.33:52930) 2023-10-09T15:33:10.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff0780cf200 0x7ff0780cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40602/0 (socket says 172.21.15.33:40602) 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff077fff700 1 -- 172.21.15.33:0/3488001325 learned_addr learned my addr 172.21.15.33:0/3488001325 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 0x7ff0780ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 -- 172.21.15.33:0/3488001325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 msgr2=0x7ff0780ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 0x7ff0780ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 -- 172.21.15.33:0/3488001325 >> v1:172.21.15.33:6789/0 conn(0x7ff0780b0ba0 legacy=0x7ff07806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 -- 172.21.15.33:0/3488001325 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff07806d850 con 0x7ff0780cf200 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 0x7ff0780ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff0780cd000 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0098e0 tx=0x7ff06c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba4d1794cd5cdc5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff0767fc700 1 -- 172.21.15.33:0/3488001325 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c009e80 con 0x7ff0780cf200 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff0767fc700 1 -- 172.21.15.33:0/3488001325 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff06c00b8f0 con 0x7ff0780cf200 2023-10-09T15:33:10.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.981+0000 7ff0767fc700 1 -- 172.21.15.33:0/3488001325 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff06c00bc70 con 0x7ff0780cf200 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 -- 172.21.15.33:0/3488001325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 msgr2=0x7ff0780cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff0780cd000 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7ff06c0098e0 tx=0x7ff06c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 -- 172.21.15.33:0/3488001325 shutdown_connections 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b07d0 0x7ff0780ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 --2- 172.21.15.33:0/3488001325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff0780cd000 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 -- 172.21.15.33:0/3488001325 >> 172.21.15.33:0/3488001325 conn(0x7ff07806ce80 msgr2=0x7ff0780ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 -- 172.21.15.33:0/3488001325 shutdown_connections 2023-10-09T15:33:10.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.982+0000 7ff07db69700 1 -- 172.21.15.33:0/3488001325 wait complete. 2023-10-09T15:33:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.983+0000 7ff07db69700 1 Processor -- start 2023-10-09T15:33:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.983+0000 7ff07db69700 1 -- start start 2023-10-09T15:33:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 0x7ff078157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b0ba0 0x7ff0780b3b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780b2170 con 0x7ff0780cf200 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780b2d80 con 0x7ff0780b07d0 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff07db69700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0780b3060 con 0x7ff0780b0ba0 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40606/0 (socket says 172.21.15.33:40606) 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 -- 172.21.15.33:0/3659506599 learned_addr learned my addr 172.21.15.33:0/3659506599 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 0x7ff078157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff076ffd700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b0ba0 0x7ff0780b3b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 -- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b0ba0 msgr2=0x7ff0780b3b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b0ba0 0x7ff0780b3b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 -- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 msgr2=0x7ff078157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 0x7ff078157790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff077fff700 1 -- 172.21.15.33:0/3659506599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff06c009420 con 0x7ff0780cf200 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.984+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 0x7ff078157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff077fff700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff07000cc40 tx=0x7ff070001a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff07000a9c0 con 0x7ff0780cf200 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff07000ab20 con 0x7ff0780cf200 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0700070f0 con 0x7ff0780cf200 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0780b3340 con 0x7ff0780cf200 2023-10-09T15:33:10.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.985+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff078157cd0 con 0x7ff0780cf200 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.986+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0780b3860 con 0x7ff0780cf200 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.986+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7ff0700074e0 con 0x7ff0780cf200 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.987+0000 7ff05f7fe700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 0x7ff0640694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.987+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 0x7ff0640694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.987+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff070084970 con 0x7ff0780cf200 2023-10-09T15:33:10.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.987+0000 7ff0777fe700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 0x7ff0640694a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff068006ea0 tx=0x7ff068008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:10.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:10.991+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0780b3860 con 0x7ff0780cf200 2023-10-09T15:33:11.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.229+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff0780b3860 con 0x7ff0780cf200 2023-10-09T15:33:11.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.229+0000 7ff05f7fe700 1 -- 172.21.15.33:0/3659506599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v40) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff0780b3860 con 0x7ff0780cf200 2023-10-09T15:33:11.230 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:33:11.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 msgr2=0x7ff0640694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 0x7ff0640694a0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff068006ea0 tx=0x7ff068008040 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 msgr2=0x7ff078068590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7ff07000cc40 tx=0x7ff070001a50 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 shutdown_connections 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff064066ff0 0x7ff0640694a0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff0780cf200 0x7ff078068590 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0780b07d0 0x7ff078157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 --2- 172.21.15.33:0/3659506599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff0780b0ba0 0x7ff0780b3b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 >> 172.21.15.33:0/3659506599 conn(0x7ff07806ce80 msgr2=0x7ff0780c8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 shutdown_connections 2023-10-09T15:33:11.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:11.231+0000 7ff07db69700 1 -- 172.21.15.33:0/3659506599 wait complete. 2023-10-09T15:33:11.244 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:33:11.244 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:33:11.244 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:33:11.244 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:33:11.244 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:33:11.245 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:33:11.245 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:33:11.245 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:33:11.245 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:33:11.245 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.245 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:33:11.265 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:11.266 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:33:11.267 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:33:11.268 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:33:11.269 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.269 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:33:11.334 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:33:11.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.336 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:33:11.394 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:33:11.395 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:33:11.395 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:33:11.395 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:33:11.395 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:33:11.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.395 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:33:11.395 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:33:11.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:33:11.395 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:33:11.396 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:33:11.396 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:33:11.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.504 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:33:11.520 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:33:11.520 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:33:11.520 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:33:11.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.521 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:33:11.587 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:33:11.587 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:33:11.642 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:33:11.642 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:33:11.642 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:33:11.697 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:33:11.698 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:33:11.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:33:11.779 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:33:11.780 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:33:11.780 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:33:11.788 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:33:11.788 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:33:11.788 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:33:11.788 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:33:11.788 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:33:11.810 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:33:11.810 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:33:11.810 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:33:11.811 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:33:11.811 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:33:11.811 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:33:11.811 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:33:11.811 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:33:11.813 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:33:11.813 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:33:11.813 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:33:11.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:33:12.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.012+0000 7fe9f26d4700 1 Processor -- start 2023-10-09T15:33:12.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.012+0000 7fe9f26d4700 1 -- start start 2023-10-09T15:33:12.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f26d4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9ec1598f0 0x7fe9ec0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f26d4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec159d50 con 0x7fe9ec0cd770 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f26d4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9ec0cf330 con 0x7fe9ec0cb880 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f26d4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9ec0cead0 con 0x7fe9ec1598f0 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f0c71700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe9ec1598f0 0x7fe9ec0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9eb7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe9ec0cd770 0x7fe9ec1591e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52932/0 (socket says 172.21.15.33:52932) 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9eb7fe700 1 -- 172.21.15.33:0/2013932595 learned_addr learned my addr 172.21.15.33:0/2013932595 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f0c71700 1 -- 172.21.15.33:0/2013932595 >> v1:172.21.15.59:6789/0 conn(0x7fe9ec0cb880 legacy=0x7fe9ec0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f0c71700 1 -- 172.21.15.33:0/2013932595 >> v1:172.21.15.33:6789/0 conn(0x7fe9ec0cd770 legacy=0x7fe9ec1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9f0c71700 1 -- 172.21.15.33:0/2013932595 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9ec0cddd0 con 0x7fe9ec1598f0 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.013+0000 7fe9eaffd700 1 -- 172.21.15.33:0/2013932595 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4183744212 0 0) 0x7fe9ec159d50 con 0x7fe9ec0cd770 2023-10-09T15:33:12.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f0c71700 1 --2- 172.21.15.33:0/2013932595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec1598f0 0x7fe9ec0cbc50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009e60 tx=0x7fe9e4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ddf5afd6e216caa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9eaffd700 1 -- 172.21.15.33:0/2013932595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e400e070 con 0x7fe9ec1598f0 2023-10-09T15:33:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9eaffd700 1 -- 172.21.15.33:0/2013932595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9e400bc30 con 0x7fe9ec1598f0 2023-10-09T15:33:12.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9eaffd700 1 -- 172.21.15.33:0/2013932595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9e4012430 con 0x7fe9ec1598f0 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2013932595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec1598f0 msgr2=0x7fe9ec0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2013932595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec1598f0 0x7fe9ec0cbc50 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fe9e4009e60 tx=0x7fe9e4009780 comp rx=0 tx=0).stop 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2013932595 shutdown_connections 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2013932595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec1598f0 0x7fe9ec0cbc50 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2013932595 >> 172.21.15.33:0/2013932595 conn(0x7fe9ec0703a0 msgr2=0x7fe9ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2013932595 shutdown_connections 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.014+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2013932595 wait complete. 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.015+0000 7fe9f26d4700 1 Processor -- start 2023-10-09T15:33:12.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 -- start start 2023-10-09T15:33:12.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:12.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9ec0cd770 0x7fe9ec14f210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:12.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 0x7fe9ec0b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15e3d0 con 0x7fe9ec0cb880 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15d7c0 con 0x7fe9ec0cd770 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.016+0000 7fe9f26d4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9ec15daa0 con 0x7fe9ec1598f0 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40628/0 (socket says 172.21.15.33:40628) 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 -- 172.21.15.33:0/2174103472 learned_addr learned my addr 172.21.15.33:0/2174103472 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9eb7fe700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9ec0cd770 0x7fe9ec14f210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9f0c71700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 0x7fe9ec0b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 -- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 msgr2=0x7fe9ec0b12d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 0x7fe9ec0b12d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:12.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 -- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9ec0cd770 msgr2=0x7fe9ec14f210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9ec0cd770 0x7fe9ec14f210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 -- 172.21.15.33:0/2174103472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9e4009a20 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9f0c71700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 0x7fe9ec0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9ebfff700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c790 tx=0x7fe9dc007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc011590 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9dc0116f0 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9ec15dd80 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9dc011ab0 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.017+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9ec15d400 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.018+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9ec04c3c0 con 0x7fe9ec0cb880 2023-10-09T15:33:12.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.019+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe9dc01b3b0 con 0x7fe9ec0cb880 2023-10-09T15:33:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.019+0000 7fe9d3fff700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 0x7fe9d8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.019+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe9dc083a00 con 0x7fe9ec0cb880 2023-10-09T15:33:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.019+0000 7fe9eb7fe700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 0x7fe9d8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:12.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.020+0000 7fe9eb7fe700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 0x7fe9d8069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0c6170 tx=0x7fe9e0007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:12.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.023+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9dc050c80 con 0x7fe9ec0cb880 2023-10-09T15:33:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:12.261+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe9ec0ce680 con 0x7fe9ec0cb880 2023-10-09T15:33:13.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.222+0000 7fe9d3fff700 1 -- 172.21.15.33:0/2174103472 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v41) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe9dc017020 con 0x7fe9ec0cb880 2023-10-09T15:33:13.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 msgr2=0x7fe9d8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 0x7fe9d8069470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7fe9ec0c6170 tx=0x7fe9e0007d30 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 msgr2=0x7fe9ec14ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe9dc00c790 tx=0x7fe9dc007f40 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 shutdown_connections 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9d8066fc0 0x7fe9d8069470 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9ec0cb880 0x7fe9ec14ecd0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9ec1598f0 0x7fe9ec0b12d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 --2- 172.21.15.33:0/2174103472 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9ec0cd770 0x7fe9ec14f210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 >> 172.21.15.33:0/2174103472 conn(0x7fe9ec0703a0 msgr2=0x7fe9ec1513f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 shutdown_connections 2023-10-09T15:33:13.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.225+0000 7fe9f26d4700 1 -- 172.21.15.33:0/2174103472 wait complete. 2023-10-09T15:33:13.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:33:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.367+0000 7fe8172a6700 1 Processor -- start 2023-10-09T15:33:13.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 -- start start 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 0x7fe8100cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8100cd9e0 0x7fe810159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8100cde50 0x7fe81015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8100d13f0 con 0x7fe8100cde50 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81015a940 con 0x7fe8100cd9e0 2023-10-09T15:33:13.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.368+0000 7fe8172a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81015ae40 con 0x7fe8100cb5a0 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8100cde50 0x7fe81015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8100cde50 0x7fe81015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40642/0 (socket says 172.21.15.33:40642) 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 -- 172.21.15.33:0/3487461998 learned_addr learned my addr 172.21.15.33:0/3487461998 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe814841700 1 --2- 172.21.15.33:0/3487461998 >> v2:172.21.15.59:3300/0 conn(0x7fe8100cd9e0 0x7fe810159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815042700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 0x7fe8100cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 -- 172.21.15.33:0/3487461998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 msgr2=0x7fe8100cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 0x7fe8100cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 -- 172.21.15.33:0/3487461998 >> v2:172.21.15.59:3300/0 conn(0x7fe8100cd9e0 msgr2=0x7fe810159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 --2- 172.21.15.33:0/3487461998 >> v2:172.21.15.59:3300/0 conn(0x7fe8100cd9e0 0x7fe810159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 -- 172.21.15.33:0/3487461998 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81015ab60 con 0x7fe8100cde50 2023-10-09T15:33:13.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815042700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 0x7fe8100cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe815843700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8100cde50 0x7fe81015a400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe81006ea90 tx=0x7fe808009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc2efe9e71e48a21 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe80ffff700 1 -- 172.21.15.33:0/3487461998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80800e070 con 0x7fe8100cde50 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe80ffff700 1 -- 172.21.15.33:0/3487461998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80800b990 con 0x7fe8100cde50 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.369+0000 7fe80ffff700 1 -- 172.21.15.33:0/3487461998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8080092e0 con 0x7fe8100cde50 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 -- 172.21.15.33:0/3487461998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8100cde50 msgr2=0x7fe81015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8100cde50 0x7fe81015a400 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe81006ea90 tx=0x7fe808009840 comp rx=0 tx=0).stop 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 -- 172.21.15.33:0/3487461998 shutdown_connections 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8100cde50 0x7fe81015a400 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 --2- 172.21.15.33:0/3487461998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cb5a0 0x7fe8100cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 --2- 172.21.15.33:0/3487461998 >> v2:172.21.15.59:3300/0 conn(0x7fe8100cd9e0 0x7fe810159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 -- 172.21.15.33:0/3487461998 >> 172.21.15.33:0/3487461998 conn(0x7fe810070e30 msgr2=0x7fe8100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 -- 172.21.15.33:0/3487461998 shutdown_connections 2023-10-09T15:33:13.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.370+0000 7fe8172a6700 1 -- 172.21.15.33:0/3487461998 wait complete. 2023-10-09T15:33:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.371+0000 7fe8172a6700 1 Processor -- start 2023-10-09T15:33:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.371+0000 7fe8172a6700 1 -- start start 2023-10-09T15:33:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 0x7fe8100c9d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 0x7fe810155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810155c90 con 0x7fe810155f50 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe810157910 con 0x7fe8100cb5a0 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe8172a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe810157bf0 con 0x7fe8100cd9e0 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40654/0 (socket says 172.21.15.33:40654) 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 -- 172.21.15.33:0/660661516 learned_addr learned my addr 172.21.15.33:0/660661516 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815042700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 0x7fe8100c9d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe814841700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 0x7fe810155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 -- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 msgr2=0x7fe810155750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 0x7fe810155750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 -- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 msgr2=0x7fe8100c9d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 0x7fe8100c9d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 -- 172.21.15.33:0/660661516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe808009ae0 con 0x7fe810155f50 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe814841700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 0x7fe810155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815042700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 0x7fe8100c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe815843700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe81006ea60 tx=0x7fe808018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.372+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe808008c30 con 0x7fe810155f50 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.373+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe808008db0 con 0x7fe810155f50 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.373+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8100c9240 con 0x7fe810155f50 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.373+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80801c660 con 0x7fe810155f50 2023-10-09T15:33:13.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.373+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8100c9800 con 0x7fe810155f50 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.374+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8100c99f0 con 0x7fe810155f50 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.374+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fe808003040 con 0x7fe810155f50 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.374+0000 7fe80d7fa700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 0x7fe7fc069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.374+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe808085e60 con 0x7fe810155f50 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.374+0000 7fe815042700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 0x7fe7fc069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.375+0000 7fe815042700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 0x7fe7fc069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe800006f00 tx=0x7fe800008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.379+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe808052fd0 con 0x7fe810155f50 2023-10-09T15:33:13.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.599+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe81004c3c0 con 0x7fe7fc066fc0 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.600+0000 7fe80d7fa700 1 -- 172.21.15.33:0/660661516 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe81004c3c0 con 0x7fe7fc066fc0 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:33:13.601 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 msgr2=0x7fe7fc069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 0x7fe7fc069470 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fe800006f00 tx=0x7fe800008040 comp rx=0 tx=0).stop 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 msgr2=0x7fe81015bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fe81006ea60 tx=0x7fe808018000 comp rx=0 tx=0).stop 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 shutdown_connections 2023-10-09T15:33:13.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc066fc0 0x7fe7fc069470 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe810155f50 0x7fe81015bbb0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8100cb5a0 0x7fe8100c9d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 --2- 172.21.15.33:0/660661516 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8100cd9e0 0x7fe810155750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 >> 172.21.15.33:0/660661516 conn(0x7fe810070e30 msgr2=0x7fe8100b0b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 shutdown_connections 2023-10-09T15:33:13.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.602+0000 7fe8172a6700 1 -- 172.21.15.33:0/660661516 wait complete. 2023-10-09T15:33:13.615 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:33:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.736+0000 7f274588b700 1 Processor -- start 2023-10-09T15:33:13.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.736+0000 7f274588b700 1 -- start start 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f274588b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2740153a00 0x7f2740153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f274588b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274015ac50 con 0x7f274015de50 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f274588b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f274015d010 con 0x7f27400cea00 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f274588b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f274015af60 con 0x7f2740153a00 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f273ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f274015de50 0x7f274015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52936/0 (socket says 172.21.15.33:52936) 2023-10-09T15:33:13.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f273ffff700 1 -- 172.21.15.33:0/566639140 learned_addr learned my addr 172.21.15.33:0/566639140 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f2744889700 1 --2- 172.21.15.33:0/566639140 >> v2:172.21.15.59:3300/0 conn(0x7f2740153a00 0x7f2740153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2030440625 0 0) 0x7f274015ac50 con 0x7f274015de50 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.737+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2728003570 con 0x7f274015de50 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 254161408 0 0) 0x7f274015d010 con 0x7f27400cea00 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f274015ac50 con 0x7f27400cea00 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1079254883 0 0) 0x7f2728003570 con 0x7f274015de50 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 >> v2:172.21.15.59:3300/0 conn(0x7f2740153a00 msgr2=0x7f2740153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 --2- 172.21.15.33:0/566639140 >> v2:172.21.15.59:3300/0 conn(0x7f2740153a00 0x7f2740153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 >> v1:172.21.15.59:6789/0 conn(0x7f27400cea00 legacy=0x7f27400cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274015b240 con 0x7f274015de50 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f2734001470 con 0x7f274015de50 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 >> v1:172.21.15.33:6789/0 conn(0x7f274015de50 legacy=0x7f274015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2728003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2728004810 0x7f2728004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27280051c0 0x7f272800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f274015af60 con 0x7f2728003bf0 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272800c160 con 0x7f2728004810 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f272800c320 con 0x7f27280051c0 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2728003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273ffff700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2728004810 0x7f2728004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f274508a700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27280051c0 0x7f272800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 -- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27280051c0 msgr2=0x7f272800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27280051c0 0x7f272800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 -- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2728004810 msgr2=0x7f2728004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2728004810 0x7f2728004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 -- 172.21.15.33:0/566639140 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2728003570 con 0x7f2728003bf0 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f274508a700 1 -- 172.21.15.33:0/566639140 reap_dead start 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f2744889700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2728003fe0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f27380094d0 tx=0x7f273800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1491c7cb0b60f86e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800ea30 con 0x7f2728003bf0 2023-10-09T15:33:13.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273800f040 con 0x7f2728003bf0 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.738+0000 7f273f7fe700 1 -- 172.21.15.33:0/566639140 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273800edc0 con 0x7f2728003bf0 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 -- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 msgr2=0x7f2728003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2728003fe0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f27380094d0 tx=0x7f273800b040 comp rx=0 tx=0).stop 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 -- 172.21.15.33:0/566639140 shutdown_connections 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 --2- 172.21.15.33:0/566639140 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2728003fe0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 -- 172.21.15.33:0/566639140 >> 172.21.15.33:0/566639140 conn(0x7f27400703a0 msgr2=0x7f27400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 -- 172.21.15.33:0/566639140 shutdown_connections 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.739+0000 7f274588b700 1 -- 172.21.15.33:0/566639140 wait complete. 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.740+0000 7f274588b700 1 Processor -- start 2023-10-09T15:33:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.740+0000 7f274588b700 1 -- start start 2023-10-09T15:33:13.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27400c9b60 0x7f27400c6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27400c9fd0 0x7f27400c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2740169600 con 0x7f2728003bf0 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c84c0 con 0x7f27400c9b60 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f274588b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27400c87a0 con 0x7f27400c9fd0 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40674/0 (socket says 172.21.15.33:40674) 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 -- 172.21.15.33:0/1069525736 learned_addr learned my addr 172.21.15.33:0/1069525736 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:13.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 -- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27400c9fd0 msgr2=0x7f27400c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27400c9fd0 0x7f27400c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 -- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27400c9b60 msgr2=0x7f27400c6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f273ffff700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27400c9b60 0x7f27400c6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27400c9b60 0x7f27400c6790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.741+0000 7f2744889700 1 -- 172.21.15.33:0/1069525736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27400c8a80 con 0x7f2728003bf0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f2744889700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f27380094a0 tx=0x7f273801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273801d450 con 0x7f2728003bf0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f273801d5b0 con 0x7f2728003bf0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27400b48b0 con 0x7f2728003bf0 2023-10-09T15:33:13.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f273801d970 con 0x7f2728003bf0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.742+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27400d0b10 con 0x7f2728003bf0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.743+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27400d0d00 con 0x7f2728003bf0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.743+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f2738003040 con 0x7f2728003bf0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.744+0000 7f273cff9700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 0x7f272c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.744+0000 7f273ffff700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 0x7f272c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.744+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2738086ac0 con 0x7f2728003bf0 2023-10-09T15:33:13.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.744+0000 7f273ffff700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 0x7f272c069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27340015a0 tx=0x7f2734000cb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:13.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.748+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2738053c70 con 0x7f2728003bf0 2023-10-09T15:33:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.940+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f274004c3c0 con 0x7f2728003bf0 2023-10-09T15:33:13.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.941+0000 7f273cff9700 1 -- 172.21.15.33:0/1069525736 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2738018020 con 0x7f2728003bf0 2023-10-09T15:33:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 msgr2=0x7f272c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 0x7f272c069470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f27340015a0 tx=0x7f2734000cb0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 msgr2=0x7f2740152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:13.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f27380094a0 tx=0x7f273801a000 comp rx=0 tx=0).stop 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 shutdown_connections 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f272c066fc0 0x7f272c069470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2728003bf0 0x7f2740152010 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27400c9fd0 0x7f27400c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 --2- 172.21.15.33:0/1069525736 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27400c9b60 0x7f27400c6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 >> 172.21.15.33:0/1069525736 conn(0x7f27400703a0 msgr2=0x7f274015cda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 shutdown_connections 2023-10-09T15:33:13.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:13.943+0000 7f274588b700 1 -- 172.21.15.33:0/1069525736 wait complete. 2023-10-09T15:33:13.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvolume_0000000000563690 --mode=777 2023-10-09T15:33:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.078+0000 7f9002c83700 1 Processor -- start 2023-10-09T15:33:14.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.078+0000 7f9002c83700 1 -- start start 2023-10-09T15:33:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9002c83700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9002c83700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ffc0b04f0 0x7f8ffc1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9002c83700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ffc0cf330 con 0x7f8ffc0cb880 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9002c83700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0cead0 con 0x7f8ffc0cd770 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9002c83700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ffc0cdbc0 con 0x7f8ffc0b04f0 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40676/0 (socket says 172.21.15.33:40676) 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 -- 172.21.15.33:0/1481153431 learned_addr learned my addr 172.21.15.33:0/1481153431 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f9001220700 1 --2- 172.21.15.33:0/1481153431 >> v2:172.21.15.59:3300/0 conn(0x7f8ffc0b04f0 0x7f8ffc1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 -- 172.21.15.33:0/1481153431 >> v2:172.21.15.59:3300/0 conn(0x7f8ffc0b04f0 msgr2=0x7f8ffc1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 --2- 172.21.15.33:0/1481153431 >> v2:172.21.15.59:3300/0 conn(0x7f8ffc0b04f0 0x7f8ffc1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 -- 172.21.15.33:0/1481153431 >> v1:172.21.15.59:6789/0 conn(0x7f8ffc0cb880 legacy=0x7f8ffc0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 -- 172.21.15.33:0/1481153431 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ffc0cddd0 con 0x7f8ffc0cd770 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.079+0000 7f8ffbfff700 1 --2- 172.21.15.33:0/1481153431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0ccab0 tx=0x7f8ff0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92c5300a5497a4a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f8ffb7fe700 1 -- 172.21.15.33:0/1481153431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000b860 con 0x7f8ffc0cd770 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f8ffb7fe700 1 -- 172.21.15.33:0/1481153431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff000b9c0 con 0x7f8ffc0cd770 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f8ffb7fe700 1 -- 172.21.15.33:0/1481153431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff000bd60 con 0x7f8ffc0cd770 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 -- 172.21.15.33:0/1481153431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 msgr2=0x7f8ffc0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 --2- 172.21.15.33:0/1481153431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f8ffc0ccab0 tx=0x7f8ff0009250 comp rx=0 tx=0).stop 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 -- 172.21.15.33:0/1481153431 shutdown_connections 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 --2- 172.21.15.33:0/1481153431 >> v2:172.21.15.59:3300/0 conn(0x7f8ffc0b04f0 0x7f8ffc1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 --2- 172.21.15.33:0/1481153431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc0cbc50 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 -- 172.21.15.33:0/1481153431 >> 172.21.15.33:0/1481153431 conn(0x7f8ffc0703a0 msgr2=0x7f8ffc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 -- 172.21.15.33:0/1481153431 shutdown_connections 2023-10-09T15:33:14.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.080+0000 7f9002c83700 1 -- 172.21.15.33:0/1481153431 wait complete. 2023-10-09T15:33:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.081+0000 7f9002c83700 1 Processor -- start 2023-10-09T15:33:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.081+0000 7f9002c83700 1 -- start start 2023-10-09T15:33:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ffc0b04f0 0x7f8ffc16d280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ffc0cb880 0x7f8ffc0ca1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0c8990 con 0x7f8ffc0cd770 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc0ca6e0 con 0x7f8ffc0cb880 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9002c83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ffc16d980 con 0x7f8ffc0b04f0 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9001220700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9001220700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40678/0 (socket says 172.21.15.33:40678) 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9001220700 1 -- 172.21.15.33:0/395605046 learned_addr learned my addr 172.21.15.33:0/395605046 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f9000a1f700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ffc0b04f0 0x7f8ffc16d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.082+0000 7f8ffbfff700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ffc0cb880 0x7f8ffc0ca1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 -- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ffc0b04f0 msgr2=0x7f8ffc16d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ffc0b04f0 0x7f8ffc16d280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 -- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ffc0cb880 msgr2=0x7f8ffc0ca1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ffc0cb880 0x7f8ffc0ca1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 -- 172.21.15.33:0/395605046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ff00094f0 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9001220700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009fa0 tx=0x7f8ff4009900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff400ed20 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ff400ee80 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ffc16dc60 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ff4014670 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.083+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ffc14a540 con 0x7f8ffc0cd770 2023-10-09T15:33:14.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.084+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ffc16e180 con 0x7f8ffc0cd770 2023-10-09T15:33:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.084+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f8ff40149e0 con 0x7f8ffc0cd770 2023-10-09T15:33:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.085+0000 7f8ff8ff9700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 0x7f8fe8069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.085+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ff4084d50 con 0x7f8ffc0cd770 2023-10-09T15:33:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.085+0000 7f9000a1f700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 0x7f8fe8069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.085+0000 7f9000a1f700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 0x7f8fe8069470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fec003860 tx=0x7f8fec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.089+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ffc16e180 con 0x7f8ffc0cd770 2023-10-09T15:33:14.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.316+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvolume_0000000000563690", "mode": "777", "target": ["mon-mgr", ""]}) v1 -- 0x7f8ffc0c8760 con 0x7f8fe8066fc0 2023-10-09T15:33:14.318 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.318+0000 7f91f73a0700 -1 client.5550 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-09T15:32:37.372977+0000 mtime=2023-10-09T15:32:37.372977+0000 ctime=2023-10-09T15:32:37.382183+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000406266"] has_dir_layout 0x55c534e50000) 2023-10-09T15:33:14.322 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.321+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:33:14.322 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.321+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:33:14.323 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.321+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:33:14.323 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.321+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:33:14.323 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:33:14.321+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:33:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.349+0000 7f8ff8ff9700 1 -- 172.21.15.33:0/395605046 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f8ffc0c8760 con 0x7f8fe8066fc0 2023-10-09T15:33:14.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 msgr2=0x7f8fe8069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 0x7f8fe8069470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8fec003860 tx=0x7f8fec009040 comp rx=0 tx=0).stop 2023-10-09T15:33:14.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 msgr2=0x7f8ffc14a000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f8ff4009fa0 tx=0x7f8ff4009900 comp rx=0 tx=0).stop 2023-10-09T15:33:14.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 shutdown_connections 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8fe8066fc0 0x7f8fe8069470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ffc0cd770 0x7f8ffc14a000 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ffc0b04f0 0x7f8ffc16d280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 --2- 172.21.15.33:0/395605046 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ffc0cb880 0x7f8ffc0ca1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 >> 172.21.15.33:0/395605046 conn(0x7f8ffc0703a0 msgr2=0x7f8ffc06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 shutdown_connections 2023-10-09T15:33:14.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.352+0000 7f9002c83700 1 -- 172.21.15.33:0/395605046 wait complete. 2023-10-09T15:33:14.365 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvolume_0000000000563690 2023-10-09T15:33:14.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.487+0000 7f5eb5c84700 1 Processor -- start 2023-10-09T15:33:14.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.487+0000 7f5eb5c84700 1 -- start start 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5c84700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5eb0153dd0 0x7f5eb015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5c84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb00cea00 0x7f5eb00ceea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5c84700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eb015ac50 con 0x7f5eb0153a00 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5c84700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eb015d010 con 0x7f5eb0153dd0 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5c84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00cf3e0 con 0x7f5eb00cea00 2023-10-09T15:33:14.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb4c82700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5eb0153a00 0x7f5eb015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52944/0 (socket says 172.21.15.33:52944) 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb4c82700 1 -- 172.21.15.33:0/450396265 learned_addr learned my addr 172.21.15.33:0/450396265 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eaffff700 1 --2- 172.21.15.33:0/450396265 >> v2:172.21.15.59:3300/0 conn(0x7f5eb0153dd0 0x7f5eb015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eb5483700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb00cea00 0x7f5eb00ceea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 298041594 0 0) 0x7f5eb015ac50 con 0x7f5eb0153a00 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e98003570 con 0x7f5eb0153a00 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.488+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 810302121 0 0) 0x7f5e98003570 con 0x7f5eb0153a00 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb00cea00 msgr2=0x7f5eb00ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:14.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb00cea00 0x7f5eb00ceea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 >> v2:172.21.15.59:3300/0 conn(0x7f5eb0153dd0 msgr2=0x7f5eb015de50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 --2- 172.21.15.33:0/450396265 >> v2:172.21.15.59:3300/0 conn(0x7f5eb0153dd0 0x7f5eb015de50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb015af60 con 0x7f5eb0153a00 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5ea80017f0 con 0x7f5eb0153a00 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 >> v1:172.21.15.33:6789/0 conn(0x7f5eb0153a00 legacy=0x7f5eb015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98003a60 0x7f5e98003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98004810 0x7f5e98004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e980051c0 0x7f5e9800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb015d010 con 0x7f5e98004810 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00cf3e0 con 0x7f5e98003a60 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e9800bfa0 con 0x7f5e980051c0 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eb5483700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5eb00cea00 0x7f5eb00ceea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98004810 0x7f5e98004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eb5483700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e980051c0 0x7f5e9800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eb4c82700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98003a60 0x7f5e98003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 -- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e980051c0 msgr2=0x7f5e9800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e980051c0 0x7f5e9800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 -- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98003a60 msgr2=0x7f5e98003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98003a60 0x7f5e98003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 -- 172.21.15.33:0/450396265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e98003570 con 0x7f5e98004810 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eb5483700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e980051c0 0x7f5e9800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eb4c82700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e98003a60 0x7f5e98003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaffff700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98004810 0x7f5e98004c80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5eb015e390 tx=0x7f5ea40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ff24cd619892c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400e710 con 0x7f5e98004810 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400e870 con 0x7f5e98004810 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.489+0000 7f5eaf7fe700 1 -- 172.21.15.33:0/450396265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea400ec30 con 0x7f5e98004810 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 -- 172.21.15.33:0/450396265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98004810 msgr2=0x7f5e98004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/450396265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e98004810 0x7f5e98004c80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5eb015e390 tx=0x7f5ea40091a0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5483700 1 -- 172.21.15.33:0/450396265 reap_dead start 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 -- 172.21.15.33:0/450396265 shutdown_connections 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 -- 172.21.15.33:0/450396265 >> 172.21.15.33:0/450396265 conn(0x7f5eb00703a0 msgr2=0x7f5eb00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 -- 172.21.15.33:0/450396265 shutdown_connections 2023-10-09T15:33:14.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.490+0000 7f5eb5c84700 1 -- 172.21.15.33:0/450396265 wait complete. 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.491+0000 7f5eb5c84700 1 Processor -- start 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.491+0000 7f5eb5c84700 1 -- start start 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e98004810 0x7f5eb0157550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb00cc0e0 0x7f5eb00cc550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb016aa70 con 0x7f5eb0150780 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb01543b0 con 0x7f5eb00cc0e0 2023-10-09T15:33:14.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5c84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eb00cca90 con 0x7f5e98004810 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:40714/0 (socket says 172.21.15.33:40714) 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 -- 172.21.15.33:0/3000319491 learned_addr learned my addr 172.21.15.33:0/3000319491 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb4c82700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e98004810 0x7f5eb0157550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eb5483700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb00cc0e0 0x7f5eb00cc550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 -- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e98004810 msgr2=0x7f5eb0157550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e98004810 0x7f5eb0157550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 -- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb00cc0e0 msgr2=0x7f5eb00cc550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb00cc0e0 0x7f5eb00cc550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.492+0000 7f5eaffff700 1 -- 172.21.15.33:0/3000319491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eb0158860 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eaffff700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e980046f0 tx=0x7f5ea401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea4023070 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ea400e9e0 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eb0150bf0 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ea401e030 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.493+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eb0157c50 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.494+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eb01589f0 con 0x7f5eb0150780 2023-10-09T15:33:14.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.494+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 6) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f5ea4013470 con 0x7f5eb0150780 2023-10-09T15:33:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.494+0000 7f5eacff9700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 0x7f5e9c069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:33:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.495+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ea4085c70 con 0x7f5eb0150780 2023-10-09T15:33:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.495+0000 7f5eb4c82700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 0x7f5e9c069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:33:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.495+0000 7f5eb4c82700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 0x7f5e9c069470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80013d0 tx=0x7f5ea8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:33:14.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.499+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ea4052ef0 con 0x7f5eb0150780 2023-10-09T15:33:14.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.725+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvolume_0000000000563690", "target": ["mon-mgr", ""]}) v1 -- 0x7f5eb004c3c0 con 0x7f5e9c066fc0 2023-10-09T15:33:14.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.730+0000 7f5eacff9700 1 -- 172.21.15.33:0/3000319491 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+82 (secure 0 0 0) 0x7f5eb004c3c0 con 0x7f5e9c066fc0 2023-10-09T15:33:14.731 INFO:teuthology.orchestra.run.smithi033.stdout:/volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499 2023-10-09T15:33:14.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 msgr2=0x7f5e9c069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 0x7f5e9c069470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80013d0 tx=0x7f5ea8009040 comp rx=0 tx=0).stop 2023-10-09T15:33:14.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 msgr2=0x7f5eb016a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:33:14.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5e980046f0 tx=0x7f5ea401a000 comp rx=0 tx=0).stop 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 shutdown_connections 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e9c066fc0 0x7f5e9c069470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5eb00cc0e0 0x7f5eb00cc550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e98004810 0x7f5eb0157550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.731+0000 7f5eb5c84700 1 --2- 172.21.15.33:0/3000319491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5eb0150780 0x7f5eb016a530 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.732+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 >> 172.21.15.33:0/3000319491 conn(0x7f5eb00703a0 msgr2=0x7f5eb00d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.732+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 shutdown_connections 2023-10-09T15:33:14.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:33:14.732+0000 7f5eb5c84700 1 -- 172.21.15.33:0/3000319491 wait complete. 2023-10-09T15:33:14.745 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvolume_0000000000563690 with 3000 files each 0.1MB size under directory volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499 2023-10-09T15:33:14.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.745 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.0 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:14.768 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7957e-05 s, 0.0 kB/s 2023-10-09T15:33:14.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.769 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:14.824 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-09T15:33:14.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.825 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:14.881 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.4489e-05 s, 0.0 kB/s 2023-10-09T15:33:14.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.882 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.3 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:14.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:14.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:14.936 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0122e-05 s, 0.0 kB/s 2023-10-09T15:33:14.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.937 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.4 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:14.992 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:14.992 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:14.992 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8912e-05 s, 0.0 kB/s 2023-10-09T15:33:14.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:14.993 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.5 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.048 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9912e-05 s, 0.0 kB/s 2023-10-09T15:33:15.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.049 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.6 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.104 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0547e-05 s, 0.0 kB/s 2023-10-09T15:33:15.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.104 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.7 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2768e-05 s, 0.0 kB/s 2023-10-09T15:33:15.159 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.160 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.8 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1626e-05 s, 0.0 kB/s 2023-10-09T15:33:15.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.216 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.9 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.271 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.325e-05 s, 0.0 kB/s 2023-10-09T15:33:15.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.272 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.10 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.327 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1938e-05 s, 0.0 kB/s 2023-10-09T15:33:15.327 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.328 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.11 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.383 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.383 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.383 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2611e-05 s, 0.0 kB/s 2023-10-09T15:33:15.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.384 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.12 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.439 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0577e-05 s, 0.0 kB/s 2023-10-09T15:33:15.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.439 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.13 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.495 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.959e-05 s, 0.0 kB/s 2023-10-09T15:33:15.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.495 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.14 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.551 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9703e-05 s, 0.0 kB/s 2023-10-09T15:33:15.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.552 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.15 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.607 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1557e-05 s, 0.0 kB/s 2023-10-09T15:33:15.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.607 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.16 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.162e-05 s, 0.0 kB/s 2023-10-09T15:33:15.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.664 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.17 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.719 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0267e-05 s, 0.0 kB/s 2023-10-09T15:33:15.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.720 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.18 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.776 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0294e-05 s, 0.0 kB/s 2023-10-09T15:33:15.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.776 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.19 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.831 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2198e-05 s, 0.0 kB/s 2023-10-09T15:33:15.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.832 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.20 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-09T15:33:15.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.21 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.943 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:15.943 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:15.943 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9903e-05 s, 0.0 kB/s 2023-10-09T15:33:15.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:15.944 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.22 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1417e-05 s, 0.0 kB/s 2023-10-09T15:33:16.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.23 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.055 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.055 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.055 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2179e-05 s, 0.0 kB/s 2023-10-09T15:33:16.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.24 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0348e-05 s, 0.0 kB/s 2023-10-09T15:33:16.111 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.111 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.25 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.167 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0367e-05 s, 0.0 kB/s 2023-10-09T15:33:16.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.168 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.26 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.223 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2919e-05 s, 0.0 kB/s 2023-10-09T15:33:16.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.224 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.27 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.279 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.280 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2186e-05 s, 0.0 kB/s 2023-10-09T15:33:16.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.280 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.28 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.335 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4923e-05 s, 0.0 kB/s 2023-10-09T15:33:16.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.336 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.29 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.391 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.392 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0066e-05 s, 0.0 kB/s 2023-10-09T15:33:16.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.392 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.30 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.447 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-09T15:33:16.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.448 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.31 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.503 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9906e-05 s, 0.0 kB/s 2023-10-09T15:33:16.503 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.504 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.32 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.559 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1638e-05 s, 0.0 kB/s 2023-10-09T15:33:16.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.560 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.33 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.616 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1768e-05 s, 0.0 kB/s 2023-10-09T15:33:16.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.616 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.34 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.671 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2489e-05 s, 0.0 kB/s 2023-10-09T15:33:16.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.672 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.35 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.727 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9683e-05 s, 0.0 kB/s 2023-10-09T15:33:16.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.728 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.36 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0835e-05 s, 0.0 kB/s 2023-10-09T15:33:16.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.784 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.37 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.099e-05 s, 0.0 kB/s 2023-10-09T15:33:16.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.38 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.896 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9577e-05 s, 0.0 kB/s 2023-10-09T15:33:16.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.896 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.39 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:16.951 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2438e-05 s, 0.0 kB/s 2023-10-09T15:33:16.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:16.952 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.40 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-09T15:33:17.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.41 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.064 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0283e-05 s, 0.0 kB/s 2023-10-09T15:33:17.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.064 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.42 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7143e-05 s, 0.0 kB/s 2023-10-09T15:33:17.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.43 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2666e-05 s, 0.0 kB/s 2023-10-09T15:33:17.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.176 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.44 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2725e-05 s, 0.0 kB/s 2023-10-09T15:33:17.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.232 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.45 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.288 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3952e-05 s, 0.0 kB/s 2023-10-09T15:33:17.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.46 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.345 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4529e-05 s, 0.0 kB/s 2023-10-09T15:33:17.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.345 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.47 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4553e-05 s, 0.0 kB/s 2023-10-09T15:33:17.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.48 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.77e-05 s, 0.0 kB/s 2023-10-09T15:33:17.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.458 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.49 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9238e-05 s, 0.0 kB/s 2023-10-09T15:33:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.515 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.50 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.570 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3814e-05 s, 0.0 kB/s 2023-10-09T15:33:17.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.571 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.51 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4953e-05 s, 0.0 kB/s 2023-10-09T15:33:17.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.626 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.52 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3709e-05 s, 0.0 kB/s 2023-10-09T15:33:17.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.682 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.53 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.737 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.738 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3161e-05 s, 0.0 kB/s 2023-10-09T15:33:17.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.738 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.54 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.794 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.064e-05 s, 0.0 kB/s 2023-10-09T15:33:17.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.794 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.55 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.849 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5896e-05 s, 0.0 kB/s 2023-10-09T15:33:17.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.850 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.56 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1293e-05 s, 0.0 kB/s 2023-10-09T15:33:17.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.906 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.57 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:17.962 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:17.962 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:17.962 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3175e-05 s, 0.0 kB/s 2023-10-09T15:33:17.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:17.963 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.58 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.018 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2989e-05 s, 0.0 kB/s 2023-10-09T15:33:18.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.019 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.59 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1417e-05 s, 0.0 kB/s 2023-10-09T15:33:18.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.60 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.130 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.130 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.130 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9224e-05 s, 0.0 kB/s 2023-10-09T15:33:18.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.130 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.61 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3158e-05 s, 0.0 kB/s 2023-10-09T15:33:18.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.186 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.62 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1087e-05 s, 0.0 kB/s 2023-10-09T15:33:18.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.243 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.63 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1387e-05 s, 0.0 kB/s 2023-10-09T15:33:18.299 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.299 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.64 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.355 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1983e-05 s, 0.0 kB/s 2023-10-09T15:33:18.355 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.355 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.65 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-09T15:33:18.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.412 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.66 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.467 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.468 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-09T15:33:18.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.468 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.67 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.523 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.524 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2853e-05 s, 0.0 kB/s 2023-10-09T15:33:18.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.524 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.68 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9334e-05 s, 0.0 kB/s 2023-10-09T15:33:18.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.580 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.69 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.635 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8664e-05 s, 0.0 kB/s 2023-10-09T15:33:18.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.636 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.70 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.692 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.692 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9318e-05 s, 0.0 kB/s 2023-10-09T15:33:18.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.692 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.71 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.748 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-09T15:33:18.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.749 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.72 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.7772e-05 s, 0.0 kB/s 2023-10-09T15:33:18.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.73 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0417e-05 s, 0.0 kB/s 2023-10-09T15:33:18.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.74 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-09T15:33:18.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.75 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:18.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:18.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:18.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9519e-05 s, 0.0 kB/s 2023-10-09T15:33:18.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:18.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.76 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0938e-05 s, 0.0 kB/s 2023-10-09T15:33:19.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.031 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.77 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1086e-05 s, 0.0 kB/s 2023-10-09T15:33:19.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.78 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9589e-05 s, 0.0 kB/s 2023-10-09T15:33:19.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.79 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.199 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1537e-05 s, 0.0 kB/s 2023-10-09T15:33:19.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.80 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.255 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.255 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1071e-05 s, 0.0 kB/s 2023-10-09T15:33:19.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.81 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1551e-05 s, 0.0 kB/s 2023-10-09T15:33:19.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.82 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2989e-05 s, 0.0 kB/s 2023-10-09T15:33:19.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.367 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.83 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.423 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5848e-05 s, 0.0 kB/s 2023-10-09T15:33:19.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.424 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.84 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.480 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.042e-05 s, 0.0 kB/s 2023-10-09T15:33:19.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.480 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.85 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.537 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-09T15:33:19.537 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.537 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.86 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.592 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.592 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.593 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1126e-05 s, 0.0 kB/s 2023-10-09T15:33:19.593 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.593 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.87 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.648 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.649 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8552e-05 s, 0.0 kB/s 2023-10-09T15:33:19.649 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.649 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.88 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.704 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.705 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3383e-05 s, 0.0 kB/s 2023-10-09T15:33:19.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.705 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.89 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.761 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3919e-05 s, 0.0 kB/s 2023-10-09T15:33:19.761 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.761 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.90 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.816 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.817 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.7975e-05 s, 0.0 kB/s 2023-10-09T15:33:19.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.817 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.91 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.872 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.873 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0163e-05 s, 0.0 kB/s 2023-10-09T15:33:19.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.873 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.92 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.929 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2733e-05 s, 0.0 kB/s 2023-10-09T15:33:19.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.930 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.93 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:19.984 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3667e-05 s, 0.0 kB/s 2023-10-09T15:33:19.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:19.985 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.94 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3956e-05 s, 0.0 kB/s 2023-10-09T15:33:20.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.041 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.95 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9743e-05 s, 0.0 kB/s 2023-10-09T15:33:20.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.097 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.96 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.152 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1489e-05 s, 0.0 kB/s 2023-10-09T15:33:20.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.153 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.97 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.208 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.209 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0449e-05 s, 0.0 kB/s 2023-10-09T15:33:20.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.209 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.98 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.264 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0014e-05 s, 0.0 kB/s 2023-10-09T15:33:20.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.265 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.99 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.321 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0981e-05 s, 0.0 kB/s 2023-10-09T15:33:20.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.321 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.378 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.378 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1714e-05 s, 0.0 kB/s 2023-10-09T15:33:20.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.434 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.434 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.434 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1947e-05 s, 0.0 kB/s 2023-10-09T15:33:20.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.435 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.490 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.490 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.490 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4282e-05 s, 0.0 kB/s 2023-10-09T15:33:20.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.491 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.547 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4079e-05 s, 0.0 kB/s 2023-10-09T15:33:20.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.548 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.604 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-09T15:33:20.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.661 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.661 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.661 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2906e-05 s, 0.0 kB/s 2023-10-09T15:33:20.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.662 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.718 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.718 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.718 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1493e-05 s, 0.0 kB/s 2023-10-09T15:33:20.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.719 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.775 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0345e-05 s, 0.0 kB/s 2023-10-09T15:33:20.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.776 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.832 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9823e-05 s, 0.0 kB/s 2023-10-09T15:33:20.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.832 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9826e-05 s, 0.0 kB/s 2023-10-09T15:33:20.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.943 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.944 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2444e-05 s, 0.0 kB/s 2023-10-09T15:33:20.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:20.944 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:20.999 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1508e-05 s, 0.0 kB/s 2023-10-09T15:33:21.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1039e-05 s, 0.0 kB/s 2023-10-09T15:33:21.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.112 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2399e-05 s, 0.0 kB/s 2023-10-09T15:33:21.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.112 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.168 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2095e-05 s, 0.0 kB/s 2023-10-09T15:33:21.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.168 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.224 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1727e-05 s, 0.0 kB/s 2023-10-09T15:33:21.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0849e-05 s, 0.0 kB/s 2023-10-09T15:33:21.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.337 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0857e-05 s, 0.0 kB/s 2023-10-09T15:33:21.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.338 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0902e-05 s, 0.0 kB/s 2023-10-09T15:33:21.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.394 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.450 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2794e-05 s, 0.0 kB/s 2023-10-09T15:33:21.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.450 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.505 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.17e-05 s, 0.0 kB/s 2023-10-09T15:33:21.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.506 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.562 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-09T15:33:21.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.562 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1062e-05 s, 0.0 kB/s 2023-10-09T15:33:21.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.618 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.674 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3781e-05 s, 0.0 kB/s 2023-10-09T15:33:21.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.674 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.730 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9779e-05 s, 0.0 kB/s 2023-10-09T15:33:21.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.730 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.786 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.7387e-05 s, 0.0 kB/s 2023-10-09T15:33:21.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.786 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.841 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1407e-05 s, 0.0 kB/s 2023-10-09T15:33:21.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.842 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.897 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9121e-05 s, 0.0 kB/s 2023-10-09T15:33:21.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.898 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:21.953 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:21.990 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:21.991 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8953e-05 s, 0.0 kB/s 2023-10-09T15:33:21.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:21.991 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-09T15:33:22.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.063 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8635e-05 s, 0.0 kB/s 2023-10-09T15:33:22.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.064 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.119 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1614e-05 s, 0.0 kB/s 2023-10-09T15:33:22.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.119 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.176 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1906e-05 s, 0.0 kB/s 2023-10-09T15:33:22.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.176 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.232 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1354e-05 s, 0.0 kB/s 2023-10-09T15:33:22.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.233 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0924e-05 s, 0.0 kB/s 2023-10-09T15:33:22.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.345 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1646e-05 s, 0.0 kB/s 2023-10-09T15:33:22.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.345 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.400 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0161e-05 s, 0.0 kB/s 2023-10-09T15:33:22.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.401 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.456 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.456 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.456 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8987e-05 s, 0.0 kB/s 2023-10-09T15:33:22.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.457 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.512 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1621e-05 s, 0.0 kB/s 2023-10-09T15:33:22.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.512 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.567 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1729e-05 s, 0.0 kB/s 2023-10-09T15:33:22.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.567 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.623 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9662e-05 s, 0.0 kB/s 2023-10-09T15:33:22.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-09T15:33:22.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.678 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.733 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.7918e-05 s, 0.0 kB/s 2023-10-09T15:33:22.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.734 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.212e-05 s, 0.0 kB/s 2023-10-09T15:33:22.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.790 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.846 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.371e-05 s, 0.0 kB/s 2023-10-09T15:33:22.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.846 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.902 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-09T15:33:22.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.903 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9952e-05 s, 0.0 kB/s 2023-10-09T15:33:22.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:22.958 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0361e-05 s, 0.0 kB/s 2023-10-09T15:33:23.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.015 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0391e-05 s, 0.0 kB/s 2023-10-09T15:33:23.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.070 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.126 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.193e-05 s, 0.0 kB/s 2023-10-09T15:33:23.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.126 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.182 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0675e-05 s, 0.0 kB/s 2023-10-09T15:33:23.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.183 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0257e-05 s, 0.0 kB/s 2023-10-09T15:33:23.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.239 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.294 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2441e-05 s, 0.0 kB/s 2023-10-09T15:33:23.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.295 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9756e-05 s, 0.0 kB/s 2023-10-09T15:33:23.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.351 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.407 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3259e-05 s, 0.0 kB/s 2023-10-09T15:33:23.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.408 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1229e-05 s, 0.0 kB/s 2023-10-09T15:33:23.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.464 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.519 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8905e-05 s, 0.0 kB/s 2023-10-09T15:33:23.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.520 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-09T15:33:23.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.576 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.631 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0525e-05 s, 0.0 kB/s 2023-10-09T15:33:23.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.631 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.689 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3184e-05 s, 0.0 kB/s 2023-10-09T15:33:23.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.689 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9584e-05 s, 0.0 kB/s 2023-10-09T15:33:23.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.744 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4244e-05 s, 0.0 kB/s 2023-10-09T15:33:23.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1048e-05 s, 0.0 kB/s 2023-10-09T15:33:23.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.854 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3199e-05 s, 0.0 kB/s 2023-10-09T15:33:23.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:23.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:23.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:23.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2494e-05 s, 0.0 kB/s 2023-10-09T15:33:23.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:23.966 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0076e-05 s, 0.0 kB/s 2023-10-09T15:33:24.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.023 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0616e-05 s, 0.0 kB/s 2023-10-09T15:33:24.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.079 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-09T15:33:24.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.135 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.034e-05 s, 0.0 kB/s 2023-10-09T15:33:24.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.191 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3788e-05 s, 0.0 kB/s 2023-10-09T15:33:24.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.247 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.304 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3631e-05 s, 0.0 kB/s 2023-10-09T15:33:24.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.305 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.361 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.361 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.361 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2796e-05 s, 0.0 kB/s 2023-10-09T15:33:24.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.361 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.416 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0269e-05 s, 0.0 kB/s 2023-10-09T15:33:24.417 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.417 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.472 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2041e-05 s, 0.0 kB/s 2023-10-09T15:33:24.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.473 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.528 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1171e-05 s, 0.0 kB/s 2023-10-09T15:33:24.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.529 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.585 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9976e-05 s, 0.0 kB/s 2023-10-09T15:33:24.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.585 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.640 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0786e-05 s, 0.0 kB/s 2023-10-09T15:33:24.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.641 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.697 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.226e-05 s, 0.0 kB/s 2023-10-09T15:33:24.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.697 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9765e-05 s, 0.0 kB/s 2023-10-09T15:33:24.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.753 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-09T15:33:24.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.809 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.865 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0352e-05 s, 0.0 kB/s 2023-10-09T15:33:24.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.865 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.921 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.921 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.921 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8459e-05 s, 0.0 kB/s 2023-10-09T15:33:24.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.921 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:24.977 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.411e-05 s, 0.0 kB/s 2023-10-09T15:33:24.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:24.977 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.032 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.033 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.033 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.016e-05 s, 0.0 kB/s 2023-10-09T15:33:25.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.033 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.088 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.088 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.089 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-09T15:33:25.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.089 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0875e-05 s, 0.0 kB/s 2023-10-09T15:33:25.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.145 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.201 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0421e-05 s, 0.0 kB/s 2023-10-09T15:33:25.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0151e-05 s, 0.0 kB/s 2023-10-09T15:33:25.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.258 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.312 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.313 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-09T15:33:25.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.313 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.369 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.370 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.081e-05 s, 0.0 kB/s 2023-10-09T15:33:25.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.370 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.426 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9994e-05 s, 0.0 kB/s 2023-10-09T15:33:25.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.426 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.482 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1114e-05 s, 0.0 kB/s 2023-10-09T15:33:25.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.145e-05 s, 0.0 kB/s 2023-10-09T15:33:25.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.594 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0098e-05 s, 0.0 kB/s 2023-10-09T15:33:25.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.650 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9389e-05 s, 0.0 kB/s 2023-10-09T15:33:25.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.706 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3025e-05 s, 0.0 kB/s 2023-10-09T15:33:25.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.706 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.762 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4984e-05 s, 0.0 kB/s 2023-10-09T15:33:25.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.818 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9846e-05 s, 0.0 kB/s 2023-10-09T15:33:25.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.818 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.874 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0618e-05 s, 0.0 kB/s 2023-10-09T15:33:25.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.874 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.929 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-09T15:33:25.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.930 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:25.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:25.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:25.985 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9421e-05 s, 0.0 kB/s 2023-10-09T15:33:25.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:25.986 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0047e-05 s, 0.0 kB/s 2023-10-09T15:33:26.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.042 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2496e-05 s, 0.0 kB/s 2023-10-09T15:33:26.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.097 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9808e-05 s, 0.0 kB/s 2023-10-09T15:33:26.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.153 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.209 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9226e-05 s, 0.0 kB/s 2023-10-09T15:33:26.209 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1384e-05 s, 0.0 kB/s 2023-10-09T15:33:26.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.266 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.321 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4148e-05 s, 0.0 kB/s 2023-10-09T15:33:26.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.321 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.378 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.378 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.378 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5283e-05 s, 0.0 kB/s 2023-10-09T15:33:26.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.433 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1254e-05 s, 0.0 kB/s 2023-10-09T15:33:26.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.433 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.489 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0389e-05 s, 0.0 kB/s 2023-10-09T15:33:26.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.489 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.545 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3087e-05 s, 0.0 kB/s 2023-10-09T15:33:26.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.545 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.600 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.600 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.600 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9649e-05 s, 0.0 kB/s 2023-10-09T15:33:26.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.601 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.656 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.656 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.656 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2877e-05 s, 0.0 kB/s 2023-10-09T15:33:26.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.657 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.712 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.712 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.712 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1482e-05 s, 0.0 kB/s 2023-10-09T15:33:26.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.712 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.767 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.767 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.767 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0606e-05 s, 0.0 kB/s 2023-10-09T15:33:26.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.768 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.823 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.823 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.823 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9598e-05 s, 0.0 kB/s 2023-10-09T15:33:26.824 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.824 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.879 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.879 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.879 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0333e-05 s, 0.0 kB/s 2023-10-09T15:33:26.880 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.880 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.936 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1668e-05 s, 0.0 kB/s 2023-10-09T15:33:26.936 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.936 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:26.991 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:26.992 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9784e-05 s, 0.0 kB/s 2023-10-09T15:33:26.992 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:26.993 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.047 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9581e-05 s, 0.0 kB/s 2023-10-09T15:33:27.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.048 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.103 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.104 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8551e-05 s, 0.0 kB/s 2023-10-09T15:33:27.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.104 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.160 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3336e-05 s, 0.0 kB/s 2023-10-09T15:33:27.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.161 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.216 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9409e-05 s, 0.0 kB/s 2023-10-09T15:33:27.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.216 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.271 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.271 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.272 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9605e-05 s, 0.0 kB/s 2023-10-09T15:33:27.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.272 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.328 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4032e-05 s, 0.0 kB/s 2023-10-09T15:33:27.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.385 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2103e-05 s, 0.0 kB/s 2023-10-09T15:33:27.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.385 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.440 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0408e-05 s, 0.0 kB/s 2023-10-09T15:33:27.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.440 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.496 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2874e-05 s, 0.0 kB/s 2023-10-09T15:33:27.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.496 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.552 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0968e-05 s, 0.0 kB/s 2023-10-09T15:33:27.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.552 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.607 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-09T15:33:27.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.608 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.663 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1098e-05 s, 0.0 kB/s 2023-10-09T15:33:27.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.663 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.719 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0748e-05 s, 0.0 kB/s 2023-10-09T15:33:27.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.720 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.775 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1669e-05 s, 0.0 kB/s 2023-10-09T15:33:27.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.775 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.829 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0615e-05 s, 0.0 kB/s 2023-10-09T15:33:27.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.830 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.885 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.214e-05 s, 0.0 kB/s 2023-10-09T15:33:27.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.886 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.942 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.972e-05 s, 0.0 kB/s 2023-10-09T15:33:27.942 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.942 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:27.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:27.997 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:27.997 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.2202e-05 s, 0.0 kB/s 2023-10-09T15:33:27.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:27.997 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.051 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0612e-05 s, 0.0 kB/s 2023-10-09T15:33:28.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.052 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.108 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.108 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-09T15:33:28.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.109 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.164 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.164 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.164 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0507e-05 s, 0.0 kB/s 2023-10-09T15:33:28.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.164 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4114e-05 s, 0.0 kB/s 2023-10-09T15:33:28.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.275 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1655e-05 s, 0.0 kB/s 2023-10-09T15:33:28.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.275 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.331 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5179e-05 s, 0.0 kB/s 2023-10-09T15:33:28.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1667e-05 s, 0.0 kB/s 2023-10-09T15:33:28.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.388 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.443 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-09T15:33:28.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.444 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.500 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3652e-05 s, 0.0 kB/s 2023-10-09T15:33:28.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.501 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.556 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0766e-05 s, 0.0 kB/s 2023-10-09T15:33:28.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.556 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.611 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.154e-05 s, 0.0 kB/s 2023-10-09T15:33:28.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.612 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.668 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2113e-05 s, 0.0 kB/s 2023-10-09T15:33:28.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.668 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.723 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.723 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.723 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.15e-05 s, 0.0 kB/s 2023-10-09T15:33:28.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.237e-05 s, 0.0 kB/s 2023-10-09T15:33:28.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.778 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.833 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0226e-05 s, 0.0 kB/s 2023-10-09T15:33:28.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3585e-05 s, 0.0 kB/s 2023-10-09T15:33:28.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:28.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:28.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:28.944 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-09T15:33:28.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:28.945 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2067e-05 s, 0.0 kB/s 2023-10-09T15:33:29.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.054 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.055 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.055 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1676e-05 s, 0.0 kB/s 2023-10-09T15:33:29.055 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.055 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.110 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0804e-05 s, 0.0 kB/s 2023-10-09T15:33:29.110 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.110 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.164 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.164 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3152e-05 s, 0.0 kB/s 2023-10-09T15:33:29.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.166 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.220 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3049e-05 s, 0.0 kB/s 2023-10-09T15:33:29.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.221 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.278 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0703e-05 s, 0.0 kB/s 2023-10-09T15:33:29.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.278 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.333 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3746e-05 s, 0.0 kB/s 2023-10-09T15:33:29.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.334 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.389 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1349e-05 s, 0.0 kB/s 2023-10-09T15:33:29.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.390 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.445 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9895e-05 s, 0.0 kB/s 2023-10-09T15:33:29.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.445 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.501 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.501 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.501 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0205e-05 s, 0.0 kB/s 2023-10-09T15:33:29.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.501 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.556 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1208e-05 s, 0.0 kB/s 2023-10-09T15:33:29.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.557 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.613 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9642e-05 s, 0.0 kB/s 2023-10-09T15:33:29.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.613 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.669 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8515e-05 s, 0.0 kB/s 2023-10-09T15:33:29.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.669 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.725 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3202e-05 s, 0.0 kB/s 2023-10-09T15:33:29.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.725 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.781 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.781 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.781 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0403e-05 s, 0.0 kB/s 2023-10-09T15:33:29.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.781 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.837 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.458e-05 s, 0.0 kB/s 2023-10-09T15:33:29.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.838 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.892 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9907e-05 s, 0.0 kB/s 2023-10-09T15:33:29.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.893 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:29.949 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:29.949 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:29.949 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4376e-05 s, 0.0 kB/s 2023-10-09T15:33:29.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:29.949 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.004 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0909e-05 s, 0.0 kB/s 2023-10-09T15:33:30.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.004 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2222e-05 s, 0.0 kB/s 2023-10-09T15:33:30.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.060 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.115 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.115 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.115 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0939e-05 s, 0.0 kB/s 2023-10-09T15:33:30.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.115 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.115e-05 s, 0.0 kB/s 2023-10-09T15:33:30.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.170 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.225 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3151e-05 s, 0.0 kB/s 2023-10-09T15:33:30.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0829e-05 s, 0.0 kB/s 2023-10-09T15:33:30.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.282 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.337 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0277e-05 s, 0.0 kB/s 2023-10-09T15:33:30.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.338 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.394 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4801e-05 s, 0.0 kB/s 2023-10-09T15:33:30.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.394 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.449 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-09T15:33:30.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.505 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-09T15:33:30.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.506 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.561 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9723e-05 s, 0.0 kB/s 2023-10-09T15:33:30.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.561 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.617 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.7902e-05 s, 0.0 kB/s 2023-10-09T15:33:30.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.671 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.671 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.972e-05 s, 0.0 kB/s 2023-10-09T15:33:30.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.673 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.727 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6981e-05 s, 0.0 kB/s 2023-10-09T15:33:30.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.728 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0261e-05 s, 0.0 kB/s 2023-10-09T15:33:30.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.784 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8627e-05 s, 0.0 kB/s 2023-10-09T15:33:30.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.895 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0302e-05 s, 0.0 kB/s 2023-10-09T15:33:30.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.895 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:30.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:30.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:30.950 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0948e-05 s, 0.0 kB/s 2023-10-09T15:33:30.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:30.951 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.006 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2187e-05 s, 0.0 kB/s 2023-10-09T15:33:31.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.007 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.062 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.062 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.062 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9415e-05 s, 0.0 kB/s 2023-10-09T15:33:31.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.063 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.118 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.118 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.118 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9972e-05 s, 0.0 kB/s 2023-10-09T15:33:31.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.118 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.173 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9223e-05 s, 0.0 kB/s 2023-10-09T15:33:31.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.173 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.229 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.229 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.229 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9993e-05 s, 0.0 kB/s 2023-10-09T15:33:31.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.230 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.285 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2187e-05 s, 0.0 kB/s 2023-10-09T15:33:31.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.286 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.341 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9831e-05 s, 0.0 kB/s 2023-10-09T15:33:31.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.342 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.399 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0911e-05 s, 0.0 kB/s 2023-10-09T15:33:31.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.399 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2452e-05 s, 0.0 kB/s 2023-10-09T15:33:31.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.455 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.510 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5158e-05 s, 0.0 kB/s 2023-10-09T15:33:31.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.511 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.566 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2589e-05 s, 0.0 kB/s 2023-10-09T15:33:31.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.566 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.622 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9453e-05 s, 0.0 kB/s 2023-10-09T15:33:31.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3675e-05 s, 0.0 kB/s 2023-10-09T15:33:31.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.679 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.734 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4993e-05 s, 0.0 kB/s 2023-10-09T15:33:31.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.734 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.790 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.791 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-09T15:33:31.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.791 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.847 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4229e-05 s, 0.0 kB/s 2023-10-09T15:33:31.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.847 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.903 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2609e-05 s, 0.0 kB/s 2023-10-09T15:33:31.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.903 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:31.959 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3902e-05 s, 0.0 kB/s 2023-10-09T15:33:31.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:31.960 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.015 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0977e-05 s, 0.0 kB/s 2023-10-09T15:33:32.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.016 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.071 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2187e-05 s, 0.0 kB/s 2023-10-09T15:33:32.072 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.072 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.127 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.127 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.127 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3014e-05 s, 0.0 kB/s 2023-10-09T15:33:32.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.127 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.183 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3055e-05 s, 0.0 kB/s 2023-10-09T15:33:32.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.184 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2758e-05 s, 0.0 kB/s 2023-10-09T15:33:32.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.241 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.35e-05 s, 0.0 kB/s 2023-10-09T15:33:32.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.298 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.353 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2684e-05 s, 0.0 kB/s 2023-10-09T15:33:32.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.354 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.412 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4223e-05 s, 0.0 kB/s 2023-10-09T15:33:32.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.412 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.467 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.467 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.467 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3814e-05 s, 0.0 kB/s 2023-10-09T15:33:32.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.468 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1373e-05 s, 0.0 kB/s 2023-10-09T15:33:32.524 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.524 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.580 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2425e-05 s, 0.0 kB/s 2023-10-09T15:33:32.580 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.580 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0632e-05 s, 0.0 kB/s 2023-10-09T15:33:32.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.635 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.691 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2511e-05 s, 0.0 kB/s 2023-10-09T15:33:32.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.692 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.747 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-09T15:33:32.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.748 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.803 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.803 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.803 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-09T15:33:32.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.804 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.859 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.859 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.859 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1076e-05 s, 0.0 kB/s 2023-10-09T15:33:32.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.859 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.914 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3373e-05 s, 0.0 kB/s 2023-10-09T15:33:32.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.915 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:32.970 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:32.970 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:32.970 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0736e-05 s, 0.0 kB/s 2023-10-09T15:33:32.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:32.971 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.026 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.026 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.026 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2365e-05 s, 0.0 kB/s 2023-10-09T15:33:33.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.027 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.083 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.225e-05 s, 0.0 kB/s 2023-10-09T15:33:33.083 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.083 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.138 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1506e-05 s, 0.0 kB/s 2023-10-09T15:33:33.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.138 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.193 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9265e-05 s, 0.0 kB/s 2023-10-09T15:33:33.193 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.193 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.249 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0136e-05 s, 0.0 kB/s 2023-10-09T15:33:33.249 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.250 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.305 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2664e-05 s, 0.0 kB/s 2023-10-09T15:33:33.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.305 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.361 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.361 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.361 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.304e-05 s, 0.0 kB/s 2023-10-09T15:33:33.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.362 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.418 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.418 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.418 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2865e-05 s, 0.0 kB/s 2023-10-09T15:33:33.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.418 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.473 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.473 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.473 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3614e-05 s, 0.0 kB/s 2023-10-09T15:33:33.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.474 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.529 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1244e-05 s, 0.0 kB/s 2023-10-09T15:33:33.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.529 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.585 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2726e-05 s, 0.0 kB/s 2023-10-09T15:33:33.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.585 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.641 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.641 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.641 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9152e-05 s, 0.0 kB/s 2023-10-09T15:33:33.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.641 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0147e-05 s, 0.0 kB/s 2023-10-09T15:33:33.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.697 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.753 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.872e-05 s, 0.0 kB/s 2023-10-09T15:33:33.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.753 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2525e-05 s, 0.0 kB/s 2023-10-09T15:33:33.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.809 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.096e-05 s, 0.0 kB/s 2023-10-09T15:33:33.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-09T15:33:33.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:33.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:33.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:33.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3489e-05 s, 0.0 kB/s 2023-10-09T15:33:33.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:33.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.324e-05 s, 0.0 kB/s 2023-10-09T15:33:34.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.031 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1939e-05 s, 0.0 kB/s 2023-10-09T15:33:34.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.088 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.144 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3496e-05 s, 0.0 kB/s 2023-10-09T15:33:34.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.145 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.200 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0903e-05 s, 0.0 kB/s 2023-10-09T15:33:34.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.258 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2531e-05 s, 0.0 kB/s 2023-10-09T15:33:34.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.258 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.315 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0333e-05 s, 0.0 kB/s 2023-10-09T15:33:34.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.372 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-09T15:33:34.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.428 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1722e-05 s, 0.0 kB/s 2023-10-09T15:33:34.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-09T15:33:34.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2745e-05 s, 0.0 kB/s 2023-10-09T15:33:34.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4267e-05 s, 0.0 kB/s 2023-10-09T15:33:34.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.651 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1623e-05 s, 0.0 kB/s 2023-10-09T15:33:34.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.708 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3698e-05 s, 0.0 kB/s 2023-10-09T15:33:34.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.763 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3768e-05 s, 0.0 kB/s 2023-10-09T15:33:34.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.764 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.820 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1629e-05 s, 0.0 kB/s 2023-10-09T15:33:34.821 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.821 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3501e-05 s, 0.0 kB/s 2023-10-09T15:33:34.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.933 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.933 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0718e-05 s, 0.0 kB/s 2023-10-09T15:33:34.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.933 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:34.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:34.989 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.993e-05 s, 0.0 kB/s 2023-10-09T15:33:34.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:34.989 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.044 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.045 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.359e-05 s, 0.0 kB/s 2023-10-09T15:33:35.045 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.045 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.100 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.101 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4889e-05 s, 0.0 kB/s 2023-10-09T15:33:35.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.101 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.156 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.29e-05 s, 0.0 kB/s 2023-10-09T15:33:35.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.157 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.213 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0408e-05 s, 0.0 kB/s 2023-10-09T15:33:35.213 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.213 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.269 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0498e-05 s, 0.0 kB/s 2023-10-09T15:33:35.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.115e-05 s, 0.0 kB/s 2023-10-09T15:33:35.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.146e-05 s, 0.0 kB/s 2023-10-09T15:33:35.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.381 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.437 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.437 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.437 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4405e-05 s, 0.0 kB/s 2023-10-09T15:33:35.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.494 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3739e-05 s, 0.0 kB/s 2023-10-09T15:33:35.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.494 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.551 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2175e-05 s, 0.0 kB/s 2023-10-09T15:33:35.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.551 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.606 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4005e-05 s, 0.0 kB/s 2023-10-09T15:33:35.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.607 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.662 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.662 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.662 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0825e-05 s, 0.0 kB/s 2023-10-09T15:33:35.663 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.663 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.719 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0229e-05 s, 0.0 kB/s 2023-10-09T15:33:35.719 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.719 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.775 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1924e-05 s, 0.0 kB/s 2023-10-09T15:33:35.775 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.775 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.830 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.830 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.830 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0562e-05 s, 0.0 kB/s 2023-10-09T15:33:35.831 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.831 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.887 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1309e-05 s, 0.0 kB/s 2023-10-09T15:33:35.887 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.887 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.943 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3575e-05 s, 0.0 kB/s 2023-10-09T15:33:35.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.943 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:35.998 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:35.998 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:35.999 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2124e-05 s, 0.0 kB/s 2023-10-09T15:33:35.999 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:35.999 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.023 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:33:36.042 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:33:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.055 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.32e-05 s, 0.0 kB/s 2023-10-09T15:33:36.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5497e-05 s, 0.0 kB/s 2023-10-09T15:33:36.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.112 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.169 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4274e-05 s, 0.0 kB/s 2023-10-09T15:33:36.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.169 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.224 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0911e-05 s, 0.0 kB/s 2023-10-09T15:33:36.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2997e-05 s, 0.0 kB/s 2023-10-09T15:33:36.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.337 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1677e-05 s, 0.0 kB/s 2023-10-09T15:33:36.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.337 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4117e-05 s, 0.0 kB/s 2023-10-09T15:33:36.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.393 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.449 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3897e-05 s, 0.0 kB/s 2023-10-09T15:33:36.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.506 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2524e-05 s, 0.0 kB/s 2023-10-09T15:33:36.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.506 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.562 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.382e-05 s, 0.0 kB/s 2023-10-09T15:33:36.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.562 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-09T15:33:36.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.618 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.673 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2795e-05 s, 0.0 kB/s 2023-10-09T15:33:36.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.674 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.730 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1366e-05 s, 0.0 kB/s 2023-10-09T15:33:36.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.730 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.786 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.786 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1927e-05 s, 0.0 kB/s 2023-10-09T15:33:36.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.786 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.842 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1563e-05 s, 0.0 kB/s 2023-10-09T15:33:36.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.842 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.898 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1561e-05 s, 0.0 kB/s 2023-10-09T15:33:36.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.898 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2453e-05 s, 0.0 kB/s 2023-10-09T15:33:36.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:36.954 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.009 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.010 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.365e-05 s, 0.0 kB/s 2023-10-09T15:33:37.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.010 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.065 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.066 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1292e-05 s, 0.0 kB/s 2023-10-09T15:33:37.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.066 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.121 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0542e-05 s, 0.0 kB/s 2023-10-09T15:33:37.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.122 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.177 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1488e-05 s, 0.0 kB/s 2023-10-09T15:33:37.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.178 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.233 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.233 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.233 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.231e-05 s, 0.0 kB/s 2023-10-09T15:33:37.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.234 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.290 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3931e-05 s, 0.0 kB/s 2023-10-09T15:33:37.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.290 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2974e-05 s, 0.0 kB/s 2023-10-09T15:33:37.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.401 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2345e-05 s, 0.0 kB/s 2023-10-09T15:33:37.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.458 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-09T15:33:37.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.459 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.515 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2245e-05 s, 0.0 kB/s 2023-10-09T15:33:37.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.515 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.571 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1438e-05 s, 0.0 kB/s 2023-10-09T15:33:37.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.571 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.627 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-09T15:33:37.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.627 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.682 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.35e-05 s, 0.0 kB/s 2023-10-09T15:33:37.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.683 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.738 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4778e-05 s, 0.0 kB/s 2023-10-09T15:33:37.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.739 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.796 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.796 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.796 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6862e-05 s, 0.0 kB/s 2023-10-09T15:33:37.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.796 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.851 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4335e-05 s, 0.0 kB/s 2023-10-09T15:33:37.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.852 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2124e-05 s, 0.0 kB/s 2023-10-09T15:33:37.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.908 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:37.963 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4027e-05 s, 0.0 kB/s 2023-10-09T15:33:37.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:37.964 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.019 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4048e-05 s, 0.0 kB/s 2023-10-09T15:33:38.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.020 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2038e-05 s, 0.0 kB/s 2023-10-09T15:33:38.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.131 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2858e-05 s, 0.0 kB/s 2023-10-09T15:33:38.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.187 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1396e-05 s, 0.0 kB/s 2023-10-09T15:33:38.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.243 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4117e-05 s, 0.0 kB/s 2023-10-09T15:33:38.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.299 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9287e-05 s, 0.0 kB/s 2023-10-09T15:33:38.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1156e-05 s, 0.0 kB/s 2023-10-09T15:33:38.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.357 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0479e-05 s, 0.0 kB/s 2023-10-09T15:33:38.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.413 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9212e-05 s, 0.0 kB/s 2023-10-09T15:33:38.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.526 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.526 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2701e-05 s, 0.0 kB/s 2023-10-09T15:33:38.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1561e-05 s, 0.0 kB/s 2023-10-09T15:33:38.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.582 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-09T15:33:38.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.638 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3547e-05 s, 0.0 kB/s 2023-10-09T15:33:38.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.750 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.182e-05 s, 0.0 kB/s 2023-10-09T15:33:38.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.750 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.805 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0657e-05 s, 0.0 kB/s 2023-10-09T15:33:38.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0854e-05 s, 0.0 kB/s 2023-10-09T15:33:38.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.862 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3068e-05 s, 0.0 kB/s 2023-10-09T15:33:38.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.918 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:38.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:38.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:38.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.175e-05 s, 0.0 kB/s 2023-10-09T15:33:38.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:38.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3584e-05 s, 0.0 kB/s 2023-10-09T15:33:39.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0391e-05 s, 0.0 kB/s 2023-10-09T15:33:39.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.143 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1739e-05 s, 0.0 kB/s 2023-10-09T15:33:39.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2613e-05 s, 0.0 kB/s 2023-10-09T15:33:39.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2408e-05 s, 0.0 kB/s 2023-10-09T15:33:39.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.310 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2704e-05 s, 0.0 kB/s 2023-10-09T15:33:39.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.368 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4781e-05 s, 0.0 kB/s 2023-10-09T15:33:39.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.369 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.424 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.424 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.424 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4939e-05 s, 0.0 kB/s 2023-10-09T15:33:39.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.425 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.481 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3277e-05 s, 0.0 kB/s 2023-10-09T15:33:39.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.537 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2513e-05 s, 0.0 kB/s 2023-10-09T15:33:39.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.593 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0731e-05 s, 0.0 kB/s 2023-10-09T15:33:39.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.650 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2784e-05 s, 0.0 kB/s 2023-10-09T15:33:39.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.705 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1866e-05 s, 0.0 kB/s 2023-10-09T15:33:39.705 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.706 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.762 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4448e-05 s, 0.0 kB/s 2023-10-09T15:33:39.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.819 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.312e-05 s, 0.0 kB/s 2023-10-09T15:33:39.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1758e-05 s, 0.0 kB/s 2023-10-09T15:33:39.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.877 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.932 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2039e-05 s, 0.0 kB/s 2023-10-09T15:33:39.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.933 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:39.989 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:39.989 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:39.990 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3243e-05 s, 0.0 kB/s 2023-10-09T15:33:39.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:39.990 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.045 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-09T15:33:40.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.046 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.101 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9189e-05 s, 0.0 kB/s 2023-10-09T15:33:40.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.102 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.157 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1228e-05 s, 0.0 kB/s 2023-10-09T15:33:40.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.157 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.213 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.214 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.214 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4428e-05 s, 0.0 kB/s 2023-10-09T15:33:40.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.214 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.269 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4708e-05 s, 0.0 kB/s 2023-10-09T15:33:40.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.270 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3999e-05 s, 0.0 kB/s 2023-10-09T15:33:40.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.326 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.382 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.382 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.382 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4472e-05 s, 0.0 kB/s 2023-10-09T15:33:40.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.382 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.437 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.438 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3858e-05 s, 0.0 kB/s 2023-10-09T15:33:40.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.438 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.494 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3531e-05 s, 0.0 kB/s 2023-10-09T15:33:40.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.495 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.550 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4169e-05 s, 0.0 kB/s 2023-10-09T15:33:40.551 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.551 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-09T15:33:40.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.608 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.663 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3695e-05 s, 0.0 kB/s 2023-10-09T15:33:40.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.664 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.719 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7874e-05 s, 0.0 kB/s 2023-10-09T15:33:40.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.720 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.775 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1103e-05 s, 0.0 kB/s 2023-10-09T15:33:40.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.776 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.831 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-09T15:33:40.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.832 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2302e-05 s, 0.0 kB/s 2023-10-09T15:33:40.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.944 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1775e-05 s, 0.0 kB/s 2023-10-09T15:33:40.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:40.944 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3577e-05 s, 0.0 kB/s 2023-10-09T15:33:41.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3312e-05 s, 0.0 kB/s 2023-10-09T15:33:41.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.111 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.112 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0192e-05 s, 0.0 kB/s 2023-10-09T15:33:41.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.112 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.166 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.167 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7212e-05 s, 0.0 kB/s 2023-10-09T15:33:41.167 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.168 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.223 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-09T15:33:41.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.224 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.278 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.279 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.279 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2045e-05 s, 0.0 kB/s 2023-10-09T15:33:41.279 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.280 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.335 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-09T15:33:41.335 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.335 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3543e-05 s, 0.0 kB/s 2023-10-09T15:33:41.391 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.391 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.446 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.446 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.446 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2918e-05 s, 0.0 kB/s 2023-10-09T15:33:41.447 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.447 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.504 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2245e-05 s, 0.0 kB/s 2023-10-09T15:33:41.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.504 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.559 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.559 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.560 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.273e-05 s, 0.0 kB/s 2023-10-09T15:33:41.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.560 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.615 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3192e-05 s, 0.0 kB/s 2023-10-09T15:33:41.615 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.616 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3596e-05 s, 0.0 kB/s 2023-10-09T15:33:41.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.672 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4125e-05 s, 0.0 kB/s 2023-10-09T15:33:41.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.728 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T15:33:41.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.784 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.839 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.839 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.005e-05 s, 0.0 kB/s 2023-10-09T15:33:41.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.896 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.896 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4075e-05 s, 0.0 kB/s 2023-10-09T15:33:41.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.896 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:41.951 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:41.951 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:41.952 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4686e-05 s, 0.0 kB/s 2023-10-09T15:33:41.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:41.952 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1488e-05 s, 0.0 kB/s 2023-10-09T15:33:42.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.064 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1885e-05 s, 0.0 kB/s 2023-10-09T15:33:42.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.064 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4545e-05 s, 0.0 kB/s 2023-10-09T15:33:42.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.176 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1857e-05 s, 0.0 kB/s 2023-10-09T15:33:42.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.176 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.232 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3267e-05 s, 0.0 kB/s 2023-10-09T15:33:42.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.232 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-09T15:33:42.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.345 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4863e-05 s, 0.0 kB/s 2023-10-09T15:33:42.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.345 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.400 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3766e-05 s, 0.0 kB/s 2023-10-09T15:33:42.401 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.401 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.76e-05 s, 0.0 kB/s 2023-10-09T15:33:42.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.458 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.513 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.513 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.514 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4172e-05 s, 0.0 kB/s 2023-10-09T15:33:42.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.515 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.571 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1166e-05 s, 0.0 kB/s 2023-10-09T15:33:42.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.571 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.627 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4124e-05 s, 0.0 kB/s 2023-10-09T15:33:42.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.627 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.683 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.683 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.425e-05 s, 0.0 kB/s 2023-10-09T15:33:42.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.683 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.739 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3878e-05 s, 0.0 kB/s 2023-10-09T15:33:42.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.739 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.794 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.794 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.795 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0826e-05 s, 0.0 kB/s 2023-10-09T15:33:42.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.795 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.850 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2372e-05 s, 0.0 kB/s 2023-10-09T15:33:42.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.851 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.906 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.906 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.906 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1812e-05 s, 0.0 kB/s 2023-10-09T15:33:42.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.907 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:42.962 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:42.962 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:42.963 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3833e-05 s, 0.0 kB/s 2023-10-09T15:33:42.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:42.963 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.018 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-09T15:33:43.019 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.019 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.074 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2364e-05 s, 0.0 kB/s 2023-10-09T15:33:43.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.132 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1262e-05 s, 0.0 kB/s 2023-10-09T15:33:43.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.187 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2538e-05 s, 0.0 kB/s 2023-10-09T15:33:43.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.243 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1913e-05 s, 0.0 kB/s 2023-10-09T15:33:43.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.300 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.300 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.300 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.2099e-05 s, 0.0 kB/s 2023-10-09T15:33:43.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.356 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0893e-05 s, 0.0 kB/s 2023-10-09T15:33:43.356 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.356 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.412 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.282e-05 s, 0.0 kB/s 2023-10-09T15:33:43.412 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.412 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.468 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.982e-05 s, 0.0 kB/s 2023-10-09T15:33:43.468 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.468 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2664e-05 s, 0.0 kB/s 2023-10-09T15:33:43.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.525 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2326e-05 s, 0.0 kB/s 2023-10-09T15:33:43.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.581 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.637 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9834e-05 s, 0.0 kB/s 2023-10-09T15:33:43.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.637 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.692 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.693 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2715e-05 s, 0.0 kB/s 2023-10-09T15:33:43.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.693 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.749 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1144e-05 s, 0.0 kB/s 2023-10-09T15:33:43.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.749 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.804 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0963e-05 s, 0.0 kB/s 2023-10-09T15:33:43.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.860 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2789e-05 s, 0.0 kB/s 2023-10-09T15:33:43.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.861 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.917 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5383e-05 s, 0.0 kB/s 2023-10-09T15:33:43.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.917 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3562e-05 s, 0.0 kB/s 2023-10-09T15:33:43.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:43.973 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.028 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4346e-05 s, 0.0 kB/s 2023-10-09T15:33:44.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.029 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.085 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3439e-05 s, 0.0 kB/s 2023-10-09T15:33:44.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.085 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.140 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0784e-05 s, 0.0 kB/s 2023-10-09T15:33:44.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.141 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.197 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3834e-05 s, 0.0 kB/s 2023-10-09T15:33:44.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.253 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1336e-05 s, 0.0 kB/s 2023-10-09T15:33:44.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.253 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.309 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7947e-05 s, 0.0 kB/s 2023-10-09T15:33:44.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.309 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0477e-05 s, 0.0 kB/s 2023-10-09T15:33:44.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.365 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.420 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3212e-05 s, 0.0 kB/s 2023-10-09T15:33:44.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.421 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.477 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.478 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0166e-05 s, 0.0 kB/s 2023-10-09T15:33:44.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.478 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.533 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2828e-05 s, 0.0 kB/s 2023-10-09T15:33:44.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.534 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.590 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9273e-05 s, 0.0 kB/s 2023-10-09T15:33:44.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.590 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.645 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-09T15:33:44.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.645 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0489e-05 s, 0.0 kB/s 2023-10-09T15:33:44.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.701 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1675e-05 s, 0.0 kB/s 2023-10-09T15:33:44.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.757 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3956e-05 s, 0.0 kB/s 2023-10-09T15:33:44.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7495e-05 s, 0.0 kB/s 2023-10-09T15:33:44.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-09T15:33:44.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.925 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:44.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:44.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:44.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2475e-05 s, 0.0 kB/s 2023-10-09T15:33:44.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:44.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4001e-05 s, 0.0 kB/s 2023-10-09T15:33:45.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9953e-05 s, 0.0 kB/s 2023-10-09T15:33:45.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.092 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.147 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8772e-05 s, 0.0 kB/s 2023-10-09T15:33:45.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.203 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8767e-05 s, 0.0 kB/s 2023-10-09T15:33:45.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.203 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.258 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9453e-05 s, 0.0 kB/s 2023-10-09T15:33:45.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.259 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.314 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-09T15:33:45.314 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.370 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.371 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-09T15:33:45.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.371 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4269e-05 s, 0.0 kB/s 2023-10-09T15:33:45.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.427 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.481 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.382e-05 s, 0.0 kB/s 2023-10-09T15:33:45.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2576e-05 s, 0.0 kB/s 2023-10-09T15:33:45.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.539 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.594 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1942e-05 s, 0.0 kB/s 2023-10-09T15:33:45.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.595 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.650 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2502e-05 s, 0.0 kB/s 2023-10-09T15:33:45.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.706 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.706 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.706 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0862e-05 s, 0.0 kB/s 2023-10-09T15:33:45.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.707 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.761 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1533e-05 s, 0.0 kB/s 2023-10-09T15:33:45.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.818 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8898e-05 s, 0.0 kB/s 2023-10-09T15:33:45.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.819 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.873 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0358e-05 s, 0.0 kB/s 2023-10-09T15:33:45.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.874 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.930 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1442e-05 s, 0.0 kB/s 2023-10-09T15:33:45.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.930 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:45.985 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9857e-05 s, 0.0 kB/s 2023-10-09T15:33:45.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:45.985 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2229e-05 s, 0.0 kB/s 2023-10-09T15:33:46.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.042 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1337e-05 s, 0.0 kB/s 2023-10-09T15:33:46.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.098 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0125e-05 s, 0.0 kB/s 2023-10-09T15:33:46.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.209 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2555e-05 s, 0.0 kB/s 2023-10-09T15:33:46.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2335e-05 s, 0.0 kB/s 2023-10-09T15:33:46.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.266 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.322 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0279e-05 s, 0.0 kB/s 2023-10-09T15:33:46.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.322 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.377 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-09T15:33:46.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1168e-05 s, 0.0 kB/s 2023-10-09T15:33:46.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.434 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.489 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1564e-05 s, 0.0 kB/s 2023-10-09T15:33:46.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.490 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.546 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.546 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.546 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1896e-05 s, 0.0 kB/s 2023-10-09T15:33:46.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.546 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.601 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.601 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.601 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.078e-05 s, 0.0 kB/s 2023-10-09T15:33:46.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.602 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.657 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.657 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.657 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8659e-05 s, 0.0 kB/s 2023-10-09T15:33:46.658 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.658 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.713 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.713 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.713 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9712e-05 s, 0.0 kB/s 2023-10-09T15:33:46.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.714 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.073e-05 s, 0.0 kB/s 2023-10-09T15:33:46.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.770 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.825 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.825 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.825 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.943e-05 s, 0.0 kB/s 2023-10-09T15:33:46.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.826 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.880 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.2674e-05 s, 0.0 kB/s 2023-10-09T15:33:46.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.881 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.937 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9315e-05 s, 0.0 kB/s 2023-10-09T15:33:46.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.938 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:46.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:46.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:46.993 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0027e-05 s, 0.0 kB/s 2023-10-09T15:33:46.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:46.993 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.049 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4784e-05 s, 0.0 kB/s 2023-10-09T15:33:47.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.049 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.106 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2523e-05 s, 0.0 kB/s 2023-10-09T15:33:47.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.106 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.161 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.161 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.161 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.014e-05 s, 0.0 kB/s 2023-10-09T15:33:47.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.162 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1124e-05 s, 0.0 kB/s 2023-10-09T15:33:47.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.218 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1783e-05 s, 0.0 kB/s 2023-10-09T15:33:47.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.274 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.330 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.330 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.330 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.493e-05 s, 0.0 kB/s 2023-10-09T15:33:47.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.330 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.386 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.25e-05 s, 0.0 kB/s 2023-10-09T15:33:47.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.386 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.441 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2368e-05 s, 0.0 kB/s 2023-10-09T15:33:47.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.441 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.496 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.018e-05 s, 0.0 kB/s 2023-10-09T15:33:47.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.496 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.553 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2437e-05 s, 0.0 kB/s 2023-10-09T15:33:47.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.553 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.608 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3084e-05 s, 0.0 kB/s 2023-10-09T15:33:47.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.608 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2468e-05 s, 0.0 kB/s 2023-10-09T15:33:47.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.665 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.720 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0688e-05 s, 0.0 kB/s 2023-10-09T15:33:47.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.721 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.777 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5563e-05 s, 0.0 kB/s 2023-10-09T15:33:47.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.777 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.833 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0787e-05 s, 0.0 kB/s 2023-10-09T15:33:47.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.887 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2682e-05 s, 0.0 kB/s 2023-10-09T15:33:47.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:47.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:47.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:47.945 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9231e-05 s, 0.0 kB/s 2023-10-09T15:33:47.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:47.945 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4197e-05 s, 0.0 kB/s 2023-10-09T15:33:48.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.001 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.176e-05 s, 0.0 kB/s 2023-10-09T15:33:48.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.057 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.113 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1954e-05 s, 0.0 kB/s 2023-10-09T15:33:48.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.113 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.168 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1825e-05 s, 0.0 kB/s 2023-10-09T15:33:48.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.169 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.224 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0984e-05 s, 0.0 kB/s 2023-10-09T15:33:48.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.224 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1205e-05 s, 0.0 kB/s 2023-10-09T15:33:48.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.338 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.338 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.8301e-05 s, 0.0 kB/s 2023-10-09T15:33:48.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.394 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0205e-05 s, 0.0 kB/s 2023-10-09T15:33:48.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.395 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-09T15:33:48.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.451 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.507 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3307e-05 s, 0.0 kB/s 2023-10-09T15:33:48.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.507 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-09T15:33:48.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.893e-05 s, 0.0 kB/s 2023-10-09T15:33:48.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.619 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.674 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0122e-05 s, 0.0 kB/s 2023-10-09T15:33:48.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.674 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.729 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0129e-05 s, 0.0 kB/s 2023-10-09T15:33:48.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.729 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2202e-05 s, 0.0 kB/s 2023-10-09T15:33:48.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.784 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T15:33:48.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.841 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.896 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.896 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.896 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0417e-05 s, 0.0 kB/s 2023-10-09T15:33:48.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.897 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:48.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:48.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:48.952 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9771e-05 s, 0.0 kB/s 2023-10-09T15:33:48.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:48.952 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.007 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2919e-05 s, 0.0 kB/s 2023-10-09T15:33:49.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.064 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3133e-05 s, 0.0 kB/s 2023-10-09T15:33:49.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.064 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9561e-05 s, 0.0 kB/s 2023-10-09T15:33:49.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8813e-05 s, 0.0 kB/s 2023-10-09T15:33:49.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.231 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9621e-05 s, 0.0 kB/s 2023-10-09T15:33:49.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.232 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8786e-05 s, 0.0 kB/s 2023-10-09T15:33:49.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.346 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8043e-05 s, 0.0 kB/s 2023-10-09T15:33:49.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.403 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.403 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4606e-05 s, 0.0 kB/s 2023-10-09T15:33:49.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.403 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.458 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0877e-05 s, 0.0 kB/s 2023-10-09T15:33:49.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.459 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.514 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-09T15:33:49.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.515 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1047e-05 s, 0.0 kB/s 2023-10-09T15:33:49.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.570 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.626 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2567e-05 s, 0.0 kB/s 2023-10-09T15:33:49.626 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.626 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.682 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4092e-05 s, 0.0 kB/s 2023-10-09T15:33:49.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.683 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.738 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0469e-05 s, 0.0 kB/s 2023-10-09T15:33:49.739 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.739 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.794 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.794 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.794 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9905e-05 s, 0.0 kB/s 2023-10-09T15:33:49.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.794 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.849 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.849 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.849 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2023e-05 s, 0.0 kB/s 2023-10-09T15:33:49.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.850 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.905 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1292e-05 s, 0.0 kB/s 2023-10-09T15:33:49.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.905 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:49.960 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.228e-05 s, 0.0 kB/s 2023-10-09T15:33:49.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:49.960 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.016 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.016 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.016 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-09T15:33:50.016 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.016 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.072 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.072 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.072 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0657e-05 s, 0.0 kB/s 2023-10-09T15:33:50.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.073 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.128 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1154e-05 s, 0.0 kB/s 2023-10-09T15:33:50.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.128 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.184 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.184 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.184 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0034e-05 s, 0.0 kB/s 2023-10-09T15:33:50.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.184 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.240 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-09T15:33:50.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.240 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.295 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0331e-05 s, 0.0 kB/s 2023-10-09T15:33:50.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.295 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.351 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2254e-05 s, 0.0 kB/s 2023-10-09T15:33:50.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.352 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2497e-05 s, 0.0 kB/s 2023-10-09T15:33:50.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.408 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3475e-05 s, 0.0 kB/s 2023-10-09T15:33:50.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.463 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.518 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.518 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.518 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0882e-05 s, 0.0 kB/s 2023-10-09T15:33:50.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.519 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.574 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2491e-05 s, 0.0 kB/s 2023-10-09T15:33:50.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.575 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9766e-05 s, 0.0 kB/s 2023-10-09T15:33:50.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-09T15:33:50.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.686 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0754e-05 s, 0.0 kB/s 2023-10-09T15:33:50.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0979e-05 s, 0.0 kB/s 2023-10-09T15:33:50.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.798 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-09T15:33:50.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1599e-05 s, 0.0 kB/s 2023-10-09T15:33:50.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.910 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:50.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9198e-05 s, 0.0 kB/s 2023-10-09T15:33:50.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:50.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9941e-05 s, 0.0 kB/s 2023-10-09T15:33:51.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.022 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4092e-05 s, 0.0 kB/s 2023-10-09T15:33:51.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.079 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0818e-05 s, 0.0 kB/s 2023-10-09T15:33:51.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.134 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-09T15:33:51.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.190 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.245 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3718e-05 s, 0.0 kB/s 2023-10-09T15:33:51.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.246 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.301 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5172e-05 s, 0.0 kB/s 2023-10-09T15:33:51.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.302 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9757e-05 s, 0.0 kB/s 2023-10-09T15:33:51.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.413 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0509e-05 s, 0.0 kB/s 2023-10-09T15:33:51.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.413 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.469 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1563e-05 s, 0.0 kB/s 2023-10-09T15:33:51.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3495e-05 s, 0.0 kB/s 2023-10-09T15:33:51.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.525 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1608e-05 s, 0.0 kB/s 2023-10-09T15:33:51.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.582 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.637 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1604e-05 s, 0.0 kB/s 2023-10-09T15:33:51.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.637 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.693 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1324e-05 s, 0.0 kB/s 2023-10-09T15:33:51.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1271e-05 s, 0.0 kB/s 2023-10-09T15:33:51.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.750 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.805 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4663e-05 s, 0.0 kB/s 2023-10-09T15:33:51.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.860 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1002e-05 s, 0.0 kB/s 2023-10-09T15:33:51.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.861 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.916 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.917 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3394e-05 s, 0.0 kB/s 2023-10-09T15:33:51.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.917 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:51.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:51.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:51.972 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0103e-05 s, 0.0 kB/s 2023-10-09T15:33:51.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:51.973 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.028 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0907e-05 s, 0.0 kB/s 2023-10-09T15:33:52.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.028 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.083 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0545e-05 s, 0.0 kB/s 2023-10-09T15:33:52.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.084 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.139 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.139 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.139 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1595e-05 s, 0.0 kB/s 2023-10-09T15:33:52.139 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.139 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.194 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.194 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.194 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5121e-05 s, 0.0 kB/s 2023-10-09T15:33:52.195 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.195 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.250 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.251 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.251 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9381e-05 s, 0.0 kB/s 2023-10-09T15:33:52.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.251 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.306 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.306 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.306 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0349e-05 s, 0.0 kB/s 2023-10-09T15:33:52.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.307 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.363 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.331e-05 s, 0.0 kB/s 2023-10-09T15:33:52.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.363 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2119e-05 s, 0.0 kB/s 2023-10-09T15:33:52.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.419 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.475 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1931e-05 s, 0.0 kB/s 2023-10-09T15:33:52.475 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.475 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.531 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3938e-05 s, 0.0 kB/s 2023-10-09T15:33:52.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.531 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4324e-05 s, 0.0 kB/s 2023-10-09T15:33:52.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.588 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.788 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2868e-05 s, 0.0 kB/s 2023-10-09T15:33:52.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.789 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1289e-05 s, 0.0 kB/s 2023-10-09T15:33:52.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.806 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.861 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-09T15:33:52.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.862 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.917 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0115e-05 s, 0.0 kB/s 2023-10-09T15:33:52.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.918 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:52.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:52.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:52.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1213e-05 s, 0.0 kB/s 2023-10-09T15:33:52.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:52.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.029 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9952e-05 s, 0.0 kB/s 2023-10-09T15:33:53.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.085 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9891e-05 s, 0.0 kB/s 2023-10-09T15:33:53.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.086 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.141 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3367e-05 s, 0.0 kB/s 2023-10-09T15:33:53.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.142 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.197 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1494e-05 s, 0.0 kB/s 2023-10-09T15:33:53.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.198 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.253 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0869e-05 s, 0.0 kB/s 2023-10-09T15:33:53.254 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.254 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.309 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1453e-05 s, 0.0 kB/s 2023-10-09T15:33:53.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.310 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.366 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1719e-05 s, 0.0 kB/s 2023-10-09T15:33:53.366 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.366 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0789e-05 s, 0.0 kB/s 2023-10-09T15:33:53.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.422 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.478 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9262e-05 s, 0.0 kB/s 2023-10-09T15:33:53.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.478 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.534 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0624e-05 s, 0.0 kB/s 2023-10-09T15:33:53.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.534 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.590 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2244e-05 s, 0.0 kB/s 2023-10-09T15:33:53.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.590 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.645 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7991e-05 s, 0.0 kB/s 2023-10-09T15:33:53.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.646 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.701 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2724e-05 s, 0.0 kB/s 2023-10-09T15:33:53.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.702 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.757 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2143e-05 s, 0.0 kB/s 2023-10-09T15:33:53.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.758 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.813 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3606e-05 s, 0.0 kB/s 2023-10-09T15:33:53.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.813 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.867 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0323e-05 s, 0.0 kB/s 2023-10-09T15:33:53.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1579e-05 s, 0.0 kB/s 2023-10-09T15:33:53.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.925 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:53.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:53.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:53.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0821e-05 s, 0.0 kB/s 2023-10-09T15:33:53.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:53.981 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.035 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2393e-05 s, 0.0 kB/s 2023-10-09T15:33:54.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.037 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0319e-05 s, 0.0 kB/s 2023-10-09T15:33:54.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.093 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0363e-05 s, 0.0 kB/s 2023-10-09T15:33:54.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.149 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9341e-05 s, 0.0 kB/s 2023-10-09T15:33:54.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.260 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2268e-05 s, 0.0 kB/s 2023-10-09T15:33:54.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.318 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2481e-05 s, 0.0 kB/s 2023-10-09T15:33:54.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.318 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.374 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2169e-05 s, 0.0 kB/s 2023-10-09T15:33:54.374 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.374 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.429 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.429 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.429 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0633e-05 s, 0.0 kB/s 2023-10-09T15:33:54.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.430 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.485 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2264e-05 s, 0.0 kB/s 2023-10-09T15:33:54.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1078e-05 s, 0.0 kB/s 2023-10-09T15:33:54.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9969e-05 s, 0.0 kB/s 2023-10-09T15:33:54.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2115e-05 s, 0.0 kB/s 2023-10-09T15:33:54.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3968e-05 s, 0.0 kB/s 2023-10-09T15:33:54.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.763 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9994e-05 s, 0.0 kB/s 2023-10-09T15:33:54.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.763 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.818 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0695e-05 s, 0.0 kB/s 2023-10-09T15:33:54.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.819 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.874 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.874 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.874 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9909e-05 s, 0.0 kB/s 2023-10-09T15:33:54.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.875 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.930 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2658e-05 s, 0.0 kB/s 2023-10-09T15:33:54.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.931 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:54.986 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:54.986 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:54.986 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1395e-05 s, 0.0 kB/s 2023-10-09T15:33:54.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:54.986 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.654e-05 s, 0.0 kB/s 2023-10-09T15:33:55.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.042 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3617e-05 s, 0.0 kB/s 2023-10-09T15:33:55.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.098 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1933e-05 s, 0.0 kB/s 2023-10-09T15:33:55.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.210 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0342e-05 s, 0.0 kB/s 2023-10-09T15:33:55.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0671e-05 s, 0.0 kB/s 2023-10-09T15:33:55.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.265 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.320 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8742e-05 s, 0.0 kB/s 2023-10-09T15:33:55.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.321 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.377 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2335e-05 s, 0.0 kB/s 2023-10-09T15:33:55.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.434 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1951e-05 s, 0.0 kB/s 2023-10-09T15:33:55.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.434 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.490 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.490 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.490 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1637e-05 s, 0.0 kB/s 2023-10-09T15:33:55.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.490 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.545 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0641e-05 s, 0.0 kB/s 2023-10-09T15:33:55.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.546 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.602 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.603 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0953e-05 s, 0.0 kB/s 2023-10-09T15:33:55.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.603 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.659 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.452e-05 s, 0.0 kB/s 2023-10-09T15:33:55.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.659 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.714 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2491e-05 s, 0.0 kB/s 2023-10-09T15:33:55.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.715 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.770 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2659e-05 s, 0.0 kB/s 2023-10-09T15:33:55.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.771 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.827 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0432e-05 s, 0.0 kB/s 2023-10-09T15:33:55.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.827 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.882 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0129e-05 s, 0.0 kB/s 2023-10-09T15:33:55.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.882 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.937 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9725e-05 s, 0.0 kB/s 2023-10-09T15:33:55.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.937 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:55.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:55.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:55.993 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9998e-05 s, 0.0 kB/s 2023-10-09T15:33:55.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:55.993 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.048 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.9821e-05 s, 0.0 kB/s 2023-10-09T15:33:56.048 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.049 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.104 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9991e-05 s, 0.0 kB/s 2023-10-09T15:33:56.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.105 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.160 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0534e-05 s, 0.0 kB/s 2023-10-09T15:33:56.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.161 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.216 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8711e-05 s, 0.0 kB/s 2023-10-09T15:33:56.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.272 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1203e-05 s, 0.0 kB/s 2023-10-09T15:33:56.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.273 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.329 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4687e-05 s, 0.0 kB/s 2023-10-09T15:33:56.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.386 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4402e-05 s, 0.0 kB/s 2023-10-09T15:33:56.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.387 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.442 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1356e-05 s, 0.0 kB/s 2023-10-09T15:33:56.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.443 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4876e-05 s, 0.0 kB/s 2023-10-09T15:33:56.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.499 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.555 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0138e-05 s, 0.0 kB/s 2023-10-09T15:33:56.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.556 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.613 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2596e-05 s, 0.0 kB/s 2023-10-09T15:33:56.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.613 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.669 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.669 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.669 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1602e-05 s, 0.0 kB/s 2023-10-09T15:33:56.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.669 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.724 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4632e-05 s, 0.0 kB/s 2023-10-09T15:33:56.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.725 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.780 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9597e-05 s, 0.0 kB/s 2023-10-09T15:33:56.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.781 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.837 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1881e-05 s, 0.0 kB/s 2023-10-09T15:33:56.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.892 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9088e-05 s, 0.0 kB/s 2023-10-09T15:33:56.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.893 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:56.948 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4073e-05 s, 0.0 kB/s 2023-10-09T15:33:56.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:56.949 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.005 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3828e-05 s, 0.0 kB/s 2023-10-09T15:33:57.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.005 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.061 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1766e-05 s, 0.0 kB/s 2023-10-09T15:33:57.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.061 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.116 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.074e-05 s, 0.0 kB/s 2023-10-09T15:33:57.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.116 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.172 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.172 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.172 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9509e-05 s, 0.0 kB/s 2023-10-09T15:33:57.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.172 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.228 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1745e-05 s, 0.0 kB/s 2023-10-09T15:33:57.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.229 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.284 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2134e-05 s, 0.0 kB/s 2023-10-09T15:33:57.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.285 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.340 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.340 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.341 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-09T15:33:57.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.341 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.396 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2549e-05 s, 0.0 kB/s 2023-10-09T15:33:57.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.397 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.452 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.941e-05 s, 0.0 kB/s 2023-10-09T15:33:57.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.453 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.508 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4084e-05 s, 0.0 kB/s 2023-10-09T15:33:57.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.509 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.564 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.564 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.564 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9163e-05 s, 0.0 kB/s 2023-10-09T15:33:57.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.565 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.621 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.622 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4521e-05 s, 0.0 kB/s 2023-10-09T15:33:57.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.622 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.678 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.226e-05 s, 0.0 kB/s 2023-10-09T15:33:57.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.678 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.733 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1365e-05 s, 0.0 kB/s 2023-10-09T15:33:57.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.733 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2564e-05 s, 0.0 kB/s 2023-10-09T15:33:57.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.789 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.844 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.845 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.122e-05 s, 0.0 kB/s 2023-10-09T15:33:57.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.845 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.900 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.27e-05 s, 0.0 kB/s 2023-10-09T15:33:57.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.901 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:57.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:57.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:57.956 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2324e-05 s, 0.0 kB/s 2023-10-09T15:33:57.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:57.957 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.012 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5095e-05 s, 0.0 kB/s 2023-10-09T15:33:58.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.013 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.069 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1785e-05 s, 0.0 kB/s 2023-10-09T15:33:58.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.069 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3822e-05 s, 0.0 kB/s 2023-10-09T15:33:58.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.125 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.180 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1195e-05 s, 0.0 kB/s 2023-10-09T15:33:58.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.181 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.236 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.452e-05 s, 0.0 kB/s 2023-10-09T15:33:58.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.237 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.292 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.293 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2027e-05 s, 0.0 kB/s 2023-10-09T15:33:58.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.293 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.350 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1076e-05 s, 0.0 kB/s 2023-10-09T15:33:58.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.351 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.034e-05 s, 0.0 kB/s 2023-10-09T15:33:58.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.407 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0557e-05 s, 0.0 kB/s 2023-10-09T15:33:58.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.463 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.518 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.519 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2426e-05 s, 0.0 kB/s 2023-10-09T15:33:58.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.519 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2021e-05 s, 0.0 kB/s 2023-10-09T15:33:58.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.575 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.631 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4659e-05 s, 0.0 kB/s 2023-10-09T15:33:58.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.631 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8869e-05 s, 0.0 kB/s 2023-10-09T15:33:58.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.687 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0308e-05 s, 0.0 kB/s 2023-10-09T15:33:58.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.744 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9136e-05 s, 0.0 kB/s 2023-10-09T15:33:58.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.800 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0419e-05 s, 0.0 kB/s 2023-10-09T15:33:58.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.856 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0628e-05 s, 0.0 kB/s 2023-10-09T15:33:58.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.912 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.012e-05 s, 0.0 kB/s 2023-10-09T15:33:58.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:58.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.024 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.024 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5855e-05 s, 0.0 kB/s 2023-10-09T15:33:59.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.024 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0869e-05 s, 0.0 kB/s 2023-10-09T15:33:59.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.136 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2101e-05 s, 0.0 kB/s 2023-10-09T15:33:59.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.136 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.192 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2697e-05 s, 0.0 kB/s 2023-10-09T15:33:59.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.192 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.948e-05 s, 0.0 kB/s 2023-10-09T15:33:59.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.248 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.305 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5848e-05 s, 0.0 kB/s 2023-10-09T15:33:59.305 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.305 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.360 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.361 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.361 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3527e-05 s, 0.0 kB/s 2023-10-09T15:33:59.361 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.361 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.416 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2053e-05 s, 0.0 kB/s 2023-10-09T15:33:59.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.416 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.472 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3669e-05 s, 0.0 kB/s 2023-10-09T15:33:59.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.472 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1205e-05 s, 0.0 kB/s 2023-10-09T15:33:59.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.528 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.584 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1136e-05 s, 0.0 kB/s 2023-10-09T15:33:59.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.584 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2128e-05 s, 0.0 kB/s 2023-10-09T15:33:59.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0953e-05 s, 0.0 kB/s 2023-10-09T15:33:59.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.695 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0832e-05 s, 0.0 kB/s 2023-10-09T15:33:59.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.752 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.262e-05 s, 0.0 kB/s 2023-10-09T15:33:59.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.807 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.863 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3803e-05 s, 0.0 kB/s 2023-10-09T15:33:59.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1087e-05 s, 0.0 kB/s 2023-10-09T15:33:59.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:33:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:33:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:33:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2601e-05 s, 0.0 kB/s 2023-10-09T15:33:59.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:33:59.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6287e-05 s, 0.0 kB/s 2023-10-09T15:34:00.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.084 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5638e-05 s, 0.0 kB/s 2023-10-09T15:34:00.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.085 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.141 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4719e-05 s, 0.0 kB/s 2023-10-09T15:34:00.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.142 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.197 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2262e-05 s, 0.0 kB/s 2023-10-09T15:34:00.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.252 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1033e-05 s, 0.0 kB/s 2023-10-09T15:34:00.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.252 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.307 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3849e-05 s, 0.0 kB/s 2023-10-09T15:34:00.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.307 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.364 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6637e-05 s, 0.0 kB/s 2023-10-09T15:34:00.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.364 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.420 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.251e-05 s, 0.0 kB/s 2023-10-09T15:34:00.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.420 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.476 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5439e-05 s, 0.0 kB/s 2023-10-09T15:34:00.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.476 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.531 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2992e-05 s, 0.0 kB/s 2023-10-09T15:34:00.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.532 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.587 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.438e-05 s, 0.0 kB/s 2023-10-09T15:34:00.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.588 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1464e-05 s, 0.0 kB/s 2023-10-09T15:34:00.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.644 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.699 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1571e-05 s, 0.0 kB/s 2023-10-09T15:34:00.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.700 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.755 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9693e-05 s, 0.0 kB/s 2023-10-09T15:34:00.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.756 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.811 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1759e-05 s, 0.0 kB/s 2023-10-09T15:34:00.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.867 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0857e-05 s, 0.0 kB/s 2023-10-09T15:34:00.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.923 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-09T15:34:00.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.923 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:00.979 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2326e-05 s, 0.0 kB/s 2023-10-09T15:34:00.979 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:00.979 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.034 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-09T15:34:01.034 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.034 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.090 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.090 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.090 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9397e-05 s, 0.0 kB/s 2023-10-09T15:34:01.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.090 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.146 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3812e-05 s, 0.0 kB/s 2023-10-09T15:34:01.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.146 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.202 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2062e-05 s, 0.0 kB/s 2023-10-09T15:34:01.202 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.203 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.259 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.19e-05 s, 0.0 kB/s 2023-10-09T15:34:01.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.259 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.314 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0723e-05 s, 0.0 kB/s 2023-10-09T15:34:01.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.371 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3436e-05 s, 0.0 kB/s 2023-10-09T15:34:01.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.371 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2691e-05 s, 0.0 kB/s 2023-10-09T15:34:01.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.427 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.483 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.246e-05 s, 0.0 kB/s 2023-10-09T15:34:01.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.483 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.539 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6209e-05 s, 0.0 kB/s 2023-10-09T15:34:01.539 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.539 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1344e-05 s, 0.0 kB/s 2023-10-09T15:34:01.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1694e-05 s, 0.0 kB/s 2023-10-09T15:34:01.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.653 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.709 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.709 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3115e-05 s, 0.0 kB/s 2023-10-09T15:34:01.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.709 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.765 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.986e-05 s, 0.0 kB/s 2023-10-09T15:34:01.765 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.765 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.820 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9338e-05 s, 0.0 kB/s 2023-10-09T15:34:01.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.98e-05 s, 0.0 kB/s 2023-10-09T15:34:01.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.932 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.384e-05 s, 0.0 kB/s 2023-10-09T15:34:01.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.933 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:01.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:01.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:01.988 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0436e-05 s, 0.0 kB/s 2023-10-09T15:34:01.989 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:01.989 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.045 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.045 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.046 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3544e-05 s, 0.0 kB/s 2023-10-09T15:34:02.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.046 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.101 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8484e-05 s, 0.0 kB/s 2023-10-09T15:34:02.101 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.102 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.157 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3239e-05 s, 0.0 kB/s 2023-10-09T15:34:02.157 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.157 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.213 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.213 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.213 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.406e-05 s, 0.0 kB/s 2023-10-09T15:34:02.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.214 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.270 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0014e-05 s, 0.0 kB/s 2023-10-09T15:34:02.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.270 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-09T15:34:02.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.326 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.382 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-09T15:34:02.382 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.382 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.437 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.438 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3312e-05 s, 0.0 kB/s 2023-10-09T15:34:02.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.438 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4279e-05 s, 0.0 kB/s 2023-10-09T15:34:02.494 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.494 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-09T15:34:02.550 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.550 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0423e-05 s, 0.0 kB/s 2023-10-09T15:34:02.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.662 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.662 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.662 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.23e-05 s, 0.0 kB/s 2023-10-09T15:34:02.662 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.662 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.839e-05 s, 0.0 kB/s 2023-10-09T15:34:02.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.717 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.772 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1238e-05 s, 0.0 kB/s 2023-10-09T15:34:02.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.773 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.829 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1369e-05 s, 0.0 kB/s 2023-10-09T15:34:02.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.829 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.884 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2216e-05 s, 0.0 kB/s 2023-10-09T15:34:02.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.885 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.941 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.941 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-09T15:34:02.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.941 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1822e-05 s, 0.0 kB/s 2023-10-09T15:34:02.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:02.996 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2463e-05 s, 0.0 kB/s 2023-10-09T15:34:03.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.053 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.108 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.108 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.108 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1414e-05 s, 0.0 kB/s 2023-10-09T15:34:03.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.108 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.163 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0352e-05 s, 0.0 kB/s 2023-10-09T15:34:03.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.164 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3526e-05 s, 0.0 kB/s 2023-10-09T15:34:03.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.275 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0692e-05 s, 0.0 kB/s 2023-10-09T15:34:03.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.331 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1784e-05 s, 0.0 kB/s 2023-10-09T15:34:03.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.388 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4174e-05 s, 0.0 kB/s 2023-10-09T15:34:03.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.389 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.444 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1945e-05 s, 0.0 kB/s 2023-10-09T15:34:03.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.444 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1201e-05 s, 0.0 kB/s 2023-10-09T15:34:03.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.501 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2443e-05 s, 0.0 kB/s 2023-10-09T15:34:03.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.557 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.612 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4112e-05 s, 0.0 kB/s 2023-10-09T15:34:03.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.613 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.668 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4029e-05 s, 0.0 kB/s 2023-10-09T15:34:03.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.669 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.724 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9085e-05 s, 0.0 kB/s 2023-10-09T15:34:03.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.725 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.781 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0722e-05 s, 0.0 kB/s 2023-10-09T15:34:03.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.781 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.836 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2188e-05 s, 0.0 kB/s 2023-10-09T15:34:03.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.892 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9087e-05 s, 0.0 kB/s 2023-10-09T15:34:03.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.892 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:03.947 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1173e-05 s, 0.0 kB/s 2023-10-09T15:34:03.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:03.947 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.003 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1932e-05 s, 0.0 kB/s 2023-10-09T15:34:04.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.004 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0766e-05 s, 0.0 kB/s 2023-10-09T15:34:04.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.060 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.115 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.115 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.115 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8346e-05 s, 0.0 kB/s 2023-10-09T15:34:04.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.116 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0593e-05 s, 0.0 kB/s 2023-10-09T15:34:04.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.002e-05 s, 0.0 kB/s 2023-10-09T15:34:04.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.228 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.284 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.608e-05 s, 0.0 kB/s 2023-10-09T15:34:04.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.284 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.340 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.340 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.432e-05 s, 0.0 kB/s 2023-10-09T15:34:04.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.340 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1093e-05 s, 0.0 kB/s 2023-10-09T15:34:04.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.395 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.451 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5486e-05 s, 0.0 kB/s 2023-10-09T15:34:04.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.452 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.507 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1661e-05 s, 0.0 kB/s 2023-10-09T15:34:04.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.508 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0205e-05 s, 0.0 kB/s 2023-10-09T15:34:04.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.564 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.620 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2104e-05 s, 0.0 kB/s 2023-10-09T15:34:04.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.620 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.676 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.676 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.676 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1192e-05 s, 0.0 kB/s 2023-10-09T15:34:04.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.676 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.732 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0018e-05 s, 0.0 kB/s 2023-10-09T15:34:04.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.732 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.788 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0427e-05 s, 0.0 kB/s 2023-10-09T15:34:04.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.788 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.843 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.844 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.844 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0346e-05 s, 0.0 kB/s 2023-10-09T15:34:04.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.844 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.899 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.899 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.899 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.305e-05 s, 0.0 kB/s 2023-10-09T15:34:04.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.899 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:04.955 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:04.955 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:04.955 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9566e-05 s, 0.0 kB/s 2023-10-09T15:34:04.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:04.955 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.010 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.010 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.010 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9955e-05 s, 0.0 kB/s 2023-10-09T15:34:05.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.011 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.066 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.066 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.066 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0367e-05 s, 0.0 kB/s 2023-10-09T15:34:05.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.067 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.122 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2435e-05 s, 0.0 kB/s 2023-10-09T15:34:05.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.123 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.178 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8429e-05 s, 0.0 kB/s 2023-10-09T15:34:05.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.178 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.234 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1843e-05 s, 0.0 kB/s 2023-10-09T15:34:05.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.234 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3113e-05 s, 0.0 kB/s 2023-10-09T15:34:05.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.290 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.346 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3002e-05 s, 0.0 kB/s 2023-10-09T15:34:05.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.401 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9806e-05 s, 0.0 kB/s 2023-10-09T15:34:05.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1147e-05 s, 0.0 kB/s 2023-10-09T15:34:05.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.458 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.513 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6348e-05 s, 0.0 kB/s 2023-10-09T15:34:05.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.514 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.569 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2918e-05 s, 0.0 kB/s 2023-10-09T15:34:05.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.570 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.625 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0955e-05 s, 0.0 kB/s 2023-10-09T15:34:05.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.625 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.680 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0114e-05 s, 0.0 kB/s 2023-10-09T15:34:05.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.681 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.736 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.201e-05 s, 0.0 kB/s 2023-10-09T15:34:05.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.737 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.792 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.792 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.792 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1491e-05 s, 0.0 kB/s 2023-10-09T15:34:05.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.792 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.847 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0704e-05 s, 0.0 kB/s 2023-10-09T15:34:05.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.848 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.903 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2421e-05 s, 0.0 kB/s 2023-10-09T15:34:05.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.904 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:05.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:05.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:05.959 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3622e-05 s, 0.0 kB/s 2023-10-09T15:34:05.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:05.959 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3118e-05 s, 0.0 kB/s 2023-10-09T15:34:06.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.015 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.005e-05 s, 0.0 kB/s 2023-10-09T15:34:06.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.071 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.109 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:34:06.113 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:34:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.126 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.168e-05 s, 0.0 kB/s 2023-10-09T15:34:06.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.127 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.221 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3764e-05 s, 0.0 kB/s 2023-10-09T15:34:06.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.221 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.277 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2729e-05 s, 0.0 kB/s 2023-10-09T15:34:06.278 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.278 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.333 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0465e-05 s, 0.0 kB/s 2023-10-09T15:34:06.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.334 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0705e-05 s, 0.0 kB/s 2023-10-09T15:34:06.390 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.390 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.445 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0351e-05 s, 0.0 kB/s 2023-10-09T15:34:06.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.446 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.501 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.501 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.502 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-09T15:34:06.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.502 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.558 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3065e-05 s, 0.0 kB/s 2023-10-09T15:34:06.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.558 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.614 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1861e-05 s, 0.0 kB/s 2023-10-09T15:34:06.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.614 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2305e-05 s, 0.0 kB/s 2023-10-09T15:34:06.670 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.670 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.725 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.726 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2402e-05 s, 0.0 kB/s 2023-10-09T15:34:06.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.726 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.781 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.781 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.781 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0549e-05 s, 0.0 kB/s 2023-10-09T15:34:06.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.782 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.838 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3613e-05 s, 0.0 kB/s 2023-10-09T15:34:06.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.838 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.893 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0451e-05 s, 0.0 kB/s 2023-10-09T15:34:06.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.894 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:06.949 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:06.949 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:06.949 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3688e-05 s, 0.0 kB/s 2023-10-09T15:34:06.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:06.950 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.005 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.005 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.006 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.136e-05 s, 0.0 kB/s 2023-10-09T15:34:07.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.006 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.061 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.062 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5368e-05 s, 0.0 kB/s 2023-10-09T15:34:07.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.062 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.117 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4733e-05 s, 0.0 kB/s 2023-10-09T15:34:07.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.118 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.173 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.358e-05 s, 0.0 kB/s 2023-10-09T15:34:07.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.174 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-09T15:34:07.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.230 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.286 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.286 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4486e-05 s, 0.0 kB/s 2023-10-09T15:34:07.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.286 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.341 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.342 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2253e-05 s, 0.0 kB/s 2023-10-09T15:34:07.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.342 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.397 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1581e-05 s, 0.0 kB/s 2023-10-09T15:34:07.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.398 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.453 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9747e-05 s, 0.0 kB/s 2023-10-09T15:34:07.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.453 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.509 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.509 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.509 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1177e-05 s, 0.0 kB/s 2023-10-09T15:34:07.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.510 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.568 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.568 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2481e-05 s, 0.0 kB/s 2023-10-09T15:34:07.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.568 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.623 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0446e-05 s, 0.0 kB/s 2023-10-09T15:34:07.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.184e-05 s, 0.0 kB/s 2023-10-09T15:34:07.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.680 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.736 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3737e-05 s, 0.0 kB/s 2023-10-09T15:34:07.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.736 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.792 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.792 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2116e-05 s, 0.0 kB/s 2023-10-09T15:34:07.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.792 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.847 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.4626e-05 s, 0.0 kB/s 2023-10-09T15:34:07.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.848 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.904 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1038e-05 s, 0.0 kB/s 2023-10-09T15:34:07.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.904 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:07.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:07.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:07.959 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9472e-05 s, 0.0 kB/s 2023-10-09T15:34:07.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:07.960 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.015 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-09T15:34:08.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.016 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.071 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-09T15:34:08.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.071 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.128 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8859e-05 s, 0.0 kB/s 2023-10-09T15:34:08.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.128 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.184 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1481e-05 s, 0.0 kB/s 2023-10-09T15:34:08.185 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.185 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.240 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0878e-05 s, 0.0 kB/s 2023-10-09T15:34:08.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.241 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.296 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0635e-05 s, 0.0 kB/s 2023-10-09T15:34:08.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.297 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.353 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2251e-05 s, 0.0 kB/s 2023-10-09T15:34:08.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.353 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.408 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.409 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0921e-05 s, 0.0 kB/s 2023-10-09T15:34:08.409 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.409 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.464 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.465 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-09T15:34:08.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.465 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.520 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.521 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.521 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.307e-05 s, 0.0 kB/s 2023-10-09T15:34:08.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.521 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4561e-05 s, 0.0 kB/s 2023-10-09T15:34:08.577 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.577 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.632 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.632 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.632 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2677e-05 s, 0.0 kB/s 2023-10-09T15:34:08.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.633 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.688 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.689 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0841e-05 s, 0.0 kB/s 2023-10-09T15:34:08.689 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.689 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.745 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2158e-05 s, 0.0 kB/s 2023-10-09T15:34:08.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.746 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1151e-05 s, 0.0 kB/s 2023-10-09T15:34:08.802 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.802 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.857 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9601e-05 s, 0.0 kB/s 2023-10-09T15:34:08.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.858 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.913 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.914 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4027e-05 s, 0.0 kB/s 2023-10-09T15:34:08.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.914 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:08.969 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:08.969 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:08.969 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1277e-05 s, 0.0 kB/s 2023-10-09T15:34:08.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:08.970 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.025 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1258e-05 s, 0.0 kB/s 2023-10-09T15:34:09.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.026 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.081 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2012e-05 s, 0.0 kB/s 2023-10-09T15:34:09.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.082 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.137 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3127e-05 s, 0.0 kB/s 2023-10-09T15:34:09.137 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.138 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.194 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.194 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2442e-05 s, 0.0 kB/s 2023-10-09T15:34:09.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.194 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1718e-05 s, 0.0 kB/s 2023-10-09T15:34:09.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.250 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.306 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-09T15:34:09.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.306 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.362 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-09T15:34:09.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.362 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.436e-05 s, 0.0 kB/s 2023-10-09T15:34:09.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.418 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-09T15:34:09.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.474 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.529 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.068e-05 s, 0.0 kB/s 2023-10-09T15:34:09.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.530 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.585 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.585 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.585 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1657e-05 s, 0.0 kB/s 2023-10-09T15:34:09.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.586 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.641 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9352e-05 s, 0.0 kB/s 2023-10-09T15:34:09.641 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.641 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.697 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2154e-05 s, 0.0 kB/s 2023-10-09T15:34:09.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.698 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.754 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2047e-05 s, 0.0 kB/s 2023-10-09T15:34:09.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.754 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0459e-05 s, 0.0 kB/s 2023-10-09T15:34:09.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.867 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0178e-05 s, 0.0 kB/s 2023-10-09T15:34:09.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.197e-05 s, 0.0 kB/s 2023-10-09T15:34:09.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:09.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:09.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:09.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0373e-05 s, 0.0 kB/s 2023-10-09T15:34:09.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:09.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0732e-05 s, 0.0 kB/s 2023-10-09T15:34:10.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9977e-05 s, 0.0 kB/s 2023-10-09T15:34:10.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.092 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.206e-05 s, 0.0 kB/s 2023-10-09T15:34:10.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.203 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.958e-05 s, 0.0 kB/s 2023-10-09T15:34:10.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.204 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-09T15:34:10.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.260 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.315 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0302e-05 s, 0.0 kB/s 2023-10-09T15:34:10.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.316 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.372 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0318e-05 s, 0.0 kB/s 2023-10-09T15:34:10.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.428 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.303e-05 s, 0.0 kB/s 2023-10-09T15:34:10.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3393e-05 s, 0.0 kB/s 2023-10-09T15:34:10.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9781e-05 s, 0.0 kB/s 2023-10-09T15:34:10.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3688e-05 s, 0.0 kB/s 2023-10-09T15:34:10.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0434e-05 s, 0.0 kB/s 2023-10-09T15:34:10.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1723e-05 s, 0.0 kB/s 2023-10-09T15:34:10.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.764 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-09T15:34:10.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.765 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.820 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.025e-05 s, 0.0 kB/s 2023-10-09T15:34:10.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.821 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0744e-05 s, 0.0 kB/s 2023-10-09T15:34:10.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.877 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.932 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2206e-05 s, 0.0 kB/s 2023-10-09T15:34:10.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.933 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:10.988 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.941e-05 s, 0.0 kB/s 2023-10-09T15:34:10.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:10.989 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.044 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.044 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.044 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2652e-05 s, 0.0 kB/s 2023-10-09T15:34:11.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.045 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.099 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9818e-05 s, 0.0 kB/s 2023-10-09T15:34:11.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.156 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9802e-05 s, 0.0 kB/s 2023-10-09T15:34:11.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.212 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2074e-05 s, 0.0 kB/s 2023-10-09T15:34:11.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.268 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1937e-05 s, 0.0 kB/s 2023-10-09T15:34:11.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.268 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3694e-05 s, 0.0 kB/s 2023-10-09T15:34:11.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.324 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.379 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.379 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.379 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2901e-05 s, 0.0 kB/s 2023-10-09T15:34:11.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.379 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.435 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1518e-05 s, 0.0 kB/s 2023-10-09T15:34:11.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.436 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.491 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.491 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.491 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-09T15:34:11.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.492 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.547 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2412e-05 s, 0.0 kB/s 2023-10-09T15:34:11.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.547 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.603 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9751e-05 s, 0.0 kB/s 2023-10-09T15:34:11.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.603 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.659 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-09T15:34:11.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.659 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3789e-05 s, 0.0 kB/s 2023-10-09T15:34:11.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.715 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.771 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1025e-05 s, 0.0 kB/s 2023-10-09T15:34:11.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.771 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.826 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0043e-05 s, 0.0 kB/s 2023-10-09T15:34:11.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.827 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.882 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3658e-05 s, 0.0 kB/s 2023-10-09T15:34:11.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.883 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.938 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.106e-05 s, 0.0 kB/s 2023-10-09T15:34:11.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.939 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:11.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:11.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:11.995 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1602e-05 s, 0.0 kB/s 2023-10-09T15:34:11.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:11.995 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.050 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3566e-05 s, 0.0 kB/s 2023-10-09T15:34:12.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.051 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.106 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0413e-05 s, 0.0 kB/s 2023-10-09T15:34:12.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.106 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.162 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2172e-05 s, 0.0 kB/s 2023-10-09T15:34:12.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.163 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.218 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.218 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.218 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1124e-05 s, 0.0 kB/s 2023-10-09T15:34:12.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.218 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.275 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3965e-05 s, 0.0 kB/s 2023-10-09T15:34:12.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.275 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.330 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.330 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.330 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4361e-05 s, 0.0 kB/s 2023-10-09T15:34:12.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.331 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1563e-05 s, 0.0 kB/s 2023-10-09T15:34:12.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.387 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.443 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-09T15:34:12.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.443 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.42e-05 s, 0.0 kB/s 2023-10-09T15:34:12.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.499 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.555 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1777e-05 s, 0.0 kB/s 2023-10-09T15:34:12.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.555 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.610 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3921e-05 s, 0.0 kB/s 2023-10-09T15:34:12.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.611 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.666 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2723e-05 s, 0.0 kB/s 2023-10-09T15:34:12.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.667 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0392e-05 s, 0.0 kB/s 2023-10-09T15:34:12.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.779 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.779 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.779 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6839e-05 s, 0.0 kB/s 2023-10-09T15:34:12.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.779 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3958e-05 s, 0.0 kB/s 2023-10-09T15:34:12.836 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.836 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.891 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.891 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.892 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4189e-05 s, 0.0 kB/s 2023-10-09T15:34:12.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.892 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:12.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:12.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:12.947 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2097e-05 s, 0.0 kB/s 2023-10-09T15:34:12.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:12.948 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.003 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.003 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.003 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0861e-05 s, 0.0 kB/s 2023-10-09T15:34:13.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.004 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.059 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0028e-05 s, 0.0 kB/s 2023-10-09T15:34:13.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.059 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1512e-05 s, 0.0 kB/s 2023-10-09T15:34:13.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.115 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-09T15:34:13.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.226 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3552e-05 s, 0.0 kB/s 2023-10-09T15:34:13.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.282 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.282 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.282 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0257e-05 s, 0.0 kB/s 2023-10-09T15:34:13.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.283 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.205e-05 s, 0.0 kB/s 2023-10-09T15:34:13.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1916e-05 s, 0.0 kB/s 2023-10-09T15:34:13.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.395 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2706e-05 s, 0.0 kB/s 2023-10-09T15:34:13.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.451 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.506 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1977e-05 s, 0.0 kB/s 2023-10-09T15:34:13.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.507 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.562 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0698e-05 s, 0.0 kB/s 2023-10-09T15:34:13.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4e-05 s, 0.0 kB/s 2023-10-09T15:34:13.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.619 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.675 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1261e-05 s, 0.0 kB/s 2023-10-09T15:34:13.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.675 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.730 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1711e-05 s, 0.0 kB/s 2023-10-09T15:34:13.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.731 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.787 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2077e-05 s, 0.0 kB/s 2023-10-09T15:34:13.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.787 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.842 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.842 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.842 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1613e-05 s, 0.0 kB/s 2023-10-09T15:34:13.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.842 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.898 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9397e-05 s, 0.0 kB/s 2023-10-09T15:34:13.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.899 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:13.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:13.955 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1317e-05 s, 0.0 kB/s 2023-10-09T15:34:13.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:13.955 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.010 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8111e-05 s, 0.0 kB/s 2023-10-09T15:34:14.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.011 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.067 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2986e-05 s, 0.0 kB/s 2023-10-09T15:34:14.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.068 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.123 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.124 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1401e-05 s, 0.0 kB/s 2023-10-09T15:34:14.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.124 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1879e-05 s, 0.0 kB/s 2023-10-09T15:34:14.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.180 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.237 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-09T15:34:14.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.237 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.294 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.034e-05 s, 0.0 kB/s 2023-10-09T15:34:14.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.294 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.350 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.341e-05 s, 0.0 kB/s 2023-10-09T15:34:14.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.406 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2168e-05 s, 0.0 kB/s 2023-10-09T15:34:14.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.406 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.461 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0986e-05 s, 0.0 kB/s 2023-10-09T15:34:14.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.517 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3e-05 s, 0.0 kB/s 2023-10-09T15:34:14.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.574 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2357e-05 s, 0.0 kB/s 2023-10-09T15:34:14.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.574 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.629 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0749e-05 s, 0.0 kB/s 2023-10-09T15:34:14.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2835e-05 s, 0.0 kB/s 2023-10-09T15:34:14.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.686 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.741 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1674e-05 s, 0.0 kB/s 2023-10-09T15:34:14.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.742 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2708e-05 s, 0.0 kB/s 2023-10-09T15:34:14.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.798 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.855 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1984e-05 s, 0.0 kB/s 2023-10-09T15:34:14.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1722e-05 s, 0.0 kB/s 2023-10-09T15:34:14.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:14.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:14.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:14.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-09T15:34:14.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:14.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2127e-05 s, 0.0 kB/s 2023-10-09T15:34:15.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.022 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2696e-05 s, 0.0 kB/s 2023-10-09T15:34:15.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.078 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.135 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2616e-05 s, 0.0 kB/s 2023-10-09T15:34:15.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.135 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.191 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-09T15:34:15.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.191 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.246 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3776e-05 s, 0.0 kB/s 2023-10-09T15:34:15.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.247 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.302 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2059e-05 s, 0.0 kB/s 2023-10-09T15:34:15.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.303 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.359 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-09T15:34:15.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.359 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2113e-05 s, 0.0 kB/s 2023-10-09T15:34:15.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.415 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.471 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9877e-05 s, 0.0 kB/s 2023-10-09T15:34:15.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.471 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.529 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4741e-05 s, 0.0 kB/s 2023-10-09T15:34:15.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.529 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.584 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0393e-05 s, 0.0 kB/s 2023-10-09T15:34:15.585 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.585 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.640 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0407e-05 s, 0.0 kB/s 2023-10-09T15:34:15.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.641 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.696 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.266e-05 s, 0.0 kB/s 2023-10-09T15:34:15.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.697 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.753 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2531e-05 s, 0.0 kB/s 2023-10-09T15:34:15.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.753 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-09T15:34:15.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.809 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0617e-05 s, 0.0 kB/s 2023-10-09T15:34:15.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.920 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3188e-05 s, 0.0 kB/s 2023-10-09T15:34:15.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:15.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0444e-05 s, 0.0 kB/s 2023-10-09T15:34:15.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:15.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0883e-05 s, 0.0 kB/s 2023-10-09T15:34:16.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.032 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1017e-05 s, 0.0 kB/s 2023-10-09T15:34:16.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.142 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3867e-05 s, 0.0 kB/s 2023-10-09T15:34:16.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.198 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2145e-05 s, 0.0 kB/s 2023-10-09T15:34:16.198 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.198 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.255 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2653e-05 s, 0.0 kB/s 2023-10-09T15:34:16.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9896e-05 s, 0.0 kB/s 2023-10-09T15:34:16.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5699e-05 s, 0.0 kB/s 2023-10-09T15:34:16.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.367 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.422 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2142e-05 s, 0.0 kB/s 2023-10-09T15:34:16.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.423 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.478 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0478e-05 s, 0.0 kB/s 2023-10-09T15:34:16.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.479 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-09T15:34:16.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.535 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.590 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1979e-05 s, 0.0 kB/s 2023-10-09T15:34:16.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.591 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.646 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2657e-05 s, 0.0 kB/s 2023-10-09T15:34:16.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.647 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.702 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0623e-05 s, 0.0 kB/s 2023-10-09T15:34:16.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.703 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.758 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0137e-05 s, 0.0 kB/s 2023-10-09T15:34:16.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.758 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.814 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.814 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.814 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1315e-05 s, 0.0 kB/s 2023-10-09T15:34:16.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.814 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.869 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9434e-05 s, 0.0 kB/s 2023-10-09T15:34:16.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.869 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.925 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2866e-05 s, 0.0 kB/s 2023-10-09T15:34:16.925 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.926 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4459e-05 s, 0.0 kB/s 2023-10-09T15:34:16.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:16.982 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.037 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2909e-05 s, 0.0 kB/s 2023-10-09T15:34:17.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.038 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.093 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5235e-05 s, 0.0 kB/s 2023-10-09T15:34:17.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.093 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.149 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2599e-05 s, 0.0 kB/s 2023-10-09T15:34:17.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.149 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0943e-05 s, 0.0 kB/s 2023-10-09T15:34:17.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.260 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-09T15:34:17.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.336 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1875e-05 s, 0.0 kB/s 2023-10-09T15:34:17.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.337 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2156e-05 s, 0.0 kB/s 2023-10-09T15:34:17.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.393 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3198e-05 s, 0.0 kB/s 2023-10-09T15:34:17.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3022e-05 s, 0.0 kB/s 2023-10-09T15:34:17.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.505 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3711e-05 s, 0.0 kB/s 2023-10-09T15:34:17.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.561 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2453e-05 s, 0.0 kB/s 2023-10-09T15:34:17.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.673 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2439e-05 s, 0.0 kB/s 2023-10-09T15:34:17.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.673 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.729 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2444e-05 s, 0.0 kB/s 2023-10-09T15:34:17.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.729 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.785 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4744e-05 s, 0.0 kB/s 2023-10-09T15:34:17.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.785 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.841 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0387e-05 s, 0.0 kB/s 2023-10-09T15:34:17.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.841 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.898 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.441e-05 s, 0.0 kB/s 2023-10-09T15:34:17.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.898 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:17.953 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:17.954 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1065e-05 s, 0.0 kB/s 2023-10-09T15:34:17.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:17.954 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.009 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.009 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.010 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0289e-05 s, 0.0 kB/s 2023-10-09T15:34:18.010 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.010 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.066 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9643e-05 s, 0.0 kB/s 2023-10-09T15:34:18.066 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.066 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.121 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8772e-05 s, 0.0 kB/s 2023-10-09T15:34:18.122 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.122 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.177 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.178 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4407e-05 s, 0.0 kB/s 2023-10-09T15:34:18.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.178 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.234 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1622e-05 s, 0.0 kB/s 2023-10-09T15:34:18.234 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.234 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.290 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4871e-05 s, 0.0 kB/s 2023-10-09T15:34:18.290 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.290 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.347 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.347 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0668e-05 s, 0.0 kB/s 2023-10-09T15:34:18.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.347 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1794e-05 s, 0.0 kB/s 2023-10-09T15:34:18.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.403 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3667e-05 s, 0.0 kB/s 2023-10-09T15:34:18.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.459 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.515 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2888e-05 s, 0.0 kB/s 2023-10-09T15:34:18.515 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.515 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.571 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1318e-05 s, 0.0 kB/s 2023-10-09T15:34:18.571 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.571 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.627 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-09T15:34:18.627 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.627 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4458e-05 s, 0.0 kB/s 2023-10-09T15:34:18.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.683 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.739 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.740 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2888e-05 s, 0.0 kB/s 2023-10-09T15:34:18.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.740 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0109e-05 s, 0.0 kB/s 2023-10-09T15:34:18.795 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.796 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1092e-05 s, 0.0 kB/s 2023-10-09T15:34:18.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.852 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.907 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2969e-05 s, 0.0 kB/s 2023-10-09T15:34:18.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.908 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:18.963 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.953e-05 s, 0.0 kB/s 2023-10-09T15:34:18.963 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:18.963 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.019 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9419e-05 s, 0.0 kB/s 2023-10-09T15:34:19.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.020 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1912e-05 s, 0.0 kB/s 2023-10-09T15:34:19.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.076 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.131 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.263e-05 s, 0.0 kB/s 2023-10-09T15:34:19.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.187 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9383e-05 s, 0.0 kB/s 2023-10-09T15:34:19.187 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.243 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9622e-05 s, 0.0 kB/s 2023-10-09T15:34:19.243 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.243 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.299 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1976e-05 s, 0.0 kB/s 2023-10-09T15:34:19.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.5689e-05 s, 0.0 kB/s 2023-10-09T15:34:19.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-09T15:34:19.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.414 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2281e-05 s, 0.0 kB/s 2023-10-09T15:34:19.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1588e-05 s, 0.0 kB/s 2023-10-09T15:34:19.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4514e-05 s, 0.0 kB/s 2023-10-09T15:34:19.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.582 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.637 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9821e-05 s, 0.0 kB/s 2023-10-09T15:34:19.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.637 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.694 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2087e-05 s, 0.0 kB/s 2023-10-09T15:34:19.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.750 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.750 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1971e-05 s, 0.0 kB/s 2023-10-09T15:34:19.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.750 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.805 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1909e-05 s, 0.0 kB/s 2023-10-09T15:34:19.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.806 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.861 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2706e-05 s, 0.0 kB/s 2023-10-09T15:34:19.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.862 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9888e-05 s, 0.0 kB/s 2023-10-09T15:34:19.917 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.918 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:19.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-09T15:34:19.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:19.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.030 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1327e-05 s, 0.0 kB/s 2023-10-09T15:34:20.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.085 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.001e-05 s, 0.0 kB/s 2023-10-09T15:34:20.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.085 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.142 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0286e-05 s, 0.0 kB/s 2023-10-09T15:34:20.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.142 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0647e-05 s, 0.0 kB/s 2023-10-09T15:34:20.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.253 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0623e-05 s, 0.0 kB/s 2023-10-09T15:34:20.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.253 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.308 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.308 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.308 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9689e-05 s, 0.0 kB/s 2023-10-09T15:34:20.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.309 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.365 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5007e-05 s, 0.0 kB/s 2023-10-09T15:34:20.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.365 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.421 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.421 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.421 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.486e-05 s, 0.0 kB/s 2023-10-09T15:34:20.422 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.422 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.477 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.478 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5575e-05 s, 0.0 kB/s 2023-10-09T15:34:20.478 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.478 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.533 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1116e-05 s, 0.0 kB/s 2023-10-09T15:34:20.534 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.534 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.588 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.589 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9496e-05 s, 0.0 kB/s 2023-10-09T15:34:20.590 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.590 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.645 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0411e-05 s, 0.0 kB/s 2023-10-09T15:34:20.646 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.646 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.701 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3167e-05 s, 0.0 kB/s 2023-10-09T15:34:20.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.701 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.756 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2341e-05 s, 0.0 kB/s 2023-10-09T15:34:20.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.757 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1605e-05 s, 0.0 kB/s 2023-10-09T15:34:20.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.813 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9667e-05 s, 0.0 kB/s 2023-10-09T15:34:20.869 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.869 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.992e-05 s, 0.0 kB/s 2023-10-09T15:34:20.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:20.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:20.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:20.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-09T15:34:20.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:20.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.164e-05 s, 0.0 kB/s 2023-10-09T15:34:21.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9681e-05 s, 0.0 kB/s 2023-10-09T15:34:21.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.093 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1361e-05 s, 0.0 kB/s 2023-10-09T15:34:21.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.149 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1212e-05 s, 0.0 kB/s 2023-10-09T15:34:21.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.260 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2661e-05 s, 0.0 kB/s 2023-10-09T15:34:21.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.317 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.317 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.317 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.937e-05 s, 0.0 kB/s 2023-10-09T15:34:21.318 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.318 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.373 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0351e-05 s, 0.0 kB/s 2023-10-09T15:34:21.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.374 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.429 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.429 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.429 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3154e-05 s, 0.0 kB/s 2023-10-09T15:34:21.430 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.430 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.485 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.485 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.486 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2061e-05 s, 0.0 kB/s 2023-10-09T15:34:21.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.486 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.542 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5151e-05 s, 0.0 kB/s 2023-10-09T15:34:21.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.542 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.597 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2989e-05 s, 0.0 kB/s 2023-10-09T15:34:21.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.598 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.653 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2756e-05 s, 0.0 kB/s 2023-10-09T15:34:21.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.654 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.733 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.903e-05 s, 0.0 kB/s 2023-10-09T15:34:21.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.734 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.790 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.791 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2931e-05 s, 0.0 kB/s 2023-10-09T15:34:21.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.791 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.845 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.846 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0379e-05 s, 0.0 kB/s 2023-10-09T15:34:21.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.847 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.903 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2106e-05 s, 0.0 kB/s 2023-10-09T15:34:21.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.903 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:21.957 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:21.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:21.958 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0014e-05 s, 0.0 kB/s 2023-10-09T15:34:21.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:21.959 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9994e-05 s, 0.0 kB/s 2023-10-09T15:34:22.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.014 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2086e-05 s, 0.0 kB/s 2023-10-09T15:34:22.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.070 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.125 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.125 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.125 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9216e-05 s, 0.0 kB/s 2023-10-09T15:34:22.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.126 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.181 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.181 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.181 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0013e-05 s, 0.0 kB/s 2023-10-09T15:34:22.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.182 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.238 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4022e-05 s, 0.0 kB/s 2023-10-09T15:34:22.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.238 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.293 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2528e-05 s, 0.0 kB/s 2023-10-09T15:34:22.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.294 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.350 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4865e-05 s, 0.0 kB/s 2023-10-09T15:34:22.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.405 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2056e-05 s, 0.0 kB/s 2023-10-09T15:34:22.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.406 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.462 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1205e-05 s, 0.0 kB/s 2023-10-09T15:34:22.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.517 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0954e-05 s, 0.0 kB/s 2023-10-09T15:34:22.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.574 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2552e-05 s, 0.0 kB/s 2023-10-09T15:34:22.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.574 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.629 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2912e-05 s, 0.0 kB/s 2023-10-09T15:34:22.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1354e-05 s, 0.0 kB/s 2023-10-09T15:34:22.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.687 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1669e-05 s, 0.0 kB/s 2023-10-09T15:34:22.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1176e-05 s, 0.0 kB/s 2023-10-09T15:34:22.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.855 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2812e-05 s, 0.0 kB/s 2023-10-09T15:34:22.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.911 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-09T15:34:22.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.912 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:22.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:22.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:22.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-09T15:34:22.968 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:22.968 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.024 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2245e-05 s, 0.0 kB/s 2023-10-09T15:34:23.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.024 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.079 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5901e-05 s, 0.0 kB/s 2023-10-09T15:34:23.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.135 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-09T15:34:23.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.136 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.192 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0537e-05 s, 0.0 kB/s 2023-10-09T15:34:23.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.192 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.245e-05 s, 0.0 kB/s 2023-10-09T15:34:23.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.248 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3905e-05 s, 0.0 kB/s 2023-10-09T15:34:23.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.304 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.360 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.469 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9844e-05 s, 0.0 kB/s 2023-10-09T15:34:23.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.486 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.071e-05 s, 0.0 kB/s 2023-10-09T15:34:23.486 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.486 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.542 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3627e-05 s, 0.0 kB/s 2023-10-09T15:34:23.542 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.542 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.598 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.598 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0552e-05 s, 0.0 kB/s 2023-10-09T15:34:23.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.598 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.653 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3149e-05 s, 0.0 kB/s 2023-10-09T15:34:23.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.654 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.710 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.710 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.710 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2012e-05 s, 0.0 kB/s 2023-10-09T15:34:23.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.711 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.766 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.766 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.766 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.185e-05 s, 0.0 kB/s 2023-10-09T15:34:23.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.767 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.823 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2491e-05 s, 0.0 kB/s 2023-10-09T15:34:23.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.823 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.878 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.878 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.879 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1562e-05 s, 0.0 kB/s 2023-10-09T15:34:23.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.879 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2644e-05 s, 0.0 kB/s 2023-10-09T15:34:23.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.935 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:23.990 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2762e-05 s, 0.0 kB/s 2023-10-09T15:34:23.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:23.991 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.046 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.046 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.046 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.062e-05 s, 0.0 kB/s 2023-10-09T15:34:24.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.047 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.102 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.102 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.103 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0447e-05 s, 0.0 kB/s 2023-10-09T15:34:24.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.103 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.158 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9323e-05 s, 0.0 kB/s 2023-10-09T15:34:24.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.159 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.214 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.215 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.263e-05 s, 0.0 kB/s 2023-10-09T15:34:24.215 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.215 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.270 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2869e-05 s, 0.0 kB/s 2023-10-09T15:34:24.271 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.271 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.327 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0199e-05 s, 0.0 kB/s 2023-10-09T15:34:24.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.328 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.384 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-09T15:34:24.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.384 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.440 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2438e-05 s, 0.0 kB/s 2023-10-09T15:34:24.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.440 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.495 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.316e-05 s, 0.0 kB/s 2023-10-09T15:34:24.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.496 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.551 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1226e-05 s, 0.0 kB/s 2023-10-09T15:34:24.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.552 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.608 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4967e-05 s, 0.0 kB/s 2023-10-09T15:34:24.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.609 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-09T15:34:24.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.665 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.720 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2655e-05 s, 0.0 kB/s 2023-10-09T15:34:24.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.720 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.776 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0113e-05 s, 0.0 kB/s 2023-10-09T15:34:24.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.777 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.832 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3471e-05 s, 0.0 kB/s 2023-10-09T15:34:24.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5716e-05 s, 0.0 kB/s 2023-10-09T15:34:24.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:24.945 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-09T15:34:24.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:24.946 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0124e-05 s, 0.0 kB/s 2023-10-09T15:34:25.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.057 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9121e-05 s, 0.0 kB/s 2023-10-09T15:34:25.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.057 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.112 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1059e-05 s, 0.0 kB/s 2023-10-09T15:34:25.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.112 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.168 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0473e-05 s, 0.0 kB/s 2023-10-09T15:34:25.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.169 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.224 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0244e-05 s, 0.0 kB/s 2023-10-09T15:34:25.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2817e-05 s, 0.0 kB/s 2023-10-09T15:34:25.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5731e-05 s, 0.0 kB/s 2023-10-09T15:34:25.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.337 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5233e-05 s, 0.0 kB/s 2023-10-09T15:34:25.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.393 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.448 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1319e-05 s, 0.0 kB/s 2023-10-09T15:34:25.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.505 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5949e-05 s, 0.0 kB/s 2023-10-09T15:34:25.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.505 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.560 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.560 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.560 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0372e-05 s, 0.0 kB/s 2023-10-09T15:34:25.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.561 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.616 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.077e-05 s, 0.0 kB/s 2023-10-09T15:34:25.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0297e-05 s, 0.0 kB/s 2023-10-09T15:34:25.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.673 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.728 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0832e-05 s, 0.0 kB/s 2023-10-09T15:34:25.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.729 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1047e-05 s, 0.0 kB/s 2023-10-09T15:34:25.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.785 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.285e-05 s, 0.0 kB/s 2023-10-09T15:34:25.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.384e-05 s, 0.0 kB/s 2023-10-09T15:34:25.896 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.896 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:25.952 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2021e-05 s, 0.0 kB/s 2023-10-09T15:34:25.952 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:25.953 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1531e-05 s, 0.0 kB/s 2023-10-09T15:34:26.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.009 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.065 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9648e-05 s, 0.0 kB/s 2023-10-09T15:34:26.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.065 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1556e-05 s, 0.0 kB/s 2023-10-09T15:34:26.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.175 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1891e-05 s, 0.0 kB/s 2023-10-09T15:34:26.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.176 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.231 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7552e-05 s, 0.0 kB/s 2023-10-09T15:34:26.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.231 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.287 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0275e-05 s, 0.0 kB/s 2023-10-09T15:34:26.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.288 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.343 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.343 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.343 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9982e-05 s, 0.0 kB/s 2023-10-09T15:34:26.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.344 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.399 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5432e-05 s, 0.0 kB/s 2023-10-09T15:34:26.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.400 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.455 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.455 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.455 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3156e-05 s, 0.0 kB/s 2023-10-09T15:34:26.456 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.456 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.511 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2323e-05 s, 0.0 kB/s 2023-10-09T15:34:26.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.512 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.568 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2213e-05 s, 0.0 kB/s 2023-10-09T15:34:26.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.568 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.623 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.209e-05 s, 0.0 kB/s 2023-10-09T15:34:26.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.624 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-09T15:34:26.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.680 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.735 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.735 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9557e-05 s, 0.0 kB/s 2023-10-09T15:34:26.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.736 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.791 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3184e-05 s, 0.0 kB/s 2023-10-09T15:34:26.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.791 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.848 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-09T15:34:26.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.848 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.903 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2709e-05 s, 0.0 kB/s 2023-10-09T15:34:26.904 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.904 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:26.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:26.960 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-09T15:34:26.960 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:26.960 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.015 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0746e-05 s, 0.0 kB/s 2023-10-09T15:34:27.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.016 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.071 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4167e-05 s, 0.0 kB/s 2023-10-09T15:34:27.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.072 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.127 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.127 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.127 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2142e-05 s, 0.0 kB/s 2023-10-09T15:34:27.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.127 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.183 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5221e-05 s, 0.0 kB/s 2023-10-09T15:34:27.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.183 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.238 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0757e-05 s, 0.0 kB/s 2023-10-09T15:34:27.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.239 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.294 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2278e-05 s, 0.0 kB/s 2023-10-09T15:34:27.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.295 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.352 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9746e-05 s, 0.0 kB/s 2023-10-09T15:34:27.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.352 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.408 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.408 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.33e-05 s, 0.0 kB/s 2023-10-09T15:34:27.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.408 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2746e-05 s, 0.0 kB/s 2023-10-09T15:34:27.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.464 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.519 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.127e-05 s, 0.0 kB/s 2023-10-09T15:34:27.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.520 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1334e-05 s, 0.0 kB/s 2023-10-09T15:34:27.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.576 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0284e-05 s, 0.0 kB/s 2023-10-09T15:34:27.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.631 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.687 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4518e-05 s, 0.0 kB/s 2023-10-09T15:34:27.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.687 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.741 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1568e-05 s, 0.0 kB/s 2023-10-09T15:34:27.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1e-05 s, 0.0 kB/s 2023-10-09T15:34:27.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.939e-05 s, 0.0 kB/s 2023-10-09T15:34:27.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.285e-05 s, 0.0 kB/s 2023-10-09T15:34:27.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:27.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.117e-05 s, 0.0 kB/s 2023-10-09T15:34:27.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:27.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0981e-05 s, 0.0 kB/s 2023-10-09T15:34:28.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.023 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-09T15:34:28.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.079 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0528e-05 s, 0.0 kB/s 2023-10-09T15:34:28.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.134 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2577e-05 s, 0.0 kB/s 2023-10-09T15:34:28.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.190 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.245 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.266e-05 s, 0.0 kB/s 2023-10-09T15:34:28.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.246 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.301 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3202e-05 s, 0.0 kB/s 2023-10-09T15:34:28.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.302 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.358 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9732e-05 s, 0.0 kB/s 2023-10-09T15:34:28.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3648e-05 s, 0.0 kB/s 2023-10-09T15:34:28.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.414 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1341e-05 s, 0.0 kB/s 2023-10-09T15:34:28.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.469 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1513e-05 s, 0.0 kB/s 2023-10-09T15:34:28.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.525 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9999e-05 s, 0.0 kB/s 2023-10-09T15:34:28.581 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.581 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.636 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.636 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.636 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1279e-05 s, 0.0 kB/s 2023-10-09T15:34:28.637 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.637 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.692 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.693 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2438e-05 s, 0.0 kB/s 2023-10-09T15:34:28.693 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.693 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.747 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.748 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.026e-05 s, 0.0 kB/s 2023-10-09T15:34:28.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.748 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.804 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.804 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0822e-05 s, 0.0 kB/s 2023-10-09T15:34:28.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.861 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9838e-05 s, 0.0 kB/s 2023-10-09T15:34:28.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.861 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.915 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.916 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5199e-05 s, 0.0 kB/s 2023-10-09T15:34:28.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.917 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:28.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:28.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:28.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3196e-05 s, 0.0 kB/s 2023-10-09T15:34:28.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:28.973 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.028 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1923e-05 s, 0.0 kB/s 2023-10-09T15:34:29.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.029 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.084 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.085 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.27e-05 s, 0.0 kB/s 2023-10-09T15:34:29.085 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.085 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.140 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1024e-05 s, 0.0 kB/s 2023-10-09T15:34:29.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.141 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.196 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0838e-05 s, 0.0 kB/s 2023-10-09T15:34:29.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1677e-05 s, 0.0 kB/s 2023-10-09T15:34:29.252 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.253 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.310 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.369e-05 s, 0.0 kB/s 2023-10-09T15:34:29.310 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.366 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2132e-05 s, 0.0 kB/s 2023-10-09T15:34:29.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.367 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.422 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4405e-05 s, 0.0 kB/s 2023-10-09T15:34:29.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.423 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.479 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1257e-05 s, 0.0 kB/s 2023-10-09T15:34:29.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.479 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.534 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1219e-05 s, 0.0 kB/s 2023-10-09T15:34:29.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.535 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.591 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8434e-05 s, 0.0 kB/s 2023-10-09T15:34:29.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.591 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.646 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.647 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-09T15:34:29.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.647 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.702 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2533e-05 s, 0.0 kB/s 2023-10-09T15:34:29.702 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.702 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.757 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4428e-05 s, 0.0 kB/s 2023-10-09T15:34:29.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.757 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.813 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.186e-05 s, 0.0 kB/s 2023-10-09T15:34:29.814 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.814 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.869 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.869 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.869 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9511e-05 s, 0.0 kB/s 2023-10-09T15:34:29.870 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.870 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.925 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.925 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.926 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1779e-05 s, 0.0 kB/s 2023-10-09T15:34:29.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.926 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:29.981 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.139e-05 s, 0.0 kB/s 2023-10-09T15:34:29.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:29.982 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.037 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1995e-05 s, 0.0 kB/s 2023-10-09T15:34:30.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.038 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.093 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2119e-05 s, 0.0 kB/s 2023-10-09T15:34:30.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.093 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2776e-05 s, 0.0 kB/s 2023-10-09T15:34:30.149 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.149 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0906e-05 s, 0.0 kB/s 2023-10-09T15:34:30.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.261 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4342e-05 s, 0.0 kB/s 2023-10-09T15:34:30.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.316 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-09T15:34:30.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.317 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.373 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9739e-05 s, 0.0 kB/s 2023-10-09T15:34:30.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.373 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.429 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3221e-05 s, 0.0 kB/s 2023-10-09T15:34:30.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.429 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.041e-05 s, 0.0 kB/s 2023-10-09T15:34:30.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.541 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2854e-05 s, 0.0 kB/s 2023-10-09T15:34:30.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.541 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.597 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2382e-05 s, 0.0 kB/s 2023-10-09T15:34:30.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.597 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1906e-05 s, 0.0 kB/s 2023-10-09T15:34:30.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.707 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9382e-05 s, 0.0 kB/s 2023-10-09T15:34:30.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.763 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1394e-05 s, 0.0 kB/s 2023-10-09T15:34:30.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.764 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.818 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2733e-05 s, 0.0 kB/s 2023-10-09T15:34:30.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.819 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.875 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0687e-05 s, 0.0 kB/s 2023-10-09T15:34:30.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.931 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0101e-05 s, 0.0 kB/s 2023-10-09T15:34:30.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.931 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:30.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:30.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:30.988 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2993e-05 s, 0.0 kB/s 2023-10-09T15:34:30.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:30.988 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.043 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-09T15:34:31.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.044 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.099 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-09T15:34:31.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.155 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2458e-05 s, 0.0 kB/s 2023-10-09T15:34:31.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.211 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3705e-05 s, 0.0 kB/s 2023-10-09T15:34:31.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.211 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.267 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.267 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.267 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3621e-05 s, 0.0 kB/s 2023-10-09T15:34:31.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.268 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3687e-05 s, 0.0 kB/s 2023-10-09T15:34:31.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2083e-05 s, 0.0 kB/s 2023-10-09T15:34:31.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.381 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.437 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3905e-05 s, 0.0 kB/s 2023-10-09T15:34:31.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.493 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.096e-05 s, 0.0 kB/s 2023-10-09T15:34:31.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.548 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2825e-05 s, 0.0 kB/s 2023-10-09T15:34:31.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.604 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4033e-05 s, 0.0 kB/s 2023-10-09T15:34:31.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3639e-05 s, 0.0 kB/s 2023-10-09T15:34:31.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.661 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.716 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0882e-05 s, 0.0 kB/s 2023-10-09T15:34:31.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.716 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.772 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2437e-05 s, 0.0 kB/s 2023-10-09T15:34:31.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.772 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.828 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1768e-05 s, 0.0 kB/s 2023-10-09T15:34:31.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.829 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.885 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1875e-05 s, 0.0 kB/s 2023-10-09T15:34:31.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.885 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:31.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.6578e-05 s, 0.0 kB/s 2023-10-09T15:34:31.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:31.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1498e-05 s, 0.0 kB/s 2023-10-09T15:34:32.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.023 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.079 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2107e-05 s, 0.0 kB/s 2023-10-09T15:34:32.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1427e-05 s, 0.0 kB/s 2023-10-09T15:34:32.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.136 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.191 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2418e-05 s, 0.0 kB/s 2023-10-09T15:34:32.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.192 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.293e-05 s, 0.0 kB/s 2023-10-09T15:34:32.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.248 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.304 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3203e-05 s, 0.0 kB/s 2023-10-09T15:34:32.304 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.304 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.359 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.360 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1634e-05 s, 0.0 kB/s 2023-10-09T15:34:32.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.360 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4479e-05 s, 0.0 kB/s 2023-10-09T15:34:32.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.416 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.471 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-09T15:34:32.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.472 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.527 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4332e-05 s, 0.0 kB/s 2023-10-09T15:34:32.528 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.528 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.583 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.277e-05 s, 0.0 kB/s 2023-10-09T15:34:32.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.584 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.640 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-09T15:34:32.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.696 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0674e-05 s, 0.0 kB/s 2023-10-09T15:34:32.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.696 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.979e-05 s, 0.0 kB/s 2023-10-09T15:34:32.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.751 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.806 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-09T15:34:32.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.807 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1131e-05 s, 0.0 kB/s 2023-10-09T15:34:32.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.918 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3557e-05 s, 0.0 kB/s 2023-10-09T15:34:32.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:32.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3754e-05 s, 0.0 kB/s 2023-10-09T15:34:32.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:32.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T15:34:33.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.031 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.086 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0039e-05 s, 0.0 kB/s 2023-10-09T15:34:33.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.143 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.009e-05 s, 0.0 kB/s 2023-10-09T15:34:33.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.198 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2731e-05 s, 0.0 kB/s 2023-10-09T15:34:33.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.254 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0881e-05 s, 0.0 kB/s 2023-10-09T15:34:33.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.495e-05 s, 0.0 kB/s 2023-10-09T15:34:33.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5743e-05 s, 0.0 kB/s 2023-10-09T15:34:33.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.367 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.422 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.16e-05 s, 0.0 kB/s 2023-10-09T15:34:33.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.423 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.479 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0883e-05 s, 0.0 kB/s 2023-10-09T15:34:33.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.480 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2483e-05 s, 0.0 kB/s 2023-10-09T15:34:33.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.536 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.591 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2881e-05 s, 0.0 kB/s 2023-10-09T15:34:33.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.592 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.647 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2748e-05 s, 0.0 kB/s 2023-10-09T15:34:33.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.648 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.703 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.703 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.703 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3012e-05 s, 0.0 kB/s 2023-10-09T15:34:33.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.704 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.760 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0583e-05 s, 0.0 kB/s 2023-10-09T15:34:33.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.760 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.815 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-09T15:34:33.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.816 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.871 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.871 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.871 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2628e-05 s, 0.0 kB/s 2023-10-09T15:34:33.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.872 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.927 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.928 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1837e-05 s, 0.0 kB/s 2023-10-09T15:34:33.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.928 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:33.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:33.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:33.983 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1771e-05 s, 0.0 kB/s 2023-10-09T15:34:33.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:33.984 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.040 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0182e-05 s, 0.0 kB/s 2023-10-09T15:34:34.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.040 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.095 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.095 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.096 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0829e-05 s, 0.0 kB/s 2023-10-09T15:34:34.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.096 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.151 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.152 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.152 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2702e-05 s, 0.0 kB/s 2023-10-09T15:34:34.152 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.152 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.207 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.207 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.208 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1211e-05 s, 0.0 kB/s 2023-10-09T15:34:34.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.208 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.264 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.819e-05 s, 0.0 kB/s 2023-10-09T15:34:34.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.265 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.322 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.322 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.3496e-05 s, 0.0 kB/s 2023-10-09T15:34:34.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.322 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.378 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.378 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.213e-05 s, 0.0 kB/s 2023-10-09T15:34:34.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.434 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.991e-05 s, 0.0 kB/s 2023-10-09T15:34:34.434 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.434 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.489 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1072e-05 s, 0.0 kB/s 2023-10-09T15:34:34.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.490 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.546 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1465e-05 s, 0.0 kB/s 2023-10-09T15:34:34.546 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.546 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.601 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.602 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.602 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.126e-05 s, 0.0 kB/s 2023-10-09T15:34:34.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.602 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.658 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1138e-05 s, 0.0 kB/s 2023-10-09T15:34:34.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.659 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.714 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.715 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.715 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.479e-05 s, 0.0 kB/s 2023-10-09T15:34:34.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.715 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.770 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9369e-05 s, 0.0 kB/s 2023-10-09T15:34:34.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.771 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.826 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3097e-05 s, 0.0 kB/s 2023-10-09T15:34:34.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.826 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.881 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.051e-05 s, 0.0 kB/s 2023-10-09T15:34:34.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.882 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.937 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0007e-05 s, 0.0 kB/s 2023-10-09T15:34:34.938 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.938 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:34.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:34.994 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.198e-05 s, 0.0 kB/s 2023-10-09T15:34:34.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:34.994 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.049 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9981e-05 s, 0.0 kB/s 2023-10-09T15:34:35.050 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.050 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.105 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4534e-05 s, 0.0 kB/s 2023-10-09T15:34:35.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.105 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.161 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.161 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0627e-05 s, 0.0 kB/s 2023-10-09T15:34:35.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.162 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9667e-05 s, 0.0 kB/s 2023-10-09T15:34:35.218 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.218 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2008e-05 s, 0.0 kB/s 2023-10-09T15:34:35.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.274 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2721e-05 s, 0.0 kB/s 2023-10-09T15:34:35.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.330 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.387 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-09T15:34:35.387 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.387 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.443 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.208e-05 s, 0.0 kB/s 2023-10-09T15:34:35.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.443 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3479e-05 s, 0.0 kB/s 2023-10-09T15:34:35.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.499 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.554 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1008e-05 s, 0.0 kB/s 2023-10-09T15:34:35.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.555 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.611 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0744e-05 s, 0.0 kB/s 2023-10-09T15:34:35.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.611 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.666 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.985e-05 s, 0.0 kB/s 2023-10-09T15:34:35.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.667 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.449e-05 s, 0.0 kB/s 2023-10-09T15:34:35.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.779 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1963e-05 s, 0.0 kB/s 2023-10-09T15:34:35.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.779 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.834 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0357e-05 s, 0.0 kB/s 2023-10-09T15:34:35.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.891 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4024e-05 s, 0.0 kB/s 2023-10-09T15:34:35.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.891 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:35.946 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1032e-05 s, 0.0 kB/s 2023-10-09T15:34:35.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:35.947 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2058e-05 s, 0.0 kB/s 2023-10-09T15:34:36.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.003 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0603e-05 s, 0.0 kB/s 2023-10-09T15:34:36.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.059 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.118 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3444e-05 s, 0.0 kB/s 2023-10-09T15:34:36.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.118 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.173 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3771e-05 s, 0.0 kB/s 2023-10-09T15:34:36.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.173 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:34:36.216 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:34:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.230 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1952e-05 s, 0.0 kB/s 2023-10-09T15:34:36.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.231 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.286 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.287 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5209e-05 s, 0.0 kB/s 2023-10-09T15:34:36.287 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.287 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.342 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.342 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.343 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.38e-05 s, 0.0 kB/s 2023-10-09T15:34:36.343 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.343 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3311e-05 s, 0.0 kB/s 2023-10-09T15:34:36.399 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.399 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.454 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.454 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.454 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0693e-05 s, 0.0 kB/s 2023-10-09T15:34:36.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.455 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.510 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.224e-05 s, 0.0 kB/s 2023-10-09T15:34:36.511 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.511 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.566 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0856e-05 s, 0.0 kB/s 2023-10-09T15:34:36.567 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.567 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.623 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0244e-05 s, 0.0 kB/s 2023-10-09T15:34:36.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.678 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5368e-05 s, 0.0 kB/s 2023-10-09T15:34:36.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.679 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.735 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3033e-05 s, 0.0 kB/s 2023-10-09T15:34:36.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.735 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.790 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.791 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3265e-05 s, 0.0 kB/s 2023-10-09T15:34:36.791 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.791 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2064e-05 s, 0.0 kB/s 2023-10-09T15:34:36.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.847 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.902 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.902 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.902 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0098e-05 s, 0.0 kB/s 2023-10-09T15:34:36.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.903 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:36.958 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5429e-05 s, 0.0 kB/s 2023-10-09T15:34:36.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:36.959 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3289e-05 s, 0.0 kB/s 2023-10-09T15:34:37.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.015 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.071 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1484e-05 s, 0.0 kB/s 2023-10-09T15:34:37.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.071 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.127 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0696e-05 s, 0.0 kB/s 2023-10-09T15:34:37.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.127 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.183 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2387e-05 s, 0.0 kB/s 2023-10-09T15:34:37.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.183 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.238 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2515e-05 s, 0.0 kB/s 2023-10-09T15:34:37.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.239 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.294 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0754e-05 s, 0.0 kB/s 2023-10-09T15:34:37.295 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.295 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2595e-05 s, 0.0 kB/s 2023-10-09T15:34:37.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.351 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.407 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2111e-05 s, 0.0 kB/s 2023-10-09T15:34:37.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.407 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.462 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2163e-05 s, 0.0 kB/s 2023-10-09T15:34:37.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.463 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.519 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3496e-05 s, 0.0 kB/s 2023-10-09T15:34:37.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.519 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2634e-05 s, 0.0 kB/s 2023-10-09T15:34:37.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.575 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0703e-05 s, 0.0 kB/s 2023-10-09T15:34:37.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.631 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2173e-05 s, 0.0 kB/s 2023-10-09T15:34:37.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.687 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1841e-05 s, 0.0 kB/s 2023-10-09T15:34:37.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4161e-05 s, 0.0 kB/s 2023-10-09T15:34:37.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.687e-05 s, 0.0 kB/s 2023-10-09T15:34:37.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5121e-05 s, 0.0 kB/s 2023-10-09T15:34:37.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:37.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:37.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:37.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0026e-05 s, 0.0 kB/s 2023-10-09T15:34:37.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:37.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.023 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0598e-05 s, 0.0 kB/s 2023-10-09T15:34:38.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.023 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.117 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.6339e-05 s, 0.0 kB/s 2023-10-09T15:34:38.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.118 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4851e-05 s, 0.0 kB/s 2023-10-09T15:34:38.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.134 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-09T15:34:38.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.190 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.245 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9742e-05 s, 0.0 kB/s 2023-10-09T15:34:38.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.246 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.301 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.471e-05 s, 0.0 kB/s 2023-10-09T15:34:38.302 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.302 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4246e-05 s, 0.0 kB/s 2023-10-09T15:34:38.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2388e-05 s, 0.0 kB/s 2023-10-09T15:34:38.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.414 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1193e-05 s, 0.0 kB/s 2023-10-09T15:34:38.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1249e-05 s, 0.0 kB/s 2023-10-09T15:34:38.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0224e-05 s, 0.0 kB/s 2023-10-09T15:34:38.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.582 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.638 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1137e-05 s, 0.0 kB/s 2023-10-09T15:34:38.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.638 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.694 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2958e-05 s, 0.0 kB/s 2023-10-09T15:34:38.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.749 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1681e-05 s, 0.0 kB/s 2023-10-09T15:34:38.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.750 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.806 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3353e-05 s, 0.0 kB/s 2023-10-09T15:34:38.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.806 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4785e-05 s, 0.0 kB/s 2023-10-09T15:34:38.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.862 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.918 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4632e-05 s, 0.0 kB/s 2023-10-09T15:34:38.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.918 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:38.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:38.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:38.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1767e-05 s, 0.0 kB/s 2023-10-09T15:34:38.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:38.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.029 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0188e-05 s, 0.0 kB/s 2023-10-09T15:34:39.029 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.086 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1282e-05 s, 0.0 kB/s 2023-10-09T15:34:39.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4819e-05 s, 0.0 kB/s 2023-10-09T15:34:39.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.199 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3958e-05 s, 0.0 kB/s 2023-10-09T15:34:39.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.254 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0503e-05 s, 0.0 kB/s 2023-10-09T15:34:39.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9349e-05 s, 0.0 kB/s 2023-10-09T15:34:39.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.366 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0814e-05 s, 0.0 kB/s 2023-10-09T15:34:39.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.367 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.422 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.422 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2682e-05 s, 0.0 kB/s 2023-10-09T15:34:39.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.423 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.478 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.478 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1039e-05 s, 0.0 kB/s 2023-10-09T15:34:39.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.479 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4543e-05 s, 0.0 kB/s 2023-10-09T15:34:39.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.535 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2702e-05 s, 0.0 kB/s 2023-10-09T15:34:39.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.591 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4329e-05 s, 0.0 kB/s 2023-10-09T15:34:39.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.647 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.703 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1688e-05 s, 0.0 kB/s 2023-10-09T15:34:39.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.703 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.758 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1356e-05 s, 0.0 kB/s 2023-10-09T15:34:39.759 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.759 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.814 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.815 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1198e-05 s, 0.0 kB/s 2023-10-09T15:34:39.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.815 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.870 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.870 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.870 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.312e-05 s, 0.0 kB/s 2023-10-09T15:34:39.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.871 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.926 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.926 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.927 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2882e-05 s, 0.0 kB/s 2023-10-09T15:34:39.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.927 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:39.982 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:39.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:39.983 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.52e-05 s, 0.0 kB/s 2023-10-09T15:34:39.983 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:39.983 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.038 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9243e-05 s, 0.0 kB/s 2023-10-09T15:34:40.038 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.039 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.094 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.094 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.094 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2929e-05 s, 0.0 kB/s 2023-10-09T15:34:40.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.095 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.151 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1958e-05 s, 0.0 kB/s 2023-10-09T15:34:40.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.151 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.206 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.206 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.207 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3073e-05 s, 0.0 kB/s 2023-10-09T15:34:40.207 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.207 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2499e-05 s, 0.0 kB/s 2023-10-09T15:34:40.262 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.263 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.318 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.318 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.318 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2394e-05 s, 0.0 kB/s 2023-10-09T15:34:40.319 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.319 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4182e-05 s, 0.0 kB/s 2023-10-09T15:34:40.375 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.375 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.430 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3802e-05 s, 0.0 kB/s 2023-10-09T15:34:40.431 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.431 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.486 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.486 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.486 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2018e-05 s, 0.0 kB/s 2023-10-09T15:34:40.487 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.487 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.542 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.542 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.542 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3538e-05 s, 0.0 kB/s 2023-10-09T15:34:40.543 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.543 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.598 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.598 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.599 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0811e-05 s, 0.0 kB/s 2023-10-09T15:34:40.599 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.599 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.654 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.655 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4876e-05 s, 0.0 kB/s 2023-10-09T15:34:40.655 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.655 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.711 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3022e-05 s, 0.0 kB/s 2023-10-09T15:34:40.711 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.711 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.766 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.767 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.767 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4914e-05 s, 0.0 kB/s 2023-10-09T15:34:40.767 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.767 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.822 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.823 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0774e-05 s, 0.0 kB/s 2023-10-09T15:34:40.823 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.823 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.879 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-09T15:34:40.879 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.879 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5123e-05 s, 0.0 kB/s 2023-10-09T15:34:40.935 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.935 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4516e-05 s, 0.0 kB/s 2023-10-09T15:34:40.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:40.991 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.047 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4242e-05 s, 0.0 kB/s 2023-10-09T15:34:41.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.047 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.103 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.495e-05 s, 0.0 kB/s 2023-10-09T15:34:41.103 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.104 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.160 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2705e-05 s, 0.0 kB/s 2023-10-09T15:34:41.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.161 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3992e-05 s, 0.0 kB/s 2023-10-09T15:34:41.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2521e-05 s, 0.0 kB/s 2023-10-09T15:34:41.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.273 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.328 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1226e-05 s, 0.0 kB/s 2023-10-09T15:34:41.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.384 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9531e-05 s, 0.0 kB/s 2023-10-09T15:34:41.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.384 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.440 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1102e-05 s, 0.0 kB/s 2023-10-09T15:34:41.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.440 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.496 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8774e-05 s, 0.0 kB/s 2023-10-09T15:34:41.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.497 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.552 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3089e-05 s, 0.0 kB/s 2023-10-09T15:34:41.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.553 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.608 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9978e-05 s, 0.0 kB/s 2023-10-09T15:34:41.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.609 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2125e-05 s, 0.0 kB/s 2023-10-09T15:34:41.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.665 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.720 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5149e-05 s, 0.0 kB/s 2023-10-09T15:34:41.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.721 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.776 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1643e-05 s, 0.0 kB/s 2023-10-09T15:34:41.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.777 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.833 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0745e-05 s, 0.0 kB/s 2023-10-09T15:34:41.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0597e-05 s, 0.0 kB/s 2023-10-09T15:34:41.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:41.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:41.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:41.945 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0162e-05 s, 0.0 kB/s 2023-10-09T15:34:41.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:41.945 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0063e-05 s, 0.0 kB/s 2023-10-09T15:34:42.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.001 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2135e-05 s, 0.0 kB/s 2023-10-09T15:34:42.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.112 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.994e-05 s, 0.0 kB/s 2023-10-09T15:34:42.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.112 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.167 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.168 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9079e-05 s, 0.0 kB/s 2023-10-09T15:34:42.168 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.168 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.223 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.223 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.2666e-05 s, 0.0 kB/s 2023-10-09T15:34:42.224 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.224 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.280 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.112e-05 s, 0.0 kB/s 2023-10-09T15:34:42.280 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.335 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1581e-05 s, 0.0 kB/s 2023-10-09T15:34:42.336 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.336 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2164e-05 s, 0.0 kB/s 2023-10-09T15:34:42.392 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.392 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.447 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.447 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.447 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.032e-05 s, 0.0 kB/s 2023-10-09T15:34:42.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.448 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.503 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.504 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5371e-05 s, 0.0 kB/s 2023-10-09T15:34:42.504 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.504 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.559 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.559 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.559 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1485e-05 s, 0.0 kB/s 2023-10-09T15:34:42.560 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.560 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.615 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9473e-05 s, 0.0 kB/s 2023-10-09T15:34:42.616 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.616 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4004e-05 s, 0.0 kB/s 2023-10-09T15:34:42.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.672 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.727 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3406e-05 s, 0.0 kB/s 2023-10-09T15:34:42.728 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.728 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0719e-05 s, 0.0 kB/s 2023-10-09T15:34:42.784 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.784 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1852e-05 s, 0.0 kB/s 2023-10-09T15:34:42.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.895 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0698e-05 s, 0.0 kB/s 2023-10-09T15:34:42.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.895 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:42.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:42.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:42.950 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.908e-05 s, 0.0 kB/s 2023-10-09T15:34:42.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:42.951 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0446e-05 s, 0.0 kB/s 2023-10-09T15:34:43.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.063 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2277e-05 s, 0.0 kB/s 2023-10-09T15:34:43.064 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.064 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.217e-05 s, 0.0 kB/s 2023-10-09T15:34:43.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.175 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0876e-05 s, 0.0 kB/s 2023-10-09T15:34:43.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.231 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0785e-05 s, 0.0 kB/s 2023-10-09T15:34:43.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.231 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.288 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4644e-05 s, 0.0 kB/s 2023-10-09T15:34:43.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.288 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.343 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.344 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3424e-05 s, 0.0 kB/s 2023-10-09T15:34:43.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.344 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.399 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.400 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2205e-05 s, 0.0 kB/s 2023-10-09T15:34:43.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.400 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.455 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.455 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.455 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1137e-05 s, 0.0 kB/s 2023-10-09T15:34:43.455 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.455 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.511 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2979e-05 s, 0.0 kB/s 2023-10-09T15:34:43.512 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.512 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.849e-05 s, 0.0 kB/s 2023-10-09T15:34:43.568 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.568 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.624 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2044e-05 s, 0.0 kB/s 2023-10-09T15:34:43.624 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.624 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1059e-05 s, 0.0 kB/s 2023-10-09T15:34:43.680 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.680 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.752 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.1265e-05 s, 0.0 kB/s 2023-10-09T15:34:43.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.753 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3976e-05 s, 0.0 kB/s 2023-10-09T15:34:43.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.809 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0434e-05 s, 0.0 kB/s 2023-10-09T15:34:43.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.865 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.920 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.843e-05 s, 0.0 kB/s 2023-10-09T15:34:43.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:43.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:43.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:43.976 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1545e-05 s, 0.0 kB/s 2023-10-09T15:34:43.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:43.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.032 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.032 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.032 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0852e-05 s, 0.0 kB/s 2023-10-09T15:34:44.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.033 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.089 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9951e-05 s, 0.0 kB/s 2023-10-09T15:34:44.090 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.090 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.146 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2852e-05 s, 0.0 kB/s 2023-10-09T15:34:44.146 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.146 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2845e-05 s, 0.0 kB/s 2023-10-09T15:34:44.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.202 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3371e-05 s, 0.0 kB/s 2023-10-09T15:34:44.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.258 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.5212e-05 s, 0.0 kB/s 2023-10-09T15:34:44.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.371 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4375e-05 s, 0.0 kB/s 2023-10-09T15:34:44.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.428 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.074e-05 s, 0.0 kB/s 2023-10-09T15:34:44.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.429 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0414e-05 s, 0.0 kB/s 2023-10-09T15:34:44.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9663e-05 s, 0.0 kB/s 2023-10-09T15:34:44.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3752e-05 s, 0.0 kB/s 2023-10-09T15:34:44.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.651 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5047e-05 s, 0.0 kB/s 2023-10-09T15:34:44.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.708 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1982e-05 s, 0.0 kB/s 2023-10-09T15:34:44.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.763 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0405e-05 s, 0.0 kB/s 2023-10-09T15:34:44.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.764 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1064e-05 s, 0.0 kB/s 2023-10-09T15:34:44.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0635e-05 s, 0.0 kB/s 2023-10-09T15:34:44.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.932 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2051e-05 s, 0.0 kB/s 2023-10-09T15:34:44.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.932 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1091e-05 s, 0.0 kB/s 2023-10-09T15:34:44.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:44.988 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.044 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.958e-05 s, 0.0 kB/s 2023-10-09T15:34:45.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.044 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.099 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9502e-05 s, 0.0 kB/s 2023-10-09T15:34:45.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.155 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3301e-05 s, 0.0 kB/s 2023-10-09T15:34:45.155 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.211 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2503e-05 s, 0.0 kB/s 2023-10-09T15:34:45.211 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.267 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.268 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2849e-05 s, 0.0 kB/s 2023-10-09T15:34:45.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.268 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.323 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.323 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.323 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-09T15:34:45.324 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.324 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.380 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2242e-05 s, 0.0 kB/s 2023-10-09T15:34:45.380 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.380 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2732e-05 s, 0.0 kB/s 2023-10-09T15:34:45.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.492 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4488e-05 s, 0.0 kB/s 2023-10-09T15:34:45.492 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.548 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1617e-05 s, 0.0 kB/s 2023-10-09T15:34:45.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.603 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2815e-05 s, 0.0 kB/s 2023-10-09T15:34:45.604 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.660 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4386e-05 s, 0.0 kB/s 2023-10-09T15:34:45.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.661 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.716 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9925e-05 s, 0.0 kB/s 2023-10-09T15:34:45.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.716 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.772 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-09T15:34:45.772 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.772 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.828 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2135e-05 s, 0.0 kB/s 2023-10-09T15:34:45.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.829 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.884 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0035e-05 s, 0.0 kB/s 2023-10-09T15:34:45.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.885 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.191e-05 s, 0.0 kB/s 2023-10-09T15:34:45.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.940 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:45.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:45.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:45.996 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3345e-05 s, 0.0 kB/s 2023-10-09T15:34:45.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:45.996 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.051 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2144e-05 s, 0.0 kB/s 2023-10-09T15:34:46.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.052 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.107 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1907e-05 s, 0.0 kB/s 2023-10-09T15:34:46.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.108 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.163 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0244e-05 s, 0.0 kB/s 2023-10-09T15:34:46.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.164 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.218 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1961e-05 s, 0.0 kB/s 2023-10-09T15:34:46.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.276 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.164e-05 s, 0.0 kB/s 2023-10-09T15:34:46.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.331 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9235e-05 s, 0.0 kB/s 2023-10-09T15:34:46.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.388 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1564e-05 s, 0.0 kB/s 2023-10-09T15:34:46.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.388 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.443 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2105e-05 s, 0.0 kB/s 2023-10-09T15:34:46.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.444 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5137e-05 s, 0.0 kB/s 2023-10-09T15:34:46.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.500 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.555 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-09T15:34:46.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.556 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.612 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3375e-05 s, 0.0 kB/s 2023-10-09T15:34:46.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.612 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.667 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.668 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3427e-05 s, 0.0 kB/s 2023-10-09T15:34:46.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.668 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.725 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.726 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.726 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1321e-05 s, 0.0 kB/s 2023-10-09T15:34:46.726 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.726 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.782 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.782 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.782 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4093e-05 s, 0.0 kB/s 2023-10-09T15:34:46.782 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.782 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.838 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5512e-05 s, 0.0 kB/s 2023-10-09T15:34:46.838 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.838 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.894 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.219e-05 s, 0.0 kB/s 2023-10-09T15:34:46.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.894 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:46.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:46.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:46.950 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4179e-05 s, 0.0 kB/s 2023-10-09T15:34:46.950 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:46.950 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.005 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.006 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.006 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-09T15:34:47.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.006 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.061 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.062 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5329e-05 s, 0.0 kB/s 2023-10-09T15:34:47.062 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.062 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.117 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2671e-05 s, 0.0 kB/s 2023-10-09T15:34:47.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.118 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.174 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.174 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.174 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3484e-05 s, 0.0 kB/s 2023-10-09T15:34:47.174 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.174 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.229 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.230 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2111e-05 s, 0.0 kB/s 2023-10-09T15:34:47.230 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.230 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.286 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0509e-05 s, 0.0 kB/s 2023-10-09T15:34:47.286 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.286 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.342 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3619e-05 s, 0.0 kB/s 2023-10-09T15:34:47.342 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.342 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.398 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.398 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.398 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4663e-05 s, 0.0 kB/s 2023-10-09T15:34:47.398 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.398 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0196e-05 s, 0.0 kB/s 2023-10-09T15:34:47.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.454 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.509 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.510 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9428e-05 s, 0.0 kB/s 2023-10-09T15:34:47.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.510 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.566 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2271e-05 s, 0.0 kB/s 2023-10-09T15:34:47.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.566 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.621 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.621 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.621 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-09T15:34:47.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.622 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.677 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0642e-05 s, 0.0 kB/s 2023-10-09T15:34:47.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.678 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.733 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1885e-05 s, 0.0 kB/s 2023-10-09T15:34:47.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.734 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.789 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.789 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3586e-05 s, 0.0 kB/s 2023-10-09T15:34:47.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.790 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.846 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-09T15:34:47.846 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.846 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0591e-05 s, 0.0 kB/s 2023-10-09T15:34:47.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.901 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2433e-05 s, 0.0 kB/s 2023-10-09T15:34:47.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:47.957 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.012 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4022e-05 s, 0.0 kB/s 2023-10-09T15:34:48.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.012 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.069 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4187e-05 s, 0.0 kB/s 2023-10-09T15:34:48.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.069 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.124 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4336e-05 s, 0.0 kB/s 2023-10-09T15:34:48.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.125 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1795e-05 s, 0.0 kB/s 2023-10-09T15:34:48.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.181 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.238 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.036e-05 s, 0.0 kB/s 2023-10-09T15:34:48.238 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.238 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.293 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0663e-05 s, 0.0 kB/s 2023-10-09T15:34:48.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.294 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.350 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.445e-05 s, 0.0 kB/s 2023-10-09T15:34:48.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.406 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9974e-05 s, 0.0 kB/s 2023-10-09T15:34:48.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.406 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.462 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.462 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.462 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4632e-05 s, 0.0 kB/s 2023-10-09T15:34:48.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.517 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.215e-05 s, 0.0 kB/s 2023-10-09T15:34:48.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.573 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2568e-05 s, 0.0 kB/s 2023-10-09T15:34:48.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.574 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.122e-05 s, 0.0 kB/s 2023-10-09T15:34:48.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.316e-05 s, 0.0 kB/s 2023-10-09T15:34:48.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.686 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.741 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9911e-05 s, 0.0 kB/s 2023-10-09T15:34:48.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.742 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.797 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.797 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.797 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1221e-05 s, 0.0 kB/s 2023-10-09T15:34:48.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.798 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7425e-05 s, 0.0 kB/s 2023-10-09T15:34:48.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.920 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3218e-05 s, 0.0 kB/s 2023-10-09T15:34:48.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1472e-05 s, 0.0 kB/s 2023-10-09T15:34:48.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:48.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2353e-05 s, 0.0 kB/s 2023-10-09T15:34:49.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.032 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2293e-05 s, 0.0 kB/s 2023-10-09T15:34:49.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.088 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.144 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3578e-05 s, 0.0 kB/s 2023-10-09T15:34:49.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.144 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.200 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-09T15:34:49.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0297e-05 s, 0.0 kB/s 2023-10-09T15:34:49.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.312 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.313 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4979e-05 s, 0.0 kB/s 2023-10-09T15:34:49.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.313 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.369 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.369 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.369 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2321e-05 s, 0.0 kB/s 2023-10-09T15:34:49.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.369 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.425 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.7412e-05 s, 0.0 kB/s 2023-10-09T15:34:49.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.426 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.482 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4477e-05 s, 0.0 kB/s 2023-10-09T15:34:49.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3217e-05 s, 0.0 kB/s 2023-10-09T15:34:49.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.593 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3866e-05 s, 0.0 kB/s 2023-10-09T15:34:49.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.649 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0779e-05 s, 0.0 kB/s 2023-10-09T15:34:49.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2369e-05 s, 0.0 kB/s 2023-10-09T15:34:49.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.706 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.761 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1969e-05 s, 0.0 kB/s 2023-10-09T15:34:49.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.817 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2503e-05 s, 0.0 kB/s 2023-10-09T15:34:49.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.818 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.874 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.874 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-09T15:34:49.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.874 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.930 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0543e-05 s, 0.0 kB/s 2023-10-09T15:34:49.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.930 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:49.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:49.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:49.986 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4399e-05 s, 0.0 kB/s 2023-10-09T15:34:49.986 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:49.986 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0967e-05 s, 0.0 kB/s 2023-10-09T15:34:50.042 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.042 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-09T15:34:50.098 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.098 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0435e-05 s, 0.0 kB/s 2023-10-09T15:34:50.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.210 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-09T15:34:50.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4374e-05 s, 0.0 kB/s 2023-10-09T15:34:50.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.266 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3007e-05 s, 0.0 kB/s 2023-10-09T15:34:50.322 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.322 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2608e-05 s, 0.0 kB/s 2023-10-09T15:34:50.378 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.378 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.433 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1257e-05 s, 0.0 kB/s 2023-10-09T15:34:50.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.434 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.489 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.489 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1209e-05 s, 0.0 kB/s 2023-10-09T15:34:50.490 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.490 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.545 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.545 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.016e-05 s, 0.0 kB/s 2023-10-09T15:34:50.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.545 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1706e-05 s, 0.0 kB/s 2023-10-09T15:34:50.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.601 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.656 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2848e-05 s, 0.0 kB/s 2023-10-09T15:34:50.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.658 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.713 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3683e-05 s, 0.0 kB/s 2023-10-09T15:34:50.714 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.714 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.771 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.771 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2792e-05 s, 0.0 kB/s 2023-10-09T15:34:50.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.771 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.826 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2865e-05 s, 0.0 kB/s 2023-10-09T15:34:50.826 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.827 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.882 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3462e-05 s, 0.0 kB/s 2023-10-09T15:34:50.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.883 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.939 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.939 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1158e-05 s, 0.0 kB/s 2023-10-09T15:34:50.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.939 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:50.994 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1851e-05 s, 0.0 kB/s 2023-10-09T15:34:50.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:50.995 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.051 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3671e-05 s, 0.0 kB/s 2023-10-09T15:34:51.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.051 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.106 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.106 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.106 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2044e-05 s, 0.0 kB/s 2023-10-09T15:34:51.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.107 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1995e-05 s, 0.0 kB/s 2023-10-09T15:34:51.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.163 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.218 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4317e-05 s, 0.0 kB/s 2023-10-09T15:34:51.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.219 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.276 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0491e-05 s, 0.0 kB/s 2023-10-09T15:34:51.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.331 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0923e-05 s, 0.0 kB/s 2023-10-09T15:34:51.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.388 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2076e-05 s, 0.0 kB/s 2023-10-09T15:34:51.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.388 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.444 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2364e-05 s, 0.0 kB/s 2023-10-09T15:34:51.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.445 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.500 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2655e-05 s, 0.0 kB/s 2023-10-09T15:34:51.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.501 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2759e-05 s, 0.0 kB/s 2023-10-09T15:34:51.558 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.558 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.613 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3613e-05 s, 0.0 kB/s 2023-10-09T15:34:51.614 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.614 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.670 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4274e-05 s, 0.0 kB/s 2023-10-09T15:34:51.671 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.671 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.726 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.727 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.727 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0668e-05 s, 0.0 kB/s 2023-10-09T15:34:51.727 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.727 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.782 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.783 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3078e-05 s, 0.0 kB/s 2023-10-09T15:34:51.783 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.783 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.838 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.838 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.838 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4996e-05 s, 0.0 kB/s 2023-10-09T15:34:51.839 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.839 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.894 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.895 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0513e-05 s, 0.0 kB/s 2023-10-09T15:34:51.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.895 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:51.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:51.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:51.950 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-09T15:34:51.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:51.951 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.411e-05 s, 0.0 kB/s 2023-10-09T15:34:52.008 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.008 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.064 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7668e-05 s, 0.0 kB/s 2023-10-09T15:34:52.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.065 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2828e-05 s, 0.0 kB/s 2023-10-09T15:34:52.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.121 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.178 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3532e-05 s, 0.0 kB/s 2023-10-09T15:34:52.178 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.178 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.235 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-09T15:34:52.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.236 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.291 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.291 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.291 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2969e-05 s, 0.0 kB/s 2023-10-09T15:34:52.292 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.292 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.349 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4113e-05 s, 0.0 kB/s 2023-10-09T15:34:52.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.349 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.404 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.405 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9438e-05 s, 0.0 kB/s 2023-10-09T15:34:52.405 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.405 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.44e-05 s, 0.0 kB/s 2023-10-09T15:34:52.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.461 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.517 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1463e-05 s, 0.0 kB/s 2023-10-09T15:34:52.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.517 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.572 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.572 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.572 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1514e-05 s, 0.0 kB/s 2023-10-09T15:34:52.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.573 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.628 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0428e-05 s, 0.0 kB/s 2023-10-09T15:34:52.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.629 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.684 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.685 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2361e-05 s, 0.0 kB/s 2023-10-09T15:34:52.685 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.685 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.740 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3002e-05 s, 0.0 kB/s 2023-10-09T15:34:52.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.741 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0724e-05 s, 0.0 kB/s 2023-10-09T15:34:52.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.798 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.853 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3341e-05 s, 0.0 kB/s 2023-10-09T15:34:52.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.854 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2507e-05 s, 0.0 kB/s 2023-10-09T15:34:52.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.910 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:52.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:52.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:52.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4045e-05 s, 0.0 kB/s 2023-10-09T15:34:52.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:52.966 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.156e-05 s, 0.0 kB/s 2023-10-09T15:34:53.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.022 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1604e-05 s, 0.0 kB/s 2023-10-09T15:34:53.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.078 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4522e-05 s, 0.0 kB/s 2023-10-09T15:34:53.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.134 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2089e-05 s, 0.0 kB/s 2023-10-09T15:34:53.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.190 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0339e-05 s, 0.0 kB/s 2023-10-09T15:34:53.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.247 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2736e-05 s, 0.0 kB/s 2023-10-09T15:34:53.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.303 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.359 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.359 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.359 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2486e-05 s, 0.0 kB/s 2023-10-09T15:34:53.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.360 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3787e-05 s, 0.0 kB/s 2023-10-09T15:34:53.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.416 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.472 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4535e-05 s, 0.0 kB/s 2023-10-09T15:34:53.472 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.472 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.529 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.530 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3249e-05 s, 0.0 kB/s 2023-10-09T15:34:53.530 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.530 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.586 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2733e-05 s, 0.0 kB/s 2023-10-09T15:34:53.586 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.586 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.641 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.642 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.341e-05 s, 0.0 kB/s 2023-10-09T15:34:53.642 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.642 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.698 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4105e-05 s, 0.0 kB/s 2023-10-09T15:34:53.698 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.698 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.753 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.754 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1735e-05 s, 0.0 kB/s 2023-10-09T15:34:53.754 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.754 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.810 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0422e-05 s, 0.0 kB/s 2023-10-09T15:34:53.810 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.810 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.865 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.865 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.865 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9419e-05 s, 0.0 kB/s 2023-10-09T15:34:53.866 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.866 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.921 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2722e-05 s, 0.0 kB/s 2023-10-09T15:34:53.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.922 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:53.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:53.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:53.984 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7203e-05 s, 0.0 kB/s 2023-10-09T15:34:53.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:53.984 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.040 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3147e-05 s, 0.0 kB/s 2023-10-09T15:34:54.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.040 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.195 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.196 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2728e-05 s, 0.0 kB/s 2023-10-09T15:34:54.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.196 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.212 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2521e-05 s, 0.0 kB/s 2023-10-09T15:34:54.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.213 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.269 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.259e-05 s, 0.0 kB/s 2023-10-09T15:34:54.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.397e-05 s, 0.0 kB/s 2023-10-09T15:34:54.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7381e-05 s, 0.0 kB/s 2023-10-09T15:34:54.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.381 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.436 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3534e-05 s, 0.0 kB/s 2023-10-09T15:34:54.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.493 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.493 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.493 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2573e-05 s, 0.0 kB/s 2023-10-09T15:34:54.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.548 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.125e-05 s, 0 B/s 2023-10-09T15:34:54.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.604 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2131e-05 s, 0.0 kB/s 2023-10-09T15:34:54.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.660 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9639e-05 s, 0.0 kB/s 2023-10-09T15:34:54.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.661 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.716 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.716 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0919e-05 s, 0.0 kB/s 2023-10-09T15:34:54.716 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.717 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.772 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.773 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2313e-05 s, 0.0 kB/s 2023-10-09T15:34:54.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.773 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.828 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.969e-05 s, 0.0 kB/s 2023-10-09T15:34:54.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.829 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.884 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1191e-05 s, 0.0 kB/s 2023-10-09T15:34:54.884 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.884 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.939 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.940 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1399e-05 s, 0.0 kB/s 2023-10-09T15:34:54.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.940 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:54.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:54.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:54.996 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.105e-05 s, 0.0 kB/s 2023-10-09T15:34:54.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:54.996 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.052 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-09T15:34:55.052 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.052 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.107 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0933e-05 s, 0.0 kB/s 2023-10-09T15:34:55.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.107 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.163 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1215e-05 s, 0.0 kB/s 2023-10-09T15:34:55.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.164 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0363e-05 s, 0.0 kB/s 2023-10-09T15:34:55.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.276 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1646e-05 s, 0.0 kB/s 2023-10-09T15:34:55.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.332 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1476e-05 s, 0.0 kB/s 2023-10-09T15:34:55.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.108e-05 s, 0.0 kB/s 2023-10-09T15:34:55.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.388 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.443 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1208e-05 s, 0.0 kB/s 2023-10-09T15:34:55.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.444 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2405e-05 s, 0.0 kB/s 2023-10-09T15:34:55.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.499 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0217e-05 s, 0.0 kB/s 2023-10-09T15:34:55.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.555 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.610 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0252e-05 s, 0.0 kB/s 2023-10-09T15:34:55.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.611 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.666 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2666e-05 s, 0.0 kB/s 2023-10-09T15:34:55.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.667 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8524e-05 s, 0.0 kB/s 2023-10-09T15:34:55.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.778 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.898e-05 s, 0.0 kB/s 2023-10-09T15:34:55.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.778 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.833 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1504e-05 s, 0.0 kB/s 2023-10-09T15:34:55.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.889 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.889 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.864e-05 s, 0.0 kB/s 2023-10-09T15:34:55.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:55.944 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0395e-05 s, 0.0 kB/s 2023-10-09T15:34:55.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:55.945 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1863e-05 s, 0.0 kB/s 2023-10-09T15:34:56.001 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.001 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3206e-05 s, 0.0 kB/s 2023-10-09T15:34:56.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.057 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.112 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1181e-05 s, 0.0 kB/s 2023-10-09T15:34:56.112 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.113 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.168 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4906e-05 s, 0.0 kB/s 2023-10-09T15:34:56.169 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.169 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.224 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.225 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9024e-05 s, 0.0 kB/s 2023-10-09T15:34:56.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-09T15:34:56.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.282 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.338 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.338 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7119e-05 s, 0.0 kB/s 2023-10-09T15:34:56.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.338 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0987e-05 s, 0.0 kB/s 2023-10-09T15:34:56.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.394 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.451 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4709e-05 s, 0.0 kB/s 2023-10-09T15:34:56.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.451 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.506 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2539e-05 s, 0.0 kB/s 2023-10-09T15:34:56.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.507 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.562 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1142e-05 s, 0.0 kB/s 2023-10-09T15:34:56.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9935e-05 s, 0.0 kB/s 2023-10-09T15:34:56.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.618 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.673 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0859e-05 s, 0.0 kB/s 2023-10-09T15:34:56.674 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.674 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.729 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.729 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4171e-05 s, 0.0 kB/s 2023-10-09T15:34:56.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.730 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.785 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.786 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0313e-05 s, 0.0 kB/s 2023-10-09T15:34:56.786 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.786 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.841 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.842 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2509e-05 s, 0.0 kB/s 2023-10-09T15:34:56.842 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.842 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.898 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9064e-05 s, 0.0 kB/s 2023-10-09T15:34:56.898 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.898 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:56.953 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:56.953 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:56.953 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9399e-05 s, 0.0 kB/s 2023-10-09T15:34:56.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:56.953 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.009 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.359e-05 s, 0.0 kB/s 2023-10-09T15:34:57.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.009 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.064 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0049e-05 s, 0.0 kB/s 2023-10-09T15:34:57.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.065 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.120 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.120 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2172e-05 s, 0.0 kB/s 2023-10-09T15:34:57.120 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.121 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.177 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0033e-05 s, 0.0 kB/s 2023-10-09T15:34:57.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.177 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.232 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9687e-05 s, 0.0 kB/s 2023-10-09T15:34:57.233 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.233 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3845e-05 s, 0.0 kB/s 2023-10-09T15:34:57.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.345 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1302e-05 s, 0.0 kB/s 2023-10-09T15:34:57.345 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.345 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.400 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9014e-05 s, 0.0 kB/s 2023-10-09T15:34:57.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.401 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.455 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.456 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.456 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8284e-05 s, 0.0 kB/s 2023-10-09T15:34:57.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.457 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.512 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-09T15:34:57.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.513 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.568 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.568 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.568 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1793e-05 s, 0.0 kB/s 2023-10-09T15:34:57.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.569 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.625 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1992e-05 s, 0.0 kB/s 2023-10-09T15:34:57.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.625 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.681 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.101e-05 s, 0.0 kB/s 2023-10-09T15:34:57.681 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.681 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.736 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.737 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.951e-05 s, 0.0 kB/s 2023-10-09T15:34:57.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.737 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9644e-05 s, 0.0 kB/s 2023-10-09T15:34:57.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.793 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.848 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.848 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.848 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.387e-05 s, 0.0 kB/s 2023-10-09T15:34:57.849 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.849 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.905 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3669e-05 s, 0.0 kB/s 2023-10-09T15:34:57.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.905 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:57.960 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9222e-05 s, 0.0 kB/s 2023-10-09T15:34:57.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:57.961 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.016 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.016 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.016 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.133e-05 s, 0.0 kB/s 2023-10-09T15:34:58.017 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.017 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.072 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.072 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.072 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-09T15:34:58.073 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.073 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3804e-05 s, 0.0 kB/s 2023-10-09T15:34:58.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.128 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.184 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-09T15:34:58.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.184 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.239 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.239 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.239 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9909e-05 s, 0.0 kB/s 2023-10-09T15:34:58.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.240 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.296 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1295e-05 s, 0.0 kB/s 2023-10-09T15:34:58.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.296 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.352 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3407e-05 s, 0.0 kB/s 2023-10-09T15:34:58.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.352 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.408 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5999e-05 s, 0.0 kB/s 2023-10-09T15:34:58.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.408 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.464 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0144e-05 s, 0.0 kB/s 2023-10-09T15:34:58.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.464 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.520 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9081e-05 s, 0.0 kB/s 2023-10-09T15:34:58.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.520 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.576 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9292e-05 s, 0.0 kB/s 2023-10-09T15:34:58.576 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.576 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.632 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2901e-05 s, 0.0 kB/s 2023-10-09T15:34:58.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.632 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.687 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4093e-05 s, 0.0 kB/s 2023-10-09T15:34:58.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.688 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.743 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3208e-05 s, 0.0 kB/s 2023-10-09T15:34:58.744 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.744 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1175e-05 s, 0.0 kB/s 2023-10-09T15:34:58.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.800 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.855 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2584e-05 s, 0.0 kB/s 2023-10-09T15:34:58.856 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.856 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.911 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0711e-05 s, 0.0 kB/s 2023-10-09T15:34:58.912 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.912 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:58.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2647e-05 s, 0.0 kB/s 2023-10-09T15:34:58.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:58.968 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.023 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.023 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.14e-05 s, 0.0 kB/s 2023-10-09T15:34:59.023 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.024 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.079 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3255e-05 s, 0.0 kB/s 2023-10-09T15:34:59.079 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.135 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7303e-05 s, 0.0 kB/s 2023-10-09T15:34:59.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.135 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.191 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4227e-05 s, 0.0 kB/s 2023-10-09T15:34:59.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.191 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.246 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2939e-05 s, 0.0 kB/s 2023-10-09T15:34:59.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.247 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.302 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1994e-05 s, 0.0 kB/s 2023-10-09T15:34:59.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.303 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.358 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.358 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.129e-05 s, 0.0 kB/s 2023-10-09T15:34:59.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.359 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.415 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4398e-05 s, 0.0 kB/s 2023-10-09T15:34:59.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.416 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.471 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3076e-05 s, 0.0 kB/s 2023-10-09T15:34:59.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.471 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.527 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0166e-05 s, 0.0 kB/s 2023-10-09T15:34:59.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.528 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.583 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.584 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-09T15:34:59.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.584 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2242e-05 s, 0.0 kB/s 2023-10-09T15:34:59.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.695 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.659e-05 s, 0.0 kB/s 2023-10-09T15:34:59.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.696 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9989e-05 s, 0.0 kB/s 2023-10-09T15:34:59.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.751 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.807 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1322e-05 s, 0.0 kB/s 2023-10-09T15:34:59.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.807 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9021e-05 s, 0.0 kB/s 2023-10-09T15:34:59.862 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.918 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.976e-05 s, 0.0 kB/s 2023-10-09T15:34:59.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:34:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:34:59.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:34:59.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4099e-05 s, 0.0 kB/s 2023-10-09T15:34:59.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:34:59.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2616e-05 s, 0.0 kB/s 2023-10-09T15:35:00.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.031 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.086 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3185e-05 s, 0.0 kB/s 2023-10-09T15:35:00.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.159 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.81e-05 s, 0.0 kB/s 2023-10-09T15:35:00.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.160 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.215 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.216 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4503e-05 s, 0.0 kB/s 2023-10-09T15:35:00.216 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.216 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.272 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.272 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.272 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3625e-05 s, 0.0 kB/s 2023-10-09T15:35:00.272 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.272 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.328 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4334e-05 s, 0.0 kB/s 2023-10-09T15:35:00.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.386 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2854e-05 s, 0.0 kB/s 2023-10-09T15:35:00.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.386 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.441 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.441 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.442 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3566e-05 s, 0.0 kB/s 2023-10-09T15:35:00.442 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.442 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.497 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.498 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4265e-05 s, 0.0 kB/s 2023-10-09T15:35:00.498 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.498 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.554 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1957e-05 s, 0.0 kB/s 2023-10-09T15:35:00.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.554 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.609 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5312e-05 s, 0.0 kB/s 2023-10-09T15:35:00.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.610 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.665 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.228e-05 s, 0.0 kB/s 2023-10-09T15:35:00.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.666 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0389e-05 s, 0.0 kB/s 2023-10-09T15:35:00.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.779 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2586e-05 s, 0.0 kB/s 2023-10-09T15:35:00.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.779 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.834 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1542e-05 s, 0.0 kB/s 2023-10-09T15:35:00.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.891 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4182e-05 s, 0.0 kB/s 2023-10-09T15:35:00.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.891 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:00.946 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2788e-05 s, 0.0 kB/s 2023-10-09T15:35:00.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:00.947 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4261e-05 s, 0.0 kB/s 2023-10-09T15:35:01.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.002 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1771e-05 s, 0.0 kB/s 2023-10-09T15:35:01.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.059 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4533e-05 s, 0.0 kB/s 2023-10-09T15:35:01.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.114 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0411e-05 s, 0.0 kB/s 2023-10-09T15:35:01.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.170 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.225 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1068e-05 s, 0.0 kB/s 2023-10-09T15:35:01.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.280 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.280 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3517e-05 s, 0.0 kB/s 2023-10-09T15:35:01.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.337 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.163e-05 s, 0.0 kB/s 2023-10-09T15:35:01.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.337 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.392 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.392 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.086e-05 s, 0.0 kB/s 2023-10-09T15:35:01.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.393 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.448 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2298e-05 s, 0.0 kB/s 2023-10-09T15:35:01.448 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.504 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2751e-05 s, 0.0 kB/s 2023-10-09T15:35:01.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.505 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.560 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.560 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.560 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4096e-05 s, 0.0 kB/s 2023-10-09T15:35:01.561 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.561 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.615 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.616 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1991e-05 s, 0.0 kB/s 2023-10-09T15:35:01.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.673 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0642e-05 s, 0.0 kB/s 2023-10-09T15:35:01.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.673 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4081e-05 s, 0.0 kB/s 2023-10-09T15:35:01.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.729 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1589e-05 s, 0.0 kB/s 2023-10-09T15:35:01.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.785 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.840 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T15:35:01.840 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.840 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3873e-05 s, 0.0 kB/s 2023-10-09T15:35:01.895 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.896 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:01.951 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:01.951 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:01.951 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0881e-05 s, 0.0 kB/s 2023-10-09T15:35:01.951 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:01.952 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.007 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.007 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9414e-05 s, 0.0 kB/s 2023-10-09T15:35:02.007 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.007 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.063 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2476e-05 s, 0.0 kB/s 2023-10-09T15:35:02.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.063 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.119 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4117e-05 s, 0.0 kB/s 2023-10-09T15:35:02.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.120 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.175 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2303e-05 s, 0.0 kB/s 2023-10-09T15:35:02.176 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.176 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.231 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-09T15:35:02.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.232 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.287 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.288 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2163e-05 s, 0.0 kB/s 2023-10-09T15:35:02.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.288 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.344 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.344 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3122e-05 s, 0.0 kB/s 2023-10-09T15:35:02.344 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.344 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.400 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.400 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1238e-05 s, 0.0 kB/s 2023-10-09T15:35:02.400 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.401 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.456 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2537e-05 s, 0.0 kB/s 2023-10-09T15:35:02.457 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.457 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.512 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.513 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1556e-05 s, 0.0 kB/s 2023-10-09T15:35:02.513 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.513 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.568 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.569 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3002e-05 s, 0.0 kB/s 2023-10-09T15:35:02.569 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.569 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.624 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.665e-05 s, 0.0 kB/s 2023-10-09T15:35:02.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.625 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.681 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4014e-05 s, 0.0 kB/s 2023-10-09T15:35:02.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.682 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.737 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4414e-05 s, 0.0 kB/s 2023-10-09T15:35:02.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.738 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.794 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3418e-05 s, 0.0 kB/s 2023-10-09T15:35:02.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.794 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.850 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1057e-05 s, 0.0 kB/s 2023-10-09T15:35:02.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.850 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.905 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1603e-05 s, 0.0 kB/s 2023-10-09T15:35:02.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.906 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1095e-05 s, 0.0 kB/s 2023-10-09T15:35:02.961 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:02.962 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.017 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-09T15:35:03.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.018 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.073 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9671e-05 s, 0.0 kB/s 2023-10-09T15:35:03.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.074 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.129 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.129 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.129 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.904e-05 s, 0.0 kB/s 2023-10-09T15:35:03.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.130 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.185 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.185 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.185 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2287e-05 s, 0.0 kB/s 2023-10-09T15:35:03.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.186 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.241 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.241 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.241 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-09T15:35:03.241 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.241 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3627e-05 s, 0.0 kB/s 2023-10-09T15:35:03.297 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.297 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.353 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.353 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3932e-05 s, 0.0 kB/s 2023-10-09T15:35:03.353 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.354 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.409 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.410 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.410 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3911e-05 s, 0.0 kB/s 2023-10-09T15:35:03.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.410 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.465 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.466 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.466 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2619e-05 s, 0.0 kB/s 2023-10-09T15:35:03.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.466 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2899e-05 s, 0.0 kB/s 2023-10-09T15:35:03.521 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.522 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.577 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.7908e-05 s, 0.0 kB/s 2023-10-09T15:35:03.578 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.578 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.633 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.633 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.634 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2711e-05 s, 0.0 kB/s 2023-10-09T15:35:03.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.634 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1839e-05 s, 0.0 kB/s 2023-10-09T15:35:03.690 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.690 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.745 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.746 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4217e-05 s, 0.0 kB/s 2023-10-09T15:35:03.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.746 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.800 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.801 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.801 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0752e-05 s, 0.0 kB/s 2023-10-09T15:35:03.801 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.801 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.857 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.857 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.857 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3811e-05 s, 0.0 kB/s 2023-10-09T15:35:03.858 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.858 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.914 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1609e-05 s, 0.0 kB/s 2023-10-09T15:35:03.914 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.914 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:03.969 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:03.970 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2519e-05 s, 0.0 kB/s 2023-10-09T15:35:03.970 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:03.970 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.026 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.026 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.026 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.087e-05 s, 0.0 kB/s 2023-10-09T15:35:04.026 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.026 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.081 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.082 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.082 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2474e-05 s, 0.0 kB/s 2023-10-09T15:35:04.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.082 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.137 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2085e-05 s, 0.0 kB/s 2023-10-09T15:35:04.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.138 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.193 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9428e-05 s, 0.0 kB/s 2023-10-09T15:35:04.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.194 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.250 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9797e-05 s, 0.0 kB/s 2023-10-09T15:35:04.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.250 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.307 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4859e-05 s, 0.0 kB/s 2023-10-09T15:35:04.307 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.308 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.364 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.3497e-05 s, 0.0 kB/s 2023-10-09T15:35:04.364 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.364 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.419 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-09T15:35:04.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.420 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.475 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1269e-05 s, 0.0 kB/s 2023-10-09T15:35:04.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.476 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.531 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2552e-05 s, 0.0 kB/s 2023-10-09T15:35:04.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.532 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.587 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2151e-05 s, 0.0 kB/s 2023-10-09T15:35:04.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.587 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.642 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0484e-05 s, 0.0 kB/s 2023-10-09T15:35:04.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.643 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.698 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.699 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3762e-05 s, 0.0 kB/s 2023-10-09T15:35:04.699 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.699 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.754 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0955e-05 s, 0.0 kB/s 2023-10-09T15:35:04.755 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.755 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3203e-05 s, 0.0 kB/s 2023-10-09T15:35:04.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1142e-05 s, 0.0 kB/s 2023-10-09T15:35:04.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.923 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2112e-05 s, 0.0 kB/s 2023-10-09T15:35:04.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:04.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:04.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9429e-05 s, 0.0 kB/s 2023-10-09T15:35:04.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:04.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.035 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1815e-05 s, 0.0 kB/s 2023-10-09T15:35:05.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0809e-05 s, 0.0 kB/s 2023-10-09T15:35:05.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.092 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.147 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0967e-05 s, 0.0 kB/s 2023-10-09T15:35:05.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3487e-05 s, 0.0 kB/s 2023-10-09T15:35:05.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.204 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.259 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2867e-05 s, 0.0 kB/s 2023-10-09T15:35:05.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.260 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3532e-05 s, 0.0 kB/s 2023-10-09T15:35:05.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.316 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.372 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0684e-05 s, 0.0 kB/s 2023-10-09T15:35:05.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.427 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.269e-05 s, 0.0 kB/s 2023-10-09T15:35:05.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.483 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3874e-05 s, 0.0 kB/s 2023-10-09T15:35:05.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0642e-05 s, 0.0 kB/s 2023-10-09T15:35:05.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.596 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3195e-05 s, 0.0 kB/s 2023-10-09T15:35:05.597 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.597 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9409e-05 s, 0.0 kB/s 2023-10-09T15:35:05.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.653 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.709 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.709 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1953e-05 s, 0.0 kB/s 2023-10-09T15:35:05.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.709 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.768 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5839e-05 s, 0.0 kB/s 2023-10-09T15:35:05.768 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.768 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.824 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.824 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.825 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1773e-05 s, 0.0 kB/s 2023-10-09T15:35:05.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.825 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.881 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1721e-05 s, 0.0 kB/s 2023-10-09T15:35:05.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.881 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.936 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1804e-05 s, 0.0 kB/s 2023-10-09T15:35:05.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.937 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:05.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:05.993 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:05.994 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-09T15:35:05.994 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:05.994 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.049 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2961e-05 s, 0.0 kB/s 2023-10-09T15:35:06.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.049 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.105 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3453e-05 s, 0.0 kB/s 2023-10-09T15:35:06.106 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.106 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.161 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1119e-05 s, 0.0 kB/s 2023-10-09T15:35:06.162 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.162 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1353e-05 s, 0.0 kB/s 2023-10-09T15:35:06.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.274 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3229e-05 s, 0.0 kB/s 2023-10-09T15:35:06.274 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.274 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:35:06.316 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:35:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.330 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-09T15:35:06.330 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.330 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4413e-05 s, 0.0 kB/s 2023-10-09T15:35:06.386 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.386 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0256e-05 s, 0.0 kB/s 2023-10-09T15:35:06.443 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.443 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.498 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.499 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1048e-05 s, 0.0 kB/s 2023-10-09T15:35:06.499 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.499 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.554 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.555 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.001e-05 s, 0.0 kB/s 2023-10-09T15:35:06.555 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.555 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.611 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9425e-05 s, 0.0 kB/s 2023-10-09T15:35:06.611 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.611 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1141e-05 s, 0.0 kB/s 2023-10-09T15:35:06.667 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.667 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.723 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9059e-05 s, 0.0 kB/s 2023-10-09T15:35:06.723 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.723 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.778 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.779 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0951e-05 s, 0.0 kB/s 2023-10-09T15:35:06.779 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.779 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.834 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.227e-05 s, 0.0 kB/s 2023-10-09T15:35:06.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.890 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1198e-05 s, 0.0 kB/s 2023-10-09T15:35:06.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.891 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:06.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:06.946 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:06.946 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9089e-05 s, 0.0 kB/s 2023-10-09T15:35:06.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:06.947 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1965e-05 s, 0.0 kB/s 2023-10-09T15:35:07.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.002 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4077e-05 s, 0.0 kB/s 2023-10-09T15:35:07.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.059 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0455e-05 s, 0.0 kB/s 2023-10-09T15:35:07.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.115 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.1999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4567e-05 s, 0.0 kB/s 2023-10-09T15:35:07.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2000 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.415e-05 s, 0.0 kB/s 2023-10-09T15:35:07.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2001 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.282 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.282 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9582e-05 s, 0.0 kB/s 2023-10-09T15:35:07.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.283 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2002 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.338 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2427e-05 s, 0.0 kB/s 2023-10-09T15:35:07.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2003 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2669e-05 s, 0.0 kB/s 2023-10-09T15:35:07.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.396 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2004 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.452 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2015e-05 s, 0.0 kB/s 2023-10-09T15:35:07.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.452 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2005 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.508 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9865e-05 s, 0.0 kB/s 2023-10-09T15:35:07.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.508 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2006 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.564 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4414e-05 s, 0.0 kB/s 2023-10-09T15:35:07.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.564 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2007 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.619 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.11e-05 s, 0.0 kB/s 2023-10-09T15:35:07.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.620 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2008 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9984e-05 s, 0.0 kB/s 2023-10-09T15:35:07.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.676 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2009 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.732 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1199e-05 s, 0.0 kB/s 2023-10-09T15:35:07.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.733 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2010 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.789 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.062e-05 s, 0.0 kB/s 2023-10-09T15:35:07.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.789 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2011 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.844 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.845 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.845 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0314e-05 s, 0.0 kB/s 2023-10-09T15:35:07.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.845 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2012 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.900 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1447e-05 s, 0.0 kB/s 2023-10-09T15:35:07.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.901 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2013 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:07.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:07.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:07.956 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4027e-05 s, 0.0 kB/s 2023-10-09T15:35:07.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:07.957 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2014 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.012 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1628e-05 s, 0.0 kB/s 2023-10-09T15:35:08.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.013 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2015 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.068 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2013e-05 s, 0.0 kB/s 2023-10-09T15:35:08.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.069 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2016 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.124 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0356e-05 s, 0.0 kB/s 2023-10-09T15:35:08.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.125 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2017 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2311e-05 s, 0.0 kB/s 2023-10-09T15:35:08.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.181 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2018 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.236 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-09T15:35:08.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.237 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2019 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.292 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.293 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2067e-05 s, 0.0 kB/s 2023-10-09T15:35:08.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.293 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2020 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.349 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2299e-05 s, 0.0 kB/s 2023-10-09T15:35:08.349 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2021 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.406 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.144e-05 s, 0.0 kB/s 2023-10-09T15:35:08.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.406 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2022 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.462 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.462 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0978e-05 s, 0.0 kB/s 2023-10-09T15:35:08.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2023 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.518 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.068e-05 s, 0.0 kB/s 2023-10-09T15:35:08.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2024 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3766e-05 s, 0.0 kB/s 2023-10-09T15:35:08.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.574 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2025 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.023e-05 s, 0.0 kB/s 2023-10-09T15:35:08.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2026 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.685 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1767e-05 s, 0.0 kB/s 2023-10-09T15:35:08.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.686 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2027 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2466e-05 s, 0.0 kB/s 2023-10-09T15:35:08.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.742 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2028 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.797 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.797 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2774e-05 s, 0.0 kB/s 2023-10-09T15:35:08.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.798 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2029 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.853 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0042e-05 s, 0.0 kB/s 2023-10-09T15:35:08.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.854 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2030 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.910 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-09T15:35:08.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.910 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2031 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:08.965 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:08.965 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:08.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7795e-05 s, 0.0 kB/s 2023-10-09T15:35:08.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:08.966 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2032 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.021 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.021 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.021 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0162e-05 s, 0.0 kB/s 2023-10-09T15:35:09.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.022 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2033 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.077 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.971e-05 s, 0.0 kB/s 2023-10-09T15:35:09.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.078 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2034 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.133 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.087e-05 s, 0.0 kB/s 2023-10-09T15:35:09.134 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.134 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2035 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0478e-05 s, 0.0 kB/s 2023-10-09T15:35:09.190 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.190 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2036 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.245 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.246 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4362e-05 s, 0.0 kB/s 2023-10-09T15:35:09.246 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.246 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2037 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1236e-05 s, 0.0 kB/s 2023-10-09T15:35:09.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.304 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2038 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.360 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3103e-05 s, 0.0 kB/s 2023-10-09T15:35:09.360 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.360 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2039 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.415 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2025e-05 s, 0.0 kB/s 2023-10-09T15:35:09.416 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.416 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2040 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.472 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.473 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1765e-05 s, 0.0 kB/s 2023-10-09T15:35:09.473 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.473 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2041 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.528 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2277e-05 s, 0.0 kB/s 2023-10-09T15:35:09.529 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.529 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2042 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.584 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0402e-05 s, 0.0 kB/s 2023-10-09T15:35:09.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.585 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2043 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.640 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.234e-05 s, 0.0 kB/s 2023-10-09T15:35:09.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.641 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2044 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.696 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1998e-05 s, 0.0 kB/s 2023-10-09T15:35:09.697 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.697 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2045 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.752 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0811e-05 s, 0.0 kB/s 2023-10-09T15:35:09.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.752 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2046 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2701e-05 s, 0.0 kB/s 2023-10-09T15:35:09.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.809 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2047 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0753e-05 s, 0.0 kB/s 2023-10-09T15:35:09.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.865 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2048 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.288e-05 s, 0.0 kB/s 2023-10-09T15:35:09.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.921 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2049 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0895e-05 s, 0.0 kB/s 2023-10-09T15:35:09.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:09.977 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2050 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.032 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.033 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1605e-05 s, 0.0 kB/s 2023-10-09T15:35:10.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.033 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2051 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.088 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0727e-05 s, 0.0 kB/s 2023-10-09T15:35:10.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.089 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2052 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.145 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3985e-05 s, 0.0 kB/s 2023-10-09T15:35:10.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.145 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2053 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.200 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.459e-05 s, 0.0 kB/s 2023-10-09T15:35:10.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2054 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-09T15:35:10.258 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.258 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2055 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2479e-05 s, 0.0 kB/s 2023-10-09T15:35:10.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.313 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2056 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.369 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2574e-05 s, 0.0 kB/s 2023-10-09T15:35:10.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.370 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2057 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.427 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4224e-05 s, 0.0 kB/s 2023-10-09T15:35:10.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.427 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2058 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.483 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9597e-05 s, 0.0 kB/s 2023-10-09T15:35:10.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2059 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.539 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.539 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.514e-05 s, 0.0 kB/s 2023-10-09T15:35:10.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2060 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.595 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3355e-05 s, 0.0 kB/s 2023-10-09T15:35:10.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.595 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2061 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.651 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1035e-05 s, 0.0 kB/s 2023-10-09T15:35:10.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2062 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.707 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.257e-05 s, 0.0 kB/s 2023-10-09T15:35:10.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.707 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2063 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.762 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3481e-05 s, 0.0 kB/s 2023-10-09T15:35:10.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2064 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.817 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2182e-05 s, 0.0 kB/s 2023-10-09T15:35:10.817 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.818 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2065 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.883 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4812e-05 s, 0.0 kB/s 2023-10-09T15:35:10.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.884 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2066 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.939 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.939 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.940 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2176e-05 s, 0.0 kB/s 2023-10-09T15:35:10.940 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.940 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2067 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:10.995 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:10.995 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:10.996 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1415e-05 s, 0.0 kB/s 2023-10-09T15:35:10.996 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:10.996 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2068 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.051 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.974e-05 s, 0.0 kB/s 2023-10-09T15:35:11.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.052 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2069 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.108 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4032e-05 s, 0.0 kB/s 2023-10-09T15:35:11.108 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.108 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2070 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.163 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.164 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.164 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.298e-05 s, 0.0 kB/s 2023-10-09T15:35:11.164 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.164 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2071 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.220 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4978e-05 s, 0.0 kB/s 2023-10-09T15:35:11.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2072 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.276 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2379e-05 s, 0.0 kB/s 2023-10-09T15:35:11.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2073 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.332 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.332 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.226e-05 s, 0.0 kB/s 2023-10-09T15:35:11.332 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.332 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2074 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.387 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.388 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3744e-05 s, 0.0 kB/s 2023-10-09T15:35:11.388 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.388 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2075 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.444 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4934e-05 s, 0.0 kB/s 2023-10-09T15:35:11.445 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.445 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2076 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.501 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1269e-05 s, 0.0 kB/s 2023-10-09T15:35:11.501 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.501 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2077 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.556 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.368e-05 s, 0.0 kB/s 2023-10-09T15:35:11.557 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.557 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2078 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.612 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.612 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.612 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2713e-05 s, 0.0 kB/s 2023-10-09T15:35:11.613 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.613 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2079 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.668 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0685e-05 s, 0.0 kB/s 2023-10-09T15:35:11.669 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.669 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2080 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.724 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.725 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1673e-05 s, 0.0 kB/s 2023-10-09T15:35:11.725 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.725 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2081 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.780 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.781 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2005e-05 s, 0.0 kB/s 2023-10-09T15:35:11.781 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.781 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2082 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.837 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4854e-05 s, 0.0 kB/s 2023-10-09T15:35:11.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2083 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.892 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9475e-05 s, 0.0 kB/s 2023-10-09T15:35:11.893 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.893 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2084 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:11.948 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.286e-05 s, 0.0 kB/s 2023-10-09T15:35:11.949 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:11.949 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2085 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.005 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.005 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4897e-05 s, 0.0 kB/s 2023-10-09T15:35:12.005 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.005 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2086 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.060 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3566e-05 s, 0.0 kB/s 2023-10-09T15:35:12.061 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.061 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2087 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.116 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2401e-05 s, 0.0 kB/s 2023-10-09T15:35:12.117 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.117 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2088 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.172 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.173 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4399e-05 s, 0.0 kB/s 2023-10-09T15:35:12.173 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.173 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2089 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-09T15:35:12.229 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.229 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2090 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.285 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3453e-05 s, 0.0 kB/s 2023-10-09T15:35:12.285 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.285 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2091 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.340 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.341 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.341 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2714e-05 s, 0.0 kB/s 2023-10-09T15:35:12.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.341 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2092 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.397 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4968e-05 s, 0.0 kB/s 2023-10-09T15:35:12.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.397 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2093 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.454 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.454 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3416e-05 s, 0.0 kB/s 2023-10-09T15:35:12.454 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.454 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2094 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.510 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2951e-05 s, 0.0 kB/s 2023-10-09T15:35:12.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.510 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2095 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.566 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2271e-05 s, 0.0 kB/s 2023-10-09T15:35:12.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.566 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2096 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.622 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.272e-05 s, 0.0 kB/s 2023-10-09T15:35:12.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.622 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2097 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4749e-05 s, 0.0 kB/s 2023-10-09T15:35:12.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.678 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2098 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9228e-05 s, 0.0 kB/s 2023-10-09T15:35:12.734 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.734 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2099 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.789 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0983e-05 s, 0.0 kB/s 2023-10-09T15:35:12.790 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.790 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2100 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.847 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.847 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.497e-05 s, 0.0 kB/s 2023-10-09T15:35:12.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.847 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2101 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.903 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1649e-05 s, 0.0 kB/s 2023-10-09T15:35:12.903 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.903 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2102 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:12.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:12.959 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:12.959 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2263e-05 s, 0.0 kB/s 2023-10-09T15:35:12.959 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:12.959 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2103 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.015 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1141e-05 s, 0.0 kB/s 2023-10-09T15:35:13.015 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.015 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2104 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4108e-05 s, 0.0 kB/s 2023-10-09T15:35:13.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.071 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2105 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.127 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.127 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2212e-05 s, 0.0 kB/s 2023-10-09T15:35:13.127 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.127 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2106 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.183 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1673e-05 s, 0.0 kB/s 2023-10-09T15:35:13.183 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.183 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2107 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.239 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1991e-05 s, 0.0 kB/s 2023-10-09T15:35:13.239 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.240 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2108 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.295 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.295 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.295 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2864e-05 s, 0.0 kB/s 2023-10-09T15:35:13.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.296 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2109 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.352 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.352 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.352 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4016e-05 s, 0.0 kB/s 2023-10-09T15:35:13.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.352 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2110 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.408 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.102e-05 s, 0.0 kB/s 2023-10-09T15:35:13.408 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.408 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2111 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.464 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9328e-05 s, 0.0 kB/s 2023-10-09T15:35:13.464 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.464 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2112 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.519 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9935e-05 s, 0.0 kB/s 2023-10-09T15:35:13.520 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.520 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2113 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.036e-05 s, 0.0 kB/s 2023-10-09T15:35:13.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.576 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2114 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.631 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.631 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.193e-05 s, 0.0 kB/s 2023-10-09T15:35:13.632 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.632 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2115 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.687 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2339e-05 s, 0.0 kB/s 2023-10-09T15:35:13.688 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.688 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2116 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.745 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7424e-05 s, 0.0 kB/s 2023-10-09T15:35:13.745 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.745 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2117 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.800 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.800 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.800 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9657e-05 s, 0.0 kB/s 2023-10-09T15:35:13.800 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.801 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2118 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.856 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3046e-05 s, 0.0 kB/s 2023-10-09T15:35:13.857 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.857 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2119 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.912 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.912 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.913 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4311e-05 s, 0.0 kB/s 2023-10-09T15:35:13.913 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.913 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2120 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:13.968 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:13.969 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1348e-05 s, 0.0 kB/s 2023-10-09T15:35:13.969 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:13.969 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2121 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.024 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1996e-05 s, 0.0 kB/s 2023-10-09T15:35:14.025 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.025 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2122 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.081 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9509e-05 s, 0.0 kB/s 2023-10-09T15:35:14.082 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.082 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2123 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.137 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.138 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3088e-05 s, 0.0 kB/s 2023-10-09T15:35:14.138 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.138 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2124 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.193 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8341e-05 s, 0.0 kB/s 2023-10-09T15:35:14.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.194 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2125 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.249 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.250 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9904e-05 s, 0.0 kB/s 2023-10-09T15:35:14.250 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.250 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2126 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.306 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2463e-05 s, 0.0 kB/s 2023-10-09T15:35:14.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.306 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2127 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.362 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2629e-05 s, 0.0 kB/s 2023-10-09T15:35:14.362 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.362 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2128 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.417 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.418 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.233e-05 s, 0.0 kB/s 2023-10-09T15:35:14.418 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.418 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2129 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.474 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2433e-05 s, 0.0 kB/s 2023-10-09T15:35:14.474 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.474 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2130 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.530 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.530 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.531 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9745e-05 s, 0.0 kB/s 2023-10-09T15:35:14.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.531 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2131 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.587 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.388e-05 s, 0.0 kB/s 2023-10-09T15:35:14.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.587 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2132 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.643 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2374e-05 s, 0.0 kB/s 2023-10-09T15:35:14.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.643 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2133 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.699 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0037e-05 s, 0.0 kB/s 2023-10-09T15:35:14.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.700 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2134 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.756 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0927e-05 s, 0.0 kB/s 2023-10-09T15:35:14.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.756 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2135 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1937e-05 s, 0.0 kB/s 2023-10-09T15:35:14.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2136 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2437e-05 s, 0.0 kB/s 2023-10-09T15:35:14.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2137 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.923 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3263e-05 s, 0.0 kB/s 2023-10-09T15:35:14.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2138 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:14.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:14.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:14.979 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2465e-05 s, 0.0 kB/s 2023-10-09T15:35:14.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:14.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2139 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.034 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.035 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1194e-05 s, 0.0 kB/s 2023-10-09T15:35:15.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2140 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.091 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1188e-05 s, 0.0 kB/s 2023-10-09T15:35:15.091 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.091 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2141 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.146 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.147 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-09T15:35:15.147 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.147 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2142 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.202 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.202 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.202 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9967e-05 s, 0.0 kB/s 2023-10-09T15:35:15.203 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.203 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2143 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.258 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.258 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0563e-05 s, 0.0 kB/s 2023-10-09T15:35:15.259 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.259 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2144 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.315 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.379e-05 s, 0.0 kB/s 2023-10-09T15:35:15.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2145 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.371 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0681e-05 s, 0.0 kB/s 2023-10-09T15:35:15.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2146 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.428 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2278e-05 s, 0.0 kB/s 2023-10-09T15:35:15.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2147 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1313e-05 s, 0.0 kB/s 2023-10-09T15:35:15.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2148 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8362e-05 s, 0.0 kB/s 2023-10-09T15:35:15.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.541 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2149 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.352e-05 s, 0.0 kB/s 2023-10-09T15:35:15.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.597 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2150 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0377e-05 s, 0.0 kB/s 2023-10-09T15:35:15.653 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.653 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2151 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.708 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2651e-05 s, 0.0 kB/s 2023-10-09T15:35:15.709 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.709 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2152 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.764 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-09T15:35:15.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.765 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2153 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.89e-05 s, 0.0 kB/s 2023-10-09T15:35:15.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2154 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1317e-05 s, 0.0 kB/s 2023-10-09T15:35:15.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.877 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2155 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:15.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:15.933 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:15.933 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4687e-05 s, 0.0 kB/s 2023-10-09T15:35:15.933 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:15.933 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2156 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9646e-05 s, 0.0 kB/s 2023-10-09T15:35:16.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.002 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2157 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.058 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.405e-05 s, 0.0 kB/s 2023-10-09T15:35:16.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.058 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2158 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9894e-05 s, 0.0 kB/s 2023-10-09T15:35:16.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.114 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2159 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2313e-05 s, 0.0 kB/s 2023-10-09T15:35:16.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.170 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2160 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.225 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0429e-05 s, 0.0 kB/s 2023-10-09T15:35:16.225 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.225 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2161 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.281 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5274e-05 s, 0.0 kB/s 2023-10-09T15:35:16.281 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.281 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2162 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.336 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3369e-05 s, 0.0 kB/s 2023-10-09T15:35:16.337 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.337 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2163 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.393 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1809e-05 s, 0.0 kB/s 2023-10-09T15:35:16.393 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.393 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2164 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.448 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9401e-05 s, 0.0 kB/s 2023-10-09T15:35:16.449 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.449 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2165 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.504 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2843e-05 s, 0.0 kB/s 2023-10-09T15:35:16.505 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.505 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2166 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0162e-05 s, 0.0 kB/s 2023-10-09T15:35:16.562 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.562 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2167 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.617 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0733e-05 s, 0.0 kB/s 2023-10-09T15:35:16.617 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.617 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2168 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.672 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0699e-05 s, 0.0 kB/s 2023-10-09T15:35:16.673 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.673 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2169 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.728 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.728 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4962e-05 s, 0.0 kB/s 2023-10-09T15:35:16.729 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.729 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2170 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.784 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9938e-05 s, 0.0 kB/s 2023-10-09T15:35:16.785 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.785 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2171 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.840 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5096e-05 s, 0.0 kB/s 2023-10-09T15:35:16.841 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.841 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2172 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.897 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.897 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3452e-05 s, 0.0 kB/s 2023-10-09T15:35:16.897 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.897 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2173 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:16.952 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:16.953 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.416e-05 s, 0.0 kB/s 2023-10-09T15:35:16.953 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:16.953 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2174 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.008 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9059e-05 s, 0.0 kB/s 2023-10-09T15:35:17.009 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.009 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2175 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.065 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9874e-05 s, 0.0 kB/s 2023-10-09T15:35:17.065 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.065 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2176 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.121 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.121 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.027e-05 s, 0.0 kB/s 2023-10-09T15:35:17.121 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.121 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2177 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.176 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0757e-05 s, 0.0 kB/s 2023-10-09T15:35:17.177 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.177 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2178 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.232 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2255e-05 s, 0.0 kB/s 2023-10-09T15:35:17.232 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.233 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2179 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.289 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1298e-05 s, 0.0 kB/s 2023-10-09T15:35:17.289 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2180 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.346 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.346 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4558e-05 s, 0.0 kB/s 2023-10-09T15:35:17.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2181 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.401 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.402 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.322e-05 s, 0.0 kB/s 2023-10-09T15:35:17.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2182 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1763e-05 s, 0.0 kB/s 2023-10-09T15:35:17.458 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.458 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2183 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.188e-05 s, 0.0 kB/s 2023-10-09T15:35:17.514 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.514 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2184 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.569 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.569 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.569 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9436e-05 s, 0.0 kB/s 2023-10-09T15:35:17.570 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.570 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2185 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8904e-05 s, 0.0 kB/s 2023-10-09T15:35:17.625 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.626 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2186 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.681 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0442e-05 s, 0.0 kB/s 2023-10-09T15:35:17.682 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.682 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2187 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.737 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.738 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.738 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1125e-05 s, 0.0 kB/s 2023-10-09T15:35:17.738 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.738 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2188 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.794 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.794 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.315e-05 s, 0.0 kB/s 2023-10-09T15:35:17.794 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.794 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2189 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.850 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2563e-05 s, 0.0 kB/s 2023-10-09T15:35:17.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.850 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2190 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.905 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9493e-05 s, 0.0 kB/s 2023-10-09T15:35:17.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.906 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2191 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:17.961 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1034e-05 s, 0.0 kB/s 2023-10-09T15:35:17.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:17.962 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2192 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.017 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.018 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4248e-05 s, 0.0 kB/s 2023-10-09T15:35:18.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.018 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2193 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.073 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.074 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9562e-05 s, 0.0 kB/s 2023-10-09T15:35:18.074 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.074 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2194 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.129 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.129 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.130 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0591e-05 s, 0.0 kB/s 2023-10-09T15:35:18.130 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.130 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2195 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.186 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9259e-05 s, 0.0 kB/s 2023-10-09T15:35:18.186 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.186 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2196 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.241 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.242 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1159e-05 s, 0.0 kB/s 2023-10-09T15:35:18.242 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.242 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2197 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.297 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.298 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2915e-05 s, 0.0 kB/s 2023-10-09T15:35:18.298 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.298 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2198 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.354 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3677e-05 s, 0.0 kB/s 2023-10-09T15:35:18.354 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.354 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2199 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.410 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.410 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1223e-05 s, 0.0 kB/s 2023-10-09T15:35:18.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.410 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2200 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.465 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.465 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.465 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2156e-05 s, 0.0 kB/s 2023-10-09T15:35:18.465 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.466 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2201 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.522 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1001e-05 s, 0.0 kB/s 2023-10-09T15:35:18.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.523 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2202 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.578 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.579 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1225e-05 s, 0.0 kB/s 2023-10-09T15:35:18.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.579 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2203 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.634 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.634 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.634 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1024e-05 s, 0.0 kB/s 2023-10-09T15:35:18.634 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.635 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2204 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.691 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4604e-05 s, 0.0 kB/s 2023-10-09T15:35:18.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.691 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2205 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.746 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.746 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.746 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.317e-05 s, 0.0 kB/s 2023-10-09T15:35:18.746 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.747 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2206 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1855e-05 s, 0.0 kB/s 2023-10-09T15:35:18.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.803 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2207 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.859 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.859 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.859 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1502e-05 s, 0.0 kB/s 2023-10-09T15:35:18.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.859 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2208 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.915 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.916 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.916 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0047e-05 s, 0.0 kB/s 2023-10-09T15:35:18.916 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.916 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2209 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:18.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:18.972 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:18.972 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2937e-05 s, 0.0 kB/s 2023-10-09T15:35:18.972 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:18.972 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2210 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2415e-05 s, 0.0 kB/s 2023-10-09T15:35:19.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.028 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2211 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.084 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.084 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2479e-05 s, 0.0 kB/s 2023-10-09T15:35:19.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.084 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2212 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.140 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.473e-05 s, 0.0 kB/s 2023-10-09T15:35:19.140 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.140 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2213 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.195 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.196 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5092e-05 s, 0.0 kB/s 2023-10-09T15:35:19.196 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.196 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2214 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.251 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.251 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.251 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2351e-05 s, 0.0 kB/s 2023-10-09T15:35:19.251 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.251 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2215 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.308 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.308 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.308 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2791e-05 s, 0.0 kB/s 2023-10-09T15:35:19.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.309 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2216 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.364 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.365 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3949e-05 s, 0.0 kB/s 2023-10-09T15:35:19.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.365 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2217 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.420 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.137e-05 s, 0.0 kB/s 2023-10-09T15:35:19.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.421 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2218 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.476 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2106e-05 s, 0.0 kB/s 2023-10-09T15:35:19.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.477 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2219 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.533 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.852e-05 s, 0.0 kB/s 2023-10-09T15:35:19.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.533 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2220 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.588 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.974e-05 s, 0.0 kB/s 2023-10-09T15:35:19.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.589 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2221 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.644 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.644 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.645 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0171e-05 s, 0.0 kB/s 2023-10-09T15:35:19.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.645 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2222 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.700 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1692e-05 s, 0.0 kB/s 2023-10-09T15:35:19.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.701 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2223 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.757 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2683e-05 s, 0.0 kB/s 2023-10-09T15:35:19.757 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.757 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2224 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2764e-05 s, 0.0 kB/s 2023-10-09T15:35:19.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2225 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2432e-05 s, 0.0 kB/s 2023-10-09T15:35:19.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.869 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2226 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.122e-05 s, 0.0 kB/s 2023-10-09T15:35:19.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2227 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:19.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:19.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:19.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1555e-05 s, 0.0 kB/s 2023-10-09T15:35:19.981 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:19.981 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2228 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1673e-05 s, 0.0 kB/s 2023-10-09T15:35:20.037 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.037 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2229 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.093 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.093 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2181e-05 s, 0.0 kB/s 2023-10-09T15:35:20.093 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.093 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2230 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2387e-05 s, 0.0 kB/s 2023-10-09T15:35:20.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2231 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4623e-05 s, 0.0 kB/s 2023-10-09T15:35:20.205 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.205 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2232 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.260 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2061e-05 s, 0.0 kB/s 2023-10-09T15:35:20.261 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.261 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2233 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0268e-05 s, 0.0 kB/s 2023-10-09T15:35:20.317 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.317 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2234 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.373 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6932e-05 s, 0.0 kB/s 2023-10-09T15:35:20.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.373 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2235 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.429 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3313e-05 s, 0.0 kB/s 2023-10-09T15:35:20.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.429 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2236 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9367e-05 s, 0.0 kB/s 2023-10-09T15:35:20.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2237 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.081e-05 s, 0.0 kB/s 2023-10-09T15:35:20.541 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.541 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2238 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.597 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.598 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-09T15:35:20.598 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.598 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2239 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.653 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.654 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0862e-05 s, 0.0 kB/s 2023-10-09T15:35:20.654 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.654 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2240 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.709 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.709 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.710 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3839e-05 s, 0.0 kB/s 2023-10-09T15:35:20.710 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.710 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2241 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.765 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.765 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.766 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-09T15:35:20.766 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.766 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2242 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.821 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0988e-05 s, 0.0 kB/s 2023-10-09T15:35:20.822 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.822 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2243 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.877 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2152e-05 s, 0.0 kB/s 2023-10-09T15:35:20.877 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.878 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2244 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.933 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.933 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.933 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3737e-05 s, 0.0 kB/s 2023-10-09T15:35:20.934 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.934 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2245 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:20.989 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:20.989 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:20.989 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9778e-05 s, 0.0 kB/s 2023-10-09T15:35:20.990 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:20.990 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2246 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.046 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.046 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.046 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0222e-05 s, 0.0 kB/s 2023-10-09T15:35:21.046 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.046 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2247 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.101 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.101 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9203e-05 s, 0.0 kB/s 2023-10-09T15:35:21.102 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.102 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2248 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.157 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.157 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2153e-05 s, 0.0 kB/s 2023-10-09T15:35:21.158 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.158 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2249 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.213 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.213 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.213 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9132e-05 s, 0.0 kB/s 2023-10-09T15:35:21.214 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.214 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2250 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.269 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4567e-05 s, 0.0 kB/s 2023-10-09T15:35:21.270 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.270 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2251 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1617e-05 s, 0.0 kB/s 2023-10-09T15:35:21.328 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.328 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2252 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.383 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.383 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.383 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9163e-05 s, 0.0 kB/s 2023-10-09T15:35:21.384 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.384 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2253 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.440 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0653e-05 s, 0.0 kB/s 2023-10-09T15:35:21.440 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.440 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2254 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.496 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.183e-05 s, 0.0 kB/s 2023-10-09T15:35:21.496 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.496 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2255 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.552 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2636e-05 s, 0.0 kB/s 2023-10-09T15:35:21.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.552 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2256 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.607 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.607 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2607e-05 s, 0.0 kB/s 2023-10-09T15:35:21.607 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.607 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2257 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.663 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2225e-05 s, 0.0 kB/s 2023-10-09T15:35:21.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.664 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2258 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.719 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3078e-05 s, 0.0 kB/s 2023-10-09T15:35:21.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.720 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2259 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.775 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.776 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1915e-05 s, 0.0 kB/s 2023-10-09T15:35:21.776 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.776 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2260 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.831 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.832 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9163e-05 s, 0.0 kB/s 2023-10-09T15:35:21.832 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.832 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2261 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.888 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3908e-05 s, 0.0 kB/s 2023-10-09T15:35:21.888 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2262 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.943 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-09T15:35:21.944 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:21.944 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2263 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:21.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.000 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.000 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1141e-05 s, 0.0 kB/s 2023-10-09T15:35:22.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2264 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.055 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.056 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2149e-05 s, 0.0 kB/s 2023-10-09T15:35:22.056 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.056 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2265 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.154 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 5.0026e-05 s, 0.0 kB/s 2023-10-09T15:35:22.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2266 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0744e-05 s, 0.0 kB/s 2023-10-09T15:35:22.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2267 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1548e-05 s, 0.0 kB/s 2023-10-09T15:35:22.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2268 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2785e-05 s, 0.0 kB/s 2023-10-09T15:35:22.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.284 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2269 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9572e-05 s, 0.0 kB/s 2023-10-09T15:35:22.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.340 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2270 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-09T15:35:22.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.396 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2271 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.453 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.453 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0707e-05 s, 0.0 kB/s 2023-10-09T15:35:22.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.453 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2272 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.509 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1326e-05 s, 0.0 kB/s 2023-10-09T15:35:22.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.509 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2273 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.565 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1511e-05 s, 0.0 kB/s 2023-10-09T15:35:22.565 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.565 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2274 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.620 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5436e-05 s, 0.0 kB/s 2023-10-09T15:35:22.621 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.621 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2275 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.676 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9731e-05 s, 0.0 kB/s 2023-10-09T15:35:22.677 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.677 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2276 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.733 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.733 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2189e-05 s, 0.0 kB/s 2023-10-09T15:35:22.733 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.733 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2277 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.789 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1032e-05 s, 0.0 kB/s 2023-10-09T15:35:22.789 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.789 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2278 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.845 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5856e-05 s, 0.0 kB/s 2023-10-09T15:35:22.845 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.845 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2279 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3661e-05 s, 0.0 kB/s 2023-10-09T15:35:22.902 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.902 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2280 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:22.958 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5826e-05 s, 0.0 kB/s 2023-10-09T15:35:22.958 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:22.958 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2281 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.013 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3551e-05 s, 0.0 kB/s 2023-10-09T15:35:23.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.015 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2282 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1639e-05 s, 0.0 kB/s 2023-10-09T15:35:23.071 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.071 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2283 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.128 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.128 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2436e-05 s, 0.0 kB/s 2023-10-09T15:35:23.128 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.128 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2284 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.183 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.184 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5187e-05 s, 0.0 kB/s 2023-10-09T15:35:23.184 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.184 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2285 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.240 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.240 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5318e-05 s, 0.0 kB/s 2023-10-09T15:35:23.240 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.240 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2286 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.296 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.296 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3744e-05 s, 0.0 kB/s 2023-10-09T15:35:23.296 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.296 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2287 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3915e-05 s, 0.0 kB/s 2023-10-09T15:35:23.352 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.352 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2288 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.409 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.409 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.409 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2871e-05 s, 0.0 kB/s 2023-10-09T15:35:23.410 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.410 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2289 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.466 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.0034e-05 s, 0.0 kB/s 2023-10-09T15:35:23.466 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.467 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2290 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.522 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2981e-05 s, 0.0 kB/s 2023-10-09T15:35:23.522 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.523 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2291 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3687e-05 s, 0.0 kB/s 2023-10-09T15:35:23.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.579 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2292 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.635 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3869e-05 s, 0.0 kB/s 2023-10-09T15:35:23.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.635 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2293 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.691 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0812e-05 s, 0.0 kB/s 2023-10-09T15:35:23.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.692 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2294 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.748 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.469e-05 s, 0.0 kB/s 2023-10-09T15:35:23.748 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.748 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2295 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.803 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.803 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.804 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1186e-05 s, 0.0 kB/s 2023-10-09T15:35:23.804 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.804 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2296 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.472e-05 s, 0.0 kB/s 2023-10-09T15:35:23.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2297 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2601e-05 s, 0.0 kB/s 2023-10-09T15:35:23.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2298 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:23.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:23.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:23.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1471e-05 s, 0.0 kB/s 2023-10-09T15:35:23.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:23.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2299 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.43e-05 s, 0.0 kB/s 2023-10-09T15:35:24.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.032 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2300 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.089 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4145e-05 s, 0.0 kB/s 2023-10-09T15:35:24.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.089 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2301 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.145 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.145 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.145 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9236e-05 s, 0.0 kB/s 2023-10-09T15:35:24.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.145 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2302 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.201 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4941e-05 s, 0.0 kB/s 2023-10-09T15:35:24.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2303 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2178e-05 s, 0.0 kB/s 2023-10-09T15:35:24.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2304 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.313 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2512e-05 s, 0.0 kB/s 2023-10-09T15:35:24.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.314 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2305 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.370 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3257e-05 s, 0.0 kB/s 2023-10-09T15:35:24.370 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.370 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2306 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.425 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1119e-05 s, 0.0 kB/s 2023-10-09T15:35:24.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.426 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2307 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1989e-05 s, 0.0 kB/s 2023-10-09T15:35:24.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2308 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3033e-05 s, 0.0 kB/s 2023-10-09T15:35:24.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2309 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.594 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5616e-05 s, 0.0 kB/s 2023-10-09T15:35:24.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2310 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.649 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1796e-05 s, 0.0 kB/s 2023-10-09T15:35:24.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2311 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.706 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-09T15:35:24.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.706 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2312 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.761 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0638e-05 s, 0.0 kB/s 2023-10-09T15:35:24.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2313 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3751e-05 s, 0.0 kB/s 2023-10-09T15:35:24.973 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2314 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:24.990 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:24.991 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2875e-05 s, 0.0 kB/s 2023-10-09T15:35:24.991 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:24.991 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2315 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.047 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2021e-05 s, 0.0 kB/s 2023-10-09T15:35:25.047 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.047 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2316 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.104 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5297e-05 s, 0.0 kB/s 2023-10-09T15:35:25.104 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.104 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2317 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.159 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3113e-05 s, 0.0 kB/s 2023-10-09T15:35:25.160 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.160 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2318 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.217 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2328e-05 s, 0.0 kB/s 2023-10-09T15:35:25.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2319 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.272 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4005e-05 s, 0.0 kB/s 2023-10-09T15:35:25.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.273 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2320 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.329 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.416e-05 s, 0.0 kB/s 2023-10-09T15:35:25.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2321 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.385 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3752e-05 s, 0.0 kB/s 2023-10-09T15:35:25.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.385 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2322 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.440 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2787e-05 s, 0.0 kB/s 2023-10-09T15:35:25.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.441 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2323 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-09T15:35:25.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.497 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2324 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.553 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5787e-05 s, 0.0 kB/s 2023-10-09T15:35:25.553 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.553 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2325 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.609 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3942e-05 s, 0.0 kB/s 2023-10-09T15:35:25.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.610 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2326 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.666 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1121e-05 s, 0.0 kB/s 2023-10-09T15:35:25.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.666 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2327 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3109e-05 s, 0.0 kB/s 2023-10-09T15:35:25.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.722 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2328 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.777 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3983e-05 s, 0.0 kB/s 2023-10-09T15:35:25.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.778 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2329 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.833 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.834 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0254e-05 s, 0.0 kB/s 2023-10-09T15:35:25.834 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.834 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2330 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.889 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.890 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1842e-05 s, 0.0 kB/s 2023-10-09T15:35:25.890 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.890 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2331 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:25.945 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2525e-05 s, 0.0 kB/s 2023-10-09T15:35:25.946 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:25.946 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2332 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8157e-05 s, 0.0 kB/s 2023-10-09T15:35:26.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.002 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2333 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.057 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1843e-05 s, 0.0 kB/s 2023-10-09T15:35:26.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.058 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2334 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.113 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2568e-05 s, 0.0 kB/s 2023-10-09T15:35:26.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.114 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2335 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0586e-05 s, 0.0 kB/s 2023-10-09T15:35:26.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.170 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2336 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.225 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4291e-05 s, 0.0 kB/s 2023-10-09T15:35:26.226 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.226 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2337 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.281 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.282 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.282 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3859e-05 s, 0.0 kB/s 2023-10-09T15:35:26.282 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.282 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2338 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.337 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.338 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-09T15:35:26.338 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2339 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.393 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.394 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.574e-05 s, 0.0 kB/s 2023-10-09T15:35:26.394 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.394 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2340 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.449 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.450 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3415e-05 s, 0.0 kB/s 2023-10-09T15:35:26.450 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.450 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2341 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.506 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3531e-05 s, 0.0 kB/s 2023-10-09T15:35:26.506 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.506 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2342 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5592e-05 s, 0.0 kB/s 2023-10-09T15:35:26.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2343 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2717e-05 s, 0.0 kB/s 2023-10-09T15:35:26.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.619 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2344 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.675 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0079e-05 s, 0.0 kB/s 2023-10-09T15:35:26.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.675 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2345 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.731 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3277e-05 s, 0.0 kB/s 2023-10-09T15:35:26.731 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.731 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2346 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.786 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.786 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.786 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4356e-05 s, 0.0 kB/s 2023-10-09T15:35:26.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.787 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2347 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.843 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.843 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.843 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1981e-05 s, 0.0 kB/s 2023-10-09T15:35:26.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.843 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2348 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.899 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1428e-05 s, 0.0 kB/s 2023-10-09T15:35:26.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.899 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2349 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:26.954 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.116e-05 s, 0.0 kB/s 2023-10-09T15:35:26.955 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:26.955 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2350 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.010 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3211e-05 s, 0.0 kB/s 2023-10-09T15:35:27.011 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.011 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2351 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.067 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0187e-05 s, 0.0 kB/s 2023-10-09T15:35:27.067 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.067 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2352 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.122 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.123 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.123 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4929e-05 s, 0.0 kB/s 2023-10-09T15:35:27.123 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.123 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2353 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.178 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.179 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.179 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1071e-05 s, 0.0 kB/s 2023-10-09T15:35:27.179 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.179 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2354 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.234 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1432e-05 s, 0.0 kB/s 2023-10-09T15:35:27.235 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.235 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2355 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.290 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.290 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.291 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2561e-05 s, 0.0 kB/s 2023-10-09T15:35:27.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.291 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2356 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.347 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.347 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.347 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-09T15:35:27.347 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.347 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2357 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2932e-05 s, 0.0 kB/s 2023-10-09T15:35:27.403 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.403 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2358 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0595e-05 s, 0.0 kB/s 2023-10-09T15:35:27.460 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.460 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2359 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.515 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2285e-05 s, 0.0 kB/s 2023-10-09T15:35:27.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.516 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2360 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.571 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-09T15:35:27.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.572 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2361 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.628 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3194e-05 s, 0.0 kB/s 2023-10-09T15:35:27.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.628 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2362 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.683 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1856e-05 s, 0.0 kB/s 2023-10-09T15:35:27.683 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.684 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2363 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.739 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.740 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4254e-05 s, 0.0 kB/s 2023-10-09T15:35:27.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.740 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2364 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.795 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.795 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.795 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2825e-05 s, 0.0 kB/s 2023-10-09T15:35:27.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.796 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2365 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0029e-05 s, 0.0 kB/s 2023-10-09T15:35:27.851 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.852 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2366 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.907 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1519e-05 s, 0.0 kB/s 2023-10-09T15:35:27.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.908 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2367 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:27.963 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1488e-05 s, 0.0 kB/s 2023-10-09T15:35:27.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:27.964 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2368 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.020 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4368e-05 s, 0.0 kB/s 2023-10-09T15:35:28.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.020 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2369 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2348e-05 s, 0.0 kB/s 2023-10-09T15:35:28.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.076 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2370 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.132 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0187e-05 s, 0.0 kB/s 2023-10-09T15:35:28.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2371 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.188 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2048e-05 s, 0.0 kB/s 2023-10-09T15:35:28.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2372 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.244 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3229e-05 s, 0.0 kB/s 2023-10-09T15:35:28.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2373 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.300 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5287e-05 s, 0.0 kB/s 2023-10-09T15:35:28.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2374 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6433e-05 s, 0.0 kB/s 2023-10-09T15:35:28.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.357 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2375 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.412 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.413 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5468e-05 s, 0.0 kB/s 2023-10-09T15:35:28.413 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.413 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2376 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.469 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4289e-05 s, 0.0 kB/s 2023-10-09T15:35:28.469 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2377 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4318e-05 s, 0.0 kB/s 2023-10-09T15:35:28.525 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.525 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2378 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3223e-05 s, 0.0 kB/s 2023-10-09T15:35:28.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.583 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2379 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.267e-05 s, 0.0 kB/s 2023-10-09T15:35:28.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2380 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.695 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.468e-05 s, 0.0 kB/s 2023-10-09T15:35:28.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.695 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2381 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.750 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3588e-05 s, 0.0 kB/s 2023-10-09T15:35:28.751 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.751 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2382 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.807 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3934e-05 s, 0.0 kB/s 2023-10-09T15:35:28.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.807 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2383 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2053e-05 s, 0.0 kB/s 2023-10-09T15:35:28.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2384 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.374e-05 s, 0.0 kB/s 2023-10-09T15:35:28.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2385 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:28.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:28.977 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3501e-05 s, 0.0 kB/s 2023-10-09T15:35:28.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:28.977 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2386 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.033 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.033 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.033 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3867e-05 s, 0.0 kB/s 2023-10-09T15:35:29.033 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.033 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2387 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.089 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.089 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4863e-05 s, 0.0 kB/s 2023-10-09T15:35:29.089 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.089 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2388 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.145 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1286e-05 s, 0.0 kB/s 2023-10-09T15:35:29.145 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.145 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2389 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.201 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3333e-05 s, 0.0 kB/s 2023-10-09T15:35:29.201 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.201 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2390 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4185e-05 s, 0.0 kB/s 2023-10-09T15:35:29.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2391 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.314 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.314 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4014e-05 s, 0.0 kB/s 2023-10-09T15:35:29.315 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.315 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2392 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.371 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.207e-05 s, 0.0 kB/s 2023-10-09T15:35:29.371 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.371 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2393 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.427 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2e-05 s, 0 B/s 2023-10-09T15:35:29.427 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.427 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2394 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.482 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1444e-05 s, 0.0 kB/s 2023-10-09T15:35:29.483 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.483 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2395 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2516e-05 s, 0.0 kB/s 2023-10-09T15:35:29.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.539 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2396 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.595 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.397e-05 s, 0.0 kB/s 2023-10-09T15:35:29.595 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.595 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2397 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.651 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1678e-05 s, 0.0 kB/s 2023-10-09T15:35:29.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2398 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.708 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3792e-05 s, 0.0 kB/s 2023-10-09T15:35:29.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2399 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.764 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1348e-05 s, 0.0 kB/s 2023-10-09T15:35:29.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.764 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2400 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.819 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2633e-05 s, 0.0 kB/s 2023-10-09T15:35:29.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2401 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3087e-05 s, 0.0 kB/s 2023-10-09T15:35:29.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2402 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.931 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.932 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.932 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2295e-05 s, 0.0 kB/s 2023-10-09T15:35:29.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.932 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2403 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:29.987 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:29.988 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3012e-05 s, 0.0 kB/s 2023-10-09T15:35:29.988 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:29.988 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2404 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.044 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-09T15:35:30.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.044 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2405 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.100 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1196e-05 s, 0.0 kB/s 2023-10-09T15:35:30.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2406 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.156 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.078e-05 s, 0.0 kB/s 2023-10-09T15:35:30.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2407 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.212 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8868e-05 s, 0.0 kB/s 2023-10-09T15:35:30.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2408 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2539e-05 s, 0.0 kB/s 2023-10-09T15:35:30.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2409 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0943e-05 s, 0.0 kB/s 2023-10-09T15:35:30.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2410 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2558e-05 s, 0.0 kB/s 2023-10-09T15:35:30.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.382 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2411 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.438 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0807e-05 s, 0.0 kB/s 2023-10-09T15:35:30.438 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.439 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2412 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.494 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.494 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5758e-05 s, 0.0 kB/s 2023-10-09T15:35:30.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.495 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2413 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.551 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.552 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3991e-05 s, 0.0 kB/s 2023-10-09T15:35:30.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.552 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2414 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.608 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.608 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0579e-05 s, 0.0 kB/s 2023-10-09T15:35:30.608 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.608 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2415 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.664 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.664 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.221e-05 s, 0.0 kB/s 2023-10-09T15:35:30.664 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.665 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2416 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.721 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.721 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8096e-05 s, 0.0 kB/s 2023-10-09T15:35:30.721 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.721 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2417 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2826e-05 s, 0.0 kB/s 2023-10-09T15:35:30.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.777 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2418 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.834 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.834 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4613e-05 s, 0.0 kB/s 2023-10-09T15:35:30.835 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.835 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2419 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.890 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.891 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5664e-05 s, 0.0 kB/s 2023-10-09T15:35:30.891 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.891 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2420 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:30.947 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1009e-05 s, 0.0 kB/s 2023-10-09T15:35:30.947 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:30.947 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2421 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.002 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9221e-05 s, 0.0 kB/s 2023-10-09T15:35:31.003 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.003 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2422 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.058 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.059 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9238e-05 s, 0.0 kB/s 2023-10-09T15:35:31.059 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.059 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2423 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9455e-05 s, 0.0 kB/s 2023-10-09T15:35:31.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.115 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2424 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.171 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2895e-05 s, 0.0 kB/s 2023-10-09T15:35:31.171 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2425 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.226 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9687e-05 s, 0.0 kB/s 2023-10-09T15:35:31.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2426 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1073e-05 s, 0.0 kB/s 2023-10-09T15:35:31.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.283 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2427 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5789e-05 s, 0.0 kB/s 2023-10-09T15:35:31.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2428 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2196e-05 s, 0.0 kB/s 2023-10-09T15:35:31.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.395 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2429 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.451 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1747e-05 s, 0.0 kB/s 2023-10-09T15:35:31.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.451 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2430 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.507 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3166e-05 s, 0.0 kB/s 2023-10-09T15:35:31.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.507 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2431 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3117e-05 s, 0.0 kB/s 2023-10-09T15:35:31.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2432 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.619 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9387e-05 s, 0.0 kB/s 2023-10-09T15:35:31.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.619 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2433 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.675 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2765e-05 s, 0.0 kB/s 2023-10-09T15:35:31.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.676 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2434 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.731 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.732 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9922e-05 s, 0.0 kB/s 2023-10-09T15:35:31.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.732 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2435 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.788 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0819e-05 s, 0.0 kB/s 2023-10-09T15:35:31.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.789 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2436 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.846 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0596e-05 s, 0.0 kB/s 2023-10-09T15:35:31.847 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.847 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2437 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.900 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4484e-05 s, 0.0 kB/s 2023-10-09T15:35:31.901 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.901 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2438 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:31.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:31.957 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:31.957 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2337e-05 s, 0.0 kB/s 2023-10-09T15:35:31.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:31.957 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2439 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.012 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.012 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3336e-05 s, 0.0 kB/s 2023-10-09T15:35:32.013 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.013 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2440 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.068 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.069 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2102e-05 s, 0.0 kB/s 2023-10-09T15:35:32.069 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.069 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2441 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.124 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.125 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1597e-05 s, 0.0 kB/s 2023-10-09T15:35:32.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.125 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2442 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.180 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.181 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9105e-05 s, 0.0 kB/s 2023-10-09T15:35:32.181 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.181 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2443 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.236 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.237 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5673e-05 s, 0.0 kB/s 2023-10-09T15:35:32.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.237 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2444 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.38e-05 s, 0.0 kB/s 2023-10-09T15:35:32.293 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.294 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2445 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.349 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.350 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4143e-05 s, 0.0 kB/s 2023-10-09T15:35:32.350 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.350 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2446 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.405 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4261e-05 s, 0.0 kB/s 2023-10-09T15:35:32.406 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.406 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2447 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.461 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2542e-05 s, 0.0 kB/s 2023-10-09T15:35:32.462 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.462 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2448 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.517 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.518 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1515e-05 s, 0.0 kB/s 2023-10-09T15:35:32.518 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.518 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2449 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.573 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1442e-05 s, 0.0 kB/s 2023-10-09T15:35:32.574 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.574 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2450 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.629 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.630 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5606e-05 s, 0.0 kB/s 2023-10-09T15:35:32.630 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.630 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2451 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.686 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5352e-05 s, 0.0 kB/s 2023-10-09T15:35:32.686 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.686 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2452 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.742 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.742 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0589e-05 s, 0.0 kB/s 2023-10-09T15:35:32.742 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.742 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2453 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.798 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.798 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.522e-05 s, 0.0 kB/s 2023-10-09T15:35:32.798 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2454 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.854 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2266e-05 s, 0.0 kB/s 2023-10-09T15:35:32.854 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.854 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2455 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.909 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.308e-05 s, 0.0 kB/s 2023-10-09T15:35:32.910 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.910 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2456 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:32.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:32.966 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:32.966 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0526e-05 s, 0.0 kB/s 2023-10-09T15:35:32.966 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:32.967 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2457 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.022 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.022 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0372e-05 s, 0.0 kB/s 2023-10-09T15:35:33.022 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.022 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2458 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.078 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1128e-05 s, 0.0 kB/s 2023-10-09T15:35:33.078 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.078 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2459 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.133 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.134 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.134 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0282e-05 s, 0.0 kB/s 2023-10-09T15:35:33.135 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.135 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2460 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.190 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3431e-05 s, 0.0 kB/s 2023-10-09T15:35:33.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.191 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2461 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.246 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2397e-05 s, 0.0 kB/s 2023-10-09T15:35:33.247 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.247 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2462 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.303 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9797e-05 s, 0.0 kB/s 2023-10-09T15:35:33.303 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.303 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2463 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.359 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.359 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.359 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6373e-05 s, 0.0 kB/s 2023-10-09T15:35:33.359 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.359 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2464 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3023e-05 s, 0.0 kB/s 2023-10-09T15:35:33.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.415 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2465 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5094e-05 s, 0.0 kB/s 2023-10-09T15:35:33.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.471 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2466 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.527 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.527 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1696e-05 s, 0.0 kB/s 2023-10-09T15:35:33.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.527 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2467 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.583 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-09T15:35:33.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.583 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2468 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.638 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.638 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2739e-05 s, 0.0 kB/s 2023-10-09T15:35:33.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.639 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2469 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.695 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1239e-05 s, 0.0 kB/s 2023-10-09T15:35:33.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.695 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2470 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.752 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.752 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0654e-05 s, 0.0 kB/s 2023-10-09T15:35:33.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.752 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2471 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.808 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.808 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4735e-05 s, 0.0 kB/s 2023-10-09T15:35:33.808 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.808 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2472 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.864 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.162e-05 s, 0.0 kB/s 2023-10-09T15:35:33.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2473 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3846e-05 s, 0.0 kB/s 2023-10-09T15:35:33.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2474 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:33.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:33.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:33.976 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.175e-05 s, 0.0 kB/s 2023-10-09T15:35:33.976 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:33.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2475 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3995e-05 s, 0.0 kB/s 2023-10-09T15:35:34.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.032 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2476 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3092e-05 s, 0.0 kB/s 2023-10-09T15:35:34.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.088 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2477 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.144 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.144 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1397e-05 s, 0.0 kB/s 2023-10-09T15:35:34.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.144 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2478 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.199 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.674e-05 s, 0.0 kB/s 2023-10-09T15:35:34.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2479 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.256 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1882e-05 s, 0.0 kB/s 2023-10-09T15:35:34.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.256 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2480 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.312 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.312 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3709e-05 s, 0.0 kB/s 2023-10-09T15:35:34.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.312 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2481 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.368 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2952e-05 s, 0.0 kB/s 2023-10-09T15:35:34.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.368 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2482 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.423 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0306e-05 s, 0.0 kB/s 2023-10-09T15:35:34.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.424 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2483 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3539e-05 s, 0.0 kB/s 2023-10-09T15:35:34.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.480 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2484 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1873e-05 s, 0.0 kB/s 2023-10-09T15:35:34.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.536 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2485 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.591 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-09T15:35:34.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.592 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2486 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.647 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4975e-05 s, 0.0 kB/s 2023-10-09T15:35:34.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.648 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2487 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.704 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2673e-05 s, 0.0 kB/s 2023-10-09T15:35:34.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.704 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2488 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.377e-05 s, 0.0 kB/s 2023-10-09T15:35:34.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.760 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2489 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.815 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9007e-05 s, 0.0 kB/s 2023-10-09T15:35:34.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.816 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2490 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.872 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.872 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.873 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.317e-05 s, 0.0 kB/s 2023-10-09T15:35:34.873 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.873 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2491 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.928 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.929 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0178e-05 s, 0.0 kB/s 2023-10-09T15:35:34.929 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.929 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2492 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:34.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:34.985 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:34.985 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.985e-05 s, 0.0 kB/s 2023-10-09T15:35:34.985 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:34.985 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2493 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.041 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2442e-05 s, 0.0 kB/s 2023-10-09T15:35:35.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.041 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2494 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1762e-05 s, 0.0 kB/s 2023-10-09T15:35:35.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.097 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2495 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8832e-05 s, 0.0 kB/s 2023-10-09T15:35:35.154 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.154 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2496 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.209 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4489e-05 s, 0.0 kB/s 2023-10-09T15:35:35.210 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.210 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2497 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.266 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9253e-05 s, 0.0 kB/s 2023-10-09T15:35:35.266 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.266 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2498 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1389e-05 s, 0.0 kB/s 2023-10-09T15:35:35.323 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.324 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2499 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.379 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.379 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.379 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-09T15:35:35.379 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.380 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2500 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.435 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.435 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.435 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3502e-05 s, 0.0 kB/s 2023-10-09T15:35:35.435 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.435 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2501 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.490 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.491 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.491 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3885e-05 s, 0.0 kB/s 2023-10-09T15:35:35.491 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.491 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2502 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.547 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.547 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3533e-05 s, 0.0 kB/s 2023-10-09T15:35:35.547 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.548 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2503 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.603 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1111e-05 s, 0.0 kB/s 2023-10-09T15:35:35.603 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.603 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2504 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.658 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2078e-05 s, 0.0 kB/s 2023-10-09T15:35:35.659 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.659 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2505 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.715 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2469e-05 s, 0.0 kB/s 2023-10-09T15:35:35.715 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.715 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2506 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.770 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1838e-05 s, 0.0 kB/s 2023-10-09T15:35:35.771 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.771 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2507 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.827 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.827 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.827 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3803e-05 s, 0.0 kB/s 2023-10-09T15:35:35.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.827 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2508 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.882 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3619e-05 s, 0.0 kB/s 2023-10-09T15:35:35.883 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.883 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2509 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.939 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.21e-05 s, 0.0 kB/s 2023-10-09T15:35:35.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.939 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2510 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:35.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:35.995 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3322e-05 s, 0.0 kB/s 2023-10-09T15:35:35.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:35.995 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2511 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.12e-05 s, 0.0 kB/s 2023-10-09T15:35:36.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.051 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2512 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.106 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.107 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0046e-05 s, 0.0 kB/s 2023-10-09T15:35:36.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.108 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2513 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.162 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2709e-05 s, 0.0 kB/s 2023-10-09T15:35:36.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.163 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2514 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.17e-05 s, 0.0 kB/s 2023-10-09T15:35:36.220 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.220 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2515 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.275 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.275 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1188e-05 s, 0.0 kB/s 2023-10-09T15:35:36.276 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.276 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2516 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.333 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4086e-05 s, 0.0 kB/s 2023-10-09T15:35:36.334 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.334 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2517 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.385 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:35:36.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.389 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1133e-05 s, 0.0 kB/s 2023-10-09T15:35:36.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.389 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2518 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:35:36.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.445 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1899e-05 s, 0.0 kB/s 2023-10-09T15:35:36.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.446 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2519 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.522 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1379e-05 s, 0.0 kB/s 2023-10-09T15:35:36.523 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.523 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2520 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.578 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.578 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.578 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1348e-05 s, 0.0 kB/s 2023-10-09T15:35:36.579 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.579 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2521 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.635 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.635 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0968e-05 s, 0.0 kB/s 2023-10-09T15:35:36.636 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.636 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2522 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.691 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.691 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.019e-05 s, 0.0 kB/s 2023-10-09T15:35:36.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.692 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2523 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.748 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.748 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2977e-05 s, 0.0 kB/s 2023-10-09T15:35:36.749 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.749 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2524 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.805 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.805 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3077e-05 s, 0.0 kB/s 2023-10-09T15:35:36.805 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.805 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2525 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.860 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.861 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.861 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-09T15:35:36.861 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.861 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2526 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.917 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.918 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.918 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.159e-05 s, 0.0 kB/s 2023-10-09T15:35:36.918 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.918 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2527 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:36.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3189e-05 s, 0.0 kB/s 2023-10-09T15:35:36.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:36.974 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2528 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.029 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.589e-05 s, 0.0 kB/s 2023-10-09T15:35:37.030 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.030 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2529 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.085 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3131e-05 s, 0.0 kB/s 2023-10-09T15:35:37.086 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.086 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2530 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.141 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1038e-05 s, 0.0 kB/s 2023-10-09T15:35:37.142 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.142 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2531 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.198 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1998e-05 s, 0.0 kB/s 2023-10-09T15:35:37.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2532 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.254 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5251e-05 s, 0.0 kB/s 2023-10-09T15:35:37.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2533 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1247e-05 s, 0.0 kB/s 2023-10-09T15:35:37.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.312 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2534 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.405e-05 s, 0.0 kB/s 2023-10-09T15:35:37.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.368 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2535 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.424 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0525e-05 s, 0.0 kB/s 2023-10-09T15:35:37.425 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.425 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2536 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.481 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1894e-05 s, 0.0 kB/s 2023-10-09T15:35:37.481 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.481 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2537 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3393e-05 s, 0.0 kB/s 2023-10-09T15:35:37.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2538 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.594 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.123e-05 s, 0.0 kB/s 2023-10-09T15:35:37.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2539 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.649 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.650 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3315e-05 s, 0.0 kB/s 2023-10-09T15:35:37.650 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.650 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2540 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2658e-05 s, 0.0 kB/s 2023-10-09T15:35:37.706 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.706 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2541 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.064e-05 s, 0.0 kB/s 2023-10-09T15:35:37.762 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.762 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2542 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.817 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1789e-05 s, 0.0 kB/s 2023-10-09T15:35:37.818 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.818 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2543 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.873 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.874 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.874 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.228e-05 s, 0.0 kB/s 2023-10-09T15:35:37.874 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.874 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2544 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:37.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:37.929 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:37.929 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2259e-05 s, 0.0 kB/s 2023-10-09T15:35:37.930 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:37.930 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2545 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.040 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.4309e-05 s, 0.0 kB/s 2023-10-09T15:35:38.041 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.041 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2546 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.057 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2592e-05 s, 0.0 kB/s 2023-10-09T15:35:38.057 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.057 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2547 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.113 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9398e-05 s, 0.0 kB/s 2023-10-09T15:35:38.113 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.114 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2548 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.170 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.170 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3478e-05 s, 0.0 kB/s 2023-10-09T15:35:38.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.171 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2549 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3815e-05 s, 0.0 kB/s 2023-10-09T15:35:38.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2550 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3717e-05 s, 0.0 kB/s 2023-10-09T15:35:38.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.283 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2551 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-09T15:35:38.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2552 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5272e-05 s, 0.0 kB/s 2023-10-09T15:35:38.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.396 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2553 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.452 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.463e-05 s, 0.0 kB/s 2023-10-09T15:35:38.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.453 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2554 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.392e-05 s, 0.0 kB/s 2023-10-09T15:35:38.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.509 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2555 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.566 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3419e-05 s, 0.0 kB/s 2023-10-09T15:35:38.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.566 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2556 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.622 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1799e-05 s, 0.0 kB/s 2023-10-09T15:35:38.622 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.622 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2557 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3345e-05 s, 0.0 kB/s 2023-10-09T15:35:38.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.679 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2558 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.735 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.735 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.735 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3962e-05 s, 0.0 kB/s 2023-10-09T15:35:38.736 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.736 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2559 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.793 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3487e-05 s, 0.0 kB/s 2023-10-09T15:35:38.793 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.794 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2560 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.850 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.850 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5617e-05 s, 0.0 kB/s 2023-10-09T15:35:38.850 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.850 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2561 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.905 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.906 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.131e-05 s, 0.0 kB/s 2023-10-09T15:35:38.906 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.906 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2562 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:38.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:38.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:38.962 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2811e-05 s, 0.0 kB/s 2023-10-09T15:35:38.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:38.962 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2563 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.018 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3446e-05 s, 0.0 kB/s 2023-10-09T15:35:39.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.019 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2564 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5185e-05 s, 0.0 kB/s 2023-10-09T15:35:39.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2565 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.132 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2317e-05 s, 0.0 kB/s 2023-10-09T15:35:39.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2566 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.188 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.188 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.188 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2224e-05 s, 0.0 kB/s 2023-10-09T15:35:39.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2567 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.244 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.244 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.244 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1677e-05 s, 0.0 kB/s 2023-10-09T15:35:39.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2568 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.300 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.300 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.300 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6478e-05 s, 0.0 kB/s 2023-10-09T15:35:39.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.301 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2569 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6933e-05 s, 0.0 kB/s 2023-10-09T15:35:39.358 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2570 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2647e-05 s, 0.0 kB/s 2023-10-09T15:35:39.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.414 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2571 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.469 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1226e-05 s, 0.0 kB/s 2023-10-09T15:35:39.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2572 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.525 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2363e-05 s, 0.0 kB/s 2023-10-09T15:35:39.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2573 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.581 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0402e-05 s, 0.0 kB/s 2023-10-09T15:35:39.582 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.582 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2574 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.637 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1368e-05 s, 0.0 kB/s 2023-10-09T15:35:39.638 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.638 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2575 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.693 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.694 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3127e-05 s, 0.0 kB/s 2023-10-09T15:35:39.694 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.694 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2576 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.749 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.750 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2218e-05 s, 0.0 kB/s 2023-10-09T15:35:39.750 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.750 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2577 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.806 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0105e-05 s, 0.0 kB/s 2023-10-09T15:35:39.806 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.806 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2578 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.8479e-05 s, 0.0 kB/s 2023-10-09T15:35:39.864 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.864 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2579 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.920 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2435e-05 s, 0.0 kB/s 2023-10-09T15:35:39.920 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.920 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2580 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:39.975 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.138e-05 s, 0.0 kB/s 2023-10-09T15:35:39.975 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:39.976 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2581 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2431e-05 s, 0.0 kB/s 2023-10-09T15:35:40.032 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.032 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2582 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0371e-05 s, 0.0 kB/s 2023-10-09T15:35:40.088 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.088 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2583 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.144 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3481e-05 s, 0.0 kB/s 2023-10-09T15:35:40.144 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.144 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2584 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.200 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3548e-05 s, 0.0 kB/s 2023-10-09T15:35:40.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.200 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2585 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1574e-05 s, 0.0 kB/s 2023-10-09T15:35:40.256 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.256 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2586 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.311 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2779e-05 s, 0.0 kB/s 2023-10-09T15:35:40.312 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.312 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2587 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.368 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3383e-05 s, 0.0 kB/s 2023-10-09T15:35:40.368 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.368 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2588 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.424 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.424 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0922e-05 s, 0.0 kB/s 2023-10-09T15:35:40.424 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.424 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2589 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.480 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2964e-05 s, 0.0 kB/s 2023-10-09T15:35:40.480 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.480 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2590 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1926e-05 s, 0.0 kB/s 2023-10-09T15:35:40.536 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.536 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2591 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.592 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.592 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3637e-05 s, 0.0 kB/s 2023-10-09T15:35:40.592 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.592 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2592 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.648 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.648 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0641e-05 s, 0.0 kB/s 2023-10-09T15:35:40.648 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.648 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2593 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.703 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1246e-05 s, 0.0 kB/s 2023-10-09T15:35:40.704 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.704 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2594 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.759 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.759 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.103e-05 s, 0.0 kB/s 2023-10-09T15:35:40.760 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.760 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2595 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.816 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.816 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1863e-05 s, 0.0 kB/s 2023-10-09T15:35:40.816 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.816 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2596 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.871 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.871 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.871 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2355e-05 s, 0.0 kB/s 2023-10-09T15:35:40.872 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.872 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2597 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.927 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.928 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4397e-05 s, 0.0 kB/s 2023-10-09T15:35:40.928 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.928 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2598 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:40.982 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:40.983 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:40.983 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1239e-05 s, 0.0 kB/s 2023-10-09T15:35:40.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:40.984 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2599 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.039 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4849e-05 s, 0.0 kB/s 2023-10-09T15:35:41.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.040 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2600 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.097 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2423e-05 s, 0.0 kB/s 2023-10-09T15:35:41.097 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.097 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2601 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.152 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3802e-05 s, 0.0 kB/s 2023-10-09T15:35:41.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.153 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2602 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.208 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.208 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.208 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0268e-05 s, 0.0 kB/s 2023-10-09T15:35:41.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.209 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2603 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.265 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.265 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4592e-05 s, 0.0 kB/s 2023-10-09T15:35:41.265 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.265 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2604 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.320 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.320 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.320 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3469e-05 s, 0.0 kB/s 2023-10-09T15:35:41.321 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.321 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2605 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.376 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.376 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.376 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1622e-05 s, 0.0 kB/s 2023-10-09T15:35:41.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.377 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2606 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.432 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4272e-05 s, 0.0 kB/s 2023-10-09T15:35:41.433 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.433 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2607 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.488 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.489 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1419e-05 s, 0.0 kB/s 2023-10-09T15:35:41.489 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.489 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2608 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.544 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2822e-05 s, 0.0 kB/s 2023-10-09T15:35:41.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.545 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2609 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.600 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.600 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.600 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2097e-05 s, 0.0 kB/s 2023-10-09T15:35:41.601 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.601 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2610 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.656 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.656 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.657 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.072e-05 s, 0.0 kB/s 2023-10-09T15:35:41.657 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.657 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2611 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.712 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.713 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2991e-05 s, 0.0 kB/s 2023-10-09T15:35:41.713 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.713 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2612 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.768 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.769 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1445e-05 s, 0.0 kB/s 2023-10-09T15:35:41.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.769 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2613 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.825 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.825 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.825 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.2082e-05 s, 0.0 kB/s 2023-10-09T15:35:41.825 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.825 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2614 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2534e-05 s, 0.0 kB/s 2023-10-09T15:35:41.881 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.881 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2615 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.936 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.937 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3132e-05 s, 0.0 kB/s 2023-10-09T15:35:41.937 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.937 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2616 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:41.992 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:41.992 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:41.993 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1823e-05 s, 0.0 kB/s 2023-10-09T15:35:41.993 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:41.993 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2617 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4247e-05 s, 0.0 kB/s 2023-10-09T15:35:42.049 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.049 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2618 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.104 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.105 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9704e-05 s, 0.0 kB/s 2023-10-09T15:35:42.105 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.105 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2619 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.160 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.161 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0479e-05 s, 0.0 kB/s 2023-10-09T15:35:42.161 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.161 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2620 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.216 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.217 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1355e-05 s, 0.0 kB/s 2023-10-09T15:35:42.217 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.217 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2621 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3559e-05 s, 0.0 kB/s 2023-10-09T15:35:42.273 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.273 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2622 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.328 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.329 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.329 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3315e-05 s, 0.0 kB/s 2023-10-09T15:35:42.329 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.329 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2623 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2901e-05 s, 0.0 kB/s 2023-10-09T15:35:42.385 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.385 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2624 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.440 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.441 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5319e-05 s, 0.0 kB/s 2023-10-09T15:35:42.441 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.441 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2625 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.496 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.299e-05 s, 0.0 kB/s 2023-10-09T15:35:42.497 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.497 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2626 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.553 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.553 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3171e-05 s, 0.0 kB/s 2023-10-09T15:35:42.554 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.554 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2627 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.610 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.610 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8743e-05 s, 0.0 kB/s 2023-10-09T15:35:42.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.610 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2628 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.666 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.666 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.445e-05 s, 0.0 kB/s 2023-10-09T15:35:42.666 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.666 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2629 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.722 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5394e-05 s, 0.0 kB/s 2023-10-09T15:35:42.722 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.722 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2630 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.777 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3195e-05 s, 0.0 kB/s 2023-10-09T15:35:42.778 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.778 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2631 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6626e-05 s, 0.0 kB/s 2023-10-09T15:35:42.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2632 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.891 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.185e-05 s, 0.0 kB/s 2023-10-09T15:35:42.892 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.892 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2633 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:42.947 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3894e-05 s, 0.0 kB/s 2023-10-09T15:35:42.948 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:42.948 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2634 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.003 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.004 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.004 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0763e-05 s, 0.0 kB/s 2023-10-09T15:35:43.004 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.004 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2635 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.060 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.060 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3827e-05 s, 0.0 kB/s 2023-10-09T15:35:43.060 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.060 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2636 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.115 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.116 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1414e-05 s, 0.0 kB/s 2023-10-09T15:35:43.116 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.116 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2637 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.172 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.172 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4013e-05 s, 0.0 kB/s 2023-10-09T15:35:43.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.172 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2638 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1263e-05 s, 0.0 kB/s 2023-10-09T15:35:43.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.228 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2639 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.284 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.284 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5822e-05 s, 0.0 kB/s 2023-10-09T15:35:43.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.285 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2640 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.340 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.341 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.341 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2742e-05 s, 0.0 kB/s 2023-10-09T15:35:43.341 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.341 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2641 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.397 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.397 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.55e-05 s, 0.0 kB/s 2023-10-09T15:35:43.397 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.397 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2642 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.452 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.453 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2988e-05 s, 0.0 kB/s 2023-10-09T15:35:43.453 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.453 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2643 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.510 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5649e-05 s, 0.0 kB/s 2023-10-09T15:35:43.510 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.510 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2644 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3878e-05 s, 0.0 kB/s 2023-10-09T15:35:43.566 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.566 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2645 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.622 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.623 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.258e-05 s, 0.0 kB/s 2023-10-09T15:35:43.623 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2646 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.678 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.679 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2342e-05 s, 0.0 kB/s 2023-10-09T15:35:43.679 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.679 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2647 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.734 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.735 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9427e-05 s, 0.0 kB/s 2023-10-09T15:35:43.735 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.735 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2648 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.791 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0575e-05 s, 0.0 kB/s 2023-10-09T15:35:43.792 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.792 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2649 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.848 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0617e-05 s, 0.0 kB/s 2023-10-09T15:35:43.848 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.848 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2650 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.904 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.904 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.904 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3278e-05 s, 0.0 kB/s 2023-10-09T15:35:43.905 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.905 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2651 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:43.961 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:43.962 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:43.962 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5038e-05 s, 0.0 kB/s 2023-10-09T15:35:43.962 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:43.962 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2652 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3908e-05 s, 0.0 kB/s 2023-10-09T15:35:44.018 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.018 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2653 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.074 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.075 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5063e-05 s, 0.0 kB/s 2023-10-09T15:35:44.075 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.075 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2654 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.174 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.174 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.174 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.4439e-05 s, 0.0 kB/s 2023-10-09T15:35:44.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2655 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.191 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2554e-05 s, 0.0 kB/s 2023-10-09T15:35:44.191 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.191 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2656 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.247 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0047e-05 s, 0.0 kB/s 2023-10-09T15:35:44.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.248 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2657 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.305 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2678e-05 s, 0.0 kB/s 2023-10-09T15:35:44.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.306 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2658 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.363 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.554e-05 s, 0.0 kB/s 2023-10-09T15:35:44.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.363 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2659 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.418 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.419 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-09T15:35:44.419 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.419 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2660 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.475 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0694e-05 s, 0.0 kB/s 2023-10-09T15:35:44.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.476 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2661 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.530 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3347e-05 s, 0.0 kB/s 2023-10-09T15:35:44.531 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.531 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2662 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.586 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.586 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7052e-05 s, 0.0 kB/s 2023-10-09T15:35:44.587 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.587 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2663 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.642 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.642 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.642 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0492e-05 s, 0.0 kB/s 2023-10-09T15:35:44.643 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.643 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2664 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.700 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0659e-05 s, 0.0 kB/s 2023-10-09T15:35:44.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.700 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2665 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.755 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.756 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4814e-05 s, 0.0 kB/s 2023-10-09T15:35:44.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.756 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2666 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.812 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0463e-05 s, 0.0 kB/s 2023-10-09T15:35:44.812 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2667 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5198e-05 s, 0.0 kB/s 2023-10-09T15:35:44.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2668 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.923 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.349e-05 s, 0.0 kB/s 2023-10-09T15:35:44.923 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2669 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:44.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:44.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:44.979 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3409e-05 s, 0.0 kB/s 2023-10-09T15:35:44.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:44.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2670 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7214e-05 s, 0.0 kB/s 2023-10-09T15:35:45.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2671 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.3087e-05 s, 0.0 kB/s 2023-10-09T15:35:45.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.092 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2672 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.148 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.148 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5609e-05 s, 0.0 kB/s 2023-10-09T15:35:45.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2673 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.204 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.204 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2922e-05 s, 0.0 kB/s 2023-10-09T15:35:45.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.204 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2674 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.259 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3595e-05 s, 0.0 kB/s 2023-10-09T15:35:45.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.260 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2675 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.316 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.316 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0017e-05 s, 0.0 kB/s 2023-10-09T15:35:45.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.316 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2676 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.372 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3893e-05 s, 0.0 kB/s 2023-10-09T15:35:45.372 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.372 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2677 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.427 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0951e-05 s, 0.0 kB/s 2023-10-09T15:35:45.428 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.428 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2678 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.483 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2362e-05 s, 0.0 kB/s 2023-10-09T15:35:45.484 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.484 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2679 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6526e-05 s, 0.0 kB/s 2023-10-09T15:35:45.540 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.540 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2680 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.595 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.596 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2576e-05 s, 0.0 kB/s 2023-10-09T15:35:45.596 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.596 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2681 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.652 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5087e-05 s, 0.0 kB/s 2023-10-09T15:35:45.652 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.652 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2682 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.707 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1738e-05 s, 0.0 kB/s 2023-10-09T15:35:45.708 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.708 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2683 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.764 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.764 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.166e-05 s, 0.0 kB/s 2023-10-09T15:35:45.764 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.764 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2684 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.819 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.378e-05 s, 0.0 kB/s 2023-10-09T15:35:45.820 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.820 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2685 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.876 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3837e-05 s, 0.0 kB/s 2023-10-09T15:35:45.876 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.876 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2686 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.931 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2402e-05 s, 0.0 kB/s 2023-10-09T15:35:45.932 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.932 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2687 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:45.987 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.153e-05 s, 0.0 kB/s 2023-10-09T15:35:45.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:45.988 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2688 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.043 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0213e-05 s, 0.0 kB/s 2023-10-09T15:35:46.044 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.044 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2689 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.099 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0475e-05 s, 0.0 kB/s 2023-10-09T15:35:46.100 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2690 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.155 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.155 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.109e-05 s, 0.0 kB/s 2023-10-09T15:35:46.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2691 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.211 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.169e-05 s, 0.0 kB/s 2023-10-09T15:35:46.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2692 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.268 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3175e-05 s, 0.0 kB/s 2023-10-09T15:35:46.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2693 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4253e-05 s, 0.0 kB/s 2023-10-09T15:35:46.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2694 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9274e-05 s, 0.0 kB/s 2023-10-09T15:35:46.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.381 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2695 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.436 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.359e-05 s, 0.0 kB/s 2023-10-09T15:35:46.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2696 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.493 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.31e-05 s, 0.0 kB/s 2023-10-09T15:35:46.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2697 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.549 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3553e-05 s, 0.0 kB/s 2023-10-09T15:35:46.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2698 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.604 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.249e-05 s, 0.0 kB/s 2023-10-09T15:35:46.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2699 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.661 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.058e-05 s, 0.0 kB/s 2023-10-09T15:35:46.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.661 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2700 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.717 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0602e-05 s, 0.0 kB/s 2023-10-09T15:35:46.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.717 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2701 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3068e-05 s, 0.0 kB/s 2023-10-09T15:35:46.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.773 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2702 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.830 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.830 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.830 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4574e-05 s, 0.0 kB/s 2023-10-09T15:35:46.830 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.830 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2703 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.886 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1701e-05 s, 0.0 kB/s 2023-10-09T15:35:46.886 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.887 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2704 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.942 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.942 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4343e-05 s, 0.0 kB/s 2023-10-09T15:35:46.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:46.943 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2705 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:46.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:46.999 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:46.999 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4727e-05 s, 0.0 kB/s 2023-10-09T15:35:47.000 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.000 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2706 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.057 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0298e-05 s, 0.0 kB/s 2023-10-09T15:35:47.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.058 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2707 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.114 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.114 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3102e-05 s, 0.0 kB/s 2023-10-09T15:35:47.115 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.115 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2708 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.171 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.171 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4927e-05 s, 0.0 kB/s 2023-10-09T15:35:47.172 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.172 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2709 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1573e-05 s, 0.0 kB/s 2023-10-09T15:35:47.228 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.228 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2710 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4038e-05 s, 0.0 kB/s 2023-10-09T15:35:47.284 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.284 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2711 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-09T15:35:47.340 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.340 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2712 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.396 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3405e-05 s, 0.0 kB/s 2023-10-09T15:35:47.396 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.396 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2713 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.451 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3502e-05 s, 0.0 kB/s 2023-10-09T15:35:47.452 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.452 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2714 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.507 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.507 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2456e-05 s, 0.0 kB/s 2023-10-09T15:35:47.508 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.508 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2715 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5561e-05 s, 0.0 kB/s 2023-10-09T15:35:47.564 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.564 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2716 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.619 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.620 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1224e-05 s, 0.0 kB/s 2023-10-09T15:35:47.620 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.620 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2717 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.676 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1608e-05 s, 0.0 kB/s 2023-10-09T15:35:47.676 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.676 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2718 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.731 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.732 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.732 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2371e-05 s, 0.0 kB/s 2023-10-09T15:35:47.732 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.732 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2719 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.788 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.788 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0246e-05 s, 0.0 kB/s 2023-10-09T15:35:47.788 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.788 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2720 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.843 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.844 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2527e-05 s, 0.0 kB/s 2023-10-09T15:35:47.844 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.844 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2721 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.900 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.9902e-05 s, 0.0 kB/s 2023-10-09T15:35:47.900 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.900 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2722 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:47.956 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3194e-05 s, 0.0 kB/s 2023-10-09T15:35:47.956 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:47.957 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2723 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.011 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.011 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.011 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0744e-05 s, 0.0 kB/s 2023-10-09T15:35:48.012 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.012 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2724 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.067 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4862e-05 s, 0.0 kB/s 2023-10-09T15:35:48.068 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.068 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2725 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.123 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2343e-05 s, 0.0 kB/s 2023-10-09T15:35:48.124 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.124 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2726 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.179 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8941e-05 s, 0.0 kB/s 2023-10-09T15:35:48.180 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.180 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2727 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.235 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1538e-05 s, 0.0 kB/s 2023-10-09T15:35:48.236 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.236 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2728 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.291 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1575e-05 s, 0.0 kB/s 2023-10-09T15:35:48.291 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.291 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2729 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.347 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.347 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.348 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2714e-05 s, 0.0 kB/s 2023-10-09T15:35:48.348 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.348 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2730 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.403 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5808e-05 s, 0.0 kB/s 2023-10-09T15:35:48.404 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.404 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2731 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.460 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.461 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.461 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3157e-05 s, 0.0 kB/s 2023-10-09T15:35:48.461 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.461 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2732 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.516 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2876e-05 s, 0.0 kB/s 2023-10-09T15:35:48.517 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.517 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2733 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.572 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3721e-05 s, 0.0 kB/s 2023-10-09T15:35:48.573 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.573 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2734 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.08e-05 s, 0.0 kB/s 2023-10-09T15:35:48.629 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.629 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2735 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.684 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.684 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.684 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3625e-05 s, 0.0 kB/s 2023-10-09T15:35:48.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.684 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2736 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.741 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.741 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1029e-05 s, 0.0 kB/s 2023-10-09T15:35:48.741 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.741 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2737 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.796 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0972e-05 s, 0.0 kB/s 2023-10-09T15:35:48.797 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.797 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2738 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.852 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.852 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.853 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.423e-05 s, 0.0 kB/s 2023-10-09T15:35:48.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.853 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2739 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.909 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.909 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.336e-05 s, 0.0 kB/s 2023-10-09T15:35:48.909 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.909 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2740 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:48.964 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.164e-05 s, 0.0 kB/s 2023-10-09T15:35:48.965 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:48.965 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2741 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.020 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1064e-05 s, 0.0 kB/s 2023-10-09T15:35:49.021 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.021 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2742 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.077 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3082e-05 s, 0.0 kB/s 2023-10-09T15:35:49.077 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.077 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2743 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.133 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.133 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.317e-05 s, 0.0 kB/s 2023-10-09T15:35:49.133 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.133 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2744 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.189 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.189 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2067e-05 s, 0.0 kB/s 2023-10-09T15:35:49.189 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.189 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2745 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.244 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4771e-05 s, 0.0 kB/s 2023-10-09T15:35:49.245 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.245 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2746 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.301 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.301 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5121e-05 s, 0.0 kB/s 2023-10-09T15:35:49.301 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.301 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2747 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.356 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-09T15:35:49.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.357 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2748 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.414 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.414 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6347e-05 s, 0.0 kB/s 2023-10-09T15:35:49.414 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.414 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2749 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.470 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1622e-05 s, 0.0 kB/s 2023-10-09T15:35:49.470 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.470 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2750 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.526 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.526 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.526 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5013e-05 s, 0.0 kB/s 2023-10-09T15:35:49.526 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.526 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2751 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.581 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.582 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4132e-05 s, 0.0 kB/s 2023-10-09T15:35:49.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.583 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2752 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4437e-05 s, 0.0 kB/s 2023-10-09T15:35:49.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.639 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2753 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.694 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.695 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1332e-05 s, 0.0 kB/s 2023-10-09T15:35:49.695 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.695 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2754 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3067e-05 s, 0.0 kB/s 2023-10-09T15:35:49.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.752 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2755 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.806 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.807 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.807 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.334e-05 s, 0.0 kB/s 2023-10-09T15:35:49.807 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.807 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2756 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.862 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.862 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3339e-05 s, 0.0 kB/s 2023-10-09T15:35:49.863 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.863 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2757 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.919 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.441e-05 s, 0.0 kB/s 2023-10-09T15:35:49.919 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.919 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2758 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:49.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:49.974 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:49.974 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0399e-05 s, 0.0 kB/s 2023-10-09T15:35:49.974 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:49.975 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2759 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.030 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.031 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0691e-05 s, 0.0 kB/s 2023-10-09T15:35:50.031 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.031 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2760 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.086 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.086 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4659e-05 s, 0.0 kB/s 2023-10-09T15:35:50.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2761 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.142 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.142 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1635e-05 s, 0.0 kB/s 2023-10-09T15:35:50.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2762 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.198 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2727e-05 s, 0.0 kB/s 2023-10-09T15:35:50.199 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.199 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2763 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.254 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1439e-05 s, 0.0 kB/s 2023-10-09T15:35:50.255 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.255 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2764 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.310 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.311 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2679e-05 s, 0.0 kB/s 2023-10-09T15:35:50.311 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.311 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2765 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.367 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.367 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3435e-05 s, 0.0 kB/s 2023-10-09T15:35:50.367 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.368 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2766 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4653e-05 s, 0.0 kB/s 2023-10-09T15:35:50.423 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.423 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2767 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.479 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.316e-05 s, 0.0 kB/s 2023-10-09T15:35:50.479 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.479 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2768 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.534 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.535 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.535 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.402e-05 s, 0.0 kB/s 2023-10-09T15:35:50.535 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.535 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2769 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.591 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.591 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2388e-05 s, 0.0 kB/s 2023-10-09T15:35:50.591 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.591 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2770 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.647 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.016e-05 s, 0.0 kB/s 2023-10-09T15:35:50.647 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.647 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2771 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.703 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3705e-05 s, 0.0 kB/s 2023-10-09T15:35:50.703 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.703 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2772 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-09T15:35:50.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.759 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2773 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4911e-05 s, 0.0 kB/s 2023-10-09T15:35:50.815 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.815 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2774 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.870 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.871 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3242e-05 s, 0.0 kB/s 2023-10-09T15:35:50.871 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.871 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2775 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.927 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2414e-05 s, 0.0 kB/s 2023-10-09T15:35:50.927 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.928 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2776 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:50.984 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-09T15:35:50.984 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:50.984 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2777 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.040 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5107e-05 s, 0.0 kB/s 2023-10-09T15:35:51.040 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.040 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2778 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.096 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.096 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5567e-05 s, 0.0 kB/s 2023-10-09T15:35:51.096 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.096 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2779 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2899e-05 s, 0.0 kB/s 2023-10-09T15:35:51.153 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.153 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2780 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3693e-05 s, 0.0 kB/s 2023-10-09T15:35:51.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2781 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.269 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.269 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4761e-05 s, 0.0 kB/s 2023-10-09T15:35:51.269 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.270 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2782 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.326 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.326 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.326 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3135e-05 s, 0.0 kB/s 2023-10-09T15:35:51.326 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.327 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2783 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.382 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.383 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2261e-05 s, 0.0 kB/s 2023-10-09T15:35:51.383 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.383 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2784 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.439 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.439 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3125e-05 s, 0.0 kB/s 2023-10-09T15:35:51.439 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.439 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2785 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.495 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.495 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4687e-05 s, 0.0 kB/s 2023-10-09T15:35:51.495 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.495 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2786 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.552 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.552 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1143e-05 s, 0.0 kB/s 2023-10-09T15:35:51.552 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.553 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2787 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.229e-05 s, 0.0 kB/s 2023-10-09T15:35:51.609 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.609 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2788 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.665 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4674e-05 s, 0.0 kB/s 2023-10-09T15:35:51.665 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.665 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2789 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.720 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.720 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0522e-05 s, 0.0 kB/s 2023-10-09T15:35:51.720 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.721 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2790 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.776 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.777 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.777 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4379e-05 s, 0.0 kB/s 2023-10-09T15:35:51.777 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.777 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2791 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.832 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2358e-05 s, 0.0 kB/s 2023-10-09T15:35:51.833 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.833 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2792 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.888 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.889 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0417e-05 s, 0.0 kB/s 2023-10-09T15:35:51.889 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.889 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2793 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:51.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:51.945 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:51.945 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4054e-05 s, 0.0 kB/s 2023-10-09T15:35:51.945 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:51.945 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2794 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.001 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.001 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2282e-05 s, 0.0 kB/s 2023-10-09T15:35:52.002 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.002 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2795 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.057 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.058 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2201e-05 s, 0.0 kB/s 2023-10-09T15:35:52.058 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.058 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2796 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.113 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.113 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4509e-05 s, 0.0 kB/s 2023-10-09T15:35:52.114 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.114 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2797 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.169 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.169 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0369e-05 s, 0.0 kB/s 2023-10-09T15:35:52.170 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.170 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2798 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.226 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.227 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.227 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.319e-05 s, 0.0 kB/s 2023-10-09T15:35:52.227 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.227 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2799 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6092e-05 s, 0.0 kB/s 2023-10-09T15:35:52.283 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.283 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2800 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.339 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.339 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3035e-05 s, 0.0 kB/s 2023-10-09T15:35:52.339 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.339 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2801 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.394 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.395 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1947e-05 s, 0.0 kB/s 2023-10-09T15:35:52.395 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.395 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2802 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.450 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.451 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.451 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1988e-05 s, 0.0 kB/s 2023-10-09T15:35:52.451 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.451 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2803 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.506 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.506 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.068e-05 s, 0.0 kB/s 2023-10-09T15:35:52.507 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.507 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2804 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.562 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.563 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1543e-05 s, 0.0 kB/s 2023-10-09T15:35:52.563 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.563 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2805 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.619 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1107e-05 s, 0.0 kB/s 2023-10-09T15:35:52.619 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.619 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2806 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.674 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.675 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2909e-05 s, 0.0 kB/s 2023-10-09T15:35:52.675 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.675 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2807 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.730 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.271e-05 s, 0.0 kB/s 2023-10-09T15:35:52.730 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.731 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2808 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.786 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.787 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.787 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0111e-05 s, 0.0 kB/s 2023-10-09T15:35:52.787 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.787 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2809 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.842 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.842 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.843 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2887e-05 s, 0.0 kB/s 2023-10-09T15:35:52.843 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.843 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2810 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.898 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.899 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0005e-05 s, 0.0 kB/s 2023-10-09T15:35:52.899 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.899 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2811 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:52.957 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2694e-05 s, 0.0 kB/s 2023-10-09T15:35:52.957 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:52.958 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2812 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.014 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4786e-05 s, 0.0 kB/s 2023-10-09T15:35:53.014 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.014 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2813 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.12e-05 s, 0.0 kB/s 2023-10-09T15:35:53.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.070 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2814 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.125 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.126 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.126 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2097e-05 s, 0.0 kB/s 2023-10-09T15:35:53.126 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.126 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2815 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.181 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.182 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.182 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5425e-05 s, 0.0 kB/s 2023-10-09T15:35:53.182 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.182 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2816 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.237 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.058e-05 s, 0.0 kB/s 2023-10-09T15:35:53.237 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.238 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2817 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.293 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.294 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.294 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3678e-05 s, 0.0 kB/s 2023-10-09T15:35:53.294 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.294 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2818 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4933e-05 s, 0.0 kB/s 2023-10-09T15:35:53.351 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.351 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2819 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.406 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.407 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3792e-05 s, 0.0 kB/s 2023-10-09T15:35:53.407 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.407 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2820 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.463 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.463 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2455e-05 s, 0.0 kB/s 2023-10-09T15:35:53.463 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.463 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2821 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.518 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.518 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.518 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.306e-05 s, 0.0 kB/s 2023-10-09T15:35:53.519 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.519 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2822 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.574 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.575 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2192e-05 s, 0.0 kB/s 2023-10-09T15:35:53.575 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.575 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2823 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.630 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.631 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2965e-05 s, 0.0 kB/s 2023-10-09T15:35:53.631 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.631 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2824 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.687 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.687 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1582e-05 s, 0.0 kB/s 2023-10-09T15:35:53.687 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.687 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2825 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.743 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0734e-05 s, 0.0 kB/s 2023-10-09T15:35:53.743 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.743 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2826 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.799 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.799 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2228e-05 s, 0.0 kB/s 2023-10-09T15:35:53.799 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.799 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2827 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.855 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.855 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1003e-05 s, 0.0 kB/s 2023-10-09T15:35:53.855 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.855 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2828 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.910 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.911 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.911 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-09T15:35:53.911 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.911 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2829 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:53.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:53.967 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:53.967 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4382e-05 s, 0.0 kB/s 2023-10-09T15:35:53.967 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:53.968 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2830 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2639e-05 s, 0.0 kB/s 2023-10-09T15:35:54.024 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.024 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2831 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.079 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.080 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.080 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1942e-05 s, 0.0 kB/s 2023-10-09T15:35:54.080 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2832 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.135 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.152e-05 s, 0.0 kB/s 2023-10-09T15:35:54.136 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.136 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2833 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.191 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.192 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.297e-05 s, 0.0 kB/s 2023-10-09T15:35:54.192 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.192 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2834 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.248 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.248 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.248 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.177e-05 s, 0.0 kB/s 2023-10-09T15:35:54.248 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.248 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2835 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.305 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.305 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2654e-05 s, 0.0 kB/s 2023-10-09T15:35:54.306 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.306 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2836 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.362 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3253e-05 s, 0.0 kB/s 2023-10-09T15:35:54.363 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.363 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2837 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.419 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.419 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4956e-05 s, 0.0 kB/s 2023-10-09T15:35:54.420 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.420 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2838 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.476 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1276e-05 s, 0.0 kB/s 2023-10-09T15:35:54.476 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.476 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2839 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.531 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.532 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-09T15:35:54.532 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.532 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2840 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.587 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.587 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.962e-05 s, 0.0 kB/s 2023-10-09T15:35:54.588 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.588 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2841 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.643 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9688e-05 s, 0.0 kB/s 2023-10-09T15:35:54.644 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.644 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2842 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.699 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 2.9672e-05 s, 0.0 kB/s 2023-10-09T15:35:54.700 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.700 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2843 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.756 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.756 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2969e-05 s, 0.0 kB/s 2023-10-09T15:35:54.756 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.756 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2844 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.811 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.811 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2922e-05 s, 0.0 kB/s 2023-10-09T15:35:54.811 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.812 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2845 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2363e-05 s, 0.0 kB/s 2023-10-09T15:35:54.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2846 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.924 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3879e-05 s, 0.0 kB/s 2023-10-09T15:35:54.924 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.924 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2847 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:54.979 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:54.980 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:54.980 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3727e-05 s, 0.0 kB/s 2023-10-09T15:35:54.980 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:54.980 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2848 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1926e-05 s, 0.0 kB/s 2023-10-09T15:35:55.036 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.036 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2849 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.091 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.092 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1288e-05 s, 0.0 kB/s 2023-10-09T15:35:55.092 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.092 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2850 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.147 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.147 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3424e-05 s, 0.0 kB/s 2023-10-09T15:35:55.148 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.148 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2851 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.203 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1877e-05 s, 0.0 kB/s 2023-10-09T15:35:55.204 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.204 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2852 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.259 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.260 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3354e-05 s, 0.0 kB/s 2023-10-09T15:35:55.260 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.260 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2853 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.315 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.316 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7529e-05 s, 0.0 kB/s 2023-10-09T15:35:55.316 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.316 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2854 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.372 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.373 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.373 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.105e-05 s, 0.0 kB/s 2023-10-09T15:35:55.373 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.373 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2855 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.428 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.428 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2178e-05 s, 0.0 kB/s 2023-10-09T15:35:55.429 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.429 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2856 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.484 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1449e-05 s, 0.0 kB/s 2023-10-09T15:35:55.485 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.485 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2857 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.541 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.618 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.618 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5808e-05 s, 0.0 kB/s 2023-10-09T15:35:55.618 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.618 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2858 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.634 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.634 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.634 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3167e-05 s, 0.0 kB/s 2023-10-09T15:35:55.635 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.635 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2859 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.690 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2995e-05 s, 0.0 kB/s 2023-10-09T15:35:55.691 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.691 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2860 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.746 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.747 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.747 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1778e-05 s, 0.0 kB/s 2023-10-09T15:35:55.747 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.747 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2861 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.802 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.803 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0355e-05 s, 0.0 kB/s 2023-10-09T15:35:55.803 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.803 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2862 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.859 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3169e-05 s, 0.0 kB/s 2023-10-09T15:35:55.859 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.859 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2863 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.915 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3189e-05 s, 0.0 kB/s 2023-10-09T15:35:55.915 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.915 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2864 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:55.970 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:55.970 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:55.970 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1434e-05 s, 0.0 kB/s 2023-10-09T15:35:55.971 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:55.971 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2865 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.027 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2285e-05 s, 0.0 kB/s 2023-10-09T15:35:56.028 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.028 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2866 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.083 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1018e-05 s, 0.0 kB/s 2023-10-09T15:35:56.084 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.084 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2867 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.140 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.141 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3931e-05 s, 0.0 kB/s 2023-10-09T15:35:56.141 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.141 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2868 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.196 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3255e-05 s, 0.0 kB/s 2023-10-09T15:35:56.197 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.197 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2869 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.253 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1934e-05 s, 0.0 kB/s 2023-10-09T15:35:56.253 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.253 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2870 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.308 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.309 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5414e-05 s, 0.0 kB/s 2023-10-09T15:35:56.309 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.309 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2871 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.365 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2019e-05 s, 0.0 kB/s 2023-10-09T15:35:56.365 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.365 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2872 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.420 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.421 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.206e-05 s, 0.0 kB/s 2023-10-09T15:35:56.421 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.421 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2873 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.476 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5182e-05 s, 0.0 kB/s 2023-10-09T15:35:56.477 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.477 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2874 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.532 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.532 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.532 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1466e-05 s, 0.0 kB/s 2023-10-09T15:35:56.533 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.533 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2875 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2646e-05 s, 0.0 kB/s 2023-10-09T15:35:56.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.590 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2876 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.644 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.645 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3638e-05 s, 0.0 kB/s 2023-10-09T15:35:56.645 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.645 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2877 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.700 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.701 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.183e-05 s, 0.0 kB/s 2023-10-09T15:35:56.701 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.701 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2878 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5256e-05 s, 0.0 kB/s 2023-10-09T15:35:56.758 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.758 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2879 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.812 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.813 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4684e-05 s, 0.0 kB/s 2023-10-09T15:35:56.813 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.813 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2880 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.867 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.868 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.868 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0168e-05 s, 0.0 kB/s 2023-10-09T15:35:56.868 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.868 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2881 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.924 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.925 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3019e-05 s, 0.0 kB/s 2023-10-09T15:35:56.926 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.926 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2882 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:56.981 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2867e-05 s, 0.0 kB/s 2023-10-09T15:35:56.982 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:56.982 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2883 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.038 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.039 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.039 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.26e-05 s, 0.0 kB/s 2023-10-09T15:35:57.039 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.039 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2884 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.094 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3473e-05 s, 0.0 kB/s 2023-10-09T15:35:57.095 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.095 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2885 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.151 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3015e-05 s, 0.0 kB/s 2023-10-09T15:35:57.151 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.152 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2886 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.207 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.208 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.208 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6092e-05 s, 0.0 kB/s 2023-10-09T15:35:57.208 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.208 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2887 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.263 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.263 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.263 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3486e-05 s, 0.0 kB/s 2023-10-09T15:35:57.264 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.264 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2888 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.319 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.320 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.320 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4749e-05 s, 0.0 kB/s 2023-10-09T15:35:57.320 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.320 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2889 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.376 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.376 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.376 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1522e-05 s, 0.0 kB/s 2023-10-09T15:35:57.376 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.376 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2890 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.431 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2643e-05 s, 0.0 kB/s 2023-10-09T15:35:57.432 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.432 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2891 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.487 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.446e-05 s, 0.0 kB/s 2023-10-09T15:35:57.488 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.488 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2892 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.544 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.544 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4357e-05 s, 0.0 kB/s 2023-10-09T15:35:57.545 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.545 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2893 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.599 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.599 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.600 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4916e-05 s, 0.0 kB/s 2023-10-09T15:35:57.600 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.600 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2894 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.655 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.655 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.655 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4116e-05 s, 0.0 kB/s 2023-10-09T15:35:57.656 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.656 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2895 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.711 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.711 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.711 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3801e-05 s, 0.0 kB/s 2023-10-09T15:35:57.712 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.712 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2896 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.769 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.769 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.7858e-05 s, 0.0 kB/s 2023-10-09T15:35:57.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.769 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2897 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.826 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3309e-05 s, 0.0 kB/s 2023-10-09T15:35:57.827 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.827 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2898 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.881 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1324e-05 s, 0.0 kB/s 2023-10-09T15:35:57.882 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.882 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2899 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.938 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2491e-05 s, 0.0 kB/s 2023-10-09T15:35:57.939 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.939 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2900 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:57.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:57.994 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:57.994 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5171e-05 s, 0.0 kB/s 2023-10-09T15:35:57.995 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:57.995 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2901 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.051 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8201e-05 s, 0.0 kB/s 2023-10-09T15:35:58.051 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.051 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2902 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.106 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.107 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.107 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.107e-05 s, 0.0 kB/s 2023-10-09T15:35:58.107 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.107 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2903 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.162 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0426e-05 s, 0.0 kB/s 2023-10-09T15:35:58.163 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.163 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2904 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.219 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.219 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4149e-05 s, 0.0 kB/s 2023-10-09T15:35:58.219 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.219 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2905 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.274 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.274 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.274 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6209e-05 s, 0.0 kB/s 2023-10-09T15:35:58.275 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.275 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2906 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.331 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.331 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2571e-05 s, 0.0 kB/s 2023-10-09T15:35:58.331 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.331 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2907 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.388 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.389 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1475e-05 s, 0.0 kB/s 2023-10-09T15:35:58.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.389 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2908 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.443 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.444 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.552e-05 s, 0.0 kB/s 2023-10-09T15:35:58.444 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.444 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2909 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.500 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.4457e-05 s, 0.0 kB/s 2023-10-09T15:35:58.500 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.500 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2910 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.556 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3285e-05 s, 0.0 kB/s 2023-10-09T15:35:58.556 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.557 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2911 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.611 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.612 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.612 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1805e-05 s, 0.0 kB/s 2023-10-09T15:35:58.612 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.612 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2912 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.667 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.668 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.668 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3856e-05 s, 0.0 kB/s 2023-10-09T15:35:58.668 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.668 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2913 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.723 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1108e-05 s, 0.0 kB/s 2023-10-09T15:35:58.724 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.724 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2914 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.779 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6792e-05 s, 0.0 kB/s 2023-10-09T15:35:58.780 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.780 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2915 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.836 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.836 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2879e-05 s, 0.0 kB/s 2023-10-09T15:35:58.837 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.837 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2916 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.893 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1929e-05 s, 0.0 kB/s 2023-10-09T15:35:58.894 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.894 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2917 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:58.950 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5153e-05 s, 0.0 kB/s 2023-10-09T15:35:58.954 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:58.954 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2918 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.006 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4621e-05 s, 0.0 kB/s 2023-10-09T15:35:59.006 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.006 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2919 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.063 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2934e-05 s, 0.0 kB/s 2023-10-09T15:35:59.063 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.063 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2920 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.118 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.119 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.119 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1642e-05 s, 0.0 kB/s 2023-10-09T15:35:59.119 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.119 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2921 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.174 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.175 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4269e-05 s, 0.0 kB/s 2023-10-09T15:35:59.175 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2922 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.231 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3546e-05 s, 0.0 kB/s 2023-10-09T15:35:59.231 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.231 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2923 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.288 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.288 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5397e-05 s, 0.0 kB/s 2023-10-09T15:35:59.288 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.289 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2924 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.345 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6884e-05 s, 0.0 kB/s 2023-10-09T15:35:59.346 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.346 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2925 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.402 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.402 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4581e-05 s, 0.0 kB/s 2023-10-09T15:35:59.402 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.402 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2926 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.458 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.459 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.218e-05 s, 0.0 kB/s 2023-10-09T15:35:59.459 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.459 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2927 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.516 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.516 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4337e-05 s, 0.0 kB/s 2023-10-09T15:35:59.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.516 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2928 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.571 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3004e-05 s, 0.0 kB/s 2023-10-09T15:35:59.572 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.572 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2929 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.627 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.627 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.627 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2998e-05 s, 0.0 kB/s 2023-10-09T15:35:59.628 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.628 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2930 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1576e-05 s, 0.0 kB/s 2023-10-09T15:35:59.684 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.684 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2931 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.739 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.740 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.740 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1993e-05 s, 0.0 kB/s 2023-10-09T15:35:59.740 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.740 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2932 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3906e-05 s, 0.0 kB/s 2023-10-09T15:35:59.796 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.796 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2933 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.851 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.852 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.169e-05 s, 0.0 kB/s 2023-10-09T15:35:59.852 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.852 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2934 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.907 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5408e-05 s, 0.0 kB/s 2023-10-09T15:35:59.908 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.908 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2935 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:35:59.963 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:35:59.964 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:35:59.964 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4123e-05 s, 0.0 kB/s 2023-10-09T15:35:59.964 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:35:59.964 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2936 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.019 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.020 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2425e-05 s, 0.0 kB/s 2023-10-09T15:36:00.020 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.020 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2937 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.076 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2802e-05 s, 0.0 kB/s 2023-10-09T15:36:00.076 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.076 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2938 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.131 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.132 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2462e-05 s, 0.0 kB/s 2023-10-09T15:36:00.132 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.132 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2939 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.187 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2938e-05 s, 0.0 kB/s 2023-10-09T15:36:00.188 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.188 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2940 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.243 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.243 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1651e-05 s, 0.0 kB/s 2023-10-09T15:36:00.244 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.244 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2941 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.299 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.299 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1793e-05 s, 0.0 kB/s 2023-10-09T15:36:00.300 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.300 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2942 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.356 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.357 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3269e-05 s, 0.0 kB/s 2023-10-09T15:36:00.357 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.358 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2943 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.415 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.415 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4976e-05 s, 0.0 kB/s 2023-10-09T15:36:00.415 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.415 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2944 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.471 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3021e-05 s, 0.0 kB/s 2023-10-09T15:36:00.471 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.471 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2945 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.526 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.526 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.527 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3486e-05 s, 0.0 kB/s 2023-10-09T15:36:00.527 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.527 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2946 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.582 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.583 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1461e-05 s, 0.0 kB/s 2023-10-09T15:36:00.583 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.583 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2947 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.639 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3568e-05 s, 0.0 kB/s 2023-10-09T15:36:00.640 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.640 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2948 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.695 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.696 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0597e-05 s, 0.0 kB/s 2023-10-09T15:36:00.696 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.696 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2949 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.751 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1786e-05 s, 0.0 kB/s 2023-10-09T15:36:00.752 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.752 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2950 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.809 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.809 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2001e-05 s, 0.0 kB/s 2023-10-09T15:36:00.809 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.810 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2951 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.864 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.865 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3713e-05 s, 0.0 kB/s 2023-10-09T15:36:00.865 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.865 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2952 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.920 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.921 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3514e-05 s, 0.0 kB/s 2023-10-09T15:36:00.921 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.921 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2953 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:00.976 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:00.977 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5474e-05 s, 0.0 kB/s 2023-10-09T15:36:00.977 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:00.977 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2954 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.069 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.070 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 4.6667e-05 s, 0.0 kB/s 2023-10-09T15:36:01.070 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.070 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2955 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.087 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.087 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4227e-05 s, 0.0 kB/s 2023-10-09T15:36:01.087 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.087 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2956 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.143 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.143 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3127e-05 s, 0.0 kB/s 2023-10-09T15:36:01.143 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.143 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2957 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.199 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.199 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5737e-05 s, 0.0 kB/s 2023-10-09T15:36:01.200 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.200 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2958 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.256 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.257 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.8353e-05 s, 0.0 kB/s 2023-10-09T15:36:01.257 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.257 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2959 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.312 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2098e-05 s, 0.0 kB/s 2023-10-09T15:36:01.313 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.313 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2960 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.368 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3868e-05 s, 0.0 kB/s 2023-10-09T15:36:01.369 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.369 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2961 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.426 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3549e-05 s, 0.0 kB/s 2023-10-09T15:36:01.426 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.427 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2962 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.481 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.482 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.482 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1734e-05 s, 0.0 kB/s 2023-10-09T15:36:01.482 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.482 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2963 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.537 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3452e-05 s, 0.0 kB/s 2023-10-09T15:36:01.538 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.538 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2964 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.593 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3557e-05 s, 0.0 kB/s 2023-10-09T15:36:01.594 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.594 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2965 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.650 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.651 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6804e-05 s, 0.0 kB/s 2023-10-09T15:36:01.651 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.651 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2966 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.707 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5361e-05 s, 0.0 kB/s 2023-10-09T15:36:01.707 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.707 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2967 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.762 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.763 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.763 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4376e-05 s, 0.0 kB/s 2023-10-09T15:36:01.763 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.763 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2968 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.818 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.819 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2154e-05 s, 0.0 kB/s 2023-10-09T15:36:01.819 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.819 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2969 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.874 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.875 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.875 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0801e-05 s, 0.0 kB/s 2023-10-09T15:36:01.875 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.875 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2970 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.930 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.931 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0311e-05 s, 0.0 kB/s 2023-10-09T15:36:01.931 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.931 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2971 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:01.987 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:01.987 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:01.987 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1793e-05 s, 0.0 kB/s 2023-10-09T15:36:01.987 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:01.987 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2972 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.042 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.043 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.043 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4136e-05 s, 0.0 kB/s 2023-10-09T15:36:02.043 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.043 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2973 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.099 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3626e-05 s, 0.0 kB/s 2023-10-09T15:36:02.099 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.100 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2974 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.156 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.156 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3632e-05 s, 0.0 kB/s 2023-10-09T15:36:02.156 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.156 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2975 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.211 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.211 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1589e-05 s, 0.0 kB/s 2023-10-09T15:36:02.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.212 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2976 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.268 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2397e-05 s, 0.0 kB/s 2023-10-09T15:36:02.268 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.269 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2977 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.324 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.325 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.325 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2562e-05 s, 0.0 kB/s 2023-10-09T15:36:02.325 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.325 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2978 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.381 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5526e-05 s, 0.0 kB/s 2023-10-09T15:36:02.381 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.381 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2979 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.436 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.436 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.1075e-05 s, 0.0 kB/s 2023-10-09T15:36:02.437 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.437 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2980 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.492 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2092e-05 s, 0.0 kB/s 2023-10-09T15:36:02.493 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.493 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2981 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.548 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.549 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5169e-05 s, 0.0 kB/s 2023-10-09T15:36:02.549 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.549 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2982 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.604 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.605 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2332e-05 s, 0.0 kB/s 2023-10-09T15:36:02.605 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.605 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2983 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.660 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.661 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4019e-05 s, 0.0 kB/s 2023-10-09T15:36:02.661 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.661 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2984 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4337e-05 s, 0.0 kB/s 2023-10-09T15:36:02.717 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.717 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2985 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.773 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3291e-05 s, 0.0 kB/s 2023-10-09T15:36:02.773 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.773 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2986 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.828 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4991e-05 s, 0.0 kB/s 2023-10-09T15:36:02.829 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.829 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2987 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.885 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.0869e-05 s, 0.0 kB/s 2023-10-09T15:36:02.885 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.885 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2988 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.940 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.941 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.3822e-05 s, 0.0 kB/s 2023-10-09T15:36:02.941 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.941 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2989 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5925e-05 s, 0.0 kB/s 2023-10-09T15:36:02.997 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:02.997 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2990 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.052 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.053 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2982e-05 s, 0.0 kB/s 2023-10-09T15:36:03.053 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.053 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2991 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.109 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.109 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.109 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4773e-05 s, 0.0 kB/s 2023-10-09T15:36:03.109 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.109 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2992 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.165 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.165 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.165 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4629e-05 s, 0.0 kB/s 2023-10-09T15:36:03.165 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.165 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2993 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.220 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.221 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.221 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4902e-05 s, 0.0 kB/s 2023-10-09T15:36:03.221 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.221 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2994 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.277 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.277 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.6505e-05 s, 0.0 kB/s 2023-10-09T15:36:03.277 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.277 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2995 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.332 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.333 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.333 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2792e-05 s, 0.0 kB/s 2023-10-09T15:36:03.333 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.333 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2996 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.389 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.2681e-05 s, 0.0 kB/s 2023-10-09T15:36:03.389 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.390 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2997 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.445 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.446 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.5733e-05 s, 0.0 kB/s 2023-10-09T15:36:03.446 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.446 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2998 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.501 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.502 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.256e-05 s, 0.0 kB/s 2023-10-09T15:36:03.502 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:03.502 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvolume_0000000000563690/1ac92322-2aae-42ae-8d00-2502b5680499/subvolume_file.2999 bs=1M conv=fdatasync count=0 seek=0) 2023-10-09T15:36:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records in 2023-10-09T15:36:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:0+0 records out 2023-10-09T15:36:03.558 INFO:teuthology.orchestra.run.smithi033.stderr:0 bytes copied, 3.4507e-05 s, 0.0 kB/s 2023-10-09T15:36:03.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvolume_0000000000563690 2023-10-09T15:36:03.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.719+0000 7f1cc3aa7700 1 Processor -- start 2023-10-09T15:36:03.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.719+0000 7f1cc3aa7700 1 -- start start 2023-10-09T15:36:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc3aa7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cbc13c9b0 0x7f1cbc069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc3aa7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc3aa7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cbc06d7b0 con 0x7f1cbc0cc320 2023-10-09T15:36:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc3aa7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc06f7d0 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc3aa7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cbc06e330 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc2044700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc2044700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59626/0 (socket says 172.21.15.33:59626) 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.720+0000 7f1cc2044700 1 -- 172.21.15.33:0/3832322323 learned_addr learned my addr 172.21.15.33:0/3832322323 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc1042700 1 --2- 172.21.15.33:0/3832322323 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc13c9b0 0x7f1cbc069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc2044700 1 -- 172.21.15.33:0/3832322323 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc13c9b0 msgr2=0x7f1cbc069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc2044700 1 --2- 172.21.15.33:0/3832322323 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc13c9b0 0x7f1cbc069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc2044700 1 -- 172.21.15.33:0/3832322323 >> v1:172.21.15.59:6789/0 conn(0x7f1cbc0cc320 legacy=0x7f1cbc13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc2044700 1 -- 172.21.15.33:0/3832322323 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cbc06da00 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc2044700 1 --2- 172.21.15.33:0/3832322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0647f0 tx=0x7f1cac009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbc656eec5d43be3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc0841700 1 -- 172.21.15.33:0/3832322323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac00e070 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc0841700 1 -- 172.21.15.33:0/3832322323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac00ba20 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.721+0000 7f1cc0841700 1 -- 172.21.15.33:0/3832322323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac0092e0 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/3832322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc0cc6f0 msgr2=0x7f1cbc069f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/3832322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f1cbc0647f0 tx=0x7f1cac009840 comp rx=0 tx=0).stop 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/3832322323 shutdown_connections 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/3832322323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc0cc6f0 0x7f1cbc069f40 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/3832322323 >> v2:172.21.15.59:3300/0 conn(0x7f1cbc13c9b0 0x7f1cbc069a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:03.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/3832322323 >> 172.21.15.33:0/3832322323 conn(0x7f1cbc067f00 msgr2=0x7f1cbc068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/3832322323 shutdown_connections 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.722+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/3832322323 wait complete. 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.723+0000 7f1cc3aa7700 1 Processor -- start 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.723+0000 7f1cc3aa7700 1 -- start start 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0cc320 0x7f1cbc0c5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0cc6f0 0x7f1cbc0cad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b0210 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc13b1c0 con 0x7f1cbc0cc320 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc3aa7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cbc0b04b0 con 0x7f1cbc0cc6f0 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59642/0 (socket says 172.21.15.33:59642) 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 -- 172.21.15.33:0/2918037783 learned_addr learned my addr 172.21.15.33:0/2918037783 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc1843700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0cc320 0x7f1cbc0c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc1042700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0cc6f0 0x7f1cbc0cad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 -- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0cc6f0 msgr2=0x7f1cbc0cad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0cc6f0 0x7f1cbc0cad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 -- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0cc320 msgr2=0x7f1cbc0c5660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0cc320 0x7f1cbc0c5660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 -- 172.21.15.33:0/2918037783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cac009ae0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cc2044700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009880 tx=0x7f1cac018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac008a80 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.724+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac008be0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.725+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac026460 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.725+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cbc0b0790 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.725+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cbc0c5ba0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.726+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cbc04c3c0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.726+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7f1cac003040 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.726+0000 7f1cb9ffb700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 0x7f1ca80694a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.727+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f1cac0865e0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.727+0000 7f1cc1843700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 0x7f1ca80694a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:03.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.727+0000 7f1cc1843700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 0x7f1ca80694a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4003a80 tx=0x7f1cb4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:03.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.731+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cac0536c0 con 0x7f1cbc13c9b0 2023-10-09T15:36:03.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:03.959+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvolume_0000000000563690", "target": ["mon-mgr", ""]}) v1 -- 0x7f1cbc0b0980 con 0x7f1ca8066ff0 2023-10-09T15:36:03.962 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:03.963+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:03.963 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:03.963+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:03.963 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:03.963+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:03.963 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:03.963+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:03.963 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:03.963+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.025+0000 7f1cb9ffb700 1 -- 172.21.15.33:0/2918037783 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1cb4002480 con 0x7f1ca8066ff0 2023-10-09T15:36:04.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 msgr2=0x7f1ca80694a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 0x7f1ca80694a0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f1cb4003a80 tx=0x7f1cb4007ec0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 msgr2=0x7f1cbc137c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f1cac009880 tx=0x7f1cac018000 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 shutdown_connections 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1ca8066ff0 0x7f1ca80694a0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cbc13c9b0 0x7f1cbc137c10 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cbc0cc320 0x7f1cbc0c5660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 --2- 172.21.15.33:0/2918037783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cbc0cc6f0 0x7f1cbc0cad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 >> 172.21.15.33:0/2918037783 conn(0x7f1cbc067f00 msgr2=0x7f1cbc0b18f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 shutdown_connections 2023-10-09T15:36:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.027+0000 7f1cc3aa7700 1 -- 172.21.15.33:0/2918037783 wait complete. 2023-10-09T15:36:04.029 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.028+0000 7f91fa3a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.029 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.028+0000 7f91fa3a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.029 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.028+0000 7f91fa3a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.029 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.028+0000 7f91fa3a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.029 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.028+0000 7f91fa3a6700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.041 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T15:36:04.042 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.041+0000 7f91f8ba3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.042 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.041+0000 7f91f8ba3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.042 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.041+0000 7f91f8ba3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.042 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.041+0000 7f91f8ba3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.042 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:04.041+0000 7f91f8ba3700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.169+0000 7fdfe33f7700 1 Processor -- start 2023-10-09T15:36:04.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.169+0000 7fdfe33f7700 1 -- start start 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe33f7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdfdc153a00 0x7fdfdc153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe33f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0cea00 0x7fdfdc0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe33f7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfdc15ac50 con 0x7fdfdc15de50 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe33f7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfdc15d010 con 0x7fdfdc153a00 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe33f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0cf3c0 con 0x7fdfdc0cea00 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdfdc153a00 0x7fdfdc153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdfdc153a00 0x7fdfdc153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59686/0 (socket says 172.21.15.33:59686) 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 -- 172.21.15.33:0/3625539172 learned_addr learned my addr 172.21.15.33:0/3625539172 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:04.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe2bf6700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0cea00 0x7fdfdc0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 -- 172.21.15.33:0/3625539172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0cea00 msgr2=0x7fdfdc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0cea00 0x7fdfdc0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 -- 172.21.15.33:0/3625539172 >> v1:172.21.15.59:6789/0 conn(0x7fdfdc15de50 legacy=0x7fdfdc15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.170+0000 7fdfe23f5700 1 -- 172.21.15.33:0/3625539172 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfdc15af60 con 0x7fdfdc153a00 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe23f5700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc153a00 0x7fdfdc153dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80099b0 tx=0x7fdfd8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60f33e79ff4a28f5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe13f3700 1 -- 172.21.15.33:0/3625539172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd800b860 con 0x7fdfdc153a00 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe13f3700 1 -- 172.21.15.33:0/3625539172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd800b9c0 con 0x7fdfdc153a00 2023-10-09T15:36:04.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe13f3700 1 -- 172.21.15.33:0/3625539172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd800bd60 con 0x7fdfdc153a00 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe33f7700 1 -- 172.21.15.33:0/3625539172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc153a00 msgr2=0x7fdfdc153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.171+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc153a00 0x7fdfdc153dd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7fdfd80099b0 tx=0x7fdfd8009250 comp rx=0 tx=0).stop 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 -- 172.21.15.33:0/3625539172 shutdown_connections 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc0cea00 0x7fdfdc0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/3625539172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc153a00 0x7fdfdc153dd0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 -- 172.21.15.33:0/3625539172 >> 172.21.15.33:0/3625539172 conn(0x7fdfdc0703a0 msgr2=0x7fdfdc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 -- 172.21.15.33:0/3625539172 shutdown_connections 2023-10-09T15:36:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.172+0000 7fdfe33f7700 1 -- 172.21.15.33:0/3625539172 wait complete. 2023-10-09T15:36:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.173+0000 7fdfe33f7700 1 Processor -- start 2023-10-09T15:36:04.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.173+0000 7fdfe33f7700 1 -- start start 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.173+0000 7fdfe33f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.173+0000 7fdfe33f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc153a00 0x7fdfdc0c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 0x7fdfdc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b51e0 con 0x7fdfdc0cea00 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b53f0 con 0x7fdfdc15de50 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfdc0b56d0 con 0x7fdfdc153a00 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59694/0 (socket says 172.21.15.33:59694) 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 -- 172.21.15.33:0/1837589218 learned_addr learned my addr 172.21.15.33:0/1837589218 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe2bf6700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 0x7fdfdc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe1bf4700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc153a00 0x7fdfdc0c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 -- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc153a00 msgr2=0x7fdfdc0c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc153a00 0x7fdfdc0c7b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 -- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 msgr2=0x7fdfdc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 0x7fdfdc0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 -- 172.21.15.33:0/1837589218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd80094f0 con 0x7fdfdc0cea00 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe2bf6700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 0x7fdfdc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe23f5700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc06eb00 tx=0x7fdfd8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8024440 con 0x7fdfdc0cea00 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfd80245a0 con 0x7fdfdc0cea00 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfdc0b59b0 con 0x7fdfdc0cea00 2023-10-09T15:36:04.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdfd8024940 con 0x7fdfdc0cea00 2023-10-09T15:36:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.174+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfdc0b5f70 con 0x7fdfdc0cea00 2023-10-09T15:36:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.175+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfdc0b6160 con 0x7fdfdc0cea00 2023-10-09T15:36:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.176+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 8) v1 ==== 84791+0+0 (secure 0 0 0) 0x7fdfd801a420 con 0x7fdfdc0cea00 2023-10-09T15:36:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.177+0000 7fdfd27fc700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 0x7fdfc0069470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:04.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.177+0000 7fdfe1bf4700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 0x7fdfc0069470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:04.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.177+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fdfd8086380 con 0x7fdfdc0cea00 2023-10-09T15:36:04.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.177+0000 7fdfe1bf4700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 0x7fdfc0069470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc157310 tx=0x7fdfcc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:04.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.182+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdfd8053640 con 0x7fdfdc0cea00 2023-10-09T15:36:04.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.483+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fdfdc04c3c0 con 0x7fdfc0066fc0 2023-10-09T15:36:04.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.490+0000 7fdfd27fc700 1 -- 172.21.15.33:0/1837589218 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+534 (secure 0 0 0) 0x7fdfdc04c3c0 con 0x7fdfc0066fc0 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "mon_addrs": [ 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.33:6789", 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6789", 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6790" 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "pending_subvolume_deletions": 1, 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "pools": { 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: "data": [ 2023-10-09T15:36:04.490 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365976289280, 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_data", 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 8192 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": [ 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365976289280, 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_metadata", 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 19685376 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:36:04.491 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:04.492 INFO:teuthology.orchestra.run.smithi033.stdout: "used_size": 0 2023-10-09T15:36:04.492 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:04.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 msgr2=0x7fdfc0069470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 0x7fdfc0069470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc157310 tx=0x7fdfcc009040 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 msgr2=0x7fdfdc140850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7fdfdc06eb00 tx=0x7fdfd8017000 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 shutdown_connections 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdfc0066fc0 0x7fdfc0069470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdfdc0cea00 0x7fdfdc140850 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdfdc15de50 0x7fdfdc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 --2- 172.21.15.33:0/1837589218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdfdc153a00 0x7fdfdc0c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 >> 172.21.15.33:0/1837589218 conn(0x7fdfdc0703a0 msgr2=0x7fdfdc0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 shutdown_connections 2023-10-09T15:36:04.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:04.492+0000 7fdfe33f7700 1 -- 172.21.15.33:0/1837589218 wait complete. 2023-10-09T15:36:04.505 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:36:04.505 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:04.542 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:04.588 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:36:04.589 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:36:04.589 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:04.589 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:05.175 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:36:05.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:05.175 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:36:05.194 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:36:05.194 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:05.194 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:05.783 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:36:05.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:05.784 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:36:05.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:05.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.939+0000 7f40934d6700 1 Processor -- start 2023-10-09T15:36:05.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.939+0000 7f40934d6700 1 -- start start 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f40934d6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f408c0cb970 0x7f408c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f40934d6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 0x7f408c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f40934d6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408c15ae40 con 0x7f408c0cb5a0 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f40934d6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0ce0f0 con 0x7f408c0cb970 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f40934d6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f408c0d13f0 con 0x7f408c15a400 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f408c0cb970 0x7f408c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f408c0cb970 0x7f408c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59710/0 (socket says 172.21.15.33:59710) 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 -- 172.21.15.33:0/1091592575 learned_addr learned my addr 172.21.15.33:0/1091592575 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4091272700 1 --1- 172.21.15.33:0/1091592575 >> v1:172.21.15.33:6789/0 conn(0x7f408c0cb5a0 0x7f408c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36498/0 (socket says 172.21.15.33:36498) 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4091a73700 1 --2- 172.21.15.33:0/1091592575 >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 0x7f408c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 -- 172.21.15.33:0/1091592575 >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 msgr2=0x7f408c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:05.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 --2- 172.21.15.33:0/1091592575 >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 0x7f408c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 -- 172.21.15.33:0/1091592575 >> v1:172.21.15.33:6789/0 conn(0x7f408c0cb5a0 legacy=0x7f408c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 -- 172.21.15.33:0/1091592575 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c15ab60 con 0x7f408c0cb970 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4091a73700 1 --2- 172.21.15.33:0/1091592575 >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 0x7f408c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.940+0000 7f4090a71700 1 --2- 172.21.15.33:0/1091592575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb970 0x7f408c159ec0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ccdf0 tx=0x7f407c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3283a30bf6b5ea9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f4083fff700 1 -- 172.21.15.33:0/1091592575 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00b860 con 0x7f408c0cb970 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f4083fff700 1 -- 172.21.15.33:0/1091592575 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407c00b9c0 con 0x7f408c0cb970 2023-10-09T15:36:05.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f4083fff700 1 -- 172.21.15.33:0/1091592575 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407c00bd60 con 0x7f408c0cb970 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 -- 172.21.15.33:0/1091592575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb970 msgr2=0x7f408c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 --2- 172.21.15.33:0/1091592575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb970 0x7f408c159ec0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ccdf0 tx=0x7f407c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 -- 172.21.15.33:0/1091592575 shutdown_connections 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 --2- 172.21.15.33:0/1091592575 >> v2:172.21.15.59:3300/0 conn(0x7f408c15a400 0x7f408c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 --2- 172.21.15.33:0/1091592575 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb970 0x7f408c159ec0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:05.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 -- 172.21.15.33:0/1091592575 >> 172.21.15.33:0/1091592575 conn(0x7f408c070e30 msgr2=0x7f408c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:05.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 -- 172.21.15.33:0/1091592575 shutdown_connections 2023-10-09T15:36:05.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.941+0000 7f40934d6700 1 -- 172.21.15.33:0/1091592575 wait complete. 2023-10-09T15:36:05.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.943+0000 7f40934d6700 1 Processor -- start 2023-10-09T15:36:05.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.943+0000 7f40934d6700 1 -- start start 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 0x7f408c0b0900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c15a400 0x7f408c0b0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b3ec0 con 0x7f408c0cb5a0 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b4160 con 0x7f408c15a400 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f40934d6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f408c0b3630 con 0x7f408c0cb970 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.944+0000 7f4091272700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59722/0 (socket says 172.21.15.33:59722) 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 -- 172.21.15.33:0/1728614909 learned_addr learned my addr 172.21.15.33:0/1728614909 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:05.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091a73700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c15a400 0x7f408c0b0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4090a71700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 0x7f408c0b0900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 -- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 msgr2=0x7f408c0b0900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 0x7f408c0b0900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 -- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c15a400 msgr2=0x7f408c0b0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c15a400 0x7f408c0b0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 -- 172.21.15.33:0/1728614909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f407c0094f0 con 0x7f408c0cb5a0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4090a71700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 0x7f408c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f4091272700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f408800c7c0 tx=0x7f4088007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088005a70 con 0x7f408c0cb5a0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4088005bd0 con 0x7f408c0cb5a0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f408c0b3910 con 0x7f408c0cb5a0 2023-10-09T15:36:05.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40880070d0 con 0x7f408c0cb5a0 2023-10-09T15:36:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.945+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f408c152950 con 0x7f408c0cb5a0 2023-10-09T15:36:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.947+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f408c04c3c0 con 0x7f408c0cb5a0 2023-10-09T15:36:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.947+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4088007480 con 0x7f408c0cb5a0 2023-10-09T15:36:05.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.947+0000 7f40817fa700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 0x7f4070069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.947+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f4088083d80 con 0x7f408c0cb5a0 2023-10-09T15:36:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.947+0000 7f4090a71700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 0x7f4070069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:05.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.948+0000 7f4090a71700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 0x7f4070069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ccdf0 tx=0x7f407c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:05.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:05.953+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4088050d20 con 0x7f408c0cb5a0 2023-10-09T15:36:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.224+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f408c0ccf00 con 0x7f408c0cb5a0 2023-10-09T15:36:06.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.225+0000 7f40817fa700 1 -- 172.21.15.33:0/1728614909 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f4088017020 con 0x7f408c0cb5a0 2023-10-09T15:36:06.225 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:06.225 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:36:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 msgr2=0x7f4070069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 0x7f4070069620 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f408c0ccdf0 tx=0x7f407c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 msgr2=0x7f408c15df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f408800c7c0 tx=0x7f4088007f70 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 shutdown_connections 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4070067170 0x7f4070069620 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f408c0cb5a0 0x7f408c15df60 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f408c15a400 0x7f408c0b0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 --2- 172.21.15.33:0/1728614909 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408c0cb970 0x7f408c0b0900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 >> 172.21.15.33:0/1728614909 conn(0x7f408c070e30 msgr2=0x7f408c0ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.227+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 shutdown_connections 2023-10-09T15:36:06.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.228+0000 7f40934d6700 1 -- 172.21.15.33:0/1728614909 wait complete. 2023-10-09T15:36:06.229 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2023-10-09T15:36:06.241 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:06.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.380+0000 7f3bbe795700 1 Processor -- start 2023-10-09T15:36:06.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.380+0000 7f3bbe795700 1 -- start start 2023-10-09T15:36:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbe795700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3bb80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbe795700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3bb80aee90 0x7f3bb80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbe795700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bb80ce1a0 con 0x7f3bb806d280 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbe795700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bb80cd5d0 con 0x7f3bb80aee90 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbe795700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cd870 con 0x7f3bb80a8be0 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3bb806d280 0x7f3bb80ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36500/0 (socket says 172.21.15.33:36500) 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb77fe700 1 -- 172.21.15.33:0/431865849 learned_addr learned my addr 172.21.15.33:0/431865849 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/431865849 >> v2:172.21.15.59:3300/0 conn(0x7f3bb80aee90 0x7f3bb80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb7fff700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3bb80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959685264 0 0) 0x7f3bb80ce1a0 con 0x7f3bb806d280 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ba0003570 con 0x7f3bb806d280 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 509446469 0 0) 0x7f3ba0003570 con 0x7f3bb806d280 2023-10-09T15:36:06.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 msgr2=0x7f3bb80a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3bb80a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 >> v2:172.21.15.59:3300/0 conn(0x7f3bb80aee90 msgr2=0x7f3bb80b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.381+0000 7f3bb6ffd700 1 --2- 172.21.15.33:0/431865849 >> v2:172.21.15.59:3300/0 conn(0x7f3bb80aee90 0x7f3bb80b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb80cdb50 con 0x7f3bb806d280 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3bac0015f0 con 0x7f3bb806d280 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 >> v1:172.21.15.33:6789/0 conn(0x7f3bb806d280 legacy=0x7f3bb80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3ba0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ba0003fe0 0x7f3ba0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0004d50 0x7f3ba00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cd5d0 con 0x7f3ba0004d50 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb80cd870 con 0x7f3ba0003fe0 2023-10-09T15:36:06.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ba000ba90 con 0x7f3bb80a8be0 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0004d50 0x7f3ba00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb7fff700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3ba0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb77fe700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ba0003fe0 0x7f3ba0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 -- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 msgr2=0x7f3ba0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb80a8be0 0x7f3ba0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 -- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ba0003fe0 msgr2=0x7f3ba0004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ba0003fe0 0x7f3ba0004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 -- 172.21.15.33:0/431865849 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ba0003570 con 0x7f3ba0004d50 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb77fe700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3ba0003fe0 0x7f3ba0004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0004d50 0x7f3ba00051c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80af290 tx=0x7f3bb000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eedb1b94aa76bd91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000ea00 con 0x7f3ba0004d50 2023-10-09T15:36:06.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb000f040 con 0x7f3ba0004d50 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.382+0000 7f3bb6ffd700 1 -- 172.21.15.33:0/431865849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb000ed90 con 0x7f3ba0004d50 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 -- 172.21.15.33:0/431865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0004d50 msgr2=0x7f3ba00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 --2- 172.21.15.33:0/431865849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3ba0004d50 0x7f3ba00051c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80af290 tx=0x7f3bb000b040 comp rx=0 tx=0).stop 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbcd32700 1 -- 172.21.15.33:0/431865849 reap_dead start 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 -- 172.21.15.33:0/431865849 shutdown_connections 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 -- 172.21.15.33:0/431865849 >> 172.21.15.33:0/431865849 conn(0x7f3bb806ce80 msgr2=0x7f3bb80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 -- 172.21.15.33:0/431865849 shutdown_connections 2023-10-09T15:36:06.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.383+0000 7f3bbe795700 1 -- 172.21.15.33:0/431865849 wait complete. 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.384+0000 7f3bbe795700 1 Processor -- start 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.385+0000 7f3bbe795700 1 -- start start 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb8152970 0x7f3bb8155f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb8154940 0x7f3bb80991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8155ad0 con 0x7f3bb81525a0 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb8154ec0 con 0x7f3bb8154940 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bb81551a0 con 0x7f3bb8152970 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59738/0 (socket says 172.21.15.33:59738) 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 -- 172.21.15.33:0/1003875434 learned_addr learned my addr 172.21.15.33:0/1003875434 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb77fe700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb8152970 0x7f3bb8155f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbcd32700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb8154940 0x7f3bb80991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 -- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb8152970 msgr2=0x7f3bb8155f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb8152970 0x7f3bb8155f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 -- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb8154940 msgr2=0x7f3bb80991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb8154940 0x7f3bb80991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 -- 172.21.15.33:0/1003875434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8155480 con 0x7f3bb81525a0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bb7fff700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8011b10 tx=0x7f3ba8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8005c10 con 0x7f3bb81525a0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ba8005d70 con 0x7f3bb81525a0 2023-10-09T15:36:06.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb8155760 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ba800f960 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.386+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bb81564a0 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.387+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bb804c3c0 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.388+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3ba800fd10 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.388+0000 7f3b9ffff700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 0x7f3ba4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.388+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f3ba8085140 con 0x7f3bb81525a0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.388+0000 7f3bb77fe700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 0x7f3ba4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.389+0000 7f3bb77fe700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 0x7f3ba4069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80ca9b0 tx=0x7f3bac00c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.396+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3ba80521a0 con 0x7f3bb81525a0 2023-10-09T15:36:06.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:36:06.469 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:36:06.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.666+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bb8156780 con 0x7f3bb81525a0 2023-10-09T15:36:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.667+0000 7f3b9ffff700 1 -- 172.21.15.33:0/1003875434 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15403 (secure 0 0 0) 0x7f3ba80557c0 con 0x7f3bb81525a0 2023-10-09T15:36:06.667 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:06.667 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":65,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:33:48.329778+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 msgr2=0x7f3ba4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 0x7f3ba4069620 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80ca9b0 tx=0x7f3bac00c040 comp rx=0 tx=0).stop 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 msgr2=0x7f3bb8154400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8011b10 tx=0x7f3ba8009120 comp rx=0 tx=0).stop 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 shutdown_connections 2023-10-09T15:36:06.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3ba4067170 0x7f3ba4069620 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3bb81525a0 0x7f3bb8154400 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3bb8154940 0x7f3bb80991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 --2- 172.21.15.33:0/1003875434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3bb8152970 0x7f3bb8155f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 >> 172.21.15.33:0/1003875434 conn(0x7f3bb806ce80 msgr2=0x7f3bb80b1330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 shutdown_connections 2023-10-09T15:36:06.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.670+0000 7f3bbe795700 1 -- 172.21.15.33:0/1003875434 wait complete. 2023-10-09T15:36:06.683 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:32:57.157608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '62', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:32:57.710786+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '63', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:36:06.684 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:36:06.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 Processor -- start 2023-10-09T15:36:06.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 -- start start 2023-10-09T15:36:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f30153a00 0x7f6f30153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 0x7f6f3015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f3015af60 con 0x7f6f300cea00 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f3015d010 con 0x7f6f30153a00 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.822+0000 7f6f34b0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f3015b240 con 0x7f6f3015de50 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f30153a00 0x7f6f30153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6f30153a00 0x7f6f30153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59748/0 (socket says 172.21.15.33:59748) 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2113283612 learned_addr learned my addr 172.21.15.33:0/2113283612 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2effd700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 0x7f6f3015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2113283612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 msgr2=0x7f6f3015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 0x7f6f3015a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2113283612 >> v1:172.21.15.59:6789/0 conn(0x7f6f300cea00 legacy=0x7f6f300cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2113283612 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f3015b520 con 0x7f6f30153a00 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2effd700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 0x7f6f3015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:06.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2f7fe700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f30153a00 0x7f6f30153dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6f200099b0 tx=0x7f6f20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=186d0de8dda49b0f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2e7fc700 1 -- 172.21.15.33:0/2113283612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000b860 con 0x7f6f30153a00 2023-10-09T15:36:06.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2e7fc700 1 -- 172.21.15.33:0/2113283612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2000b9c0 con 0x7f6f30153a00 2023-10-09T15:36:06.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.823+0000 7f6f2e7fc700 1 -- 172.21.15.33:0/2113283612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f2000bd60 con 0x7f6f30153a00 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2113283612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f30153a00 msgr2=0x7f6f30153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f30153a00 0x7f6f30153dd0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f6f200099b0 tx=0x7f6f20009250 comp rx=0 tx=0).stop 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2113283612 shutdown_connections 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f30153a00 0x7f6f30153dd0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2113283612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f3015de50 0x7f6f3015a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2113283612 >> 172.21.15.33:0/2113283612 conn(0x7f6f300703a0 msgr2=0x7f6f300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2113283612 shutdown_connections 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.824+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2113283612 wait complete. 2023-10-09T15:36:06.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.826+0000 7f6f34b0e700 1 Processor -- start 2023-10-09T15:36:06.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.826+0000 7f6f34b0e700 1 -- start start 2023-10-09T15:36:06.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30153a00 0x7f6f300cb110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f3015de50 0x7f6f300cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cc290 con 0x7f6f300cea00 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300ccfe0 con 0x7f6f3015de50 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f34b0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f300cbcd0 con 0x7f6f30153a00 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59758/0 (socket says 172.21.15.33:59758) 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.827+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2198020262 learned_addr learned my addr 172.21.15.33:0/2198020262 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2effd700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30153a00 0x7f6f300cb110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2ffff700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f3015de50 0x7f6f300cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30153a00 msgr2=0x7f6f300cb110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30153a00 0x7f6f300cb110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f3015de50 msgr2=0x7f6f300cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f3015de50 0x7f6f300cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 -- 172.21.15.33:0/2198020262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f200094f0 con 0x7f6f300cea00 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f2f7fe700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009290 tx=0x7f6f20017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f20011e00 con 0x7f6f300cea00 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f2001f070 con 0x7f6f300cea00 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f200266d0 con 0x7f6f300cea00 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f300cbfb0 con 0x7f6f300cea00 2023-10-09T15:36:06.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.828+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f301519c0 con 0x7f6f300cea00 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.830+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f3004c3c0 con 0x7f6f300cea00 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.830+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6f20026a40 con 0x7f6f300cea00 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.830+0000 7f6f177fe700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 0x7f6f1c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.830+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f6f20021070 con 0x7f6f300cea00 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.830+0000 7f6f2effd700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 0x7f6f1c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:06.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.831+0000 7f6f2effd700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 0x7f6f1c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006f00 tx=0x7f6f24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:06.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:06.836+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6f20053560 con 0x7f6f300cea00 2023-10-09T15:36:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.066+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6f3015b800 con 0x7f6f300cea00 2023-10-09T15:36:07.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.067+0000 7f6f177fe700 1 -- 172.21.15.33:0/2198020262 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v65) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6f20056b80 con 0x7f6f300cea00 2023-10-09T15:36:07.067 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 msgr2=0x7f6f1c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 0x7f6f1c069620 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f6f24006f00 tx=0x7f6f24008040 comp rx=0 tx=0).stop 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 msgr2=0x7f6f30156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f6f20009290 tx=0x7f6f20017000 comp rx=0 tx=0).stop 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 shutdown_connections 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6f1c067170 0x7f6f1c069620 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6f300cea00 0x7f6f30156380 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6f3015de50 0x7f6f300cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 --2- 172.21.15.33:0/2198020262 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6f30153a00 0x7f6f300cb110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 >> 172.21.15.33:0/2198020262 conn(0x7f6f300703a0 msgr2=0x7f6f3015bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 shutdown_connections 2023-10-09T15:36:07.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.069+0000 7f6f34b0e700 1 -- 172.21.15.33:0/2198020262 wait complete. 2023-10-09T15:36:07.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:36:07.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.226+0000 7f70b5724700 1 Processor -- start 2023-10-09T15:36:07.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.226+0000 7f70b5724700 1 -- start start 2023-10-09T15:36:07.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70b5724700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00684e0 0x7f70b00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70b5724700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b0068320 con 0x7f70b00cc910 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70b5724700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b015ae00 con 0x7f70b00cd780 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70b5724700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b015a560 con 0x7f70b00684e0 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00684e0 0x7f70b00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00684e0 0x7f70b00cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59772/0 (socket says 172.21.15.33:59772) 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 -- 172.21.15.33:0/1901739660 learned_addr learned my addr 172.21.15.33:0/1901739660 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70aeffd700 1 --1- 172.21.15.33:0/1901739660 >> v1:172.21.15.33:6789/0 conn(0x7f70b00cc910 0x7f70b0159d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36514/0 (socket says 172.21.15.33:36514) 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 -- 172.21.15.33:0/1901739660 >> v1:172.21.15.59:6789/0 conn(0x7f70b00cd780 legacy=0x7f70b015dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 -- 172.21.15.33:0/1901739660 >> v1:172.21.15.33:6789/0 conn(0x7f70b00cc910 legacy=0x7f70b0159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.227+0000 7f70ae7fc700 1 -- 172.21.15.33:0/1901739660 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b015a840 con 0x7f70b00684e0 2023-10-09T15:36:07.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.228+0000 7f70ae7fc700 1 --2- 172.21.15.33:0/1901739660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00cd240 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8f1f60826d9f0cc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.228+0000 7f70adffb700 1 -- 172.21.15.33:0/1901739660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400b820 con 0x7f70b00684e0 2023-10-09T15:36:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.228+0000 7f70adffb700 1 -- 172.21.15.33:0/1901739660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a400b980 con 0x7f70b00684e0 2023-10-09T15:36:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.228+0000 7f70adffb700 1 -- 172.21.15.33:0/1901739660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400bd20 con 0x7f70b00684e0 2023-10-09T15:36:07.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 -- 172.21.15.33:0/1901739660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 msgr2=0x7f70b00cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 --2- 172.21.15.33:0/1901739660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00cd240 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4009250 comp rx=0 tx=0).stop 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 -- 172.21.15.33:0/1901739660 shutdown_connections 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 --2- 172.21.15.33:0/1901739660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00cd240 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 -- 172.21.15.33:0/1901739660 >> 172.21.15.33:0/1901739660 conn(0x7f70b006d7b0 msgr2=0x7f70b006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 -- 172.21.15.33:0/1901739660 shutdown_connections 2023-10-09T15:36:07.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.229+0000 7f70b5724700 1 -- 172.21.15.33:0/1901739660 wait complete. 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.230+0000 7f70b5724700 1 Processor -- start 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.230+0000 7f70b5724700 1 -- start start 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b00cc910 0x7f70b0154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 0x7f70b00ae750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015d950 con 0x7f70b00684e0 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015e1f0 con 0x7f70b00cc910 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70b5724700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00ad950 con 0x7f70b00cd780 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59786/0 (socket says 172.21.15.33:59786) 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 -- 172.21.15.33:0/2033448910 learned_addr learned my addr 172.21.15.33:0/2033448910 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70ae7fc700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b00cc910 0x7f70b0154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 0x7f70b00ae750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 -- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 msgr2=0x7f70b00ae750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 0x7f70b00ae750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 -- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b00cc910 msgr2=0x7f70b0154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b00cc910 0x7f70b0154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70aeffd700 1 -- 172.21.15.33:0/2033448910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a40094f0 con 0x7f70b00684e0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.231+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 0x7f70b00ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c590 tx=0x7f70a0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a0005a70 con 0x7f70b00684e0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a0005bd0 con 0x7f70b00684e0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a00070d0 con 0x7f70b00684e0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b015dba0 con 0x7f70b00684e0 2023-10-09T15:36:07.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.232+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b00aec90 con 0x7f70b00684e0 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.233+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b004c3c0 con 0x7f70b00684e0 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.234+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f70a0007480 con 0x7f70b00684e0 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.234+0000 7f7096ffd700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.234+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f70a0083b40 con 0x7f70b00684e0 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.234+0000 7f70ae7fc700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.235+0000 7f70ae7fc700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.238+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70a0050ae0 con 0x7f70b00684e0 2023-10-09T15:36:07.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.509+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f70b0068320 con 0x7f70b00684e0 2023-10-09T15:36:07.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.510+0000 7f7096ffd700 1 -- 172.21.15.33:0/2033448910 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v65) v1 ==== 104+0+11 (secure 0 0 0) 0x7f70b0068320 con 0x7f70b00684e0 2023-10-09T15:36:07.510 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 msgr2=0x7f709c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f70a40099b0 tx=0x7f70a4016000 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 msgr2=0x7f70b00ad370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f70a000c590 tx=0x7f70a0007f70 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 shutdown_connections 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00684e0 0x7f70b00ad370 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00cd780 0x7f70b00ae750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 --2- 172.21.15.33:0/2033448910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b00cc910 0x7f70b0154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 >> 172.21.15.33:0/2033448910 conn(0x7f70b006d7b0 msgr2=0x7f70b006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:07.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 shutdown_connections 2023-10-09T15:36:07.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.512+0000 7f70b5724700 1 -- 172.21.15.33:0/2033448910 wait complete. 2023-10-09T15:36:07.525 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:36:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.667+0000 7f7e0e632700 1 Processor -- start 2023-10-09T15:36:07.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.667+0000 7f7e0e632700 1 -- start start 2023-10-09T15:36:07.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e0e632700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 0x7f7e080c2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e0e632700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e081562a0 con 0x7f7e080af0c0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e0e632700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e080c8050 con 0x7f7e080af920 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e0e632700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080af490 con 0x7f7e0806f0e0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e07fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7e080af0c0 0x7f7e0806d3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36526/0 (socket says 172.21.15.33:36526) 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.668+0000 7f7e07fff700 1 -- 172.21.15.33:0/3382043032 learned_addr learned my addr 172.21.15.33:0/3382043032 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e0cbcf700 1 --2- 172.21.15.33:0/3382043032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 0x7f7e080c2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4136819302 0 0) 0x7f7e081562a0 con 0x7f7e080af0c0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7df0003570 con 0x7f7e080af0c0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617175077 0 0) 0x7f7e080c8050 con 0x7f7e080af920 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e081562a0 con 0x7f7e080af920 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1381288177 0 0) 0x7f7df0003570 con 0x7f7e080af0c0 2023-10-09T15:36:07.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e0cbcf700 1 -- 172.21.15.33:0/3382043032 >> v1:172.21.15.59:6789/0 conn(0x7f7e080af920 legacy=0x7f7e0806e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e0cbcf700 1 -- 172.21.15.33:0/3382043032 >> v1:172.21.15.33:6789/0 conn(0x7f7e080af0c0 legacy=0x7f7e0806d3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e0cbcf700 1 -- 172.21.15.33:0/3382043032 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0806dc30 con 0x7f7e0806f0e0 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e0cbcf700 1 --2- 172.21.15.33:0/3382043032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 0x7f7e080c2ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e90 tx=0x7f7e00009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=605880eca38ff4ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0000e070 con 0x7f7e0806f0e0 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0000b870 con 0x7f7e0806f0e0 2023-10-09T15:36:07.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.669+0000 7f7e06ffd700 1 -- 172.21.15.33:0/3382043032 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80015f0 con 0x7f7e0806f0e0 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 -- 172.21.15.33:0/3382043032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 msgr2=0x7f7e080c2ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 --2- 172.21.15.33:0/3382043032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 0x7f7e080c2ac0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7e00009e90 tx=0x7f7e00009780 comp rx=0 tx=0).stop 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 -- 172.21.15.33:0/3382043032 shutdown_connections 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 --2- 172.21.15.33:0/3382043032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e0806f0e0 0x7f7e080c2ac0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 -- 172.21.15.33:0/3382043032 >> 172.21.15.33:0/3382043032 conn(0x7f7e080ccb60 msgr2=0x7f7e080ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 -- 172.21.15.33:0/3382043032 shutdown_connections 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.670+0000 7f7e0e632700 1 -- 172.21.15.33:0/3382043032 wait complete. 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.672+0000 7f7e0e632700 1 Processor -- start 2023-10-09T15:36:07.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.672+0000 7f7e0e632700 1 -- start start 2023-10-09T15:36:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e080af0c0 0x7f7e080b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e080af920 0x7f7e080b23f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e080c58e0 con 0x7f7e0806f0e0 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e081570b0 con 0x7f7e080af920 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0e632700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e08157390 con 0x7f7e080af0c0 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59800/0 (socket says 172.21.15.33:59800) 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 -- 172.21.15.33:0/1299251455 learned_addr learned my addr 172.21.15.33:0/1299251455 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e0cbcf700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e080af920 0x7f7e080b23f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e077fe700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e080af0c0 0x7f7e080b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 -- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e080af0c0 msgr2=0x7f7e080b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e080af0c0 0x7f7e080b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 -- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e080af920 msgr2=0x7f7e080b23f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e080af920 0x7f7e080b23f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.673+0000 7f7e07fff700 1 -- 172.21.15.33:0/1299251455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e00009a20 con 0x7f7e0806f0e0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7e07fff700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7df800cb70 tx=0x7f7df8002bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df8007e40 con 0x7f7e0806f0e0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7df8007300 con 0x7f7e0806f0e0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e08157670 con 0x7f7e0806f0e0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7df80076a0 con 0x7f7e0806f0e0 2023-10-09T15:36:07.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.674+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e08157c30 con 0x7f7e0806f0e0 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.675+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e0804c3c0 con 0x7f7e0806f0e0 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.676+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7df8005a00 con 0x7f7e0806f0e0 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.676+0000 7f7deffff700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 0x7f7df4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.676+0000 7f7e077fe700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 0x7f7df4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.676+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7df8084630 con 0x7f7e0806f0e0 2023-10-09T15:36:07.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.677+0000 7f7e077fe700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 0x7f7df4069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc007fd0 tx=0x7f7dfc007d10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:07.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.681+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7df8055060 con 0x7f7e0806f0e0 2023-10-09T15:36:07.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.920+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7e080c1f50 con 0x7f7e0806f0e0 2023-10-09T15:36:07.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.920+0000 7f7deffff700 1 -- 172.21.15.33:0/1299251455 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v65) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7df8005cb0 con 0x7f7e0806f0e0 2023-10-09T15:36:07.920 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:36:07.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.922+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 msgr2=0x7f7df4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.922+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 0x7f7df4069620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f7dfc007fd0 tx=0x7f7dfc007d10 comp rx=0 tx=0).stop 2023-10-09T15:36:07.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.922+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 msgr2=0x7f7e081459b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:07.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.922+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f7df800cb70 tx=0x7f7df8002bb0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 shutdown_connections 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7df4067170 0x7f7df4069620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e0806f0e0 0x7f7e081459b0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e080af920 0x7f7e080b23f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 --2- 172.21.15.33:0/1299251455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e080af0c0 0x7f7e080b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 >> 172.21.15.33:0/1299251455 conn(0x7f7e080ccb60 msgr2=0x7f7e081553a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:07.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 shutdown_connections 2023-10-09T15:36:07.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:07.923+0000 7f7e0e632700 1 -- 172.21.15.33:0/1299251455 wait complete. 2023-10-09T15:36:07.937 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.081+0000 7f7765281700 1 Processor -- start 2023-10-09T15:36:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.081+0000 7f7765281700 1 -- start start 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7765281700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f776006c8f0 0x7f776015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7765281700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006ccc0 0x7f77600a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7765281700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77600cb460 con 0x7f77600ccac0 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7765281700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77600cb180 con 0x7f776006c8f0 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7765281700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f776015db00 con 0x7f776006ccc0 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f776006c8f0 0x7f776015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f776006c8f0 0x7f776015d2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59808/0 (socket says 172.21.15.33:59808) 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 -- 172.21.15.33:0/1378850247 learned_addr learned my addr 172.21.15.33:0/1378850247 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f7764a80700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006ccc0 0x7f77600a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 -- 172.21.15.33:0/1378850247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006ccc0 msgr2=0x7f77600a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006ccc0 0x7f77600a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 -- 172.21.15.33:0/1378850247 >> v1:172.21.15.33:6789/0 conn(0x7f77600ccac0 legacy=0x7f77600cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.082+0000 7f775ffff700 1 -- 172.21.15.33:0/1378850247 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f776015dde0 con 0x7f776006c8f0 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f775ffff700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006c8f0 0x7f776015d2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f77500099b0 tx=0x7f7750009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77d88101ee9b13c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f775effd700 1 -- 172.21.15.33:0/1378850247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750009ea0 con 0x7f776006c8f0 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f775effd700 1 -- 172.21.15.33:0/1378850247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f775000b860 con 0x7f776006c8f0 2023-10-09T15:36:08.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f775effd700 1 -- 172.21.15.33:0/1378850247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f775000bc00 con 0x7f776006c8f0 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 -- 172.21.15.33:0/1378850247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006c8f0 msgr2=0x7f776015d2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006c8f0 0x7f776015d2b0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f77500099b0 tx=0x7f7750009250 comp rx=0 tx=0).stop 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 -- 172.21.15.33:0/1378850247 shutdown_connections 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006ccc0 0x7f77600a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 --2- 172.21.15.33:0/1378850247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006c8f0 0x7f776015d2b0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.083+0000 7f7765281700 1 -- 172.21.15.33:0/1378850247 >> 172.21.15.33:0/1378850247 conn(0x7f776006e280 msgr2=0x7f77600cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:08.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.084+0000 7f7765281700 1 -- 172.21.15.33:0/1378850247 shutdown_connections 2023-10-09T15:36:08.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.084+0000 7f7765281700 1 -- 172.21.15.33:0/1378850247 wait complete. 2023-10-09T15:36:08.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.085+0000 7f7765281700 1 Processor -- start 2023-10-09T15:36:08.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.085+0000 7f7765281700 1 -- start start 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006c8f0 0x7f77600ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 0x7f7760159600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7760159ee0 con 0x7f776006ccc0 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77600aeb10 con 0x7f77600ccac0 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.086+0000 7f7765281700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77600aedf0 con 0x7f776006c8f0 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59816/0 (socket says 172.21.15.33:59816) 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 -- 172.21.15.33:0/1212601642 learned_addr learned my addr 172.21.15.33:0/1212601642 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7764a80700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 0x7f7760159600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775ffff700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006c8f0 0x7f77600ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 -- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006c8f0 msgr2=0x7f77600ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006c8f0 0x7f77600ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 -- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 msgr2=0x7f7760159600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 0x7f7760159600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 -- 172.21.15.33:0/1212601642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77500094f0 con 0x7f776006ccc0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7764a80700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 0x7f7760159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f775f7fe700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f775400c4e0 tx=0x7f775400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011590 con 0x7f776006ccc0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77600ad3e0 con 0x7f776006ccc0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7754011710 con 0x7f776006ccc0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7754011ad0 con 0x7f776006ccc0 2023-10-09T15:36:08.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.087+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77600acb30 con 0x7f776006ccc0 2023-10-09T15:36:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.089+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77600ad900 con 0x7f776006ccc0 2023-10-09T15:36:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.089+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f7754001020 con 0x7f776006ccc0 2023-10-09T15:36:08.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.089+0000 7f7747fff700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 0x7f774c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.090+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f7754083ce0 con 0x7f776006ccc0 2023-10-09T15:36:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.090+0000 7f775ffff700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 0x7f774c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.090+0000 7f775ffff700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 0x7f774c069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f77500099b0 tx=0x7f7750017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.096+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77600ad900 con 0x7f776006ccc0 2023-10-09T15:36:08.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.407+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f77600ad900 con 0x7f776006ccc0 2023-10-09T15:36:08.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.408+0000 7f7747fff700 1 -- 172.21.15.33:0/1212601642 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f77600ad900 con 0x7f776006ccc0 2023-10-09T15:36:08.408 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:08.408 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 msgr2=0x7f774c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 0x7f774c069620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f77500099b0 tx=0x7f7750017000 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 msgr2=0x7f77600adbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f775400c4e0 tx=0x7f775400c8a0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 shutdown_connections 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f774c067170 0x7f774c069620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f77600ccac0 0x7f7760159600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.410+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f776006c8f0 0x7f77600ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.411+0000 7f7765281700 1 --2- 172.21.15.33:0/1212601642 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f776006ccc0 0x7f77600adbe0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.411+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 >> 172.21.15.33:0/1212601642 conn(0x7f776006e280 msgr2=0x7f7760068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.411+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 shutdown_connections 2023-10-09T15:36:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.411+0000 7f7765281700 1 -- 172.21.15.33:0/1212601642 wait complete. 2023-10-09T15:36:08.412 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2023-10-09T15:36:08.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:08.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.567+0000 7fe01635d700 1 Processor -- start 2023-10-09T15:36:08.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.567+0000 7fe01635d700 1 -- start start 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe01635d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 0x7fe010156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe01635d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01015ae40 con 0x7fe0100cb970 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe01635d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe01015ab60 con 0x7fe0100cb5a0 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe01635d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ce0f0 con 0x7fe01015a5d0 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe0100cb970 0x7fe010159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36546/0 (socket says 172.21.15.33:36546) 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00f7fe700 1 -- 172.21.15.33:0/658543859 learned_addr learned my addr 172.21.15.33:0/658543859 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe0148fa700 1 --2- 172.21.15.33:0/658543859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 0x7fe010156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 469869774 0 0) 0x7fe01015ae40 con 0x7fe0100cb970 2023-10-09T15:36:08.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdff8003570 con 0x7fe0100cb970 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2215889944 0 0) 0x7fe01015ab60 con 0x7fe0100cb5a0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.568+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe01015ae40 con 0x7fe0100cb5a0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe0148fa700 1 -- 172.21.15.33:0/658543859 >> v1:172.21.15.59:6789/0 conn(0x7fe0100cb5a0 legacy=0x7fe0100cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3900337491 0 0) 0x7fdff8003570 con 0x7fe0100cb970 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe0148fa700 1 -- 172.21.15.33:0/658543859 >> v1:172.21.15.33:6789/0 conn(0x7fe0100cb970 legacy=0x7fe010159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe0148fa700 1 -- 172.21.15.33:0/658543859 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0100ccf00 con 0x7fe01015a5d0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe0148fa700 1 --2- 172.21.15.33:0/658543859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 0x7fe010156e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe008009e90 tx=0x7fe008009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c66723b0211846d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00800e070 con 0x7fe01015a5d0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe00800b870 con 0x7fe01015a5d0 2023-10-09T15:36:08.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.569+0000 7fe00effd700 1 -- 172.21.15.33:0/658543859 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe004001470 con 0x7fe01015a5d0 2023-10-09T15:36:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 -- 172.21.15.33:0/658543859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 msgr2=0x7fe010156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 --2- 172.21.15.33:0/658543859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 0x7fe010156e90 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fe008009e90 tx=0x7fe008009780 comp rx=0 tx=0).stop 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 -- 172.21.15.33:0/658543859 shutdown_connections 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 --2- 172.21.15.33:0/658543859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe01015a5d0 0x7fe010156e90 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 -- 172.21.15.33:0/658543859 >> 172.21.15.33:0/658543859 conn(0x7fe010070e30 msgr2=0x7fe0100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 -- 172.21.15.33:0/658543859 shutdown_connections 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.570+0000 7fe01635d700 1 -- 172.21.15.33:0/658543859 wait complete. 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.571+0000 7fe01635d700 1 Processor -- start 2023-10-09T15:36:08.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.571+0000 7fe01635d700 1 -- start start 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0100cb5a0 0x7fe0101522c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0100cb970 0x7fe0100c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100ca670 con 0x7fe01015a5d0 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe010152800 con 0x7fe0100cb5a0 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe01635d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0100c95d0 con 0x7fe0100cb970 2023-10-09T15:36:08.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.572+0000 7fe0148fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59818/0 (socket says 172.21.15.33:59818) 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 -- 172.21.15.33:0/2010874370 learned_addr learned my addr 172.21.15.33:0/2010874370 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe00f7fe700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0100cb970 0x7fe0100c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe00ffff700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0100cb5a0 0x7fe0101522c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 -- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0100cb970 msgr2=0x7fe0100c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0100cb970 0x7fe0100c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 -- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0100cb5a0 msgr2=0x7fe0101522c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0100cb5a0 0x7fe0101522c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 -- 172.21.15.33:0/2010874370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe008009a20 con 0x7fe01015a5d0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe0148fa700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe008009de0 tx=0x7fe008017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe008012c20 con 0x7fe01015a5d0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe008012d80 con 0x7fe01015a5d0 2023-10-09T15:36:08.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe00801e6a0 con 0x7fe01015a5d0 2023-10-09T15:36:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0100c98b0 con 0x7fe01015a5d0 2023-10-09T15:36:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.573+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0100c9e70 con 0x7fe01015a5d0 2023-10-09T15:36:08.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.574+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe01004c3c0 con 0x7fe01015a5d0 2023-10-09T15:36:08.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.575+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fe00801ead0 con 0x7fe01015a5d0 2023-10-09T15:36:08.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.576+0000 7fdff7fff700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 0x7fdffc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.576+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe008086750 con 0x7fe01015a5d0 2023-10-09T15:36:08.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.576+0000 7fe00ffff700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 0x7fdffc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.576+0000 7fe00ffff700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 0x7fdffc069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe000007fd0 tx=0x7fe000007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.582+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0080535e0 con 0x7fe01015a5d0 2023-10-09T15:36:08.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.796+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0100b05e0 con 0x7fe01015a5d0 2023-10-09T15:36:08.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.797+0000 7fdff7fff700 1 -- 172.21.15.33:0/2010874370 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15403 (secure 0 0 0) 0x7fe008056c00 con 0x7fe01015a5d0 2023-10-09T15:36:08.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:08.797 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":65,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:33:48.329778+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 msgr2=0x7fdffc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 0x7fdffc069620 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fe000007fd0 tx=0x7fe000007d50 comp rx=0 tx=0).stop 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 msgr2=0x7fe010152e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fe008009de0 tx=0x7fe008017000 comp rx=0 tx=0).stop 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 shutdown_connections 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdffc067170 0x7fdffc069620 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe01015a5d0 0x7fe010152e70 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0100cb5a0 0x7fe0101522c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 --2- 172.21.15.33:0/2010874370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0100cb970 0x7fe0100c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 >> 172.21.15.33:0/2010874370 conn(0x7fe010070e30 msgr2=0x7fe0100cd950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 shutdown_connections 2023-10-09T15:36:08.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.801+0000 7fe01635d700 1 -- 172.21.15.33:0/2010874370 wait complete. 2023-10-09T15:36:08.818 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:36:08.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.946+0000 7f5bfec24700 1 Processor -- start 2023-10-09T15:36:08.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.946+0000 7f5bfec24700 1 -- start start 2023-10-09T15:36:08.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.947+0000 7f5bfec24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf815de50 0x7f5bf80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.947+0000 7f5bfec24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.947+0000 7f5bfec24700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bf80cf3c0 con 0x7f5bf8153c30 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.947+0000 7f5bfec24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf815afd0 con 0x7f5bf815de50 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.947+0000 7f5bfec24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815b2b0 con 0x7f5bf80cef40 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfd421700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5bf815de50 0x7f5bf80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:45522/0 (socket says 172.21.15.33:45522) 2023-10-09T15:36:08.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 -- 172.21.15.33:0/469169866 learned_addr learned my addr 172.21.15.33:0/469169866 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 -- 172.21.15.33:0/469169866 >> v2:172.21.15.59:3300/0 conn(0x7f5bf815de50 msgr2=0x7f5bf80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 --2- 172.21.15.33:0/469169866 >> v2:172.21.15.59:3300/0 conn(0x7f5bf815de50 0x7f5bf80cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 -- 172.21.15.33:0/469169866 >> v1:172.21.15.59:6789/0 conn(0x7f5bf8153c30 legacy=0x7f5bf815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 -- 172.21.15.33:0/469169866 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf815b590 con 0x7f5bf80cef40 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfe423700 1 --2- 172.21.15.33:0/469169866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009f20 tx=0x7f5bf0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6e4e6ef605c570 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfcc20700 1 -- 172.21.15.33:0/469169866 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf000e070 con 0x7f5bf80cef40 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfcc20700 1 -- 172.21.15.33:0/469169866 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf000b9d0 con 0x7f5bf80cef40 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.948+0000 7f5bfcc20700 1 -- 172.21.15.33:0/469169866 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf00092e0 con 0x7f5bf80cef40 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 -- 172.21.15.33:0/469169866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 msgr2=0x7f5bf815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 --2- 172.21.15.33:0/469169866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5bf0009f20 tx=0x7f5bf0009840 comp rx=0 tx=0).stop 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 -- 172.21.15.33:0/469169866 shutdown_connections 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 --2- 172.21.15.33:0/469169866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf815c070 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 --2- 172.21.15.33:0/469169866 >> v2:172.21.15.59:3300/0 conn(0x7f5bf815de50 0x7f5bf80cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 -- 172.21.15.33:0/469169866 >> 172.21.15.33:0/469169866 conn(0x7f5bf80703a0 msgr2=0x7f5bf80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 -- 172.21.15.33:0/469169866 shutdown_connections 2023-10-09T15:36:08.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.949+0000 7f5bfec24700 1 -- 172.21.15.33:0/469169866 wait complete. 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 Processor -- start 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 -- start start 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf815de50 0x7f5bf80c7b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81517a0 con 0x7f5bf8153c30 2023-10-09T15:36:08.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8150b90 con 0x7f5bf815de50 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.951+0000 7f5bfec24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8150e70 con 0x7f5bf80cef40 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59828/0 (socket says 172.21.15.33:59828) 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 -- 172.21.15.33:0/969528788 learned_addr learned my addr 172.21.15.33:0/969528788 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfdc22700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfe423700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf815de50 0x7f5bf80c7b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 -- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 msgr2=0x7f5bf814c240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf814c240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 -- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf815de50 msgr2=0x7f5bf80c7b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf815de50 0x7f5bf80c7b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 -- 172.21.15.33:0/969528788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf0009ae0 con 0x7f5bf8153c30 2023-10-09T15:36:08.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfd421700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ec80 tx=0x7f5be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800c850 con 0x7f5bf8153c30 2023-10-09T15:36:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be800c9b0 con 0x7f5bf8153c30 2023-10-09T15:36:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.952+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf8151150 con 0x7f5bf8153c30 2023-10-09T15:36:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.953+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be800cd50 con 0x7f5bf8153c30 2023-10-09T15:36:08.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.953+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf814c780 con 0x7f5bf8153c30 2023-10-09T15:36:08.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.954+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf804c3c0 con 0x7f5bf8153c30 2023-10-09T15:36:08.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.954+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f5be8013680 con 0x7f5bf8153c30 2023-10-09T15:36:08.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.955+0000 7f5bedffb700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 0x7f5bdc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:08.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.955+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7f5be8084bc0 con 0x7f5bf8153c30 2023-10-09T15:36:08.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.955+0000 7f5bfdc22700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 0x7f5bdc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:08.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.955+0000 7f5bfdc22700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 0x7f5bdc069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003a80 tx=0x7f5bf4007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:08.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:08.963+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5be8051b60 con 0x7f5bf8153c30 2023-10-09T15:36:09.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.247+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5bf81518e0 con 0x7f5bf8153c30 2023-10-09T15:36:09.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.247+0000 7f5bedffb700 1 -- 172.21.15.33:0/969528788 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5be8017090 con 0x7f5bf8153c30 2023-10-09T15:36:09.248 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:09.248 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:36:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 msgr2=0x7f5bdc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 0x7f5bdc069620 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4003a80 tx=0x7f5bf4007ec0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 msgr2=0x7f5bf80c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f5be800ec80 tx=0x7f5be80091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 shutdown_connections 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067170 0x7f5bdc069620 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bf815de50 0x7f5bf80c7b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bf80cef40 0x7f5bf814c240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 --2- 172.21.15.33:0/969528788 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bf8153c30 0x7f5bf80c75e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 >> 172.21.15.33:0/969528788 conn(0x7f5bf80703a0 msgr2=0x7f5bf80d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 shutdown_connections 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.250+0000 7f5bfec24700 1 -- 172.21.15.33:0/969528788 wait complete. 2023-10-09T15:36:09.251 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2023-10-09T15:36:09.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:09.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.415+0000 7fb8ef02f700 1 Processor -- start 2023-10-09T15:36:09.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.415+0000 7fb8ef02f700 1 -- start start 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ef02f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ef02f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb8e80aee90 0x7fb8e80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ef02f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8e80ce1a0 con 0x7fb8e806d280 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ef02f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8e80cd5d0 con 0x7fb8e80aee90 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ef02f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80cd870 con 0x7fb8e80a8be0 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb8e80aee90 0x7fb8e80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb8e80aee90 0x7fb8e80b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59842/0 (socket says 172.21.15.33:59842) 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 -- 172.21.15.33:0/1775434556 learned_addr learned my addr 172.21.15.33:0/1775434556 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ecdcb700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 -- 172.21.15.33:0/1775434556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 msgr2=0x7fb8e80a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e80a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.416+0000 7fb8ed5cc700 1 -- 172.21.15.33:0/1775434556 >> v1:172.21.15.33:6789/0 conn(0x7fb8e806d280 legacy=0x7fb8e80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8ed5cc700 1 -- 172.21.15.33:0/1775434556 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e80cdb50 con 0x7fb8e80aee90 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8ed5cc700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e80aee90 0x7fb8e80b08c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009f20 tx=0x7fb8e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed64fd954cf8935c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8e77fe700 1 -- 172.21.15.33:0/1775434556 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e000e070 con 0x7fb8e80aee90 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8e77fe700 1 -- 172.21.15.33:0/1775434556 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8e000bb10 con 0x7fb8e80aee90 2023-10-09T15:36:09.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8e77fe700 1 -- 172.21.15.33:0/1775434556 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8e00092e0 con 0x7fb8e80aee90 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1775434556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e80aee90 msgr2=0x7fb8e80b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.417+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e80aee90 0x7fb8e80b08c0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0009f20 tx=0x7fb8e0009840 comp rx=0 tx=0).stop 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1775434556 shutdown_connections 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e80aee90 0x7fb8e80b08c0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1775434556 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e80a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1775434556 >> 172.21.15.33:0/1775434556 conn(0x7fb8e806ce80 msgr2=0x7fb8e80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:09.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1775434556 shutdown_connections 2023-10-09T15:36:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.418+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1775434556 wait complete. 2023-10-09T15:36:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.419+0000 7fb8ef02f700 1 Processor -- start 2023-10-09T15:36:09.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.419+0000 7fb8ef02f700 1 -- start start 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e8099c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 0x7fb8e815d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e815b030 con 0x7fb8e806d280 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80ad540 con 0x7fb8e80aee90 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ef02f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8e80ac930 con 0x7fb8e80a8be0 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ecdcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ecdcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59852/0 (socket says 172.21.15.33:59852) 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ecdcb700 1 -- 172.21.15.33:0/1601553886 learned_addr learned my addr 172.21.15.33:0/1601553886 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8e7fff700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e8099c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.420+0000 7fb8ed5cc700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 0x7fb8e815d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 -- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 msgr2=0x7fb8e8099c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e8099c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 -- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 msgr2=0x7fb8e815d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 0x7fb8e815d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 -- 172.21.15.33:0/1601553886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e0009ae0 con 0x7fb8e806d280 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8e7fff700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e8099c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ed5cc700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 0x7fb8e815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ecdcb700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d8c0 tx=0x7fb8dc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc018070 con 0x7fb8e806d280 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8e80acc10 con 0x7fb8e806d280 2023-10-09T15:36:09.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8e80ad1d0 con 0x7fb8e806d280 2023-10-09T15:36:09.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8dc00de60 con 0x7fb8e806d280 2023-10-09T15:36:09.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.421+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8dc005c10 con 0x7fb8e806d280 2023-10-09T15:36:09.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.422+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8c80052b0 con 0x7fb8e806d280 2023-10-09T15:36:09.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.422+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb8dc00b780 con 0x7fb8e806d280 2023-10-09T15:36:09.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.423+0000 7fb8e4ff9700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 0x7fb8cc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.423+0000 7fb8e7fff700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 0x7fb8cc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.423+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fb8dc0849d0 con 0x7fb8e806d280 2023-10-09T15:36:09.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.424+0000 7fb8e7fff700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 0x7fb8cc069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4007fd0 tx=0x7fb8d4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.429+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb8dc051970 con 0x7fb8e806d280 2023-10-09T15:36:09.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.695+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb8c8005560 con 0x7fb8e806d280 2023-10-09T15:36:09.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.695+0000 7fb8e4ff9700 1 -- 172.21.15.33:0/1601553886 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 41 v41) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fb8dc054f90 con 0x7fb8e806d280 2023-10-09T15:36:09.695 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:09.695 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":41,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34}],"filesystems":[{"mdsmap":{"epoch":40,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:32:58.740361+0000","modified":"2023-10-09T15:33:02.363339+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5718},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5718":{"gid":5718,"name":"a","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2608740394","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":2608740394},{"type":"v1","addr":"172.21.15.33:6837","nonce":2608740394}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":5}]} 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.697+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 msgr2=0x7fb8cc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.697+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 0x7fb8cc069620 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4007fd0 tx=0x7fb8d4009040 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.697+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 msgr2=0x7fb8e815aaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.697+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb8dc00d8c0 tx=0x7fb8dc008040 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 shutdown_connections 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb8cc067170 0x7fb8cc069620 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb8e806d280 0x7fb8e815aaf0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb8e80aee90 0x7fb8e815d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 --2- 172.21.15.33:0/1601553886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb8e80a8be0 0x7fb8e8099c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 >> 172.21.15.33:0/1601553886 conn(0x7fb8e806ce80 msgr2=0x7fb8e80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:09.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 shutdown_connections 2023-10-09T15:36:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.698+0000 7fb8ef02f700 1 -- 172.21.15.33:0/1601553886 wait complete. 2023-10-09T15:36:09.699 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 41 2023-10-09T15:36:09.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:09.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.843+0000 7fc0b5039700 1 Processor -- start 2023-10-09T15:36:09.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.843+0000 7fc0b5039700 1 -- start start 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0b5039700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0b5039700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0b5039700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0b00ce1a0 con 0x7fc0b006d280 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0b5039700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0b00cd5d0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0b5039700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b00cd870 con 0x7fc0b00aee90 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0aed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0aed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59862/0 (socket says 172.21.15.33:59862) 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.844+0000 7fc0aed9d700 1 -- 172.21.15.33:0/4217231820 learned_addr learned my addr 172.21.15.33:0/4217231820 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0af59e700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0aed9d700 1 -- 172.21.15.33:0/4217231820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 msgr2=0x7fc0b00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0aed9d700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0aed9d700 1 -- 172.21.15.33:0/4217231820 >> v1:172.21.15.33:6789/0 conn(0x7fc0b006d280 legacy=0x7fc0b00ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0aed9d700 1 -- 172.21.15.33:0/4217231820 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0b00cdb50 con 0x7fc0b00a8be0 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0aed9d700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009990 tx=0x7fc0a0009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5e842802f2e668d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0add9b700 1 -- 172.21.15.33:0/4217231820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a0005c10 con 0x7fc0b00a8be0 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0add9b700 1 -- 172.21.15.33:0/4217231820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a0005d70 con 0x7fc0b00a8be0 2023-10-09T15:36:09.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.845+0000 7fc0add9b700 1 -- 172.21.15.33:0/4217231820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a000b910 con 0x7fc0b00a8be0 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 -- 172.21.15.33:0/4217231820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 msgr2=0x7fc0b00a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009990 tx=0x7fc0a0009220 comp rx=0 tx=0).stop 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 -- 172.21.15.33:0/4217231820 shutdown_connections 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 --2- 172.21.15.33:0/4217231820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b00a8fb0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 -- 172.21.15.33:0/4217231820 >> 172.21.15.33:0/4217231820 conn(0x7fc0b006ce80 msgr2=0x7fc0b00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 -- 172.21.15.33:0/4217231820 shutdown_connections 2023-10-09T15:36:09.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.846+0000 7fc0b5039700 1 -- 172.21.15.33:0/4217231820 wait complete. 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.847+0000 7fc0b5039700 1 Processor -- start 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.847+0000 7fc0b5039700 1 -- start start 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b006d280 0x7fc0b009b180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b01474d0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0099850 con 0x7fc0b006d280 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0b5039700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0b0098c40 con 0x7fc0b00aee90 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59878/0 (socket says 172.21.15.33:59878) 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 -- 172.21.15.33:0/1740724114 learned_addr learned my addr 172.21.15.33:0/1740724114 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:09.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0af59e700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0aed9d700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b006d280 0x7fc0b009b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 -- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 msgr2=0x7fc0b00980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 -- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b006d280 msgr2=0x7fc0b009b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b006d280 0x7fc0b009b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.848+0000 7fc0ae59c700 1 -- 172.21.15.33:0/1740724114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0a0009480 con 0x7fc0b00a8be0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc0ae59c700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4c0 tx=0x7fc0a4007ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400ce70 con 0x7fc0b00a8be0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0a400f470 con 0x7fc0b00a8be0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0b0098f20 con 0x7fc0b00a8be0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400f830 con 0x7fc0b00a8be0 2023-10-09T15:36:09.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.849+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0b00994e0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.850+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0b00999e0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.850+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc0a400fba0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.851+0000 7fc096ffd700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 0x7fc09c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:09.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.851+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fc0a4083cf0 con 0x7fc0b00a8be0 2023-10-09T15:36:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.851+0000 7fc0aed9d700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 0x7fc09c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:09.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.851+0000 7fc0aed9d700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 0x7fc09c069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009260 tx=0x7fc0a0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:09.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:09.856+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc0a4088070 con 0x7fc0b00a8be0 2023-10-09T15:36:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.071+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc0b004c3c0 con 0x7fc0b00a8be0 2023-10-09T15:36:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.072+0000 7fc096ffd700 1 -- 172.21.15.33:0/1740724114 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+15403 (secure 0 0 0) 0x7fc0a4017070 con 0x7fc0b00a8be0 2023-10-09T15:36:10.072 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:10.073 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":65,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:33:48.329778+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:32:57.157608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"62","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-10-09T15:32:57.710786+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"63","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.20","mappings":[{"from":6,"to":0}]},{"pgid":"11.2e","mappings":[{"from":6,"to":0}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:10.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 msgr2=0x7fc09c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 0x7fc09c069620 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0009260 tx=0x7fc0a0016000 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 msgr2=0x7fc0b0147760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7fc0a400c4c0 tx=0x7fc0a4007ee0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 shutdown_connections 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc09c067170 0x7fc09c069620 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0b00aee90 0x7fc0b00980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0b006d280 0x7fc0b009b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 --2- 172.21.15.33:0/1740724114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0b00a8be0 0x7fc0b0147760 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 >> 172.21.15.33:0/1740724114 conn(0x7fc0b006ce80 msgr2=0x7fc0b006d820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 shutdown_connections 2023-10-09T15:36:10.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.075+0000 7fc0b5039700 1 -- 172.21.15.33:0/1740724114 wait complete. 2023-10-09T15:36:10.090 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.220+0000 7fe8b4809700 1 Processor -- start 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.220+0000 7fe8b4809700 1 -- start start 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8b4809700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b0153d20 0x7fe8b006b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8b4809700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe8b015d9a0 0x7fe8b0068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8b4809700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8b00687b0 con 0x7fe8b0067e00 2023-10-09T15:36:10.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8b4809700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b015e280 con 0x7fe8b0153d20 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8b4809700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8b015dfa0 con 0x7fe8b015d9a0 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b0153d20 0x7fe8b006b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe8b0153d20 0x7fe8b006b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59890/0 (socket says 172.21.15.33:59890) 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 -- 172.21.15.33:0/672421037 learned_addr learned my addr 172.21.15.33:0/672421037 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8aeffd700 1 --1- 172.21.15.33:0/672421037 >> v1:172.21.15.33:6789/0 conn(0x7fe8b0067e00 0x7fe8b015d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36564/0 (socket says 172.21.15.33:36564) 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8affff700 1 --2- 172.21.15.33:0/672421037 >> v2:172.21.15.59:3300/0 conn(0x7fe8b015d9a0 0x7fe8b0068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 -- 172.21.15.33:0/672421037 >> v2:172.21.15.59:3300/0 conn(0x7fe8b015d9a0 msgr2=0x7fe8b0068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 --2- 172.21.15.33:0/672421037 >> v2:172.21.15.59:3300/0 conn(0x7fe8b015d9a0 0x7fe8b0068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 -- 172.21.15.33:0/672421037 >> v1:172.21.15.33:6789/0 conn(0x7fe8b0067e00 legacy=0x7fe8b015d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8ae7fc700 1 -- 172.21.15.33:0/672421037 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2532726460 0 0) 0x7fe8b00687b0 con 0x7fe8b0067e00 2023-10-09T15:36:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 -- 172.21.15.33:0/672421037 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8b006a5b0 con 0x7fe8b0153d20 2023-10-09T15:36:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.221+0000 7fe8af7fe700 1 --2- 172.21.15.33:0/672421037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0153d20 0x7fe8b006b090 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0068a60 tx=0x7fe8a0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada2e3108b49d391 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8ae7fc700 1 -- 172.21.15.33:0/672421037 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0009e70 con 0x7fe8b0153d20 2023-10-09T15:36:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8ae7fc700 1 -- 172.21.15.33:0/672421037 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000b860 con 0x7fe8b0153d20 2023-10-09T15:36:10.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8ae7fc700 1 -- 172.21.15.33:0/672421037 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a000bc00 con 0x7fe8b0153d20 2023-10-09T15:36:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 -- 172.21.15.33:0/672421037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0153d20 msgr2=0x7fe8b006b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 --2- 172.21.15.33:0/672421037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0153d20 0x7fe8b006b090 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe8b0068a60 tx=0x7fe8a0009250 comp rx=0 tx=0).stop 2023-10-09T15:36:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 -- 172.21.15.33:0/672421037 shutdown_connections 2023-10-09T15:36:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 --2- 172.21.15.33:0/672421037 >> v2:172.21.15.59:3300/0 conn(0x7fe8b015d9a0 0x7fe8b0068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 --2- 172.21.15.33:0/672421037 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0153d20 0x7fe8b006b090 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 -- 172.21.15.33:0/672421037 >> 172.21.15.33:0/672421037 conn(0x7fe8b00cca00 msgr2=0x7fe8b00cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 -- 172.21.15.33:0/672421037 shutdown_connections 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.222+0000 7fe8b4809700 1 -- 172.21.15.33:0/672421037 wait complete. 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 Processor -- start 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 -- start start 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8b0153d20 0x7fe8b0159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8b015d9a0 0x7fe8b00cbda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b016aca0 con 0x7fe8b0067e00 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.224+0000 7fe8b4809700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b0150710 con 0x7fe8b015d9a0 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8b4809700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8b01509f0 con 0x7fe8b0153d20 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59896/0 (socket says 172.21.15.33:59896) 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 -- 172.21.15.33:0/2198735728 learned_addr learned my addr 172.21.15.33:0/2198735728 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8aeffd700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8b0153d20 0x7fe8b0159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8affff700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8b015d9a0 0x7fe8b00cbda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 -- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8b0153d20 msgr2=0x7fe8b0159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8b0153d20 0x7fe8b0159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 -- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8b015d9a0 msgr2=0x7fe8b00cbda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8b015d9a0 0x7fe8b00cbda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 -- 172.21.15.33:0/2198735728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8a00094f0 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8af7fe700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00094c0 tx=0x7fe8a0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0000c90 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8a000b9d0 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8b0150cd0 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8a0025420 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.225+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8b015a460 con 0x7fe8b0067e00 2023-10-09T15:36:10.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.227+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8b006d860 con 0x7fe8b0067e00 2023-10-09T15:36:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.228+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fe8a0023070 con 0x7fe8b0067e00 2023-10-09T15:36:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.228+0000 7fe8977fe700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 0x7fe89c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.228+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5763+0+0 (secure 0 0 0) 0x7fe8a0085fb0 con 0x7fe8b0067e00 2023-10-09T15:36:10.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.228+0000 7fe8aeffd700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 0x7fe89c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.229+0000 7fe8aeffd700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 0x7fe89c069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4007180 tx=0x7fe8a4007ef0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.233+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe8a0052f50 con 0x7fe8b0067e00 2023-10-09T15:36:10.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.517+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe8b004c3c0 con 0x7fe8b0067e00 2023-10-09T15:36:10.517 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:36:10.517+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:36:10.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.522+0000 7fe8977fe700 1 -- 172.21.15.33:0/2198735728 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v42) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe8a0056570 con 0x7fe8b0067e00 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 msgr2=0x7fe89c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 0x7fe89c069620 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe8a4007180 tx=0x7fe8a4007ef0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 msgr2=0x7fe8b016a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe8a00094c0 tx=0x7fe8a0017000 comp rx=0 tx=0).stop 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 shutdown_connections 2023-10-09T15:36:10.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe89c067170 0x7fe89c069620 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe8b0067e00 0x7fe8b016a760 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe8b015d9a0 0x7fe8b00cbda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 --2- 172.21.15.33:0/2198735728 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe8b0153d20 0x7fe8b0159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 >> 172.21.15.33:0/2198735728 conn(0x7fe8b00cca00 msgr2=0x7fe8b0159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 shutdown_connections 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.525+0000 7fe8b4809700 1 -- 172.21.15.33:0/2198735728 wait complete. 2023-10-09T15:36:10.526 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:36:10.537 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:36:10.559 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:36:10.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.661+0000 7f33c4d4c700 1 Processor -- start 2023-10-09T15:36:10.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 -- start start 2023-10-09T15:36:10.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 0x7f33c0159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 0x7f33c006edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33c006c6a0 0x7f33c006cb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c006f300 con 0x7f33c006c6a0 2023-10-09T15:36:10.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33c00c71a0 con 0x7f33c006e950 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.662+0000 7f33c4d4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00c7a40 con 0x7f33c01597e0 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33c006c6a0 0x7f33c006cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33c006c6a0 0x7f33c006cb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59078/0 (socket says 172.21.15.33:59078) 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 -- 172.21.15.33:0/1841545654 learned_addr learned my addr 172.21.15.33:0/1841545654 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bdd9b700 1 --2- 172.21.15.33:0/1841545654 >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 0x7f33c006edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33be59c700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 0x7f33c0159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 -- 172.21.15.33:0/1841545654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 msgr2=0x7f33c0159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 0x7f33c0159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 -- 172.21.15.33:0/1841545654 >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 msgr2=0x7f33c006edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 --2- 172.21.15.33:0/1841545654 >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 0x7f33c006edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 -- 172.21.15.33:0/1841545654 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c006d3d0 con 0x7f33c006c6a0 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33be59c700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 0x7f33c0159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bdd9b700 1 --2- 172.21.15.33:0/1841545654 >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 0x7f33c006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bed9d700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006c6a0 0x7f33c006cb20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f33c006faf0 tx=0x7f33b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4fe528675c27bd1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bd59a700 1 -- 172.21.15.33:0/1841545654 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b000e070 con 0x7f33c006c6a0 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bd59a700 1 -- 172.21.15.33:0/1841545654 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33b000ba50 con 0x7f33c006c6a0 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.663+0000 7f33bd59a700 1 -- 172.21.15.33:0/1841545654 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33b00092e0 con 0x7f33c006c6a0 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1841545654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006c6a0 msgr2=0x7f33c006cb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006c6a0 0x7f33c006cb20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f33c006faf0 tx=0x7f33b0009840 comp rx=0 tx=0).stop 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1841545654 shutdown_connections 2023-10-09T15:36:10.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006c6a0 0x7f33c006cb20 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1841545654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c01597e0 0x7f33c0159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1841545654 >> v2:172.21.15.59:3300/0 conn(0x7f33c006e950 0x7f33c006edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1841545654 >> 172.21.15.33:0/1841545654 conn(0x7f33c00ccb60 msgr2=0x7f33c00ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:10.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1841545654 shutdown_connections 2023-10-09T15:36:10.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.664+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1841545654 wait complete. 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.665+0000 7f33c4d4c700 1 Processor -- start 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.665+0000 7f33c4d4c700 1 -- start start 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c006c6a0 0x7f33c0168e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 0x7f33c00c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00af0a0 con 0x7f33c006e950 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00aedc0 con 0x7f33c01597e0 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33c00b0b90 con 0x7f33c006c6a0 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59082/0 (socket says 172.21.15.33:59082) 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 -- 172.21.15.33:0/1414027531 learned_addr learned my addr 172.21.15.33:0/1414027531 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33be59c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c006c6a0 0x7f33c0168e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bed9d700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 0x7f33c00c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 -- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c006c6a0 msgr2=0x7f33c0168e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c006c6a0 0x7f33c0168e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 -- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 msgr2=0x7f33c00c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 0x7f33c00c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 -- 172.21.15.33:0/1414027531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33b0009ae0 con 0x7f33c006e950 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bed9d700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 0x7f33c00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33bdd9b700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c880 tx=0x7f33a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011600 con 0x7f33c006e950 2023-10-09T15:36:10.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33a8011760 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33c00ae490 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.666+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33a8011b20 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.667+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33c00aea50 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.667+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33c0070610 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.668+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f33a80193b0 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.668+0000 7f33b67fc700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 0x7f33a0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.668+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f33a8084a30 con 0x7f33c006e950 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.668+0000 7f33be59c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 0x7f33a0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.669+0000 7f33be59c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 0x7f33a0069620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f33b800aaf0 tx=0x7f33b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:10.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.672+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33a80517d0 con 0x7f33c006e950 2023-10-09T15:36:10.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:10.908+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f33c004c3c0 con 0x7f33c006e950 2023-10-09T15:36:11.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.524+0000 7f33b67fc700 1 -- 172.21.15.33:0/1414027531 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v43) v1 ==== 104+0+0 (secure 0 0 0) 0x7f33a8054df0 con 0x7f33c006e950 2023-10-09T15:36:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.526+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 msgr2=0x7f33a0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.526+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 0x7f33a0069620 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f33b800aaf0 tx=0x7f33b8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.526+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 msgr2=0x7f33c00c96e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.526+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f33a800c880 tx=0x7f33a8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 shutdown_connections 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33a0067170 0x7f33a0069620 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33c01597e0 0x7f33c00c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33c006c6a0 0x7f33c0168e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 --2- 172.21.15.33:0/1414027531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33c006e950 0x7f33c00c96e0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 >> 172.21.15.33:0/1414027531 conn(0x7f33c00ccb60 msgr2=0x7f33c00c80b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:11.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 shutdown_connections 2023-10-09T15:36:11.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.527+0000 7f33c4d4c700 1 -- 172.21.15.33:0/1414027531 wait complete. 2023-10-09T15:36:11.540 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:36:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.707+0000 7f195531f700 1 Processor -- start 2023-10-09T15:36:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.707+0000 7f195531f700 1 -- start start 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f195531f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19500cd200 0x7f19500cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f195531f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f19501509d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f195531f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19500ce360 con 0x7f19500caeb0 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f195531f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500cb780 con 0x7f19500cd200 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f195531f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500cb970 con 0x7f19500cb320 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f194effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19500cd200 0x7f19500cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f194effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19500cd200 0x7f19500cd5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59090/0 (socket says 172.21.15.33:59090) 2023-10-09T15:36:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f194effd700 1 -- 172.21.15.33:0/4273726461 learned_addr learned my addr 172.21.15.33:0/4273726461 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.708+0000 7f194f7fe700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f19501509d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194effd700 1 -- 172.21.15.33:0/4273726461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 msgr2=0x7f19501509d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194effd700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f19501509d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194effd700 1 -- 172.21.15.33:0/4273726461 >> v1:172.21.15.59:6789/0 conn(0x7f19500caeb0 legacy=0x7f19501502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194effd700 1 -- 172.21.15.33:0/4273726461 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500cbc50 con 0x7f19500cd200 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194effd700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500cd200 0x7f19500cd5d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1940009f70 tx=0x7f1940009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c744a4aeba2042d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194dffb700 1 -- 172.21.15.33:0/4273726461 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000e070 con 0x7f19500cd200 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194dffb700 1 -- 172.21.15.33:0/4273726461 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000ba20 con 0x7f19500cd200 2023-10-09T15:36:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f194dffb700 1 -- 172.21.15.33:0/4273726461 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400092e0 con 0x7f19500cd200 2023-10-09T15:36:11.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f195531f700 1 -- 172.21.15.33:0/4273726461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500cd200 msgr2=0x7f19500cd5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.709+0000 7f195531f700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500cd200 0x7f19500cd5d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f1940009f70 tx=0x7f1940009840 comp rx=0 tx=0).stop 2023-10-09T15:36:11.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 -- 172.21.15.33:0/4273726461 shutdown_connections 2023-10-09T15:36:11.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f19501509d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 --2- 172.21.15.33:0/4273726461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500cd200 0x7f19500cd5d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 -- 172.21.15.33:0/4273726461 >> 172.21.15.33:0/4273726461 conn(0x7f19500999c0 msgr2=0x7f1950070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 -- 172.21.15.33:0/4273726461 shutdown_connections 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.710+0000 7f195531f700 1 -- 172.21.15.33:0/4273726461 wait complete. 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 Processor -- start 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 -- start start 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f1950151b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19500cd200 0x7f19500b45f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.711+0000 7f195531f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19501570d0 con 0x7f19500caeb0 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f195531f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1950152080 con 0x7f19500cd200 2023-10-09T15:36:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f195531f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500b4330 con 0x7f19500cb320 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59106/0 (socket says 172.21.15.33:59106) 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 -- 172.21.15.33:0/2632139711 learned_addr learned my addr 172.21.15.33:0/2632139711 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194f7fe700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19500cd200 0x7f19500b45f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194e7fc700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f1950151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 -- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 msgr2=0x7f1950151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f1950151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 -- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19500cd200 msgr2=0x7f19500b45f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19500cd200 0x7f19500b45f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 -- 172.21.15.33:0/2632139711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940009ae0 con 0x7f19500caeb0 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f194effd700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f194000b6c0 tx=0x7f1940018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19400094e0 con 0x7f19500caeb0 2023-10-09T15:36:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1940008ad0 con 0x7f19500caeb0 2023-10-09T15:36:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1950157330 con 0x7f19500caeb0 2023-10-09T15:36:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940008e90 con 0x7f19500caeb0 2023-10-09T15:36:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.712+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19500b3850 con 0x7f19500caeb0 2023-10-09T15:36:11.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.713+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f195004c3c0 con 0x7f19500caeb0 2023-10-09T15:36:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.714+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f1940003040 con 0x7f19500caeb0 2023-10-09T15:36:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.714+0000 7f1946ffd700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 0x7f1930069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.714+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 5849+0+0 (secure 0 0 0) 0x7f1940086690 con 0x7f19500caeb0 2023-10-09T15:36:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.714+0000 7f194e7fc700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 0x7f1930069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:11.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.715+0000 7f194e7fc700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 0x7f1930069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1950156870 tx=0x7f1938000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:11.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.719+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1940053400 con 0x7f19500caeb0 2023-10-09T15:36:11.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:11.910+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f19500cbf30 con 0x7f19500caeb0 2023-10-09T15:36:12.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.527+0000 7f1946ffd700 1 -- 172.21.15.33:0/2632139711 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v67) v1 ==== 181+0+0 (secure 0 0 0) 0x7f1940056a20 con 0x7f19500caeb0 2023-10-09T15:36:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 msgr2=0x7f1930069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 0x7f1930069620 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f1950156870 tx=0x7f1938000bc0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 msgr2=0x7f1950156b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:12.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f194000b6c0 tx=0x7f1940018000 comp rx=0 tx=0).stop 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 shutdown_connections 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1930067170 0x7f1930069620 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19500caeb0 0x7f1950156b90 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19500cd200 0x7f19500b45f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 --2- 172.21.15.33:0/2632139711 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19500cb320 0x7f1950151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.531+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 >> 172.21.15.33:0/2632139711 conn(0x7f19500999c0 msgr2=0x7f1950159230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.532+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 shutdown_connections 2023-10-09T15:36:12.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.532+0000 7f195531f700 1 -- 172.21.15.33:0/2632139711 wait complete. 2023-10-09T15:36:12.533 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:36:12.547 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:36:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.682+0000 7fc53ef97700 1 Processor -- start 2023-10-09T15:36:12.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.682+0000 7fc53ef97700 1 -- start start 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc5380cb880 0x7fc5380cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc5380b04f0 0x7fc5380cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc5381591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380cead0 con 0x7fc5380b04f0 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5380cf330 con 0x7fc5380cb880 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53ef97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380cddd0 con 0x7fc5380cd5a0 2023-10-09T15:36:12.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc5380b04f0 0x7fc5380cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc5380b04f0 0x7fc5380cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59110/0 (socket says 172.21.15.33:59110) 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 -- 172.21.15.33:0/1226617664 learned_addr learned my addr 172.21.15.33:0/1226617664 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53cd33700 1 --2- 172.21.15.33:0/1226617664 >> v2:172.21.15.59:3300/0 conn(0x7fc5380cb880 0x7fc5380cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc53d534700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc5381591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 -- 172.21.15.33:0/1226617664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 msgr2=0x7fc5381591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc5381591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 -- 172.21.15.33:0/1226617664 >> v2:172.21.15.59:3300/0 conn(0x7fc5380cb880 msgr2=0x7fc5380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 --2- 172.21.15.33:0/1226617664 >> v2:172.21.15.59:3300/0 conn(0x7fc5380cb880 0x7fc5380cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 -- 172.21.15.33:0/1226617664 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5380cece0 con 0x7fc5380b04f0 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc537fff700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380b04f0 0x7fc5380cd060 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc5380ce1c0 tx=0x7fc52c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5702f739ab5f849e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:12.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc5377fe700 1 -- 172.21.15.33:0/1226617664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00b860 con 0x7fc5380b04f0 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc5377fe700 1 -- 172.21.15.33:0/1226617664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c00b9c0 con 0x7fc5380b04f0 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.683+0000 7fc5377fe700 1 -- 172.21.15.33:0/1226617664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c00bd60 con 0x7fc5380b04f0 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 -- 172.21.15.33:0/1226617664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380b04f0 msgr2=0x7fc5380cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380b04f0 0x7fc5380cd060 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fc5380ce1c0 tx=0x7fc52c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 -- 172.21.15.33:0/1226617664 shutdown_connections 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1226617664 >> v2:172.21.15.59:3300/0 conn(0x7fc5380cb880 0x7fc5380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc5381591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1226617664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380b04f0 0x7fc5380cd060 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 -- 172.21.15.33:0/1226617664 >> 172.21.15.33:0/1226617664 conn(0x7fc5380703a0 msgr2=0x7fc5380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 -- 172.21.15.33:0/1226617664 shutdown_connections 2023-10-09T15:36:12.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.684+0000 7fc53ef97700 1 -- 172.21.15.33:0/1226617664 wait complete. 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.685+0000 7fc53ef97700 1 Processor -- start 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.685+0000 7fc53ef97700 1 -- start start 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5380b04f0 0x7fc538158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc53815fa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c8bf0 con 0x7fc5380cb880 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc53815a6d0 con 0x7fc5380b04f0 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53ef97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5380c8eb0 con 0x7fc5380cd5a0 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59122/0 (socket says 172.21.15.33:59122) 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 -- 172.21.15.33:0/1992009613 learned_addr learned my addr 172.21.15.33:0/1992009613 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53cd33700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5380b04f0 0x7fc538158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53d534700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc53815fa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 -- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 msgr2=0x7fc53815fa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc53815fa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 -- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5380b04f0 msgr2=0x7fc538158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:12.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5380b04f0 0x7fc538158200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc537fff700 1 -- 172.21.15.33:0/1992009613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc52c0094f0 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.686+0000 7fc53d534700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc53815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc537fff700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc52c006fd0 tx=0x7fc52c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c011e30 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc52c024440 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc538159e30 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc52c024800 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.687+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc53815a3f0 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.688+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc53804c3c0 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.688+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc52c01a420 con 0x7fc5380cb880 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.689+0000 7fc534ff9700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 0x7fc524069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:12.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.689+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(67..67 src has 1..67) v4 ==== 5411+0+0 (secure 0 0 0) 0x7fc52c0866b0 con 0x7fc5380cb880 2023-10-09T15:36:12.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.689+0000 7fc53cd33700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 0x7fc524069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:12.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.689+0000 7fc53cd33700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 0x7fc524069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc528009fd0 tx=0x7fc528009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:12.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.693+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc52c0537b0 con 0x7fc5380cb880 2023-10-09T15:36:12.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:12.887+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fc5380c8ff0 con 0x7fc5380cb880 2023-10-09T15:36:13.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.534+0000 7fc534ff9700 1 -- 172.21.15.33:0/1992009613 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v68) v1 ==== 169+0+0 (secure 0 0 0) 0x7fc52c056dd0 con 0x7fc5380cb880 2023-10-09T15:36:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 msgr2=0x7fc524069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 0x7fc524069620 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fc528009fd0 tx=0x7fc528009880 comp rx=0 tx=0).stop 2023-10-09T15:36:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 msgr2=0x7fc53815f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fc52c006fd0 tx=0x7fc52c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:13.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 shutdown_connections 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc524067170 0x7fc524069620 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc5380cd5a0 0x7fc53815fa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc5380b04f0 0x7fc538158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 --2- 172.21.15.33:0/1992009613 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc5380cb880 0x7fc53815f500 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 >> 172.21.15.33:0/1992009613 conn(0x7fc5380703a0 msgr2=0x7fc5380d0650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 shutdown_connections 2023-10-09T15:36:13.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.540+0000 7fc53ef97700 1 -- 172.21.15.33:0/1992009613 wait complete. 2023-10-09T15:36:13.542 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:36:13.556 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:36:13.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.682+0000 7f9c392bd700 1 Processor -- start 2023-10-09T15:36:13.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.682+0000 7f9c392bd700 1 -- start start 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c392bd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c3406dc70 0x7f9c34159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c392bd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c3406e0e0 0x7f9c340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c392bd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c340ccfd0 con 0x7f9c34159530 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c392bd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3415a3d0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c392bd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c3415a6b0 con 0x7f9c3406dc70 2023-10-09T15:36:13.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c3406e0e0 0x7f9c340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c32ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9c34159530 0x7f9c340ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54716/0 (socket says 172.21.15.33:54716) 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c32ffd700 1 -- 172.21.15.33:0/2624434365 learned_addr learned my addr 172.21.15.33:0/2624434365 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c327fc700 1 --2- 172.21.15.33:0/2624434365 >> v2:172.21.15.59:3300/0 conn(0x7f9c3406dc70 0x7f9c34159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 -- 172.21.15.33:0/2624434365 >> v2:172.21.15.59:3300/0 conn(0x7f9c3406dc70 msgr2=0x7f9c34159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 --2- 172.21.15.33:0/2624434365 >> v2:172.21.15.59:3300/0 conn(0x7f9c3406dc70 0x7f9c34159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 -- 172.21.15.33:0/2624434365 >> v1:172.21.15.33:6789/0 conn(0x7f9c34159530 legacy=0x7f9c340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 -- 172.21.15.33:0/2624434365 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c3415a990 con 0x7f9c3406e0e0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c31ffb700 1 -- 172.21.15.33:0/2624434365 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 869252581 0 0) 0x7f9c340ccfd0 con 0x7f9c34159530 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.683+0000 7f9c337fe700 1 --2- 172.21.15.33:0/2624434365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340cb6f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9c340b66e0 tx=0x7f9c2c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db8de61b13c80826 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c31ffb700 1 -- 172.21.15.33:0/2624434365 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00b6b0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c31ffb700 1 -- 172.21.15.33:0/2624434365 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c2c00b810 con 0x7f9c3406e0e0 2023-10-09T15:36:13.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c31ffb700 1 -- 172.21.15.33:0/2624434365 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c2c00bbb0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 -- 172.21.15.33:0/2624434365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 msgr2=0x7f9c340cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 --2- 172.21.15.33:0/2624434365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340cb6f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f9c340b66e0 tx=0x7f9c2c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 -- 172.21.15.33:0/2624434365 shutdown_connections 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 --2- 172.21.15.33:0/2624434365 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340cb6f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 --2- 172.21.15.33:0/2624434365 >> v2:172.21.15.59:3300/0 conn(0x7f9c3406dc70 0x7f9c34159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 -- 172.21.15.33:0/2624434365 >> 172.21.15.33:0/2624434365 conn(0x7f9c340703a0 msgr2=0x7f9c340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 -- 172.21.15.33:0/2624434365 shutdown_connections 2023-10-09T15:36:13.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.684+0000 7f9c392bd700 1 -- 172.21.15.33:0/2624434365 wait complete. 2023-10-09T15:36:13.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.685+0000 7f9c392bd700 1 Processor -- start 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.685+0000 7f9c392bd700 1 -- start start 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c3406dc70 0x7f9c3414e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c34159530 0x7f9c340c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c340caa50 con 0x7f9c3406e0e0 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3416ce00 con 0x7f9c34159530 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c392bd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3416d0e0 con 0x7f9c3406dc70 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59146/0 (socket says 172.21.15.33:59146) 2023-10-09T15:36:13.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 -- 172.21.15.33:0/3460589595 learned_addr learned my addr 172.21.15.33:0/3460589595 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 -- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c3406dc70 msgr2=0x7f9c3414e0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c3406dc70 0x7f9c3414e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.686+0000 7f9c327fc700 1 -- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c34159530 msgr2=0x7f9c340c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c327fc700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c34159530 0x7f9c340c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c327fc700 1 -- 172.21.15.33:0/3460589595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c2c009420 con 0x7f9c3406e0e0 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c327fc700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00d890 tx=0x7f9c1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c0125f0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c1c012770 con 0x7f9c3406e0e0 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c3416d3c0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c1c012b30 con 0x7f9c3406e0e0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.687+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c3416dbc0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.688+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3404c3c0 con 0x7f9c3406e0e0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.688+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9c1c01e460 con 0x7f9c3406e0e0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.689+0000 7f9c2affd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 0x7f9c14069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.689+0000 7f9c32ffd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 0x7f9c14069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.689+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9c1c084c40 con 0x7f9c3406e0e0 2023-10-09T15:36:13.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.689+0000 7f9c32ffd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 0x7f9c14069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002090 tx=0x7f9c240015f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:13.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.693+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c1c051f20 con 0x7f9c3406e0e0 2023-10-09T15:36:13.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.895+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9c3415ac70 con 0x7f9c3406e0e0 2023-10-09T15:36:13.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.898+0000 7f9c2affd700 1 -- 172.21.15.33:0/3460589595 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9c1c055540 con 0x7f9c3406e0e0 2023-10-09T15:36:13.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 msgr2=0x7f9c14069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 0x7f9c14069620 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f9c24002090 tx=0x7f9c240015f0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 msgr2=0x7f9c340c6860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:13.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f9c1c00d890 tx=0x7f9c1c008040 comp rx=0 tx=0).stop 2023-10-09T15:36:13.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 shutdown_connections 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c14067170 0x7f9c14069620 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c34159530 0x7f9c340c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c3406dc70 0x7f9c3414e0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 --2- 172.21.15.33:0/3460589595 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c3406e0e0 0x7f9c340c6860 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 >> 172.21.15.33:0/3460589595 conn(0x7f9c340703a0 msgr2=0x7f9c340ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 shutdown_connections 2023-10-09T15:36:13.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:13.901+0000 7f9c392bd700 1 -- 172.21.15.33:0/3460589595 wait complete. 2023-10-09T15:36:13.913 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions' 2023-10-09T15:36:14.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.032+0000 7f74dfdb1700 1 Processor -- start 2023-10-09T15:36:14.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 -- start start 2023-10-09T15:36:14.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74d80cb970 0x7f74d8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d815a400 0x7f74d8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74d815ae40 con 0x7f74d80cb5a0 2023-10-09T15:36:14.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74d80ce0f0 con 0x7f74d80cb970 2023-10-09T15:36:14.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.033+0000 7f74dfdb1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80d13f0 con 0x7f74d815a400 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74d80cb970 0x7f74d8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f74d80cb970 0x7f74d8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59154/0 (socket says 172.21.15.33:59154) 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 -- 172.21.15.33:0/1757035621 learned_addr learned my addr 172.21.15.33:0/1757035621 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 -- 172.21.15.33:0/1757035621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d815a400 msgr2=0x7f74d8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74de34e700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d815a400 0x7f74d8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d815a400 0x7f74d8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 -- 172.21.15.33:0/1757035621 >> v1:172.21.15.59:6789/0 conn(0x7f74d80cb5a0 legacy=0x7f74d80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 -- 172.21.15.33:0/1757035621 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74d815ab60 con 0x7f74d80cb970 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dd34c700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d80cb970 0x7f74d8159ec0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0099b0 tx=0x7f74cc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e0a76a289df782 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dcb4b700 1 -- 172.21.15.33:0/1757035621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00b820 con 0x7f74d80cb970 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dcb4b700 1 -- 172.21.15.33:0/1757035621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74cc00b980 con 0x7f74d80cb970 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.034+0000 7f74dcb4b700 1 -- 172.21.15.33:0/1757035621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74cc00bd20 con 0x7f74d80cb970 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 -- 172.21.15.33:0/1757035621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d80cb970 msgr2=0x7f74d8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d80cb970 0x7f74d8159ec0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f74cc0099b0 tx=0x7f74cc009250 comp rx=0 tx=0).stop 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 -- 172.21.15.33:0/1757035621 shutdown_connections 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d815a400 0x7f74d8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/1757035621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d80cb970 0x7f74d8159ec0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 -- 172.21.15.33:0/1757035621 >> 172.21.15.33:0/1757035621 conn(0x7f74d8070e30 msgr2=0x7f74d80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 -- 172.21.15.33:0/1757035621 shutdown_connections 2023-10-09T15:36:14.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.035+0000 7f74dfdb1700 1 -- 172.21.15.33:0/1757035621 wait complete. 2023-10-09T15:36:14.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.036+0000 7f74dfdb1700 1 Processor -- start 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.036+0000 7f74dfdb1700 1 -- start start 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d80cb5a0 0x7f74d80b60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d80cb970 0x7f74d8169c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80b5010 con 0x7f74d815a400 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80b52f0 con 0x7f74d80cb970 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74d80b55d0 con 0x7f74d80cb5a0 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59164/0 (socket says 172.21.15.33:59164) 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 -- 172.21.15.33:0/2056864288 learned_addr learned my addr 172.21.15.33:0/2056864288 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dd34c700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d80cb970 0x7f74d8169c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74ddb4d700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d80cb5a0 0x7f74d80b60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 -- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d80cb5a0 msgr2=0x7f74d80b60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d80cb5a0 0x7f74d80b60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 -- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d80cb970 msgr2=0x7f74d8169c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d80cb970 0x7f74d8169c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 -- 172.21.15.33:0/2056864288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74cc0094f0 con 0x7f74d815a400 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74de34e700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f74c800cdb0 tx=0x7f74c80077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c800a9d0 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74c800ab30 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74c8017430 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.037+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74d80b58b0 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.038+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74d816a190 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.038+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74d816a3e0 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.039+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f74c8003020 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.039+0000 7f74d5ffb700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 0x7f74c4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.039+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f74c8013070 con 0x7f74d815a400 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.039+0000 7f74ddb4d700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 0x7f74c4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.040+0000 7f74ddb4d700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 0x7f74c4069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74d0003a30 tx=0x7f74d0007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.043+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f74c8051bc0 con 0x7f74d815a400 2023-10-09T15:36:14.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.319+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]} v 0) v1 -- 0x7f74d804c3c0 con 0x7f74d815a400 2023-10-09T15:36:14.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.533+0000 7f74d5ffb700 1 -- 172.21.15.33:0/2056864288 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_pending_subvol_deletions"]}]=0 v242) v1 ==== 158+0+0 (secure 0 0 0) 0x7f74c80078f0 con 0x7f74d815a400 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 msgr2=0x7f74c4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 0x7f74c4069620 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f74d0003a30 tx=0x7f74d0007ea0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 msgr2=0x7f74d80cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f74c800cdb0 tx=0x7f74c80077d0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 shutdown_connections 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f74c4067170 0x7f74c4069620 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f74d815a400 0x7f74d80cf200 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f74d80cb5a0 0x7f74d80b60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 --2- 172.21.15.33:0/2056864288 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f74d80cb970 0x7f74d8169c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 >> 172.21.15.33:0/2056864288 conn(0x7f74d8070e30 msgr2=0x7f74d81552a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:14.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 shutdown_connections 2023-10-09T15:36:14.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.535+0000 7f74dfdb1700 1 -- 172.21.15.33:0/2056864288 wait complete. 2023-10-09T15:36:14.549 INFO:tasks.cephfs_test_runner:Tests the pending_subvolume_deletions in 'fs volume info' command ... ok 2023-10-09T15:36:14.549 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command 2023-10-09T15:36:14.549 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:36:14.550 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-09T15:36:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.669+0000 7f96f1bea700 1 Processor -- start 2023-10-09T15:36:14.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.669+0000 7f96f1bea700 1 -- start start 2023-10-09T15:36:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96f1bea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f96ec0b0ba0 0x7f96ec0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96f1bea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec15a280 con 0x7f96ec0cf200 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96f1bea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96ec06e180 con 0x7f96ec0b07d0 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96f1bea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96ec06d850 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96eaffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f96ec0cf200 0x7f96ec06e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54720/0 (socket says 172.21.15.33:54720) 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96eaffd700 1 -- 172.21.15.33:0/1516793056 learned_addr learned my addr 172.21.15.33:0/1516793056 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ebfff700 1 --2- 172.21.15.33:0/1516793056 >> v2:172.21.15.59:3300/0 conn(0x7f96ec0b0ba0 0x7f96ec0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4279503052 0 0) 0x7f96ec15a280 con 0x7f96ec0cf200 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96d8003570 con 0x7f96ec0cf200 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3092016718 0 0) 0x7f96ec06e180 con 0x7f96ec0b07d0 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f96ec15a280 con 0x7f96ec0b07d0 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ebfff700 1 -- 172.21.15.33:0/1516793056 >> v1:172.21.15.59:6789/0 conn(0x7f96ec0b07d0 legacy=0x7f96ec0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ebfff700 1 -- 172.21.15.33:0/1516793056 >> v1:172.21.15.33:6789/0 conn(0x7f96ec0cf200 legacy=0x7f96ec06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4152940457 0 0) 0x7f96d8003570 con 0x7f96ec0cf200 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.670+0000 7f96ebfff700 1 -- 172.21.15.33:0/1516793056 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96ec06db30 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96ebfff700 1 --2- 172.21.15.33:0/1516793056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0b0ba0 0x7f96ec0c42c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009e60 tx=0x7f96e4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d382907473acc89f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96e400e070 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96e400b7a0 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96ea7fc700 1 -- 172.21.15.33:0/1516793056 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d4001470 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 -- 172.21.15.33:0/1516793056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0b0ba0 msgr2=0x7f96ec0c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 --2- 172.21.15.33:0/1516793056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0b0ba0 0x7f96ec0c42c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f96e4009e60 tx=0x7f96e4009780 comp rx=0 tx=0).stop 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 -- 172.21.15.33:0/1516793056 shutdown_connections 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 --2- 172.21.15.33:0/1516793056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0b0ba0 0x7f96ec0c42c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 -- 172.21.15.33:0/1516793056 >> 172.21.15.33:0/1516793056 conn(0x7f96ec06ce80 msgr2=0x7f96ec0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 -- 172.21.15.33:0/1516793056 shutdown_connections 2023-10-09T15:36:14.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.671+0000 7f96f1bea700 1 -- 172.21.15.33:0/1516793056 wait complete. 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.672+0000 7f96f1bea700 1 Processor -- start 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 -- start start 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96ec0b0ba0 0x7f96ec0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0cf200 0x7f96ec0980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c71a0 con 0x7f96ec0b07d0 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6590 con 0x7f96ec0cf200 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96f1bea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96ec0c6870 con 0x7f96ec0b0ba0 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59174/0 (socket says 172.21.15.33:59174) 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.673+0000 7f96eb7fe700 1 -- 172.21.15.33:0/2108015435 learned_addr learned my addr 172.21.15.33:0/2108015435 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96ebfff700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0cf200 0x7f96ec0980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 -- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96ec0b0ba0 msgr2=0x7f96ec0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96ec0b0ba0 0x7f96ec0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 -- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0cf200 msgr2=0x7f96ec0980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0cf200 0x7f96ec0980d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:14.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 -- 172.21.15.33:0/2108015435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e4009a20 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96eb7fe700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c560 tx=0x7f96dc007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc010510 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc010670 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96ec0c6b50 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc010a30 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.674+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96ec0b1cb0 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.675+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96ec04c3c0 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.675+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f96dc002050 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.676+0000 7f96e37fe700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 0x7f96cc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.676+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f96dc084010 con 0x7f96ec0b07d0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.676+0000 7f96eaffd700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 0x7f96cc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:14.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.676+0000 7f96eaffd700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 0x7f96cc069620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d40011e0 tx=0x7f96d4001320 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.680+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f96dc0512f0 con 0x7f96ec0b07d0 2023-10-09T15:36:14.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:14.950+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7f96ec06de10 con 0x7f96ec0b07d0 2023-10-09T15:36:15.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.537+0000 7f96e37fe700 1 -- 172.21.15.33:0/2108015435 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v243) v1 ==== 161+0+0 (secure 0 0 0) 0x7f96dc054910 con 0x7f96ec0b07d0 2023-10-09T15:36:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 msgr2=0x7f96cc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 0x7f96cc069620 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f96d40011e0 tx=0x7f96d4001320 comp rx=0 tx=0).stop 2023-10-09T15:36:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 msgr2=0x7f96ec14b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f96dc00c560 tx=0x7f96dc007e00 comp rx=0 tx=0).stop 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 shutdown_connections 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f96cc067170 0x7f96cc069620 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f96ec0b07d0 0x7f96ec14b660 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f96ec0cf200 0x7f96ec0980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 --2- 172.21.15.33:0/2108015435 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f96ec0b0ba0 0x7f96ec0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 >> 172.21.15.33:0/2108015435 conn(0x7f96ec06ce80 msgr2=0x7f96ec0c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 shutdown_connections 2023-10-09T15:36:15.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.540+0000 7f96f1bea700 1 -- 172.21.15.33:0/2108015435 wait complete. 2023-10-09T15:36:15.555 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:36:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.679+0000 7ff1459c0700 1 Processor -- start 2023-10-09T15:36:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.679+0000 7ff1459c0700 1 -- start start 2023-10-09T15:36:15.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff1459c0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff14006dc70 0x7ff140159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff1459c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff1459c0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1400ccfd0 con 0x7ff140159530 2023-10-09T15:36:15.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff1459c0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14015a3d0 con 0x7ff14006dc70 2023-10-09T15:36:15.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff1459c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14015a6b0 con 0x7ff14006e0e0 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff140159530 0x7ff1400ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54732/0 (socket says 172.21.15.33:54732) 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff14006dc70 0x7ff140159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13effd700 1 -- 172.21.15.33:0/3978017555 learned_addr learned my addr 172.21.15.33:0/3978017555 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13f7fe700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 -- 172.21.15.33:0/3978017555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 msgr2=0x7ff1400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 -- 172.21.15.33:0/3978017555 >> v1:172.21.15.33:6789/0 conn(0x7ff140159530 legacy=0x7ff1400ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13dffb700 1 -- 172.21.15.33:0/3978017555 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2972463549 0 0) 0x7ff1400ccfd0 con 0x7ff140159530 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 -- 172.21.15.33:0/3978017555 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14015a990 con 0x7ff14006dc70 2023-10-09T15:36:15.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13f7fe700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13e7fc700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14006dc70 0x7ff140159900 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff1280098e0 tx=0x7ff1280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac07788f8d240f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13dffb700 1 -- 172.21.15.33:0/3978017555 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128009e80 con 0x7ff14006dc70 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13dffb700 1 -- 172.21.15.33:0/3978017555 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff12800b860 con 0x7ff14006dc70 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.680+0000 7ff13dffb700 1 -- 172.21.15.33:0/3978017555 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff12800bbe0 con 0x7ff14006dc70 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 -- 172.21.15.33:0/3978017555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14006dc70 msgr2=0x7ff140159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14006dc70 0x7ff140159900 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7ff1280098e0 tx=0x7ff1280091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 -- 172.21.15.33:0/3978017555 shutdown_connections 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 --2- 172.21.15.33:0/3978017555 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14006dc70 0x7ff140159900 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 -- 172.21.15.33:0/3978017555 >> 172.21.15.33:0/3978017555 conn(0x7ff1400703a0 msgr2=0x7ff1400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 -- 172.21.15.33:0/3978017555 shutdown_connections 2023-10-09T15:36:15.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.681+0000 7ff1459c0700 1 -- 172.21.15.33:0/3978017555 wait complete. 2023-10-09T15:36:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.682+0000 7ff1459c0700 1 Processor -- start 2023-10-09T15:36:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.682+0000 7ff1459c0700 1 -- start start 2023-10-09T15:36:15.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14006dc70 0x7ff140156c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c9590 con 0x7ff140159530 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c86e0 con 0x7ff14006dc70 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff1459c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1400c8980 con 0x7ff14006e0e0 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59200/0 (socket says 172.21.15.33:59200) 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 -- 172.21.15.33:0/164190904 learned_addr learned my addr 172.21.15.33:0/164190904 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 -- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 msgr2=0x7ff1400c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13e7fc700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13effd700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14006dc70 0x7ff140156c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 -- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14006dc70 msgr2=0x7ff140156c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14006dc70 0x7ff140156c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.683+0000 7ff13f7fe700 1 -- 172.21.15.33:0/164190904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff128009420 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff13f7fe700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d0d0 tx=0x7ff1380099f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff13800dd70 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff13800f040 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1400c8c60 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff138015690 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.684+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1400c9220 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.685+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1400c9740 con 0x7ff140159530 2023-10-09T15:36:15.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.685+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff13801e3b0 con 0x7ff140159530 2023-10-09T15:36:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.686+0000 7ff136ffd700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 0x7ff120069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.686+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff138084cb0 con 0x7ff140159530 2023-10-09T15:36:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.686+0000 7ff13effd700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 0x7ff120069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:15.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.686+0000 7ff13effd700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 0x7ff120069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff1300016b0 tx=0x7ff130009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:15.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.690+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff1400c9740 con 0x7ff140159530 2023-10-09T15:36:15.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.882+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff14004c3c0 con 0x7ff140159530 2023-10-09T15:36:15.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.886+0000 7ff136ffd700 1 -- 172.21.15.33:0/164190904 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff13801a0c0 con 0x7ff140159530 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 msgr2=0x7ff120069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 0x7ff120069620 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7ff1300016b0 tx=0x7ff130009040 comp rx=0 tx=0).stop 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 msgr2=0x7ff1400c9a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7ff13800d0d0 tx=0x7ff1380099f0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 shutdown_connections 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff120067170 0x7ff120069620 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff140159530 0x7ff1400c9a20 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14006dc70 0x7ff140156c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 --2- 172.21.15.33:0/164190904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14006e0e0 0x7ff1400c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 >> 172.21.15.33:0/164190904 conn(0x7ff1400703a0 msgr2=0x7ff1400d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 shutdown_connections 2023-10-09T15:36:15.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:15.888+0000 7ff1459c0700 1 -- 172.21.15.33:0/164190904 wait complete. 2023-10-09T15:36:15.901 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:36:15.902 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:15.939 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:15.984 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:36:15.984 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:36:15.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:16.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.102+0000 7f6207262700 1 Processor -- start 2023-10-09T15:36:16.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.102+0000 7f6207262700 1 -- start start 2023-10-09T15:36:16.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.103+0000 7f6207262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.103+0000 7f6207262700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62000cb1a0 0x7f62000cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.103+0000 7f6207262700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620015e010 con 0x7f62001598a0 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.103+0000 7f6207262700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620015d420 con 0x7f62000cb1a0 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.103+0000 7f6207262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620015d6e0 con 0x7f62001594d0 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f6204ffe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62000cb1a0 0x7f62000cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62000cb1a0 0x7f62000cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:45204/0 (socket says 172.21.15.33:45204) 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f6204ffe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:33974/0 (socket says 172.21.15.33:33974) 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f62057ff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f62001598a0 0x7f62000ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36760/0 (socket says 172.21.15.33:36760) 2023-10-09T15:36:16.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 -- 172.21.15.33:0/4288221003 learned_addr learned my addr 172.21.15.33:0/4288221003 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 -- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 msgr2=0x7f62000cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 -- 172.21.15.33:0/4288221003 >> v1:172.21.15.59:6789/0 conn(0x7f62001598a0 legacy=0x7f62000ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 -- 172.21.15.33:0/4288221003 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620015d9c0 con 0x7f62000cb1a0 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f6204ffe700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61fffff700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62000cb1a0 0x7f62000cefb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61f00099b0 tx=0x7f61f0009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=27c1602d721dc1bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.104+0000 7f61ff7fe700 1 -- 172.21.15.33:0/4288221003 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f0009ea0 con 0x7f62000cb1a0 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f61ff7fe700 1 -- 172.21.15.33:0/4288221003 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f000b860 con 0x7f62000cb1a0 2023-10-09T15:36:16.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f61ff7fe700 1 -- 172.21.15.33:0/4288221003 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f000bc00 con 0x7f62000cb1a0 2023-10-09T15:36:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 -- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62000cb1a0 msgr2=0x7f62000cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62000cb1a0 0x7f62000cefb0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f61f00099b0 tx=0x7f61f0009250 comp rx=0 tx=0).stop 2023-10-09T15:36:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 -- 172.21.15.33:0/4288221003 shutdown_connections 2023-10-09T15:36:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 --2- 172.21.15.33:0/4288221003 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62000cb1a0 0x7f62000cefb0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 -- 172.21.15.33:0/4288221003 >> 172.21.15.33:0/4288221003 conn(0x7f62000703a0 msgr2=0x7f6200070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 -- 172.21.15.33:0/4288221003 shutdown_connections 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.105+0000 7f6207262700 1 -- 172.21.15.33:0/4288221003 wait complete. 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.106+0000 7f6207262700 1 Processor -- start 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.106+0000 7f6207262700 1 -- start start 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000c7f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 0x7f62000c8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000b3490 con 0x7f62000cb1a0 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620016adb0 con 0x7f62001598a0 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6207262700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62000c8ad0 con 0x7f62001594d0 2023-10-09T15:36:16.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6204ffe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6204ffe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59204/0 (socket says 172.21.15.33:59204) 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.107+0000 7f6204ffe700 1 -- 172.21.15.33:0/652115630 learned_addr learned my addr 172.21.15.33:0/652115630 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f62057ff700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 0x7f62000c8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f61fffff700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000c7f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 -- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 msgr2=0x7f62000c7f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000c7f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 -- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 msgr2=0x7f62000c8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 0x7f62000c8490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 -- 172.21.15.33:0/652115630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e8009420 con 0x7f62000cb1a0 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f62057ff700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 0x7f62000c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6204ffe700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f61e800ec80 tx=0x7f61e80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e800ca60 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f00094f0 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e800cbc0 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e8013470 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.108+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62000c9090 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.109+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620016b090 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.109+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f61e8013820 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.110+0000 7f61fcff9700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 0x7f61e0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.110+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(68..68 src has 1..68) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f61e8084bb0 con 0x7f62000cb1a0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.110+0000 7f61fffff700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 0x7f61e0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.110+0000 7f61fffff700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 0x7f61e0069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61f00099b0 tx=0x7f61f0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.114+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61e8051df0 con 0x7f62000cb1a0 2023-10-09T15:36:16.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.351+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62000c93d0 con 0x7f62000cb1a0 2023-10-09T15:36:16.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.352+0000 7f61fcff9700 1 -- 172.21.15.33:0/652115630 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 43 v43) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f61e8021de0 con 0x7f62000cb1a0 2023-10-09T15:36:16.353 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:16.353 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":43,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5117,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1620007676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1620007676},{"type":"v1","addr":"172.21.15.59:6834","nonce":1620007676}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5120,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2152204648","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2152204648},{"type":"v1","addr":"172.21.15.59:6835","nonce":2152204648}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":5697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6835/4105304119","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":4105304119},{"type":"v1","addr":"172.21.15.33:6835","nonce":4105304119}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6033,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4118466754","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6836","nonce":4118466754},{"type":"v1","addr":"172.21.15.33:6837","nonce":4118466754}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":43}],"filesystems":[]} 2023-10-09T15:36:16.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 msgr2=0x7f61e0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 0x7f61e0069620 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f61f00099b0 tx=0x7f61f0017000 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 msgr2=0x7f6200149980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f61e800ec80 tx=0x7f61e80091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 shutdown_connections 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61e0067170 0x7f61e0069620 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62000cb1a0 0x7f6200149980 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001598a0 0x7f62000c8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 --2- 172.21.15.33:0/652115630 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001594d0 0x7f62000c7f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 >> 172.21.15.33:0/652115630 conn(0x7f62000703a0 msgr2=0x7f620015ec50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:16.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 shutdown_connections 2023-10-09T15:36:16.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.354+0000 7f6207262700 1 -- 172.21.15.33:0/652115630 wait complete. 2023-10-09T15:36:16.357 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 43 2023-10-09T15:36:16.367 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:36:16.368 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:36:16.368 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:36:16.368 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:16.368 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:36:16.368 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:36:16.369 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:36:16.369 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:16.369 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:36:16.369 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:36:16.369 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:36:16.369 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:16.370 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:36:16.370 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:36:16.370 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:36:16.370 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:16.377 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:36:16.377 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:36:16.378 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:36:16.378 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:36:16.381 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:36:16.381 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:36:16.381 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:36:16.382 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:36:16.419 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:36:16.419 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:16.420 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:36:16.420 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:16.423 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:36:16.423 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:16.424 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:36:16.424 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:16.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:36:16.495 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:36:16.495 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:36:16.509 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:36:16.509 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:36:16.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.551+0000 7f2af4209700 1 Processor -- start 2023-10-09T15:36:16.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.551+0000 7f2af4209700 1 -- start start 2023-10-09T15:36:16.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af4209700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 0x7f2aec158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af4209700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 0x7f2aec0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af4209700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2aec158c80 con 0x7f2aec1508c0 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af4209700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2aec15afc0 con 0x7f2aec150c90 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af4209700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec0af820 con 0x7f2aec15a7d0 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af1fa5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2aec1508c0 0x7f2aec15a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54768/0 (socket says 172.21.15.33:54768) 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af1fa5700 1 -- 172.21.15.33:0/2254182629 learned_addr learned my addr 172.21.15.33:0/2254182629 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af17a4700 1 --2- 172.21.15.33:0/2254182629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 0x7f2aec158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af27a6700 1 --2- 172.21.15.33:0/2254182629 >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 0x7f2aec0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af17a4700 1 -- 172.21.15.33:0/2254182629 >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 msgr2=0x7f2aec0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af17a4700 1 --2- 172.21.15.33:0/2254182629 >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 0x7f2aec0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af17a4700 1 -- 172.21.15.33:0/2254182629 >> v1:172.21.15.33:6789/0 conn(0x7f2aec1508c0 legacy=0x7f2aec15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af17a4700 1 -- 172.21.15.33:0/2254182629 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2aec155710 con 0x7f2aec15a7d0 2023-10-09T15:36:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.552+0000 7f2af27a6700 1 --2- 172.21.15.33:0/2254182629 >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 0x7f2aec0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:16.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.553+0000 7f2af17a4700 1 --2- 172.21.15.33:0/2254182629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 0x7f2aec158650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0098e0 tx=0x7f2adc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b2e1e206cbf7afb4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.554+0000 7f2af0fa3700 1 -- 172.21.15.33:0/2254182629 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00b640 con 0x7f2aec15a7d0 2023-10-09T15:36:16.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.554+0000 7f2af0fa3700 1 -- 172.21.15.33:0/2254182629 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2adc00b7a0 con 0x7f2aec15a7d0 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.554+0000 7f2af0fa3700 1 -- 172.21.15.33:0/2254182629 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2adc00bb40 con 0x7f2aec15a7d0 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.554+0000 7f2af4209700 1 -- 172.21.15.33:0/2254182629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 msgr2=0x7f2aec158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.554+0000 7f2af4209700 1 --2- 172.21.15.33:0/2254182629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 0x7f2aec158650 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2adc0098e0 tx=0x7f2adc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 -- 172.21.15.33:0/2254182629 shutdown_connections 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 --2- 172.21.15.33:0/2254182629 >> v2:172.21.15.59:3300/0 conn(0x7f2aec150c90 0x7f2aec0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 --2- 172.21.15.33:0/2254182629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec15a7d0 0x7f2aec158650 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 -- 172.21.15.33:0/2254182629 >> 172.21.15.33:0/2254182629 conn(0x7f2aec0cded0 msgr2=0x7f2aec06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:16.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 -- 172.21.15.33:0/2254182629 shutdown_connections 2023-10-09T15:36:16.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.555+0000 7f2af4209700 1 -- 172.21.15.33:0/2254182629 wait complete. 2023-10-09T15:36:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.556+0000 7f2af4209700 1 Processor -- start 2023-10-09T15:36:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.556+0000 7f2af4209700 1 -- start start 2023-10-09T15:36:16.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec1508c0 0x7f2aec14a130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec150c90 0x7f2aec159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec14cce0 con 0x7f2aec15a7d0 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec14a670 con 0x7f2aec1508c0 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af4209700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2aec151fc0 con 0x7f2aec150c90 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59222/0 (socket says 172.21.15.33:59222) 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 -- 172.21.15.33:0/248976740 learned_addr learned my addr 172.21.15.33:0/248976740 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:16.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af1fa5700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec1508c0 0x7f2aec14a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af17a4700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec150c90 0x7f2aec159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 -- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec150c90 msgr2=0x7f2aec159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec150c90 0x7f2aec159c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 -- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec1508c0 msgr2=0x7f2aec14a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec1508c0 0x7f2aec14a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 -- 172.21.15.33:0/248976740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ae4009a20 con 0x7f2aec15a7d0 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.557+0000 7f2af27a6700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009fc0 tx=0x7f2ae400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.558+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae400cbd0 con 0x7f2aec15a7d0 2023-10-09T15:36:16.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.558+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ae400f040 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.558+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2adc009420 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.558+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ae4014480 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.558+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aec152580 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.559+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aec0b2580 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.559+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2ae4003020 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.559+0000 7f2ae1ffb700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 0x7f2ad0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.560+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2ae4085090 con 0x7f2aec15a7d0 2023-10-09T15:36:16.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.560+0000 7f2af1fa5700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 0x7f2ad0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.560+0000 7f2af1fa5700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 0x7f2ad0069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8001950 tx=0x7f2ae8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:16.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.564+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2ae4052170 con 0x7f2aec15a7d0 2023-10-09T15:36:16.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:16.771+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f2aec1544d0 con 0x7f2aec15a7d0 2023-10-09T15:36:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.557+0000 7f2ae1ffb700 1 -- 172.21.15.33:0/248976740 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v73) v1 ==== 97+0+0 (secure 0 0 0) 0x7f2ae4055790 con 0x7f2aec15a7d0 2023-10-09T15:36:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 msgr2=0x7f2ad0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 0x7f2ad0069620 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f2ae8001950 tx=0x7f2ae8009040 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 msgr2=0x7f2aec15a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f2ae4009fc0 tx=0x7f2ae400b040 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 shutdown_connections 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2ad0067170 0x7f2ad0069620 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2aec15a7d0 0x7f2aec15a160 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2aec1508c0 0x7f2aec14a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 --2- 172.21.15.33:0/248976740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2aec150c90 0x7f2aec159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 >> 172.21.15.33:0/248976740 conn(0x7f2aec0cded0 msgr2=0x7f2aec068210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 shutdown_connections 2023-10-09T15:36:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.560+0000 7f2af4209700 1 -- 172.21.15.33:0/248976740 wait complete. 2023-10-09T15:36:17.563 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:36:17.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:36:17.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 Processor -- start 2023-10-09T15:36:17.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 -- start start 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff50815d440 0x7ff5080aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50806c6a0 0x7ff50806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff50806d050 con 0x7ff50815d810 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff50815a750 con 0x7ff50815d440 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.702+0000 7ff50e567700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50815e3a0 con 0x7ff50806c6a0 2023-10-09T15:36:17.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff50815d440 0x7ff5080aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff50815d440 0x7ff5080aec90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59238/0 (socket says 172.21.15.33:59238) 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 -- 172.21.15.33:0/3766103183 learned_addr learned my addr 172.21.15.33:0/3766103183 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff5077fe700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50806c6a0 0x7ff50806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 -- 172.21.15.33:0/3766103183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50806c6a0 msgr2=0x7ff50806cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50806c6a0 0x7ff50806cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 -- 172.21.15.33:0/3766103183 >> v1:172.21.15.33:6789/0 conn(0x7ff50815d810 legacy=0x7ff50815dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 -- 172.21.15.33:0/3766103183 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff508159e40 con 0x7ff50815d440 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff507fff700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d440 0x7ff5080aec90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=159a67ec41d067ad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff506ffd700 1 -- 172.21.15.33:0/3766103183 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00b860 con 0x7ff50815d440 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff506ffd700 1 -- 172.21.15.33:0/3766103183 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4fc00b9c0 con 0x7ff50815d440 2023-10-09T15:36:17.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.703+0000 7ff506ffd700 1 -- 172.21.15.33:0/3766103183 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4fc00bd60 con 0x7ff50815d440 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 -- 172.21.15.33:0/3766103183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d440 msgr2=0x7ff5080aec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d440 0x7ff5080aec90 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc009250 comp rx=0 tx=0).stop 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 -- 172.21.15.33:0/3766103183 shutdown_connections 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d440 0x7ff5080aec90 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 --2- 172.21.15.33:0/3766103183 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50806c6a0 0x7ff50806cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 -- 172.21.15.33:0/3766103183 >> 172.21.15.33:0/3766103183 conn(0x7ff50806f190 msgr2=0x7ff5080ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 -- 172.21.15.33:0/3766103183 shutdown_connections 2023-10-09T15:36:17.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.704+0000 7ff50e567700 1 -- 172.21.15.33:0/3766103183 wait complete. 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.705+0000 7ff50e567700 1 Processor -- start 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.705+0000 7ff50e567700 1 -- start start 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50806c6a0 0x7ff5080b1a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50815d440 0x7ff5081699a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff508159630 con 0x7ff50815d810 2023-10-09T15:36:17.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080b09c0 con 0x7ff50806c6a0 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50e567700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5080b0ca0 con 0x7ff50815d440 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59242/0 (socket says 172.21.15.33:59242) 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 -- 172.21.15.33:0/3696287366 learned_addr learned my addr 172.21.15.33:0/3696287366 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff5077fe700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50815d440 0x7ff5081699a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff507fff700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50806c6a0 0x7ff5080b1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 -- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50815d440 msgr2=0x7ff5081699a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50815d440 0x7ff5081699a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 -- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50806c6a0 msgr2=0x7ff5080b1a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50806c6a0 0x7ff5080b1a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.706+0000 7ff50cb04700 1 -- 172.21.15.33:0/3696287366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4fc0094f0 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff50cb04700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c8e0 tx=0x7ff500001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000ce80 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50000a7e0 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5080b0f80 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50000ab80 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.707+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5080b1540 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.708+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50804c3c0 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.708+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ff500012420 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.709+0000 7ff4effff700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 0x7ff4f4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.709+0000 7ff507fff700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 0x7ff4f4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.709+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ff5000847e0 con 0x7ff50815d810 2023-10-09T15:36:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.709+0000 7ff507fff700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 0x7ff4f4069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:17.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.713+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff500051b10 con 0x7ff50815d810 2023-10-09T15:36:17.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.986+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7ff5080af300 con 0x7ff50815d810 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.987+0000 7ff4effff700 1 -- 172.21.15.33:0/3696287366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7ff500055130 con 0x7ff50815d810 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:36:17.988 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.989 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:17.990 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.991 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:36:17.992 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.993 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.994 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.995 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.996 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.997 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:17.998 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:36:17.999 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:18.000 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:18.001 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:18.002 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:18.003 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:18.004 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:36:18.005 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:18.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.006 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:18.006 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:36:18.006 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 msgr2=0x7ff4f4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 0x7ff4f4069620 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7ff4fc0099b0 tx=0x7ff4fc017000 comp rx=0 tx=0).stop 2023-10-09T15:36:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 msgr2=0x7ff508169ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7ff50000c8e0 tx=0x7ff500001710 comp rx=0 tx=0).stop 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 shutdown_connections 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4f4067170 0x7ff4f4069620 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff50815d810 0x7ff508169ee0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff50806c6a0 0x7ff5080b1a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 --2- 172.21.15.33:0/3696287366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff50815d440 0x7ff5081699a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 >> 172.21.15.33:0/3696287366 conn(0x7ff50806f190 msgr2=0x7ff50814e050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 shutdown_connections 2023-10-09T15:36:18.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:17.989+0000 7ff50e567700 1 -- 172.21.15.33:0/3696287366 wait complete. 2023-10-09T15:36:18.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:18.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 Processor -- start 2023-10-09T15:36:18.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 -- start start 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00a90d0 0x7f70b006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 0x7f70b00af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70b00aeee0 con 0x7f70b00a8d00 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70b006e820 con 0x7f70b00a90d0 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.128+0000 7f70b5b1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b00ae680 con 0x7f70b006e380 2023-10-09T15:36:18.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00a90d0 0x7f70b006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70b00a90d0 0x7f70b006de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59250/0 (socket says 172.21.15.33:59250) 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 -- 172.21.15.33:0/3488860589 learned_addr learned my addr 172.21.15.33:0/3488860589 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70affff700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 0x7f70b00af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 -- 172.21.15.33:0/3488860589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 msgr2=0x7f70b00af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 0x7f70b00af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 -- 172.21.15.33:0/3488860589 >> v1:172.21.15.59:6789/0 conn(0x7f70b00a8d00 legacy=0x7f70b00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 -- 172.21.15.33:0/3488860589 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70b00cf490 con 0x7f70b00a90d0 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70affff700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 0x7f70b00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70aeffd700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a90d0 0x7f70b006de40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009990 tx=0x7f70a4009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc539ec0da6c08de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70ae7fc700 1 -- 172.21.15.33:0/3488860589 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4005c10 con 0x7f70b00a90d0 2023-10-09T15:36:18.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70ae7fc700 1 -- 172.21.15.33:0/3488860589 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4005d70 con 0x7f70b00a90d0 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.129+0000 7f70ae7fc700 1 -- 172.21.15.33:0/3488860589 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a400b880 con 0x7f70b00a90d0 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 -- 172.21.15.33:0/3488860589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a90d0 msgr2=0x7f70b006de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a90d0 0x7f70b006de40 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f70a4009990 tx=0x7f70a4009220 comp rx=0 tx=0).stop 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 -- 172.21.15.33:0/3488860589 shutdown_connections 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b006e380 0x7f70b00af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/3488860589 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a90d0 0x7f70b006de40 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 -- 172.21.15.33:0/3488860589 >> 172.21.15.33:0/3488860589 conn(0x7f70b006ce80 msgr2=0x7f70b00ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 -- 172.21.15.33:0/3488860589 shutdown_connections 2023-10-09T15:36:18.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.130+0000 7f70b5b1d700 1 -- 172.21.15.33:0/3488860589 wait complete. 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.131+0000 7f70b5b1d700 1 Processor -- start 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.131+0000 7f70b5b1d700 1 -- start start 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 0x7f70b015b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 0x7f70b016b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b01587a0 con 0x7f70b00a8d00 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015b380 con 0x7f70b006e380 2023-10-09T15:36:18.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70b5b1d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70b015def0 con 0x7f70b00a90d0 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59264/0 (socket says 172.21.15.33:59264) 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 -- 172.21.15.33:0/2122471664 learned_addr learned my addr 172.21.15.33:0/2122471664 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70affff700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 0x7f70b016b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 0x7f70b015b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 -- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 msgr2=0x7f70b016b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 0x7f70b016b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 -- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 msgr2=0x7f70b015b810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 0x7f70b015b810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 -- 172.21.15.33:0/2122471664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70a4009480 con 0x7f70b00a8d00 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70affff700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 0x7f70b016b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 0x7f70b015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:18.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.132+0000 7f70aeffd700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005d40 tx=0x7f70a4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.133+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a4011a60 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.133+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70a4011bc0 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.133+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70b015a770 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.133+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70a401b430 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.133+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70b015ad30 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.134+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70b015b510 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.134+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f70a401b820 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.134+0000 7f70977fe700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.134+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f70a4085e40 con 0x7f70b00a8d00 2023-10-09T15:36:18.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.134+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.135+0000 7f70af7fe700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001870 tx=0x7f70a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.138+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70a4053170 con 0x7f70b00a8d00 2023-10-09T15:36:18.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.336+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f70b004c3c0 con 0x7f70b00a8d00 2023-10-09T15:36:18.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.337+0000 7f70977fe700 1 -- 172.21.15.33:0/2122471664 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v73) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f70a402a090 con 0x7f70b00a8d00 2023-10-09T15:36:18.338 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:18.338 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":73,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:17.555828+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":64,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":61,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:18.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 msgr2=0x7f709c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f70a0001870 tx=0x7f70a0009040 comp rx=0 tx=0).stop 2023-10-09T15:36:18.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 msgr2=0x7f70b015eb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f70a4005d40 tx=0x7f70a4016000 comp rx=0 tx=0).stop 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 shutdown_connections 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f709c067170 0x7f709c069620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70b00a90d0 0x7f70b016b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70b006e380 0x7f70b015b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 --2- 172.21.15.33:0/2122471664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70b00a8d00 0x7f70b015eb00 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 >> 172.21.15.33:0/2122471664 conn(0x7f70b006ce80 msgr2=0x7f70b00af1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 shutdown_connections 2023-10-09T15:36:18.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.339+0000 7f70b5b1d700 1 -- 172.21.15.33:0/2122471664 wait complete. 2023-10-09T15:36:18.352 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:36:18.353 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:36:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.474+0000 7fc13dddf700 1 Processor -- start 2023-10-09T15:36:18.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.474+0000 7fc13dddf700 1 -- start start 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc13dddf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc13806dc70 0x7fc138159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc13dddf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1380ccfd0 con 0x7fc13806e0e0 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc13dddf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc13815a3d0 con 0x7fc138159530 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc13dddf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc13815a6b0 con 0x7fc13806dc70 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc13806dc70 0x7fc138159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc13806dc70 0x7fc138159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59276/0 (socket says 172.21.15.33:59276) 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 -- 172.21.15.33:0/849687098 learned_addr learned my addr 172.21.15.33:0/849687098 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc137fff700 1 --1- 172.21.15.33:0/849687098 >> v1:172.21.15.33:6789/0 conn(0x7fc13806e0e0 0x7fc1380cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54790/0 (socket says 172.21.15.33:54790) 2023-10-09T15:36:18.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 -- 172.21.15.33:0/849687098 >> v1:172.21.15.59:6789/0 conn(0x7fc138159530 legacy=0x7fc1380ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 -- 172.21.15.33:0/849687098 >> v1:172.21.15.33:6789/0 conn(0x7fc13806e0e0 legacy=0x7fc1380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.475+0000 7fc136ffd700 1 -- 172.21.15.33:0/849687098 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc13815a990 con 0x7fc13806dc70 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc136ffd700 1 --2- 172.21.15.33:0/849687098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806dc70 0x7fc138159900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0099b0 tx=0x7fc12c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dce74d703780671a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc1367fc700 1 -- 172.21.15.33:0/849687098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00b860 con 0x7fc13806dc70 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc1367fc700 1 -- 172.21.15.33:0/849687098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c00b9c0 con 0x7fc13806dc70 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc1367fc700 1 -- 172.21.15.33:0/849687098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c00bd60 con 0x7fc13806dc70 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 -- 172.21.15.33:0/849687098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806dc70 msgr2=0x7fc138159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 --2- 172.21.15.33:0/849687098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806dc70 0x7fc138159900 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc12c0099b0 tx=0x7fc12c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 -- 172.21.15.33:0/849687098 shutdown_connections 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 --2- 172.21.15.33:0/849687098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806dc70 0x7fc138159900 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 -- 172.21.15.33:0/849687098 >> 172.21.15.33:0/849687098 conn(0x7fc1380703a0 msgr2=0x7fc1380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 -- 172.21.15.33:0/849687098 shutdown_connections 2023-10-09T15:36:18.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.476+0000 7fc13dddf700 1 -- 172.21.15.33:0/849687098 wait complete. 2023-10-09T15:36:18.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 Processor -- start 2023-10-09T15:36:18.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 -- start start 2023-10-09T15:36:18.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13806dc70 0x7fc1381537a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc138159530 0x7fc13814e1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc138155fb0 con 0x7fc13806e0e0 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b39c0 con 0x7fc13806dc70 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc13dddf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1380b3c40 con 0x7fc138159530 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc136ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc136ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59286/0 (socket says 172.21.15.33:59286) 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.478+0000 7fc136ffd700 1 -- 172.21.15.33:0/4065615084 learned_addr learned my addr 172.21.15.33:0/4065615084 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc137fff700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc138159530 0x7fc13814e1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc1377fe700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13806dc70 0x7fc1381537a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 -- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc138159530 msgr2=0x7fc13814e1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc138159530 0x7fc13814e1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 -- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13806dc70 msgr2=0x7fc1381537a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13806dc70 0x7fc1381537a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 -- 172.21.15.33:0/4065615084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0094f0 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc136ffd700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc138089650 tx=0x7fc12c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c011ea0 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12c01a630 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1380b3f20 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12c01a9d0 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.479+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1380b44e0 con 0x7fc13806e0e0 2023-10-09T15:36:18.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.480+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc138155d80 con 0x7fc13806e0e0 2023-10-09T15:36:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.480+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fc12c02d440 con 0x7fc13806e0e0 2023-10-09T15:36:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.481+0000 7fc11f7fe700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 0x7fc124069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.481+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fc12c085ff0 con 0x7fc13806e0e0 2023-10-09T15:36:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.481+0000 7fc1377fe700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 0x7fc124069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.481+0000 7fc1377fe700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 0x7fc124069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc128001760 tx=0x7fc128009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.485+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc138155d80 con 0x7fc13806e0e0 2023-10-09T15:36:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.678+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fc138155d80 con 0x7fc13806e0e0 2023-10-09T15:36:18.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.679+0000 7fc11f7fe700 1 -- 172.21.15.33:0/4065615084 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v73) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc138155d80 con 0x7fc13806e0e0 2023-10-09T15:36:18.680 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:36:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 msgr2=0x7fc124069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 0x7fc124069620 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fc128001760 tx=0x7fc128009040 comp rx=0 tx=0).stop 2023-10-09T15:36:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 msgr2=0x7fc1380b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc138089650 tx=0x7fc12c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:18.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 shutdown_connections 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc124067170 0x7fc124069620 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc138159530 0x7fc13814e1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc13806dc70 0x7fc1381537a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 --2- 172.21.15.33:0/4065615084 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc13806e0e0 0x7fc1380b3480 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 >> 172.21.15.33:0/4065615084 conn(0x7fc1380703a0 msgr2=0x7fc13815b200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 shutdown_connections 2023-10-09T15:36:18.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.681+0000 7fc13dddf700 1 -- 172.21.15.33:0/4065615084 wait complete. 2023-10-09T15:36:18.694 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:36:18.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.812+0000 7fea69d0a700 1 Processor -- start 2023-10-09T15:36:18.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.812+0000 7fea69d0a700 1 -- start start 2023-10-09T15:36:18.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea69d0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea640cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea69d0a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6415ae40 con 0x7fea640cde50 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea69d0a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea6415ab60 con 0x7fea640cd9e0 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea69d0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea640d13f0 con 0x7fea640cb5a0 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea63fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fea640cde50 0x7fea64156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54792/0 (socket says 172.21.15.33:54792) 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea63fff700 1 -- 172.21.15.33:0/2845545990 learned_addr learned my addr 172.21.15.33:0/2845545990 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.813+0000 7fea637fe700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea640cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2417519774 0 0) 0x7fea6415ae40 con 0x7fea640cde50 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea4c003570 con 0x7fea640cde50 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 910312548 0 0) 0x7fea4c003570 con 0x7fea640cde50 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 msgr2=0x7fea640cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea640cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 >> v1:172.21.15.59:6789/0 conn(0x7fea640cd9e0 legacy=0x7fea64159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea640ccf00 con 0x7fea640cde50 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fea5c0017f0 con 0x7fea640cde50 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 >> v1:172.21.15.33:6789/0 conn(0x7fea640cde50 legacy=0x7fea64156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea4c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea4c004060 0x7fea4c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4c004d50 0x7fea4c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c00bbf0 con 0x7fea4c004060 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c00bd60 con 0x7fea4c004d50 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea4c00bf20 con 0x7fea640cb5a0 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea4c004060 0x7fea4c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea637fe700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea4c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea63fff700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4c004d50 0x7fea4c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 -- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 msgr2=0x7fea4c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea640cb5a0 0x7fea4c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 -- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4c004d50 msgr2=0x7fea4c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea4c004d50 0x7fea4c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.814+0000 7fea62ffd700 1 -- 172.21.15.33:0/2845545990 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4c003570 con 0x7fea4c004060 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea4c004060 0x7fea4c004810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fea580018b0 tx=0x7fea58007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aee821a95873326 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58012420 con 0x7fea4c004060 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58012580 con 0x7fea4c004060 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea627fc700 1 -- 172.21.15.33:0/2845545990 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58012920 con 0x7fea4c004060 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 -- 172.21.15.33:0/2845545990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea4c004060 msgr2=0x7fea4c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2845545990 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea4c004060 0x7fea4c004810 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fea580018b0 tx=0x7fea58007d30 comp rx=0 tx=0).stop 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea63fff700 1 -- 172.21.15.33:0/2845545990 reap_dead start 2023-10-09T15:36:18.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 -- 172.21.15.33:0/2845545990 shutdown_connections 2023-10-09T15:36:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 -- 172.21.15.33:0/2845545990 >> 172.21.15.33:0/2845545990 conn(0x7fea64070e30 msgr2=0x7fea640d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 -- 172.21.15.33:0/2845545990 shutdown_connections 2023-10-09T15:36:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.815+0000 7fea69d0a700 1 -- 172.21.15.33:0/2845545990 wait complete. 2023-10-09T15:36:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 Processor -- start 2023-10-09T15:36:18.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 -- start start 2023-10-09T15:36:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea4c004060 0x7fea64154d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64155ca0 0x7fea64156110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64156650 con 0x7fea6415cbc0 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea64155270 con 0x7fea64155ca0 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea69d0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea6415bb20 con 0x7fea4c004060 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea62ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59300/0 (socket says 172.21.15.33:59300) 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.817+0000 7fea62ffd700 1 -- 172.21.15.33:0/2803534639 learned_addr learned my addr 172.21.15.33:0/2803534639 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea637fe700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea4c004060 0x7fea64154d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea63fff700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64155ca0 0x7fea64156110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 -- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea4c004060 msgr2=0x7fea64154d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea4c004060 0x7fea64154d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 -- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64155ca0 msgr2=0x7fea64156110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64155ca0 0x7fea64156110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:18.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 -- 172.21.15.33:0/2803534639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea6415be00 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea62ffd700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fea58007db0 tx=0x7fea58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58006a30 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea58006bb0 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea6415c0e0 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea58007030 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.818+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea6415c6a0 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.819+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea6404c3c0 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.820+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fea58007460 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.820+0000 7fea4b7fe700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 0x7fea50069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.820+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fea58085310 con 0x7fea6415cbc0 2023-10-09T15:36:18.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.820+0000 7fea637fe700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 0x7fea50069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.820+0000 7fea637fe700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 0x7fea50069650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea54006f00 tx=0x7fea540091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:18.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:18.824+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea58052640 con 0x7fea6415cbc0 2023-10-09T15:36:19.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.022+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fea640cd1e0 con 0x7fea6415cbc0 2023-10-09T15:36:19.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.022+0000 7fea4b7fe700 1 -- 172.21.15.33:0/2803534639 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v73) v1 ==== 84+0+65 (secure 0 0 0) 0x7fea58055c60 con 0x7fea6415cbc0 2023-10-09T15:36:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:19.023 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:36:19.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:36:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:36:19.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:19.024 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 msgr2=0x7fea50069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 0x7fea50069650 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fea54006f00 tx=0x7fea540091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 msgr2=0x7fea640b59d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7fea58007db0 tx=0x7fea58015000 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 shutdown_connections 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea500671a0 0x7fea50069650 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea64155ca0 0x7fea64156110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea4c004060 0x7fea64154d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 --2- 172.21.15.33:0/2803534639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea6415cbc0 0x7fea640b59d0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 >> 172.21.15.33:0/2803534639 conn(0x7fea64070e30 msgr2=0x7fea640c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:19.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 shutdown_connections 2023-10-09T15:36:19.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.024+0000 7fea69d0a700 1 -- 172.21.15.33:0/2803534639 wait complete. 2023-10-09T15:36:19.037 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:36:19.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:36:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.161+0000 7fb932481700 1 Processor -- start 2023-10-09T15:36:19.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.161+0000 7fb932481700 1 -- start start 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 0x7fb92c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb92c06dcf0 0x7fb92c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92c0ccfd0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb92c15a410 con 0x7fb92c159530 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb932481700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c15a6f0 con 0x7fb92c159e40 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb92b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb92c06dcf0 0x7fb92c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb92b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb92c06dcf0 0x7fb92c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59302/0 (socket says 172.21.15.33:59302) 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.162+0000 7fb92b7fe700 1 -- 172.21.15.33:0/1471804660 learned_addr learned my addr 172.21.15.33:0/1471804660 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb930a1e700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92bfff700 1 --2- 172.21.15.33:0/1471804660 >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 0x7fb92c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 -- 172.21.15.33:0/1471804660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 msgr2=0x7fb92c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 -- 172.21.15.33:0/1471804660 >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 msgr2=0x7fb92c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/1471804660 >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 0x7fb92c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 -- 172.21.15.33:0/1471804660 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb92c15a9d0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb930a1e700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:19.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92bfff700 1 --2- 172.21.15.33:0/1471804660 >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 0x7fb92c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c159900 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb92c06d630 tx=0x7fb91c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85a94502416db10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92affd700 1 -- 172.21.15.33:0/1471804660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00b860 con 0x7fb92c06dcf0 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92affd700 1 -- 172.21.15.33:0/1471804660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb91c00b9c0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb92affd700 1 -- 172.21.15.33:0/1471804660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb91c00bd60 con 0x7fb92c06dcf0 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 -- 172.21.15.33:0/1471804660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 msgr2=0x7fb92c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c159900 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb92c06d630 tx=0x7fb91c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 -- 172.21.15.33:0/1471804660 shutdown_connections 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 --2- 172.21.15.33:0/1471804660 >> v2:172.21.15.59:3300/0 conn(0x7fb92c159530 0x7fb92c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.163+0000 7fb932481700 1 --2- 172.21.15.33:0/1471804660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c159900 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.164+0000 7fb932481700 1 -- 172.21.15.33:0/1471804660 >> 172.21.15.33:0/1471804660 conn(0x7fb92c0703a0 msgr2=0x7fb92c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.164+0000 7fb932481700 1 -- 172.21.15.33:0/1471804660 shutdown_connections 2023-10-09T15:36:19.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.164+0000 7fb932481700 1 -- 172.21.15.33:0/1471804660 wait complete. 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 Processor -- start 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 -- start start 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb92c159530 0x7fb92c0b1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.165+0000 7fb932481700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0b2600 con 0x7fb92c06dcf0 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb932481700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0b19f0 con 0x7fb92c159530 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb932481700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb92c0b1cd0 con 0x7fb92c159e40 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59304/0 (socket says 172.21.15.33:59304) 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 -- 172.21.15.33:0/2277697119 learned_addr learned my addr 172.21.15.33:0/2277697119 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb92c159530 0x7fb92c0b1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb930a1e700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 -- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 msgr2=0x7fb92c0c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 -- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb92c159530 msgr2=0x7fb92c0b1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb92c159530 0x7fb92c0b1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 -- 172.21.15.33:0/2277697119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb91c0094f0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb92bfff700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c880 tx=0x7fb914008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011600 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb914011760 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb914011ae0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb92c0b1fb0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.166+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb92c1415c0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.167+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb92c04c3c0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.168+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fb914010350 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.168+0000 7fb923fff700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 0x7fb90c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.168+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb9140845b0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.168+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 0x7fb90c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.169+0000 7fb92b7fe700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 0x7fb90c069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb92c06d630 tx=0x7fb91c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.172+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb914055260 con 0x7fb92c06dcf0 2023-10-09T15:36:19.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.365+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fb92c15acb0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.565+0000 7fb923fff700 1 -- 172.21.15.33:0/2277697119 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v74) v1 ==== 138+0+0 (secure 0 0 0) 0x7fb914054df0 con 0x7fb92c06dcf0 2023-10-09T15:36:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 msgr2=0x7fb90c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 0x7fb90c069620 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb92c06d630 tx=0x7fb91c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 msgr2=0x7fb92c141080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb91400c880 tx=0x7fb914008040 comp rx=0 tx=0).stop 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 shutdown_connections 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb90c067170 0x7fb90c069620 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb92c06dcf0 0x7fb92c141080 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb92c159e40 0x7fb92c0c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 --2- 172.21.15.33:0/2277697119 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb92c159530 0x7fb92c0b1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.568+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 >> 172.21.15.33:0/2277697119 conn(0x7fb92c0703a0 msgr2=0x7fb92c0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:19.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.569+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 shutdown_connections 2023-10-09T15:36:19.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.569+0000 7fb932481700 1 -- 172.21.15.33:0/2277697119 wait complete. 2023-10-09T15:36:19.572 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:36:19.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:36:19.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.710+0000 7f9c4751d700 1 Processor -- start 2023-10-09T15:36:19.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.710+0000 7f9c4751d700 1 -- start start 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c4751d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c40159530 0x7f9c400ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c4751d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c4006dc70 0x7f9c40159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c4751d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c400ccfd0 con 0x7f9c4006e0e0 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c4751d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c400cf0e0 con 0x7f9c4006dc70 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c4751d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c4015a3d0 con 0x7f9c40159530 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c4006dc70 0x7f9c40159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c4006dc70 0x7f9c40159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59310/0 (socket says 172.21.15.33:59310) 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 -- 172.21.15.33:0/75956436 learned_addr learned my addr 172.21.15.33:0/75956436 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c45aba700 1 --1- 172.21.15.33:0/75956436 >> v1:172.21.15.33:6789/0 conn(0x7f9c4006e0e0 0x7f9c400cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54796/0 (socket says 172.21.15.33:54796) 2023-10-09T15:36:19.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c452b9700 1 --2- 172.21.15.33:0/75956436 >> v2:172.21.15.59:3300/0 conn(0x7f9c40159530 0x7f9c400ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 -- 172.21.15.33:0/75956436 >> v2:172.21.15.59:3300/0 conn(0x7f9c40159530 msgr2=0x7f9c400ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 --2- 172.21.15.33:0/75956436 >> v2:172.21.15.59:3300/0 conn(0x7f9c40159530 0x7f9c400ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 -- 172.21.15.33:0/75956436 >> v1:172.21.15.33:6789/0 conn(0x7f9c4006e0e0 legacy=0x7f9c400cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c44ab8700 1 -- 172.21.15.33:0/75956436 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c4015a6b0 con 0x7f9c4006dc70 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.711+0000 7f9c3ffff700 1 -- 172.21.15.33:0/75956436 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2367441015 0 0) 0x7f9c400ccfd0 con 0x7f9c4006e0e0 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c44ab8700 1 --2- 172.21.15.33:0/75956436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40159900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006d630 tx=0x7f9c34009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae824aa11ddcb5bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c3ffff700 1 -- 172.21.15.33:0/75956436 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c34009e70 con 0x7f9c4006dc70 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c3ffff700 1 -- 172.21.15.33:0/75956436 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3400b860 con 0x7f9c4006dc70 2023-10-09T15:36:19.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c3ffff700 1 -- 172.21.15.33:0/75956436 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3400bc00 con 0x7f9c4006dc70 2023-10-09T15:36:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 -- 172.21.15.33:0/75956436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 msgr2=0x7f9c40159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 --2- 172.21.15.33:0/75956436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40159900 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006d630 tx=0x7f9c34009250 comp rx=0 tx=0).stop 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 -- 172.21.15.33:0/75956436 shutdown_connections 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 --2- 172.21.15.33:0/75956436 >> v2:172.21.15.59:3300/0 conn(0x7f9c40159530 0x7f9c400ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 --2- 172.21.15.33:0/75956436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40159900 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 -- 172.21.15.33:0/75956436 >> 172.21.15.33:0/75956436 conn(0x7f9c400703a0 msgr2=0x7f9c400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 -- 172.21.15.33:0/75956436 shutdown_connections 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.712+0000 7f9c4751d700 1 -- 172.21.15.33:0/75956436 wait complete. 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.713+0000 7f9c4751d700 1 Processor -- start 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 -- start start 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c4006e0e0 0x7f9c400c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 0x7f9c400c8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40142fc0 con 0x7f9c4006dc70 2023-10-09T15:36:19.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c40169f30 con 0x7f9c40159530 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c4751d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c4016b290 con 0x7f9c4006e0e0 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c452b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c452b9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59320/0 (socket says 172.21.15.33:59320) 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.714+0000 7f9c452b9700 1 -- 172.21.15.33:0/1065406425 learned_addr learned my addr 172.21.15.33:0/1065406425 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c45aba700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 0x7f9c400c8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c44ab8700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c4006e0e0 0x7f9c400c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 -- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c4006e0e0 msgr2=0x7f9c400c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c4006e0e0 0x7f9c400c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 -- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 msgr2=0x7f9c400c8ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 0x7f9c400c8ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 -- 172.21.15.33:0/1065406425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c340094f0 con 0x7f9c4006dc70 2023-10-09T15:36:19.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c45aba700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 0x7f9c400c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c452b9700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009e80 tx=0x7f9c3800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c3800cc20 con 0x7f9c4006dc70 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c3800f040 con 0x7f9c4006dc70 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c400c9340 con 0x7f9c4006dc70 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c38014480 con 0x7f9c4006dc70 2023-10-09T15:36:19.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.715+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c4016af20 con 0x7f9c4006dc70 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.716+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c4016ad80 con 0x7f9c4006dc70 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.717+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9c380147f0 con 0x7f9c4006dc70 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.717+0000 7f9c3d7fa700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 0x7f9c2c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.717+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f9c38085460 con 0x7f9c4006dc70 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.717+0000 7f9c44ab8700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 0x7f9c2c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:19.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.717+0000 7f9c44ab8700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 0x7f9c2c069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006d630 tx=0x7f9c34017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:19.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.721+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c4016ad80 con 0x7f9c4006dc70 2023-10-09T15:36:19.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:19.917+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f9c4016ad80 con 0x7f9c4006dc70 2023-10-09T15:36:20.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.567+0000 7f9c3d7fa700 1 -- 172.21.15.33:0/1065406425 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v75) v1 ==== 170+0+0 (secure 0 0 0) 0x7f9c4016ad80 con 0x7f9c4006dc70 2023-10-09T15:36:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.570+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 msgr2=0x7f9c2c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.570+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 0x7f9c2c069620 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9c4006d630 tx=0x7f9c34017000 comp rx=0 tx=0).stop 2023-10-09T15:36:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 msgr2=0x7f9c40142a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f9c38009e80 tx=0x7f9c3800b040 comp rx=0 tx=0).stop 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 shutdown_connections 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c2c067170 0x7f9c2c069620 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c4006dc70 0x7f9c40142a80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c40159530 0x7f9c400c8ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 --2- 172.21.15.33:0/1065406425 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c4006e0e0 0x7f9c400c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 >> 172.21.15.33:0/1065406425 conn(0x7f9c400703a0 msgr2=0x7f9c400cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 shutdown_connections 2023-10-09T15:36:20.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.571+0000 7f9c4751d700 1 -- 172.21.15.33:0/1065406425 wait complete. 2023-10-09T15:36:20.578 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:36:20.598 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:36:20.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.722+0000 7ffb10beb700 1 Processor -- start 2023-10-09T15:36:20.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.722+0000 7ffb10beb700 1 -- start start 2023-10-09T15:36:20.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.723+0000 7ffb10beb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.723+0000 7ffb10beb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb0c06a110 0x7ffb0c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.723+0000 7ffb10beb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb0c06d7b0 con 0x7ffb0c0cc6f0 2023-10-09T15:36:20.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.723+0000 7ffb10beb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c06a570 con 0x7ffb0c0cc320 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.723+0000 7ffb10beb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb0c06f7d0 con 0x7ffb0c06a110 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56116/0 (socket says 172.21.15.33:56116) 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 -- 172.21.15.33:0/3901925571 learned_addr learned my addr 172.21.15.33:0/3901925571 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0ad9d700 1 --2- 172.21.15.33:0/3901925571 >> v2:172.21.15.59:3300/0 conn(0x7ffb0c06a110 0x7ffb0c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 -- 172.21.15.33:0/3901925571 >> v2:172.21.15.59:3300/0 conn(0x7ffb0c06a110 msgr2=0x7ffb0c13c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 --2- 172.21.15.33:0/3901925571 >> v2:172.21.15.59:3300/0 conn(0x7ffb0c06a110 0x7ffb0c13c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 -- 172.21.15.33:0/3901925571 >> v1:172.21.15.59:6789/0 conn(0x7ffb0c0cc6f0 legacy=0x7ffb0c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 -- 172.21.15.33:0/3901925571 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c06e330 con 0x7ffb0c0cc320 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0a59c700 1 --2- 172.21.15.33:0/3901925571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c154440 tx=0x7ffb04009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ee390b541078ab server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0959a700 1 -- 172.21.15.33:0/3901925571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400e070 con 0x7ffb0c0cc320 2023-10-09T15:36:20.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0959a700 1 -- 172.21.15.33:0/3901925571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400ba40 con 0x7ffb0c0cc320 2023-10-09T15:36:20.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.724+0000 7ffb0959a700 1 -- 172.21.15.33:0/3901925571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb040092e0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 -- 172.21.15.33:0/3901925571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 msgr2=0x7ffb0c13c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 --2- 172.21.15.33:0/3901925571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c154440 tx=0x7ffb04009840 comp rx=0 tx=0).stop 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 -- 172.21.15.33:0/3901925571 shutdown_connections 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 --2- 172.21.15.33:0/3901925571 >> v2:172.21.15.59:3300/0 conn(0x7ffb0c06a110 0x7ffb0c13c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 --2- 172.21.15.33:0/3901925571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c13c2a0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 -- 172.21.15.33:0/3901925571 >> 172.21.15.33:0/3901925571 conn(0x7ffb0c067f00 msgr2=0x7ffb0c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:20.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 -- 172.21.15.33:0/3901925571 shutdown_connections 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.725+0000 7ffb10beb700 1 -- 172.21.15.33:0/3901925571 wait complete. 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.726+0000 7ffb10beb700 1 Processor -- start 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.726+0000 7ffb10beb700 1 -- start start 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0c06a110 0x7ffb0c0abe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0c0cc6f0 0x7ffb0c0a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0c8e70 con 0x7ffb0c0cc320 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0aa250 con 0x7ffb0c0cc6f0 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb10beb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c0aa530 con 0x7ffb0c06a110 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56120/0 (socket says 172.21.15.33:56120) 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 -- 172.21.15.33:0/406368616 learned_addr learned my addr 172.21.15.33:0/406368616 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb0ad9d700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0c0cc6f0 0x7ffb0c0a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb0a59c700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0c06a110 0x7ffb0c0abe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 -- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0c06a110 msgr2=0x7ffb0c0abe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0c06a110 0x7ffb0c0abe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 -- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0c0cc6f0 msgr2=0x7ffb0c0a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0c0cc6f0 0x7ffb0c0a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 -- 172.21.15.33:0/406368616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb04009ae0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.727+0000 7ffb09d9b700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c4e0 tx=0x7ffaf400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.728+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011590 con 0x7ffb0c0cc320 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.728+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf4011710 con 0x7ffb0c0cc320 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.728+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c0aa810 con 0x7ffb0c0cc320 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.728+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4011ad0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.728+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c0ac350 con 0x7ffb0c0cc320 2023-10-09T15:36:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.729+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c04c3c0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.729+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7ffaf401b3b0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.730+0000 7ffb027fc700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 0x7ffaec0696f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:20.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.730+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 5605+0+0 (secure 0 0 0) 0x7ffaf4083bd0 con 0x7ffb0c0cc320 2023-10-09T15:36:20.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.730+0000 7ffb0a59c700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 0x7ffaec0696f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:20.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.730+0000 7ffb0a59c700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 0x7ffaec0696f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009ea0 tx=0x7ffb04018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:20.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.734+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffaf4050c90 con 0x7ffb0c0cc320 2023-10-09T15:36:20.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:20.973+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ffb0c06da00 con 0x7ffb0c0cc320 2023-10-09T15:36:21.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.583+0000 7ffb027fc700 1 -- 172.21.15.33:0/406368616 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) v1 ==== 174+0+0 (secure 0 0 0) 0x7ffaf4017070 con 0x7ffb0c0cc320 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.588+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 msgr2=0x7ffaec0696f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.588+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 0x7ffaec0696f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009ea0 tx=0x7ffb04018000 comp rx=0 tx=0).stop 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 msgr2=0x7ffb0c1528f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7ffaf400c4e0 tx=0x7ffaf400c7f0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 shutdown_connections 2023-10-09T15:36:21.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffaec067240 0x7ffaec0696f0 secure :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7ffb04009ea0 tx=0x7ffb04018000 comp rx=0 tx=0).stop 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0c0cc6f0 0x7ffb0c0a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0c06a110 0x7ffb0c0abe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 --2- 172.21.15.33:0/406368616 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0c0cc320 0x7ffb0c1528f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 >> 172.21.15.33:0/406368616 conn(0x7ffb0c067f00 msgr2=0x7ffb0c0b2680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.589+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 shutdown_connections 2023-10-09T15:36:21.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.590+0000 7ffb10beb700 1 -- 172.21.15.33:0/406368616 wait complete. 2023-10-09T15:36:21.592 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 12 and data pool 13 2023-10-09T15:36:21.607 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:21.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.731+0000 7fed90b00700 1 Processor -- start 2023-10-09T15:36:21.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.732+0000 7fed90b00700 1 -- start start 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.732+0000 7fed90b00700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fed8c1598b0 0x7fed8c0af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed90b00700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0ce9d0 con 0x7fed8c159c80 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed90b00700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed8c0afc30 con 0x7fed8c0af790 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed90b00700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed8c0aff10 con 0x7fed8c1598b0 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed89d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fed8c159c80 0x7fed8c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51582/0 (socket says 172.21.15.33:51582) 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed89d9b700 1 -- 172.21.15.33:0/2184901924 learned_addr learned my addr 172.21.15.33:0/2184901924 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8a59c700 1 --2- 172.21.15.33:0/2184901924 >> v2:172.21.15.59:3300/0 conn(0x7fed8c1598b0 0x7fed8c0af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2364245522 0 0) 0x7fed8c0ce9d0 con 0x7fed8c159c80 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed78003570 con 0x7fed8c159c80 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 373324332 0 0) 0x7fed78003570 con 0x7fed8c159c80 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 >> v2:172.21.15.59:3300/0 conn(0x7fed8c1598b0 msgr2=0x7fed8c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 --2- 172.21.15.33:0/2184901924 >> v2:172.21.15.59:3300/0 conn(0x7fed8c1598b0 0x7fed8c0af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 >> v1:172.21.15.59:6789/0 conn(0x7fed8c0af790 legacy=0x7fed8c163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0ce380 con 0x7fed8c159c80 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fed74001470 con 0x7fed8c159c80 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 >> v1:172.21.15.33:6789/0 conn(0x7fed8c159c80 legacy=0x7fed8c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78003a60 0x7fed78003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed78004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed780051c0 0x7fed7800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0aff10 con 0x7fed78004810 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed7800c0d0 con 0x7fed78003a60 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7800c290 con 0x7fed780051c0 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.733+0000 7fed89d9b700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed78004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8a59c700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78003a60 0x7fed78003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8ad9d700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed780051c0 0x7fed7800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 -- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed780051c0 msgr2=0x7fed7800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed780051c0 0x7fed7800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 -- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78003a60 msgr2=0x7fed78003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed78003a60 0x7fed78003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 -- 172.21.15.33:0/2184901924 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed78003570 con 0x7fed78004810 2023-10-09T15:36:21.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8ad9d700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed780051c0 0x7fed7800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8ad9d700 1 -- 172.21.15.33:0/2184901924 reap_dead start 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed89d9b700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed78004c80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c3c0 tx=0x7fed74001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7220af51b75f6fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed7400cc90 con 0x7fed78004810 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed7400cdf0 con 0x7fed78004810 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.734+0000 7fed8959a700 1 -- 172.21.15.33:0/2184901924 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed74005b50 con 0x7fed78004810 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 -- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 msgr2=0x7fed78004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed78004c80 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fed7400c3c0 tx=0x7fed74001e50 comp rx=0 tx=0).stop 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 -- 172.21.15.33:0/2184901924 shutdown_connections 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 --2- 172.21.15.33:0/2184901924 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed78004c80 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 -- 172.21.15.33:0/2184901924 >> 172.21.15.33:0/2184901924 conn(0x7fed8c070e30 msgr2=0x7fed8c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 -- 172.21.15.33:0/2184901924 shutdown_connections 2023-10-09T15:36:21.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.735+0000 7fed90b00700 1 -- 172.21.15.33:0/2184901924 wait complete. 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.736+0000 7fed90b00700 1 Processor -- start 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.736+0000 7fed90b00700 1 -- start start 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.736+0000 7fed90b00700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.736+0000 7fed90b00700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 0x7fed8c0c6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed8c14b0b0 0x7fed8c0b22e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0c6b70 con 0x7fed78004810 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b4530 con 0x7fed8c14b0b0 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed8c0b4810 con 0x7fed8c0b55d0 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56138/0 (socket says 172.21.15.33:56138) 2023-10-09T15:36:21.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 -- 172.21.15.33:0/1963848397 learned_addr learned my addr 172.21.15.33:0/1963848397 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed89d9b700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 0x7fed8c0c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8ad9d700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed8c14b0b0 0x7fed8c0b22e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 -- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 msgr2=0x7fed8c0c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 0x7fed8c0c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 -- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed8c14b0b0 msgr2=0x7fed8c0b22e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed8c14b0b0 0x7fed8c0b22e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 -- 172.21.15.33:0/1963848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0b4af0 con 0x7fed78004810 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed89d9b700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 0x7fed8c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed8a59c700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fed84011f80 tx=0x7fed8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400e040 con 0x7fed78004810 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400f040 con 0x7fed78004810 2023-10-09T15:36:21.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8c0b4dd0 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84015430 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.737+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed8c14b530 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.738+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed8c14b7b0 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.739+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fed840157e0 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.739+0000 7fed827fc700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 0x7fed6c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.739+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed84085760 con 0x7fed78004810 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.739+0000 7fed89d9b700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 0x7fed6c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:21.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.740+0000 7fed89d9b700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 0x7fed6c069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed74001ed0 tx=0x7fed74015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:21.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.744+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed840560c0 con 0x7fed78004810 2023-10-09T15:36:21.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.940+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed8c04c3c0 con 0x7fed78004810 2023-10-09T15:36:21.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.941+0000 7fed827fc700 1 -- 172.21.15.33:0/1963848397 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) v1 ==== 74+0+15318 (secure 0 0 0) 0x7fed84055c50 con 0x7fed78004810 2023-10-09T15:36:21.942 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:21.942 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":76,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:20.975286+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 msgr2=0x7fed6c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 0x7fed6c069620 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fed74001ed0 tx=0x7fed74015000 comp rx=0 tx=0).stop 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 msgr2=0x7fed8c0b3ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fed84011f80 tx=0x7fed8400b040 comp rx=0 tx=0).stop 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 shutdown_connections 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed6c067170 0x7fed6c069620 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed78004810 0x7fed8c0b3ec0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed8c14b0b0 0x7fed8c0b22e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 --2- 172.21.15.33:0/1963848397 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed8c0b55d0 0x7fed8c0c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:21.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 >> 172.21.15.33:0/1963848397 conn(0x7fed8c070e30 msgr2=0x7fed8c15fc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:21.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 shutdown_connections 2023-10-09T15:36:21.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:21.943+0000 7fed90b00700 1 -- 172.21.15.33:0/1963848397 wait complete. 2023-10-09T15:36:21.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:22.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.075+0000 7f03593a3700 1 Processor -- start 2023-10-09T15:36:22.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.075+0000 7f03593a3700 1 -- start start 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03593a3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03540cb5a0 0x7f03540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03593a3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035415ae40 con 0x7f035415a5d0 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03593a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f035415ab60 con 0x7f03540cd9e0 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03593a3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03540d13f0 con 0x7f03540cb5a0 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03537fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f035415a5d0 0x7f0354156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51596/0 (socket says 172.21.15.33:51596) 2023-10-09T15:36:22.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f03537fe700 1 -- 172.21.15.33:0/546765394 learned_addr learned my addr 172.21.15.33:0/546765394 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0352ffd700 1 --2- 172.21.15.33:0/546765394 >> v2:172.21.15.59:3300/0 conn(0x7f03540cb5a0 0x7f03540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4095926479 0 0) 0x7f035415ae40 con 0x7f035415a5d0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0340003570 con 0x7f035415a5d0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3749905491 0 0) 0x7f0340003570 con 0x7f035415a5d0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 >> v2:172.21.15.59:3300/0 conn(0x7f03540cb5a0 msgr2=0x7f03540cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 --2- 172.21.15.33:0/546765394 >> v2:172.21.15.59:3300/0 conn(0x7f03540cb5a0 0x7f03540cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 >> v1:172.21.15.59:6789/0 conn(0x7f03540cd9e0 legacy=0x7f0354159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540ccf00 con 0x7f035415a5d0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.076+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0344001470 con 0x7f035415a5d0 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 >> v1:172.21.15.33:6789/0 conn(0x7f035415a5d0 legacy=0x7f0354156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0340003a60 0x7f0340003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f0340004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03400051c0 0x7f034000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034000c050 con 0x7f0340004810 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f034000c190 con 0x7f0340003a60 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f034000c350 con 0x7f03400051c0 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f0340004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0352ffd700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0340003a60 0x7f0340003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03537fe700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03400051c0 0x7f034000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 -- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03400051c0 msgr2=0x7f034000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03400051c0 0x7f034000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 -- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0340003a60 msgr2=0x7f0340003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0340003a60 0x7f0340003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03537fe700 1 -- 172.21.15.33:0/546765394 reap_dead start 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 -- 172.21.15.33:0/546765394 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0340003570 con 0x7f0340004810 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f03527fc700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f0340004c80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f033c0019a0 tx=0x7f033c007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8191c7ad0d538f75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00c5d0 con 0x7f0340004810 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f033c00c730 con 0x7f0340004810 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.077+0000 7f0351ffb700 1 -- 172.21.15.33:0/546765394 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f033c00cad0 con 0x7f0340004810 2023-10-09T15:36:22.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 -- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 msgr2=0x7f0340004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f0340004c80 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f033c0019a0 tx=0x7f033c007d10 comp rx=0 tx=0).stop 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 -- 172.21.15.33:0/546765394 shutdown_connections 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 --2- 172.21.15.33:0/546765394 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f0340004c80 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 -- 172.21.15.33:0/546765394 >> 172.21.15.33:0/546765394 conn(0x7f0354070e30 msgr2=0x7f03540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 -- 172.21.15.33:0/546765394 shutdown_connections 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.078+0000 7f03593a3700 1 -- 172.21.15.33:0/546765394 wait complete. 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.079+0000 7f03593a3700 1 Processor -- start 2023-10-09T15:36:22.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.079+0000 7f03593a3700 1 -- start start 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0354152a20 0x7f0354152e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03540c8e40 0x7f03540c92a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03541538e0 con 0x7f0340004810 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03540c89b0 con 0x7f0354152a20 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03593a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03541533d0 con 0x7f03540c8e40 2023-10-09T15:36:22.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56150/0 (socket says 172.21.15.33:56150) 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 -- 172.21.15.33:0/1976624872 learned_addr learned my addr 172.21.15.33:0/1976624872 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03537fe700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03540c8e40 0x7f03540c92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f03527fc700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0354152a20 0x7f0354152e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 -- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03540c8e40 msgr2=0x7f03540c92a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03540c8e40 0x7f03540c92a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 -- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0354152a20 msgr2=0x7f0354152e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0354152a20 0x7f0354152e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 -- 172.21.15.33:0/1976624872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03540c7da0 con 0x7f0340004810 2023-10-09T15:36:22.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.080+0000 7f0352ffd700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e20 tx=0x7f034c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c00e040 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f034c00f040 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03540c8080 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f034c015430 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03540c8640 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.081+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f035404c3c0 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.083+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f034c015820 con 0x7f0340004810 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.083+0000 7f034affd700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 0x7f0334069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.083+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(76..76 src has 1..76) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f034c085b00 con 0x7f0340004810 2023-10-09T15:36:22.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.083+0000 7f03527fc700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 0x7f0334069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.084+0000 7f03527fc700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 0x7f0334069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f033c001730 tx=0x7f033c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.087+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f034c052a50 con 0x7f0340004810 2023-10-09T15:36:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.283+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03540b2c20 con 0x7f0340004810 2023-10-09T15:36:22.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.283+0000 7f034affd700 1 -- 172.21.15.33:0/1976624872 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f034c019090 con 0x7f0340004810 2023-10-09T15:36:22.284 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:22.285 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":77,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:22.245493+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 msgr2=0x7f0334069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 0x7f0334069620 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f033c001730 tx=0x7f033c015000 comp rx=0 tx=0).stop 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 msgr2=0x7f03540b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f034c009e20 tx=0x7f034c00b040 comp rx=0 tx=0).stop 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 shutdown_connections 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0334067170 0x7f0334069620 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0340004810 0x7f03540b5600 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03540c8e40 0x7f03540c92a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 --2- 172.21.15.33:0/1976624872 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0354152a20 0x7f0354152e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 >> 172.21.15.33:0/1976624872 conn(0x7f0354070e30 msgr2=0x7f03540b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 shutdown_connections 2023-10-09T15:36:22.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.285+0000 7f03593a3700 1 -- 172.21.15.33:0/1976624872 wait complete. 2023-10-09T15:36:22.299 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:36:22.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.420+0000 7f8bfdb60700 1 Processor -- start 2023-10-09T15:36:22.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.420+0000 7f8bfdb60700 1 -- start start 2023-10-09T15:36:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfdb60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 0x7f8bf80b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfdb60700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bf80af6b0 0x7f8bf80accd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfdb60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bf80ac840 con 0x7f8bf806d250 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfdb60700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80b18f0 con 0x7f8bf80af6b0 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfdb60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bf80abf50 con 0x7f8bf8157420 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfd35f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bf80af6b0 0x7f8bf80accd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfd35f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bf80af6b0 0x7f8bf80accd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56164/0 (socket says 172.21.15.33:56164) 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfd35f700 1 -- 172.21.15.33:0/330321080 learned_addr learned my addr 172.21.15.33:0/330321080 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfcb5e700 1 --2- 172.21.15.33:0/330321080 >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 0x7f8bf80b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.421+0000 7f8bfd35f700 1 -- 172.21.15.33:0/330321080 >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 msgr2=0x7f8bf80b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfd35f700 1 --2- 172.21.15.33:0/330321080 >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 0x7f8bf80b13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfd35f700 1 -- 172.21.15.33:0/330321080 >> v1:172.21.15.59:6789/0 conn(0x7f8bf806d250 legacy=0x7f8bf80aefa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfd35f700 1 -- 172.21.15.33:0/330321080 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf80aea60 con 0x7f8bf80af6b0 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfcb5e700 1 --2- 172.21.15.33:0/330321080 >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 0x7f8bf80b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfd35f700 1 --2- 172.21.15.33:0/330321080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf80af6b0 0x7f8bf80accd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80b0e70 tx=0x7f8bf0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdaaacde29cfaa27 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bf77fe700 1 -- 172.21.15.33:0/330321080 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf000e070 con 0x7f8bf80af6b0 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bf77fe700 1 -- 172.21.15.33:0/330321080 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bf000ba50 con 0x7f8bf80af6b0 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bf77fe700 1 -- 172.21.15.33:0/330321080 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bf00092e0 con 0x7f8bf80af6b0 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 -- 172.21.15.33:0/330321080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf80af6b0 msgr2=0x7f8bf80accd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/330321080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf80af6b0 0x7f8bf80accd0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f8bf80b0e70 tx=0x7f8bf0009840 comp rx=0 tx=0).stop 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 -- 172.21.15.33:0/330321080 shutdown_connections 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/330321080 >> v2:172.21.15.59:3300/0 conn(0x7f8bf8157420 0x7f8bf80b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/330321080 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf80af6b0 0x7f8bf80accd0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 -- 172.21.15.33:0/330321080 >> 172.21.15.33:0/330321080 conn(0x7f8bf806ce80 msgr2=0x7f8bf80ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.422+0000 7f8bfdb60700 1 -- 172.21.15.33:0/330321080 shutdown_connections 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.423+0000 7f8bfdb60700 1 -- 172.21.15.33:0/330321080 wait complete. 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 Processor -- start 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 -- start start 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bf80af6b0 0x7f8bf81540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bf8157420 0x7f8bf8154600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8099130 con 0x7f8bf806d250 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf806e6c0 con 0x7f8bf8157420 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.424+0000 7f8bfdb60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf8098e50 con 0x7f8bf80af6b0 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56178/0 (socket says 172.21.15.33:56178) 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 -- 172.21.15.33:0/3689026672 learned_addr learned my addr 172.21.15.33:0/3689026672 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfd35f700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bf8157420 0x7f8bf8154600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bf7fff700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bf80af6b0 0x7f8bf81540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 -- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bf80af6b0 msgr2=0x7f8bf81540c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bf80af6b0 0x7f8bf81540c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 -- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bf8157420 msgr2=0x7f8bf8154600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bf8157420 0x7f8bf8154600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 -- 172.21.15.33:0/3689026672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bf0009ae0 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfcb5e700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e900 tx=0x7f8be8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8013410 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8be8013570 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf806e070 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8be8013910 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.425+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf8098a20 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.426+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf806e9a0 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.427+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f8be8013d00 con 0x7f8bf806d250 2023-10-09T15:36:22.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.427+0000 7f8bf4ff9700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 0x7f8be4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.427+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8be80845d0 con 0x7f8bf806d250 2023-10-09T15:36:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.427+0000 7f8bf7fff700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 0x7f8be4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.428+0000 7f8bf7fff700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 0x7f8be4069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8bf816cdd0 tx=0x7f8bec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:22.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.431+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8be80514a0 con 0x7f8bf806d250 2023-10-09T15:36:22.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:22.677+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f8bf804c3c0 con 0x7f8bf806d250 2023-10-09T15:36:23.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.600+0000 7f8bf4ff9700 1 -- 172.21.15.33:0/3689026672 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v48) v1 ==== 118+0+0 (secure 0 0 0) 0x7f8be8054ac0 con 0x7f8bf806d250 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.602+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 msgr2=0x7f8be4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.602+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 0x7f8be4069620 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f8bf816cdd0 tx=0x7f8bec009040 comp rx=0 tx=0).stop 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.602+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 msgr2=0x7f8bf806eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.602+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f8be800e900 tx=0x7f8be8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.602+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 shutdown_connections 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be4067170 0x7f8be4069620 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bf806d250 0x7f8bf806eb50 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bf8157420 0x7f8bf8154600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 --2- 172.21.15.33:0/3689026672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bf80af6b0 0x7f8bf81540c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 >> 172.21.15.33:0/3689026672 conn(0x7f8bf806ce80 msgr2=0x7f8bf80add30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:23.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 shutdown_connections 2023-10-09T15:36:23.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.603+0000 7f8bfdb60700 1 -- 172.21.15.33:0/3689026672 wait complete. 2023-10-09T15:36:23.619 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:36:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.745+0000 7f6df34ae700 1 Processor -- start 2023-10-09T15:36:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 -- start start 2023-10-09T15:36:23.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6dec159860 0x7f6dec0ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0cbd90 0x7f6dec0cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dec0cf510 con 0x7f6dec0ccfa0 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dec0cc1e0 con 0x7f6dec159860 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.746+0000 7f6df34ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec0ce900 con 0x7f6dec0cbd90 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6dec159860 0x7f6dec0ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6dec159860 0x7f6dec0ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56190/0 (socket says 172.21.15.33:56190) 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 -- 172.21.15.33:0/3081198147 learned_addr learned my addr 172.21.15.33:0/3081198147 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df0a49700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0cbd90 0x7f6dec0cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 -- 172.21.15.33:0/3081198147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0cbd90 msgr2=0x7f6dec0cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0cbd90 0x7f6dec0cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 -- 172.21.15.33:0/3081198147 >> v1:172.21.15.59:6789/0 conn(0x7f6dec0ccfa0 legacy=0x7f6dec0cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 -- 172.21.15.33:0/3081198147 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec0cebe0 con 0x7f6dec159860 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6df124a700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec0ce220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6de8009990 tx=0x7f6de8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab8ae9612b96d630 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6de3fff700 1 -- 172.21.15.33:0/3081198147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de8005c10 con 0x7f6dec159860 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6de3fff700 1 -- 172.21.15.33:0/3081198147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de8005d70 con 0x7f6dec159860 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.747+0000 7f6de3fff700 1 -- 172.21.15.33:0/3081198147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de800b840 con 0x7f6dec159860 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 -- 172.21.15.33:0/3081198147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 msgr2=0x7f6dec0ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec0ce220 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f6de8009990 tx=0x7f6de8009220 comp rx=0 tx=0).stop 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 -- 172.21.15.33:0/3081198147 shutdown_connections 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec0ce220 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 --2- 172.21.15.33:0/3081198147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0cbd90 0x7f6dec0cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 -- 172.21.15.33:0/3081198147 >> 172.21.15.33:0/3081198147 conn(0x7f6dec0999b0 msgr2=0x7f6dec070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:23.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 -- 172.21.15.33:0/3081198147 shutdown_connections 2023-10-09T15:36:23.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.748+0000 7f6df34ae700 1 -- 172.21.15.33:0/3081198147 wait complete. 2023-10-09T15:36:23.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.749+0000 7f6df34ae700 1 Processor -- start 2023-10-09T15:36:23.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.749+0000 7f6df34ae700 1 -- start start 2023-10-09T15:36:23.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec0cbd90 0x7f6dec09d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0ccfa0 0x7f6dec09dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09ccc0 con 0x7f6dec159860 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09c0b0 con 0x7f6dec0cbd90 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df34ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dec09c390 con 0x7f6dec0ccfa0 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56202/0 (socket says 172.21.15.33:56202) 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 -- 172.21.15.33:0/2264781645 learned_addr learned my addr 172.21.15.33:0/2264781645 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df124a700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec0cbd90 0x7f6dec09d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df0a49700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0ccfa0 0x7f6dec09dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 -- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0ccfa0 msgr2=0x7f6dec09dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0ccfa0 0x7f6dec09dc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 -- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec0cbd90 msgr2=0x7f6dec09d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec0cbd90 0x7f6dec09d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 -- 172.21.15.33:0/2264781645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6de8009480 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6df1a4b700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c930 tx=0x7f6de40026e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.750+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4012630 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.751+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de40127d0 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.751+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dec09c670 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.751+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4012b90 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.751+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dec09d690 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.752+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dec04c3c0 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.752+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f6de400a3b0 con 0x7f6dec159860 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.752+0000 7f6de17fa700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 0x7f6dd0069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:23.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.753+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6de40845c0 con 0x7f6dec159860 2023-10-09T15:36:23.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.753+0000 7f6df124a700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 0x7f6dd0069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:23.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.753+0000 7f6df124a700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 0x7f6dd0069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6de8003080 tx=0x7f6de8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:23.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:23.757+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6de40515a0 con 0x7f6dec159860 2023-10-09T15:36:24.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.000+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f6dec09ce00 con 0x7f6dec159860 2023-10-09T15:36:24.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.600+0000 7f6de17fa700 1 -- 172.21.15.33:0/2264781645 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v49) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6de4054bc0 con 0x7f6dec159860 2023-10-09T15:36:24.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 msgr2=0x7f6dd0069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 0x7f6dd0069620 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f6de8003080 tx=0x7f6de8015000 comp rx=0 tx=0).stop 2023-10-09T15:36:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 msgr2=0x7f6dec1589e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c930 tx=0x7f6de40026e0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 shutdown_connections 2023-10-09T15:36:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dd0067170 0x7f6dd0069620 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6dec159860 0x7f6dec1589e0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6dec0cbd90 0x7f6dec09d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 --2- 172.21.15.33:0/2264781645 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6dec0ccfa0 0x7f6dec09dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 >> 172.21.15.33:0/2264781645 conn(0x7f6dec0999b0 msgr2=0x7f6dec0b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 shutdown_connections 2023-10-09T15:36:24.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.603+0000 7f6df34ae700 1 -- 172.21.15.33:0/2264781645 wait complete. 2023-10-09T15:36:24.619 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.744+0000 7fed65c3b700 1 Processor -- start 2023-10-09T15:36:24.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.744+0000 7fed65c3b700 1 -- start start 2023-10-09T15:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed65c3b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed6015de50 0x7fed600cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed65c3b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed600cf3c0 con 0x7fed600cef40 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed65c3b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed6015afd0 con 0x7fed60153c30 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed65c3b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed6015b2b0 con 0x7fed6015de50 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed5ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed6015de50 0x7fed600cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed5ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed6015de50 0x7fed600cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56216/0 (socket says 172.21.15.33:56216) 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.745+0000 7fed5ffff700 1 -- 172.21.15.33:0/1333357366 learned_addr learned my addr 172.21.15.33:0/1333357366 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5ffff700 1 -- 172.21.15.33:0/1333357366 >> v1:172.21.15.59:6789/0 conn(0x7fed60153c30 legacy=0x7fed6015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5ffff700 1 -- 172.21.15.33:0/1333357366 >> v1:172.21.15.33:6789/0 conn(0x7fed600cef40 legacy=0x7fed6015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5ffff700 1 -- 172.21.15.33:0/1333357366 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6015b590 con 0x7fed6015de50 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5ffff700 1 --2- 172.21.15.33:0/1333357366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed6015de50 0x7fed600cea00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fed50009f20 tx=0x7fed50009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d38bfe9149bf740b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5f7fe700 1 -- 172.21.15.33:0/1333357366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed5000e070 con 0x7fed6015de50 2023-10-09T15:36:24.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5f7fe700 1 -- 172.21.15.33:0/1333357366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed5000ba80 con 0x7fed6015de50 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed5f7fe700 1 -- 172.21.15.33:0/1333357366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed500092e0 con 0x7fed6015de50 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 -- 172.21.15.33:0/1333357366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed6015de50 msgr2=0x7fed600cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 --2- 172.21.15.33:0/1333357366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed6015de50 0x7fed600cea00 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7fed50009f20 tx=0x7fed50009840 comp rx=0 tx=0).stop 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 -- 172.21.15.33:0/1333357366 shutdown_connections 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 --2- 172.21.15.33:0/1333357366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed6015de50 0x7fed600cea00 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 -- 172.21.15.33:0/1333357366 >> 172.21.15.33:0/1333357366 conn(0x7fed600703a0 msgr2=0x7fed600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 -- 172.21.15.33:0/1333357366 shutdown_connections 2023-10-09T15:36:24.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.746+0000 7fed65c3b700 1 -- 172.21.15.33:0/1333357366 wait complete. 2023-10-09T15:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 Processor -- start 2023-10-09T15:36:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 -- start start 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed60153c30 0x7fed600c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed6015de50 0x7fed6013e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b5500 con 0x7fed600cef40 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b4950 con 0x7fed60153c30 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.748+0000 7fed65c3b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed600b4bd0 con 0x7fed6015de50 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56222/0 (socket says 172.21.15.33:56222) 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 -- 172.21.15.33:0/2845426650 learned_addr learned my addr 172.21.15.33:0/2845426650 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed6543a700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed6015de50 0x7fed6013e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed5ffff700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed60153c30 0x7fed600c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 -- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed6015de50 msgr2=0x7fed6013e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed6015de50 0x7fed6013e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 -- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed60153c30 msgr2=0x7fed600c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed60153c30 0x7fed600c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 -- 172.21.15.33:0/2845426650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed50009ae0 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed64c39700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c590 tx=0x7fed5800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011590 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed58011710 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed600b4eb0 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed58011ad0 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.749+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed600ca1e0 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.750+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed6004c3c0 con 0x7fed600cef40 2023-10-09T15:36:24.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.751+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fed5801b3b0 con 0x7fed600cef40 2023-10-09T15:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.751+0000 7fed5cff9700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 0x7fed40069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.751+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed58083cd0 con 0x7fed600cef40 2023-10-09T15:36:24.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.751+0000 7fed5ffff700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 0x7fed40069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:24.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.752+0000 7fed5ffff700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 0x7fed40069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed50009880 tx=0x7fed50018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:24.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.755+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed58050cb0 con 0x7fed600cef40 2023-10-09T15:36:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.992+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fed6015db00 con 0x7fed600cef40 2023-10-09T15:36:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.992+0000 7fed5cff9700 1 -- 172.21.15.33:0/2845426650 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fed58017070 con 0x7fed600cef40 2023-10-09T15:36:24.993 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:24.993 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.994+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 msgr2=0x7fed40069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.994+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 0x7fed40069620 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fed50009880 tx=0x7fed50018000 comp rx=0 tx=0).stop 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.994+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 msgr2=0x7fed600cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.994+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7fed5800c590 tx=0x7fed5800c8a0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 shutdown_connections 2023-10-09T15:36:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067170 0x7fed40069620 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed600cef40 0x7fed600cccd0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed6015de50 0x7fed6013e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 --2- 172.21.15.33:0/2845426650 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed60153c30 0x7fed600c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 >> 172.21.15.33:0/2845426650 conn(0x7fed600703a0 msgr2=0x7fed601510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 shutdown_connections 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:24.995+0000 7fed65c3b700 1 -- 172.21.15.33:0/2845426650 wait complete. 2023-10-09T15:36:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 49 2023-10-09T15:36:25.008 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.126+0000 7f28d759e700 1 Processor -- start 2023-10-09T15:36:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.126+0000 7f28d759e700 1 -- start start 2023-10-09T15:36:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f28d815de50 0x7f28d80cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28d80cef40 0x7f28d815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d759e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28d80cf3c0 con 0x7f28d8153c30 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d759e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d815afd0 con 0x7f28d80cef40 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28d815b2b0 con 0x7f28d815de50 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f28d8153c30 0x7f28d815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51612/0 (socket says 172.21.15.33:51612) 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d659c700 1 -- 172.21.15.33:0/3070663592 learned_addr learned my addr 172.21.15.33:0/3070663592 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d6d9d700 1 --2- 172.21.15.33:0/3070663592 >> v2:172.21.15.33:3300/0 conn(0x7f28d80cef40 0x7f28d815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d5d9b700 1 --2- 172.21.15.33:0/3070663592 >> v2:172.21.15.59:3300/0 conn(0x7f28d815de50 0x7f28d80cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d6d9d700 1 -- 172.21.15.33:0/3070663592 >> v2:172.21.15.59:3300/0 conn(0x7f28d815de50 msgr2=0x7f28d80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.127+0000 7f28d6d9d700 1 --2- 172.21.15.33:0/3070663592 >> v2:172.21.15.59:3300/0 conn(0x7f28d815de50 0x7f28d80cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d6d9d700 1 -- 172.21.15.33:0/3070663592 >> v1:172.21.15.33:6789/0 conn(0x7f28d8153c30 legacy=0x7f28d815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d6d9d700 1 -- 172.21.15.33:0/3070663592 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28d815b590 con 0x7f28d80cef40 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d559a700 1 -- 172.21.15.33:0/3070663592 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505126159 0 0) 0x7f28d80cf3c0 con 0x7f28d8153c30 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d6d9d700 1 --2- 172.21.15.33:0/3070663592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d815c070 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f28d80713a0 tx=0x7f28c8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f622e77702a4f8a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d559a700 1 -- 172.21.15.33:0/3070663592 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c800e070 con 0x7f28d80cef40 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d559a700 1 -- 172.21.15.33:0/3070663592 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28c800bb60 con 0x7f28d80cef40 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d559a700 1 -- 172.21.15.33:0/3070663592 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28c8012430 con 0x7f28d80cef40 2023-10-09T15:36:25.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 -- 172.21.15.33:0/3070663592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 msgr2=0x7f28d815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 --2- 172.21.15.33:0/3070663592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d815c070 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f28d80713a0 tx=0x7f28c8009780 comp rx=0 tx=0).stop 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 -- 172.21.15.33:0/3070663592 shutdown_connections 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 --2- 172.21.15.33:0/3070663592 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d815c070 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 --2- 172.21.15.33:0/3070663592 >> v2:172.21.15.59:3300/0 conn(0x7f28d815de50 0x7f28d80cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 -- 172.21.15.33:0/3070663592 >> 172.21.15.33:0/3070663592 conn(0x7f28d80703a0 msgr2=0x7f28d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 -- 172.21.15.33:0/3070663592 shutdown_connections 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.128+0000 7f28d759e700 1 -- 172.21.15.33:0/3070663592 wait complete. 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 Processor -- start 2023-10-09T15:36:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 -- start start 2023-10-09T15:36:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28d8153c30 0x7f28d80c9f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28d815de50 0x7f28d81519c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80ca4b0 con 0x7f28d80cef40 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28d8154110 con 0x7f28d8153c30 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28d80b4f80 con 0x7f28d815de50 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56252/0 (socket says 172.21.15.33:56252) 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.130+0000 7f28d659c700 1 -- 172.21.15.33:0/1018035056 learned_addr learned my addr 172.21.15.33:0/1018035056 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d6d9d700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28d815de50 0x7f28d81519c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d5d9b700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28d8153c30 0x7f28d80c9f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 -- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28d815de50 msgr2=0x7f28d81519c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28d815de50 0x7f28d81519c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 -- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28d8153c30 msgr2=0x7f28d80c9f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28d8153c30 0x7f28d80c9f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 -- 172.21.15.33:0/1018035056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28c8009a20 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d659c700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c5b0 tx=0x7f28d0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0005c00 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d0005d60 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d80b4370 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d0007300 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.131+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28d80b49b0 con 0x7f28d80cef40 2023-10-09T15:36:25.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.132+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28d804c3c0 con 0x7f28d80cef40 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.132+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f28d001b3b0 con 0x7f28d80cef40 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.133+0000 7f28ce7fc700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 0x7f28b8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.133+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f28d0083e20 con 0x7f28d80cef40 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.133+0000 7f28d5d9b700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 0x7f28b8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.133+0000 7f28d5d9b700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 0x7f28b8069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28d80c6610 tx=0x7f28c00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.137+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f28d0050e00 con 0x7f28d80cef40 2023-10-09T15:36:25.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.332+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f28d80caef0 con 0x7f28d80cef40 2023-10-09T15:36:25.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.333+0000 7f28ce7fc700 1 -- 172.21.15.33:0/1018035056 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f28d0017020 con 0x7f28d80cef40 2023-10-09T15:36:25.334 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:25.334 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":77,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:22.245493+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 msgr2=0x7f28b8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 0x7f28b8069620 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f28d80c6610 tx=0x7f28c00091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 msgr2=0x7f28d80b3c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c5b0 tx=0x7f28d0001070 comp rx=0 tx=0).stop 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 shutdown_connections 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f28b8067170 0x7f28b8069620 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28d80cef40 0x7f28d80b3c90 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f28d815de50 0x7f28d81519c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 --2- 172.21.15.33:0/1018035056 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28d8153c30 0x7f28d80c9f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 >> 172.21.15.33:0/1018035056 conn(0x7f28d80703a0 msgr2=0x7f28d8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 shutdown_connections 2023-10-09T15:36:25.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.335+0000 7f28d759e700 1 -- 172.21.15.33:0/1018035056 wait complete. 2023-10-09T15:36:25.348 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:36:25.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:36:25.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 Processor -- start 2023-10-09T15:36:25.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 -- start start 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40cb5a0 0x7f15c40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f15c40cd9e0 0x7f15c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f15c40cde50 0x7f15c415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c40d13f0 con 0x7f15c40cde50 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f15c415a940 con 0x7f15c40cd9e0 2023-10-09T15:36:25.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.467+0000 7f15c9a32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c415ae40 con 0x7f15c40cb5a0 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f15c40cde50 0x7f15c415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f15c40cde50 0x7f15c415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56260/0 (socket says 172.21.15.33:56260) 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 -- 172.21.15.33:0/2375322628 learned_addr learned my addr 172.21.15.33:0/2375322628 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c2ffd700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40cb5a0 0x7f15c40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c27fc700 1 --2- 172.21.15.33:0/2375322628 >> v2:172.21.15.59:3300/0 conn(0x7f15c40cd9e0 0x7f15c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 -- 172.21.15.33:0/2375322628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40cb5a0 msgr2=0x7f15c40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40cb5a0 0x7f15c40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 -- 172.21.15.33:0/2375322628 >> v2:172.21.15.59:3300/0 conn(0x7f15c40cd9e0 msgr2=0x7f15c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 --2- 172.21.15.33:0/2375322628 >> v2:172.21.15.59:3300/0 conn(0x7f15c40cd9e0 0x7f15c4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 -- 172.21.15.33:0/2375322628 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15c415ab60 con 0x7f15c40cde50 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c37fe700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cde50 0x7f15c415a400 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f15c406ea90 tx=0x7f15b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c890fe9dac37903f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c1ffb700 1 -- 172.21.15.33:0/2375322628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400b640 con 0x7f15c40cde50 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c1ffb700 1 -- 172.21.15.33:0/2375322628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15b400b7a0 con 0x7f15c40cde50 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.468+0000 7f15c1ffb700 1 -- 172.21.15.33:0/2375322628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15b400bb40 con 0x7f15c40cde50 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 -- 172.21.15.33:0/2375322628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cde50 msgr2=0x7f15c415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cde50 0x7f15c415a400 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f15c406ea90 tx=0x7f15b4009250 comp rx=0 tx=0).stop 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 -- 172.21.15.33:0/2375322628 shutdown_connections 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cde50 0x7f15c415a400 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2375322628 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40cb5a0 0x7f15c40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2375322628 >> v2:172.21.15.59:3300/0 conn(0x7f15c40cd9e0 0x7f15c4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 -- 172.21.15.33:0/2375322628 >> 172.21.15.33:0/2375322628 conn(0x7f15c4070e30 msgr2=0x7f15c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 -- 172.21.15.33:0/2375322628 shutdown_connections 2023-10-09T15:36:25.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.469+0000 7f15c9a32700 1 -- 172.21.15.33:0/2375322628 wait complete. 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.470+0000 7f15c9a32700 1 Processor -- start 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.470+0000 7f15c9a32700 1 -- start start 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 0x7f15c414a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40ca0a0 0x7f15c40b1090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c416a150 con 0x7f15c40cb5a0 2023-10-09T15:36:25.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4169760 con 0x7f15c40cd9e0 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c9a32700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f15c4169a40 con 0x7f15c40ca0a0 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56264/0 (socket says 172.21.15.33:56264) 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 -- 172.21.15.33:0/2342990203 learned_addr learned my addr 172.21.15.33:0/2342990203 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 -- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40ca0a0 msgr2=0x7f15c40b1090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40ca0a0 0x7f15c40b1090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c27fc700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 0x7f15c414a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 -- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 msgr2=0x7f15c414a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.471+0000 7f15c2ffd700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 0x7f15c414a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15c2ffd700 1 -- 172.21.15.33:0/2342990203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15b40094f0 con 0x7f15c40cb5a0 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15c27fc700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 0x7f15c414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:25.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15c2ffd700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009ef0 tx=0x7f15bc00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc00cc50 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f15bc00f040 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15c4169d20 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f15bc014480 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.472+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15c4169470 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.473+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15c4157150 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.473+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f15bc0147f0 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.474+0000 7f15baffd700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 0x7f15a4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.474+0000 7f15c27fc700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 0x7f15a4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.474+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f15bc0853e0 con 0x7f15c40cb5a0 2023-10-09T15:36:25.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.474+0000 7f15c27fc700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 0x7f15a4069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f15ac006f00 tx=0x7f15ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.478+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f15bc0522b0 con 0x7f15c40cb5a0 2023-10-09T15:36:25.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.671+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f15c4156c40 con 0x7f15a4067170 2023-10-09T15:36:25.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.679+0000 7f15baffd700 1 -- 172.21.15.33:0/2342990203 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289458 (secure 0 0 0) 0x7f15c4156c40 con 0x7f15a4067170 2023-10-09T15:36:25.684 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:25.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 msgr2=0x7f15a4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 0x7f15a4069620 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f15ac006f00 tx=0x7f15ac008040 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 msgr2=0x7f15c4168f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f15bc009ef0 tx=0x7f15bc00b040 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 shutdown_connections 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f15a4067170 0x7f15a4069620 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f15c40cb5a0 0x7f15c4168f30 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f15c40ca0a0 0x7f15c40b1090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 --2- 172.21.15.33:0/2342990203 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f15c40cd9e0 0x7f15c414a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.682+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 >> 172.21.15.33:0/2342990203 conn(0x7f15c4070e30 msgr2=0x7f15c40d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.683+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 shutdown_connections 2023-10-09T15:36:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.683+0000 7f15c9a32700 1 -- 172.21.15.33:0/2342990203 wait complete. 2023-10-09T15:36:25.688 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:36:25.696 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-09T15:36:25.302461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390952,"kb_used_data":8552,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752583768,"statfs":{"total":773094113280,"available":770645778432,"internally_reserved":0,"allocated":8757248,"data_stored":4402657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736967"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266399+0000","last_change":"2023-10-09T15:36:21.259496+0000","last_active":"2023-10-09T15:36:21.266399+0000","last_peered":"2023-10-09T15:36:21.266399+0000","last_clean":"2023-10-09T15:36:21.266399+0000","last_became_active":"2023-10-09T15:36:21.259199+0000","last_became_peered":"2023-10-09T15:36:21.259199+0000","last_unstale":"2023-10-09T15:36:21.266399+0000","last_undegraded":"2023-10-09T15:36:21.266399+0000","last_fullsized":"2023-10-09T15:36:21.266399+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.834282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273678+0000","last_change":"2023-10-09T15:36:21.271892+0000","last_active":"2023-10-09T15:36:21.273678+0000","last_peered":"2023-10-09T15:36:21.273678+0000","last_clean":"2023-10-09T15:36:21.273678+0000","last_became_active":"2023-10-09T15:36:21.271615+0000","last_became_peered":"2023-10-09T15:36:21.271615+0000","last_unstale":"2023-10-09T15:36:21.273678+0000","last_undegraded":"2023-10-09T15:36:21.273678+0000","last_fullsized":"2023-10-09T15:36:21.273678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:32.770547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273244+0000","last_change":"2023-10-09T15:36:21.271175+0000","last_active":"2023-10-09T15:36:21.273244+0000","last_peered":"2023-10-09T15:36:21.273244+0000","last_clean":"2023-10-09T15:36:21.273244+0000","last_became_active":"2023-10-09T15:36:21.270796+0000","last_became_peered":"2023-10-09T15:36:21.270796+0000","last_unstale":"2023-10-09T15:36:21.273244+0000","last_undegraded":"2023-10-09T15:36:21.273244+0000","last_fullsized":"2023-10-09T15:36:21.273244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:19:34.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269976+0000","last_change":"2023-10-09T15:36:21.267231+0000","last_active":"2023-10-09T15:36:21.269976+0000","last_peered":"2023-10-09T15:36:21.269976+0000","last_clean":"2023-10-09T15:36:21.269976+0000","last_became_active":"2023-10-09T15:36:21.266921+0000","last_became_peered":"2023-10-09T15:36:21.266921+0000","last_unstale":"2023-10-09T15:36:21.269976+0000","last_undegraded":"2023-10-09T15:36:21.269976+0000","last_fullsized":"2023-10-09T15:36:21.269976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:32:48.399841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268969+0000","last_change":"2023-10-09T15:36:21.267222+0000","last_active":"2023-10-09T15:36:21.268969+0000","last_peered":"2023-10-09T15:36:21.268969+0000","last_clean":"2023-10-09T15:36:21.268969+0000","last_became_active":"2023-10-09T15:36:21.266979+0000","last_became_peered":"2023-10-09T15:36:21.266979+0000","last_unstale":"2023-10-09T15:36:21.268969+0000","last_undegraded":"2023-10-09T15:36:21.268969+0000","last_fullsized":"2023-10-09T15:36:21.268969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272655+0000","last_change":"2023-10-09T15:36:21.269739+0000","last_active":"2023-10-09T15:36:21.272655+0000","last_peered":"2023-10-09T15:36:21.272655+0000","last_clean":"2023-10-09T15:36:21.272655+0000","last_became_active":"2023-10-09T15:36:21.269248+0000","last_became_peered":"2023-10-09T15:36:21.269248+0000","last_unstale":"2023-10-09T15:36:21.272655+0000","last_undegraded":"2023-10-09T15:36:21.272655+0000","last_fullsized":"2023-10-09T15:36:21.272655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269948+0000","last_change":"2023-10-09T15:36:21.265770+0000","last_active":"2023-10-09T15:36:21.269948+0000","last_peered":"2023-10-09T15:36:21.269948+0000","last_clean":"2023-10-09T15:36:21.269948+0000","last_became_active":"2023-10-09T15:36:21.265493+0000","last_became_peered":"2023-10-09T15:36:21.265493+0000","last_unstale":"2023-10-09T15:36:21.269948+0000","last_undegraded":"2023-10-09T15:36:21.269948+0000","last_fullsized":"2023-10-09T15:36:21.269948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:39.766556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269030+0000","last_change":"2023-10-09T15:36:21.268118+0000","last_active":"2023-10-09T15:36:21.269030+0000","last_peered":"2023-10-09T15:36:21.269030+0000","last_clean":"2023-10-09T15:36:21.269030+0000","last_became_active":"2023-10-09T15:36:21.267815+0000","last_became_peered":"2023-10-09T15:36:21.267815+0000","last_unstale":"2023-10-09T15:36:21.269030+0000","last_undegraded":"2023-10-09T15:36:21.269030+0000","last_fullsized":"2023-10-09T15:36:21.269030+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:24.473764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268641+0000","last_change":"2023-10-09T15:36:21.265816+0000","last_active":"2023-10-09T15:36:21.268641+0000","last_peered":"2023-10-09T15:36:21.268641+0000","last_clean":"2023-10-09T15:36:21.268641+0000","last_became_active":"2023-10-09T15:36:21.265567+0000","last_became_peered":"2023-10-09T15:36:21.265567+0000","last_unstale":"2023-10-09T15:36:21.268641+0000","last_undegraded":"2023-10-09T15:36:21.268641+0000","last_fullsized":"2023-10-09T15:36:21.268641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269592+0000","last_change":"2023-10-09T15:36:21.264115+0000","last_active":"2023-10-09T15:36:21.269592+0000","last_peered":"2023-10-09T15:36:21.269592+0000","last_clean":"2023-10-09T15:36:21.269592+0000","last_became_active":"2023-10-09T15:36:21.263767+0000","last_became_peered":"2023-10-09T15:36:21.263767+0000","last_unstale":"2023-10-09T15:36:21.269592+0000","last_undegraded":"2023-10-09T15:36:21.269592+0000","last_fullsized":"2023-10-09T15:36:21.269592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:24.473764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273746+0000","last_change":"2023-10-09T15:36:21.272232+0000","last_active":"2023-10-09T15:36:21.273746+0000","last_peered":"2023-10-09T15:36:21.273746+0000","last_clean":"2023-10-09T15:36:21.273746+0000","last_became_active":"2023-10-09T15:36:21.271922+0000","last_became_peered":"2023-10-09T15:36:21.271922+0000","last_unstale":"2023-10-09T15:36:21.273746+0000","last_undegraded":"2023-10-09T15:36:21.273746+0000","last_fullsized":"2023-10-09T15:36:21.273746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:03.817605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270215+0000","last_change":"2023-10-09T15:36:21.264233+0000","last_active":"2023-10-09T15:36:21.270215+0000","last_peered":"2023-10-09T15:36:21.270215+0000","last_clean":"2023-10-09T15:36:21.270215+0000","last_became_active":"2023-10-09T15:36:21.263918+0000","last_became_peered":"2023-10-09T15:36:21.263918+0000","last_unstale":"2023-10-09T15:36:21.270215+0000","last_undegraded":"2023-10-09T15:36:21.270215+0000","last_fullsized":"2023-10-09T15:36:21.270215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:10.645144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271666+0000","last_change":"2023-10-09T15:36:21.267333+0000","last_active":"2023-10-09T15:36:21.271666+0000","last_peered":"2023-10-09T15:36:21.271666+0000","last_clean":"2023-10-09T15:36:21.271666+0000","last_became_active":"2023-10-09T15:36:21.267060+0000","last_became_peered":"2023-10-09T15:36:21.267060+0000","last_unstale":"2023-10-09T15:36:21.271666+0000","last_undegraded":"2023-10-09T15:36:21.271666+0000","last_fullsized":"2023-10-09T15:36:21.271666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:58.696335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270005+0000","last_change":"2023-10-09T15:36:21.267646+0000","last_active":"2023-10-09T15:36:21.270005+0000","last_peered":"2023-10-09T15:36:21.270005+0000","last_clean":"2023-10-09T15:36:21.270005+0000","last_became_active":"2023-10-09T15:36:21.267277+0000","last_became_peered":"2023-10-09T15:36:21.267277+0000","last_unstale":"2023-10-09T15:36:21.270005+0000","last_undegraded":"2023-10-09T15:36:21.270005+0000","last_fullsized":"2023-10-09T15:36:21.270005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:21.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268428+0000","last_change":"2023-10-09T15:36:21.265323+0000","last_active":"2023-10-09T15:36:21.268428+0000","last_peered":"2023-10-09T15:36:21.268428+0000","last_clean":"2023-10-09T15:36:21.268428+0000","last_became_active":"2023-10-09T15:36:21.264906+0000","last_became_peered":"2023-10-09T15:36:21.264906+0000","last_unstale":"2023-10-09T15:36:21.268428+0000","last_undegraded":"2023-10-09T15:36:21.268428+0000","last_fullsized":"2023-10-09T15:36:21.268428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:18.276861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.262550+0000","last_change":"2023-10-09T15:36:21.254979+0000","last_active":"2023-10-09T15:36:21.262550+0000","last_peered":"2023-10-09T15:36:21.262550+0000","last_clean":"2023-10-09T15:36:21.262550+0000","last_became_active":"2023-10-09T15:36:21.254643+0000","last_became_peered":"2023-10-09T15:36:21.254643+0000","last_unstale":"2023-10-09T15:36:21.262550+0000","last_undegraded":"2023-10-09T15:36:21.262550+0000","last_fullsized":"2023-10-09T15:36:21.262550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265837+0000","last_change":"2023-10-09T15:36:21.258600+0000","last_active":"2023-10-09T15:36:21.265837+0000","last_peered":"2023-10-09T15:36:21.265837+0000","last_clean":"2023-10-09T15:36:21.265837+0000","last_became_active":"2023-10-09T15:36:21.258138+0000","last_became_peered":"2023-10-09T15:36:21.258138+0000","last_unstale":"2023-10-09T15:36:21.265837+0000","last_undegraded":"2023-10-09T15:36:21.265837+0000","last_fullsized":"2023-10-09T15:36:21.265837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.263556+0000","last_change":"2023-10-09T15:36:21.257428+0000","last_active":"2023-10-09T15:36:21.263556+0000","last_peered":"2023-10-09T15:36:21.263556+0000","last_clean":"2023-10-09T15:36:21.263556+0000","last_became_active":"2023-10-09T15:36:21.257137+0000","last_became_peered":"2023-10-09T15:36:21.257137+0000","last_unstale":"2023-10-09T15:36:21.263556+0000","last_undegraded":"2023-10-09T15:36:21.263556+0000","last_fullsized":"2023-10-09T15:36:21.263556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:06:25.921125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269539+0000","last_change":"2023-10-09T15:36:21.264769+0000","last_active":"2023-10-09T15:36:21.269539+0000","last_peered":"2023-10-09T15:36:21.269539+0000","last_clean":"2023-10-09T15:36:21.269539+0000","last_became_active":"2023-10-09T15:36:21.264032+0000","last_became_peered":"2023-10-09T15:36:21.264032+0000","last_unstale":"2023-10-09T15:36:21.269539+0000","last_undegraded":"2023-10-09T15:36:21.269539+0000","last_fullsized":"2023-10-09T15:36:21.269539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268754+0000","last_change":"2023-10-09T15:36:21.258572+0000","last_active":"2023-10-09T15:36:21.268754+0000","last_peered":"2023-10-09T15:36:21.268754+0000","last_clean":"2023-10-09T15:36:21.268754+0000","last_became_active":"2023-10-09T15:36:21.258172+0000","last_became_peered":"2023-10-09T15:36:21.258172+0000","last_unstale":"2023-10-09T15:36:21.268754+0000","last_undegraded":"2023-10-09T15:36:21.268754+0000","last_fullsized":"2023-10-09T15:36:21.268754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:45.521102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268730+0000","last_change":"2023-10-09T15:36:21.259070+0000","last_active":"2023-10-09T15:36:21.268730+0000","last_peered":"2023-10-09T15:36:21.268730+0000","last_clean":"2023-10-09T15:36:21.268730+0000","last_became_active":"2023-10-09T15:36:21.258690+0000","last_became_peered":"2023-10-09T15:36:21.258690+0000","last_unstale":"2023-10-09T15:36:21.268730+0000","last_undegraded":"2023-10-09T15:36:21.268730+0000","last_fullsized":"2023-10-09T15:36:21.268730+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:12.299964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273245+0000","last_change":"2023-10-09T15:36:21.271262+0000","last_active":"2023-10-09T15:36:21.273245+0000","last_peered":"2023-10-09T15:36:21.273245+0000","last_clean":"2023-10-09T15:36:21.273245+0000","last_became_active":"2023-10-09T15:36:21.270756+0000","last_became_peered":"2023-10-09T15:36:21.270756+0000","last_unstale":"2023-10-09T15:36:21.273245+0000","last_undegraded":"2023-10-09T15:36:21.273245+0000","last_fullsized":"2023-10-09T15:36:21.273245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:15.309183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266455+0000","last_change":"2023-10-09T15:36:21.259450+0000","last_active":"2023-10-09T15:36:21.266455+0000","last_peered":"2023-10-09T15:36:21.266455+0000","last_clean":"2023-10-09T15:36:21.266455+0000","last_became_active":"2023-10-09T15:36:21.258952+0000","last_became_peered":"2023-10-09T15:36:21.258952+0000","last_unstale":"2023-10-09T15:36:21.266455+0000","last_undegraded":"2023-10-09T15:36:21.266455+0000","last_fullsized":"2023-10-09T15:36:21.266455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269095+0000","last_change":"2023-10-09T15:36:21.259280+0000","last_active":"2023-10-09T15:36:21.269095+0000","last_peered":"2023-10-09T15:36:21.269095+0000","last_clean":"2023-10-09T15:36:21.269095+0000","last_became_active":"2023-10-09T15:36:21.258018+0000","last_became_peered":"2023-10-09T15:36:21.258018+0000","last_unstale":"2023-10-09T15:36:21.269095+0000","last_undegraded":"2023-10-09T15:36:21.269095+0000","last_fullsized":"2023-10-09T15:36:21.269095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273346+0000","last_change":"2023-10-09T15:36:21.271582+0000","last_active":"2023-10-09T15:36:21.273346+0000","last_peered":"2023-10-09T15:36:21.273346+0000","last_clean":"2023-10-09T15:36:21.273346+0000","last_became_active":"2023-10-09T15:36:21.271196+0000","last_became_peered":"2023-10-09T15:36:21.271196+0000","last_unstale":"2023-10-09T15:36:21.273346+0000","last_undegraded":"2023-10-09T15:36:21.273346+0000","last_fullsized":"2023-10-09T15:36:21.273346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:24.902855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.274276+0000","last_change":"2023-10-09T15:36:21.273435+0000","last_active":"2023-10-09T15:36:21.274276+0000","last_peered":"2023-10-09T15:36:21.274276+0000","last_clean":"2023-10-09T15:36:21.274276+0000","last_became_active":"2023-10-09T15:36:21.273117+0000","last_became_peered":"2023-10-09T15:36:21.273117+0000","last_unstale":"2023-10-09T15:36:21.274276+0000","last_undegraded":"2023-10-09T15:36:21.274276+0000","last_fullsized":"2023-10-09T15:36:21.274276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:43.537846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266384+0000","last_change":"2023-10-09T15:36:21.264353+0000","last_active":"2023-10-09T15:36:21.266384+0000","last_peered":"2023-10-09T15:36:21.266384+0000","last_clean":"2023-10-09T15:36:21.266384+0000","last_became_active":"2023-10-09T15:36:21.264082+0000","last_became_peered":"2023-10-09T15:36:21.264082+0000","last_unstale":"2023-10-09T15:36:21.266384+0000","last_undegraded":"2023-10-09T15:36:21.266384+0000","last_fullsized":"2023-10-09T15:36:21.266384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:16.094036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266813+0000","last_change":"2023-10-09T15:36:21.258785+0000","last_active":"2023-10-09T15:36:21.266813+0000","last_peered":"2023-10-09T15:36:21.266813+0000","last_clean":"2023-10-09T15:36:21.266813+0000","last_became_active":"2023-10-09T15:36:21.258128+0000","last_became_peered":"2023-10-09T15:36:21.258128+0000","last_unstale":"2023-10-09T15:36:21.266813+0000","last_undegraded":"2023-10-09T15:36:21.266813+0000","last_fullsized":"2023-10-09T15:36:21.266813+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273725+0000","last_change":"2023-10-09T15:36:21.271992+0000","last_active":"2023-10-09T15:36:21.273725+0000","last_peered":"2023-10-09T15:36:21.273725+0000","last_clean":"2023-10-09T15:36:21.273725+0000","last_became_active":"2023-10-09T15:36:21.269124+0000","last_became_peered":"2023-10-09T15:36:21.269124+0000","last_unstale":"2023-10-09T15:36:21.273725+0000","last_undegraded":"2023-10-09T15:36:21.273725+0000","last_fullsized":"2023-10-09T15:36:21.273725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:05.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273225+0000","last_change":"2023-10-09T15:36:21.270731+0000","last_active":"2023-10-09T15:36:21.273225+0000","last_peered":"2023-10-09T15:36:21.273225+0000","last_clean":"2023-10-09T15:36:21.273225+0000","last_became_active":"2023-10-09T15:36:21.270468+0000","last_became_peered":"2023-10-09T15:36:21.270468+0000","last_unstale":"2023-10-09T15:36:21.273225+0000","last_undegraded":"2023-10-09T15:36:21.273225+0000","last_fullsized":"2023-10-09T15:36:21.273225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:55.553745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265978+0000","last_change":"2023-10-09T15:36:21.260749+0000","last_active":"2023-10-09T15:36:21.265978+0000","last_peered":"2023-10-09T15:36:21.265978+0000","last_clean":"2023-10-09T15:36:21.265978+0000","last_became_active":"2023-10-09T15:36:21.258910+0000","last_became_peered":"2023-10-09T15:36:21.258910+0000","last_unstale":"2023-10-09T15:36:21.265978+0000","last_undegraded":"2023-10-09T15:36:21.265978+0000","last_fullsized":"2023-10-09T15:36:21.265978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273452+0000","last_change":"2023-10-09T15:36:21.271551+0000","last_active":"2023-10-09T15:36:21.273452+0000","last_peered":"2023-10-09T15:36:21.273452+0000","last_clean":"2023-10-09T15:36:21.273452+0000","last_became_active":"2023-10-09T15:36:21.271229+0000","last_became_peered":"2023-10-09T15:36:21.271229+0000","last_unstale":"2023-10-09T15:36:21.273452+0000","last_undegraded":"2023-10-09T15:36:21.273452+0000","last_fullsized":"2023-10-09T15:36:21.273452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.257630+0000","last_change":"2023-10-09T15:36:21.254192+0000","last_active":"2023-10-09T15:36:21.257630+0000","last_peered":"2023-10-09T15:36:21.257630+0000","last_clean":"2023-10-09T15:36:21.257630+0000","last_became_active":"2023-10-09T15:36:21.253878+0000","last_became_peered":"2023-10-09T15:36:21.253878+0000","last_unstale":"2023-10-09T15:36:21.257630+0000","last_undegraded":"2023-10-09T15:36:21.257630+0000","last_fullsized":"2023-10-09T15:36:21.257630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:33:50.947299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.594210+0000","last_change":"2023-10-09T15:36:20.585511+0000","last_active":"2023-10-09T15:36:21.594210+0000","last_peered":"2023-10-09T15:36:21.594210+0000","last_clean":"2023-10-09T15:36:21.594210+0000","last_became_active":"2023-10-09T15:36:20.585181+0000","last_became_peered":"2023-10-09T15:36:20.585181+0000","last_unstale":"2023-10-09T15:36:21.594210+0000","last_undegraded":"2023-10-09T15:36:21.594210+0000","last_fullsized":"2023-10-09T15:36:21.594210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:11.849563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266370+0000","last_change":"2023-10-09T15:36:21.259121+0000","last_active":"2023-10-09T15:36:21.266370+0000","last_peered":"2023-10-09T15:36:21.266370+0000","last_clean":"2023-10-09T15:36:21.266370+0000","last_became_active":"2023-10-09T15:36:21.258815+0000","last_became_peered":"2023-10-09T15:36:21.258815+0000","last_unstale":"2023-10-09T15:36:21.266370+0000","last_undegraded":"2023-10-09T15:36:21.266370+0000","last_fullsized":"2023-10-09T15:36:21.266370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:33:50.947299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592252+0000","last_change":"2023-10-09T15:36:20.585562+0000","last_active":"2023-10-09T15:36:21.592252+0000","last_peered":"2023-10-09T15:36:21.592252+0000","last_clean":"2023-10-09T15:36:21.592252+0000","last_became_active":"2023-10-09T15:36:20.585310+0000","last_became_peered":"2023-10-09T15:36:20.585310+0000","last_unstale":"2023-10-09T15:36:21.592252+0000","last_undegraded":"2023-10-09T15:36:21.592252+0000","last_fullsized":"2023-10-09T15:36:21.592252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:11.849563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270233+0000","last_change":"2023-10-09T15:36:21.267104+0000","last_active":"2023-10-09T15:36:21.270233+0000","last_peered":"2023-10-09T15:36:21.270233+0000","last_clean":"2023-10-09T15:36:21.270233+0000","last_became_active":"2023-10-09T15:36:21.266813+0000","last_became_peered":"2023-10-09T15:36:21.266813+0000","last_unstale":"2023-10-09T15:36:21.270233+0000","last_undegraded":"2023-10-09T15:36:21.270233+0000","last_fullsized":"2023-10-09T15:36:21.270233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592779+0000","last_change":"2023-10-09T15:36:20.591302+0000","last_active":"2023-10-09T15:36:21.592779+0000","last_peered":"2023-10-09T15:36:21.592779+0000","last_clean":"2023-10-09T15:36:21.592779+0000","last_became_active":"2023-10-09T15:36:20.590916+0000","last_became_peered":"2023-10-09T15:36:20.590916+0000","last_unstale":"2023-10-09T15:36:21.592779+0000","last_undegraded":"2023-10-09T15:36:21.592779+0000","last_fullsized":"2023-10-09T15:36:21.592779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:49.346985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273225+0000","last_change":"2023-10-09T15:36:21.271007+0000","last_active":"2023-10-09T15:36:21.273225+0000","last_peered":"2023-10-09T15:36:21.273225+0000","last_clean":"2023-10-09T15:36:21.273225+0000","last_became_active":"2023-10-09T15:36:21.270474+0000","last_became_peered":"2023-10-09T15:36:21.270474+0000","last_unstale":"2023-10-09T15:36:21.273225+0000","last_undegraded":"2023-10-09T15:36:21.273225+0000","last_fullsized":"2023-10-09T15:36:21.273225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:28.958095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592852+0000","last_change":"2023-10-09T15:36:20.591296+0000","last_active":"2023-10-09T15:36:21.592852+0000","last_peered":"2023-10-09T15:36:21.592852+0000","last_clean":"2023-10-09T15:36:21.592852+0000","last_became_active":"2023-10-09T15:36:20.590954+0000","last_became_peered":"2023-10-09T15:36:20.590954+0000","last_unstale":"2023-10-09T15:36:21.592852+0000","last_undegraded":"2023-10-09T15:36:21.592852+0000","last_fullsized":"2023-10-09T15:36:21.592852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:54.548844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273207+0000","last_change":"2023-10-09T15:36:21.270468+0000","last_active":"2023-10-09T15:36:21.273207+0000","last_peered":"2023-10-09T15:36:21.273207+0000","last_clean":"2023-10-09T15:36:21.273207+0000","last_became_active":"2023-10-09T15:36:21.270136+0000","last_became_peered":"2023-10-09T15:36:21.270136+0000","last_unstale":"2023-10-09T15:36:21.273207+0000","last_undegraded":"2023-10-09T15:36:21.273207+0000","last_fullsized":"2023-10-09T15:36:21.273207+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.980347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593012+0000","last_change":"2023-10-09T15:36:20.593716+0000","last_active":"2023-10-09T15:36:21.593012+0000","last_peered":"2023-10-09T15:36:21.593012+0000","last_clean":"2023-10-09T15:36:21.593012+0000","last_became_active":"2023-10-09T15:36:20.593377+0000","last_became_peered":"2023-10-09T15:36:20.593377+0000","last_unstale":"2023-10-09T15:36:21.593012+0000","last_undegraded":"2023-10-09T15:36:21.593012+0000","last_fullsized":"2023-10-09T15:36:21.593012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.408346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265769+0000","last_change":"2023-10-09T15:36:21.258381+0000","last_active":"2023-10-09T15:36:21.265769+0000","last_peered":"2023-10-09T15:36:21.265769+0000","last_clean":"2023-10-09T15:36:21.265769+0000","last_became_active":"2023-10-09T15:36:21.258095+0000","last_became_peered":"2023-10-09T15:36:21.258095+0000","last_unstale":"2023-10-09T15:36:21.265769+0000","last_undegraded":"2023-10-09T15:36:21.265769+0000","last_fullsized":"2023-10-09T15:36:21.265769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:34:41.133769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592098+0000","last_change":"2023-10-09T15:36:20.589134+0000","last_active":"2023-10-09T15:36:21.592098+0000","last_peered":"2023-10-09T15:36:21.592098+0000","last_clean":"2023-10-09T15:36:21.592098+0000","last_became_active":"2023-10-09T15:36:20.588753+0000","last_became_peered":"2023-10-09T15:36:20.588753+0000","last_unstale":"2023-10-09T15:36:21.592098+0000","last_undegraded":"2023-10-09T15:36:21.592098+0000","last_fullsized":"2023-10-09T15:36:21.592098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:31.765647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271972+0000","last_change":"2023-10-09T15:36:21.268259+0000","last_active":"2023-10-09T15:36:21.271972+0000","last_peered":"2023-10-09T15:36:21.271972+0000","last_clean":"2023-10-09T15:36:21.271972+0000","last_became_active":"2023-10-09T15:36:21.267989+0000","last_became_peered":"2023-10-09T15:36:21.267989+0000","last_unstale":"2023-10-09T15:36:21.271972+0000","last_undegraded":"2023-10-09T15:36:21.271972+0000","last_fullsized":"2023-10-09T15:36:21.271972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:53.063102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247504+0000","last_change":"2023-10-09T15:36:20.586973+0000","last_active":"2023-10-09T15:36:21.247504+0000","last_peered":"2023-10-09T15:36:21.247504+0000","last_clean":"2023-10-09T15:36:21.247504+0000","last_became_active":"2023-10-09T15:36:20.586685+0000","last_became_peered":"2023-10-09T15:36:20.586685+0000","last_unstale":"2023-10-09T15:36:21.247504+0000","last_undegraded":"2023-10-09T15:36:21.247504+0000","last_fullsized":"2023-10-09T15:36:21.247504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.975446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267233+0000","last_change":"2023-10-09T15:36:21.263592+0000","last_active":"2023-10-09T15:36:21.267233+0000","last_peered":"2023-10-09T15:36:21.267233+0000","last_clean":"2023-10-09T15:36:21.267233+0000","last_became_active":"2023-10-09T15:36:21.263270+0000","last_became_peered":"2023-10-09T15:36:21.263270+0000","last_unstale":"2023-10-09T15:36:21.267233+0000","last_undegraded":"2023-10-09T15:36:21.267233+0000","last_fullsized":"2023-10-09T15:36:21.267233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:46.483370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265552+0000","last_change":"2023-10-09T15:36:20.589121+0000","last_active":"2023-10-09T15:36:21.265552+0000","last_peered":"2023-10-09T15:36:21.265552+0000","last_clean":"2023-10-09T15:36:21.265552+0000","last_became_active":"2023-10-09T15:36:20.588813+0000","last_became_peered":"2023-10-09T15:36:20.588813+0000","last_unstale":"2023-10-09T15:36:21.265552+0000","last_undegraded":"2023-10-09T15:36:21.265552+0000","last_fullsized":"2023-10-09T15:36:21.265552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:44.537654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269037+0000","last_change":"2023-10-09T15:36:21.267490+0000","last_active":"2023-10-09T15:36:21.269037+0000","last_peered":"2023-10-09T15:36:21.269037+0000","last_clean":"2023-10-09T15:36:21.269037+0000","last_became_active":"2023-10-09T15:36:21.267206+0000","last_became_peered":"2023-10-09T15:36:21.267206+0000","last_unstale":"2023-10-09T15:36:21.269037+0000","last_undegraded":"2023-10-09T15:36:21.269037+0000","last_fullsized":"2023-10-09T15:36:21.269037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:31.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.252426+0000","last_change":"2023-10-09T15:36:20.577806+0000","last_active":"2023-10-09T15:36:21.252426+0000","last_peered":"2023-10-09T15:36:21.252426+0000","last_clean":"2023-10-09T15:36:21.252426+0000","last_became_active":"2023-10-09T15:36:20.577515+0000","last_became_peered":"2023-10-09T15:36:20.577515+0000","last_unstale":"2023-10-09T15:36:21.252426+0000","last_undegraded":"2023-10-09T15:36:21.252426+0000","last_fullsized":"2023-10-09T15:36:21.252426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:23.817113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272574+0000","last_change":"2023-10-09T15:36:21.269561+0000","last_active":"2023-10-09T15:36:21.272574+0000","last_peered":"2023-10-09T15:36:21.272574+0000","last_clean":"2023-10-09T15:36:21.272574+0000","last_became_active":"2023-10-09T15:36:21.269266+0000","last_became_peered":"2023-10-09T15:36:21.269266+0000","last_unstale":"2023-10-09T15:36:21.272574+0000","last_undegraded":"2023-10-09T15:36:21.272574+0000","last_fullsized":"2023-10-09T15:36:21.272574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249628+0000","last_change":"2023-10-09T15:36:20.582877+0000","last_active":"2023-10-09T15:36:21.249628+0000","last_peered":"2023-10-09T15:36:21.249628+0000","last_clean":"2023-10-09T15:36:21.249628+0000","last_became_active":"2023-10-09T15:36:20.582548+0000","last_became_peered":"2023-10-09T15:36:20.582548+0000","last_unstale":"2023-10-09T15:36:21.249628+0000","last_undegraded":"2023-10-09T15:36:21.249628+0000","last_fullsized":"2023-10-09T15:36:21.249628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:20.553387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259590+0000","last_change":"2023-10-09T15:36:21.254584+0000","last_active":"2023-10-09T15:36:21.259590+0000","last_peered":"2023-10-09T15:36:21.259590+0000","last_clean":"2023-10-09T15:36:21.259590+0000","last_became_active":"2023-10-09T15:36:21.254297+0000","last_became_peered":"2023-10-09T15:36:21.254297+0000","last_unstale":"2023-10-09T15:36:21.259590+0000","last_undegraded":"2023-10-09T15:36:21.259590+0000","last_fullsized":"2023-10-09T15:36:21.259590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.594095+0000","last_change":"2023-10-09T15:36:20.591254+0000","last_active":"2023-10-09T15:36:21.594095+0000","last_peered":"2023-10-09T15:36:21.594095+0000","last_clean":"2023-10-09T15:36:21.594095+0000","last_became_active":"2023-10-09T15:36:20.590972+0000","last_became_peered":"2023-10-09T15:36:20.590972+0000","last_unstale":"2023-10-09T15:36:21.594095+0000","last_undegraded":"2023-10-09T15:36:21.594095+0000","last_fullsized":"2023-10-09T15:36:21.594095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.695202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266276+0000","last_change":"2023-10-09T15:36:21.260898+0000","last_active":"2023-10-09T15:36:21.266276+0000","last_peered":"2023-10-09T15:36:21.266276+0000","last_clean":"2023-10-09T15:36:21.266276+0000","last_became_active":"2023-10-09T15:36:21.259059+0000","last_became_peered":"2023-10-09T15:36:21.259059+0000","last_unstale":"2023-10-09T15:36:21.266276+0000","last_undegraded":"2023-10-09T15:36:21.266276+0000","last_fullsized":"2023-10-09T15:36:21.266276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.834282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.596890+0000","last_change":"2023-10-09T15:36:20.589918+0000","last_active":"2023-10-09T15:36:21.596890+0000","last_peered":"2023-10-09T15:36:21.596890+0000","last_clean":"2023-10-09T15:36:21.596890+0000","last_became_active":"2023-10-09T15:36:20.589694+0000","last_became_peered":"2023-10-09T15:36:20.589694+0000","last_unstale":"2023-10-09T15:36:21.596890+0000","last_undegraded":"2023-10-09T15:36:21.596890+0000","last_fullsized":"2023-10-09T15:36:21.596890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:57.006504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259573+0000","last_change":"2023-10-09T15:36:21.255337+0000","last_active":"2023-10-09T15:36:21.259573+0000","last_peered":"2023-10-09T15:36:21.259573+0000","last_clean":"2023-10-09T15:36:21.259573+0000","last_became_active":"2023-10-09T15:36:21.255089+0000","last_became_peered":"2023-10-09T15:36:21.255089+0000","last_unstale":"2023-10-09T15:36:21.259573+0000","last_undegraded":"2023-10-09T15:36:21.259573+0000","last_fullsized":"2023-10-09T15:36:21.259573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593656+0000","last_change":"2023-10-09T15:36:20.592555+0000","last_active":"2023-10-09T15:36:21.593656+0000","last_peered":"2023-10-09T15:36:21.593656+0000","last_clean":"2023-10-09T15:36:21.593656+0000","last_became_active":"2023-10-09T15:36:20.592239+0000","last_became_peered":"2023-10-09T15:36:20.592239+0000","last_unstale":"2023-10-09T15:36:21.593656+0000","last_undegraded":"2023-10-09T15:36:21.593656+0000","last_fullsized":"2023-10-09T15:36:21.593656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:59.498672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272957+0000","last_change":"2023-10-09T15:36:21.270400+0000","last_active":"2023-10-09T15:36:21.272957+0000","last_peered":"2023-10-09T15:36:21.272957+0000","last_clean":"2023-10-09T15:36:21.272957+0000","last_became_active":"2023-10-09T15:36:21.270165+0000","last_became_peered":"2023-10-09T15:36:21.270165+0000","last_unstale":"2023-10-09T15:36:21.272957+0000","last_undegraded":"2023-10-09T15:36:21.272957+0000","last_fullsized":"2023-10-09T15:36:21.272957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:21.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.254369+0000","last_change":"2023-10-09T15:36:20.589471+0000","last_active":"2023-10-09T15:36:21.254369+0000","last_peered":"2023-10-09T15:36:21.254369+0000","last_clean":"2023-10-09T15:36:21.254369+0000","last_became_active":"2023-10-09T15:36:20.589197+0000","last_became_peered":"2023-10-09T15:36:20.589197+0000","last_unstale":"2023-10-09T15:36:21.254369+0000","last_undegraded":"2023-10-09T15:36:21.254369+0000","last_fullsized":"2023-10-09T15:36:21.254369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:57.396668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273321+0000","last_change":"2023-10-09T15:36:21.271364+0000","last_active":"2023-10-09T15:36:21.273321+0000","last_peered":"2023-10-09T15:36:21.273321+0000","last_clean":"2023-10-09T15:36:21.273321+0000","last_became_active":"2023-10-09T15:36:21.271086+0000","last_became_peered":"2023-10-09T15:36:21.271086+0000","last_unstale":"2023-10-09T15:36:21.273321+0000","last_undegraded":"2023-10-09T15:36:21.273321+0000","last_fullsized":"2023-10-09T15:36:21.273321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:13.984092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.257976+0000","last_change":"2023-10-09T15:36:20.582158+0000","last_active":"2023-10-09T15:36:21.257976+0000","last_peered":"2023-10-09T15:36:21.257976+0000","last_clean":"2023-10-09T15:36:21.257976+0000","last_became_active":"2023-10-09T15:36:20.581798+0000","last_became_peered":"2023-10-09T15:36:20.581798+0000","last_unstale":"2023-10-09T15:36:21.257976+0000","last_undegraded":"2023-10-09T15:36:21.257976+0000","last_fullsized":"2023-10-09T15:36:21.257976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:23.897954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273371+0000","last_change":"2023-10-09T15:36:21.271493+0000","last_active":"2023-10-09T15:36:21.273371+0000","last_peered":"2023-10-09T15:36:21.273371+0000","last_clean":"2023-10-09T15:36:21.273371+0000","last_became_active":"2023-10-09T15:36:21.271135+0000","last_became_peered":"2023-10-09T15:36:21.271135+0000","last_unstale":"2023-10-09T15:36:21.273371+0000","last_undegraded":"2023-10-09T15:36:21.273371+0000","last_fullsized":"2023-10-09T15:36:21.273371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:58.011405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"76'8","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593764+0000","last_change":"2023-10-09T15:36:20.587280+0000","last_active":"2023-10-09T15:36:21.593764+0000","last_peered":"2023-10-09T15:36:21.593764+0000","last_clean":"2023-10-09T15:36:21.593764+0000","last_became_active":"2023-10-09T15:36:20.587006+0000","last_became_peered":"2023-10-09T15:36:20.587006+0000","last_unstale":"2023-10-09T15:36:21.593764+0000","last_undegraded":"2023-10-09T15:36:21.593764+0000","last_fullsized":"2023-10-09T15:36:21.593764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:15.089136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271679+0000","last_change":"2023-10-09T15:36:21.268109+0000","last_active":"2023-10-09T15:36:21.271679+0000","last_peered":"2023-10-09T15:36:21.271679+0000","last_clean":"2023-10-09T15:36:21.271679+0000","last_became_active":"2023-10-09T15:36:21.267812+0000","last_became_peered":"2023-10-09T15:36:21.267812+0000","last_unstale":"2023-10-09T15:36:21.271679+0000","last_undegraded":"2023-10-09T15:36:21.271679+0000","last_fullsized":"2023-10-09T15:36:21.271679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:40.856359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592887+0000","last_change":"2023-10-09T15:36:20.580692+0000","last_active":"2023-10-09T15:36:21.592887+0000","last_peered":"2023-10-09T15:36:21.592887+0000","last_clean":"2023-10-09T15:36:21.592887+0000","last_became_active":"2023-10-09T15:36:20.580440+0000","last_became_peered":"2023-10-09T15:36:20.580440+0000","last_unstale":"2023-10-09T15:36:21.592887+0000","last_undegraded":"2023-10-09T15:36:21.592887+0000","last_fullsized":"2023-10-09T15:36:21.592887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:51.744334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270233+0000","last_change":"2023-10-09T15:36:21.264795+0000","last_active":"2023-10-09T15:36:21.270233+0000","last_peered":"2023-10-09T15:36:21.270233+0000","last_clean":"2023-10-09T15:36:21.270233+0000","last_became_active":"2023-10-09T15:36:21.264493+0000","last_became_peered":"2023-10-09T15:36:21.264493+0000","last_unstale":"2023-10-09T15:36:21.270233+0000","last_undegraded":"2023-10-09T15:36:21.270233+0000","last_fullsized":"2023-10-09T15:36:21.270233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592770+0000","last_change":"2023-10-09T15:36:20.584321+0000","last_active":"2023-10-09T15:36:21.592770+0000","last_peered":"2023-10-09T15:36:21.592770+0000","last_clean":"2023-10-09T15:36:21.592770+0000","last_became_active":"2023-10-09T15:36:20.584031+0000","last_became_peered":"2023-10-09T15:36:20.584031+0000","last_unstale":"2023-10-09T15:36:21.592770+0000","last_undegraded":"2023-10-09T15:36:21.592770+0000","last_fullsized":"2023-10-09T15:36:21.592770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:23.468863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269013+0000","last_change":"2023-10-09T15:36:21.267320+0000","last_active":"2023-10-09T15:36:21.269013+0000","last_peered":"2023-10-09T15:36:21.269013+0000","last_clean":"2023-10-09T15:36:21.269013+0000","last_became_active":"2023-10-09T15:36:21.267035+0000","last_became_peered":"2023-10-09T15:36:21.267035+0000","last_unstale":"2023-10-09T15:36:21.269013+0000","last_undegraded":"2023-10-09T15:36:21.269013+0000","last_fullsized":"2023-10-09T15:36:21.269013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247948+0000","last_change":"2023-10-09T15:36:20.586981+0000","last_active":"2023-10-09T15:36:21.247948+0000","last_peered":"2023-10-09T15:36:21.247948+0000","last_clean":"2023-10-09T15:36:21.247948+0000","last_became_active":"2023-10-09T15:36:20.586708+0000","last_became_peered":"2023-10-09T15:36:20.586708+0000","last_unstale":"2023-10-09T15:36:21.247948+0000","last_undegraded":"2023-10-09T15:36:21.247948+0000","last_fullsized":"2023-10-09T15:36:21.247948+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:14.304283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269992+0000","last_change":"2023-10-09T15:36:21.267314+0000","last_active":"2023-10-09T15:36:21.269992+0000","last_peered":"2023-10-09T15:36:21.269992+0000","last_clean":"2023-10-09T15:36:21.269992+0000","last_became_active":"2023-10-09T15:36:21.267009+0000","last_became_peered":"2023-10-09T15:36:21.267009+0000","last_unstale":"2023-10-09T15:36:21.269992+0000","last_undegraded":"2023-10-09T15:36:21.269992+0000","last_fullsized":"2023-10-09T15:36:21.269992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:38.557380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.591652+0000","last_change":"2023-10-09T15:36:20.585577+0000","last_active":"2023-10-09T15:36:21.591652+0000","last_peered":"2023-10-09T15:36:21.591652+0000","last_clean":"2023-10-09T15:36:21.591652+0000","last_became_active":"2023-10-09T15:36:20.585242+0000","last_became_peered":"2023-10-09T15:36:20.585242+0000","last_unstale":"2023-10-09T15:36:21.591652+0000","last_undegraded":"2023-10-09T15:36:21.591652+0000","last_fullsized":"2023-10-09T15:36:21.591652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:20.243834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267266+0000","last_change":"2023-10-09T15:36:21.263776+0000","last_active":"2023-10-09T15:36:21.267266+0000","last_peered":"2023-10-09T15:36:21.267266+0000","last_clean":"2023-10-09T15:36:21.267266+0000","last_became_active":"2023-10-09T15:36:21.263487+0000","last_became_peered":"2023-10-09T15:36:21.263487+0000","last_unstale":"2023-10-09T15:36:21.267266+0000","last_undegraded":"2023-10-09T15:36:21.267266+0000","last_fullsized":"2023-10-09T15:36:21.267266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:10.645144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251496+0000","last_change":"2023-10-09T15:36:20.587685+0000","last_active":"2023-10-09T15:36:21.251496+0000","last_peered":"2023-10-09T15:36:21.251496+0000","last_clean":"2023-10-09T15:36:21.251496+0000","last_became_active":"2023-10-09T15:36:20.587379+0000","last_became_peered":"2023-10-09T15:36:20.587379+0000","last_unstale":"2023-10-09T15:36:21.251496+0000","last_undegraded":"2023-10-09T15:36:21.251496+0000","last_fullsized":"2023-10-09T15:36:21.251496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:15:21.502520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269984+0000","last_change":"2023-10-09T15:36:21.264685+0000","last_active":"2023-10-09T15:36:21.269984+0000","last_peered":"2023-10-09T15:36:21.269984+0000","last_clean":"2023-10-09T15:36:21.269984+0000","last_became_active":"2023-10-09T15:36:21.264406+0000","last_became_peered":"2023-10-09T15:36:21.264406+0000","last_unstale":"2023-10-09T15:36:21.269984+0000","last_undegraded":"2023-10-09T15:36:21.269984+0000","last_fullsized":"2023-10-09T15:36:21.269984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:56.931597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251142+0000","last_change":"2023-10-09T15:36:20.584581+0000","last_active":"2023-10-09T15:36:21.251142+0000","last_peered":"2023-10-09T15:36:21.251142+0000","last_clean":"2023-10-09T15:36:21.251142+0000","last_became_active":"2023-10-09T15:36:20.584306+0000","last_became_peered":"2023-10-09T15:36:20.584306+0000","last_unstale":"2023-10-09T15:36:21.251142+0000","last_undegraded":"2023-10-09T15:36:21.251142+0000","last_fullsized":"2023-10-09T15:36:21.251142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:18.419869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268603+0000","last_change":"2023-10-09T15:36:21.264975+0000","last_active":"2023-10-09T15:36:21.268603+0000","last_peered":"2023-10-09T15:36:21.268603+0000","last_clean":"2023-10-09T15:36:21.268603+0000","last_became_active":"2023-10-09T15:36:21.264654+0000","last_became_peered":"2023-10-09T15:36:21.264654+0000","last_unstale":"2023-10-09T15:36:21.268603+0000","last_undegraded":"2023-10-09T15:36:21.268603+0000","last_fullsized":"2023-10-09T15:36:21.268603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:52.120309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.254272+0000","last_change":"2023-10-09T15:36:20.582150+0000","last_active":"2023-10-09T15:36:21.254272+0000","last_peered":"2023-10-09T15:36:21.254272+0000","last_clean":"2023-10-09T15:36:21.254272+0000","last_became_active":"2023-10-09T15:36:20.581902+0000","last_became_peered":"2023-10-09T15:36:20.581902+0000","last_unstale":"2023-10-09T15:36:21.254272+0000","last_undegraded":"2023-10-09T15:36:21.254272+0000","last_fullsized":"2023-10-09T15:36:21.254272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:39.851459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266402+0000","last_change":"2023-10-09T15:36:21.263509+0000","last_active":"2023-10-09T15:36:21.266402+0000","last_peered":"2023-10-09T15:36:21.266402+0000","last_clean":"2023-10-09T15:36:21.266402+0000","last_became_active":"2023-10-09T15:36:21.263247+0000","last_became_peered":"2023-10-09T15:36:21.263247+0000","last_unstale":"2023-10-09T15:36:21.266402+0000","last_undegraded":"2023-10-09T15:36:21.266402+0000","last_fullsized":"2023-10-09T15:36:21.266402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:13.547321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593958+0000","last_change":"2023-10-09T15:36:20.589000+0000","last_active":"2023-10-09T15:36:21.593958+0000","last_peered":"2023-10-09T15:36:21.593958+0000","last_clean":"2023-10-09T15:36:21.593958+0000","last_became_active":"2023-10-09T15:36:20.588640+0000","last_became_peered":"2023-10-09T15:36:20.588640+0000","last_unstale":"2023-10-09T15:36:21.593958+0000","last_undegraded":"2023-10-09T15:36:21.593958+0000","last_fullsized":"2023-10-09T15:36:21.593958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.283050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272965+0000","last_change":"2023-10-09T15:36:21.270156+0000","last_active":"2023-10-09T15:36:21.272965+0000","last_peered":"2023-10-09T15:36:21.272965+0000","last_clean":"2023-10-09T15:36:21.272965+0000","last_became_active":"2023-10-09T15:36:21.269896+0000","last_became_peered":"2023-10-09T15:36:21.269896+0000","last_unstale":"2023-10-09T15:36:21.272965+0000","last_undegraded":"2023-10-09T15:36:21.272965+0000","last_fullsized":"2023-10-09T15:36:21.272965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:57.407105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.264333+0000","last_change":"2023-10-09T15:36:20.588939+0000","last_active":"2023-10-09T15:36:21.264333+0000","last_peered":"2023-10-09T15:36:21.264333+0000","last_clean":"2023-10-09T15:36:21.264333+0000","last_became_active":"2023-10-09T15:36:20.588616+0000","last_became_peered":"2023-10-09T15:36:20.588616+0000","last_unstale":"2023-10-09T15:36:21.264333+0000","last_undegraded":"2023-10-09T15:36:21.264333+0000","last_fullsized":"2023-10-09T15:36:21.264333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:07:02.575043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266835+0000","last_change":"2023-10-09T15:36:21.258986+0000","last_active":"2023-10-09T15:36:21.266835+0000","last_peered":"2023-10-09T15:36:21.266835+0000","last_clean":"2023-10-09T15:36:21.266835+0000","last_became_active":"2023-10-09T15:36:21.258498+0000","last_became_peered":"2023-10-09T15:36:21.258498+0000","last_unstale":"2023-10-09T15:36:21.266835+0000","last_undegraded":"2023-10-09T15:36:21.266835+0000","last_fullsized":"2023-10-09T15:36:21.266835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:34:41.133769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249374+0000","last_change":"2023-10-09T15:36:20.582615+0000","last_active":"2023-10-09T15:36:21.249374+0000","last_peered":"2023-10-09T15:36:21.249374+0000","last_clean":"2023-10-09T15:36:21.249374+0000","last_became_active":"2023-10-09T15:36:20.582271+0000","last_became_peered":"2023-10-09T15:36:20.582271+0000","last_unstale":"2023-10-09T15:36:21.249374+0000","last_undegraded":"2023-10-09T15:36:21.249374+0000","last_fullsized":"2023-10-09T15:36:21.249374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.408346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265902+0000","last_change":"2023-10-09T15:36:21.259116+0000","last_active":"2023-10-09T15:36:21.265902+0000","last_peered":"2023-10-09T15:36:21.265902+0000","last_clean":"2023-10-09T15:36:21.265902+0000","last_became_active":"2023-10-09T15:36:21.258750+0000","last_became_peered":"2023-10-09T15:36:21.258750+0000","last_unstale":"2023-10-09T15:36:21.265902+0000","last_undegraded":"2023-10-09T15:36:21.265902+0000","last_fullsized":"2023-10-09T15:36:21.265902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251341+0000","last_change":"2023-10-09T15:36:20.577747+0000","last_active":"2023-10-09T15:36:21.251341+0000","last_peered":"2023-10-09T15:36:21.251341+0000","last_clean":"2023-10-09T15:36:21.251341+0000","last_became_active":"2023-10-09T15:36:20.577382+0000","last_became_peered":"2023-10-09T15:36:20.577382+0000","last_unstale":"2023-10-09T15:36:21.251341+0000","last_undegraded":"2023-10-09T15:36:21.251341+0000","last_fullsized":"2023-10-09T15:36:21.251341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:07.383250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267298+0000","last_change":"2023-10-09T15:36:21.264145+0000","last_active":"2023-10-09T15:36:21.267298+0000","last_peered":"2023-10-09T15:36:21.267298+0000","last_clean":"2023-10-09T15:36:21.267298+0000","last_became_active":"2023-10-09T15:36:21.263872+0000","last_became_peered":"2023-10-09T15:36:21.263872+0000","last_unstale":"2023-10-09T15:36:21.267298+0000","last_undegraded":"2023-10-09T15:36:21.267298+0000","last_fullsized":"2023-10-09T15:36:21.267298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:16.094036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247673+0000","last_change":"2023-10-09T15:36:20.582908+0000","last_active":"2023-10-09T15:36:21.247673+0000","last_peered":"2023-10-09T15:36:21.247673+0000","last_clean":"2023-10-09T15:36:21.247673+0000","last_became_active":"2023-10-09T15:36:20.582623+0000","last_became_peered":"2023-10-09T15:36:20.582623+0000","last_unstale":"2023-10-09T15:36:21.247673+0000","last_undegraded":"2023-10-09T15:36:21.247673+0000","last_fullsized":"2023-10-09T15:36:21.247673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:12.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259587+0000","last_change":"2023-10-09T15:36:21.255334+0000","last_active":"2023-10-09T15:36:21.259587+0000","last_peered":"2023-10-09T15:36:21.259587+0000","last_clean":"2023-10-09T15:36:21.259587+0000","last_became_active":"2023-10-09T15:36:21.255008+0000","last_became_peered":"2023-10-09T15:36:21.255008+0000","last_unstale":"2023-10-09T15:36:21.259587+0000","last_undegraded":"2023-10-09T15:36:21.259587+0000","last_fullsized":"2023-10-09T15:36:21.259587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249787+0000","last_change":"2023-10-09T15:36:20.585259+0000","last_active":"2023-10-09T15:36:21.249787+0000","last_peered":"2023-10-09T15:36:21.249787+0000","last_clean":"2023-10-09T15:36:21.249787+0000","last_became_active":"2023-10-09T15:36:20.584929+0000","last_became_peered":"2023-10-09T15:36:20.584929+0000","last_unstale":"2023-10-09T15:36:21.249787+0000","last_undegraded":"2023-10-09T15:36:21.249787+0000","last_fullsized":"2023-10-09T15:36:21.249787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.695202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.274294+0000","last_change":"2023-10-09T15:36:21.273506+0000","last_active":"2023-10-09T15:36:21.274294+0000","last_peered":"2023-10-09T15:36:21.274294+0000","last_clean":"2023-10-09T15:36:21.274294+0000","last_became_active":"2023-10-09T15:36:21.273029+0000","last_became_peered":"2023-10-09T15:36:21.273029+0000","last_unstale":"2023-10-09T15:36:21.274294+0000","last_undegraded":"2023-10-09T15:36:21.274294+0000","last_fullsized":"2023-10-09T15:36:21.274294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:58.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.248965+0000","last_change":"2023-10-09T15:36:20.578133+0000","last_active":"2023-10-09T15:36:21.248965+0000","last_peered":"2023-10-09T15:36:21.248965+0000","last_clean":"2023-10-09T15:36:21.248965+0000","last_became_active":"2023-10-09T15:36:20.577526+0000","last_became_peered":"2023-10-09T15:36:20.577526+0000","last_unstale":"2023-10-09T15:36:21.248965+0000","last_undegraded":"2023-10-09T15:36:21.248965+0000","last_fullsized":"2023-10-09T15:36:21.248965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:22:02.618562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266435+0000","last_change":"2023-10-09T15:36:21.259251+0000","last_active":"2023-10-09T15:36:21.266435+0000","last_peered":"2023-10-09T15:36:21.266435+0000","last_clean":"2023-10-09T15:36:21.266435+0000","last_became_active":"2023-10-09T15:36:21.258570+0000","last_became_peered":"2023-10-09T15:36:21.258570+0000","last_unstale":"2023-10-09T15:36:21.266435+0000","last_undegraded":"2023-10-09T15:36:21.266435+0000","last_fullsized":"2023-10-09T15:36:21.266435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251553+0000","last_change":"2023-10-09T15:36:20.587558+0000","last_active":"2023-10-09T15:36:21.251553+0000","last_peered":"2023-10-09T15:36:21.251553+0000","last_clean":"2023-10-09T15:36:21.251553+0000","last_became_active":"2023-10-09T15:36:20.587165+0000","last_became_peered":"2023-10-09T15:36:20.587165+0000","last_unstale":"2023-10-09T15:36:21.251553+0000","last_undegraded":"2023-10-09T15:36:21.251553+0000","last_fullsized":"2023-10-09T15:36:21.251553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:20.553387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273274+0000","last_change":"2023-10-09T15:36:21.269743+0000","last_active":"2023-10-09T15:36:21.273274+0000","last_peered":"2023-10-09T15:36:21.273274+0000","last_clean":"2023-10-09T15:36:21.273274+0000","last_became_active":"2023-10-09T15:36:21.269484+0000","last_became_peered":"2023-10-09T15:36:21.269484+0000","last_unstale":"2023-10-09T15:36:21.273274+0000","last_undegraded":"2023-10-09T15:36:21.273274+0000","last_fullsized":"2023-10-09T15:36:21.273274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:40.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593415+0000","last_change":"2023-10-09T15:36:20.595227+0000","last_active":"2023-10-09T15:36:21.593415+0000","last_peered":"2023-10-09T15:36:21.593415+0000","last_clean":"2023-10-09T15:36:21.593415+0000","last_became_active":"2023-10-09T15:36:20.594868+0000","last_became_peered":"2023-10-09T15:36:20.594868+0000","last_unstale":"2023-10-09T15:36:21.593415+0000","last_undegraded":"2023-10-09T15:36:21.593415+0000","last_fullsized":"2023-10-09T15:36:21.593415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:15.089136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.260856+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:36:21.260856+0000","last_peered":"2023-10-09T15:36:21.260856+0000","last_clean":"2023-10-09T15:36:21.260856+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:36:21.260856+0000","last_undegraded":"2023-10-09T15:36:21.260856+0000","last_fullsized":"2023-10-09T15:36:21.260856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298784,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073056,"statfs":{"total":96636764160,"available":96330809344,"internally_reserved":0,"allocated":1531904,"data_stored":990370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63400000000000001,"5min":0.874,"15min":0.874},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.46600000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":3,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.745,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5}]},{"osd":4,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.88,"15min":0.88},"last":0.439}]},{"osd":5,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.57199999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.38800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63900000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.56000000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":1.379,"15min":1.379},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.61699999999999999,"15min":0.80300000000000005},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.62},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66800000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.872,"15min":0.872},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":400126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36199999999999999,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52900000000000003,"5min":1.512,"15min":1.512},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":1.286,"15min":1.286},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55000000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.877,"5min":1.222,"15min":1.222},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.81499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.877}]},{"osd":7,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.997,"15min":0.997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69299999999999995,"15min":0.82099999999999995},"min":{"1min":0.48099999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.93300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298780,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073060,"statfs":{"total":96636764160,"available":96330813440,"internally_reserved":0,"allocated":1527808,"data_stored":989323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.373},"min":{"1min":0.219,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.377},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.41599999999999998},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36399999999999999,"15min":0.39000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.497,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.318},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.29399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.54200000000000004},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47099999999999997,"15min":0.621},"min":{"1min":0.33300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53400000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":1.196,"15min":1.196},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.508,"15min":1.508},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60299999999999998,"15min":0.63300000000000001},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.68100000000000005},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":406774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35199999999999998,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51200000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.437},{"interface":"front","average":{"1min":0.377,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48999999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.434},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61199999999999999,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83199999999999996,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.69299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.68500000000000005},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":1.407,"15min":1.407},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":401468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32600000000000001,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46899999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.49199999999999999,"15min":0.91200000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45700000000000002,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.42299999999999999,"15min":0.68000000000000005},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.64700000000000002,"15min":1.429},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.498,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.48299999999999998,"15min":0.755},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50700000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":1.121},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":17.02,"15min":17.02},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.71599999999999997,"15min":0.92700000000000005},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.75},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":1.149},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.93700000000000006},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.278,"15min":1.278},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.78000000000000003,"15min":1.1950000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85099999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.95199999999999996},"min":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.876,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":406220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70599999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.871,"5min":2.879,"15min":2.879},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65000000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.68000000000000005},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.80200000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":401490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.165,"15min":1.165},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":2.089,"15min":2.089},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.71699999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":11.055,"15min":11.055},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.93899999999999995},"min":{"1min":0.49199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.5}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68500000000000005,"15min":0.94099999999999995},"min":{"1min":0.46999999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79300000000000004,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72999999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.78400000000000003,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:36:25.703 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:36:25.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.854+0000 7fa060f9e700 1 Processor -- start 2023-10-09T15:36:25.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.854+0000 7fa060f9e700 1 -- start start 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa060f9e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa05c153c30 0x7fa05c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa060f9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 0x7fa05c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa060f9e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa05c15afd0 con 0x7fa05c15de50 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa060f9e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c15b2b0 con 0x7fa05c153c30 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa060f9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa05c15b590 con 0x7fa05c0cf110 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa05c153c30 0x7fa05c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05affd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa05c15de50 0x7fa05c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51624/0 (socket says 172.21.15.33:51624) 2023-10-09T15:36:25.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa05c153c30 0x7fa05c15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56266/0 (socket says 172.21.15.33:56266) 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05affd700 1 -- 172.21.15.33:0/1351947907 learned_addr learned my addr 172.21.15.33:0/1351947907 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05bfff700 1 --2- 172.21.15.33:0/1351947907 >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 0x7fa05c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05b7fe700 1 -- 172.21.15.33:0/1351947907 >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 msgr2=0x7fa05c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05b7fe700 1 --2- 172.21.15.33:0/1351947907 >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 0x7fa05c15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.855+0000 7fa05b7fe700 1 -- 172.21.15.33:0/1351947907 >> v1:172.21.15.33:6789/0 conn(0x7fa05c15de50 legacy=0x7fa05c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05b7fe700 1 -- 172.21.15.33:0/1351947907 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa05c15b870 con 0x7fa05c153c30 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05bfff700 1 --2- 172.21.15.33:0/1351947907 >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 0x7fa05c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05b7fe700 1 --2- 172.21.15.33:0/1351947907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c15a5e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0cdab0 tx=0x7fa04c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8be880f66b60dac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05a7fc700 1 -- 172.21.15.33:0/1351947907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00b6b0 con 0x7fa05c153c30 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05a7fc700 1 -- 172.21.15.33:0/1351947907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa04c00b810 con 0x7fa05c153c30 2023-10-09T15:36:25.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa05a7fc700 1 -- 172.21.15.33:0/1351947907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa04c00bbb0 con 0x7fa05c153c30 2023-10-09T15:36:25.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 -- 172.21.15.33:0/1351947907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 msgr2=0x7fa05c15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 --2- 172.21.15.33:0/1351947907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c15a5e0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fa05c0cdab0 tx=0x7fa04c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 -- 172.21.15.33:0/1351947907 shutdown_connections 2023-10-09T15:36:25.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 --2- 172.21.15.33:0/1351947907 >> v2:172.21.15.59:3300/0 conn(0x7fa05c0cf110 0x7fa05c15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 --2- 172.21.15.33:0/1351947907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c15a5e0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 -- 172.21.15.33:0/1351947907 >> 172.21.15.33:0/1351947907 conn(0x7fa05c0703a0 msgr2=0x7fa05c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 -- 172.21.15.33:0/1351947907 shutdown_connections 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.856+0000 7fa060f9e700 1 -- 172.21.15.33:0/1351947907 wait complete. 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.858+0000 7fa060f9e700 1 Processor -- start 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.858+0000 7fa060f9e700 1 -- start start 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.858+0000 7fa060f9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa05c0cf110 0x7fa05c0c7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.858+0000 7fa060f9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 0x7fa05c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0b44c0 con 0x7fa05c153c30 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0ca380 con 0x7fa05c0cf110 2023-10-09T15:36:25.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05c0c7dc0 con 0x7fa05c15de50 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56280/0 (socket says 172.21.15.33:56280) 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 -- 172.21.15.33:0/127105091 learned_addr learned my addr 172.21.15.33:0/127105091 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05b7fe700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa05c0cf110 0x7fa05c0c7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05bfff700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 0x7fa05c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 -- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 msgr2=0x7fa05c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 0x7fa05c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 -- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa05c0cf110 msgr2=0x7fa05c0c7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa05c0cf110 0x7fa05c0c7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 -- 172.21.15.33:0/127105091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa04c009420 con 0x7fa05c153c30 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05bfff700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 0x7fa05c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:25.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa05affd700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c590 tx=0x7fa050001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050005b30 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa050005cb0 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa05c0c80a0 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa050007320 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.859+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa05c0c8660 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.860+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa05c0b4630 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.861+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa05001b3b0 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.861+0000 7fa0437fe700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 0x7fa048069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.861+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa050083cb0 con 0x7fa05c153c30 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.861+0000 7fa05b7fe700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 0x7fa048069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:25.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.861+0000 7fa05b7fe700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 0x7fa048069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0093f0 tx=0x7fa04c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:25.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:25.865+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa050050c90 con 0x7fa05c153c30 2023-10-09T15:36:26.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.055+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa05c04c3c0 con 0x7fa048067170 2023-10-09T15:36:26.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.063+0000 7fa0437fe700 1 -- 172.21.15.33:0/127105091 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289458 (secure 0 0 0) 0x7fa05c04c3c0 con 0x7fa048067170 2023-10-09T15:36:26.067 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 msgr2=0x7fa048069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 0x7fa048069620 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fa04c0093f0 tx=0x7fa04c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 msgr2=0x7fa05c0c9e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fa05000c590 tx=0x7fa050001020 comp rx=0 tx=0).stop 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 shutdown_connections 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa048067170 0x7fa048069620 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa05c15de50 0x7fa05c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa05c0cf110 0x7fa05c0c7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 --2- 172.21.15.33:0/127105091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa05c153c30 0x7fa05c0c9e40 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.066+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 >> 172.21.15.33:0/127105091 conn(0x7fa05c0703a0 msgr2=0x7fa05c0c6340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:26.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.067+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 shutdown_connections 2023-10-09T15:36:26.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.067+0000 7fa060f9e700 1 -- 172.21.15.33:0/127105091 wait complete. 2023-10-09T15:36:26.071 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:36:26.080 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":236,"stamp":"2023-10-09T15:36:25.302461+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":63,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2390952,"kb_used_data":8552,"kb_used_omap":0,"kb_used_meta":2382336,"kb_avail":752583768,"statfs":{"total":773094113280,"available":770645778432,"internally_reserved":0,"allocated":8757248,"data_stored":4402657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2439512064},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.736967"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266399+0000","last_change":"2023-10-09T15:36:21.259496+0000","last_active":"2023-10-09T15:36:21.266399+0000","last_peered":"2023-10-09T15:36:21.266399+0000","last_clean":"2023-10-09T15:36:21.266399+0000","last_became_active":"2023-10-09T15:36:21.259199+0000","last_became_peered":"2023-10-09T15:36:21.259199+0000","last_unstale":"2023-10-09T15:36:21.266399+0000","last_undegraded":"2023-10-09T15:36:21.266399+0000","last_fullsized":"2023-10-09T15:36:21.266399+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.834282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273678+0000","last_change":"2023-10-09T15:36:21.271892+0000","last_active":"2023-10-09T15:36:21.273678+0000","last_peered":"2023-10-09T15:36:21.273678+0000","last_clean":"2023-10-09T15:36:21.273678+0000","last_became_active":"2023-10-09T15:36:21.271615+0000","last_became_peered":"2023-10-09T15:36:21.271615+0000","last_unstale":"2023-10-09T15:36:21.273678+0000","last_undegraded":"2023-10-09T15:36:21.273678+0000","last_fullsized":"2023-10-09T15:36:21.273678+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:32.770547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273244+0000","last_change":"2023-10-09T15:36:21.271175+0000","last_active":"2023-10-09T15:36:21.273244+0000","last_peered":"2023-10-09T15:36:21.273244+0000","last_clean":"2023-10-09T15:36:21.273244+0000","last_became_active":"2023-10-09T15:36:21.270796+0000","last_became_peered":"2023-10-09T15:36:21.270796+0000","last_unstale":"2023-10-09T15:36:21.273244+0000","last_undegraded":"2023-10-09T15:36:21.273244+0000","last_fullsized":"2023-10-09T15:36:21.273244+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:19:34.006937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269976+0000","last_change":"2023-10-09T15:36:21.267231+0000","last_active":"2023-10-09T15:36:21.269976+0000","last_peered":"2023-10-09T15:36:21.269976+0000","last_clean":"2023-10-09T15:36:21.269976+0000","last_became_active":"2023-10-09T15:36:21.266921+0000","last_became_peered":"2023-10-09T15:36:21.266921+0000","last_unstale":"2023-10-09T15:36:21.269976+0000","last_undegraded":"2023-10-09T15:36:21.269976+0000","last_fullsized":"2023-10-09T15:36:21.269976+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:32:48.399841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268969+0000","last_change":"2023-10-09T15:36:21.267222+0000","last_active":"2023-10-09T15:36:21.268969+0000","last_peered":"2023-10-09T15:36:21.268969+0000","last_clean":"2023-10-09T15:36:21.268969+0000","last_became_active":"2023-10-09T15:36:21.266979+0000","last_became_peered":"2023-10-09T15:36:21.266979+0000","last_unstale":"2023-10-09T15:36:21.268969+0000","last_undegraded":"2023-10-09T15:36:21.268969+0000","last_fullsized":"2023-10-09T15:36:21.268969+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272655+0000","last_change":"2023-10-09T15:36:21.269739+0000","last_active":"2023-10-09T15:36:21.272655+0000","last_peered":"2023-10-09T15:36:21.272655+0000","last_clean":"2023-10-09T15:36:21.272655+0000","last_became_active":"2023-10-09T15:36:21.269248+0000","last_became_peered":"2023-10-09T15:36:21.269248+0000","last_unstale":"2023-10-09T15:36:21.272655+0000","last_undegraded":"2023-10-09T15:36:21.272655+0000","last_fullsized":"2023-10-09T15:36:21.272655+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269948+0000","last_change":"2023-10-09T15:36:21.265770+0000","last_active":"2023-10-09T15:36:21.269948+0000","last_peered":"2023-10-09T15:36:21.269948+0000","last_clean":"2023-10-09T15:36:21.269948+0000","last_became_active":"2023-10-09T15:36:21.265493+0000","last_became_peered":"2023-10-09T15:36:21.265493+0000","last_unstale":"2023-10-09T15:36:21.269948+0000","last_undegraded":"2023-10-09T15:36:21.269948+0000","last_fullsized":"2023-10-09T15:36:21.269948+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:38:39.766556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269030+0000","last_change":"2023-10-09T15:36:21.268118+0000","last_active":"2023-10-09T15:36:21.269030+0000","last_peered":"2023-10-09T15:36:21.269030+0000","last_clean":"2023-10-09T15:36:21.269030+0000","last_became_active":"2023-10-09T15:36:21.267815+0000","last_became_peered":"2023-10-09T15:36:21.267815+0000","last_unstale":"2023-10-09T15:36:21.269030+0000","last_undegraded":"2023-10-09T15:36:21.269030+0000","last_fullsized":"2023-10-09T15:36:21.269030+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:24.473764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268641+0000","last_change":"2023-10-09T15:36:21.265816+0000","last_active":"2023-10-09T15:36:21.268641+0000","last_peered":"2023-10-09T15:36:21.268641+0000","last_clean":"2023-10-09T15:36:21.268641+0000","last_became_active":"2023-10-09T15:36:21.265567+0000","last_became_peered":"2023-10-09T15:36:21.265567+0000","last_unstale":"2023-10-09T15:36:21.268641+0000","last_undegraded":"2023-10-09T15:36:21.268641+0000","last_fullsized":"2023-10-09T15:36:21.268641+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269592+0000","last_change":"2023-10-09T15:36:21.264115+0000","last_active":"2023-10-09T15:36:21.269592+0000","last_peered":"2023-10-09T15:36:21.269592+0000","last_clean":"2023-10-09T15:36:21.269592+0000","last_became_active":"2023-10-09T15:36:21.263767+0000","last_became_peered":"2023-10-09T15:36:21.263767+0000","last_unstale":"2023-10-09T15:36:21.269592+0000","last_undegraded":"2023-10-09T15:36:21.269592+0000","last_fullsized":"2023-10-09T15:36:21.269592+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:24.473764+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273746+0000","last_change":"2023-10-09T15:36:21.272232+0000","last_active":"2023-10-09T15:36:21.273746+0000","last_peered":"2023-10-09T15:36:21.273746+0000","last_clean":"2023-10-09T15:36:21.273746+0000","last_became_active":"2023-10-09T15:36:21.271922+0000","last_became_peered":"2023-10-09T15:36:21.271922+0000","last_unstale":"2023-10-09T15:36:21.273746+0000","last_undegraded":"2023-10-09T15:36:21.273746+0000","last_fullsized":"2023-10-09T15:36:21.273746+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:03.817605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270215+0000","last_change":"2023-10-09T15:36:21.264233+0000","last_active":"2023-10-09T15:36:21.270215+0000","last_peered":"2023-10-09T15:36:21.270215+0000","last_clean":"2023-10-09T15:36:21.270215+0000","last_became_active":"2023-10-09T15:36:21.263918+0000","last_became_peered":"2023-10-09T15:36:21.263918+0000","last_unstale":"2023-10-09T15:36:21.270215+0000","last_undegraded":"2023-10-09T15:36:21.270215+0000","last_fullsized":"2023-10-09T15:36:21.270215+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:10.645144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271666+0000","last_change":"2023-10-09T15:36:21.267333+0000","last_active":"2023-10-09T15:36:21.271666+0000","last_peered":"2023-10-09T15:36:21.271666+0000","last_clean":"2023-10-09T15:36:21.271666+0000","last_became_active":"2023-10-09T15:36:21.267060+0000","last_became_peered":"2023-10-09T15:36:21.267060+0000","last_unstale":"2023-10-09T15:36:21.271666+0000","last_undegraded":"2023-10-09T15:36:21.271666+0000","last_fullsized":"2023-10-09T15:36:21.271666+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:58.696335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270005+0000","last_change":"2023-10-09T15:36:21.267646+0000","last_active":"2023-10-09T15:36:21.270005+0000","last_peered":"2023-10-09T15:36:21.270005+0000","last_clean":"2023-10-09T15:36:21.270005+0000","last_became_active":"2023-10-09T15:36:21.267277+0000","last_became_peered":"2023-10-09T15:36:21.267277+0000","last_unstale":"2023-10-09T15:36:21.270005+0000","last_undegraded":"2023-10-09T15:36:21.270005+0000","last_fullsized":"2023-10-09T15:36:21.270005+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:21.348657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268428+0000","last_change":"2023-10-09T15:36:21.265323+0000","last_active":"2023-10-09T15:36:21.268428+0000","last_peered":"2023-10-09T15:36:21.268428+0000","last_clean":"2023-10-09T15:36:21.268428+0000","last_became_active":"2023-10-09T15:36:21.264906+0000","last_became_peered":"2023-10-09T15:36:21.264906+0000","last_unstale":"2023-10-09T15:36:21.268428+0000","last_undegraded":"2023-10-09T15:36:21.268428+0000","last_fullsized":"2023-10-09T15:36:21.268428+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:18.276861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.262550+0000","last_change":"2023-10-09T15:36:21.254979+0000","last_active":"2023-10-09T15:36:21.262550+0000","last_peered":"2023-10-09T15:36:21.262550+0000","last_clean":"2023-10-09T15:36:21.262550+0000","last_became_active":"2023-10-09T15:36:21.254643+0000","last_became_peered":"2023-10-09T15:36:21.254643+0000","last_unstale":"2023-10-09T15:36:21.262550+0000","last_undegraded":"2023-10-09T15:36:21.262550+0000","last_fullsized":"2023-10-09T15:36:21.262550+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265837+0000","last_change":"2023-10-09T15:36:21.258600+0000","last_active":"2023-10-09T15:36:21.265837+0000","last_peered":"2023-10-09T15:36:21.265837+0000","last_clean":"2023-10-09T15:36:21.265837+0000","last_became_active":"2023-10-09T15:36:21.258138+0000","last_became_peered":"2023-10-09T15:36:21.258138+0000","last_unstale":"2023-10-09T15:36:21.265837+0000","last_undegraded":"2023-10-09T15:36:21.265837+0000","last_fullsized":"2023-10-09T15:36:21.265837+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.263556+0000","last_change":"2023-10-09T15:36:21.257428+0000","last_active":"2023-10-09T15:36:21.263556+0000","last_peered":"2023-10-09T15:36:21.263556+0000","last_clean":"2023-10-09T15:36:21.263556+0000","last_became_active":"2023-10-09T15:36:21.257137+0000","last_became_peered":"2023-10-09T15:36:21.257137+0000","last_unstale":"2023-10-09T15:36:21.263556+0000","last_undegraded":"2023-10-09T15:36:21.263556+0000","last_fullsized":"2023-10-09T15:36:21.263556+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:06:25.921125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269539+0000","last_change":"2023-10-09T15:36:21.264769+0000","last_active":"2023-10-09T15:36:21.269539+0000","last_peered":"2023-10-09T15:36:21.269539+0000","last_clean":"2023-10-09T15:36:21.269539+0000","last_became_active":"2023-10-09T15:36:21.264032+0000","last_became_peered":"2023-10-09T15:36:21.264032+0000","last_unstale":"2023-10-09T15:36:21.269539+0000","last_undegraded":"2023-10-09T15:36:21.269539+0000","last_fullsized":"2023-10-09T15:36:21.269539+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268754+0000","last_change":"2023-10-09T15:36:21.258572+0000","last_active":"2023-10-09T15:36:21.268754+0000","last_peered":"2023-10-09T15:36:21.268754+0000","last_clean":"2023-10-09T15:36:21.268754+0000","last_became_active":"2023-10-09T15:36:21.258172+0000","last_became_peered":"2023-10-09T15:36:21.258172+0000","last_unstale":"2023-10-09T15:36:21.268754+0000","last_undegraded":"2023-10-09T15:36:21.268754+0000","last_fullsized":"2023-10-09T15:36:21.268754+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:18:45.521102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268730+0000","last_change":"2023-10-09T15:36:21.259070+0000","last_active":"2023-10-09T15:36:21.268730+0000","last_peered":"2023-10-09T15:36:21.268730+0000","last_clean":"2023-10-09T15:36:21.268730+0000","last_became_active":"2023-10-09T15:36:21.258690+0000","last_became_peered":"2023-10-09T15:36:21.258690+0000","last_unstale":"2023-10-09T15:36:21.268730+0000","last_undegraded":"2023-10-09T15:36:21.268730+0000","last_fullsized":"2023-10-09T15:36:21.268730+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:59:12.299964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273245+0000","last_change":"2023-10-09T15:36:21.271262+0000","last_active":"2023-10-09T15:36:21.273245+0000","last_peered":"2023-10-09T15:36:21.273245+0000","last_clean":"2023-10-09T15:36:21.273245+0000","last_became_active":"2023-10-09T15:36:21.270756+0000","last_became_peered":"2023-10-09T15:36:21.270756+0000","last_unstale":"2023-10-09T15:36:21.273245+0000","last_undegraded":"2023-10-09T15:36:21.273245+0000","last_fullsized":"2023-10-09T15:36:21.273245+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:15.309183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266455+0000","last_change":"2023-10-09T15:36:21.259450+0000","last_active":"2023-10-09T15:36:21.266455+0000","last_peered":"2023-10-09T15:36:21.266455+0000","last_clean":"2023-10-09T15:36:21.266455+0000","last_became_active":"2023-10-09T15:36:21.258952+0000","last_became_peered":"2023-10-09T15:36:21.258952+0000","last_unstale":"2023-10-09T15:36:21.266455+0000","last_undegraded":"2023-10-09T15:36:21.266455+0000","last_fullsized":"2023-10-09T15:36:21.266455+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269095+0000","last_change":"2023-10-09T15:36:21.259280+0000","last_active":"2023-10-09T15:36:21.269095+0000","last_peered":"2023-10-09T15:36:21.269095+0000","last_clean":"2023-10-09T15:36:21.269095+0000","last_became_active":"2023-10-09T15:36:21.258018+0000","last_became_peered":"2023-10-09T15:36:21.258018+0000","last_unstale":"2023-10-09T15:36:21.269095+0000","last_undegraded":"2023-10-09T15:36:21.269095+0000","last_fullsized":"2023-10-09T15:36:21.269095+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.057201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273346+0000","last_change":"2023-10-09T15:36:21.271582+0000","last_active":"2023-10-09T15:36:21.273346+0000","last_peered":"2023-10-09T15:36:21.273346+0000","last_clean":"2023-10-09T15:36:21.273346+0000","last_became_active":"2023-10-09T15:36:21.271196+0000","last_became_peered":"2023-10-09T15:36:21.271196+0000","last_unstale":"2023-10-09T15:36:21.273346+0000","last_undegraded":"2023-10-09T15:36:21.273346+0000","last_fullsized":"2023-10-09T15:36:21.273346+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:24.902855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.274276+0000","last_change":"2023-10-09T15:36:21.273435+0000","last_active":"2023-10-09T15:36:21.274276+0000","last_peered":"2023-10-09T15:36:21.274276+0000","last_clean":"2023-10-09T15:36:21.274276+0000","last_became_active":"2023-10-09T15:36:21.273117+0000","last_became_peered":"2023-10-09T15:36:21.273117+0000","last_unstale":"2023-10-09T15:36:21.274276+0000","last_undegraded":"2023-10-09T15:36:21.274276+0000","last_fullsized":"2023-10-09T15:36:21.274276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:43.537846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266384+0000","last_change":"2023-10-09T15:36:21.264353+0000","last_active":"2023-10-09T15:36:21.266384+0000","last_peered":"2023-10-09T15:36:21.266384+0000","last_clean":"2023-10-09T15:36:21.266384+0000","last_became_active":"2023-10-09T15:36:21.264082+0000","last_became_peered":"2023-10-09T15:36:21.264082+0000","last_unstale":"2023-10-09T15:36:21.266384+0000","last_undegraded":"2023-10-09T15:36:21.266384+0000","last_fullsized":"2023-10-09T15:36:21.266384+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:16.094036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266813+0000","last_change":"2023-10-09T15:36:21.258785+0000","last_active":"2023-10-09T15:36:21.266813+0000","last_peered":"2023-10-09T15:36:21.266813+0000","last_clean":"2023-10-09T15:36:21.266813+0000","last_became_active":"2023-10-09T15:36:21.258128+0000","last_became_peered":"2023-10-09T15:36:21.258128+0000","last_unstale":"2023-10-09T15:36:21.266813+0000","last_undegraded":"2023-10-09T15:36:21.266813+0000","last_fullsized":"2023-10-09T15:36:21.266813+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273725+0000","last_change":"2023-10-09T15:36:21.271992+0000","last_active":"2023-10-09T15:36:21.273725+0000","last_peered":"2023-10-09T15:36:21.273725+0000","last_clean":"2023-10-09T15:36:21.273725+0000","last_became_active":"2023-10-09T15:36:21.269124+0000","last_became_peered":"2023-10-09T15:36:21.269124+0000","last_unstale":"2023-10-09T15:36:21.273725+0000","last_undegraded":"2023-10-09T15:36:21.273725+0000","last_fullsized":"2023-10-09T15:36:21.273725+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:05.700103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273225+0000","last_change":"2023-10-09T15:36:21.270731+0000","last_active":"2023-10-09T15:36:21.273225+0000","last_peered":"2023-10-09T15:36:21.273225+0000","last_clean":"2023-10-09T15:36:21.273225+0000","last_became_active":"2023-10-09T15:36:21.270468+0000","last_became_peered":"2023-10-09T15:36:21.270468+0000","last_unstale":"2023-10-09T15:36:21.273225+0000","last_undegraded":"2023-10-09T15:36:21.273225+0000","last_fullsized":"2023-10-09T15:36:21.273225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:55.553745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265978+0000","last_change":"2023-10-09T15:36:21.260749+0000","last_active":"2023-10-09T15:36:21.265978+0000","last_peered":"2023-10-09T15:36:21.265978+0000","last_clean":"2023-10-09T15:36:21.265978+0000","last_became_active":"2023-10-09T15:36:21.258910+0000","last_became_peered":"2023-10-09T15:36:21.258910+0000","last_unstale":"2023-10-09T15:36:21.265978+0000","last_undegraded":"2023-10-09T15:36:21.265978+0000","last_fullsized":"2023-10-09T15:36:21.265978+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273452+0000","last_change":"2023-10-09T15:36:21.271551+0000","last_active":"2023-10-09T15:36:21.273452+0000","last_peered":"2023-10-09T15:36:21.273452+0000","last_clean":"2023-10-09T15:36:21.273452+0000","last_became_active":"2023-10-09T15:36:21.271229+0000","last_became_peered":"2023-10-09T15:36:21.271229+0000","last_unstale":"2023-10-09T15:36:21.273452+0000","last_undegraded":"2023-10-09T15:36:21.273452+0000","last_fullsized":"2023-10-09T15:36:21.273452+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.257630+0000","last_change":"2023-10-09T15:36:21.254192+0000","last_active":"2023-10-09T15:36:21.257630+0000","last_peered":"2023-10-09T15:36:21.257630+0000","last_clean":"2023-10-09T15:36:21.257630+0000","last_became_active":"2023-10-09T15:36:21.253878+0000","last_became_peered":"2023-10-09T15:36:21.253878+0000","last_unstale":"2023-10-09T15:36:21.257630+0000","last_undegraded":"2023-10-09T15:36:21.257630+0000","last_fullsized":"2023-10-09T15:36:21.257630+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:33:50.947299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"76'4","reported_seq":14,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.594210+0000","last_change":"2023-10-09T15:36:20.585511+0000","last_active":"2023-10-09T15:36:21.594210+0000","last_peered":"2023-10-09T15:36:21.594210+0000","last_clean":"2023-10-09T15:36:21.594210+0000","last_became_active":"2023-10-09T15:36:20.585181+0000","last_became_peered":"2023-10-09T15:36:20.585181+0000","last_unstale":"2023-10-09T15:36:21.594210+0000","last_undegraded":"2023-10-09T15:36:21.594210+0000","last_fullsized":"2023-10-09T15:36:21.594210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:11.849563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266370+0000","last_change":"2023-10-09T15:36:21.259121+0000","last_active":"2023-10-09T15:36:21.266370+0000","last_peered":"2023-10-09T15:36:21.266370+0000","last_clean":"2023-10-09T15:36:21.266370+0000","last_became_active":"2023-10-09T15:36:21.258815+0000","last_became_peered":"2023-10-09T15:36:21.258815+0000","last_unstale":"2023-10-09T15:36:21.266370+0000","last_undegraded":"2023-10-09T15:36:21.266370+0000","last_fullsized":"2023-10-09T15:36:21.266370+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:33:50.947299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592252+0000","last_change":"2023-10-09T15:36:20.585562+0000","last_active":"2023-10-09T15:36:21.592252+0000","last_peered":"2023-10-09T15:36:21.592252+0000","last_clean":"2023-10-09T15:36:21.592252+0000","last_became_active":"2023-10-09T15:36:20.585310+0000","last_became_peered":"2023-10-09T15:36:20.585310+0000","last_unstale":"2023-10-09T15:36:21.592252+0000","last_undegraded":"2023-10-09T15:36:21.592252+0000","last_fullsized":"2023-10-09T15:36:21.592252+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:27:11.849563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270233+0000","last_change":"2023-10-09T15:36:21.267104+0000","last_active":"2023-10-09T15:36:21.270233+0000","last_peered":"2023-10-09T15:36:21.270233+0000","last_clean":"2023-10-09T15:36:21.270233+0000","last_became_active":"2023-10-09T15:36:21.266813+0000","last_became_peered":"2023-10-09T15:36:21.266813+0000","last_unstale":"2023-10-09T15:36:21.270233+0000","last_undegraded":"2023-10-09T15:36:21.270233+0000","last_fullsized":"2023-10-09T15:36:21.270233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592779+0000","last_change":"2023-10-09T15:36:20.591302+0000","last_active":"2023-10-09T15:36:21.592779+0000","last_peered":"2023-10-09T15:36:21.592779+0000","last_clean":"2023-10-09T15:36:21.592779+0000","last_became_active":"2023-10-09T15:36:20.590916+0000","last_became_peered":"2023-10-09T15:36:20.590916+0000","last_unstale":"2023-10-09T15:36:21.592779+0000","last_undegraded":"2023-10-09T15:36:21.592779+0000","last_fullsized":"2023-10-09T15:36:21.592779+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:49.346985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273225+0000","last_change":"2023-10-09T15:36:21.271007+0000","last_active":"2023-10-09T15:36:21.273225+0000","last_peered":"2023-10-09T15:36:21.273225+0000","last_clean":"2023-10-09T15:36:21.273225+0000","last_became_active":"2023-10-09T15:36:21.270474+0000","last_became_peered":"2023-10-09T15:36:21.270474+0000","last_unstale":"2023-10-09T15:36:21.273225+0000","last_undegraded":"2023-10-09T15:36:21.273225+0000","last_fullsized":"2023-10-09T15:36:21.273225+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:47:28.958095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592852+0000","last_change":"2023-10-09T15:36:20.591296+0000","last_active":"2023-10-09T15:36:21.592852+0000","last_peered":"2023-10-09T15:36:21.592852+0000","last_clean":"2023-10-09T15:36:21.592852+0000","last_became_active":"2023-10-09T15:36:20.590954+0000","last_became_peered":"2023-10-09T15:36:20.590954+0000","last_unstale":"2023-10-09T15:36:21.592852+0000","last_undegraded":"2023-10-09T15:36:21.592852+0000","last_fullsized":"2023-10-09T15:36:21.592852+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:54.548844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273207+0000","last_change":"2023-10-09T15:36:21.270468+0000","last_active":"2023-10-09T15:36:21.273207+0000","last_peered":"2023-10-09T15:36:21.273207+0000","last_clean":"2023-10-09T15:36:21.273207+0000","last_became_active":"2023-10-09T15:36:21.270136+0000","last_became_peered":"2023-10-09T15:36:21.270136+0000","last_unstale":"2023-10-09T15:36:21.273207+0000","last_undegraded":"2023-10-09T15:36:21.273207+0000","last_fullsized":"2023-10-09T15:36:21.273207+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:07.980347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593012+0000","last_change":"2023-10-09T15:36:20.593716+0000","last_active":"2023-10-09T15:36:21.593012+0000","last_peered":"2023-10-09T15:36:21.593012+0000","last_clean":"2023-10-09T15:36:21.593012+0000","last_became_active":"2023-10-09T15:36:20.593377+0000","last_became_peered":"2023-10-09T15:36:20.593377+0000","last_unstale":"2023-10-09T15:36:21.593012+0000","last_undegraded":"2023-10-09T15:36:21.593012+0000","last_fullsized":"2023-10-09T15:36:21.593012+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.408346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265769+0000","last_change":"2023-10-09T15:36:21.258381+0000","last_active":"2023-10-09T15:36:21.265769+0000","last_peered":"2023-10-09T15:36:21.265769+0000","last_clean":"2023-10-09T15:36:21.265769+0000","last_became_active":"2023-10-09T15:36:21.258095+0000","last_became_peered":"2023-10-09T15:36:21.258095+0000","last_unstale":"2023-10-09T15:36:21.265769+0000","last_undegraded":"2023-10-09T15:36:21.265769+0000","last_fullsized":"2023-10-09T15:36:21.265769+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:34:41.133769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592098+0000","last_change":"2023-10-09T15:36:20.589134+0000","last_active":"2023-10-09T15:36:21.592098+0000","last_peered":"2023-10-09T15:36:21.592098+0000","last_clean":"2023-10-09T15:36:21.592098+0000","last_became_active":"2023-10-09T15:36:20.588753+0000","last_became_peered":"2023-10-09T15:36:20.588753+0000","last_unstale":"2023-10-09T15:36:21.592098+0000","last_undegraded":"2023-10-09T15:36:21.592098+0000","last_fullsized":"2023-10-09T15:36:21.592098+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:31.765647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271972+0000","last_change":"2023-10-09T15:36:21.268259+0000","last_active":"2023-10-09T15:36:21.271972+0000","last_peered":"2023-10-09T15:36:21.271972+0000","last_clean":"2023-10-09T15:36:21.271972+0000","last_became_active":"2023-10-09T15:36:21.267989+0000","last_became_peered":"2023-10-09T15:36:21.267989+0000","last_unstale":"2023-10-09T15:36:21.271972+0000","last_undegraded":"2023-10-09T15:36:21.271972+0000","last_fullsized":"2023-10-09T15:36:21.271972+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:53.063102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247504+0000","last_change":"2023-10-09T15:36:20.586973+0000","last_active":"2023-10-09T15:36:21.247504+0000","last_peered":"2023-10-09T15:36:21.247504+0000","last_clean":"2023-10-09T15:36:21.247504+0000","last_became_active":"2023-10-09T15:36:20.586685+0000","last_became_peered":"2023-10-09T15:36:20.586685+0000","last_unstale":"2023-10-09T15:36:21.247504+0000","last_undegraded":"2023-10-09T15:36:21.247504+0000","last_fullsized":"2023-10-09T15:36:21.247504+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:59:06.975446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267233+0000","last_change":"2023-10-09T15:36:21.263592+0000","last_active":"2023-10-09T15:36:21.267233+0000","last_peered":"2023-10-09T15:36:21.267233+0000","last_clean":"2023-10-09T15:36:21.267233+0000","last_became_active":"2023-10-09T15:36:21.263270+0000","last_became_peered":"2023-10-09T15:36:21.263270+0000","last_unstale":"2023-10-09T15:36:21.267233+0000","last_undegraded":"2023-10-09T15:36:21.267233+0000","last_fullsized":"2023-10-09T15:36:21.267233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:46.483370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265552+0000","last_change":"2023-10-09T15:36:20.589121+0000","last_active":"2023-10-09T15:36:21.265552+0000","last_peered":"2023-10-09T15:36:21.265552+0000","last_clean":"2023-10-09T15:36:21.265552+0000","last_became_active":"2023-10-09T15:36:20.588813+0000","last_became_peered":"2023-10-09T15:36:20.588813+0000","last_unstale":"2023-10-09T15:36:21.265552+0000","last_undegraded":"2023-10-09T15:36:21.265552+0000","last_fullsized":"2023-10-09T15:36:21.265552+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:44.537654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269037+0000","last_change":"2023-10-09T15:36:21.267490+0000","last_active":"2023-10-09T15:36:21.269037+0000","last_peered":"2023-10-09T15:36:21.269037+0000","last_clean":"2023-10-09T15:36:21.269037+0000","last_became_active":"2023-10-09T15:36:21.267206+0000","last_became_peered":"2023-10-09T15:36:21.267206+0000","last_unstale":"2023-10-09T15:36:21.269037+0000","last_undegraded":"2023-10-09T15:36:21.269037+0000","last_fullsized":"2023-10-09T15:36:21.269037+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:48:31.130698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.252426+0000","last_change":"2023-10-09T15:36:20.577806+0000","last_active":"2023-10-09T15:36:21.252426+0000","last_peered":"2023-10-09T15:36:21.252426+0000","last_clean":"2023-10-09T15:36:21.252426+0000","last_became_active":"2023-10-09T15:36:20.577515+0000","last_became_peered":"2023-10-09T15:36:20.577515+0000","last_unstale":"2023-10-09T15:36:21.252426+0000","last_undegraded":"2023-10-09T15:36:21.252426+0000","last_fullsized":"2023-10-09T15:36:21.252426+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:23.817113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272574+0000","last_change":"2023-10-09T15:36:21.269561+0000","last_active":"2023-10-09T15:36:21.272574+0000","last_peered":"2023-10-09T15:36:21.272574+0000","last_clean":"2023-10-09T15:36:21.272574+0000","last_became_active":"2023-10-09T15:36:21.269266+0000","last_became_peered":"2023-10-09T15:36:21.269266+0000","last_unstale":"2023-10-09T15:36:21.272574+0000","last_undegraded":"2023-10-09T15:36:21.272574+0000","last_fullsized":"2023-10-09T15:36:21.272574+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249628+0000","last_change":"2023-10-09T15:36:20.582877+0000","last_active":"2023-10-09T15:36:21.249628+0000","last_peered":"2023-10-09T15:36:21.249628+0000","last_clean":"2023-10-09T15:36:21.249628+0000","last_became_active":"2023-10-09T15:36:20.582548+0000","last_became_peered":"2023-10-09T15:36:20.582548+0000","last_unstale":"2023-10-09T15:36:21.249628+0000","last_undegraded":"2023-10-09T15:36:21.249628+0000","last_fullsized":"2023-10-09T15:36:21.249628+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:20.553387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259590+0000","last_change":"2023-10-09T15:36:21.254584+0000","last_active":"2023-10-09T15:36:21.259590+0000","last_peered":"2023-10-09T15:36:21.259590+0000","last_clean":"2023-10-09T15:36:21.259590+0000","last_became_active":"2023-10-09T15:36:21.254297+0000","last_became_peered":"2023-10-09T15:36:21.254297+0000","last_unstale":"2023-10-09T15:36:21.259590+0000","last_undegraded":"2023-10-09T15:36:21.259590+0000","last_fullsized":"2023-10-09T15:36:21.259590+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:57.532343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"76'3","reported_seq":13,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.594095+0000","last_change":"2023-10-09T15:36:20.591254+0000","last_active":"2023-10-09T15:36:21.594095+0000","last_peered":"2023-10-09T15:36:21.594095+0000","last_clean":"2023-10-09T15:36:21.594095+0000","last_became_active":"2023-10-09T15:36:20.590972+0000","last_became_peered":"2023-10-09T15:36:20.590972+0000","last_unstale":"2023-10-09T15:36:21.594095+0000","last_undegraded":"2023-10-09T15:36:21.594095+0000","last_fullsized":"2023-10-09T15:36:21.594095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.695202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266276+0000","last_change":"2023-10-09T15:36:21.260898+0000","last_active":"2023-10-09T15:36:21.266276+0000","last_peered":"2023-10-09T15:36:21.266276+0000","last_clean":"2023-10-09T15:36:21.266276+0000","last_became_active":"2023-10-09T15:36:21.259059+0000","last_became_peered":"2023-10-09T15:36:21.259059+0000","last_unstale":"2023-10-09T15:36:21.266276+0000","last_undegraded":"2023-10-09T15:36:21.266276+0000","last_fullsized":"2023-10-09T15:36:21.266276+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:50.834282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"76'6","reported_seq":16,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.596890+0000","last_change":"2023-10-09T15:36:20.589918+0000","last_active":"2023-10-09T15:36:21.596890+0000","last_peered":"2023-10-09T15:36:21.596890+0000","last_clean":"2023-10-09T15:36:21.596890+0000","last_became_active":"2023-10-09T15:36:20.589694+0000","last_became_peered":"2023-10-09T15:36:20.589694+0000","last_unstale":"2023-10-09T15:36:21.596890+0000","last_undegraded":"2023-10-09T15:36:21.596890+0000","last_fullsized":"2023-10-09T15:36:21.596890+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:57.006504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259573+0000","last_change":"2023-10-09T15:36:21.255337+0000","last_active":"2023-10-09T15:36:21.259573+0000","last_peered":"2023-10-09T15:36:21.259573+0000","last_clean":"2023-10-09T15:36:21.259573+0000","last_became_active":"2023-10-09T15:36:21.255089+0000","last_became_peered":"2023-10-09T15:36:21.255089+0000","last_unstale":"2023-10-09T15:36:21.259573+0000","last_undegraded":"2023-10-09T15:36:21.259573+0000","last_fullsized":"2023-10-09T15:36:21.259573+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593656+0000","last_change":"2023-10-09T15:36:20.592555+0000","last_active":"2023-10-09T15:36:21.593656+0000","last_peered":"2023-10-09T15:36:21.593656+0000","last_clean":"2023-10-09T15:36:21.593656+0000","last_became_active":"2023-10-09T15:36:20.592239+0000","last_became_peered":"2023-10-09T15:36:20.592239+0000","last_unstale":"2023-10-09T15:36:21.593656+0000","last_undegraded":"2023-10-09T15:36:21.593656+0000","last_fullsized":"2023-10-09T15:36:21.593656+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:59.498672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272957+0000","last_change":"2023-10-09T15:36:21.270400+0000","last_active":"2023-10-09T15:36:21.272957+0000","last_peered":"2023-10-09T15:36:21.272957+0000","last_clean":"2023-10-09T15:36:21.272957+0000","last_became_active":"2023-10-09T15:36:21.270165+0000","last_became_peered":"2023-10-09T15:36:21.270165+0000","last_unstale":"2023-10-09T15:36:21.272957+0000","last_undegraded":"2023-10-09T15:36:21.272957+0000","last_fullsized":"2023-10-09T15:36:21.272957+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:21.248734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.254369+0000","last_change":"2023-10-09T15:36:20.589471+0000","last_active":"2023-10-09T15:36:21.254369+0000","last_peered":"2023-10-09T15:36:21.254369+0000","last_clean":"2023-10-09T15:36:21.254369+0000","last_became_active":"2023-10-09T15:36:20.589197+0000","last_became_peered":"2023-10-09T15:36:20.589197+0000","last_unstale":"2023-10-09T15:36:21.254369+0000","last_undegraded":"2023-10-09T15:36:21.254369+0000","last_fullsized":"2023-10-09T15:36:21.254369+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:57.396668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273321+0000","last_change":"2023-10-09T15:36:21.271364+0000","last_active":"2023-10-09T15:36:21.273321+0000","last_peered":"2023-10-09T15:36:21.273321+0000","last_clean":"2023-10-09T15:36:21.273321+0000","last_became_active":"2023-10-09T15:36:21.271086+0000","last_became_peered":"2023-10-09T15:36:21.271086+0000","last_unstale":"2023-10-09T15:36:21.273321+0000","last_undegraded":"2023-10-09T15:36:21.273321+0000","last_fullsized":"2023-10-09T15:36:21.273321+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:45:13.984092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.257976+0000","last_change":"2023-10-09T15:36:20.582158+0000","last_active":"2023-10-09T15:36:21.257976+0000","last_peered":"2023-10-09T15:36:21.257976+0000","last_clean":"2023-10-09T15:36:21.257976+0000","last_became_active":"2023-10-09T15:36:20.581798+0000","last_became_peered":"2023-10-09T15:36:20.581798+0000","last_unstale":"2023-10-09T15:36:21.257976+0000","last_undegraded":"2023-10-09T15:36:21.257976+0000","last_fullsized":"2023-10-09T15:36:21.257976+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:23.897954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273371+0000","last_change":"2023-10-09T15:36:21.271493+0000","last_active":"2023-10-09T15:36:21.273371+0000","last_peered":"2023-10-09T15:36:21.273371+0000","last_clean":"2023-10-09T15:36:21.273371+0000","last_became_active":"2023-10-09T15:36:21.271135+0000","last_became_peered":"2023-10-09T15:36:21.271135+0000","last_unstale":"2023-10-09T15:36:21.273371+0000","last_undegraded":"2023-10-09T15:36:21.273371+0000","last_fullsized":"2023-10-09T15:36:21.273371+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:58.011405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"76'8","reported_seq":18,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593764+0000","last_change":"2023-10-09T15:36:20.587280+0000","last_active":"2023-10-09T15:36:21.593764+0000","last_peered":"2023-10-09T15:36:21.593764+0000","last_clean":"2023-10-09T15:36:21.593764+0000","last_became_active":"2023-10-09T15:36:20.587006+0000","last_became_peered":"2023-10-09T15:36:20.587006+0000","last_unstale":"2023-10-09T15:36:21.593764+0000","last_undegraded":"2023-10-09T15:36:21.593764+0000","last_fullsized":"2023-10-09T15:36:21.593764+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:15.089136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.271679+0000","last_change":"2023-10-09T15:36:21.268109+0000","last_active":"2023-10-09T15:36:21.271679+0000","last_peered":"2023-10-09T15:36:21.271679+0000","last_clean":"2023-10-09T15:36:21.271679+0000","last_became_active":"2023-10-09T15:36:21.267812+0000","last_became_peered":"2023-10-09T15:36:21.267812+0000","last_unstale":"2023-10-09T15:36:21.271679+0000","last_undegraded":"2023-10-09T15:36:21.271679+0000","last_fullsized":"2023-10-09T15:36:21.271679+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:40.856359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592887+0000","last_change":"2023-10-09T15:36:20.580692+0000","last_active":"2023-10-09T15:36:21.592887+0000","last_peered":"2023-10-09T15:36:21.592887+0000","last_clean":"2023-10-09T15:36:21.592887+0000","last_became_active":"2023-10-09T15:36:20.580440+0000","last_became_peered":"2023-10-09T15:36:20.580440+0000","last_unstale":"2023-10-09T15:36:21.592887+0000","last_undegraded":"2023-10-09T15:36:21.592887+0000","last_fullsized":"2023-10-09T15:36:21.592887+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:51.744334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.270233+0000","last_change":"2023-10-09T15:36:21.264795+0000","last_active":"2023-10-09T15:36:21.270233+0000","last_peered":"2023-10-09T15:36:21.270233+0000","last_clean":"2023-10-09T15:36:21.270233+0000","last_became_active":"2023-10-09T15:36:21.264493+0000","last_became_peered":"2023-10-09T15:36:21.264493+0000","last_unstale":"2023-10-09T15:36:21.270233+0000","last_undegraded":"2023-10-09T15:36:21.270233+0000","last_fullsized":"2023-10-09T15:36:21.270233+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:59.110155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.592770+0000","last_change":"2023-10-09T15:36:20.584321+0000","last_active":"2023-10-09T15:36:21.592770+0000","last_peered":"2023-10-09T15:36:21.592770+0000","last_clean":"2023-10-09T15:36:21.592770+0000","last_became_active":"2023-10-09T15:36:20.584031+0000","last_became_peered":"2023-10-09T15:36:20.584031+0000","last_unstale":"2023-10-09T15:36:21.592770+0000","last_undegraded":"2023-10-09T15:36:21.592770+0000","last_fullsized":"2023-10-09T15:36:21.592770+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:56:23.468863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269013+0000","last_change":"2023-10-09T15:36:21.267320+0000","last_active":"2023-10-09T15:36:21.269013+0000","last_peered":"2023-10-09T15:36:21.269013+0000","last_clean":"2023-10-09T15:36:21.269013+0000","last_became_active":"2023-10-09T15:36:21.267035+0000","last_became_peered":"2023-10-09T15:36:21.267035+0000","last_unstale":"2023-10-09T15:36:21.269013+0000","last_undegraded":"2023-10-09T15:36:21.269013+0000","last_fullsized":"2023-10-09T15:36:21.269013+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:08.948340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247948+0000","last_change":"2023-10-09T15:36:20.586981+0000","last_active":"2023-10-09T15:36:21.247948+0000","last_peered":"2023-10-09T15:36:21.247948+0000","last_clean":"2023-10-09T15:36:21.247948+0000","last_became_active":"2023-10-09T15:36:20.586708+0000","last_became_peered":"2023-10-09T15:36:20.586708+0000","last_unstale":"2023-10-09T15:36:21.247948+0000","last_undegraded":"2023-10-09T15:36:21.247948+0000","last_fullsized":"2023-10-09T15:36:21.247948+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:14.304283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269992+0000","last_change":"2023-10-09T15:36:21.267314+0000","last_active":"2023-10-09T15:36:21.269992+0000","last_peered":"2023-10-09T15:36:21.269992+0000","last_clean":"2023-10-09T15:36:21.269992+0000","last_became_active":"2023-10-09T15:36:21.267009+0000","last_became_peered":"2023-10-09T15:36:21.267009+0000","last_unstale":"2023-10-09T15:36:21.269992+0000","last_undegraded":"2023-10-09T15:36:21.269992+0000","last_fullsized":"2023-10-09T15:36:21.269992+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:18:38.557380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.591652+0000","last_change":"2023-10-09T15:36:20.585577+0000","last_active":"2023-10-09T15:36:21.591652+0000","last_peered":"2023-10-09T15:36:21.591652+0000","last_clean":"2023-10-09T15:36:21.591652+0000","last_became_active":"2023-10-09T15:36:20.585242+0000","last_became_peered":"2023-10-09T15:36:20.585242+0000","last_unstale":"2023-10-09T15:36:21.591652+0000","last_undegraded":"2023-10-09T15:36:21.591652+0000","last_fullsized":"2023-10-09T15:36:21.591652+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:20.243834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267266+0000","last_change":"2023-10-09T15:36:21.263776+0000","last_active":"2023-10-09T15:36:21.267266+0000","last_peered":"2023-10-09T15:36:21.267266+0000","last_clean":"2023-10-09T15:36:21.267266+0000","last_became_active":"2023-10-09T15:36:21.263487+0000","last_became_peered":"2023-10-09T15:36:21.263487+0000","last_unstale":"2023-10-09T15:36:21.267266+0000","last_undegraded":"2023-10-09T15:36:21.267266+0000","last_fullsized":"2023-10-09T15:36:21.267266+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:02:10.645144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251496+0000","last_change":"2023-10-09T15:36:20.587685+0000","last_active":"2023-10-09T15:36:21.251496+0000","last_peered":"2023-10-09T15:36:21.251496+0000","last_clean":"2023-10-09T15:36:21.251496+0000","last_became_active":"2023-10-09T15:36:20.587379+0000","last_became_peered":"2023-10-09T15:36:20.587379+0000","last_unstale":"2023-10-09T15:36:21.251496+0000","last_undegraded":"2023-10-09T15:36:21.251496+0000","last_fullsized":"2023-10-09T15:36:21.251496+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:15:21.502520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.269984+0000","last_change":"2023-10-09T15:36:21.264685+0000","last_active":"2023-10-09T15:36:21.269984+0000","last_peered":"2023-10-09T15:36:21.269984+0000","last_clean":"2023-10-09T15:36:21.269984+0000","last_became_active":"2023-10-09T15:36:21.264406+0000","last_became_peered":"2023-10-09T15:36:21.264406+0000","last_unstale":"2023-10-09T15:36:21.269984+0000","last_undegraded":"2023-10-09T15:36:21.269984+0000","last_fullsized":"2023-10-09T15:36:21.269984+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:39:56.931597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251142+0000","last_change":"2023-10-09T15:36:20.584581+0000","last_active":"2023-10-09T15:36:21.251142+0000","last_peered":"2023-10-09T15:36:21.251142+0000","last_clean":"2023-10-09T15:36:21.251142+0000","last_became_active":"2023-10-09T15:36:20.584306+0000","last_became_peered":"2023-10-09T15:36:20.584306+0000","last_unstale":"2023-10-09T15:36:21.251142+0000","last_undegraded":"2023-10-09T15:36:21.251142+0000","last_fullsized":"2023-10-09T15:36:21.251142+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:16:18.419869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.268603+0000","last_change":"2023-10-09T15:36:21.264975+0000","last_active":"2023-10-09T15:36:21.268603+0000","last_peered":"2023-10-09T15:36:21.268603+0000","last_clean":"2023-10-09T15:36:21.268603+0000","last_became_active":"2023-10-09T15:36:21.264654+0000","last_became_peered":"2023-10-09T15:36:21.264654+0000","last_unstale":"2023-10-09T15:36:21.268603+0000","last_undegraded":"2023-10-09T15:36:21.268603+0000","last_fullsized":"2023-10-09T15:36:21.268603+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:52.120309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.254272+0000","last_change":"2023-10-09T15:36:20.582150+0000","last_active":"2023-10-09T15:36:21.254272+0000","last_peered":"2023-10-09T15:36:21.254272+0000","last_clean":"2023-10-09T15:36:21.254272+0000","last_became_active":"2023-10-09T15:36:20.581902+0000","last_became_peered":"2023-10-09T15:36:20.581902+0000","last_unstale":"2023-10-09T15:36:21.254272+0000","last_undegraded":"2023-10-09T15:36:21.254272+0000","last_fullsized":"2023-10-09T15:36:21.254272+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:58:39.851459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266402+0000","last_change":"2023-10-09T15:36:21.263509+0000","last_active":"2023-10-09T15:36:21.266402+0000","last_peered":"2023-10-09T15:36:21.266402+0000","last_clean":"2023-10-09T15:36:21.266402+0000","last_became_active":"2023-10-09T15:36:21.263247+0000","last_became_peered":"2023-10-09T15:36:21.263247+0000","last_unstale":"2023-10-09T15:36:21.266402+0000","last_undegraded":"2023-10-09T15:36:21.266402+0000","last_fullsized":"2023-10-09T15:36:21.266402+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:13.547321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"76'2","reported_seq":12,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593958+0000","last_change":"2023-10-09T15:36:20.589000+0000","last_active":"2023-10-09T15:36:21.593958+0000","last_peered":"2023-10-09T15:36:21.593958+0000","last_clean":"2023-10-09T15:36:21.593958+0000","last_became_active":"2023-10-09T15:36:20.588640+0000","last_became_peered":"2023-10-09T15:36:20.588640+0000","last_unstale":"2023-10-09T15:36:21.593958+0000","last_undegraded":"2023-10-09T15:36:21.593958+0000","last_fullsized":"2023-10-09T15:36:21.593958+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:11.283050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.272965+0000","last_change":"2023-10-09T15:36:21.270156+0000","last_active":"2023-10-09T15:36:21.272965+0000","last_peered":"2023-10-09T15:36:21.272965+0000","last_clean":"2023-10-09T15:36:21.272965+0000","last_became_active":"2023-10-09T15:36:21.269896+0000","last_became_peered":"2023-10-09T15:36:21.269896+0000","last_unstale":"2023-10-09T15:36:21.272965+0000","last_undegraded":"2023-10-09T15:36:21.272965+0000","last_fullsized":"2023-10-09T15:36:21.272965+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:57.407105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.264333+0000","last_change":"2023-10-09T15:36:20.588939+0000","last_active":"2023-10-09T15:36:21.264333+0000","last_peered":"2023-10-09T15:36:21.264333+0000","last_clean":"2023-10-09T15:36:21.264333+0000","last_became_active":"2023-10-09T15:36:20.588616+0000","last_became_peered":"2023-10-09T15:36:20.588616+0000","last_unstale":"2023-10-09T15:36:21.264333+0000","last_undegraded":"2023-10-09T15:36:21.264333+0000","last_fullsized":"2023-10-09T15:36:21.264333+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:07:02.575043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266835+0000","last_change":"2023-10-09T15:36:21.258986+0000","last_active":"2023-10-09T15:36:21.266835+0000","last_peered":"2023-10-09T15:36:21.266835+0000","last_clean":"2023-10-09T15:36:21.266835+0000","last_became_active":"2023-10-09T15:36:21.258498+0000","last_became_peered":"2023-10-09T15:36:21.258498+0000","last_unstale":"2023-10-09T15:36:21.266835+0000","last_undegraded":"2023-10-09T15:36:21.266835+0000","last_fullsized":"2023-10-09T15:36:21.266835+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:34:41.133769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249374+0000","last_change":"2023-10-09T15:36:20.582615+0000","last_active":"2023-10-09T15:36:21.249374+0000","last_peered":"2023-10-09T15:36:21.249374+0000","last_clean":"2023-10-09T15:36:21.249374+0000","last_became_active":"2023-10-09T15:36:20.582271+0000","last_became_peered":"2023-10-09T15:36:20.582271+0000","last_unstale":"2023-10-09T15:36:21.249374+0000","last_undegraded":"2023-10-09T15:36:21.249374+0000","last_fullsized":"2023-10-09T15:36:21.249374+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:26.408346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.265902+0000","last_change":"2023-10-09T15:36:21.259116+0000","last_active":"2023-10-09T15:36:21.265902+0000","last_peered":"2023-10-09T15:36:21.265902+0000","last_clean":"2023-10-09T15:36:21.265902+0000","last_became_active":"2023-10-09T15:36:21.258750+0000","last_became_peered":"2023-10-09T15:36:21.258750+0000","last_unstale":"2023-10-09T15:36:21.265902+0000","last_undegraded":"2023-10-09T15:36:21.265902+0000","last_fullsized":"2023-10-09T15:36:21.265902+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:35.623875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251341+0000","last_change":"2023-10-09T15:36:20.577747+0000","last_active":"2023-10-09T15:36:21.251341+0000","last_peered":"2023-10-09T15:36:21.251341+0000","last_clean":"2023-10-09T15:36:21.251341+0000","last_became_active":"2023-10-09T15:36:20.577382+0000","last_became_peered":"2023-10-09T15:36:20.577382+0000","last_unstale":"2023-10-09T15:36:21.251341+0000","last_undegraded":"2023-10-09T15:36:21.251341+0000","last_fullsized":"2023-10-09T15:36:21.251341+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:07.383250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.267298+0000","last_change":"2023-10-09T15:36:21.264145+0000","last_active":"2023-10-09T15:36:21.267298+0000","last_peered":"2023-10-09T15:36:21.267298+0000","last_clean":"2023-10-09T15:36:21.267298+0000","last_became_active":"2023-10-09T15:36:21.263872+0000","last_became_peered":"2023-10-09T15:36:21.263872+0000","last_unstale":"2023-10-09T15:36:21.267298+0000","last_undegraded":"2023-10-09T15:36:21.267298+0000","last_fullsized":"2023-10-09T15:36:21.267298+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:16.094036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.247673+0000","last_change":"2023-10-09T15:36:20.582908+0000","last_active":"2023-10-09T15:36:21.247673+0000","last_peered":"2023-10-09T15:36:21.247673+0000","last_clean":"2023-10-09T15:36:21.247673+0000","last_became_active":"2023-10-09T15:36:20.582623+0000","last_became_peered":"2023-10-09T15:36:20.582623+0000","last_unstale":"2023-10-09T15:36:21.247673+0000","last_undegraded":"2023-10-09T15:36:21.247673+0000","last_fullsized":"2023-10-09T15:36:21.247673+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:12.542420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.259587+0000","last_change":"2023-10-09T15:36:21.255334+0000","last_active":"2023-10-09T15:36:21.259587+0000","last_peered":"2023-10-09T15:36:21.259587+0000","last_clean":"2023-10-09T15:36:21.259587+0000","last_became_active":"2023-10-09T15:36:21.255008+0000","last_became_peered":"2023-10-09T15:36:21.255008+0000","last_unstale":"2023-10-09T15:36:21.259587+0000","last_undegraded":"2023-10-09T15:36:21.259587+0000","last_fullsized":"2023-10-09T15:36:21.259587+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:55:53.148875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.249787+0000","last_change":"2023-10-09T15:36:20.585259+0000","last_active":"2023-10-09T15:36:21.249787+0000","last_peered":"2023-10-09T15:36:21.249787+0000","last_clean":"2023-10-09T15:36:21.249787+0000","last_became_active":"2023-10-09T15:36:20.584929+0000","last_became_peered":"2023-10-09T15:36:20.584929+0000","last_unstale":"2023-10-09T15:36:21.249787+0000","last_undegraded":"2023-10-09T15:36:21.249787+0000","last_fullsized":"2023-10-09T15:36:21.249787+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:04.695202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.274294+0000","last_change":"2023-10-09T15:36:21.273506+0000","last_active":"2023-10-09T15:36:21.274294+0000","last_peered":"2023-10-09T15:36:21.274294+0000","last_clean":"2023-10-09T15:36:21.274294+0000","last_became_active":"2023-10-09T15:36:21.273029+0000","last_became_peered":"2023-10-09T15:36:21.273029+0000","last_unstale":"2023-10-09T15:36:21.274294+0000","last_undegraded":"2023-10-09T15:36:21.274294+0000","last_fullsized":"2023-10-09T15:36:21.274294+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:58.401568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.248965+0000","last_change":"2023-10-09T15:36:20.578133+0000","last_active":"2023-10-09T15:36:21.248965+0000","last_peered":"2023-10-09T15:36:21.248965+0000","last_clean":"2023-10-09T15:36:21.248965+0000","last_became_active":"2023-10-09T15:36:20.577526+0000","last_became_peered":"2023-10-09T15:36:20.577526+0000","last_unstale":"2023-10-09T15:36:21.248965+0000","last_undegraded":"2023-10-09T15:36:21.248965+0000","last_fullsized":"2023-10-09T15:36:21.248965+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:22:02.618562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.266435+0000","last_change":"2023-10-09T15:36:21.259251+0000","last_active":"2023-10-09T15:36:21.266435+0000","last_peered":"2023-10-09T15:36:21.266435+0000","last_clean":"2023-10-09T15:36:21.266435+0000","last_became_active":"2023-10-09T15:36:21.258570+0000","last_became_peered":"2023-10-09T15:36:21.258570+0000","last_unstale":"2023-10-09T15:36:21.266435+0000","last_undegraded":"2023-10-09T15:36:21.266435+0000","last_fullsized":"2023-10-09T15:36:21.266435+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:32.060077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":10,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.251553+0000","last_change":"2023-10-09T15:36:20.587558+0000","last_active":"2023-10-09T15:36:21.251553+0000","last_peered":"2023-10-09T15:36:21.251553+0000","last_clean":"2023-10-09T15:36:21.251553+0000","last_became_active":"2023-10-09T15:36:20.587165+0000","last_became_peered":"2023-10-09T15:36:20.587165+0000","last_unstale":"2023-10-09T15:36:21.251553+0000","last_undegraded":"2023-10-09T15:36:21.251553+0000","last_fullsized":"2023-10-09T15:36:21.251553+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:20.553387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":9,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.273274+0000","last_change":"2023-10-09T15:36:21.269743+0000","last_active":"2023-10-09T15:36:21.273274+0000","last_peered":"2023-10-09T15:36:21.273274+0000","last_clean":"2023-10-09T15:36:21.273274+0000","last_became_active":"2023-10-09T15:36:21.269484+0000","last_became_peered":"2023-10-09T15:36:21.269484+0000","last_unstale":"2023-10-09T15:36:21.273274+0000","last_undegraded":"2023-10-09T15:36:21.273274+0000","last_fullsized":"2023-10-09T15:36:21.273274+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":75,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:20.563804+0000","last_clean_scrub_stamp":"2023-10-09T15:36:20.563804+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:02:40.144331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"76'1","reported_seq":11,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.593415+0000","last_change":"2023-10-09T15:36:20.595227+0000","last_active":"2023-10-09T15:36:21.593415+0000","last_peered":"2023-10-09T15:36:21.593415+0000","last_clean":"2023-10-09T15:36:21.593415+0000","last_became_active":"2023-10-09T15:36:20.594868+0000","last_became_peered":"2023-10-09T15:36:20.594868+0000","last_unstale":"2023-10-09T15:36:21.593415+0000","last_undegraded":"2023-10-09T15:36:21.593415+0000","last_fullsized":"2023-10-09T15:36:21.593415+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":74,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:19.558904+0000","last_clean_scrub_stamp":"2023-10-09T15:36:19.558904+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:15.089136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":212,"reported_epoch":76,"state":"active+clean","last_fresh":"2023-10-09T15:36:21.260856+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:36:21.260856+0000","last_peered":"2023-10-09T15:36:21.260856+0000","last_clean":"2023-10-09T15:36:21.260856+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:36:21.260856+0000","last_undegraded":"2023-10-09T15:36:21.260856+0000","last_fullsized":"2023-10-09T15:36:21.260856+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574918,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298784,"kb_used_data":1496,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073056,"statfs":{"total":96636764160,"available":96330809344,"internally_reserved":0,"allocated":1531904,"data_stored":990370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.64300000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63400000000000001,"5min":0.874,"15min":0.874},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.53700000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.46600000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.623}]},{"osd":3,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.745,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.5}]},{"osd":4,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.88,"15min":0.88},"last":0.439}]},{"osd":5,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.41799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.57199999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.38800000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298224,"kb_used_data":936,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073616,"statfs":{"total":96636764160,"available":96331382784,"internally_reserved":0,"allocated":958464,"data_stored":406886,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63900000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.45600000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.56000000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":1.379,"15min":1.379},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.38800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.61699999999999999,"15min":0.80300000000000005},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.41199999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.62},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66800000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.872,"15min":0.872},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.61599999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.64500000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302308,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069532,"statfs":{"total":96636764160,"available":96327200768,"internally_reserved":0,"allocated":946176,"data_stored":400126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.63},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36199999999999999,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52900000000000003,"5min":1.512,"15min":1.512},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":1.286,"15min":1.286},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55000000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.49299999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.69699999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.877,"5min":1.222,"15min":1.222},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.86099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.83699999999999997},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.81499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.877}]},{"osd":7,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.997,"15min":0.997},"last":0.72499999999999998},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69299999999999995,"15min":0.82099999999999995},"min":{"1min":0.48099999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.93300000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574917,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298780,"kb_used_data":1492,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073060,"statfs":{"total":96636764160,"available":96330813440,"internally_reserved":0,"allocated":1527808,"data_stored":989323,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.373},"min":{"1min":0.219,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.377},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.41599999999999998},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36399999999999999,"15min":0.39000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.497,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.318},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":0.29399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.54200000000000004},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47099999999999997,"15min":0.621},"min":{"1min":0.33300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53400000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":0.40899999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":1.196,"15min":1.196},"last":0.73699999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.508,"15min":1.508},"last":0.59399999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.621,"5min":0.60299999999999998,"15min":0.63300000000000001},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":0.51700000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.68100000000000005},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":0.67100000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.72099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":406774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35199999999999998,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.39800000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51200000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.437},{"interface":"front","average":{"1min":0.377,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.47299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48999999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.434},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48399999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61199999999999999,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83199999999999996,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.77700000000000002},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.69299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.74399999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.68500000000000005},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":1.407,"15min":1.407},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":401468,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32600000000000001,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46899999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.49199999999999999,"15min":0.91200000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45700000000000002,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.56599999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.42299999999999999,"15min":0.68000000000000005},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.64700000000000002,"15min":1.429},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.498,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.38,"5min":0.48299999999999998,"15min":0.755},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50700000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":1.121},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":17.02,"15min":17.02},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.71599999999999997,"15min":0.92700000000000005},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.44500000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.75},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":1.149},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.499}]},{"osd":6,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.93700000000000006},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.278,"15min":1.278},"last":0.77300000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.78000000000000003,"15min":1.1950000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85099999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.95199999999999996},"min":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.876,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.51100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574917,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298212,"kb_used_data":924,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073628,"statfs":{"total":96636764160,"available":96331395072,"internally_reserved":0,"allocated":946176,"data_stored":406220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70599999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59299999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.871,"5min":2.879,"15min":2.879},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.63300000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65000000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.36799999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.70699999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.77500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.68000000000000005},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.80200000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.82199999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298216,"kb_used_data":928,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073624,"statfs":{"total":96636764160,"available":96331390976,"internally_reserved":0,"allocated":950272,"data_stored":401490,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.165,"15min":1.165},"last":0.56399999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":2.089,"15min":2.089},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.71699999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":11.055,"15min":11.055},"last":0.63600000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.93899999999999995},"min":{"1min":0.49199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.5}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68500000000000005,"15min":0.94099999999999995},"min":{"1min":0.46999999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79300000000000004,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.73599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72999999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.752}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.78400000000000003,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:36:26.085 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:36:26.085 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:36:26.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.246+0000 7f47950b8700 1 Processor -- start 2023-10-09T15:36:26.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.246+0000 7f47950b8700 1 -- start start 2023-10-09T15:36:26.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f47950b8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f47950b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f47950b8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47900ccfd0 con 0x7f479006dc70 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f47950b8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47900cf0e0 con 0x7f4790159530 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f47950b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479015a3d0 con 0x7f479006e0e0 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:36130/0 (socket says 172.21.15.33:36130) 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 -- 172.21.15.33:0/2461678291 learned_addr learned my addr 172.21.15.33:0/2461678291 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:34534/0 (socket says 172.21.15.33:34534) 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 -- 172.21.15.33:0/2461678291 >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 msgr2=0x7f47900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 --2- 172.21.15.33:0/2461678291 >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 -- 172.21.15.33:0/2461678291 >> v1:172.21.15.59:6789/0 conn(0x7f479006dc70 legacy=0x7f4790159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 -- 172.21.15.33:0/2461678291 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f479015a6b0 con 0x7f479006e0e0 2023-10-09T15:36:26.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478ed9d700 1 --2- 172.21.15.33:0/2461678291 >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.247+0000 7f478f59e700 1 --2- 172.21.15.33:0/2461678291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4788009f20 tx=0x7f4788009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6b03f0ddf38da92 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f478dd9b700 1 -- 172.21.15.33:0/2461678291 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f478800e070 con 0x7f479006e0e0 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f478dd9b700 1 -- 172.21.15.33:0/2461678291 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f478800b9d0 con 0x7f479006e0e0 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f478dd9b700 1 -- 172.21.15.33:0/2461678291 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47880092e0 con 0x7f479006e0e0 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 -- 172.21.15.33:0/2461678291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 msgr2=0x7f47900cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 --2- 172.21.15.33:0/2461678291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f4788009f20 tx=0x7f4788009840 comp rx=0 tx=0).stop 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 -- 172.21.15.33:0/2461678291 shutdown_connections 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 --2- 172.21.15.33:0/2461678291 >> v2:172.21.15.59:3300/0 conn(0x7f4790159530 0x7f47900ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 --2- 172.21.15.33:0/2461678291 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900cb6f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 -- 172.21.15.33:0/2461678291 >> 172.21.15.33:0/2461678291 conn(0x7f47900703a0 msgr2=0x7f47900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:26.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 -- 172.21.15.33:0/2461678291 shutdown_connections 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.248+0000 7f47950b8700 1 -- 172.21.15.33:0/2461678291 wait complete. 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.249+0000 7f47950b8700 1 Processor -- start 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.249+0000 7f47950b8700 1 -- start start 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479006dc70 0x7f47900b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4790155bc0 con 0x7f4790159530 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47900b1530 con 0x7f479006dc70 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f47950b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47900b1810 con 0x7f479006e0e0 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f478f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f478f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56282/0 (socket says 172.21.15.33:56282) 2023-10-09T15:36:26.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f478f59e700 1 -- 172.21.15.33:0/2409237442 learned_addr learned my addr 172.21.15.33:0/2409237442 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f478ed9d700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479006dc70 0x7f47900b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.250+0000 7f478e59c700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 -- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 msgr2=0x7f47900b4fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900b4fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 -- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479006dc70 msgr2=0x7f47900b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479006dc70 0x7f47900b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 -- 172.21.15.33:0/2409237442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4780009420 con 0x7f4790159530 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f478f59e700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f479015a510 tx=0x7f4788018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788008ad0 con 0x7f4790159530 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4788008c30 con 0x7f4790159530 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4788009ae0 con 0x7f4790159530 2023-10-09T15:36:26.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4788026460 con 0x7f4790159530 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.251+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47900b1dd0 con 0x7f4790159530 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.252+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4790155d70 con 0x7f4790159530 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.252+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4788003040 con 0x7f4790159530 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.253+0000 7f4776ffd700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 0x7f477c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.253+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47880867c0 con 0x7f4790159530 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.253+0000 7f478ed9d700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 0x7f477c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.253+0000 7f478ed9d700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 0x7f477c069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ea0 tx=0x7f47800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.257+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4790155d70 con 0x7f4790159530 2023-10-09T15:36:26.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.531+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f479004c3c0 con 0x7f4790159530 2023-10-09T15:36:26.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.536+0000 7f4776ffd700 1 -- 172.21.15.33:0/2409237442 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f4788053690 con 0x7f4790159530 2023-10-09T15:36:26.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 msgr2=0x7f477c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 0x7f477c069620 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f4780009ea0 tx=0x7f47800091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 msgr2=0x7f47900b54e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f479015a510 tx=0x7f4788018000 comp rx=0 tx=0).stop 2023-10-09T15:36:26.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 shutdown_connections 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f477c067170 0x7f477c069620 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4790159530 0x7f47900b54e0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f479006dc70 0x7f47900b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 --2- 172.21.15.33:0/2409237442 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f479006e0e0 0x7f47900b4fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 >> 172.21.15.33:0/2409237442 conn(0x7f47900703a0 msgr2=0x7f479015abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 shutdown_connections 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.538+0000 7f47950b8700 1 -- 172.21.15.33:0/2409237442 wait complete. 2023-10-09T15:36:26.540 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:36:26.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:26.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.669+0000 7faf8da86700 1 Processor -- start 2023-10-09T15:36:26.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.669+0000 7faf8da86700 1 -- start start 2023-10-09T15:36:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf8da86700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf880aec90 0x7faf8815df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf8da86700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf8815a750 con 0x7faf8806cdb0 2023-10-09T15:36:26.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf8da86700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf88159e40 con 0x7faf8815d440 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf8da86700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880af110 con 0x7faf880aec90 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf880aec90 0x7faf8815df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf880aec90 0x7faf8815df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56294/0 (socket says 172.21.15.33:56294) 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 -- 172.21.15.33:0/775368988 learned_addr learned my addr 172.21.15.33:0/775368988 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 -- 172.21.15.33:0/775368988 >> v1:172.21.15.59:6789/0 conn(0x7faf8815d440 legacy=0x7faf8806c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 -- 172.21.15.33:0/775368988 >> v1:172.21.15.33:6789/0 conn(0x7faf8806cdb0 legacy=0x7faf8815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 -- 172.21.15.33:0/775368988 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880af300 con 0x7faf880aec90 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf87fff700 1 --2- 172.21.15.33:0/775368988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf880aec90 0x7faf8815df20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7faf80009f20 tx=0x7faf80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a026c85da3c074fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.670+0000 7faf867fc700 1 -- 172.21.15.33:0/775368988 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000e070 con 0x7faf880aec90 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf867fc700 1 -- 172.21.15.33:0/775368988 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000ba40 con 0x7faf880aec90 2023-10-09T15:36:26.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf867fc700 1 -- 172.21.15.33:0/775368988 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf800092e0 con 0x7faf880aec90 2023-10-09T15:36:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 -- 172.21.15.33:0/775368988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf880aec90 msgr2=0x7faf8815df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 --2- 172.21.15.33:0/775368988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf880aec90 0x7faf8815df20 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7faf80009f20 tx=0x7faf80009840 comp rx=0 tx=0).stop 2023-10-09T15:36:26.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 -- 172.21.15.33:0/775368988 shutdown_connections 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 --2- 172.21.15.33:0/775368988 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf880aec90 0x7faf8815df20 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 -- 172.21.15.33:0/775368988 >> 172.21.15.33:0/775368988 conn(0x7faf8806f190 msgr2=0x7faf880ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 -- 172.21.15.33:0/775368988 shutdown_connections 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.671+0000 7faf8da86700 1 -- 172.21.15.33:0/775368988 wait complete. 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.672+0000 7faf8da86700 1 Processor -- start 2023-10-09T15:36:26.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.672+0000 7faf8da86700 1 -- start start 2023-10-09T15:36:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 0x7faf8815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 0x7faf8815dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8816dc20 con 0x7faf8806cdb0 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf8816d010 con 0x7faf880aec90 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf8da86700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf8816d2f0 con 0x7faf8815d440 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56300/0 (socket says 172.21.15.33:56300) 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 -- 172.21.15.33:0/3253922989 learned_addr learned my addr 172.21.15.33:0/3253922989 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf87fff700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 0x7faf8815dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf86ffd700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 0x7faf8815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 -- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 msgr2=0x7faf8815dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 0x7faf8815dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 -- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 msgr2=0x7faf8815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 0x7faf8815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf877fe700 1 -- 172.21.15.33:0/3253922989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009ae0 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf87fff700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 0x7faf8815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.673+0000 7faf86ffd700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 0x7faf8815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf877fe700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c5d0 tx=0x7faf78007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78011590 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf78011710 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf8816d5d0 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf78011ad0 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.674+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf8814d390 con 0x7faf8806cdb0 2023-10-09T15:36:26.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.675+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf8816df00 con 0x7faf8806cdb0 2023-10-09T15:36:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.675+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7faf7801c460 con 0x7faf8806cdb0 2023-10-09T15:36:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.676+0000 7faf6f7fe700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.676+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faf780846e0 con 0x7faf8806cdb0 2023-10-09T15:36:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.676+0000 7faf86ffd700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:26.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.676+0000 7faf86ffd700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 0x7faf74069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faf8814e880 tx=0x7faf7c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:26.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.680+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf780516c0 con 0x7faf8806cdb0 2023-10-09T15:36:26.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.918+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7faf8804c3c0 con 0x7faf8806cdb0 2023-10-09T15:36:26.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.919+0000 7faf6f7fe700 1 -- 172.21.15.33:0/3253922989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 49 v49) v1 ==== 94+0+4599 (secure 0 0 0) 0x7faf78054ce0 con 0x7faf8806cdb0 2023-10-09T15:36:26.920 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:26.920 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":49,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:26.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 msgr2=0x7faf74069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 0x7faf74069620 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faf8814e880 tx=0x7faf7c009040 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 msgr2=0x7faf8814ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7faf7800c5d0 tx=0x7faf78007f60 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 shutdown_connections 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf74067170 0x7faf74069620 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf8806cdb0 0x7faf8814ce50 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf8815d440 0x7faf8815dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 --2- 172.21.15.33:0/3253922989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf880aec90 0x7faf8815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 >> 172.21.15.33:0/3253922989 conn(0x7faf8806f190 msgr2=0x7faf8806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:26.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 shutdown_connections 2023-10-09T15:36:26.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:26.921+0000 7faf8da86700 1 -- 172.21.15.33:0/3253922989 wait complete. 2023-10-09T15:36:26.924 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 49 2023-10-09T15:36:27.252 INFO:tasks.ceph.mds.b.smithi059.stderr:2023-10-09T15:36:27.251+0000 7f93741e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:36:27.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 49, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:36:20.975612+0000', 'modified': '2023-10-09T15:36:24.598102+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6111}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6111': {'gid': 6111, 'name': 'b', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6835/2947470060', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6833', 'nonce': 2947470060}, {'type': 'v1', 'addr': '172.21.15.59:6835', 'nonce': 2947470060}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:36:27.337 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:36:27.337 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T15:36:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.461+0000 7f4f34c0f700 1 Processor -- start 2023-10-09T15:36:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.461+0000 7f4f34c0f700 1 -- start start 2023-10-09T15:36:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f34c0f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f300cb5a0 0x7f4f300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f34c0f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4f3015a5d0 0x7f4f30156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f34c0f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f3015ae40 con 0x7f4f300cd9e0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f34c0f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f300d13f0 con 0x7f4f300cb5a0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f34c0f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f3015ab60 con 0x7f4f3015a5d0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f300cb5a0 0x7f4f300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f300cb5a0 0x7f4f300cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56314/0 (socket says 172.21.15.33:56314) 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 -- 172.21.15.33:0/2804348246 learned_addr learned my addr 172.21.15.33:0/2804348246 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/2804348246 >> v2:172.21.15.59:3300/0 conn(0x7f4f3015a5d0 0x7f4f30156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 -- 172.21.15.33:0/2804348246 >> v2:172.21.15.59:3300/0 conn(0x7f4f3015a5d0 msgr2=0x7f4f30156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/2804348246 >> v2:172.21.15.59:3300/0 conn(0x7f4f3015a5d0 0x7f4f30156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 -- 172.21.15.33:0/2804348246 >> v1:172.21.15.33:6789/0 conn(0x7f4f300cd9e0 legacy=0x7f4f30159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.462+0000 7f4f2e59c700 1 -- 172.21.15.33:0/2804348246 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f300ccf00 con 0x7f4f300cb5a0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/2804348246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cb5a0 0x7f4f300cb970 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009f20 tx=0x7f4f20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c51b8b7a92595b95 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f2d59a700 1 -- 172.21.15.33:0/2804348246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2000e070 con 0x7f4f300cb5a0 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f2d59a700 1 -- 172.21.15.33:0/2804348246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2000ba40 con 0x7f4f300cb5a0 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f2d59a700 1 -- 172.21.15.33:0/2804348246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200092e0 con 0x7f4f300cb5a0 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 -- 172.21.15.33:0/2804348246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cb5a0 msgr2=0x7f4f300cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/2804348246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cb5a0 0x7f4f300cb970 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009f20 tx=0x7f4f20009840 comp rx=0 tx=0).stop 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 -- 172.21.15.33:0/2804348246 shutdown_connections 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/2804348246 >> v2:172.21.15.59:3300/0 conn(0x7f4f3015a5d0 0x7f4f30156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/2804348246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cb5a0 0x7f4f300cb970 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 -- 172.21.15.33:0/2804348246 >> 172.21.15.33:0/2804348246 conn(0x7f4f30070e30 msgr2=0x7f4f300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 -- 172.21.15.33:0/2804348246 shutdown_connections 2023-10-09T15:36:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.463+0000 7f4f34c0f700 1 -- 172.21.15.33:0/2804348246 wait complete. 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.464+0000 7f4f34c0f700 1 Processor -- start 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 -- start start 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f300cb5a0 0x7f4f30156180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3015a5d0 0x7f4f300b4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3015d780 con 0x7f4f300cd9e0 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f301566c0 con 0x7f4f300cb5a0 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f34c0f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f3015cb70 con 0x7f4f3015a5d0 2023-10-09T15:36:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f2dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f2dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56326/0 (socket says 172.21.15.33:56326) 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f2dd9b700 1 -- 172.21.15.33:0/1356837012 learned_addr learned my addr 172.21.15.33:0/1356837012 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f300cb5a0 0x7f4f30156180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.465+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3015a5d0 0x7f4f300b4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 -- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3015a5d0 msgr2=0x7f4f300b4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3015a5d0 0x7f4f300b4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 -- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f300cb5a0 msgr2=0x7f4f30156180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f300cb5a0 0x7f4f30156180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 -- 172.21.15.33:0/1356837012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f20009ae0 con 0x7f4f300cd9e0 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c590 tx=0x7f4f1800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f267fc700 1 -- 172.21.15.33:0/1356837012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011590 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f267fc700 1 -- 172.21.15.33:0/1356837012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f18011710 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f3015ce50 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f267fc700 1 -- 172.21.15.33:0/1356837012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f18011ad0 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.466+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f3015d410 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.468+0000 7f4f267fc700 1 -- 172.21.15.33:0/1356837012 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4f1801b3b0 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.468+0000 7f4f267fc700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 0x7f4f10069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.468+0000 7f4f267fc700 1 -- 172.21.15.33:0/1356837012 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f18083ca0 con 0x7f4f300cd9e0 2023-10-09T15:36:27.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.468+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 0x7f4f10069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.468+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 0x7f4f10069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009880 tx=0x7f4f20018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.470+0000 7f4f3df07b80 1 Processor -- start 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.470+0000 7f4f3df07b80 1 -- start start 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 0x563fb8e69a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 0x563fb8e3ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8d97a70 con 0x563fb8e40a50 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8d95270 con 0x563fb8e8ad00 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fb8d91060 con 0x563fb8e69f60 2023-10-09T15:36:27.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56336/0 (socket says 172.21.15.33:56336) 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3045629351 learned_addr learned my addr 172.21.15.33:0/3045629351 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 0x563fb8e3ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 0x563fb8e69a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 msgr2=0x563fb8e3ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 0x563fb8e3ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 msgr2=0x563fb8e69a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 0x563fb8e69a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3045629351 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fb8c2b270 con 0x563fb8e40a50 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 0x563fb8e69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 0x563fb8e3ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:27.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000f40 tx=0x7f4f20020040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d16646775da2ec53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f0f7fe700 1 -- 172.21.15.33:0/3045629351 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f20007aa0 con 0x563fb8e40a50 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f0f7fe700 1 -- 172.21.15.33:0/3045629351 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20007c00 con 0x563fb8e40a50 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.471+0000 7f4f0f7fe700 1 -- 172.21.15.33:0/3045629351 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2001e430 con 0x563fb8e40a50 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3045629351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 msgr2=0x563fb8e40e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f4f20000f40 tx=0x7f4f20020040 comp rx=0 tx=0).stop 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3045629351 shutdown_connections 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e40a50 0x563fb8e40e20 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e69f60 0x563fb8e3ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3045629351 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e8ad00 0x563fb8e69a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3045629351 >> 172.21.15.33:0/3045629351 conn(0x563fb8e42370 msgr2=0x563fb8e42740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3045629351 shutdown_connections 2023-10-09T15:36:27.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.472+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3045629351 wait complete. 2023-10-09T15:36:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.473+0000 7f4f3df07b80 1 -- start start 2023-10-09T15:36:27.477 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.473+0000 7f4f3df07b80 1 Processor -- start 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e97b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e87b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8d3c890 con 0x563fb8e9a5e0 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8d57ea0 con 0x563fb8e69f60 2023-10-09T15:36:27.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fb8c13e30 con 0x563fb8e8ad00 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f3df07b80 10 client.0 _ll_register_callbacks cb 0x563fb8e04110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56338/0 (socket says 172.21.15.33:56338) 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3254238762 learned_addr learned my addr 172.21.15.33:0/3254238762 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e87b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e97b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 msgr2=0x563fb8e87b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e87b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 msgr2=0x563fb8e97b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e97b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3254238762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f300ccf00 con 0x563fb8e9a5e0 2023-10-09T15:36:27.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4f280129e0 tx=0x7f4f28008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c09e232299b9883 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2800be40 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.474+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f280108f0 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563fb8e35b70 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f28010d00 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 10 client.6249 fetch_fsmap learned FSMap version 49 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x563fb8bcdfe0 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563fb8e35b70 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f28015450 con 0x563fb8e9a5e0 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 10 client.6249 fetch_fsmap finished waiting for FSMap version 49 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 10 client.6249 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:36:27.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 20 client.6249 populate_metadata read hostname 'smithi033' 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e3dbb0 0x563fb8e84420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 4 client.6249 mds_command: new command op to 6111 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 --> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563fb8e12aa0 con 0x563fb8e3dbb0 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.475+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e3dbb0 0x563fb8e84420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.476+0000 7f4f0cff9700 10 client.6249 ms_handle_connect on v2:172.21.15.59:6833/2947470060 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.476+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e3dbb0 0x563fb8e84420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a846155f01348442 server_cookie=8482e6acc9e346d4 in_seq=0 out_seq=0 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3254238762 <== mds.0 v2:172.21.15.59:6833/2947470060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x563fb8e12aa0 con 0x563fb8e3dbb0 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f0cff9700 10 client.6249 handle_command_reply: tid=0 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 client.6249 shutdown 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 msgr2=0x563fb8e894d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f4f280129e0 tx=0x7f4f28008040 comp rx=0 tx=0).stop 2023-10-09T15:36:27.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 shutdown_connections 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e3dbb0 0x563fb8e84420 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8e894d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f0cff9700 0 client.6249 ms_handle_reset on v2:172.21.15.59:6833/2947470060 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e97b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3254238762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e87b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 >> 172.21.15.33:0/3254238762 conn(0x563fb8e42370 msgr2=0x563fb8e86550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 shutdown_connections 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3254238762 wait complete. 2023-10-09T15:36:27.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.477+0000 7f4f3df07b80 20 client.6249 trim_cache size 0 max 16384 2023-10-09T15:36:27.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.494+0000 7f4f3df07b80 1 Processor -- start 2023-10-09T15:36:27.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.494+0000 7f4f3df07b80 1 -- start start 2023-10-09T15:36:27.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e96580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e9a5e0 0x563fb8e3bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8e3fc70 con 0x563fb8e69f60 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8e20510 con 0x563fb8e9a5e0 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fb8ea9a60 con 0x563fb8e8ad00 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56348/0 (socket says 172.21.15.33:56348) 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3093269799 learned_addr learned my addr 172.21.15.33:0/3093269799 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e96580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e9a5e0 0x563fb8e3bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 msgr2=0x563fb8e96580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e96580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e9a5e0 msgr2=0x563fb8e3bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e9a5e0 0x563fb8e3bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 -- 172.21.15.33:0/3093269799 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563fb8d5f780 con 0x563fb8e69f60 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009570 tx=0x7f4f20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e215aec472bae6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f0ffff700 1 -- 172.21.15.33:0/3093269799 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2003e070 con 0x563fb8e69f60 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f0ffff700 1 -- 172.21.15.33:0/3093269799 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20007a20 con 0x563fb8e69f60 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.495+0000 7f4f0ffff700 1 -- 172.21.15.33:0/3093269799 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f200073a0 con 0x563fb8e69f60 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3093269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 msgr2=0x563fb8e42f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009570 tx=0x7f4f20016000 comp rx=0 tx=0).stop 2023-10-09T15:36:27.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3093269799 shutdown_connections 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e69f60 0x563fb8e42f40 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e9a5e0 0x563fb8e3bc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3093269799 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8e96580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3093269799 >> 172.21.15.33:0/3093269799 conn(0x563fb8e42370 msgr2=0x563fb8e89f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3093269799 shutdown_connections 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.496+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3093269799 wait complete. 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.497+0000 7f4f3df07b80 1 -- start start 2023-10-09T15:36:27.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.497+0000 7f4f3df07b80 1 Processor -- start 2023-10-09T15:36:27.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.497+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e969e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8eec640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8e68830 con 0x563fb8e9a5e0 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x563fb8e65970 con 0x563fb8e69f60 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x563fb8e685e0 con 0x563fb8e8ad00 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 10 client.0 _ll_register_callbacks cb 0x563fb8e04110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56352/0 (socket says 172.21.15.33:56352) 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3860965428 learned_addr learned my addr 172.21.15.33:0/3860965428 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2dd9b700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8eec640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e969e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 msgr2=0x563fb8eec640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8eec640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 msgr2=0x563fb8e969e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e969e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 -- 172.21.15.33:0/3860965428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563fb8c2b270 con 0x563fb8e9a5e0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f2ed9d700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4f280106b0 tx=0x7f4f28024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=376a0971c77ccd18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f0cff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f28010530 con 0x563fb8e9a5e0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4f28006c90 con 0x563fb8e9a5e0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f4f20007c00 con 0x563fb8e9a5e0 2023-10-09T15:36:27.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=49) v2 ==== 24+0+0 (secure 0 0 0) 0x7f4f28015450 con 0x563fb8e9a5e0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 10 client.6255 fetch_fsmap learned FSMap version 49 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.498+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=49,monmap=2+}) v3 -- 0x563fb8d46470 con 0x563fb8e9a5e0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f20007c00 con 0x563fb8e9a5e0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 49) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f4f28015910 con 0x563fb8e9a5e0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 10 client.6255 fetch_fsmap finished waiting for FSMap version 49 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 10 client.6255 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 20 client.6255 populate_metadata read hostname 'smithi033' 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e648a0 0x563fb8e64c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 4 client.6255 mds_command: new command op to 6111 tid=0[{"prefix": "status"}] 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 --> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] -- command(tid 0: {"prefix": "status"}) v1 -- 0x563fb8d33e00 con 0x563fb8e648a0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e648a0 0x563fb8e64c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f0cff9700 10 client.6255 ms_handle_connect on v2:172.21.15.59:6833/2947470060 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.499+0000 7f4f2e59c700 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e648a0 0x563fb8e64c70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=45a3c4196eb109e7 server_cookie=51e41e486771350e in_seq=0 out_seq=0 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f0cff9700 1 -- 172.21.15.33:0/3860965428 <== mds.0 v2:172.21.15.59:6833/2947470060 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x563fb8d33e00 con 0x563fb8e648a0 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f0cff9700 10 client.6255 handle_command_reply: tid=0 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 client.6255 shutdown 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 msgr2=0x563fb8eecb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f4f280106b0 tx=0x7f4f28024000 comp rx=0 tx=0).stop 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 shutdown_connections 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:6833/2947470060,v1:172.21.15.59:6835/2947470060] conn(0x563fb8e648a0 0x563fb8e64c70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x563fb8e9a5e0 0x563fb8eecb80 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x563fb8e69f60 0x563fb8e969e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f0cff9700 0 client.6255 ms_handle_reset on v2:172.21.15.59:6833/2947470060 2023-10-09T15:36:27.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 --2- 172.21.15.33:0/3860965428 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x563fb8e8ad00 0x563fb8eec640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 >> 172.21.15.33:0/3860965428 conn(0x563fb8e42370 msgr2=0x563fb8e68bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 shutdown_connections 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 1 -- 172.21.15.33:0/3860965428 wait complete. 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f3df07b80 20 client.6255 trim_cache size 0 max 16384 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 6111, 2023-10-09T15:36:27.508 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9185741140000001, 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 49, 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 77, 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 77, 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 10.990708164999999 2023-10-09T15:36:27.509 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 msgr2=0x7f4f10069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 0x7f4f10069620 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f4f20009880 tx=0x7f4f20018000 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 msgr2=0x7f4f3015ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4f1800c590 tx=0x7f4f1800c8a0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 shutdown_connections 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f10067170 0x7f4f10069620 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f3015a5d0 0x7f4f300b4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f300cb5a0 0x7f4f30156180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.500+0000 7f4f34c0f700 1 --2- 172.21.15.33:0/1356837012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f300cd9e0 0x7f4f3015ba20 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.501+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 >> 172.21.15.33:0/1356837012 conn(0x7f4f30070e30 msgr2=0x7f4f300c5d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.501+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 shutdown_connections 2023-10-09T15:36:27.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.501+0000 7f4f34c0f700 1 -- 172.21.15.33:0/1356837012 wait complete. 2023-10-09T15:36:27.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:36:27.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.632+0000 7fa023e62700 1 Processor -- start 2023-10-09T15:36:27.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.632+0000 7fa023e62700 1 -- start start 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa023e62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa01c0cb970 0x7fa01c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa023e62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa01c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa023e62700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa01c15ae40 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa023e62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa01c0ce0f0 con 0x7fa01c0cb970 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa023e62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0d13f0 con 0x7fa01c15a400 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa021bfe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa01c0cb5a0 0x7fa01c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51652/0 (socket says 172.21.15.33:51652) 2023-10-09T15:36:27.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa021bfe700 1 -- 172.21.15.33:0/36157159 learned_addr learned my addr 172.21.15.33:0/36157159 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa0213fd700 1 --2- 172.21.15.33:0/36157159 >> v2:172.21.15.59:3300/0 conn(0x7fa01c0cb970 0x7fa01c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa01c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1758340000 0 0) 0x7fa01c15ae40 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa004003570 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 335986333 0 0) 0x7fa004003570 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 msgr2=0x7fa01c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa01c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 >> v2:172.21.15.59:3300/0 conn(0x7fa01c0cb970 msgr2=0x7fa01c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 --2- 172.21.15.33:0/36157159 >> v2:172.21.15.59:3300/0 conn(0x7fa01c0cb970 0x7fa01c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c15ab60 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa00c0017f0 con 0x7fa01c0cb5a0 2023-10-09T15:36:27.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa0213fd700 1 --2- 172.21.15.33:0/36157159 >> v2:172.21.15.59:3300/0 conn(0x7fa01c0cb970 0x7fa01c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa01c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 >> v1:172.21.15.33:6789/0 conn(0x7fa01c0cb5a0 legacy=0x7fa01c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.633+0000 7fa020bfc700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa004003a60 0x7fa004003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa004004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004004d50 0x7fa0040051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ce0f0 con 0x7fa004004d50 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa00400ba60 con 0x7fa004003a60 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa00400bba0 con 0x7fa01c15a400 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004004d50 0x7fa0040051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0213fd700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa004004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa021bfe700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa004003a60 0x7fa004003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 -- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 msgr2=0x7fa004004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa01c15a400 0x7fa004004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 -- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa004003a60 msgr2=0x7fa004003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa004003a60 0x7fa004003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 -- 172.21.15.33:0/36157159 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa014009420 con 0x7fa004004d50 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa0223ff700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004004d50 0x7fa0040051c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa014009df0 tx=0x7fa0140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b28f428eec94504 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa014009740 con 0x7fa004004d50 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01400e8c0 con 0x7fa004004d50 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.634+0000 7fa020bfc700 1 -- 172.21.15.33:0/36157159 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01400ec80 con 0x7fa004004d50 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 -- 172.21.15.33:0/36157159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004004d50 msgr2=0x7fa0040051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 --2- 172.21.15.33:0/36157159 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa004004d50 0x7fa0040051c0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fa014009df0 tx=0x7fa0140091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa0223ff700 1 -- 172.21.15.33:0/36157159 reap_dead start 2023-10-09T15:36:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 -- 172.21.15.33:0/36157159 shutdown_connections 2023-10-09T15:36:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 -- 172.21.15.33:0/36157159 >> 172.21.15.33:0/36157159 conn(0x7fa01c070e30 msgr2=0x7fa01c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 -- 172.21.15.33:0/36157159 shutdown_connections 2023-10-09T15:36:27.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.635+0000 7fa023e62700 1 -- 172.21.15.33:0/36157159 wait complete. 2023-10-09T15:36:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.636+0000 7fa023e62700 1 Processor -- start 2023-10-09T15:36:27.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.636+0000 7fa023e62700 1 -- start start 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa004004d50 0x7fa01c0b0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 0x7fa01c16d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0ca730 con 0x7fa01c0c8e60 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0c9b20 con 0x7fa01c16ceb0 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa023e62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa01c0c9e00 con 0x7fa004004d50 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56372/0 (socket says 172.21.15.33:56372) 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 -- 172.21.15.33:0/1690345512 learned_addr learned my addr 172.21.15.33:0/1690345512 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa021bfe700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa004004d50 0x7fa01c0b0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0223ff700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 0x7fa01c16d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 -- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa004004d50 msgr2=0x7fa01c0b0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa004004d50 0x7fa01c0b0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 -- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 msgr2=0x7fa01c16d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 0x7fa01c16d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 -- 172.21.15.33:0/1690345512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa01c0ca0e0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0223ff700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 0x7fa01c16d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.637+0000 7fa0213fd700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa010011d70 tx=0x7fa0100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.638+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01000fcd0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.638+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa01000fe30 con 0x7fa01c0c8e60 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.638+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa01001d6d0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.638+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa01c0ca3c0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.638+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa01c0b0d80 con 0x7fa01c0c8e60 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.639+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa01c04c3c0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.639+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fa01001dac0 con 0x7fa01c0c8e60 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.640+0000 7fa019ffb700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 0x7fa008069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.640+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa010018070 con 0x7fa01c0c8e60 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.640+0000 7fa021bfe700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 0x7fa008069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.640+0000 7fa021bfe700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 0x7fa008069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00a100 tx=0x7fa00c006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:27.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.645+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa010052740 con 0x7fa01c0c8e60 2023-10-09T15:36:27.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.882+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa01c0d1610 con 0x7fa01c0c8e60 2023-10-09T15:36:27.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.882+0000 7fa019ffb700 1 -- 172.21.15.33:0/1690345512 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa010022070 con 0x7fa01c0c8e60 2023-10-09T15:36:27.883 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 msgr2=0x7fa008069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 0x7fa008069620 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa00c00a100 tx=0x7fa00c006040 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 msgr2=0x7fa01c0c92d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fa010011d70 tx=0x7fa0100091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 shutdown_connections 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa008067170 0x7fa008069620 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa01c16ceb0 0x7fa01c16d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa004004d50 0x7fa01c0b0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 --2- 172.21.15.33:0/1690345512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa01c0c8e60 0x7fa01c0c92d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.884+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 >> 172.21.15.33:0/1690345512 conn(0x7fa01c070e30 msgr2=0x7fa01c155510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:27.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.885+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 shutdown_connections 2023-10-09T15:36:27.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:27.885+0000 7fa023e62700 1 -- 172.21.15.33:0/1690345512 wait complete. 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:36:27.898 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:36:27.899 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:36:27.899 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:27.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:27.899 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:36:27.914 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:36:27.914 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:36:27.914 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:27.915 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42099sec preferred_lft 42099sec 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:36:27.916 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:27.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:27.918 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:36:27.978 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:36:27.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:27.980 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:36:28.036 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:36:28.036 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:36:28.036 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:36:28.036 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:36:28.036 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:36:28.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:36:28.037 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:36:28.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.139 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:36:28.153 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:36:28.154 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:36:28.154 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:28.154 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.154 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:36:28.219 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:28.219 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:28.274 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:28.275 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:28.275 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:28.329 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:36:28.329 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:36:28.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:28.410 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:28.410 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:28.410 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:28.419 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:28.419 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:28.419 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:28.419 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:28.419 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:28.441 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:28.441 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:36:28.442 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:36:28.444 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:36:28.444 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.444 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:28.510 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:36:28.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.670+0000 7f20827e6700 1 Processor -- start 2023-10-09T15:36:28.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.670+0000 7f20827e6700 1 -- start start 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f20827e6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f207c0cf110 0x7f207c164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f20827e6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c15afd0 con 0x7f207c15de50 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f20827e6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f207c15b2b0 con 0x7f207c153c30 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f20827e6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f207c15b590 con 0x7f207c0cf110 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f2081fe5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f207c0cf110 0x7f207c164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f2081fe5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f207c0cf110 0x7f207c164600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56386/0 (socket says 172.21.15.33:56386) 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f2081fe5700 1 -- 172.21.15.33:0/4140489590 learned_addr learned my addr 172.21.15.33:0/4140489590 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.671+0000 7f2080fe3700 1 --1- 172.21.15.33:0/4140489590 >> v1:172.21.15.33:6789/0 conn(0x7f207c15de50 0x7f207c0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51668/0 (socket says 172.21.15.33:51668) 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f2081fe5700 1 -- 172.21.15.33:0/4140489590 >> v1:172.21.15.59:6789/0 conn(0x7f207c153c30 legacy=0x7f207c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f2081fe5700 1 -- 172.21.15.33:0/4140489590 >> v1:172.21.15.33:6789/0 conn(0x7f207c15de50 legacy=0x7f207c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f2081fe5700 1 -- 172.21.15.33:0/4140489590 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f207c15b870 con 0x7f207c0cf110 2023-10-09T15:36:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f2081fe5700 1 --2- 172.21.15.33:0/4140489590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0cf110 0x7f207c164600 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f20740099b0 tx=0x7f2074009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cdd97a8dce4bcb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f207bfff700 1 -- 172.21.15.33:0/4140489590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400b860 con 0x7f207c0cf110 2023-10-09T15:36:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f207bfff700 1 -- 172.21.15.33:0/4140489590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207400b9c0 con 0x7f207c0cf110 2023-10-09T15:36:28.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f207bfff700 1 -- 172.21.15.33:0/4140489590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207400bd60 con 0x7f207c0cf110 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f20827e6700 1 -- 172.21.15.33:0/4140489590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0cf110 msgr2=0x7f207c164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f20827e6700 1 --2- 172.21.15.33:0/4140489590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0cf110 0x7f207c164600 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f20740099b0 tx=0x7f2074009250 comp rx=0 tx=0).stop 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f20827e6700 1 -- 172.21.15.33:0/4140489590 shutdown_connections 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f20827e6700 1 --2- 172.21.15.33:0/4140489590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c0cf110 0x7f207c164600 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.672+0000 7f20827e6700 1 -- 172.21.15.33:0/4140489590 >> 172.21.15.33:0/4140489590 conn(0x7f207c0703a0 msgr2=0x7f207c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.673+0000 7f20827e6700 1 -- 172.21.15.33:0/4140489590 shutdown_connections 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.673+0000 7f20827e6700 1 -- 172.21.15.33:0/4140489590 wait complete. 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.674+0000 7f20827e6700 1 Processor -- start 2023-10-09T15:36:28.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.674+0000 7f20827e6700 1 -- start start 2023-10-09T15:36:28.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.674+0000 7f20827e6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207c0cf110 0x7f207c0b4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.674+0000 7f20827e6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207c153c30 0x7f207c0b4c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.674+0000 7f20827e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20827e6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0b60a0 con 0x7f207c15de50 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20827e6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0b5490 con 0x7f207c153c30 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20827e6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f207c0b5770 con 0x7f207c0cf110 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56402/0 (socket says 172.21.15.33:56402) 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 -- 172.21.15.33:0/1154713955 learned_addr learned my addr 172.21.15.33:0/1154713955 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2080fe3700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207c153c30 0x7f207c0b4c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:28.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20817e4700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207c0cf110 0x7f207c0b4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 -- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207c0cf110 msgr2=0x7f207c0b4710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207c0cf110 0x7f207c0b4710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 -- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207c153c30 msgr2=0x7f207c0b4c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207c153c30 0x7f207c0b4c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 -- 172.21.15.33:0/1154713955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20740094f0 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f2081fe5700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f20740094c0 tx=0x7f2074017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207401a630 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207401a790 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c0b5a50 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207401ab50 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.675+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207c0b5190 con 0x7f207c15de50 2023-10-09T15:36:28.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.676+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207c04c3c0 con 0x7f207c15de50 2023-10-09T15:36:28.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.677+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f20740233e0 con 0x7f207c15de50 2023-10-09T15:36:28.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.677+0000 7f20797fa700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 0x7f2068069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:28.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.677+0000 7f20817e4700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 0x7f2068069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:28.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.677+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2074086470 con 0x7f207c15de50 2023-10-09T15:36:28.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.678+0000 7f20817e4700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 0x7f2068069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f206c007fd0 tx=0x7f206c0016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:28.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.682+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2074053450 con 0x7f207c15de50 2023-10-09T15:36:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.922+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f207c0b61e0 con 0x7f207c15de50 2023-10-09T15:36:28.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.922+0000 7f20797fa700 1 -- 172.21.15.33:0/1154713955 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v49) v1 ==== 53+0+73 (secure 0 0 0) 0x7f207c0b61e0 con 0x7f207c15de50 2023-10-09T15:36:28.923 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.924+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 msgr2=0x7f2068069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.924+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 0x7f2068069620 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f206c007fd0 tx=0x7f206c0016f0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.924+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 msgr2=0x7f207c0c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f20740094c0 tx=0x7f2074017000 comp rx=0 tx=0).stop 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 shutdown_connections 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2068067170 0x7f2068069620 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f207c15de50 0x7f207c0c93a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f207c0cf110 0x7f207c0b4710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 --2- 172.21.15.33:0/1154713955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f207c153c30 0x7f207c0b4c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 >> 172.21.15.33:0/1154713955 conn(0x7f207c0703a0 msgr2=0x7f207c06d790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 shutdown_connections 2023-10-09T15:36:28.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:28.925+0000 7f20827e6700 1 -- 172.21.15.33:0/1154713955 wait complete. 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:36:28.938 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:28.939 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.939 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:36:28.957 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:36:28.957 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:36:28.957 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:36:28.958 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42107sec preferred_lft 42107sec 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.959 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:36:28.960 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:28.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:28.961 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:36:29.026 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:36:29.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:29.028 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:36:29.087 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:36:29.087 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:36:29.087 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:36:29.087 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:36:29.087 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:36:29.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:36:29.088 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:36:29.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:29.195 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:36:29.211 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:36:29.211 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:36:29.211 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:29.211 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:29.211 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:36:29.278 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:29.278 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:29.334 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:29.334 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:29.334 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:29.389 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:36:29.390 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:36:29.390 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:29.471 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:29.471 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:29.471 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:29.479 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:29.480 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:29.480 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:29.480 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:29.480 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:29.501 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:29.501 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:29.501 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:29.501 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:29.502 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:29.502 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:36:29.502 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:36:29.502 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:36:29.504 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:36:29.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:29.504 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:29.569 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:36:29.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.700+0000 7f84efa5a700 1 Processor -- start 2023-10-09T15:36:29.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 -- start start 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84e8159530 0x7f84e80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e806dcf0 0x7f84e8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84e8159e40 0x7f84e80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e80ccfd0 con 0x7f84e8159e40 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84e815a410 con 0x7f84e8159530 2023-10-09T15:36:29.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.701+0000 7f84efa5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815a6f0 con 0x7f84e806dcf0 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84e8159e40 0x7f84e80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84e8159e40 0x7f84e80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56410/0 (socket says 172.21.15.33:56410) 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 -- 172.21.15.33:0/301795286 learned_addr learned my addr 172.21.15.33:0/301795286 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84ed7f6700 1 --2- 172.21.15.33:0/301795286 >> v2:172.21.15.59:3300/0 conn(0x7f84e8159530 0x7f84e80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84ecff5700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e806dcf0 0x7f84e8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 -- 172.21.15.33:0/301795286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e806dcf0 msgr2=0x7f84e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e806dcf0 0x7f84e8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 -- 172.21.15.33:0/301795286 >> v2:172.21.15.59:3300/0 conn(0x7f84e8159530 msgr2=0x7f84e80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 --2- 172.21.15.33:0/301795286 >> v2:172.21.15.59:3300/0 conn(0x7f84e8159530 0x7f84e80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 -- 172.21.15.33:0/301795286 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e815a9d0 con 0x7f84e8159e40 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84edff7700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80cb6f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f84e806d630 tx=0x7f84e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80770e720ed0d245 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:29.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84e7fff700 1 -- 172.21.15.33:0/301795286 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000b640 con 0x7f84e8159e40 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84e7fff700 1 -- 172.21.15.33:0/301795286 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e000b7a0 con 0x7f84e8159e40 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.702+0000 7f84e7fff700 1 -- 172.21.15.33:0/301795286 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e000bb60 con 0x7f84e8159e40 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 -- 172.21.15.33:0/301795286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 msgr2=0x7f84e80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80cb6f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f84e806d630 tx=0x7f84e0009250 comp rx=0 tx=0).stop 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 -- 172.21.15.33:0/301795286 shutdown_connections 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 --2- 172.21.15.33:0/301795286 >> v2:172.21.15.59:3300/0 conn(0x7f84e8159530 0x7f84e80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80cb6f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 --2- 172.21.15.33:0/301795286 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e806dcf0 0x7f84e8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 -- 172.21.15.33:0/301795286 >> 172.21.15.33:0/301795286 conn(0x7f84e80703a0 msgr2=0x7f84e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 -- 172.21.15.33:0/301795286 shutdown_connections 2023-10-09T15:36:29.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.703+0000 7f84efa5a700 1 -- 172.21.15.33:0/301795286 wait complete. 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.704+0000 7f84efa5a700 1 Processor -- start 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.704+0000 7f84efa5a700 1 -- start start 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 0x7f84e8157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8159530 0x7f84e80c8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815b980 con 0x7f84e8159e40 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815b050 con 0x7f84e806dcf0 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84efa5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84e815b330 con 0x7f84e8159530 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56418/0 (socket says 172.21.15.33:56418) 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 -- 172.21.15.33:0/1629766110 learned_addr learned my addr 172.21.15.33:0/1629766110 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84ed7f6700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 0x7f84e8157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84ecff5700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8159530 0x7f84e80c8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 -- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8159530 msgr2=0x7f84e80c8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8159530 0x7f84e80c8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 -- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 msgr2=0x7f84e8157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 0x7f84e8157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:29.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 -- 172.21.15.33:0/1629766110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e00094f0 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84ed7f6700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 0x7f84e8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.705+0000 7f84edff7700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f84e00094c0 tx=0x7f84e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.706+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0011420 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.706+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e00115c0 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.706+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84e815b610 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.706+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0011980 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.706+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84e8157690 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.707+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84e815baf0 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.707+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f84e0011cf0 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.708+0000 7f84e57fa700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 0x7f84d4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.708+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84e0085d50 con 0x7f84e8159e40 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.708+0000 7f84ed7f6700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 0x7f84d4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:29.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.708+0000 7f84ed7f6700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 0x7f84d4069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f84d80076c0 tx=0x7f84d800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:29.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.712+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f84e0089030 con 0x7f84e8159e40 2023-10-09T15:36:29.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:29.952+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f84e804c3c0 con 0x7f84e8159e40 2023-10-09T15:36:30.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.264+0000 7f84e57fa700 1 -- 172.21.15.33:0/1629766110 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v50) v1 ==== 136+0+0 (secure 0 0 0) 0x7f84e0052e60 con 0x7f84e8159e40 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 msgr2=0x7f84d4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 0x7f84d4069620 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f84d80076c0 tx=0x7f84d800b040 comp rx=0 tx=0).stop 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 msgr2=0x7f84e80b3fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f84e00094c0 tx=0x7f84e0017000 comp rx=0 tx=0).stop 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 shutdown_connections 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f84d4067170 0x7f84d4069620 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84e8159e40 0x7f84e80b3fe0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84e806dcf0 0x7f84e8157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 --2- 172.21.15.33:0/1629766110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84e8159530 0x7f84e80c8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 >> 172.21.15.33:0/1629766110 conn(0x7f84e80703a0 msgr2=0x7f84e80c58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 shutdown_connections 2023-10-09T15:36:30.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.267+0000 7f84efa5a700 1 -- 172.21.15.33:0/1629766110 wait complete. 2023-10-09T15:36:30.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:36:30.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.401+0000 7f2d9025c700 1 Processor -- start 2023-10-09T15:36:30.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.401+0000 7f2d9025c700 1 -- start start 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d9025c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d881598b0 0x7f2d880af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d9025c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2d88159c80 0x7f2d880cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d9025c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d880ce9d0 con 0x7f2d880af790 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d9025c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d880afc30 con 0x7f2d881598b0 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d9025c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d880aff10 con 0x7f2d88159c80 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d8dff8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d881598b0 0x7f2d880af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d8dff8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2d881598b0 0x7f2d880af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56430/0 (socket says 172.21.15.33:56430) 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.402+0000 7f2d8dff8700 1 -- 172.21.15.33:0/138811104 learned_addr learned my addr 172.21.15.33:0/138811104 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8d7f7700 1 --2- 172.21.15.33:0/138811104 >> v2:172.21.15.59:3300/0 conn(0x7f2d88159c80 0x7f2d880cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8dff8700 1 -- 172.21.15.33:0/138811104 >> v2:172.21.15.59:3300/0 conn(0x7f2d88159c80 msgr2=0x7f2d880cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8dff8700 1 --2- 172.21.15.33:0/138811104 >> v2:172.21.15.59:3300/0 conn(0x7f2d88159c80 0x7f2d880cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8dff8700 1 -- 172.21.15.33:0/138811104 >> v1:172.21.15.59:6789/0 conn(0x7f2d880af790 legacy=0x7f2d880cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8dff8700 1 -- 172.21.15.33:0/138811104 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d880ce380 con 0x7f2d881598b0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8dff8700 1 --2- 172.21.15.33:0/138811104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d881598b0 0x7f2d880af250 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2d880642b0 tx=0x7f2d78009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a33702ca5456e0ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8cff6700 1 -- 172.21.15.33:0/138811104 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d7800e070 con 0x7f2d881598b0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8cff6700 1 -- 172.21.15.33:0/138811104 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d7800ba50 con 0x7f2d881598b0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.403+0000 7f2d8cff6700 1 -- 172.21.15.33:0/138811104 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d780092e0 con 0x7f2d881598b0 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 -- 172.21.15.33:0/138811104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d881598b0 msgr2=0x7f2d880af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 --2- 172.21.15.33:0/138811104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d881598b0 0x7f2d880af250 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f2d880642b0 tx=0x7f2d78009840 comp rx=0 tx=0).stop 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 -- 172.21.15.33:0/138811104 shutdown_connections 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 --2- 172.21.15.33:0/138811104 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d881598b0 0x7f2d880af250 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 --2- 172.21.15.33:0/138811104 >> v2:172.21.15.59:3300/0 conn(0x7f2d88159c80 0x7f2d880cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 -- 172.21.15.33:0/138811104 >> 172.21.15.33:0/138811104 conn(0x7f2d88070e30 msgr2=0x7f2d880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 -- 172.21.15.33:0/138811104 shutdown_connections 2023-10-09T15:36:30.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.404+0000 7f2d9025c700 1 -- 172.21.15.33:0/138811104 wait complete. 2023-10-09T15:36:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.405+0000 7f2d9025c700 1 Processor -- start 2023-10-09T15:36:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.405+0000 7f2d9025c700 1 -- start start 2023-10-09T15:36:30.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d880af790 0x7f2d88153e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d881598b0 0x7f2d880c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88156160 con 0x7f2d88159c80 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88156440 con 0x7f2d880af790 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d88156720 con 0x7f2d881598b0 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56432/0 (socket says 172.21.15.33:56432) 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8dff8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d880af790 0x7f2d88153e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 -- 172.21.15.33:0/2542924845 learned_addr learned my addr 172.21.15.33:0/2542924845 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8d7f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d881598b0 0x7f2d880c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 -- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d881598b0 msgr2=0x7f2d880c9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d881598b0 0x7f2d880c9460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 -- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d880af790 msgr2=0x7f2d88153e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d880af790 0x7f2d88153e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 -- 172.21.15.33:0/2542924845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d78009ae0 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d8e7f9700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c590 tx=0x7f2d80007ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80011590 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d800116f0 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d88156a00 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.406+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d80011ab0 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.407+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d88154360 con 0x7f2d88159c80 2023-10-09T15:36:30.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.408+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d88156f20 con 0x7f2d88159c80 2023-10-09T15:36:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.408+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f2d8001b3b0 con 0x7f2d88159c80 2023-10-09T15:36:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.408+0000 7f2d85ffb700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 0x7f2d74069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.409+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2d80083cb0 con 0x7f2d88159c80 2023-10-09T15:36:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.409+0000 7f2d8dff8700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 0x7f2d74069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.409+0000 7f2d8dff8700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 0x7f2d74069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009880 tx=0x7f2d78018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.413+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2d88156f20 con 0x7f2d88159c80 2023-10-09T15:36:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.637+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f2d880b3a70 con 0x7f2d74067170 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.638+0000 7f2d85ffb700 1 -- 172.21.15.33:0/2542924845 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f2d880b3a70 con 0x7f2d74067170 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:30.639 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:36:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 msgr2=0x7f2d74069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 0x7f2d74069620 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f2d78009880 tx=0x7f2d78018000 comp rx=0 tx=0).stop 2023-10-09T15:36:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 msgr2=0x7f2d880c54b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f2d8000c590 tx=0x7f2d80007ec0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 shutdown_connections 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2d74067170 0x7f2d74069620 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2d88159c80 0x7f2d880c54b0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2d880af790 0x7f2d88153e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 --2- 172.21.15.33:0/2542924845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2d881598b0 0x7f2d880c9460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 >> 172.21.15.33:0/2542924845 conn(0x7f2d88070e30 msgr2=0x7f2d880cad30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 shutdown_connections 2023-10-09T15:36:30.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.640+0000 7f2d9025c700 1 -- 172.21.15.33:0/2542924845 wait complete. 2023-10-09T15:36:30.653 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:36:30.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.774+0000 7f2307d3e700 1 Processor -- start 2023-10-09T15:36:30.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 -- start start 2023-10-09T15:36:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f23000ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f230006dc70 0x7f2300159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23000ccfd0 con 0x7f230006e0e0 2023-10-09T15:36:30.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23000cf0e0 con 0x7f230006dc70 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.775+0000 7f2307d3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230015a3d0 con 0x7f2300159530 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f230006dc70 0x7f2300159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f230006dc70 0x7f2300159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35030/0 (socket says 172.21.15.33:35030) 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 -- 172.21.15.33:0/2483466273 learned_addr learned my addr 172.21.15.33:0/2483466273 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f2305ada700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f23000ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 -- 172.21.15.33:0/2483466273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 msgr2=0x7f23000ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f23000ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 -- 172.21.15.33:0/2483466273 >> v1:172.21.15.59:6789/0 conn(0x7f230006e0e0 legacy=0x7f23000cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 -- 172.21.15.33:0/2483466273 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f230015a6b0 con 0x7f230006dc70 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f23052d9700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006dc70 0x7f2300159900 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f22f40099b0 tx=0x7f22f4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e9ca7d843368ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f2304ad8700 1 -- 172.21.15.33:0/2483466273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400b860 con 0x7f230006dc70 2023-10-09T15:36:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f2304ad8700 1 -- 172.21.15.33:0/2483466273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f400b9c0 con 0x7f230006dc70 2023-10-09T15:36:30.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.776+0000 7f2304ad8700 1 -- 172.21.15.33:0/2483466273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f400bd60 con 0x7f230006dc70 2023-10-09T15:36:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 -- 172.21.15.33:0/2483466273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006dc70 msgr2=0x7f2300159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006dc70 0x7f2300159900 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f22f40099b0 tx=0x7f22f4009250 comp rx=0 tx=0).stop 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 -- 172.21.15.33:0/2483466273 shutdown_connections 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f23000ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 --2- 172.21.15.33:0/2483466273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006dc70 0x7f2300159900 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 -- 172.21.15.33:0/2483466273 >> 172.21.15.33:0/2483466273 conn(0x7f23000703a0 msgr2=0x7f23000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 -- 172.21.15.33:0/2483466273 shutdown_connections 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.777+0000 7f2307d3e700 1 -- 172.21.15.33:0/2483466273 wait complete. 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.778+0000 7f2307d3e700 1 Processor -- start 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.778+0000 7f2307d3e700 1 -- start start 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230006dc70 0x7f23000ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f230014fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c8b30 con 0x7f230006e0e0 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23000c8240 con 0x7f230006dc70 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2307d3e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f230014d820 con 0x7f2300159530 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35042/0 (socket says 172.21.15.33:35042) 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 -- 172.21.15.33:0/3021448476 learned_addr learned my addr 172.21.15.33:0/3021448476 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f2305ada700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230006dc70 0x7f23000ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23062db700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f230014fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 -- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 msgr2=0x7f230014fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f230014fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 -- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230006dc70 msgr2=0x7f23000ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230006dc70 0x7f23000ca190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 -- 172.21.15.33:0/3021448476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22f40094f0 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23062db700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f230014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.779+0000 7f23052d9700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2300089650 tx=0x7f22f4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.780+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4024440 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.780+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22f40245c0 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.780+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23000c84e0 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.780+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22f4024980 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.780+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23000ca770 con 0x7f230006e0e0 2023-10-09T15:36:30.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.781+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f230004c3c0 con 0x7f230006e0e0 2023-10-09T15:36:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.781+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f22f401a420 con 0x7f230006e0e0 2023-10-09T15:36:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.782+0000 7f22fdffb700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 0x7f22ec069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.782+0000 7f2305ada700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 0x7f22ec069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.782+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f22f4086610 con 0x7f230006e0e0 2023-10-09T15:36:30.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.782+0000 7f2305ada700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 0x7f22ec069620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007460 tx=0x7f22f800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:30.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.786+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f22f40535f0 con 0x7f230006e0e0 2023-10-09T15:36:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.979+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f230015a990 con 0x7f230006e0e0 2023-10-09T15:36:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.979+0000 7f22fdffb700 1 -- 172.21.15.33:0/3021448476 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7f22f4056c10 con 0x7f230006e0e0 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 msgr2=0x7f22ec069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 0x7f22ec069620 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f22f8007460 tx=0x7f22f800b040 comp rx=0 tx=0).stop 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 msgr2=0x7f230014d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f2300089650 tx=0x7f22f4017000 comp rx=0 tx=0).stop 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 shutdown_connections 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f22ec067170 0x7f22ec069620 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2300159530 0x7f230014fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f230006dc70 0x7f23000ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 --2- 172.21.15.33:0/3021448476 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f230006e0e0 0x7f230014d2e0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:30.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.981+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 >> 172.21.15.33:0/3021448476 conn(0x7f23000703a0 msgr2=0x7f23000b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:30.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.982+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 shutdown_connections 2023-10-09T15:36:30.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:30.982+0000 7f2307d3e700 1 -- 172.21.15.33:0/3021448476 wait complete. 2023-10-09T15:36:30.996 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create cephfs group_0000000000409951 2023-10-09T15:36:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.118+0000 7f9e3b59e700 1 Processor -- start 2023-10-09T15:36:31.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.118+0000 7f9e3b59e700 1 -- start start 2023-10-09T15:36:31.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3b59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9e3c153a00 0x7f9e3c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9e3c15de50 0x7f9e3c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3b59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3c15af60 con 0x7f9e3c0cea00 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3b59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c15d010 con 0x7f9e3c153a00 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3c15b240 con 0x7f9e3c15de50 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9e3c153a00 0x7f9e3c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9e3c153a00 0x7f9e3c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35058/0 (socket says 172.21.15.33:35058) 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 -- 172.21.15.33:0/3050456324 learned_addr learned my addr 172.21.15.33:0/3050456324 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3ad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9e3c0cea00 0x7f9e3c0cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43050/0 (socket says 172.21.15.33:43050) 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e39d9b700 1 --2- 172.21.15.33:0/3050456324 >> v2:172.21.15.59:3300/0 conn(0x7f9e3c15de50 0x7f9e3c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 -- 172.21.15.33:0/3050456324 >> v2:172.21.15.59:3300/0 conn(0x7f9e3c15de50 msgr2=0x7f9e3c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 --2- 172.21.15.33:0/3050456324 >> v2:172.21.15.59:3300/0 conn(0x7f9e3c15de50 0x7f9e3c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 -- 172.21.15.33:0/3050456324 >> v1:172.21.15.33:6789/0 conn(0x7f9e3c0cea00 legacy=0x7f9e3c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3a59c700 1 -- 172.21.15.33:0/3050456324 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e3c15b520 con 0x7f9e3c153a00 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.119+0000 7f9e3959a700 1 -- 172.21.15.33:0/3050456324 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312495585 0 0) 0x7f9e3c15af60 con 0x7f9e3c0cea00 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3a59c700 1 --2- 172.21.15.33:0/3050456324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c153a00 0x7f9e3c153dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0b3070 tx=0x7f9e2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48af3df2af5c50c0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3959a700 1 -- 172.21.15.33:0/3050456324 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c00e070 con 0x7f9e3c153a00 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3959a700 1 -- 172.21.15.33:0/3050456324 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2c00ba20 con 0x7f9e3c153a00 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3959a700 1 -- 172.21.15.33:0/3050456324 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2c0092e0 con 0x7f9e3c153a00 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3050456324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c153a00 msgr2=0x7f9e3c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3050456324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c153a00 0x7f9e3c153dd0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f9e3c0b3070 tx=0x7f9e2c009840 comp rx=0 tx=0).stop 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3050456324 shutdown_connections 2023-10-09T15:36:31.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3050456324 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c153a00 0x7f9e3c153dd0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3050456324 >> v2:172.21.15.59:3300/0 conn(0x7f9e3c15de50 0x7f9e3c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3050456324 >> 172.21.15.33:0/3050456324 conn(0x7f9e3c0703a0 msgr2=0x7f9e3c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:31.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3050456324 shutdown_connections 2023-10-09T15:36:31.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.120+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3050456324 wait complete. 2023-10-09T15:36:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.121+0000 7f9e3b59e700 1 Processor -- start 2023-10-09T15:36:31.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.121+0000 7f9e3b59e700 1 -- start start 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e3c0cea00 0x7f9e3c0c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e3c153a00 0x7f9e3c14add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c14b5d0 con 0x7f9e3c15de50 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c14fc60 con 0x7f9e3c153a00 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3c150150 con 0x7f9e3c0cea00 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35074/0 (socket says 172.21.15.33:35074) 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3ad9d700 1 -- 172.21.15.33:0/3701233998 learned_addr learned my addr 172.21.15.33:0/3701233998 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e39d9b700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e3c153a00 0x7f9e3c14add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.122+0000 7f9e3a59c700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e3c0cea00 0x7f9e3c0c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 -- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e3c0cea00 msgr2=0x7f9e3c0c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e3c0cea00 0x7f9e3c0c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 -- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e3c153a00 msgr2=0x7f9e3c14add0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e3c153a00 0x7f9e3c14add0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 -- 172.21.15.33:0/3701233998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c009ae0 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3ad9d700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c530 tx=0x7f9e34007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e34005a70 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e34005bd0 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3c0c5ac0 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e340070d0 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.123+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e3c0c5470 con 0x7f9e3c15de50 2023-10-09T15:36:31.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.124+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3c0c5c50 con 0x7f9e3c15de50 2023-10-09T15:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.124+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f9e34007440 con 0x7f9e3c15de50 2023-10-09T15:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.125+0000 7f9e327fc700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 0x7f9e1c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.125+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9e34083bc0 con 0x7f9e3c15de50 2023-10-09T15:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.125+0000 7f9e3a59c700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 0x7f9e1c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.125+0000 7f9e3a59c700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 0x7f9e1c069620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009880 tx=0x7f9e2c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.129+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e34050ba0 con 0x7f9e3c15de50 2023-10-09T15:36:31.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.353+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "group_0000000000409951", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e3c04c3c0 con 0x7f9e1c067170 2023-10-09T15:36:31.358 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:31.358+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:31.359 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:31.358+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:31.359 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:31.358+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:31.359 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:31.358+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:31.359 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:31.358+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:31.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.374+0000 7f9e327fc700 1 -- 172.21.15.33:0/3701233998 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f9e3c04c3c0 con 0x7f9e1c067170 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.375+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 msgr2=0x7f9e1c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.375+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 0x7f9e1c069620 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f9e2c009880 tx=0x7f9e2c018000 comp rx=0 tx=0).stop 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.375+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 msgr2=0x7f9e3c14f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.375+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f9e3400c530 tx=0x7f9e34007f90 comp rx=0 tx=0).stop 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 shutdown_connections 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e1c067170 0x7f9e1c069620 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e3c15de50 0x7f9e3c14f720 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e3c0cea00 0x7f9e3c0c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 --2- 172.21.15.33:0/3701233998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e3c153a00 0x7f9e3c14add0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 >> 172.21.15.33:0/3701233998 conn(0x7f9e3c0703a0 msgr2=0x7f9e3c158d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:31.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 shutdown_connections 2023-10-09T15:36:31.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.376+0000 7f9e3b59e700 1 -- 172.21.15.33:0/3701233998 wait complete. 2023-10-09T15:36:31.389 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-09T15:36:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.510+0000 7f0e49e41700 1 Processor -- start 2023-10-09T15:36:31.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.510+0000 7f0e49e41700 1 -- start start 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e49e41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0e4406dc70 0x7f0e44159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e49e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e440cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e49e41700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e440ccfd0 con 0x7f0e44159530 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e49e41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e4415a3d0 con 0x7f0e4406dc70 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e49e41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415a6b0 con 0x7f0e4406e0e0 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e437fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0e44159530 0x7f0e440ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43054/0 (socket says 172.21.15.33:43054) 2023-10-09T15:36:31.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e437fe700 1 -- 172.21.15.33:0/2293450387 learned_addr learned my addr 172.21.15.33:0/2293450387 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e440cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e42ffd700 1 --2- 172.21.15.33:0/2293450387 >> v2:172.21.15.59:3300/0 conn(0x7f0e4406dc70 0x7f0e44159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.511+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 963734039 0 0) 0x7f0e440ccfd0 con 0x7f0e44159530 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e2c003570 con 0x7f0e44159530 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 924600436 0 0) 0x7f0e2c003570 con 0x7f0e44159530 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 msgr2=0x7f0e440cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e440cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 >> v2:172.21.15.59:3300/0 conn(0x7f0e4406dc70 msgr2=0x7f0e44159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 --2- 172.21.15.33:0/2293450387 >> v2:172.21.15.59:3300/0 conn(0x7f0e4406dc70 0x7f0e44159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4415a990 con 0x7f0e44159530 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0e34001470 con 0x7f0e44159530 2023-10-09T15:36:31.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 >> v1:172.21.15.33:6789/0 conn(0x7f0e44159530 legacy=0x7f0e440ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2c003a60 0x7f0e2c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c004810 0x7f0e2c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e2c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415a3d0 con 0x7f0e2c003a60 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e4415a6b0 con 0x7f0e2c004810 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e2c014270 con 0x7f0e4406e0e0 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e2c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e42ffd700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c004810 0x7f0e2c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.512+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2c003a60 0x7f0e2c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 -- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 msgr2=0x7f0e2c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:31.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e2c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 -- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c004810 msgr2=0x7f0e2c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c004810 0x7f0e2c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 -- 172.21.15.33:0/2293450387 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e4415a990 con 0x7f0e2c003a60 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e4406e0e0 0x7f0e2c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e42ffd700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c004810 0x7f0e2c004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2c003a60 0x7f0e2c003e70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c460 tx=0x7f0e340079d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7116227a840c6327 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3400cd50 con 0x7f0e2c003a60 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e34005920 con 0x7f0e2c003a60 2023-10-09T15:36:31.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.513+0000 7f0e427fc700 1 -- 172.21.15.33:0/2293450387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e34005cc0 con 0x7f0e2c003a60 2023-10-09T15:36:31.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 -- 172.21.15.33:0/2293450387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2c003a60 msgr2=0x7f0e2c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2293450387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2c003a60 0x7f0e2c003e70 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f0e3400c460 tx=0x7f0e340079d0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e43fff700 1 -- 172.21.15.33:0/2293450387 reap_dead start 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 -- 172.21.15.33:0/2293450387 shutdown_connections 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 -- 172.21.15.33:0/2293450387 >> 172.21.15.33:0/2293450387 conn(0x7f0e440703a0 msgr2=0x7f0e440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 -- 172.21.15.33:0/2293450387 shutdown_connections 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.514+0000 7f0e49e41700 1 -- 172.21.15.33:0/2293450387 wait complete. 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.515+0000 7f0e49e41700 1 Processor -- start 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.515+0000 7f0e49e41700 1 -- start start 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c003a60 0x7f0e44154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 0x7f0e44165730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44155fa0 con 0x7f0e44165c70 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e44157bb0 con 0x7f0e2c003a60 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e440b3f30 con 0x7f0e440c9a70 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35118/0 (socket says 172.21.15.33:35118) 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 -- 172.21.15.33:0/2209726615 learned_addr learned my addr 172.21.15.33:0/2209726615 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c003a60 0x7f0e44154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e42ffd700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 0x7f0e44165730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 -- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 msgr2=0x7f0e44165730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 0x7f0e44165730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 -- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c003a60 msgr2=0x7f0e44154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c003a60 0x7f0e44154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 -- 172.21.15.33:0/2209726615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e440b4210 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e42ffd700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 0x7f0e44165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e43fff700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0e440cf2d0 tx=0x7f0e3c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c00e040 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e3c00f040 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.516+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e440b44f0 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.517+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e3c015430 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.517+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e440c9ee0 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.517+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e4404c3c0 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.518+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f0e3c015860 con 0x7f0e44165c70 2023-10-09T15:36:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.518+0000 7f0e2b7fe700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 0x7f0e30069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.518+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e3c084bb0 con 0x7f0e44165c70 2023-10-09T15:36:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.518+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 0x7f0e30069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.519+0000 7f0e437fe700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 0x7f0e30069620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0e34007a10 tx=0x7f0e34015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.523+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e3c0519e0 con 0x7f0e44165c70 2023-10-09T15:36:31.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.743+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f0e4415ac70 con 0x7f0e30067170 2023-10-09T15:36:31.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.745+0000 7f0e2b7fe700 1 -- 172.21.15.33:0/2209726615 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+532 (secure 0 0 0) 0x7f0e4415ac70 con 0x7f0e30067170 2023-10-09T15:36:31.746 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:31.746 INFO:teuthology.orchestra.run.smithi033.stdout: "mon_addrs": [ 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.33:6789", 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6789", 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6790" 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "pending_subvolume_deletions": 0, 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "pools": { 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "data": [ 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": " 340G", 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_data", 2023-10-09T15:36:31.747 INFO:teuthology.orchestra.run.smithi033.stdout: "used": " 0 " 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": [ 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": " 340G", 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_metadata", 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: "used": "64.0k" 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout: "used_size": " 0 " 2023-10-09T15:36:31.748 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 msgr2=0x7f0e30069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 0x7f0e30069620 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f0e34007a10 tx=0x7f0e34015000 comp rx=0 tx=0).stop 2023-10-09T15:36:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 msgr2=0x7f0e440b4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:31.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f0e440cf2d0 tx=0x7f0e3c00b040 comp rx=0 tx=0).stop 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 shutdown_connections 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e30067170 0x7f0e30069620 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e44165c70 0x7f0e440b4cf0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e2c003a60 0x7f0e44154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 --2- 172.21.15.33:0/2209726615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e440c9a70 0x7f0e44165730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 >> 172.21.15.33:0/2209726615 conn(0x7f0e440703a0 msgr2=0x7f0e4415af20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 shutdown_connections 2023-10-09T15:36:31.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:31.747+0000 7f0e49e41700 1 -- 172.21.15.33:0/2209726615 wait complete. 2023-10-09T15:36:31.760 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:36:31.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:31.800 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:31.852 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:36:31.852 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:36:31.853 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:31.853 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:31.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:36:31.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:31.888 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:36:31.943 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:36:31.943 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:31.943 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:31.996 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:36:31.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:31.997 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:36:32.013 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:32.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.131+0000 7febbfcd1700 1 Processor -- start 2023-10-09T15:36:32.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 -- start start 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7febb80cb970 0x7febb8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7febb815a400 0x7febb8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febb815ae40 con 0x7febb80cb5a0 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80ce0f0 con 0x7febb815a400 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbfcd1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febb80d13f0 con 0x7febb80cb970 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbda6d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7febb80cb5a0 0x7febb80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43066/0 (socket says 172.21.15.33:43066) 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbda6d700 1 -- 172.21.15.33:0/2413211876 learned_addr learned my addr 172.21.15.33:0/2413211876 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:32.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.132+0000 7febbe26e700 1 --2- 172.21.15.33:0/2413211876 >> v2:172.21.15.33:3300/0 conn(0x7febb815a400 0x7febb8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbd26c700 1 --2- 172.21.15.33:0/2413211876 >> v2:172.21.15.59:3300/0 conn(0x7febb80cb970 0x7febb8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbca6b700 1 -- 172.21.15.33:0/2413211876 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3001861930 0 0) 0x7febb815ae40 con 0x7febb80cb5a0 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbca6b700 1 -- 172.21.15.33:0/2413211876 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feba0003570 con 0x7febb80cb5a0 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbe26e700 1 -- 172.21.15.33:0/2413211876 >> v2:172.21.15.59:3300/0 conn(0x7febb80cb970 msgr2=0x7febb8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbe26e700 1 --2- 172.21.15.33:0/2413211876 >> v2:172.21.15.59:3300/0 conn(0x7febb80cb970 0x7febb8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbe26e700 1 -- 172.21.15.33:0/2413211876 >> v1:172.21.15.33:6789/0 conn(0x7febb80cb5a0 legacy=0x7febb80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbe26e700 1 -- 172.21.15.33:0/2413211876 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febb815ab60 con 0x7febb815a400 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbe26e700 1 --2- 172.21.15.33:0/2413211876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb815a400 0x7febb8156e90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7febb80d1780 tx=0x7feba8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4653367fe8f28fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbca6b700 1 -- 172.21.15.33:0/2413211876 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba800e070 con 0x7febb815a400 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbca6b700 1 -- 172.21.15.33:0/2413211876 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feba800bab0 con 0x7febb815a400 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.133+0000 7febbca6b700 1 -- 172.21.15.33:0/2413211876 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feba800be70 con 0x7febb815a400 2023-10-09T15:36:32.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 -- 172.21.15.33:0/2413211876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb815a400 msgr2=0x7febb8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2413211876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb815a400 0x7febb8156e90 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7febb80d1780 tx=0x7feba8009780 comp rx=0 tx=0).stop 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 -- 172.21.15.33:0/2413211876 shutdown_connections 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2413211876 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb815a400 0x7febb8156e90 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2413211876 >> v2:172.21.15.59:3300/0 conn(0x7febb80cb970 0x7febb8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 -- 172.21.15.33:0/2413211876 >> 172.21.15.33:0/2413211876 conn(0x7febb8070e30 msgr2=0x7febb80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 -- 172.21.15.33:0/2413211876 shutdown_connections 2023-10-09T15:36:32.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.134+0000 7febbfcd1700 1 -- 172.21.15.33:0/2413211876 wait complete. 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.135+0000 7febbfcd1700 1 Processor -- start 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.135+0000 7febbfcd1700 1 -- start start 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 0x7febb815da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 0x7febb815b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb815be60 con 0x7febb80cb970 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febb80b4670 con 0x7febb80cb5a0 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febb815c100 con 0x7febb815a400 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35142/0 (socket says 172.21.15.33:35142) 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 -- 172.21.15.33:0/2147860367 learned_addr learned my addr 172.21.15.33:0/2147860367 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbda6d700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 0x7febb815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbe26e700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 0x7febb815b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 -- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 msgr2=0x7febb815b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 0x7febb815b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 -- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 msgr2=0x7febb815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 0x7febb815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 -- 172.21.15.33:0/2147860367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feba8009a20 con 0x7febb80cb970 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbe26e700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 0x7febb815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbda6d700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 0x7febb815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbd26c700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7febac00ec80 tx=0x7febac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac00c9d0 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febac00cb30 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febb815c3e0 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.136+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febac013470 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.137+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febb815e000 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.138+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febb80b4890 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.138+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7febac013820 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.138+0000 7febb5ffb700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 0x7feba4069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.138+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7febac084c10 con 0x7febb80cb970 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.139+0000 7febbda6d700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 0x7feba4069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.139+0000 7febbda6d700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 0x7feba4069620 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febb00058d0 tx=0x7febb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.143+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7febb80b4890 con 0x7febb80cb970 2023-10-09T15:36:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.383+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7febb80b4830 con 0x7febb80cb970 2023-10-09T15:36:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.384+0000 7febb5ffb700 1 -- 172.21.15.33:0/2147860367 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7febac051bf0 con 0x7febb80cb970 2023-10-09T15:36:32.385 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:32.385 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:32.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 msgr2=0x7feba4069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 0x7feba4069620 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7febb00058d0 tx=0x7febb0009040 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 msgr2=0x7febb80c9d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7febac00ec80 tx=0x7febac0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 shutdown_connections 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feba4067170 0x7feba4069620 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7febb815a400 0x7febb815b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7febb80cb5a0 0x7febb815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 --2- 172.21.15.33:0/2147860367 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7febb80cb970 0x7febb80c9d60 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 >> 172.21.15.33:0/2147860367 conn(0x7febb8070e30 msgr2=0x7febb80b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 shutdown_connections 2023-10-09T15:36:32.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.386+0000 7febbfcd1700 1 -- 172.21.15.33:0/2147860367 wait complete. 2023-10-09T15:36:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 50 2023-10-09T15:36:32.400 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.518+0000 7f3dbaa50700 1 Processor -- start 2023-10-09T15:36:32.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.518+0000 7f3dbaa50700 1 -- start start 2023-10-09T15:36:32.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dbaa50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3db40cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dbaa50700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3db415a8c0 0x7f3db406d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dbaa50700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db40cec30 con 0x7f3db406ddd0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dbaa50700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db406e220 con 0x7f3db415a8c0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dbaa50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40ce930 con 0x7f3db40b2980 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dba24f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3db406ddd0 0x7f3db415d280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43070/0 (socket says 172.21.15.33:43070) 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3dba24f700 1 -- 172.21.15.33:0/753014762 learned_addr learned my addr 172.21.15.33:0/753014762 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3db40cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3db924d700 1 --2- 172.21.15.33:0/753014762 >> v2:172.21.15.59:3300/0 conn(0x7f3db415a8c0 0x7f3db406d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1022319488 0 0) 0x7f3db40cec30 con 0x7f3db406ddd0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.519+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3d9c003570 con 0x7f3db406ddd0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2031421093 0 0) 0x7f3d9c003570 con 0x7f3db406ddd0 2023-10-09T15:36:32.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 msgr2=0x7f3db40cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3db40cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 >> v2:172.21.15.59:3300/0 conn(0x7f3db415a8c0 msgr2=0x7f3db406d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 --2- 172.21.15.33:0/753014762 >> v2:172.21.15.59:3300/0 conn(0x7f3db415a8c0 0x7f3db406d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40d00d0 con 0x7f3db406ddd0 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3dac001470 con 0x7f3db406ddd0 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 >> v1:172.21.15.33:6789/0 conn(0x7f3db406ddd0 legacy=0x7f3db415d280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c004810 0x7f3d9c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3d9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db406e220 con 0x7f3d9c003a60 2023-10-09T15:36:32.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db40ce930 con 0x7f3d9c004810 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d9c00ba60 con 0x7f3db40b2980 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3dba24f700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3d9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db924d700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c004810 0x7f3d9c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 -- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 msgr2=0x7f3d9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db40b2980 0x7f3d9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 -- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c004810 msgr2=0x7f3d9c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c004810 0x7f3d9c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 -- 172.21.15.33:0/753014762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d9c003570 con 0x7f3d9c003a60 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003e70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e240 tx=0x7f3da400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5116852976a81445 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400eaf0 con 0x7f3d9c003a60 2023-10-09T15:36:32.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400f040 con 0x7f3d9c003a60 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.520+0000 7f3db8a4c700 1 -- 172.21.15.33:0/753014762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400eea0 con 0x7f3d9c003a60 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 -- 172.21.15.33:0/753014762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d9c003a60 msgr2=0x7f3d9c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/753014762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d9c003a60 0x7f3d9c003e70 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f3da400e240 tx=0x7f3da400b040 comp rx=0 tx=0).stop 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dba24f700 1 -- 172.21.15.33:0/753014762 reap_dead start 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 -- 172.21.15.33:0/753014762 shutdown_connections 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 -- 172.21.15.33:0/753014762 >> 172.21.15.33:0/753014762 conn(0x7f3db40703a0 msgr2=0x7f3db40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 -- 172.21.15.33:0/753014762 shutdown_connections 2023-10-09T15:36:32.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.521+0000 7f3dbaa50700 1 -- 172.21.15.33:0/753014762 wait complete. 2023-10-09T15:36:32.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.522+0000 7f3dbaa50700 1 Processor -- start 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.522+0000 7f3dbaa50700 1 -- start start 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c003a60 0x7f3db414f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db415b7e0 0x7f3db4169a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db416a480 con 0x7f3db415bc50 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415d660 con 0x7f3d9c003a60 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dbaa50700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db415ca50 con 0x7f3db415b7e0 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35172/0 (socket says 172.21.15.33:35172) 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 -- 172.21.15.33:0/2272420733 learned_addr learned my addr 172.21.15.33:0/2272420733 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:32.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3db924d700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db415b7e0 0x7f3db4169a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c003a60 0x7f3db414f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 -- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db415b7e0 msgr2=0x7f3db4169a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db415b7e0 0x7f3db4169a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 -- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c003a60 msgr2=0x7f3db414f5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c003a60 0x7f3db414f5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.523+0000 7f3dba24f700 1 -- 172.21.15.33:0/2272420733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db415cd30 con 0x7f3db415bc50 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3dba24f700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0011e0 tx=0x7f3db406e360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac018030 con 0x7f3db415bc50 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac00f610 con 0x7f3db415bc50 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db415d010 con 0x7f3db415bc50 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00f9b0 con 0x7f3db415bc50 2023-10-09T15:36:32.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.524+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db415daf0 con 0x7f3db415bc50 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.525+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db415d4b0 con 0x7f3db415bc50 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.525+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f3dac01b070 con 0x7f3db415bc50 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.526+0000 7f3db1ffb700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 0x7f3da0069650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.526+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3dac019070 con 0x7f3db415bc50 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.526+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 0x7f3da0069650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.526+0000 7f3db9a4e700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 0x7f3da0069650 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3da40094a0 tx=0x7f3da401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.530+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dac051470 con 0x7f3db415bc50 2023-10-09T15:36:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.724+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3db4150b80 con 0x7f3db415bc50 2023-10-09T15:36:32.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.725+0000 7f3db1ffb700 1 -- 172.21.15.33:0/2272420733 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f3dac054a90 con 0x7f3db415bc50 2023-10-09T15:36:32.726 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:32.726 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":77,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:22.245493+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 msgr2=0x7f3da0069650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 0x7f3da0069650 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f3da40094a0 tx=0x7f3da401a000 comp rx=0 tx=0).stop 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 msgr2=0x7f3db4169f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f3dac0011e0 tx=0x7f3db406e360 comp rx=0 tx=0).stop 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 shutdown_connections 2023-10-09T15:36:32.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3da00671a0 0x7f3da0069650 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3db415bc50 0x7f3db4169f40 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d9c003a60 0x7f3db414f5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 --2- 172.21.15.33:0/2272420733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3db415b7e0 0x7f3db4169a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 >> 172.21.15.33:0/2272420733 conn(0x7f3db40703a0 msgr2=0x7f3db414fdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 shutdown_connections 2023-10-09T15:36:32.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.727+0000 7f3dbaa50700 1 -- 172.21.15.33:0/2272420733 wait complete. 2023-10-09T15:36:32.740 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:36:19.396986+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '76', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:36:19.948299+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '77', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:36:32.740 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:36:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.862+0000 7f90bf084700 1 Processor -- start 2023-10-09T15:36:32.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.862+0000 7f90bf084700 1 -- start start 2023-10-09T15:36:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bf084700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90b8159530 0x7f90b80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bf084700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80ccfd0 con 0x7f90b806dc70 2023-10-09T15:36:32.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bf084700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90b80cf0e0 con 0x7f90b806e0e0 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bf084700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90b815a3d0 con 0x7f90b8159530 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90b8159530 0x7f90b80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90b8159530 0x7f90b80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35188/0 (socket says 172.21.15.33:35188) 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 -- 172.21.15.33:0/3125681325 learned_addr learned my addr 172.21.15.33:0/3125681325 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 -- 172.21.15.33:0/3125681325 >> v1:172.21.15.59:6789/0 conn(0x7f90b806e0e0 legacy=0x7f90b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 -- 172.21.15.33:0/3125681325 >> v1:172.21.15.33:6789/0 conn(0x7f90b806dc70 legacy=0x7f90b8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 -- 172.21.15.33:0/3125681325 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b815a6b0 con 0x7f90b8159530 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.863+0000 7f90bce20700 1 --2- 172.21.15.33:0/3125681325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b8159530 0x7f90b80ceba0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009f20 tx=0x7f90a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0625ec572f189c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90b77fe700 1 -- 172.21.15.33:0/3125681325 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a800e070 con 0x7f90b8159530 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90b77fe700 1 -- 172.21.15.33:0/3125681325 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a800ba40 con 0x7f90b8159530 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90b77fe700 1 -- 172.21.15.33:0/3125681325 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a80092e0 con 0x7f90b8159530 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 -- 172.21.15.33:0/3125681325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b8159530 msgr2=0x7f90b80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 --2- 172.21.15.33:0/3125681325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b8159530 0x7f90b80ceba0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009f20 tx=0x7f90a8009840 comp rx=0 tx=0).stop 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 -- 172.21.15.33:0/3125681325 shutdown_connections 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 --2- 172.21.15.33:0/3125681325 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b8159530 0x7f90b80ceba0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 -- 172.21.15.33:0/3125681325 >> 172.21.15.33:0/3125681325 conn(0x7f90b80703a0 msgr2=0x7f90b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 -- 172.21.15.33:0/3125681325 shutdown_connections 2023-10-09T15:36:32.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.864+0000 7f90bf084700 1 -- 172.21.15.33:0/3125681325 wait complete. 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.865+0000 7f90bf084700 1 Processor -- start 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 -- start start 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90b806dc70 0x7f90b816aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90b8159530 0x7f90b8155080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80b4990 con 0x7f90b806e0e0 2023-10-09T15:36:32.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90b81555c0 con 0x7f90b806dc70 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90bf084700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90b80b4bf0 con 0x7f90b8159530 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35202/0 (socket says 172.21.15.33:35202) 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.866+0000 7f90b7fff700 1 -- 172.21.15.33:0/834957539 learned_addr learned my addr 172.21.15.33:0/834957539 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90bce20700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90b806dc70 0x7f90b816aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90bd621700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90b8159530 0x7f90b8155080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 -- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90b8159530 msgr2=0x7f90b8155080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90b8159530 0x7f90b8155080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 -- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90b806dc70 msgr2=0x7f90b816aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:32.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90b806dc70 0x7f90b816aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 -- 172.21.15.33:0/834957539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a8009ae0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b7fff700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c590 tx=0x7f90a000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011590 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90a00116f0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90b80b4ed0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90a0011ab0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.867+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90b80b5490 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.868+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90b804c3c0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.869+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f90a001b3b0 con 0x7f90b806e0e0 2023-10-09T15:36:32.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.869+0000 7f90b4ff9700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 0x7f9098069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:32.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.869+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f90a0083dd0 con 0x7f90b806e0e0 2023-10-09T15:36:32.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.869+0000 7f90bce20700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 0x7f9098069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:32.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.869+0000 7f90bce20700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 0x7f9098069620 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009880 tx=0x7f90a8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:32.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:32.873+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f90a0050db0 con 0x7f90b806e0e0 2023-10-09T15:36:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.067+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f90b815a990 con 0x7f90b806e0e0 2023-10-09T15:36:33.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.068+0000 7f90b4ff9700 1 -- 172.21.15.33:0/834957539 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v77) v1 ==== 93+0+10 (secure 0 0 0) 0x7f90a0017070 con 0x7f90b806e0e0 2023-10-09T15:36:33.069 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 msgr2=0x7f9098069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 0x7f9098069620 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f90a8009880 tx=0x7f90a8017000 comp rx=0 tx=0).stop 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 msgr2=0x7f90b80b4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c590 tx=0x7f90a000c950 comp rx=0 tx=0).stop 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 shutdown_connections 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9098067170 0x7f9098069620 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90b8159530 0x7f90b8155080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90b806dc70 0x7f90b816aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 --2- 172.21.15.33:0/834957539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90b806e0e0 0x7f90b80b4450 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 >> 172.21.15.33:0/834957539 conn(0x7f90b80703a0 msgr2=0x7f90b80cf300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 shutdown_connections 2023-10-09T15:36:33.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.070+0000 7f90bf084700 1 -- 172.21.15.33:0/834957539 wait complete. 2023-10-09T15:36:33.083 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:36:33.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.204+0000 7f4df7fff700 1 Processor -- start 2023-10-09T15:36:33.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.204+0000 7f4df7fff700 1 -- start start 2023-10-09T15:36:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4df8153a00 0x7f4df8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80cea00 0x7f4df80cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df7fff700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4df815ac50 con 0x7f4df815de50 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df7fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4df815d010 con 0x7f4df8153a00 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df80cf3c0 con 0x7f4df80cea00 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df6ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4df8153a00 0x7f4df8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df6ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4df8153a00 0x7f4df8153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35216/0 (socket says 172.21.15.33:35216) 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df77fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80cea00 0x7f4df80cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df6ffd700 1 -- 172.21.15.33:0/2726445050 learned_addr learned my addr 172.21.15.33:0/2726445050 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.205+0000 7f4df67fc700 1 --1- 172.21.15.33:0/2726445050 >> v1:172.21.15.33:6789/0 conn(0x7f4df815de50 0x7f4df815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43090/0 (socket says 172.21.15.33:43090) 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df6ffd700 1 -- 172.21.15.33:0/2726445050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80cea00 msgr2=0x7f4df80cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2726445050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80cea00 0x7f4df80cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df6ffd700 1 -- 172.21.15.33:0/2726445050 >> v1:172.21.15.33:6789/0 conn(0x7f4df815de50 legacy=0x7f4df815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df6ffd700 1 -- 172.21.15.33:0/2726445050 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df815af60 con 0x7f4df8153a00 2023-10-09T15:36:33.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2726445050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8153dd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4df00099b0 tx=0x7f4df0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c16ab4878345d64 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df5ffb700 1 -- 172.21.15.33:0/2726445050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df0009ea0 con 0x7f4df8153a00 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df5ffb700 1 -- 172.21.15.33:0/2726445050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4df000b860 con 0x7f4df8153a00 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df5ffb700 1 -- 172.21.15.33:0/2726445050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4df000bc00 con 0x7f4df8153a00 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 -- 172.21.15.33:0/2726445050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 msgr2=0x7f4df8153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2726445050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8153dd0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4df00099b0 tx=0x7f4df0009250 comp rx=0 tx=0).stop 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 -- 172.21.15.33:0/2726445050 shutdown_connections 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2726445050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df80cea00 0x7f4df80cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2726445050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8153dd0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 -- 172.21.15.33:0/2726445050 >> 172.21.15.33:0/2726445050 conn(0x7f4df80703a0 msgr2=0x7f4df80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 -- 172.21.15.33:0/2726445050 shutdown_connections 2023-10-09T15:36:33.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.206+0000 7f4df7fff700 1 -- 172.21.15.33:0/2726445050 wait complete. 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 Processor -- start 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 -- start start 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 0x7f4df80c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df815de50 0x7f4df80c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df816d180 con 0x7f4df8153a00 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4df816d3d0 con 0x7f4df80cea00 2023-10-09T15:36:33.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.208+0000 7f4df7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4df816d6b0 con 0x7f4df815de50 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35230/0 (socket says 172.21.15.33:35230) 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 -- 172.21.15.33:0/2497665694 learned_addr learned my addr 172.21.15.33:0/2497665694 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df77fe700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df815de50 0x7f4df80c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 0x7f4df80c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 -- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df815de50 msgr2=0x7f4df80c8f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df815de50 0x7f4df80c8f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 -- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 msgr2=0x7f4df80c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 0x7f4df80c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 -- 172.21.15.33:0/2497665694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4df00094f0 con 0x7f4df8153a00 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 0x7f4df80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:33.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df67fc700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c560 tx=0x7f4de0007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de0005a70 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4de0005bd0 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4df816d990 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4de00070d0 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.209+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4df816df50 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.210+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4df8169bd0 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.211+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7f4de0007440 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.211+0000 7f4deeffd700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 0x7f4dd8069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.211+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4de0083c70 con 0x7f4df8153a00 2023-10-09T15:36:33.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.211+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 0x7f4dd8069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.212+0000 7f4df6ffd700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 0x7f4dd8069620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4df00099b0 tx=0x7f4df0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.215+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4de0050c50 con 0x7f4df8153a00 2023-10-09T15:36:33.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.412+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4df804c3c0 con 0x7f4df8153a00 2023-10-09T15:36:33.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.412+0000 7f4deeffd700 1 -- 172.21.15.33:0/2497665694 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v77) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4de00170a0 con 0x7f4df8153a00 2023-10-09T15:36:33.413 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:36:33.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 msgr2=0x7f4dd8069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 0x7f4dd8069620 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4df00099b0 tx=0x7f4df0017000 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 msgr2=0x7f4df8152cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4de000c560 tx=0x7f4de0007f70 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 shutdown_connections 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4dd8067170 0x7f4dd8069620 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4df815de50 0x7f4df80c8f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4df80cea00 0x7f4df80c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 --2- 172.21.15.33:0/2497665694 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4df8153a00 0x7f4df8152cb0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 >> 172.21.15.33:0/2497665694 conn(0x7f4df80703a0 msgr2=0x7f4df8151f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 shutdown_connections 2023-10-09T15:36:33.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.414+0000 7f4df7fff700 1 -- 172.21.15.33:0/2497665694 wait complete. 2023-10-09T15:36:33.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:36:33.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 Processor -- start 2023-10-09T15:36:33.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 -- start start 2023-10-09T15:36:33.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd33c06e0e0 0x7fd33c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd33c0ccfd0 con 0x7fd33c159530 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd33c15a3d0 con 0x7fd33c06e0e0 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.549+0000 7fd341a51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c15a6b0 con 0x7fd33c06dc70 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd33c159530 0x7fd33c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:38866/0 (socket says 172.21.15.33:38866) 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33affd700 1 -- 172.21.15.33:0/3032667040 learned_addr learned my addr 172.21.15.33:0/3032667040 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33b7fe700 1 --2- 172.21.15.33:0/3032667040 >> v2:172.21.15.59:3300/0 conn(0x7fd33c06e0e0 0x7fd33c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd339ffb700 1 -- 172.21.15.33:0/3032667040 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1014827939 0 0) 0x7fd33c0ccfd0 con 0x7fd33c159530 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd339ffb700 1 -- 172.21.15.33:0/3032667040 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd328003570 con 0x7fd33c159530 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 -- 172.21.15.33:0/3032667040 >> v2:172.21.15.59:3300/0 conn(0x7fd33c06e0e0 msgr2=0x7fd33c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 --2- 172.21.15.33:0/3032667040 >> v2:172.21.15.59:3300/0 conn(0x7fd33c06e0e0 0x7fd33c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 -- 172.21.15.33:0/3032667040 >> v1:172.21.15.59:6789/0 conn(0x7fd33c159530 legacy=0x7fd33c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 -- 172.21.15.33:0/3032667040 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd33c15a990 con 0x7fd33c06dc70 2023-10-09T15:36:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.550+0000 7fd33a7fc700 1 --2- 172.21.15.33:0/3032667040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c159900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3240098e0 tx=0x7fd3240091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d7e23626a91d0a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd339ffb700 1 -- 172.21.15.33:0/3032667040 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324011630 con 0x7fd33c06dc70 2023-10-09T15:36:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd339ffb700 1 -- 172.21.15.33:0/3032667040 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324011790 con 0x7fd33c06dc70 2023-10-09T15:36:33.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd339ffb700 1 -- 172.21.15.33:0/3032667040 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324011b30 con 0x7fd33c06dc70 2023-10-09T15:36:33.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 -- 172.21.15.33:0/3032667040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 msgr2=0x7fd33c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 --2- 172.21.15.33:0/3032667040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c159900 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fd3240098e0 tx=0x7fd3240091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 -- 172.21.15.33:0/3032667040 shutdown_connections 2023-10-09T15:36:33.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 --2- 172.21.15.33:0/3032667040 >> v2:172.21.15.59:3300/0 conn(0x7fd33c06e0e0 0x7fd33c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 --2- 172.21.15.33:0/3032667040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c159900 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 -- 172.21.15.33:0/3032667040 >> 172.21.15.33:0/3032667040 conn(0x7fd33c0703a0 msgr2=0x7fd33c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 -- 172.21.15.33:0/3032667040 shutdown_connections 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.551+0000 7fd341a51700 1 -- 172.21.15.33:0/3032667040 wait complete. 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.552+0000 7fd341a51700 1 Processor -- start 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.552+0000 7fd341a51700 1 -- start start 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c14f590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd33c159530 0x7fd33c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c0b5120 con 0x7fd33c06e0e0 2023-10-09T15:36:33.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c156820 con 0x7fd33c159530 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd341a51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd33c156ae0 con 0x7fd33c06dc70 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd33a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35234/0 (socket says 172.21.15.33:35234) 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.553+0000 7fd33a7fc700 1 -- 172.21.15.33:0/1197864610 learned_addr learned my addr 172.21.15.33:0/1197864610 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33affd700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c14f590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33b7fe700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd33c159530 0x7fd33c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 -- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 msgr2=0x7fd33c14f590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c14f590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 -- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd33c159530 msgr2=0x7fd33c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd33c159530 0x7fd33c0c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 -- 172.21.15.33:0/1197864610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd324009420 con 0x7fd33c06e0e0 2023-10-09T15:36:33.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd33a7fc700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd33c15a7f0 tx=0x7fd324017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324011900 con 0x7fd33c06e0e0 2023-10-09T15:36:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd324011a60 con 0x7fd33c06e0e0 2023-10-09T15:36:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd33c0b4880 con 0x7fd33c06e0e0 2023-10-09T15:36:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd324025640 con 0x7fd33c06e0e0 2023-10-09T15:36:33.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.554+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd33c0b4e40 con 0x7fd33c06e0e0 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.555+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd33c156c50 con 0x7fd33c06e0e0 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.556+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fd324025a30 con 0x7fd33c06e0e0 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.556+0000 7fd332ffd700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 0x7fd31c069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.556+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd324086000 con 0x7fd33c06e0e0 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.556+0000 7fd33affd700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 0x7fd31c069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.556+0000 7fd33affd700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 0x7fd31c069620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.560+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd324052fe0 con 0x7fd33c06e0e0 2023-10-09T15:36:33.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.754+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd33c04c3c0 con 0x7fd33c06e0e0 2023-10-09T15:36:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.755+0000 7fd332ffd700 1 -- 172.21.15.33:0/1197864610 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v77) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd324056600 con 0x7fd33c06e0e0 2023-10-09T15:36:33.756 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 msgr2=0x7fd31c069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 0x7fd31c069620 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fd32c007fd0 tx=0x7fd32c009040 comp rx=0 tx=0).stop 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 msgr2=0x7fd33c0c9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd33c15a7f0 tx=0x7fd324017000 comp rx=0 tx=0).stop 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 shutdown_connections 2023-10-09T15:36:33.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd31c067170 0x7fd31c069620 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd33c159530 0x7fd33c0c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd33c06dc70 0x7fd33c14f590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 --2- 172.21.15.33:0/1197864610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd33c06e0e0 0x7fd33c0c9620 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 >> 172.21.15.33:0/1197864610 conn(0x7fd33c0703a0 msgr2=0x7fd33c0cedb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 shutdown_connections 2023-10-09T15:36:33.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.757+0000 7fd341a51700 1 -- 172.21.15.33:0/1197864610 wait complete. 2023-10-09T15:36:33.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.888+0000 7fede11bc700 1 Processor -- start 2023-10-09T15:36:33.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.888+0000 7fede11bc700 1 -- start start 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede11bc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feddc15de50 0x7feddc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede11bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc0cef40 0x7feddc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede11bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feddc0cf3c0 con 0x7feddc153c30 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede11bc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feddc15afd0 con 0x7feddc15de50 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede11bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc15b2b0 con 0x7feddc0cef40 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddbfff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7feddc153c30 0x7feddc15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:38878/0 (socket says 172.21.15.33:38878) 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddbfff700 1 -- 172.21.15.33:0/1438494816 learned_addr learned my addr 172.21.15.33:0/1438494816 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7fede09bb700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc0cef40 0x7feddc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddb7fe700 1 --2- 172.21.15.33:0/1438494816 >> v2:172.21.15.59:3300/0 conn(0x7feddc15de50 0x7feddc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddaffd700 1 -- 172.21.15.33:0/1438494816 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2016554195 0 0) 0x7feddc0cf3c0 con 0x7feddc153c30 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddaffd700 1 -- 172.21.15.33:0/1438494816 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedc8003570 con 0x7feddc153c30 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddb7fe700 1 -- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc0cef40 msgr2=0x7feddc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.889+0000 7feddb7fe700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc0cef40 0x7feddc15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddb7fe700 1 -- 172.21.15.33:0/1438494816 >> v1:172.21.15.59:6789/0 conn(0x7feddc153c30 legacy=0x7feddc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddb7fe700 1 -- 172.21.15.33:0/1438494816 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feddc15b590 con 0x7feddc15de50 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddb7fe700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc15de50 0x7feddc0cea00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0098e0 tx=0x7fedcc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2f1be732e560a15d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddaffd700 1 -- 172.21.15.33:0/1438494816 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011630 con 0x7feddc15de50 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddaffd700 1 -- 172.21.15.33:0/1438494816 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedcc011790 con 0x7feddc15de50 2023-10-09T15:36:33.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7feddaffd700 1 -- 172.21.15.33:0/1438494816 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedcc011b30 con 0x7feddc15de50 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7fede11bc700 1 -- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc15de50 msgr2=0x7feddc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.890+0000 7fede11bc700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc15de50 0x7feddc0cea00 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fedcc0098e0 tx=0x7fedcc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 -- 172.21.15.33:0/1438494816 shutdown_connections 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc0cef40 0x7feddc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 --2- 172.21.15.33:0/1438494816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc15de50 0x7feddc0cea00 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 -- 172.21.15.33:0/1438494816 >> 172.21.15.33:0/1438494816 conn(0x7feddc0703a0 msgr2=0x7feddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 -- 172.21.15.33:0/1438494816 shutdown_connections 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.891+0000 7fede11bc700 1 -- 172.21.15.33:0/1438494816 wait complete. 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.892+0000 7fede11bc700 1 Processor -- start 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.892+0000 7fede11bc700 1 -- start start 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 0x7feddc0b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 0x7feddc159800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0c8720 con 0x7feddc15de50 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feddc159d40 con 0x7feddc0cef40 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede11bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feddc0b57c0 con 0x7feddc153c30 2023-10-09T15:36:33.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35242/0 (socket says 172.21.15.33:35242) 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 -- 172.21.15.33:0/780635682 learned_addr learned my addr 172.21.15.33:0/780635682 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7feddb7fe700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 0x7feddc159800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7feddbfff700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 0x7feddc0b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 -- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 msgr2=0x7feddc159800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 0x7feddc159800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 -- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 msgr2=0x7feddc0b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 0x7feddc0b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 -- 172.21.15.33:0/780635682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedcc009420 con 0x7feddc15de50 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7feddbfff700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 0x7feddc0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7feddb7fe700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 0x7feddc159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:33.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fede09bb700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009df0 tx=0x7fedd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400caa0 con 0x7feddc15de50 2023-10-09T15:36:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.893+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedd400f040 con 0x7feddc15de50 2023-10-09T15:36:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.894+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feddc0b5aa0 con 0x7feddc15de50 2023-10-09T15:36:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.894+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedd400ce70 con 0x7feddc15de50 2023-10-09T15:36:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.894+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feddc0b6060 con 0x7feddc15de50 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.895+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feddc0c8890 con 0x7feddc15de50 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.895+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 9) v1 ==== 84944+0+0 (secure 0 0 0) 0x7fedd4014690 con 0x7feddc15de50 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.895+0000 7fedd3fff700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 0x7fedbc069620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.896+0000 7feddbfff700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 0x7fedbc069620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.896+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fedd4085180 con 0x7feddc15de50 2023-10-09T15:36:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.896+0000 7feddbfff700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 0x7fedbc069620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:33.900+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fedd4055ae0 con 0x7feddc15de50 2023-10-09T15:36:34.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.138+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7feddc04c3c0 con 0x7feddc15de50 2023-10-09T15:36:34.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.138+0000 7fedd3fff700 1 -- 172.21.15.33:0/780635682 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fedd4055670 con 0x7feddc15de50 2023-10-09T15:36:34.139 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:34.139 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:34.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 msgr2=0x7fedbc069620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 0x7fedbc069620 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fedc4007fd0 tx=0x7fedc4009040 comp rx=0 tx=0).stop 2023-10-09T15:36:34.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 msgr2=0x7feddc0b1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fedd4009df0 tx=0x7fedd400b040 comp rx=0 tx=0).stop 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 shutdown_connections 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fedbc067170 0x7fedbc069620 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feddc15de50 0x7feddc0b1760 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feddc0cef40 0x7feddc0b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 --2- 172.21.15.33:0/780635682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feddc153c30 0x7feddc159800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 >> 172.21.15.33:0/780635682 conn(0x7feddc0703a0 msgr2=0x7feddc0c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 shutdown_connections 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.140+0000 7fede11bc700 1 -- 172.21.15.33:0/780635682 wait complete. 2023-10-09T15:36:34.142 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 50 2023-10-09T15:36:34.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.272+0000 7f47f9754700 1 Processor -- start 2023-10-09T15:36:34.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.272+0000 7f47f9754700 1 -- start start 2023-10-09T15:36:34.275 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f9754700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f9754700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 0x7f47f40c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f9754700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47f406e560 con 0x7f47f40b05a0 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f9754700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47f406e260 con 0x7f47f40b0970 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f9754700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f40c3240 con 0x7f47f40cec90 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f3fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f47f40b05a0 0x7f47f40c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43098/0 (socket says 172.21.15.33:43098) 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f3fff700 1 -- 172.21.15.33:0/3722661380 learned_addr learned my addr 172.21.15.33:0/3722661380 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f8f53700 1 --2- 172.21.15.33:0/3722661380 >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 0x7f47f40c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f37fe700 1 --2- 172.21.15.33:0/3722661380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 842697142 0 0) 0x7f47f406e560 con 0x7f47f40b05a0 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47dc003570 con 0x7f47f40b05a0 2023-10-09T15:36:34.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f37fe700 1 -- 172.21.15.33:0/3722661380 >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 msgr2=0x7f47f40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f37fe700 1 --2- 172.21.15.33:0/3722661380 >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 0x7f47f40c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f37fe700 1 -- 172.21.15.33:0/3722661380 >> v1:172.21.15.33:6789/0 conn(0x7f47f40b05a0 legacy=0x7f47f40c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3284754472 0 0) 0x7f47dc003570 con 0x7f47f40b05a0 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f37fe700 1 -- 172.21.15.33:0/3722661380 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47f40c3520 con 0x7f47f40cec90 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.273+0000 7f47f8f53700 1 --2- 172.21.15.33:0/3722661380 >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 0x7f47f40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f37fe700 1 --2- 172.21.15.33:0/3722661380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40cd7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47e80098e0 tx=0x7f47e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=475acd3897448b9f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e40015f0 con 0x7f47f40cec90 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e8011420 con 0x7f47f40cec90 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f2ffd700 1 -- 172.21.15.33:0/3722661380 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e80117c0 con 0x7f47f40cec90 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 -- 172.21.15.33:0/3722661380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 msgr2=0x7f47f40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 --2- 172.21.15.33:0/3722661380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40cd7d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f47e80098e0 tx=0x7f47e80091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 -- 172.21.15.33:0/3722661380 shutdown_connections 2023-10-09T15:36:34.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 --2- 172.21.15.33:0/3722661380 >> v2:172.21.15.59:3300/0 conn(0x7f47f40b0970 0x7f47f40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 --2- 172.21.15.33:0/3722661380 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40cd7d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 -- 172.21.15.33:0/3722661380 >> 172.21.15.33:0/3722661380 conn(0x7f47f4088000 msgr2=0x7f47f40ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:34.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 -- 172.21.15.33:0/3722661380 shutdown_connections 2023-10-09T15:36:34.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.274+0000 7f47f9754700 1 -- 172.21.15.33:0/3722661380 wait complete. 2023-10-09T15:36:34.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.276+0000 7f47f9754700 1 Processor -- start 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.276+0000 7f47f9754700 1 -- start start 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f40b05a0 0x7f47f4157490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40c63c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4069750 con 0x7f47f40b0970 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4157ae0 con 0x7f47f40b05a0 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f9754700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47f4157dc0 con 0x7f47f40cec90 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35244/0 (socket says 172.21.15.33:35244) 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 -- 172.21.15.33:0/1888566953 learned_addr learned my addr 172.21.15.33:0/1888566953 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:34.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f3fff700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f40b05a0 0x7f47f4157490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f8f53700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40c63c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 -- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 msgr2=0x7f47f40c63c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40c63c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 -- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f40b05a0 msgr2=0x7f47f4157490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f40b05a0 0x7f47f4157490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 -- 172.21.15.33:0/1888566953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47ec009a20 con 0x7f47f40b0970 2023-10-09T15:36:34.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.277+0000 7f47f37fe700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47e80030c0 tx=0x7f47e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.284+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e801cbe0 con 0x7f47f40b0970 2023-10-09T15:36:34.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.284+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e8009420 con 0x7f47f40b0970 2023-10-09T15:36:34.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.284+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47e801a450 con 0x7f47f40b0970 2023-10-09T15:36:34.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.284+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47e801a5c0 con 0x7f47f40b0970 2023-10-09T15:36:34.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.284+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47f4158380 con 0x7f47f40b0970 2023-10-09T15:36:34.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.285+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47f404c3c0 con 0x7f47f40b0970 2023-10-09T15:36:34.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.285+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f47e801a9f0 con 0x7f47f40b0970 2023-10-09T15:36:34.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.285+0000 7f47dbfff700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 0x7f47e00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.286+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f47e8086170 con 0x7f47f40b0970 2023-10-09T15:36:34.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.286+0000 7f47f3fff700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 0x7f47e00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.286+0000 7f47f3fff700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 0x7f47e00696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000ef0 tx=0x7f47e4002ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.290+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f47e8053200 con 0x7f47f40b0970 2023-10-09T15:36:34.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.486+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47f40cd3d0 con 0x7f47f40b0970 2023-10-09T15:36:34.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.487+0000 7f47dbfff700 1 -- 172.21.15.33:0/1888566953 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f47e8056820 con 0x7f47f40b0970 2023-10-09T15:36:34.488 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:34.489 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":77,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:22.245493+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 msgr2=0x7f47e00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 0x7f47e00696b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f47e4000ef0 tx=0x7f47e4002ea0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 msgr2=0x7f47f4069210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f47e80030c0 tx=0x7f47e8016000 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 shutdown_connections 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f47e0067200 0x7f47e00696b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f47f40cec90 0x7f47f40c63c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f47f40b05a0 0x7f47f4157490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 --2- 172.21.15.33:0/1888566953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f47f40b0970 0x7f47f4069210 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.489+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 >> 172.21.15.33:0/1888566953 conn(0x7f47f4088000 msgr2=0x7f47f4152300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:34.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.490+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 shutdown_connections 2023-10-09T15:36:34.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.490+0000 7f47f9754700 1 -- 172.21.15.33:0/1888566953 wait complete. 2023-10-09T15:36:34.503 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:36:34.503 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:34.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.621+0000 7f33ec85e700 1 Processor -- start 2023-10-09T15:36:34.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33ec85e700 1 -- start start 2023-10-09T15:36:34.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33ec85e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 0x7f33e81565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33ec85e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e815a840 con 0x7f33e806ae50 2023-10-09T15:36:34.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33ec85e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80c8520 con 0x7f33e815acd0 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33ec85e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e815a1f0 con 0x7f33e80c7fb0 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33e77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f33e806ae50 0x7f33e80c78a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43112/0 (socket says 172.21.15.33:43112) 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.622+0000 7f33e77fe700 1 -- 172.21.15.33:0/2673836351 learned_addr learned my addr 172.21.15.33:0/2673836351 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e7fff700 1 --2- 172.21.15.33:0/2673836351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 0x7f33e81565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 614530329 0 0) 0x7f33e815a840 con 0x7f33e806ae50 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d4003570 con 0x7f33e806ae50 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1818892086 0 0) 0x7f33e80c8520 con 0x7f33e815acd0 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33e815a840 con 0x7f33e815acd0 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e7fff700 1 -- 172.21.15.33:0/2673836351 >> v1:172.21.15.59:6789/0 conn(0x7f33e815acd0 legacy=0x7f33e8155eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e7fff700 1 -- 172.21.15.33:0/2673836351 >> v1:172.21.15.33:6789/0 conn(0x7f33e806ae50 legacy=0x7f33e80c78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2129478742 0 0) 0x7f33d4003570 con 0x7f33e806ae50 2023-10-09T15:36:34.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e7fff700 1 -- 172.21.15.33:0/2673836351 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e815a4d0 con 0x7f33e80c7fb0 2023-10-09T15:36:34.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e7fff700 1 --2- 172.21.15.33:0/2673836351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 0x7f33e81565c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009910 tx=0x7f33e00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d172b770405fcf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80017f0 con 0x7f33e80c7fb0 2023-10-09T15:36:34.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0011420 con 0x7f33e80c7fb0 2023-10-09T15:36:34.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.623+0000 7f33e67fc700 1 -- 172.21.15.33:0/2673836351 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e00117a0 con 0x7f33e80c7fb0 2023-10-09T15:36:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 -- 172.21.15.33:0/2673836351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 msgr2=0x7f33e81565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 --2- 172.21.15.33:0/2673836351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 0x7f33e81565c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f33e0009910 tx=0x7f33e00091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 -- 172.21.15.33:0/2673836351 shutdown_connections 2023-10-09T15:36:34.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 --2- 172.21.15.33:0/2673836351 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e80c7fb0 0x7f33e81565c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 -- 172.21.15.33:0/2673836351 >> 172.21.15.33:0/2673836351 conn(0x7f33e806e280 msgr2=0x7f33e80cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 -- 172.21.15.33:0/2673836351 shutdown_connections 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.624+0000 7f33ec85e700 1 -- 172.21.15.33:0/2673836351 wait complete. 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.625+0000 7f33ec85e700 1 Processor -- start 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.625+0000 7f33ec85e700 1 -- start start 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e806ae50 0x7f33e8155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e80c7fb0 0x7f33e80b1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80b28a0 con 0x7f33e815acd0 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80c3c30 con 0x7f33e80c7fb0 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33ec85e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8167940 con 0x7f33e806ae50 2023-10-09T15:36:34.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35246/0 (socket says 172.21.15.33:35246) 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 -- 172.21.15.33:0/440040243 learned_addr learned my addr 172.21.15.33:0/440040243 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e77fe700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e806ae50 0x7f33e8155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e6ffd700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e80c7fb0 0x7f33e80b1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 -- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e806ae50 msgr2=0x7f33e8155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e806ae50 0x7f33e8155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 -- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e80c7fb0 msgr2=0x7f33e80b1d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e80c7fb0 0x7f33e80b1d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.626+0000 7f33e7fff700 1 -- 172.21.15.33:0/440040243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e0009420 con 0x7f33e815acd0 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33e7fff700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f33e80afe30 tx=0x7f33e0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e001cd10 con 0x7f33e815acd0 2023-10-09T15:36:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e001ce70 con 0x7f33e815acd0 2023-10-09T15:36:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e8167c20 con 0x7f33e815acd0 2023-10-09T15:36:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e001a680 con 0x7f33e815acd0 2023-10-09T15:36:34.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.627+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e81681e0 con 0x7f33e815acd0 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.628+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e81683d0 con 0x7f33e815acd0 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.628+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f33e001aa70 con 0x7f33e815acd0 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.628+0000 7f33df7fe700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 0x7f33c80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.629+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f33e00862f0 con 0x7f33e815acd0 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.629+0000 7f33e77fe700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 0x7f33c80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:34.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.629+0000 7f33e77fe700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 0x7f33c80696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f33d8007fd0 tx=0x7f33d8000f40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:34.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.633+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f33e0053210 con 0x7f33e815acd0 2023-10-09T15:36:34.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.873+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33e804c3c0 con 0x7f33e815acd0 2023-10-09T15:36:35.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.873+0000 7f33df7fe700 1 -- 172.21.15.33:0/440040243 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f33e005ae60 con 0x7f33e815acd0 2023-10-09T15:36:35.049 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:35.049 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:35.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.875+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 msgr2=0x7f33c80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.875+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 0x7f33c80696b0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f33d8007fd0 tx=0x7f33d8000f40 comp rx=0 tx=0).stop 2023-10-09T15:36:35.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.875+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 msgr2=0x7f33e80b2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.875+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f33e80afe30 tx=0x7f33e0016000 comp rx=0 tx=0).stop 2023-10-09T15:36:35.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 shutdown_connections 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f33c8067200 0x7f33c80696b0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33e815acd0 0x7f33e80b2290 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33e806ae50 0x7f33e8155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 --2- 172.21.15.33:0/440040243 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f33e80c7fb0 0x7f33e80b1d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 >> 172.21.15.33:0/440040243 conn(0x7f33e806e280 msgr2=0x7f33e80675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 shutdown_connections 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:34.876+0000 7f33ec85e700 1 -- 172.21.15.33:0/440040243 wait complete. 2023-10-09T15:36:35.238 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 50 2023-10-09T15:36:35.239 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:35.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.359+0000 7fefed691700 1 Processor -- start 2023-10-09T15:36:35.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.359+0000 7fefed691700 1 -- start start 2023-10-09T15:36:35.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefed691700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fefe81594d0 0x7fefe80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefed691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefed691700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefe815e010 con 0x7fefe80cb1a0 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefed691700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefe815d420 con 0x7fefe81594d0 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefed691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe815d6e0 con 0x7fefe81598a0 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fefe81594d0 0x7fefe80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe67fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fefe80cb1a0 0x7fefe80ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43126/0 (socket says 172.21.15.33:43126) 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe67fc700 1 -- 172.21.15.33:0/518614480 learned_addr learned my addr 172.21.15.33:0/518614480 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fefe81594d0 0x7fefe80cea70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35258/0 (socket says 172.21.15.33:35258) 2023-10-09T15:36:35.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe77fe700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 -- 172.21.15.33:0/518614480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 msgr2=0x7fefe80cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe80cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 -- 172.21.15.33:0/518614480 >> v1:172.21.15.33:6789/0 conn(0x7fefe80cb1a0 legacy=0x7fefe80ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe6ffd700 1 -- 172.21.15.33:0/518614480 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefe815d9c0 con 0x7fefe81594d0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe5ffb700 1 -- 172.21.15.33:0/518614480 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073841716 0 0) 0x7fefe815e010 con 0x7fefe80cb1a0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.360+0000 7fefe77fe700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80cea70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098e0 tx=0x7fefd80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa2069c1c3a68e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefe5ffb700 1 -- 172.21.15.33:0/518614480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd8009e80 con 0x7fefe81594d0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefe5ffb700 1 -- 172.21.15.33:0/518614480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd800b860 con 0x7fefe81594d0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefe5ffb700 1 -- 172.21.15.33:0/518614480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd800bbe0 con 0x7fefe81594d0 2023-10-09T15:36:35.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 -- 172.21.15.33:0/518614480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 msgr2=0x7fefe80cea70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80cea70 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7fefd80098e0 tx=0x7fefd80091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 -- 172.21.15.33:0/518614480 shutdown_connections 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe80cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 --2- 172.21.15.33:0/518614480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80cea70 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 -- 172.21.15.33:0/518614480 >> 172.21.15.33:0/518614480 conn(0x7fefe80703a0 msgr2=0x7fefe8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 -- 172.21.15.33:0/518614480 shutdown_connections 2023-10-09T15:36:35.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.361+0000 7fefed691700 1 -- 172.21.15.33:0/518614480 wait complete. 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 Processor -- start 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 -- start start 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 0x7fefe80b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe8159e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80b2110 con 0x7fefe81594d0 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefe8151c80 con 0x7fefe80cb1a0 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefed691700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefe80b1500 con 0x7fefe81598a0 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.363+0000 7fefe67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35262/0 (socket says 172.21.15.33:35262) 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 -- 172.21.15.33:0/3076357148 learned_addr learned my addr 172.21.15.33:0/3076357148 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe77fe700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe8159e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 0x7fefe80b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 -- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 msgr2=0x7fefe8159e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe8159e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 -- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 msgr2=0x7fefe80b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 0x7fefe80b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 -- 172.21.15.33:0/3076357148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefd8009420 con 0x7fefe81594d0 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 0x7fefe80b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefe67fc700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c810 tx=0x7fefd0007db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0005c00 con 0x7fefe81594d0 2023-10-09T15:36:35.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefd0005d60 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefe80b17e0 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefd0007320 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.364+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefe80b1da0 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.365+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefe80b22c0 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.366+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fefd001b400 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.366+0000 7fefdeffd700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 0x7fefc80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.366+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefd0084440 con 0x7fefe81594d0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.366+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 0x7fefc80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.367+0000 7fefe6ffd700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 0x7fefc80696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c76b0 tx=0x7fefd8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.370+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefd00513e0 con 0x7fefe81594d0 2023-10-09T15:36:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.609+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fefe804c3c0 con 0x7fefe81594d0 2023-10-09T15:36:35.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.609+0000 7fefdeffd700 1 -- 172.21.15.33:0/3076357148 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 50 v50) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fefd0054a00 con 0x7fefe81594d0 2023-10-09T15:36:35.610 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:35.610 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":50,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":49,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:20.975612+0000","modified":"2023-10-09T15:36:24.598102+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6111},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6111":{"gid":6111,"name":"b","rank":0,"incarnation":45,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6835/2947470060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2947470060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2947470060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":6}]} 2023-10-09T15:36:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 msgr2=0x7fefc80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 0x7fefc80696b0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fefe80c76b0 tx=0x7fefd8017000 comp rx=0 tx=0).stop 2023-10-09T15:36:35.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 msgr2=0x7fefe80c7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7fefd000c810 tx=0x7fefd0007db0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 shutdown_connections 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefc8067200 0x7fefc80696b0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefe81598a0 0x7fefe8159e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefe80cb1a0 0x7fefe80b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 --2- 172.21.15.33:0/3076357148 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefe81594d0 0x7fefe80c7bf0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 >> 172.21.15.33:0/3076357148 conn(0x7fefe80703a0 msgr2=0x7fefe80c6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 shutdown_connections 2023-10-09T15:36:35.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.611+0000 7fefed691700 1 -- 172.21.15.33:0/3076357148 wait complete. 2023-10-09T15:36:35.614 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 50 2023-10-09T15:36:35.625 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:35.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.743+0000 7fbcc57af700 1 Processor -- start 2023-10-09T15:36:35.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 -- start start 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 0x7fbcc015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc00d13f0 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcc015a940 con 0x7fbcc00cde50 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcc57af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc015ae40 con 0x7fbcc00cb5a0 2023-10-09T15:36:35.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.744+0000 7fbcbe7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35274/0 (socket says 172.21.15.33:35274) 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbeffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 -- 172.21.15.33:0/4196208218 learned_addr learned my addr 172.21.15.33:0/4196208218 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbf7fe700 1 --2- 172.21.15.33:0/4196208218 >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 0x7fbcc015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 -- 172.21.15.33:0/4196208218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 msgr2=0x7fbcc00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 --2- 172.21.15.33:0/4196208218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 -- 172.21.15.33:0/4196208218 >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 msgr2=0x7fbcc015a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 --2- 172.21.15.33:0/4196208218 >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 0x7fbcc015a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 -- 172.21.15.33:0/4196208218 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcc015ab60 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbf7fe700 1 --2- 172.21.15.33:0/4196208218 >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 0x7fbcc015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbe7fc700 1 --2- 172.21.15.33:0/4196208218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00cbeb0 tx=0x7fbca8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=385b769a1821d39f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbdffb700 1 -- 172.21.15.33:0/4196208218 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca8009ea0 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbdffb700 1 -- 172.21.15.33:0/4196208218 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca800b820 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.745+0000 7fbcbdffb700 1 -- 172.21.15.33:0/4196208218 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbca800bbc0 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 -- 172.21.15.33:0/4196208218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00cd9e0 msgr2=0x7fbcc0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 --2- 172.21.15.33:0/4196208218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fbcc00cbeb0 tx=0x7fbca8009250 comp rx=0 tx=0).stop 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 -- 172.21.15.33:0/4196208218 shutdown_connections 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 --2- 172.21.15.33:0/4196208218 >> v2:172.21.15.59:3300/0 conn(0x7fbcc00cde50 0x7fbcc015a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 --2- 172.21.15.33:0/4196208218 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 --2- 172.21.15.33:0/4196208218 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc0159ec0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 -- 172.21.15.33:0/4196208218 >> 172.21.15.33:0/4196208218 conn(0x7fbcc0070e30 msgr2=0x7fbcc00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 -- 172.21.15.33:0/4196208218 shutdown_connections 2023-10-09T15:36:35.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.746+0000 7fbcc57af700 1 -- 172.21.15.33:0/4196208218 wait complete. 2023-10-09T15:36:35.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.747+0000 7fbcc57af700 1 Processor -- start 2023-10-09T15:36:35.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.747+0000 7fbcc57af700 1 -- start start 2023-10-09T15:36:35.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc0159a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc014c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc00b4ff0 con 0x7fbcc00b4630 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc015bf60 con 0x7fbcc00cd9e0 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcc57af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcc0159f90 con 0x7fbcc00cb5a0 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35282/0 (socket says 172.21.15.33:35282) 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 -- 172.21.15.33:0/3156051649 learned_addr learned my addr 172.21.15.33:0/3156051649 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbe7fc700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc014c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbeffd700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc0159a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 -- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 msgr2=0x7fbcc0159a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc0159a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 -- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcc00cd9e0 msgr2=0x7fbcc014c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc014c1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 -- 172.21.15.33:0/3156051649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca80094f0 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.748+0000 7fbcbf7fe700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000d860 tx=0x7fbcb0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.749+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb00125f0 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.749+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcb0012750 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.749+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcb0012ad0 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.749+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbcc015b070 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.749+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcc015b630 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.750+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcc0156c40 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.750+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fbcb0014430 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.750+0000 7fbcb6ffd700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 0x7fbca00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.750+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbcb0084d40 con 0x7fbcc00b4630 2023-10-09T15:36:35.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.751+0000 7fbcbeffd700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 0x7fbca00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:35.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.751+0000 7fbcbeffd700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 0x7fbca00696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80076a0 tx=0x7fbcb800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:35.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.755+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbcb00556f0 con 0x7fbcc00b4630 2023-10-09T15:36:35.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.953+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcc00ccf00 con 0x7fbcc00b4630 2023-10-09T15:36:35.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.954+0000 7fbcb6ffd700 1 -- 172.21.15.33:0/3156051649 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v77) v1 ==== 74+0+15305 (secure 0 0 0) 0x7fbcb0055280 con 0x7fbcc00b4630 2023-10-09T15:36:35.955 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:35.955 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":77,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:22.245493+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:19.396986+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"76","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:19.948299+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"77","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:35.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 msgr2=0x7fbca00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 0x7fbca00696b0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fbcb80076a0 tx=0x7fbcb800b040 comp rx=0 tx=0).stop 2023-10-09T15:36:35.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 msgr2=0x7fbcc00b4ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:35.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fbcb000d860 tx=0x7fbcb0008040 comp rx=0 tx=0).stop 2023-10-09T15:36:35.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 shutdown_connections 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbca0067200 0x7fbca00696b0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbcc00b4630 0x7fbcc00b4ab0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbcc00cb5a0 0x7fbcc0159a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 --2- 172.21.15.33:0/3156051649 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbcc00cd9e0 0x7fbcc014c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 >> 172.21.15.33:0/3156051649 conn(0x7fbcc0070e30 msgr2=0x7fbcc00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 shutdown_connections 2023-10-09T15:36:35.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:35.956+0000 7fbcc57af700 1 -- 172.21.15.33:0/3156051649 wait complete. 2023-10-09T15:36:35.969 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:36:36.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.088+0000 7fe5f9a40700 1 Processor -- start 2023-10-09T15:36:36.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.088+0000 7fe5f9a40700 1 -- start start 2023-10-09T15:36:36.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f9a40700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f9a40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f9a40700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5f415afd0 con 0x7fe5f40cef40 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f9a40700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe5f415b2b0 con 0x7fe5f4153c30 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f9a40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f415b590 con 0x7fe5f415de50 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f8a3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f8a3e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:37720/0 (socket says 172.21.15.33:37720) 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:35942/0 (socket says 172.21.15.33:35942) 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f8a3e700 1 -- 172.21.15.33:0/1458096580 learned_addr learned my addr 172.21.15.33:0/1458096580 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.089+0000 7fe5f923f700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe5f40cef40 0x7fe5f406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:38892/0 (socket says 172.21.15.33:38892) 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f3fff700 1 -- 172.21.15.33:0/1458096580 >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 msgr2=0x7fe5f415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f3fff700 1 --2- 172.21.15.33:0/1458096580 >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f3fff700 1 -- 172.21.15.33:0/1458096580 >> v1:172.21.15.59:6789/0 conn(0x7fe5f40cef40 legacy=0x7fe5f406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f3fff700 1 -- 172.21.15.33:0/1458096580 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f415b870 con 0x7fe5f415de50 2023-10-09T15:36:36.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f8a3e700 1 --2- 172.21.15.33:0/1458096580 >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:36.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f3fff700 1 --2- 172.21.15.33:0/1458096580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80098e0 tx=0x7fe5e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=626e8034ff8ddb88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f37fe700 1 -- 172.21.15.33:0/1458096580 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800b640 con 0x7fe5f415de50 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f37fe700 1 -- 172.21.15.33:0/1458096580 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e800b7a0 con 0x7fe5f415de50 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f37fe700 1 -- 172.21.15.33:0/1458096580 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e800bb40 con 0x7fe5f415de50 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f9a40700 1 -- 172.21.15.33:0/1458096580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 msgr2=0x7fe5f40cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/1458096580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80098e0 tx=0x7fe5e80091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f9a40700 1 -- 172.21.15.33:0/1458096580 shutdown_connections 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/1458096580 >> v2:172.21.15.59:3300/0 conn(0x7fe5f4153c30 0x7fe5f415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.090+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/1458096580 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f415de50 0x7fe5f40cea00 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.091+0000 7fe5f9a40700 1 -- 172.21.15.33:0/1458096580 >> 172.21.15.33:0/1458096580 conn(0x7fe5f40703a0 msgr2=0x7fe5f40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:36.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.091+0000 7fe5f9a40700 1 -- 172.21.15.33:0/1458096580 shutdown_connections 2023-10-09T15:36:36.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.091+0000 7fe5f9a40700 1 -- 172.21.15.33:0/1458096580 wait complete. 2023-10-09T15:36:36.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.092+0000 7fe5f9a40700 1 Processor -- start 2023-10-09T15:36:36.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.092+0000 7fe5f9a40700 1 -- start start 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 0x7fe5f4144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f415de50 0x7fe5f40b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c97c0 con 0x7fe5f4153c30 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c8bb0 con 0x7fe5f415de50 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f9a40700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5f40c8e90 con 0x7fe5f40cef40 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 0x7fe5f4144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:35954/0 (socket says 172.21.15.33:35954) 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 -- 172.21.15.33:0/2838819078 learned_addr learned my addr 172.21.15.33:0/2838819078 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:36.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f923f700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f415de50 0x7fe5f40b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 -- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f415de50 msgr2=0x7fe5f40b3ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f415de50 0x7fe5f40b3ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 -- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 msgr2=0x7fe5f4144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 0x7fe5f4144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 -- 172.21.15.33:0/2838819078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e40094f0 con 0x7fe5f40cef40 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f3fff700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 0x7fe5f4144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.093+0000 7fe5f8a3e700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400ec50 tx=0x7fe5e4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400c850 con 0x7fe5f40cef40 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5e400c9b0 con 0x7fe5f40cef40 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5e400cd50 con 0x7fe5f40cef40 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5e8009420 con 0x7fe5f40cef40 2023-10-09T15:36:36.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5f40c9450 con 0x7fe5f40cef40 2023-10-09T15:36:36.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.094+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5f404c3c0 con 0x7fe5f40cef40 2023-10-09T15:36:36.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.095+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe5e4005a00 con 0x7fe5f40cef40 2023-10-09T15:36:36.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.096+0000 7fe5f0ff9700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 0x7fe5e00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.096+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe5e4084b00 con 0x7fe5f40cef40 2023-10-09T15:36:36.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.096+0000 7fe5f3fff700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 0x7fe5e00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.096+0000 7fe5f3fff700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 0x7fe5e00696b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80091e0 tx=0x7fe5e8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.100+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe5e4051aa0 con 0x7fe5f40cef40 2023-10-09T15:36:36.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.340+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe5f40c8fd0 con 0x7fe5f40cef40 2023-10-09T15:36:36.342 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:36:36.341+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:36:36.348 INFO:tasks.ceph.mds.b.smithi059.stderr: -1776> 2023-10-09T15:36:27.251+0000 7f93741e3700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:36:36.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.349+0000 7fe5f0ff9700 1 -- 172.21.15.33:0/2838819078 <== mon.2 v2:172.21.15.59:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v51) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe5f40c8fd0 con 0x7fe5f40cef40 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 msgr2=0x7fe5e00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 0x7fe5e00696b0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fe5e80091e0 tx=0x7fe5e8017000 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 msgr2=0x7fe5f40c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe5e400ec50 tx=0x7fe5e4009250 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 shutdown_connections 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe5e0067200 0x7fe5e00696b0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe5f415de50 0x7fe5f40b3ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe5f40cef40 0x7fe5f40c9c50 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 --2- 172.21.15.33:0/2838819078 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe5f4153c30 0x7fe5f4144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 >> 172.21.15.33:0/2838819078 conn(0x7fe5f40703a0 msgr2=0x7fe5f40cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:36.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 shutdown_connections 2023-10-09T15:36:36.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.351+0000 7fe5f9a40700 1 -- 172.21.15.33:0/2838819078 wait complete. 2023-10-09T15:36:36.354 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:36:36.364 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:36:36.373 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:36:36.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.485+0000 7f692712a700 1 Processor -- start 2023-10-09T15:36:36.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.485+0000 7f692712a700 1 -- start start 2023-10-09T15:36:36.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.485+0000 7f692712a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f69200c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.485+0000 7f692712a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f69200c8bd0 0x7f69200b0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f692712a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69200adbc0 con 0x7f69200b0f80 2023-10-09T15:36:36.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f692712a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69200b1400 con 0x7f69200c8bd0 2023-10-09T15:36:36.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f692712a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c9d30 con 0x7f69200c8800 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f69256c7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f69200b0f80 0x7f69200ae050 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43128/0 (socket says 172.21.15.33:43128) 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f69256c7700 1 -- 172.21.15.33:0/1538761985 learned_addr learned my addr 172.21.15.33:0/1538761985 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3071293310 0 0) 0x7f69200adbc0 con 0x7f69200b0f80 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f6924ec6700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f69200c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6908003570 con 0x7f69200b0f80 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691ffff700 1 --2- 172.21.15.33:0/1538761985 >> v2:172.21.15.59:3300/0 conn(0x7f69200c8bd0 0x7f69200b0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 115995665 0 0) 0x7f6908003570 con 0x7f69200b0f80 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 msgr2=0x7f69200c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f69200c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 >> v2:172.21.15.59:3300/0 conn(0x7f69200c8bd0 msgr2=0x7f69200b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 --2- 172.21.15.33:0/1538761985 >> v2:172.21.15.59:3300/0 conn(0x7f69200c8bd0 0x7f69200b0a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69200acfb0 con 0x7f69200b0f80 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f69180017f0 con 0x7f69200b0f80 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 >> v1:172.21.15.33:6789/0 conn(0x7f69200b0f80 legacy=0x7f69200ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6908003a60 0x7f6908003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f6908004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6908004d50 0x7f69080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200b1400 con 0x7f6908003a60 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69200c9d30 con 0x7f6908004d50 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f690800ba60 con 0x7f69200c8800 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.486+0000 7f6924ec6700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6908003a60 0x7f6908003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f69256c7700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6908004d50 0x7f69080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f691ffff700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f6908004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 -- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 msgr2=0x7f6908004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:36.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f6908004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 -- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6908004d50 msgr2=0x7f69080051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6908004d50 0x7f69080051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 -- 172.21.15.33:0/1538761985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6908003570 con 0x7f6908003a60 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f691ffff700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f69200c8800 0x7f6908004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f6924ec6700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6908003a60 0x7f6908003e70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6910009c00 tx=0x7f69100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b0dea6090f5d0db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000e6b0 con 0x7f6908003a60 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f691000e810 con 0x7f6908003a60 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f691f7fe700 1 -- 172.21.15.33:0/1538761985 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691000ebd0 con 0x7f6908003a60 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f692712a700 1 -- 172.21.15.33:0/1538761985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6908003a60 msgr2=0x7f6908003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f692712a700 1 --2- 172.21.15.33:0/1538761985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6908003a60 0x7f6908003e70 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6910009c00 tx=0x7f69100091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.487+0000 7f69256c7700 1 -- 172.21.15.33:0/1538761985 reap_dead start 2023-10-09T15:36:36.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.488+0000 7f692712a700 1 -- 172.21.15.33:0/1538761985 shutdown_connections 2023-10-09T15:36:36.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.488+0000 7f692712a700 1 -- 172.21.15.33:0/1538761985 >> 172.21.15.33:0/1538761985 conn(0x7f692006d170 msgr2=0x7f69200cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:36.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.488+0000 7f692712a700 1 -- 172.21.15.33:0/1538761985 shutdown_connections 2023-10-09T15:36:36.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.488+0000 7f692712a700 1 -- 172.21.15.33:0/1538761985 wait complete. 2023-10-09T15:36:36.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.489+0000 7f692712a700 1 Processor -- start 2023-10-09T15:36:36.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.489+0000 7f692712a700 1 -- start start 2023-10-09T15:36:36.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6908003a60 0x7f692014ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6920155fa0 0x7f6920146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692014daf0 con 0x7f692014d110 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f692014bf20 con 0x7f6920155fa0 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f692014b310 con 0x7f6908003a60 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35314/0 (socket says 172.21.15.33:35314) 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 -- 172.21.15.33:0/3510115069 learned_addr learned my addr 172.21.15.33:0/3510115069 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f691ffff700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6920155fa0 0x7f6920146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f6924ec6700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6908003a60 0x7f692014ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 -- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6908003a60 msgr2=0x7f692014ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6908003a60 0x7f692014ad30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 -- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6920155fa0 msgr2=0x7f6920146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6920155fa0 0x7f6920146fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:36.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 -- 172.21.15.33:0/3510115069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692014b5f0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f69256c7700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f80 tx=0x7f6918002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f691800adf0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69180133f0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f692014b8d0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69180137b0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.490+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6920147510 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.491+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f692004c3c0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.492+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6918013ba0 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.492+0000 7f691cff9700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 0x7f690c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.492+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f6918085310 con 0x7f692014d110 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.492+0000 7f6924ec6700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 0x7f690c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:36.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.493+0000 7f6924ec6700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 0x7f690c0696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6910009c00 tx=0x7f691001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:36.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.497+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f69180521e0 con 0x7f692014d110 2023-10-09T15:36:36.538 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:36:36.540 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:36:36.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:36.738+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f6920063d70 con 0x7f692014d110 2023-10-09T15:36:37.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.345+0000 7f691cff9700 1 -- 172.21.15.33:0/3510115069 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v52) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6918055800 con 0x7f692014d110 2023-10-09T15:36:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 msgr2=0x7f690c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 0x7f690c0696b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f6910009c00 tx=0x7f691001a000 comp rx=0 tx=0).stop 2023-10-09T15:36:37.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 msgr2=0x7f692014d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f6918000f80 tx=0x7f6918002210 comp rx=0 tx=0).stop 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 shutdown_connections 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f690c067200 0x7f690c0696b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f692014d110 0x7f692014d5b0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6908003a60 0x7f692014ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 --2- 172.21.15.33:0/3510115069 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6920155fa0 0x7f6920146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 >> 172.21.15.33:0/3510115069 conn(0x7f692006d170 msgr2=0x7f69200afc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 shutdown_connections 2023-10-09T15:36:37.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.348+0000 7f692712a700 1 -- 172.21.15.33:0/3510115069 wait complete. 2023-10-09T15:36:37.363 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:36:37.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.487+0000 7f0818081700 1 Processor -- start 2023-10-09T15:36:37.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 -- start start 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159530 0x7f08100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f081006dcf0 0x7f0810159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08100ccfd0 con 0x7f0810159e40 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f081015a410 con 0x7f081006dcf0 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f0818081700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081015a6f0 con 0x7f0810159530 2023-10-09T15:36:37.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f081561c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f081006dcf0 0x7f0810159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f081661e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0810159e40 0x7f08100cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43144/0 (socket says 172.21.15.33:43144) 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.488+0000 7f081661e700 1 -- 172.21.15.33:0/3819140288 learned_addr learned my addr 172.21.15.33:0/3819140288 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0815e1d700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159530 0x7f08100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0814e1b700 1 -- 172.21.15.33:0/3819140288 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891591408 0 0) 0x7f08100ccfd0 con 0x7f0810159e40 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0814e1b700 1 -- 172.21.15.33:0/3819140288 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f07f8003570 con 0x7f0810159e40 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f081561c700 1 -- 172.21.15.33:0/3819140288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159530 msgr2=0x7f08100ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f081561c700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159530 0x7f08100ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f081561c700 1 -- 172.21.15.33:0/3819140288 >> v1:172.21.15.33:6789/0 conn(0x7f0810159e40 legacy=0x7f08100cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f081561c700 1 -- 172.21.15.33:0/3819140288 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f081015a9d0 con 0x7f081006dcf0 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f081561c700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810159900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f08040098e0 tx=0x7f08040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=418468a131d1eb57 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:37.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0814e1b700 1 -- 172.21.15.33:0/3819140288 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011630 con 0x7f081006dcf0 2023-10-09T15:36:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0814e1b700 1 -- 172.21.15.33:0/3819140288 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0804011790 con 0x7f081006dcf0 2023-10-09T15:36:37.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.489+0000 7f0814e1b700 1 -- 172.21.15.33:0/3819140288 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0804011b10 con 0x7f081006dcf0 2023-10-09T15:36:37.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 -- 172.21.15.33:0/3819140288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 msgr2=0x7f0810159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810159900 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f08040098e0 tx=0x7f08040091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 -- 172.21.15.33:0/3819140288 shutdown_connections 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159530 0x7f08100ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 --2- 172.21.15.33:0/3819140288 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810159900 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 -- 172.21.15.33:0/3819140288 >> 172.21.15.33:0/3819140288 conn(0x7f08100703a0 msgr2=0x7f08100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 -- 172.21.15.33:0/3819140288 shutdown_connections 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.490+0000 7f0818081700 1 -- 172.21.15.33:0/3819140288 wait complete. 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.491+0000 7f0818081700 1 Processor -- start 2023-10-09T15:36:37.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.491+0000 7f0818081700 1 -- start start 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0810159530 0x7f081015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159e40 0x7f08100c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015ecc0 con 0x7f081006dcf0 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f081015e0b0 con 0x7f0810159530 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f081015e390 con 0x7f0810159e40 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35334/0 (socket says 172.21.15.33:35334) 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 -- 172.21.15.33:0/1048384691 learned_addr learned my addr 172.21.15.33:0/1048384691 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f081661e700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159e40 0x7f08100c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f081561c700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0810159530 0x7f081015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 -- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159e40 msgr2=0x7f08100c5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159e40 0x7f08100c5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 -- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0810159530 msgr2=0x7f081015af60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0810159530 0x7f081015af60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 -- 172.21.15.33:0/1048384691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0804009420 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0815e1d700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0800009ef0 tx=0x7f080000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f080000cc20 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f080000f040 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f081015e670 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.492+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0800014480 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.493+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0810156c90 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.493+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f081004c3c0 con 0x7f081006dcf0 2023-10-09T15:36:37.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.494+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f08000147f0 con 0x7f081006dcf0 2023-10-09T15:36:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.494+0000 7f080dffb700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 0x7f07fc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.494+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f0800085590 con 0x7f081006dcf0 2023-10-09T15:36:37.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.494+0000 7f081561c700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 0x7f07fc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.495+0000 7f081561c700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 0x7f07fc0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08040091e0 tx=0x7f0804017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:37.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.499+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0800052310 con 0x7f081006dcf0 2023-10-09T15:36:37.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:37.694+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f081015acb0 con 0x7f081006dcf0 2023-10-09T15:36:38.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.349+0000 7f080dffb700 1 -- 172.21.15.33:0/1048384691 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v79) v1 ==== 181+0+0 (secure 0 0 0) 0x7f0800055930 con 0x7f081006dcf0 2023-10-09T15:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 msgr2=0x7f07fc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 0x7f07fc0696b0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f08040091e0 tx=0x7f0804017000 comp rx=0 tx=0).stop 2023-10-09T15:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 msgr2=0x7f0810156750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f0800009ef0 tx=0x7f080000b040 comp rx=0 tx=0).stop 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 shutdown_connections 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f07fc067200 0x7f07fc0696b0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f081006dcf0 0x7f0810156750 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0810159e40 0x7f08100c5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 --2- 172.21.15.33:0/1048384691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0810159530 0x7f081015af60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 >> 172.21.15.33:0/1048384691 conn(0x7f08100703a0 msgr2=0x7f0810158600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 shutdown_connections 2023-10-09T15:36:38.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.353+0000 7f0818081700 1 -- 172.21.15.33:0/1048384691 wait complete. 2023-10-09T15:36:38.356 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:36:38.369 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:36:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.496+0000 7f276359e700 1 Processor -- start 2023-10-09T15:36:38.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.496+0000 7f276359e700 1 -- start start 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 0x7f27640a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27640a9e30 0x7f276415d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27640aa2b0 con 0x7f276406c8f0 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f276415e2d0 con 0x7f27640a9e30 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640cc1c0 con 0x7f276406ccc0 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f2762d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f27640a9e30 0x7f276415d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f276406c8f0 0x7f27640cbab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43150/0 (socket says 172.21.15.33:43150) 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.497+0000 7f276259c700 1 -- 172.21.15.33:0/3713649282 learned_addr learned my addr 172.21.15.33:0/3713649282 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2761d9b700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 0x7f27640a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2762d9d700 1 -- 172.21.15.33:0/3713649282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 msgr2=0x7f27640a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2762d9d700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 0x7f27640a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2762d9d700 1 -- 172.21.15.33:0/3713649282 >> v1:172.21.15.33:6789/0 conn(0x7f276406c8f0 legacy=0x7f27640cbab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2762d9d700 1 -- 172.21.15.33:0/3713649282 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f276415dff0 con 0x7f27640a9e30 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2761d9b700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 0x7f27640a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f2762d9d700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27640a9e30 0x7f276415d370 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f275c009e60 tx=0x7f275c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9f41515078109e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f276159a700 1 -- 172.21.15.33:0/3713649282 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c00e070 con 0x7f27640a9e30 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f276159a700 1 -- 172.21.15.33:0/3713649282 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f275c00bc30 con 0x7f27640a9e30 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f276159a700 1 -- 172.21.15.33:0/3713649282 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f275c012430 con 0x7f27640a9e30 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f276359e700 1 -- 172.21.15.33:0/3713649282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27640a9e30 msgr2=0x7f276415d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.498+0000 7f276359e700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27640a9e30 0x7f276415d370 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f275c009e60 tx=0x7f275c009780 comp rx=0 tx=0).stop 2023-10-09T15:36:38.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 -- 172.21.15.33:0/3713649282 shutdown_connections 2023-10-09T15:36:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f27640a9e30 0x7f276415d370 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 --2- 172.21.15.33:0/3713649282 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f276406ccc0 0x7f27640a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 -- 172.21.15.33:0/3713649282 >> 172.21.15.33:0/3713649282 conn(0x7f276406e280 msgr2=0x7f27640cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 -- 172.21.15.33:0/3713649282 shutdown_connections 2023-10-09T15:36:38.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.499+0000 7f276359e700 1 -- 172.21.15.33:0/3713649282 wait complete. 2023-10-09T15:36:38.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 Processor -- start 2023-10-09T15:36:38.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 -- start start 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276406ccc0 0x7f27640c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27640a9e30 0x7f27640c4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640b0960 con 0x7f276406c8f0 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27640b16b0 con 0x7f276406ccc0 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.500+0000 7f276359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27640b10a0 con 0x7f27640a9e30 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35346/0 (socket says 172.21.15.33:35346) 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 -- 172.21.15.33:0/1527573572 learned_addr learned my addr 172.21.15.33:0/1527573572 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:38.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f2762d9d700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27640a9e30 0x7f27640c4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f2761d9b700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276406ccc0 0x7f27640c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 -- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27640a9e30 msgr2=0x7f27640c4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27640a9e30 0x7f27640c4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 -- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276406ccc0 msgr2=0x7f27640c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276406ccc0 0x7f27640c4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 -- 172.21.15.33:0/1527573572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c009a20 con 0x7f276406c8f0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276259c700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f275400c7c0 tx=0x7f2754007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754005b30 con 0x7f276406c8f0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2754005cb0 con 0x7f276406c8f0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2754004a80 con 0x7f276406c8f0 2023-10-09T15:36:38.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27640abbd0 con 0x7f276406c8f0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.501+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27640abeb0 con 0x7f276406c8f0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.502+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f276404c3c0 con 0x7f276406c8f0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.503+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f27540070d0 con 0x7f276406c8f0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.503+0000 7f275a7fc700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 0x7f27440696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.503+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f2754083a20 con 0x7f276406c8f0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.503+0000 7f2761d9b700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 0x7f27440696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:38.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.504+0000 7f2761d9b700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 0x7f27440696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f276415cbf0 tx=0x7f274c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:38.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.507+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f275404b5a0 con 0x7f276406c8f0 2023-10-09T15:36:38.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:38.702+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f27640cafd0 con 0x7f276406c8f0 2023-10-09T15:36:39.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.357+0000 7f275a7fc700 1 -- 172.21.15.33:0/1527573572 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v80) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2754050aa0 con 0x7f276406c8f0 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 msgr2=0x7f27440696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 0x7f27440696b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f276415cbf0 tx=0x7f274c008040 comp rx=0 tx=0).stop 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 msgr2=0x7f27641565e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f275400c7c0 tx=0x7f2754007f70 comp rx=0 tx=0).stop 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 shutdown_connections 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2744067200 0x7f27440696b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f276406c8f0 0x7f27641565e0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27640a9e30 0x7f27640c4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 --2- 172.21.15.33:0/1527573572 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f276406ccc0 0x7f27640c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 >> 172.21.15.33:0/1527573572 conn(0x7f276406e280 msgr2=0x7f27640687c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 shutdown_connections 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.361+0000 7f276359e700 1 -- 172.21.15.33:0/1527573572 wait complete. 2023-10-09T15:36:39.363 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:36:39.377 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:36:39.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.508+0000 7fac2743f700 1 Processor -- start 2023-10-09T15:36:39.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 -- start start 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fac20159530 0x7fac200ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac2006e0e0 0x7fac200cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac200ccfd0 con 0x7fac2006dc70 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac200cf0e0 con 0x7fac2006e0e0 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac2743f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac2015a3d0 con 0x7fac20159530 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.509+0000 7fac259dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac2006e0e0 0x7fac200cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fac2006e0e0 0x7fac200cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35354/0 (socket says 172.21.15.33:35354) 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 -- 172.21.15.33:0/2894306382 learned_addr learned my addr 172.21.15.33:0/2894306382 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac251db700 1 --2- 172.21.15.33:0/2894306382 >> v2:172.21.15.59:3300/0 conn(0x7fac20159530 0x7fac200ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 -- 172.21.15.33:0/2894306382 >> v2:172.21.15.59:3300/0 conn(0x7fac20159530 msgr2=0x7fac200ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 --2- 172.21.15.33:0/2894306382 >> v2:172.21.15.59:3300/0 conn(0x7fac20159530 0x7fac200ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 -- 172.21.15.33:0/2894306382 >> v1:172.21.15.59:6789/0 conn(0x7fac2006dc70 legacy=0x7fac20159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 -- 172.21.15.33:0/2894306382 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac2015a6b0 con 0x7fac2006e0e0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac259dc700 1 --2- 172.21.15.33:0/2894306382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200cb6f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fac2006d630 tx=0x7fac18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a8fb546174e8b50 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac1ffff700 1 -- 172.21.15.33:0/2894306382 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800b820 con 0x7fac2006e0e0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac1ffff700 1 -- 172.21.15.33:0/2894306382 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac1800b980 con 0x7fac2006e0e0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.510+0000 7fac1ffff700 1 -- 172.21.15.33:0/2894306382 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac1800bd20 con 0x7fac2006e0e0 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 -- 172.21.15.33:0/2894306382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 msgr2=0x7fac200cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 --2- 172.21.15.33:0/2894306382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200cb6f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7fac2006d630 tx=0x7fac18009250 comp rx=0 tx=0).stop 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 -- 172.21.15.33:0/2894306382 shutdown_connections 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 --2- 172.21.15.33:0/2894306382 >> v2:172.21.15.59:3300/0 conn(0x7fac20159530 0x7fac200ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 --2- 172.21.15.33:0/2894306382 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200cb6f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 -- 172.21.15.33:0/2894306382 >> 172.21.15.33:0/2894306382 conn(0x7fac200703a0 msgr2=0x7fac200707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 -- 172.21.15.33:0/2894306382 shutdown_connections 2023-10-09T15:36:39.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.511+0000 7fac2743f700 1 -- 172.21.15.33:0/2894306382 wait complete. 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.512+0000 7fac2743f700 1 Processor -- start 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.512+0000 7fac2743f700 1 -- start start 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac2006dc70 0x7fac201518a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac20159530 0x7fac2014e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac2014e9b0 con 0x7fac2006e0e0 2023-10-09T15:36:39.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c8a10 con 0x7fac2006dc70 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac2743f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac200c8730 con 0x7fac20159530 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35370/0 (socket says 172.21.15.33:35370) 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 -- 172.21.15.33:0/4226615227 learned_addr learned my addr 172.21.15.33:0/4226615227 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac251db700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac2006dc70 0x7fac201518a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac259dc700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac20159530 0x7fac2014e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 -- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac20159530 msgr2=0x7fac2014e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac20159530 0x7fac2014e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 -- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac2006dc70 msgr2=0x7fac201518a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac2006dc70 0x7fac201518a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.513+0000 7fac249da700 1 -- 172.21.15.33:0/4226615227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac180094f0 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac249da700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c5d0 tx=0x7fac14007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011590 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac14011710 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac200b45e0 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac14011ad0 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.514+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac200b4ba0 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.515+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac2004c3c0 con 0x7fac2006e0e0 2023-10-09T15:36:39.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.515+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fac1401c460 con 0x7fac2006e0e0 2023-10-09T15:36:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.516+0000 7fac1d7fa700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 0x7fac0c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.516+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fac14084340 con 0x7fac2006e0e0 2023-10-09T15:36:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.516+0000 7fac251db700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 0x7fac0c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.516+0000 7fac251db700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 0x7fac0c0696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fac100075a0 tx=0x7fac100097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.520+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac14051560 con 0x7fac2006e0e0 2023-10-09T15:36:39.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.715+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fac2015a990 con 0x7fac2006e0e0 2023-10-09T15:36:39.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.719+0000 7fac1d7fa700 1 -- 172.21.15.33:0/4226615227 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7fac14054b80 con 0x7fac2006e0e0 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 msgr2=0x7fac0c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 0x7fac0c0696b0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7fac100075a0 tx=0x7fac100097e0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 msgr2=0x7fac200c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fac1400c5d0 tx=0x7fac14007f60 comp rx=0 tx=0).stop 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 shutdown_connections 2023-10-09T15:36:39.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac0c067200 0x7fac0c0696b0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fac20159530 0x7fac2014e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac2006dc70 0x7fac201518a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 --2- 172.21.15.33:0/4226615227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac2006e0e0 0x7fac200c8030 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 >> 172.21.15.33:0/4226615227 conn(0x7fac200703a0 msgr2=0x7fac200b2840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 shutdown_connections 2023-10-09T15:36:39.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.721+0000 7fac2743f700 1 -- 172.21.15.33:0/4226615227 wait complete. 2023-10-09T15:36:39.734 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag' 2023-10-09T15:36:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.852+0000 7fcb91634700 1 Processor -- start 2023-10-09T15:36:39.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.852+0000 7fcb91634700 1 -- start start 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c0c95c0 0x7fcb8c0aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb8c0caa00 0x7fcb8c0c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb8c157290 0x7fcb8c157730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c3d00 con 0x7fcb8c157290 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c3110 con 0x7fcb8c0caa00 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb91634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c33d0 con 0x7fcb8c0c95c0 2023-10-09T15:36:39.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb90e33700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb8c157290 0x7fcb8c157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb90e33700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcb8c157290 0x7fcb8c157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35386/0 (socket says 172.21.15.33:35386) 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.853+0000 7fcb90e33700 1 -- 172.21.15.33:0/839474809 learned_addr learned my addr 172.21.15.33:0/839474809 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb8bfff700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c0c95c0 0x7fcb8c0aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb8b7fe700 1 --2- 172.21.15.33:0/839474809 >> v2:172.21.15.59:3300/0 conn(0x7fcb8c0caa00 0x7fcb8c0c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 -- 172.21.15.33:0/839474809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c0c95c0 msgr2=0x7fcb8c0aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c0c95c0 0x7fcb8c0aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 -- 172.21.15.33:0/839474809 >> v2:172.21.15.59:3300/0 conn(0x7fcb8c0caa00 msgr2=0x7fcb8c0c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 --2- 172.21.15.33:0/839474809 >> v2:172.21.15.59:3300/0 conn(0x7fcb8c0caa00 0x7fcb8c0c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 -- 172.21.15.33:0/839474809 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb8c0c36b0 con 0x7fcb8c157290 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb90e33700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c157290 0x7fcb8c157730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06b750 tx=0x7fcb84009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5056285f4fbc332 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb8affd700 1 -- 172.21.15.33:0/839474809 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8400e070 con 0x7fcb8c157290 2023-10-09T15:36:39.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb8affd700 1 -- 172.21.15.33:0/839474809 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb8400b970 con 0x7fcb8c157290 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.854+0000 7fcb8affd700 1 -- 172.21.15.33:0/839474809 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb840092e0 con 0x7fcb8c157290 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 -- 172.21.15.33:0/839474809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c157290 msgr2=0x7fcb8c157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c157290 0x7fcb8c157730 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fcb8c06b750 tx=0x7fcb84009840 comp rx=0 tx=0).stop 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 -- 172.21.15.33:0/839474809 shutdown_connections 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c157290 0x7fcb8c157730 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 --2- 172.21.15.33:0/839474809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c0c95c0 0x7fcb8c0aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 --2- 172.21.15.33:0/839474809 >> v2:172.21.15.59:3300/0 conn(0x7fcb8c0caa00 0x7fcb8c0c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 -- 172.21.15.33:0/839474809 >> 172.21.15.33:0/839474809 conn(0x7fcb8c088000 msgr2=0x7fcb8c0ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 -- 172.21.15.33:0/839474809 shutdown_connections 2023-10-09T15:36:39.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.855+0000 7fcb91634700 1 -- 172.21.15.33:0/839474809 wait complete. 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.856+0000 7fcb91634700 1 Processor -- start 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.856+0000 7fcb91634700 1 -- start start 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8c0c95c0 0x7fcb8c14fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c157290 0x7fcb8c0c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0cd010 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0c78e0 con 0x7fcb8c0c95c0 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb91634700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb8c0adcd0 con 0x7fcb8c157290 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35394/0 (socket says 172.21.15.33:35394) 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 -- 172.21.15.33:0/2662496881 learned_addr learned my addr 172.21.15.33:0/2662496881 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb8bfff700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8c0c95c0 0x7fcb8c14fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb8b7fe700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c157290 0x7fcb8c0c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 -- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c157290 msgr2=0x7fcb8c0c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c157290 0x7fcb8c0c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 -- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8c0c95c0 msgr2=0x7fcb8c14fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8c0c95c0 0x7fcb8c14fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:39.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 -- 172.21.15.33:0/2662496881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb84009ae0 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.857+0000 7fcb90e33700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009880 tx=0x7fcb84018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.858+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb84008bc0 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.858+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb84008d40 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.858+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb8c0adfb0 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.858+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb8401c660 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.858+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb8c0ae570 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.859+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8c0ae760 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.859+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fcb84003040 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.859+0000 7fcb83fff700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 0x7fcb6c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.859+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fcb84086010 con 0x7fcb8c0c72d0 2023-10-09T15:36:39.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.859+0000 7fcb8bfff700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 0x7fcb6c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.860+0000 7fcb8bfff700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 0x7fcb6c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009d30 tx=0x7fcb74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:39.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:39.864+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb84053120 con 0x7fcb8c0c72d0 2023-10-09T15:36:40.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.137+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]} v 0) v1 -- 0x7fcb8c04c3c0 con 0x7fcb8c0c72d0 2023-10-09T15:36:40.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.356+0000 7fcb83fff700 1 -- 172.21.15.33:0/2662496881 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag"]}]=0 v267) v1 ==== 158+0+0 (secure 0 0 0) 0x7fcb84056740 con 0x7fcb8c0c72d0 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 msgr2=0x7fcb6c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 0x7fcb6c0696b0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009d30 tx=0x7fcb74008040 comp rx=0 tx=0).stop 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 msgr2=0x7fcb8c15c100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7fcb84009880 tx=0x7fcb84018000 comp rx=0 tx=0).stop 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 shutdown_connections 2023-10-09T15:36:40.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb6c067200 0x7fcb6c0696b0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb8c0c72d0 0x7fcb8c15c100 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb8c0c95c0 0x7fcb8c14fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 --2- 172.21.15.33:0/2662496881 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb8c157290 0x7fcb8c0c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 >> 172.21.15.33:0/2662496881 conn(0x7fcb8c088000 msgr2=0x7fcb8c0ad3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 shutdown_connections 2023-10-09T15:36:40.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.358+0000 7fcb91634700 1 -- 172.21.15.33:0/2662496881 wait complete. 2023-10-09T15:36:40.372 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command ... ok 2023-10-09T15:36:40.372 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info --human_readable' command without subvolume group 2023-10-09T15:36:40.372 INFO:tasks.cephfs_test_runner:test_volume_info_with_human_readable_flag_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:36:40.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-09T15:36:40.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.492+0000 7f9a958da700 1 Processor -- start 2023-10-09T15:36:40.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.492+0000 7f9a958da700 1 -- start start 2023-10-09T15:36:40.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a958da700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9a900cb5a0 0x7f9a900cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a958da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 0x7f9a90159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a958da700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9015ae40 con 0x7f9a900cde50 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a958da700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a900d13f0 con 0x7f9a900cb5a0 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a958da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9015ab60 con 0x7f9a900cd9e0 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a8effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9a900cb5a0 0x7f9a900cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a8f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9a900cde50 0x7f9a90156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43158/0 (socket says 172.21.15.33:43158) 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a8f7fe700 1 -- 172.21.15.33:0/2800641494 learned_addr learned my addr 172.21.15.33:0/2800641494 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:40.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.493+0000 7f9a8e7fc700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 0x7f9a90159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8effd700 1 -- 172.21.15.33:0/2800641494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 msgr2=0x7f9a90159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8effd700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 0x7f9a90159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8effd700 1 -- 172.21.15.33:0/2800641494 >> v1:172.21.15.33:6789/0 conn(0x7f9a900cde50 legacy=0x7f9a90156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8dffb700 1 -- 172.21.15.33:0/2800641494 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 903532578 0 0) 0x7f9a9015ae40 con 0x7f9a900cde50 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8effd700 1 -- 172.21.15.33:0/2800641494 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a900ccf00 con 0x7f9a900cb5a0 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8e7fc700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 0x7f9a90159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8effd700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cb5a0 0x7f9a900cb970 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c091c3804139111 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8dffb700 1 -- 172.21.15.33:0/2800641494 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a8000e070 con 0x7f9a900cb5a0 2023-10-09T15:36:40.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8dffb700 1 -- 172.21.15.33:0/2800641494 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a8000bc30 con 0x7f9a900cb5a0 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a8dffb700 1 -- 172.21.15.33:0/2800641494 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a80012430 con 0x7f9a900cb5a0 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 -- 172.21.15.33:0/2800641494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cb5a0 msgr2=0x7f9a900cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cb5a0 0x7f9a900cb970 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80009780 comp rx=0 tx=0).stop 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 -- 172.21.15.33:0/2800641494 shutdown_connections 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cb5a0 0x7f9a900cb970 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 --2- 172.21.15.33:0/2800641494 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cd9e0 0x7f9a90159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.494+0000 7f9a958da700 1 -- 172.21.15.33:0/2800641494 >> 172.21.15.33:0/2800641494 conn(0x7f9a90070e30 msgr2=0x7f9a900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.495+0000 7f9a958da700 1 -- 172.21.15.33:0/2800641494 shutdown_connections 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.495+0000 7f9a958da700 1 -- 172.21.15.33:0/2800641494 wait complete. 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 Processor -- start 2023-10-09T15:36:40.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 -- start start 2023-10-09T15:36:40.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 0x7f9a90142730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 0x7f9a90152d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9013fa80 con 0x7f9a900cd9e0 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a90142c70 con 0x7f9a90150e00 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.496+0000 7f9a958da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a900b4de0 con 0x7f9a900cb5a0 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35406/0 (socket says 172.21.15.33:35406) 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 -- 172.21.15.33:0/3033530960 learned_addr learned my addr 172.21.15.33:0/3033530960 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8f7fe700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 0x7f9a90152d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8effd700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 0x7f9a90142730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 -- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 msgr2=0x7f9a90142730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 0x7f9a90142730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 -- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 msgr2=0x7f9a90152d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 0x7f9a90152d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 -- 172.21.15.33:0/3033530960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a80009a20 con 0x7f9a900cd9e0 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8f7fe700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 0x7f9a90152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8effd700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 0x7f9a90142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a8e7fc700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e8d0 tx=0x7f9a78008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800ee70 con 0x7f9a900cd9e0 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a7800c5e0 con 0x7f9a900cd9e0 2023-10-09T15:36:40.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a9015b5b0 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a7800c980 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.497+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9015bb10 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.498+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9004c3c0 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.499+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f9a7800cd30 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.499+0000 7f9a86ffd700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 0x7f9a700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.499+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9a78084610 con 0x7f9a900cd9e0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.499+0000 7f9a8effd700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 0x7f9a700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:40.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.500+0000 7f9a8effd700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 0x7f9a700696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:40.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.503+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a78051640 con 0x7f9a900cd9e0 2023-10-09T15:36:40.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:40.776+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f9a900cd1e0 con 0x7f9a900cd9e0 2023-10-09T15:36:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.356+0000 7f9a86ffd700 1 -- 172.21.15.33:0/3033530960 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v268) v1 ==== 184+0+0 (secure 0 0 0) 0x7f9a78054c60 con 0x7f9a900cd9e0 2023-10-09T15:36:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 msgr2=0x7f9a700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 0x7f9a700696b0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f9a80009e60 tx=0x7f9a80019000 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 msgr2=0x7f9a9015b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800e8d0 tx=0x7f9a78008040 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 shutdown_connections 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a70067200 0x7f9a700696b0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a90150e00 0x7f9a90152d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a900cb5a0 0x7f9a90142730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 --2- 172.21.15.33:0/3033530960 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a900cd9e0 0x7f9a9015b070 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 >> 172.21.15.33:0/3033530960 conn(0x7f9a90070e30 msgr2=0x7f9a900ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 shutdown_connections 2023-10-09T15:36:41.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.358+0000 7f9a958da700 1 -- 172.21.15.33:0/3033530960 wait complete. 2023-10-09T15:36:41.373 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:36:41.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.497+0000 7f0f6749b700 1 Processor -- start 2023-10-09T15:36:41.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.497+0000 7f0f6749b700 1 -- start start 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f6749b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f60157930 0x7f0f600ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f6749b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ca2c0 0x7f0f600ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f6749b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f600c32a0 con 0x7f0f600ccba0 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f6749b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f600c9730 con 0x7f0f60157930 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f6749b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600c4100 con 0x7f0f600ca2c0 2023-10-09T15:36:41.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f65237700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f60157930 0x7f0f600ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f65a38700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f600ccba0 0x7f0f600c4590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56816/0 (socket says 172.21.15.33:56816) 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.498+0000 7f0f65a38700 1 -- 172.21.15.33:0/2181433051 learned_addr learned my addr 172.21.15.33:0/2181433051 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f64a36700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ca2c0 0x7f0f600ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f65237700 1 -- 172.21.15.33:0/2181433051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ca2c0 msgr2=0x7f0f600ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f65237700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ca2c0 0x7f0f600ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f65237700 1 -- 172.21.15.33:0/2181433051 >> v1:172.21.15.33:6789/0 conn(0x7f0f600ccba0 legacy=0x7f0f600c4590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f5ffff700 1 -- 172.21.15.33:0/2181433051 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1722221856 0 0) 0x7f0f600c32a0 con 0x7f0f600ccba0 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f65237700 1 -- 172.21.15.33:0/2181433051 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f600c34f0 con 0x7f0f60157930 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f65237700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f600ab070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098e0 tx=0x7f0f580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf2deeebc48ca583 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f5ffff700 1 -- 172.21.15.33:0/2181433051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f58009e80 con 0x7f0f60157930 2023-10-09T15:36:41.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f5ffff700 1 -- 172.21.15.33:0/2181433051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5800b860 con 0x7f0f60157930 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.499+0000 7f0f5ffff700 1 -- 172.21.15.33:0/2181433051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5800bbe0 con 0x7f0f60157930 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 -- 172.21.15.33:0/2181433051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 msgr2=0x7f0f600ab070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f600ab070 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f0f580098e0 tx=0x7f0f580091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 -- 172.21.15.33:0/2181433051 shutdown_connections 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f600ab070 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2181433051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ca2c0 0x7f0f600ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 -- 172.21.15.33:0/2181433051 >> 172.21.15.33:0/2181433051 conn(0x7f0f60088000 msgr2=0x7f0f600883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 -- 172.21.15.33:0/2181433051 shutdown_connections 2023-10-09T15:36:41.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.500+0000 7f0f6749b700 1 -- 172.21.15.33:0/2181433051 wait complete. 2023-10-09T15:36:41.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.501+0000 7f0f6749b700 1 Processor -- start 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.501+0000 7f0f6749b700 1 -- start start 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f600ca2c0 0x7f0f60154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ccba0 0x7f0f600b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6006e2d0 con 0x7f0f60157930 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f600b3020 con 0x7f0f600ca2c0 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60154850 con 0x7f0f600ccba0 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53192/0 (socket says 172.21.15.33:53192) 2023-10-09T15:36:41.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 -- 172.21.15.33:0/2321286779 learned_addr learned my addr 172.21.15.33:0/2321286779 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f64a36700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ccba0 0x7f0f600b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65237700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f600ca2c0 0x7f0f60154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 -- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ccba0 msgr2=0x7f0f600b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ccba0 0x7f0f600b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 -- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f600ca2c0 msgr2=0x7f0f60154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f600ca2c0 0x7f0f60154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 -- 172.21.15.33:0/2321286779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f58009420 con 0x7f0f60157930 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f65a38700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000cc90 tx=0x7f0f50001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5000cea0 con 0x7f0f60157930 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5000ab70 con 0x7f0f60157930 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f600b2410 con 0x7f0f60157930 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.502+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f500070f0 con 0x7f0f60157930 2023-10-09T15:36:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.503+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f600b29d0 con 0x7f0f60157930 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.503+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f600b3190 con 0x7f0f60157930 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.504+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0f50007460 con 0x7f0f60157930 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.504+0000 7f0f5d7fa700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 0x7f0f4c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.504+0000 7f0f65237700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 0x7f0f4c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.504+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f0f50084ac0 con 0x7f0f60157930 2023-10-09T15:36:41.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.505+0000 7f0f65237700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 0x7f0f4c0696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0f580091e0 tx=0x7f0f58017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.509+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f50051d60 con 0x7f0f60157930 2023-10-09T15:36:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.702+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0f6004c3c0 con 0x7f0f60157930 2023-10-09T15:36:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.705+0000 7f0f5d7fa700 1 -- 172.21.15.33:0/2321286779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0f50055380 con 0x7f0f60157930 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 msgr2=0x7f0f4c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 0x7f0f4c0696b0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f0f580091e0 tx=0x7f0f58017000 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 msgr2=0x7f0f6006ee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000cc90 tx=0x7f0f50001a80 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 shutdown_connections 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f4c067200 0x7f0f4c0696b0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f60157930 0x7f0f6006ee80 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f600ca2c0 0x7f0f60154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 --2- 172.21.15.33:0/2321286779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f600ccba0 0x7f0f600b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 >> 172.21.15.33:0/2321286779 conn(0x7f0f60088000 msgr2=0x7f0f600639f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 shutdown_connections 2023-10-09T15:36:41.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.707+0000 7f0f6749b700 1 -- 172.21.15.33:0/2321286779 wait complete. 2023-10-09T15:36:41.720 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:36:41.721 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:41.755 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:41.801 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:36:41.802 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:36:41.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:41.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.920+0000 7f424186c700 1 Processor -- start 2023-10-09T15:36:41.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.920+0000 7f424186c700 1 -- start start 2023-10-09T15:36:41.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f423c0b07d0 0x7f423c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0cf200 0x7f423c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f423c0b0ba0 0x7f423c06e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c15a280 con 0x7f423c0b0ba0 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f423c06e180 con 0x7f423c0b07d0 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f424186c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c0cd540 con 0x7f423c0cf200 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f423c0b0ba0 0x7f423c06e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f423c0b0ba0 0x7f423c06e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53194/0 (socket says 172.21.15.33:53194) 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 -- 172.21.15.33:0/4108090341 learned_addr learned my addr 172.21.15.33:0/4108090341 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423a7fc700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0cf200 0x7f423c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423affd700 1 --2- 172.21.15.33:0/4108090341 >> v2:172.21.15.59:3300/0 conn(0x7f423c0b07d0 0x7f423c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 -- 172.21.15.33:0/4108090341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0cf200 msgr2=0x7f423c0cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0cf200 0x7f423c0cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 -- 172.21.15.33:0/4108090341 >> v2:172.21.15.59:3300/0 conn(0x7f423c0b07d0 msgr2=0x7f423c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4108090341 >> v2:172.21.15.59:3300/0 conn(0x7f423c0b07d0 0x7f423c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 -- 172.21.15.33:0/4108090341 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f423c06d850 con 0x7f423c0b0ba0 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.921+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0b0ba0 0x7f423c06e610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f423c064720 tx=0x7f4234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95d024d8d141469 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f4239ffb700 1 -- 172.21.15.33:0/4108090341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400b8f0 con 0x7f423c0b0ba0 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f4239ffb700 1 -- 172.21.15.33:0/4108090341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423400ba50 con 0x7f423c0b0ba0 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f4239ffb700 1 -- 172.21.15.33:0/4108090341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423400bdf0 con 0x7f423c0b0ba0 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 -- 172.21.15.33:0/4108090341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0b0ba0 msgr2=0x7f423c06e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0b0ba0 0x7f423c06e610 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f423c064720 tx=0x7f4234009250 comp rx=0 tx=0).stop 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 -- 172.21.15.33:0/4108090341 shutdown_connections 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 --2- 172.21.15.33:0/4108090341 >> v2:172.21.15.59:3300/0 conn(0x7f423c0b07d0 0x7f423c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0b0ba0 0x7f423c06e610 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 --2- 172.21.15.33:0/4108090341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0cf200 0x7f423c0cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 -- 172.21.15.33:0/4108090341 >> 172.21.15.33:0/4108090341 conn(0x7f423c06ce80 msgr2=0x7f423c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 -- 172.21.15.33:0/4108090341 shutdown_connections 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.922+0000 7f424186c700 1 -- 172.21.15.33:0/4108090341 wait complete. 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.923+0000 7f424186c700 1 Processor -- start 2023-10-09T15:36:41.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 -- start start 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c0b07d0 0x7f423c152a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0b0ba0 0x7f423c157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1550e0 con 0x7f423c0cf200 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f423c1547b0 con 0x7f423c0b07d0 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f424186c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f423c154a90 con 0x7f423c0b0ba0 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f423b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f423b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53196/0 (socket says 172.21.15.33:53196) 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f423b7fe700 1 -- 172.21.15.33:0/4043963531 learned_addr learned my addr 172.21.15.33:0/4043963531 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f423a7fc700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0b0ba0 0x7f423c157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.924+0000 7f423affd700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c0b07d0 0x7f423c152a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 -- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0b0ba0 msgr2=0x7f423c157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0b0ba0 0x7f423c157ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 -- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c0b07d0 msgr2=0x7f423c152a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c0b07d0 0x7f423c152a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 -- 172.21.15.33:0/4043963531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42340094f0 con 0x7f423c0cf200 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f423b7fe700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f423c06af10 tx=0x7f4234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4234011e80 con 0x7f423c0cf200 2023-10-09T15:36:41.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f423401a630 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f423c154d70 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f423401a9f0 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.925+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f423c152f60 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.926+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f423c0c90b0 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.926+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f423402e430 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.927+0000 7f4232ffd700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 0x7f421c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.927+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4234086290 con 0x7f423c0cf200 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.927+0000 7f423affd700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 0x7f421c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:41.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.927+0000 7f423affd700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 0x7f421c0696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f422c007680 tx=0x7f422c0098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:41.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:41.931+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42340534b0 con 0x7f423c0cf200 2023-10-09T15:36:42.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.168+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f423c04c3c0 con 0x7f423c0cf200 2023-10-09T15:36:42.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.169+0000 7f4232ffd700 1 -- 172.21.15.33:0/4043963531 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f4234015de0 con 0x7f423c0cf200 2023-10-09T15:36:42.170 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:42.170 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":52,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5375,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2132063623","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2132063623},{"type":"v1","addr":"172.21.15.33:6837","nonce":2132063623}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":5806,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1733970864","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1733970864},{"type":"v1","addr":"172.21.15.59:6834","nonce":1733970864}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44},{"gid":6040,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/913802994","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":913802994},{"type":"v1","addr":"172.21.15.59:6835","nonce":913802994}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":52},{"gid":6093,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1367755842","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1367755842},{"type":"v1","addr":"172.21.15.33:6836","nonce":1367755842}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":44}],"filesystems":[]} 2023-10-09T15:36:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 msgr2=0x7f421c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 0x7f421c0696b0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f422c007680 tx=0x7f422c0098d0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 msgr2=0x7f423c158430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f423c06af10 tx=0x7f4234017000 comp rx=0 tx=0).stop 2023-10-09T15:36:42.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 shutdown_connections 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f421c067200 0x7f421c0696b0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f423c0cf200 0x7f423c158430 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f423c0b07d0 0x7f423c152a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 --2- 172.21.15.33:0/4043963531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f423c0b0ba0 0x7f423c157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 >> 172.21.15.33:0/4043963531 conn(0x7f423c06ce80 msgr2=0x7f423c0cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 shutdown_connections 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.171+0000 7f424186c700 1 -- 172.21.15.33:0/4043963531 wait complete. 2023-10-09T15:36:42.173 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 52 2023-10-09T15:36:42.184 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:36:42.184 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:36:42.184 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:36:42.185 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:42.185 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:36:42.185 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:36:42.185 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:36:42.185 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:42.185 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:36:42.186 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:36:42.186 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:36:42.186 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:42.186 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:36:42.186 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:36:42.186 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:36:42.187 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:36:42.193 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:36:42.193 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:36:42.194 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:36:42.194 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:36:42.197 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:36:42.197 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:36:42.198 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:36:42.198 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:36:42.235 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:36:42.235 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:42.236 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:36:42.236 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:42.239 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:36:42.239 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:42.240 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:36:42.240 DEBUG:teuthology.parallel:result is None 2023-10-09T15:36:42.240 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:36:42.312 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:36:42.312 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:36:42.323 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:36:42.324 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:36:42.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.368+0000 7efc829b2700 1 Processor -- start 2023-10-09T15:36:42.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.368+0000 7efc829b2700 1 -- start start 2023-10-09T15:36:42.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc829b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c13fcc0 0x7efc7c156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc829b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc7c070410 0x7efc7c160120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc829b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc7c0c3a30 con 0x7efc7c0c29b0 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc829b2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0c2e20 con 0x7efc7c070410 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc829b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0c3100 con 0x7efc7c13fcc0 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc7c070410 0x7efc7c160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc7b7fe700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7efc7c0c29b0 0x7efc7c0c43a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:36010/0 (socket says 172.21.15.33:36010) 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7efc7c070410 0x7efc7c160120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:35002/0 (socket says 172.21.15.33:35002) 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc7b7fe700 1 -- 172.21.15.33:0/2068185289 learned_addr learned my addr 172.21.15.33:0/2068185289 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 -- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c13fcc0 msgr2=0x7efc7c156af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 --2- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c13fcc0 0x7efc7c156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 -- 172.21.15.33:0/2068185289 >> v1:172.21.15.59:6789/0 conn(0x7efc7c0c29b0 legacy=0x7efc7c0c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.369+0000 7efc80f4f700 1 -- 172.21.15.33:0/2068185289 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0c33e0 con 0x7efc7c070410 2023-10-09T15:36:42.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.370+0000 7efc80f4f700 1 --2- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c070410 0x7efc7c160120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e60 tx=0x7efc74009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f828204a444313 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.370+0000 7efc7affd700 1 -- 172.21.15.33:0/2068185289 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7400e070 con 0x7efc7c070410 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.370+0000 7efc7affd700 1 -- 172.21.15.33:0/2068185289 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc7400bc30 con 0x7efc7c070410 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.370+0000 7efc7affd700 1 -- 172.21.15.33:0/2068185289 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc74012430 con 0x7efc7c070410 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 -- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c070410 msgr2=0x7efc7c160120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 --2- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c070410 0x7efc7c160120 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7efc74009e60 tx=0x7efc74009780 comp rx=0 tx=0).stop 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 -- 172.21.15.33:0/2068185289 shutdown_connections 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 --2- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c070410 0x7efc7c160120 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 --2- 172.21.15.33:0/2068185289 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c13fcc0 0x7efc7c156af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 -- 172.21.15.33:0/2068185289 >> 172.21.15.33:0/2068185289 conn(0x7efc7c0ccb60 msgr2=0x7efc7c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 -- 172.21.15.33:0/2068185289 shutdown_connections 2023-10-09T15:36:42.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.371+0000 7efc829b2700 1 -- 172.21.15.33:0/2068185289 wait complete. 2023-10-09T15:36:42.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.372+0000 7efc829b2700 1 Processor -- start 2023-10-09T15:36:42.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.372+0000 7efc829b2700 1 -- start start 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c070410 0x7efc7c136100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c13fcc0 0x7efc7c1679f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c136640 con 0x7efc7c0c29b0 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c168860 con 0x7efc7c13fcc0 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc829b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c140fa0 con 0x7efc7c070410 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53234/0 (socket says 172.21.15.33:53234) 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 -- 172.21.15.33:0/2834234064 learned_addr learned my addr 172.21.15.33:0/2834234064 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:42.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc80f4f700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c13fcc0 0x7efc7c1679f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7bfff700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c070410 0x7efc7c136100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 -- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c070410 msgr2=0x7efc7c136100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c070410 0x7efc7c136100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 -- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c13fcc0 msgr2=0x7efc7c1679f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c13fcc0 0x7efc7c1679f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 -- 172.21.15.33:0/2834234064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc74009a20 con 0x7efc7c0c29b0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc7b7fe700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c7c0 tx=0x7efc70007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.373+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70005b30 con 0x7efc7c0c29b0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.374+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70005c90 con 0x7efc7c0c29b0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.374+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70004a80 con 0x7efc7c0c29b0 2023-10-09T15:36:42.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.374+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c141280 con 0x7efc7c0c29b0 2023-10-09T15:36:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.374+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c141840 con 0x7efc7c0c29b0 2023-10-09T15:36:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c04c3c0 con 0x7efc7c0c29b0 2023-10-09T15:36:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.375+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7efc700070d0 con 0x7efc7c0c29b0 2023-10-09T15:36:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.375+0000 7efc63fff700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 0x7efc680696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:42.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.376+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 4939+0+0 (secure 0 0 0) 0x7efc70083980 con 0x7efc7c0c29b0 2023-10-09T15:36:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.376+0000 7efc7bfff700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 0x7efc680696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:42.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.376+0000 7efc7bfff700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 0x7efc680696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc7c140470 tx=0x7efc6c0090f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:42.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.380+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efc7004b5a0 con 0x7efc7c0c29b0 2023-10-09T15:36:42.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:42.591+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7efc7c0c36c0 con 0x7efc7c0c29b0 2023-10-09T15:36:43.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.373+0000 7efc63fff700 1 -- 172.21.15.33:0/2834234064 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v85) v1 ==== 97+0+0 (secure 0 0 0) 0x7efc70050ba0 con 0x7efc7c0c29b0 2023-10-09T15:36:43.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 msgr2=0x7efc680696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 0x7efc680696b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7efc7c140470 tx=0x7efc6c0090f0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 msgr2=0x7efc7c1404e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c7c0 tx=0x7efc70007f70 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 shutdown_connections 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efc68067200 0x7efc680696b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efc7c13fcc0 0x7efc7c1679f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efc7c070410 0x7efc7c136100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 --2- 172.21.15.33:0/2834234064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efc7c0c29b0 0x7efc7c1404e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 >> 172.21.15.33:0/2834234064 conn(0x7efc7c0ccb60 msgr2=0x7efc7c06a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:43.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 shutdown_connections 2023-10-09T15:36:43.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.375+0000 7efc829b2700 1 -- 172.21.15.33:0/2834234064 wait complete. 2023-10-09T15:36:43.378 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:36:43.391 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:36:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.516+0000 7f32aec59700 1 Processor -- start 2023-10-09T15:36:43.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.516+0000 7f32aec59700 1 -- start start 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32aec59700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32a80cb5a0 0x7f32a80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32aec59700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32a80cd9e0 0x7f32a8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32aec59700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32a815ae40 con 0x7f32a815a400 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32aec59700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a80d13f0 con 0x7f32a80cd9e0 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32aec59700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32a815ab60 con 0x7f32a80cb5a0 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32a7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32a80cd9e0 0x7f32a8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32ad1f6700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f32a815a400 0x7f32a8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56836/0 (socket says 172.21.15.33:56836) 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.517+0000 7f32ad1f6700 1 -- 172.21.15.33:0/1950193296 learned_addr learned my addr 172.21.15.33:0/1950193296 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a7fff700 1 -- 172.21.15.33:0/1950193296 >> v2:172.21.15.59:3300/0 conn(0x7f32a80cb5a0 msgr2=0x7f32a80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32ac9f5700 1 --2- 172.21.15.33:0/1950193296 >> v2:172.21.15.59:3300/0 conn(0x7f32a80cb5a0 0x7f32a80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a7fff700 1 --2- 172.21.15.33:0/1950193296 >> v2:172.21.15.59:3300/0 conn(0x7f32a80cb5a0 0x7f32a80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a7fff700 1 -- 172.21.15.33:0/1950193296 >> v1:172.21.15.33:6789/0 conn(0x7f32a815a400 legacy=0x7f32a8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a77fe700 1 -- 172.21.15.33:0/1950193296 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3899612690 0 0) 0x7f32a815ae40 con 0x7f32a815a400 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a7fff700 1 -- 172.21.15.33:0/1950193296 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32a80ccf00 con 0x7f32a80cd9e0 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a7fff700 1 --2- 172.21.15.33:0/1950193296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cd9e0 0x7f32a8159ec0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f329c0098e0 tx=0x7f329c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35117c4f49af300 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a77fe700 1 -- 172.21.15.33:0/1950193296 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c009e80 con 0x7f32a80cd9e0 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a77fe700 1 -- 172.21.15.33:0/1950193296 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f329c00b820 con 0x7f32a80cd9e0 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32a77fe700 1 -- 172.21.15.33:0/1950193296 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f329c00bba0 con 0x7f32a80cd9e0 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32aec59700 1 -- 172.21.15.33:0/1950193296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cd9e0 msgr2=0x7f32a8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.518+0000 7f32aec59700 1 --2- 172.21.15.33:0/1950193296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cd9e0 0x7f32a8159ec0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f329c0098e0 tx=0x7f329c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 -- 172.21.15.33:0/1950193296 shutdown_connections 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 --2- 172.21.15.33:0/1950193296 >> v2:172.21.15.59:3300/0 conn(0x7f32a80cb5a0 0x7f32a80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 --2- 172.21.15.33:0/1950193296 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cd9e0 0x7f32a8159ec0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 -- 172.21.15.33:0/1950193296 >> 172.21.15.33:0/1950193296 conn(0x7f32a8070e30 msgr2=0x7f32a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 -- 172.21.15.33:0/1950193296 shutdown_connections 2023-10-09T15:36:43.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.519+0000 7f32aec59700 1 -- 172.21.15.33:0/1950193296 wait complete. 2023-10-09T15:36:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.520+0000 7f32aec59700 1 Processor -- start 2023-10-09T15:36:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.520+0000 7f32aec59700 1 -- start start 2023-10-09T15:36:43.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.520+0000 7f32aec59700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32a80cd9e0 0x7f32a80b49a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32a815a400 0x7f32a80c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a8152a30 con 0x7f32a80cb5a0 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b4510 con 0x7f32a815a400 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32a80b3660 con 0x7f32a80cd9e0 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53256/0 (socket says 172.21.15.33:53256) 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 -- 172.21.15.33:0/3172770832 learned_addr learned my addr 172.21.15.33:0/3172770832 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32a7fff700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32a80cd9e0 0x7f32a80b49a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 -- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32a80cd9e0 msgr2=0x7f32a80b49a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32a80cd9e0 0x7f32a80b49a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 -- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32a815a400 msgr2=0x7f32a80c9ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32a815a400 0x7f32a80c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 -- 172.21.15.33:0/3172770832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c009420 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32ac9f5700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32a000cfc0 tx=0x7f32a00078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0016430 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32a0016590 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32a0016930 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32a80b3900 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.521+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32a80b3ec0 con 0x7f32a80cb5a0 2023-10-09T15:36:43.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.522+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32a804c3c0 con 0x7f32a80cb5a0 2023-10-09T15:36:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.523+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f32a0003020 con 0x7f32a80cb5a0 2023-10-09T15:36:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.523+0000 7f32a4ff9700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 0x7f32940696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.523+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f32a0012070 con 0x7f32a80cb5a0 2023-10-09T15:36:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.523+0000 7f32a7fff700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 0x7f32940696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.524+0000 7f32a7fff700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 0x7f32940696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32a80af120 tx=0x7f329c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.527+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32a00527f0 con 0x7f32a80cb5a0 2023-10-09T15:36:43.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.806+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f32a80cd1e0 con 0x7f32a80cb5a0 2023-10-09T15:36:43.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.806+0000 7f32a4ff9700 1 -- 172.21.15.33:0/3172770832 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f32a0055e10 con 0x7f32a80cb5a0 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.808 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.809 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.810 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:36:43.811 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.812 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.813 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.814 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.815 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.816 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.817 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:36:43.818 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.819 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:36:43.820 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:43.821 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:36:43.822 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:43.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 msgr2=0x7f32940696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 0x7f32940696b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f32a80af120 tx=0x7f329c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 msgr2=0x7f32a81524f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f32a000cfc0 tx=0x7f32a00078b0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 shutdown_connections 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3294067200 0x7f32940696b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32a80cb5a0 0x7f32a81524f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32a815a400 0x7f32a80c9ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 --2- 172.21.15.33:0/3172770832 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32a80cd9e0 0x7f32a80b49a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 >> 172.21.15.33:0/3172770832 conn(0x7f32a8070e30 msgr2=0x7f32a80cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 shutdown_connections 2023-10-09T15:36:43.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.809+0000 7f32aec59700 1 -- 172.21.15.33:0/3172770832 wait complete. 2023-10-09T15:36:43.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.944+0000 7f86c4d94700 1 Processor -- start 2023-10-09T15:36:43.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.944+0000 7f86c4d94700 1 -- start start 2023-10-09T15:36:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86c4d94700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f86c015cb50 0x7f86c00b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86c4d94700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c015ad50 con 0x7f86c015cf20 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86c4d94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86c015a140 con 0x7f86c00b0710 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86c4d94700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c015a420 con 0x7f86c015cb50 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86bdd9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f86c015cf20 0x7f86c00b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56842/0 (socket says 172.21.15.33:56842) 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86bdd9b700 1 -- 172.21.15.33:0/3306682254 learned_addr learned my addr 172.21.15.33:0/3306682254 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1757956214 0 0) 0x7f86c015ad50 con 0x7f86c015cf20 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86a8003570 con 0x7f86c015cf20 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.945+0000 7f86be59c700 1 --2- 172.21.15.33:0/3306682254 >> v2:172.21.15.59:3300/0 conn(0x7f86c015cb50 0x7f86c00b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2773146191 0 0) 0x7f86a8003570 con 0x7f86c015cf20 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 >> v2:172.21.15.59:3300/0 conn(0x7f86c015cb50 msgr2=0x7f86c00b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 --2- 172.21.15.33:0/3306682254 >> v2:172.21.15.59:3300/0 conn(0x7f86c015cb50 0x7f86c00b01d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 >> v1:172.21.15.59:6789/0 conn(0x7f86c00b0710 legacy=0x7f86c01536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c015a700 con 0x7f86c015cf20 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f86b4001470 con 0x7f86c015cf20 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 >> v1:172.21.15.33:6789/0 conn(0x7f86c015cf20 legacy=0x7f86c00b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a8003a60 0x7f86a8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a8004810 0x7f86a8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86a800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c015a420 con 0x7f86a80051c0 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86a800c0d0 con 0x7f86a8004810 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86a800c290 con 0x7f86a8003a60 2023-10-09T15:36:43.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86a800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86be59c700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a8003a60 0x7f86a8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bdd9b700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a8004810 0x7f86a8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 -- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a8003a60 msgr2=0x7f86a8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86a8003a60 0x7f86a8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 -- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a8004810 msgr2=0x7f86a8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86a8004810 0x7f86a8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 -- 172.21.15.33:0/3306682254 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86a8003570 con 0x7f86a80051c0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 -- 172.21.15.33:0/3306682254 reap_dead start 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bed9d700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86a800ba60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001ff0 tx=0x7f86b8001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64b1d30e1a68db94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.946+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b8001980 con 0x7f86a80051c0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b800c8b0 con 0x7f86a80051c0 2023-10-09T15:36:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86bd59a700 1 -- 172.21.15.33:0/3306682254 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b800cc90 con 0x7f86a80051c0 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 -- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 msgr2=0x7f86a800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86a800ba60 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f86b8001ff0 tx=0x7f86b8001670 comp rx=0 tx=0).stop 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 -- 172.21.15.33:0/3306682254 shutdown_connections 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 --2- 172.21.15.33:0/3306682254 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86a800ba60 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 -- 172.21.15.33:0/3306682254 >> 172.21.15.33:0/3306682254 conn(0x7f86c00cded0 msgr2=0x7f86c006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 -- 172.21.15.33:0/3306682254 shutdown_connections 2023-10-09T15:36:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.947+0000 7f86c4d94700 1 -- 172.21.15.33:0/3306682254 wait complete. 2023-10-09T15:36:43.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.948+0000 7f86c4d94700 1 Processor -- start 2023-10-09T15:36:43.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.948+0000 7f86c4d94700 1 -- start start 2023-10-09T15:36:43.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86c00c29f0 0x7f86c00c2e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86c00c6e40 0x7f86c00c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c5f60 con 0x7f86a80051c0 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c00c77f0 con 0x7f86c00c6e40 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86c4d94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c014f500 con 0x7f86c00c29f0 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53264/0 (socket says 172.21.15.33:53264) 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 -- 172.21.15.33:0/1280305855 learned_addr learned my addr 172.21.15.33:0/1280305855 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86bed9d700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86c00c6e40 0x7f86c00c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86bdd9b700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86c00c29f0 0x7f86c00c2e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 -- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86c00c29f0 msgr2=0x7f86c00c2e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86c00c29f0 0x7f86c00c2e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 -- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86c00c6e40 msgr2=0x7f86c00c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86c00c6e40 0x7f86c00c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 -- 172.21.15.33:0/1280305855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c00c69b0 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.949+0000 7f86be59c700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f86b0006ac0 tx=0x7f86b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.950+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b000fa10 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.950+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86b000fb70 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.950+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c00c5c80 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.950+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86b0014440 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.950+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c00c6640 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.951+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c004c3c0 con 0x7f86a80051c0 2023-10-09T15:36:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.951+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f86b0014830 con 0x7f86a80051c0 2023-10-09T15:36:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.951+0000 7f86ae7fc700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 0x7f86a00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.951+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f86b0018030 con 0x7f86a80051c0 2023-10-09T15:36:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.951+0000 7f86bdd9b700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 0x7f86a00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.952+0000 7f86bdd9b700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 0x7f86a00696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86b40016e0 tx=0x7f86b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:43.956+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f86b00522f0 con 0x7f86a80051c0 2023-10-09T15:36:44.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.151+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f86c00aabe0 con 0x7f86a80051c0 2023-10-09T15:36:44.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.151+0000 7f86ae7fc700 1 -- 172.21.15.33:0/1280305855 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f86b0022090 con 0x7f86a80051c0 2023-10-09T15:36:44.153 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:44.153 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:43.369473+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":75,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.153+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 msgr2=0x7f86a00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.153+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 0x7f86a00696b0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f86b40016e0 tx=0x7f86b4009040 comp rx=0 tx=0).stop 2023-10-09T15:36:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 msgr2=0x7f86c014efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f86b0006ac0 tx=0x7f86b00091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 shutdown_connections 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f86a0067200 0x7f86a00696b0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86a80051c0 0x7f86c014efc0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f86c00c6e40 0x7f86c00c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 --2- 172.21.15.33:0/1280305855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86c00c29f0 0x7f86c00c2e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 >> 172.21.15.33:0/1280305855 conn(0x7f86c00cded0 msgr2=0x7f86c00aed20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 shutdown_connections 2023-10-09T15:36:44.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.154+0000 7f86c4d94700 1 -- 172.21.15.33:0/1280305855 wait complete. 2023-10-09T15:36:44.167 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:36:44.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:36:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.289+0000 7ffb0d968700 1 Processor -- start 2023-10-09T15:36:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.289+0000 7ffb0d968700 1 -- start start 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb08159530 0x7ffb080ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0806dc70 0x7ffb08159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffb0806e0e0 0x7ffb080cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080ccfd0 con 0x7ffb0806dc70 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb080cf0e0 con 0x7ffb0806e0e0 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb0d968700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0815a3d0 con 0x7ffb08159530 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb067fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0806dc70 0x7ffb08159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb067fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb0806dc70 0x7ffb08159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53276/0 (socket says 172.21.15.33:53276) 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb067fc700 1 -- 172.21.15.33:0/1404736474 learned_addr learned my addr 172.21.15.33:0/1404736474 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb077fe700 1 --2- 172.21.15.33:0/1404736474 >> v2:172.21.15.59:3300/0 conn(0x7ffb0806e0e0 0x7ffb080cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.290+0000 7ffb06ffd700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb08159530 0x7ffb080ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 -- 172.21.15.33:0/1404736474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb08159530 msgr2=0x7ffb080ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb08159530 0x7ffb080ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 -- 172.21.15.33:0/1404736474 >> v2:172.21.15.59:3300/0 conn(0x7ffb0806e0e0 msgr2=0x7ffb080cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 --2- 172.21.15.33:0/1404736474 >> v2:172.21.15.59:3300/0 conn(0x7ffb0806e0e0 0x7ffb080cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 -- 172.21.15.33:0/1404736474 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0815a6b0 con 0x7ffb0806dc70 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb067fc700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0806dc70 0x7ffb08159900 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb08089880 tx=0x7ffaf0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edcfec2fa3fa5a4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb05ffb700 1 -- 172.21.15.33:0/1404736474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000b860 con 0x7ffb0806dc70 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb05ffb700 1 -- 172.21.15.33:0/1404736474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf000b9c0 con 0x7ffb0806dc70 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb05ffb700 1 -- 172.21.15.33:0/1404736474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf000bd60 con 0x7ffb0806dc70 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 -- 172.21.15.33:0/1404736474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0806dc70 msgr2=0x7ffb08159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0806dc70 0x7ffb08159900 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7ffb08089880 tx=0x7ffaf0009250 comp rx=0 tx=0).stop 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 -- 172.21.15.33:0/1404736474 shutdown_connections 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1404736474 >> v2:172.21.15.59:3300/0 conn(0x7ffb0806e0e0 0x7ffb080cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb08159530 0x7ffb080ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1404736474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb0806dc70 0x7ffb08159900 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 -- 172.21.15.33:0/1404736474 >> 172.21.15.33:0/1404736474 conn(0x7ffb080703a0 msgr2=0x7ffb080707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 -- 172.21.15.33:0/1404736474 shutdown_connections 2023-10-09T15:36:44.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.291+0000 7ffb0d968700 1 -- 172.21.15.33:0/1404736474 wait complete. 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 Processor -- start 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 -- start start 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0806dc70 0x7ffb080b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0806e0e0 0x7ffb080b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080b6160 con 0x7ffb08159530 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080b6440 con 0x7ffb0806e0e0 2023-10-09T15:36:44.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.293+0000 7ffb0d968700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb080b3480 con 0x7ffb0806dc70 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53286/0 (socket says 172.21.15.33:53286) 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 -- 172.21.15.33:0/1126729433 learned_addr learned my addr 172.21.15.33:0/1126729433 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb06ffd700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0806dc70 0x7ffb080b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb067fc700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0806e0e0 0x7ffb080b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 -- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0806dc70 msgr2=0x7ffb080b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0806dc70 0x7ffb080b3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 -- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0806e0e0 msgr2=0x7ffb080b4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0806e0e0 0x7ffb080b4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 -- 172.21.15.33:0/1126729433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffaf00094f0 con 0x7ffb08159530 2023-10-09T15:36:44.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb077fe700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800d890 tx=0x7ffaf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf80125f0 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffaf8012750 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb080b3760 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffaf8012b10 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.294+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb080b5d80 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.295+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0804c3c0 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.296+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ffaf8013480 con 0x7ffb08159530 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.296+0000 7ffafeffd700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 0x7ffae80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.296+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4853+0+0 (secure 0 0 0) 0x7ffaf8084960 con 0x7ffb08159530 2023-10-09T15:36:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.296+0000 7ffb06ffd700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 0x7ffae80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.297+0000 7ffb06ffd700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 0x7ffae80696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb000075a0 tx=0x7ffb000097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.300+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffaf8051bd0 con 0x7ffb08159530 2023-10-09T15:36:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.492+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ffb080b62a0 con 0x7ffb08159530 2023-10-09T15:36:44.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.493+0000 7ffafeffd700 1 -- 172.21.15.33:0/1126729433 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7ffb080b62a0 con 0x7ffb08159530 2023-10-09T15:36:44.494 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:36:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 msgr2=0x7ffae80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 0x7ffae80696b0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7ffb000075a0 tx=0x7ffb000097e0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 msgr2=0x7ffb080b1700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7ffaf800d890 tx=0x7ffaf8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 shutdown_connections 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffae8067200 0x7ffae80696b0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb08159530 0x7ffb080b1700 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb0806dc70 0x7ffb080b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 --2- 172.21.15.33:0/1126729433 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb0806e0e0 0x7ffb080b4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 >> 172.21.15.33:0/1126729433 conn(0x7ffb080703a0 msgr2=0x7ffb080c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 shutdown_connections 2023-10-09T15:36:44.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.495+0000 7ffb0d968700 1 -- 172.21.15.33:0/1126729433 wait complete. 2023-10-09T15:36:44.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:36:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.629+0000 7f533318d700 1 Processor -- start 2023-10-09T15:36:44.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.629+0000 7f533318d700 1 -- start start 2023-10-09T15:36:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533318d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 0x7f532c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533318d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f532c0cd9e0 0x7f532c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533318d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c15ae40 con 0x7f532c15a400 2023-10-09T15:36:44.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533318d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0d13f0 con 0x7f532c0cd9e0 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533318d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c15ab60 con 0x7f532c0cb5a0 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f532c0cd9e0 0x7f532c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533172a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f532c15a400 0x7f532c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56856/0 (socket says 172.21.15.33:56856) 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f533172a700 1 -- 172.21.15.33:0/2521593844 learned_addr learned my addr 172.21.15.33:0/2521593844 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f5330f29700 1 --2- 172.21.15.33:0/2521593844 >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 0x7f532c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 -- 172.21.15.33:0/2521593844 >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 msgr2=0x7f532c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 --2- 172.21.15.33:0/2521593844 >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 0x7f532c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 -- 172.21.15.33:0/2521593844 >> v1:172.21.15.33:6789/0 conn(0x7f532c15a400 legacy=0x7f532c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 -- 172.21.15.33:0/2521593844 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0ccf00 con 0x7f532c0cd9e0 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532b7fe700 1 -- 172.21.15.33:0/2521593844 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887060064 0 0) 0x7f532c15ae40 con 0x7f532c15a400 2023-10-09T15:36:44.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f5330f29700 1 --2- 172.21.15.33:0/2521593844 >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 0x7f532c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532bfff700 1 --2- 172.21.15.33:0/2521593844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cd9e0 0x7f532c159ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e60 tx=0x7f531c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dffb489354c9eb60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532b7fe700 1 -- 172.21.15.33:0/2521593844 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c00e070 con 0x7f532c0cd9e0 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532b7fe700 1 -- 172.21.15.33:0/2521593844 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531c00bbf0 con 0x7f532c0cd9e0 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.630+0000 7f532b7fe700 1 -- 172.21.15.33:0/2521593844 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531c012430 con 0x7f532c0cd9e0 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 -- 172.21.15.33:0/2521593844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cd9e0 msgr2=0x7f532c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 --2- 172.21.15.33:0/2521593844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cd9e0 0x7f532c159ec0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f531c009e60 tx=0x7f531c009780 comp rx=0 tx=0).stop 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 -- 172.21.15.33:0/2521593844 shutdown_connections 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 --2- 172.21.15.33:0/2521593844 >> v2:172.21.15.59:3300/0 conn(0x7f532c0cb5a0 0x7f532c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 --2- 172.21.15.33:0/2521593844 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cd9e0 0x7f532c159ec0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 -- 172.21.15.33:0/2521593844 >> 172.21.15.33:0/2521593844 conn(0x7f532c070e30 msgr2=0x7f532c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 -- 172.21.15.33:0/2521593844 shutdown_connections 2023-10-09T15:36:44.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.631+0000 7f533318d700 1 -- 172.21.15.33:0/2521593844 wait complete. 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.632+0000 7f533318d700 1 Processor -- start 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.632+0000 7f533318d700 1 -- start start 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532c0cd9e0 0x7f532c0c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532c15a400 0x7f532c15c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0c9810 con 0x7f532c0cb5a0 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0c9af0 con 0x7f532c15a400 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f533318d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0c9dd0 con 0x7f532c0cd9e0 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53310/0 (socket says 172.21.15.33:53310) 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 -- 172.21.15.33:0/1302561621 learned_addr learned my addr 172.21.15.33:0/1302561621 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 -- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532c0cd9e0 msgr2=0x7f532c0c8f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f532bfff700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532c0cd9e0 0x7f532c0c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532c0cd9e0 0x7f532c0c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 -- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532c15a400 msgr2=0x7f532c15c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532c15a400 0x7f532c15c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.633+0000 7f5330f29700 1 -- 172.21.15.33:0/1302561621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f531c009a20 con 0x7f532c0cb5a0 2023-10-09T15:36:44.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f5330f29700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f531400e8d0 tx=0x7f5314008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400ee70 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400c5e0 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f532c0ca0b0 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400c980 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.634+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c152820 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.635+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c0b3680 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.635+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5314013410 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.635+0000 7f5328ff9700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 0x7f530c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.636+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f53140848b0 con 0x7f532c0cb5a0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.636+0000 7f532bfff700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 0x7f530c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.636+0000 7f532bfff700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 0x7f530c0696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f532c0cbc50 tx=0x7f531c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.640+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5314051930 con 0x7f532c0cb5a0 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.839+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f532c04c3c0 con 0x7f532c0cb5a0 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.839+0000 7f5328ff9700 1 -- 172.21.15.33:0/1302561621 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v85) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5314020090 con 0x7f532c0cb5a0 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:44.840 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:36:44.841 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:36:44.841 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:44.841 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:36:44.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 msgr2=0x7f530c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 0x7f530c0696b0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f532c0cbc50 tx=0x7f531c019000 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 msgr2=0x7f532c0c8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f531400e8d0 tx=0x7f5314008040 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 shutdown_connections 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f530c067200 0x7f530c0696b0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f532c0cb5a0 0x7f532c0c8a40 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f532c15a400 0x7f532c15c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 --2- 172.21.15.33:0/1302561621 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f532c0cd9e0 0x7f532c0c8f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 >> 172.21.15.33:0/1302561621 conn(0x7f532c070e30 msgr2=0x7f532c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 shutdown_connections 2023-10-09T15:36:44.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.841+0000 7f533318d700 1 -- 172.21.15.33:0/1302561621 wait complete. 2023-10-09T15:36:44.854 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:36:44.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:36:44.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.977+0000 7f6ba2c6d700 1 Processor -- start 2023-10-09T15:36:44.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.977+0000 7f6ba2c6d700 1 -- start start 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b9c159530 0x7f6b9c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b9c06dcf0 0x7f6b9c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c0ccfd0 con 0x7f6b9c159530 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b9c15a410 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba2c6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c15a6f0 con 0x7f6b9c159e40 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b9c159530 0x7f6b9c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b9c159530 0x7f6b9c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53316/0 (socket says 172.21.15.33:53316) 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 -- 172.21.15.33:0/1476969701 learned_addr learned my addr 172.21.15.33:0/1476969701 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 -- 172.21.15.33:0/1476969701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 msgr2=0x7f6b9c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/1476969701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 -- 172.21.15.33:0/1476969701 >> v2:172.21.15.59:3300/0 conn(0x7f6b9c06dcf0 msgr2=0x7f6b9c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/1476969701 >> v2:172.21.15.59:3300/0 conn(0x7f6b9c06dcf0 0x7f6b9c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 -- 172.21.15.33:0/1476969701 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b9c15a9d0 con 0x7f6b9c159530 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/1476969701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c159530 0x7f6b9c0ceba0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c15d390 tx=0x7f6b8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fca6272e0e17f43c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6b9b7fe700 1 -- 172.21.15.33:0/1476969701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00b860 con 0x7f6b9c159530 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6b9b7fe700 1 -- 172.21.15.33:0/1476969701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c00b9c0 con 0x7f6b9c159530 2023-10-09T15:36:44.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.978+0000 7f6b9b7fe700 1 -- 172.21.15.33:0/1476969701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c00bd60 con 0x7f6b9c159530 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/1476969701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c159530 msgr2=0x7f6b9c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/1476969701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c159530 0x7f6b9c0ceba0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6b9c15d390 tx=0x7f6b8c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/1476969701 shutdown_connections 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/1476969701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/1476969701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c159530 0x7f6b9c0ceba0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/1476969701 >> v2:172.21.15.59:3300/0 conn(0x7f6b9c06dcf0 0x7f6b9c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/1476969701 >> 172.21.15.33:0/1476969701 conn(0x7f6b9c0703a0 msgr2=0x7f6b9c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/1476969701 shutdown_connections 2023-10-09T15:36:44.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.979+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/1476969701 wait complete. 2023-10-09T15:36:44.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.980+0000 7f6ba2c6d700 1 Processor -- start 2023-10-09T15:36:44.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.980+0000 7f6ba2c6d700 1 -- start start 2023-10-09T15:36:44.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 0x7f6b9c0c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c156c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0c7f80 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0b2e60 con 0x7f6b9c159530 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba2c6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b9c0c7930 con 0x7f6b9c159e40 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53326/0 (socket says 172.21.15.33:53326) 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 -- 172.21.15.33:0/564304930 learned_addr learned my addr 172.21.15.33:0/564304930 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6b9bfff700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 0x7f6b9c0c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba120a700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c156c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 -- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 msgr2=0x7f6b9c156c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c156c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 -- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 msgr2=0x7f6b9c0c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 0x7f6b9c0c8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 -- 172.21.15.33:0/564304930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c0094f0 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6b9bfff700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 0x7f6b9c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba120a700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.981+0000 7f6ba0a09700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009290 tx=0x7f6b8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.982+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c011e20 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.982+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8c01f070 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.982+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b9c0c7c10 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.982+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b8c01a890 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.982+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b9c153510 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.983+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b9c0c7770 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.983+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f6b8c01ac40 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.983+0000 7f6b98ff9700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 0x7f6b880696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.984+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f6b8c021070 con 0x7f6b9c06dcf0 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.984+0000 7f6b9bfff700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 0x7f6b880696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:44.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.984+0000 7f6b9bfff700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 0x7f6b880696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:44.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:44.988+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b8c053810 con 0x7f6b9c06dcf0 2023-10-09T15:36:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.183+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f6b9c0c8260 con 0x7f6b9c06dcf0 2023-10-09T15:36:45.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.385+0000 7f6b98ff9700 1 -- 172.21.15.33:0/564304930 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v86) v1 ==== 138+0+0 (secure 0 0 0) 0x7f6b8c056e30 con 0x7f6b9c06dcf0 2023-10-09T15:36:45.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 msgr2=0x7f6b880696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 0x7f6b880696b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f6b90006fd0 tx=0x7f6b90008040 comp rx=0 tx=0).stop 2023-10-09T15:36:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 msgr2=0x7f6b9c0c8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6b8c009290 tx=0x7f6b8c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:45.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 shutdown_connections 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b88067200 0x7f6b880696b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b9c06dcf0 0x7f6b9c0c8410 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b9c159e40 0x7f6b9c156c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 --2- 172.21.15.33:0/564304930 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b9c159530 0x7f6b9c0c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 >> 172.21.15.33:0/564304930 conn(0x7f6b9c0703a0 msgr2=0x7f6b9c155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.389+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 shutdown_connections 2023-10-09T15:36:45.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.390+0000 7f6ba2c6d700 1 -- 172.21.15.33:0/564304930 wait complete. 2023-10-09T15:36:45.392 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:36:45.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:36:45.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 Processor -- start 2023-10-09T15:36:45.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 -- start start 2023-10-09T15:36:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 0x7f3dd00ab070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dd00cd2b0 0x7f3dd00ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3dd00c32a0 con 0x7f3dd00ca2c0 2023-10-09T15:36:45.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dd00c9730 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.530+0000 7f3dd6062700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00c4100 con 0x7f3dd0157930 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dd00cd2b0 0x7f3dd00ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dd00cd2b0 0x7f3dd00ca730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53342/0 (socket says 172.21.15.33:53342) 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 -- 172.21.15.33:0/516104874 learned_addr learned my addr 172.21.15.33:0/516104874 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcf7fe700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 0x7f3dd00ab070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 -- 172.21.15.33:0/516104874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 msgr2=0x7f3dd00ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 0x7f3dd00ab070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 -- 172.21.15.33:0/516104874 >> v1:172.21.15.59:6789/0 conn(0x7f3dd00ca2c0 legacy=0x7f3dd00ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 -- 172.21.15.33:0/516104874 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dd00c34f0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcf7fe700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 0x7f3dd00ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dcffff700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00ca730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f20 tx=0x7f3dc8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6598367241df8f0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dce7fc700 1 -- 172.21.15.33:0/516104874 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc800e070 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dce7fc700 1 -- 172.21.15.33:0/516104874 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc800ba80 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.531+0000 7f3dce7fc700 1 -- 172.21.15.33:0/516104874 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc80092e0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 -- 172.21.15.33:0/516104874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 msgr2=0x7f3dd00ca730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00ca730 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f3dc8009f20 tx=0x7f3dc8009840 comp rx=0 tx=0).stop 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 -- 172.21.15.33:0/516104874 shutdown_connections 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00ca730 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 --2- 172.21.15.33:0/516104874 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd0157930 0x7f3dd00ab070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 -- 172.21.15.33:0/516104874 >> 172.21.15.33:0/516104874 conn(0x7f3dd0088000 msgr2=0x7f3dd00883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 -- 172.21.15.33:0/516104874 shutdown_connections 2023-10-09T15:36:45.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.532+0000 7f3dd6062700 1 -- 172.21.15.33:0/516104874 wait complete. 2023-10-09T15:36:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.533+0000 7f3dd6062700 1 Processor -- start 2023-10-09T15:36:45.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.533+0000 7f3dd6062700 1 -- start start 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd00ca2c0 0x7f3dd0153ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 0x7f3dd00cc430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd0154530 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00ae6c0 con 0x7f3dd0157930 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dd6062700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dd00ae9a0 con 0x7f3dd00ca2c0 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53346/0 (socket says 172.21.15.33:53346) 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 -- 172.21.15.33:0/1869172364 learned_addr learned my addr 172.21.15.33:0/1869172364 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dcf7fe700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd00ca2c0 0x7f3dd0153ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dcffff700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 0x7f3dd00cc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 -- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd00ca2c0 msgr2=0x7f3dd0153ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd00ca2c0 0x7f3dd0153ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 -- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 msgr2=0x7f3dd00cc430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 0x7f3dd00cc430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dceffd700 1 -- 172.21.15.33:0/1869172364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dc8009ae0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.534+0000 7f3dcffff700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 0x7f3dd00cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3dceffd700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c4e0 tx=0x7f3dc000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011590 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dc0011710 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dd00aec80 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dc0011ad0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.535+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dd00c69d0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.536+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dd004c3c0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.536+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3dc001b3b0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.537+0000 7f3db77fe700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 0x7f3dbc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.537+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f3dc0083ce0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.537+0000 7f3dcf7fe700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 0x7f3dbc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:45.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.537+0000 7f3dcf7fe700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 0x7f3dbc0696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400ac00 tx=0x7f3dc4006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:45.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.541+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dc0050de0 con 0x7f3dd00cd2b0 2023-10-09T15:36:45.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:45.736+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3dd00c3c60 con 0x7f3dd00cd2b0 2023-10-09T15:36:46.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.386+0000 7f3db77fe700 1 -- 172.21.15.33:0/1869172364 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v87) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3dc0017070 con 0x7f3dd00cd2b0 2023-10-09T15:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 msgr2=0x7f3dbc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 0x7f3dbc0696b0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f3dc400ac00 tx=0x7f3dc4006f90 comp rx=0 tx=0).stop 2023-10-09T15:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 msgr2=0x7f3dd00addc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f3dc000c4e0 tx=0x7f3dc000c8a0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 shutdown_connections 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dbc067200 0x7f3dbc0696b0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dd0157930 0x7f3dd00cc430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dd00ca2c0 0x7f3dd0153ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 --2- 172.21.15.33:0/1869172364 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dd00cd2b0 0x7f3dd00addc0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 >> 172.21.15.33:0/1869172364 conn(0x7f3dd0088000 msgr2=0x7f3dd00690d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 shutdown_connections 2023-10-09T15:36:46.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.405+0000 7f3dd6062700 1 -- 172.21.15.33:0/1869172364 wait complete. 2023-10-09T15:36:46.408 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:36:46.423 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:36:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.547+0000 7f3d7b3f2700 1 Processor -- start 2023-10-09T15:36:46.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 -- start start 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d74159530 0x7f3d740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d7406e0e0 0x7f3d740cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d740ccfd0 con 0x7f3d7406dc70 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d740cf0e0 con 0x7f3d7406e0e0 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.548+0000 7f3d7b3f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d7415a3d0 con 0x7f3d74159530 2023-10-09T15:36:46.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d7406e0e0 0x7f3d740cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d7406e0e0 0x7f3d740cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53348/0 (socket says 172.21.15.33:53348) 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 -- 172.21.15.33:0/2452822635 learned_addr learned my addr 172.21.15.33:0/2452822635 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7898d700 1 --1- 172.21.15.33:0/2452822635 >> v1:172.21.15.33:6789/0 conn(0x7f3d7406dc70 0x7f3d74159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56862/0 (socket says 172.21.15.33:56862) 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7918e700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d74159530 0x7f3d740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 -- 172.21.15.33:0/2452822635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d74159530 msgr2=0x7f3d740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d74159530 0x7f3d740ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 -- 172.21.15.33:0/2452822635 >> v1:172.21.15.33:6789/0 conn(0x7f3d7406dc70 legacy=0x7f3d74159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d73fff700 1 -- 172.21.15.33:0/2452822635 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3727052257 0 0) 0x7f3d740ccfd0 con 0x7f3d7406dc70 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 -- 172.21.15.33:0/2452822635 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d7415a6b0 con 0x7f3d7406e0e0 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d7998f700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406e0e0 0x7f3d740cb6f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0099b0 tx=0x7f3d6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491b0455f508948 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:46.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d73fff700 1 -- 172.21.15.33:0/2452822635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00b860 con 0x7f3d7406e0e0 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d73fff700 1 -- 172.21.15.33:0/2452822635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6c00b9c0 con 0x7f3d7406e0e0 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.549+0000 7f3d73fff700 1 -- 172.21.15.33:0/2452822635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6c00bd60 con 0x7f3d7406e0e0 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/2452822635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406e0e0 msgr2=0x7f3d740cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406e0e0 0x7f3d740cb6f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3d6c0099b0 tx=0x7f3d6c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/2452822635 shutdown_connections 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406e0e0 0x7f3d740cb6f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/2452822635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d74159530 0x7f3d740ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/2452822635 >> 172.21.15.33:0/2452822635 conn(0x7f3d740703a0 msgr2=0x7f3d740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/2452822635 shutdown_connections 2023-10-09T15:36:46.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.550+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/2452822635 wait complete. 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.551+0000 7f3d7b3f2700 1 Processor -- start 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.551+0000 7f3d7b3f2700 1 -- start start 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d7406e0e0 0x7f3d740b5cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d74159530 0x7f3d74154c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c9ae0 con 0x7f3d7406dc70 2023-10-09T15:36:46.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c8ed0 con 0x7f3d74159530 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7b3f2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d740c91b0 con 0x7f3d7406e0e0 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53364/0 (socket says 172.21.15.33:53364) 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 -- 172.21.15.33:0/4021836268 learned_addr learned my addr 172.21.15.33:0/4021836268 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7998f700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d74159530 0x7f3d74154c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 -- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d7406e0e0 msgr2=0x7f3d740b5cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7898d700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d7406e0e0 0x7f3d740b5cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d7406e0e0 0x7f3d740b5cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 -- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d74159530 msgr2=0x7f3d74154c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d74159530 0x7f3d74154c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 -- 172.21.15.33:0/4021836268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6c0094f0 con 0x7f3d7406dc70 2023-10-09T15:36:46.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.552+0000 7f3d7918e700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009fa0 tx=0x7f3d64009880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.553+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6400ed20 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.553+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6400ee80 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.553+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d64014670 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.553+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d740c9490 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.553+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d74152310 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.554+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d740c9dc0 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.554+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f3d640149e0 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.555+0000 7f3d717fa700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 0x7f3d600696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.555+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f3d640850e0 con 0x7f3d7406dc70 2023-10-09T15:36:46.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.555+0000 7f3d7898d700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 0x7f3d600696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:46.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.555+0000 7f3d7898d700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 0x7f3d600696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d68007fd0 tx=0x7f3d68009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:46.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.559+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d64052020 con 0x7f3d7406dc70 2023-10-09T15:36:46.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:46.797+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f3d7404c3c0 con 0x7f3d7406dc70 2023-10-09T15:36:47.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.397+0000 7f3d717fa700 1 -- 172.21.15.33:0/4021836268 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v54) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3d640099c0 con 0x7f3d7406dc70 2023-10-09T15:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.413+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 msgr2=0x7f3d600696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.413+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 0x7f3d600696b0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3d68007fd0 tx=0x7f3d68009040 comp rx=0 tx=0).stop 2023-10-09T15:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.413+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 msgr2=0x7f3d74151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.413+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f3d64009fa0 tx=0x7f3d64009880 comp rx=0 tx=0).stop 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 shutdown_connections 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d60067200 0x7f3d600696b0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d7406dc70 0x7f3d74151dd0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d74159530 0x7f3d74154c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 --2- 172.21.15.33:0/4021836268 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d7406e0e0 0x7f3d740b5cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.414+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 >> 172.21.15.33:0/4021836268 conn(0x7f3d740703a0 msgr2=0x7f3d740d0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:47.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.416+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 shutdown_connections 2023-10-09T15:36:47.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.416+0000 7f3d7b3f2700 1 -- 172.21.15.33:0/4021836268 wait complete. 2023-10-09T15:36:47.424 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 14 and data pool 15 2023-10-09T15:36:47.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:47.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.559+0000 7f49cdbf4700 1 Processor -- start 2023-10-09T15:36:47.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.559+0000 7f49cdbf4700 1 -- start start 2023-10-09T15:36:47.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49cdbf4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49c80cb5a0 0x7f49c80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49cdbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49cdbf4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49c815ae40 con 0x7f49c80cd9e0 2023-10-09T15:36:47.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49cdbf4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49c80d13f0 con 0x7f49c80cb5a0 2023-10-09T15:36:47.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49cdbf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c815ab60 con 0x7f49c815a5d0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49c6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f49c80cd9e0 0x7f49c8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56870/0 (socket says 172.21.15.33:56870) 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49c6ffd700 1 -- 172.21.15.33:0/3966822574 learned_addr learned my addr 172.21.15.33:0/3966822574 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49c7fff700 1 --2- 172.21.15.33:0/3966822574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.560+0000 7f49c77fe700 1 --2- 172.21.15.33:0/3966822574 >> v2:172.21.15.59:3300/0 conn(0x7f49c80cb5a0 0x7f49c80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073409558 0 0) 0x7f49c815ae40 con 0x7f49c80cd9e0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49b0003570 con 0x7f49c80cd9e0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2571293187 0 0) 0x7f49b0003570 con 0x7f49c80cd9e0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c7fff700 1 -- 172.21.15.33:0/3966822574 >> v2:172.21.15.59:3300/0 conn(0x7f49c80cb5a0 msgr2=0x7f49c80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c7fff700 1 --2- 172.21.15.33:0/3966822574 >> v2:172.21.15.59:3300/0 conn(0x7f49c80cb5a0 0x7f49c80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c7fff700 1 -- 172.21.15.33:0/3966822574 >> v1:172.21.15.33:6789/0 conn(0x7f49c80cd9e0 legacy=0x7f49c8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c7fff700 1 -- 172.21.15.33:0/3966822574 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c80ccf00 con 0x7f49c815a5d0 2023-10-09T15:36:47.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c7fff700 1 --2- 172.21.15.33:0/3966822574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8156e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009e90 tx=0x7f49c0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8d9b03e841d135db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49c000e070 con 0x7f49c815a5d0 2023-10-09T15:36:47.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49c000b870 con 0x7f49c815a5d0 2023-10-09T15:36:47.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.561+0000 7f49c67fc700 1 -- 172.21.15.33:0/3966822574 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc001470 con 0x7f49c815a5d0 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3966822574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 msgr2=0x7f49c8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3966822574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8156e90 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f49c0009e90 tx=0x7f49c0009780 comp rx=0 tx=0).stop 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3966822574 shutdown_connections 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3966822574 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8156e90 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3966822574 >> v2:172.21.15.59:3300/0 conn(0x7f49c80cb5a0 0x7f49c80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3966822574 >> 172.21.15.33:0/3966822574 conn(0x7f49c8070e30 msgr2=0x7f49c80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3966822574 shutdown_connections 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.562+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3966822574 wait complete. 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.563+0000 7f49cdbf4700 1 Processor -- start 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.563+0000 7f49cdbf4700 1 -- start start 2023-10-09T15:36:47.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 0x7f49c815d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8159ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80b4410 con 0x7f49c80cd9e0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49c80b49d0 con 0x7f49c80cb5a0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49cdbf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49c815def0 con 0x7f49c815a5d0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53370/0 (socket says 172.21.15.33:53370) 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 -- 172.21.15.33:0/3353827907 learned_addr learned my addr 172.21.15.33:0/3353827907 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c77fe700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 0x7f49c815d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c7fff700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8159ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 -- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 msgr2=0x7f49c8159ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8159ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 -- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 msgr2=0x7f49c815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 0x7f49c815d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 -- 172.21.15.33:0/3353827907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0009a20 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c7fff700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c77fe700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 0x7f49c815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.564+0000 7f49c6ffd700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00cbc0 tx=0x7f49bc001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc007360 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49bc0074c0 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49bc004830 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49c815e1d0 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49c8153940 con 0x7f49c80cd9e0 2023-10-09T15:36:47.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.565+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49c80b2e70 con 0x7f49c80cd9e0 2023-10-09T15:36:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.566+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f49bc004ba0 con 0x7f49c80cd9e0 2023-10-09T15:36:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.566+0000 7f49af7fe700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 0x7f49b40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.567+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f49bc084390 con 0x7f49c80cd9e0 2023-10-09T15:36:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.567+0000 7f49c77fe700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 0x7f49b40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.567+0000 7f49c77fe700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 0x7f49b40696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f49b8006f00 tx=0x7f49b8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.571+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49bc051250 con 0x7f49c80cd9e0 2023-10-09T15:36:47.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.766+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f49c804c3c0 con 0x7f49c80cd9e0 2023-10-09T15:36:47.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.767+0000 7f49af7fe700 1 -- 172.21.15.33:0/3353827907 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f49bc054870 con 0x7f49c80cd9e0 2023-10-09T15:36:47.768 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:47.768 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":88,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:46.799134+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:47.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 msgr2=0x7f49b40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 0x7f49b40696b0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f49b8006f00 tx=0x7f49b8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:47.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 msgr2=0x7f49c8153400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f49bc00cbc0 tx=0x7f49bc001b50 comp rx=0 tx=0).stop 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 shutdown_connections 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49b4067200 0x7f49b40696b0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49c815a5d0 0x7f49c8159ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49c80cb5a0 0x7f49c815d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 --2- 172.21.15.33:0/3353827907 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49c80cd9e0 0x7f49c8153400 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 >> 172.21.15.33:0/3353827907 conn(0x7f49c8070e30 msgr2=0x7f49c80b2080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 shutdown_connections 2023-10-09T15:36:47.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.769+0000 7f49cdbf4700 1 -- 172.21.15.33:0/3353827907 wait complete. 2023-10-09T15:36:47.783 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:47.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.900+0000 7f1baf2df700 1 Processor -- start 2023-10-09T15:36:47.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 -- start start 2023-10-09T15:36:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba80cf200 0x7f1ba80c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1ba80b0ba0 0x7f1ba806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba815a280 con 0x7f1ba80b07d0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba806e180 con 0x7f1ba80b0ba0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.901+0000 7f1baf2df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba806d850 con 0x7f1ba80cf200 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bad07b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1ba80b07d0 0x7f1ba80ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56882/0 (socket says 172.21.15.33:56882) 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bad07b700 1 -- 172.21.15.33:0/454340319 learned_addr learned my addr 172.21.15.33:0/454340319 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba80cf200 0x7f1ba80c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bad87c700 1 --2- 172.21.15.33:0/454340319 >> v2:172.21.15.59:3300/0 conn(0x7f1ba80b0ba0 0x7f1ba806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2233452870 0 0) 0x7f1ba815a280 con 0x7f1ba80b07d0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b94003570 con 0x7f1ba80b07d0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2226442060 0 0) 0x7f1b94003570 con 0x7f1ba80b07d0 2023-10-09T15:36:47.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba80cf200 msgr2=0x7f1ba80c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba80cf200 0x7f1ba80c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 >> v2:172.21.15.59:3300/0 conn(0x7f1ba80b0ba0 msgr2=0x7f1ba806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 --2- 172.21.15.33:0/454340319 >> v2:172.21.15.59:3300/0 conn(0x7f1ba80b0ba0 0x7f1ba806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba806db30 con 0x7f1ba80b07d0 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1ba40015f0 con 0x7f1ba80b07d0 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 >> v1:172.21.15.33:6789/0 conn(0x7f1ba80b07d0 legacy=0x7f1ba80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b94003a60 0x7f1b94003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b940051c0 0x7f1b9400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba806e180 con 0x7f1b94004810 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba806d850 con 0x7f1b940051c0 2023-10-09T15:36:47.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b9400bfa0 con 0x7f1b94003a60 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba80cf200 0x7f1ba80c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.902+0000 7f1bad87c700 1 --2- 172.21.15.33:0/454340319 >> v2:172.21.15.59:3300/0 conn(0x7f1ba80b0ba0 0x7f1ba806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bad07b700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b94003a60 0x7f1b94003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bad87c700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b940051c0 0x7f1b9400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 -- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b94003a60 msgr2=0x7f1b94003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b94003a60 0x7f1b94003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 -- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b940051c0 msgr2=0x7f1b9400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1b940051c0 0x7f1b9400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 -- 172.21.15.33:0/454340319 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b94003570 con 0x7f1b94004810 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1bac87a700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1ba806a920 tx=0x7f1b980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c32912e66e8e8128 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800e710 con 0x7f1b94004810 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9800e870 con 0x7f1b94004810 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.903+0000 7f1b9ffff700 1 -- 172.21.15.33:0/454340319 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9800ec10 con 0x7f1b94004810 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 -- 172.21.15.33:0/454340319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 msgr2=0x7f1b94004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 --2- 172.21.15.33:0/454340319 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1b94004c80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f1ba806a920 tx=0x7f1b980091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1bad87c700 1 -- 172.21.15.33:0/454340319 reap_dead start 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 -- 172.21.15.33:0/454340319 shutdown_connections 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 -- 172.21.15.33:0/454340319 >> 172.21.15.33:0/454340319 conn(0x7f1ba806ce80 msgr2=0x7f1ba80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 -- 172.21.15.33:0/454340319 shutdown_connections 2023-10-09T15:36:47.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.904+0000 7f1baf2df700 1 -- 172.21.15.33:0/454340319 wait complete. 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.905+0000 7f1baf2df700 1 Processor -- start 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.905+0000 7f1baf2df700 1 -- start start 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 0x7f1ba816cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ba8158490 0x7f1ba8158930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba80b17e0 con 0x7f1b94004810 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba8158e70 con 0x7f1ba8158490 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1baf2df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba816d5a0 con 0x7f1ba816cb50 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53400/0 (socket says 172.21.15.33:53400) 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 -- 172.21.15.33:0/2842712761 learned_addr learned my addr 172.21.15.33:0/2842712761 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bac87a700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 0x7f1ba816cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad87c700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ba8158490 0x7f1ba8158930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 -- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 msgr2=0x7f1ba816cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 0x7f1ba816cfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 -- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ba8158490 msgr2=0x7f1ba8158930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ba8158490 0x7f1ba8158930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 -- 172.21.15.33:0/2842712761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba816d880 con 0x7f1b94004810 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bac87a700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 0x7f1ba816cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.906+0000 7f1bad07b700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400fc00 tx=0x7f1ba4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.907+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40072e0 con 0x7f1b94004810 2023-10-09T15:36:47.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.907+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba4007440 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.907+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba80b1470 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.907+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba40057f0 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.907+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba809bf70 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.908+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba80b12d0 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.908+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f1ba4005be0 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.909+0000 7f1b9d7fa700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 0x7f1b8c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.909+0000 7f1bac87a700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 0x7f1b8c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.909+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1ba4084c00 con 0x7f1b94004810 2023-10-09T15:36:47.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.909+0000 7f1bac87a700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 0x7f1b8c0696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b980091e0 tx=0x7f1b98019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:47.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:47.913+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1ba80b12d0 con 0x7f1b94004810 2023-10-09T15:36:48.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.110+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1ba80b12d0 con 0x7f1b94004810 2023-10-09T15:36:48.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.111+0000 7f1b9d7fa700 1 -- 172.21.15.33:0/2842712761 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+15318 (secure 0 0 0) 0x7f1ba80b12d0 con 0x7f1b94004810 2023-10-09T15:36:48.112 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:48.113 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":88,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:46.799134+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:48.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 msgr2=0x7f1b8c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 0x7f1b8c0696b0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f1b980091e0 tx=0x7f1b98019000 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 msgr2=0x7f1ba80b3830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1ba400fc00 tx=0x7f1ba4009040 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 shutdown_connections 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1b8c067200 0x7f1b8c0696b0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b94004810 0x7f1ba80b3830 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ba8158490 0x7f1ba8158930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 --2- 172.21.15.33:0/2842712761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ba816cb50 0x7f1ba816cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 >> 172.21.15.33:0/2842712761 conn(0x7f1ba806ce80 msgr2=0x7f1ba80c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:48.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 shutdown_connections 2023-10-09T15:36:48.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.113+0000 7f1baf2df700 1 -- 172.21.15.33:0/2842712761 wait complete. 2023-10-09T15:36:48.127 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:36:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.248+0000 7f39b9b60700 1 Processor -- start 2023-10-09T15:36:48.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.248+0000 7f39b9b60700 1 -- start start 2023-10-09T15:36:48.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b9b60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f39b4159530 0x7f39b40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b9b60700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40ccfd0 con 0x7f39b406dc70 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b9b60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39b40cf0e0 con 0x7f39b406e0e0 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b9b60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39b415a3d0 con 0x7f39b4159530 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b2ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f39b406dc70 0x7f39b4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56892/0 (socket says 172.21.15.33:56892) 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b2ffd700 1 -- 172.21.15.33:0/692530942 learned_addr learned my addr 172.21.15.33:0/692530942 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b37fe700 1 --2- 172.21.15.33:0/692530942 >> v2:172.21.15.59:3300/0 conn(0x7f39b4159530 0x7f39b40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 804502629 0 0) 0x7f39b40ccfd0 con 0x7f39b406dc70 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f399c003570 con 0x7f39b406dc70 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b37fe700 1 -- 172.21.15.33:0/692530942 >> v1:172.21.15.59:6789/0 conn(0x7f39b406e0e0 legacy=0x7f39b40cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b37fe700 1 -- 172.21.15.33:0/692530942 >> v1:172.21.15.33:6789/0 conn(0x7f39b406dc70 legacy=0x7f39b4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2142557096 0 0) 0x7f39b40cf0e0 con 0x7f39b406e0e0 2023-10-09T15:36:48.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b37fe700 1 -- 172.21.15.33:0/692530942 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b415a6b0 con 0x7f39b4159530 2023-10-09T15:36:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.249+0000 7f39b37fe700 1 --2- 172.21.15.33:0/692530942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b4159530 0x7f39b40ceba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39a40098e0 tx=0x7f39a40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eecf26e208caaa6c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400b640 con 0x7f39b4159530 2023-10-09T15:36:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a400b7a0 con 0x7f39b4159530 2023-10-09T15:36:48.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b27fc700 1 -- 172.21.15.33:0/692530942 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a400bb40 con 0x7f39b4159530 2023-10-09T15:36:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 -- 172.21.15.33:0/692530942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b4159530 msgr2=0x7f39b40ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 --2- 172.21.15.33:0/692530942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b4159530 0x7f39b40ceba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f39a40098e0 tx=0x7f39a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 -- 172.21.15.33:0/692530942 shutdown_connections 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 --2- 172.21.15.33:0/692530942 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b4159530 0x7f39b40ceba0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 -- 172.21.15.33:0/692530942 >> 172.21.15.33:0/692530942 conn(0x7f39b40703a0 msgr2=0x7f39b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 -- 172.21.15.33:0/692530942 shutdown_connections 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.250+0000 7f39b9b60700 1 -- 172.21.15.33:0/692530942 wait complete. 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.251+0000 7f39b9b60700 1 Processor -- start 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.251+0000 7f39b9b60700 1 -- start start 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b406dc70 0x7f39b414f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39b4159530 0x7f39b40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c9dc0 con 0x7f39b406e0e0 2023-10-09T15:36:48.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c91b0 con 0x7f39b406dc70 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b9b60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39b40c9490 con 0x7f39b4159530 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53404/0 (socket says 172.21.15.33:53404) 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b2ffd700 1 -- 172.21.15.33:0/4255164460 learned_addr learned my addr 172.21.15.33:0/4255164460 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b37fe700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b406dc70 0x7f39b414f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.252+0000 7f39b3fff700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39b4159530 0x7f39b40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 -- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39b4159530 msgr2=0x7f39b40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39b4159530 0x7f39b40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 -- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b406dc70 msgr2=0x7f39b414f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b406dc70 0x7f39b414f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 -- 172.21.15.33:0/4255164460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a4009420 con 0x7f39b406e0e0 2023-10-09T15:36:48.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b2ffd700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f39a80011e0 tx=0x7f39a8007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8005b30 con 0x7f39b406e0e0 2023-10-09T15:36:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8005c90 con 0x7f39b406e0e0 2023-10-09T15:36:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39b40c9770 con 0x7f39b406e0e0 2023-10-09T15:36:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8007300 con 0x7f39b406e0e0 2023-10-09T15:36:48.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.253+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39b414fc20 con 0x7f39b406e0e0 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.254+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39b40c9f30 con 0x7f39b406e0e0 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.254+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f39a8007670 con 0x7f39b406e0e0 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.255+0000 7f399b7fe700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 0x7f39a00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.255+0000 7f39b37fe700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 0x7f39a00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.255+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f39a8083d90 con 0x7f39b406e0e0 2023-10-09T15:36:48.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.255+0000 7f39b37fe700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 0x7f39a00696b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39a40093f0 tx=0x7f39a4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:48.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.260+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f39a8087030 con 0x7f39b406e0e0 2023-10-09T15:36:48.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:48.502+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f39b40ca150 con 0x7f39b406e0e0 2023-10-09T15:36:49.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.417+0000 7f399b7fe700 1 -- 172.21.15.33:0/4255164460 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v57) v1 ==== 118+0+0 (secure 0 0 0) 0x7f39a8017020 con 0x7f39b406e0e0 2023-10-09T15:36:49.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 msgr2=0x7f39a00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 0x7f39a00696b0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f39a40093f0 tx=0x7f39a4017000 comp rx=0 tx=0).stop 2023-10-09T15:36:49.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 msgr2=0x7f39b40c8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f39a80011e0 tx=0x7f39a8007df0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 shutdown_connections 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f39a0067200 0x7f39a00696b0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f39b4159530 0x7f39b40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f39b406dc70 0x7f39b414f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 --2- 172.21.15.33:0/4255164460 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f39b406e0e0 0x7f39b40c8860 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 >> 172.21.15.33:0/4255164460 conn(0x7f39b40703a0 msgr2=0x7f39b40cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 shutdown_connections 2023-10-09T15:36:49.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.420+0000 7f39b9b60700 1 -- 172.21.15.33:0/4255164460 wait complete. 2023-10-09T15:36:49.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:36:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.565+0000 7f17df3ea700 1 Processor -- start 2023-10-09T15:36:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.565+0000 7f17df3ea700 1 -- start start 2023-10-09T15:36:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17df3ea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f17d806dc70 0x7f17d8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17df3ea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d80ccfd0 con 0x7f17d8159530 2023-10-09T15:36:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17df3ea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17d815a3d0 con 0x7f17d806e0e0 2023-10-09T15:36:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17df3ea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17d815a6b0 con 0x7f17d806dc70 2023-10-09T15:36:49.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17dd186700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f17d8159530 0x7f17d80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56894/0 (socket says 172.21.15.33:56894) 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17dd186700 1 -- 172.21.15.33:0/2597841980 learned_addr learned my addr 172.21.15.33:0/2597841980 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.566+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3161541370 0 0) 0x7f17d80ccfd0 con 0x7f17d8159530 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17c0003570 con 0x7f17d8159530 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dc985700 1 --2- 172.21.15.33:0/2597841980 >> v2:172.21.15.59:3300/0 conn(0x7f17d806dc70 0x7f17d8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1234552290 0 0) 0x7f17c0003570 con 0x7f17d8159530 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 >> v2:172.21.15.59:3300/0 conn(0x7f17d806dc70 msgr2=0x7f17d8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 --2- 172.21.15.33:0/2597841980 >> v2:172.21.15.59:3300/0 conn(0x7f17d806dc70 0x7f17d8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 >> v1:172.21.15.59:6789/0 conn(0x7f17d806e0e0 legacy=0x7f17d80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d815a990 con 0x7f17d8159530 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f17c80017f0 con 0x7f17d8159530 2023-10-09T15:36:49.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 >> v1:172.21.15.33:6789/0 conn(0x7f17d8159530 legacy=0x7f17d80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c0003a60 0x7f17c0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17c0004810 0x7f17c0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 0x7f17c000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d815a6b0 con 0x7f17c00051c0 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17c000c0d0 con 0x7f17c0004810 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17c000c290 con 0x7f17c0003a60 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 0x7f17c000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dc985700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17c0004810 0x7f17c0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd186700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c0003a60 0x7f17c0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 -- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c0003a60 msgr2=0x7f17c0003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:49.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c0003a60 0x7f17c0003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 -- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17c0004810 msgr2=0x7f17c0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17c0004810 0x7f17c0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 -- 172.21.15.33:0/2597841980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17c0003570 con 0x7f17c00051c0 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.567+0000 7f17dd987700 1 -- 172.21.15.33:0/2597841980 reap_dead start 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17dd987700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 0x7f17c000ba60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f17d00018b0 tx=0x7f17d0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5983033beac0707 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0012420 con 0x7f17c00051c0 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17d00125a0 con 0x7f17c00051c0 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17d7fff700 1 -- 172.21.15.33:0/2597841980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17d0012960 con 0x7f17c00051c0 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 -- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 msgr2=0x7f17c000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 0x7f17c000ba60 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f17d00018b0 tx=0x7f17d0007d30 comp rx=0 tx=0).stop 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 -- 172.21.15.33:0/2597841980 shutdown_connections 2023-10-09T15:36:49.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2597841980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17c00051c0 0x7f17c000ba60 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 -- 172.21.15.33:0/2597841980 >> 172.21.15.33:0/2597841980 conn(0x7f17d80703a0 msgr2=0x7f17d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 -- 172.21.15.33:0/2597841980 shutdown_connections 2023-10-09T15:36:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.568+0000 7f17df3ea700 1 -- 172.21.15.33:0/2597841980 wait complete. 2023-10-09T15:36:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.569+0000 7f17df3ea700 1 Processor -- start 2023-10-09T15:36:49.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.569+0000 7f17df3ea700 1 -- start start 2023-10-09T15:36:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c00051c0 0x7f17d8142aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 0x7f17d816a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80ca180 con 0x7f17d8154490 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17d80c9cf0 con 0x7f17d816a070 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17df3ea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17d816aa20 con 0x7f17c00051c0 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17dc985700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17dc985700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53434/0 (socket says 172.21.15.33:53434) 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.570+0000 7f17dc985700 1 -- 172.21.15.33:0/2833944102 learned_addr learned my addr 172.21.15.33:0/2833944102 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dd987700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 0x7f17d816a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dd186700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c00051c0 0x7f17d8142aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 -- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c00051c0 msgr2=0x7f17d8142aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c00051c0 0x7f17d8142aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 -- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 msgr2=0x7f17d816a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 0x7f17d816a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 -- 172.21.15.33:0/2833944102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17d80c93c0 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dd987700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 0x7f17d816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17dc985700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f17cc006ac0 tx=0x7f17cc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc00fa10 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17cc00fb70 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17d80c96a0 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17cc014440 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.571+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17d8154900 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.572+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17d804c3c0 con 0x7f17d8154490 2023-10-09T15:36:49.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.572+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f17cc014830 con 0x7f17d8154490 2023-10-09T15:36:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.573+0000 7f17d57fa700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 0x7f17c40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.573+0000 7f17dd186700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 0x7f17c40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.573+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f17cc018030 con 0x7f17d8154490 2023-10-09T15:36:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.573+0000 7f17dd186700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 0x7f17c40696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a0c0 tx=0x7f17c8006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:49.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.577+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f17cc052310 con 0x7f17d8154490 2023-10-09T15:36:49.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:49.815+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f17d80c9e30 con 0x7f17d8154490 2023-10-09T15:36:50.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.418+0000 7f17d57fa700 1 -- 172.21.15.33:0/2833944102 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v58) v1 ==== 122+0+0 (secure 0 0 0) 0x7f17cc055930 con 0x7f17d8154490 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.420+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 msgr2=0x7f17c40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.420+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 0x7f17c40696b0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f17c800a0c0 tx=0x7f17c8006040 comp rx=0 tx=0).stop 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.420+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 msgr2=0x7f17d8169b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.420+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f17cc006ac0 tx=0x7f17cc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 shutdown_connections 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f17c4067200 0x7f17c40696b0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f17d816a070 0x7f17d816a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f17c00051c0 0x7f17d8142aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 --2- 172.21.15.33:0/2833944102 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f17d8154490 0x7f17d8169b30 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 >> 172.21.15.33:0/2833944102 conn(0x7f17d80703a0 msgr2=0x7f17d8153b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 shutdown_connections 2023-10-09T15:36:50.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.421+0000 7f17df3ea700 1 -- 172.21.15.33:0/2833944102 wait complete. 2023-10-09T15:36:50.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.558+0000 7fe78c978700 1 Processor -- start 2023-10-09T15:36:50.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.558+0000 7fe78c978700 1 -- start start 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78c978700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7880cf110 0x7fe788164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78c978700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78815afd0 con 0x7fe788153c30 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78c978700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78815b2b0 con 0x7fe78815de50 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78c978700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78815b590 con 0x7fe7880cf110 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe786d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe788153c30 0x7fe78815a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56900/0 (socket says 172.21.15.33:56900) 2023-10-09T15:36:50.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe7880cf110 0x7fe788164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe786d9d700 1 -- 172.21.15.33:0/602821961 learned_addr learned my addr 172.21.15.33:0/602821961 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe785d9b700 1 -- 172.21.15.33:0/602821961 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 217284477 0 0) 0x7fe78815afd0 con 0x7fe788153c30 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe785d9b700 1 -- 172.21.15.33:0/602821961 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe774003570 con 0x7fe788153c30 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78759e700 1 -- 172.21.15.33:0/602821961 >> v1:172.21.15.59:6789/0 conn(0x7fe78815de50 legacy=0x7fe7880cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78759e700 1 -- 172.21.15.33:0/602821961 >> v1:172.21.15.33:6789/0 conn(0x7fe788153c30 legacy=0x7fe78815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78759e700 1 -- 172.21.15.33:0/602821961 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78815b870 con 0x7fe7880cf110 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.559+0000 7fe78759e700 1 --2- 172.21.15.33:0/602821961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7880cf110 0x7fe788164600 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe780009e60 tx=0x7fe780009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70cc0ef406a4ea7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe785d9b700 1 -- 172.21.15.33:0/602821961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78000e070 con 0x7fe7880cf110 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe785d9b700 1 -- 172.21.15.33:0/602821961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78000bb60 con 0x7fe7880cf110 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe785d9b700 1 -- 172.21.15.33:0/602821961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780012430 con 0x7fe7880cf110 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 -- 172.21.15.33:0/602821961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7880cf110 msgr2=0x7fe788164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 --2- 172.21.15.33:0/602821961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7880cf110 0x7fe788164600 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fe780009e60 tx=0x7fe780009780 comp rx=0 tx=0).stop 2023-10-09T15:36:50.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 -- 172.21.15.33:0/602821961 shutdown_connections 2023-10-09T15:36:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 --2- 172.21.15.33:0/602821961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe7880cf110 0x7fe788164600 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 -- 172.21.15.33:0/602821961 >> 172.21.15.33:0/602821961 conn(0x7fe7880703a0 msgr2=0x7fe7880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 -- 172.21.15.33:0/602821961 shutdown_connections 2023-10-09T15:36:50.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.560+0000 7fe78c978700 1 -- 172.21.15.33:0/602821961 wait complete. 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.561+0000 7fe78c978700 1 Processor -- start 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.561+0000 7fe78c978700 1 -- start start 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880cf110 0x7fe788169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe788153c30 0x7fe7880b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b4390 con 0x7fe78815de50 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b3b80 con 0x7fe788153c30 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78c978700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7880b3dd0 con 0x7fe7880cf110 2023-10-09T15:36:50.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:53460/0 (socket says 172.21.15.33:53460) 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 -- 172.21.15.33:0/1671621672 learned_addr learned my addr 172.21.15.33:0/1671621672 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78659c700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe788153c30 0x7fe7880b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe786d9d700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880cf110 0x7fe788169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 -- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880cf110 msgr2=0x7fe788169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880cf110 0x7fe788169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 -- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe788153c30 msgr2=0x7fe7880b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe788153c30 0x7fe7880b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.562+0000 7fe78759e700 1 -- 172.21.15.33:0/1671621672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe780009a20 con 0x7fe78815de50 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe78759e700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe78806eb00 tx=0x7fe780019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe780012e90 con 0x7fe78815de50 2023-10-09T15:36:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe78001d630 con 0x7fe78815de50 2023-10-09T15:36:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7880b40b0 con 0x7fe78815de50 2023-10-09T15:36:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe78001d9f0 con 0x7fe78815de50 2023-10-09T15:36:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.563+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7880b60d0 con 0x7fe78815de50 2023-10-09T15:36:50.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.564+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7880b62f0 con 0x7fe78815de50 2023-10-09T15:36:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.564+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe780024070 con 0x7fe78815de50 2023-10-09T15:36:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.565+0000 7fe77effd700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 0x7fe7680696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.565+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe7800872a0 con 0x7fe78815de50 2023-10-09T15:36:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.565+0000 7fe786d9d700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 0x7fe7680696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.565+0000 7fe786d9d700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 0x7fe7680696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe7780058d0 tx=0x7fe778009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.569+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe7800541c0 con 0x7fe78815de50 2023-10-09T15:36:50.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.810+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe78804c3c0 con 0x7fe78815de50 2023-10-09T15:36:50.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.810+0000 7fe77effd700 1 -- 172.21.15.33:0/1671621672 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4596 (secure 0 0 0) 0x7fe7800577e0 con 0x7fe78815de50 2023-10-09T15:36:50.811 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:50.811 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 msgr2=0x7fe7680696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 0x7fe7680696b0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fe7780058d0 tx=0x7fe778009040 comp rx=0 tx=0).stop 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 msgr2=0x7fe7880c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fe78806eb00 tx=0x7fe780019000 comp rx=0 tx=0).stop 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 shutdown_connections 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe768067200 0x7fe7680696b0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe78815de50 0x7fe7880c91e0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe7880cf110 0x7fe788169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 --2- 172.21.15.33:0/1671621672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe788153c30 0x7fe7880b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 >> 172.21.15.33:0/1671621672 conn(0x7fe7880703a0 msgr2=0x7fe7880c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.812+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 shutdown_connections 2023-10-09T15:36:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.813+0000 7fe78c978700 1 -- 172.21.15.33:0/1671621672 wait complete. 2023-10-09T15:36:50.815 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 58 2023-10-09T15:36:50.826 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.944+0000 7f043e229700 1 Processor -- start 2023-10-09T15:36:50.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.944+0000 7f043e229700 1 -- start start 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f043e229700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f04380cb970 0x7f0438159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f043e229700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f043815a400 0x7f0438156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f043e229700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f043815ae40 con 0x7f04380cb5a0 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f043e229700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04380ce0f0 con 0x7f043815a400 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f043e229700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04380d13f0 con 0x7f04380cb970 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f0437fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f043815a400 0x7f0438156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f04377fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f04380cb5a0 0x7f04380cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50480/0 (socket says 172.21.15.33:50480) 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f04377fe700 1 -- 172.21.15.33:0/1129522952 learned_addr learned my addr 172.21.15.33:0/1129522952 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.945+0000 7f0436ffd700 1 --2- 172.21.15.33:0/1129522952 >> v2:172.21.15.59:3300/0 conn(0x7f04380cb970 0x7f0438159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f0437fff700 1 -- 172.21.15.33:0/1129522952 >> v2:172.21.15.59:3300/0 conn(0x7f04380cb970 msgr2=0x7f0438159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f0437fff700 1 --2- 172.21.15.33:0/1129522952 >> v2:172.21.15.59:3300/0 conn(0x7f04380cb970 0x7f0438159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f0437fff700 1 -- 172.21.15.33:0/1129522952 >> v1:172.21.15.33:6789/0 conn(0x7f04380cb5a0 legacy=0x7f04380cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f0437fff700 1 -- 172.21.15.33:0/1129522952 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f043815ab60 con 0x7f043815a400 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f04367fc700 1 -- 172.21.15.33:0/1129522952 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3270216317 0 0) 0x7f043815ae40 con 0x7f04380cb5a0 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f0437fff700 1 --2- 172.21.15.33:0/1129522952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f043815a400 0x7f0438156e90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1780 tx=0x7f0430009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=721e0cce5d3f1c7e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f04367fc700 1 -- 172.21.15.33:0/1129522952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f043000e070 con 0x7f043815a400 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f04367fc700 1 -- 172.21.15.33:0/1129522952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f043000bb60 con 0x7f043815a400 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f04367fc700 1 -- 172.21.15.33:0/1129522952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0430012430 con 0x7f043815a400 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f043e229700 1 -- 172.21.15.33:0/1129522952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f043815a400 msgr2=0x7f0438156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f043e229700 1 --2- 172.21.15.33:0/1129522952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f043815a400 0x7f0438156e90 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1780 tx=0x7f0430009780 comp rx=0 tx=0).stop 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f043e229700 1 -- 172.21.15.33:0/1129522952 shutdown_connections 2023-10-09T15:36:50.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.946+0000 7f043e229700 1 --2- 172.21.15.33:0/1129522952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f043815a400 0x7f0438156e90 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.947+0000 7f043e229700 1 --2- 172.21.15.33:0/1129522952 >> v2:172.21.15.59:3300/0 conn(0x7f04380cb970 0x7f0438159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.947+0000 7f043e229700 1 -- 172.21.15.33:0/1129522952 >> 172.21.15.33:0/1129522952 conn(0x7f0438070e30 msgr2=0x7f04380d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:50.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.947+0000 7f043e229700 1 -- 172.21.15.33:0/1129522952 shutdown_connections 2023-10-09T15:36:50.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.947+0000 7f043e229700 1 -- 172.21.15.33:0/1129522952 wait complete. 2023-10-09T15:36:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.948+0000 7f043e229700 1 Processor -- start 2023-10-09T15:36:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.948+0000 7f043e229700 1 -- start start 2023-10-09T15:36:50.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.948+0000 7f043e229700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.948+0000 7f043e229700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04380cb970 0x7f04380cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 0x7f04380cf740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380c91d0 con 0x7f04380cb5a0 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04380b4c50 con 0x7f043815a400 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04380b4970 con 0x7f04380cb970 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55736/0 (socket says 172.21.15.33:55736) 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 -- 172.21.15.33:0/3256856157 learned_addr learned my addr 172.21.15.33:0/3256856157 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f0437fff700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 0x7f04380cf740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f0436ffd700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04380cb970 0x7f04380cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 -- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04380cb970 msgr2=0x7f04380cf200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04380cb970 0x7f04380cf200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 -- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 msgr2=0x7f04380cf740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 0x7f04380cf740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 -- 172.21.15.33:0/3256856157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0430009a20 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f0437fff700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 0x7f04380cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f04377fe700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f042800c7e0 tx=0x7f0428007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428005b30 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0428005c90 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04380c8b80 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0428007300 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.949+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04381517f0 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.950+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f043804c3c0 con 0x7f04380cb5a0 2023-10-09T15:36:50.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.951+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f042801b400 con 0x7f04380cb5a0 2023-10-09T15:36:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.951+0000 7f041f7fe700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 0x7f04240696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.951+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0428084500 con 0x7f04380cb5a0 2023-10-09T15:36:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.951+0000 7f0436ffd700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 0x7f04240696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:50.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.952+0000 7f0436ffd700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 0x7f04240696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1160 tx=0x7f042c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:50.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:50.955+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f04280514a0 con 0x7f04380cb5a0 2023-10-09T15:36:51.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.151+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f04380ccf00 con 0x7f04380cb5a0 2023-10-09T15:36:51.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.152+0000 7f041f7fe700 1 -- 172.21.15.33:0/3256856157 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f0428054ac0 con 0x7f04380cb5a0 2023-10-09T15:36:51.153 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:51.153 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:48.395316+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 msgr2=0x7f04240696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 0x7f04240696b0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f04380d1160 tx=0x7f042c008040 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 msgr2=0x7f04381512b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f042800c7e0 tx=0x7f0428007df0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 shutdown_connections 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0424067200 0x7f04240696b0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f04380cb5a0 0x7f04381512b0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f043815a400 0x7f04380cf740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 --2- 172.21.15.33:0/3256856157 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f04380cb970 0x7f04380cf200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 >> 172.21.15.33:0/3256856157 conn(0x7f0438070e30 msgr2=0x7f04381547f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:51.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 shutdown_connections 2023-10-09T15:36:51.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.154+0000 7f043e229700 1 -- 172.21.15.33:0/3256856157 wait complete. 2023-10-09T15:36:51.168 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:36:51.168 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:36:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.286+0000 7f2a6759e700 1 Processor -- start 2023-10-09T15:36:51.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.286+0000 7f2a6759e700 1 -- start start 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a68157710 0x7f2a680acbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a680ad500 con 0x7f2a680ad100 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a6815bdd0 con 0x7f2a68157710 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680aee50 con 0x7f2a68157340 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a65d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a68157710 0x7f2a680acbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a65d9b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2a68157710 0x7f2a680acbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:43304/0 (socket says 172.21.15.33:43304) 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a66d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f2a680ad100 0x7f2a6815b0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:44488/0 (socket says 172.21.15.33:44488) 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a6659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:55336/0 (socket says 172.21.15.33:55336) 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.287+0000 7f2a65d9b700 1 -- 172.21.15.33:0/2494264749 learned_addr learned my addr 172.21.15.33:0/2494264749 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a65d9b700 1 -- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 msgr2=0x7f2a680af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a65d9b700 1 --2- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a65d9b700 1 -- 172.21.15.33:0/2494264749 >> v1:172.21.15.59:6789/0 conn(0x7f2a680ad100 legacy=0x7f2a6815b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a65d9b700 1 -- 172.21.15.33:0/2494264749 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a680af130 con 0x7f2a68157710 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a6559a700 1 -- 172.21.15.33:0/2494264749 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1010124602 0 0) 0x7f2a680ad500 con 0x7f2a680ad100 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a65d9b700 1 --2- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68157710 0x7f2a680acbc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0099b0 tx=0x7f2a5c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bfdcb38d65c3e06 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a6559a700 1 -- 172.21.15.33:0/2494264749 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c009ea0 con 0x7f2a68157710 2023-10-09T15:36:51.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a6559a700 1 -- 172.21.15.33:0/2494264749 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a5c00b860 con 0x7f2a68157710 2023-10-09T15:36:51.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.288+0000 7f2a6559a700 1 -- 172.21.15.33:0/2494264749 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c00bc20 con 0x7f2a68157710 2023-10-09T15:36:51.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 -- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68157710 msgr2=0x7f2a680acbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68157710 0x7f2a680acbc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c0099b0 tx=0x7f2a5c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:51.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 -- 172.21.15.33:0/2494264749 shutdown_connections 2023-10-09T15:36:51.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2494264749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a68157710 0x7f2a680acbc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 -- 172.21.15.33:0/2494264749 >> 172.21.15.33:0/2494264749 conn(0x7f2a6806e280 msgr2=0x7f2a680cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 -- 172.21.15.33:0/2494264749 shutdown_connections 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.289+0000 7f2a6759e700 1 -- 172.21.15.33:0/2494264749 wait complete. 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.290+0000 7f2a6759e700 1 Processor -- start 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.290+0000 7f2a6759e700 1 -- start start 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a680ad100 0x7f2a680c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680c6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c33f0 con 0x7f2a68157710 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c5670 con 0x7f2a680ad100 2023-10-09T15:36:51.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a680c27e0 con 0x7f2a68157340 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55750/0 (socket says 172.21.15.33:55750) 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 -- 172.21.15.33:0/2187472865 learned_addr learned my addr 172.21.15.33:0/2187472865 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a65d9b700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680c6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a6659c700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a680ad100 0x7f2a680c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 -- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 msgr2=0x7f2a680c6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680c6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 -- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a680ad100 msgr2=0x7f2a680c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a680ad100 0x7f2a680c3b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 -- 172.21.15.33:0/2187472865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a5c0094f0 con 0x7f2a68157710 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a66d9d700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000cd50 tx=0x7f2a60001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a60005df0 con 0x7f2a68157710 2023-10-09T15:36:51.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a6000a960 con 0x7f2a68157710 2023-10-09T15:36:51.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.291+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a6000ad20 con 0x7f2a68157710 2023-10-09T15:36:51.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.292+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a680c2ac0 con 0x7f2a68157710 2023-10-09T15:36:51.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.292+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a680c3080 con 0x7f2a68157710 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.293+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a6804c3c0 con 0x7f2a68157710 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.293+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f2a60007300 con 0x7f2a68157710 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.293+0000 7f2a567fc700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 0x7f2a480696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.294+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2a60084b90 con 0x7f2a68157710 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.294+0000 7f2a6659c700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 0x7f2a480696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.294+0000 7f2a6659c700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 0x7f2a480696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009d40 tx=0x7f2a58008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.298+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a60051b30 con 0x7f2a68157710 2023-10-09T15:36:51.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.487+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2a680cdd60 con 0x7f2a48067200 2023-10-09T15:36:51.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.495+0000 7f2a567fc700 1 -- 172.21.15.33:0/2187472865 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289419 (secure 0 0 0) 0x7f2a680cdd60 con 0x7f2a48067200 2023-10-09T15:36:51.500 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.498+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 msgr2=0x7f2a480696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.498+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 0x7f2a480696b0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f2a58009d40 tx=0x7f2a58008040 comp rx=0 tx=0).stop 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.498+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 msgr2=0x7f2a68156410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f2a6000cd50 tx=0x7f2a60001b10 comp rx=0 tx=0).stop 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 shutdown_connections 2023-10-09T15:36:51.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a48067200 0x7f2a480696b0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a68157710 0x7f2a68156410 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a680ad100 0x7f2a680c3b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 --2- 172.21.15.33:0/2187472865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a68157340 0x7f2a680c6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 >> 172.21.15.33:0/2187472865 conn(0x7f2a6806e280 msgr2=0x7f2a680b27c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 shutdown_connections 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.499+0000 7f2a6759e700 1 -- 172.21.15.33:0/2187472865 wait complete. 2023-10-09T15:36:51.503 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:36:51.512 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-10-09T15:36:51.307589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396196,"kb_used_data":9700,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752578524,"statfs":{"total":773094113280,"available":770640408576,"internally_reserved":0,"allocated":9932800,"data_stored":4922338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922937"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422577+0000","last_change":"2023-10-09T15:36:47.422577+0000","last_active":"2023-10-09T15:36:47.422577+0000","last_peered":"2023-10-09T15:36:47.422577+0000","last_clean":"2023-10-09T15:36:47.422577+0000","last_became_active":"2023-10-09T15:36:47.422301+0000","last_became_peered":"2023-10-09T15:36:47.422301+0000","last_unstale":"2023-10-09T15:36:47.422577+0000","last_undegraded":"2023-10-09T15:36:47.422577+0000","last_fullsized":"2023-10-09T15:36:47.422577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:59.561891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420721+0000","last_change":"2023-10-09T15:36:47.420721+0000","last_active":"2023-10-09T15:36:47.420721+0000","last_peered":"2023-10-09T15:36:47.420721+0000","last_clean":"2023-10-09T15:36:47.420721+0000","last_became_active":"2023-10-09T15:36:47.420420+0000","last_became_peered":"2023-10-09T15:36:47.420420+0000","last_unstale":"2023-10-09T15:36:47.420721+0000","last_undegraded":"2023-10-09T15:36:47.420721+0000","last_fullsized":"2023-10-09T15:36:47.420721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:08.174347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417784+0000","last_change":"2023-10-09T15:36:47.417784+0000","last_active":"2023-10-09T15:36:47.417784+0000","last_peered":"2023-10-09T15:36:47.417784+0000","last_clean":"2023-10-09T15:36:47.417784+0000","last_became_active":"2023-10-09T15:36:47.417457+0000","last_became_peered":"2023-10-09T15:36:47.417457+0000","last_unstale":"2023-10-09T15:36:47.417784+0000","last_undegraded":"2023-10-09T15:36:47.417784+0000","last_fullsized":"2023-10-09T15:36:47.417784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:51.422119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414892+0000","last_change":"2023-10-09T15:36:47.414892+0000","last_active":"2023-10-09T15:36:47.414892+0000","last_peered":"2023-10-09T15:36:47.414892+0000","last_clean":"2023-10-09T15:36:47.414892+0000","last_became_active":"2023-10-09T15:36:47.414613+0000","last_became_peered":"2023-10-09T15:36:47.414613+0000","last_unstale":"2023-10-09T15:36:47.414892+0000","last_undegraded":"2023-10-09T15:36:47.414892+0000","last_fullsized":"2023-10-09T15:36:47.414892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:03:37.768941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419379+0000","last_change":"2023-10-09T15:36:47.419379+0000","last_active":"2023-10-09T15:36:47.419379+0000","last_peered":"2023-10-09T15:36:47.419379+0000","last_clean":"2023-10-09T15:36:47.419379+0000","last_became_active":"2023-10-09T15:36:47.419142+0000","last_became_peered":"2023-10-09T15:36:47.419142+0000","last_unstale":"2023-10-09T15:36:47.419379+0000","last_undegraded":"2023-10-09T15:36:47.419379+0000","last_fullsized":"2023-10-09T15:36:47.419379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416885+0000","last_change":"2023-10-09T15:36:47.416885+0000","last_active":"2023-10-09T15:36:47.416885+0000","last_peered":"2023-10-09T15:36:47.416885+0000","last_clean":"2023-10-09T15:36:47.416885+0000","last_became_active":"2023-10-09T15:36:47.416601+0000","last_became_peered":"2023-10-09T15:36:47.416601+0000","last_unstale":"2023-10-09T15:36:47.416885+0000","last_undegraded":"2023-10-09T15:36:47.416885+0000","last_fullsized":"2023-10-09T15:36:47.416885+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419078+0000","last_change":"2023-10-09T15:36:47.419078+0000","last_active":"2023-10-09T15:36:47.419078+0000","last_peered":"2023-10-09T15:36:47.419078+0000","last_clean":"2023-10-09T15:36:47.419078+0000","last_became_active":"2023-10-09T15:36:47.418811+0000","last_became_peered":"2023-10-09T15:36:47.418811+0000","last_unstale":"2023-10-09T15:36:47.419078+0000","last_undegraded":"2023-10-09T15:36:47.419078+0000","last_fullsized":"2023-10-09T15:36:47.419078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417666+0000","last_change":"2023-10-09T15:36:47.417666+0000","last_active":"2023-10-09T15:36:47.417666+0000","last_peered":"2023-10-09T15:36:47.417666+0000","last_clean":"2023-10-09T15:36:47.417666+0000","last_became_active":"2023-10-09T15:36:47.416862+0000","last_became_peered":"2023-10-09T15:36:47.416862+0000","last_unstale":"2023-10-09T15:36:47.417666+0000","last_undegraded":"2023-10-09T15:36:47.417666+0000","last_fullsized":"2023-10-09T15:36:47.417666+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:03.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416178+0000","last_change":"2023-10-09T15:36:47.416178+0000","last_active":"2023-10-09T15:36:47.416178+0000","last_peered":"2023-10-09T15:36:47.416178+0000","last_clean":"2023-10-09T15:36:47.416178+0000","last_became_active":"2023-10-09T15:36:47.413013+0000","last_became_peered":"2023-10-09T15:36:47.413013+0000","last_unstale":"2023-10-09T15:36:47.416178+0000","last_undegraded":"2023-10-09T15:36:47.416178+0000","last_fullsized":"2023-10-09T15:36:47.416178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420634+0000","last_change":"2023-10-09T15:36:47.420634+0000","last_active":"2023-10-09T15:36:47.420634+0000","last_peered":"2023-10-09T15:36:47.420634+0000","last_clean":"2023-10-09T15:36:47.420634+0000","last_became_active":"2023-10-09T15:36:47.420316+0000","last_became_peered":"2023-10-09T15:36:47.420316+0000","last_unstale":"2023-10-09T15:36:47.420634+0000","last_undegraded":"2023-10-09T15:36:47.420634+0000","last_fullsized":"2023-10-09T15:36:47.420634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421522+0000","last_change":"2023-10-09T15:36:47.421522+0000","last_active":"2023-10-09T15:36:47.421522+0000","last_peered":"2023-10-09T15:36:47.421522+0000","last_clean":"2023-10-09T15:36:47.421522+0000","last_became_active":"2023-10-09T15:36:47.421230+0000","last_became_peered":"2023-10-09T15:36:47.421230+0000","last_unstale":"2023-10-09T15:36:47.421522+0000","last_undegraded":"2023-10-09T15:36:47.421522+0000","last_fullsized":"2023-10-09T15:36:47.421522+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:32.193031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421329+0000","last_change":"2023-10-09T15:36:47.421329+0000","last_active":"2023-10-09T15:36:47.421329+0000","last_peered":"2023-10-09T15:36:47.421329+0000","last_clean":"2023-10-09T15:36:47.421329+0000","last_became_active":"2023-10-09T15:36:47.421033+0000","last_became_peered":"2023-10-09T15:36:47.421033+0000","last_unstale":"2023-10-09T15:36:47.421329+0000","last_undegraded":"2023-10-09T15:36:47.421329+0000","last_fullsized":"2023-10-09T15:36:47.421329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:50.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.427698+0000","last_change":"2023-10-09T15:36:47.427698+0000","last_active":"2023-10-09T15:36:47.427698+0000","last_peered":"2023-10-09T15:36:47.427698+0000","last_clean":"2023-10-09T15:36:47.427698+0000","last_became_active":"2023-10-09T15:36:47.427422+0000","last_became_peered":"2023-10-09T15:36:47.427422+0000","last_unstale":"2023-10-09T15:36:47.427698+0000","last_undegraded":"2023-10-09T15:36:47.427698+0000","last_fullsized":"2023-10-09T15:36:47.427698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:16.839482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405823+0000","last_change":"2023-10-09T15:36:47.405823+0000","last_active":"2023-10-09T15:36:47.405823+0000","last_peered":"2023-10-09T15:36:47.405823+0000","last_clean":"2023-10-09T15:36:47.405823+0000","last_became_active":"2023-10-09T15:36:47.405570+0000","last_became_peered":"2023-10-09T15:36:47.405570+0000","last_unstale":"2023-10-09T15:36:47.405823+0000","last_undegraded":"2023-10-09T15:36:47.405823+0000","last_fullsized":"2023-10-09T15:36:47.405823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:06.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421660+0000","last_change":"2023-10-09T15:36:47.421660+0000","last_active":"2023-10-09T15:36:47.421660+0000","last_peered":"2023-10-09T15:36:47.421660+0000","last_clean":"2023-10-09T15:36:47.421660+0000","last_became_active":"2023-10-09T15:36:47.421340+0000","last_became_peered":"2023-10-09T15:36:47.421340+0000","last_unstale":"2023-10-09T15:36:47.421660+0000","last_undegraded":"2023-10-09T15:36:47.421660+0000","last_fullsized":"2023-10-09T15:36:47.421660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426721+0000","last_change":"2023-10-09T15:36:47.426721+0000","last_active":"2023-10-09T15:36:47.426721+0000","last_peered":"2023-10-09T15:36:47.426721+0000","last_clean":"2023-10-09T15:36:47.426721+0000","last_became_active":"2023-10-09T15:36:47.426359+0000","last_became_peered":"2023-10-09T15:36:47.426359+0000","last_unstale":"2023-10-09T15:36:47.426721+0000","last_undegraded":"2023-10-09T15:36:47.426721+0000","last_fullsized":"2023-10-09T15:36:47.426721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:39.305569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.425157+0000","last_change":"2023-10-09T15:36:47.425157+0000","last_active":"2023-10-09T15:36:47.425157+0000","last_peered":"2023-10-09T15:36:47.425157+0000","last_clean":"2023-10-09T15:36:47.425157+0000","last_became_active":"2023-10-09T15:36:47.424859+0000","last_became_peered":"2023-10-09T15:36:47.424859+0000","last_unstale":"2023-10-09T15:36:47.425157+0000","last_undegraded":"2023-10-09T15:36:47.425157+0000","last_fullsized":"2023-10-09T15:36:47.425157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:31.435657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414951+0000","last_change":"2023-10-09T15:36:47.414951+0000","last_active":"2023-10-09T15:36:47.414951+0000","last_peered":"2023-10-09T15:36:47.414951+0000","last_clean":"2023-10-09T15:36:47.414951+0000","last_became_active":"2023-10-09T15:36:47.414669+0000","last_became_peered":"2023-10-09T15:36:47.414669+0000","last_unstale":"2023-10-09T15:36:47.414951+0000","last_undegraded":"2023-10-09T15:36:47.414951+0000","last_fullsized":"2023-10-09T15:36:47.414951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:59.861240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.429961+0000","last_change":"2023-10-09T15:36:47.429961+0000","last_active":"2023-10-09T15:36:47.429961+0000","last_peered":"2023-10-09T15:36:47.429961+0000","last_clean":"2023-10-09T15:36:47.429961+0000","last_became_active":"2023-10-09T15:36:47.429626+0000","last_became_peered":"2023-10-09T15:36:47.429626+0000","last_unstale":"2023-10-09T15:36:47.429961+0000","last_undegraded":"2023-10-09T15:36:47.429961+0000","last_fullsized":"2023-10-09T15:36:47.429961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:13.694967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415161+0000","last_change":"2023-10-09T15:36:47.415161+0000","last_active":"2023-10-09T15:36:47.415161+0000","last_peered":"2023-10-09T15:36:47.415161+0000","last_clean":"2023-10-09T15:36:47.415161+0000","last_became_active":"2023-10-09T15:36:47.413634+0000","last_became_peered":"2023-10-09T15:36:47.413634+0000","last_unstale":"2023-10-09T15:36:47.415161+0000","last_undegraded":"2023-10-09T15:36:47.415161+0000","last_fullsized":"2023-10-09T15:36:47.415161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:53.399271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417796+0000","last_change":"2023-10-09T15:36:47.417796+0000","last_active":"2023-10-09T15:36:47.417796+0000","last_peered":"2023-10-09T15:36:47.417796+0000","last_clean":"2023-10-09T15:36:47.417796+0000","last_became_active":"2023-10-09T15:36:47.417517+0000","last_became_peered":"2023-10-09T15:36:47.417517+0000","last_unstale":"2023-10-09T15:36:47.417796+0000","last_undegraded":"2023-10-09T15:36:47.417796+0000","last_fullsized":"2023-10-09T15:36:47.417796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:47.066805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420039+0000","last_change":"2023-10-09T15:36:47.420039+0000","last_active":"2023-10-09T15:36:47.420039+0000","last_peered":"2023-10-09T15:36:47.420039+0000","last_clean":"2023-10-09T15:36:47.420039+0000","last_became_active":"2023-10-09T15:36:47.419768+0000","last_became_peered":"2023-10-09T15:36:47.419768+0000","last_unstale":"2023-10-09T15:36:47.420039+0000","last_undegraded":"2023-10-09T15:36:47.420039+0000","last_fullsized":"2023-10-09T15:36:47.420039+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418826+0000","last_change":"2023-10-09T15:36:47.418826+0000","last_active":"2023-10-09T15:36:47.418826+0000","last_peered":"2023-10-09T15:36:47.418826+0000","last_clean":"2023-10-09T15:36:47.418826+0000","last_became_active":"2023-10-09T15:36:47.418555+0000","last_became_peered":"2023-10-09T15:36:47.418555+0000","last_unstale":"2023-10-09T15:36:47.418826+0000","last_undegraded":"2023-10-09T15:36:47.418826+0000","last_fullsized":"2023-10-09T15:36:47.418826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:32.193031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423202+0000","last_change":"2023-10-09T15:36:47.423202+0000","last_active":"2023-10-09T15:36:47.423202+0000","last_peered":"2023-10-09T15:36:47.423202+0000","last_clean":"2023-10-09T15:36:47.423202+0000","last_became_active":"2023-10-09T15:36:47.422855+0000","last_became_peered":"2023-10-09T15:36:47.422855+0000","last_unstale":"2023-10-09T15:36:47.423202+0000","last_undegraded":"2023-10-09T15:36:47.423202+0000","last_fullsized":"2023-10-09T15:36:47.423202+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:03.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426739+0000","last_change":"2023-10-09T15:36:47.426739+0000","last_active":"2023-10-09T15:36:47.426739+0000","last_peered":"2023-10-09T15:36:47.426739+0000","last_clean":"2023-10-09T15:36:47.426739+0000","last_became_active":"2023-10-09T15:36:47.426154+0000","last_became_peered":"2023-10-09T15:36:47.426154+0000","last_unstale":"2023-10-09T15:36:47.426739+0000","last_undegraded":"2023-10-09T15:36:47.426739+0000","last_fullsized":"2023-10-09T15:36:47.426739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:18.708089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422475+0000","last_change":"2023-10-09T15:36:47.422475+0000","last_active":"2023-10-09T15:36:47.422475+0000","last_peered":"2023-10-09T15:36:47.422475+0000","last_clean":"2023-10-09T15:36:47.422475+0000","last_became_active":"2023-10-09T15:36:47.422079+0000","last_became_peered":"2023-10-09T15:36:47.422079+0000","last_unstale":"2023-10-09T15:36:47.422475+0000","last_undegraded":"2023-10-09T15:36:47.422475+0000","last_fullsized":"2023-10-09T15:36:47.422475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:45.373027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416813+0000","last_change":"2023-10-09T15:36:47.416813+0000","last_active":"2023-10-09T15:36:47.416813+0000","last_peered":"2023-10-09T15:36:47.416813+0000","last_clean":"2023-10-09T15:36:47.416813+0000","last_became_active":"2023-10-09T15:36:47.416526+0000","last_became_peered":"2023-10-09T15:36:47.416526+0000","last_unstale":"2023-10-09T15:36:47.416813+0000","last_undegraded":"2023-10-09T15:36:47.416813+0000","last_fullsized":"2023-10-09T15:36:47.416813+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:21.067920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.428156+0000","last_change":"2023-10-09T15:36:47.428156+0000","last_active":"2023-10-09T15:36:47.428156+0000","last_peered":"2023-10-09T15:36:47.428156+0000","last_clean":"2023-10-09T15:36:47.428156+0000","last_became_active":"2023-10-09T15:36:47.427878+0000","last_became_peered":"2023-10-09T15:36:47.427878+0000","last_unstale":"2023-10-09T15:36:47.428156+0000","last_undegraded":"2023-10-09T15:36:47.428156+0000","last_fullsized":"2023-10-09T15:36:47.428156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:50.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424456+0000","last_change":"2023-10-09T15:36:47.424456+0000","last_active":"2023-10-09T15:36:47.424456+0000","last_peered":"2023-10-09T15:36:47.424456+0000","last_clean":"2023-10-09T15:36:47.424456+0000","last_became_active":"2023-10-09T15:36:47.422582+0000","last_became_peered":"2023-10-09T15:36:47.422582+0000","last_unstale":"2023-10-09T15:36:47.424456+0000","last_undegraded":"2023-10-09T15:36:47.424456+0000","last_fullsized":"2023-10-09T15:36:47.424456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418669+0000","last_change":"2023-10-09T15:36:47.418669+0000","last_active":"2023-10-09T15:36:47.418669+0000","last_peered":"2023-10-09T15:36:47.418669+0000","last_clean":"2023-10-09T15:36:47.418669+0000","last_became_active":"2023-10-09T15:36:47.418401+0000","last_became_peered":"2023-10-09T15:36:47.418401+0000","last_unstale":"2023-10-09T15:36:47.418669+0000","last_undegraded":"2023-10-09T15:36:47.418669+0000","last_fullsized":"2023-10-09T15:36:47.418669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:35.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419576+0000","last_change":"2023-10-09T15:36:47.419576+0000","last_active":"2023-10-09T15:36:47.419576+0000","last_peered":"2023-10-09T15:36:47.419576+0000","last_clean":"2023-10-09T15:36:47.419576+0000","last_became_active":"2023-10-09T15:36:47.419308+0000","last_became_peered":"2023-10-09T15:36:47.419308+0000","last_unstale":"2023-10-09T15:36:47.419576+0000","last_undegraded":"2023-10-09T15:36:47.419576+0000","last_fullsized":"2023-10-09T15:36:47.419576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426614+0000","last_change":"2023-10-09T15:36:47.426614+0000","last_active":"2023-10-09T15:36:47.426614+0000","last_peered":"2023-10-09T15:36:47.426614+0000","last_clean":"2023-10-09T15:36:47.426614+0000","last_became_active":"2023-10-09T15:36:47.426361+0000","last_became_peered":"2023-10-09T15:36:47.426361+0000","last_unstale":"2023-10-09T15:36:47.426614+0000","last_undegraded":"2023-10-09T15:36:47.426614+0000","last_fullsized":"2023-10-09T15:36:47.426614+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:19:28.448077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416277+0000","last_change":"2023-10-09T15:36:47.416277+0000","last_active":"2023-10-09T15:36:47.416277+0000","last_peered":"2023-10-09T15:36:47.416277+0000","last_clean":"2023-10-09T15:36:47.416277+0000","last_became_active":"2023-10-09T15:36:47.416031+0000","last_became_peered":"2023-10-09T15:36:47.416031+0000","last_unstale":"2023-10-09T15:36:47.416277+0000","last_undegraded":"2023-10-09T15:36:47.416277+0000","last_fullsized":"2023-10-09T15:36:47.416277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:24.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"88'4","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.427823+0000","last_change":"2023-10-09T15:36:46.410673+0000","last_active":"2023-10-09T15:36:47.427823+0000","last_peered":"2023-10-09T15:36:47.427823+0000","last_clean":"2023-10-09T15:36:47.427823+0000","last_became_active":"2023-10-09T15:36:46.407940+0000","last_became_peered":"2023-10-09T15:36:46.407940+0000","last_unstale":"2023-10-09T15:36:47.427823+0000","last_undegraded":"2023-10-09T15:36:47.427823+0000","last_fullsized":"2023-10-09T15:36:47.427823+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:57.104684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419252+0000","last_change":"2023-10-09T15:36:47.419252+0000","last_active":"2023-10-09T15:36:47.419252+0000","last_peered":"2023-10-09T15:36:47.419252+0000","last_clean":"2023-10-09T15:36:47.419252+0000","last_became_active":"2023-10-09T15:36:47.418945+0000","last_became_peered":"2023-10-09T15:36:47.418945+0000","last_unstale":"2023-10-09T15:36:47.419252+0000","last_undegraded":"2023-10-09T15:36:47.419252+0000","last_fullsized":"2023-10-09T15:36:47.419252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405624+0000","last_change":"2023-10-09T15:36:46.409635+0000","last_active":"2023-10-09T15:36:47.405624+0000","last_peered":"2023-10-09T15:36:47.405624+0000","last_clean":"2023-10-09T15:36:47.405624+0000","last_became_active":"2023-10-09T15:36:46.409365+0000","last_became_peered":"2023-10-09T15:36:46.409365+0000","last_unstale":"2023-10-09T15:36:47.405624+0000","last_undegraded":"2023-10-09T15:36:47.405624+0000","last_fullsized":"2023-10-09T15:36:47.405624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:13.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423158+0000","last_change":"2023-10-09T15:36:47.423158+0000","last_active":"2023-10-09T15:36:47.423158+0000","last_peered":"2023-10-09T15:36:47.423158+0000","last_clean":"2023-10-09T15:36:47.423158+0000","last_became_active":"2023-10-09T15:36:47.422711+0000","last_became_peered":"2023-10-09T15:36:47.422711+0000","last_unstale":"2023-10-09T15:36:47.423158+0000","last_undegraded":"2023-10-09T15:36:47.423158+0000","last_fullsized":"2023-10-09T15:36:47.423158+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:48.097318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424198+0000","last_change":"2023-10-09T15:36:46.410612+0000","last_active":"2023-10-09T15:36:47.424198+0000","last_peered":"2023-10-09T15:36:47.424198+0000","last_clean":"2023-10-09T15:36:47.424198+0000","last_became_active":"2023-10-09T15:36:46.407869+0000","last_became_peered":"2023-10-09T15:36:46.407869+0000","last_unstale":"2023-10-09T15:36:47.424198+0000","last_undegraded":"2023-10-09T15:36:47.424198+0000","last_fullsized":"2023-10-09T15:36:47.424198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.117286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414263+0000","last_change":"2023-10-09T15:36:47.414263+0000","last_active":"2023-10-09T15:36:47.414263+0000","last_peered":"2023-10-09T15:36:47.414263+0000","last_clean":"2023-10-09T15:36:47.414263+0000","last_became_active":"2023-10-09T15:36:47.413968+0000","last_became_peered":"2023-10-09T15:36:47.413968+0000","last_unstale":"2023-10-09T15:36:47.414263+0000","last_undegraded":"2023-10-09T15:36:47.414263+0000","last_fullsized":"2023-10-09T15:36:47.414263+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:14.858920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424032+0000","last_change":"2023-10-09T15:36:46.407661+0000","last_active":"2023-10-09T15:36:47.424032+0000","last_peered":"2023-10-09T15:36:47.424032+0000","last_clean":"2023-10-09T15:36:47.424032+0000","last_became_active":"2023-10-09T15:36:46.407359+0000","last_became_peered":"2023-10-09T15:36:46.407359+0000","last_unstale":"2023-10-09T15:36:47.424032+0000","last_undegraded":"2023-10-09T15:36:47.424032+0000","last_fullsized":"2023-10-09T15:36:47.424032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:52.391930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413872+0000","last_change":"2023-10-09T15:36:47.413872+0000","last_active":"2023-10-09T15:36:47.413872+0000","last_peered":"2023-10-09T15:36:47.413872+0000","last_clean":"2023-10-09T15:36:47.413872+0000","last_became_active":"2023-10-09T15:36:47.413580+0000","last_became_peered":"2023-10-09T15:36:47.413580+0000","last_unstale":"2023-10-09T15:36:47.413872+0000","last_undegraded":"2023-10-09T15:36:47.413872+0000","last_fullsized":"2023-10-09T15:36:47.413872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:59.561891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418702+0000","last_change":"2023-10-09T15:36:46.403115+0000","last_active":"2023-10-09T15:36:47.418702+0000","last_peered":"2023-10-09T15:36:47.418702+0000","last_clean":"2023-10-09T15:36:47.418702+0000","last_became_active":"2023-10-09T15:36:46.402741+0000","last_became_peered":"2023-10-09T15:36:46.402741+0000","last_unstale":"2023-10-09T15:36:47.418702+0000","last_undegraded":"2023-10-09T15:36:47.418702+0000","last_fullsized":"2023-10-09T15:36:47.418702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:13.996205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415395+0000","last_change":"2023-10-09T15:36:47.415395+0000","last_active":"2023-10-09T15:36:47.415395+0000","last_peered":"2023-10-09T15:36:47.415395+0000","last_clean":"2023-10-09T15:36:47.415395+0000","last_became_active":"2023-10-09T15:36:47.415106+0000","last_became_peered":"2023-10-09T15:36:47.415106+0000","last_unstale":"2023-10-09T15:36:47.415395+0000","last_undegraded":"2023-10-09T15:36:47.415395+0000","last_fullsized":"2023-10-09T15:36:47.415395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405039+0000","last_change":"2023-10-09T15:36:46.404530+0000","last_active":"2023-10-09T15:36:47.405039+0000","last_peered":"2023-10-09T15:36:47.405039+0000","last_clean":"2023-10-09T15:36:47.405039+0000","last_became_active":"2023-10-09T15:36:46.404202+0000","last_became_peered":"2023-10-09T15:36:46.404202+0000","last_unstale":"2023-10-09T15:36:47.405039+0000","last_undegraded":"2023-10-09T15:36:47.405039+0000","last_fullsized":"2023-10-09T15:36:47.405039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415634+0000","last_change":"2023-10-09T15:36:47.415634+0000","last_active":"2023-10-09T15:36:47.415634+0000","last_peered":"2023-10-09T15:36:47.415634+0000","last_clean":"2023-10-09T15:36:47.415634+0000","last_became_active":"2023-10-09T15:36:47.415356+0000","last_became_peered":"2023-10-09T15:36:47.415356+0000","last_unstale":"2023-10-09T15:36:47.415634+0000","last_undegraded":"2023-10-09T15:36:47.415634+0000","last_fullsized":"2023-10-09T15:36:47.415634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:39.305569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406822+0000","last_change":"2023-10-09T15:36:46.404996+0000","last_active":"2023-10-09T15:36:46.406822+0000","last_peered":"2023-10-09T15:36:46.406822+0000","last_clean":"2023-10-09T15:36:46.406822+0000","last_became_active":"2023-10-09T15:36:46.404748+0000","last_became_peered":"2023-10-09T15:36:46.404748+0000","last_unstale":"2023-10-09T15:36:46.406822+0000","last_undegraded":"2023-10-09T15:36:46.406822+0000","last_fullsized":"2023-10-09T15:36:46.406822+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:50.414779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418027+0000","last_change":"2023-10-09T15:36:47.418027+0000","last_active":"2023-10-09T15:36:47.418027+0000","last_peered":"2023-10-09T15:36:47.418027+0000","last_clean":"2023-10-09T15:36:47.418027+0000","last_became_active":"2023-10-09T15:36:47.417696+0000","last_became_peered":"2023-10-09T15:36:47.417696+0000","last_unstale":"2023-10-09T15:36:47.418027+0000","last_undegraded":"2023-10-09T15:36:47.418027+0000","last_fullsized":"2023-10-09T15:36:47.418027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:44.141388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.409152+0000","last_change":"2023-10-09T15:36:46.405626+0000","last_active":"2023-10-09T15:36:46.409152+0000","last_peered":"2023-10-09T15:36:46.409152+0000","last_clean":"2023-10-09T15:36:46.409152+0000","last_became_active":"2023-10-09T15:36:46.403230+0000","last_became_peered":"2023-10-09T15:36:46.403230+0000","last_unstale":"2023-10-09T15:36:46.409152+0000","last_undegraded":"2023-10-09T15:36:46.409152+0000","last_fullsized":"2023-10-09T15:36:46.409152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:16:17.466871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424393+0000","last_change":"2023-10-09T15:36:47.424393+0000","last_active":"2023-10-09T15:36:47.424393+0000","last_peered":"2023-10-09T15:36:47.424393+0000","last_clean":"2023-10-09T15:36:47.424393+0000","last_became_active":"2023-10-09T15:36:47.423931+0000","last_became_peered":"2023-10-09T15:36:47.423931+0000","last_unstale":"2023-10-09T15:36:47.424393+0000","last_undegraded":"2023-10-09T15:36:47.424393+0000","last_fullsized":"2023-10-09T15:36:47.424393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:31.052302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.409486+0000","last_change":"2023-10-09T15:36:46.407919+0000","last_active":"2023-10-09T15:36:46.409486+0000","last_peered":"2023-10-09T15:36:46.409486+0000","last_clean":"2023-10-09T15:36:46.409486+0000","last_became_active":"2023-10-09T15:36:46.407642+0000","last_became_peered":"2023-10-09T15:36:46.407642+0000","last_unstale":"2023-10-09T15:36:46.409486+0000","last_undegraded":"2023-10-09T15:36:46.409486+0000","last_fullsized":"2023-10-09T15:36:46.409486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:19:09.904144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420286+0000","last_change":"2023-10-09T15:36:47.420286+0000","last_active":"2023-10-09T15:36:47.420286+0000","last_peered":"2023-10-09T15:36:47.420286+0000","last_clean":"2023-10-09T15:36:47.420286+0000","last_became_active":"2023-10-09T15:36:47.419974+0000","last_became_peered":"2023-10-09T15:36:47.419974+0000","last_unstale":"2023-10-09T15:36:47.420286+0000","last_undegraded":"2023-10-09T15:36:47.420286+0000","last_fullsized":"2023-10-09T15:36:47.420286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:22.020942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.408850+0000","last_change":"2023-10-09T15:36:46.407233+0000","last_active":"2023-10-09T15:36:46.408850+0000","last_peered":"2023-10-09T15:36:46.408850+0000","last_clean":"2023-10-09T15:36:46.408850+0000","last_became_active":"2023-10-09T15:36:46.406958+0000","last_became_peered":"2023-10-09T15:36:46.406958+0000","last_unstale":"2023-10-09T15:36:46.408850+0000","last_undegraded":"2023-10-09T15:36:46.408850+0000","last_fullsized":"2023-10-09T15:36:46.408850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410863+0000","last_change":"2023-10-09T15:36:47.410863+0000","last_active":"2023-10-09T15:36:47.410863+0000","last_peered":"2023-10-09T15:36:47.410863+0000","last_clean":"2023-10-09T15:36:47.410863+0000","last_became_active":"2023-10-09T15:36:47.410591+0000","last_became_peered":"2023-10-09T15:36:47.410591+0000","last_unstale":"2023-10-09T15:36:47.410863+0000","last_undegraded":"2023-10-09T15:36:47.410863+0000","last_fullsized":"2023-10-09T15:36:47.410863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:30.124627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"88'3","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423613+0000","last_change":"2023-10-09T15:36:46.407253+0000","last_active":"2023-10-09T15:36:47.423613+0000","last_peered":"2023-10-09T15:36:47.423613+0000","last_clean":"2023-10-09T15:36:47.423613+0000","last_became_active":"2023-10-09T15:36:46.406920+0000","last_became_peered":"2023-10-09T15:36:46.406920+0000","last_unstale":"2023-10-09T15:36:47.423613+0000","last_undegraded":"2023-10-09T15:36:47.423613+0000","last_fullsized":"2023-10-09T15:36:47.423613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426714+0000","last_change":"2023-10-09T15:36:47.426714+0000","last_active":"2023-10-09T15:36:47.426714+0000","last_peered":"2023-10-09T15:36:47.426714+0000","last_clean":"2023-10-09T15:36:47.426714+0000","last_became_active":"2023-10-09T15:36:47.426421+0000","last_became_peered":"2023-10-09T15:36:47.426421+0000","last_unstale":"2023-10-09T15:36:47.426714+0000","last_undegraded":"2023-10-09T15:36:47.426714+0000","last_fullsized":"2023-10-09T15:36:47.426714+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:31.435657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"88'6","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.428081+0000","last_change":"2023-10-09T15:36:46.403396+0000","last_active":"2023-10-09T15:36:47.428081+0000","last_peered":"2023-10-09T15:36:47.428081+0000","last_clean":"2023-10-09T15:36:47.428081+0000","last_became_active":"2023-10-09T15:36:46.403051+0000","last_became_peered":"2023-10-09T15:36:46.403051+0000","last_unstale":"2023-10-09T15:36:47.428081+0000","last_undegraded":"2023-10-09T15:36:47.428081+0000","last_fullsized":"2023-10-09T15:36:47.428081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:50.414779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416873+0000","last_change":"2023-10-09T15:36:47.416873+0000","last_active":"2023-10-09T15:36:47.416873+0000","last_peered":"2023-10-09T15:36:47.416873+0000","last_clean":"2023-10-09T15:36:47.416873+0000","last_became_active":"2023-10-09T15:36:47.416576+0000","last_became_peered":"2023-10-09T15:36:47.416576+0000","last_unstale":"2023-10-09T15:36:47.416873+0000","last_undegraded":"2023-10-09T15:36:47.416873+0000","last_fullsized":"2023-10-09T15:36:47.416873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:21.067920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.430526+0000","last_change":"2023-10-09T15:36:46.403652+0000","last_active":"2023-10-09T15:36:47.430526+0000","last_peered":"2023-10-09T15:36:47.430526+0000","last_clean":"2023-10-09T15:36:47.430526+0000","last_became_active":"2023-10-09T15:36:46.403339+0000","last_became_peered":"2023-10-09T15:36:46.403339+0000","last_unstale":"2023-10-09T15:36:47.430526+0000","last_undegraded":"2023-10-09T15:36:47.430526+0000","last_fullsized":"2023-10-09T15:36:47.430526+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:22.343073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414600+0000","last_change":"2023-10-09T15:36:47.414600+0000","last_active":"2023-10-09T15:36:47.414600+0000","last_peered":"2023-10-09T15:36:47.414600+0000","last_clean":"2023-10-09T15:36:47.414600+0000","last_became_active":"2023-10-09T15:36:47.414321+0000","last_became_peered":"2023-10-09T15:36:47.414321+0000","last_unstale":"2023-10-09T15:36:47.414600+0000","last_undegraded":"2023-10-09T15:36:47.414600+0000","last_fullsized":"2023-10-09T15:36:47.414600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:32.061169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411834+0000","last_change":"2023-10-09T15:36:46.408562+0000","last_active":"2023-10-09T15:36:46.411834+0000","last_peered":"2023-10-09T15:36:46.411834+0000","last_clean":"2023-10-09T15:36:46.411834+0000","last_became_active":"2023-10-09T15:36:46.407818+0000","last_became_peered":"2023-10-09T15:36:46.407818+0000","last_unstale":"2023-10-09T15:36:46.411834+0000","last_undegraded":"2023-10-09T15:36:46.411834+0000","last_fullsized":"2023-10-09T15:36:46.411834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:00.434605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413186+0000","last_change":"2023-10-09T15:36:47.413186+0000","last_active":"2023-10-09T15:36:47.413186+0000","last_peered":"2023-10-09T15:36:47.413186+0000","last_clean":"2023-10-09T15:36:47.413186+0000","last_became_active":"2023-10-09T15:36:47.412853+0000","last_became_peered":"2023-10-09T15:36:47.412853+0000","last_unstale":"2023-10-09T15:36:47.413186+0000","last_undegraded":"2023-10-09T15:36:47.413186+0000","last_fullsized":"2023-10-09T15:36:47.413186+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:53.688382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.410252+0000","last_change":"2023-10-09T15:36:46.407022+0000","last_active":"2023-10-09T15:36:46.410252+0000","last_peered":"2023-10-09T15:36:46.410252+0000","last_clean":"2023-10-09T15:36:46.410252+0000","last_became_active":"2023-10-09T15:36:46.406754+0000","last_became_peered":"2023-10-09T15:36:46.406754+0000","last_unstale":"2023-10-09T15:36:46.410252+0000","last_undegraded":"2023-10-09T15:36:46.410252+0000","last_fullsized":"2023-10-09T15:36:46.410252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:58.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.403512+0000","last_change":"2023-10-09T15:36:47.403512+0000","last_active":"2023-10-09T15:36:47.403512+0000","last_peered":"2023-10-09T15:36:47.403512+0000","last_clean":"2023-10-09T15:36:47.403512+0000","last_became_active":"2023-10-09T15:36:47.403215+0000","last_became_peered":"2023-10-09T15:36:47.403215+0000","last_unstale":"2023-10-09T15:36:47.403512+0000","last_undegraded":"2023-10-09T15:36:47.403512+0000","last_fullsized":"2023-10-09T15:36:47.403512+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:42.089522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"88'8","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.425648+0000","last_change":"2023-10-09T15:36:46.408310+0000","last_active":"2023-10-09T15:36:47.425648+0000","last_peered":"2023-10-09T15:36:47.425648+0000","last_clean":"2023-10-09T15:36:47.425648+0000","last_became_active":"2023-10-09T15:36:46.408055+0000","last_became_peered":"2023-10-09T15:36:46.408055+0000","last_unstale":"2023-10-09T15:36:47.425648+0000","last_undegraded":"2023-10-09T15:36:47.425648+0000","last_fullsized":"2023-10-09T15:36:47.425648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:29.056276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410458+0000","last_change":"2023-10-09T15:36:47.410458+0000","last_active":"2023-10-09T15:36:47.410458+0000","last_peered":"2023-10-09T15:36:47.410458+0000","last_clean":"2023-10-09T15:36:47.410458+0000","last_became_active":"2023-10-09T15:36:47.409486+0000","last_became_peered":"2023-10-09T15:36:47.409486+0000","last_unstale":"2023-10-09T15:36:47.410458+0000","last_undegraded":"2023-10-09T15:36:47.410458+0000","last_fullsized":"2023-10-09T15:36:47.410458+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:03:37.768941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.430272+0000","last_change":"2023-10-09T15:36:46.406891+0000","last_active":"2023-10-09T15:36:47.430272+0000","last_peered":"2023-10-09T15:36:47.430272+0000","last_clean":"2023-10-09T15:36:47.430272+0000","last_became_active":"2023-10-09T15:36:46.406612+0000","last_became_peered":"2023-10-09T15:36:46.406612+0000","last_unstale":"2023-10-09T15:36:47.430272+0000","last_undegraded":"2023-10-09T15:36:47.430272+0000","last_fullsized":"2023-10-09T15:36:47.430272+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:47.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416174+0000","last_change":"2023-10-09T15:36:47.416174+0000","last_active":"2023-10-09T15:36:47.416174+0000","last_peered":"2023-10-09T15:36:47.416174+0000","last_clean":"2023-10-09T15:36:47.416174+0000","last_became_active":"2023-10-09T15:36:47.415847+0000","last_became_peered":"2023-10-09T15:36:47.415847+0000","last_unstale":"2023-10-09T15:36:47.416174+0000","last_undegraded":"2023-10-09T15:36:47.416174+0000","last_fullsized":"2023-10-09T15:36:47.416174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:19:28.448077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.402469+0000","last_change":"2023-10-09T15:36:46.398568+0000","last_active":"2023-10-09T15:36:47.402469+0000","last_peered":"2023-10-09T15:36:47.402469+0000","last_clean":"2023-10-09T15:36:47.402469+0000","last_became_active":"2023-10-09T15:36:46.398167+0000","last_became_peered":"2023-10-09T15:36:46.398167+0000","last_unstale":"2023-10-09T15:36:47.402469+0000","last_undegraded":"2023-10-09T15:36:47.402469+0000","last_fullsized":"2023-10-09T15:36:47.402469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:25.222489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424227+0000","last_change":"2023-10-09T15:36:47.424227+0000","last_active":"2023-10-09T15:36:47.424227+0000","last_peered":"2023-10-09T15:36:47.424227+0000","last_clean":"2023-10-09T15:36:47.424227+0000","last_became_active":"2023-10-09T15:36:47.423775+0000","last_became_peered":"2023-10-09T15:36:47.423775+0000","last_unstale":"2023-10-09T15:36:47.424227+0000","last_undegraded":"2023-10-09T15:36:47.424227+0000","last_fullsized":"2023-10-09T15:36:47.424227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411192+0000","last_change":"2023-10-09T15:36:46.405086+0000","last_active":"2023-10-09T15:36:46.411192+0000","last_peered":"2023-10-09T15:36:46.411192+0000","last_clean":"2023-10-09T15:36:46.411192+0000","last_became_active":"2023-10-09T15:36:46.404730+0000","last_became_peered":"2023-10-09T15:36:46.404730+0000","last_unstale":"2023-10-09T15:36:46.411192+0000","last_undegraded":"2023-10-09T15:36:46.411192+0000","last_fullsized":"2023-10-09T15:36:46.411192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:43.134048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.412812+0000","last_change":"2023-10-09T15:36:47.412812+0000","last_active":"2023-10-09T15:36:47.412812+0000","last_peered":"2023-10-09T15:36:47.412812+0000","last_clean":"2023-10-09T15:36:47.412812+0000","last_became_active":"2023-10-09T15:36:47.412484+0000","last_became_peered":"2023-10-09T15:36:47.412484+0000","last_unstale":"2023-10-09T15:36:47.412812+0000","last_undegraded":"2023-10-09T15:36:47.412812+0000","last_fullsized":"2023-10-09T15:36:47.412812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:31.938709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424217+0000","last_change":"2023-10-09T15:36:46.404205+0000","last_active":"2023-10-09T15:36:47.424217+0000","last_peered":"2023-10-09T15:36:47.424217+0000","last_clean":"2023-10-09T15:36:47.424217+0000","last_became_active":"2023-10-09T15:36:46.403937+0000","last_became_peered":"2023-10-09T15:36:46.403937+0000","last_unstale":"2023-10-09T15:36:47.424217+0000","last_undegraded":"2023-10-09T15:36:47.424217+0000","last_fullsized":"2023-10-09T15:36:47.424217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:28.294765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.431298+0000","last_change":"2023-10-09T15:36:47.431298+0000","last_active":"2023-10-09T15:36:47.431298+0000","last_peered":"2023-10-09T15:36:47.431298+0000","last_clean":"2023-10-09T15:36:47.431298+0000","last_became_active":"2023-10-09T15:36:47.431002+0000","last_became_peered":"2023-10-09T15:36:47.431002+0000","last_unstale":"2023-10-09T15:36:47.431298+0000","last_undegraded":"2023-10-09T15:36:47.431298+0000","last_fullsized":"2023-10-09T15:36:47.431298+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:36:32.365133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406046+0000","last_change":"2023-10-09T15:36:46.404419+0000","last_active":"2023-10-09T15:36:46.406046+0000","last_peered":"2023-10-09T15:36:46.406046+0000","last_clean":"2023-10-09T15:36:46.406046+0000","last_became_active":"2023-10-09T15:36:46.404221+0000","last_became_peered":"2023-10-09T15:36:46.404221+0000","last_unstale":"2023-10-09T15:36:46.406046+0000","last_undegraded":"2023-10-09T15:36:46.406046+0000","last_fullsized":"2023-10-09T15:36:46.406046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:38.010757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410598+0000","last_change":"2023-10-09T15:36:47.410598+0000","last_active":"2023-10-09T15:36:47.410598+0000","last_peered":"2023-10-09T15:36:47.410598+0000","last_clean":"2023-10-09T15:36:47.410598+0000","last_became_active":"2023-10-09T15:36:47.410165+0000","last_became_peered":"2023-10-09T15:36:47.410165+0000","last_unstale":"2023-10-09T15:36:47.410598+0000","last_undegraded":"2023-10-09T15:36:47.410598+0000","last_fullsized":"2023-10-09T15:36:47.410598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:18.881173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406016+0000","last_change":"2023-10-09T15:36:46.403902+0000","last_active":"2023-10-09T15:36:46.406016+0000","last_peered":"2023-10-09T15:36:46.406016+0000","last_clean":"2023-10-09T15:36:46.406016+0000","last_became_active":"2023-10-09T15:36:46.403623+0000","last_became_peered":"2023-10-09T15:36:46.403623+0000","last_unstale":"2023-10-09T15:36:46.406016+0000","last_undegraded":"2023-10-09T15:36:46.406016+0000","last_fullsized":"2023-10-09T15:36:46.406016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:12.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420496+0000","last_change":"2023-10-09T15:36:47.420496+0000","last_active":"2023-10-09T15:36:47.420496+0000","last_peered":"2023-10-09T15:36:47.420496+0000","last_clean":"2023-10-09T15:36:47.420496+0000","last_became_active":"2023-10-09T15:36:47.420207+0000","last_became_peered":"2023-10-09T15:36:47.420207+0000","last_unstale":"2023-10-09T15:36:47.420496+0000","last_undegraded":"2023-10-09T15:36:47.420496+0000","last_fullsized":"2023-10-09T15:36:47.420496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:59.861240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411622+0000","last_change":"2023-10-09T15:36:46.406369+0000","last_active":"2023-10-09T15:36:46.411622+0000","last_peered":"2023-10-09T15:36:46.411622+0000","last_clean":"2023-10-09T15:36:46.411622+0000","last_became_active":"2023-10-09T15:36:46.406097+0000","last_became_peered":"2023-10-09T15:36:46.406097+0000","last_unstale":"2023-10-09T15:36:46.411622+0000","last_undegraded":"2023-10-09T15:36:46.411622+0000","last_fullsized":"2023-10-09T15:36:46.411622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:17.727872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420223+0000","last_change":"2023-10-09T15:36:47.420223+0000","last_active":"2023-10-09T15:36:47.420223+0000","last_peered":"2023-10-09T15:36:47.420223+0000","last_clean":"2023-10-09T15:36:47.420223+0000","last_became_active":"2023-10-09T15:36:47.418794+0000","last_became_peered":"2023-10-09T15:36:47.418794+0000","last_unstale":"2023-10-09T15:36:47.420223+0000","last_undegraded":"2023-10-09T15:36:47.420223+0000","last_fullsized":"2023-10-09T15:36:47.420223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:33.151120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422439+0000","last_change":"2023-10-09T15:36:46.406945+0000","last_active":"2023-10-09T15:36:47.422439+0000","last_peered":"2023-10-09T15:36:47.422439+0000","last_clean":"2023-10-09T15:36:47.422439+0000","last_became_active":"2023-10-09T15:36:46.406708+0000","last_became_peered":"2023-10-09T15:36:46.406708+0000","last_unstale":"2023-10-09T15:36:47.422439+0000","last_undegraded":"2023-10-09T15:36:47.422439+0000","last_fullsized":"2023-10-09T15:36:47.422439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:30:24.818883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416792+0000","last_change":"2023-10-09T15:36:47.416792+0000","last_active":"2023-10-09T15:36:47.416792+0000","last_peered":"2023-10-09T15:36:47.416792+0000","last_clean":"2023-10-09T15:36:47.416792+0000","last_became_active":"2023-10-09T15:36:47.416453+0000","last_became_peered":"2023-10-09T15:36:47.416453+0000","last_unstale":"2023-10-09T15:36:47.416792+0000","last_undegraded":"2023-10-09T15:36:47.416792+0000","last_fullsized":"2023-10-09T15:36:47.416792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:26.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411676+0000","last_change":"2023-10-09T15:36:46.407507+0000","last_active":"2023-10-09T15:36:46.411676+0000","last_peered":"2023-10-09T15:36:46.411676+0000","last_clean":"2023-10-09T15:36:46.411676+0000","last_became_active":"2023-10-09T15:36:46.407220+0000","last_became_peered":"2023-10-09T15:36:46.407220+0000","last_unstale":"2023-10-09T15:36:46.411676+0000","last_undegraded":"2023-10-09T15:36:46.411676+0000","last_fullsized":"2023-10-09T15:36:46.411676+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:25.222489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420902+0000","last_change":"2023-10-09T15:36:47.420902+0000","last_active":"2023-10-09T15:36:47.420902+0000","last_peered":"2023-10-09T15:36:47.420902+0000","last_clean":"2023-10-09T15:36:47.420902+0000","last_became_active":"2023-10-09T15:36:47.420617+0000","last_became_peered":"2023-10-09T15:36:47.420617+0000","last_unstale":"2023-10-09T15:36:47.420902+0000","last_undegraded":"2023-10-09T15:36:47.420902+0000","last_fullsized":"2023-10-09T15:36:47.420902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:47.412388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.414038+0000","last_change":"2023-10-09T15:36:46.407980+0000","last_active":"2023-10-09T15:36:46.414038+0000","last_peered":"2023-10-09T15:36:46.414038+0000","last_clean":"2023-10-09T15:36:46.414038+0000","last_became_active":"2023-10-09T15:36:46.407596+0000","last_became_peered":"2023-10-09T15:36:46.407596+0000","last_unstale":"2023-10-09T15:36:46.414038+0000","last_undegraded":"2023-10-09T15:36:46.414038+0000","last_fullsized":"2023-10-09T15:36:46.414038+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:31.053829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413812+0000","last_change":"2023-10-09T15:36:47.413812+0000","last_active":"2023-10-09T15:36:47.413812+0000","last_peered":"2023-10-09T15:36:47.413812+0000","last_clean":"2023-10-09T15:36:47.413812+0000","last_became_active":"2023-10-09T15:36:47.413553+0000","last_became_peered":"2023-10-09T15:36:47.413553+0000","last_unstale":"2023-10-09T15:36:47.413812+0000","last_undegraded":"2023-10-09T15:36:47.413812+0000","last_fullsized":"2023-10-09T15:36:47.413812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:22.020942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406697+0000","last_change":"2023-10-09T15:36:46.405120+0000","last_active":"2023-10-09T15:36:46.406697+0000","last_peered":"2023-10-09T15:36:46.406697+0000","last_clean":"2023-10-09T15:36:46.406697+0000","last_became_active":"2023-10-09T15:36:46.404777+0000","last_became_peered":"2023-10-09T15:36:46.404777+0000","last_unstale":"2023-10-09T15:36:46.406697+0000","last_undegraded":"2023-10-09T15:36:46.406697+0000","last_fullsized":"2023-10-09T15:36:46.406697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:47.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.409202+0000","last_change":"2023-10-09T15:36:47.409202+0000","last_active":"2023-10-09T15:36:47.409202+0000","last_peered":"2023-10-09T15:36:47.409202+0000","last_clean":"2023-10-09T15:36:47.409202+0000","last_became_active":"2023-10-09T15:36:47.408957+0000","last_became_peered":"2023-10-09T15:36:47.408957+0000","last_unstale":"2023-10-09T15:36:47.409202+0000","last_undegraded":"2023-10-09T15:36:47.409202+0000","last_fullsized":"2023-10-09T15:36:47.409202+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:31.511474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406517+0000","last_change":"2023-10-09T15:36:46.402190+0000","last_active":"2023-10-09T15:36:46.406517+0000","last_peered":"2023-10-09T15:36:46.406517+0000","last_clean":"2023-10-09T15:36:46.406517+0000","last_became_active":"2023-10-09T15:36:46.401943+0000","last_became_peered":"2023-10-09T15:36:46.401943+0000","last_unstale":"2023-10-09T15:36:46.406517+0000","last_undegraded":"2023-10-09T15:36:46.406517+0000","last_fullsized":"2023-10-09T15:36:46.406517+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413447+0000","last_change":"2023-10-09T15:36:47.413447+0000","last_active":"2023-10-09T15:36:47.413447+0000","last_peered":"2023-10-09T15:36:47.413447+0000","last_clean":"2023-10-09T15:36:47.413447+0000","last_became_active":"2023-10-09T15:36:47.413080+0000","last_became_peered":"2023-10-09T15:36:47.413080+0000","last_unstale":"2023-10-09T15:36:47.413447+0000","last_undegraded":"2023-10-09T15:36:47.413447+0000","last_fullsized":"2023-10-09T15:36:47.413447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:29.302105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406543+0000","last_change":"2023-10-09T15:36:46.401085+0000","last_active":"2023-10-09T15:36:46.406543+0000","last_peered":"2023-10-09T15:36:46.406543+0000","last_clean":"2023-10-09T15:36:46.406543+0000","last_became_active":"2023-10-09T15:36:46.400835+0000","last_became_peered":"2023-10-09T15:36:46.400835+0000","last_unstale":"2023-10-09T15:36:46.406543+0000","last_undegraded":"2023-10-09T15:36:46.406543+0000","last_fullsized":"2023-10-09T15:36:46.406543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:31.053829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.403609+0000","last_change":"2023-10-09T15:36:47.403609+0000","last_active":"2023-10-09T15:36:47.403609+0000","last_peered":"2023-10-09T15:36:47.403609+0000","last_clean":"2023-10-09T15:36:47.403609+0000","last_became_active":"2023-10-09T15:36:47.403234+0000","last_became_peered":"2023-10-09T15:36:47.403234+0000","last_unstale":"2023-10-09T15:36:47.403609+0000","last_undegraded":"2023-10-09T15:36:47.403609+0000","last_fullsized":"2023-10-09T15:36:47.403609+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:36.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.408512+0000","last_change":"2023-10-09T15:36:46.405238+0000","last_active":"2023-10-09T15:36:46.408512+0000","last_peered":"2023-10-09T15:36:46.408512+0000","last_clean":"2023-10-09T15:36:46.408512+0000","last_became_active":"2023-10-09T15:36:46.404571+0000","last_became_peered":"2023-10-09T15:36:46.404571+0000","last_unstale":"2023-10-09T15:36:46.408512+0000","last_undegraded":"2023-10-09T15:36:46.408512+0000","last_fullsized":"2023-10-09T15:36:46.408512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413260+0000","last_change":"2023-10-09T15:36:47.413260+0000","last_active":"2023-10-09T15:36:47.413260+0000","last_peered":"2023-10-09T15:36:47.413260+0000","last_clean":"2023-10-09T15:36:47.413260+0000","last_became_active":"2023-10-09T15:36:47.412982+0000","last_became_peered":"2023-10-09T15:36:47.412982+0000","last_unstale":"2023-10-09T15:36:47.413260+0000","last_undegraded":"2023-10-09T15:36:47.413260+0000","last_fullsized":"2023-10-09T15:36:47.413260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406562+0000","last_change":"2023-10-09T15:36:46.405202+0000","last_active":"2023-10-09T15:36:46.406562+0000","last_peered":"2023-10-09T15:36:46.406562+0000","last_clean":"2023-10-09T15:36:46.406562+0000","last_became_active":"2023-10-09T15:36:46.404931+0000","last_became_peered":"2023-10-09T15:36:46.404931+0000","last_unstale":"2023-10-09T15:36:46.406562+0000","last_undegraded":"2023-10-09T15:36:46.406562+0000","last_fullsized":"2023-10-09T15:36:46.406562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:15.645012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410403+0000","last_change":"2023-10-09T15:36:47.410403+0000","last_active":"2023-10-09T15:36:47.410403+0000","last_peered":"2023-10-09T15:36:47.410403+0000","last_clean":"2023-10-09T15:36:47.410403+0000","last_became_active":"2023-10-09T15:36:47.410178+0000","last_became_peered":"2023-10-09T15:36:47.410178+0000","last_unstale":"2023-10-09T15:36:47.410403+0000","last_undegraded":"2023-10-09T15:36:47.410403+0000","last_fullsized":"2023-10-09T15:36:47.410403+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:12.301441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405525+0000","last_change":"2023-10-09T15:36:46.403851+0000","last_active":"2023-10-09T15:36:47.405525+0000","last_peered":"2023-10-09T15:36:47.405525+0000","last_clean":"2023-10-09T15:36:47.405525+0000","last_became_active":"2023-10-09T15:36:46.403552+0000","last_became_peered":"2023-10-09T15:36:46.403552+0000","last_unstale":"2023-10-09T15:36:47.405525+0000","last_undegraded":"2023-10-09T15:36:47.405525+0000","last_fullsized":"2023-10-09T15:36:47.405525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":221,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.398430+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:36:46.398430+0000","last_peered":"2023-10-09T15:36:46.398430+0000","last_clean":"2023-10-09T15:36:46.398430+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:36:46.398430+0000","last_undegraded":"2023-10-09T15:36:46.398430+0000","last_fullsized":"2023-10-09T15:36:46.398430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1058783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63400000000000001,"5min":0.874,"15min":0.874},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.46600000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.745,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.622},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.88,"15min":0.88},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.57199999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":468927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63900000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.437}]},{"osd":1,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.56000000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":1.379,"15min":1.379},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.61699999999999999,"15min":0.80300000000000005},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.62},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66800000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.872,"15min":0.872},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":468303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36199999999999999,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52900000000000003,"5min":1.512,"15min":1.512},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":1.286,"15min":1.286},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55000000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.877,"5min":1.222,"15min":1.222},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.81499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.997,"15min":0.997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69299999999999995,"15min":0.82099999999999995},"min":{"1min":0.48099999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.373},"min":{"1min":0.219,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.41599999999999998},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":2.0859999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36399999999999999,"15min":0.39000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.497,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":6.484},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":6.2859999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.54200000000000004},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47099999999999997,"15min":0.621},"min":{"1min":0.33300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53400000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":2.109}]},{"osd":4,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":1.196,"15min":1.196},"last":1.921},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.508,"15min":1.508},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.60299999999999998,"15min":0.63300000000000001},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":4.1020000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":3.9009999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.68100000000000005},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":1.9810000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":2.032},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":468337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35199999999999998,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51200000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48999999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.434},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61199999999999999,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83199999999999996,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.50800000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.69299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.68500000000000005},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":1.407,"15min":1.407},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":469861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32600000000000001,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46899999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.49199999999999999,"15min":0.91200000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45700000000000002,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.42299999999999999,"15min":0.68000000000000005},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.64700000000000002,"15min":1.429},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.498,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.38,"5min":0.48299999999999998,"15min":0.755},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50700000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":1.121},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":17.02,"15min":17.02},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.71599999999999997,"15min":0.92700000000000005},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":1.149},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.873}]},{"osd":6,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.93700000000000006},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.278,"15min":1.278},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.78000000000000003,"15min":1.1950000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85099999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.95199999999999996},"min":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.876,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70599999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.871,"5min":2.879,"15min":2.879},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65000000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.5}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.68000000000000005},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.80200000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":468373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.432},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.165,"15min":1.165},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":2.089,"15min":2.089},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":11.055,"15min":11.055},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.93899999999999995},"min":{"1min":0.49199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68500000000000005,"15min":0.94099999999999995},"min":{"1min":0.46999999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79300000000000004,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72999999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.78400000000000003,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:36:51.518 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:36:51.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.670+0000 7f2062faf700 1 Processor -- start 2023-10-09T15:36:51.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.670+0000 7f2062faf700 1 -- start start 2023-10-09T15:36:51.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2062faf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2062faf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c15ae40 con 0x7f205c0cb5a0 2023-10-09T15:36:51.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2062faf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f205c15ab60 con 0x7f205c15a400 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2062faf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0ce0f0 con 0x7f205c0cb970 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2060d4b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f205c0cb5a0 0x7f205c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50488/0 (socket says 172.21.15.33:50488) 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f2060d4b700 1 -- 172.21.15.33:0/1921466330 learned_addr learned my addr 172.21.15.33:0/1921466330 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.671+0000 7f205bfff700 1 --2- 172.21.15.33:0/1921466330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3723503386 0 0) 0x7f205c15ae40 con 0x7f205c0cb5a0 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2044003570 con 0x7f205c0cb5a0 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 575834923 0 0) 0x7f205c15ab60 con 0x7f205c15a400 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f205c15ae40 con 0x7f205c15a400 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1675315880 0 0) 0x7f2044003570 con 0x7f205c0cb5a0 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205bfff700 1 -- 172.21.15.33:0/1921466330 >> v1:172.21.15.59:6789/0 conn(0x7f205c15a400 legacy=0x7f205c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205bfff700 1 -- 172.21.15.33:0/1921466330 >> v1:172.21.15.33:6789/0 conn(0x7f205c0cb5a0 legacy=0x7f205c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205bfff700 1 -- 172.21.15.33:0/1921466330 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f205c0ccf00 con 0x7f205c0cb970 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205bfff700 1 --2- 172.21.15.33:0/1921466330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c159ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2050009910 tx=0x7f20500091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c254de599a6498b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c001470 con 0x7f205c0cb970 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2050011420 con 0x7f205c0cb970 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.672+0000 7f205b7fe700 1 -- 172.21.15.33:0/1921466330 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20500117c0 con 0x7f205c0cb970 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 -- 172.21.15.33:0/1921466330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 msgr2=0x7f205c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 --2- 172.21.15.33:0/1921466330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c159ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f2050009910 tx=0x7f20500091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 -- 172.21.15.33:0/1921466330 shutdown_connections 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 --2- 172.21.15.33:0/1921466330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c159ec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 -- 172.21.15.33:0/1921466330 >> 172.21.15.33:0/1921466330 conn(0x7f205c070e30 msgr2=0x7f205c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:51.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 -- 172.21.15.33:0/1921466330 shutdown_connections 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.673+0000 7f2062faf700 1 -- 172.21.15.33:0/1921466330 wait complete. 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.674+0000 7f2062faf700 1 Processor -- start 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.674+0000 7f2062faf700 1 -- start start 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 0x7f205c158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c0cbde0 con 0x7f205c0cb5a0 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f205c156790 con 0x7f205c15a400 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2062faf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f205c16a1d0 con 0x7f205c0cb970 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55754/0 (socket says 172.21.15.33:55754) 2023-10-09T15:36:51.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 -- 172.21.15.33:0/1692396504 learned_addr learned my addr 172.21.15.33:0/1692396504 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f205bfff700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f206154c700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 0x7f205c158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 -- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 msgr2=0x7f205c155850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c155850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 -- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 msgr2=0x7f205c158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 0x7f205c158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 -- 172.21.15.33:0/1692396504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2050009420 con 0x7f205c0cb5a0 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f205bfff700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f206154c700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 0x7f205c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.675+0000 7f2060d4b700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f204c00c840 tx=0x7f204c001a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.676+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c007360 con 0x7f205c0cb5a0 2023-10-09T15:36:51.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.676+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f204c0074c0 con 0x7f205c0cb5a0 2023-10-09T15:36:51.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.676+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f205c151470 con 0x7f205c0cb5a0 2023-10-09T15:36:51.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.676+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f204c004830 con 0x7f205c0cb5a0 2023-10-09T15:36:51.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.676+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f205c1561d0 con 0x7f205c0cb5a0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.677+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f205c151240 con 0x7f205c0cb5a0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.677+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f204c004be0 con 0x7f205c0cb5a0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.677+0000 7f2058ff9700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 0x7f20480696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.677+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f204c0842b0 con 0x7f205c0cb5a0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.677+0000 7f205bfff700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 0x7f20480696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.678+0000 7f205bfff700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 0x7f20480696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f205c088540 tx=0x7f2050016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:51.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.682+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f205c151240 con 0x7f205c0cb5a0 2023-10-09T15:36:51.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.871+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f205c151240 con 0x7f2048067200 2023-10-09T15:36:51.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.880+0000 7f2058ff9700 1 -- 172.21.15.33:0/1692396504 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289419 (secure 0 0 0) 0x7f205c151240 con 0x7f2048067200 2023-10-09T15:36:51.884 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 msgr2=0x7f20480696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 0x7f20480696b0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f205c088540 tx=0x7f2050016000 comp rx=0 tx=0).stop 2023-10-09T15:36:51.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 msgr2=0x7f205c155310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f204c00c840 tx=0x7f204c001a10 comp rx=0 tx=0).stop 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 shutdown_connections 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2048067200 0x7f20480696b0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f205c0cb5a0 0x7f205c155310 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f205c15a400 0x7f205c158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 --2- 172.21.15.33:0/1692396504 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f205c0cb970 0x7f205c155850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 >> 172.21.15.33:0/1692396504 conn(0x7f205c070e30 msgr2=0x7f205c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 shutdown_connections 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:51.883+0000 7f2062faf700 1 -- 172.21.15.33:0/1692396504 wait complete. 2023-10-09T15:36:51.887 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:36:51.896 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":261,"stamp":"2023-10-09T15:36:51.307589+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":68,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2396196,"kb_used_data":9700,"kb_used_omap":0,"kb_used_meta":2386432,"kb_avail":752578524,"statfs":{"total":773094113280,"available":770640408576,"internally_reserved":0,"allocated":9932800,"data_stored":4922338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2443706368},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.922937"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422577+0000","last_change":"2023-10-09T15:36:47.422577+0000","last_active":"2023-10-09T15:36:47.422577+0000","last_peered":"2023-10-09T15:36:47.422577+0000","last_clean":"2023-10-09T15:36:47.422577+0000","last_became_active":"2023-10-09T15:36:47.422301+0000","last_became_peered":"2023-10-09T15:36:47.422301+0000","last_unstale":"2023-10-09T15:36:47.422577+0000","last_undegraded":"2023-10-09T15:36:47.422577+0000","last_fullsized":"2023-10-09T15:36:47.422577+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:59.561891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420721+0000","last_change":"2023-10-09T15:36:47.420721+0000","last_active":"2023-10-09T15:36:47.420721+0000","last_peered":"2023-10-09T15:36:47.420721+0000","last_clean":"2023-10-09T15:36:47.420721+0000","last_became_active":"2023-10-09T15:36:47.420420+0000","last_became_peered":"2023-10-09T15:36:47.420420+0000","last_unstale":"2023-10-09T15:36:47.420721+0000","last_undegraded":"2023-10-09T15:36:47.420721+0000","last_fullsized":"2023-10-09T15:36:47.420721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:08.174347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417784+0000","last_change":"2023-10-09T15:36:47.417784+0000","last_active":"2023-10-09T15:36:47.417784+0000","last_peered":"2023-10-09T15:36:47.417784+0000","last_clean":"2023-10-09T15:36:47.417784+0000","last_became_active":"2023-10-09T15:36:47.417457+0000","last_became_peered":"2023-10-09T15:36:47.417457+0000","last_unstale":"2023-10-09T15:36:47.417784+0000","last_undegraded":"2023-10-09T15:36:47.417784+0000","last_fullsized":"2023-10-09T15:36:47.417784+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:51.422119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414892+0000","last_change":"2023-10-09T15:36:47.414892+0000","last_active":"2023-10-09T15:36:47.414892+0000","last_peered":"2023-10-09T15:36:47.414892+0000","last_clean":"2023-10-09T15:36:47.414892+0000","last_became_active":"2023-10-09T15:36:47.414613+0000","last_became_peered":"2023-10-09T15:36:47.414613+0000","last_unstale":"2023-10-09T15:36:47.414892+0000","last_undegraded":"2023-10-09T15:36:47.414892+0000","last_fullsized":"2023-10-09T15:36:47.414892+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:03:37.768941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419379+0000","last_change":"2023-10-09T15:36:47.419379+0000","last_active":"2023-10-09T15:36:47.419379+0000","last_peered":"2023-10-09T15:36:47.419379+0000","last_clean":"2023-10-09T15:36:47.419379+0000","last_became_active":"2023-10-09T15:36:47.419142+0000","last_became_peered":"2023-10-09T15:36:47.419142+0000","last_unstale":"2023-10-09T15:36:47.419379+0000","last_undegraded":"2023-10-09T15:36:47.419379+0000","last_fullsized":"2023-10-09T15:36:47.419379+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416885+0000","last_change":"2023-10-09T15:36:47.416885+0000","last_active":"2023-10-09T15:36:47.416885+0000","last_peered":"2023-10-09T15:36:47.416885+0000","last_clean":"2023-10-09T15:36:47.416885+0000","last_became_active":"2023-10-09T15:36:47.416601+0000","last_became_peered":"2023-10-09T15:36:47.416601+0000","last_unstale":"2023-10-09T15:36:47.416885+0000","last_undegraded":"2023-10-09T15:36:47.416885+0000","last_fullsized":"2023-10-09T15:36:47.416885+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419078+0000","last_change":"2023-10-09T15:36:47.419078+0000","last_active":"2023-10-09T15:36:47.419078+0000","last_peered":"2023-10-09T15:36:47.419078+0000","last_clean":"2023-10-09T15:36:47.419078+0000","last_became_active":"2023-10-09T15:36:47.418811+0000","last_became_peered":"2023-10-09T15:36:47.418811+0000","last_unstale":"2023-10-09T15:36:47.419078+0000","last_undegraded":"2023-10-09T15:36:47.419078+0000","last_fullsized":"2023-10-09T15:36:47.419078+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417666+0000","last_change":"2023-10-09T15:36:47.417666+0000","last_active":"2023-10-09T15:36:47.417666+0000","last_peered":"2023-10-09T15:36:47.417666+0000","last_clean":"2023-10-09T15:36:47.417666+0000","last_became_active":"2023-10-09T15:36:47.416862+0000","last_became_peered":"2023-10-09T15:36:47.416862+0000","last_unstale":"2023-10-09T15:36:47.417666+0000","last_undegraded":"2023-10-09T15:36:47.417666+0000","last_fullsized":"2023-10-09T15:36:47.417666+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:03.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416178+0000","last_change":"2023-10-09T15:36:47.416178+0000","last_active":"2023-10-09T15:36:47.416178+0000","last_peered":"2023-10-09T15:36:47.416178+0000","last_clean":"2023-10-09T15:36:47.416178+0000","last_became_active":"2023-10-09T15:36:47.413013+0000","last_became_peered":"2023-10-09T15:36:47.413013+0000","last_unstale":"2023-10-09T15:36:47.416178+0000","last_undegraded":"2023-10-09T15:36:47.416178+0000","last_fullsized":"2023-10-09T15:36:47.416178+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420634+0000","last_change":"2023-10-09T15:36:47.420634+0000","last_active":"2023-10-09T15:36:47.420634+0000","last_peered":"2023-10-09T15:36:47.420634+0000","last_clean":"2023-10-09T15:36:47.420634+0000","last_became_active":"2023-10-09T15:36:47.420316+0000","last_became_peered":"2023-10-09T15:36:47.420316+0000","last_unstale":"2023-10-09T15:36:47.420634+0000","last_undegraded":"2023-10-09T15:36:47.420634+0000","last_fullsized":"2023-10-09T15:36:47.420634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421522+0000","last_change":"2023-10-09T15:36:47.421522+0000","last_active":"2023-10-09T15:36:47.421522+0000","last_peered":"2023-10-09T15:36:47.421522+0000","last_clean":"2023-10-09T15:36:47.421522+0000","last_became_active":"2023-10-09T15:36:47.421230+0000","last_became_peered":"2023-10-09T15:36:47.421230+0000","last_unstale":"2023-10-09T15:36:47.421522+0000","last_undegraded":"2023-10-09T15:36:47.421522+0000","last_fullsized":"2023-10-09T15:36:47.421522+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:32.193031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421329+0000","last_change":"2023-10-09T15:36:47.421329+0000","last_active":"2023-10-09T15:36:47.421329+0000","last_peered":"2023-10-09T15:36:47.421329+0000","last_clean":"2023-10-09T15:36:47.421329+0000","last_became_active":"2023-10-09T15:36:47.421033+0000","last_became_peered":"2023-10-09T15:36:47.421033+0000","last_unstale":"2023-10-09T15:36:47.421329+0000","last_undegraded":"2023-10-09T15:36:47.421329+0000","last_fullsized":"2023-10-09T15:36:47.421329+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:50.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.427698+0000","last_change":"2023-10-09T15:36:47.427698+0000","last_active":"2023-10-09T15:36:47.427698+0000","last_peered":"2023-10-09T15:36:47.427698+0000","last_clean":"2023-10-09T15:36:47.427698+0000","last_became_active":"2023-10-09T15:36:47.427422+0000","last_became_peered":"2023-10-09T15:36:47.427422+0000","last_unstale":"2023-10-09T15:36:47.427698+0000","last_undegraded":"2023-10-09T15:36:47.427698+0000","last_fullsized":"2023-10-09T15:36:47.427698+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:16.839482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405823+0000","last_change":"2023-10-09T15:36:47.405823+0000","last_active":"2023-10-09T15:36:47.405823+0000","last_peered":"2023-10-09T15:36:47.405823+0000","last_clean":"2023-10-09T15:36:47.405823+0000","last_became_active":"2023-10-09T15:36:47.405570+0000","last_became_peered":"2023-10-09T15:36:47.405570+0000","last_unstale":"2023-10-09T15:36:47.405823+0000","last_undegraded":"2023-10-09T15:36:47.405823+0000","last_fullsized":"2023-10-09T15:36:47.405823+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:06.977918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.421660+0000","last_change":"2023-10-09T15:36:47.421660+0000","last_active":"2023-10-09T15:36:47.421660+0000","last_peered":"2023-10-09T15:36:47.421660+0000","last_clean":"2023-10-09T15:36:47.421660+0000","last_became_active":"2023-10-09T15:36:47.421340+0000","last_became_peered":"2023-10-09T15:36:47.421340+0000","last_unstale":"2023-10-09T15:36:47.421660+0000","last_undegraded":"2023-10-09T15:36:47.421660+0000","last_fullsized":"2023-10-09T15:36:47.421660+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426721+0000","last_change":"2023-10-09T15:36:47.426721+0000","last_active":"2023-10-09T15:36:47.426721+0000","last_peered":"2023-10-09T15:36:47.426721+0000","last_clean":"2023-10-09T15:36:47.426721+0000","last_became_active":"2023-10-09T15:36:47.426359+0000","last_became_peered":"2023-10-09T15:36:47.426359+0000","last_unstale":"2023-10-09T15:36:47.426721+0000","last_undegraded":"2023-10-09T15:36:47.426721+0000","last_fullsized":"2023-10-09T15:36:47.426721+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:39.305569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.425157+0000","last_change":"2023-10-09T15:36:47.425157+0000","last_active":"2023-10-09T15:36:47.425157+0000","last_peered":"2023-10-09T15:36:47.425157+0000","last_clean":"2023-10-09T15:36:47.425157+0000","last_became_active":"2023-10-09T15:36:47.424859+0000","last_became_peered":"2023-10-09T15:36:47.424859+0000","last_unstale":"2023-10-09T15:36:47.425157+0000","last_undegraded":"2023-10-09T15:36:47.425157+0000","last_fullsized":"2023-10-09T15:36:47.425157+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:31.435657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414951+0000","last_change":"2023-10-09T15:36:47.414951+0000","last_active":"2023-10-09T15:36:47.414951+0000","last_peered":"2023-10-09T15:36:47.414951+0000","last_clean":"2023-10-09T15:36:47.414951+0000","last_became_active":"2023-10-09T15:36:47.414669+0000","last_became_peered":"2023-10-09T15:36:47.414669+0000","last_unstale":"2023-10-09T15:36:47.414951+0000","last_undegraded":"2023-10-09T15:36:47.414951+0000","last_fullsized":"2023-10-09T15:36:47.414951+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:59.861240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.429961+0000","last_change":"2023-10-09T15:36:47.429961+0000","last_active":"2023-10-09T15:36:47.429961+0000","last_peered":"2023-10-09T15:36:47.429961+0000","last_clean":"2023-10-09T15:36:47.429961+0000","last_became_active":"2023-10-09T15:36:47.429626+0000","last_became_peered":"2023-10-09T15:36:47.429626+0000","last_unstale":"2023-10-09T15:36:47.429961+0000","last_undegraded":"2023-10-09T15:36:47.429961+0000","last_fullsized":"2023-10-09T15:36:47.429961+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:13.694967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415161+0000","last_change":"2023-10-09T15:36:47.415161+0000","last_active":"2023-10-09T15:36:47.415161+0000","last_peered":"2023-10-09T15:36:47.415161+0000","last_clean":"2023-10-09T15:36:47.415161+0000","last_became_active":"2023-10-09T15:36:47.413634+0000","last_became_peered":"2023-10-09T15:36:47.413634+0000","last_unstale":"2023-10-09T15:36:47.415161+0000","last_undegraded":"2023-10-09T15:36:47.415161+0000","last_fullsized":"2023-10-09T15:36:47.415161+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:53.399271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.417796+0000","last_change":"2023-10-09T15:36:47.417796+0000","last_active":"2023-10-09T15:36:47.417796+0000","last_peered":"2023-10-09T15:36:47.417796+0000","last_clean":"2023-10-09T15:36:47.417796+0000","last_became_active":"2023-10-09T15:36:47.417517+0000","last_became_peered":"2023-10-09T15:36:47.417517+0000","last_unstale":"2023-10-09T15:36:47.417796+0000","last_undegraded":"2023-10-09T15:36:47.417796+0000","last_fullsized":"2023-10-09T15:36:47.417796+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:38:47.066805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420039+0000","last_change":"2023-10-09T15:36:47.420039+0000","last_active":"2023-10-09T15:36:47.420039+0000","last_peered":"2023-10-09T15:36:47.420039+0000","last_clean":"2023-10-09T15:36:47.420039+0000","last_became_active":"2023-10-09T15:36:47.419768+0000","last_became_peered":"2023-10-09T15:36:47.419768+0000","last_unstale":"2023-10-09T15:36:47.420039+0000","last_undegraded":"2023-10-09T15:36:47.420039+0000","last_fullsized":"2023-10-09T15:36:47.420039+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418826+0000","last_change":"2023-10-09T15:36:47.418826+0000","last_active":"2023-10-09T15:36:47.418826+0000","last_peered":"2023-10-09T15:36:47.418826+0000","last_clean":"2023-10-09T15:36:47.418826+0000","last_became_active":"2023-10-09T15:36:47.418555+0000","last_became_peered":"2023-10-09T15:36:47.418555+0000","last_unstale":"2023-10-09T15:36:47.418826+0000","last_undegraded":"2023-10-09T15:36:47.418826+0000","last_fullsized":"2023-10-09T15:36:47.418826+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:32.193031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423202+0000","last_change":"2023-10-09T15:36:47.423202+0000","last_active":"2023-10-09T15:36:47.423202+0000","last_peered":"2023-10-09T15:36:47.423202+0000","last_clean":"2023-10-09T15:36:47.423202+0000","last_became_active":"2023-10-09T15:36:47.422855+0000","last_became_peered":"2023-10-09T15:36:47.422855+0000","last_unstale":"2023-10-09T15:36:47.423202+0000","last_undegraded":"2023-10-09T15:36:47.423202+0000","last_fullsized":"2023-10-09T15:36:47.423202+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:03.134122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426739+0000","last_change":"2023-10-09T15:36:47.426739+0000","last_active":"2023-10-09T15:36:47.426739+0000","last_peered":"2023-10-09T15:36:47.426739+0000","last_clean":"2023-10-09T15:36:47.426739+0000","last_became_active":"2023-10-09T15:36:47.426154+0000","last_became_peered":"2023-10-09T15:36:47.426154+0000","last_unstale":"2023-10-09T15:36:47.426739+0000","last_undegraded":"2023-10-09T15:36:47.426739+0000","last_fullsized":"2023-10-09T15:36:47.426739+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:04:18.708089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422475+0000","last_change":"2023-10-09T15:36:47.422475+0000","last_active":"2023-10-09T15:36:47.422475+0000","last_peered":"2023-10-09T15:36:47.422475+0000","last_clean":"2023-10-09T15:36:47.422475+0000","last_became_active":"2023-10-09T15:36:47.422079+0000","last_became_peered":"2023-10-09T15:36:47.422079+0000","last_unstale":"2023-10-09T15:36:47.422475+0000","last_undegraded":"2023-10-09T15:36:47.422475+0000","last_fullsized":"2023-10-09T15:36:47.422475+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:45.373027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416813+0000","last_change":"2023-10-09T15:36:47.416813+0000","last_active":"2023-10-09T15:36:47.416813+0000","last_peered":"2023-10-09T15:36:47.416813+0000","last_clean":"2023-10-09T15:36:47.416813+0000","last_became_active":"2023-10-09T15:36:47.416526+0000","last_became_peered":"2023-10-09T15:36:47.416526+0000","last_unstale":"2023-10-09T15:36:47.416813+0000","last_undegraded":"2023-10-09T15:36:47.416813+0000","last_fullsized":"2023-10-09T15:36:47.416813+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:21.067920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.428156+0000","last_change":"2023-10-09T15:36:47.428156+0000","last_active":"2023-10-09T15:36:47.428156+0000","last_peered":"2023-10-09T15:36:47.428156+0000","last_clean":"2023-10-09T15:36:47.428156+0000","last_became_active":"2023-10-09T15:36:47.427878+0000","last_became_peered":"2023-10-09T15:36:47.427878+0000","last_unstale":"2023-10-09T15:36:47.428156+0000","last_undegraded":"2023-10-09T15:36:47.428156+0000","last_fullsized":"2023-10-09T15:36:47.428156+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:43:50.800405+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424456+0000","last_change":"2023-10-09T15:36:47.424456+0000","last_active":"2023-10-09T15:36:47.424456+0000","last_peered":"2023-10-09T15:36:47.424456+0000","last_clean":"2023-10-09T15:36:47.424456+0000","last_became_active":"2023-10-09T15:36:47.422582+0000","last_became_peered":"2023-10-09T15:36:47.422582+0000","last_unstale":"2023-10-09T15:36:47.424456+0000","last_undegraded":"2023-10-09T15:36:47.424456+0000","last_fullsized":"2023-10-09T15:36:47.424456+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418669+0000","last_change":"2023-10-09T15:36:47.418669+0000","last_active":"2023-10-09T15:36:47.418669+0000","last_peered":"2023-10-09T15:36:47.418669+0000","last_clean":"2023-10-09T15:36:47.418669+0000","last_became_active":"2023-10-09T15:36:47.418401+0000","last_became_peered":"2023-10-09T15:36:47.418401+0000","last_unstale":"2023-10-09T15:36:47.418669+0000","last_undegraded":"2023-10-09T15:36:47.418669+0000","last_fullsized":"2023-10-09T15:36:47.418669+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:35.421414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419576+0000","last_change":"2023-10-09T15:36:47.419576+0000","last_active":"2023-10-09T15:36:47.419576+0000","last_peered":"2023-10-09T15:36:47.419576+0000","last_clean":"2023-10-09T15:36:47.419576+0000","last_became_active":"2023-10-09T15:36:47.419308+0000","last_became_peered":"2023-10-09T15:36:47.419308+0000","last_unstale":"2023-10-09T15:36:47.419576+0000","last_undegraded":"2023-10-09T15:36:47.419576+0000","last_fullsized":"2023-10-09T15:36:47.419576+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:05.702684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426614+0000","last_change":"2023-10-09T15:36:47.426614+0000","last_active":"2023-10-09T15:36:47.426614+0000","last_peered":"2023-10-09T15:36:47.426614+0000","last_clean":"2023-10-09T15:36:47.426614+0000","last_became_active":"2023-10-09T15:36:47.426361+0000","last_became_peered":"2023-10-09T15:36:47.426361+0000","last_unstale":"2023-10-09T15:36:47.426614+0000","last_undegraded":"2023-10-09T15:36:47.426614+0000","last_fullsized":"2023-10-09T15:36:47.426614+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:19:28.448077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416277+0000","last_change":"2023-10-09T15:36:47.416277+0000","last_active":"2023-10-09T15:36:47.416277+0000","last_peered":"2023-10-09T15:36:47.416277+0000","last_clean":"2023-10-09T15:36:47.416277+0000","last_became_active":"2023-10-09T15:36:47.416031+0000","last_became_peered":"2023-10-09T15:36:47.416031+0000","last_unstale":"2023-10-09T15:36:47.416277+0000","last_undegraded":"2023-10-09T15:36:47.416277+0000","last_fullsized":"2023-10-09T15:36:47.416277+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:04:24.922205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"88'4","reported_seq":13,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.427823+0000","last_change":"2023-10-09T15:36:46.410673+0000","last_active":"2023-10-09T15:36:47.427823+0000","last_peered":"2023-10-09T15:36:47.427823+0000","last_clean":"2023-10-09T15:36:47.427823+0000","last_became_active":"2023-10-09T15:36:46.407940+0000","last_became_peered":"2023-10-09T15:36:46.407940+0000","last_unstale":"2023-10-09T15:36:47.427823+0000","last_undegraded":"2023-10-09T15:36:47.427823+0000","last_fullsized":"2023-10-09T15:36:47.427823+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:57.104684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.419252+0000","last_change":"2023-10-09T15:36:47.419252+0000","last_active":"2023-10-09T15:36:47.419252+0000","last_peered":"2023-10-09T15:36:47.419252+0000","last_clean":"2023-10-09T15:36:47.419252+0000","last_became_active":"2023-10-09T15:36:47.418945+0000","last_became_peered":"2023-10-09T15:36:47.418945+0000","last_unstale":"2023-10-09T15:36:47.419252+0000","last_undegraded":"2023-10-09T15:36:47.419252+0000","last_fullsized":"2023-10-09T15:36:47.419252+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405624+0000","last_change":"2023-10-09T15:36:46.409635+0000","last_active":"2023-10-09T15:36:47.405624+0000","last_peered":"2023-10-09T15:36:47.405624+0000","last_clean":"2023-10-09T15:36:47.405624+0000","last_became_active":"2023-10-09T15:36:46.409365+0000","last_became_peered":"2023-10-09T15:36:46.409365+0000","last_unstale":"2023-10-09T15:36:47.405624+0000","last_undegraded":"2023-10-09T15:36:47.405624+0000","last_fullsized":"2023-10-09T15:36:47.405624+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:13.851579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423158+0000","last_change":"2023-10-09T15:36:47.423158+0000","last_active":"2023-10-09T15:36:47.423158+0000","last_peered":"2023-10-09T15:36:47.423158+0000","last_clean":"2023-10-09T15:36:47.423158+0000","last_became_active":"2023-10-09T15:36:47.422711+0000","last_became_peered":"2023-10-09T15:36:47.422711+0000","last_unstale":"2023-10-09T15:36:47.423158+0000","last_undegraded":"2023-10-09T15:36:47.423158+0000","last_fullsized":"2023-10-09T15:36:47.423158+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:48.097318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424198+0000","last_change":"2023-10-09T15:36:46.410612+0000","last_active":"2023-10-09T15:36:47.424198+0000","last_peered":"2023-10-09T15:36:47.424198+0000","last_clean":"2023-10-09T15:36:47.424198+0000","last_became_active":"2023-10-09T15:36:46.407869+0000","last_became_peered":"2023-10-09T15:36:46.407869+0000","last_unstale":"2023-10-09T15:36:47.424198+0000","last_undegraded":"2023-10-09T15:36:47.424198+0000","last_fullsized":"2023-10-09T15:36:47.424198+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:29.117286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414263+0000","last_change":"2023-10-09T15:36:47.414263+0000","last_active":"2023-10-09T15:36:47.414263+0000","last_peered":"2023-10-09T15:36:47.414263+0000","last_clean":"2023-10-09T15:36:47.414263+0000","last_became_active":"2023-10-09T15:36:47.413968+0000","last_became_peered":"2023-10-09T15:36:47.413968+0000","last_unstale":"2023-10-09T15:36:47.414263+0000","last_undegraded":"2023-10-09T15:36:47.414263+0000","last_fullsized":"2023-10-09T15:36:47.414263+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:53:14.858920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424032+0000","last_change":"2023-10-09T15:36:46.407661+0000","last_active":"2023-10-09T15:36:47.424032+0000","last_peered":"2023-10-09T15:36:47.424032+0000","last_clean":"2023-10-09T15:36:47.424032+0000","last_became_active":"2023-10-09T15:36:46.407359+0000","last_became_peered":"2023-10-09T15:36:46.407359+0000","last_unstale":"2023-10-09T15:36:47.424032+0000","last_undegraded":"2023-10-09T15:36:47.424032+0000","last_fullsized":"2023-10-09T15:36:47.424032+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:20:52.391930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413872+0000","last_change":"2023-10-09T15:36:47.413872+0000","last_active":"2023-10-09T15:36:47.413872+0000","last_peered":"2023-10-09T15:36:47.413872+0000","last_clean":"2023-10-09T15:36:47.413872+0000","last_became_active":"2023-10-09T15:36:47.413580+0000","last_became_peered":"2023-10-09T15:36:47.413580+0000","last_unstale":"2023-10-09T15:36:47.413872+0000","last_undegraded":"2023-10-09T15:36:47.413872+0000","last_fullsized":"2023-10-09T15:36:47.413872+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:59.561891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418702+0000","last_change":"2023-10-09T15:36:46.403115+0000","last_active":"2023-10-09T15:36:47.418702+0000","last_peered":"2023-10-09T15:36:47.418702+0000","last_clean":"2023-10-09T15:36:47.418702+0000","last_became_active":"2023-10-09T15:36:46.402741+0000","last_became_peered":"2023-10-09T15:36:46.402741+0000","last_unstale":"2023-10-09T15:36:47.418702+0000","last_undegraded":"2023-10-09T15:36:47.418702+0000","last_fullsized":"2023-10-09T15:36:47.418702+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:13.996205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415395+0000","last_change":"2023-10-09T15:36:47.415395+0000","last_active":"2023-10-09T15:36:47.415395+0000","last_peered":"2023-10-09T15:36:47.415395+0000","last_clean":"2023-10-09T15:36:47.415395+0000","last_became_active":"2023-10-09T15:36:47.415106+0000","last_became_peered":"2023-10-09T15:36:47.415106+0000","last_unstale":"2023-10-09T15:36:47.415395+0000","last_undegraded":"2023-10-09T15:36:47.415395+0000","last_fullsized":"2023-10-09T15:36:47.415395+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:54.654236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405039+0000","last_change":"2023-10-09T15:36:46.404530+0000","last_active":"2023-10-09T15:36:47.405039+0000","last_peered":"2023-10-09T15:36:47.405039+0000","last_clean":"2023-10-09T15:36:47.405039+0000","last_became_active":"2023-10-09T15:36:46.404202+0000","last_became_peered":"2023-10-09T15:36:46.404202+0000","last_unstale":"2023-10-09T15:36:47.405039+0000","last_undegraded":"2023-10-09T15:36:47.405039+0000","last_fullsized":"2023-10-09T15:36:47.405039+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.415634+0000","last_change":"2023-10-09T15:36:47.415634+0000","last_active":"2023-10-09T15:36:47.415634+0000","last_peered":"2023-10-09T15:36:47.415634+0000","last_clean":"2023-10-09T15:36:47.415634+0000","last_became_active":"2023-10-09T15:36:47.415356+0000","last_became_peered":"2023-10-09T15:36:47.415356+0000","last_unstale":"2023-10-09T15:36:47.415634+0000","last_undegraded":"2023-10-09T15:36:47.415634+0000","last_fullsized":"2023-10-09T15:36:47.415634+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:33:39.305569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406822+0000","last_change":"2023-10-09T15:36:46.404996+0000","last_active":"2023-10-09T15:36:46.406822+0000","last_peered":"2023-10-09T15:36:46.406822+0000","last_clean":"2023-10-09T15:36:46.406822+0000","last_became_active":"2023-10-09T15:36:46.404748+0000","last_became_peered":"2023-10-09T15:36:46.404748+0000","last_unstale":"2023-10-09T15:36:46.406822+0000","last_undegraded":"2023-10-09T15:36:46.406822+0000","last_fullsized":"2023-10-09T15:36:46.406822+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:50.414779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.418027+0000","last_change":"2023-10-09T15:36:47.418027+0000","last_active":"2023-10-09T15:36:47.418027+0000","last_peered":"2023-10-09T15:36:47.418027+0000","last_clean":"2023-10-09T15:36:47.418027+0000","last_became_active":"2023-10-09T15:36:47.417696+0000","last_became_peered":"2023-10-09T15:36:47.417696+0000","last_unstale":"2023-10-09T15:36:47.418027+0000","last_undegraded":"2023-10-09T15:36:47.418027+0000","last_fullsized":"2023-10-09T15:36:47.418027+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:44.141388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.409152+0000","last_change":"2023-10-09T15:36:46.405626+0000","last_active":"2023-10-09T15:36:46.409152+0000","last_peered":"2023-10-09T15:36:46.409152+0000","last_clean":"2023-10-09T15:36:46.409152+0000","last_became_active":"2023-10-09T15:36:46.403230+0000","last_became_peered":"2023-10-09T15:36:46.403230+0000","last_unstale":"2023-10-09T15:36:46.409152+0000","last_undegraded":"2023-10-09T15:36:46.409152+0000","last_fullsized":"2023-10-09T15:36:46.409152+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:16:17.466871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424393+0000","last_change":"2023-10-09T15:36:47.424393+0000","last_active":"2023-10-09T15:36:47.424393+0000","last_peered":"2023-10-09T15:36:47.424393+0000","last_clean":"2023-10-09T15:36:47.424393+0000","last_became_active":"2023-10-09T15:36:47.423931+0000","last_became_peered":"2023-10-09T15:36:47.423931+0000","last_unstale":"2023-10-09T15:36:47.424393+0000","last_undegraded":"2023-10-09T15:36:47.424393+0000","last_fullsized":"2023-10-09T15:36:47.424393+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:31.052302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.409486+0000","last_change":"2023-10-09T15:36:46.407919+0000","last_active":"2023-10-09T15:36:46.409486+0000","last_peered":"2023-10-09T15:36:46.409486+0000","last_clean":"2023-10-09T15:36:46.409486+0000","last_became_active":"2023-10-09T15:36:46.407642+0000","last_became_peered":"2023-10-09T15:36:46.407642+0000","last_unstale":"2023-10-09T15:36:46.409486+0000","last_undegraded":"2023-10-09T15:36:46.409486+0000","last_fullsized":"2023-10-09T15:36:46.409486+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:19:09.904144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420286+0000","last_change":"2023-10-09T15:36:47.420286+0000","last_active":"2023-10-09T15:36:47.420286+0000","last_peered":"2023-10-09T15:36:47.420286+0000","last_clean":"2023-10-09T15:36:47.420286+0000","last_became_active":"2023-10-09T15:36:47.419974+0000","last_became_peered":"2023-10-09T15:36:47.419974+0000","last_unstale":"2023-10-09T15:36:47.420286+0000","last_undegraded":"2023-10-09T15:36:47.420286+0000","last_fullsized":"2023-10-09T15:36:47.420286+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:22.020942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.408850+0000","last_change":"2023-10-09T15:36:46.407233+0000","last_active":"2023-10-09T15:36:46.408850+0000","last_peered":"2023-10-09T15:36:46.408850+0000","last_clean":"2023-10-09T15:36:46.408850+0000","last_became_active":"2023-10-09T15:36:46.406958+0000","last_became_peered":"2023-10-09T15:36:46.406958+0000","last_unstale":"2023-10-09T15:36:46.408850+0000","last_undegraded":"2023-10-09T15:36:46.408850+0000","last_fullsized":"2023-10-09T15:36:46.408850+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410863+0000","last_change":"2023-10-09T15:36:47.410863+0000","last_active":"2023-10-09T15:36:47.410863+0000","last_peered":"2023-10-09T15:36:47.410863+0000","last_clean":"2023-10-09T15:36:47.410863+0000","last_became_active":"2023-10-09T15:36:47.410591+0000","last_became_peered":"2023-10-09T15:36:47.410591+0000","last_unstale":"2023-10-09T15:36:47.410863+0000","last_undegraded":"2023-10-09T15:36:47.410863+0000","last_fullsized":"2023-10-09T15:36:47.410863+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:30.124627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"88'3","reported_seq":12,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.423613+0000","last_change":"2023-10-09T15:36:46.407253+0000","last_active":"2023-10-09T15:36:47.423613+0000","last_peered":"2023-10-09T15:36:47.423613+0000","last_clean":"2023-10-09T15:36:47.423613+0000","last_became_active":"2023-10-09T15:36:46.406920+0000","last_became_peered":"2023-10-09T15:36:46.406920+0000","last_unstale":"2023-10-09T15:36:47.423613+0000","last_undegraded":"2023-10-09T15:36:47.423613+0000","last_fullsized":"2023-10-09T15:36:47.423613+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.426714+0000","last_change":"2023-10-09T15:36:47.426714+0000","last_active":"2023-10-09T15:36:47.426714+0000","last_peered":"2023-10-09T15:36:47.426714+0000","last_clean":"2023-10-09T15:36:47.426714+0000","last_became_active":"2023-10-09T15:36:47.426421+0000","last_became_peered":"2023-10-09T15:36:47.426421+0000","last_unstale":"2023-10-09T15:36:47.426714+0000","last_undegraded":"2023-10-09T15:36:47.426714+0000","last_fullsized":"2023-10-09T15:36:47.426714+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:31.435657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"88'6","reported_seq":15,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.428081+0000","last_change":"2023-10-09T15:36:46.403396+0000","last_active":"2023-10-09T15:36:47.428081+0000","last_peered":"2023-10-09T15:36:47.428081+0000","last_clean":"2023-10-09T15:36:47.428081+0000","last_became_active":"2023-10-09T15:36:46.403051+0000","last_became_peered":"2023-10-09T15:36:46.403051+0000","last_unstale":"2023-10-09T15:36:47.428081+0000","last_undegraded":"2023-10-09T15:36:47.428081+0000","last_fullsized":"2023-10-09T15:36:47.428081+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:53:50.414779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416873+0000","last_change":"2023-10-09T15:36:47.416873+0000","last_active":"2023-10-09T15:36:47.416873+0000","last_peered":"2023-10-09T15:36:47.416873+0000","last_clean":"2023-10-09T15:36:47.416873+0000","last_became_active":"2023-10-09T15:36:47.416576+0000","last_became_peered":"2023-10-09T15:36:47.416576+0000","last_unstale":"2023-10-09T15:36:47.416873+0000","last_undegraded":"2023-10-09T15:36:47.416873+0000","last_fullsized":"2023-10-09T15:36:47.416873+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:21.067920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.430526+0000","last_change":"2023-10-09T15:36:46.403652+0000","last_active":"2023-10-09T15:36:47.430526+0000","last_peered":"2023-10-09T15:36:47.430526+0000","last_clean":"2023-10-09T15:36:47.430526+0000","last_became_active":"2023-10-09T15:36:46.403339+0000","last_became_peered":"2023-10-09T15:36:46.403339+0000","last_unstale":"2023-10-09T15:36:47.430526+0000","last_undegraded":"2023-10-09T15:36:47.430526+0000","last_fullsized":"2023-10-09T15:36:47.430526+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:22.343073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.414600+0000","last_change":"2023-10-09T15:36:47.414600+0000","last_active":"2023-10-09T15:36:47.414600+0000","last_peered":"2023-10-09T15:36:47.414600+0000","last_clean":"2023-10-09T15:36:47.414600+0000","last_became_active":"2023-10-09T15:36:47.414321+0000","last_became_peered":"2023-10-09T15:36:47.414321+0000","last_unstale":"2023-10-09T15:36:47.414600+0000","last_undegraded":"2023-10-09T15:36:47.414600+0000","last_fullsized":"2023-10-09T15:36:47.414600+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:32.061169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411834+0000","last_change":"2023-10-09T15:36:46.408562+0000","last_active":"2023-10-09T15:36:46.411834+0000","last_peered":"2023-10-09T15:36:46.411834+0000","last_clean":"2023-10-09T15:36:46.411834+0000","last_became_active":"2023-10-09T15:36:46.407818+0000","last_became_peered":"2023-10-09T15:36:46.407818+0000","last_unstale":"2023-10-09T15:36:46.411834+0000","last_undegraded":"2023-10-09T15:36:46.411834+0000","last_fullsized":"2023-10-09T15:36:46.411834+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:00.434605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413186+0000","last_change":"2023-10-09T15:36:47.413186+0000","last_active":"2023-10-09T15:36:47.413186+0000","last_peered":"2023-10-09T15:36:47.413186+0000","last_clean":"2023-10-09T15:36:47.413186+0000","last_became_active":"2023-10-09T15:36:47.412853+0000","last_became_peered":"2023-10-09T15:36:47.412853+0000","last_unstale":"2023-10-09T15:36:47.413186+0000","last_undegraded":"2023-10-09T15:36:47.413186+0000","last_fullsized":"2023-10-09T15:36:47.413186+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:53.688382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.410252+0000","last_change":"2023-10-09T15:36:46.407022+0000","last_active":"2023-10-09T15:36:46.410252+0000","last_peered":"2023-10-09T15:36:46.410252+0000","last_clean":"2023-10-09T15:36:46.410252+0000","last_became_active":"2023-10-09T15:36:46.406754+0000","last_became_peered":"2023-10-09T15:36:46.406754+0000","last_unstale":"2023-10-09T15:36:46.410252+0000","last_undegraded":"2023-10-09T15:36:46.410252+0000","last_fullsized":"2023-10-09T15:36:46.410252+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:35:58.554551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.403512+0000","last_change":"2023-10-09T15:36:47.403512+0000","last_active":"2023-10-09T15:36:47.403512+0000","last_peered":"2023-10-09T15:36:47.403512+0000","last_clean":"2023-10-09T15:36:47.403512+0000","last_became_active":"2023-10-09T15:36:47.403215+0000","last_became_peered":"2023-10-09T15:36:47.403215+0000","last_unstale":"2023-10-09T15:36:47.403512+0000","last_undegraded":"2023-10-09T15:36:47.403512+0000","last_fullsized":"2023-10-09T15:36:47.403512+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:42.089522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"88'8","reported_seq":17,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.425648+0000","last_change":"2023-10-09T15:36:46.408310+0000","last_active":"2023-10-09T15:36:47.425648+0000","last_peered":"2023-10-09T15:36:47.425648+0000","last_clean":"2023-10-09T15:36:47.425648+0000","last_became_active":"2023-10-09T15:36:46.408055+0000","last_became_peered":"2023-10-09T15:36:46.408055+0000","last_unstale":"2023-10-09T15:36:47.425648+0000","last_undegraded":"2023-10-09T15:36:47.425648+0000","last_fullsized":"2023-10-09T15:36:47.425648+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:29.056276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410458+0000","last_change":"2023-10-09T15:36:47.410458+0000","last_active":"2023-10-09T15:36:47.410458+0000","last_peered":"2023-10-09T15:36:47.410458+0000","last_clean":"2023-10-09T15:36:47.410458+0000","last_became_active":"2023-10-09T15:36:47.409486+0000","last_became_peered":"2023-10-09T15:36:47.409486+0000","last_unstale":"2023-10-09T15:36:47.410458+0000","last_undegraded":"2023-10-09T15:36:47.410458+0000","last_fullsized":"2023-10-09T15:36:47.410458+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:03:37.768941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.430272+0000","last_change":"2023-10-09T15:36:46.406891+0000","last_active":"2023-10-09T15:36:47.430272+0000","last_peered":"2023-10-09T15:36:47.430272+0000","last_clean":"2023-10-09T15:36:47.430272+0000","last_became_active":"2023-10-09T15:36:46.406612+0000","last_became_peered":"2023-10-09T15:36:46.406612+0000","last_unstale":"2023-10-09T15:36:47.430272+0000","last_undegraded":"2023-10-09T15:36:47.430272+0000","last_fullsized":"2023-10-09T15:36:47.430272+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:47.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416174+0000","last_change":"2023-10-09T15:36:47.416174+0000","last_active":"2023-10-09T15:36:47.416174+0000","last_peered":"2023-10-09T15:36:47.416174+0000","last_clean":"2023-10-09T15:36:47.416174+0000","last_became_active":"2023-10-09T15:36:47.415847+0000","last_became_peered":"2023-10-09T15:36:47.415847+0000","last_unstale":"2023-10-09T15:36:47.416174+0000","last_undegraded":"2023-10-09T15:36:47.416174+0000","last_fullsized":"2023-10-09T15:36:47.416174+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:19:28.448077+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.402469+0000","last_change":"2023-10-09T15:36:46.398568+0000","last_active":"2023-10-09T15:36:47.402469+0000","last_peered":"2023-10-09T15:36:47.402469+0000","last_clean":"2023-10-09T15:36:47.402469+0000","last_became_active":"2023-10-09T15:36:46.398167+0000","last_became_peered":"2023-10-09T15:36:46.398167+0000","last_unstale":"2023-10-09T15:36:47.402469+0000","last_undegraded":"2023-10-09T15:36:47.402469+0000","last_fullsized":"2023-10-09T15:36:47.402469+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:25.222489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424227+0000","last_change":"2023-10-09T15:36:47.424227+0000","last_active":"2023-10-09T15:36:47.424227+0000","last_peered":"2023-10-09T15:36:47.424227+0000","last_clean":"2023-10-09T15:36:47.424227+0000","last_became_active":"2023-10-09T15:36:47.423775+0000","last_became_peered":"2023-10-09T15:36:47.423775+0000","last_unstale":"2023-10-09T15:36:47.424227+0000","last_undegraded":"2023-10-09T15:36:47.424227+0000","last_fullsized":"2023-10-09T15:36:47.424227+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:30.405163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411192+0000","last_change":"2023-10-09T15:36:46.405086+0000","last_active":"2023-10-09T15:36:46.411192+0000","last_peered":"2023-10-09T15:36:46.411192+0000","last_clean":"2023-10-09T15:36:46.411192+0000","last_became_active":"2023-10-09T15:36:46.404730+0000","last_became_peered":"2023-10-09T15:36:46.404730+0000","last_unstale":"2023-10-09T15:36:46.411192+0000","last_undegraded":"2023-10-09T15:36:46.411192+0000","last_fullsized":"2023-10-09T15:36:46.411192+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:43.134048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.412812+0000","last_change":"2023-10-09T15:36:47.412812+0000","last_active":"2023-10-09T15:36:47.412812+0000","last_peered":"2023-10-09T15:36:47.412812+0000","last_clean":"2023-10-09T15:36:47.412812+0000","last_became_active":"2023-10-09T15:36:47.412484+0000","last_became_peered":"2023-10-09T15:36:47.412484+0000","last_unstale":"2023-10-09T15:36:47.412812+0000","last_undegraded":"2023-10-09T15:36:47.412812+0000","last_fullsized":"2023-10-09T15:36:47.412812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:31.938709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.424217+0000","last_change":"2023-10-09T15:36:46.404205+0000","last_active":"2023-10-09T15:36:47.424217+0000","last_peered":"2023-10-09T15:36:47.424217+0000","last_clean":"2023-10-09T15:36:47.424217+0000","last_became_active":"2023-10-09T15:36:46.403937+0000","last_became_peered":"2023-10-09T15:36:46.403937+0000","last_unstale":"2023-10-09T15:36:47.424217+0000","last_undegraded":"2023-10-09T15:36:47.424217+0000","last_fullsized":"2023-10-09T15:36:47.424217+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:28.294765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.431298+0000","last_change":"2023-10-09T15:36:47.431298+0000","last_active":"2023-10-09T15:36:47.431298+0000","last_peered":"2023-10-09T15:36:47.431298+0000","last_clean":"2023-10-09T15:36:47.431298+0000","last_became_active":"2023-10-09T15:36:47.431002+0000","last_became_peered":"2023-10-09T15:36:47.431002+0000","last_unstale":"2023-10-09T15:36:47.431298+0000","last_undegraded":"2023-10-09T15:36:47.431298+0000","last_fullsized":"2023-10-09T15:36:47.431298+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:36:32.365133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406046+0000","last_change":"2023-10-09T15:36:46.404419+0000","last_active":"2023-10-09T15:36:46.406046+0000","last_peered":"2023-10-09T15:36:46.406046+0000","last_clean":"2023-10-09T15:36:46.406046+0000","last_became_active":"2023-10-09T15:36:46.404221+0000","last_became_peered":"2023-10-09T15:36:46.404221+0000","last_unstale":"2023-10-09T15:36:46.406046+0000","last_undegraded":"2023-10-09T15:36:46.406046+0000","last_fullsized":"2023-10-09T15:36:46.406046+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:38.010757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410598+0000","last_change":"2023-10-09T15:36:47.410598+0000","last_active":"2023-10-09T15:36:47.410598+0000","last_peered":"2023-10-09T15:36:47.410598+0000","last_clean":"2023-10-09T15:36:47.410598+0000","last_became_active":"2023-10-09T15:36:47.410165+0000","last_became_peered":"2023-10-09T15:36:47.410165+0000","last_unstale":"2023-10-09T15:36:47.410598+0000","last_undegraded":"2023-10-09T15:36:47.410598+0000","last_fullsized":"2023-10-09T15:36:47.410598+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:18.881173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406016+0000","last_change":"2023-10-09T15:36:46.403902+0000","last_active":"2023-10-09T15:36:46.406016+0000","last_peered":"2023-10-09T15:36:46.406016+0000","last_clean":"2023-10-09T15:36:46.406016+0000","last_became_active":"2023-10-09T15:36:46.403623+0000","last_became_peered":"2023-10-09T15:36:46.403623+0000","last_unstale":"2023-10-09T15:36:46.406016+0000","last_undegraded":"2023-10-09T15:36:46.406016+0000","last_fullsized":"2023-10-09T15:36:46.406016+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:37:12.759712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420496+0000","last_change":"2023-10-09T15:36:47.420496+0000","last_active":"2023-10-09T15:36:47.420496+0000","last_peered":"2023-10-09T15:36:47.420496+0000","last_clean":"2023-10-09T15:36:47.420496+0000","last_became_active":"2023-10-09T15:36:47.420207+0000","last_became_peered":"2023-10-09T15:36:47.420207+0000","last_unstale":"2023-10-09T15:36:47.420496+0000","last_undegraded":"2023-10-09T15:36:47.420496+0000","last_fullsized":"2023-10-09T15:36:47.420496+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:59.861240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411622+0000","last_change":"2023-10-09T15:36:46.406369+0000","last_active":"2023-10-09T15:36:46.411622+0000","last_peered":"2023-10-09T15:36:46.411622+0000","last_clean":"2023-10-09T15:36:46.411622+0000","last_became_active":"2023-10-09T15:36:46.406097+0000","last_became_peered":"2023-10-09T15:36:46.406097+0000","last_unstale":"2023-10-09T15:36:46.411622+0000","last_undegraded":"2023-10-09T15:36:46.411622+0000","last_fullsized":"2023-10-09T15:36:46.411622+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:42:17.727872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420223+0000","last_change":"2023-10-09T15:36:47.420223+0000","last_active":"2023-10-09T15:36:47.420223+0000","last_peered":"2023-10-09T15:36:47.420223+0000","last_clean":"2023-10-09T15:36:47.420223+0000","last_became_active":"2023-10-09T15:36:47.418794+0000","last_became_peered":"2023-10-09T15:36:47.418794+0000","last_unstale":"2023-10-09T15:36:47.420223+0000","last_undegraded":"2023-10-09T15:36:47.420223+0000","last_fullsized":"2023-10-09T15:36:47.420223+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:33.151120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"88'2","reported_seq":11,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.422439+0000","last_change":"2023-10-09T15:36:46.406945+0000","last_active":"2023-10-09T15:36:47.422439+0000","last_peered":"2023-10-09T15:36:47.422439+0000","last_clean":"2023-10-09T15:36:47.422439+0000","last_became_active":"2023-10-09T15:36:46.406708+0000","last_became_peered":"2023-10-09T15:36:46.406708+0000","last_unstale":"2023-10-09T15:36:47.422439+0000","last_undegraded":"2023-10-09T15:36:47.422439+0000","last_fullsized":"2023-10-09T15:36:47.422439+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:30:24.818883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.416792+0000","last_change":"2023-10-09T15:36:47.416792+0000","last_active":"2023-10-09T15:36:47.416792+0000","last_peered":"2023-10-09T15:36:47.416792+0000","last_clean":"2023-10-09T15:36:47.416792+0000","last_became_active":"2023-10-09T15:36:47.416453+0000","last_became_peered":"2023-10-09T15:36:47.416453+0000","last_unstale":"2023-10-09T15:36:47.416792+0000","last_undegraded":"2023-10-09T15:36:47.416792+0000","last_fullsized":"2023-10-09T15:36:47.416792+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:26.229829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.411676+0000","last_change":"2023-10-09T15:36:46.407507+0000","last_active":"2023-10-09T15:36:46.411676+0000","last_peered":"2023-10-09T15:36:46.411676+0000","last_clean":"2023-10-09T15:36:46.411676+0000","last_became_active":"2023-10-09T15:36:46.407220+0000","last_became_peered":"2023-10-09T15:36:46.407220+0000","last_unstale":"2023-10-09T15:36:46.411676+0000","last_undegraded":"2023-10-09T15:36:46.411676+0000","last_fullsized":"2023-10-09T15:36:46.411676+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:25.222489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.420902+0000","last_change":"2023-10-09T15:36:47.420902+0000","last_active":"2023-10-09T15:36:47.420902+0000","last_peered":"2023-10-09T15:36:47.420902+0000","last_clean":"2023-10-09T15:36:47.420902+0000","last_became_active":"2023-10-09T15:36:47.420617+0000","last_became_peered":"2023-10-09T15:36:47.420617+0000","last_unstale":"2023-10-09T15:36:47.420902+0000","last_undegraded":"2023-10-09T15:36:47.420902+0000","last_fullsized":"2023-10-09T15:36:47.420902+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:47.412388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.414038+0000","last_change":"2023-10-09T15:36:46.407980+0000","last_active":"2023-10-09T15:36:46.414038+0000","last_peered":"2023-10-09T15:36:46.414038+0000","last_clean":"2023-10-09T15:36:46.414038+0000","last_became_active":"2023-10-09T15:36:46.407596+0000","last_became_peered":"2023-10-09T15:36:46.407596+0000","last_unstale":"2023-10-09T15:36:46.414038+0000","last_undegraded":"2023-10-09T15:36:46.414038+0000","last_fullsized":"2023-10-09T15:36:46.414038+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:31.053829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413812+0000","last_change":"2023-10-09T15:36:47.413812+0000","last_active":"2023-10-09T15:36:47.413812+0000","last_peered":"2023-10-09T15:36:47.413812+0000","last_clean":"2023-10-09T15:36:47.413812+0000","last_became_active":"2023-10-09T15:36:47.413553+0000","last_became_peered":"2023-10-09T15:36:47.413553+0000","last_unstale":"2023-10-09T15:36:47.413812+0000","last_undegraded":"2023-10-09T15:36:47.413812+0000","last_fullsized":"2023-10-09T15:36:47.413812+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:14:22.020942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406697+0000","last_change":"2023-10-09T15:36:46.405120+0000","last_active":"2023-10-09T15:36:46.406697+0000","last_peered":"2023-10-09T15:36:46.406697+0000","last_clean":"2023-10-09T15:36:46.406697+0000","last_became_active":"2023-10-09T15:36:46.404777+0000","last_became_peered":"2023-10-09T15:36:46.404777+0000","last_unstale":"2023-10-09T15:36:46.406697+0000","last_undegraded":"2023-10-09T15:36:46.406697+0000","last_fullsized":"2023-10-09T15:36:46.406697+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:10:47.089978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.409202+0000","last_change":"2023-10-09T15:36:47.409202+0000","last_active":"2023-10-09T15:36:47.409202+0000","last_peered":"2023-10-09T15:36:47.409202+0000","last_clean":"2023-10-09T15:36:47.409202+0000","last_became_active":"2023-10-09T15:36:47.408957+0000","last_became_peered":"2023-10-09T15:36:47.408957+0000","last_unstale":"2023-10-09T15:36:47.409202+0000","last_undegraded":"2023-10-09T15:36:47.409202+0000","last_fullsized":"2023-10-09T15:36:47.409202+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:04:31.511474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406517+0000","last_change":"2023-10-09T15:36:46.402190+0000","last_active":"2023-10-09T15:36:46.406517+0000","last_peered":"2023-10-09T15:36:46.406517+0000","last_clean":"2023-10-09T15:36:46.406517+0000","last_became_active":"2023-10-09T15:36:46.401943+0000","last_became_peered":"2023-10-09T15:36:46.401943+0000","last_unstale":"2023-10-09T15:36:46.406517+0000","last_undegraded":"2023-10-09T15:36:46.406517+0000","last_fullsized":"2023-10-09T15:36:46.406517+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413447+0000","last_change":"2023-10-09T15:36:47.413447+0000","last_active":"2023-10-09T15:36:47.413447+0000","last_peered":"2023-10-09T15:36:47.413447+0000","last_clean":"2023-10-09T15:36:47.413447+0000","last_became_active":"2023-10-09T15:36:47.413080+0000","last_became_peered":"2023-10-09T15:36:47.413080+0000","last_unstale":"2023-10-09T15:36:47.413447+0000","last_undegraded":"2023-10-09T15:36:47.413447+0000","last_fullsized":"2023-10-09T15:36:47.413447+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:54:29.302105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406543+0000","last_change":"2023-10-09T15:36:46.401085+0000","last_active":"2023-10-09T15:36:46.406543+0000","last_peered":"2023-10-09T15:36:46.406543+0000","last_clean":"2023-10-09T15:36:46.406543+0000","last_became_active":"2023-10-09T15:36:46.400835+0000","last_became_peered":"2023-10-09T15:36:46.400835+0000","last_unstale":"2023-10-09T15:36:46.406543+0000","last_undegraded":"2023-10-09T15:36:46.406543+0000","last_fullsized":"2023-10-09T15:36:46.406543+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:31.053829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.403609+0000","last_change":"2023-10-09T15:36:47.403609+0000","last_active":"2023-10-09T15:36:47.403609+0000","last_peered":"2023-10-09T15:36:47.403609+0000","last_clean":"2023-10-09T15:36:47.403609+0000","last_became_active":"2023-10-09T15:36:47.403234+0000","last_became_peered":"2023-10-09T15:36:47.403234+0000","last_unstale":"2023-10-09T15:36:47.403609+0000","last_undegraded":"2023-10-09T15:36:47.403609+0000","last_fullsized":"2023-10-09T15:36:47.403609+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:24:36.834901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.408512+0000","last_change":"2023-10-09T15:36:46.405238+0000","last_active":"2023-10-09T15:36:46.408512+0000","last_peered":"2023-10-09T15:36:46.408512+0000","last_clean":"2023-10-09T15:36:46.408512+0000","last_became_active":"2023-10-09T15:36:46.404571+0000","last_became_peered":"2023-10-09T15:36:46.404571+0000","last_unstale":"2023-10-09T15:36:46.408512+0000","last_undegraded":"2023-10-09T15:36:46.408512+0000","last_fullsized":"2023-10-09T15:36:46.408512+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:22:08.065145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.413260+0000","last_change":"2023-10-09T15:36:47.413260+0000","last_active":"2023-10-09T15:36:47.413260+0000","last_peered":"2023-10-09T15:36:47.413260+0000","last_clean":"2023-10-09T15:36:47.413260+0000","last_became_active":"2023-10-09T15:36:47.412982+0000","last_became_peered":"2023-10-09T15:36:47.412982+0000","last_unstale":"2023-10-09T15:36:47.413260+0000","last_undegraded":"2023-10-09T15:36:47.413260+0000","last_fullsized":"2023-10-09T15:36:47.413260+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:51:49.454324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":9,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.406562+0000","last_change":"2023-10-09T15:36:46.405202+0000","last_active":"2023-10-09T15:36:46.406562+0000","last_peered":"2023-10-09T15:36:46.406562+0000","last_clean":"2023-10-09T15:36:46.406562+0000","last_became_active":"2023-10-09T15:36:46.404931+0000","last_became_peered":"2023-10-09T15:36:46.404931+0000","last_unstale":"2023-10-09T15:36:46.406562+0000","last_undegraded":"2023-10-09T15:36:46.406562+0000","last_fullsized":"2023-10-09T15:36:46.406562+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:35:15.645012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":8,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.410403+0000","last_change":"2023-10-09T15:36:47.410403+0000","last_active":"2023-10-09T15:36:47.410403+0000","last_peered":"2023-10-09T15:36:47.410403+0000","last_clean":"2023-10-09T15:36:47.410403+0000","last_became_active":"2023-10-09T15:36:47.410178+0000","last_became_peered":"2023-10-09T15:36:47.410178+0000","last_unstale":"2023-10-09T15:36:47.410403+0000","last_undegraded":"2023-10-09T15:36:47.410403+0000","last_fullsized":"2023-10-09T15:36:47.410403+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":87,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:46.381875+0000","last_clean_scrub_stamp":"2023-10-09T15:36:46.381875+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:12.301441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"88'1","reported_seq":10,"reported_epoch":88,"state":"active+clean","last_fresh":"2023-10-09T15:36:47.405525+0000","last_change":"2023-10-09T15:36:46.403851+0000","last_active":"2023-10-09T15:36:47.405525+0000","last_peered":"2023-10-09T15:36:47.405525+0000","last_clean":"2023-10-09T15:36:47.405525+0000","last_became_active":"2023-10-09T15:36:46.403552+0000","last_became_peered":"2023-10-09T15:36:46.403552+0000","last_unstale":"2023-10-09T15:36:47.405525+0000","last_undegraded":"2023-10-09T15:36:47.405525+0000","last_fullsized":"2023-10-09T15:36:47.405525+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":86,"last_epoch_clean":87,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:36:45.374534+0000","last_clean_scrub_stamp":"2023-10-09T15:36:45.374534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:52.681042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":221,"reported_epoch":87,"state":"active+clean","last_fresh":"2023-10-09T15:36:46.398430+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:36:46.398430+0000","last_peered":"2023-10-09T15:36:46.398430+0000","last_clean":"2023-10-09T15:36:46.398430+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:36:46.398430+0000","last_undegraded":"2023-10-09T15:36:46.398430+0000","last_fullsized":"2023-10-09T15:36:46.398430+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298940,"kb_used_data":1652,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94072900,"statfs":{"total":96636764160,"available":96330649600,"internally_reserved":0,"allocated":1691648,"data_stored":1058783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.35499999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72699999999999998,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.36899999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69099999999999995,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52800000000000002,"15min":0.51400000000000001},"min":{"1min":0.379,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.63400000000000001,"5min":0.874,"15min":0.874},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.71299999999999997,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.443}]},{"osd":2,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.56299999999999994,"15min":0.53500000000000003},"min":{"1min":0.46600000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.72399999999999998,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56499999999999995,"15min":0.55000000000000004},"min":{"1min":0.39000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.70699999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.41999999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.59399999999999997,"15min":0.56699999999999995},"min":{"1min":0.41299999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.745,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.622},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.60999999999999999,"15min":0.61199999999999999},"min":{"1min":0.441,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.745,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54700000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.54900000000000004,"15min":0.52800000000000002},"min":{"1min":0.39000000000000001,"5min":0.309,"15min":0.309},"max":{"1min":0.77700000000000002,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58699999999999997,"15min":0.54800000000000004},"min":{"1min":0.45000000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.79000000000000004,"5min":0.88,"15min":0.88},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59399999999999997,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.69799999999999995,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61399999999999999,"15min":0.58399999999999996},"min":{"1min":0.51200000000000001,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.76300000000000001,"5min":0.92200000000000004,"15min":0.92200000000000004},"last":0.69299999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:03 2023","interfaces":[{"interface":"back","average":{"1min":0.68000000000000005,"5min":0.67300000000000004,"15min":0.64800000000000002},"min":{"1min":0.57199999999999995,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.81699999999999995,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.66900000000000004,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.47399999999999998,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.82299999999999995,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.755}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298360,"kb_used_data":1072,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073480,"statfs":{"total":96636764160,"available":96331243520,"internally_reserved":0,"allocated":1097728,"data_stored":468927,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.52500000000000002,"15min":0.495},"min":{"1min":0.32500000000000001,"5min":0.252,"15min":0.252},"max":{"1min":0.63900000000000001,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.53300000000000003,"15min":0.54100000000000004},"min":{"1min":0.35699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76500000000000001,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.437}]},{"osd":1,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.52900000000000003,"15min":0.56000000000000005},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.68400000000000005,"5min":1.379,"15min":1.379},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56000000000000005,"15min":0.54600000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.71599999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56000000000000005}]},{"osd":2,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.56699999999999995,"15min":0.59999999999999998},"min":{"1min":0.40300000000000002,"5min":0.308,"15min":0.308},"max":{"1min":0.66600000000000004,"5min":1.3999999999999999,"15min":1.3999999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.61699999999999999,"15min":0.80300000000000005},"min":{"1min":0.38500000000000001,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.71899999999999997,"5min":7.3419999999999996,"15min":7.3419999999999996},"last":0.51200000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.59199999999999997,"15min":0.62},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.73899999999999999,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.61299999999999999,"15min":0.64400000000000002},"min":{"1min":0.45800000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.66800000000000004,"5min":1.4399999999999999,"15min":1.4399999999999999},"last":0.59099999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.55000000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.69299999999999995,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.59799999999999998,"15min":0.57199999999999995},"min":{"1min":0.376,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.749,"5min":0.872,"15min":0.872},"last":0.67000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.70699999999999996,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.61599999999999999,"15min":0.63200000000000001},"min":{"1min":0.40600000000000003,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.76700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:36:02 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64100000000000001,"15min":0.65100000000000002},"min":{"1min":0.45300000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.78300000000000003,"5min":1.004,"15min":1.004},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.67100000000000004,"15min":0.66900000000000004},"min":{"1min":0.434,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.751,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.71299999999999997}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302448,"kb_used_data":1064,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069392,"statfs":{"total":96636764160,"available":96327057408,"internally_reserved":0,"allocated":1089536,"data_stored":468303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33900000000000002,"15min":0.35399999999999998},"min":{"1min":0.22700000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.48399999999999999,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.36199999999999999,"15min":0.39000000000000001},"min":{"1min":0.26000000000000001,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.52900000000000003,"5min":1.512,"15min":1.512},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.34599999999999997,"15min":0.374},"min":{"1min":0.22800000000000001,"5min":0.221,"15min":0.221},"max":{"1min":0.51200000000000001,"5min":1.286,"15min":1.286},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.39100000000000001,"15min":0.41199999999999998},"min":{"1min":0.29899999999999999,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":0.55000000000000004,"5min":1.0249999999999999,"15min":1.0249999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.41599999999999998,"5min":0.42799999999999999,"15min":0.44700000000000001},"min":{"1min":0.313,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.62,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.41999999999999998,"15min":0.45000000000000001},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.57199999999999995,"5min":1.4830000000000001,"15min":1.4830000000000001},"last":0.46500000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.58999999999999997,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.374,"15min":0.374},"max":{"1min":0.877,"5min":1.222,"15min":1.222},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.60499999999999998,"15min":0.63300000000000001},"min":{"1min":0.504,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77300000000000002,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.55000000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.63},"min":{"1min":0.45900000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.78000000000000003,"5min":1.4410000000000001,"15min":1.4410000000000001},"last":0.629},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.60499999999999998,"15min":0.625},"min":{"1min":0.432,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.84599999999999997,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.56599999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.68899999999999995,"15min":0.81499999999999995},"min":{"1min":0.439,"5min":0.439,"15min":0.439},"max":{"1min":0.85799999999999998,"5min":5.5010000000000003,"15min":5.5010000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65800000000000003,"15min":0.67900000000000005},"min":{"1min":0.50600000000000001,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":0.90700000000000003,"5min":1.258,"15min":1.258},"last":0.64300000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:35:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64700000000000002,"5min":0.65700000000000003,"15min":0.67100000000000004},"min":{"1min":0.42199999999999999,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.82399999999999995,"5min":0.997,"15min":0.997},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.69299999999999995,"15min":0.82099999999999995},"min":{"1min":0.48099999999999998,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":0.85299999999999998,"5min":5.5819999999999999,"15min":5.5819999999999999},"last":0.57699999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303028,"kb_used_data":1644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068812,"statfs":{"total":96636764160,"available":96326463488,"internally_reserved":0,"allocated":1683456,"data_stored":1058214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,3,5,6],"upper_bound":64},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.34100000000000003,"15min":0.373},"min":{"1min":0.219,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.38600000000000001,"15min":0.41599999999999998},"min":{"1min":0.29299999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.52300000000000002,"5min":1.0009999999999999,"15min":1.0009999999999999},"last":2.0859999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.36399999999999999,"15min":0.39000000000000001},"min":{"1min":0.249,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.497,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":6.484},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.39500000000000002,"15min":0.52900000000000003},"min":{"1min":0.253,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.51600000000000001,"5min":4.2009999999999996,"15min":4.2009999999999996},"last":6.2859999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.40500000000000003,"15min":0.54200000000000004},"min":{"1min":0.25900000000000001,"5min":0.215,"15min":0.215},"max":{"1min":0.50600000000000001,"5min":4.5190000000000001,"15min":4.5190000000000001},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.47099999999999997,"15min":0.621},"min":{"1min":0.33300000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.53400000000000003,"5min":4.5890000000000004,"15min":4.5890000000000004},"last":2.109}]},{"osd":4,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.58099999999999996,"15min":0.63700000000000001},"min":{"1min":0.435,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.80700000000000005,"5min":1.196,"15min":1.196},"last":1.921},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.66100000000000003},"min":{"1min":0.443,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78000000000000003,"5min":1.508,"15min":1.508},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.58299999999999996,"15min":0.625},"min":{"1min":0.41699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.79700000000000004,"5min":1.0509999999999999,"15min":1.0509999999999999},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.621,"5min":0.60299999999999998,"15min":0.63300000000000001},"min":{"1min":0.436,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.75600000000000001,"5min":0.92300000000000004,"15min":0.92300000000000004},"last":4.1020000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63500000000000001,"15min":0.68300000000000005},"min":{"1min":0.47499999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.79900000000000004,"5min":0.97599999999999998,"15min":0.97599999999999998},"last":3.9009999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.63,"15min":0.68100000000000005},"min":{"1min":0.496,"5min":0.443,"15min":0.443},"max":{"1min":0.83699999999999997,"5min":1.238,"15min":1.238},"last":1.9810000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:36:09 2023","interfaces":[{"interface":"back","average":{"1min":0.64500000000000002,"5min":0.64200000000000002,"15min":0.70299999999999996},"min":{"1min":0.40799999999999997,"5min":0.378,"15min":0.378},"max":{"1min":0.81499999999999995,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":2.032},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.64000000000000001,"15min":0.67100000000000004},"min":{"1min":0.52200000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.82899999999999996,"5min":0.94699999999999995,"15min":0.94699999999999995},"last":0.73499999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":468337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.33100000000000002,"15min":0.32900000000000001},"min":{"1min":0.21199999999999999,"5min":0.187,"15min":0.187},"max":{"1min":0.47299999999999998,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.35199999999999998,"15min":0.35999999999999999},"min":{"1min":0.26900000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.42599999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"last":0.29399999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.36899999999999999,"15min":0.36399999999999999},"min":{"1min":0.255,"5min":0.22500000000000001,"15min":0.22500000000000001},"max":{"1min":0.51200000000000001,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.377,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.28399999999999997,"5min":0.248,"15min":0.248},"max":{"1min":0.51200000000000001,"5min":0.73699999999999999,"15min":0.73699999999999999},"last":0.34399999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.36399999999999999,"15min":0.36399999999999999},"min":{"1min":0.27000000000000002,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.48999999999999999,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.312},{"interface":"front","average":{"1min":0.40500000000000003,"5min":0.43099999999999999,"15min":0.434},"min":{"1min":0.31,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.54200000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38300000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.61199999999999999,"15min":0.65400000000000003},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.83199999999999996,"5min":2.3399999999999999,"15min":2.3399999999999999},"last":0.502},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.59699999999999998,"15min":0.61099999999999999},"min":{"1min":0.40600000000000003,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93899999999999995,"15min":0.93899999999999995},"last":0.50800000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.60799999999999998},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71699999999999997,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.63500000000000001,"15min":0.69299999999999995},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.79800000000000004,"5min":2.5249999999999999,"15min":2.5249999999999999},"last":0.60799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.64500000000000002,"15min":0.68500000000000005},"min":{"1min":0.40799999999999997,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.82499999999999996,"5min":1.5189999999999999,"15min":1.5189999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.65900000000000003},"min":{"1min":0.47599999999999998,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.81000000000000005,"5min":0.97199999999999998,"15min":0.97199999999999998},"last":0.56799999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:36:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66900000000000004,"5min":0.65600000000000003,"15min":0.68700000000000006},"min":{"1min":0.442,"5min":0.44,"15min":0.44},"max":{"1min":0.82199999999999995,"5min":1.407,"15min":1.407},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.64500000000000002,"15min":0.66100000000000003},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.77400000000000002,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.61699999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574921,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298368,"kb_used_data":1080,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073472,"statfs":{"total":96636764160,"available":96331235328,"internally_reserved":0,"allocated":1105920,"data_stored":469861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.32600000000000001,"15min":0.36399999999999999},"min":{"1min":0.216,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.46899999999999997,"5min":1.2270000000000001,"15min":1.2270000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.32100000000000001,"5min":0.49199999999999999,"15min":0.91200000000000003},"min":{"1min":0.23000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.45700000000000002,"5min":17.085999999999999,"15min":17.085999999999999},"last":0.53000000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.42299999999999999,"15min":0.68000000000000005},"min":{"1min":0.27300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.57399999999999995,"5min":9.6600000000000001,"15min":9.6600000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.377,"15min":0.41999999999999998},"min":{"1min":0.26600000000000001,"5min":0.25800000000000001,"15min":0.25800000000000001},"max":{"1min":0.51700000000000002,"5min":1.3049999999999999,"15min":1.3049999999999999},"last":0.56899999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.64700000000000002,"15min":1.429},"min":{"1min":0.26500000000000001,"5min":0.247,"15min":0.247},"max":{"1min":0.498,"5min":16.937999999999999,"15min":16.937999999999999},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.38,"5min":0.48299999999999998,"15min":0.755},"min":{"1min":0.32000000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.50700000000000001,"5min":10.451000000000001,"15min":10.451000000000001},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.71999999999999997,"15min":1.121},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73599999999999999,"5min":17.02,"15min":17.02},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.71599999999999997,"15min":0.92700000000000005},"min":{"1min":0.42399999999999999,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.82099999999999995,"5min":9.6969999999999992,"15min":9.6969999999999992},"last":0.62}]},{"osd":5,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.628},"min":{"1min":0.47899999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83899999999999997,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.77100000000000002},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.73499999999999999,"15min":1.149},"min":{"1min":0.39500000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82499999999999996,"5min":16.984999999999999,"15min":16.984999999999999},"last":0.873}]},{"osd":6,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.69599999999999995,"15min":0.93700000000000006},"min":{"1min":0.45700000000000002,"5min":0.434,"15min":0.434},"max":{"1min":0.83999999999999997,"5min":9.7319999999999993,"15min":9.7319999999999993},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.64700000000000002,"15min":0.67200000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.436},"max":{"1min":0.86399999999999999,"5min":1.278,"15min":1.278},"last":0.86099999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.78000000000000003,"15min":1.1950000000000001},"min":{"1min":0.47099999999999997,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.85099999999999998,"5min":17.053999999999998,"15min":17.053999999999998},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.72599999999999998,"15min":0.95199999999999996},"min":{"1min":0.50700000000000001,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.876,"5min":9.6029999999999998,"15min":9.6029999999999998},"last":0.67800000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298340,"kb_used_data":1052,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073500,"statfs":{"total":96636764160,"available":96331264000,"internally_reserved":0,"allocated":1077248,"data_stored":461540,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.70599999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.39700000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.41699999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.61899999999999999,"15min":0.66300000000000003},"min":{"1min":0.42399999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.871,"5min":2.879,"15min":2.879},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.56799999999999995,"15min":0.56499999999999995},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.76900000000000002,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.65000000000000002,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57099999999999995,"15min":0.57599999999999996},"min":{"1min":0.36299999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.91100000000000003,"5min":0.91100000000000003,"15min":0.91100000000000003},"last":0.5}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.38,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.60199999999999998},"min":{"1min":0.44600000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.73399999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.54500000000000004,"15min":0.54700000000000004},"min":{"1min":0.35899999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.77600000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60999999999999999,"15min":0.627},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.73899999999999999,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.74299999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57599999999999996},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":0.71999999999999997,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.66200000000000003,"15min":0.68000000000000005},"min":{"1min":0.55400000000000005,"5min":0.433,"15min":0.433},"max":{"1min":0.80200000000000005,"5min":0.96499999999999997,"15min":0.96499999999999997},"last":0.63500000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.60599999999999998,"15min":0.628},"min":{"1min":0.40999999999999998,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":0.69799999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.65100000000000002,"15min":0.66600000000000004},"min":{"1min":0.51400000000000001,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.749,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.79700000000000004}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298356,"kb_used_data":1068,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073484,"statfs":{"total":96636764160,"available":96331247616,"internally_reserved":0,"allocated":1093632,"data_stored":468373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.51300000000000001,"15min":0.51900000000000002},"min":{"1min":0.32700000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.68600000000000005,"5min":0.87,"15min":0.87},"last":0.432},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54600000000000004,"15min":0.53600000000000003},"min":{"1min":0.35099999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.72999999999999998,"5min":1.165,"15min":1.165},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.53800000000000003},"min":{"1min":0.38,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":2.089,"15min":2.089},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52600000000000002,"5min":0.53700000000000003,"15min":0.55100000000000005},"min":{"1min":0.377,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.71199999999999997,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.50800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64800000000000002,"15min":0.91300000000000003},"min":{"1min":0.40200000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.72599999999999998,"5min":11.055,"15min":11.055},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.67800000000000005,"15min":0.93899999999999995},"min":{"1min":0.49199999999999999,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.70099999999999996,"5min":11.092000000000001,"15min":11.092000000000001},"last":0.56200000000000006}]},{"osd":3,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.68500000000000005,"15min":0.94099999999999995},"min":{"1min":0.46999999999999997,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.79300000000000004,"5min":11.164999999999999,"15min":11.164999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.60399999999999998,"15min":0.60099999999999998},"min":{"1min":0.45200000000000001,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73199999999999998,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.64400000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53300000000000003,"15min":0.53900000000000003},"min":{"1min":0.33900000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71999999999999997,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.71999999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57999999999999996,"15min":0.58699999999999997},"min":{"1min":0.41899999999999998,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83599999999999997,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.66600000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57599999999999996},"min":{"1min":0.377,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.72999999999999998,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.58099999999999996,"15min":0.60099999999999998},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76200000000000001,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.61399999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:35:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.375,"5min":0.315,"15min":0.315},"max":{"1min":0.86399999999999999,"5min":1.016,"15min":1.016},"last":0.73599999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.65200000000000002,"15min":0.65500000000000003},"min":{"1min":0.47999999999999998,"5min":0.432,"15min":0.432},"max":{"1min":0.78400000000000003,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.746}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":14,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":15,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:36:51.995 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:36:51.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:36:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.121+0000 7f68d5bc6700 1 Processor -- start 2023-10-09T15:36:52.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.121+0000 7f68d5bc6700 1 -- start start 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d5bc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 0x7f68d00b0970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d5bc6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d5bc6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68d006e560 con 0x7f68d00cec90 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d5bc6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68d006e260 con 0x7f68d00cd7d0 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d5bc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00c3240 con 0x7f68d00b05a0 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d53c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d4bc4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 0x7f68d00b0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d53c5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:43340/0 (socket says 172.21.15.33:43340) 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d53c5700 1 -- 172.21.15.33:0/4540310 learned_addr learned my addr 172.21.15.33:0/4540310 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68cffff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f68d00cec90 0x7f68d00c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:44510/0 (socket says 172.21.15.33:44510) 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.122+0000 7f68d4bc4700 1 -- 172.21.15.33:0/4540310 >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 msgr2=0x7f68d00c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d4bc4700 1 --2- 172.21.15.33:0/4540310 >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d4bc4700 1 -- 172.21.15.33:0/4540310 >> v1:172.21.15.59:6789/0 conn(0x7f68d00cec90 legacy=0x7f68d00c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d4bc4700 1 -- 172.21.15.33:0/4540310 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68d00c3520 con 0x7f68d00b05a0 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68cf7fe700 1 -- 172.21.15.33:0/4540310 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4264142042 0 0) 0x7f68d006e560 con 0x7f68d00cec90 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d53c5700 1 --2- 172.21.15.33:0/4540310 >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d4bc4700 1 --2- 172.21.15.33:0/4540310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 0x7f68d00b0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098d0 tx=0x7f68c4009120 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2078de633cf7078 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68cf7fe700 1 -- 172.21.15.33:0/4540310 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4005c10 con 0x7f68d00b05a0 2023-10-09T15:36:52.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68cf7fe700 1 -- 172.21.15.33:0/4540310 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c4005d70 con 0x7f68d00b05a0 2023-10-09T15:36:52.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68cf7fe700 1 -- 172.21.15.33:0/4540310 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c4006280 con 0x7f68d00b05a0 2023-10-09T15:36:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 -- 172.21.15.33:0/4540310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 msgr2=0x7f68d00b0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/4540310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 0x7f68d00b0970 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f68c40098d0 tx=0x7f68c4009120 comp rx=0 tx=0).stop 2023-10-09T15:36:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 -- 172.21.15.33:0/4540310 shutdown_connections 2023-10-09T15:36:52.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/4540310 >> v2:172.21.15.59:3300/0 conn(0x7f68d00cd7d0 0x7f68d00c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/4540310 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00b05a0 0x7f68d00b0970 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 -- 172.21.15.33:0/4540310 >> 172.21.15.33:0/4540310 conn(0x7f68d0088000 msgr2=0x7f68d00ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.123+0000 7f68d5bc6700 1 -- 172.21.15.33:0/4540310 shutdown_connections 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.124+0000 7f68d5bc6700 1 -- 172.21.15.33:0/4540310 wait complete. 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 Processor -- start 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 -- start start 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68d00cd7d0 0x7f68d0145d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00cec90 0x7f68d0146290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b1700 con 0x7f68d00b05a0 2023-10-09T15:36:52.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b2280 con 0x7f68d00cd7d0 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.125+0000 7f68d5bc6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68d00b1950 con 0x7f68d00cec90 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55764/0 (socket says 172.21.15.33:55764) 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 -- 172.21.15.33:0/2055042050 learned_addr learned my addr 172.21.15.33:0/2055042050 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d53c5700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00cec90 0x7f68d0146290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68cffff700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68d00cd7d0 0x7f68d0145d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 -- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00cec90 msgr2=0x7f68d0146290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00cec90 0x7f68d0146290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 -- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68d00cd7d0 msgr2=0x7f68d0145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68d00cd7d0 0x7f68d0145d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 -- 172.21.15.33:0/2055042050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68c8009ae0 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d4bc4700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009f70 tx=0x7f68c4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c401a700 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68c401a860 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68c40093c0 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68c401ac20 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.126+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68d00b1f10 con 0x7f68d00b05a0 2023-10-09T15:36:52.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.127+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68d004c3c0 con 0x7f68d00b05a0 2023-10-09T15:36:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.128+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f68c4011420 con 0x7f68d00b05a0 2023-10-09T15:36:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.128+0000 7f68ccff9700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 0x7f68b40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.128+0000 7f68cffff700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 0x7f68b40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.128+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f68c4085ef0 con 0x7f68d00b05a0 2023-10-09T15:36:52.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.129+0000 7f68cffff700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 0x7f68b40696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f68d00c4b90 tx=0x7f68bc007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.133+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f68c4052e10 con 0x7f68d00b05a0 2023-10-09T15:36:52.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.409+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f68d00686f0 con 0x7f68d00b05a0 2023-10-09T15:36:52.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.414+0000 7f68ccff9700 1 -- 172.21.15.33:0/2055042050 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f68c402b020 con 0x7f68d00b05a0 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 msgr2=0x7f68b40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 0x7f68b40696b0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f68d00c4b90 tx=0x7f68bc007d50 comp rx=0 tx=0).stop 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 msgr2=0x7f68d00c5670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f68c4009f70 tx=0x7f68c4016000 comp rx=0 tx=0).stop 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 shutdown_connections 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f68b4067200 0x7f68b40696b0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68d00b05a0 0x7f68d00c5670 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68d00cec90 0x7f68d0146290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 --2- 172.21.15.33:0/2055042050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68d00cd7d0 0x7f68d0145d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 >> 172.21.15.33:0/2055042050 conn(0x7f68d0088000 msgr2=0x7f68d006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 shutdown_connections 2023-10-09T15:36:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.417+0000 7f68d5bc6700 1 -- 172.21.15.33:0/2055042050 wait complete. 2023-10-09T15:36:52.419 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:36:52.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.549+0000 7ffa81d98700 1 Processor -- start 2023-10-09T15:36:52.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.549+0000 7ffa81d98700 1 -- start start 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa81d98700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa81d98700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c15a280 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa81d98700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa7c06e180 con 0x7ffa7c0cf200 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa81d98700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa7c06d850 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55774/0 (socket says 172.21.15.33:55774) 2023-10-09T15:36:52.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ffa7c0b0ba0 0x7ffa7c06ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50490/0 (socket says 172.21.15.33:50490) 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 -- 172.21.15.33:0/3478603258 learned_addr learned my addr 172.21.15.33:0/3478603258 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 -- 172.21.15.33:0/3478603258 >> v1:172.21.15.59:6789/0 conn(0x7ffa7c0cf200 legacy=0x7ffa7c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 -- 172.21.15.33:0/3478603258 >> v1:172.21.15.33:6789/0 conn(0x7ffa7c0b0ba0 legacy=0x7ffa7c06ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 -- 172.21.15.33:0/3478603258 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa7c06db30 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7b7fe700 1 --2- 172.21.15.33:0/3478603258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f70 tx=0x7ffa6c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e40d68c54880d401 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7a7fc700 1 -- 172.21.15.33:0/3478603258 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c00e070 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7a7fc700 1 -- 172.21.15.33:0/3478603258 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6c00bb20 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.550+0000 7ffa7a7fc700 1 -- 172.21.15.33:0/3478603258 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6c0092e0 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 -- 172.21.15.33:0/3478603258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b07d0 msgr2=0x7ffa7c0ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 --2- 172.21.15.33:0/3478603258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f70 tx=0x7ffa6c009840 comp rx=0 tx=0).stop 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 -- 172.21.15.33:0/3478603258 shutdown_connections 2023-10-09T15:36:52.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 --2- 172.21.15.33:0/3478603258 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b07d0 0x7ffa7c0ccac0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 -- 172.21.15.33:0/3478603258 >> 172.21.15.33:0/3478603258 conn(0x7ffa7c06ce80 msgr2=0x7ffa7c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 -- 172.21.15.33:0/3478603258 shutdown_connections 2023-10-09T15:36:52.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.551+0000 7ffa81d98700 1 -- 172.21.15.33:0/3478603258 wait complete. 2023-10-09T15:36:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.552+0000 7ffa81d98700 1 Processor -- start 2023-10-09T15:36:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.552+0000 7ffa81d98700 1 -- start start 2023-10-09T15:36:52.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7c0b07d0 0x7ffa7c15c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7c0cf200 0x7ffa7c0c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0ce140 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0cd570 con 0x7ffa7c0cf200 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa7c0cd810 con 0x7ffa7c0b07d0 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55790/0 (socket says 172.21.15.33:55790) 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 -- 172.21.15.33:0/1774085172 learned_addr learned my addr 172.21.15.33:0/1774085172 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 -- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7c0b07d0 msgr2=0x7ffa7c15c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7c0b07d0 0x7ffa7c15c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 -- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7c0cf200 msgr2=0x7ffa7c0c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7c0cf200 0x7ffa7c0c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 -- 172.21.15.33:0/1774085172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa6c009ae0 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa7affd700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400b5e0 tx=0x7ffa64009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400f510 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa6400f670 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa7c0cdaf0 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa6400fa30 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.554+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa7c0cef50 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.555+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa7c04c3c0 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.555+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7ffa6401a400 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.555+0000 7ffa737fe700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 0x7ffa5c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.555+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa640844b0 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.556+0000 7ffa7b7fe700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 0x7ffa5c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:52.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.556+0000 7ffa7b7fe700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 0x7ffa5c0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f70 tx=0x7ffa6c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:52.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.561+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa64051450 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.802+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ffa7c0ce280 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.802+0000 7ffa737fe700 1 -- 172.21.15.33:0/1774085172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 58 v58) v1 ==== 94+0+4596 (secure 0 0 0) 0x7ffa64054a70 con 0x7ffa7c0b0ba0 2023-10-09T15:36:52.802 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:52.802 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":58,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 msgr2=0x7ffa5c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 0x7ffa5c0696b0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7ffa6c009f70 tx=0x7ffa6c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 msgr2=0x7ffa7c15cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7ffa6400b5e0 tx=0x7ffa64009120 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 shutdown_connections 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa5c067200 0x7ffa5c0696b0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa7c0cf200 0x7ffa7c0c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa7c0b07d0 0x7ffa7c15c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.804+0000 7ffa81d98700 1 --2- 172.21.15.33:0/1774085172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa7c0b0ba0 0x7ffa7c15cdf0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.805+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 >> 172.21.15.33:0/1774085172 conn(0x7ffa7c06ce80 msgr2=0x7ffa7c068830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:52.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.805+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 shutdown_connections 2023-10-09T15:36:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:52.805+0000 7ffa81d98700 1 -- 172.21.15.33:0/1774085172 wait complete. 2023-10-09T15:36:52.806 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 58 2023-10-09T15:36:53.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 58, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:36:46.799528+0000', 'modified': '2023-10-09T15:36:50.417201+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6456}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6456': {'gid': 6456, 'name': 'c', 'rank': 0, 'incarnation': 54, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6837/503031600', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6835', 'nonce': 503031600}, {'type': 'v1', 'addr': '172.21.15.33:6837', 'nonce': 503031600}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:36:53.219 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:36:53.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T15:36:53.257 INFO:tasks.ceph.mds.c.smithi033.stderr:2023-10-09T15:36:53.258+0000 7f85b6e3d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:36:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.343+0000 7fb18c3dc700 1 Processor -- start 2023-10-09T15:36:53.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.343+0000 7fb18c3dc700 1 -- start start 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18c3dc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1840b07d0 0x7fb1840ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18c3dc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1840b0ba0 0x7fb1840c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18c3dc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb18415a280 con 0x7fb1840cf200 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18c3dc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18406e180 con 0x7fb1840b0ba0 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18c3dc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb18406d850 con 0x7fb1840b07d0 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1840b0ba0 0x7fb1840c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb1840b0ba0 0x7fb1840c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55800/0 (socket says 172.21.15.33:55800) 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 -- 172.21.15.33:0/3157717798 learned_addr learned my addr 172.21.15.33:0/3157717798 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a178700 1 --2- 172.21.15.33:0/3157717798 >> v2:172.21.15.59:3300/0 conn(0x7fb1840b07d0 0x7fb1840ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 -- 172.21.15.33:0/3157717798 >> v2:172.21.15.59:3300/0 conn(0x7fb1840b07d0 msgr2=0x7fb1840ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 --2- 172.21.15.33:0/3157717798 >> v2:172.21.15.59:3300/0 conn(0x7fb1840b07d0 0x7fb1840ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 -- 172.21.15.33:0/3157717798 >> v1:172.21.15.59:6789/0 conn(0x7fb1840cf200 legacy=0x7fb18406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 -- 172.21.15.33:0/3157717798 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb18406db30 con 0x7fb1840b0ba0 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.344+0000 7fb18a979700 1 --2- 172.21.15.33:0/3157717798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb1840c42c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb184064720 tx=0x7fb174009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29df12f2c12e3fd8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb189176700 1 -- 172.21.15.33:0/3157717798 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400b820 con 0x7fb1840b0ba0 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb189176700 1 -- 172.21.15.33:0/3157717798 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17400b980 con 0x7fb1840b0ba0 2023-10-09T15:36:53.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb189176700 1 -- 172.21.15.33:0/3157717798 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400bd20 con 0x7fb1840b0ba0 2023-10-09T15:36:53.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 -- 172.21.15.33:0/3157717798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 msgr2=0x7fb1840c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/3157717798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb1840c42c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fb184064720 tx=0x7fb174009250 comp rx=0 tx=0).stop 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 -- 172.21.15.33:0/3157717798 shutdown_connections 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/3157717798 >> v2:172.21.15.59:3300/0 conn(0x7fb1840b07d0 0x7fb1840ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/3157717798 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb1840c42c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 -- 172.21.15.33:0/3157717798 >> 172.21.15.33:0/3157717798 conn(0x7fb18406ce80 msgr2=0x7fb1840ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 -- 172.21.15.33:0/3157717798 shutdown_connections 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.345+0000 7fb18c3dc700 1 -- 172.21.15.33:0/3157717798 wait complete. 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.346+0000 7fb18c3dc700 1 Processor -- start 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.346+0000 7fb18c3dc700 1 -- start start 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1840b07d0 0x7fb18416db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1840cf200 0x7fb1841444f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184153bc0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb184153ea0 con 0x7fb1840cf200 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb18c3dc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb184144a30 con 0x7fb1840b07d0 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb189977700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb189977700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55816/0 (socket says 172.21.15.33:55816) 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.347+0000 7fb189977700 1 -- 172.21.15.33:0/2511259865 learned_addr learned my addr 172.21.15.33:0/2511259865 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 -- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1840b07d0 msgr2=0x7fb18416db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1840b07d0 0x7fb18416db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 -- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1840cf200 msgr2=0x7fb1841444f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1840cf200 0x7fb1841444f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 -- 172.21.15.33:0/2511259865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1740094f0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb189977700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c5d0 tx=0x7fb178007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb1827fc700 1 -- 172.21.15.33:0/2511259865 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011590 con 0x7fb1840b0ba0 2023-10-09T15:36:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb1827fc700 1 -- 172.21.15.33:0/2511259865 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1780116f0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb184098a20 con 0x7fb1840b0ba0 2023-10-09T15:36:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb1827fc700 1 -- 172.21.15.33:0/2511259865 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb178011ab0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.348+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb184098fe0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.349+0000 7fb1827fc700 1 -- 172.21.15.33:0/2511259865 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fb17801c460 con 0x7fb1840b0ba0 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.350+0000 7fb1827fc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 0x7fb1700696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.350+0000 7fb1827fc700 1 -- 172.21.15.33:0/2511259865 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb1780846a0 con 0x7fb1840b0ba0 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.350+0000 7fb18a178700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 0x7fb1700696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.350+0000 7fb18a178700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 0x7fb1700696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007f00 tx=0x7fb17c0073f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.352+0000 7fb1956d4b80 1 Processor -- start 2023-10-09T15:36:53.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.352+0000 7fb1956d4b80 1 -- start start 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2e50e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e9ad00 0x55b2a2e79a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2da7a70 con 0x55b2a2e79f60 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2da5270 con 0x55b2a2e50a50 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2da1060 con 0x55b2a2e9ad00 2023-10-09T15:36:53.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55826/0 (socket says 172.21.15.33:55826) 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 -- 172.21.15.33:0/3796181224 learned_addr learned my addr 172.21.15.33:0/3796181224 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a178700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2e50e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb189977700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e9ad00 0x55b2a2e79a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 -- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e9ad00 msgr2=0x55b2a2e79a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e9ad00 0x55b2a2e79a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 -- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 msgr2=0x55b2a2e50e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2e50e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 -- 172.21.15.33:0/3796181224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a2c3b270 con 0x55b2a2e79f60 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a178700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2e50e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb18a979700 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=894a336327c0dbfc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb16b7fe700 1 -- 172.21.15.33:0/3796181224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400baf0 con 0x55b2a2e79f60 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb16b7fe700 1 -- 172.21.15.33:0/3796181224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174020070 con 0x55b2a2e79f60 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.353+0000 7fb16b7fe700 1 -- 172.21.15.33:0/3796181224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400bcb0 con 0x55b2a2e79f60 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3796181224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 msgr2=0x55b2a2e4ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fd0 tx=0x7fb174016000 comp rx=0 tx=0).stop 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3796181224 shutdown_connections 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e79f60 0x55b2a2e4ccf0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2e50e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3796181224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e9ad00 0x55b2a2e79a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3796181224 >> 172.21.15.33:0/3796181224 conn(0x55b2a2e52370 msgr2=0x55b2a2e52740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3796181224 shutdown_connections 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.354+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3796181224 wait complete. 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.355+0000 7fb1956d4b80 1 -- start start 2023-10-09T15:36:53.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.355+0000 7fb1956d4b80 1 Processor -- start 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e92ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e930e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2d4c890 con 0x55b2a2e50a50 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2d67ea0 con 0x55b2a2e9ad00 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2c23e30 con 0x55b2a2e79f60 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb1956d4b80 10 client.0 _ll_register_callbacks cb 0x55b2a2e14110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:36:53.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55842/0 (socket says 172.21.15.33:55842) 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 -- 172.21.15.33:0/1678409766 learned_addr learned my addr 172.21.15.33:0/1678409766 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb189977700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e92ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a979700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e930e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 -- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 msgr2=0x55b2a2e92ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e92ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 -- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 msgr2=0x55b2a2e930e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e930e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 -- 172.21.15.33:0/1678409766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb18406db30 con 0x55b2a2e50a50 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a979700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e930e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb189977700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e92ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:53.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb18a178700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00cf70 tx=0x7fb17c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63fd3aa0fc350459 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.356+0000 7fb168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00ee90 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b2a2e45b70 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb17c01d420 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb17c01d7f0 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 10 client.6597 fetch_fsmap learned FSMap version 58 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55b2a2bddfe0 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b2a2e45b70 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb17c01d950 con 0x55b2a2e50a50 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 10 client.6597 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 10 client.6597 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:36:53.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 20 client.6597 populate_metadata read hostname 'smithi033' 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2e7ff70 0x55b2a2ea9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 4 client.6597 mds_command: new command op to 6456 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 --> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b2a2e22aa0 con 0x55b2a2e7ff70 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.357+0000 7fb189977700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2e7ff70 0x55b2a2ea9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb168ff9700 10 client.6597 ms_handle_connect on v2:172.21.15.33:6835/503031600 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb189977700 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2e7ff70 0x55b2a2ea9990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d18ea674126ce0f9 server_cookie=8342767773d7b73a in_seq=0 out_seq=0 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb168ff9700 1 -- 172.21.15.33:0/1678409766 <== mds.0 v2:172.21.15.33:6835/503031600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b2a2e22aa0 con 0x55b2a2e7ff70 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb168ff9700 10 client.6597 handle_command_reply: tid=0 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 client.6597 shutdown 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 msgr2=0x55b2a2e912d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fb17c00cf70 tx=0x7fb17c013000 comp rx=0 tx=0).stop 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 shutdown_connections 2023-10-09T15:36:53.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2e7ff70 0x55b2a2ea9990 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e912d0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb168ff9700 0 client.6597 ms_handle_reset on v2:172.21.15.33:6835/503031600 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e930e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/1678409766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e92ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 >> 172.21.15.33:0/1678409766 conn(0x55b2a2e52370 msgr2=0x55b2a2e4d6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 shutdown_connections 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.358+0000 7fb1956d4b80 1 -- 172.21.15.33:0/1678409766 wait complete. 2023-10-09T15:36:53.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.359+0000 7fb1956d4b80 20 client.6597 trim_cache size 0 max 16384 2023-10-09T15:36:53.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 Processor -- start 2023-10-09T15:36:53.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 -- start start 2023-10-09T15:36:53.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e99d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2eb19d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2e4ed60 con 0x55b2a2e50a50 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2e93f80 con 0x55b2a2e9ad00 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.376+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2e9a850 con 0x55b2a2e79f60 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55858/0 (socket says 172.21.15.33:55858) 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 -- 172.21.15.33:0/3912005045 learned_addr learned my addr 172.21.15.33:0/3912005045 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a979700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2eb19d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 -- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 msgr2=0x55b2a2e99d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb189977700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e99d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e99d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 -- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 msgr2=0x55b2a2eb19d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2eb19d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 -- 172.21.15.33:0/3912005045 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b2a2d6f780 con 0x55b2a2e50a50 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a979700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2eb19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb18a178700 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007c20 tx=0x7fb17c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d97eca4f40309911 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb16bfff700 1 -- 172.21.15.33:0/3912005045 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c00ead0 con 0x55b2a2e50a50 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb16bfff700 1 -- 172.21.15.33:0/3912005045 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb17c01d420 con 0x55b2a2e50a50 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.377+0000 7fb16bfff700 1 -- 172.21.15.33:0/3912005045 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17c01da40 con 0x55b2a2e50a50 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3912005045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 msgr2=0x55b2a2e951d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007c20 tx=0x7fb17c01f000 comp rx=0 tx=0).stop 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3912005045 shutdown_connections 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e50a50 0x55b2a2e951d0 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e9ad00 0x55b2a2eb19d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/3912005045 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2e99d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3912005045 >> 172.21.15.33:0/3912005045 conn(0x55b2a2e52370 msgr2=0x55b2a2e4c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3912005045 shutdown_connections 2023-10-09T15:36:53.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- 172.21.15.33:0/3912005045 wait complete. 2023-10-09T15:36:53.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 -- start start 2023-10-09T15:36:53.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.378+0000 7fb1956d4b80 1 Processor -- start 2023-10-09T15:36:53.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2efc740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2eba260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2e51a80 con 0x55b2a2e9ad00 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2eb7080 con 0x55b2a2e50a50 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b2a2e50f90 con 0x55b2a2e79f60 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.379+0000 7fb1956d4b80 10 client.0 _ll_register_callbacks cb 0x55b2a2e14110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55860/0 (socket says 172.21.15.33:55860) 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 -- 172.21.15.33:0/882568280 learned_addr learned my addr 172.21.15.33:0/882568280 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a178700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2efc740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb189977700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2eba260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 -- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 msgr2=0x55b2a2eba260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2eba260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 -- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 msgr2=0x55b2a2efc740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2efc740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 -- 172.21.15.33:0/882568280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55b2a2bddfe0 con 0x55b2a2e9ad00 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb18a979700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fa0 tx=0x7fb17401e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba34067072583a35 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb168ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb17400bd00 con 0x55b2a2e9ad00 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb17400be60 con 0x55b2a2e9ad00 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb174020070 con 0x55b2a2e9ad00 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=58) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb174011a50 con 0x55b2a2e9ad00 2023-10-09T15:36:53.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb1956d4b80 10 client.6603 fetch_fsmap learned FSMap version 58 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=58,monmap=2+}) v3 -- 0x55b2a2d56470 con 0x55b2a2e9ad00 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.380+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb174020070 con 0x55b2a2e9ad00 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 58) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb17402c040 con 0x55b2a2e9ad00 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 10 client.6603 fetch_fsmap finished waiting for FSMap version 58 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 10 client.6603 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 20 client.6603 populate_metadata read hostname 'smithi033' 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2eb19d0 0x55b2a2eb1da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 4 client.6603 mds_command: new command op to 6456 tid=0[{"prefix": "status"}] 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 --> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b2a2d43e00 con 0x55b2a2eb19d0 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb18a178700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2eb19d0 0x55b2a2eb1da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb18a178700 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2eb19d0 0x55b2a2eb1da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752696161bf664c5 server_cookie=e00c455e0b0edf20 in_seq=0 out_seq=0 2023-10-09T15:36:53.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb168ff9700 10 client.6603 ms_handle_connect on v2:172.21.15.33:6835/503031600 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb168ff9700 1 -- 172.21.15.33:0/882568280 <== mds.0 v2:172.21.15.33:6835/503031600 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55b2a2d43e00 con 0x55b2a2eb19d0 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb168ff9700 10 client.6603 handle_command_reply: tid=0 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 client.6603 shutdown 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 msgr2=0x55b2a2e7ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7fb174006fa0 tx=0x7fb17401e070 comp rx=0 tx=0).stop 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 shutdown_connections 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:6835/503031600,v1:172.21.15.33:6837/503031600] conn(0x55b2a2eb19d0 0x55b2a2eb1da0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b2a2e9ad00 0x55b2a2e7ca00 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb168ff9700 0 client.6603 ms_handle_reset on v2:172.21.15.33:6835/503031600 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b2a2e50a50 0x55b2a2efc740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 --2- 172.21.15.33:0/882568280 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b2a2e79f60 0x55b2a2eba260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.381+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 >> 172.21.15.33:0/882568280 conn(0x55b2a2e52370 msgr2=0x55b2a2e99d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 shutdown_connections 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb1956d4b80 1 -- 172.21.15.33:0/882568280 wait complete. 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb1956d4b80 20 client.6603 trim_cache size 0 max 16384 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 6456, 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:36:53.389 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9861601130000004, 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 58, 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 89, 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 89, 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.067575957000001 2023-10-09T15:36:53.390 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 msgr2=0x7fb1700696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 0x7fb1700696b0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb17c007f00 tx=0x7fb17c0073f0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 msgr2=0x7fb18409a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fb17800c5d0 tx=0x7fb178007f60 comp rx=0 tx=0).stop 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 shutdown_connections 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb170067200 0x7fb1700696b0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1840cf200 0x7fb1841444f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1840b07d0 0x7fb18416db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 --2- 172.21.15.33:0/2511259865 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1840b0ba0 0x7fb18409a6d0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 >> 172.21.15.33:0/2511259865 conn(0x7fb18406ce80 msgr2=0x7fb184067ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 shutdown_connections 2023-10-09T15:36:53.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.382+0000 7fb18c3dc700 1 -- 172.21.15.33:0/2511259865 wait complete. 2023-10-09T15:36:53.394 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:36:53.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.553+0000 7effc2e0c700 1 Processor -- start 2023-10-09T15:36:53.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.553+0000 7effc2e0c700 1 -- start start 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effc2e0c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 0x7effbc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effc2e0c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7effbc0cd9e0 0x7effbc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effc2e0c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc15ae40 con 0x7effbc15a400 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effc2e0c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc0d13f0 con 0x7effbc0cd9e0 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effc2e0c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effbc15ab60 con 0x7effbc0cb5a0 2023-10-09T15:36:53.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effbbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7effbc0cd9e0 0x7effbc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effbbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7effbc0cd9e0 0x7effbc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55872/0 (socket says 172.21.15.33:55872) 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.554+0000 7effbbfff700 1 -- 172.21.15.33:0/1295557628 learned_addr learned my addr 172.21.15.33:0/1295557628 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbbfff700 1 -- 172.21.15.33:0/1295557628 >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 msgr2=0x7effbc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc0ba8700 1 --2- 172.21.15.33:0/1295557628 >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 0x7effbc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbbfff700 1 --2- 172.21.15.33:0/1295557628 >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 0x7effbc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbbfff700 1 -- 172.21.15.33:0/1295557628 >> v1:172.21.15.59:6789/0 conn(0x7effbc15a400 legacy=0x7effbc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbbfff700 1 -- 172.21.15.33:0/1295557628 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc0ccf00 con 0x7effbc0cd9e0 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc0ba8700 1 --2- 172.21.15.33:0/1295557628 >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 0x7effbc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbbfff700 1 --2- 172.21.15.33:0/1295557628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cd9e0 0x7effbc159ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7effac0099b0 tx=0x7effac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4261e16d46a73b32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbb7fe700 1 -- 172.21.15.33:0/1295557628 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00b7e0 con 0x7effbc0cd9e0 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbb7fe700 1 -- 172.21.15.33:0/1295557628 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00b940 con 0x7effbc0cd9e0 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effbb7fe700 1 -- 172.21.15.33:0/1295557628 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00bce0 con 0x7effbc0cd9e0 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc2e0c700 1 -- 172.21.15.33:0/1295557628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cd9e0 msgr2=0x7effbc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc2e0c700 1 --2- 172.21.15.33:0/1295557628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cd9e0 0x7effbc159ec0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7effac0099b0 tx=0x7effac009250 comp rx=0 tx=0).stop 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc2e0c700 1 -- 172.21.15.33:0/1295557628 shutdown_connections 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.555+0000 7effc2e0c700 1 --2- 172.21.15.33:0/1295557628 >> v2:172.21.15.59:3300/0 conn(0x7effbc0cb5a0 0x7effbc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.556+0000 7effc2e0c700 1 --2- 172.21.15.33:0/1295557628 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cd9e0 0x7effbc159ec0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.556+0000 7effc2e0c700 1 -- 172.21.15.33:0/1295557628 >> 172.21.15.33:0/1295557628 conn(0x7effbc070e30 msgr2=0x7effbc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.556+0000 7effc2e0c700 1 -- 172.21.15.33:0/1295557628 shutdown_connections 2023-10-09T15:36:53.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.556+0000 7effc2e0c700 1 -- 172.21.15.33:0/1295557628 wait complete. 2023-10-09T15:36:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.557+0000 7effc2e0c700 1 Processor -- start 2023-10-09T15:36:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.557+0000 7effc2e0c700 1 -- start start 2023-10-09T15:36:53.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.557+0000 7effc2e0c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 0x7effbc151570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 0x7effbc1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc158ad0 con 0x7effbc0cb5a0 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc157ec0 con 0x7effbc15a400 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc1581a0 con 0x7effbc0cd9e0 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55878/0 (socket says 172.21.15.33:55878) 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 -- 172.21.15.33:0/670634110 learned_addr learned my addr 172.21.15.33:0/670634110 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:53.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effbbfff700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 0x7effbc151570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc13a9700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 0x7effbc1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 -- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 msgr2=0x7effbc151570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 0x7effbc151570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 -- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 msgr2=0x7effbc1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 0x7effbc1530f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 -- 172.21.15.33:0/670634110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac0094f0 con 0x7effbc0cb5a0 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effbbfff700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 0x7effbc151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc13a9700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 0x7effbc1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc0ba8700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7effa400c830 tx=0x7effa4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4011600 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effa4011760 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effbc158480 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effa4011b20 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.558+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc157b50 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.559+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc04c3c0 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.560+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7effa400a3e0 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.560+0000 7effb8ff9700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 0x7eff9c0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.560+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effa4084f90 con 0x7effbc0cb5a0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.560+0000 7effbbfff700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 0x7eff9c0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:53.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.561+0000 7effbbfff700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 0x7eff9c0696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7effac0099b0 tx=0x7effac016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:53.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.564+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effa4051d60 con 0x7effbc0cb5a0 2023-10-09T15:36:53.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.801+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effbc0cd1e0 con 0x7effbc0cb5a0 2023-10-09T15:36:53.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.802+0000 7effb8ff9700 1 -- 172.21.15.33:0/670634110 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7effa4015070 con 0x7effbc0cb5a0 2023-10-09T15:36:53.802 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:36:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 msgr2=0x7eff9c0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 0x7eff9c0696b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7effac0099b0 tx=0x7effac016000 comp rx=0 tx=0).stop 2023-10-09T15:36:53.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 msgr2=0x7effbc157610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7effa400c830 tx=0x7effa4008040 comp rx=0 tx=0).stop 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 shutdown_connections 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff9c067200 0x7eff9c0696b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effbc0cb5a0 0x7effbc157610 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effbc15a400 0x7effbc1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 --2- 172.21.15.33:0/670634110 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effbc0cd9e0 0x7effbc151570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 >> 172.21.15.33:0/670634110 conn(0x7effbc070e30 msgr2=0x7effbc0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 shutdown_connections 2023-10-09T15:36:53.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:53.804+0000 7effc2e0c700 1 -- 172.21.15.33:0/670634110 wait complete. 2023-10-09T15:36:53.816 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:36:53.816 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:36:53.816 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:36:53.816 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:36:53.817 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:53.817 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:36:53.817 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:36:53.817 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:36:53.817 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:53.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:53.817 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:53.833 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42074sec preferred_lft 42074sec 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.834 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:36:53.835 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.836 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:36:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:36:53.836 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:53.836 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:53.836 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:36:53.896 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:36:53.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:53.898 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:36:53.955 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:53.955 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:36:53.956 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:36:53.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:36:53.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:36:53.956 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:36:53.956 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:36:54.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:54.057 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:36:54.072 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:36:54.072 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:36:54.072 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:54.072 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:54.073 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:36:54.137 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:54.137 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:54.191 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:36:54.192 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:54.192 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:54.246 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:36:54.247 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:36:54.247 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:54.328 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:54.338 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:54.338 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:54.339 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:54.339 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:54.339 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:54.339 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:54.339 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:54.360 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:36:54.403 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:36:54.403 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:36:54.404 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:54.404 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:54.404 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:36:54.404 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:36:54.404 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:36:54.405 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:36:54.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:54.405 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:54.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:36:54.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.629+0000 7f0f1d357700 1 Processor -- start 2023-10-09T15:36:54.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.629+0000 7f0f1d357700 1 -- start start 2023-10-09T15:36:54.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f1d357700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f180cb5a0 0x7f0f180cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f1d357700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1815ae40 con 0x7f0f180cd9e0 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f1d357700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f1815ab60 con 0x7f0f1815a5d0 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f1d357700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f180d13f0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f16ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f180cb5a0 0x7f0f180cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f167fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f180cd9e0 0x7f0f18159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50504/0 (socket says 172.21.15.33:50504) 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.630+0000 7f0f167fc700 1 -- 172.21.15.33:0/3491338995 learned_addr learned my addr 172.21.15.33:0/3491338995 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f16ffd700 1 -- 172.21.15.33:0/3491338995 >> v1:172.21.15.59:6789/0 conn(0x7f0f1815a5d0 legacy=0x7f0f18156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f16ffd700 1 -- 172.21.15.33:0/3491338995 >> v1:172.21.15.33:6789/0 conn(0x7f0f180cd9e0 legacy=0x7f0f18159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f16ffd700 1 -- 172.21.15.33:0/3491338995 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f180ccf00 con 0x7f0f180cb5a0 2023-10-09T15:36:54.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f15ffb700 1 -- 172.21.15.33:0/3491338995 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3513215890 0 0) 0x7f0f1815ae40 con 0x7f0f180cd9e0 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f16ffd700 1 --2- 172.21.15.33:0/3491338995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f180cb970 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009e90 tx=0x7f0f08009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711a0e9787017a8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f15ffb700 1 -- 172.21.15.33:0/3491338995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f0800e070 con 0x7f0f180cb5a0 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f15ffb700 1 -- 172.21.15.33:0/3491338995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f0800bbf0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.631+0000 7f0f15ffb700 1 -- 172.21.15.33:0/3491338995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08012430 con 0x7f0f180cb5a0 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 -- 172.21.15.33:0/3491338995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 msgr2=0x7f0f180cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 --2- 172.21.15.33:0/3491338995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f180cb970 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f0f08009e90 tx=0x7f0f08009780 comp rx=0 tx=0).stop 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 -- 172.21.15.33:0/3491338995 shutdown_connections 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 --2- 172.21.15.33:0/3491338995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f180cb970 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 -- 172.21.15.33:0/3491338995 >> 172.21.15.33:0/3491338995 conn(0x7f0f18070e30 msgr2=0x7f0f180d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:54.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 -- 172.21.15.33:0/3491338995 shutdown_connections 2023-10-09T15:36:54.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.632+0000 7f0f1d357700 1 -- 172.21.15.33:0/3491338995 wait complete. 2023-10-09T15:36:54.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.633+0000 7f0f1d357700 1 Processor -- start 2023-10-09T15:36:54.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.633+0000 7f0f1d357700 1 -- start start 2023-10-09T15:36:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f180cd9e0 0x7f0f180c9e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:54.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f1815a5d0 0x7f0f180c7e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181513c0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181521c0 con 0x7f0f1815a5d0 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f181515b0 con 0x7f0f180cd9e0 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55894/0 (socket says 172.21.15.33:55894) 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 -- 172.21.15.33:0/2403835962 learned_addr learned my addr 172.21.15.33:0/2403835962 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:54.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 -- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f180cd9e0 msgr2=0x7f0f180c9e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f180cd9e0 0x7f0f180c9e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 -- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f1815a5d0 msgr2=0x7f0f180c7e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f1815a5d0 0x7f0f180c7e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 -- 172.21.15.33:0/2403835962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f08009a20 con 0x7f0f180cb5a0 2023-10-09T15:36:54.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f16ffd700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0f1806ea60 tx=0x7f0f08019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f08026480 con 0x7f0f180cb5a0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f080265e0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f18151890 con 0x7f0f180cb5a0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f080269a0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.634+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f18151ed0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.635+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f18150050 con 0x7f0f180cb5a0 2023-10-09T15:36:54.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.636+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0f08026d10 con 0x7f0f180cb5a0 2023-10-09T15:36:54.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.636+0000 7f0f0effd700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 0x7f0ef80696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:54.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.636+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f08086af0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.637+0000 7f0f167fc700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 0x7f0ef80696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:54.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.637+0000 7f0f167fc700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 0x7f0ef80696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0f000011e0 tx=0x7f0f000079d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:54.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.641+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f08053900 con 0x7f0f180cb5a0 2023-10-09T15:36:54.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.885+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0f180cd1e0 con 0x7f0f180cb5a0 2023-10-09T15:36:54.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.885+0000 7f0f0effd700 1 -- 172.21.15.33:0/2403835962 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v58) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0f0802b070 con 0x7f0f180cb5a0 2023-10-09T15:36:54.885 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:36:54.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 msgr2=0x7f0ef80696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 0x7f0ef80696b0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f0f000011e0 tx=0x7f0f000079d0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 msgr2=0x7f0f1814fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f0f1806ea60 tx=0x7f0f08019000 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 shutdown_connections 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ef8067200 0x7f0ef80696b0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f180cb5a0 0x7f0f1814fab0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f1815a5d0 0x7f0f180c7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 --2- 172.21.15.33:0/2403835962 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f180cd9e0 0x7f0f180c9e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 >> 172.21.15.33:0/2403835962 conn(0x7f0f18070e30 msgr2=0x7f0f180b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 shutdown_connections 2023-10-09T15:36:54.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:54.887+0000 7f0f1d357700 1 -- 172.21.15.33:0/2403835962 wait complete. 2023-10-09T15:36:54.899 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:36:54.899 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:36:54.899 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:36:54.900 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:54.901 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:54.901 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:54.920 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42081sec preferred_lft 42081sec 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:36:54.921 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:36:54.922 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.923 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:36:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:36:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:36:54.923 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:36:54.923 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:54.923 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:36:54.989 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:36:55.046 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:55.046 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:36:55.107 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:36:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:36:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:36:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:36:55.264 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:36:55.265 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:36:55.265 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:36:55.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:55.336 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:36:55.352 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:36:55.352 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:36:55.352 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:55.352 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:55.352 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:36:55.419 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:55.419 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:55.475 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:36:55.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:36:55.476 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:55.530 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:36:55.530 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:36:55.530 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:55.612 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:55.612 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:55.612 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:55.621 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:55.621 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:55.621 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:55.621 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:55.621 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:55.643 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:36:55.643 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:36:55.644 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:36:55.645 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:36:55.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:55.646 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:55.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:36:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.847+0000 7fe34d584700 1 Processor -- start 2023-10-09T15:36:55.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.847+0000 7fe34d584700 1 -- start start 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.847+0000 7fe34d584700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe348067e50 0x7fe34815de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.847+0000 7fe34d584700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe3480c8c70 0x7fe3480c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe34d584700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe34815d9f0 con 0x7fe348068220 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe34d584700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815d3c0 con 0x7fe348067e50 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe34d584700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe34815a8f0 con 0x7fe3480c8c70 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe348067e50 0x7fe34815de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe348067e50 0x7fe34815de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55904/0 (socket says 172.21.15.33:55904) 2023-10-09T15:36:55.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 -- 172.21.15.33:0/204422039 learned_addr learned my addr 172.21.15.33:0/204422039 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe3477fe700 1 --2- 172.21.15.33:0/204422039 >> v2:172.21.15.59:3300/0 conn(0x7fe3480c8c70 0x7fe3480c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 -- 172.21.15.33:0/204422039 >> v2:172.21.15.59:3300/0 conn(0x7fe3480c8c70 msgr2=0x7fe3480c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 --2- 172.21.15.33:0/204422039 >> v2:172.21.15.59:3300/0 conn(0x7fe3480c8c70 0x7fe3480c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 -- 172.21.15.33:0/204422039 >> v1:172.21.15.59:6789/0 conn(0x7fe348068220 legacy=0x7fe348159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 -- 172.21.15.33:0/204422039 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe34815abd0 con 0x7fe348067e50 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe346ffd700 1 --2- 172.21.15.33:0/204422039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe348067e50 0x7fe34815de80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c1da0 tx=0x7fe338009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8627c5eb2206161 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe345ffb700 1 -- 172.21.15.33:0/204422039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe338009e70 con 0x7fe348067e50 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe345ffb700 1 -- 172.21.15.33:0/204422039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe33800b860 con 0x7fe348067e50 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.848+0000 7fe345ffb700 1 -- 172.21.15.33:0/204422039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe33800bc00 con 0x7fe348067e50 2023-10-09T15:36:55.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 -- 172.21.15.33:0/204422039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe348067e50 msgr2=0x7fe34815de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 --2- 172.21.15.33:0/204422039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe348067e50 0x7fe34815de80 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c1da0 tx=0x7fe338009250 comp rx=0 tx=0).stop 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 -- 172.21.15.33:0/204422039 shutdown_connections 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 --2- 172.21.15.33:0/204422039 >> v2:172.21.15.59:3300/0 conn(0x7fe3480c8c70 0x7fe3480c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 --2- 172.21.15.33:0/204422039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe348067e50 0x7fe34815de80 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 -- 172.21.15.33:0/204422039 >> 172.21.15.33:0/204422039 conn(0x7fe3480ce4a0 msgr2=0x7fe3480ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 -- 172.21.15.33:0/204422039 shutdown_connections 2023-10-09T15:36:55.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.849+0000 7fe34d584700 1 -- 172.21.15.33:0/204422039 wait complete. 2023-10-09T15:36:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.850+0000 7fe34d584700 1 Processor -- start 2023-10-09T15:36:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.850+0000 7fe34d584700 1 -- start start 2023-10-09T15:36:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe348067e50 0x7fe34814ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348068220 0x7fe3480b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe34814bf50 con 0x7fe3480c8c70 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480c31b0 con 0x7fe348068220 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe34d584700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3480b1ba0 con 0x7fe348067e50 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe3477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe3477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55910/0 (socket says 172.21.15.33:55910) 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe3477fe700 1 -- 172.21.15.33:0/137194445 learned_addr learned my addr 172.21.15.33:0/137194445 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe3467fc700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348068220 0x7fe3480b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.851+0000 7fe346ffd700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe348067e50 0x7fe34814ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 -- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe348067e50 msgr2=0x7fe34814ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:55.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe348067e50 0x7fe34814ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 -- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348068220 msgr2=0x7fe3480b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348068220 0x7fe3480b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 -- 172.21.15.33:0/137194445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3380094f0 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe3477fe700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe340009e90 tx=0x7fe34000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe34000cb70 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe34000f040 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3480b1e80 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe340014480 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.852+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3480c2e40 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.853+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3480c3340 con 0x7fe3480c8c70 2023-10-09T15:36:55.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.853+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fe3400147f0 con 0x7fe3480c8c70 2023-10-09T15:36:55.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.854+0000 7fe33effd700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 0x7fe3280696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:55.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.854+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe340085710 con 0x7fe3480c8c70 2023-10-09T15:36:55.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.854+0000 7fe346ffd700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 0x7fe3280696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:55.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.854+0000 7fe346ffd700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 0x7fe3280696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c1da0 tx=0x7fe338017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:55.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:55.858+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe340052560 con 0x7fe3480c8c70 2023-10-09T15:36:56.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.099+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe34804c3c0 con 0x7fe3480c8c70 2023-10-09T15:36:56.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.444+0000 7fe33effd700 1 -- 172.21.15.33:0/137194445 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 136+0+0 (secure 0 0 0) 0x7fe340055b80 con 0x7fe3480c8c70 2023-10-09T15:36:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 msgr2=0x7fe3280696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 0x7fe3280696b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fe3480c1da0 tx=0x7fe338017000 comp rx=0 tx=0).stop 2023-10-09T15:36:56.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 msgr2=0x7fe34806e930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7fe340009e90 tx=0x7fe34000b040 comp rx=0 tx=0).stop 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 shutdown_connections 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe328067200 0x7fe3280696b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3480c8c70 0x7fe34806e930 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe348067e50 0x7fe34814ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 --2- 172.21.15.33:0/137194445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe348068220 0x7fe3480b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 >> 172.21.15.33:0/137194445 conn(0x7fe3480ce4a0 msgr2=0x7fe348157ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 shutdown_connections 2023-10-09T15:36:56.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.446+0000 7fe34d584700 1 -- 172.21.15.33:0/137194445 wait complete. 2023-10-09T15:36:56.459 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:36:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.581+0000 7f12ada8f700 1 Processor -- start 2023-10-09T15:36:56.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.581+0000 7f12ada8f700 1 -- start start 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ada8f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12a8153c30 0x7f12a815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ada8f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a815afd0 con 0x7f12a80cf110 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ada8f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a815b2b0 con 0x7f12a815de50 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ada8f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a815b590 con 0x7f12a8153c30 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12aca8d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12a8153c30 0x7f12a815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ad28e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f12a80cf110 0x7f12a815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50512/0 (socket says 172.21.15.33:50512) 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12aca8d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12a8153c30 0x7f12a815a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55922/0 (socket says 172.21.15.33:55922) 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12ad28e700 1 -- 172.21.15.33:0/109938969 learned_addr learned my addr 172.21.15.33:0/109938969 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:56.583 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12aca8d700 1 -- 172.21.15.33:0/109938969 >> v1:172.21.15.59:6789/0 conn(0x7f12a815de50 legacy=0x7f12a80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12aca8d700 1 -- 172.21.15.33:0/109938969 >> v1:172.21.15.33:6789/0 conn(0x7f12a80cf110 legacy=0x7f12a815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.582+0000 7f12aca8d700 1 -- 172.21.15.33:0/109938969 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a815b870 con 0x7f12a8153c30 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12aca8d700 1 --2- 172.21.15.33:0/109938969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a8153c30 0x7f12a815a5e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f12900098e0 tx=0x7f12900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87c3ea187f7098a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12a77fe700 1 -- 172.21.15.33:0/109938969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1290009e80 con 0x7f12a8153c30 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12a77fe700 1 -- 172.21.15.33:0/109938969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129000b860 con 0x7f12a8153c30 2023-10-09T15:36:56.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12a77fe700 1 -- 172.21.15.33:0/109938969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000bbe0 con 0x7f12a8153c30 2023-10-09T15:36:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 -- 172.21.15.33:0/109938969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a8153c30 msgr2=0x7f12a815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 --2- 172.21.15.33:0/109938969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a8153c30 0x7f12a815a5e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7f12900098e0 tx=0x7f12900091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 -- 172.21.15.33:0/109938969 shutdown_connections 2023-10-09T15:36:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 --2- 172.21.15.33:0/109938969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a8153c30 0x7f12a815a5e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 -- 172.21.15.33:0/109938969 >> 172.21.15.33:0/109938969 conn(0x7f12a80703a0 msgr2=0x7f12a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 -- 172.21.15.33:0/109938969 shutdown_connections 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.583+0000 7f12ada8f700 1 -- 172.21.15.33:0/109938969 wait complete. 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.584+0000 7f12ada8f700 1 Processor -- start 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 -- start start 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12a8153c30 0x7f12a80c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 0x7f12a80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a8169f60 con 0x7f12a80cf110 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80b4110 con 0x7f12a815de50 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12ada8f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a80c91c0 con 0x7f12a8153c30 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12aca8d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:56.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12aca8d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55934/0 (socket says 172.21.15.33:55934) 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.585+0000 7f12aca8d700 1 -- 172.21.15.33:0/2717221542 learned_addr learned my addr 172.21.15.33:0/2717221542 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12ad28e700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 0x7f12a80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12a7fff700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12a8153c30 0x7f12a80c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 -- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12a8153c30 msgr2=0x7f12a80c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12a8153c30 0x7f12a80c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 -- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 msgr2=0x7f12a80cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 0x7f12a80cc4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 -- 172.21.15.33:0/2717221542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1290009420 con 0x7f12a80cf110 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12ad28e700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 0x7f12a80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12aca8d700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f12a806eb00 tx=0x7f1290017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129000bb20 con 0x7f12a80cf110 2023-10-09T15:36:56.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1290025420 con 0x7f12a80cf110 2023-10-09T15:36:56.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a80c94a0 con 0x7f12a80cf110 2023-10-09T15:36:56.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12900257c0 con 0x7f12a80cf110 2023-10-09T15:36:56.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.586+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a80b43f0 con 0x7f12a80cf110 2023-10-09T15:36:56.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.587+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a80c99c0 con 0x7f12a80cf110 2023-10-09T15:36:56.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.588+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f1290023070 con 0x7f12a80cf110 2023-10-09T15:36:56.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.588+0000 7f12a4ff9700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 0x7f12880696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:56.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.588+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1290086160 con 0x7f12a80cf110 2023-10-09T15:36:56.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.588+0000 7f12a7fff700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 0x7f12880696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:56.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.588+0000 7f12a7fff700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 0x7f12880696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f12a80c6560 tx=0x7f1298009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:56.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.592+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12a80c99c0 con 0x7f12a80cf110 2023-10-09T15:36:56.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.816+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f12a80c99c0 con 0x7f1288067200 2023-10-09T15:36:56.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.818+0000 7f12a4ff9700 1 -- 172.21.15.33:0/2717221542 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f12a80c99c0 con 0x7f1288067200 2023-10-09T15:36:56.818 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:36:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:36:56.818 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:56.818 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:36:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 msgr2=0x7f12880696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 0x7f12880696b0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f12a80c6560 tx=0x7f1298009040 comp rx=0 tx=0).stop 2023-10-09T15:36:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 msgr2=0x7f12a80b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f12a806eb00 tx=0x7f1290017000 comp rx=0 tx=0).stop 2023-10-09T15:36:56.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 shutdown_connections 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1288067200 0x7f12880696b0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12a80cf110 0x7f12a80b5a50 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12a815de50 0x7f12a80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 --2- 172.21.15.33:0/2717221542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12a8153c30 0x7f12a80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 >> 172.21.15.33:0/2717221542 conn(0x7f12a80703a0 msgr2=0x7f12a8151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 shutdown_connections 2023-10-09T15:36:56.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.820+0000 7f12ada8f700 1 -- 172.21.15.33:0/2717221542 wait complete. 2023-10-09T15:36:56.832 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:36:56.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.954+0000 7f974fc2e700 1 Processor -- start 2023-10-09T15:36:56.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.954+0000 7f974fc2e700 1 -- start start 2023-10-09T15:36:56.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974fc2e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9748159530 0x7f97480ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974fc2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f9748159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974fc2e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480ccfd0 con 0x7f974806e0e0 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974fc2e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97480cf0e0 con 0x7f9748159530 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974fc2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f974815a3d0 con 0x7f974806dc70 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974d9ca700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9748159530 0x7f97480ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974d9ca700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9748159530 0x7f97480ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55950/0 (socket says 172.21.15.33:55950) 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974d9ca700 1 -- 172.21.15.33:0/3143255961 learned_addr learned my addr 172.21.15.33:0/3143255961 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.955+0000 7f974d1c9700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f9748159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974d9ca700 1 -- 172.21.15.33:0/3143255961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 msgr2=0x7f9748159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974d9ca700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f9748159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974d9ca700 1 -- 172.21.15.33:0/3143255961 >> v1:172.21.15.59:6789/0 conn(0x7f974806e0e0 legacy=0x7f97480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974d9ca700 1 -- 172.21.15.33:0/3143255961 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f974815a6b0 con 0x7f9748159530 2023-10-09T15:36:57.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974d9ca700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480ceba0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f97380099b0 tx=0x7f9738009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24ae6193d657580f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974c9c8700 1 -- 172.21.15.33:0/3143255961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9738009ea0 con 0x7f9748159530 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974c9c8700 1 -- 172.21.15.33:0/3143255961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973800b860 con 0x7f9748159530 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974c9c8700 1 -- 172.21.15.33:0/3143255961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973800bc00 con 0x7f9748159530 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974fc2e700 1 -- 172.21.15.33:0/3143255961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 msgr2=0x7f97480ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.956+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480ceba0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f97380099b0 tx=0x7f9738009250 comp rx=0 tx=0).stop 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 -- 172.21.15.33:0/3143255961 shutdown_connections 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480ceba0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3143255961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f9748159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 -- 172.21.15.33:0/3143255961 >> 172.21.15.33:0/3143255961 conn(0x7f97480703a0 msgr2=0x7f97480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 -- 172.21.15.33:0/3143255961 shutdown_connections 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.957+0000 7f974fc2e700 1 -- 172.21.15.33:0/3143255961 wait complete. 2023-10-09T15:36:57.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.958+0000 7f974fc2e700 1 Processor -- start 2023-10-09T15:36:57.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.958+0000 7f974fc2e700 1 -- start start 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f97480cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974806e0e0 0x7f974816a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480d0670 con 0x7f9748159530 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480d1060 con 0x7f974806e0e0 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480d0d80 con 0x7f974806dc70 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55960/0 (socket says 172.21.15.33:55960) 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 -- 172.21.15.33:0/3629750236 learned_addr learned my addr 172.21.15.33:0/3629750236 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974d1c9700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974806e0e0 0x7f974816a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974d9ca700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f97480cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 -- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 msgr2=0x7f97480cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f97480cf2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 -- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974806e0e0 msgr2=0x7f974816a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974806e0e0 0x7f974816a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 -- 172.21.15.33:0/3629750236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97380094f0 con 0x7f9748159530 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974e1cb700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f974000c910 tx=0x7f97400016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740012630 con 0x7f9748159530 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9740012790 con 0x7f9748159530 2023-10-09T15:36:57.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97480b3520 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.959+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9740012b50 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.960+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97480b3b70 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.961+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f974804c3c0 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.961+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f974001b450 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.961+0000 7f9745ffb700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 0x7f9734069730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.961+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9740084a80 con 0x7f9748159530 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.961+0000 7f974d9ca700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 0x7f9734069730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.962+0000 7f974d9ca700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 0x7f9734069730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97380099b0 tx=0x7f9738017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:56.965+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9740051960 con 0x7f9748159530 2023-10-09T15:36:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.158+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f97480b39c0 con 0x7f9748159530 2023-10-09T15:36:57.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.158+0000 7f9745ffb700 1 -- 172.21.15.33:0/3629750236 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97400160c0 con 0x7f9748159530 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 msgr2=0x7f9734069730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 0x7f9734069730 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f97380099b0 tx=0x7f9738017000 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 msgr2=0x7f97480d0130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f974000c910 tx=0x7f97400016f0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 shutdown_connections 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9734067280 0x7f9734069730 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9748159530 0x7f97480d0130 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f974806dc70 0x7f97480cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 --2- 172.21.15.33:0/3629750236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f974806e0e0 0x7f974816a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 >> 172.21.15.33:0/3629750236 conn(0x7f97480703a0 msgr2=0x7f9748070a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 shutdown_connections 2023-10-09T15:36:57.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.160+0000 7f974fc2e700 1 -- 172.21.15.33:0/3629750236 wait complete. 2023-10-09T15:36:57.172 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs --human_readable 2023-10-09T15:36:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.295+0000 7fef7de30700 1 Processor -- start 2023-10-09T15:36:57.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.295+0000 7fef7de30700 1 -- start start 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef7de30700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef7806dc70 0x7fef78159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef7de30700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fef7806e0e0 0x7fef780cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef7de30700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef780ccfd0 con 0x7fef78159530 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef7de30700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7815a3d0 con 0x7fef7806dc70 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef7de30700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef7815a6b0 con 0x7fef7806e0e0 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef76ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef7806dc70 0x7fef78159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef76ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef7806dc70 0x7fef78159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55972/0 (socket says 172.21.15.33:55972) 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.296+0000 7fef76ffd700 1 -- 172.21.15.33:0/3940027496 learned_addr learned my addr 172.21.15.33:0/3940027496 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef77fff700 1 --2- 172.21.15.33:0/3940027496 >> v2:172.21.15.59:3300/0 conn(0x7fef7806e0e0 0x7fef780cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef76ffd700 1 -- 172.21.15.33:0/3940027496 >> v2:172.21.15.59:3300/0 conn(0x7fef7806e0e0 msgr2=0x7fef780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef76ffd700 1 --2- 172.21.15.33:0/3940027496 >> v2:172.21.15.59:3300/0 conn(0x7fef7806e0e0 0x7fef780cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef76ffd700 1 -- 172.21.15.33:0/3940027496 >> v1:172.21.15.59:6789/0 conn(0x7fef78159530 legacy=0x7fef780ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef76ffd700 1 -- 172.21.15.33:0/3940027496 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7815a990 con 0x7fef7806dc70 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef76ffd700 1 --2- 172.21.15.33:0/3940027496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef78159900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fef780cf2b0 tx=0x7fef6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f6745bc0c90fcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef767fc700 1 -- 172.21.15.33:0/3940027496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00b860 con 0x7fef7806dc70 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef767fc700 1 -- 172.21.15.33:0/3940027496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef6c00b9c0 con 0x7fef7806dc70 2023-10-09T15:36:57.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef767fc700 1 -- 172.21.15.33:0/3940027496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef6c00bd60 con 0x7fef7806dc70 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.297+0000 7fef7de30700 1 -- 172.21.15.33:0/3940027496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 msgr2=0x7fef78159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 --2- 172.21.15.33:0/3940027496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef78159900 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7fef780cf2b0 tx=0x7fef6c009250 comp rx=0 tx=0).stop 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 -- 172.21.15.33:0/3940027496 shutdown_connections 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 --2- 172.21.15.33:0/3940027496 >> v2:172.21.15.59:3300/0 conn(0x7fef7806e0e0 0x7fef780cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 --2- 172.21.15.33:0/3940027496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef78159900 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 -- 172.21.15.33:0/3940027496 >> 172.21.15.33:0/3940027496 conn(0x7fef780703a0 msgr2=0x7fef780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 -- 172.21.15.33:0/3940027496 shutdown_connections 2023-10-09T15:36:57.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.298+0000 7fef7de30700 1 -- 172.21.15.33:0/3940027496 wait complete. 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.299+0000 7fef7de30700 1 Processor -- start 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.299+0000 7fef7de30700 1 -- start start 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7806e0e0 0x7fef780b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef78159530 0x7fef78152be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef7814eb50 con 0x7fef7806dc70 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b3480 con 0x7fef7806e0e0 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef7de30700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef780b3720 con 0x7fef78159530 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55986/0 (socket says 172.21.15.33:55986) 2023-10-09T15:36:57.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 -- 172.21.15.33:0/3232190791 learned_addr learned my addr 172.21.15.33:0/3232190791 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef77fff700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef78159530 0x7fef78152be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef76ffd700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7806e0e0 0x7fef780b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 -- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef78159530 msgr2=0x7fef78152be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef78159530 0x7fef78152be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 -- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7806e0e0 msgr2=0x7fef780b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7806e0e0 0x7fef780b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 -- 172.21.15.33:0/3232190791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef6c0094f0 con 0x7fef7806dc70 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.300+0000 7fef777fe700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c4e0 tx=0x7fef6800c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.301+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68011590 con 0x7fef7806dc70 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.301+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef68011710 con 0x7fef7806dc70 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.301+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef780b3a00 con 0x7fef7806dc70 2023-10-09T15:36:57.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.301+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef68011ad0 con 0x7fef7806dc70 2023-10-09T15:36:57.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.301+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef780b3d90 con 0x7fef7806dc70 2023-10-09T15:36:57.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.302+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef7804c3c0 con 0x7fef7806dc70 2023-10-09T15:36:57.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.302+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fef6801b3b0 con 0x7fef7806dc70 2023-10-09T15:36:57.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.302+0000 7fef5f7fe700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 0x7fef640696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.302+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef68083d10 con 0x7fef7806dc70 2023-10-09T15:36:57.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.302+0000 7fef76ffd700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 0x7fef640696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.303+0000 7fef76ffd700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 0x7fef640696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef780cf2b0 tx=0x7fef6c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.307+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef68050c30 con 0x7fef7806dc70 2023-10-09T15:36:57.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.533+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "human_readable": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fef7815ac70 con 0x7fef64067200 2023-10-09T15:36:57.534 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.535+0000 7f91f73a0700 -1 client.6303 remove_session_caps still has dirty|flushing caps on 0x10000000001.head(faked_ino=0 nref=4 ll_ref=0 cap_refs={} open={} mode=40755 size=0/0 nlink=1 btime=2023-10-09T15:36:31.368657+0000 mtime=2023-10-09T15:36:31.368657+0000 ctime=2023-10-09T15:36:31.375175+0000 change_attr=2 caps=- flushing_caps=Ax COMPLETE parents=0x10000000000.head["group_0000000000409951"] has_dir_layout 0x55c534429600) 2023-10-09T15:36:57.538 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.538+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:57.538 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.538+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:57.538 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.538+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:57.538 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.538+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:57.538 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:36:57.538+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.543+0000 7fef5f7fe700 1 -- 172.21.15.33:0/3232190791 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+468 (secure 0 0 0) 0x7fef7815ac70 con 0x7fef64067200 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout: "mon_addrs": [ 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.33:6789", 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6789", 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6790" 2023-10-09T15:36:57.543 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "pools": { 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "data": [ 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": " 340G", 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_data", 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "used": " 0 " 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": [ 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": " 340G", 2023-10-09T15:36:57.544 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_metadata", 2023-10-09T15:36:57.545 INFO:teuthology.orchestra.run.smithi033.stdout: "used": "64.0k" 2023-10-09T15:36:57.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:57.545 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:36:57.545 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:36:57.545 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 msgr2=0x7fef640696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 0x7fef640696b0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fef780cf2b0 tx=0x7fef6c017000 comp rx=0 tx=0).stop 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 msgr2=0x7fef7814e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7fef6800c4e0 tx=0x7fef6800c7f0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 shutdown_connections 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067200 0x7fef640696b0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef7806dc70 0x7fef7814e610 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef78159530 0x7fef78152be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 --2- 172.21.15.33:0/3232190791 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef7806e0e0 0x7fef780b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 >> 172.21.15.33:0/3232190791 conn(0x7fef780703a0 msgr2=0x7fef780d0300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 shutdown_connections 2023-10-09T15:36:57.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.545+0000 7fef7de30700 1 -- 172.21.15.33:0/3232190791 wait complete. 2023-10-09T15:36:57.557 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:36:57.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:57.596 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:36:57.639 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:36:57.639 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:36:57.639 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:57.640 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:36:57.681 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:36:57.681 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:57.681 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:36:57.737 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:36:57.737 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:36:57.737 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:36:57.784 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:36:57.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:36:57.785 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:36:57.802 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:36:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.921+0000 7f99beb71700 1 Processor -- start 2023-10-09T15:36:57.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.921+0000 7f99beb71700 1 -- start start 2023-10-09T15:36:57.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99beb71700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99b80b07d0 0x7f99b80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99beb71700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f99b80cf200 0x7f99b80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99beb71700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b815a280 con 0x7f99b80b0ba0 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99beb71700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b806e180 con 0x7f99b80cf200 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99beb71700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80cd540 con 0x7f99b80b07d0 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f99b80cf200 0x7f99b80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99b7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f99b80cf200 0x7f99b80cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:55994/0 (socket says 172.21.15.33:55994) 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99b7fff700 1 -- 172.21.15.33:0/1236619936 learned_addr learned my addr 172.21.15.33:0/1236619936 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99bc90d700 1 --2- 172.21.15.33:0/1236619936 >> v2:172.21.15.59:3300/0 conn(0x7f99b80b07d0 0x7f99b80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.922+0000 7f99b7fff700 1 -- 172.21.15.33:0/1236619936 >> v2:172.21.15.59:3300/0 conn(0x7f99b80b07d0 msgr2=0x7f99b80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:57.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1236619936 >> v2:172.21.15.59:3300/0 conn(0x7f99b80b07d0 0x7f99b80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b7fff700 1 -- 172.21.15.33:0/1236619936 >> v1:172.21.15.59:6789/0 conn(0x7f99b80b0ba0 legacy=0x7f99b806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b7fff700 1 -- 172.21.15.33:0/1236619936 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b806d850 con 0x7f99b80cf200 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1236619936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80cf200 0x7f99b80cd000 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f99b8064720 tx=0x7f99ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d8207751167a863 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b77fe700 1 -- 172.21.15.33:0/1236619936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00b8f0 con 0x7f99b80cf200 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b77fe700 1 -- 172.21.15.33:0/1236619936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99ac00ba50 con 0x7f99b80cf200 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99b77fe700 1 -- 172.21.15.33:0/1236619936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99ac00bdf0 con 0x7f99b80cf200 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 -- 172.21.15.33:0/1236619936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80cf200 msgr2=0x7f99b80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 --2- 172.21.15.33:0/1236619936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80cf200 0x7f99b80cd000 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f99b8064720 tx=0x7f99ac009250 comp rx=0 tx=0).stop 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 -- 172.21.15.33:0/1236619936 shutdown_connections 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 --2- 172.21.15.33:0/1236619936 >> v2:172.21.15.59:3300/0 conn(0x7f99b80b07d0 0x7f99b80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 --2- 172.21.15.33:0/1236619936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80cf200 0x7f99b80cd000 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 -- 172.21.15.33:0/1236619936 >> 172.21.15.33:0/1236619936 conn(0x7f99b806ce80 msgr2=0x7f99b80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.923+0000 7f99beb71700 1 -- 172.21.15.33:0/1236619936 shutdown_connections 2023-10-09T15:36:57.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.924+0000 7f99beb71700 1 -- 172.21.15.33:0/1236619936 wait complete. 2023-10-09T15:36:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.925+0000 7f99beb71700 1 Processor -- start 2023-10-09T15:36:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.925+0000 7f99beb71700 1 -- start start 2023-10-09T15:36:57.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 0x7f99b8157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99b80cf200 0x7f99b80b32e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b809bfc0 con 0x7f99b80b07d0 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815aaa0 con 0x7f99b80b0ba0 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99beb71700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815ad80 con 0x7f99b80cf200 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56006/0 (socket says 172.21.15.33:56006) 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 -- 172.21.15.33:0/1279055995 learned_addr learned my addr 172.21.15.33:0/1279055995 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 0x7f99b8157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bd10e700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99b80cf200 0x7f99b80b32e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 -- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99b80cf200 msgr2=0x7f99b80b32e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99b80cf200 0x7f99b80b32e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 -- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 msgr2=0x7f99b8157160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 0x7f99b8157160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 -- 172.21.15.33:0/1279055995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99ac0094f0 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 0x7f99b8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99bc90d700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d890 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.926+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8018070 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.927+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99a8005a00 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.927+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b815b060 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.927+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99a8005dc0 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.927+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b809b060 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.927+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b815dae0 con 0x7f99b80b07d0 2023-10-09T15:36:57.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.928+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f99a800b8a0 con 0x7f99b80b07d0 2023-10-09T15:36:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.928+0000 7f99b4ff9700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 0x7f99a40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.928+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f99a8084c00 con 0x7f99b80b07d0 2023-10-09T15:36:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.928+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 0x7f99a40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:57.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.929+0000 7f99b7fff700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 0x7f99a40696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f99b8064720 tx=0x7f99ac017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:57.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:57.933+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f99a8051b20 con 0x7f99b80b07d0 2023-10-09T15:36:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.168+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b815b670 con 0x7f99b80b07d0 2023-10-09T15:36:58.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.169+0000 7f99b4ff9700 1 -- 172.21.15.33:0/1279055995 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f99a8055140 con 0x7f99b80b07d0 2023-10-09T15:36:58.169 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:58.169 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 msgr2=0x7f99a40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 0x7f99a40696b0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f99b8064720 tx=0x7f99ac017000 comp rx=0 tx=0).stop 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 msgr2=0x7f99b815a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f99a800d890 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 shutdown_connections 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f99a4067200 0x7f99a40696b0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99b80b07d0 0x7f99b815a410 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99b80cf200 0x7f99b80b32e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 --2- 172.21.15.33:0/1279055995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f99b80b0ba0 0x7f99b8157160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 >> 172.21.15.33:0/1279055995 conn(0x7f99b806ce80 msgr2=0x7f99b80680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:58.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 shutdown_connections 2023-10-09T15:36:58.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.171+0000 7f99beb71700 1 -- 172.21.15.33:0/1279055995 wait complete. 2023-10-09T15:36:58.238 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 59 2023-10-09T15:36:58.238 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:36:58.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.359+0000 7f5ae739e700 1 Processor -- start 2023-10-09T15:36:58.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.359+0000 7f5ae739e700 1 -- start start 2023-10-09T15:36:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae739e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ae01565d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae739e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ae006ab20 0x7f5ae00af000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae739e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ae00af540 con 0x7f5ae00ad330 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae739e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ae0070a60 con 0x7f5ae006ab20 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae739e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00ae540 con 0x7f5ae0156200 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae5b9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5ae00ad330 0x7f5ae006a410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50520/0 (socket says 172.21.15.33:50520) 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae5b9b700 1 -- 172.21.15.33:0/2372781562 learned_addr learned my addr 172.21.15.33:0/2372781562 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae639c700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ae01565d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae6b9d700 1 --2- 172.21.15.33:0/2372781562 >> v2:172.21.15.59:3300/0 conn(0x7f5ae006ab20 0x7f5ae00af000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 48267848 0 0) 0x7f5ad4001110 con 0x7f5ae00ad330 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ac8003570 con 0x7f5ae00ad330 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 492569913 0 0) 0x7f5ac8003570 con 0x7f5ae00ad330 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 msgr2=0x7f5ae01565d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:58.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ae01565d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 >> v2:172.21.15.59:3300/0 conn(0x7f5ae006ab20 msgr2=0x7f5ae00af000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 --2- 172.21.15.33:0/2372781562 >> v2:172.21.15.59:3300/0 conn(0x7f5ae006ab20 0x7f5ae00af000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae00ad930 con 0x7f5ae00ad330 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5ad4001600 con 0x7f5ae00ad330 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 >> v1:172.21.15.33:6789/0 conn(0x7f5ae00ad330 legacy=0x7f5ae006a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac8003a60 0x7f5ac8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ac8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac8004d50 0x7f5ac80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0070a60 con 0x7f5ac8003a60 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.360+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae00ae540 con 0x7f5ac8004d50 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ac800ba60 con 0x7f5ae0156200 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae6b9d700 1 --2- 172.21.15.33:0/2372781562 >> v2:172.21.15.59:3300/0 conn(0x7f5ae006ab20 0x7f5ae00af000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac8003a60 0x7f5ac8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae5b9b700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ac8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae6b9d700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac8004d50 0x7f5ac80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 -- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 msgr2=0x7f5ac8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ae0156200 0x7f5ac8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 -- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac8004d50 msgr2=0x7f5ac80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ac8004d50 0x7f5ac80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 -- 172.21.15.33:0/2372781562 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ac8003570 con 0x7f5ac8003a60 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae639c700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac8003a60 0x7f5ac8003e70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e210 tx=0x7f5ad000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af2988d7630a95a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ea60 con 0x7f5ac8003a60 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad000f040 con 0x7f5ac8003a60 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.361+0000 7f5ae539a700 1 -- 172.21.15.33:0/2372781562 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad000ee10 con 0x7f5ac8003a60 2023-10-09T15:36:58.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 -- 172.21.15.33:0/2372781562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac8003a60 msgr2=0x7f5ac8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 --2- 172.21.15.33:0/2372781562 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ac8003a60 0x7f5ac8003e70 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000e210 tx=0x7f5ad000b040 comp rx=0 tx=0).stop 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae6b9d700 1 -- 172.21.15.33:0/2372781562 reap_dead start 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 -- 172.21.15.33:0/2372781562 shutdown_connections 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 -- 172.21.15.33:0/2372781562 >> 172.21.15.33:0/2372781562 conn(0x7f5ae00cca00 msgr2=0x7f5ae00cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 -- 172.21.15.33:0/2372781562 shutdown_connections 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.362+0000 7f5ae739e700 1 -- 172.21.15.33:0/2372781562 wait complete. 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.363+0000 7f5ae739e700 1 Processor -- start 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.363+0000 7f5ae739e700 1 -- start start 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac8003a60 0x7f5ae0150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae00c5d00 0x7f5ae00c6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0169fc0 con 0x7f5ae01565d0 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0158870 con 0x7f5ae00c5d00 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ae0156f80 con 0x7f5ac8003a60 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56024/0 (socket says 172.21.15.33:56024) 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 -- 172.21.15.33:0/830277830 learned_addr learned my addr 172.21.15.33:0/830277830 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae6b9d700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae00c5d00 0x7f5ae00c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae639c700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac8003a60 0x7f5ae0150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 -- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac8003a60 msgr2=0x7f5ae0150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac8003a60 0x7f5ae0150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 -- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae00c5d00 msgr2=0x7f5ae00c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae00c5d00 0x7f5ae00c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 -- 172.21.15.33:0/830277830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae0151180 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae5b9b700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007390 tx=0x7f5ae00ae680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad4018030 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad4007800 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad400fb20 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ae00c6690 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.364+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ae0157490 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.365+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ae004c3c0 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.366+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f5ad401b070 con 0x7f5ae01565d0 2023-10-09T15:36:58.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.366+0000 7f5ade7fc700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 0x7f5acc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.366+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5ad4019070 con 0x7f5ae01565d0 2023-10-09T15:36:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.366+0000 7f5ae639c700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 0x7f5acc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.367+0000 7f5ae639c700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 0x7f5acc0696b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000afd0 tx=0x7f5ad001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:58.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.370+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ad4051660 con 0x7f5ae01565d0 2023-10-09T15:36:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.567+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5ae00af540 con 0x7f5ae01565d0 2023-10-09T15:36:58.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.568+0000 7f5ade7fc700 1 -- 172.21.15.33:0/830277830 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f5ae00af540 con 0x7f5ae01565d0 2023-10-09T15:36:58.817 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:36:58.817 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:48.395316+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:36:58.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 msgr2=0x7f5acc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 0x7f5acc0696b0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f5ad000afd0 tx=0x7f5ad001a000 comp rx=0 tx=0).stop 2023-10-09T15:36:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 msgr2=0x7f5ae0156a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f5ad4007390 tx=0x7f5ae00ae680 comp rx=0 tx=0).stop 2023-10-09T15:36:58.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 shutdown_connections 2023-10-09T15:36:58.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5acc067200 0x7f5acc0696b0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5ae00c5d00 0x7f5ae00c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ac8003a60 0x7f5ae0150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 --2- 172.21.15.33:0/830277830 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ae01565d0 0x7f5ae0156a40 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 >> 172.21.15.33:0/830277830 conn(0x7f5ae00cca00 msgr2=0x7f5ae00cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 shutdown_connections 2023-10-09T15:36:58.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.571+0000 7f5ae739e700 1 -- 172.21.15.33:0/830277830 wait complete. 2023-10-09T15:36:58.865 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:36:45.214941+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '88', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:36:45.767560+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '89', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:36:58.865 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:36:58.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.989+0000 7fcb7c6fc700 1 Processor -- start 2023-10-09T15:36:58.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.989+0000 7fcb7c6fc700 1 -- start start 2023-10-09T15:36:58.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.990+0000 7fcb7c6fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.990+0000 7fcb7c6fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.990+0000 7fcb7c6fc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb740ccfd0 con 0x7fcb74159530 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.990+0000 7fcb7c6fc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb7415a3d0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.990+0000 7fcb7c6fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7415a6b0 con 0x7fcb7406dc70 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb7ac99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb7ac99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:43570/0 (socket says 172.21.15.33:43570) 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:55556/0 (socket says 172.21.15.33:55556) 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb7ac99700 1 -- 172.21.15.33:0/3346028738 learned_addr learned my addr 172.21.15.33:0/3346028738 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb7a498700 1 --1- 172.21.15.33:0/3346028738 >> v1:172.21.15.59:6789/0 conn(0x7fcb74159530 0x7fcb740ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:44612/0 (socket says 172.21.15.33:44612) 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 -- 172.21.15.33:0/3346028738 >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 msgr2=0x7fcb740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:58.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 --2- 172.21.15.33:0/3346028738 >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 -- 172.21.15.33:0/3346028738 >> v1:172.21.15.59:6789/0 conn(0x7fcb74159530 legacy=0x7fcb740ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 -- 172.21.15.33:0/3346028738 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7415a990 con 0x7fcb7406dc70 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb7ac99700 1 --2- 172.21.15.33:0/3346028738 >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79c97700 1 --2- 172.21.15.33:0/3346028738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb680098e0 tx=0x7fcb680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b0a13b89101512f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79496700 1 -- 172.21.15.33:0/3346028738 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800b640 con 0x7fcb7406dc70 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79496700 1 -- 172.21.15.33:0/3346028738 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800b7a0 con 0x7fcb7406dc70 2023-10-09T15:36:58.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.991+0000 7fcb79496700 1 -- 172.21.15.33:0/3346028738 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800bb40 con 0x7fcb7406dc70 2023-10-09T15:36:58.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/3346028738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 msgr2=0x7fcb74159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/3346028738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fcb680098e0 tx=0x7fcb680091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/3346028738 shutdown_connections 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/3346028738 >> v2:172.21.15.59:3300/0 conn(0x7fcb7406e0e0 0x7fcb740cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/3346028738 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb7406dc70 0x7fcb74159900 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/3346028738 >> 172.21.15.33:0/3346028738 conn(0x7fcb740703a0 msgr2=0x7fcb740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/3346028738 shutdown_connections 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.992+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/3346028738 wait complete. 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.993+0000 7fcb7c6fc700 1 Processor -- start 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.993+0000 7fcb7c6fc700 1 -- start start 2023-10-09T15:36:58.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb7406dc70 0x7fcb740b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb74159530 0x7fcb740d0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7416d5f0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7415f0f0 con 0x7fcb7406dc70 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7c6fc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7416d840 con 0x7fcb74159530 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56028/0 (socket says 172.21.15.33:56028) 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 -- 172.21.15.33:0/823591028 learned_addr learned my addr 172.21.15.33:0/823591028 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7a498700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb7406dc70 0x7fcb740b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb7ac99700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb74159530 0x7fcb740d0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 -- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb74159530 msgr2=0x7fcb740d0850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb74159530 0x7fcb740d0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 -- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb7406dc70 msgr2=0x7fcb740b5e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb7406dc70 0x7fcb740b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.994+0000 7fcb79c97700 1 -- 172.21.15.33:0/823591028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb64009ae0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb79c97700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcb7415a7f0 tx=0x7fcb68017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6801bda0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb68011420 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb68009420 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb680117e0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.995+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb7416de00 con 0x7fcb7406e0e0 2023-10-09T15:36:58.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.996+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb7416dff0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.996+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7fcb68011b50 con 0x7fcb7406e0e0 2023-10-09T15:36:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.996+0000 7fcb727fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 0x7fcb600696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.997+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb680860c0 con 0x7fcb7406e0e0 2023-10-09T15:36:58.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.997+0000 7fcb7a498700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 0x7fcb600696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:58.997+0000 7fcb7a498700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 0x7fcb600696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0016e0 tx=0x7fcb6c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.001+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb68052fe0 con 0x7fcb7406e0e0 2023-10-09T15:36:59.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.194+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcb7404c3c0 con 0x7fcb7406e0e0 2023-10-09T15:36:59.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.195+0000 7fcb727fc700 1 -- 172.21.15.33:0/823591028 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcb68056600 con 0x7fcb7406e0e0 2023-10-09T15:36:59.195 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 msgr2=0x7fcb600696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 0x7fcb600696b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0016e0 tx=0x7fcb6c009040 comp rx=0 tx=0).stop 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 msgr2=0x7fcb7414dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fcb7415a7f0 tx=0x7fcb68017000 comp rx=0 tx=0).stop 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 shutdown_connections 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb60067200 0x7fcb600696b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb74159530 0x7fcb740d0850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb7406dc70 0x7fcb740b5e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 --2- 172.21.15.33:0/823591028 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb7406e0e0 0x7fcb7414dd80 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 >> 172.21.15.33:0/823591028 conn(0x7fcb740703a0 msgr2=0x7fcb740c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 shutdown_connections 2023-10-09T15:36:59.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.197+0000 7fcb7c6fc700 1 -- 172.21.15.33:0/823591028 wait complete. 2023-10-09T15:36:59.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:36:59.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.332+0000 7f99805ed700 1 Processor -- start 2023-10-09T15:36:59.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.332+0000 7f99805ed700 1 -- start start 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f99805ed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f99780cc320 0x7f997813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f99805ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f99780cc6f0 0x7f997813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f99805ed700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997806d7b0 con 0x7f9978069a00 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f99805ed700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997806a570 con 0x7f99780cc320 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f99805ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f997806f7d0 con 0x7f99780cc6f0 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f997e389700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f99780cc320 0x7f997813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.333+0000 7f997eb8a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9978069a00 0x7f9978069e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50522/0 (socket says 172.21.15.33:50522) 2023-10-09T15:36:59.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997eb8a700 1 -- 172.21.15.33:0/1579111255 learned_addr learned my addr 172.21.15.33:0/1579111255 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997db88700 1 --2- 172.21.15.33:0/1579111255 >> v2:172.21.15.59:3300/0 conn(0x7f99780cc6f0 0x7f997813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997e389700 1 -- 172.21.15.33:0/1579111255 >> v2:172.21.15.59:3300/0 conn(0x7f99780cc6f0 msgr2=0x7f997813c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997e389700 1 --2- 172.21.15.33:0/1579111255 >> v2:172.21.15.59:3300/0 conn(0x7f99780cc6f0 0x7f997813c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997d387700 1 -- 172.21.15.33:0/1579111255 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3982808903 0 0) 0x7f997806d7b0 con 0x7f9978069a00 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997e389700 1 -- 172.21.15.33:0/1579111255 >> v1:172.21.15.33:6789/0 conn(0x7f9978069a00 legacy=0x7f9978069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997e389700 1 -- 172.21.15.33:0/1579111255 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997806e330 con 0x7f99780cc320 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997e389700 1 --2- 172.21.15.33:0/1579111255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813c2a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f99780647f0 tx=0x7f9968009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f06ceb173bf0279 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997d387700 1 -- 172.21.15.33:0/1579111255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996800e070 con 0x7f99780cc320 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997d387700 1 -- 172.21.15.33:0/1579111255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800bbf0 con 0x7f99780cc320 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.334+0000 7f997d387700 1 -- 172.21.15.33:0/1579111255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9968012430 con 0x7f99780cc320 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 -- 172.21.15.33:0/1579111255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 msgr2=0x7f997813c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 --2- 172.21.15.33:0/1579111255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813c2a0 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f99780647f0 tx=0x7f9968009780 comp rx=0 tx=0).stop 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 -- 172.21.15.33:0/1579111255 shutdown_connections 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 --2- 172.21.15.33:0/1579111255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813c2a0 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 --2- 172.21.15.33:0/1579111255 >> v2:172.21.15.59:3300/0 conn(0x7f99780cc6f0 0x7f997813c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 -- 172.21.15.33:0/1579111255 >> 172.21.15.33:0/1579111255 conn(0x7f9978067f00 msgr2=0x7f9978068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 -- 172.21.15.33:0/1579111255 shutdown_connections 2023-10-09T15:36:59.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.335+0000 7f99805ed700 1 -- 172.21.15.33:0/1579111255 wait complete. 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.336+0000 7f99805ed700 1 Processor -- start 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.336+0000 7f99805ed700 1 -- start start 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 0x7f9978169170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99780cc6f0 0x7f99780cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780adcc0 con 0x7f99780cc320 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99780ae840 con 0x7f9978069a00 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99805ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997813a1b0 con 0x7f99780cc6f0 2023-10-09T15:36:59.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56052/0 (socket says 172.21.15.33:56052) 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 -- 172.21.15.33:0/2228237125 learned_addr learned my addr 172.21.15.33:0/2228237125 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997e389700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 0x7f9978169170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997eb8a700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99780cc6f0 0x7f99780cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 -- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99780cc6f0 msgr2=0x7f99780cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99780cc6f0 0x7f99780cab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 -- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 msgr2=0x7f9978169170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 0x7f9978169170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 -- 172.21.15.33:0/2228237125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009a20 con 0x7f99780cc320 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997e389700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 0x7f9978169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f997db88700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c880 tx=0x7f996c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.337+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c011600 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.338+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996c011780 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.338+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99780adf10 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.338+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f996c011b40 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.338+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99780ae4d0 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.338+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99780ae9b0 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.339+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f996c018360 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.339+0000 7f99767fc700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 0x7f99640696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.339+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f996c084810 con 0x7f99780cc320 2023-10-09T15:36:59.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.340+0000 7f997e389700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 0x7f99640696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.340+0000 7f997e389700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 0x7f99640696b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9968009de0 tx=0x7f9968019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.344+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f996c051620 con 0x7f99780cc320 2023-10-09T15:36:59.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.539+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f997804c3c0 con 0x7f99780cc320 2023-10-09T15:36:59.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.540+0000 7f99767fc700 1 -- 172.21.15.33:0/2228237125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) v1 ==== 104+0+11 (secure 0 0 0) 0x7f996c0150a0 con 0x7f99780cc320 2023-10-09T15:36:59.540 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:36:59.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 msgr2=0x7f99640696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 0x7f99640696b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f9968009de0 tx=0x7f9968019000 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 msgr2=0x7f997813ae70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f996c00c880 tx=0x7f996c008040 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 shutdown_connections 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9964067200 0x7f99640696b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f99780cc6f0 0x7f99780cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9978069a00 0x7f9978169170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 --2- 172.21.15.33:0/2228237125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f99780cc320 0x7f997813ae70 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 >> 172.21.15.33:0/2228237125 conn(0x7f9978067f00 msgr2=0x7f997813c070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 shutdown_connections 2023-10-09T15:36:59.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.542+0000 7f99805ed700 1 -- 172.21.15.33:0/2228237125 wait complete. 2023-10-09T15:36:59.554 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:36:59.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.676+0000 7f0c0ea60700 1 Processor -- start 2023-10-09T15:36:59.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.676+0000 7f0c0ea60700 1 -- start start 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ea60700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0c0806db20 0x7f0c0815a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ea60700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0815ada0 con 0x7f0c080caec0 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ea60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c0806ca80 con 0x7f0c08153c90 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ea60700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c0806cd60 con 0x7f0c0806db20 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0e25f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0c080caec0 0x7f0c0815afb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:50538/0 (socket says 172.21.15.33:50538) 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0e25f700 1 -- 172.21.15.33:0/831866716 learned_addr learned my addr 172.21.15.33:0/831866716 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/831866716 >> v2:172.21.15.59:3300/0 conn(0x7f0c0806db20 0x7f0c0815a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1554280563 0 0) 0x7f0bf8001110 con 0x7f0c080caec0 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.677+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf0003570 con 0x7f0c080caec0 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802587286 0 0) 0x7f0c0806ca80 con 0x7f0c08153c90 2023-10-09T15:36:59.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0bf8001110 con 0x7f0c08153c90 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1163668728 0 0) 0x7f0bf0003570 con 0x7f0c080caec0 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 >> v2:172.21.15.59:3300/0 conn(0x7f0c0806db20 msgr2=0x7f0c0815a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 --2- 172.21.15.33:0/831866716 >> v2:172.21.15.59:3300/0 conn(0x7f0c0806db20 0x7f0c0815a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 >> v1:172.21.15.59:6789/0 conn(0x7f0c08153c90 legacy=0x7f0c080ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c0806d040 con 0x7f0c080caec0 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0bf8001580 con 0x7f0c080caec0 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 >> v1:172.21.15.33:6789/0 conn(0x7f0c080caec0 legacy=0x7f0c0815afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf0003c40 0x7f0bf0004030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 0x7f0bf0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0005210 0x7f0bf000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c0806cd60 con 0x7f0bf0004810 2023-10-09T15:36:59.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf000c130 con 0x7f0bf0003c40 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bf000c2c0 con 0x7f0bf0005210 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 0x7f0bf0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0da5e700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf0003c40 0x7f0bf0004030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0e25f700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0005210 0x7f0bf000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 -- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0005210 msgr2=0x7f0bf000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0005210 0x7f0bf000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 -- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf0003c40 msgr2=0x7f0bf0004030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bf0003c40 0x7f0bf0004030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 -- 172.21.15.33:0/831866716 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bf0003570 con 0x7f0bf0004810 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0e25f700 1 -- 172.21.15.33:0/831866716 reap_dead start 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.678+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 0x7f0bf0004c80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f0c08069eb0 tx=0x7f0bfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ce7e5e805b0998d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00e710 con 0x7f0bf0004810 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc00e870 con 0x7f0bf0004810 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ca5c700 1 -- 172.21.15.33:0/831866716 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc00ec30 con 0x7f0bf0004810 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 -- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 msgr2=0x7f0bf0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 0x7f0bf0004c80 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f0c08069eb0 tx=0x7f0bfc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 -- 172.21.15.33:0/831866716 shutdown_connections 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/831866716 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bf0004810 0x7f0bf0004c80 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 -- 172.21.15.33:0/831866716 >> 172.21.15.33:0/831866716 conn(0x7f0c0806e720 msgr2=0x7f0c0806eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 -- 172.21.15.33:0/831866716 shutdown_connections 2023-10-09T15:36:59.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.679+0000 7f0c0ea60700 1 -- 172.21.15.33:0/831866716 wait complete. 2023-10-09T15:36:59.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.680+0000 7f0c0ea60700 1 Processor -- start 2023-10-09T15:36:59.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.680+0000 7f0c0ea60700 1 -- start start 2023-10-09T15:36:59.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0004810 0x7f0c08146520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c080b1e50 0x7f0c080c4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c08146a60 con 0x7f0c080c23f0 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080b0db0 con 0x7f0c080b1e50 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0ea60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c080b1090 con 0x7f0bf0004810 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56070/0 (socket says 172.21.15.33:56070) 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 -- 172.21.15.33:0/977735483 learned_addr learned my addr 172.21.15.33:0/977735483 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0e25f700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c080b1e50 0x7f0c080c4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 -- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0004810 msgr2=0x7f0c08146520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0004810 0x7f0c08146520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 -- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c080b1e50 msgr2=0x7f0c080c4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c080b1e50 0x7f0c080c4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.681+0000 7f0c0d25d700 1 -- 172.21.15.33:0/977735483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c080b1370 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c0d25d700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00057b0 tx=0x7f0bfc01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc022070 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bfc000d10 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c080b1650 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bfc0276c0 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.682+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c080b0aa0 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.683+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c0804c3c0 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.683+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0bfc01c450 con 0x7f0c080c23f0 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.684+0000 7f0c05ffb700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 0x7f0bf40696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:36:59.687 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.684+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bfc0864b0 con 0x7f0c080c23f0 2023-10-09T15:36:59.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.684+0000 7f0c0da5e700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 0x7f0bf40696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:36:59.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.684+0000 7f0c0da5e700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 0x7f0bf40696b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c00002f30 tx=0x7f0c000017a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:36:59.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.688+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bfc053410 con 0x7f0c080c23f0 2023-10-09T15:36:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.880+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0c08159bc0 con 0x7f0c080c23f0 2023-10-09T15:36:59.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.881+0000 7f0c05ffb700 1 -- 172.21.15.33:0/977735483 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0bfc00ebf0 con 0x7f0c080c23f0 2023-10-09T15:36:59.881 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 msgr2=0x7f0bf40696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 0x7f0bf40696b0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0c00002f30 tx=0x7f0c000017a0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 msgr2=0x7f0c080b0560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f0bf00057b0 tx=0x7f0bfc01a000 comp rx=0 tx=0).stop 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 shutdown_connections 2023-10-09T15:36:59.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bf4067200 0x7f0bf40696b0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0c080b1e50 0x7f0c080c4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bf0004810 0x7f0c08146520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 --2- 172.21.15.33:0/977735483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0c080c23f0 0x7f0c080b0560 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 >> 172.21.15.33:0/977735483 conn(0x7f0c0806e720 msgr2=0x7f0c08152830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 shutdown_connections 2023-10-09T15:36:59.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:36:59.883+0000 7f0c0ea60700 1 -- 172.21.15.33:0/977735483 wait complete. 2023-10-09T15:36:59.895 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.014+0000 7f0be0d09700 1 Processor -- start 2023-10-09T15:37:00.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.014+0000 7f0be0d09700 1 -- start start 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0be0d09700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0be0d09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc15a5d0 0x7f0bdc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0be0d09700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bdc15ae40 con 0x7f0bdc0cd9e0 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0be0d09700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bdc0d13f0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0be0d09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc15ab60 con 0x7f0bdc15a5d0 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bda59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bda59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56086/0 (socket says 172.21.15.33:56086) 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bda59c700 1 -- 172.21.15.33:0/1431659927 learned_addr learned my addr 172.21.15.33:0/1431659927 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bdad9d700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc15a5d0 0x7f0bdc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bda59c700 1 -- 172.21.15.33:0/1431659927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc15a5d0 msgr2=0x7f0bdc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:00.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.015+0000 7f0bda59c700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc15a5d0 0x7f0bdc156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bda59c700 1 -- 172.21.15.33:0/1431659927 >> v1:172.21.15.59:6789/0 conn(0x7f0bdc0cd9e0 legacy=0x7f0bdc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bda59c700 1 -- 172.21.15.33:0/1431659927 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bdc0ccf00 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bda59c700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40099e0 tx=0x7f0bd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e4586a834023b72 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bd959a700 1 -- 172.21.15.33:0/1431659927 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400b7e0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bd959a700 1 -- 172.21.15.33:0/1431659927 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd400b940 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0bd959a700 1 -- 172.21.15.33:0/1431659927 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd400bce0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 -- 172.21.15.33:0/1431659927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 msgr2=0x7f0bdc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0bd40099e0 tx=0x7f0bd4009250 comp rx=0 tx=0).stop 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 -- 172.21.15.33:0/1431659927 shutdown_connections 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc15a5d0 0x7f0bdc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 --2- 172.21.15.33:0/1431659927 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0cb970 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.016+0000 7f0be0d09700 1 -- 172.21.15.33:0/1431659927 >> 172.21.15.33:0/1431659927 conn(0x7f0bdc070e30 msgr2=0x7f0bdc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.017+0000 7f0be0d09700 1 -- 172.21.15.33:0/1431659927 shutdown_connections 2023-10-09T15:37:00.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.017+0000 7f0be0d09700 1 -- 172.21.15.33:0/1431659927 wait complete. 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 Processor -- start 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 -- start start 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc0cd9e0 0x7f0bdc150d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15a5d0 0x7f0bdc159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc158ec0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc0b50d0 con 0x7f0bdc15a5d0 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.018+0000 7f0be0d09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bdc158870 con 0x7f0bdc0cd9e0 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56100/0 (socket says 172.21.15.33:56100) 2023-10-09T15:37:00.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 -- 172.21.15.33:0/317262339 learned_addr learned my addr 172.21.15.33:0/317262339 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bd9d9b700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc0cd9e0 0x7f0bdc150d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bdad9d700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15a5d0 0x7f0bdc159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 -- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc0cd9e0 msgr2=0x7f0bdc150d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc0cd9e0 0x7f0bdc150d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 -- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15a5d0 msgr2=0x7f0bdc159350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15a5d0 0x7f0bdc159350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 -- 172.21.15.33:0/317262339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bd40094f0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bda59c700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc06ea60 tx=0x7f0bd4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd4011c70 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bd4020070 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bd401b450 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.022 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bdc158b50 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.019+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bdc151290 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.020+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bdc1586d0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.021+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f0bd4022030 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.021+0000 7f0bd27fc700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 0x7f0bbc0696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.021+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0bd4086830 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.021+0000 7f0bd9d9b700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 0x7f0bbc0696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.022+0000 7f0bd9d9b700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 0x7f0bbc0696b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc1519c0 tx=0x7f0bc4007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.026+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0bdc1586d0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.265+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0bdc1586d0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.266+0000 7f0bd27fc700 1 -- 172.21.15.33:0/317262339 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f0bdc1586d0 con 0x7f0bdc0cb5a0 2023-10-09T15:37:00.266 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:00.266 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:37:00.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 msgr2=0x7f0bbc0696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 0x7f0bbc0696b0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc1519c0 tx=0x7f0bc4007ea0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 msgr2=0x7f0bdc0b47d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0bdc06ea60 tx=0x7f0bd4016000 comp rx=0 tx=0).stop 2023-10-09T15:37:00.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 shutdown_connections 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0bbc067200 0x7f0bbc0696b0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0bdc0cb5a0 0x7f0bdc0b47d0 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0bdc15a5d0 0x7f0bdc159350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 --2- 172.21.15.33:0/317262339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0bdc0cd9e0 0x7f0bdc150d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 >> 172.21.15.33:0/317262339 conn(0x7f0bdc070e30 msgr2=0x7f0bdc1553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 shutdown_connections 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.268+0000 7f0be0d09700 1 -- 172.21.15.33:0/317262339 wait complete. 2023-10-09T15:37:00.269 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 59 2023-10-09T15:37:00.280 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.399+0000 7f16caf44700 1 Processor -- start 2023-10-09T15:37:00.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.399+0000 7f16caf44700 1 -- start start 2023-10-09T15:37:00.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16caf44700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f16c40cb970 0x7f16c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16caf44700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16c415a400 0x7f16c4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16caf44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f16c415ae40 con 0x7f16c40cb5a0 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16caf44700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40ce0f0 con 0x7f16c415a400 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16caf44700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f16c40d13f0 con 0x7f16c40cb970 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16c94e1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16c415a400 0x7f16c4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16c94e1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f16c415a400 0x7f16c4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56112/0 (socket says 172.21.15.33:56112) 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16c94e1700 1 -- 172.21.15.33:0/2787836263 learned_addr learned my addr 172.21.15.33:0/2787836263 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.400+0000 7f16c3fff700 1 --2- 172.21.15.33:0/2787836263 >> v2:172.21.15.59:3300/0 conn(0x7f16c40cb970 0x7f16c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c94e1700 1 -- 172.21.15.33:0/2787836263 >> v2:172.21.15.59:3300/0 conn(0x7f16c40cb970 msgr2=0x7f16c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c94e1700 1 --2- 172.21.15.33:0/2787836263 >> v2:172.21.15.59:3300/0 conn(0x7f16c40cb970 0x7f16c4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c94e1700 1 -- 172.21.15.33:0/2787836263 >> v1:172.21.15.59:6789/0 conn(0x7f16c40cb5a0 legacy=0x7f16c40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c94e1700 1 -- 172.21.15.33:0/2787836263 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16c415ab60 con 0x7f16c415a400 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c94e1700 1 --2- 172.21.15.33:0/2787836263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c4156e90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f16c40d1780 tx=0x7f16b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=892b6b305e6925c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c37fe700 1 -- 172.21.15.33:0/2787836263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400b820 con 0x7f16c415a400 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c37fe700 1 -- 172.21.15.33:0/2787836263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b400b980 con 0x7f16c415a400 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16c37fe700 1 -- 172.21.15.33:0/2787836263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400bd20 con 0x7f16c415a400 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 -- 172.21.15.33:0/2787836263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 msgr2=0x7f16c4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 --2- 172.21.15.33:0/2787836263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c4156e90 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f16c40d1780 tx=0x7f16b4009250 comp rx=0 tx=0).stop 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 -- 172.21.15.33:0/2787836263 shutdown_connections 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 --2- 172.21.15.33:0/2787836263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c4156e90 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 --2- 172.21.15.33:0/2787836263 >> v2:172.21.15.59:3300/0 conn(0x7f16c40cb970 0x7f16c4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 -- 172.21.15.33:0/2787836263 >> 172.21.15.33:0/2787836263 conn(0x7f16c4070e30 msgr2=0x7f16c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.401+0000 7f16caf44700 1 -- 172.21.15.33:0/2787836263 shutdown_connections 2023-10-09T15:37:00.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.402+0000 7f16caf44700 1 -- 172.21.15.33:0/2787836263 wait complete. 2023-10-09T15:37:00.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 Processor -- start 2023-10-09T15:37:00.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 -- start start 2023-10-09T15:37:00.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c40cb5a0 0x7f16c40ca2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c40cb970 0x7f16c40c8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40c9e20 con 0x7f16c415a400 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40b6480 con 0x7f16c40cb970 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.403+0000 7f16caf44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f16c40c9210 con 0x7f16c40cb5a0 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:56122/0 (socket says 172.21.15.33:56122) 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 -- 172.21.15.33:0/852620925 learned_addr learned my addr 172.21.15.33:0/852620925 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c8ce0700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c40cb5a0 0x7f16c40ca2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c3fff700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c40cb970 0x7f16c40c8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 -- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c40cb5a0 msgr2=0x7f16c40ca2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c40cb5a0 0x7f16c40ca2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 -- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c40cb970 msgr2=0x7f16c40c8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c40cb970 0x7f16c40c8b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 -- 172.21.15.33:0/852620925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f16b40094f0 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c94e1700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009290 tx=0x7f16b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b400bed0 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f16b4020070 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f16c40c94f0 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f16b401b6c0 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.404+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f16c40c9ab0 con 0x7f16c415a400 2023-10-09T15:37:00.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.405+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f16c40c9f90 con 0x7f16c415a400 2023-10-09T15:37:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.406+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 10) v1 ==== 84995+0+0 (secure 0 0 0) 0x7f16b4022030 con 0x7f16c415a400 2023-10-09T15:37:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.406+0000 7f16c0ff9700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 0x7f16b00696b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.407+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f16b40868e0 con 0x7f16c415a400 2023-10-09T15:37:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.407+0000 7f16c8ce0700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 0x7f16b00696b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.407+0000 7f16c8ce0700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 0x7f16b00696b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16bc007fd0 tx=0x7f16bc0026a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.411+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f16b4053800 con 0x7f16c415a400 2023-10-09T15:37:00.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.469+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f16b4053bd0 con 0x7f16c415a400 2023-10-09T15:37:00.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.606+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f16c404c3c0 con 0x7f16c415a400 2023-10-09T15:37:00.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.607+0000 7f16c0ff9700 1 -- 172.21.15.33:0/852620925 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f16b4057290 con 0x7f16c415a400 2023-10-09T15:37:00.607 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:00.607 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:48.395316+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 msgr2=0x7f16b00696b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 0x7f16b00696b0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f16bc007fd0 tx=0x7f16bc0026a0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 msgr2=0x7f16c41513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f16b4009290 tx=0x7f16b4016000 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 shutdown_connections 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f16b0067200 0x7f16b00696b0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f16c415a400 0x7f16c41513e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f16c40cb5a0 0x7f16c40ca2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 --2- 172.21.15.33:0/852620925 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f16c40cb970 0x7f16c40c8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 >> 172.21.15.33:0/852620925 conn(0x7f16c4070e30 msgr2=0x7f16c4155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.609+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 shutdown_connections 2023-10-09T15:37:00.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.610+0000 7f16caf44700 1 -- 172.21.15.33:0/852620925 wait complete. 2023-10-09T15:37:00.621 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:37:00.622 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:00.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 Processor -- start 2023-10-09T15:37:00.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 -- start start 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff040b07d0 0x7eff040ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff040cf200 0x7eff040cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0415a280 con 0x7eff040b0ba0 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0406e180 con 0x7eff040cf200 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.741+0000 7eff09d24700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff040cd540 con 0x7eff040b07d0 2023-10-09T15:37:00.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff040cf200 0x7eff040cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff03fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7eff040b0ba0 0x7eff0406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58064/0 (socket says 172.21.15.33:58064) 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff03fff700 1 -- 172.21.15.33:0/719834778 learned_addr learned my addr 172.21.15.33:0/719834778 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 -- 172.21.15.33:0/719834778 >> v2:172.21.15.59:3300/0 conn(0x7eff040b07d0 msgr2=0x7eff040ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 --2- 172.21.15.33:0/719834778 >> v2:172.21.15.59:3300/0 conn(0x7eff040b07d0 0x7eff040ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 -- 172.21.15.33:0/719834778 >> v1:172.21.15.33:6789/0 conn(0x7eff040b0ba0 legacy=0x7eff0406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 -- 172.21.15.33:0/719834778 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0406d850 con 0x7eff040cf200 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff027fc700 1 -- 172.21.15.33:0/719834778 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4070561378 0 0) 0x7eff0415a280 con 0x7eff040b0ba0 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff02ffd700 1 --2- 172.21.15.33:0/719834778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff040cd000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7eff04064720 tx=0x7efef80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bfaef53bf01eb1b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff027fc700 1 -- 172.21.15.33:0/719834778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800b740 con 0x7eff040cf200 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff027fc700 1 -- 172.21.15.33:0/719834778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efef800b8a0 con 0x7eff040cf200 2023-10-09T15:37:00.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.742+0000 7eff027fc700 1 -- 172.21.15.33:0/719834778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efef800bc40 con 0x7eff040cf200 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 -- 172.21.15.33:0/719834778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 msgr2=0x7eff040cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 --2- 172.21.15.33:0/719834778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff040cd000 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7eff04064720 tx=0x7efef80091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 -- 172.21.15.33:0/719834778 shutdown_connections 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 --2- 172.21.15.33:0/719834778 >> v2:172.21.15.59:3300/0 conn(0x7eff040b07d0 0x7eff040ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 --2- 172.21.15.33:0/719834778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff040cd000 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 -- 172.21.15.33:0/719834778 >> 172.21.15.33:0/719834778 conn(0x7eff0406ce80 msgr2=0x7eff040ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 -- 172.21.15.33:0/719834778 shutdown_connections 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.743+0000 7eff09d24700 1 -- 172.21.15.33:0/719834778 wait complete. 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.744+0000 7eff09d24700 1 Processor -- start 2023-10-09T15:37:00.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.744+0000 7eff09d24700 1 -- start start 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff040b07d0 0x7eff04156ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff040b0ba0 0x7eff041473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff04147930 con 0x7eff040cf200 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff040c6070 con 0x7eff040b07d0 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff09d24700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff040682c0 con 0x7eff040b0ba0 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43904/0 (socket says 172.21.15.33:43904) 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 -- 172.21.15.33:0/1009232317 learned_addr learned my addr 172.21.15.33:0/1009232317 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff037fe700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff040b07d0 0x7eff04156ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff02ffd700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff040b0ba0 0x7eff041473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 -- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff040b0ba0 msgr2=0x7eff041473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff040b0ba0 0x7eff041473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 -- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff040b07d0 msgr2=0x7eff04156ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff040b07d0 0x7eff04156ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 -- 172.21.15.33:0/1009232317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efef8009420 con 0x7eff040cf200 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7eff03fff700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efefc00ccc0 tx=0x7efefc001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.745+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00a860 con 0x7eff040cf200 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.746+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efefc00a9c0 con 0x7eff040cf200 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.746+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0409b510 con 0x7eff040cf200 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.746+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efefc00ad80 con 0x7eff040cf200 2023-10-09T15:37:00.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.746+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0409ba70 con 0x7eff040cf200 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.746+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff04068430 con 0x7eff040cf200 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.747+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7efefc007300 con 0x7eff040cf200 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.747+0000 7efeeb7fe700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 0x7efef0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.748+0000 7eff037fe700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 0x7efef0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.748+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7efefc084f50 con 0x7eff040cf200 2023-10-09T15:37:00.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.748+0000 7eff037fe700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 0x7efef0069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efef4009bd0 tx=0x7efef40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:00.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.752+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efefc051c20 con 0x7eff040cf200 2023-10-09T15:37:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.991+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7eff0404c3c0 con 0x7eff040cf200 2023-10-09T15:37:00.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.992+0000 7efeeb7fe700 1 -- 172.21.15.33:0/1009232317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7efefc055240 con 0x7eff040cf200 2023-10-09T15:37:00.992 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:00.992 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.993+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 msgr2=0x7efef0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.993+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 0x7efef0069740 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7efef4009bd0 tx=0x7efef40091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.993+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 msgr2=0x7eff0409afd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.993+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7efefc00ccc0 tx=0x7efefc001a20 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 shutdown_connections 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efef0067290 0x7efef0069740 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff040cf200 0x7eff0409afd0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff040b07d0 0x7eff04156ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 --2- 172.21.15.33:0/1009232317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff040b0ba0 0x7eff041473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 >> 172.21.15.33:0/1009232317 conn(0x7eff0406ce80 msgr2=0x7eff04158e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 shutdown_connections 2023-10-09T15:37:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:00.994+0000 7eff09d24700 1 -- 172.21.15.33:0/1009232317 wait complete. 2023-10-09T15:37:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 59 2023-10-09T15:37:01.006 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.124+0000 7f060fa51700 1 Processor -- start 2023-10-09T15:37:01.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.125+0000 7f060fa51700 1 -- start start 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.125+0000 7f060fa51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f06080cb5a0 0x7f06080cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.125+0000 7f060fa51700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f060815a5d0 0x7f0608156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060fa51700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f060815ae40 con 0x7f06080cd9e0 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060fa51700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06080d13f0 con 0x7f060815a5d0 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060fa51700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f060815ab60 con 0x7f06080cb5a0 2023-10-09T15:37:01.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f060815a5d0 0x7f0608156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060cfec700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06080cd9e0 0x7f0608159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58070/0 (socket says 172.21.15.33:58070) 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060cfec700 1 -- 172.21.15.33:0/1194427259 learned_addr learned my addr 172.21.15.33:0/1194427259 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060d7ed700 1 --2- 172.21.15.33:0/1194427259 >> v2:172.21.15.59:3300/0 conn(0x7f06080cb5a0 0x7f06080cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 -- 172.21.15.33:0/1194427259 >> v2:172.21.15.59:3300/0 conn(0x7f06080cb5a0 msgr2=0x7f06080cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 --2- 172.21.15.33:0/1194427259 >> v2:172.21.15.59:3300/0 conn(0x7f06080cb5a0 0x7f06080cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 -- 172.21.15.33:0/1194427259 >> v1:172.21.15.33:6789/0 conn(0x7f06080cd9e0 legacy=0x7f0608159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 -- 172.21.15.33:0/1194427259 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06080ccf00 con 0x7f060815a5d0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f0607fff700 1 -- 172.21.15.33:0/1194427259 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3165057289 0 0) 0x7f060815ae40 con 0x7f06080cd9e0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f060dfee700 1 --2- 172.21.15.33:0/1194427259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f060815a5d0 0x7f0608156e90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f05f80098e0 tx=0x7f05f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=877fea259fccb2a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f0607fff700 1 -- 172.21.15.33:0/1194427259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f8009e80 con 0x7f060815a5d0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f0607fff700 1 -- 172.21.15.33:0/1194427259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05f800b820 con 0x7f060815a5d0 2023-10-09T15:37:01.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.126+0000 7f0607fff700 1 -- 172.21.15.33:0/1194427259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05f800bba0 con 0x7f060815a5d0 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 -- 172.21.15.33:0/1194427259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f060815a5d0 msgr2=0x7f0608156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 --2- 172.21.15.33:0/1194427259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f060815a5d0 0x7f0608156e90 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f05f80098e0 tx=0x7f05f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 -- 172.21.15.33:0/1194427259 shutdown_connections 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 --2- 172.21.15.33:0/1194427259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f060815a5d0 0x7f0608156e90 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 --2- 172.21.15.33:0/1194427259 >> v2:172.21.15.59:3300/0 conn(0x7f06080cb5a0 0x7f06080cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 -- 172.21.15.33:0/1194427259 >> 172.21.15.33:0/1194427259 conn(0x7f0608070e30 msgr2=0x7f06080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 -- 172.21.15.33:0/1194427259 shutdown_connections 2023-10-09T15:37:01.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.127+0000 7f060fa51700 1 -- 172.21.15.33:0/1194427259 wait complete. 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.128+0000 7f060fa51700 1 Processor -- start 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.128+0000 7f060fa51700 1 -- start start 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 0x7f0608159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f060815a5d0 0x7f0608169730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080b6500 con 0x7f06080cb5a0 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06080c9140 con 0x7f06080cd9e0 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060fa51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06080c9990 con 0x7f060815a5d0 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43922/0 (socket says 172.21.15.33:43922) 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 -- 172.21.15.33:0/3454032964 learned_addr learned my addr 172.21.15.33:0/3454032964 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060dfee700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f060815a5d0 0x7f0608169730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060cfec700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 0x7f0608159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 -- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f060815a5d0 msgr2=0x7f0608169730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f060815a5d0 0x7f0608169730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 -- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 msgr2=0x7f0608159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 0x7f0608159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060d7ed700 1 -- 172.21.15.33:0/3454032964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05f8009420 con 0x7f06080cb5a0 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.129+0000 7f060cfec700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 0x7f0608159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f060d7ed700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f060000e190 tx=0x7f0600009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f060000ee30 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0600014420 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06080b6220 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06000147e0 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.130+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06080c93f0 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.131+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06080c9c70 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.131+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f0600014b90 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.131+0000 7f06057fa700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 0x7f05f4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.132+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06000852c0 con 0x7f06080cb5a0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.132+0000 7f060cfec700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 0x7f05f4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.132+0000 7f060cfec700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 0x7f05f4069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f05fc007fd0 tx=0x7f05fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.136+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0600052120 con 0x7f06080cb5a0 2023-10-09T15:37:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.373+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f06080b5f70 con 0x7f06080cb5a0 2023-10-09T15:37:01.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.374+0000 7f06057fa700 1 -- 172.21.15.33:0/3454032964 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+4596 (secure 0 0 0) 0x7f0600009a60 con 0x7f06080cb5a0 2023-10-09T15:37:01.374 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:01.374 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":59,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53}],"filesystems":[{"mdsmap":{"epoch":58,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:36:46.799528+0000","modified":"2023-10-09T15:36:50.417201+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6456},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6456":{"gid":6456,"name":"c","rank":0,"incarnation":54,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/503031600","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":503031600},{"type":"v1","addr":"172.21.15.33:6837","nonce":503031600}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":7}]} 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.375+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 msgr2=0x7f05f4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.375+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 0x7f05f4069740 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f05fc007fd0 tx=0x7f05fc009040 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.375+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 msgr2=0x7f0608156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.375+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f060000e190 tx=0x7f0600009920 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 shutdown_connections 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f05f4067290 0x7f05f4069740 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06080cb5a0 0x7f0608156c60 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f060815a5d0 0x7f0608169730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 --2- 172.21.15.33:0/3454032964 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06080cd9e0 0x7f0608159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 >> 172.21.15.33:0/3454032964 conn(0x7f0608070e30 msgr2=0x7f06080cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:01.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 shutdown_connections 2023-10-09T15:37:01.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.376+0000 7f060fa51700 1 -- 172.21.15.33:0/3454032964 wait complete. 2023-10-09T15:37:01.377 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 59 2023-10-09T15:37:01.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:01.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.508+0000 7f507ca5a700 1 Processor -- start 2023-10-09T15:37:01.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.508+0000 7f507ca5a700 1 -- start start 2023-10-09T15:37:01.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507ca5a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5078159850 0x7f50780adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507ca5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f50780ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507ca5a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50780adb20 con 0x7f5078159c20 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507ca5a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50780ccdc0 con 0x7f5078159850 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507ca5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50780acf10 con 0x7f50780b1040 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f5075d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5078159c20 0x7f50780b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58080/0 (socket says 172.21.15.33:58080) 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f5075d9b700 1 -- 172.21.15.33:0/781268115 learned_addr learned my addr 172.21.15.33:0/781268115 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507659c700 1 --2- 172.21.15.33:0/781268115 >> v2:172.21.15.59:3300/0 conn(0x7f5078159850 0x7f50780adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3174545150 0 0) 0x7f50780adb20 con 0x7f5078159c20 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f5076d9d700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f50780ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5064003570 con 0x7f5078159c20 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3616811908 0 0) 0x7f5064003570 con 0x7f5078159c20 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 msgr2=0x7f50780ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:01.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f50780ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 >> v2:172.21.15.59:3300/0 conn(0x7f5078159850 msgr2=0x7f50780adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 --2- 172.21.15.33:0/781268115 >> v2:172.21.15.59:3300/0 conn(0x7f5078159850 0x7f50780adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50780ad1f0 con 0x7f5078159c20 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5060001470 con 0x7f5078159c20 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.509+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 >> v1:172.21.15.33:6789/0 conn(0x7f5078159c20 legacy=0x7f50780b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f5064003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064003fe0 0x7f5064004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5064004d50 0x7f50640051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780ccdc0 con 0x7f5064004d50 2023-10-09T15:37:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50780acf10 con 0x7f5064003fe0 2023-10-09T15:37:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f506400ba90 con 0x7f50780b1040 2023-10-09T15:37:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5064004d50 0x7f50640051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5075d9b700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064003fe0 0x7f5064004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507659c700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f5064003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 -- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 msgr2=0x7f5064003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f50780b1040 0x7f5064003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 -- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064003fe0 msgr2=0x7f5064004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064003fe0 0x7f5064004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 -- 172.21.15.33:0/781268115 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064003570 con 0x7f5064004d50 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f5076d9d700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5064004d50 0x7f50640051c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5078069a10 tx=0x7f50680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d185911b69e06bdb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800e680 con 0x7f5064004d50 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800e7e0 con 0x7f5064004d50 2023-10-09T15:37:01.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.510+0000 7f507559a700 1 -- 172.21.15.33:0/781268115 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800eba0 con 0x7f5064004d50 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 -- 172.21.15.33:0/781268115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5064004d50 msgr2=0x7f50640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 --2- 172.21.15.33:0/781268115 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5064004d50 0x7f50640051c0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5078069a10 tx=0x7f50680091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f5076d9d700 1 -- 172.21.15.33:0/781268115 reap_dead start 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 -- 172.21.15.33:0/781268115 shutdown_connections 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 -- 172.21.15.33:0/781268115 >> 172.21.15.33:0/781268115 conn(0x7f507806d170 msgr2=0x7f50780cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 -- 172.21.15.33:0/781268115 shutdown_connections 2023-10-09T15:37:01.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.511+0000 7f507ca5a700 1 -- 172.21.15.33:0/781268115 wait complete. 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.512+0000 7f507ca5a700 1 Processor -- start 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.512+0000 7f507ca5a700 1 -- start start 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 0x7f50781500b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5078151420 0x7f5078151890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507814d700 con 0x7f5078153410 2023-10-09T15:37:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5078166670 con 0x7f5064004d50 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507ca5a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50781505f0 con 0x7f5078151420 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43940/0 (socket says 172.21.15.33:43940) 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 -- 172.21.15.33:0/2623471989 learned_addr learned my addr 172.21.15.33:0/2623471989 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5075d9b700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5078151420 0x7f5078151890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 -- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5078151420 msgr2=0x7f5078151890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5078151420 0x7f5078151890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 -- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 msgr2=0x7f50781500b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507659c700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 0x7f50781500b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 0x7f50781500b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 -- 172.21.15.33:0/2623471989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5078151dd0 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f507659c700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 0x7f50781500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.513+0000 7f5076d9d700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f50780aedc0 tx=0x7f506801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5068023070 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f506800eb60 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50780c9a30 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f506800e680 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50781543e0 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.514+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50780c9bc0 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.515+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5068026070 con 0x7f5078153410 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.515+0000 7f506e7fc700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 0x7f5058069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.515+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5068085a90 con 0x7f5078153410 2023-10-09T15:37:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.515+0000 7f507659c700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 0x7f5058069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.516+0000 7f507659c700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 0x7f5058069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5070009fd0 tx=0x7f507000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.520+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f50680528f0 con 0x7f5078153410 2023-10-09T15:37:01.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.713+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f507804c3c0 con 0x7f5078153410 2023-10-09T15:37:01.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.714+0000 7f506e7fc700 1 -- 172.21.15.33:0/2623471989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) v1 ==== 74+0+15305 (secure 0 0 0) 0x7f5068017090 con 0x7f5078153410 2023-10-09T15:37:01.714 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:01.714 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":89,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:36:48.395316+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:36:45.214941+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"88","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-10-09T15:36:45.767560+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"89","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 msgr2=0x7f5058069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 0x7f5058069740 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f5070009fd0 tx=0x7f507000b040 comp rx=0 tx=0).stop 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 msgr2=0x7f50781538b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f50780aedc0 tx=0x7f506801a000 comp rx=0 tx=0).stop 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 shutdown_connections 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5058067290 0x7f5058069740 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5078153410 0x7f50781538b0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5064004d50 0x7f50781500b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 --2- 172.21.15.33:0/2623471989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5078151420 0x7f5078151890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 >> 172.21.15.33:0/2623471989 conn(0x7f507806d170 msgr2=0x7f5078158a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 shutdown_connections 2023-10-09T15:37:01.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.716+0000 7f507ca5a700 1 -- 172.21.15.33:0/2623471989 wait complete. 2023-10-09T15:37:01.729 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:37:01.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.848+0000 7f0633df3700 1 Processor -- start 2023-10-09T15:37:01.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.849+0000 7f0633df3700 1 -- start start 2023-10-09T15:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.849+0000 7f0633df3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f062c15a5d0 0x7f062c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.849+0000 7f0633df3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c15ae40 con 0x7f062c0cb970 2023-10-09T15:37:01.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.849+0000 7f0633df3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f062c15ab60 con 0x7f062c0cb5a0 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.849+0000 7f0633df3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f062c0ce0f0 con 0x7f062c15a5d0 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f063138e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f062c0cb970 0x7f062c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58086/0 (socket says 172.21.15.33:58086) 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f063138e700 1 -- 172.21.15.33:0/3351850053 learned_addr learned my addr 172.21.15.33:0/3351850053 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0632390700 1 --2- 172.21.15.33:0/3351850053 >> v2:172.21.15.59:3300/0 conn(0x7f062c15a5d0 0x7f062c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0630b8d700 1 -- 172.21.15.33:0/3351850053 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1030861531 0 0) 0x7f062c15ae40 con 0x7f062c0cb970 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0630b8d700 1 -- 172.21.15.33:0/3351850053 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0614003570 con 0x7f062c0cb970 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0632390700 1 -- 172.21.15.33:0/3351850053 >> v1:172.21.15.59:6789/0 conn(0x7f062c0cb5a0 legacy=0x7f062c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0632390700 1 -- 172.21.15.33:0/3351850053 >> v1:172.21.15.33:6789/0 conn(0x7f062c0cb970 legacy=0x7f062c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0632390700 1 -- 172.21.15.33:0/3351850053 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f062c0ccf00 con 0x7f062c15a5d0 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0632390700 1 --2- 172.21.15.33:0/3351850053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c15a5d0 0x7f062c156e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f061c009e60 tx=0x7f061c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3d2ebb9d9984d7bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0630b8d700 1 -- 172.21.15.33:0/3351850053 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c00e070 con 0x7f062c15a5d0 2023-10-09T15:37:01.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0630b8d700 1 -- 172.21.15.33:0/3351850053 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c00bb60 con 0x7f062c15a5d0 2023-10-09T15:37:01.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.850+0000 7f0630b8d700 1 -- 172.21.15.33:0/3351850053 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c012430 con 0x7f062c15a5d0 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 -- 172.21.15.33:0/3351850053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c15a5d0 msgr2=0x7f062c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 --2- 172.21.15.33:0/3351850053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c15a5d0 0x7f062c156e90 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f061c009e60 tx=0x7f061c009780 comp rx=0 tx=0).stop 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 -- 172.21.15.33:0/3351850053 shutdown_connections 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 --2- 172.21.15.33:0/3351850053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c15a5d0 0x7f062c156e90 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 -- 172.21.15.33:0/3351850053 >> 172.21.15.33:0/3351850053 conn(0x7f062c070e30 msgr2=0x7f062c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:01.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 -- 172.21.15.33:0/3351850053 shutdown_connections 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.851+0000 7f0633df3700 1 -- 172.21.15.33:0/3351850053 wait complete. 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.852+0000 7f0633df3700 1 Processor -- start 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.852+0000 7f0633df3700 1 -- start start 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0cb5a0 0x7f062c149160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 0x7f062c0b1c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c156d70 con 0x7f062c15a5d0 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0b3e80 con 0x7f062c0cb970 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0633df3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f062c0c9f60 con 0x7f062c0cb5a0 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43956/0 (socket says 172.21.15.33:43956) 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 -- 172.21.15.33:0/3726514535 learned_addr learned my addr 172.21.15.33:0/3726514535 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f063138e700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 0x7f062c0b1c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 -- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0cb5a0 msgr2=0x7f062c149160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0631b8f700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0cb5a0 0x7f062c149160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0cb5a0 0x7f062c149160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 -- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 msgr2=0x7f062c0b1c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 0x7f062c0b1c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 -- 172.21.15.33:0/3726514535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f061c009a20 con 0x7f062c15a5d0 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f063138e700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 0x7f062c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.853+0000 7f0632390700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f062c06ea60 tx=0x7f061c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.854+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c012e00 con 0x7f062c15a5d0 2023-10-09T15:37:01.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.854+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f061c01d630 con 0x7f062c15a5d0 2023-10-09T15:37:01.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.854+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f062c0b3550 con 0x7f062c15a5d0 2023-10-09T15:37:01.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.854+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f061c01d9f0 con 0x7f062c15a5d0 2023-10-09T15:37:01.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.854+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f062c0b3b10 con 0x7f062c15a5d0 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.855+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f062c04c3c0 con 0x7f062c15a5d0 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.855+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f061c024070 con 0x7f062c15a5d0 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.855+0000 7f0629ffb700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 0x7f0618069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.856+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f061c087370 con 0x7f062c15a5d0 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.856+0000 7f0631b8f700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 0x7f0618069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:01.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.856+0000 7f0631b8f700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 0x7f0618069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0624001760 tx=0x7f0624009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:01.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:01.860+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f061c054190 con 0x7f062c15a5d0 2023-10-09T15:37:02.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.097+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f062c0af260 con 0x7f062c15a5d0 2023-10-09T15:37:02.097 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:37:02.098+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:37:02.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.102+0000 7f0629ffb700 1 -- 172.21.15.33:0/3726514535 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v60) v1 ==== 161+0+0 (secure 0 0 0) 0x7f061c0577b0 con 0x7f062c15a5d0 2023-10-09T15:37:02.102 INFO:tasks.ceph.mds.c.smithi033.stderr: -809> 2023-10-09T15:36:53.258+0000 7f85b6e3d700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 msgr2=0x7f0618069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 0x7f0618069740 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f0624001760 tx=0x7f0624009040 comp rx=0 tx=0).stop 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 msgr2=0x7f062c0b2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f062c06ea60 tx=0x7f061c019000 comp rx=0 tx=0).stop 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 shutdown_connections 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0618067290 0x7f0618069740 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f062c15a5d0 0x7f062c0b2170 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f062c0cb5a0 0x7f062c149160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 --2- 172.21.15.33:0/3726514535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f062c0cb970 0x7f062c0b1c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.104+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 >> 172.21.15.33:0/3726514535 conn(0x7f062c070e30 msgr2=0x7f062c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:02.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.105+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 shutdown_connections 2023-10-09T15:37:02.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.105+0000 7f0633df3700 1 -- 172.21.15.33:0/3726514535 wait complete. 2023-10-09T15:37:02.106 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:37:02.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:37:02.123 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:37:02.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.241+0000 7f8d77c8e700 1 Processor -- start 2023-10-09T15:37:02.241 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.242+0000 7f8d77c8e700 1 -- start start 2023-10-09T15:37:02.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.242+0000 7f8d77c8e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8d701598c0 0x7f8d700c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.242+0000 7f8d77c8e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700c9310 con 0x7f8d700cdb70 2023-10-09T15:37:02.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.242+0000 7f8d77c8e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d700ce090 con 0x7f8d70159c90 2023-10-09T15:37:02.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.242+0000 7f8d77c8e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d700ad990 con 0x7f8d701598c0 2023-10-09T15:37:02.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d7622b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8d700cdb70 0x7f8d700c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58098/0 (socket says 172.21.15.33:58098) 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d7622b700 1 -- 172.21.15.33:0/604995527 learned_addr learned my addr 172.21.15.33:0/604995527 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d75a2a700 1 --2- 172.21.15.33:0/604995527 >> v2:172.21.15.59:3300/0 conn(0x7f8d701598c0 0x7f8d700c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1916464201 0 0) 0x7f8d700c9310 con 0x7f8d700cdb70 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8d58003570 con 0x7f8d700cdb70 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1390868893 0 0) 0x7f8d58003570 con 0x7f8d700cdb70 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 >> v2:172.21.15.59:3300/0 conn(0x7f8d701598c0 msgr2=0x7f8d700c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 --2- 172.21.15.33:0/604995527 >> v2:172.21.15.59:3300/0 conn(0x7f8d701598c0 0x7f8d700c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 >> v1:172.21.15.59:6789/0 conn(0x7f8d70159c90 legacy=0x7f8d700cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700c8cc0 con 0x7f8d700cdb70 2023-10-09T15:37:02.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8d600017f0 con 0x7f8d700cdb70 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 >> v1:172.21.15.33:6789/0 conn(0x7f8d700cdb70 legacy=0x7f8d700c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d58003a60 0x7f8d58003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58004810 0x7f8d58004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 0x7f8d5800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700ad990 con 0x7f8d580051c0 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5800c0d0 con 0x7f8d58004810 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d5800c290 con 0x7f8d58003a60 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d7622b700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 0x7f8d5800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d75229700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58004810 0x7f8d58004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.243+0000 7f8d75a2a700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d58003a60 0x7f8d58003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 -- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d58003a60 msgr2=0x7f8d58003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d58003a60 0x7f8d58003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 -- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58004810 msgr2=0x7f8d58004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d58004810 0x7f8d58004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 -- 172.21.15.33:0/604995527 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d58003570 con 0x7f8d580051c0 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 -- 172.21.15.33:0/604995527 reap_dead start 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d7622b700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 0x7f8d5800ba60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000a930 tx=0x7f8d600021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a1a9a41e8a11bfa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600070d0 con 0x7f8d580051c0 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d60007230 con 0x7f8d580051c0 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d74a28700 1 -- 172.21.15.33:0/604995527 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600075d0 con 0x7f8d580051c0 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d77c8e700 1 -- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 msgr2=0x7f8d5800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 0x7f8d5800ba60 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f8d6000a930 tx=0x7f8d600021d0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.244+0000 7f8d77c8e700 1 -- 172.21.15.33:0/604995527 shutdown_connections 2023-10-09T15:37:02.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.245+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/604995527 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d580051c0 0x7f8d5800ba60 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.245+0000 7f8d77c8e700 1 -- 172.21.15.33:0/604995527 >> 172.21.15.33:0/604995527 conn(0x7f8d70088000 msgr2=0x7f8d700883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:02.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.245+0000 7f8d77c8e700 1 -- 172.21.15.33:0/604995527 shutdown_connections 2023-10-09T15:37:02.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.245+0000 7f8d77c8e700 1 -- 172.21.15.33:0/604995527 wait complete. 2023-10-09T15:37:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 Processor -- start 2023-10-09T15:37:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 -- start start 2023-10-09T15:37:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d580051c0 0x7f8d70169f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d700aba80 0x7f8d7015f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700aca50 con 0x7f8d7015fb10 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7016a710 con 0x7f8d580051c0 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.246+0000 7f8d77c8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d700abef0 con 0x7f8d700aba80 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43976/0 (socket says 172.21.15.33:43976) 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 -- 172.21.15.33:0/1179689444 learned_addr learned my addr 172.21.15.33:0/1179689444 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d75229700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d700aba80 0x7f8d7015f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d75a2a700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d580051c0 0x7f8d70169f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 -- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d700aba80 msgr2=0x7f8d7015f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d700aba80 0x7f8d7015f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 -- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d580051c0 msgr2=0x7f8d70169f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d580051c0 0x7f8d70169f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 -- 172.21.15.33:0/1179689444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d700ac1b0 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d7622b700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8d7006c3c0 tx=0x7f8d60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d600075b0 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6001d420 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d700ac490 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6001d7e0 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.247+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d700b17e0 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.248+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7016a880 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.249+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f8d6001dbd0 con 0x7f8d7015fb10 2023-10-09T15:37:02.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.249+0000 7f8d6dffb700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 0x7f8d5c069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.249+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8d60086fc0 con 0x7f8d7015fb10 2023-10-09T15:37:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.249+0000 7f8d75a2a700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 0x7f8d5c069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.250+0000 7f8d75a2a700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 0x7f8d5c069770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006f00 tx=0x7f8d680091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:02.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.253+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8d60053dd0 con 0x7f8d7015fb10 2023-10-09T15:37:02.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:02.493+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8d7004c3c0 con 0x7f8d7015fb10 2023-10-09T15:37:03.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.102+0000 7f8d6dffb700 1 -- 172.21.15.33:0/1179689444 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v61) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8d600573f0 con 0x7f8d7015fb10 2023-10-09T15:37:03.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 msgr2=0x7f8d5c069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 0x7f8d5c069770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f8d68006f00 tx=0x7f8d680091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 msgr2=0x7f8d700b12a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f8d7006c3c0 tx=0x7f8d60016000 comp rx=0 tx=0).stop 2023-10-09T15:37:03.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 shutdown_connections 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8d5c0672c0 0x7f8d5c069770 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8d7015fb10 0x7f8d700b12a0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8d580051c0 0x7f8d70169f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 --2- 172.21.15.33:0/1179689444 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8d700aba80 0x7f8d7015f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 >> 172.21.15.33:0/1179689444 conn(0x7f8d70088000 msgr2=0x7f8d700697b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 shutdown_connections 2023-10-09T15:37:03.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.105+0000 7f8d77c8e700 1 -- 172.21.15.33:0/1179689444 wait complete. 2023-10-09T15:37:03.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:37:03.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.285+0000 7fe2d5168700 1 Processor -- start 2023-10-09T15:37:03.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.285+0000 7fe2d5168700 1 -- start start 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2d5168700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe2d0159800 0x7fe2d00b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2d5168700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00b0c80 con 0x7fe2d00b24f0 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2d5168700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2d00b0f60 con 0x7fe2d00b1d40 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2d5168700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2d00d10d0 con 0x7fe2d0159800 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2cffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe2d00b24f0 0x7fe2d01590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58100/0 (socket says 172.21.15.33:58100) 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2cffff700 1 -- 172.21.15.33:0/2266828471 learned_addr learned my addr 172.21.15.33:0/2266828471 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/2266828471 >> v2:172.21.15.59:3300/0 conn(0x7fe2d0159800 0x7fe2d00b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387027862 0 0) 0x7fe2d00b0c80 con 0x7fe2d00b24f0 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.286+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe2bc003570 con 0x7fe2d00b24f0 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3765318139 0 0) 0x7fe2bc003570 con 0x7fe2d00b24f0 2023-10-09T15:37:03.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 >> v2:172.21.15.59:3300/0 conn(0x7fe2d0159800 msgr2=0x7fe2d00b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 --2- 172.21.15.33:0/2266828471 >> v2:172.21.15.59:3300/0 conn(0x7fe2d0159800 0x7fe2d00b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 >> v1:172.21.15.59:6789/0 conn(0x7fe2d00b1d40 legacy=0x7fe2d00b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d00b1240 con 0x7fe2d00b24f0 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fe2c0001470 con 0x7fe2d00b24f0 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 >> v1:172.21.15.33:6789/0 conn(0x7fe2d00b24f0 legacy=0x7fe2d01590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 0x7fe2bc003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2bc004810 0x7fe2bc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc005210 0x7fe2bc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d00d10d0 con 0x7fe2bc003ab0 2023-10-09T15:37:03.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00c130 con 0x7fe2bc004810 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2bc00c2f0 con 0x7fe2bc005210 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 0x7fe2bc003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2bc004810 0x7fe2bc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2d4967700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc005210 0x7fe2bc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 -- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc005210 msgr2=0x7fe2bc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc005210 0x7fe2bc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 -- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2bc004810 msgr2=0x7fe2bc004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2bc004810 0x7fe2bc004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 -- 172.21.15.33:0/2266828471 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2bc003570 con 0x7fe2bc003ab0 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2bc004810 0x7fe2bc004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2d4967700 1 -- 172.21.15.33:0/2266828471 reap_dead start 2023-10-09T15:37:03.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2cffff700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 0x7fe2bc003ec0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c2d0 tx=0x7fe2c0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc9f0f9d8afb7e68 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.287+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c000cba0 con 0x7fe2bc003ab0 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2c000cd20 con 0x7fe2bc003ab0 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2ceffd700 1 -- 172.21.15.33:0/2266828471 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2c0005b70 con 0x7fe2bc003ab0 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 -- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 msgr2=0x7fe2bc003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 0x7fe2bc003ec0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fe2c000c2d0 tx=0x7fe2c0001d80 comp rx=0 tx=0).stop 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 -- 172.21.15.33:0/2266828471 shutdown_connections 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 --2- 172.21.15.33:0/2266828471 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2bc003ab0 0x7fe2bc003ec0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 -- 172.21.15.33:0/2266828471 >> 172.21.15.33:0/2266828471 conn(0x7fe2d00703a0 msgr2=0x7fe2d00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 -- 172.21.15.33:0/2266828471 shutdown_connections 2023-10-09T15:37:03.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.288+0000 7fe2d5168700 1 -- 172.21.15.33:0/2266828471 wait complete. 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.289+0000 7fe2d5168700 1 Processor -- start 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.289+0000 7fe2d5168700 1 -- start start 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc003ab0 0x7fe2d0153ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d00aea60 0x7fe2d00a9010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d0154910 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d016aec0 con 0x7fe2d00aea60 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d5168700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2d01543e0 con 0x7fe2bc003ab0 2023-10-09T15:37:03.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43992/0 (socket says 172.21.15.33:43992) 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 -- 172.21.15.33:0/1888005330 learned_addr learned my addr 172.21.15.33:0/1888005330 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2d4967700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d00aea60 0x7fe2d00a9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cffff700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc003ab0 0x7fe2d0153ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 -- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc003ab0 msgr2=0x7fe2d0153ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc003ab0 0x7fe2d0153ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 -- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d00aea60 msgr2=0x7fe2d00a9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d00aea60 0x7fe2d00a9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.290+0000 7fe2cf7fe700 1 -- 172.21.15.33:0/1888005330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2d016a2b0 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2cf7fe700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8011730 tx=0x7fe2b8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8015670 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2b80157d0 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2b8015b90 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2d016a590 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.291+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2d016ab50 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.292+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2d00a6e30 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.292+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe2b8013410 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.292+0000 7fe2c7fff700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 0x7fe2b0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.293+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fe2b8085110 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.293+0000 7fe2cffff700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 0x7fe2b0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:03.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.293+0000 7fe2cffff700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 0x7fe2b0069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00d0440 tx=0x7fe2c0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:03.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.297+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe2d00a6e30 con 0x7fe2d00ae5f0 2023-10-09T15:37:03.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:03.494+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe2d00a6e30 con 0x7fe2d00ae5f0 2023-10-09T15:37:04.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.478+0000 7fe2c7fff700 1 -- 172.21.15.33:0/1888005330 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe2d00a6e30 con 0x7fe2d00ae5f0 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 msgr2=0x7fe2b0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 0x7fe2b0069740 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe2d00d0440 tx=0x7fe2c0015000 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 msgr2=0x7fe2d00a8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fe2b8011730 tx=0x7fe2b8008040 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 shutdown_connections 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe2b0067290 0x7fe2b0069740 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2d00aea60 0x7fe2d00a9010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2bc003ab0 0x7fe2d0153ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 --2- 172.21.15.33:0/1888005330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe2d00ae5f0 0x7fe2d00a8ad0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 >> 172.21.15.33:0/1888005330 conn(0x7fe2d00703a0 msgr2=0x7fe2d0156150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:04.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 shutdown_connections 2023-10-09T15:37:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.482+0000 7fe2d5168700 1 -- 172.21.15.33:0/1888005330 wait complete. 2023-10-09T15:37:04.484 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:37:04.499 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:37:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.630+0000 7f79ec979700 1 Processor -- start 2023-10-09T15:37:04.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.630+0000 7f79ec979700 1 -- start start 2023-10-09T15:37:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.631+0000 7f79ec979700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79e8159530 0x7f79e80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.631+0000 7f79ec979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e80cb6f0 0x7f79e80cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.631+0000 7f79ec979700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79e80cc090 con 0x7f79e806dcf0 2023-10-09T15:37:04.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.631+0000 7f79ec979700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79e80ccfd0 con 0x7f79e8159530 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.631+0000 7f79ec979700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e815a410 con 0x7f79e80cb6f0 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79e8159530 0x7f79e80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79e8159530 0x7f79e80ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43994/0 (socket says 172.21.15.33:43994) 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 -- 172.21.15.33:0/2209373166 learned_addr learned my addr 172.21.15.33:0/2209373166 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e6d9d700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e80cb6f0 0x7f79e80cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 -- 172.21.15.33:0/2209373166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e80cb6f0 msgr2=0x7f79e80cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e80cb6f0 0x7f79e80cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 -- 172.21.15.33:0/2209373166 >> v1:172.21.15.59:6789/0 conn(0x7f79e806dcf0 legacy=0x7f79e8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 -- 172.21.15.33:0/2209373166 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e815a6f0 con 0x7f79e8159530 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e659c700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e8159530 0x7f79e80ceba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f79e00099b0 tx=0x7f79e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d615bb398119f735 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e559a700 1 -- 172.21.15.33:0/2209373166 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e0009ea0 con 0x7f79e8159530 2023-10-09T15:37:04.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e559a700 1 -- 172.21.15.33:0/2209373166 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e000b860 con 0x7f79e8159530 2023-10-09T15:37:04.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.632+0000 7f79e559a700 1 -- 172.21.15.33:0/2209373166 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000bc00 con 0x7f79e8159530 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 -- 172.21.15.33:0/2209373166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e8159530 msgr2=0x7f79e80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e8159530 0x7f79e80ceba0 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f79e00099b0 tx=0x7f79e0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 -- 172.21.15.33:0/2209373166 shutdown_connections 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e80cb6f0 0x7f79e80cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 --2- 172.21.15.33:0/2209373166 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e8159530 0x7f79e80ceba0 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 -- 172.21.15.33:0/2209373166 >> 172.21.15.33:0/2209373166 conn(0x7f79e80703a0 msgr2=0x7f79e80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 -- 172.21.15.33:0/2209373166 shutdown_connections 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.633+0000 7f79ec979700 1 -- 172.21.15.33:0/2209373166 wait complete. 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.634+0000 7f79ec979700 1 Processor -- start 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.634+0000 7f79ec979700 1 -- start start 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 0x7f79e816a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e8159530 0x7f79e80c9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e81537e0 con 0x7f79e806dcf0 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8157420 con 0x7f79e80cb6f0 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79ec979700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79e8157700 con 0x7f79e8159530 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44002/0 (socket says 172.21.15.33:44002) 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 -- 172.21.15.33:0/2933497285 learned_addr learned my addr 172.21.15.33:0/2933497285 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e5d9b700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 0x7f79e816a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e6d9d700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e8159530 0x7f79e80c9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 -- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e8159530 msgr2=0x7f79e80c9be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e8159530 0x7f79e80c9be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 -- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 msgr2=0x7f79e816a810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 0x7f79e816a810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 -- 172.21.15.33:0/2933497285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79e00094f0 con 0x7f79e806dcf0 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e5d9b700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 0x7f79e816a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79e659c700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f79e80caf20 tx=0x7f79e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:04.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.635+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e000bbe0 con 0x7f79e806dcf0 2023-10-09T15:37:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.636+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79e0011420 con 0x7f79e806dcf0 2023-10-09T15:37:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.636+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79e00117e0 con 0x7f79e806dcf0 2023-10-09T15:37:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.636+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79e81579e0 con 0x7f79e806dcf0 2023-10-09T15:37:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.636+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79e8157fa0 con 0x7f79e806dcf0 2023-10-09T15:37:04.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.636+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79e804c3c0 con 0x7f79e806dcf0 2023-10-09T15:37:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.637+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f79e0011b50 con 0x7f79e806dcf0 2023-10-09T15:37:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.637+0000 7f79de7fc700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 0x7f79c8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.638+0000 7f79e5d9b700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 0x7f79c8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.638+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f79e0085dd0 con 0x7f79e806dcf0 2023-10-09T15:37:04.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.638+0000 7f79e5d9b700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 0x7f79c8069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007fd0 tx=0x7f79d0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:04.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.643+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79e0089030 con 0x7f79e806dcf0 2023-10-09T15:37:04.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:04.839+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f79e815a9d0 con 0x7f79e806dcf0 2023-10-09T15:37:05.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.486+0000 7f79de7fc700 1 -- 172.21.15.33:0/2933497285 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7f79e0052e10 con 0x7f79e806dcf0 2023-10-09T15:37:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 msgr2=0x7f79c8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 0x7f79c8069740 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f79d0007fd0 tx=0x7f79d0009040 comp rx=0 tx=0).stop 2023-10-09T15:37:05.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 msgr2=0x7f79e8169bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f79e80caf20 tx=0x7f79e0017000 comp rx=0 tx=0).stop 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 shutdown_connections 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f79c8067290 0x7f79c8069740 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79e806dcf0 0x7f79e8169bc0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79e8159530 0x7f79e80c9be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 --2- 172.21.15.33:0/2933497285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79e80cb6f0 0x7f79e816a810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 >> 172.21.15.33:0/2933497285 conn(0x7f79e80703a0 msgr2=0x7f79e80c5480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 shutdown_connections 2023-10-09T15:37:05.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.491+0000 7f79ec979700 1 -- 172.21.15.33:0/2933497285 wait complete. 2023-10-09T15:37:05.493 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:37:05.507 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:37:05.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.633+0000 7f725abb2700 1 Processor -- start 2023-10-09T15:37:05.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.633+0000 7f725abb2700 1 -- start start 2023-10-09T15:37:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725abb2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f725406dc70 0x7f7254159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725abb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f72540cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725abb2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72540ccfd0 con 0x7f7254159530 2023-10-09T15:37:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725abb2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f725415a3d0 con 0x7f725406dc70 2023-10-09T15:37:05.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725abb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a6b0 con 0x7f725406e0e0 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725894e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7254159530 0x7f72540ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58104/0 (socket says 172.21.15.33:58104) 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725894e700 1 -- 172.21.15.33:0/3914390403 learned_addr learned my addr 172.21.15.33:0/3914390403 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 183294825 0 0) 0x7f72540ccfd0 con 0x7f7254159530 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f723c003570 con 0x7f7254159530 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> v2:172.21.15.59:3300/0 conn(0x7f725406dc70 0x7f7254159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f725914f700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f72540cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 456006333 0 0) 0x7f723c003570 con 0x7f7254159530 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 msgr2=0x7f72540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f72540cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 >> v2:172.21.15.59:3300/0 conn(0x7f725406dc70 msgr2=0x7f7254159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 --2- 172.21.15.33:0/3914390403 >> v2:172.21.15.59:3300/0 conn(0x7f725406dc70 0x7f7254159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f725415a990 con 0x7f7254159530 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f7244001470 con 0x7f7254159530 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.634+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> v2:172.21.15.59:3300/0 conn(0x7f725406dc70 0x7f7254159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 >> v1:172.21.15.33:6789/0 conn(0x7f7254159530 legacy=0x7f72540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f723c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f723c004090 0x7f723c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f723c004d50 0x7f723c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a3d0 con 0x7f723c004090 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f725415a6b0 con 0x7f723c004d50 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f723c00bbf0 con 0x7f725406e0e0 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f723c004090 0x7f723c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f725894e700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f723c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f725914f700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f723c004d50 0x7f723c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 -- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 msgr2=0x7f723c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f725406e0e0 0x7f723c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 -- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f723c004d50 msgr2=0x7f723c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f723c004d50 0x7f723c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 -- 172.21.15.33:0/3914390403 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f723c003570 con 0x7f723c004090 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f7253fff700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f723c004090 0x7f723c004810 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7248009ba0 tx=0x7f7248008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b36f0f9db33f09c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724800c070 con 0x7f723c004090 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724800e5e0 con 0x7f723c004090 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.635+0000 7f72537fe700 1 -- 172.21.15.33:0/3914390403 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7248009510 con 0x7f723c004090 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 -- 172.21.15.33:0/3914390403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f723c004090 msgr2=0x7f723c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 --2- 172.21.15.33:0/3914390403 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f723c004090 0x7f723c004810 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f7248009ba0 tx=0x7f7248008040 comp rx=0 tx=0).stop 2023-10-09T15:37:05.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725914f700 1 -- 172.21.15.33:0/3914390403 reap_dead start 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 -- 172.21.15.33:0/3914390403 shutdown_connections 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 -- 172.21.15.33:0/3914390403 >> 172.21.15.33:0/3914390403 conn(0x7f72540703a0 msgr2=0x7f72540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 -- 172.21.15.33:0/3914390403 shutdown_connections 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.636+0000 7f725abb2700 1 -- 172.21.15.33:0/3914390403 wait complete. 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.637+0000 7f725abb2700 1 Processor -- start 2023-10-09T15:37:05.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.637+0000 7f725abb2700 1 -- start start 2023-10-09T15:37:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f723c004090 0x7f72541532a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 0x7f72540b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540b20f0 con 0x7f72540b5710 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72540b14e0 con 0x7f72540b0a60 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725abb2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72540b17c0 con 0x7f723c004090 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44028/0 (socket says 172.21.15.33:44028) 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 -- 172.21.15.33:0/1264217393 learned_addr learned my addr 172.21.15.33:0/1264217393 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725894e700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f723c004090 0x7f72541532a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f7253fff700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 0x7f72540b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 -- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f723c004090 msgr2=0x7f72541532a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f723c004090 0x7f72541532a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 -- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 msgr2=0x7f72540b0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 0x7f72540b0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 -- 172.21.15.33:0/1264217393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72540b1aa0 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f7253fff700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 0x7f72540b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.638+0000 7f725914f700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f72540cf2d0 tx=0x7f724c009710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c009b10 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f724c002d50 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72540b1d80 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f724c015670 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7254158ad0 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.639+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72540b2480 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.640+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f724c003040 con 0x7f72540b5710 2023-10-09T15:37:05.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.640+0000 7f7250ff9700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 0x7f7240069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.640+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f724c085050 con 0x7f72540b5710 2023-10-09T15:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.640+0000 7f725894e700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 0x7f7240069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.641+0000 7f725894e700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 0x7f7240069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7244001d20 tx=0x7f7244009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.645+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72540b2480 con 0x7f72540b5710 2023-10-09T15:37:05.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.836+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f72540b2480 con 0x7f72540b5710 2023-10-09T15:37:05.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.840+0000 7f7250ff9700 1 -- 172.21.15.33:0/1264217393 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7f72540b2480 con 0x7f72540b5710 2023-10-09T15:37:05.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 msgr2=0x7f7240069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 0x7f7240069740 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f7244001d20 tx=0x7f7244009040 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 msgr2=0x7f72540b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f72540cf2d0 tx=0x7f724c009710 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 shutdown_connections 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7240067290 0x7f7240069740 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72540b5710 0x7f72540b5b60 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f723c004090 0x7f72541532a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 --2- 172.21.15.33:0/1264217393 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72540b0a60 0x7f72540b0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 >> 172.21.15.33:0/1264217393 conn(0x7f72540703a0 msgr2=0x7f7254153c90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 shutdown_connections 2023-10-09T15:37:05.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.842+0000 7f725abb2700 1 -- 172.21.15.33:0/1264217393 wait complete. 2023-10-09T15:37:05.859 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup' 2023-10-09T15:37:05.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.978+0000 7f5cdabcb700 1 Processor -- start 2023-10-09T15:37:05.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.978+0000 7f5cdabcb700 1 -- start start 2023-10-09T15:37:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cdabcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5cd406c860 0x7f5cd406cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cdabcb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5cd41409d0 0x7f5cd4140e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cdabcb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5cd40c86e0 con 0x7f5cd40c7a40 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cdabcb700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd415c1c0 con 0x7f5cd41409d0 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cdabcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5cd4141380 con 0x7f5cd406c860 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5cd41409d0 0x7f5cd4140e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd9168700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5cd40c7a40 0x7f5cd40c7ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58108/0 (socket says 172.21.15.33:58108) 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd9168700 1 -- 172.21.15.33:0/361092371 learned_addr learned my addr 172.21.15.33:0/361092371 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd8967700 1 --2- 172.21.15.33:0/361092371 >> v2:172.21.15.59:3300/0 conn(0x7f5cd406c860 0x7f5cd406cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd37fe700 1 -- 172.21.15.33:0/361092371 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3433074858 0 0) 0x7f5cd40c86e0 con 0x7f5cd40c7a40 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd37fe700 1 -- 172.21.15.33:0/361092371 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5cc0003570 con 0x7f5cd40c7a40 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd3fff700 1 -- 172.21.15.33:0/361092371 >> v2:172.21.15.59:3300/0 conn(0x7f5cd406c860 msgr2=0x7f5cd406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd3fff700 1 --2- 172.21.15.33:0/361092371 >> v2:172.21.15.59:3300/0 conn(0x7f5cd406c860 0x7f5cd406cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd3fff700 1 -- 172.21.15.33:0/361092371 >> v1:172.21.15.33:6789/0 conn(0x7f5cd40c7a40 legacy=0x7f5cd40c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.979+0000 7f5cd3fff700 1 -- 172.21.15.33:0/361092371 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cd415b400 con 0x7f5cd41409d0 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cd3fff700 1 --2- 172.21.15.33:0/361092371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd4140e40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40ce490 tx=0x7f5cc4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59e3a1b2778c77e6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cd37fe700 1 -- 172.21.15.33:0/361092371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400e070 con 0x7f5cd41409d0 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cd37fe700 1 -- 172.21.15.33:0/361092371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cc400bab0 con 0x7f5cd41409d0 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cd37fe700 1 -- 172.21.15.33:0/361092371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cc400be70 con 0x7f5cd41409d0 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 -- 172.21.15.33:0/361092371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 msgr2=0x7f5cd4140e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/361092371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd4140e40 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f5cd40ce490 tx=0x7f5cc4009780 comp rx=0 tx=0).stop 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 -- 172.21.15.33:0/361092371 shutdown_connections 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/361092371 >> v2:172.21.15.59:3300/0 conn(0x7f5cd406c860 0x7f5cd406cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/361092371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd4140e40 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 -- 172.21.15.33:0/361092371 >> 172.21.15.33:0/361092371 conn(0x7f5cd40cd400 msgr2=0x7f5cd40cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 -- 172.21.15.33:0/361092371 shutdown_connections 2023-10-09T15:37:05.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.980+0000 7f5cdabcb700 1 -- 172.21.15.33:0/361092371 wait complete. 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.981+0000 7f5cdabcb700 1 Processor -- start 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 -- start start 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cd406c860 0x7f5cd414afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd40c7a40 0x7f5cd413e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd413a750 con 0x7f5cd41409d0 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd413ec30 con 0x7f5cd40c7a40 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cdabcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5cd413da40 con 0x7f5cd406c860 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cd9168700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.982+0000 7f5cd9168700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44054/0 (socket says 172.21.15.33:44054) 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 -- 172.21.15.33:0/3240025167 learned_addr learned my addr 172.21.15.33:0/3240025167 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd3fff700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd40c7a40 0x7f5cd413e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd8967700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cd406c860 0x7f5cd414afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 -- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cd406c860 msgr2=0x7f5cd414afa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cd406c860 0x7f5cd414afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 -- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd40c7a40 msgr2=0x7f5cd413e190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd40c7a40 0x7f5cd413e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 -- 172.21.15.33:0/3240025167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5cc4009a20 con 0x7f5cd41409d0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd9168700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c790 tx=0x7f5cbc007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc005c00 con 0x7f5cd41409d0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5cbc005d60 con 0x7f5cd41409d0 2023-10-09T15:37:05.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cd413ded0 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5cbc0072e0 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.983+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cd413d3f0 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.984+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cd404c3c0 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.984+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f5cbc007690 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.985+0000 7f5cd0ff9700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 0x7f5cb4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.985+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5cbc083d60 con 0x7f5cd41409d0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.985+0000 7f5cd8967700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 0x7f5cb4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:05.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.985+0000 7f5cd8967700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 0x7f5cb4069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0093f0 tx=0x7f5ccc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:05.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:05.989+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5cbc04b5a0 con 0x7f5cd41409d0 2023-10-09T15:37:06.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.260+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]} v 0) v1 -- 0x7f5cd413db80 con 0x7f5cd41409d0 2023-10-09T15:37:06.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.485+0000 7f5cd0ff9700 1 -- 172.21.15.33:0/3240025167 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_with_human_readable_flag_without_subvolumegroup"]}]=0 v293) v1 ==== 181+0+0 (secure 0 0 0) 0x7f5cbc017020 con 0x7f5cd41409d0 2023-10-09T15:37:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 msgr2=0x7f5cb4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 0x7f5cb4069740 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f5ccc0093f0 tx=0x7f5ccc008040 comp rx=0 tx=0).stop 2023-10-09T15:37:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 msgr2=0x7f5cd415d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f5cbc00c790 tx=0x7f5cbc007dd0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 shutdown_connections 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cb4067290 0x7f5cb4069740 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5cd41409d0 0x7f5cd415d8e0 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5cd406c860 0x7f5cd414afa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 --2- 172.21.15.33:0/3240025167 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5cd40c7a40 0x7f5cd413e190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 >> 172.21.15.33:0/3240025167 conn(0x7f5cd40cd400 msgr2=0x7f5cd40c7ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 shutdown_connections 2023-10-09T15:37:06.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.488+0000 7f5cdabcb700 1 -- 172.21.15.33:0/3240025167 wait complete. 2023-10-09T15:37:06.501 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info --human_readable' command without subvolume group ... ok 2023-10-09T15:37:06.502 INFO:tasks.cephfs_test_runner:Starting test: test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) Tests the 'fs volume info' command without subvolume group 2023-10-09T15:37:06.502 INFO:tasks.cephfs_test_runner:test_volume_info_without_subvolumegroup (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:37:06.502 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-09T15:37:06.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:37:06.614 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:37:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.622+0000 7fdb10b9d700 1 Processor -- start 2023-10-09T15:37:06.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.622+0000 7fdb10b9d700 1 -- start start 2023-10-09T15:37:06.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.623+0000 7fdb10b9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.623+0000 7fdb10b9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb0c0c5510 0x7fdb0c0c5910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.623+0000 7fdb10b9d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0c51f0 con 0x7fdb0c1576a0 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.623+0000 7fdb10b9d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c157a70 con 0x7fdb0c0c5510 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.623+0000 7fdb10b9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c5e50 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb0ad9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdb0c0c5510 0x7fdb0c0c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:33954/0 (socket says 172.21.15.33:33954) 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 -- 172.21.15.33:0/2119368637 learned_addr learned my addr 172.21.15.33:0/2119368637 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb0959a700 1 -- 172.21.15.33:0/2119368637 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4138091064 0 0) 0x7fdb0c0c51f0 con 0x7fdb0c1576a0 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb0959a700 1 -- 172.21.15.33:0/2119368637 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdaf4003570 con 0x7fdb0c1576a0 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 -- 172.21.15.33:0/2119368637 >> v2:172.21.15.59:3300/0 conn(0x7fdb0c0c5510 msgr2=0x7fdb0c0c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 --2- 172.21.15.33:0/2119368637 >> v2:172.21.15.59:3300/0 conn(0x7fdb0c0c5510 0x7fdb0c0c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 -- 172.21.15.33:0/2119368637 >> v1:172.21.15.59:6789/0 conn(0x7fdb0c1576a0 legacy=0x7fdb0c0c8040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 -- 172.21.15.33:0/2119368637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c0c8800 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.624+0000 7fdb09d9b700 1 --2- 172.21.15.33:0/2119368637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb000099b0 tx=0x7fdb00009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=98f450a7bbe7b100 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb0959a700 1 -- 172.21.15.33:0/2119368637 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000b680 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb0959a700 1 -- 172.21.15.33:0/2119368637 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b7e0 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb0959a700 1 -- 172.21.15.33:0/2119368637 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0000bb80 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 -- 172.21.15.33:0/2119368637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 msgr2=0x7fdb0c0cc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/2119368637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fdb000099b0 tx=0x7fdb00009250 comp rx=0 tx=0).stop 2023-10-09T15:37:06.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 -- 172.21.15.33:0/2119368637 shutdown_connections 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/2119368637 >> v2:172.21.15.59:3300/0 conn(0x7fdb0c0c5510 0x7fdb0c0c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/2119368637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c0cc260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 -- 172.21.15.33:0/2119368637 >> 172.21.15.33:0/2119368637 conn(0x7fdb0c0ccb60 msgr2=0x7fdb0c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 -- 172.21.15.33:0/2119368637 shutdown_connections 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.625+0000 7fdb10b9d700 1 -- 172.21.15.33:0/2119368637 wait complete. 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.626+0000 7fdb10b9d700 1 Processor -- start 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.626+0000 7fdb10b9d700 1 -- start start 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c143460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb0c1576a0 0x7fdb0c156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c159610 con 0x7fdb0c0c5510 2023-10-09T15:37:06.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c0c38d0 con 0x7fdb0c1576a0 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb10b9d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c158ce0 con 0x7fdb0c0c4d80 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb09d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44064/0 (socket says 172.21.15.33:44064) 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb09d9b700 1 -- 172.21.15.33:0/3314893247 learned_addr learned my addr 172.21.15.33:0/3314893247 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb0a59c700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c143460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.627+0000 7fdb0ad9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb0c1576a0 0x7fdb0c156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 -- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 msgr2=0x7fdb0c143460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c143460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 -- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb0c1576a0 msgr2=0x7fdb0c156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb0c1576a0 0x7fdb0c156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 -- 172.21.15.33:0/3314893247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb000094f0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb09d9b700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009290 tx=0x7fdb00017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb00002f90 con 0x7fdb0c0c5510 2023-10-09T15:37:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb0000b950 con 0x7fdb0c0c5510 2023-10-09T15:37:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c158fc0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb0001a430 con 0x7fdb0c0c5510 2023-10-09T15:37:06.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.628+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c1439a0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.629+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c1597c0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.629+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fdb0001a7e0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.630+0000 7fdafa7fc700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 0x7fdaec069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.630+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdb00086280 con 0x7fdb0c0c5510 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.630+0000 7fdb0a59c700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 0x7fdaec069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:06.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.630+0000 7fdb0a59c700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 0x7fdaec069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007fd0 tx=0x7fdafc007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:06.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.637+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdb000533e0 con 0x7fdb0c0c5510 2023-10-09T15:37:06.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:06.913+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7fdb0c04c3c0 con 0x7fdb0c0c5510 2023-10-09T15:37:07.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.491+0000 7fdafa7fc700 1 -- 172.21.15.33:0/3314893247 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v294) v1 ==== 159+0+0 (secure 0 0 0) 0x7fdb00056a00 con 0x7fdb0c0c5510 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 msgr2=0x7fdaec069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 0x7fdaec069740 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdafc007fd0 tx=0x7fdafc007d50 comp rx=0 tx=0).stop 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 msgr2=0x7fdb0c15ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7fdb00009290 tx=0x7fdb00017000 comp rx=0 tx=0).stop 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 shutdown_connections 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdaec067290 0x7fdaec069740 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdb0c1576a0 0x7fdb0c156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdb0c0c4d80 0x7fdb0c143460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 --2- 172.21.15.33:0/3314893247 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdb0c0c5510 0x7fdb0c15ade0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 >> 172.21.15.33:0/3314893247 conn(0x7fdb0c0ccb60 msgr2=0x7fdb0c1538f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:07.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 shutdown_connections 2023-10-09T15:37:07.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.493+0000 7fdb10b9d700 1 -- 172.21.15.33:0/3314893247 wait complete. 2023-10-09T15:37:07.508 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:37:07.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.636+0000 7f6ae7e41700 1 Processor -- start 2023-10-09T15:37:07.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 -- start start 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ae015db60 0x7f6ae00b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 0x7f6ae00afa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 0x7f6ae00aff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae015ffd0 con 0x7f6ae015db60 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ae015f3c0 con 0x7f6ae015df30 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.637+0000 7f6ae7e41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae015f6a0 con 0x7f6ae015ee20 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ae015db60 0x7f6ae00b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ae015db60 0x7f6ae00b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44072/0 (socket says 172.21.15.33:44072) 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 -- 172.21.15.33:0/211992941 learned_addr learned my addr 172.21.15.33:0/211992941 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 -- 172.21.15.33:0/211992941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 msgr2=0x7f6ae00afa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae63de700 1 --2- 172.21.15.33:0/211992941 >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 0x7f6ae00aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae53dc700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 0x7f6ae00afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 0x7f6ae00afa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 -- 172.21.15.33:0/211992941 >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 msgr2=0x7f6ae00aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/211992941 >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 0x7f6ae00aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 -- 172.21.15.33:0/211992941 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ae015f980 con 0x7f6ae015db60 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae63de700 1 --2- 172.21.15.33:0/211992941 >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 0x7f6ae00aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae53dc700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 0x7f6ae00afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015db60 0x7f6ae00b1c40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6ae015f2f0 tx=0x7f6ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76f8ddcbbda344c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:07.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae4bdb700 1 -- 172.21.15.33:0/211992941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800b860 con 0x7f6ae015db60 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae4bdb700 1 -- 172.21.15.33:0/211992941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad800b9c0 con 0x7f6ae015db60 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.638+0000 7f6ae4bdb700 1 -- 172.21.15.33:0/211992941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad800bd60 con 0x7f6ae015db60 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 -- 172.21.15.33:0/211992941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015db60 msgr2=0x7f6ae00b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015db60 0x7f6ae00b1c40 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f6ae015f2f0 tx=0x7f6ad8009250 comp rx=0 tx=0).stop 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 -- 172.21.15.33:0/211992941 shutdown_connections 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/211992941 >> v2:172.21.15.59:3300/0 conn(0x7f6ae015df30 0x7f6ae00aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015db60 0x7f6ae00b1c40 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/211992941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015ee20 0x7f6ae00afa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 -- 172.21.15.33:0/211992941 >> 172.21.15.33:0/211992941 conn(0x7f6ae006d170 msgr2=0x7f6ae00cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 -- 172.21.15.33:0/211992941 shutdown_connections 2023-10-09T15:37:07.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.639+0000 7f6ae7e41700 1 -- 172.21.15.33:0/211992941 wait complete. 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.640+0000 7f6ae7e41700 1 Processor -- start 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.640+0000 7f6ae7e41700 1 -- start start 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015db60 0x7f6ae0144a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 0x7f6ae0069da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae016fd40 con 0x7f6ae015ee20 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae016f170 con 0x7f6ae015df30 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae7e41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ae016f410 con 0x7f6ae015db60 2023-10-09T15:37:07.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44084/0 (socket says 172.21.15.33:44084) 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 -- 172.21.15.33:0/2048153383 learned_addr learned my addr 172.21.15.33:0/2048153383 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae53dc700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 0x7f6ae0069da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015db60 0x7f6ae0144a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 -- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015db60 msgr2=0x7f6ae0144a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015db60 0x7f6ae0144a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 -- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 msgr2=0x7f6ae0069da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 0x7f6ae0069da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae63de700 1 -- 172.21.15.33:0/2048153383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad80094f0 con 0x7f6ae015ee20 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.641+0000 7f6ae53dc700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 0x7f6ae0069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6ae63de700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000cf60 tx=0x7f6ad0007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0015440 con 0x7f6ae015ee20 2023-10-09T15:37:07.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad00155a0 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ae016f6f0 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad0015960 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.642+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ae0144fa0 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.643+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ae004c3c0 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.643+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6ad0015d50 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.644+0000 7f6addffb700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 0x7f6acc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.644+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6ad0085110 con 0x7f6ae015ee20 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.644+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 0x7f6acc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:07.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.644+0000 7f6ae5bdd700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 0x7f6acc069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ae015f2f0 tx=0x7f6ad8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:07.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.648+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ad0052270 con 0x7f6ae015ee20 2023-10-09T15:37:07.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.842+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6ae015fc60 con 0x7f6ae015ee20 2023-10-09T15:37:07.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.846+0000 7f6addffb700 1 -- 172.21.15.33:0/2048153383 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6ad0055890 con 0x7f6ae015ee20 2023-10-09T15:37:07.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 msgr2=0x7f6acc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 0x7f6acc069740 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f6ae015f2f0 tx=0x7f6ad8017000 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 msgr2=0x7f6ae006a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f6ad000cf60 tx=0x7f6ad0007870 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 shutdown_connections 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6acc067290 0x7f6acc069740 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ae015ee20 0x7f6ae006a2e0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ae015db60 0x7f6ae0144a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 --2- 172.21.15.33:0/2048153383 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ae015df30 0x7f6ae0069da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 >> 172.21.15.33:0/2048153383 conn(0x7f6ae006d170 msgr2=0x7f6ae0159430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 shutdown_connections 2023-10-09T15:37:07.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:07.848+0000 7f6ae7e41700 1 -- 172.21.15.33:0/2048153383 wait complete. 2023-10-09T15:37:07.860 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:37:07.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:07.905 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:07.953 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:37:07.953 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:37:07.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:08.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.072+0000 7f08d15b0700 1 Processor -- start 2023-10-09T15:37:08.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.072+0000 7f08d15b0700 1 -- start start 2023-10-09T15:37:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08d15b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08d15b0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08cc0cde50 0x7f08cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08d15b0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08cc15ae40 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08d15b0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08cc0d13f0 con 0x7f08cc0cde50 2023-10-09T15:37:08.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08d15b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15ab60 con 0x7f08cc0cb5a0 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08cb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f08cc0cde50 0x7f08cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08ca7fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f08cc0cd9e0 0x7f08cc159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58120/0 (socket says 172.21.15.33:58120) 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.073+0000 7f08ca7fc700 1 -- 172.21.15.33:0/2858156757 learned_addr learned my addr 172.21.15.33:0/2858156757 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08caffd700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08cb7fe700 1 -- 172.21.15.33:0/2858156757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 msgr2=0x7f08cc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08cb7fe700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08cb7fe700 1 -- 172.21.15.33:0/2858156757 >> v1:172.21.15.33:6789/0 conn(0x7f08cc0cd9e0 legacy=0x7f08cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08cb7fe700 1 -- 172.21.15.33:0/2858156757 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08cc0ccf00 con 0x7f08cc0cde50 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08c9ffb700 1 -- 172.21.15.33:0/2858156757 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3581700396 0 0) 0x7f08cc15ae40 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08caffd700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08cb7fe700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cde50 0x7f08cc156e90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009e60 tx=0x7f08c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f306a7c427c99613 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08c9ffb700 1 -- 172.21.15.33:0/2858156757 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c400e070 con 0x7f08cc0cde50 2023-10-09T15:37:08.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08c9ffb700 1 -- 172.21.15.33:0/2858156757 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c400bc30 con 0x7f08cc0cde50 2023-10-09T15:37:08.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.074+0000 7f08c9ffb700 1 -- 172.21.15.33:0/2858156757 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c4012430 con 0x7f08cc0cde50 2023-10-09T15:37:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 -- 172.21.15.33:0/2858156757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cde50 msgr2=0x7f08cc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cde50 0x7f08cc156e90 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f08c4009e60 tx=0x7f08c4009780 comp rx=0 tx=0).stop 2023-10-09T15:37:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 -- 172.21.15.33:0/2858156757 shutdown_connections 2023-10-09T15:37:08.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cde50 0x7f08cc156e90 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 --2- 172.21.15.33:0/2858156757 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 -- 172.21.15.33:0/2858156757 >> 172.21.15.33:0/2858156757 conn(0x7f08cc070e30 msgr2=0x7f08cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 -- 172.21.15.33:0/2858156757 shutdown_connections 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.075+0000 7f08d15b0700 1 -- 172.21.15.33:0/2858156757 wait complete. 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.076+0000 7f08d15b0700 1 Processor -- start 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.076+0000 7f08d15b0700 1 -- start start 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08cc16a030 0x7f08cc15b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc15e370 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b4b30 con 0x7f08cc16a030 2023-10-09T15:37:08.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08d15b0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08cc0b4e10 con 0x7f08cc0cb5a0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44112/0 (socket says 172.21.15.33:44112) 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 -- 172.21.15.33:0/4225515610 learned_addr learned my addr 172.21.15.33:0/4225515610 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08caffd700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08cb7fe700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08cc16a030 0x7f08cc15b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 -- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 msgr2=0x7f08cc0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 -- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08cc16a030 msgr2=0x7f08cc15b5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08cc16a030 0x7f08cc15b5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 -- 172.21.15.33:0/4225515610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08c4009a20 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08ca7fc700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c7e0 tx=0x7f08c0007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.077+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0005b30 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.078+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08c0005c90 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.078+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08cc0b50f0 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.078+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08c0007300 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.078+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08cc0c89e0 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.078+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08cc0b5610 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.079+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f08c001b400 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.079+0000 7f08b2ffd700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 0x7f08b8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.079+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f08c0084320 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.079+0000 7f08caffd700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 0x7f08b8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.080+0000 7f08caffd700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 0x7f08b8069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006fd0 tx=0x7f08bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.084+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f08cc0b5610 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.322+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f08cc0b5610 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.322+0000 7f08b2ffd700 1 -- 172.21.15.33:0/4225515610 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) v1 ==== 94+0+3529 (secure 0 0 0) 0x7f08cc0b5610 con 0x7f08cc0cd9e0 2023-10-09T15:37:08.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:08.323 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":61,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5603,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2130077157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2130077157},{"type":"v1","addr":"172.21.15.59:6834","nonce":2130077157}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6097,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2571978138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2571978138},{"type":"v1","addr":"172.21.15.59:6835","nonce":2571978138}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6453,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1159277752","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1159277752},{"type":"v1","addr":"172.21.15.33:6836","nonce":1159277752}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":6729,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1391847844","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1391847844},{"type":"v1","addr":"172.21.15.33:6837","nonce":1391847844}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":61}],"filesystems":[]} 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 msgr2=0x7f08b8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 0x7f08b8069740 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f08bc006fd0 tx=0x7f08bc008040 comp rx=0 tx=0).stop 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 msgr2=0x7f08cc169af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f08c000c7e0 tx=0x7f08c0007df0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 shutdown_connections 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08b8067290 0x7f08b8069740 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08cc16a030 0x7f08cc15b5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f08cc0cb5a0 0x7f08cc0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 --2- 172.21.15.33:0/4225515610 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08cc0cd9e0 0x7f08cc169af0 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 >> 172.21.15.33:0/4225515610 conn(0x7f08cc070e30 msgr2=0x7f08cc0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:08.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 shutdown_connections 2023-10-09T15:37:08.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.325+0000 7f08d15b0700 1 -- 172.21.15.33:0/4225515610 wait complete. 2023-10-09T15:37:08.326 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 61 2023-10-09T15:37:08.337 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:37:08.337 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:37:08.338 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:37:08.338 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:08.338 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:37:08.338 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:37:08.338 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:37:08.338 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:08.339 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:37:08.339 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:37:08.339 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:37:08.339 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:08.339 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:37:08.339 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:37:08.339 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:37:08.340 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:08.346 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:37:08.347 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:37:08.348 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:37:08.348 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:37:08.350 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:37:08.350 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:37:08.351 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:37:08.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:37:08.389 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:37:08.389 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:08.390 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:37:08.390 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:08.394 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:37:08.394 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:08.395 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:37:08.395 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:08.395 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:37:08.464 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:37:08.464 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:37:08.474 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:37:08.475 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:37:08.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.524+0000 7f4d6ce85700 1 Processor -- start 2023-10-09T15:37:08.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.524+0000 7f4d6ce85700 1 -- start start 2023-10-09T15:37:08.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6ce85700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d68143200 0x7f4d68159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6ce85700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d6815aa20 0x7f4d68163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6ce85700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d6806c7d0 con 0x7f4d680c3250 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6ce85700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d681171e0 con 0x7f4d6815aa20 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6ce85700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d680c37a0 con 0x7f4d68143200 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d66d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d6815aa20 0x7f4d68163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d65d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4d680c3250 0x7f4d6815a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58160/0 (socket says 172.21.15.33:58160) 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d65d9b700 1 -- 172.21.15.33:0/2739179047 learned_addr learned my addr 172.21.15.33:0/2739179047 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d66d9d700 1 -- 172.21.15.33:0/2739179047 >> v2:172.21.15.59:3300/0 conn(0x7f4d68143200 msgr2=0x7f4d68159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6659c700 1 --2- 172.21.15.33:0/2739179047 >> v2:172.21.15.59:3300/0 conn(0x7f4d68143200 0x7f4d68159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d66d9d700 1 --2- 172.21.15.33:0/2739179047 >> v2:172.21.15.59:3300/0 conn(0x7f4d68143200 0x7f4d68159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d66d9d700 1 -- 172.21.15.33:0/2739179047 >> v1:172.21.15.33:6789/0 conn(0x7f4d680c3250 legacy=0x7f4d6815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d66d9d700 1 -- 172.21.15.33:0/2739179047 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d680cc090 con 0x7f4d6815aa20 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.525+0000 7f4d6559a700 1 -- 172.21.15.33:0/2739179047 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1823497763 0 0) 0x7f4d6806c7d0 con 0x7f4d680c3250 2023-10-09T15:37:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d66d9d700 1 --2- 172.21.15.33:0/2739179047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d6815aa20 0x7f4d68163430 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4d68069780 tx=0x7f4d60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bc57a6274b822e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6559a700 1 -- 172.21.15.33:0/2739179047 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d6000e070 con 0x7f4d6815aa20 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6559a700 1 -- 172.21.15.33:0/2739179047 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d6000bc30 con 0x7f4d6815aa20 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6559a700 1 -- 172.21.15.33:0/2739179047 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d60012430 con 0x7f4d6815aa20 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 -- 172.21.15.33:0/2739179047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d6815aa20 msgr2=0x7f4d68163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/2739179047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d6815aa20 0x7f4d68163430 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f4d68069780 tx=0x7f4d60009780 comp rx=0 tx=0).stop 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 -- 172.21.15.33:0/2739179047 shutdown_connections 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/2739179047 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d6815aa20 0x7f4d68163430 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/2739179047 >> v2:172.21.15.59:3300/0 conn(0x7f4d68143200 0x7f4d68159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 -- 172.21.15.33:0/2739179047 >> 172.21.15.33:0/2739179047 conn(0x7f4d680ccb60 msgr2=0x7f4d680ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 -- 172.21.15.33:0/2739179047 shutdown_connections 2023-10-09T15:37:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.526+0000 7f4d6ce85700 1 -- 172.21.15.33:0/2739179047 wait complete. 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.527+0000 7f4d6ce85700 1 Processor -- start 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.527+0000 7f4d6ce85700 1 -- start start 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 0x7f4d68142190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6815aa20 0x7f4d68132ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d6812f1c0 con 0x7f4d680c3250 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d681336a0 con 0x7f4d6815aa20 2023-10-09T15:37:08.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6ce85700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d68133980 con 0x7f4d68143200 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44134/0 (socket says 172.21.15.33:44134) 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d6659c700 1 -- 172.21.15.33:0/1771002136 learned_addr learned my addr 172.21.15.33:0/1771002136 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d65d9b700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 0x7f4d68142190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.528+0000 7f4d66d9d700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6815aa20 0x7f4d68132ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 -- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 msgr2=0x7f4d68142190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 0x7f4d68142190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 -- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6815aa20 msgr2=0x7f4d68132ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6815aa20 0x7f4d68132ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 -- 172.21.15.33:0/1771002136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d60009a20 con 0x7f4d680c3250 2023-10-09T15:37:08.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d65d9b700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 0x7f4d68142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6659c700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c7d0 tx=0x7f4d58008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58011600 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d58011760 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d58011b20 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d68133c60 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.529+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d6813c780 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.530+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d6804c3c0 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.530+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4d58018350 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.531+0000 7f4d567fc700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 0x7f4d48069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.531+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4d58084790 con 0x7f4d680c3250 2023-10-09T15:37:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.531+0000 7f4d65d9b700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 0x7f4d48069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.531+0000 7f4d65d9b700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 0x7f4d48069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4d68141880 tx=0x7f4d5c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.535+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d580517e0 con 0x7f4d680c3250 2023-10-09T15:37:08.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:08.744+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f4d680cc370 con 0x7f4d680c3250 2023-10-09T15:37:09.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.505+0000 7f4d567fc700 1 -- 172.21.15.33:0/1771002136 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7f4d58054e00 con 0x7f4d680c3250 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 msgr2=0x7f4d48069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 0x7f4d48069740 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f4d68141880 tx=0x7f4d5c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 msgr2=0x7f4d68133f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f4d5800c7d0 tx=0x7f4d58008040 comp rx=0 tx=0).stop 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 shutdown_connections 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d48067290 0x7f4d48069740 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d680c3250 0x7f4d68133f80 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d6815aa20 0x7f4d68132ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 --2- 172.21.15.33:0/1771002136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d68143200 0x7f4d68142190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 >> 172.21.15.33:0/1771002136 conn(0x7f4d680ccb60 msgr2=0x7f4d6806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:09.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.507+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 shutdown_connections 2023-10-09T15:37:09.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.508+0000 7f4d6ce85700 1 -- 172.21.15.33:0/1771002136 wait complete. 2023-10-09T15:37:09.509 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:37:09.521 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:37:09.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.644+0000 7fb1e58a8700 1 Processor -- start 2023-10-09T15:37:09.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 -- start start 2023-10-09T15:37:09.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 0x7fb1e0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1e015a400 0x7fb1e0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1e015ae40 con 0x7fb1e00cb5a0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1e00ce0f0 con 0x7fb1e015a400 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1e58a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00cbde0 con 0x7fb1e00cb970 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.645+0000 7fb1deffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb1e00cb5a0 0x7fb1e00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58168/0 (socket says 172.21.15.33:58168) 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1deffd700 1 -- 172.21.15.33:0/2704453039 learned_addr learned my addr 172.21.15.33:0/2704453039 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/2704453039 >> v2:172.21.15.59:3300/0 conn(0x7fb1e015a400 0x7fb1e0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1de7fc700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 0x7fb1e0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4142180675 0 0) 0x7fb1e015ae40 con 0x7fb1e00cb5a0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1cc003570 con 0x7fb1e00cb5a0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 879272498 0 0) 0x7fb1cc003570 con 0x7fb1e00cb5a0 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 -- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 msgr2=0x7fb1e0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 0x7fb1e0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 -- 172.21.15.33:0/2704453039 >> v1:172.21.15.33:6789/0 conn(0x7fb1e00cb5a0 legacy=0x7fb1e00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 -- 172.21.15.33:0/2704453039 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1e015ab60 con 0x7fb1e015a400 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1de7fc700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 0x7fb1e0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.646+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e015a400 0x7fb1e0156e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009e90 tx=0x7fb1d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6588fea6741511b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d000e070 con 0x7fb1e015a400 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d000b870 con 0x7fb1e015a400 2023-10-09T15:37:09.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1ddffb700 1 -- 172.21.15.33:0/2704453039 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d8001470 con 0x7fb1e015a400 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 -- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e015a400 msgr2=0x7fb1e0156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e015a400 0x7fb1e0156e90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fb1d0009e90 tx=0x7fb1d0009780 comp rx=0 tx=0).stop 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 -- 172.21.15.33:0/2704453039 shutdown_connections 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e015a400 0x7fb1e0156e90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/2704453039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb970 0x7fb1e0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 -- 172.21.15.33:0/2704453039 >> 172.21.15.33:0/2704453039 conn(0x7fb1e0070e30 msgr2=0x7fb1e00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 -- 172.21.15.33:0/2704453039 shutdown_connections 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.647+0000 7fb1e58a8700 1 -- 172.21.15.33:0/2704453039 wait complete. 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.648+0000 7fb1e58a8700 1 Processor -- start 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.648+0000 7fb1e58a8700 1 -- start start 2023-10-09T15:37:09.651 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb5a0 0x7fb1e00b3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 0x7fb1e015c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b4de0 con 0x7fb1e015a400 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b5200 con 0x7fb1e00cb970 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1e58a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1e00b4160 con 0x7fb1e00cb5a0 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1df7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44136/0 (socket says 172.21.15.33:44136) 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1df7fe700 1 -- 172.21.15.33:0/3496352054 learned_addr learned my addr 172.21.15.33:0/3496352054 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1de7fc700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 0x7fb1e015c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.649+0000 7fb1deffd700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb5a0 0x7fb1e00b3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 -- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb5a0 msgr2=0x7fb1e00b3930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb5a0 0x7fb1e00b3930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 -- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 msgr2=0x7fb1e015c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 0x7fb1e015c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 -- 172.21.15.33:0/3496352054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1c8009420 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1de7fc700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 0x7fb1e015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1df7fe700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099f0 tx=0x7fb1d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d0012cd0 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0012e70 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d0009a20 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb1d001e680 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.650+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1e00b4720 con 0x7fb1e015a400 2023-10-09T15:37:09.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.651+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1e00b4f20 con 0x7fb1e015a400 2023-10-09T15:37:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.651+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb1d001ea70 con 0x7fb1e015a400 2023-10-09T15:37:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.652+0000 7fb1d6ffd700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 0x7fb1c0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.652+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb1d0086a80 con 0x7fb1e015a400 2023-10-09T15:37:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.652+0000 7fb1deffd700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 0x7fb1c0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:09.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.652+0000 7fb1deffd700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 0x7fb1c0069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80011e0 tx=0x7fb1d8001520 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:09.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.656+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb1e00b4f20 con 0x7fb1e015a400 2023-10-09T15:37:09.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.926+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb1e00b4f20 con 0x7fb1e015a400 2023-10-09T15:37:09.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.927+0000 7fb1d6ffd700 1 -- 172.21.15.33:0/3496352054 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb1e00b4f20 con 0x7fb1e015a400 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:09.927 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.928 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:37:09.929 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.930 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.931 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.932 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.933 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.934 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.935 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:37:09.936 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:37:09.937 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.938 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:09.939 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:09.940 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:37:09.941 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:37:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 msgr2=0x7fb1c0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 0x7fb1c0069740 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb1d80011e0 tx=0x7fb1d8001520 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 msgr2=0x7fb1e015cf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7fb1d00099f0 tx=0x7fb1d0017000 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 shutdown_connections 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1c0067290 0x7fb1c0069740 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1e015a400 0x7fb1e015cf10 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1e00cb5a0 0x7fb1e00b3930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 --2- 172.21.15.33:0/3496352054 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1e00cb970 0x7fb1e015c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 >> 172.21.15.33:0/3496352054 conn(0x7fb1e0070e30 msgr2=0x7fb1e00b08e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 shutdown_connections 2023-10-09T15:37:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:09.929+0000 7fb1e58a8700 1 -- 172.21.15.33:0/3496352054 wait complete. 2023-10-09T15:37:09.944 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.062+0000 7f4b7c8b7700 1 Processor -- start 2023-10-09T15:37:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.062+0000 7f4b7c8b7700 1 -- start start 2023-10-09T15:37:10.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7c8b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cb5a0 0x7f4b780cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7c8b7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b780cd9e0 0x7f4b78159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7c8b7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7815ae40 con 0x7f4b780cde50 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7c8b7700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b780d13f0 con 0x7f4b780cd9e0 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7c8b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b7815ab60 con 0x7f4b780cb5a0 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b75d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b780cd9e0 0x7f4b78159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b76d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4b780cde50 0x7f4b78156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58182/0 (socket says 172.21.15.33:58182) 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b76d9d700 1 -- 172.21.15.33:0/1518192154 learned_addr learned my addr 172.21.15.33:0/1518192154 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.063+0000 7f4b7659c700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cb5a0 0x7f4b780cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b75d9b700 1 -- 172.21.15.33:0/1518192154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cb5a0 msgr2=0x7f4b780cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b75d9b700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cb5a0 0x7f4b780cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b75d9b700 1 -- 172.21.15.33:0/1518192154 >> v1:172.21.15.33:6789/0 conn(0x7f4b780cde50 legacy=0x7f4b78156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b75d9b700 1 -- 172.21.15.33:0/1518192154 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b780ccf00 con 0x7f4b780cd9e0 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7559a700 1 -- 172.21.15.33:0/1518192154 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485761356 0 0) 0x7f4b7815ae40 con 0x7f4b780cde50 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b75d9b700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cd9e0 0x7f4b78159ec0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4b600098e0 tx=0x7f4b600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48282ecdeb924229 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7559a700 1 -- 172.21.15.33:0/1518192154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000b640 con 0x7f4b780cd9e0 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7559a700 1 -- 172.21.15.33:0/1518192154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000b7a0 con 0x7f4b780cd9e0 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7559a700 1 -- 172.21.15.33:0/1518192154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000bb40 con 0x7f4b780cd9e0 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/1518192154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cd9e0 msgr2=0x7f4b78159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.064+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cd9e0 0x7f4b78159ec0 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f4b600098e0 tx=0x7f4b600091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/1518192154 shutdown_connections 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cb5a0 0x7f4b780cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/1518192154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cd9e0 0x7f4b78159ec0 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/1518192154 >> 172.21.15.33:0/1518192154 conn(0x7f4b78070e30 msgr2=0x7f4b780d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/1518192154 shutdown_connections 2023-10-09T15:37:10.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.065+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/1518192154 wait complete. 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 Processor -- start 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 -- start start 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cd9e0 0x7f4b780b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b780c9f50 0x7f4b78155e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78159350 con 0x7f4b780cb5a0 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78159580 con 0x7f4b780c9f50 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.066+0000 7f4b7c8b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b78159860 con 0x7f4b780cd9e0 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44140/0 (socket says 172.21.15.33:44140) 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 -- 172.21.15.33:0/356333816 learned_addr learned my addr 172.21.15.33:0/356333816 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 -- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cd9e0 msgr2=0x7f4b780b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b75d9b700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cd9e0 0x7f4b780b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cd9e0 0x7f4b780b46d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 -- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b780c9f50 msgr2=0x7f4b78155e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b76d9d700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b780c9f50 0x7f4b78155e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b780c9f50 0x7f4b78155e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 -- 172.21.15.33:0/356333816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009420 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7659c700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800ec80 tx=0x7f4b680091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6800c9d0 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6800cb30 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b78159b40 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68013470 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.067+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7815e2c0 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.068+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b780c8c70 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.069+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f4b68013820 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.069+0000 7f4b6e7fc700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 0x7f4b58069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.069+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4b68084a90 con 0x7f4b780cb5a0 2023-10-09T15:37:10.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.069+0000 7f4b75d9b700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 0x7f4b58069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.069+0000 7f4b75d9b700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 0x7f4b58069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4b60003080 tx=0x7f4b60017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.073+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b68051c40 con 0x7f4b780cb5a0 2023-10-09T15:37:10.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.270+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4b780c8e20 con 0x7f4b780cb5a0 2023-10-09T15:37:10.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.271+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/356333816 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+12087 (secure 0 0 0) 0x7f4b68055260 con 0x7f4b780cb5a0 2023-10-09T15:37:10.271 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:10.271 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":97,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:09.502250+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":87,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 msgr2=0x7f4b58069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 0x7f4b58069740 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f4b60003080 tx=0x7f4b60017000 comp rx=0 tx=0).stop 2023-10-09T15:37:10.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 msgr2=0x7f4b7815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800ec80 tx=0x7f4b680091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 shutdown_connections 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b58067290 0x7f4b58069740 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b780cb5a0 0x7f4b7815b070 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b780c9f50 0x7f4b78155e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 --2- 172.21.15.33:0/356333816 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b780cd9e0 0x7f4b780b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 >> 172.21.15.33:0/356333816 conn(0x7f4b78070e30 msgr2=0x7f4b780c6f10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 shutdown_connections 2023-10-09T15:37:10.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.273+0000 7f4b7c8b7700 1 -- 172.21.15.33:0/356333816 wait complete. 2023-10-09T15:37:10.285 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:37:10.285 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:37:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.407+0000 7fad728a8700 1 Processor -- start 2023-10-09T15:37:10.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.407+0000 7fad728a8700 1 -- start start 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c159550 0x7fad6c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 0x7fad6c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 0x7fad6c0ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0acc00 con 0x7fad6c159550 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad6c0abff0 con 0x7fad6c159920 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad728a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0ac2d0 con 0x7fad6c15dfd0 2023-10-09T15:37:10.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad718a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c159550 0x7fad6c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad718a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad6c159550 0x7fad6c0ceac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44154/0 (socket says 172.21.15.33:44154) 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.408+0000 7fad718a6700 1 -- 172.21.15.33:0/777715355 learned_addr learned my addr 172.21.15.33:0/777715355 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad720a7700 1 --2- 172.21.15.33:0/777715355 >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 0x7fad6c0ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad710a5700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 0x7fad6c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 -- 172.21.15.33:0/777715355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 msgr2=0x7fad6c0aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 0x7fad6c0aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 -- 172.21.15.33:0/777715355 >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 msgr2=0x7fad6c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 --2- 172.21.15.33:0/777715355 >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 0x7fad6c0ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 -- 172.21.15.33:0/777715355 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad6c0ac5b0 con 0x7fad6c159550 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad720a7700 1 --2- 172.21.15.33:0/777715355 >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 0x7fad6c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad710a5700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 0x7fad6c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:10.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad718a6700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c159550 0x7fad6c0ceac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06c180 tx=0x7fad68009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e917bf2a87d4961 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad708a4700 1 -- 172.21.15.33:0/777715355 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800b860 con 0x7fad6c159550 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad708a4700 1 -- 172.21.15.33:0/777715355 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad6800b9c0 con 0x7fad6c159550 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.409+0000 7fad708a4700 1 -- 172.21.15.33:0/777715355 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad6800bd60 con 0x7fad6c159550 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 -- 172.21.15.33:0/777715355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c159550 msgr2=0x7fad6c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c159550 0x7fad6c0ceac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06c180 tx=0x7fad68009250 comp rx=0 tx=0).stop 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 -- 172.21.15.33:0/777715355 shutdown_connections 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 --2- 172.21.15.33:0/777715355 >> v2:172.21.15.59:3300/0 conn(0x7fad6c159920 0x7fad6c0ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c159550 0x7fad6c0ceac0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 --2- 172.21.15.33:0/777715355 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c15dfd0 0x7fad6c0aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 -- 172.21.15.33:0/777715355 >> 172.21.15.33:0/777715355 conn(0x7fad6c06ce80 msgr2=0x7fad6c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 -- 172.21.15.33:0/777715355 shutdown_connections 2023-10-09T15:37:10.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.410+0000 7fad728a8700 1 -- 172.21.15.33:0/777715355 wait complete. 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.411+0000 7fad728a8700 1 Processor -- start 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.411+0000 7fad728a8700 1 -- start start 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 0x7fad6c0c9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 0x7fad6c0b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0cb0f0 con 0x7fad6c15dfd0 2023-10-09T15:37:10.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0cd6c0 con 0x7fad6c159550 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad6c0ccab0 con 0x7fad6c159920 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44170/0 (socket says 172.21.15.33:44170) 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 -- 172.21.15.33:0/657126993 learned_addr learned my addr 172.21.15.33:0/657126993 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad710a5700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 0x7fad6c0b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad718a6700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 0x7fad6c0c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 -- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 msgr2=0x7fad6c0b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 0x7fad6c0b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 -- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 msgr2=0x7fad6c0c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 0x7fad6c0c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 -- 172.21.15.33:0/657126993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad680094f0 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad718a6700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 0x7fad6c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad710a5700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 0x7fad6c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad720a7700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fad6400cf60 tx=0x7fad64007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64015440 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad640155a0 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad6c0ccd90 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.412+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad64015960 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.413+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad6c0cd350 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.414+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad6c0cd870 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.414+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fad64015d50 con 0x7fad6c15dfd0 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.414+0000 7fad61ffb700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 0x7fad50069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.414+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fad64084fe0 con 0x7fad6c15dfd0 2023-10-09T15:37:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.414+0000 7fad718a6700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 0x7fad50069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.415+0000 7fad718a6700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 0x7fad50069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06c180 tx=0x7fad68017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.418+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad6c0cd870 con 0x7fad6c15dfd0 2023-10-09T15:37:10.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.613+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fad6c0cd830 con 0x7fad6c15dfd0 2023-10-09T15:37:10.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.614+0000 7fad61ffb700 1 -- 172.21.15.33:0/657126993 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7fad64052190 con 0x7fad6c15dfd0 2023-10-09T15:37:10.614 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:37:10.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 msgr2=0x7fad50069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 0x7fad50069740 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fad6c06c180 tx=0x7fad68017000 comp rx=0 tx=0).stop 2023-10-09T15:37:10.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 msgr2=0x7fad6c0b39d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7fad6400cf60 tx=0x7fad64007870 comp rx=0 tx=0).stop 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 shutdown_connections 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad50067290 0x7fad50069740 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad6c15dfd0 0x7fad6c0b39d0 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad6c159550 0x7fad6c0c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 --2- 172.21.15.33:0/657126993 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad6c159920 0x7fad6c0b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 >> 172.21.15.33:0/657126993 conn(0x7fad6c06ce80 msgr2=0x7fad6c15eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 shutdown_connections 2023-10-09T15:37:10.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.616+0000 7fad728a8700 1 -- 172.21.15.33:0/657126993 wait complete. 2023-10-09T15:37:10.628 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:37:10.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 Processor -- start 2023-10-09T15:37:10.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 -- start start 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f48a40b07d0 0x7f48a40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a415a280 con 0x7f48a40cf200 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48a406e180 con 0x7f48a40b0ba0 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.747+0000 7f48a9a29700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48a406d850 con 0x7f48a40b07d0 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f489a7fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f48a40cf200 0x7f48a406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45884/0 (socket says 172.21.15.33:45884) 2023-10-09T15:37:10.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f489a7fc700 1 -- 172.21.15.33:0/2854869438 learned_addr learned my addr 172.21.15.33:0/2854869438 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a2ffd700 1 --2- 172.21.15.33:0/2854869438 >> v2:172.21.15.59:3300/0 conn(0x7f48a40b07d0 0x7f48a40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a27fc700 1 -- 172.21.15.33:0/2854869438 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 268199953 0 0) 0x7f48a415a280 con 0x7f48a40cf200 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a27fc700 1 -- 172.21.15.33:0/2854869438 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4890003570 con 0x7f48a40cf200 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a2ffd700 1 -- 172.21.15.33:0/2854869438 >> v1:172.21.15.59:6789/0 conn(0x7f48a40b0ba0 legacy=0x7f48a406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a2ffd700 1 -- 172.21.15.33:0/2854869438 >> v1:172.21.15.33:6789/0 conn(0x7f48a40cf200 legacy=0x7f48a406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a2ffd700 1 -- 172.21.15.33:0/2854869438 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a406db30 con 0x7f48a40b07d0 2023-10-09T15:37:10.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a2ffd700 1 --2- 172.21.15.33:0/2854869438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40b07d0 0x7f48a40ccac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48940098d0 tx=0x7f4894009120 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dfe51ab0f4e5c050 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.748+0000 7f48a27fc700 1 -- 172.21.15.33:0/2854869438 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894005c10 con 0x7f48a40b07d0 2023-10-09T15:37:10.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a27fc700 1 -- 172.21.15.33:0/2854869438 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4894005d70 con 0x7f48a40b07d0 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a27fc700 1 -- 172.21.15.33:0/2854869438 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4894006280 con 0x7f48a40b07d0 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 -- 172.21.15.33:0/2854869438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40b07d0 msgr2=0x7f48a40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 --2- 172.21.15.33:0/2854869438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40b07d0 0x7f48a40ccac0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f48940098d0 tx=0x7f4894009120 comp rx=0 tx=0).stop 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 -- 172.21.15.33:0/2854869438 shutdown_connections 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 --2- 172.21.15.33:0/2854869438 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40b07d0 0x7f48a40ccac0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 -- 172.21.15.33:0/2854869438 >> 172.21.15.33:0/2854869438 conn(0x7f48a406ce80 msgr2=0x7f48a40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 -- 172.21.15.33:0/2854869438 shutdown_connections 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.749+0000 7f48a9a29700 1 -- 172.21.15.33:0/2854869438 wait complete. 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.750+0000 7f48a9a29700 1 Processor -- start 2023-10-09T15:37:10.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.750+0000 7f48a9a29700 1 -- start start 2023-10-09T15:37:10.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48a40b07d0 0x7f48a4154b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40cf200 0x7f48a40c9b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a4155ec0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41560d0 con 0x7f48a40cf200 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a9a29700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48a41563b0 con 0x7f48a40b07d0 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54350/0 (socket says 172.21.15.33:54350) 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 -- 172.21.15.33:0/409446974 learned_addr learned my addr 172.21.15.33:0/409446974 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f48a2ffd700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48a40b07d0 0x7f48a4154b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 -- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48a40b07d0 msgr2=0x7f48a4154b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48a40b07d0 0x7f48a4154b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 -- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40cf200 msgr2=0x7f48a40c9b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40cf200 0x7f48a40c9b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.751+0000 7f489a7fc700 1 -- 172.21.15.33:0/409446974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48940093c0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f489a7fc700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c590 tx=0x7f488c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c005b30 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c005cb0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48a4156690 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c007320 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.752+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48a4156c50 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.753+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48a4156e70 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.753+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f488c01b3b0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.753+0000 7f489b7fe700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 0x7f4884069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:10.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.754+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f488c083ce0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.754+0000 7f48a2ffd700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 0x7f4884069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:10.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.754+0000 7f48a2ffd700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 0x7f4884069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4894009390 tx=0x7f4894016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:10.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.758+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f488c050e90 con 0x7f48a40b0ba0 2023-10-09T15:37:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.951+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f48a404c3c0 con 0x7f48a40b0ba0 2023-10-09T15:37:10.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.951+0000 7f489b7fe700 1 -- 172.21.15.33:0/409446974 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+65 (secure 0 0 0) 0x7f488c017020 con 0x7f48a40b0ba0 2023-10-09T15:37:10.951 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:10.951 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:37:10.952 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:10.952 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:37:10.952 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:37:10.952 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:10.952 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 msgr2=0x7f4884069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 0x7f4884069740 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f4894009390 tx=0x7f4894016000 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 msgr2=0x7f48a40b31c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c590 tx=0x7f488c007e00 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 shutdown_connections 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4884067290 0x7f4884069740 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48a40cf200 0x7f48a40c9b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48a40b07d0 0x7f48a4154b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 --2- 172.21.15.33:0/409446974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48a40b0ba0 0x7f48a40b31c0 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:10.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.953+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 >> 172.21.15.33:0/409446974 conn(0x7f48a406ce80 msgr2=0x7f48a4155440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.954+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 shutdown_connections 2023-10-09T15:37:10.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:10.954+0000 7f48a9a29700 1 -- 172.21.15.33:0/409446974 wait complete. 2023-10-09T15:37:10.966 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:37:10.966 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:37:11.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.088+0000 7fe9e051b700 1 Processor -- start 2023-10-09T15:37:11.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.088+0000 7fe9e051b700 1 -- start start 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.089+0000 7fe9e051b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe9d8088400 0x7fe9d80a8e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.089+0000 7fe9e051b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d80ae6f0 0x7fe9d80aeb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.089+0000 7fe9e051b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9d80ce1c0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.089+0000 7fe9e051b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe9d80af050 con 0x7fe9d8088400 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.089+0000 7fe9e051b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d80cd5b0 con 0x7fe9d80ae6f0 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9de2b7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe9d80a8aa0 0x7fe9d80b0830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45896/0 (socket says 172.21.15.33:45896) 2023-10-09T15:37:11.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9de2b7700 1 -- 172.21.15.33:0/2107557879 learned_addr learned my addr 172.21.15.33:0/2107557879 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/2107557879 >> v2:172.21.15.59:3300/0 conn(0x7fe9d8088400 0x7fe9d80a8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9deab8700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d80ae6f0 0x7fe9d80aeb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1767947900 0 0) 0x7fe9d80ce1c0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe9c0003570 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 -- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d80ae6f0 msgr2=0x7fe9d80aeb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d80ae6f0 0x7fe9d80aeb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1117536483 0 0) 0x7fe9c0003570 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 -- 172.21.15.33:0/2107557879 >> v1:172.21.15.33:6789/0 conn(0x7fe9d80a8aa0 legacy=0x7fe9d80b0830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 -- 172.21.15.33:0/2107557879 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9d80cd890 con 0x7fe9d8088400 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d8088400 0x7fe9d80a8e70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098e0 tx=0x7fe9cc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6bd605113076e0c5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00015f0 con 0x7fe9d8088400 2023-10-09T15:37:11.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.090+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9cc011420 con 0x7fe9d8088400 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9dd2b5700 1 -- 172.21.15.33:0/2107557879 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9cc0117c0 con 0x7fe9d8088400 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 -- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d8088400 msgr2=0x7fe9d80a8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d8088400 0x7fe9d80a8e70 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe9cc0098e0 tx=0x7fe9cc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 -- 172.21.15.33:0/2107557879 shutdown_connections 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d80ae6f0 0x7fe9d80aeb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 --2- 172.21.15.33:0/2107557879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d8088400 0x7fe9d80a8e70 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 -- 172.21.15.33:0/2107557879 >> 172.21.15.33:0/2107557879 conn(0x7fe9d8088000 msgr2=0x7fe9d80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 -- 172.21.15.33:0/2107557879 shutdown_connections 2023-10-09T15:37:11.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.091+0000 7fe9e051b700 1 -- 172.21.15.33:0/2107557879 wait complete. 2023-10-09T15:37:11.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.092+0000 7fe9e051b700 1 Processor -- start 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.092+0000 7fe9e051b700 1 -- start start 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d80ae6f0 0x7fe9d81454c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d809a6d0 0x7fe9d8145a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d809b870 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d809ac60 con 0x7fe9d80ae6f0 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9e051b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9d809af40 con 0x7fe9d809a6d0 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54360/0 (socket says 172.21.15.33:54360) 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 -- 172.21.15.33:0/325795071 learned_addr learned my addr 172.21.15.33:0/325795071 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:11.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9deab8700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d809a6d0 0x7fe9d8145a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 -- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d809a6d0 msgr2=0x7fe9d8145a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d809a6d0 0x7fe9d8145a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d80ae6f0 0x7fe9d81454c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 -- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d80ae6f0 msgr2=0x7fe9d81454c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d80ae6f0 0x7fe9d81454c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.093+0000 7fe9de2b7700 1 -- 172.21.15.33:0/325795071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9cc009420 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9de2b7700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00010e0 tx=0x7fe9d0001440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d0007300 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9d0007480 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9d809b220 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe9d00057f0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.094+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9d806e9e0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.095+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9d809b6c0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.095+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe9d0005be0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.096+0000 7fe9d67fc700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 0x7fe9c4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.096+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fe9d0084670 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.096+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 0x7fe9c4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:11.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.096+0000 7fe9ddab6700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 0x7fe9c4069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe9d816cd70 tx=0x7fe9cc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:11.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.100+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9d00517a0 con 0x7fe9d80a8aa0 2023-10-09T15:37:11.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:11.294+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fe9d804c3c0 con 0x7fe9d80a8aa0 2023-10-09T15:37:12.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.261+0000 7fe9d67fc700 1 -- 172.21.15.33:0/325795071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7fe9d0054dc0 con 0x7fe9d80a8aa0 2023-10-09T15:37:12.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 msgr2=0x7fe9c4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 0x7fe9c4069740 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fe9d816cd70 tx=0x7fe9cc016000 comp rx=0 tx=0).stop 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 msgr2=0x7fe9d809a190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7fe9d00010e0 tx=0x7fe9d0001440 comp rx=0 tx=0).stop 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 shutdown_connections 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe9c4067290 0x7fe9c4069740 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe9d80a8aa0 0x7fe9d809a190 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe9d809a6d0 0x7fe9d8145a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 --2- 172.21.15.33:0/325795071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe9d80ae6f0 0x7fe9d81454c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.266+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 >> 172.21.15.33:0/325795071 conn(0x7fe9d8088000 msgr2=0x7fe9d80cae90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:12.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.268+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 shutdown_connections 2023-10-09T15:37:12.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.268+0000 7fe9e051b700 1 -- 172.21.15.33:0/325795071 wait complete. 2023-10-09T15:37:12.269 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:37:12.283 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:37:12.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.416+0000 7f92c0396700 1 Processor -- start 2023-10-09T15:37:12.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.416+0000 7f92c0396700 1 -- start start 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92c0396700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f92b806dc70 0x7f92b8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92c0396700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92b80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92c0396700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92b80ccfd0 con 0x7f92b8159530 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92c0396700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92b815a3d0 con 0x7f92b806dc70 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92c0396700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815a6b0 con 0x7f92b806e0e0 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92be132700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f92b8159530 0x7f92b80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45902/0 (socket says 172.21.15.33:45902) 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92be132700 1 -- 172.21.15.33:0/40369681 learned_addr learned my addr 172.21.15.33:0/40369681 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92be933700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92b80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801057525 0 0) 0x7f92b80ccfd0 con 0x7f92b8159530 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd931700 1 --2- 172.21.15.33:0/40369681 >> v2:172.21.15.59:3300/0 conn(0x7f92b806dc70 0x7f92b8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92a0003570 con 0x7f92b8159530 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 718921628 0 0) 0x7f92a0003570 con 0x7f92b8159530 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 msgr2=0x7f92b80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92b80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 >> v2:172.21.15.59:3300/0 conn(0x7f92b806dc70 msgr2=0x7f92b8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 --2- 172.21.15.33:0/40369681 >> v2:172.21.15.59:3300/0 conn(0x7f92b806dc70 0x7f92b8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b815a990 con 0x7f92b8159530 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f92b0001470 con 0x7f92b8159530 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 >> v1:172.21.15.33:6789/0 conn(0x7f92b8159530 legacy=0x7f92b80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92a0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92a0003fe0 0x7f92a0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0004d50 0x7f92a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815a3d0 con 0x7f92a0003fe0 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b815a6b0 con 0x7f92a0004d50 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.417+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92a000ba90 con 0x7f92b806e0e0 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92a0003fe0 0x7f92a0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92be132700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92a0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92be933700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0004d50 0x7f92a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 -- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 msgr2=0x7f92a0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b806e0e0 0x7f92a0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 -- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0004d50 msgr2=0x7f92a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0004d50 0x7f92a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 -- 172.21.15.33:0/40369681 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92a0003570 con 0x7f92a0003fe0 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92be933700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0004d50 0x7f92a00051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd931700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92a0003fe0 0x7f92a0004810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009c00 tx=0x7f92ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b6e26a62b9f71f4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00e6b0 con 0x7f92a0003fe0 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92ac00e810 con 0x7f92a0003fe0 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.418+0000 7f92bd130700 1 -- 172.21.15.33:0/40369681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92ac00ebd0 con 0x7f92a0003fe0 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 -- 172.21.15.33:0/40369681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92a0003fe0 msgr2=0x7f92a0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 --2- 172.21.15.33:0/40369681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92a0003fe0 0x7f92a0004810 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f92ac009c00 tx=0x7f92ac0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92be933700 1 -- 172.21.15.33:0/40369681 reap_dead start 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 -- 172.21.15.33:0/40369681 shutdown_connections 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 -- 172.21.15.33:0/40369681 >> 172.21.15.33:0/40369681 conn(0x7f92b80703a0 msgr2=0x7f92b80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 -- 172.21.15.33:0/40369681 shutdown_connections 2023-10-09T15:37:12.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.419+0000 7f92c0396700 1 -- 172.21.15.33:0/40369681 wait complete. 2023-10-09T15:37:12.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.420+0000 7f92c0396700 1 Processor -- start 2023-10-09T15:37:12.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.420+0000 7f92c0396700 1 -- start start 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.420+0000 7f92c0396700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0003fe0 0x7f92b80b5b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b80cd6b0 0x7f92b80b34f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80b4dd0 con 0x7f92b80cdb20 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80b5670 con 0x7f92a0003fe0 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92b80b3f70 con 0x7f92b80cd6b0 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54380/0 (socket says 172.21.15.33:54380) 2023-10-09T15:37:12.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 -- 172.21.15.33:0/2808275253 learned_addr learned my addr 172.21.15.33:0/2808275253 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92bd931700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b80cd6b0 0x7f92b80b34f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be132700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0003fe0 0x7f92b80b5b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 -- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b80cd6b0 msgr2=0x7f92b80b34f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b80cd6b0 0x7f92b80b34f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 -- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0003fe0 msgr2=0x7f92b80b5b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0003fe0 0x7f92b80b5b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 -- 172.21.15.33:0/2808275253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92b80b4220 con 0x7f92b80cdb20 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92be933700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cacd0 tx=0x7f92a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a800e050 con 0x7f92b80cdb20 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92a800f040 con 0x7f92b80cdb20 2023-10-09T15:37:12.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92a8010d70 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92b80b5020 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.421+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92b80c7790 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.422+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92b80b5800 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.423+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f92a8003020 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.423+0000 7f92b67fc700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 0x7f92a4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.423+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f92a8084b40 con 0x7f92b80cdb20 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.423+0000 7f92be132700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 0x7f92a4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.424+0000 7f92be132700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 0x7f92a4069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000e50 tx=0x7f92b0001e90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:12.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.428+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92a8051a70 con 0x7f92b80cdb20 2023-10-09T15:37:12.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:12.625+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f92b804c3c0 con 0x7f92b80cdb20 2023-10-09T15:37:13.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.263+0000 7f92b67fc700 1 -- 172.21.15.33:0/2808275253 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7f92a801a0d0 con 0x7f92b80cdb20 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.268+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 msgr2=0x7f92a4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 0x7f92a4069740 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f92b0000e50 tx=0x7f92b0001e90 comp rx=0 tx=0).stop 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 msgr2=0x7f92b80b3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f92b80cacd0 tx=0x7f92a800b040 comp rx=0 tx=0).stop 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 shutdown_connections 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92a4067290 0x7f92a4069740 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92b80cdb20 0x7f92b80b3a30 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92a0003fe0 0x7f92b80b5b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 --2- 172.21.15.33:0/2808275253 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92b80cd6b0 0x7f92b80b34f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 >> 172.21.15.33:0/2808275253 conn(0x7f92b80703a0 msgr2=0x7f92b815c1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 shutdown_connections 2023-10-09T15:37:13.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.269+0000 7f92c0396700 1 -- 172.21.15.33:0/2808275253 wait complete. 2023-10-09T15:37:13.279 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:37:13.297 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:37:13.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.426+0000 7fbbd0759700 1 Processor -- start 2023-10-09T15:37:13.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.426+0000 7fbbd0759700 1 -- start start 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbd0759700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbc8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbd0759700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbd0759700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbc80ccfd0 con 0x7fbbc8159530 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbd0759700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbc815a3d0 con 0x7fbbc806e0e0 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbd0759700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815a6b0 con 0x7fbbc806dc70 2023-10-09T15:37:13.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbce4f5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbbc8159530 0x7fbbc80ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45904/0 (socket says 172.21.15.33:45904) 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.427+0000 7fbbce4f5700 1 -- 172.21.15.33:0/2921552184 learned_addr learned my addr 172.21.15.33:0/2921552184 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcecf6700 1 --2- 172.21.15.33:0/2921552184 >> v2:172.21.15.59:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 439275318 0 0) 0x7fbbc80ccfd0 con 0x7fbbc8159530 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbbb0003570 con 0x7fbbc8159530 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbc8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 389270604 0 0) 0x7fbbb0003570 con 0x7fbbc8159530 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 msgr2=0x7fbbc8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbc8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 >> v2:172.21.15.59:3300/0 conn(0x7fbbc806e0e0 msgr2=0x7fbbc80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 --2- 172.21.15.33:0/2921552184 >> v2:172.21.15.59:3300/0 conn(0x7fbbc806e0e0 0x7fbbc80cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc815a990 con 0x7fbbc8159530 2023-10-09T15:37:13.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fbbc00017f0 con 0x7fbbc8159530 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 >> v1:172.21.15.33:6789/0 conn(0x7fbbc8159530 legacy=0x7fbbc80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbb0003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbb0003fe0 0x7fbbb0004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0004d50 0x7fbbb00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815a3d0 con 0x7fbbb0003fe0 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc815a6b0 con 0x7fbbb0004d50 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbb000ba90 con 0x7fbbc806dc70 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbb0003fe0 0x7fbbb0004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbce4f5700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbb0003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.428+0000 7fbbcecf6700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0004d50 0x7fbbb00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 -- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 msgr2=0x7fbbb0003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:13.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc806dc70 0x7fbbb0003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 -- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0004d50 msgr2=0x7fbbb00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0004d50 0x7fbbb00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 -- 172.21.15.33:0/2921552184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbb0003570 con 0x7fbbb0003fe0 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbb0003fe0 0x7fbbb0004810 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009c00 tx=0x7fbbbc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e90329b1fad746 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00e6b0 con 0x7fbbb0003fe0 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbbc00e810 con 0x7fbbb0003fe0 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcd4f3700 1 -- 172.21.15.33:0/2921552184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbbc00ebd0 con 0x7fbbb0003fe0 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbd0759700 1 -- 172.21.15.33:0/2921552184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbb0003fe0 msgr2=0x7fbbb0004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbd0759700 1 --2- 172.21.15.33:0/2921552184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbb0003fe0 0x7fbbb0004810 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7fbbbc009c00 tx=0x7fbbbc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbcecf6700 1 -- 172.21.15.33:0/2921552184 reap_dead start 2023-10-09T15:37:13.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbd0759700 1 -- 172.21.15.33:0/2921552184 shutdown_connections 2023-10-09T15:37:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.429+0000 7fbbd0759700 1 -- 172.21.15.33:0/2921552184 >> 172.21.15.33:0/2921552184 conn(0x7fbbc80703a0 msgr2=0x7fbbc80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.430+0000 7fbbd0759700 1 -- 172.21.15.33:0/2921552184 shutdown_connections 2023-10-09T15:37:13.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.430+0000 7fbbd0759700 1 -- 172.21.15.33:0/2921552184 wait complete. 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 Processor -- start 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 -- start start 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0003fe0 0x7fbbc814c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc80cba80 0x7fbbc8151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80b3480 con 0x7fbbc81515b0 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc80b3d20 con 0x7fbbb0003fe0 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbd0759700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbc814c8a0 con 0x7fbbc80cba80 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbcecf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.431+0000 7fbbcecf6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54394/0 (socket says 172.21.15.33:54394) 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbce4f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0003fe0 0x7fbbc814c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 -- 172.21.15.33:0/1216395240 learned_addr learned my addr 172.21.15.33:0/1216395240 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcdcf4700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc80cba80 0x7fbbc8151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 -- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc80cba80 msgr2=0x7fbbc8151070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc80cba80 0x7fbbc8151070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 -- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0003fe0 msgr2=0x7fbbc814c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:13.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0003fe0 0x7fbbc814c360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 -- 172.21.15.33:0/1216395240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc8151ab0 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbcecf6700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8006f00 tx=0x7fbbb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8013750 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbb80138b0 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc80b36d0 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbb8013c50 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.432+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbc815d900 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.433+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbc8071010 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.434+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fbbb8014650 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.434+0000 7fbbc67fc700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 0x7fbbb4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.434+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fbbb8084f20 con 0x7fbbc81515b0 2023-10-09T15:37:13.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.434+0000 7fbbce4f5700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 0x7fbbb4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:13.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.435+0000 7fbbce4f5700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 0x7fbbb4069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00011d0 tx=0x7fbbc0006040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:13.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.439+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbb8051e60 con 0x7fbbc81515b0 2023-10-09T15:37:13.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:13.677+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fbbc804c3c0 con 0x7fbbc81515b0 2023-10-09T15:37:14.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.512+0000 7fbbc67fc700 1 -- 172.21.15.33:0/1216395240 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v63) v1 ==== 174+0+0 (secure 0 0 0) 0x7fbbb80220c0 con 0x7fbbc81515b0 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 msgr2=0x7fbbb4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 0x7fbbb4069740 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fbbc00011d0 tx=0x7fbbc0006040 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 msgr2=0x7fbbc815d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7fbbb8006f00 tx=0x7fbbb80091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 shutdown_connections 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbb4067290 0x7fbbb4069740 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbbc81515b0 0x7fbbc815d3c0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbbb0003fe0 0x7fbbc814c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 --2- 172.21.15.33:0/1216395240 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbbc80cba80 0x7fbbc8151070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 >> 172.21.15.33:0/1216395240 conn(0x7fbbc80703a0 msgr2=0x7fbbc815bb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:14.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.520+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 shutdown_connections 2023-10-09T15:37:14.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.521+0000 7fbbd0759700 1 -- 172.21.15.33:0/1216395240 wait complete. 2023-10-09T15:37:14.523 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 16 and data pool 17 2023-10-09T15:37:14.539 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:14.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.663+0000 7f6bd0586700 1 Processor -- start 2023-10-09T15:37:14.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.663+0000 7f6bd0586700 1 -- start start 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bd0586700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bc80a90d0 0x7f6bc806de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bd0586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc806e380 0x7f6bc80af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bd0586700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bc80aeee0 con 0x7f6bc80a8d00 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bd0586700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bc806e820 con 0x7f6bc80a90d0 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bd0586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80ae680 con 0x7f6bc806e380 2023-10-09T15:37:14.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bcdb21700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bc80a90d0 0x7f6bc806de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.664+0000 7f6bcdb21700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bc80a90d0 0x7f6bc806de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54402/0 (socket says 172.21.15.33:54402) 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 -- 172.21.15.33:0/1647176197 learned_addr learned my addr 172.21.15.33:0/1647176197 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bceb23700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc806e380 0x7f6bc80af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 -- 172.21.15.33:0/1647176197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc806e380 msgr2=0x7f6bc80af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc806e380 0x7f6bc80af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 -- 172.21.15.33:0/1647176197 >> v1:172.21.15.59:6789/0 conn(0x7f6bc80a8d00 legacy=0x7f6bc80cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 -- 172.21.15.33:0/1647176197 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bc80cf490 con 0x7f6bc80a90d0 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcdb21700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc806de40 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009990 tx=0x7f6bbc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fdfea728bb36310 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcd320700 1 -- 172.21.15.33:0/1647176197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc005c10 con 0x7f6bc80a90d0 2023-10-09T15:37:14.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcd320700 1 -- 172.21.15.33:0/1647176197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bbc005d70 con 0x7f6bc80a90d0 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.665+0000 7f6bcd320700 1 -- 172.21.15.33:0/1647176197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bbc00b840 con 0x7f6bc80a90d0 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 -- 172.21.15.33:0/1647176197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 msgr2=0x7f6bc806de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc806de40 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009990 tx=0x7f6bbc009220 comp rx=0 tx=0).stop 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 -- 172.21.15.33:0/1647176197 shutdown_connections 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc806e380 0x7f6bc80af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 --2- 172.21.15.33:0/1647176197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc806de40 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 -- 172.21.15.33:0/1647176197 >> 172.21.15.33:0/1647176197 conn(0x7f6bc806ce80 msgr2=0x7f6bc80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 -- 172.21.15.33:0/1647176197 shutdown_connections 2023-10-09T15:37:14.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.666+0000 7f6bd0586700 1 -- 172.21.15.33:0/1647176197 wait complete. 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.667+0000 7f6bd0586700 1 Processor -- start 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.667+0000 7f6bd0586700 1 -- start start 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 0x7f6bc80b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 0x7f6bc8148730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc80b43a0 con 0x7f6bc80a90d0 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815cac0 con 0x7f6bc806e380 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bd0586700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bc815dd00 con 0x7f6bc80a8d00 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54410/0 (socket says 172.21.15.33:54410) 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 -- 172.21.15.33:0/3151861783 learned_addr learned my addr 172.21.15.33:0/3151861783 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bcdb21700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 0x7f6bc8148730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bce322700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 0x7f6bc80b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 -- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 msgr2=0x7f6bc8148730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 0x7f6bc8148730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 -- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 msgr2=0x7f6bc80b3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 0x7f6bc80b3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 -- 172.21.15.33:0/3151861783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc009480 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bce322700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 0x7f6bc80b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bcdb21700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 0x7f6bc8148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bceb23700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c8b0 tx=0x7f6bb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.668+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8011600 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.669+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb8011760 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.669+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8011b00 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.669+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bc816e390 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.669+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bc815c2c0 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.669+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bc804c3c0 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.670+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6bb8018360 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.670+0000 7f6bc67fc700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 0x7f6bb4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.670+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bb8084840 con 0x7f6bc80a90d0 2023-10-09T15:37:14.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.670+0000 7f6bce322700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 0x7f6bb4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.671+0000 7f6bce322700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 0x7f6bb4069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000e360 tx=0x7f6bc0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:14.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.675+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bb8055020 con 0x7f6bc80a90d0 2023-10-09T15:37:14.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.872+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6bc8067b20 con 0x7f6bc80a90d0 2023-10-09T15:37:14.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.873+0000 7f6bc67fc700 1 -- 172.21.15.33:0/3151861783 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15321 (secure 0 0 0) 0x7f6bb8054bb0 con 0x7f6bc80a90d0 2023-10-09T15:37:14.873 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:14.873 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":100,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:13.677712+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:14.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 msgr2=0x7f6bb4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 0x7f6bb4069740 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f6bc000e360 tx=0x7f6bc0009040 comp rx=0 tx=0).stop 2023-10-09T15:37:14.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 msgr2=0x7f6bc816d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:14.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c8b0 tx=0x7f6bb8008040 comp rx=0 tx=0).stop 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 shutdown_connections 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bb4067290 0x7f6bb4069740 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bc80a90d0 0x7f6bc816d5a0 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bc806e380 0x7f6bc80b3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 --2- 172.21.15.33:0/3151861783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bc80a8d00 0x7f6bc8148730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 >> 172.21.15.33:0/3151861783 conn(0x7f6bc806ce80 msgr2=0x7f6bc80cc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 shutdown_connections 2023-10-09T15:37:14.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:14.875+0000 7f6bd0586700 1 -- 172.21.15.33:0/3151861783 wait complete. 2023-10-09T15:37:14.887 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:15.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.006+0000 7f2b2ce4a700 1 Processor -- start 2023-10-09T15:37:15.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 -- start start 2023-10-09T15:37:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b280cf200 0x7f2b280c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 0x7f2b2806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b2815a280 con 0x7f2b280b07d0 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b2806e180 con 0x7f2b280cf200 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.007+0000 7f2b2ce4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b2806d850 con 0x7f2b280b0ba0 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b280cf200 0x7f2b280c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b280cf200 0x7f2b280c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54426/0 (socket says 172.21.15.33:54426) 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b2659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b280b07d0 0x7f2b280ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45916/0 (socket says 172.21.15.33:45916) 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 -- 172.21.15.33:0/2792337652 learned_addr learned my addr 172.21.15.33:0/2792337652 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:15.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b26d9d700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 0x7f2b2806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 -- 172.21.15.33:0/2792337652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 msgr2=0x7f2b2806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 0x7f2b2806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 -- 172.21.15.33:0/2792337652 >> v1:172.21.15.33:6789/0 conn(0x7f2b280b07d0 legacy=0x7f2b280ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 -- 172.21.15.33:0/2792337652 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2806db30 con 0x7f2b280cf200 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b2559a700 1 -- 172.21.15.33:0/2792337652 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1775949437 0 0) 0x7f2b2815a280 con 0x7f2b280b07d0 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b26d9d700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 0x7f2b2806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b25d9b700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280c42c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2b100099b0 tx=0x7f2b10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de27708065fbbb02 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b2559a700 1 -- 172.21.15.33:0/2792337652 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000b860 con 0x7f2b280cf200 2023-10-09T15:37:15.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b2559a700 1 -- 172.21.15.33:0/2792337652 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000b9c0 con 0x7f2b280cf200 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.008+0000 7f2b2559a700 1 -- 172.21.15.33:0/2792337652 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1000bd60 con 0x7f2b280cf200 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/2792337652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 msgr2=0x7f2b280c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280c42c0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f2b100099b0 tx=0x7f2b10009250 comp rx=0 tx=0).stop 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/2792337652 shutdown_connections 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b0ba0 0x7f2b2806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/2792337652 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280c42c0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/2792337652 >> 172.21.15.33:0/2792337652 conn(0x7f2b2806ce80 msgr2=0x7f2b280ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/2792337652 shutdown_connections 2023-10-09T15:37:15.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.009+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/2792337652 wait complete. 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.010+0000 7f2b2ce4a700 1 Processor -- start 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.010+0000 7f2b2ce4a700 1 -- start start 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b07d0 0x7f2b28157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 0x7f2b2809a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280cef60 con 0x7f2b280cf200 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b28157590 con 0x7f2b280b0ba0 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2ce4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b280b26c0 con 0x7f2b280b07d0 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54438/0 (socket says 172.21.15.33:54438) 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 -- 172.21.15.33:0/385948879 learned_addr learned my addr 172.21.15.33:0/385948879 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b25d9b700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 0x7f2b2809a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b2659c700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b07d0 0x7f2b28157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 -- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b07d0 msgr2=0x7f2b28157050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b07d0 0x7f2b28157050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 -- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 msgr2=0x7f2b2809a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 0x7f2b2809a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 -- 172.21.15.33:0/385948879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b100094f0 con 0x7f2b280cf200 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b25d9b700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 0x7f2b2809a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.011+0000 7f2b26d9d700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800d180 tx=0x7f2b18009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.012+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1800de20 con 0x7f2b280cf200 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.012+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1800f040 con 0x7f2b280cf200 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.012+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18015690 con 0x7f2b280cf200 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.012+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b280b1d90 con 0x7f2b280cf200 2023-10-09T15:37:15.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.012+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b280b2350 con 0x7f2b280cf200 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.013+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2804c3c0 con 0x7f2b280cf200 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.013+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2b1801e3b0 con 0x7f2b280cf200 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.013+0000 7f2b1e7fc700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 0x7f2b08069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.013+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2b18085190 con 0x7f2b280cf200 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.014+0000 7f2b2659c700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 0x7f2b08069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.014+0000 7f2b2659c700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 0x7f2b08069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2b20002760 tx=0x7f2b20009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.018+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b18051ee0 con 0x7f2b280cf200 2023-10-09T15:37:15.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.212+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b2806de10 con 0x7f2b280cf200 2023-10-09T15:37:15.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.213+0000 7f2b1e7fc700 1 -- 172.21.15.33:0/385948879 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+15321 (secure 0 0 0) 0x7f2b18055500 con 0x7f2b280cf200 2023-10-09T15:37:15.213 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:15.213 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":100,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:13.677712+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.214+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 msgr2=0x7f2b08069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 0x7f2b08069740 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f2b20002760 tx=0x7f2b20009040 comp rx=0 tx=0).stop 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 msgr2=0x7f2b280ce490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800d180 tx=0x7f2b18009a50 comp rx=0 tx=0).stop 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 shutdown_connections 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b08067290 0x7f2b08069740 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b280cf200 0x7f2b280ce490 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b280b07d0 0x7f2b28157050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 --2- 172.21.15.33:0/385948879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b280b0ba0 0x7f2b2809a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 >> 172.21.15.33:0/385948879 conn(0x7f2b2806ce80 msgr2=0x7f2b28069130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 shutdown_connections 2023-10-09T15:37:15.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.215+0000 7f2b2ce4a700 1 -- 172.21.15.33:0/385948879 wait complete. 2023-10-09T15:37:15.227 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:37:15.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 Processor -- start 2023-10-09T15:37:15.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 -- start start 2023-10-09T15:37:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee806dc70 0x7feee8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7feee806e0e0 0x7feee80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feee80ccfd0 con 0x7feee8159530 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feee815a3d0 con 0x7feee806e0e0 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.352+0000 7feeed277700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee815a6b0 con 0x7feee806dc70 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7feee806e0e0 0x7feee80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7feee806e0e0 0x7feee80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54440/0 (socket says 172.21.15.33:54440) 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 -- 172.21.15.33:0/527576438 learned_addr learned my addr 172.21.15.33:0/527576438 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:15.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee67fc700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee806dc70 0x7feee8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 -- 172.21.15.33:0/527576438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee806dc70 msgr2=0x7feee8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee806dc70 0x7feee8159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 -- 172.21.15.33:0/527576438 >> v1:172.21.15.59:6789/0 conn(0x7feee8159530 legacy=0x7feee80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 -- 172.21.15.33:0/527576438 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee815a990 con 0x7feee806e0e0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee77fe700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806e0e0 0x7feee80cb6f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7feee00099b0 tx=0x7feee0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eb629a5b7f97425 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee5ffb700 1 -- 172.21.15.33:0/527576438 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000b820 con 0x7feee806e0e0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee5ffb700 1 -- 172.21.15.33:0/527576438 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feee000b980 con 0x7feee806e0e0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.353+0000 7feee5ffb700 1 -- 172.21.15.33:0/527576438 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feee000bd20 con 0x7feee806e0e0 2023-10-09T15:37:15.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 -- 172.21.15.33:0/527576438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806e0e0 msgr2=0x7feee80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806e0e0 0x7feee80cb6f0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7feee00099b0 tx=0x7feee0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 -- 172.21.15.33:0/527576438 shutdown_connections 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806e0e0 0x7feee80cb6f0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 --2- 172.21.15.33:0/527576438 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee806dc70 0x7feee8159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 -- 172.21.15.33:0/527576438 >> 172.21.15.33:0/527576438 conn(0x7feee80703a0 msgr2=0x7feee80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 -- 172.21.15.33:0/527576438 shutdown_connections 2023-10-09T15:37:15.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.354+0000 7feeed277700 1 -- 172.21.15.33:0/527576438 wait complete. 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.355+0000 7feeed277700 1 Processor -- start 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.355+0000 7feeed277700 1 -- start start 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee806e0e0 0x7feee80c8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee8159530 0x7feee8153ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee8143a00 con 0x7feee806dc70 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feee80c8560 con 0x7feee806e0e0 2023-10-09T15:37:15.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeed277700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feee8154220 con 0x7feee8159530 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54452/0 (socket says 172.21.15.33:54452) 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 -- 172.21.15.33:0/3949272820 learned_addr learned my addr 172.21.15.33:0/3949272820 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee77fe700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee8159530 0x7feee8153ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee67fc700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee806e0e0 0x7feee80c8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 -- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee8159530 msgr2=0x7feee8153ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee8159530 0x7feee8153ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 -- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee806e0e0 msgr2=0x7feee80c8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee806e0e0 0x7feee80c8020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 -- 172.21.15.33:0/3949272820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feee00094f0 con 0x7feee806dc70 2023-10-09T15:37:15.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feee6ffd700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7feed800bc30 tx=0x7feed8009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.356+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed800c9b0 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.357+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feed800cb50 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.357+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feee8157c90 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.357+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feed8014410 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.357+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feee8157640 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.357+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feee8157480 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.358+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7feed8014800 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.358+0000 7feeceffd700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 0x7feed4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.358+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7feed8084b20 con 0x7feee806dc70 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.358+0000 7feee67fc700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 0x7feed4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:15.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.359+0000 7feee67fc700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 0x7feed4069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feedc00ab30 tx=0x7feedc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:15.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.362+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7feed804c5a0 con 0x7feee806dc70 2023-10-09T15:37:15.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:15.603+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7feee804c3c0 con 0x7feee806dc70 2023-10-09T15:37:16.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.528+0000 7feeceffd700 1 -- 172.21.15.33:0/3949272820 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v66) v1 ==== 118+0+0 (secure 0 0 0) 0x7feed8051980 con 0x7feee806dc70 2023-10-09T15:37:16.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 msgr2=0x7feed4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 0x7feed4069740 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7feedc00ab30 tx=0x7feedc008040 comp rx=0 tx=0).stop 2023-10-09T15:37:16.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 msgr2=0x7feee816a7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7feed800bc30 tx=0x7feed8009820 comp rx=0 tx=0).stop 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 shutdown_connections 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7feed4067290 0x7feed4069740 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feee806dc70 0x7feee816a7a0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feee8159530 0x7feee8153ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 --2- 172.21.15.33:0/3949272820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feee806e0e0 0x7feee80c8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 >> 172.21.15.33:0/3949272820 conn(0x7feee80703a0 msgr2=0x7feee80cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 shutdown_connections 2023-10-09T15:37:16.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.531+0000 7feeed277700 1 -- 172.21.15.33:0/3949272820 wait complete. 2023-10-09T15:37:16.547 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:37:16.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.673+0000 7f42fe519700 1 Processor -- start 2023-10-09T15:37:16.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.674+0000 7f42fe519700 1 -- start start 2023-10-09T15:37:16.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.674+0000 7f42fe519700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42f80c7f90 0x7f42f806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:16.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.674+0000 7f42fe519700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f80ca480 con 0x7f42f8142fd0 2023-10-09T15:37:16.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.674+0000 7f42fe519700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42f815e240 con 0x7f42f8142c00 2023-10-09T15:37:16.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.674+0000 7f42fe519700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42f806b350 con 0x7f42f80c7f90 2023-10-09T15:37:16.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fcd16700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f42f8142fd0 0x7f42f80c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45926/0 (socket says 172.21.15.33:45926) 2023-10-09T15:37:16.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fcd16700 1 -- 172.21.15.33:0/2462469579 learned_addr learned my addr 172.21.15.33:0/2462469579 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:16.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fdd18700 1 --2- 172.21.15.33:0/2462469579 >> v2:172.21.15.59:3300/0 conn(0x7f42f80c7f90 0x7f42f806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:16.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42f7fff700 1 -- 172.21.15.33:0/2462469579 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834972919 0 0) 0x7f42f80ca480 con 0x7f42f8142fd0 2023-10-09T15:37:16.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42f7fff700 1 -- 172.21.15.33:0/2462469579 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42e0003570 con 0x7f42f8142fd0 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fdd18700 1 -- 172.21.15.33:0/2462469579 >> v1:172.21.15.59:6789/0 conn(0x7f42f8142c00 legacy=0x7f42f806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fdd18700 1 -- 172.21.15.33:0/2462469579 >> v1:172.21.15.33:6789/0 conn(0x7f42f8142fd0 legacy=0x7f42f80c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fdd18700 1 -- 172.21.15.33:0/2462469579 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42f815df60 con 0x7f42f80c7f90 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.675+0000 7f42fdd18700 1 --2- 172.21.15.33:0/2462469579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f80c7f90 0x7f42f806c6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009e60 tx=0x7f42e8009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5bd722e4230c685b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42f7fff700 1 -- 172.21.15.33:0/2462469579 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e800e070 con 0x7f42f80c7f90 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42f7fff700 1 -- 172.21.15.33:0/2462469579 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42e800bb60 con 0x7f42f80c7f90 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42f7fff700 1 -- 172.21.15.33:0/2462469579 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42e8012430 con 0x7f42f80c7f90 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 -- 172.21.15.33:0/2462469579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f80c7f90 msgr2=0x7f42f806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 --2- 172.21.15.33:0/2462469579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f80c7f90 0x7f42f806c6a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f42e8009e60 tx=0x7f42e8009780 comp rx=0 tx=0).stop 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 -- 172.21.15.33:0/2462469579 shutdown_connections 2023-10-09T15:37:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 --2- 172.21.15.33:0/2462469579 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f80c7f90 0x7f42f806c6a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 -- 172.21.15.33:0/2462469579 >> 172.21.15.33:0/2462469579 conn(0x7f42f80675a0 msgr2=0x7f42f80679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 -- 172.21.15.33:0/2462469579 shutdown_connections 2023-10-09T15:37:16.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.676+0000 7f42fe519700 1 -- 172.21.15.33:0/2462469579 wait complete. 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.677+0000 7f42fe519700 1 Processor -- start 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.677+0000 7f42fe519700 1 -- start start 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 0x7f42f81587e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f8142fd0 0x7f42f80affe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f81698b0 con 0x7f42f80c7f90 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42f80b0520 con 0x7f42f8142c00 2023-10-09T15:37:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fe519700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42f816a6c0 con 0x7f42f8142fd0 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fd517700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fd517700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54466/0 (socket says 172.21.15.33:54466) 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fd517700 1 -- 172.21.15.33:0/123025724 learned_addr learned my addr 172.21.15.33:0/123025724 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.678+0000 7f42fcd16700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 0x7f42f81587e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 -- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f8142fd0 msgr2=0x7f42f80affe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fdd18700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f8142fd0 0x7f42f80affe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f8142fd0 0x7f42f80affe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 -- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 msgr2=0x7f42f81587e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 0x7f42f81587e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 -- 172.21.15.33:0/123025724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42e8009a20 con 0x7f42f80c7f90 2023-10-09T15:37:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fcd16700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 0x7f42f81587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fd517700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c790 tx=0x7f42f0007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0012630 con 0x7f42f80c7f90 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42f00127b0 con 0x7f42f80c7f90 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42f8169ab0 con 0x7f42f80c7f90 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42f0012b70 con 0x7f42f80c7f90 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.679+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42f816a070 con 0x7f42f80c7f90 2023-10-09T15:37:16.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.680+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42f804c3c0 con 0x7f42f80c7f90 2023-10-09T15:37:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.680+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f42f001b400 con 0x7f42f80c7f90 2023-10-09T15:37:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.681+0000 7f42f57fa700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 0x7f42e4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.681+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f42f0084570 con 0x7f42f80c7f90 2023-10-09T15:37:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.681+0000 7f42fcd16700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 0x7f42e4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:16.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.681+0000 7f42fcd16700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 0x7f42e4069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0058d0 tx=0x7f42ec009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:16.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.685+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42f00513d0 con 0x7f42f80c7f90 2023-10-09T15:37:16.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:16.928+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f42f806ad00 con 0x7f42f80c7f90 2023-10-09T15:37:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.537+0000 7f42f57fa700 1 -- 172.21.15.33:0/123025724 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v67) v1 ==== 122+0+0 (secure 0 0 0) 0x7f42f00549f0 con 0x7f42f80c7f90 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 msgr2=0x7f42e4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 0x7f42e4069740 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f42ec0058d0 tx=0x7f42ec009040 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 msgr2=0x7f42f8159300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f42f000c790 tx=0x7f42f0007f60 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 shutdown_connections 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f42e4067290 0x7f42e4069740 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42f80c7f90 0x7f42f8159300 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f42f8142fd0 0x7f42f80affe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 --2- 172.21.15.33:0/123025724 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42f8142c00 0x7f42f81587e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 >> 172.21.15.33:0/123025724 conn(0x7f42f80675a0 msgr2=0x7f42f80c8780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 shutdown_connections 2023-10-09T15:37:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.540+0000 7f42fe519700 1 -- 172.21.15.33:0/123025724 wait complete. 2023-10-09T15:37:17.554 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.677+0000 7fc131979700 1 Processor -- start 2023-10-09T15:37:17.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.677+0000 7fc131979700 1 -- start start 2023-10-09T15:37:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc131979700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc12c0cb5a0 0x7fc12c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc131979700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c15ae40 con 0x7fc12c15a5d0 2023-10-09T15:37:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc131979700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc12c15ab60 con 0x7fc12c0cd9e0 2023-10-09T15:37:17.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc131979700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc12c0d13f0 con 0x7fc12c0cb5a0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc12b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc12c15a5d0 0x7fc12c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45936/0 (socket says 172.21.15.33:45936) 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc12b7fe700 1 -- 172.21.15.33:0/1398106900 learned_addr learned my addr 172.21.15.33:0/1398106900 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc12affd700 1 --2- 172.21.15.33:0/1398106900 >> v2:172.21.15.59:3300/0 conn(0x7fc12c0cb5a0 0x7fc12c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2083682157 0 0) 0x7fc12c15ae40 con 0x7fc12c15a5d0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.678+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc118003570 con 0x7fc12c15a5d0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1868360183 0 0) 0x7fc118003570 con 0x7fc12c15a5d0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 >> v2:172.21.15.59:3300/0 conn(0x7fc12c0cb5a0 msgr2=0x7fc12c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 --2- 172.21.15.33:0/1398106900 >> v2:172.21.15.59:3300/0 conn(0x7fc12c0cb5a0 0x7fc12c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 >> v1:172.21.15.59:6789/0 conn(0x7fc12c0cd9e0 legacy=0x7fc12c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c0ccf00 con 0x7fc12c15a5d0 2023-10-09T15:37:17.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fc11c0017f0 con 0x7fc12c15a5d0 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 >> v1:172.21.15.33:6789/0 conn(0x7fc12c15a5d0 legacy=0x7fc12c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc118003a60 0x7fc118003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc118004810 0x7fc118004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc11800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800c050 con 0x7fc1180051c0 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800c190 con 0x7fc118003a60 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc11800c350 con 0x7fc118004810 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc11800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12affd700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc118003a60 0x7fc118003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12a7fc700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc118004810 0x7fc118004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 -- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc118004810 msgr2=0x7fc118004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:17.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc118004810 0x7fc118004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 -- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc118003a60 msgr2=0x7fc118003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc118003a60 0x7fc118003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 -- 172.21.15.33:0/1398106900 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc118003570 con 0x7fc1180051c0 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12affd700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc118003a60 0x7fc118003e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 -- 172.21.15.33:0/1398106900 reap_dead start 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.679+0000 7fc12b7fe700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc11800ba60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00a950 tx=0x7fc11c0021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daf9f2f0b394fdc5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c0070d0 con 0x7fc1180051c0 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc11c007270 con 0x7fc1180051c0 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc129ffb700 1 -- 172.21.15.33:0/1398106900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc11c007630 con 0x7fc1180051c0 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 -- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 msgr2=0x7fc11800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc11800ba60 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fc11c00a950 tx=0x7fc11c0021f0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 -- 172.21.15.33:0/1398106900 shutdown_connections 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 --2- 172.21.15.33:0/1398106900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc11800ba60 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 -- 172.21.15.33:0/1398106900 >> 172.21.15.33:0/1398106900 conn(0x7fc12c070e30 msgr2=0x7fc12c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 -- 172.21.15.33:0/1398106900 shutdown_connections 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.680+0000 7fc131979700 1 -- 172.21.15.33:0/1398106900 wait complete. 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.681+0000 7fc131979700 1 Processor -- start 2023-10-09T15:37:17.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.681+0000 7fc131979700 1 -- start start 2023-10-09T15:37:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc12c169460 0x7fc12c151bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.688 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc12c0b5cd0 0x7fc12c0b6150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c169930 con 0x7fc1180051c0 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c169c10 con 0x7fc12c169460 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc131979700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc12c169ef0 con 0x7fc12c0b5cd0 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54490/0 (socket says 172.21.15.33:54490) 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12affd700 1 -- 172.21.15.33:0/2943734370 learned_addr learned my addr 172.21.15.33:0/2943734370 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12b7fe700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc12c0b5cd0 0x7fc12c0b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12a7fc700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc12c169460 0x7fc12c151bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12affd700 1 -- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc12c0b5cd0 msgr2=0x7fc12c0b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.682+0000 7fc12affd700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc12c0b5cd0 0x7fc12c0b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc12affd700 1 -- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc12c169460 msgr2=0x7fc12c151bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc12affd700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc12c169460 0x7fc12c151bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc12affd700 1 -- 172.21.15.33:0/2943734370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc12c16a1d0 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc12affd700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc124011d70 tx=0x7fc1240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc12400fcd0 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc12400fe30 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc124014670 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc12c0b21e0 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.683+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc12c0b26d0 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.684+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc12c04c3c0 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.684+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc124014a60 con 0x7fc1180051c0 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.685+0000 7fc122ffd700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 0x7fc10c069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:17.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.685+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc124018070 con 0x7fc1180051c0 2023-10-09T15:37:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.685+0000 7fc12a7fc700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 0x7fc10c069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.685+0000 7fc12a7fc700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 0x7fc10c069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc12c1670b0 tx=0x7fc114009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:17.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.689+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc124052500 con 0x7fc1180051c0 2023-10-09T15:37:17.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.925+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc12c0c8950 con 0x7fc1180051c0 2023-10-09T15:37:17.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.926+0000 7fc122ffd700 1 -- 172.21.15.33:0/2943734370 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fc124055b20 con 0x7fc1180051c0 2023-10-09T15:37:17.927 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:17.927 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:17.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 msgr2=0x7fc10c069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 0x7fc10c069740 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fc12c1670b0 tx=0x7fc114009040 comp rx=0 tx=0).stop 2023-10-09T15:37:17.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 msgr2=0x7fc12c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:17.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fc124011d70 tx=0x7fc1240091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 shutdown_connections 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc10c067290 0x7fc10c069740 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1180051c0 0x7fc12c0b34b0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc12c0b5cd0 0x7fc12c0b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 --2- 172.21.15.33:0/2943734370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc12c169460 0x7fc12c151bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 >> 172.21.15.33:0/2943734370 conn(0x7fc12c070e30 msgr2=0x7fc12c0c6990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 shutdown_connections 2023-10-09T15:37:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:17.928+0000 7fc131979700 1 -- 172.21.15.33:0/2943734370 wait complete. 2023-10-09T15:37:17.931 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 67 2023-10-09T15:37:17.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 Processor -- start 2023-10-09T15:37:18.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 -- start start 2023-10-09T15:37:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40cb5a0 0x7fb2a40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 0x7fb2a4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb2a40cde50 0x7fb2a415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a40d13f0 con 0x7fb2a40cde50 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2a415a940 con 0x7fb2a40cd9e0 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.060+0000 7fb2a9d95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a415ae40 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb2a40cde50 0x7fb2a415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb2a40cde50 0x7fb2a415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54506/0 (socket says 172.21.15.33:54506) 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 -- 172.21.15.33:0/859486276 learned_addr learned my addr 172.21.15.33:0/859486276 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a37fe700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40cb5a0 0x7fb2a40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a2ffd700 1 --2- 172.21.15.33:0/859486276 >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 0x7fb2a4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 -- 172.21.15.33:0/859486276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40cb5a0 msgr2=0x7fb2a40cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40cb5a0 0x7fb2a40cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 -- 172.21.15.33:0/859486276 >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 msgr2=0x7fb2a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 --2- 172.21.15.33:0/859486276 >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 0x7fb2a4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 -- 172.21.15.33:0/859486276 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a415ab60 con 0x7fb2a40cde50 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a2ffd700 1 --2- 172.21.15.33:0/859486276 >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 0x7fb2a4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a3fff700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cde50 0x7fb2a415a400 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb2a406ea90 tx=0x7fb29c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5199fe4fe3a7cd6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a27fc700 1 -- 172.21.15.33:0/859486276 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c00e070 con 0x7fb2a40cde50 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a27fc700 1 -- 172.21.15.33:0/859486276 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29c00b990 con 0x7fb2a40cde50 2023-10-09T15:37:18.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.061+0000 7fb2a27fc700 1 -- 172.21.15.33:0/859486276 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29c0092e0 con 0x7fb2a40cde50 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 -- 172.21.15.33:0/859486276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cde50 msgr2=0x7fb2a415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cde50 0x7fb2a415a400 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fb2a406ea90 tx=0x7fb29c009840 comp rx=0 tx=0).stop 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 -- 172.21.15.33:0/859486276 shutdown_connections 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cde50 0x7fb2a415a400 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/859486276 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a40cb5a0 0x7fb2a40cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/859486276 >> v2:172.21.15.59:3300/0 conn(0x7fb2a40cd9e0 0x7fb2a4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 -- 172.21.15.33:0/859486276 >> 172.21.15.33:0/859486276 conn(0x7fb2a4070e30 msgr2=0x7fb2a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:18.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 -- 172.21.15.33:0/859486276 shutdown_connections 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.062+0000 7fb2a9d95700 1 -- 172.21.15.33:0/859486276 wait complete. 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.063+0000 7fb2a9d95700 1 Processor -- start 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.063+0000 7fb2a9d95700 1 -- start start 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a40cd9e0 0x7fb2a4157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a4169370 0x7fb2a40b4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a40c8cc0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4169930 con 0x7fb2a40cd9e0 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a9d95700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2a4169c10 con 0x7fb2a4169370 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54518/0 (socket says 172.21.15.33:54518) 2023-10-09T15:37:18.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 -- 172.21.15.33:0/3599869938 learned_addr learned my addr 172.21.15.33:0/3599869938 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a3fff700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a4169370 0x7fb2a40b4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a2ffd700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a40cd9e0 0x7fb2a4157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 -- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a4169370 msgr2=0x7fb2a40b4990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a4169370 0x7fb2a40b4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 -- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a40cd9e0 msgr2=0x7fb2a4157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a40cd9e0 0x7fb2a4157240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.064+0000 7fb2a37fe700 1 -- 172.21.15.33:0/3599869938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb29c009ae0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb2a37fe700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb29400ec80 tx=0x7fb2940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29400c9d0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29400cb30 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2a4169ef0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb294013470 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.065+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2a4157780 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.066+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2a404c3c0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.066+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb294013820 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.067+0000 7fb28b7fe700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 0x7fb290069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.067+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb294084de0 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.067+0000 7fb2a2ffd700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 0x7fb290069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.067+0000 7fb2a2ffd700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 0x7fb290069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb298006f00 tx=0x7fb298008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.071+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb294051c40 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.265+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb2a40ccf00 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.266+0000 7fb28b7fe700 1 -- 172.21.15.33:0/3599869938 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15308 (secure 0 0 0) 0x7fb294055260 con 0x7fb2a40cb5a0 2023-10-09T15:37:18.267 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:18.267 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":101,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:15.262273+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 msgr2=0x7fb290069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 0x7fb290069740 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb298006f00 tx=0x7fb298008040 comp rx=0 tx=0).stop 2023-10-09T15:37:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 msgr2=0x7fb2a4156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7fb29400ec80 tx=0x7fb2940091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 shutdown_connections 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb290067290 0x7fb290069740 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2a40cb5a0 0x7fb2a4156370 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2a4169370 0x7fb2a40b4990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 --2- 172.21.15.33:0/3599869938 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2a40cd9e0 0x7fb2a4157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 >> 172.21.15.33:0/3599869938 conn(0x7fb2a4070e30 msgr2=0x7fb2a40c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 shutdown_connections 2023-10-09T15:37:18.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.268+0000 7fb2a9d95700 1 -- 172.21.15.33:0/3599869938 wait complete. 2023-10-09T15:37:18.281 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:37:18.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:18.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.400+0000 7f9df9292700 1 Processor -- start 2023-10-09T15:37:18.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.400+0000 7f9df9292700 1 -- start start 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df9292700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9df40b07d0 0x7f9df40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df9292700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df9292700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9df415a280 con 0x7f9df40cf200 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df9292700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9df406e180 con 0x7f9df40b07d0 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df9292700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df406d850 con 0x7f9df40b0ba0 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9df40b07d0 0x7f9df40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df40c42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:40376/0 (socket says 172.21.15.33:40376) 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df2ffd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9df40b07d0 0x7f9df40ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:32854/0 (socket says 172.21.15.33:32854) 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df37fe700 1 -- 172.21.15.33:0/2254392450 learned_addr learned my addr 172.21.15.33:0/2254392450 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.401+0000 7f9df27fc700 1 --1- 172.21.15.33:0/2254392450 >> v1:172.21.15.59:6789/0 conn(0x7f9df40cf200 0x7f9df406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:39462/0 (socket says 172.21.15.33:39462) 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df2ffd700 1 -- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 msgr2=0x7f9df40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df2ffd700 1 --2- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df40c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df2ffd700 1 -- 172.21.15.33:0/2254392450 >> v1:172.21.15.59:6789/0 conn(0x7f9df40cf200 legacy=0x7f9df406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df2ffd700 1 -- 172.21.15.33:0/2254392450 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9df406db30 con 0x7f9df40b07d0 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df2ffd700 1 --2- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40ccac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009eb0 tx=0x7f9dec009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d919a9e3e35e3716 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df1ffb700 1 -- 172.21.15.33:0/2254392450 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00e070 con 0x7f9df40b07d0 2023-10-09T15:37:18.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df1ffb700 1 -- 172.21.15.33:0/2254392450 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00bc30 con 0x7f9df40b07d0 2023-10-09T15:37:18.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.402+0000 7f9df1ffb700 1 -- 172.21.15.33:0/2254392450 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec012430 con 0x7f9df40b07d0 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 -- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 msgr2=0x7f9df40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 --2- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40ccac0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009eb0 tx=0x7f9dec009780 comp rx=0 tx=0).stop 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 -- 172.21.15.33:0/2254392450 shutdown_connections 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 --2- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40ccac0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 --2- 172.21.15.33:0/2254392450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df40c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 -- 172.21.15.33:0/2254392450 >> 172.21.15.33:0/2254392450 conn(0x7f9df406ce80 msgr2=0x7f9df40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:18.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 -- 172.21.15.33:0/2254392450 shutdown_connections 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.403+0000 7f9df9292700 1 -- 172.21.15.33:0/2254392450 wait complete. 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.404+0000 7f9df9292700 1 Processor -- start 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.404+0000 7f9df9292700 1 -- start start 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40c6b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df4151540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4158550 con 0x7f9df40cf200 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9df4151a80 con 0x7f9df40b07d0 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df9292700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9df41576a0 con 0x7f9df40b0ba0 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54524/0 (socket says 172.21.15.33:54524) 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 -- 172.21.15.33:0/697540068 learned_addr learned my addr 172.21.15.33:0/697540068 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df27fc700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df4151540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df2ffd700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40c6b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 -- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 msgr2=0x7f9df4151540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df4151540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 -- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 msgr2=0x7f9df40c6b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40c6b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 -- 172.21.15.33:0/697540068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009a20 con 0x7f9df40cf200 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.405+0000 7f9df37fe700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e930 tx=0x7f9de4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4013680 con 0x7f9df40cf200 2023-10-09T15:37:18.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9de40137e0 con 0x7f9df40cf200 2023-10-09T15:37:18.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9df4157940 con 0x7f9df40cf200 2023-10-09T15:37:18.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9de4013ba0 con 0x7f9df40cf200 2023-10-09T15:37:18.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df4157f00 con 0x7f9df40cf200 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.406+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9df4158700 con 0x7f9df40cf200 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.407+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f9de400c3e0 con 0x7f9df40cf200 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.407+0000 7f9deaffd700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 0x7f9dd4069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.407+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9de4084c10 con 0x7f9df40cf200 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.407+0000 7f9df2ffd700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 0x7f9dd4069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.408+0000 7f9df2ffd700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 0x7f9dd4069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009eb0 tx=0x7f9dec019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.412+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9df4158700 con 0x7f9df40cf200 2023-10-09T15:37:18.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.603+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9df4071230 con 0x7f9dd4067290 2023-10-09T15:37:18.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.611+0000 7f9deaffd700 1 -- 172.21.15.33:0/697540068 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286649 (secure 0 0 0) 0x7f9df4071230 con 0x7f9dd4067290 2023-10-09T15:37:18.616 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 msgr2=0x7f9dd4069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 0x7f9dd4069740 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f9dec009eb0 tx=0x7f9dec019000 comp rx=0 tx=0).stop 2023-10-09T15:37:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 msgr2=0x7f9df4157160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f9de400e930 tx=0x7f9de4009250 comp rx=0 tx=0).stop 2023-10-09T15:37:18.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 shutdown_connections 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9dd4067290 0x7f9dd4069740 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9df40cf200 0x7f9df4157160 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9df40b07d0 0x7f9df40c6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 --2- 172.21.15.33:0/697540068 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9df40b0ba0 0x7f9df4151540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 >> 172.21.15.33:0/697540068 conn(0x7f9df406ce80 msgr2=0x7f9df40c32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 shutdown_connections 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.615+0000 7f9df9292700 1 -- 172.21.15.33:0/697540068 wait complete. 2023-10-09T15:37:18.619 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:18.628 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-09T15:37:17.312507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2413584,"kb_used_data":10704,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752561136,"statfs":{"total":773094113280,"available":770622603264,"internally_reserved":0,"allocated":10960896,"data_stored":5375172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.053314"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277976+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:35.220293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266059+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.273813+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278978+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:44.351963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271478+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:39.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279173+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:28.601902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269408+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:57:42.081268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272266+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271974+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272745+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265575+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278416+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:02.981063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271786+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.270560+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278124+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:01.457814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278971+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:41.642932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265520+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267564+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.273271+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264928+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:53.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267123+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266944+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264498+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:19.807231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266602+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264992+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:04.477658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272104+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279883+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:57:42.081268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266820+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266642+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268059+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:06.608648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277382+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:28.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277773+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:47:24.183392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279330+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:20.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.276939+0000","last_change":"2023-10-09T15:37:13.276939+0000","last_active":"2023-10-09T15:37:13.276939+0000","last_peered":"2023-10-09T15:37:13.276939+0000","last_clean":"2023-10-09T15:37:13.276939+0000","last_became_active":"2023-10-09T15:37:13.276618+0000","last_became_peered":"2023-10-09T15:37:13.276618+0000","last_unstale":"2023-10-09T15:37:13.276939+0000","last_undegraded":"2023-10-09T15:37:13.276939+0000","last_fullsized":"2023-10-09T15:37:13.276939+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267415+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.277106+0000","last_change":"2023-10-09T15:37:13.277106+0000","last_active":"2023-10-09T15:37:13.277106+0000","last_peered":"2023-10-09T15:37:13.277106+0000","last_clean":"2023-10-09T15:37:13.277106+0000","last_became_active":"2023-10-09T15:37:13.276756+0000","last_became_peered":"2023-10-09T15:37:13.276756+0000","last_unstale":"2023-10-09T15:37:13.277106+0000","last_undegraded":"2023-10-09T15:37:13.277106+0000","last_fullsized":"2023-10-09T15:37:13.277106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:52.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279486+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:09.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283184+0000","last_change":"2023-10-09T15:37:13.283184+0000","last_active":"2023-10-09T15:37:13.283184+0000","last_peered":"2023-10-09T15:37:13.283184+0000","last_clean":"2023-10-09T15:37:13.283184+0000","last_became_active":"2023-10-09T15:37:13.282883+0000","last_became_peered":"2023-10-09T15:37:13.282883+0000","last_unstale":"2023-10-09T15:37:13.283184+0000","last_undegraded":"2023-10-09T15:37:13.283184+0000","last_fullsized":"2023-10-09T15:37:13.283184+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:58.065576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272764+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283087+0000","last_change":"2023-10-09T15:37:13.283087+0000","last_active":"2023-10-09T15:37:13.283087+0000","last_peered":"2023-10-09T15:37:13.283087+0000","last_clean":"2023-10-09T15:37:13.283087+0000","last_became_active":"2023-10-09T15:37:13.282773+0000","last_became_peered":"2023-10-09T15:37:13.282773+0000","last_unstale":"2023-10-09T15:37:13.283087+0000","last_undegraded":"2023-10-09T15:37:13.283087+0000","last_fullsized":"2023-10-09T15:37:13.283087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:46.940465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.276741+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.281132+0000","last_change":"2023-10-09T15:37:13.281132+0000","last_active":"2023-10-09T15:37:13.281132+0000","last_peered":"2023-10-09T15:37:13.281132+0000","last_clean":"2023-10-09T15:37:13.281132+0000","last_became_active":"2023-10-09T15:37:13.280901+0000","last_became_peered":"2023-10-09T15:37:13.280901+0000","last_unstale":"2023-10-09T15:37:13.281132+0000","last_undegraded":"2023-10-09T15:37:13.281132+0000","last_fullsized":"2023-10-09T15:37:13.281132+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266063+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.269828+0000","last_change":"2023-10-09T15:37:13.269828+0000","last_active":"2023-10-09T15:37:13.269828+0000","last_peered":"2023-10-09T15:37:13.269828+0000","last_clean":"2023-10-09T15:37:13.269828+0000","last_became_active":"2023-10-09T15:37:13.269489+0000","last_became_peered":"2023-10-09T15:37:13.269489+0000","last_unstale":"2023-10-09T15:37:13.269828+0000","last_undegraded":"2023-10-09T15:37:13.269828+0000","last_fullsized":"2023-10-09T15:37:13.269828+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:46.511413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.286790+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:29.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274950+0000","last_change":"2023-10-09T15:37:13.274950+0000","last_active":"2023-10-09T15:37:13.274950+0000","last_peered":"2023-10-09T15:37:13.274950+0000","last_clean":"2023-10-09T15:37:13.274950+0000","last_became_active":"2023-10-09T15:37:13.274547+0000","last_became_peered":"2023-10-09T15:37:13.274547+0000","last_unstale":"2023-10-09T15:37:13.274950+0000","last_undegraded":"2023-10-09T15:37:13.274950+0000","last_fullsized":"2023-10-09T15:37:13.274950+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268329+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:28.601902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288878+0000","last_change":"2023-10-09T15:37:13.288878+0000","last_active":"2023-10-09T15:37:13.288878+0000","last_peered":"2023-10-09T15:37:13.288878+0000","last_clean":"2023-10-09T15:37:13.288878+0000","last_became_active":"2023-10-09T15:37:13.287910+0000","last_became_peered":"2023-10-09T15:37:13.287910+0000","last_unstale":"2023-10-09T15:37:13.288878+0000","last_undegraded":"2023-10-09T15:37:13.288878+0000","last_fullsized":"2023-10-09T15:37:13.288878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:14.196333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268773+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:09.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282437+0000","last_change":"2023-10-09T15:37:13.282437+0000","last_active":"2023-10-09T15:37:13.282437+0000","last_peered":"2023-10-09T15:37:13.282437+0000","last_clean":"2023-10-09T15:37:13.282437+0000","last_became_active":"2023-10-09T15:37:13.282148+0000","last_became_peered":"2023-10-09T15:37:13.282148+0000","last_unstale":"2023-10-09T15:37:13.282437+0000","last_undegraded":"2023-10-09T15:37:13.282437+0000","last_fullsized":"2023-10-09T15:37:13.282437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:29.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266905+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:53.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274732+0000","last_change":"2023-10-09T15:37:13.274732+0000","last_active":"2023-10-09T15:37:13.274732+0000","last_peered":"2023-10-09T15:37:13.274732+0000","last_clean":"2023-10-09T15:37:13.274732+0000","last_became_active":"2023-10-09T15:37:13.274416+0000","last_became_peered":"2023-10-09T15:37:13.274416+0000","last_unstale":"2023-10-09T15:37:13.274732+0000","last_undegraded":"2023-10-09T15:37:13.274732+0000","last_fullsized":"2023-10-09T15:37:13.274732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:59.743080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266282+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288137+0000","last_change":"2023-10-09T15:37:13.288137+0000","last_active":"2023-10-09T15:37:13.288137+0000","last_peered":"2023-10-09T15:37:13.288137+0000","last_clean":"2023-10-09T15:37:13.288137+0000","last_became_active":"2023-10-09T15:37:13.287608+0000","last_became_peered":"2023-10-09T15:37:13.287608+0000","last_unstale":"2023-10-09T15:37:13.288137+0000","last_undegraded":"2023-10-09T15:37:13.288137+0000","last_fullsized":"2023-10-09T15:37:13.288137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:03.271206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267929+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:01.457814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.286954+0000","last_change":"2023-10-09T15:37:13.286954+0000","last_active":"2023-10-09T15:37:13.286954+0000","last_peered":"2023-10-09T15:37:13.286954+0000","last_clean":"2023-10-09T15:37:13.286954+0000","last_became_active":"2023-10-09T15:37:13.286663+0000","last_became_peered":"2023-10-09T15:37:13.286663+0000","last_unstale":"2023-10-09T15:37:13.286954+0000","last_undegraded":"2023-10-09T15:37:13.286954+0000","last_fullsized":"2023-10-09T15:37:13.286954+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:29.120558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266208+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.281780+0000","last_change":"2023-10-09T15:37:13.281780+0000","last_active":"2023-10-09T15:37:13.281780+0000","last_peered":"2023-10-09T15:37:13.281780+0000","last_clean":"2023-10-09T15:37:13.281780+0000","last_became_active":"2023-10-09T15:37:13.281426+0000","last_became_peered":"2023-10-09T15:37:13.281426+0000","last_unstale":"2023-10-09T15:37:13.281780+0000","last_undegraded":"2023-10-09T15:37:13.281780+0000","last_fullsized":"2023-10-09T15:37:13.281780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266269+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.289688+0000","last_change":"2023-10-09T15:37:13.289688+0000","last_active":"2023-10-09T15:37:13.289688+0000","last_peered":"2023-10-09T15:37:13.289688+0000","last_clean":"2023-10-09T15:37:13.289688+0000","last_became_active":"2023-10-09T15:37:13.289475+0000","last_became_peered":"2023-10-09T15:37:13.289475+0000","last_unstale":"2023-10-09T15:37:13.289688+0000","last_undegraded":"2023-10-09T15:37:13.289688+0000","last_fullsized":"2023-10-09T15:37:13.289688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266140+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.292286+0000","last_change":"2023-10-09T15:37:13.292286+0000","last_active":"2023-10-09T15:37:13.292286+0000","last_peered":"2023-10-09T15:37:13.292286+0000","last_clean":"2023-10-09T15:37:13.292286+0000","last_became_active":"2023-10-09T15:37:13.291981+0000","last_became_peered":"2023-10-09T15:37:13.291981+0000","last_unstale":"2023-10-09T15:37:13.292286+0000","last_undegraded":"2023-10-09T15:37:13.292286+0000","last_fullsized":"2023-10-09T15:37:13.292286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:59.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271726+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.404074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290785+0000","last_change":"2023-10-09T15:37:13.290785+0000","last_active":"2023-10-09T15:37:13.290785+0000","last_peered":"2023-10-09T15:37:13.290785+0000","last_clean":"2023-10-09T15:37:13.290785+0000","last_became_active":"2023-10-09T15:37:13.290382+0000","last_became_peered":"2023-10-09T15:37:13.290382+0000","last_unstale":"2023-10-09T15:37:13.290785+0000","last_undegraded":"2023-10-09T15:37:13.290785+0000","last_fullsized":"2023-10-09T15:37:13.290785+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:29.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278832+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:06.608648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.278333+0000","last_change":"2023-10-09T15:37:13.278333+0000","last_active":"2023-10-09T15:37:13.278333+0000","last_peered":"2023-10-09T15:37:13.278333+0000","last_clean":"2023-10-09T15:37:13.278333+0000","last_became_active":"2023-10-09T15:37:13.277794+0000","last_became_peered":"2023-10-09T15:37:13.277794+0000","last_unstale":"2023-10-09T15:37:13.278333+0000","last_undegraded":"2023-10-09T15:37:13.278333+0000","last_fullsized":"2023-10-09T15:37:13.278333+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:05.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269405+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274887+0000","last_change":"2023-10-09T15:37:13.274887+0000","last_active":"2023-10-09T15:37:13.274887+0000","last_peered":"2023-10-09T15:37:13.274887+0000","last_clean":"2023-10-09T15:37:13.274887+0000","last_became_active":"2023-10-09T15:37:13.274588+0000","last_became_peered":"2023-10-09T15:37:13.274588+0000","last_unstale":"2023-10-09T15:37:13.274887+0000","last_undegraded":"2023-10-09T15:37:13.274887+0000","last_fullsized":"2023-10-09T15:37:13.274887+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271088+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288752+0000","last_change":"2023-10-09T15:37:13.288752+0000","last_active":"2023-10-09T15:37:13.288752+0000","last_peered":"2023-10-09T15:37:13.288752+0000","last_clean":"2023-10-09T15:37:13.288752+0000","last_became_active":"2023-10-09T15:37:13.288137+0000","last_became_peered":"2023-10-09T15:37:13.288137+0000","last_unstale":"2023-10-09T15:37:13.288752+0000","last_undegraded":"2023-10-09T15:37:13.288752+0000","last_fullsized":"2023-10-09T15:37:13.288752+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.123202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269722+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283569+0000","last_change":"2023-10-09T15:37:13.283569+0000","last_active":"2023-10-09T15:37:13.283569+0000","last_peered":"2023-10-09T15:37:13.283569+0000","last_clean":"2023-10-09T15:37:13.283569+0000","last_became_active":"2023-10-09T15:37:13.283300+0000","last_became_peered":"2023-10-09T15:37:13.283300+0000","last_unstale":"2023-10-09T15:37:13.283569+0000","last_undegraded":"2023-10-09T15:37:13.283569+0000","last_fullsized":"2023-10-09T15:37:13.283569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277085+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:08.956065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282555+0000","last_change":"2023-10-09T15:37:13.282555+0000","last_active":"2023-10-09T15:37:13.282555+0000","last_peered":"2023-10-09T15:37:13.282555+0000","last_clean":"2023-10-09T15:37:13.282555+0000","last_became_active":"2023-10-09T15:37:13.282285+0000","last_became_peered":"2023-10-09T15:37:13.282285+0000","last_unstale":"2023-10-09T15:37:13.282555+0000","last_undegraded":"2023-10-09T15:37:13.282555+0000","last_fullsized":"2023-10-09T15:37:13.282555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:57.308202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271761+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283869+0000","last_change":"2023-10-09T15:37:13.283869+0000","last_active":"2023-10-09T15:37:13.283869+0000","last_peered":"2023-10-09T15:37:13.283869+0000","last_clean":"2023-10-09T15:37:13.283869+0000","last_became_active":"2023-10-09T15:37:13.283553+0000","last_became_peered":"2023-10-09T15:37:13.283553+0000","last_unstale":"2023-10-09T15:37:13.283869+0000","last_undegraded":"2023-10-09T15:37:13.283869+0000","last_fullsized":"2023-10-09T15:37:13.283869+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265535+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290871+0000","last_change":"2023-10-09T15:37:13.290871+0000","last_active":"2023-10-09T15:37:13.290871+0000","last_peered":"2023-10-09T15:37:13.290871+0000","last_clean":"2023-10-09T15:37:13.290871+0000","last_became_active":"2023-10-09T15:37:13.290518+0000","last_became_peered":"2023-10-09T15:37:13.290518+0000","last_unstale":"2023-10-09T15:37:13.290871+0000","last_undegraded":"2023-10-09T15:37:13.290871+0000","last_fullsized":"2023-10-09T15:37:13.290871+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:49.732124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267075+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:04.477658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.287838+0000","last_change":"2023-10-09T15:37:13.287838+0000","last_active":"2023-10-09T15:37:13.287838+0000","last_peered":"2023-10-09T15:37:13.287838+0000","last_clean":"2023-10-09T15:37:13.287838+0000","last_became_active":"2023-10-09T15:37:13.287540+0000","last_became_peered":"2023-10-09T15:37:13.287540+0000","last_unstale":"2023-10-09T15:37:13.287838+0000","last_undegraded":"2023-10-09T15:37:13.287838+0000","last_fullsized":"2023-10-09T15:37:13.287838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:53.625320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277483+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:48.227343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.272306+0000","last_change":"2023-10-09T15:37:13.272306+0000","last_active":"2023-10-09T15:37:13.272306+0000","last_peered":"2023-10-09T15:37:13.272306+0000","last_clean":"2023-10-09T15:37:13.272306+0000","last_became_active":"2023-10-09T15:37:13.272027+0000","last_became_peered":"2023-10-09T15:37:13.272027+0000","last_unstale":"2023-10-09T15:37:13.272306+0000","last_undegraded":"2023-10-09T15:37:13.272306+0000","last_fullsized":"2023-10-09T15:37:13.272306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:40.238895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277930+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:27.274757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290899+0000","last_change":"2023-10-09T15:37:13.290899+0000","last_active":"2023-10-09T15:37:13.290899+0000","last_peered":"2023-10-09T15:37:13.290899+0000","last_clean":"2023-10-09T15:37:13.290899+0000","last_became_active":"2023-10-09T15:37:13.290629+0000","last_became_peered":"2023-10-09T15:37:13.290629+0000","last_unstale":"2023-10-09T15:37:13.290899+0000","last_undegraded":"2023-10-09T15:37:13.290899+0000","last_fullsized":"2023-10-09T15:37:13.290899+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266379+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:28.011965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282192+0000","last_change":"2023-10-09T15:37:13.282192+0000","last_active":"2023-10-09T15:37:13.282192+0000","last_peered":"2023-10-09T15:37:13.282192+0000","last_clean":"2023-10-09T15:37:13.282192+0000","last_became_active":"2023-10-09T15:37:13.281909+0000","last_became_peered":"2023-10-09T15:37:13.281909+0000","last_unstale":"2023-10-09T15:37:13.282192+0000","last_undegraded":"2023-10-09T15:37:13.282192+0000","last_fullsized":"2023-10-09T15:37:13.282192+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:03.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264653+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:28.011965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.273755+0000","last_change":"2023-10-09T15:37:13.273755+0000","last_active":"2023-10-09T15:37:13.273755+0000","last_peered":"2023-10-09T15:37:13.273755+0000","last_clean":"2023-10-09T15:37:13.273755+0000","last_became_active":"2023-10-09T15:37:13.273413+0000","last_became_peered":"2023-10-09T15:37:13.273413+0000","last_unstale":"2023-10-09T15:37:13.273755+0000","last_undegraded":"2023-10-09T15:37:13.273755+0000","last_fullsized":"2023-10-09T15:37:13.273755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264367+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:31.576956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282267+0000","last_change":"2023-10-09T15:37:13.282267+0000","last_active":"2023-10-09T15:37:13.282267+0000","last_peered":"2023-10-09T15:37:13.282267+0000","last_clean":"2023-10-09T15:37:13.282267+0000","last_became_active":"2023-10-09T15:37:13.281978+0000","last_became_peered":"2023-10-09T15:37:13.281978+0000","last_unstale":"2023-10-09T15:37:13.282267+0000","last_undegraded":"2023-10-09T15:37:13.282267+0000","last_fullsized":"2023-10-09T15:37:13.282267+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271278+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283202+0000","last_change":"2023-10-09T15:37:13.283202+0000","last_active":"2023-10-09T15:37:13.283202+0000","last_peered":"2023-10-09T15:37:13.283202+0000","last_clean":"2023-10-09T15:37:13.283202+0000","last_became_active":"2023-10-09T15:37:13.282829+0000","last_became_peered":"2023-10-09T15:37:13.282829+0000","last_unstale":"2023-10-09T15:37:13.283202+0000","last_undegraded":"2023-10-09T15:37:13.283202+0000","last_fullsized":"2023-10-09T15:37:13.283202+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:11.245573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.276859+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:20.242868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.291282+0000","last_change":"2023-10-09T15:37:13.291282+0000","last_active":"2023-10-09T15:37:13.291282+0000","last_peered":"2023-10-09T15:37:13.291282+0000","last_clean":"2023-10-09T15:37:13.291282+0000","last_became_active":"2023-10-09T15:37:13.290934+0000","last_became_peered":"2023-10-09T15:37:13.290934+0000","last_unstale":"2023-10-09T15:37:13.291282+0000","last_undegraded":"2023-10-09T15:37:13.291282+0000","last_fullsized":"2023-10-09T15:37:13.291282+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:29.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265542+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288347+0000","last_change":"2023-10-09T15:37:13.288347+0000","last_active":"2023-10-09T15:37:13.288347+0000","last_peered":"2023-10-09T15:37:13.288347+0000","last_clean":"2023-10-09T15:37:13.288347+0000","last_became_active":"2023-10-09T15:37:13.288051+0000","last_became_peered":"2023-10-09T15:37:13.288051+0000","last_unstale":"2023-10-09T15:37:13.288347+0000","last_undegraded":"2023-10-09T15:37:13.288347+0000","last_fullsized":"2023-10-09T15:37:13.288347+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.797526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T15:37:12.265853+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:12.265853+0000","last_peered":"2023-10-09T15:37:12.265853+0000","last_clean":"2023-10-09T15:37:12.265853+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:12.265853+0000","last_undegraded":"2023-10-09T15:37:12.265853+0000","last_fullsized":"2023-10-09T15:37:12.265853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303156,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":1814528,"data_stored":1114016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.437},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.64600000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.441},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.376}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.505}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.373},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.308},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:18.634 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:18.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.787+0000 7f62d4516700 1 Processor -- start 2023-10-09T15:37:18.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.787+0000 7f62d4516700 1 -- start start 2023-10-09T15:37:18.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d4516700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62cc0cb5a0 0x7f62cc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d4516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc15a5d0 0x7f62cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d4516700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62cc15ae40 con 0x7f62cc0cd9e0 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d4516700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62cc0d13f0 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d4516700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc15ab60 con 0x7f62cc15a5d0 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62cc0cb5a0 0x7f62cc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f62cc0cb5a0 0x7f62cc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54526/0 (socket says 172.21.15.33:54526) 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 -- 172.21.15.33:0/2968773135 learned_addr learned my addr 172.21.15.33:0/2968773135 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d2ab3700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc15a5d0 0x7f62cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 -- 172.21.15.33:0/2968773135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc15a5d0 msgr2=0x7f62cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc15a5d0 0x7f62cc156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 -- 172.21.15.33:0/2968773135 >> v1:172.21.15.59:6789/0 conn(0x7f62cc0cd9e0 legacy=0x7f62cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 -- 172.21.15.33:0/2968773135 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62cc0ccf00 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.788+0000 7f62d22b2700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc0cb970 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009f50 tx=0x7f62c4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ef9ab41d6d1ccc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d12b0700 1 -- 172.21.15.33:0/2968773135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c400e070 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d12b0700 1 -- 172.21.15.33:0/2968773135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62c400ba30 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d12b0700 1 -- 172.21.15.33:0/2968773135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62c40092e0 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 -- 172.21.15.33:0/2968773135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc0cb5a0 msgr2=0x7f62cc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc0cb970 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f62c4009f50 tx=0x7f62c4009840 comp rx=0 tx=0).stop 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 -- 172.21.15.33:0/2968773135 shutdown_connections 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc15a5d0 0x7f62cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 --2- 172.21.15.33:0/2968773135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc0cb970 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 -- 172.21.15.33:0/2968773135 >> 172.21.15.33:0/2968773135 conn(0x7f62cc070e30 msgr2=0x7f62cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 -- 172.21.15.33:0/2968773135 shutdown_connections 2023-10-09T15:37:18.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.789+0000 7f62d4516700 1 -- 172.21.15.33:0/2968773135 wait complete. 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.790+0000 7f62d4516700 1 Processor -- start 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.790+0000 7f62d4516700 1 -- start start 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc142bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc0cd9e0 0x7f62cc0b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc15de60 con 0x7f62cc15a5d0 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc15b4a0 con 0x7f62cc0cb5a0 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d4516700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62cc15b780 con 0x7f62cc0cd9e0 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d2ab3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d2ab3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54542/0 (socket says 172.21.15.33:54542) 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d2ab3700 1 -- 172.21.15.33:0/1994621277 learned_addr learned my addr 172.21.15.33:0/1994621277 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d22b2700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc142bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d1ab1700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc0cd9e0 0x7f62cc0b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.791+0000 7f62d2ab3700 1 -- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc0cd9e0 msgr2=0x7f62cc0b4740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d2ab3700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc0cd9e0 0x7f62cc0b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d2ab3700 1 -- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 msgr2=0x7f62cc142bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d2ab3700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc142bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d2ab3700 1 -- 172.21.15.33:0/1994621277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62c4009ae0 con 0x7f62cc15a5d0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d22b2700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d2ab3700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c880 tx=0x7f62bc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc011600 con 0x7f62cc15a5d0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62bc011760 con 0x7f62cc15a5d0 2023-10-09T15:37:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62cc15ba60 con 0x7f62cc15a5d0 2023-10-09T15:37:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62bc011b00 con 0x7f62cc15a5d0 2023-10-09T15:37:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.792+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62cc15c020 con 0x7f62cc15a5d0 2023-10-09T15:37:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.793+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62cc15c240 con 0x7f62cc15a5d0 2023-10-09T15:37:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.793+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f62bc018360 con 0x7f62cc15a5d0 2023-10-09T15:37:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.794+0000 7f62ca7fc700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 0x7f62b8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.794+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f62bc0848b0 con 0x7f62cc15a5d0 2023-10-09T15:37:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.794+0000 7f62d22b2700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 0x7f62b8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.794+0000 7f62d22b2700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 0x7f62b8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0b5430 tx=0x7f62c4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:18.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.798+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f62bc051600 con 0x7f62cc15a5d0 2023-10-09T15:37:18.851 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:37:18.850+0000 7fa28fc96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:37:18.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.988+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f62cc04c3c0 con 0x7f62b8067290 2023-10-09T15:37:18.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.996+0000 7f62ca7fc700 1 -- 172.21.15.33:0/1994621277 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286649 (secure 0 0 0) 0x7f62cc04c3c0 con 0x7f62b8067290 2023-10-09T15:37:19.000 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:19.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 msgr2=0x7f62b8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 0x7f62b8069740 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f62cc0b5430 tx=0x7f62c4017000 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 msgr2=0x7f62cc0b4c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f62bc00c880 tx=0x7f62bc008040 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 shutdown_connections 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f62b8067290 0x7f62b8069740 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f62cc15a5d0 0x7f62cc0b4c80 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62cc0cb5a0 0x7f62cc142bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 --2- 172.21.15.33:0/1994621277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62cc0cd9e0 0x7f62cc0b4740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 >> 172.21.15.33:0/1994621277 conn(0x7f62cc070e30 msgr2=0x7f62cc0cf580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 shutdown_connections 2023-10-09T15:37:19.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:18.999+0000 7f62d4516700 1 -- 172.21.15.33:0/1994621277 wait complete. 2023-10-09T15:37:19.004 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:19.012 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2023-10-09T15:37:17.312507+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":28,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2413584,"kb_used_data":10704,"kb_used_omap":0,"kb_used_meta":2402816,"kb_avail":752561136,"statfs":{"total":773094113280,"available":770622603264,"internally_reserved":0,"allocated":10960896,"data_stored":5375172,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2460483584},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":17,"apply_latency_ms":17,"commit_latency_ns":17000000,"apply_latency_ns":17000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.053314"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277976+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:29:35.220293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266059+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.273813+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278978+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:09:44.351963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271478+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:43:39.875445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279173+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:28.601902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269408+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:57:42.081268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272266+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271974+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272745+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265575+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278416+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:54:02.981063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271786+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.270560+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278124+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:01.457814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278971+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:41.642932+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265520+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267564+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.273271+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264928+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:53.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267123+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266944+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264498+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:19.807231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266602+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264992+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:04.477658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272104+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279883+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:57:42.081268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266820+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266642+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268059+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:06.608648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277382+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:05:28.671327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277773+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:47:24.183392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279330+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:20.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.276939+0000","last_change":"2023-10-09T15:37:13.276939+0000","last_active":"2023-10-09T15:37:13.276939+0000","last_peered":"2023-10-09T15:37:13.276939+0000","last_clean":"2023-10-09T15:37:13.276939+0000","last_became_active":"2023-10-09T15:37:13.276618+0000","last_became_peered":"2023-10-09T15:37:13.276618+0000","last_unstale":"2023-10-09T15:37:13.276939+0000","last_undegraded":"2023-10-09T15:37:13.276939+0000","last_fullsized":"2023-10-09T15:37:13.276939+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267415+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.277106+0000","last_change":"2023-10-09T15:37:13.277106+0000","last_active":"2023-10-09T15:37:13.277106+0000","last_peered":"2023-10-09T15:37:13.277106+0000","last_clean":"2023-10-09T15:37:13.277106+0000","last_became_active":"2023-10-09T15:37:13.276756+0000","last_became_peered":"2023-10-09T15:37:13.276756+0000","last_unstale":"2023-10-09T15:37:13.277106+0000","last_undegraded":"2023-10-09T15:37:13.277106+0000","last_fullsized":"2023-10-09T15:37:13.277106+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:52.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.279486+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:09.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283184+0000","last_change":"2023-10-09T15:37:13.283184+0000","last_active":"2023-10-09T15:37:13.283184+0000","last_peered":"2023-10-09T15:37:13.283184+0000","last_clean":"2023-10-09T15:37:13.283184+0000","last_became_active":"2023-10-09T15:37:13.282883+0000","last_became_peered":"2023-10-09T15:37:13.282883+0000","last_unstale":"2023-10-09T15:37:13.283184+0000","last_undegraded":"2023-10-09T15:37:13.283184+0000","last_fullsized":"2023-10-09T15:37:13.283184+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:58.065576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.272764+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283087+0000","last_change":"2023-10-09T15:37:13.283087+0000","last_active":"2023-10-09T15:37:13.283087+0000","last_peered":"2023-10-09T15:37:13.283087+0000","last_clean":"2023-10-09T15:37:13.283087+0000","last_became_active":"2023-10-09T15:37:13.282773+0000","last_became_peered":"2023-10-09T15:37:13.282773+0000","last_unstale":"2023-10-09T15:37:13.283087+0000","last_undegraded":"2023-10-09T15:37:13.283087+0000","last_fullsized":"2023-10-09T15:37:13.283087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:46.940465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.276741+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.281132+0000","last_change":"2023-10-09T15:37:13.281132+0000","last_active":"2023-10-09T15:37:13.281132+0000","last_peered":"2023-10-09T15:37:13.281132+0000","last_clean":"2023-10-09T15:37:13.281132+0000","last_became_active":"2023-10-09T15:37:13.280901+0000","last_became_peered":"2023-10-09T15:37:13.280901+0000","last_unstale":"2023-10-09T15:37:13.281132+0000","last_undegraded":"2023-10-09T15:37:13.281132+0000","last_fullsized":"2023-10-09T15:37:13.281132+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266063+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.269828+0000","last_change":"2023-10-09T15:37:13.269828+0000","last_active":"2023-10-09T15:37:13.269828+0000","last_peered":"2023-10-09T15:37:13.269828+0000","last_clean":"2023-10-09T15:37:13.269828+0000","last_became_active":"2023-10-09T15:37:13.269489+0000","last_became_peered":"2023-10-09T15:37:13.269489+0000","last_unstale":"2023-10-09T15:37:13.269828+0000","last_undegraded":"2023-10-09T15:37:13.269828+0000","last_fullsized":"2023-10-09T15:37:13.269828+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:46.511413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.286790+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:49:29.901035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274950+0000","last_change":"2023-10-09T15:37:13.274950+0000","last_active":"2023-10-09T15:37:13.274950+0000","last_peered":"2023-10-09T15:37:13.274950+0000","last_clean":"2023-10-09T15:37:13.274950+0000","last_became_active":"2023-10-09T15:37:13.274547+0000","last_became_peered":"2023-10-09T15:37:13.274547+0000","last_unstale":"2023-10-09T15:37:13.274950+0000","last_undegraded":"2023-10-09T15:37:13.274950+0000","last_fullsized":"2023-10-09T15:37:13.274950+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268329+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:28.601902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288878+0000","last_change":"2023-10-09T15:37:13.288878+0000","last_active":"2023-10-09T15:37:13.288878+0000","last_peered":"2023-10-09T15:37:13.288878+0000","last_clean":"2023-10-09T15:37:13.288878+0000","last_became_active":"2023-10-09T15:37:13.287910+0000","last_became_peered":"2023-10-09T15:37:13.287910+0000","last_unstale":"2023-10-09T15:37:13.288878+0000","last_undegraded":"2023-10-09T15:37:13.288878+0000","last_fullsized":"2023-10-09T15:37:13.288878+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:14.196333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.268773+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:29:09.681097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282437+0000","last_change":"2023-10-09T15:37:13.282437+0000","last_active":"2023-10-09T15:37:13.282437+0000","last_peered":"2023-10-09T15:37:13.282437+0000","last_clean":"2023-10-09T15:37:13.282437+0000","last_became_active":"2023-10-09T15:37:13.282148+0000","last_became_peered":"2023-10-09T15:37:13.282148+0000","last_unstale":"2023-10-09T15:37:13.282437+0000","last_undegraded":"2023-10-09T15:37:13.282437+0000","last_fullsized":"2023-10-09T15:37:13.282437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:29.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266905+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:53.369448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274732+0000","last_change":"2023-10-09T15:37:13.274732+0000","last_active":"2023-10-09T15:37:13.274732+0000","last_peered":"2023-10-09T15:37:13.274732+0000","last_clean":"2023-10-09T15:37:13.274732+0000","last_became_active":"2023-10-09T15:37:13.274416+0000","last_became_peered":"2023-10-09T15:37:13.274416+0000","last_unstale":"2023-10-09T15:37:13.274732+0000","last_undegraded":"2023-10-09T15:37:13.274732+0000","last_fullsized":"2023-10-09T15:37:13.274732+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:59.743080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266282+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288137+0000","last_change":"2023-10-09T15:37:13.288137+0000","last_active":"2023-10-09T15:37:13.288137+0000","last_peered":"2023-10-09T15:37:13.288137+0000","last_clean":"2023-10-09T15:37:13.288137+0000","last_became_active":"2023-10-09T15:37:13.287608+0000","last_became_peered":"2023-10-09T15:37:13.287608+0000","last_unstale":"2023-10-09T15:37:13.288137+0000","last_undegraded":"2023-10-09T15:37:13.288137+0000","last_fullsized":"2023-10-09T15:37:13.288137+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:03.271206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267929+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:14:01.457814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.286954+0000","last_change":"2023-10-09T15:37:13.286954+0000","last_active":"2023-10-09T15:37:13.286954+0000","last_peered":"2023-10-09T15:37:13.286954+0000","last_clean":"2023-10-09T15:37:13.286954+0000","last_became_active":"2023-10-09T15:37:13.286663+0000","last_became_peered":"2023-10-09T15:37:13.286663+0000","last_unstale":"2023-10-09T15:37:13.286954+0000","last_undegraded":"2023-10-09T15:37:13.286954+0000","last_fullsized":"2023-10-09T15:37:13.286954+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:29.120558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266208+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.281780+0000","last_change":"2023-10-09T15:37:13.281780+0000","last_active":"2023-10-09T15:37:13.281780+0000","last_peered":"2023-10-09T15:37:13.281780+0000","last_clean":"2023-10-09T15:37:13.281780+0000","last_became_active":"2023-10-09T15:37:13.281426+0000","last_became_peered":"2023-10-09T15:37:13.281426+0000","last_unstale":"2023-10-09T15:37:13.281780+0000","last_undegraded":"2023-10-09T15:37:13.281780+0000","last_fullsized":"2023-10-09T15:37:13.281780+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266269+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.289688+0000","last_change":"2023-10-09T15:37:13.289688+0000","last_active":"2023-10-09T15:37:13.289688+0000","last_peered":"2023-10-09T15:37:13.289688+0000","last_clean":"2023-10-09T15:37:13.289688+0000","last_became_active":"2023-10-09T15:37:13.289475+0000","last_became_peered":"2023-10-09T15:37:13.289475+0000","last_unstale":"2023-10-09T15:37:13.289688+0000","last_undegraded":"2023-10-09T15:37:13.289688+0000","last_fullsized":"2023-10-09T15:37:13.289688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266140+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.292286+0000","last_change":"2023-10-09T15:37:13.292286+0000","last_active":"2023-10-09T15:37:13.292286+0000","last_peered":"2023-10-09T15:37:13.292286+0000","last_clean":"2023-10-09T15:37:13.292286+0000","last_became_active":"2023-10-09T15:37:13.291981+0000","last_became_peered":"2023-10-09T15:37:13.291981+0000","last_unstale":"2023-10-09T15:37:13.292286+0000","last_undegraded":"2023-10-09T15:37:13.292286+0000","last_fullsized":"2023-10-09T15:37:13.292286+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:59.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271726+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:07.404074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290785+0000","last_change":"2023-10-09T15:37:13.290785+0000","last_active":"2023-10-09T15:37:13.290785+0000","last_peered":"2023-10-09T15:37:13.290785+0000","last_clean":"2023-10-09T15:37:13.290785+0000","last_became_active":"2023-10-09T15:37:13.290382+0000","last_became_peered":"2023-10-09T15:37:13.290382+0000","last_unstale":"2023-10-09T15:37:13.290785+0000","last_undegraded":"2023-10-09T15:37:13.290785+0000","last_fullsized":"2023-10-09T15:37:13.290785+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:29.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.278832+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:06.608648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.278333+0000","last_change":"2023-10-09T15:37:13.278333+0000","last_active":"2023-10-09T15:37:13.278333+0000","last_peered":"2023-10-09T15:37:13.278333+0000","last_clean":"2023-10-09T15:37:13.278333+0000","last_became_active":"2023-10-09T15:37:13.277794+0000","last_became_peered":"2023-10-09T15:37:13.277794+0000","last_unstale":"2023-10-09T15:37:13.278333+0000","last_undegraded":"2023-10-09T15:37:13.278333+0000","last_fullsized":"2023-10-09T15:37:13.278333+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:05.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269405+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:54.629165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.274887+0000","last_change":"2023-10-09T15:37:13.274887+0000","last_active":"2023-10-09T15:37:13.274887+0000","last_peered":"2023-10-09T15:37:13.274887+0000","last_clean":"2023-10-09T15:37:13.274887+0000","last_became_active":"2023-10-09T15:37:13.274588+0000","last_became_peered":"2023-10-09T15:37:13.274588+0000","last_unstale":"2023-10-09T15:37:13.274887+0000","last_undegraded":"2023-10-09T15:37:13.274887+0000","last_fullsized":"2023-10-09T15:37:13.274887+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271088+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288752+0000","last_change":"2023-10-09T15:37:13.288752+0000","last_active":"2023-10-09T15:37:13.288752+0000","last_peered":"2023-10-09T15:37:13.288752+0000","last_clean":"2023-10-09T15:37:13.288752+0000","last_became_active":"2023-10-09T15:37:13.288137+0000","last_became_peered":"2023-10-09T15:37:13.288137+0000","last_unstale":"2023-10-09T15:37:13.288752+0000","last_undegraded":"2023-10-09T15:37:13.288752+0000","last_fullsized":"2023-10-09T15:37:13.288752+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.123202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.269722+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:47.515258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283569+0000","last_change":"2023-10-09T15:37:13.283569+0000","last_active":"2023-10-09T15:37:13.283569+0000","last_peered":"2023-10-09T15:37:13.283569+0000","last_clean":"2023-10-09T15:37:13.283569+0000","last_became_active":"2023-10-09T15:37:13.283300+0000","last_became_peered":"2023-10-09T15:37:13.283300+0000","last_unstale":"2023-10-09T15:37:13.283569+0000","last_undegraded":"2023-10-09T15:37:13.283569+0000","last_fullsized":"2023-10-09T15:37:13.283569+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277085+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:08.956065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282555+0000","last_change":"2023-10-09T15:37:13.282555+0000","last_active":"2023-10-09T15:37:13.282555+0000","last_peered":"2023-10-09T15:37:13.282555+0000","last_clean":"2023-10-09T15:37:13.282555+0000","last_became_active":"2023-10-09T15:37:13.282285+0000","last_became_peered":"2023-10-09T15:37:13.282285+0000","last_unstale":"2023-10-09T15:37:13.282555+0000","last_undegraded":"2023-10-09T15:37:13.282555+0000","last_fullsized":"2023-10-09T15:37:13.282555+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:57.308202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271761+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283869+0000","last_change":"2023-10-09T15:37:13.283869+0000","last_active":"2023-10-09T15:37:13.283869+0000","last_peered":"2023-10-09T15:37:13.283869+0000","last_clean":"2023-10-09T15:37:13.283869+0000","last_became_active":"2023-10-09T15:37:13.283553+0000","last_became_peered":"2023-10-09T15:37:13.283553+0000","last_unstale":"2023-10-09T15:37:13.283869+0000","last_undegraded":"2023-10-09T15:37:13.283869+0000","last_fullsized":"2023-10-09T15:37:13.283869+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265535+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290871+0000","last_change":"2023-10-09T15:37:13.290871+0000","last_active":"2023-10-09T15:37:13.290871+0000","last_peered":"2023-10-09T15:37:13.290871+0000","last_clean":"2023-10-09T15:37:13.290871+0000","last_became_active":"2023-10-09T15:37:13.290518+0000","last_became_peered":"2023-10-09T15:37:13.290518+0000","last_unstale":"2023-10-09T15:37:13.290871+0000","last_undegraded":"2023-10-09T15:37:13.290871+0000","last_fullsized":"2023-10-09T15:37:13.290871+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:49.732124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.267075+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:04.477658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.287838+0000","last_change":"2023-10-09T15:37:13.287838+0000","last_active":"2023-10-09T15:37:13.287838+0000","last_peered":"2023-10-09T15:37:13.287838+0000","last_clean":"2023-10-09T15:37:13.287838+0000","last_became_active":"2023-10-09T15:37:13.287540+0000","last_became_peered":"2023-10-09T15:37:13.287540+0000","last_unstale":"2023-10-09T15:37:13.287838+0000","last_undegraded":"2023-10-09T15:37:13.287838+0000","last_fullsized":"2023-10-09T15:37:13.287838+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:53.625320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277483+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:48.227343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.272306+0000","last_change":"2023-10-09T15:37:13.272306+0000","last_active":"2023-10-09T15:37:13.272306+0000","last_peered":"2023-10-09T15:37:13.272306+0000","last_clean":"2023-10-09T15:37:13.272306+0000","last_became_active":"2023-10-09T15:37:13.272027+0000","last_became_peered":"2023-10-09T15:37:13.272027+0000","last_unstale":"2023-10-09T15:37:13.272306+0000","last_undegraded":"2023-10-09T15:37:13.272306+0000","last_fullsized":"2023-10-09T15:37:13.272306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:40.238895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.277930+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:13:27.274757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.290899+0000","last_change":"2023-10-09T15:37:13.290899+0000","last_active":"2023-10-09T15:37:13.290899+0000","last_peered":"2023-10-09T15:37:13.290899+0000","last_clean":"2023-10-09T15:37:13.290899+0000","last_became_active":"2023-10-09T15:37:13.290629+0000","last_became_peered":"2023-10-09T15:37:13.290629+0000","last_unstale":"2023-10-09T15:37:13.290899+0000","last_undegraded":"2023-10-09T15:37:13.290899+0000","last_fullsized":"2023-10-09T15:37:13.290899+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.266379+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:28.011965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282192+0000","last_change":"2023-10-09T15:37:13.282192+0000","last_active":"2023-10-09T15:37:13.282192+0000","last_peered":"2023-10-09T15:37:13.282192+0000","last_clean":"2023-10-09T15:37:13.282192+0000","last_became_active":"2023-10-09T15:37:13.281909+0000","last_became_peered":"2023-10-09T15:37:13.281909+0000","last_unstale":"2023-10-09T15:37:13.282192+0000","last_undegraded":"2023-10-09T15:37:13.282192+0000","last_fullsized":"2023-10-09T15:37:13.282192+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:03.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264653+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:28.011965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.273755+0000","last_change":"2023-10-09T15:37:13.273755+0000","last_active":"2023-10-09T15:37:13.273755+0000","last_peered":"2023-10-09T15:37:13.273755+0000","last_clean":"2023-10-09T15:37:13.273755+0000","last_became_active":"2023-10-09T15:37:13.273413+0000","last_became_peered":"2023-10-09T15:37:13.273413+0000","last_unstale":"2023-10-09T15:37:13.273755+0000","last_undegraded":"2023-10-09T15:37:13.273755+0000","last_fullsized":"2023-10-09T15:37:13.273755+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.264367+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:31.576956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.282267+0000","last_change":"2023-10-09T15:37:13.282267+0000","last_active":"2023-10-09T15:37:13.282267+0000","last_peered":"2023-10-09T15:37:13.282267+0000","last_clean":"2023-10-09T15:37:13.282267+0000","last_became_active":"2023-10-09T15:37:13.281978+0000","last_became_peered":"2023-10-09T15:37:13.281978+0000","last_unstale":"2023-10-09T15:37:13.282267+0000","last_undegraded":"2023-10-09T15:37:13.282267+0000","last_fullsized":"2023-10-09T15:37:13.282267+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.271278+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.283202+0000","last_change":"2023-10-09T15:37:13.283202+0000","last_active":"2023-10-09T15:37:13.283202+0000","last_peered":"2023-10-09T15:37:13.283202+0000","last_clean":"2023-10-09T15:37:13.283202+0000","last_became_active":"2023-10-09T15:37:13.282829+0000","last_became_peered":"2023-10-09T15:37:13.282829+0000","last_unstale":"2023-10-09T15:37:13.283202+0000","last_undegraded":"2023-10-09T15:37:13.283202+0000","last_fullsized":"2023-10-09T15:37:13.283202+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:11.245573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.276859+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:20.242868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.291282+0000","last_change":"2023-10-09T15:37:13.291282+0000","last_active":"2023-10-09T15:37:13.291282+0000","last_peered":"2023-10-09T15:37:13.291282+0000","last_clean":"2023-10-09T15:37:13.291282+0000","last_became_active":"2023-10-09T15:37:13.290934+0000","last_became_peered":"2023-10-09T15:37:13.290934+0000","last_unstale":"2023-10-09T15:37:13.291282+0000","last_undegraded":"2023-10-09T15:37:13.291282+0000","last_fullsized":"2023-10-09T15:37:13.291282+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:29.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:37:13.258265+0000","last_change":"2023-10-09T15:37:13.265542+0000","last_active":"2023-10-09T15:37:13.258265+0000","last_peered":"2023-10-09T15:37:13.258265+0000","last_clean":"2023-10-09T15:37:13.258265+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:37:13.258265+0000","last_undegraded":"2023-10-09T15:37:13.258265+0000","last_fullsized":"2023-10-09T15:37:13.258265+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":8,"reported_epoch":99,"state":"active+clean","last_fresh":"2023-10-09T15:37:13.288347+0000","last_change":"2023-10-09T15:37:13.288347+0000","last_active":"2023-10-09T15:37:13.288347+0000","last_peered":"2023-10-09T15:37:13.288347+0000","last_clean":"2023-10-09T15:37:13.288347+0000","last_became_active":"2023-10-09T15:37:13.288051+0000","last_became_peered":"2023-10-09T15:37:13.288051+0000","last_unstale":"2023-10-09T15:37:13.288347+0000","last_undegraded":"2023-10-09T15:37:13.288347+0000","last_fullsized":"2023-10-09T15:37:13.288347+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.797526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":228,"reported_epoch":98,"state":"active+clean","last_fresh":"2023-10-09T15:37:12.265853+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:12.265853+0000","last_peered":"2023-10-09T15:37:12.265853+0000","last_clean":"2023-10-09T15:37:12.265853+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:12.265853+0000","last_undegraded":"2023-10-09T15:37:12.265853+0000","last_fullsized":"2023-10-09T15:37:12.265853+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574928,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303156,"kb_used_data":1772,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068684,"statfs":{"total":96636764160,"available":96326332416,"internally_reserved":0,"allocated":1814528,"data_stored":1114016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.504}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.57599999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.55100000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.63600000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.437},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.64600000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.70499999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574928,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.57499999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.441},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.63900000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.52500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.5},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.73699999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.65800000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.54800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574929,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302588,"kb_used_data":1204,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069252,"statfs":{"total":96636764160,"available":96326914048,"internally_reserved":0,"allocated":1232896,"data_stored":529911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.376}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.33100000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.42199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.65300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.63500000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.75800000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.73999999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.78700000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.62}]}]},{"osd":0,"up_from":13,"seq":55834574927,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303152,"kb_used_data":1768,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068688,"statfs":{"total":96636764160,"available":96326336512,"internally_reserved":0,"allocated":1810432,"data_stored":1113005,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.505}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574928,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.49099999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.373},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.64400000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.70199999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.65800000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574926,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302576,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069264,"statfs":{"total":96636764160,"available":96326926336,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.49199999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.51000000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.45600000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.56599999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.68500000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":0.73899999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.71099999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.77300000000000002},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.67000000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574927,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.308},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.33600000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.439}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.49299999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.46999999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58599999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574928,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298480,"kb_used_data":1192,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073360,"statfs":{"total":96636764160,"available":96331120640,"internally_reserved":0,"allocated":1220608,"data_stored":523648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.55800000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.58899999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.57599999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.61699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.54100000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.65800000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:19.018 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.170+0000 7f6bfd610700 1 Processor -- start 2023-10-09T15:37:19.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.170+0000 7f6bfd610700 1 -- start start 2023-10-09T15:37:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bfd610700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf81594d0 0x7f6bf80cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bfd610700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bfd610700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf815e010 con 0x7f6bf81598a0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bfd610700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf815d420 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bfd610700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf815d6e0 con 0x7f6bf81594d0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54552/0 (socket says 172.21.15.33:54552) 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 -- 172.21.15.33:0/1018743797 learned_addr learned my addr 172.21.15.33:0/1018743797 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf6ffd700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf81594d0 0x7f6bf80cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 -- 172.21.15.33:0/1018743797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf81594d0 msgr2=0x7f6bf80cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf81594d0 0x7f6bf80cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 -- 172.21.15.33:0/1018743797 >> v1:172.21.15.33:6789/0 conn(0x7f6bf81598a0 legacy=0x7f6bf80ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.171+0000 7f6bf67fc700 1 -- 172.21.15.33:0/1018743797 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf815d9c0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bf67fc700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b91e7fa19e2395e8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bf5ffb700 1 -- 172.21.15.33:0/1018743797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0009ea0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bf5ffb700 1 -- 172.21.15.33:0/1018743797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000b860 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bf5ffb700 1 -- 172.21.15.33:0/1018743797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000bc00 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 -- 172.21.15.33:0/1018743797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf80cb1a0 msgr2=0x7f6bf80cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 -- 172.21.15.33:0/1018743797 shutdown_connections 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf81594d0 0x7f6bf80cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 --2- 172.21.15.33:0/1018743797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf80cb1a0 0x7f6bf80cefb0 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 -- 172.21.15.33:0/1018743797 >> 172.21.15.33:0/1018743797 conn(0x7f6bf80703a0 msgr2=0x7f6bf8070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 -- 172.21.15.33:0/1018743797 shutdown_connections 2023-10-09T15:37:19.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.172+0000 7f6bfd610700 1 -- 172.21.15.33:0/1018743797 wait complete. 2023-10-09T15:37:19.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 Processor -- start 2023-10-09T15:37:19.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 -- start start 2023-10-09T15:37:19.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf81594d0 0x7f6bf80c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 0x7f6bf80b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80c8c20 con 0x7f6bf81598a0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80b2e10 con 0x7f6bf81594d0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.174+0000 7f6bfd610700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf80b1830 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 0x7f6bf80b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:40408/0 (socket says 172.21.15.33:40408) 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 -- 172.21.15.33:0/3076795582 learned_addr learned my addr 172.21.15.33:0/3076795582 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf67fc700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf81594d0 0x7f6bf80c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 -- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf81594d0 msgr2=0x7f6bf80c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf81594d0 0x7f6bf80c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 -- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 msgr2=0x7f6bf80b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 0x7f6bf80b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 -- 172.21.15.33:0/3076795582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be00094f0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf77fe700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 0x7f6bf80b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bf6ffd700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000ec80 tx=0x7f6bf00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000c850 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000c9b0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf80b1b10 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000cd50 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.175+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf80b20d0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.176+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf804c3c0 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.177+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f6bf0005a00 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.177+0000 7f6beeffd700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 0x7f6bd8069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.177+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6bf0084d30 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.177+0000 7f6bf67fc700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 0x7f6bd8069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.178+0000 7f6bf67fc700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 0x7f6bd8069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.182+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6bf0051b90 con 0x7f6bf80cb1a0 2023-10-09T15:37:19.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.373+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6bf815dca0 con 0x7f6bd8067290 2023-10-09T15:37:19.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.381+0000 7f6beeffd700 1 -- 172.21.15.33:0/3076795582 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289723 (secure 0 0 0) 0x7f6bf815dca0 con 0x7f6bd8067290 2023-10-09T15:37:19.386 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 msgr2=0x7f6bd8069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 0x7f6bd8069740 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f6be00099b0 tx=0x7f6be0017000 comp rx=0 tx=0).stop 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 msgr2=0x7f6bf80b1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000ec80 tx=0x7f6bf00091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 shutdown_connections 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6bd8067290 0x7f6bd8069740 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6bf81598a0 0x7f6bf80b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6bf80cb1a0 0x7f6bf80b1130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 --2- 172.21.15.33:0/3076795582 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6bf81594d0 0x7f6bf80c86e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 >> 172.21.15.33:0/3076795582 conn(0x7f6bf80703a0 msgr2=0x7f6bf80c6ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 shutdown_connections 2023-10-09T15:37:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.385+0000 7f6bfd610700 1 -- 172.21.15.33:0/3076795582 wait complete. 2023-10-09T15:37:19.389 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:19.398 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2023-10-09T15:37:19.312793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418020,"kb_used_data":11044,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556700,"statfs":{"total":773094113280,"available":770618060800,"internally_reserved":0,"allocated":11309056,"data_stored":5528033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.051910"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285423+0000","last_change":"2023-10-09T15:37:14.283089+0000","last_active":"2023-10-09T15:37:14.285423+0000","last_peered":"2023-10-09T15:37:14.285423+0000","last_clean":"2023-10-09T15:37:14.285423+0000","last_became_active":"2023-10-09T15:37:14.282429+0000","last_became_peered":"2023-10-09T15:37:14.282429+0000","last_unstale":"2023-10-09T15:37:14.285423+0000","last_undegraded":"2023-10-09T15:37:14.285423+0000","last_fullsized":"2023-10-09T15:37:14.285423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:05.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.275646+0000","last_change":"2023-10-09T15:37:14.271244+0000","last_active":"2023-10-09T15:37:14.275646+0000","last_peered":"2023-10-09T15:37:14.275646+0000","last_clean":"2023-10-09T15:37:14.275646+0000","last_became_active":"2023-10-09T15:37:14.270928+0000","last_became_peered":"2023-10-09T15:37:14.270928+0000","last_unstale":"2023-10-09T15:37:14.275646+0000","last_undegraded":"2023-10-09T15:37:14.275646+0000","last_fullsized":"2023-10-09T15:37:14.275646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288402+0000","last_change":"2023-10-09T15:37:14.285401+0000","last_active":"2023-10-09T15:37:14.288402+0000","last_peered":"2023-10-09T15:37:14.288402+0000","last_clean":"2023-10-09T15:37:14.288402+0000","last_became_active":"2023-10-09T15:37:14.284760+0000","last_became_peered":"2023-10-09T15:37:14.284760+0000","last_unstale":"2023-10-09T15:37:14.288402+0000","last_undegraded":"2023-10-09T15:37:14.288402+0000","last_fullsized":"2023-10-09T15:37:14.288402+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284523+0000","last_change":"2023-10-09T15:37:14.279804+0000","last_active":"2023-10-09T15:37:14.284523+0000","last_peered":"2023-10-09T15:37:14.284523+0000","last_clean":"2023-10-09T15:37:14.284523+0000","last_became_active":"2023-10-09T15:37:14.279537+0000","last_became_peered":"2023-10-09T15:37:14.279537+0000","last_unstale":"2023-10-09T15:37:14.284523+0000","last_undegraded":"2023-10-09T15:37:14.284523+0000","last_fullsized":"2023-10-09T15:37:14.284523+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:35.277587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279288+0000","last_change":"2023-10-09T15:37:14.275930+0000","last_active":"2023-10-09T15:37:14.279288+0000","last_peered":"2023-10-09T15:37:14.279288+0000","last_clean":"2023-10-09T15:37:14.279288+0000","last_became_active":"2023-10-09T15:37:14.275654+0000","last_became_peered":"2023-10-09T15:37:14.275654+0000","last_unstale":"2023-10-09T15:37:14.279288+0000","last_undegraded":"2023-10-09T15:37:14.279288+0000","last_fullsized":"2023-10-09T15:37:14.279288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:09.527532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280826+0000","last_change":"2023-10-09T15:37:14.274461+0000","last_active":"2023-10-09T15:37:14.280826+0000","last_peered":"2023-10-09T15:37:14.280826+0000","last_clean":"2023-10-09T15:37:14.280826+0000","last_became_active":"2023-10-09T15:37:14.274171+0000","last_became_peered":"2023-10-09T15:37:14.274171+0000","last_unstale":"2023-10-09T15:37:14.280826+0000","last_undegraded":"2023-10-09T15:37:14.280826+0000","last_fullsized":"2023-10-09T15:37:14.280826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283290+0000","last_change":"2023-10-09T15:37:14.277236+0000","last_active":"2023-10-09T15:37:14.283290+0000","last_peered":"2023-10-09T15:37:14.283290+0000","last_clean":"2023-10-09T15:37:14.283290+0000","last_became_active":"2023-10-09T15:37:14.276969+0000","last_became_peered":"2023-10-09T15:37:14.276969+0000","last_unstale":"2023-10-09T15:37:14.283290+0000","last_undegraded":"2023-10-09T15:37:14.283290+0000","last_fullsized":"2023-10-09T15:37:14.283290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288169+0000","last_change":"2023-10-09T15:37:14.283309+0000","last_active":"2023-10-09T15:37:14.288169+0000","last_peered":"2023-10-09T15:37:14.288169+0000","last_clean":"2023-10-09T15:37:14.288169+0000","last_became_active":"2023-10-09T15:37:14.283065+0000","last_became_peered":"2023-10-09T15:37:14.283065+0000","last_unstale":"2023-10-09T15:37:14.288169+0000","last_undegraded":"2023-10-09T15:37:14.288169+0000","last_fullsized":"2023-10-09T15:37:14.288169+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284474+0000","last_change":"2023-10-09T15:37:14.278384+0000","last_active":"2023-10-09T15:37:14.284474+0000","last_peered":"2023-10-09T15:37:14.284474+0000","last_clean":"2023-10-09T15:37:14.284474+0000","last_became_active":"2023-10-09T15:37:14.277988+0000","last_became_peered":"2023-10-09T15:37:14.277988+0000","last_unstale":"2023-10-09T15:37:14.284474+0000","last_undegraded":"2023-10-09T15:37:14.284474+0000","last_fullsized":"2023-10-09T15:37:14.284474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:07.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284670+0000","last_change":"2023-10-09T15:37:14.280669+0000","last_active":"2023-10-09T15:37:14.284670+0000","last_peered":"2023-10-09T15:37:14.284670+0000","last_clean":"2023-10-09T15:37:14.284670+0000","last_became_active":"2023-10-09T15:37:14.280402+0000","last_became_peered":"2023-10-09T15:37:14.280402+0000","last_unstale":"2023-10-09T15:37:14.284670+0000","last_undegraded":"2023-10-09T15:37:14.284670+0000","last_fullsized":"2023-10-09T15:37:14.284670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:04.992720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277716+0000","last_change":"2023-10-09T15:37:14.272500+0000","last_active":"2023-10-09T15:37:14.277716+0000","last_peered":"2023-10-09T15:37:14.277716+0000","last_clean":"2023-10-09T15:37:14.277716+0000","last_became_active":"2023-10-09T15:37:14.272236+0000","last_became_peered":"2023-10-09T15:37:14.272236+0000","last_unstale":"2023-10-09T15:37:14.277716+0000","last_undegraded":"2023-10-09T15:37:14.277716+0000","last_fullsized":"2023-10-09T15:37:14.277716+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284540+0000","last_change":"2023-10-09T15:37:14.280205+0000","last_active":"2023-10-09T15:37:14.284540+0000","last_peered":"2023-10-09T15:37:14.284540+0000","last_clean":"2023-10-09T15:37:14.284540+0000","last_became_active":"2023-10-09T15:37:14.279692+0000","last_became_peered":"2023-10-09T15:37:14.279692+0000","last_unstale":"2023-10-09T15:37:14.284540+0000","last_undegraded":"2023-10-09T15:37:14.284540+0000","last_fullsized":"2023-10-09T15:37:14.284540+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:56.884832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288587+0000","last_change":"2023-10-09T15:37:14.286476+0000","last_active":"2023-10-09T15:37:14.288587+0000","last_peered":"2023-10-09T15:37:14.288587+0000","last_clean":"2023-10-09T15:37:14.288587+0000","last_became_active":"2023-10-09T15:37:14.286147+0000","last_became_peered":"2023-10-09T15:37:14.286147+0000","last_unstale":"2023-10-09T15:37:14.288587+0000","last_undegraded":"2023-10-09T15:37:14.288587+0000","last_fullsized":"2023-10-09T15:37:14.288587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288737+0000","last_change":"2023-10-09T15:37:14.287108+0000","last_active":"2023-10-09T15:37:14.288737+0000","last_peered":"2023-10-09T15:37:14.288737+0000","last_clean":"2023-10-09T15:37:14.288737+0000","last_became_active":"2023-10-09T15:37:14.286797+0000","last_became_peered":"2023-10-09T15:37:14.286797+0000","last_unstale":"2023-10-09T15:37:14.288737+0000","last_undegraded":"2023-10-09T15:37:14.288737+0000","last_fullsized":"2023-10-09T15:37:14.288737+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280566+0000","last_change":"2023-10-09T15:37:14.274476+0000","last_active":"2023-10-09T15:37:14.280566+0000","last_peered":"2023-10-09T15:37:14.280566+0000","last_clean":"2023-10-09T15:37:14.280566+0000","last_became_active":"2023-10-09T15:37:14.274181+0000","last_became_peered":"2023-10-09T15:37:14.274181+0000","last_unstale":"2023-10-09T15:37:14.280566+0000","last_undegraded":"2023-10-09T15:37:14.280566+0000","last_fullsized":"2023-10-09T15:37:14.280566+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285648+0000","last_change":"2023-10-09T15:37:14.284539+0000","last_active":"2023-10-09T15:37:14.285648+0000","last_peered":"2023-10-09T15:37:14.285648+0000","last_clean":"2023-10-09T15:37:14.285648+0000","last_became_active":"2023-10-09T15:37:14.284279+0000","last_became_peered":"2023-10-09T15:37:14.284279+0000","last_unstale":"2023-10-09T15:37:14.285648+0000","last_undegraded":"2023-10-09T15:37:14.285648+0000","last_fullsized":"2023-10-09T15:37:14.285648+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:23:52.965965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282828+0000","last_change":"2023-10-09T15:37:14.278706+0000","last_active":"2023-10-09T15:37:14.282828+0000","last_peered":"2023-10-09T15:37:14.282828+0000","last_clean":"2023-10-09T15:37:14.282828+0000","last_became_active":"2023-10-09T15:37:14.278455+0000","last_became_peered":"2023-10-09T15:37:14.278455+0000","last_unstale":"2023-10-09T15:37:14.282828+0000","last_undegraded":"2023-10-09T15:37:14.282828+0000","last_fullsized":"2023-10-09T15:37:14.282828+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.286725+0000","last_change":"2023-10-09T15:37:14.280712+0000","last_active":"2023-10-09T15:37:14.286725+0000","last_peered":"2023-10-09T15:37:14.286725+0000","last_clean":"2023-10-09T15:37:14.286725+0000","last_became_active":"2023-10-09T15:37:14.280422+0000","last_became_peered":"2023-10-09T15:37:14.280422+0000","last_unstale":"2023-10-09T15:37:14.286725+0000","last_undegraded":"2023-10-09T15:37:14.286725+0000","last_fullsized":"2023-10-09T15:37:14.286725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288789+0000","last_change":"2023-10-09T15:37:14.287406+0000","last_active":"2023-10-09T15:37:14.288789+0000","last_peered":"2023-10-09T15:37:14.288789+0000","last_clean":"2023-10-09T15:37:14.288789+0000","last_became_active":"2023-10-09T15:37:14.287052+0000","last_became_peered":"2023-10-09T15:37:14.287052+0000","last_unstale":"2023-10-09T15:37:14.288789+0000","last_undegraded":"2023-10-09T15:37:14.288789+0000","last_fullsized":"2023-10-09T15:37:14.288789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275157+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274882+0000","last_became_peered":"2023-10-09T15:37:14.274882+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282534+0000","last_change":"2023-10-09T15:37:14.276105+0000","last_active":"2023-10-09T15:37:14.282534+0000","last_peered":"2023-10-09T15:37:14.282534+0000","last_clean":"2023-10-09T15:37:14.282534+0000","last_became_active":"2023-10-09T15:37:14.275843+0000","last_became_peered":"2023-10-09T15:37:14.275843+0000","last_unstale":"2023-10-09T15:37:14.282534+0000","last_undegraded":"2023-10-09T15:37:14.282534+0000","last_fullsized":"2023-10-09T15:37:14.282534+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282391+0000","last_change":"2023-10-09T15:37:14.279166+0000","last_active":"2023-10-09T15:37:14.282391+0000","last_peered":"2023-10-09T15:37:14.282391+0000","last_clean":"2023-10-09T15:37:14.282391+0000","last_became_active":"2023-10-09T15:37:14.276319+0000","last_became_peered":"2023-10-09T15:37:14.276319+0000","last_unstale":"2023-10-09T15:37:14.282391+0000","last_undegraded":"2023-10-09T15:37:14.282391+0000","last_fullsized":"2023-10-09T15:37:14.282391+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275042+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274713+0000","last_became_peered":"2023-10-09T15:37:14.274713+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282403+0000","last_change":"2023-10-09T15:37:14.278971+0000","last_active":"2023-10-09T15:37:14.282403+0000","last_peered":"2023-10-09T15:37:14.282403+0000","last_clean":"2023-10-09T15:37:14.282403+0000","last_became_active":"2023-10-09T15:37:14.278693+0000","last_became_peered":"2023-10-09T15:37:14.278693+0000","last_unstale":"2023-10-09T15:37:14.282403+0000","last_undegraded":"2023-10-09T15:37:14.282403+0000","last_fullsized":"2023-10-09T15:37:14.282403+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282810+0000","last_change":"2023-10-09T15:37:14.278663+0000","last_active":"2023-10-09T15:37:14.282810+0000","last_peered":"2023-10-09T15:37:14.282810+0000","last_clean":"2023-10-09T15:37:14.282810+0000","last_became_active":"2023-10-09T15:37:14.278379+0000","last_became_peered":"2023-10-09T15:37:14.278379+0000","last_unstale":"2023-10-09T15:37:14.282810+0000","last_undegraded":"2023-10-09T15:37:14.282810+0000","last_fullsized":"2023-10-09T15:37:14.282810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285358+0000","last_change":"2023-10-09T15:37:14.281990+0000","last_active":"2023-10-09T15:37:14.285358+0000","last_peered":"2023-10-09T15:37:14.285358+0000","last_clean":"2023-10-09T15:37:14.285358+0000","last_became_active":"2023-10-09T15:37:14.281697+0000","last_became_peered":"2023-10-09T15:37:14.281697+0000","last_unstale":"2023-10-09T15:37:14.285358+0000","last_undegraded":"2023-10-09T15:37:14.285358+0000","last_fullsized":"2023-10-09T15:37:14.285358+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:54:57.392404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280851+0000","last_change":"2023-10-09T15:37:14.277837+0000","last_active":"2023-10-09T15:37:14.280851+0000","last_peered":"2023-10-09T15:37:14.280851+0000","last_clean":"2023-10-09T15:37:14.280851+0000","last_became_active":"2023-10-09T15:37:14.277093+0000","last_became_peered":"2023-10-09T15:37:14.277093+0000","last_unstale":"2023-10-09T15:37:14.280851+0000","last_undegraded":"2023-10-09T15:37:14.280851+0000","last_fullsized":"2023-10-09T15:37:14.280851+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:41.242740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282433+0000","last_change":"2023-10-09T15:37:14.278300+0000","last_active":"2023-10-09T15:37:14.282433+0000","last_peered":"2023-10-09T15:37:14.282433+0000","last_clean":"2023-10-09T15:37:14.282433+0000","last_became_active":"2023-10-09T15:37:14.278023+0000","last_became_peered":"2023-10-09T15:37:14.278023+0000","last_unstale":"2023-10-09T15:37:14.282433+0000","last_undegraded":"2023-10-09T15:37:14.282433+0000","last_fullsized":"2023-10-09T15:37:14.282433+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282777+0000","last_change":"2023-10-09T15:37:14.279955+0000","last_active":"2023-10-09T15:37:14.282777+0000","last_peered":"2023-10-09T15:37:14.282777+0000","last_clean":"2023-10-09T15:37:14.282777+0000","last_became_active":"2023-10-09T15:37:14.279648+0000","last_became_peered":"2023-10-09T15:37:14.279648+0000","last_unstale":"2023-10-09T15:37:14.282777+0000","last_undegraded":"2023-10-09T15:37:14.282777+0000","last_fullsized":"2023-10-09T15:37:14.282777+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288613+0000","last_change":"2023-10-09T15:37:14.280757+0000","last_active":"2023-10-09T15:37:14.288613+0000","last_peered":"2023-10-09T15:37:14.288613+0000","last_clean":"2023-10-09T15:37:14.288613+0000","last_became_active":"2023-10-09T15:37:14.280486+0000","last_became_peered":"2023-10-09T15:37:14.280486+0000","last_unstale":"2023-10-09T15:37:14.288613+0000","last_undegraded":"2023-10-09T15:37:14.288613+0000","last_fullsized":"2023-10-09T15:37:14.288613+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:20.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285665+0000","last_change":"2023-10-09T15:37:14.284845+0000","last_active":"2023-10-09T15:37:14.285665+0000","last_peered":"2023-10-09T15:37:14.285665+0000","last_clean":"2023-10-09T15:37:14.285665+0000","last_became_active":"2023-10-09T15:37:14.284582+0000","last_became_peered":"2023-10-09T15:37:14.284582+0000","last_unstale":"2023-10-09T15:37:14.285665+0000","last_undegraded":"2023-10-09T15:37:14.285665+0000","last_fullsized":"2023-10-09T15:37:14.285665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:33.335674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280808+0000","last_change":"2023-10-09T15:37:14.272511+0000","last_active":"2023-10-09T15:37:14.280808+0000","last_peered":"2023-10-09T15:37:14.280808+0000","last_clean":"2023-10-09T15:37:14.280808+0000","last_became_active":"2023-10-09T15:37:14.272246+0000","last_became_peered":"2023-10-09T15:37:14.272246+0000","last_unstale":"2023-10-09T15:37:14.280808+0000","last_undegraded":"2023-10-09T15:37:14.280808+0000","last_fullsized":"2023-10-09T15:37:14.280808+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280771+0000","last_change":"2023-10-09T15:37:14.272401+0000","last_active":"2023-10-09T15:37:14.280771+0000","last_peered":"2023-10-09T15:37:14.280771+0000","last_clean":"2023-10-09T15:37:14.280771+0000","last_became_active":"2023-10-09T15:37:14.272121+0000","last_became_peered":"2023-10-09T15:37:14.272121+0000","last_unstale":"2023-10-09T15:37:14.280771+0000","last_undegraded":"2023-10-09T15:37:14.280771+0000","last_fullsized":"2023-10-09T15:37:14.280771+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:20.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523950+0000","last_change":"2023-10-09T15:37:13.276939+0000","last_active":"2023-10-09T15:37:14.523950+0000","last_peered":"2023-10-09T15:37:14.523950+0000","last_clean":"2023-10-09T15:37:14.523950+0000","last_became_active":"2023-10-09T15:37:13.276618+0000","last_became_peered":"2023-10-09T15:37:13.276618+0000","last_unstale":"2023-10-09T15:37:14.523950+0000","last_undegraded":"2023-10-09T15:37:14.523950+0000","last_fullsized":"2023-10-09T15:37:14.523950+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280474+0000","last_change":"2023-10-09T15:37:14.276769+0000","last_active":"2023-10-09T15:37:14.280474+0000","last_peered":"2023-10-09T15:37:14.280474+0000","last_clean":"2023-10-09T15:37:14.280474+0000","last_became_active":"2023-10-09T15:37:14.276498+0000","last_became_peered":"2023-10-09T15:37:14.276498+0000","last_unstale":"2023-10-09T15:37:14.280474+0000","last_undegraded":"2023-10-09T15:37:14.280474+0000","last_fullsized":"2023-10-09T15:37:14.280474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521601+0000","last_change":"2023-10-09T15:37:13.277106+0000","last_active":"2023-10-09T15:37:14.521601+0000","last_peered":"2023-10-09T15:37:14.521601+0000","last_clean":"2023-10-09T15:37:14.521601+0000","last_became_active":"2023-10-09T15:37:13.276756+0000","last_became_peered":"2023-10-09T15:37:13.276756+0000","last_unstale":"2023-10-09T15:37:14.521601+0000","last_undegraded":"2023-10-09T15:37:14.521601+0000","last_fullsized":"2023-10-09T15:37:14.521601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:52.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280575+0000","last_change":"2023-10-09T15:37:14.274803+0000","last_active":"2023-10-09T15:37:14.280575+0000","last_peered":"2023-10-09T15:37:14.280575+0000","last_clean":"2023-10-09T15:37:14.280575+0000","last_became_active":"2023-10-09T15:37:14.274082+0000","last_became_peered":"2023-10-09T15:37:14.274082+0000","last_unstale":"2023-10-09T15:37:14.280575+0000","last_undegraded":"2023-10-09T15:37:14.280575+0000","last_fullsized":"2023-10-09T15:37:14.280575+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:14.824729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.529515+0000","last_change":"2023-10-09T15:37:13.283184+0000","last_active":"2023-10-09T15:37:14.529515+0000","last_peered":"2023-10-09T15:37:14.529515+0000","last_clean":"2023-10-09T15:37:14.529515+0000","last_became_active":"2023-10-09T15:37:13.282883+0000","last_became_peered":"2023-10-09T15:37:13.282883+0000","last_unstale":"2023-10-09T15:37:14.529515+0000","last_undegraded":"2023-10-09T15:37:14.529515+0000","last_fullsized":"2023-10-09T15:37:14.529515+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:58.065576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292432+0000","last_change":"2023-10-09T15:37:14.288289+0000","last_active":"2023-10-09T15:37:14.292432+0000","last_peered":"2023-10-09T15:37:14.292432+0000","last_clean":"2023-10-09T15:37:14.292432+0000","last_became_active":"2023-10-09T15:37:14.287837+0000","last_became_peered":"2023-10-09T15:37:14.287837+0000","last_unstale":"2023-10-09T15:37:14.292432+0000","last_undegraded":"2023-10-09T15:37:14.292432+0000","last_fullsized":"2023-10-09T15:37:14.292432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.525841+0000","last_change":"2023-10-09T15:37:13.283087+0000","last_active":"2023-10-09T15:37:14.525841+0000","last_peered":"2023-10-09T15:37:14.525841+0000","last_clean":"2023-10-09T15:37:14.525841+0000","last_became_active":"2023-10-09T15:37:13.282773+0000","last_became_peered":"2023-10-09T15:37:13.282773+0000","last_unstale":"2023-10-09T15:37:14.525841+0000","last_undegraded":"2023-10-09T15:37:14.525841+0000","last_fullsized":"2023-10-09T15:37:14.525841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:46.940465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283584+0000","last_change":"2023-10-09T15:37:14.277165+0000","last_active":"2023-10-09T15:37:14.283584+0000","last_peered":"2023-10-09T15:37:14.283584+0000","last_clean":"2023-10-09T15:37:14.283584+0000","last_became_active":"2023-10-09T15:37:14.276887+0000","last_became_peered":"2023-10-09T15:37:14.276887+0000","last_unstale":"2023-10-09T15:37:14.283584+0000","last_undegraded":"2023-10-09T15:37:14.283584+0000","last_fullsized":"2023-10-09T15:37:14.283584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:13.928326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.519739+0000","last_change":"2023-10-09T15:37:13.281132+0000","last_active":"2023-10-09T15:37:14.519739+0000","last_peered":"2023-10-09T15:37:14.519739+0000","last_clean":"2023-10-09T15:37:14.519739+0000","last_became_active":"2023-10-09T15:37:13.280901+0000","last_became_peered":"2023-10-09T15:37:13.280901+0000","last_unstale":"2023-10-09T15:37:14.519739+0000","last_undegraded":"2023-10-09T15:37:14.519739+0000","last_fullsized":"2023-10-09T15:37:14.519739+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277645+0000","last_change":"2023-10-09T15:37:14.273080+0000","last_active":"2023-10-09T15:37:14.277645+0000","last_peered":"2023-10-09T15:37:14.277645+0000","last_clean":"2023-10-09T15:37:14.277645+0000","last_became_active":"2023-10-09T15:37:14.272773+0000","last_became_peered":"2023-10-09T15:37:14.272773+0000","last_unstale":"2023-10-09T15:37:14.277645+0000","last_undegraded":"2023-10-09T15:37:14.277645+0000","last_fullsized":"2023-10-09T15:37:14.277645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.522997+0000","last_change":"2023-10-09T15:37:13.269828+0000","last_active":"2023-10-09T15:37:14.522997+0000","last_peered":"2023-10-09T15:37:14.522997+0000","last_clean":"2023-10-09T15:37:14.522997+0000","last_became_active":"2023-10-09T15:37:13.269489+0000","last_became_peered":"2023-10-09T15:37:13.269489+0000","last_unstale":"2023-10-09T15:37:14.522997+0000","last_undegraded":"2023-10-09T15:37:14.522997+0000","last_fullsized":"2023-10-09T15:37:14.522997+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:46.511413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285084+0000","last_change":"2023-10-09T15:37:14.281486+0000","last_active":"2023-10-09T15:37:14.285084+0000","last_peered":"2023-10-09T15:37:14.285084+0000","last_clean":"2023-10-09T15:37:14.285084+0000","last_became_active":"2023-10-09T15:37:14.281160+0000","last_became_peered":"2023-10-09T15:37:14.281160+0000","last_unstale":"2023-10-09T15:37:14.285084+0000","last_undegraded":"2023-10-09T15:37:14.285084+0000","last_fullsized":"2023-10-09T15:37:14.285084+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:09.832083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265903+0000","last_change":"2023-10-09T15:37:13.274950+0000","last_active":"2023-10-09T15:37:14.265903+0000","last_peered":"2023-10-09T15:37:14.265903+0000","last_clean":"2023-10-09T15:37:14.265903+0000","last_became_active":"2023-10-09T15:37:13.274547+0000","last_became_peered":"2023-10-09T15:37:13.274547+0000","last_unstale":"2023-10-09T15:37:14.265903+0000","last_undegraded":"2023-10-09T15:37:14.265903+0000","last_fullsized":"2023-10-09T15:37:14.265903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283270+0000","last_change":"2023-10-09T15:37:14.276677+0000","last_active":"2023-10-09T15:37:14.283270+0000","last_peered":"2023-10-09T15:37:14.283270+0000","last_clean":"2023-10-09T15:37:14.283270+0000","last_became_active":"2023-10-09T15:37:14.276326+0000","last_became_peered":"2023-10-09T15:37:14.276326+0000","last_unstale":"2023-10-09T15:37:14.283270+0000","last_undegraded":"2023-10-09T15:37:14.283270+0000","last_fullsized":"2023-10-09T15:37:14.283270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271548+0000","last_change":"2023-10-09T15:37:13.288878+0000","last_active":"2023-10-09T15:37:14.271548+0000","last_peered":"2023-10-09T15:37:14.271548+0000","last_clean":"2023-10-09T15:37:14.271548+0000","last_became_active":"2023-10-09T15:37:13.287910+0000","last_became_peered":"2023-10-09T15:37:13.287910+0000","last_unstale":"2023-10-09T15:37:14.271548+0000","last_undegraded":"2023-10-09T15:37:14.271548+0000","last_fullsized":"2023-10-09T15:37:14.271548+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:14.196333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288694+0000","last_change":"2023-10-09T15:37:14.282171+0000","last_active":"2023-10-09T15:37:14.288694+0000","last_peered":"2023-10-09T15:37:14.288694+0000","last_clean":"2023-10-09T15:37:14.288694+0000","last_became_active":"2023-10-09T15:37:14.281904+0000","last_became_peered":"2023-10-09T15:37:14.281904+0000","last_unstale":"2023-10-09T15:37:14.288694+0000","last_undegraded":"2023-10-09T15:37:14.288694+0000","last_fullsized":"2023-10-09T15:37:14.288694+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264415+0000","last_change":"2023-10-09T15:37:13.282437+0000","last_active":"2023-10-09T15:37:14.264415+0000","last_peered":"2023-10-09T15:37:14.264415+0000","last_clean":"2023-10-09T15:37:14.264415+0000","last_became_active":"2023-10-09T15:37:13.282148+0000","last_became_peered":"2023-10-09T15:37:13.282148+0000","last_unstale":"2023-10-09T15:37:14.264415+0000","last_undegraded":"2023-10-09T15:37:14.264415+0000","last_fullsized":"2023-10-09T15:37:14.264415+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:29.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.287675+0000","last_change":"2023-10-09T15:37:14.280613+0000","last_active":"2023-10-09T15:37:14.287675+0000","last_peered":"2023-10-09T15:37:14.287675+0000","last_clean":"2023-10-09T15:37:14.287675+0000","last_became_active":"2023-10-09T15:37:14.280267+0000","last_became_peered":"2023-10-09T15:37:14.280267+0000","last_unstale":"2023-10-09T15:37:14.287675+0000","last_undegraded":"2023-10-09T15:37:14.287675+0000","last_fullsized":"2023-10-09T15:37:14.287675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.268371+0000","last_change":"2023-10-09T15:37:13.274732+0000","last_active":"2023-10-09T15:37:14.268371+0000","last_peered":"2023-10-09T15:37:14.268371+0000","last_clean":"2023-10-09T15:37:14.268371+0000","last_became_active":"2023-10-09T15:37:13.274416+0000","last_became_peered":"2023-10-09T15:37:13.274416+0000","last_unstale":"2023-10-09T15:37:14.268371+0000","last_undegraded":"2023-10-09T15:37:14.268371+0000","last_fullsized":"2023-10-09T15:37:14.268371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:59.743080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282233+0000","last_change":"2023-10-09T15:37:14.276821+0000","last_active":"2023-10-09T15:37:14.282233+0000","last_peered":"2023-10-09T15:37:14.282233+0000","last_clean":"2023-10-09T15:37:14.282233+0000","last_became_active":"2023-10-09T15:37:14.276562+0000","last_became_peered":"2023-10-09T15:37:14.276562+0000","last_unstale":"2023-10-09T15:37:14.282233+0000","last_undegraded":"2023-10-09T15:37:14.282233+0000","last_fullsized":"2023-10-09T15:37:14.282233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528669+0000","last_change":"2023-10-09T15:37:13.288137+0000","last_active":"2023-10-09T15:37:14.528669+0000","last_peered":"2023-10-09T15:37:14.528669+0000","last_clean":"2023-10-09T15:37:14.528669+0000","last_became_active":"2023-10-09T15:37:13.287608+0000","last_became_peered":"2023-10-09T15:37:13.287608+0000","last_unstale":"2023-10-09T15:37:14.528669+0000","last_undegraded":"2023-10-09T15:37:14.528669+0000","last_fullsized":"2023-10-09T15:37:14.528669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:03.271206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292436+0000","last_change":"2023-10-09T15:37:14.285936+0000","last_active":"2023-10-09T15:37:14.292436+0000","last_peered":"2023-10-09T15:37:14.292436+0000","last_clean":"2023-10-09T15:37:14.292436+0000","last_became_active":"2023-10-09T15:37:14.285374+0000","last_became_peered":"2023-10-09T15:37:14.285374+0000","last_unstale":"2023-10-09T15:37:14.292436+0000","last_undegraded":"2023-10-09T15:37:14.292436+0000","last_fullsized":"2023-10-09T15:37:14.292436+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:56.188958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.531447+0000","last_change":"2023-10-09T15:37:13.286954+0000","last_active":"2023-10-09T15:37:14.531447+0000","last_peered":"2023-10-09T15:37:14.531447+0000","last_clean":"2023-10-09T15:37:14.531447+0000","last_became_active":"2023-10-09T15:37:13.286663+0000","last_became_peered":"2023-10-09T15:37:13.286663+0000","last_unstale":"2023-10-09T15:37:14.531447+0000","last_undegraded":"2023-10-09T15:37:14.531447+0000","last_fullsized":"2023-10-09T15:37:14.531447+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:29.120558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282356+0000","last_change":"2023-10-09T15:37:14.278482+0000","last_active":"2023-10-09T15:37:14.282356+0000","last_peered":"2023-10-09T15:37:14.282356+0000","last_clean":"2023-10-09T15:37:14.282356+0000","last_became_active":"2023-10-09T15:37:14.277837+0000","last_became_peered":"2023-10-09T15:37:14.277837+0000","last_unstale":"2023-10-09T15:37:14.282356+0000","last_undegraded":"2023-10-09T15:37:14.282356+0000","last_fullsized":"2023-10-09T15:37:14.282356+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521994+0000","last_change":"2023-10-09T15:37:13.281780+0000","last_active":"2023-10-09T15:37:14.521994+0000","last_peered":"2023-10-09T15:37:14.521994+0000","last_clean":"2023-10-09T15:37:14.521994+0000","last_became_active":"2023-10-09T15:37:13.281426+0000","last_became_peered":"2023-10-09T15:37:13.281426+0000","last_unstale":"2023-10-09T15:37:14.521994+0000","last_undegraded":"2023-10-09T15:37:14.521994+0000","last_fullsized":"2023-10-09T15:37:14.521994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283213+0000","last_change":"2023-10-09T15:37:14.281117+0000","last_active":"2023-10-09T15:37:14.283213+0000","last_peered":"2023-10-09T15:37:14.283213+0000","last_clean":"2023-10-09T15:37:14.283213+0000","last_became_active":"2023-10-09T15:37:14.280843+0000","last_became_peered":"2023-10-09T15:37:14.280843+0000","last_unstale":"2023-10-09T15:37:14.283213+0000","last_undegraded":"2023-10-09T15:37:14.283213+0000","last_fullsized":"2023-10-09T15:37:14.283213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270097+0000","last_change":"2023-10-09T15:37:13.289688+0000","last_active":"2023-10-09T15:37:14.270097+0000","last_peered":"2023-10-09T15:37:14.270097+0000","last_clean":"2023-10-09T15:37:14.270097+0000","last_became_active":"2023-10-09T15:37:13.289475+0000","last_became_peered":"2023-10-09T15:37:13.289475+0000","last_unstale":"2023-10-09T15:37:14.270097+0000","last_undegraded":"2023-10-09T15:37:14.270097+0000","last_fullsized":"2023-10-09T15:37:14.270097+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282486+0000","last_change":"2023-10-09T15:37:14.280668+0000","last_active":"2023-10-09T15:37:14.282486+0000","last_peered":"2023-10-09T15:37:14.282486+0000","last_clean":"2023-10-09T15:37:14.282486+0000","last_became_active":"2023-10-09T15:37:14.280404+0000","last_became_peered":"2023-10-09T15:37:14.280404+0000","last_unstale":"2023-10-09T15:37:14.282486+0000","last_undegraded":"2023-10-09T15:37:14.282486+0000","last_fullsized":"2023-10-09T15:37:14.282486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528883+0000","last_change":"2023-10-09T15:37:13.292286+0000","last_active":"2023-10-09T15:37:14.528883+0000","last_peered":"2023-10-09T15:37:14.528883+0000","last_clean":"2023-10-09T15:37:14.528883+0000","last_became_active":"2023-10-09T15:37:13.291981+0000","last_became_peered":"2023-10-09T15:37:13.291981+0000","last_unstale":"2023-10-09T15:37:14.528883+0000","last_undegraded":"2023-10-09T15:37:14.528883+0000","last_fullsized":"2023-10-09T15:37:14.528883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:59.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279576+0000","last_change":"2023-10-09T15:37:14.277490+0000","last_active":"2023-10-09T15:37:14.279576+0000","last_peered":"2023-10-09T15:37:14.279576+0000","last_clean":"2023-10-09T15:37:14.279576+0000","last_became_active":"2023-10-09T15:37:14.277198+0000","last_became_peered":"2023-10-09T15:37:14.277198+0000","last_unstale":"2023-10-09T15:37:14.279576+0000","last_undegraded":"2023-10-09T15:37:14.279576+0000","last_fullsized":"2023-10-09T15:37:14.279576+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:17.436456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.524200+0000","last_change":"2023-10-09T15:37:13.290785+0000","last_active":"2023-10-09T15:37:14.524200+0000","last_peered":"2023-10-09T15:37:14.524200+0000","last_clean":"2023-10-09T15:37:14.524200+0000","last_became_active":"2023-10-09T15:37:13.290382+0000","last_became_peered":"2023-10-09T15:37:13.290382+0000","last_unstale":"2023-10-09T15:37:14.524200+0000","last_undegraded":"2023-10-09T15:37:14.524200+0000","last_fullsized":"2023-10-09T15:37:14.524200+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:29.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283221+0000","last_change":"2023-10-09T15:37:14.280688+0000","last_active":"2023-10-09T15:37:14.283221+0000","last_peered":"2023-10-09T15:37:14.283221+0000","last_clean":"2023-10-09T15:37:14.283221+0000","last_became_active":"2023-10-09T15:37:14.280389+0000","last_became_peered":"2023-10-09T15:37:14.280389+0000","last_unstale":"2023-10-09T15:37:14.283221+0000","last_undegraded":"2023-10-09T15:37:14.283221+0000","last_fullsized":"2023-10-09T15:37:14.283221+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:31.576956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523931+0000","last_change":"2023-10-09T15:37:13.278333+0000","last_active":"2023-10-09T15:37:14.523931+0000","last_peered":"2023-10-09T15:37:14.523931+0000","last_clean":"2023-10-09T15:37:14.523931+0000","last_became_active":"2023-10-09T15:37:13.277794+0000","last_became_peered":"2023-10-09T15:37:13.277794+0000","last_unstale":"2023-10-09T15:37:14.523931+0000","last_undegraded":"2023-10-09T15:37:14.523931+0000","last_fullsized":"2023-10-09T15:37:14.523931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:05.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288180+0000","last_change":"2023-10-09T15:37:14.283052+0000","last_active":"2023-10-09T15:37:14.288180+0000","last_peered":"2023-10-09T15:37:14.288180+0000","last_clean":"2023-10-09T15:37:14.288180+0000","last_became_active":"2023-10-09T15:37:14.282729+0000","last_became_peered":"2023-10-09T15:37:14.282729+0000","last_unstale":"2023-10-09T15:37:14.288180+0000","last_undegraded":"2023-10-09T15:37:14.288180+0000","last_fullsized":"2023-10-09T15:37:14.288180+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523307+0000","last_change":"2023-10-09T15:37:13.274887+0000","last_active":"2023-10-09T15:37:14.523307+0000","last_peered":"2023-10-09T15:37:14.523307+0000","last_clean":"2023-10-09T15:37:14.523307+0000","last_became_active":"2023-10-09T15:37:13.274588+0000","last_became_peered":"2023-10-09T15:37:13.274588+0000","last_unstale":"2023-10-09T15:37:14.523307+0000","last_undegraded":"2023-10-09T15:37:14.523307+0000","last_fullsized":"2023-10-09T15:37:14.523307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288683+0000","last_change":"2023-10-09T15:37:14.286725+0000","last_active":"2023-10-09T15:37:14.288683+0000","last_peered":"2023-10-09T15:37:14.288683+0000","last_clean":"2023-10-09T15:37:14.288683+0000","last_became_active":"2023-10-09T15:37:14.285111+0000","last_became_peered":"2023-10-09T15:37:14.285111+0000","last_unstale":"2023-10-09T15:37:14.288683+0000","last_undegraded":"2023-10-09T15:37:14.288683+0000","last_fullsized":"2023-10-09T15:37:14.288683+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270270+0000","last_change":"2023-10-09T15:37:13.288752+0000","last_active":"2023-10-09T15:37:14.270270+0000","last_peered":"2023-10-09T15:37:14.270270+0000","last_clean":"2023-10-09T15:37:14.270270+0000","last_became_active":"2023-10-09T15:37:13.288137+0000","last_became_peered":"2023-10-09T15:37:13.288137+0000","last_unstale":"2023-10-09T15:37:14.270270+0000","last_undegraded":"2023-10-09T15:37:14.270270+0000","last_fullsized":"2023-10-09T15:37:14.270270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.123202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288118+0000","last_change":"2023-10-09T15:37:14.284986+0000","last_active":"2023-10-09T15:37:14.288118+0000","last_peered":"2023-10-09T15:37:14.288118+0000","last_clean":"2023-10-09T15:37:14.288118+0000","last_became_active":"2023-10-09T15:37:14.284646+0000","last_became_peered":"2023-10-09T15:37:14.284646+0000","last_unstale":"2023-10-09T15:37:14.288118+0000","last_undegraded":"2023-10-09T15:37:14.288118+0000","last_fullsized":"2023-10-09T15:37:14.288118+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526119+0000","last_change":"2023-10-09T15:37:13.283569+0000","last_active":"2023-10-09T15:37:14.526119+0000","last_peered":"2023-10-09T15:37:14.526119+0000","last_clean":"2023-10-09T15:37:14.526119+0000","last_became_active":"2023-10-09T15:37:13.283300+0000","last_became_peered":"2023-10-09T15:37:13.283300+0000","last_unstale":"2023-10-09T15:37:14.526119+0000","last_undegraded":"2023-10-09T15:37:14.526119+0000","last_fullsized":"2023-10-09T15:37:14.526119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285610+0000","last_change":"2023-10-09T15:37:14.284050+0000","last_active":"2023-10-09T15:37:14.285610+0000","last_peered":"2023-10-09T15:37:14.285610+0000","last_clean":"2023-10-09T15:37:14.285610+0000","last_became_active":"2023-10-09T15:37:14.283746+0000","last_became_peered":"2023-10-09T15:37:14.283746+0000","last_unstale":"2023-10-09T15:37:14.285610+0000","last_undegraded":"2023-10-09T15:37:14.285610+0000","last_fullsized":"2023-10-09T15:37:14.285610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:26.439686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264252+0000","last_change":"2023-10-09T15:37:13.282555+0000","last_active":"2023-10-09T15:37:14.264252+0000","last_peered":"2023-10-09T15:37:14.264252+0000","last_clean":"2023-10-09T15:37:14.264252+0000","last_became_active":"2023-10-09T15:37:13.282285+0000","last_became_peered":"2023-10-09T15:37:13.282285+0000","last_unstale":"2023-10-09T15:37:14.264252+0000","last_undegraded":"2023-10-09T15:37:14.264252+0000","last_fullsized":"2023-10-09T15:37:14.264252+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:57.308202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288595+0000","last_change":"2023-10-09T15:37:14.286551+0000","last_active":"2023-10-09T15:37:14.288595+0000","last_peered":"2023-10-09T15:37:14.288595+0000","last_clean":"2023-10-09T15:37:14.288595+0000","last_became_active":"2023-10-09T15:37:14.286174+0000","last_became_peered":"2023-10-09T15:37:14.286174+0000","last_unstale":"2023-10-09T15:37:14.288595+0000","last_undegraded":"2023-10-09T15:37:14.288595+0000","last_fullsized":"2023-10-09T15:37:14.288595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265707+0000","last_change":"2023-10-09T15:37:13.283869+0000","last_active":"2023-10-09T15:37:14.265707+0000","last_peered":"2023-10-09T15:37:14.265707+0000","last_clean":"2023-10-09T15:37:14.265707+0000","last_became_active":"2023-10-09T15:37:13.283553+0000","last_became_peered":"2023-10-09T15:37:13.283553+0000","last_unstale":"2023-10-09T15:37:14.265707+0000","last_undegraded":"2023-10-09T15:37:14.265707+0000","last_fullsized":"2023-10-09T15:37:14.265707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282469+0000","last_change":"2023-10-09T15:37:14.278717+0000","last_active":"2023-10-09T15:37:14.282469+0000","last_peered":"2023-10-09T15:37:14.282469+0000","last_clean":"2023-10-09T15:37:14.282469+0000","last_became_active":"2023-10-09T15:37:14.278462+0000","last_became_peered":"2023-10-09T15:37:14.278462+0000","last_unstale":"2023-10-09T15:37:14.282469+0000","last_undegraded":"2023-10-09T15:37:14.282469+0000","last_fullsized":"2023-10-09T15:37:14.282469+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:20.242868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271806+0000","last_change":"2023-10-09T15:37:13.290871+0000","last_active":"2023-10-09T15:37:14.271806+0000","last_peered":"2023-10-09T15:37:14.271806+0000","last_clean":"2023-10-09T15:37:14.271806+0000","last_became_active":"2023-10-09T15:37:13.290518+0000","last_became_peered":"2023-10-09T15:37:13.290518+0000","last_unstale":"2023-10-09T15:37:14.271806+0000","last_undegraded":"2023-10-09T15:37:14.271806+0000","last_fullsized":"2023-10-09T15:37:14.271806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:49.732124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280835+0000","last_change":"2023-10-09T15:37:14.277829+0000","last_active":"2023-10-09T15:37:14.280835+0000","last_peered":"2023-10-09T15:37:14.280835+0000","last_clean":"2023-10-09T15:37:14.280835+0000","last_became_active":"2023-10-09T15:37:14.277492+0000","last_became_peered":"2023-10-09T15:37:14.277492+0000","last_unstale":"2023-10-09T15:37:14.280835+0000","last_undegraded":"2023-10-09T15:37:14.280835+0000","last_fullsized":"2023-10-09T15:37:14.280835+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526239+0000","last_change":"2023-10-09T15:37:13.287838+0000","last_active":"2023-10-09T15:37:14.526239+0000","last_peered":"2023-10-09T15:37:14.526239+0000","last_clean":"2023-10-09T15:37:14.526239+0000","last_became_active":"2023-10-09T15:37:13.287540+0000","last_became_peered":"2023-10-09T15:37:13.287540+0000","last_unstale":"2023-10-09T15:37:14.526239+0000","last_undegraded":"2023-10-09T15:37:14.526239+0000","last_fullsized":"2023-10-09T15:37:14.526239+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:53.625320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285564+0000","last_change":"2023-10-09T15:37:14.283276+0000","last_active":"2023-10-09T15:37:14.285564+0000","last_peered":"2023-10-09T15:37:14.285564+0000","last_clean":"2023-10-09T15:37:14.285564+0000","last_became_active":"2023-10-09T15:37:14.282833+0000","last_became_peered":"2023-10-09T15:37:14.282833+0000","last_unstale":"2023-10-09T15:37:14.285564+0000","last_undegraded":"2023-10-09T15:37:14.285564+0000","last_fullsized":"2023-10-09T15:37:14.285564+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:39.258683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270676+0000","last_change":"2023-10-09T15:37:13.272306+0000","last_active":"2023-10-09T15:37:14.270676+0000","last_peered":"2023-10-09T15:37:14.270676+0000","last_clean":"2023-10-09T15:37:14.270676+0000","last_became_active":"2023-10-09T15:37:13.272027+0000","last_became_peered":"2023-10-09T15:37:13.272027+0000","last_unstale":"2023-10-09T15:37:14.270676+0000","last_undegraded":"2023-10-09T15:37:14.270676+0000","last_fullsized":"2023-10-09T15:37:14.270676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:40.238895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285567+0000","last_change":"2023-10-09T15:37:14.283291+0000","last_active":"2023-10-09T15:37:14.285567+0000","last_peered":"2023-10-09T15:37:14.285567+0000","last_clean":"2023-10-09T15:37:14.285567+0000","last_became_active":"2023-10-09T15:37:14.282969+0000","last_became_peered":"2023-10-09T15:37:14.282969+0000","last_unstale":"2023-10-09T15:37:14.285567+0000","last_undegraded":"2023-10-09T15:37:14.285567+0000","last_fullsized":"2023-10-09T15:37:14.285567+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.870108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270833+0000","last_change":"2023-10-09T15:37:13.290899+0000","last_active":"2023-10-09T15:37:14.270833+0000","last_peered":"2023-10-09T15:37:14.270833+0000","last_clean":"2023-10-09T15:37:14.270833+0000","last_became_active":"2023-10-09T15:37:13.290629+0000","last_became_peered":"2023-10-09T15:37:13.290629+0000","last_unstale":"2023-10-09T15:37:14.270833+0000","last_undegraded":"2023-10-09T15:37:14.270833+0000","last_fullsized":"2023-10-09T15:37:14.270833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280037+0000","last_change":"2023-10-09T15:37:14.277632+0000","last_active":"2023-10-09T15:37:14.280037+0000","last_peered":"2023-10-09T15:37:14.280037+0000","last_clean":"2023-10-09T15:37:14.280037+0000","last_became_active":"2023-10-09T15:37:14.277302+0000","last_became_peered":"2023-10-09T15:37:14.277302+0000","last_unstale":"2023-10-09T15:37:14.280037+0000","last_undegraded":"2023-10-09T15:37:14.280037+0000","last_fullsized":"2023-10-09T15:37:14.280037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270583+0000","last_change":"2023-10-09T15:37:13.282192+0000","last_active":"2023-10-09T15:37:14.270583+0000","last_peered":"2023-10-09T15:37:14.270583+0000","last_clean":"2023-10-09T15:37:14.270583+0000","last_became_active":"2023-10-09T15:37:13.281909+0000","last_became_peered":"2023-10-09T15:37:13.281909+0000","last_unstale":"2023-10-09T15:37:14.270583+0000","last_undegraded":"2023-10-09T15:37:14.270583+0000","last_fullsized":"2023-10-09T15:37:14.270583+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:03.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282741+0000","last_change":"2023-10-09T15:37:14.277241+0000","last_active":"2023-10-09T15:37:14.282741+0000","last_peered":"2023-10-09T15:37:14.282741+0000","last_clean":"2023-10-09T15:37:14.282741+0000","last_became_active":"2023-10-09T15:37:14.276934+0000","last_became_peered":"2023-10-09T15:37:14.276934+0000","last_unstale":"2023-10-09T15:37:14.282741+0000","last_undegraded":"2023-10-09T15:37:14.282741+0000","last_fullsized":"2023-10-09T15:37:14.282741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270280+0000","last_change":"2023-10-09T15:37:13.273755+0000","last_active":"2023-10-09T15:37:14.270280+0000","last_peered":"2023-10-09T15:37:14.270280+0000","last_clean":"2023-10-09T15:37:14.270280+0000","last_became_active":"2023-10-09T15:37:13.273413+0000","last_became_peered":"2023-10-09T15:37:13.273413+0000","last_unstale":"2023-10-09T15:37:14.270280+0000","last_undegraded":"2023-10-09T15:37:14.270280+0000","last_fullsized":"2023-10-09T15:37:14.270280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.276198+0000","last_change":"2023-10-09T15:37:14.268829+0000","last_active":"2023-10-09T15:37:14.276198+0000","last_peered":"2023-10-09T15:37:14.276198+0000","last_clean":"2023-10-09T15:37:14.276198+0000","last_became_active":"2023-10-09T15:37:14.268521+0000","last_became_peered":"2023-10-09T15:37:14.268521+0000","last_unstale":"2023-10-09T15:37:14.276198+0000","last_undegraded":"2023-10-09T15:37:14.276198+0000","last_fullsized":"2023-10-09T15:37:14.276198+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.266069+0000","last_change":"2023-10-09T15:37:13.282267+0000","last_active":"2023-10-09T15:37:14.266069+0000","last_peered":"2023-10-09T15:37:14.266069+0000","last_clean":"2023-10-09T15:37:14.266069+0000","last_became_active":"2023-10-09T15:37:13.281978+0000","last_became_peered":"2023-10-09T15:37:13.281978+0000","last_unstale":"2023-10-09T15:37:14.266069+0000","last_undegraded":"2023-10-09T15:37:14.266069+0000","last_fullsized":"2023-10-09T15:37:14.266069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288617+0000","last_change":"2023-10-09T15:37:14.286705+0000","last_active":"2023-10-09T15:37:14.288617+0000","last_peered":"2023-10-09T15:37:14.288617+0000","last_clean":"2023-10-09T15:37:14.288617+0000","last_became_active":"2023-10-09T15:37:14.285909+0000","last_became_peered":"2023-10-09T15:37:14.285909+0000","last_unstale":"2023-10-09T15:37:14.288617+0000","last_undegraded":"2023-10-09T15:37:14.288617+0000","last_fullsized":"2023-10-09T15:37:14.288617+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264214+0000","last_change":"2023-10-09T15:37:13.283202+0000","last_active":"2023-10-09T15:37:14.264214+0000","last_peered":"2023-10-09T15:37:14.264214+0000","last_clean":"2023-10-09T15:37:14.264214+0000","last_became_active":"2023-10-09T15:37:13.282829+0000","last_became_peered":"2023-10-09T15:37:13.282829+0000","last_unstale":"2023-10-09T15:37:14.264214+0000","last_undegraded":"2023-10-09T15:37:14.264214+0000","last_fullsized":"2023-10-09T15:37:14.264214+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:11.245573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283637+0000","last_change":"2023-10-09T15:37:14.278018+0000","last_active":"2023-10-09T15:37:14.283637+0000","last_peered":"2023-10-09T15:37:14.283637+0000","last_clean":"2023-10-09T15:37:14.283637+0000","last_became_active":"2023-10-09T15:37:14.277763+0000","last_became_peered":"2023-10-09T15:37:14.277763+0000","last_unstale":"2023-10-09T15:37:14.283637+0000","last_undegraded":"2023-10-09T15:37:14.283637+0000","last_fullsized":"2023-10-09T15:37:14.283637+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:38:42.318908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271669+0000","last_change":"2023-10-09T15:37:13.291282+0000","last_active":"2023-10-09T15:37:14.271669+0000","last_peered":"2023-10-09T15:37:14.271669+0000","last_clean":"2023-10-09T15:37:14.271669+0000","last_became_active":"2023-10-09T15:37:13.290934+0000","last_became_peered":"2023-10-09T15:37:13.290934+0000","last_unstale":"2023-10-09T15:37:14.271669+0000","last_undegraded":"2023-10-09T15:37:14.271669+0000","last_fullsized":"2023-10-09T15:37:14.271669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:29.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283235+0000","last_change":"2023-10-09T15:37:14.281494+0000","last_active":"2023-10-09T15:37:14.283235+0000","last_peered":"2023-10-09T15:37:14.283235+0000","last_clean":"2023-10-09T15:37:14.283235+0000","last_became_active":"2023-10-09T15:37:14.281215+0000","last_became_peered":"2023-10-09T15:37:14.281215+0000","last_unstale":"2023-10-09T15:37:14.283235+0000","last_undegraded":"2023-10-09T15:37:14.283235+0000","last_fullsized":"2023-10-09T15:37:14.283235+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271052+0000","last_change":"2023-10-09T15:37:13.288347+0000","last_active":"2023-10-09T15:37:14.271052+0000","last_peered":"2023-10-09T15:37:14.271052+0000","last_clean":"2023-10-09T15:37:14.271052+0000","last_became_active":"2023-10-09T15:37:13.288051+0000","last_became_peered":"2023-10-09T15:37:13.288051+0000","last_unstale":"2023-10-09T15:37:14.271052+0000","last_undegraded":"2023-10-09T15:37:14.271052+0000","last_fullsized":"2023-10-09T15:37:14.271052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.797526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.278041+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:14.278041+0000","last_peered":"2023-10-09T15:37:14.278041+0000","last_clean":"2023-10-09T15:37:14.278041+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:14.278041+0000","last_undegraded":"2023-10-09T15:37:14.278041+0000","last_fullsized":"2023-10-09T15:37:14.278041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1133918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.502}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":543032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":543086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.434},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":1133967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.505}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.255}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":544568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.26600000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.627},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59699999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":543538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.499}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:19.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T15:37:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.558+0000 7fe498ec9700 1 Processor -- start 2023-10-09T15:37:19.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.558+0000 7fe498ec9700 1 -- start start 2023-10-09T15:37:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe498ec9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 0x7fe4940cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe498ec9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49415ae40 con 0x7fe4940cde50 2023-10-09T15:37:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe498ec9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe49415ab60 con 0x7fe4940cd9e0 2023-10-09T15:37:19.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe498ec9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940d13f0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe492d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe4940cde50 0x7fe494156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45944/0 (socket says 172.21.15.33:45944) 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.559+0000 7fe492d9d700 1 -- 172.21.15.33:0/3524968775 learned_addr learned my addr 172.21.15.33:0/3524968775 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49259c700 1 --2- 172.21.15.33:0/3524968775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 0x7fe4940cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 562444196 0 0) 0x7fe49415ae40 con 0x7fe4940cde50 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe480003570 con 0x7fe4940cde50 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2415803028 0 0) 0x7fe49415ab60 con 0x7fe4940cd9e0 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe49415ae40 con 0x7fe4940cd9e0 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2472440266 0 0) 0x7fe480003570 con 0x7fe4940cde50 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49259c700 1 -- 172.21.15.33:0/3524968775 >> v1:172.21.15.59:6789/0 conn(0x7fe4940cd9e0 legacy=0x7fe494159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49259c700 1 -- 172.21.15.33:0/3524968775 >> v1:172.21.15.33:6789/0 conn(0x7fe4940cde50 legacy=0x7fe494156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49259c700 1 -- 172.21.15.33:0/3524968775 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4940ccf00 con 0x7fe4940cb5a0 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49259c700 1 --2- 172.21.15.33:0/3524968775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 0x7fe4940cb970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009910 tx=0x7fe48c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a681c22787df0de7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.560+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe484001770 con 0x7fe4940cb5a0 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c011420 con 0x7fe4940cb5a0 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe49159a700 1 -- 172.21.15.33:0/3524968775 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c0117c0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 -- 172.21.15.33:0/3524968775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 msgr2=0x7fe4940cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 --2- 172.21.15.33:0/3524968775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 0x7fe4940cb970 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe48c009910 tx=0x7fe48c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 -- 172.21.15.33:0/3524968775 shutdown_connections 2023-10-09T15:37:19.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 --2- 172.21.15.33:0/3524968775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940cb5a0 0x7fe4940cb970 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 -- 172.21.15.33:0/3524968775 >> 172.21.15.33:0/3524968775 conn(0x7fe494070e30 msgr2=0x7fe4940d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 -- 172.21.15.33:0/3524968775 shutdown_connections 2023-10-09T15:37:19.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.561+0000 7fe498ec9700 1 -- 172.21.15.33:0/3524968775 wait complete. 2023-10-09T15:37:19.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.562+0000 7fe498ec9700 1 Processor -- start 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.562+0000 7fe498ec9700 1 -- start start 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 0x7fe4940b0ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 0x7fe494169c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4940b18a0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415ba00 con 0x7fe4940cd9e0 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe498ec9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe49415b110 con 0x7fe4940b1400 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54562/0 (socket says 172.21.15.33:54562) 2023-10-09T15:37:19.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 -- 172.21.15.33:0/1777475349 learned_addr learned my addr 172.21.15.33:0/1777475349 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe491d9b700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 0x7fe4940b0ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe492d9d700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 0x7fe494169c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 -- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 msgr2=0x7fe494169c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 0x7fe494169c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 -- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 msgr2=0x7fe4940b0ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 0x7fe4940b0ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe49259c700 1 -- 172.21.15.33:0/1777475349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe48c009420 con 0x7fe4940cb5a0 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe491d9b700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 0x7fe4940b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.563+0000 7fe492d9d700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 0x7fe494169c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe49259c700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0091e0 tx=0x7fe48c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c01cc90 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe48c01cdf0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4941496e0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe48c01a6a0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.564+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe49415b3b0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.565+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe49404c3c0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.565+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fe48c01aa90 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.565+0000 7fe48a7fc700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 0x7fe474069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.566+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe48c086990 con 0x7fe4940cb5a0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.566+0000 7fe491d9b700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 0x7fe474069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.566+0000 7fe491d9b700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 0x7fe474069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007fd0 tx=0x7fe47c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.570+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe48c0537f0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.848+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fe4940cd1e0 con 0x7fe4940cb5a0 2023-10-09T15:37:19.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.848+0000 7fe48a7fc700 1 -- 172.21.15.33:0/1777475349 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1435 (secure 0 0 0) 0x7fe48c056e10 con 0x7fe4940cb5a0 2023-10-09T15:37:19.849 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:19.850 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":398,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1696865452,"num_in_osds":8,"osd_in_since":1696865443,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":23,"data_bytes":592674,"bytes_used":2476052480,"bytes_avail":770618060800,"bytes_total":773094113280,"write_bytes_sec":2199,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":67,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"a","status":"up:active","gid":6795}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":8,"modified":"2023-10-09T15:36:37.304959+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.850+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 msgr2=0x7fe474069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.850+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 0x7fe474069740 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe47c007fd0 tx=0x7fe47c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.850+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 msgr2=0x7fe4941491a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.850+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7fe48c0091e0 tx=0x7fe48c016000 comp rx=0 tx=0).stop 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 shutdown_connections 2023-10-09T15:37:19.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe474067290 0x7fe474069740 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe4940cb5a0 0x7fe4941491a0 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe4940b1400 0x7fe494169c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 --2- 172.21.15.33:0/1777475349 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe4940cd9e0 0x7fe4940b0ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 >> 172.21.15.33:0/1777475349 conn(0x7fe494070e30 msgr2=0x7fe4940af480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 shutdown_connections 2023-10-09T15:37:19.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.851+0000 7fe498ec9700 1 -- 172.21.15.33:0/1777475349 wait complete. 2023-10-09T15:37:19.864 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T15:37:19.864 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:19.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.981+0000 7fc1f4d66700 1 Processor -- start 2023-10-09T15:37:19.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.982+0000 7fc1f4d66700 1 -- start start 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1f4d66700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1f00cb5a0 0x7fc1f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1f4d66700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc1f00cd9e0 0x7fc1f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1f4d66700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f015ae40 con 0x7fc1f015a400 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1f4d66700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f00d13f0 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1f4d66700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f015ab60 con 0x7fc1f00cd9e0 2023-10-09T15:37:19.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1f00cb5a0 0x7fc1f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc1f00cb5a0 0x7fc1f00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54574/0 (socket says 172.21.15.33:54574) 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 -- 172.21.15.33:0/1524771314 learned_addr learned my addr 172.21.15.33:0/1524771314 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1eed9d700 1 --1- 172.21.15.33:0/1524771314 >> v1:172.21.15.33:6789/0 conn(0x7fc1f015a400 0x7fc1f0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:45946/0 (socket says 172.21.15.33:45946) 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1edd9b700 1 --2- 172.21.15.33:0/1524771314 >> v2:172.21.15.59:3300/0 conn(0x7fc1f00cd9e0 0x7fc1f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 -- 172.21.15.33:0/1524771314 >> v2:172.21.15.59:3300/0 conn(0x7fc1f00cd9e0 msgr2=0x7fc1f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 --2- 172.21.15.33:0/1524771314 >> v2:172.21.15.59:3300/0 conn(0x7fc1f00cd9e0 0x7fc1f0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 -- 172.21.15.33:0/1524771314 >> v1:172.21.15.33:6789/0 conn(0x7fc1f015a400 legacy=0x7fc1f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 -- 172.21.15.33:0/1524771314 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f00ccf00 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ee59c700 1 --2- 172.21.15.33:0/1524771314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f00cb5a0 0x7fc1f00cb970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80099b0 tx=0x7fc1e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8178ee4f4ee9a02f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ed59a700 1 -- 172.21.15.33:0/1524771314 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800b820 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ed59a700 1 -- 172.21.15.33:0/1524771314 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e800b980 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.983+0000 7fc1ed59a700 1 -- 172.21.15.33:0/1524771314 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e800bd20 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1524771314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f00cb5a0 msgr2=0x7fc1f00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1524771314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f00cb5a0 0x7fc1f00cb970 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80099b0 tx=0x7fc1e8009250 comp rx=0 tx=0).stop 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1524771314 shutdown_connections 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1524771314 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f00cb5a0 0x7fc1f00cb970 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1524771314 >> v2:172.21.15.59:3300/0 conn(0x7fc1f00cd9e0 0x7fc1f0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1524771314 >> 172.21.15.33:0/1524771314 conn(0x7fc1f0070e30 msgr2=0x7fc1f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1524771314 shutdown_connections 2023-10-09T15:37:19.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.984+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1524771314 wait complete. 2023-10-09T15:37:19.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.985+0000 7fc1f4d66700 1 Processor -- start 2023-10-09T15:37:19.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.985+0000 7fc1f4d66700 1 -- start start 2023-10-09T15:37:19.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1f00cb5a0 0x7fc1f014f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 0x7fc1f0153700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0150a40 con 0x7fc1f015a400 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0152450 con 0x7fc1f00cd9e0 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1f4d66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0153270 con 0x7fc1f00cb5a0 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:54584/0 (socket says 172.21.15.33:54584) 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 -- 172.21.15.33:0/1025431043 learned_addr learned my addr 172.21.15.33:0/1025431043 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1ee59c700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1f00cb5a0 0x7fc1f014f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1edd9b700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 0x7fc1f0153700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 -- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1f00cb5a0 msgr2=0x7fc1f014f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1f00cb5a0 0x7fc1f014f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 -- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 msgr2=0x7fc1f0153700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 0x7fc1f0153700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 -- 172.21.15.33:0/1025431043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1e80094f0 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1edd9b700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 0x7fc1f0153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.986+0000 7fc1eed9d700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000cc70 tx=0x7fc1e0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.987+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e0005df0 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.987+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e000a660 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.987+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0152660 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.987+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e000a9e0 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.987+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f0152c20 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.988+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f004c3c0 con 0x7fc1f015a400 2023-10-09T15:37:19.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.988+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc1e00070f0 con 0x7fc1f015a400 2023-10-09T15:37:19.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.988+0000 7fc1e67fc700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 0x7fc1d0069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:19.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.988+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc1e0084b90 con 0x7fc1f015a400 2023-10-09T15:37:19.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.989+0000 7fc1ee59c700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 0x7fc1d0069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:19.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.989+0000 7fc1ee59c700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 0x7fc1d0069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80099b0 tx=0x7fc1e8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:19.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:19.993+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc1e0051a20 con 0x7fc1f015a400 2023-10-09T15:37:20.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.181+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc1f00cd250 con 0x7fc1d0067290 2023-10-09T15:37:20.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.190+0000 7fc1e67fc700 1 -- 172.21.15.33:0/1025431043 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289723 (secure 0 0 0) 0x7fc1f00cd250 con 0x7fc1d0067290 2023-10-09T15:37:20.194 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 msgr2=0x7fc1d0069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 0x7fc1d0069740 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fc1e80099b0 tx=0x7fc1e8017000 comp rx=0 tx=0).stop 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 msgr2=0x7fc1f00b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7fc1e000cc70 tx=0x7fc1e0001a70 comp rx=0 tx=0).stop 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 shutdown_connections 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc1d0067290 0x7fc1d0069740 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc1f015a400 0x7fc1f00b34b0 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc1f00cb5a0 0x7fc1f014f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:20.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 --2- 172.21.15.33:0/1025431043 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc1f00cd9e0 0x7fc1f0153700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 >> 172.21.15.33:0/1025431043 conn(0x7fc1f0070e30 msgr2=0x7fc1f01553f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 shutdown_connections 2023-10-09T15:37:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:20.193+0000 7fc1f4d66700 1 -- 172.21.15.33:0/1025431043 wait complete. 2023-10-09T15:37:20.197 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:20.206 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":287,"stamp":"2023-10-09T15:37:19.312793+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418020,"kb_used_data":11044,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556700,"statfs":{"total":773094113280,"available":770618060800,"internally_reserved":0,"allocated":11309056,"data_stored":5528033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.051910"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285423+0000","last_change":"2023-10-09T15:37:14.283089+0000","last_active":"2023-10-09T15:37:14.285423+0000","last_peered":"2023-10-09T15:37:14.285423+0000","last_clean":"2023-10-09T15:37:14.285423+0000","last_became_active":"2023-10-09T15:37:14.282429+0000","last_became_peered":"2023-10-09T15:37:14.282429+0000","last_unstale":"2023-10-09T15:37:14.285423+0000","last_undegraded":"2023-10-09T15:37:14.285423+0000","last_fullsized":"2023-10-09T15:37:14.285423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:05.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.275646+0000","last_change":"2023-10-09T15:37:14.271244+0000","last_active":"2023-10-09T15:37:14.275646+0000","last_peered":"2023-10-09T15:37:14.275646+0000","last_clean":"2023-10-09T15:37:14.275646+0000","last_became_active":"2023-10-09T15:37:14.270928+0000","last_became_peered":"2023-10-09T15:37:14.270928+0000","last_unstale":"2023-10-09T15:37:14.275646+0000","last_undegraded":"2023-10-09T15:37:14.275646+0000","last_fullsized":"2023-10-09T15:37:14.275646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288402+0000","last_change":"2023-10-09T15:37:14.285401+0000","last_active":"2023-10-09T15:37:14.288402+0000","last_peered":"2023-10-09T15:37:14.288402+0000","last_clean":"2023-10-09T15:37:14.288402+0000","last_became_active":"2023-10-09T15:37:14.284760+0000","last_became_peered":"2023-10-09T15:37:14.284760+0000","last_unstale":"2023-10-09T15:37:14.288402+0000","last_undegraded":"2023-10-09T15:37:14.288402+0000","last_fullsized":"2023-10-09T15:37:14.288402+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284523+0000","last_change":"2023-10-09T15:37:14.279804+0000","last_active":"2023-10-09T15:37:14.284523+0000","last_peered":"2023-10-09T15:37:14.284523+0000","last_clean":"2023-10-09T15:37:14.284523+0000","last_became_active":"2023-10-09T15:37:14.279537+0000","last_became_peered":"2023-10-09T15:37:14.279537+0000","last_unstale":"2023-10-09T15:37:14.284523+0000","last_undegraded":"2023-10-09T15:37:14.284523+0000","last_fullsized":"2023-10-09T15:37:14.284523+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:35.277587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279288+0000","last_change":"2023-10-09T15:37:14.275930+0000","last_active":"2023-10-09T15:37:14.279288+0000","last_peered":"2023-10-09T15:37:14.279288+0000","last_clean":"2023-10-09T15:37:14.279288+0000","last_became_active":"2023-10-09T15:37:14.275654+0000","last_became_peered":"2023-10-09T15:37:14.275654+0000","last_unstale":"2023-10-09T15:37:14.279288+0000","last_undegraded":"2023-10-09T15:37:14.279288+0000","last_fullsized":"2023-10-09T15:37:14.279288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:09.527532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280826+0000","last_change":"2023-10-09T15:37:14.274461+0000","last_active":"2023-10-09T15:37:14.280826+0000","last_peered":"2023-10-09T15:37:14.280826+0000","last_clean":"2023-10-09T15:37:14.280826+0000","last_became_active":"2023-10-09T15:37:14.274171+0000","last_became_peered":"2023-10-09T15:37:14.274171+0000","last_unstale":"2023-10-09T15:37:14.280826+0000","last_undegraded":"2023-10-09T15:37:14.280826+0000","last_fullsized":"2023-10-09T15:37:14.280826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283290+0000","last_change":"2023-10-09T15:37:14.277236+0000","last_active":"2023-10-09T15:37:14.283290+0000","last_peered":"2023-10-09T15:37:14.283290+0000","last_clean":"2023-10-09T15:37:14.283290+0000","last_became_active":"2023-10-09T15:37:14.276969+0000","last_became_peered":"2023-10-09T15:37:14.276969+0000","last_unstale":"2023-10-09T15:37:14.283290+0000","last_undegraded":"2023-10-09T15:37:14.283290+0000","last_fullsized":"2023-10-09T15:37:14.283290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288169+0000","last_change":"2023-10-09T15:37:14.283309+0000","last_active":"2023-10-09T15:37:14.288169+0000","last_peered":"2023-10-09T15:37:14.288169+0000","last_clean":"2023-10-09T15:37:14.288169+0000","last_became_active":"2023-10-09T15:37:14.283065+0000","last_became_peered":"2023-10-09T15:37:14.283065+0000","last_unstale":"2023-10-09T15:37:14.288169+0000","last_undegraded":"2023-10-09T15:37:14.288169+0000","last_fullsized":"2023-10-09T15:37:14.288169+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284474+0000","last_change":"2023-10-09T15:37:14.278384+0000","last_active":"2023-10-09T15:37:14.284474+0000","last_peered":"2023-10-09T15:37:14.284474+0000","last_clean":"2023-10-09T15:37:14.284474+0000","last_became_active":"2023-10-09T15:37:14.277988+0000","last_became_peered":"2023-10-09T15:37:14.277988+0000","last_unstale":"2023-10-09T15:37:14.284474+0000","last_undegraded":"2023-10-09T15:37:14.284474+0000","last_fullsized":"2023-10-09T15:37:14.284474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:07.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284670+0000","last_change":"2023-10-09T15:37:14.280669+0000","last_active":"2023-10-09T15:37:14.284670+0000","last_peered":"2023-10-09T15:37:14.284670+0000","last_clean":"2023-10-09T15:37:14.284670+0000","last_became_active":"2023-10-09T15:37:14.280402+0000","last_became_peered":"2023-10-09T15:37:14.280402+0000","last_unstale":"2023-10-09T15:37:14.284670+0000","last_undegraded":"2023-10-09T15:37:14.284670+0000","last_fullsized":"2023-10-09T15:37:14.284670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:04.992720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277716+0000","last_change":"2023-10-09T15:37:14.272500+0000","last_active":"2023-10-09T15:37:14.277716+0000","last_peered":"2023-10-09T15:37:14.277716+0000","last_clean":"2023-10-09T15:37:14.277716+0000","last_became_active":"2023-10-09T15:37:14.272236+0000","last_became_peered":"2023-10-09T15:37:14.272236+0000","last_unstale":"2023-10-09T15:37:14.277716+0000","last_undegraded":"2023-10-09T15:37:14.277716+0000","last_fullsized":"2023-10-09T15:37:14.277716+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284540+0000","last_change":"2023-10-09T15:37:14.280205+0000","last_active":"2023-10-09T15:37:14.284540+0000","last_peered":"2023-10-09T15:37:14.284540+0000","last_clean":"2023-10-09T15:37:14.284540+0000","last_became_active":"2023-10-09T15:37:14.279692+0000","last_became_peered":"2023-10-09T15:37:14.279692+0000","last_unstale":"2023-10-09T15:37:14.284540+0000","last_undegraded":"2023-10-09T15:37:14.284540+0000","last_fullsized":"2023-10-09T15:37:14.284540+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:56.884832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288587+0000","last_change":"2023-10-09T15:37:14.286476+0000","last_active":"2023-10-09T15:37:14.288587+0000","last_peered":"2023-10-09T15:37:14.288587+0000","last_clean":"2023-10-09T15:37:14.288587+0000","last_became_active":"2023-10-09T15:37:14.286147+0000","last_became_peered":"2023-10-09T15:37:14.286147+0000","last_unstale":"2023-10-09T15:37:14.288587+0000","last_undegraded":"2023-10-09T15:37:14.288587+0000","last_fullsized":"2023-10-09T15:37:14.288587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288737+0000","last_change":"2023-10-09T15:37:14.287108+0000","last_active":"2023-10-09T15:37:14.288737+0000","last_peered":"2023-10-09T15:37:14.288737+0000","last_clean":"2023-10-09T15:37:14.288737+0000","last_became_active":"2023-10-09T15:37:14.286797+0000","last_became_peered":"2023-10-09T15:37:14.286797+0000","last_unstale":"2023-10-09T15:37:14.288737+0000","last_undegraded":"2023-10-09T15:37:14.288737+0000","last_fullsized":"2023-10-09T15:37:14.288737+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280566+0000","last_change":"2023-10-09T15:37:14.274476+0000","last_active":"2023-10-09T15:37:14.280566+0000","last_peered":"2023-10-09T15:37:14.280566+0000","last_clean":"2023-10-09T15:37:14.280566+0000","last_became_active":"2023-10-09T15:37:14.274181+0000","last_became_peered":"2023-10-09T15:37:14.274181+0000","last_unstale":"2023-10-09T15:37:14.280566+0000","last_undegraded":"2023-10-09T15:37:14.280566+0000","last_fullsized":"2023-10-09T15:37:14.280566+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285648+0000","last_change":"2023-10-09T15:37:14.284539+0000","last_active":"2023-10-09T15:37:14.285648+0000","last_peered":"2023-10-09T15:37:14.285648+0000","last_clean":"2023-10-09T15:37:14.285648+0000","last_became_active":"2023-10-09T15:37:14.284279+0000","last_became_peered":"2023-10-09T15:37:14.284279+0000","last_unstale":"2023-10-09T15:37:14.285648+0000","last_undegraded":"2023-10-09T15:37:14.285648+0000","last_fullsized":"2023-10-09T15:37:14.285648+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:23:52.965965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282828+0000","last_change":"2023-10-09T15:37:14.278706+0000","last_active":"2023-10-09T15:37:14.282828+0000","last_peered":"2023-10-09T15:37:14.282828+0000","last_clean":"2023-10-09T15:37:14.282828+0000","last_became_active":"2023-10-09T15:37:14.278455+0000","last_became_peered":"2023-10-09T15:37:14.278455+0000","last_unstale":"2023-10-09T15:37:14.282828+0000","last_undegraded":"2023-10-09T15:37:14.282828+0000","last_fullsized":"2023-10-09T15:37:14.282828+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.286725+0000","last_change":"2023-10-09T15:37:14.280712+0000","last_active":"2023-10-09T15:37:14.286725+0000","last_peered":"2023-10-09T15:37:14.286725+0000","last_clean":"2023-10-09T15:37:14.286725+0000","last_became_active":"2023-10-09T15:37:14.280422+0000","last_became_peered":"2023-10-09T15:37:14.280422+0000","last_unstale":"2023-10-09T15:37:14.286725+0000","last_undegraded":"2023-10-09T15:37:14.286725+0000","last_fullsized":"2023-10-09T15:37:14.286725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288789+0000","last_change":"2023-10-09T15:37:14.287406+0000","last_active":"2023-10-09T15:37:14.288789+0000","last_peered":"2023-10-09T15:37:14.288789+0000","last_clean":"2023-10-09T15:37:14.288789+0000","last_became_active":"2023-10-09T15:37:14.287052+0000","last_became_peered":"2023-10-09T15:37:14.287052+0000","last_unstale":"2023-10-09T15:37:14.288789+0000","last_undegraded":"2023-10-09T15:37:14.288789+0000","last_fullsized":"2023-10-09T15:37:14.288789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275157+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274882+0000","last_became_peered":"2023-10-09T15:37:14.274882+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282534+0000","last_change":"2023-10-09T15:37:14.276105+0000","last_active":"2023-10-09T15:37:14.282534+0000","last_peered":"2023-10-09T15:37:14.282534+0000","last_clean":"2023-10-09T15:37:14.282534+0000","last_became_active":"2023-10-09T15:37:14.275843+0000","last_became_peered":"2023-10-09T15:37:14.275843+0000","last_unstale":"2023-10-09T15:37:14.282534+0000","last_undegraded":"2023-10-09T15:37:14.282534+0000","last_fullsized":"2023-10-09T15:37:14.282534+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282391+0000","last_change":"2023-10-09T15:37:14.279166+0000","last_active":"2023-10-09T15:37:14.282391+0000","last_peered":"2023-10-09T15:37:14.282391+0000","last_clean":"2023-10-09T15:37:14.282391+0000","last_became_active":"2023-10-09T15:37:14.276319+0000","last_became_peered":"2023-10-09T15:37:14.276319+0000","last_unstale":"2023-10-09T15:37:14.282391+0000","last_undegraded":"2023-10-09T15:37:14.282391+0000","last_fullsized":"2023-10-09T15:37:14.282391+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275042+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274713+0000","last_became_peered":"2023-10-09T15:37:14.274713+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282403+0000","last_change":"2023-10-09T15:37:14.278971+0000","last_active":"2023-10-09T15:37:14.282403+0000","last_peered":"2023-10-09T15:37:14.282403+0000","last_clean":"2023-10-09T15:37:14.282403+0000","last_became_active":"2023-10-09T15:37:14.278693+0000","last_became_peered":"2023-10-09T15:37:14.278693+0000","last_unstale":"2023-10-09T15:37:14.282403+0000","last_undegraded":"2023-10-09T15:37:14.282403+0000","last_fullsized":"2023-10-09T15:37:14.282403+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282810+0000","last_change":"2023-10-09T15:37:14.278663+0000","last_active":"2023-10-09T15:37:14.282810+0000","last_peered":"2023-10-09T15:37:14.282810+0000","last_clean":"2023-10-09T15:37:14.282810+0000","last_became_active":"2023-10-09T15:37:14.278379+0000","last_became_peered":"2023-10-09T15:37:14.278379+0000","last_unstale":"2023-10-09T15:37:14.282810+0000","last_undegraded":"2023-10-09T15:37:14.282810+0000","last_fullsized":"2023-10-09T15:37:14.282810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285358+0000","last_change":"2023-10-09T15:37:14.281990+0000","last_active":"2023-10-09T15:37:14.285358+0000","last_peered":"2023-10-09T15:37:14.285358+0000","last_clean":"2023-10-09T15:37:14.285358+0000","last_became_active":"2023-10-09T15:37:14.281697+0000","last_became_peered":"2023-10-09T15:37:14.281697+0000","last_unstale":"2023-10-09T15:37:14.285358+0000","last_undegraded":"2023-10-09T15:37:14.285358+0000","last_fullsized":"2023-10-09T15:37:14.285358+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:54:57.392404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280851+0000","last_change":"2023-10-09T15:37:14.277837+0000","last_active":"2023-10-09T15:37:14.280851+0000","last_peered":"2023-10-09T15:37:14.280851+0000","last_clean":"2023-10-09T15:37:14.280851+0000","last_became_active":"2023-10-09T15:37:14.277093+0000","last_became_peered":"2023-10-09T15:37:14.277093+0000","last_unstale":"2023-10-09T15:37:14.280851+0000","last_undegraded":"2023-10-09T15:37:14.280851+0000","last_fullsized":"2023-10-09T15:37:14.280851+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:41.242740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282433+0000","last_change":"2023-10-09T15:37:14.278300+0000","last_active":"2023-10-09T15:37:14.282433+0000","last_peered":"2023-10-09T15:37:14.282433+0000","last_clean":"2023-10-09T15:37:14.282433+0000","last_became_active":"2023-10-09T15:37:14.278023+0000","last_became_peered":"2023-10-09T15:37:14.278023+0000","last_unstale":"2023-10-09T15:37:14.282433+0000","last_undegraded":"2023-10-09T15:37:14.282433+0000","last_fullsized":"2023-10-09T15:37:14.282433+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282777+0000","last_change":"2023-10-09T15:37:14.279955+0000","last_active":"2023-10-09T15:37:14.282777+0000","last_peered":"2023-10-09T15:37:14.282777+0000","last_clean":"2023-10-09T15:37:14.282777+0000","last_became_active":"2023-10-09T15:37:14.279648+0000","last_became_peered":"2023-10-09T15:37:14.279648+0000","last_unstale":"2023-10-09T15:37:14.282777+0000","last_undegraded":"2023-10-09T15:37:14.282777+0000","last_fullsized":"2023-10-09T15:37:14.282777+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288613+0000","last_change":"2023-10-09T15:37:14.280757+0000","last_active":"2023-10-09T15:37:14.288613+0000","last_peered":"2023-10-09T15:37:14.288613+0000","last_clean":"2023-10-09T15:37:14.288613+0000","last_became_active":"2023-10-09T15:37:14.280486+0000","last_became_peered":"2023-10-09T15:37:14.280486+0000","last_unstale":"2023-10-09T15:37:14.288613+0000","last_undegraded":"2023-10-09T15:37:14.288613+0000","last_fullsized":"2023-10-09T15:37:14.288613+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:20.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285665+0000","last_change":"2023-10-09T15:37:14.284845+0000","last_active":"2023-10-09T15:37:14.285665+0000","last_peered":"2023-10-09T15:37:14.285665+0000","last_clean":"2023-10-09T15:37:14.285665+0000","last_became_active":"2023-10-09T15:37:14.284582+0000","last_became_peered":"2023-10-09T15:37:14.284582+0000","last_unstale":"2023-10-09T15:37:14.285665+0000","last_undegraded":"2023-10-09T15:37:14.285665+0000","last_fullsized":"2023-10-09T15:37:14.285665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:33.335674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280808+0000","last_change":"2023-10-09T15:37:14.272511+0000","last_active":"2023-10-09T15:37:14.280808+0000","last_peered":"2023-10-09T15:37:14.280808+0000","last_clean":"2023-10-09T15:37:14.280808+0000","last_became_active":"2023-10-09T15:37:14.272246+0000","last_became_peered":"2023-10-09T15:37:14.272246+0000","last_unstale":"2023-10-09T15:37:14.280808+0000","last_undegraded":"2023-10-09T15:37:14.280808+0000","last_fullsized":"2023-10-09T15:37:14.280808+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280771+0000","last_change":"2023-10-09T15:37:14.272401+0000","last_active":"2023-10-09T15:37:14.280771+0000","last_peered":"2023-10-09T15:37:14.280771+0000","last_clean":"2023-10-09T15:37:14.280771+0000","last_became_active":"2023-10-09T15:37:14.272121+0000","last_became_peered":"2023-10-09T15:37:14.272121+0000","last_unstale":"2023-10-09T15:37:14.280771+0000","last_undegraded":"2023-10-09T15:37:14.280771+0000","last_fullsized":"2023-10-09T15:37:14.280771+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:20.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523950+0000","last_change":"2023-10-09T15:37:13.276939+0000","last_active":"2023-10-09T15:37:14.523950+0000","last_peered":"2023-10-09T15:37:14.523950+0000","last_clean":"2023-10-09T15:37:14.523950+0000","last_became_active":"2023-10-09T15:37:13.276618+0000","last_became_peered":"2023-10-09T15:37:13.276618+0000","last_unstale":"2023-10-09T15:37:14.523950+0000","last_undegraded":"2023-10-09T15:37:14.523950+0000","last_fullsized":"2023-10-09T15:37:14.523950+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280474+0000","last_change":"2023-10-09T15:37:14.276769+0000","last_active":"2023-10-09T15:37:14.280474+0000","last_peered":"2023-10-09T15:37:14.280474+0000","last_clean":"2023-10-09T15:37:14.280474+0000","last_became_active":"2023-10-09T15:37:14.276498+0000","last_became_peered":"2023-10-09T15:37:14.276498+0000","last_unstale":"2023-10-09T15:37:14.280474+0000","last_undegraded":"2023-10-09T15:37:14.280474+0000","last_fullsized":"2023-10-09T15:37:14.280474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521601+0000","last_change":"2023-10-09T15:37:13.277106+0000","last_active":"2023-10-09T15:37:14.521601+0000","last_peered":"2023-10-09T15:37:14.521601+0000","last_clean":"2023-10-09T15:37:14.521601+0000","last_became_active":"2023-10-09T15:37:13.276756+0000","last_became_peered":"2023-10-09T15:37:13.276756+0000","last_unstale":"2023-10-09T15:37:14.521601+0000","last_undegraded":"2023-10-09T15:37:14.521601+0000","last_fullsized":"2023-10-09T15:37:14.521601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:52.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280575+0000","last_change":"2023-10-09T15:37:14.274803+0000","last_active":"2023-10-09T15:37:14.280575+0000","last_peered":"2023-10-09T15:37:14.280575+0000","last_clean":"2023-10-09T15:37:14.280575+0000","last_became_active":"2023-10-09T15:37:14.274082+0000","last_became_peered":"2023-10-09T15:37:14.274082+0000","last_unstale":"2023-10-09T15:37:14.280575+0000","last_undegraded":"2023-10-09T15:37:14.280575+0000","last_fullsized":"2023-10-09T15:37:14.280575+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:14.824729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.529515+0000","last_change":"2023-10-09T15:37:13.283184+0000","last_active":"2023-10-09T15:37:14.529515+0000","last_peered":"2023-10-09T15:37:14.529515+0000","last_clean":"2023-10-09T15:37:14.529515+0000","last_became_active":"2023-10-09T15:37:13.282883+0000","last_became_peered":"2023-10-09T15:37:13.282883+0000","last_unstale":"2023-10-09T15:37:14.529515+0000","last_undegraded":"2023-10-09T15:37:14.529515+0000","last_fullsized":"2023-10-09T15:37:14.529515+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:58.065576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292432+0000","last_change":"2023-10-09T15:37:14.288289+0000","last_active":"2023-10-09T15:37:14.292432+0000","last_peered":"2023-10-09T15:37:14.292432+0000","last_clean":"2023-10-09T15:37:14.292432+0000","last_became_active":"2023-10-09T15:37:14.287837+0000","last_became_peered":"2023-10-09T15:37:14.287837+0000","last_unstale":"2023-10-09T15:37:14.292432+0000","last_undegraded":"2023-10-09T15:37:14.292432+0000","last_fullsized":"2023-10-09T15:37:14.292432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.525841+0000","last_change":"2023-10-09T15:37:13.283087+0000","last_active":"2023-10-09T15:37:14.525841+0000","last_peered":"2023-10-09T15:37:14.525841+0000","last_clean":"2023-10-09T15:37:14.525841+0000","last_became_active":"2023-10-09T15:37:13.282773+0000","last_became_peered":"2023-10-09T15:37:13.282773+0000","last_unstale":"2023-10-09T15:37:14.525841+0000","last_undegraded":"2023-10-09T15:37:14.525841+0000","last_fullsized":"2023-10-09T15:37:14.525841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:46.940465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283584+0000","last_change":"2023-10-09T15:37:14.277165+0000","last_active":"2023-10-09T15:37:14.283584+0000","last_peered":"2023-10-09T15:37:14.283584+0000","last_clean":"2023-10-09T15:37:14.283584+0000","last_became_active":"2023-10-09T15:37:14.276887+0000","last_became_peered":"2023-10-09T15:37:14.276887+0000","last_unstale":"2023-10-09T15:37:14.283584+0000","last_undegraded":"2023-10-09T15:37:14.283584+0000","last_fullsized":"2023-10-09T15:37:14.283584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:13.928326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.519739+0000","last_change":"2023-10-09T15:37:13.281132+0000","last_active":"2023-10-09T15:37:14.519739+0000","last_peered":"2023-10-09T15:37:14.519739+0000","last_clean":"2023-10-09T15:37:14.519739+0000","last_became_active":"2023-10-09T15:37:13.280901+0000","last_became_peered":"2023-10-09T15:37:13.280901+0000","last_unstale":"2023-10-09T15:37:14.519739+0000","last_undegraded":"2023-10-09T15:37:14.519739+0000","last_fullsized":"2023-10-09T15:37:14.519739+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277645+0000","last_change":"2023-10-09T15:37:14.273080+0000","last_active":"2023-10-09T15:37:14.277645+0000","last_peered":"2023-10-09T15:37:14.277645+0000","last_clean":"2023-10-09T15:37:14.277645+0000","last_became_active":"2023-10-09T15:37:14.272773+0000","last_became_peered":"2023-10-09T15:37:14.272773+0000","last_unstale":"2023-10-09T15:37:14.277645+0000","last_undegraded":"2023-10-09T15:37:14.277645+0000","last_fullsized":"2023-10-09T15:37:14.277645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.522997+0000","last_change":"2023-10-09T15:37:13.269828+0000","last_active":"2023-10-09T15:37:14.522997+0000","last_peered":"2023-10-09T15:37:14.522997+0000","last_clean":"2023-10-09T15:37:14.522997+0000","last_became_active":"2023-10-09T15:37:13.269489+0000","last_became_peered":"2023-10-09T15:37:13.269489+0000","last_unstale":"2023-10-09T15:37:14.522997+0000","last_undegraded":"2023-10-09T15:37:14.522997+0000","last_fullsized":"2023-10-09T15:37:14.522997+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:46.511413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285084+0000","last_change":"2023-10-09T15:37:14.281486+0000","last_active":"2023-10-09T15:37:14.285084+0000","last_peered":"2023-10-09T15:37:14.285084+0000","last_clean":"2023-10-09T15:37:14.285084+0000","last_became_active":"2023-10-09T15:37:14.281160+0000","last_became_peered":"2023-10-09T15:37:14.281160+0000","last_unstale":"2023-10-09T15:37:14.285084+0000","last_undegraded":"2023-10-09T15:37:14.285084+0000","last_fullsized":"2023-10-09T15:37:14.285084+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:09.832083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265903+0000","last_change":"2023-10-09T15:37:13.274950+0000","last_active":"2023-10-09T15:37:14.265903+0000","last_peered":"2023-10-09T15:37:14.265903+0000","last_clean":"2023-10-09T15:37:14.265903+0000","last_became_active":"2023-10-09T15:37:13.274547+0000","last_became_peered":"2023-10-09T15:37:13.274547+0000","last_unstale":"2023-10-09T15:37:14.265903+0000","last_undegraded":"2023-10-09T15:37:14.265903+0000","last_fullsized":"2023-10-09T15:37:14.265903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283270+0000","last_change":"2023-10-09T15:37:14.276677+0000","last_active":"2023-10-09T15:37:14.283270+0000","last_peered":"2023-10-09T15:37:14.283270+0000","last_clean":"2023-10-09T15:37:14.283270+0000","last_became_active":"2023-10-09T15:37:14.276326+0000","last_became_peered":"2023-10-09T15:37:14.276326+0000","last_unstale":"2023-10-09T15:37:14.283270+0000","last_undegraded":"2023-10-09T15:37:14.283270+0000","last_fullsized":"2023-10-09T15:37:14.283270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271548+0000","last_change":"2023-10-09T15:37:13.288878+0000","last_active":"2023-10-09T15:37:14.271548+0000","last_peered":"2023-10-09T15:37:14.271548+0000","last_clean":"2023-10-09T15:37:14.271548+0000","last_became_active":"2023-10-09T15:37:13.287910+0000","last_became_peered":"2023-10-09T15:37:13.287910+0000","last_unstale":"2023-10-09T15:37:14.271548+0000","last_undegraded":"2023-10-09T15:37:14.271548+0000","last_fullsized":"2023-10-09T15:37:14.271548+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:14.196333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288694+0000","last_change":"2023-10-09T15:37:14.282171+0000","last_active":"2023-10-09T15:37:14.288694+0000","last_peered":"2023-10-09T15:37:14.288694+0000","last_clean":"2023-10-09T15:37:14.288694+0000","last_became_active":"2023-10-09T15:37:14.281904+0000","last_became_peered":"2023-10-09T15:37:14.281904+0000","last_unstale":"2023-10-09T15:37:14.288694+0000","last_undegraded":"2023-10-09T15:37:14.288694+0000","last_fullsized":"2023-10-09T15:37:14.288694+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264415+0000","last_change":"2023-10-09T15:37:13.282437+0000","last_active":"2023-10-09T15:37:14.264415+0000","last_peered":"2023-10-09T15:37:14.264415+0000","last_clean":"2023-10-09T15:37:14.264415+0000","last_became_active":"2023-10-09T15:37:13.282148+0000","last_became_peered":"2023-10-09T15:37:13.282148+0000","last_unstale":"2023-10-09T15:37:14.264415+0000","last_undegraded":"2023-10-09T15:37:14.264415+0000","last_fullsized":"2023-10-09T15:37:14.264415+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:29.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.287675+0000","last_change":"2023-10-09T15:37:14.280613+0000","last_active":"2023-10-09T15:37:14.287675+0000","last_peered":"2023-10-09T15:37:14.287675+0000","last_clean":"2023-10-09T15:37:14.287675+0000","last_became_active":"2023-10-09T15:37:14.280267+0000","last_became_peered":"2023-10-09T15:37:14.280267+0000","last_unstale":"2023-10-09T15:37:14.287675+0000","last_undegraded":"2023-10-09T15:37:14.287675+0000","last_fullsized":"2023-10-09T15:37:14.287675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.268371+0000","last_change":"2023-10-09T15:37:13.274732+0000","last_active":"2023-10-09T15:37:14.268371+0000","last_peered":"2023-10-09T15:37:14.268371+0000","last_clean":"2023-10-09T15:37:14.268371+0000","last_became_active":"2023-10-09T15:37:13.274416+0000","last_became_peered":"2023-10-09T15:37:13.274416+0000","last_unstale":"2023-10-09T15:37:14.268371+0000","last_undegraded":"2023-10-09T15:37:14.268371+0000","last_fullsized":"2023-10-09T15:37:14.268371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:59.743080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282233+0000","last_change":"2023-10-09T15:37:14.276821+0000","last_active":"2023-10-09T15:37:14.282233+0000","last_peered":"2023-10-09T15:37:14.282233+0000","last_clean":"2023-10-09T15:37:14.282233+0000","last_became_active":"2023-10-09T15:37:14.276562+0000","last_became_peered":"2023-10-09T15:37:14.276562+0000","last_unstale":"2023-10-09T15:37:14.282233+0000","last_undegraded":"2023-10-09T15:37:14.282233+0000","last_fullsized":"2023-10-09T15:37:14.282233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528669+0000","last_change":"2023-10-09T15:37:13.288137+0000","last_active":"2023-10-09T15:37:14.528669+0000","last_peered":"2023-10-09T15:37:14.528669+0000","last_clean":"2023-10-09T15:37:14.528669+0000","last_became_active":"2023-10-09T15:37:13.287608+0000","last_became_peered":"2023-10-09T15:37:13.287608+0000","last_unstale":"2023-10-09T15:37:14.528669+0000","last_undegraded":"2023-10-09T15:37:14.528669+0000","last_fullsized":"2023-10-09T15:37:14.528669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:03.271206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292436+0000","last_change":"2023-10-09T15:37:14.285936+0000","last_active":"2023-10-09T15:37:14.292436+0000","last_peered":"2023-10-09T15:37:14.292436+0000","last_clean":"2023-10-09T15:37:14.292436+0000","last_became_active":"2023-10-09T15:37:14.285374+0000","last_became_peered":"2023-10-09T15:37:14.285374+0000","last_unstale":"2023-10-09T15:37:14.292436+0000","last_undegraded":"2023-10-09T15:37:14.292436+0000","last_fullsized":"2023-10-09T15:37:14.292436+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:56.188958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.531447+0000","last_change":"2023-10-09T15:37:13.286954+0000","last_active":"2023-10-09T15:37:14.531447+0000","last_peered":"2023-10-09T15:37:14.531447+0000","last_clean":"2023-10-09T15:37:14.531447+0000","last_became_active":"2023-10-09T15:37:13.286663+0000","last_became_peered":"2023-10-09T15:37:13.286663+0000","last_unstale":"2023-10-09T15:37:14.531447+0000","last_undegraded":"2023-10-09T15:37:14.531447+0000","last_fullsized":"2023-10-09T15:37:14.531447+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:29.120558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282356+0000","last_change":"2023-10-09T15:37:14.278482+0000","last_active":"2023-10-09T15:37:14.282356+0000","last_peered":"2023-10-09T15:37:14.282356+0000","last_clean":"2023-10-09T15:37:14.282356+0000","last_became_active":"2023-10-09T15:37:14.277837+0000","last_became_peered":"2023-10-09T15:37:14.277837+0000","last_unstale":"2023-10-09T15:37:14.282356+0000","last_undegraded":"2023-10-09T15:37:14.282356+0000","last_fullsized":"2023-10-09T15:37:14.282356+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521994+0000","last_change":"2023-10-09T15:37:13.281780+0000","last_active":"2023-10-09T15:37:14.521994+0000","last_peered":"2023-10-09T15:37:14.521994+0000","last_clean":"2023-10-09T15:37:14.521994+0000","last_became_active":"2023-10-09T15:37:13.281426+0000","last_became_peered":"2023-10-09T15:37:13.281426+0000","last_unstale":"2023-10-09T15:37:14.521994+0000","last_undegraded":"2023-10-09T15:37:14.521994+0000","last_fullsized":"2023-10-09T15:37:14.521994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283213+0000","last_change":"2023-10-09T15:37:14.281117+0000","last_active":"2023-10-09T15:37:14.283213+0000","last_peered":"2023-10-09T15:37:14.283213+0000","last_clean":"2023-10-09T15:37:14.283213+0000","last_became_active":"2023-10-09T15:37:14.280843+0000","last_became_peered":"2023-10-09T15:37:14.280843+0000","last_unstale":"2023-10-09T15:37:14.283213+0000","last_undegraded":"2023-10-09T15:37:14.283213+0000","last_fullsized":"2023-10-09T15:37:14.283213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270097+0000","last_change":"2023-10-09T15:37:13.289688+0000","last_active":"2023-10-09T15:37:14.270097+0000","last_peered":"2023-10-09T15:37:14.270097+0000","last_clean":"2023-10-09T15:37:14.270097+0000","last_became_active":"2023-10-09T15:37:13.289475+0000","last_became_peered":"2023-10-09T15:37:13.289475+0000","last_unstale":"2023-10-09T15:37:14.270097+0000","last_undegraded":"2023-10-09T15:37:14.270097+0000","last_fullsized":"2023-10-09T15:37:14.270097+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282486+0000","last_change":"2023-10-09T15:37:14.280668+0000","last_active":"2023-10-09T15:37:14.282486+0000","last_peered":"2023-10-09T15:37:14.282486+0000","last_clean":"2023-10-09T15:37:14.282486+0000","last_became_active":"2023-10-09T15:37:14.280404+0000","last_became_peered":"2023-10-09T15:37:14.280404+0000","last_unstale":"2023-10-09T15:37:14.282486+0000","last_undegraded":"2023-10-09T15:37:14.282486+0000","last_fullsized":"2023-10-09T15:37:14.282486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528883+0000","last_change":"2023-10-09T15:37:13.292286+0000","last_active":"2023-10-09T15:37:14.528883+0000","last_peered":"2023-10-09T15:37:14.528883+0000","last_clean":"2023-10-09T15:37:14.528883+0000","last_became_active":"2023-10-09T15:37:13.291981+0000","last_became_peered":"2023-10-09T15:37:13.291981+0000","last_unstale":"2023-10-09T15:37:14.528883+0000","last_undegraded":"2023-10-09T15:37:14.528883+0000","last_fullsized":"2023-10-09T15:37:14.528883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:59.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279576+0000","last_change":"2023-10-09T15:37:14.277490+0000","last_active":"2023-10-09T15:37:14.279576+0000","last_peered":"2023-10-09T15:37:14.279576+0000","last_clean":"2023-10-09T15:37:14.279576+0000","last_became_active":"2023-10-09T15:37:14.277198+0000","last_became_peered":"2023-10-09T15:37:14.277198+0000","last_unstale":"2023-10-09T15:37:14.279576+0000","last_undegraded":"2023-10-09T15:37:14.279576+0000","last_fullsized":"2023-10-09T15:37:14.279576+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:17.436456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.524200+0000","last_change":"2023-10-09T15:37:13.290785+0000","last_active":"2023-10-09T15:37:14.524200+0000","last_peered":"2023-10-09T15:37:14.524200+0000","last_clean":"2023-10-09T15:37:14.524200+0000","last_became_active":"2023-10-09T15:37:13.290382+0000","last_became_peered":"2023-10-09T15:37:13.290382+0000","last_unstale":"2023-10-09T15:37:14.524200+0000","last_undegraded":"2023-10-09T15:37:14.524200+0000","last_fullsized":"2023-10-09T15:37:14.524200+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:29.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283221+0000","last_change":"2023-10-09T15:37:14.280688+0000","last_active":"2023-10-09T15:37:14.283221+0000","last_peered":"2023-10-09T15:37:14.283221+0000","last_clean":"2023-10-09T15:37:14.283221+0000","last_became_active":"2023-10-09T15:37:14.280389+0000","last_became_peered":"2023-10-09T15:37:14.280389+0000","last_unstale":"2023-10-09T15:37:14.283221+0000","last_undegraded":"2023-10-09T15:37:14.283221+0000","last_fullsized":"2023-10-09T15:37:14.283221+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:31.576956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523931+0000","last_change":"2023-10-09T15:37:13.278333+0000","last_active":"2023-10-09T15:37:14.523931+0000","last_peered":"2023-10-09T15:37:14.523931+0000","last_clean":"2023-10-09T15:37:14.523931+0000","last_became_active":"2023-10-09T15:37:13.277794+0000","last_became_peered":"2023-10-09T15:37:13.277794+0000","last_unstale":"2023-10-09T15:37:14.523931+0000","last_undegraded":"2023-10-09T15:37:14.523931+0000","last_fullsized":"2023-10-09T15:37:14.523931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:05.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288180+0000","last_change":"2023-10-09T15:37:14.283052+0000","last_active":"2023-10-09T15:37:14.288180+0000","last_peered":"2023-10-09T15:37:14.288180+0000","last_clean":"2023-10-09T15:37:14.288180+0000","last_became_active":"2023-10-09T15:37:14.282729+0000","last_became_peered":"2023-10-09T15:37:14.282729+0000","last_unstale":"2023-10-09T15:37:14.288180+0000","last_undegraded":"2023-10-09T15:37:14.288180+0000","last_fullsized":"2023-10-09T15:37:14.288180+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523307+0000","last_change":"2023-10-09T15:37:13.274887+0000","last_active":"2023-10-09T15:37:14.523307+0000","last_peered":"2023-10-09T15:37:14.523307+0000","last_clean":"2023-10-09T15:37:14.523307+0000","last_became_active":"2023-10-09T15:37:13.274588+0000","last_became_peered":"2023-10-09T15:37:13.274588+0000","last_unstale":"2023-10-09T15:37:14.523307+0000","last_undegraded":"2023-10-09T15:37:14.523307+0000","last_fullsized":"2023-10-09T15:37:14.523307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288683+0000","last_change":"2023-10-09T15:37:14.286725+0000","last_active":"2023-10-09T15:37:14.288683+0000","last_peered":"2023-10-09T15:37:14.288683+0000","last_clean":"2023-10-09T15:37:14.288683+0000","last_became_active":"2023-10-09T15:37:14.285111+0000","last_became_peered":"2023-10-09T15:37:14.285111+0000","last_unstale":"2023-10-09T15:37:14.288683+0000","last_undegraded":"2023-10-09T15:37:14.288683+0000","last_fullsized":"2023-10-09T15:37:14.288683+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270270+0000","last_change":"2023-10-09T15:37:13.288752+0000","last_active":"2023-10-09T15:37:14.270270+0000","last_peered":"2023-10-09T15:37:14.270270+0000","last_clean":"2023-10-09T15:37:14.270270+0000","last_became_active":"2023-10-09T15:37:13.288137+0000","last_became_peered":"2023-10-09T15:37:13.288137+0000","last_unstale":"2023-10-09T15:37:14.270270+0000","last_undegraded":"2023-10-09T15:37:14.270270+0000","last_fullsized":"2023-10-09T15:37:14.270270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.123202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288118+0000","last_change":"2023-10-09T15:37:14.284986+0000","last_active":"2023-10-09T15:37:14.288118+0000","last_peered":"2023-10-09T15:37:14.288118+0000","last_clean":"2023-10-09T15:37:14.288118+0000","last_became_active":"2023-10-09T15:37:14.284646+0000","last_became_peered":"2023-10-09T15:37:14.284646+0000","last_unstale":"2023-10-09T15:37:14.288118+0000","last_undegraded":"2023-10-09T15:37:14.288118+0000","last_fullsized":"2023-10-09T15:37:14.288118+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526119+0000","last_change":"2023-10-09T15:37:13.283569+0000","last_active":"2023-10-09T15:37:14.526119+0000","last_peered":"2023-10-09T15:37:14.526119+0000","last_clean":"2023-10-09T15:37:14.526119+0000","last_became_active":"2023-10-09T15:37:13.283300+0000","last_became_peered":"2023-10-09T15:37:13.283300+0000","last_unstale":"2023-10-09T15:37:14.526119+0000","last_undegraded":"2023-10-09T15:37:14.526119+0000","last_fullsized":"2023-10-09T15:37:14.526119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285610+0000","last_change":"2023-10-09T15:37:14.284050+0000","last_active":"2023-10-09T15:37:14.285610+0000","last_peered":"2023-10-09T15:37:14.285610+0000","last_clean":"2023-10-09T15:37:14.285610+0000","last_became_active":"2023-10-09T15:37:14.283746+0000","last_became_peered":"2023-10-09T15:37:14.283746+0000","last_unstale":"2023-10-09T15:37:14.285610+0000","last_undegraded":"2023-10-09T15:37:14.285610+0000","last_fullsized":"2023-10-09T15:37:14.285610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:26.439686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264252+0000","last_change":"2023-10-09T15:37:13.282555+0000","last_active":"2023-10-09T15:37:14.264252+0000","last_peered":"2023-10-09T15:37:14.264252+0000","last_clean":"2023-10-09T15:37:14.264252+0000","last_became_active":"2023-10-09T15:37:13.282285+0000","last_became_peered":"2023-10-09T15:37:13.282285+0000","last_unstale":"2023-10-09T15:37:14.264252+0000","last_undegraded":"2023-10-09T15:37:14.264252+0000","last_fullsized":"2023-10-09T15:37:14.264252+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:57.308202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288595+0000","last_change":"2023-10-09T15:37:14.286551+0000","last_active":"2023-10-09T15:37:14.288595+0000","last_peered":"2023-10-09T15:37:14.288595+0000","last_clean":"2023-10-09T15:37:14.288595+0000","last_became_active":"2023-10-09T15:37:14.286174+0000","last_became_peered":"2023-10-09T15:37:14.286174+0000","last_unstale":"2023-10-09T15:37:14.288595+0000","last_undegraded":"2023-10-09T15:37:14.288595+0000","last_fullsized":"2023-10-09T15:37:14.288595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265707+0000","last_change":"2023-10-09T15:37:13.283869+0000","last_active":"2023-10-09T15:37:14.265707+0000","last_peered":"2023-10-09T15:37:14.265707+0000","last_clean":"2023-10-09T15:37:14.265707+0000","last_became_active":"2023-10-09T15:37:13.283553+0000","last_became_peered":"2023-10-09T15:37:13.283553+0000","last_unstale":"2023-10-09T15:37:14.265707+0000","last_undegraded":"2023-10-09T15:37:14.265707+0000","last_fullsized":"2023-10-09T15:37:14.265707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282469+0000","last_change":"2023-10-09T15:37:14.278717+0000","last_active":"2023-10-09T15:37:14.282469+0000","last_peered":"2023-10-09T15:37:14.282469+0000","last_clean":"2023-10-09T15:37:14.282469+0000","last_became_active":"2023-10-09T15:37:14.278462+0000","last_became_peered":"2023-10-09T15:37:14.278462+0000","last_unstale":"2023-10-09T15:37:14.282469+0000","last_undegraded":"2023-10-09T15:37:14.282469+0000","last_fullsized":"2023-10-09T15:37:14.282469+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:20.242868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271806+0000","last_change":"2023-10-09T15:37:13.290871+0000","last_active":"2023-10-09T15:37:14.271806+0000","last_peered":"2023-10-09T15:37:14.271806+0000","last_clean":"2023-10-09T15:37:14.271806+0000","last_became_active":"2023-10-09T15:37:13.290518+0000","last_became_peered":"2023-10-09T15:37:13.290518+0000","last_unstale":"2023-10-09T15:37:14.271806+0000","last_undegraded":"2023-10-09T15:37:14.271806+0000","last_fullsized":"2023-10-09T15:37:14.271806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:49.732124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280835+0000","last_change":"2023-10-09T15:37:14.277829+0000","last_active":"2023-10-09T15:37:14.280835+0000","last_peered":"2023-10-09T15:37:14.280835+0000","last_clean":"2023-10-09T15:37:14.280835+0000","last_became_active":"2023-10-09T15:37:14.277492+0000","last_became_peered":"2023-10-09T15:37:14.277492+0000","last_unstale":"2023-10-09T15:37:14.280835+0000","last_undegraded":"2023-10-09T15:37:14.280835+0000","last_fullsized":"2023-10-09T15:37:14.280835+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526239+0000","last_change":"2023-10-09T15:37:13.287838+0000","last_active":"2023-10-09T15:37:14.526239+0000","last_peered":"2023-10-09T15:37:14.526239+0000","last_clean":"2023-10-09T15:37:14.526239+0000","last_became_active":"2023-10-09T15:37:13.287540+0000","last_became_peered":"2023-10-09T15:37:13.287540+0000","last_unstale":"2023-10-09T15:37:14.526239+0000","last_undegraded":"2023-10-09T15:37:14.526239+0000","last_fullsized":"2023-10-09T15:37:14.526239+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:53.625320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285564+0000","last_change":"2023-10-09T15:37:14.283276+0000","last_active":"2023-10-09T15:37:14.285564+0000","last_peered":"2023-10-09T15:37:14.285564+0000","last_clean":"2023-10-09T15:37:14.285564+0000","last_became_active":"2023-10-09T15:37:14.282833+0000","last_became_peered":"2023-10-09T15:37:14.282833+0000","last_unstale":"2023-10-09T15:37:14.285564+0000","last_undegraded":"2023-10-09T15:37:14.285564+0000","last_fullsized":"2023-10-09T15:37:14.285564+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:39.258683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270676+0000","last_change":"2023-10-09T15:37:13.272306+0000","last_active":"2023-10-09T15:37:14.270676+0000","last_peered":"2023-10-09T15:37:14.270676+0000","last_clean":"2023-10-09T15:37:14.270676+0000","last_became_active":"2023-10-09T15:37:13.272027+0000","last_became_peered":"2023-10-09T15:37:13.272027+0000","last_unstale":"2023-10-09T15:37:14.270676+0000","last_undegraded":"2023-10-09T15:37:14.270676+0000","last_fullsized":"2023-10-09T15:37:14.270676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:40.238895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285567+0000","last_change":"2023-10-09T15:37:14.283291+0000","last_active":"2023-10-09T15:37:14.285567+0000","last_peered":"2023-10-09T15:37:14.285567+0000","last_clean":"2023-10-09T15:37:14.285567+0000","last_became_active":"2023-10-09T15:37:14.282969+0000","last_became_peered":"2023-10-09T15:37:14.282969+0000","last_unstale":"2023-10-09T15:37:14.285567+0000","last_undegraded":"2023-10-09T15:37:14.285567+0000","last_fullsized":"2023-10-09T15:37:14.285567+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.870108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270833+0000","last_change":"2023-10-09T15:37:13.290899+0000","last_active":"2023-10-09T15:37:14.270833+0000","last_peered":"2023-10-09T15:37:14.270833+0000","last_clean":"2023-10-09T15:37:14.270833+0000","last_became_active":"2023-10-09T15:37:13.290629+0000","last_became_peered":"2023-10-09T15:37:13.290629+0000","last_unstale":"2023-10-09T15:37:14.270833+0000","last_undegraded":"2023-10-09T15:37:14.270833+0000","last_fullsized":"2023-10-09T15:37:14.270833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280037+0000","last_change":"2023-10-09T15:37:14.277632+0000","last_active":"2023-10-09T15:37:14.280037+0000","last_peered":"2023-10-09T15:37:14.280037+0000","last_clean":"2023-10-09T15:37:14.280037+0000","last_became_active":"2023-10-09T15:37:14.277302+0000","last_became_peered":"2023-10-09T15:37:14.277302+0000","last_unstale":"2023-10-09T15:37:14.280037+0000","last_undegraded":"2023-10-09T15:37:14.280037+0000","last_fullsized":"2023-10-09T15:37:14.280037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270583+0000","last_change":"2023-10-09T15:37:13.282192+0000","last_active":"2023-10-09T15:37:14.270583+0000","last_peered":"2023-10-09T15:37:14.270583+0000","last_clean":"2023-10-09T15:37:14.270583+0000","last_became_active":"2023-10-09T15:37:13.281909+0000","last_became_peered":"2023-10-09T15:37:13.281909+0000","last_unstale":"2023-10-09T15:37:14.270583+0000","last_undegraded":"2023-10-09T15:37:14.270583+0000","last_fullsized":"2023-10-09T15:37:14.270583+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:03.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282741+0000","last_change":"2023-10-09T15:37:14.277241+0000","last_active":"2023-10-09T15:37:14.282741+0000","last_peered":"2023-10-09T15:37:14.282741+0000","last_clean":"2023-10-09T15:37:14.282741+0000","last_became_active":"2023-10-09T15:37:14.276934+0000","last_became_peered":"2023-10-09T15:37:14.276934+0000","last_unstale":"2023-10-09T15:37:14.282741+0000","last_undegraded":"2023-10-09T15:37:14.282741+0000","last_fullsized":"2023-10-09T15:37:14.282741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270280+0000","last_change":"2023-10-09T15:37:13.273755+0000","last_active":"2023-10-09T15:37:14.270280+0000","last_peered":"2023-10-09T15:37:14.270280+0000","last_clean":"2023-10-09T15:37:14.270280+0000","last_became_active":"2023-10-09T15:37:13.273413+0000","last_became_peered":"2023-10-09T15:37:13.273413+0000","last_unstale":"2023-10-09T15:37:14.270280+0000","last_undegraded":"2023-10-09T15:37:14.270280+0000","last_fullsized":"2023-10-09T15:37:14.270280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.276198+0000","last_change":"2023-10-09T15:37:14.268829+0000","last_active":"2023-10-09T15:37:14.276198+0000","last_peered":"2023-10-09T15:37:14.276198+0000","last_clean":"2023-10-09T15:37:14.276198+0000","last_became_active":"2023-10-09T15:37:14.268521+0000","last_became_peered":"2023-10-09T15:37:14.268521+0000","last_unstale":"2023-10-09T15:37:14.276198+0000","last_undegraded":"2023-10-09T15:37:14.276198+0000","last_fullsized":"2023-10-09T15:37:14.276198+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.266069+0000","last_change":"2023-10-09T15:37:13.282267+0000","last_active":"2023-10-09T15:37:14.266069+0000","last_peered":"2023-10-09T15:37:14.266069+0000","last_clean":"2023-10-09T15:37:14.266069+0000","last_became_active":"2023-10-09T15:37:13.281978+0000","last_became_peered":"2023-10-09T15:37:13.281978+0000","last_unstale":"2023-10-09T15:37:14.266069+0000","last_undegraded":"2023-10-09T15:37:14.266069+0000","last_fullsized":"2023-10-09T15:37:14.266069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288617+0000","last_change":"2023-10-09T15:37:14.286705+0000","last_active":"2023-10-09T15:37:14.288617+0000","last_peered":"2023-10-09T15:37:14.288617+0000","last_clean":"2023-10-09T15:37:14.288617+0000","last_became_active":"2023-10-09T15:37:14.285909+0000","last_became_peered":"2023-10-09T15:37:14.285909+0000","last_unstale":"2023-10-09T15:37:14.288617+0000","last_undegraded":"2023-10-09T15:37:14.288617+0000","last_fullsized":"2023-10-09T15:37:14.288617+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264214+0000","last_change":"2023-10-09T15:37:13.283202+0000","last_active":"2023-10-09T15:37:14.264214+0000","last_peered":"2023-10-09T15:37:14.264214+0000","last_clean":"2023-10-09T15:37:14.264214+0000","last_became_active":"2023-10-09T15:37:13.282829+0000","last_became_peered":"2023-10-09T15:37:13.282829+0000","last_unstale":"2023-10-09T15:37:14.264214+0000","last_undegraded":"2023-10-09T15:37:14.264214+0000","last_fullsized":"2023-10-09T15:37:14.264214+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:11.245573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283637+0000","last_change":"2023-10-09T15:37:14.278018+0000","last_active":"2023-10-09T15:37:14.283637+0000","last_peered":"2023-10-09T15:37:14.283637+0000","last_clean":"2023-10-09T15:37:14.283637+0000","last_became_active":"2023-10-09T15:37:14.277763+0000","last_became_peered":"2023-10-09T15:37:14.277763+0000","last_unstale":"2023-10-09T15:37:14.283637+0000","last_undegraded":"2023-10-09T15:37:14.283637+0000","last_fullsized":"2023-10-09T15:37:14.283637+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:38:42.318908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271669+0000","last_change":"2023-10-09T15:37:13.291282+0000","last_active":"2023-10-09T15:37:14.271669+0000","last_peered":"2023-10-09T15:37:14.271669+0000","last_clean":"2023-10-09T15:37:14.271669+0000","last_became_active":"2023-10-09T15:37:13.290934+0000","last_became_peered":"2023-10-09T15:37:13.290934+0000","last_unstale":"2023-10-09T15:37:14.271669+0000","last_undegraded":"2023-10-09T15:37:14.271669+0000","last_fullsized":"2023-10-09T15:37:14.271669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:29.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283235+0000","last_change":"2023-10-09T15:37:14.281494+0000","last_active":"2023-10-09T15:37:14.283235+0000","last_peered":"2023-10-09T15:37:14.283235+0000","last_clean":"2023-10-09T15:37:14.283235+0000","last_became_active":"2023-10-09T15:37:14.281215+0000","last_became_peered":"2023-10-09T15:37:14.281215+0000","last_unstale":"2023-10-09T15:37:14.283235+0000","last_undegraded":"2023-10-09T15:37:14.283235+0000","last_fullsized":"2023-10-09T15:37:14.283235+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271052+0000","last_change":"2023-10-09T15:37:13.288347+0000","last_active":"2023-10-09T15:37:14.271052+0000","last_peered":"2023-10-09T15:37:14.271052+0000","last_clean":"2023-10-09T15:37:14.271052+0000","last_became_active":"2023-10-09T15:37:13.288051+0000","last_became_peered":"2023-10-09T15:37:13.288051+0000","last_unstale":"2023-10-09T15:37:14.271052+0000","last_undegraded":"2023-10-09T15:37:14.271052+0000","last_fullsized":"2023-10-09T15:37:14.271052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.797526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.278041+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:14.278041+0000","last_peered":"2023-10-09T15:37:14.278041+0000","last_clean":"2023-10-09T15:37:14.278041+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:14.278041+0000","last_undegraded":"2023-10-09T15:37:14.278041+0000","last_fullsized":"2023-10-09T15:37:14.278041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1133918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.502}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":543032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":543086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.434},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":1133967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.505}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.255}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":544568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.26600000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.627},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59699999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":543538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.499}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:23.212 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:23.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.346+0000 7f827b150700 1 Processor -- start 2023-10-09T15:37:23.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.346+0000 7f827b150700 1 -- start start 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8274153c30 0x7f827415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 0x7f82740cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82740cef40 0x7f827406d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827415afd0 con 0x7f82740cef40 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f827415b2b0 con 0x7f827415de50 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827b150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f827415b590 con 0x7f8274153c30 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827a94f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82740cef40 0x7f827406d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827a94f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f82740cef40 0x7f827406d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39162/0 (socket says 172.21.15.33:39162) 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827a94f700 1 -- 172.21.15.33:0/4076606496 learned_addr learned my addr 172.21.15.33:0/4076606496 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827a14e700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8274153c30 0x7f827415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.347+0000 7f827994d700 1 --2- 172.21.15.33:0/4076606496 >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 0x7f82740cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 -- 172.21.15.33:0/4076606496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8274153c30 msgr2=0x7f827415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8274153c30 0x7f827415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 -- 172.21.15.33:0/4076606496 >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 msgr2=0x7f82740cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 --2- 172.21.15.33:0/4076606496 >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 0x7f82740cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 -- 172.21.15.33:0/4076606496 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f827415b870 con 0x7f82740cef40 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827994d700 1 --2- 172.21.15.33:0/4076606496 >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 0x7f82740cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827a94f700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82740cef40 0x7f827406d790 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f827406e800 tx=0x7f826c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd600979629fbfa8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827914c700 1 -- 172.21.15.33:0/4076606496 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00b860 con 0x7f82740cef40 2023-10-09T15:37:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827914c700 1 -- 172.21.15.33:0/4076606496 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c00b9c0 con 0x7f82740cef40 2023-10-09T15:37:23.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827914c700 1 -- 172.21.15.33:0/4076606496 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c00bd60 con 0x7f82740cef40 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 -- 172.21.15.33:0/4076606496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82740cef40 msgr2=0x7f827406d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82740cef40 0x7f827406d790 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f827406e800 tx=0x7f826c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 -- 172.21.15.33:0/4076606496 shutdown_connections 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f82740cef40 0x7f827406d790 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 --2- 172.21.15.33:0/4076606496 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8274153c30 0x7f827415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 --2- 172.21.15.33:0/4076606496 >> v2:172.21.15.59:3300/0 conn(0x7f827415de50 0x7f82740cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.348+0000 7f827b150700 1 -- 172.21.15.33:0/4076606496 >> 172.21.15.33:0/4076606496 conn(0x7f82740703a0 msgr2=0x7f82740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.349+0000 7f827b150700 1 -- 172.21.15.33:0/4076606496 shutdown_connections 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.349+0000 7f827b150700 1 -- 172.21.15.33:0/4076606496 wait complete. 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 Processor -- start 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 -- start start 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82740cef40 0x7f827414dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8274153c30 0x7f827414cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740b0fb0 con 0x7f827415de50 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82740b1290 con 0x7f8274153c30 2023-10-09T15:37:23.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827b150700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82740b1570 con 0x7f82740cef40 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.350+0000 7f827a94f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39168/0 (socket says 172.21.15.33:39168) 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 -- 172.21.15.33:0/3351764330 learned_addr learned my addr 172.21.15.33:0/3351764330 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a14e700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82740cef40 0x7f827414dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827994d700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8274153c30 0x7f827414cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 -- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82740cef40 msgr2=0x7f827414dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82740cef40 0x7f827414dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 -- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8274153c30 msgr2=0x7f827414cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8274153c30 0x7f827414cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 -- 172.21.15.33:0/3351764330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f826c0094f0 con 0x7f827415de50 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827a94f700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f826c0090b0 tx=0x7f826c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c011e60 con 0x7f827415de50 2023-10-09T15:37:23.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f826c01f070 con 0x7f827415de50 2023-10-09T15:37:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82740c7760 con 0x7f827415de50 2023-10-09T15:37:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f826c01a870 con 0x7f827415de50 2023-10-09T15:37:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.351+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f827414e370 con 0x7f827415de50 2023-10-09T15:37:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.352+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82740b1790 con 0x7f827415de50 2023-10-09T15:37:23.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.353+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f826c01ac20 con 0x7f827415de50 2023-10-09T15:37:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.353+0000 7f82727fc700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 0x7f8260069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.353+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f826c021070 con 0x7f827415de50 2023-10-09T15:37:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.353+0000 7f827a14e700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 0x7f8260069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.354+0000 7f827a14e700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 0x7f8260069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8264009fd0 tx=0x7f8264009880 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.358+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f826c053820 con 0x7f827415de50 2023-10-09T15:37:23.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.547+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f827404c3c0 con 0x7f8260067290 2023-10-09T15:37:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.555+0000 7f82727fc700 1 -- 172.21.15.33:0/3351764330 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289723 (secure 0 0 0) 0x7f827404c3c0 con 0x7f8260067290 2023-10-09T15:37:23.559 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 msgr2=0x7f8260069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 0x7f8260069740 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f8264009fd0 tx=0x7f8264009880 comp rx=0 tx=0).stop 2023-10-09T15:37:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 msgr2=0x7f827414d060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f826c0090b0 tx=0x7f826c017000 comp rx=0 tx=0).stop 2023-10-09T15:37:23.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 shutdown_connections 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8260067290 0x7f8260069740 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f827415de50 0x7f827414d060 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f82740cef40 0x7f827414dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 --2- 172.21.15.33:0/3351764330 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8274153c30 0x7f827414cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 >> 172.21.15.33:0/3351764330 conn(0x7f82740703a0 msgr2=0x7f82740d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 shutdown_connections 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.558+0000 7f827b150700 1 -- 172.21.15.33:0/3351764330 wait complete. 2023-10-09T15:37:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:23.571 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":289,"stamp":"2023-10-09T15:37:23.313828+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":166,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2418020,"kb_used_data":11044,"kb_used_omap":0,"kb_used_meta":2406912,"kb_avail":752556700,"statfs":{"total":773094113280,"available":770618060800,"internally_reserved":0,"allocated":11309056,"data_stored":5528033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2464677888},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.051034"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285423+0000","last_change":"2023-10-09T15:37:14.283089+0000","last_active":"2023-10-09T15:37:14.285423+0000","last_peered":"2023-10-09T15:37:14.285423+0000","last_clean":"2023-10-09T15:37:14.285423+0000","last_became_active":"2023-10-09T15:37:14.282429+0000","last_became_peered":"2023-10-09T15:37:14.282429+0000","last_unstale":"2023-10-09T15:37:14.285423+0000","last_undegraded":"2023-10-09T15:37:14.285423+0000","last_fullsized":"2023-10-09T15:37:14.285423+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:05.698194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.275646+0000","last_change":"2023-10-09T15:37:14.271244+0000","last_active":"2023-10-09T15:37:14.275646+0000","last_peered":"2023-10-09T15:37:14.275646+0000","last_clean":"2023-10-09T15:37:14.275646+0000","last_became_active":"2023-10-09T15:37:14.270928+0000","last_became_peered":"2023-10-09T15:37:14.270928+0000","last_unstale":"2023-10-09T15:37:14.275646+0000","last_undegraded":"2023-10-09T15:37:14.275646+0000","last_fullsized":"2023-10-09T15:37:14.275646+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288402+0000","last_change":"2023-10-09T15:37:14.285401+0000","last_active":"2023-10-09T15:37:14.288402+0000","last_peered":"2023-10-09T15:37:14.288402+0000","last_clean":"2023-10-09T15:37:14.288402+0000","last_became_active":"2023-10-09T15:37:14.284760+0000","last_became_peered":"2023-10-09T15:37:14.284760+0000","last_unstale":"2023-10-09T15:37:14.288402+0000","last_undegraded":"2023-10-09T15:37:14.288402+0000","last_fullsized":"2023-10-09T15:37:14.288402+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284523+0000","last_change":"2023-10-09T15:37:14.279804+0000","last_active":"2023-10-09T15:37:14.284523+0000","last_peered":"2023-10-09T15:37:14.284523+0000","last_clean":"2023-10-09T15:37:14.284523+0000","last_became_active":"2023-10-09T15:37:14.279537+0000","last_became_peered":"2023-10-09T15:37:14.279537+0000","last_unstale":"2023-10-09T15:37:14.284523+0000","last_undegraded":"2023-10-09T15:37:14.284523+0000","last_fullsized":"2023-10-09T15:37:14.284523+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:35.277587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279288+0000","last_change":"2023-10-09T15:37:14.275930+0000","last_active":"2023-10-09T15:37:14.279288+0000","last_peered":"2023-10-09T15:37:14.279288+0000","last_clean":"2023-10-09T15:37:14.279288+0000","last_became_active":"2023-10-09T15:37:14.275654+0000","last_became_peered":"2023-10-09T15:37:14.275654+0000","last_unstale":"2023-10-09T15:37:14.279288+0000","last_undegraded":"2023-10-09T15:37:14.279288+0000","last_fullsized":"2023-10-09T15:37:14.279288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:09.527532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280826+0000","last_change":"2023-10-09T15:37:14.274461+0000","last_active":"2023-10-09T15:37:14.280826+0000","last_peered":"2023-10-09T15:37:14.280826+0000","last_clean":"2023-10-09T15:37:14.280826+0000","last_became_active":"2023-10-09T15:37:14.274171+0000","last_became_peered":"2023-10-09T15:37:14.274171+0000","last_unstale":"2023-10-09T15:37:14.280826+0000","last_undegraded":"2023-10-09T15:37:14.280826+0000","last_fullsized":"2023-10-09T15:37:14.280826+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283290+0000","last_change":"2023-10-09T15:37:14.277236+0000","last_active":"2023-10-09T15:37:14.283290+0000","last_peered":"2023-10-09T15:37:14.283290+0000","last_clean":"2023-10-09T15:37:14.283290+0000","last_became_active":"2023-10-09T15:37:14.276969+0000","last_became_peered":"2023-10-09T15:37:14.276969+0000","last_unstale":"2023-10-09T15:37:14.283290+0000","last_undegraded":"2023-10-09T15:37:14.283290+0000","last_fullsized":"2023-10-09T15:37:14.283290+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288169+0000","last_change":"2023-10-09T15:37:14.283309+0000","last_active":"2023-10-09T15:37:14.288169+0000","last_peered":"2023-10-09T15:37:14.288169+0000","last_clean":"2023-10-09T15:37:14.288169+0000","last_became_active":"2023-10-09T15:37:14.283065+0000","last_became_peered":"2023-10-09T15:37:14.283065+0000","last_unstale":"2023-10-09T15:37:14.288169+0000","last_undegraded":"2023-10-09T15:37:14.288169+0000","last_fullsized":"2023-10-09T15:37:14.288169+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284474+0000","last_change":"2023-10-09T15:37:14.278384+0000","last_active":"2023-10-09T15:37:14.284474+0000","last_peered":"2023-10-09T15:37:14.284474+0000","last_clean":"2023-10-09T15:37:14.284474+0000","last_became_active":"2023-10-09T15:37:14.277988+0000","last_became_peered":"2023-10-09T15:37:14.277988+0000","last_unstale":"2023-10-09T15:37:14.284474+0000","last_undegraded":"2023-10-09T15:37:14.284474+0000","last_fullsized":"2023-10-09T15:37:14.284474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:07.385920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284670+0000","last_change":"2023-10-09T15:37:14.280669+0000","last_active":"2023-10-09T15:37:14.284670+0000","last_peered":"2023-10-09T15:37:14.284670+0000","last_clean":"2023-10-09T15:37:14.284670+0000","last_became_active":"2023-10-09T15:37:14.280402+0000","last_became_peered":"2023-10-09T15:37:14.280402+0000","last_unstale":"2023-10-09T15:37:14.284670+0000","last_undegraded":"2023-10-09T15:37:14.284670+0000","last_fullsized":"2023-10-09T15:37:14.284670+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:04.992720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277716+0000","last_change":"2023-10-09T15:37:14.272500+0000","last_active":"2023-10-09T15:37:14.277716+0000","last_peered":"2023-10-09T15:37:14.277716+0000","last_clean":"2023-10-09T15:37:14.277716+0000","last_became_active":"2023-10-09T15:37:14.272236+0000","last_became_peered":"2023-10-09T15:37:14.272236+0000","last_unstale":"2023-10-09T15:37:14.277716+0000","last_undegraded":"2023-10-09T15:37:14.277716+0000","last_fullsized":"2023-10-09T15:37:14.277716+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:30.124403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.284540+0000","last_change":"2023-10-09T15:37:14.280205+0000","last_active":"2023-10-09T15:37:14.284540+0000","last_peered":"2023-10-09T15:37:14.284540+0000","last_clean":"2023-10-09T15:37:14.284540+0000","last_became_active":"2023-10-09T15:37:14.279692+0000","last_became_peered":"2023-10-09T15:37:14.279692+0000","last_unstale":"2023-10-09T15:37:14.284540+0000","last_undegraded":"2023-10-09T15:37:14.284540+0000","last_fullsized":"2023-10-09T15:37:14.284540+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:32:56.884832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288587+0000","last_change":"2023-10-09T15:37:14.286476+0000","last_active":"2023-10-09T15:37:14.288587+0000","last_peered":"2023-10-09T15:37:14.288587+0000","last_clean":"2023-10-09T15:37:14.288587+0000","last_became_active":"2023-10-09T15:37:14.286147+0000","last_became_peered":"2023-10-09T15:37:14.286147+0000","last_unstale":"2023-10-09T15:37:14.288587+0000","last_undegraded":"2023-10-09T15:37:14.288587+0000","last_fullsized":"2023-10-09T15:37:14.288587+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288737+0000","last_change":"2023-10-09T15:37:14.287108+0000","last_active":"2023-10-09T15:37:14.288737+0000","last_peered":"2023-10-09T15:37:14.288737+0000","last_clean":"2023-10-09T15:37:14.288737+0000","last_became_active":"2023-10-09T15:37:14.286797+0000","last_became_peered":"2023-10-09T15:37:14.286797+0000","last_unstale":"2023-10-09T15:37:14.288737+0000","last_undegraded":"2023-10-09T15:37:14.288737+0000","last_fullsized":"2023-10-09T15:37:14.288737+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280566+0000","last_change":"2023-10-09T15:37:14.274476+0000","last_active":"2023-10-09T15:37:14.280566+0000","last_peered":"2023-10-09T15:37:14.280566+0000","last_clean":"2023-10-09T15:37:14.280566+0000","last_became_active":"2023-10-09T15:37:14.274181+0000","last_became_peered":"2023-10-09T15:37:14.274181+0000","last_unstale":"2023-10-09T15:37:14.280566+0000","last_undegraded":"2023-10-09T15:37:14.280566+0000","last_fullsized":"2023-10-09T15:37:14.280566+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285648+0000","last_change":"2023-10-09T15:37:14.284539+0000","last_active":"2023-10-09T15:37:14.285648+0000","last_peered":"2023-10-09T15:37:14.285648+0000","last_clean":"2023-10-09T15:37:14.285648+0000","last_became_active":"2023-10-09T15:37:14.284279+0000","last_became_peered":"2023-10-09T15:37:14.284279+0000","last_unstale":"2023-10-09T15:37:14.285648+0000","last_undegraded":"2023-10-09T15:37:14.285648+0000","last_fullsized":"2023-10-09T15:37:14.285648+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:23:52.965965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282828+0000","last_change":"2023-10-09T15:37:14.278706+0000","last_active":"2023-10-09T15:37:14.282828+0000","last_peered":"2023-10-09T15:37:14.282828+0000","last_clean":"2023-10-09T15:37:14.282828+0000","last_became_active":"2023-10-09T15:37:14.278455+0000","last_became_peered":"2023-10-09T15:37:14.278455+0000","last_unstale":"2023-10-09T15:37:14.282828+0000","last_undegraded":"2023-10-09T15:37:14.282828+0000","last_fullsized":"2023-10-09T15:37:14.282828+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:04.275051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.286725+0000","last_change":"2023-10-09T15:37:14.280712+0000","last_active":"2023-10-09T15:37:14.286725+0000","last_peered":"2023-10-09T15:37:14.286725+0000","last_clean":"2023-10-09T15:37:14.286725+0000","last_became_active":"2023-10-09T15:37:14.280422+0000","last_became_peered":"2023-10-09T15:37:14.280422+0000","last_unstale":"2023-10-09T15:37:14.286725+0000","last_undegraded":"2023-10-09T15:37:14.286725+0000","last_fullsized":"2023-10-09T15:37:14.286725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:20:00.746925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288789+0000","last_change":"2023-10-09T15:37:14.287406+0000","last_active":"2023-10-09T15:37:14.288789+0000","last_peered":"2023-10-09T15:37:14.288789+0000","last_clean":"2023-10-09T15:37:14.288789+0000","last_became_active":"2023-10-09T15:37:14.287052+0000","last_became_peered":"2023-10-09T15:37:14.287052+0000","last_unstale":"2023-10-09T15:37:14.288789+0000","last_undegraded":"2023-10-09T15:37:14.288789+0000","last_fullsized":"2023-10-09T15:37:14.288789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275157+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274882+0000","last_became_peered":"2023-10-09T15:37:14.274882+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:30.884414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282534+0000","last_change":"2023-10-09T15:37:14.276105+0000","last_active":"2023-10-09T15:37:14.282534+0000","last_peered":"2023-10-09T15:37:14.282534+0000","last_clean":"2023-10-09T15:37:14.282534+0000","last_became_active":"2023-10-09T15:37:14.275843+0000","last_became_peered":"2023-10-09T15:37:14.275843+0000","last_unstale":"2023-10-09T15:37:14.282534+0000","last_undegraded":"2023-10-09T15:37:14.282534+0000","last_fullsized":"2023-10-09T15:37:14.282534+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282391+0000","last_change":"2023-10-09T15:37:14.279166+0000","last_active":"2023-10-09T15:37:14.282391+0000","last_peered":"2023-10-09T15:37:14.282391+0000","last_clean":"2023-10-09T15:37:14.282391+0000","last_became_active":"2023-10-09T15:37:14.276319+0000","last_became_peered":"2023-10-09T15:37:14.276319+0000","last_unstale":"2023-10-09T15:37:14.282391+0000","last_undegraded":"2023-10-09T15:37:14.282391+0000","last_fullsized":"2023-10-09T15:37:14.282391+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:21:40.509183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.281776+0000","last_change":"2023-10-09T15:37:14.275042+0000","last_active":"2023-10-09T15:37:14.281776+0000","last_peered":"2023-10-09T15:37:14.281776+0000","last_clean":"2023-10-09T15:37:14.281776+0000","last_became_active":"2023-10-09T15:37:14.274713+0000","last_became_peered":"2023-10-09T15:37:14.274713+0000","last_unstale":"2023-10-09T15:37:14.281776+0000","last_undegraded":"2023-10-09T15:37:14.281776+0000","last_fullsized":"2023-10-09T15:37:14.281776+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282403+0000","last_change":"2023-10-09T15:37:14.278971+0000","last_active":"2023-10-09T15:37:14.282403+0000","last_peered":"2023-10-09T15:37:14.282403+0000","last_clean":"2023-10-09T15:37:14.282403+0000","last_became_active":"2023-10-09T15:37:14.278693+0000","last_became_peered":"2023-10-09T15:37:14.278693+0000","last_unstale":"2023-10-09T15:37:14.282403+0000","last_undegraded":"2023-10-09T15:37:14.282403+0000","last_fullsized":"2023-10-09T15:37:14.282403+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282810+0000","last_change":"2023-10-09T15:37:14.278663+0000","last_active":"2023-10-09T15:37:14.282810+0000","last_peered":"2023-10-09T15:37:14.282810+0000","last_clean":"2023-10-09T15:37:14.282810+0000","last_became_active":"2023-10-09T15:37:14.278379+0000","last_became_peered":"2023-10-09T15:37:14.278379+0000","last_unstale":"2023-10-09T15:37:14.282810+0000","last_undegraded":"2023-10-09T15:37:14.282810+0000","last_fullsized":"2023-10-09T15:37:14.282810+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285358+0000","last_change":"2023-10-09T15:37:14.281990+0000","last_active":"2023-10-09T15:37:14.285358+0000","last_peered":"2023-10-09T15:37:14.285358+0000","last_clean":"2023-10-09T15:37:14.285358+0000","last_became_active":"2023-10-09T15:37:14.281697+0000","last_became_peered":"2023-10-09T15:37:14.281697+0000","last_unstale":"2023-10-09T15:37:14.285358+0000","last_undegraded":"2023-10-09T15:37:14.285358+0000","last_fullsized":"2023-10-09T15:37:14.285358+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:54:57.392404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280851+0000","last_change":"2023-10-09T15:37:14.277837+0000","last_active":"2023-10-09T15:37:14.280851+0000","last_peered":"2023-10-09T15:37:14.280851+0000","last_clean":"2023-10-09T15:37:14.280851+0000","last_became_active":"2023-10-09T15:37:14.277093+0000","last_became_peered":"2023-10-09T15:37:14.277093+0000","last_unstale":"2023-10-09T15:37:14.280851+0000","last_undegraded":"2023-10-09T15:37:14.280851+0000","last_fullsized":"2023-10-09T15:37:14.280851+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:41.242740+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282433+0000","last_change":"2023-10-09T15:37:14.278300+0000","last_active":"2023-10-09T15:37:14.282433+0000","last_peered":"2023-10-09T15:37:14.282433+0000","last_clean":"2023-10-09T15:37:14.282433+0000","last_became_active":"2023-10-09T15:37:14.278023+0000","last_became_peered":"2023-10-09T15:37:14.278023+0000","last_unstale":"2023-10-09T15:37:14.282433+0000","last_undegraded":"2023-10-09T15:37:14.282433+0000","last_fullsized":"2023-10-09T15:37:14.282433+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:14:21.113494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282777+0000","last_change":"2023-10-09T15:37:14.279955+0000","last_active":"2023-10-09T15:37:14.282777+0000","last_peered":"2023-10-09T15:37:14.282777+0000","last_clean":"2023-10-09T15:37:14.282777+0000","last_became_active":"2023-10-09T15:37:14.279648+0000","last_became_peered":"2023-10-09T15:37:14.279648+0000","last_unstale":"2023-10-09T15:37:14.282777+0000","last_undegraded":"2023-10-09T15:37:14.282777+0000","last_fullsized":"2023-10-09T15:37:14.282777+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288613+0000","last_change":"2023-10-09T15:37:14.280757+0000","last_active":"2023-10-09T15:37:14.288613+0000","last_peered":"2023-10-09T15:37:14.288613+0000","last_clean":"2023-10-09T15:37:14.288613+0000","last_became_active":"2023-10-09T15:37:14.280486+0000","last_became_peered":"2023-10-09T15:37:14.280486+0000","last_unstale":"2023-10-09T15:37:14.288613+0000","last_undegraded":"2023-10-09T15:37:14.288613+0000","last_fullsized":"2023-10-09T15:37:14.288613+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:20.778603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285665+0000","last_change":"2023-10-09T15:37:14.284845+0000","last_active":"2023-10-09T15:37:14.285665+0000","last_peered":"2023-10-09T15:37:14.285665+0000","last_clean":"2023-10-09T15:37:14.285665+0000","last_became_active":"2023-10-09T15:37:14.284582+0000","last_became_peered":"2023-10-09T15:37:14.284582+0000","last_unstale":"2023-10-09T15:37:14.285665+0000","last_undegraded":"2023-10-09T15:37:14.285665+0000","last_fullsized":"2023-10-09T15:37:14.285665+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:33.335674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280808+0000","last_change":"2023-10-09T15:37:14.272511+0000","last_active":"2023-10-09T15:37:14.280808+0000","last_peered":"2023-10-09T15:37:14.280808+0000","last_clean":"2023-10-09T15:37:14.280808+0000","last_became_active":"2023-10-09T15:37:14.272246+0000","last_became_peered":"2023-10-09T15:37:14.272246+0000","last_unstale":"2023-10-09T15:37:14.280808+0000","last_undegraded":"2023-10-09T15:37:14.280808+0000","last_fullsized":"2023-10-09T15:37:14.280808+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:44:40.138684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280771+0000","last_change":"2023-10-09T15:37:14.272401+0000","last_active":"2023-10-09T15:37:14.280771+0000","last_peered":"2023-10-09T15:37:14.280771+0000","last_clean":"2023-10-09T15:37:14.280771+0000","last_became_active":"2023-10-09T15:37:14.272121+0000","last_became_peered":"2023-10-09T15:37:14.272121+0000","last_unstale":"2023-10-09T15:37:14.280771+0000","last_undegraded":"2023-10-09T15:37:14.280771+0000","last_fullsized":"2023-10-09T15:37:14.280771+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:20.816098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523950+0000","last_change":"2023-10-09T15:37:13.276939+0000","last_active":"2023-10-09T15:37:14.523950+0000","last_peered":"2023-10-09T15:37:14.523950+0000","last_clean":"2023-10-09T15:37:14.523950+0000","last_became_active":"2023-10-09T15:37:13.276618+0000","last_became_peered":"2023-10-09T15:37:13.276618+0000","last_unstale":"2023-10-09T15:37:14.523950+0000","last_undegraded":"2023-10-09T15:37:14.523950+0000","last_fullsized":"2023-10-09T15:37:14.523950+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280474+0000","last_change":"2023-10-09T15:37:14.276769+0000","last_active":"2023-10-09T15:37:14.280474+0000","last_peered":"2023-10-09T15:37:14.280474+0000","last_clean":"2023-10-09T15:37:14.280474+0000","last_became_active":"2023-10-09T15:37:14.276498+0000","last_became_peered":"2023-10-09T15:37:14.276498+0000","last_unstale":"2023-10-09T15:37:14.280474+0000","last_undegraded":"2023-10-09T15:37:14.280474+0000","last_fullsized":"2023-10-09T15:37:14.280474+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:16:58.807357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521601+0000","last_change":"2023-10-09T15:37:13.277106+0000","last_active":"2023-10-09T15:37:14.521601+0000","last_peered":"2023-10-09T15:37:14.521601+0000","last_clean":"2023-10-09T15:37:14.521601+0000","last_became_active":"2023-10-09T15:37:13.276756+0000","last_became_peered":"2023-10-09T15:37:13.276756+0000","last_unstale":"2023-10-09T15:37:14.521601+0000","last_undegraded":"2023-10-09T15:37:14.521601+0000","last_fullsized":"2023-10-09T15:37:14.521601+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:13:52.365603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280575+0000","last_change":"2023-10-09T15:37:14.274803+0000","last_active":"2023-10-09T15:37:14.280575+0000","last_peered":"2023-10-09T15:37:14.280575+0000","last_clean":"2023-10-09T15:37:14.280575+0000","last_became_active":"2023-10-09T15:37:14.274082+0000","last_became_peered":"2023-10-09T15:37:14.274082+0000","last_unstale":"2023-10-09T15:37:14.280575+0000","last_undegraded":"2023-10-09T15:37:14.280575+0000","last_fullsized":"2023-10-09T15:37:14.280575+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:14.824729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.529515+0000","last_change":"2023-10-09T15:37:13.283184+0000","last_active":"2023-10-09T15:37:14.529515+0000","last_peered":"2023-10-09T15:37:14.529515+0000","last_clean":"2023-10-09T15:37:14.529515+0000","last_became_active":"2023-10-09T15:37:13.282883+0000","last_became_peered":"2023-10-09T15:37:13.282883+0000","last_unstale":"2023-10-09T15:37:14.529515+0000","last_undegraded":"2023-10-09T15:37:14.529515+0000","last_fullsized":"2023-10-09T15:37:14.529515+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:58.065576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292432+0000","last_change":"2023-10-09T15:37:14.288289+0000","last_active":"2023-10-09T15:37:14.292432+0000","last_peered":"2023-10-09T15:37:14.292432+0000","last_clean":"2023-10-09T15:37:14.292432+0000","last_became_active":"2023-10-09T15:37:14.287837+0000","last_became_peered":"2023-10-09T15:37:14.287837+0000","last_unstale":"2023-10-09T15:37:14.292432+0000","last_undegraded":"2023-10-09T15:37:14.292432+0000","last_fullsized":"2023-10-09T15:37:14.292432+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.525841+0000","last_change":"2023-10-09T15:37:13.283087+0000","last_active":"2023-10-09T15:37:14.525841+0000","last_peered":"2023-10-09T15:37:14.525841+0000","last_clean":"2023-10-09T15:37:14.525841+0000","last_became_active":"2023-10-09T15:37:13.282773+0000","last_became_peered":"2023-10-09T15:37:13.282773+0000","last_unstale":"2023-10-09T15:37:14.525841+0000","last_undegraded":"2023-10-09T15:37:14.525841+0000","last_fullsized":"2023-10-09T15:37:14.525841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:12:46.940465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283584+0000","last_change":"2023-10-09T15:37:14.277165+0000","last_active":"2023-10-09T15:37:14.283584+0000","last_peered":"2023-10-09T15:37:14.283584+0000","last_clean":"2023-10-09T15:37:14.283584+0000","last_became_active":"2023-10-09T15:37:14.276887+0000","last_became_peered":"2023-10-09T15:37:14.276887+0000","last_unstale":"2023-10-09T15:37:14.283584+0000","last_undegraded":"2023-10-09T15:37:14.283584+0000","last_fullsized":"2023-10-09T15:37:14.283584+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:13.928326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.519739+0000","last_change":"2023-10-09T15:37:13.281132+0000","last_active":"2023-10-09T15:37:14.519739+0000","last_peered":"2023-10-09T15:37:14.519739+0000","last_clean":"2023-10-09T15:37:14.519739+0000","last_became_active":"2023-10-09T15:37:13.280901+0000","last_became_peered":"2023-10-09T15:37:13.280901+0000","last_unstale":"2023-10-09T15:37:14.519739+0000","last_undegraded":"2023-10-09T15:37:14.519739+0000","last_fullsized":"2023-10-09T15:37:14.519739+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.277645+0000","last_change":"2023-10-09T15:37:14.273080+0000","last_active":"2023-10-09T15:37:14.277645+0000","last_peered":"2023-10-09T15:37:14.277645+0000","last_clean":"2023-10-09T15:37:14.277645+0000","last_became_active":"2023-10-09T15:37:14.272773+0000","last_became_peered":"2023-10-09T15:37:14.272773+0000","last_unstale":"2023-10-09T15:37:14.277645+0000","last_undegraded":"2023-10-09T15:37:14.277645+0000","last_fullsized":"2023-10-09T15:37:14.277645+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.522997+0000","last_change":"2023-10-09T15:37:13.269828+0000","last_active":"2023-10-09T15:37:14.522997+0000","last_peered":"2023-10-09T15:37:14.522997+0000","last_clean":"2023-10-09T15:37:14.522997+0000","last_became_active":"2023-10-09T15:37:13.269489+0000","last_became_peered":"2023-10-09T15:37:13.269489+0000","last_unstale":"2023-10-09T15:37:14.522997+0000","last_undegraded":"2023-10-09T15:37:14.522997+0000","last_fullsized":"2023-10-09T15:37:14.522997+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:54:46.511413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285084+0000","last_change":"2023-10-09T15:37:14.281486+0000","last_active":"2023-10-09T15:37:14.285084+0000","last_peered":"2023-10-09T15:37:14.285084+0000","last_clean":"2023-10-09T15:37:14.285084+0000","last_became_active":"2023-10-09T15:37:14.281160+0000","last_became_peered":"2023-10-09T15:37:14.281160+0000","last_unstale":"2023-10-09T15:37:14.285084+0000","last_undegraded":"2023-10-09T15:37:14.285084+0000","last_fullsized":"2023-10-09T15:37:14.285084+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:09.832083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265903+0000","last_change":"2023-10-09T15:37:13.274950+0000","last_active":"2023-10-09T15:37:14.265903+0000","last_peered":"2023-10-09T15:37:14.265903+0000","last_clean":"2023-10-09T15:37:14.265903+0000","last_became_active":"2023-10-09T15:37:13.274547+0000","last_became_peered":"2023-10-09T15:37:13.274547+0000","last_unstale":"2023-10-09T15:37:14.265903+0000","last_undegraded":"2023-10-09T15:37:14.265903+0000","last_fullsized":"2023-10-09T15:37:14.265903+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283270+0000","last_change":"2023-10-09T15:37:14.276677+0000","last_active":"2023-10-09T15:37:14.283270+0000","last_peered":"2023-10-09T15:37:14.283270+0000","last_clean":"2023-10-09T15:37:14.283270+0000","last_became_active":"2023-10-09T15:37:14.276326+0000","last_became_peered":"2023-10-09T15:37:14.276326+0000","last_unstale":"2023-10-09T15:37:14.283270+0000","last_undegraded":"2023-10-09T15:37:14.283270+0000","last_fullsized":"2023-10-09T15:37:14.283270+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:12.165689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271548+0000","last_change":"2023-10-09T15:37:13.288878+0000","last_active":"2023-10-09T15:37:14.271548+0000","last_peered":"2023-10-09T15:37:14.271548+0000","last_clean":"2023-10-09T15:37:14.271548+0000","last_became_active":"2023-10-09T15:37:13.287910+0000","last_became_peered":"2023-10-09T15:37:13.287910+0000","last_unstale":"2023-10-09T15:37:14.271548+0000","last_undegraded":"2023-10-09T15:37:14.271548+0000","last_fullsized":"2023-10-09T15:37:14.271548+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:14.196333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288694+0000","last_change":"2023-10-09T15:37:14.282171+0000","last_active":"2023-10-09T15:37:14.288694+0000","last_peered":"2023-10-09T15:37:14.288694+0000","last_clean":"2023-10-09T15:37:14.288694+0000","last_became_active":"2023-10-09T15:37:14.281904+0000","last_became_peered":"2023-10-09T15:37:14.281904+0000","last_unstale":"2023-10-09T15:37:14.288694+0000","last_undegraded":"2023-10-09T15:37:14.288694+0000","last_fullsized":"2023-10-09T15:37:14.288694+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:35.004962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264415+0000","last_change":"2023-10-09T15:37:13.282437+0000","last_active":"2023-10-09T15:37:14.264415+0000","last_peered":"2023-10-09T15:37:14.264415+0000","last_clean":"2023-10-09T15:37:14.264415+0000","last_became_active":"2023-10-09T15:37:13.282148+0000","last_became_peered":"2023-10-09T15:37:13.282148+0000","last_unstale":"2023-10-09T15:37:14.264415+0000","last_undegraded":"2023-10-09T15:37:14.264415+0000","last_fullsized":"2023-10-09T15:37:14.264415+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:29.006668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.287675+0000","last_change":"2023-10-09T15:37:14.280613+0000","last_active":"2023-10-09T15:37:14.287675+0000","last_peered":"2023-10-09T15:37:14.287675+0000","last_clean":"2023-10-09T15:37:14.287675+0000","last_became_active":"2023-10-09T15:37:14.280267+0000","last_became_peered":"2023-10-09T15:37:14.280267+0000","last_unstale":"2023-10-09T15:37:14.287675+0000","last_undegraded":"2023-10-09T15:37:14.287675+0000","last_fullsized":"2023-10-09T15:37:14.287675+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:26:25.676139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.268371+0000","last_change":"2023-10-09T15:37:13.274732+0000","last_active":"2023-10-09T15:37:14.268371+0000","last_peered":"2023-10-09T15:37:14.268371+0000","last_clean":"2023-10-09T15:37:14.268371+0000","last_became_active":"2023-10-09T15:37:13.274416+0000","last_became_peered":"2023-10-09T15:37:13.274416+0000","last_unstale":"2023-10-09T15:37:14.268371+0000","last_undegraded":"2023-10-09T15:37:14.268371+0000","last_fullsized":"2023-10-09T15:37:14.268371+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:19:59.743080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282233+0000","last_change":"2023-10-09T15:37:14.276821+0000","last_active":"2023-10-09T15:37:14.282233+0000","last_peered":"2023-10-09T15:37:14.282233+0000","last_clean":"2023-10-09T15:37:14.282233+0000","last_became_active":"2023-10-09T15:37:14.276562+0000","last_became_peered":"2023-10-09T15:37:14.276562+0000","last_unstale":"2023-10-09T15:37:14.282233+0000","last_undegraded":"2023-10-09T15:37:14.282233+0000","last_fullsized":"2023-10-09T15:37:14.282233+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528669+0000","last_change":"2023-10-09T15:37:13.288137+0000","last_active":"2023-10-09T15:37:14.528669+0000","last_peered":"2023-10-09T15:37:14.528669+0000","last_clean":"2023-10-09T15:37:14.528669+0000","last_became_active":"2023-10-09T15:37:13.287608+0000","last_became_peered":"2023-10-09T15:37:13.287608+0000","last_unstale":"2023-10-09T15:37:14.528669+0000","last_undegraded":"2023-10-09T15:37:14.528669+0000","last_fullsized":"2023-10-09T15:37:14.528669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:09:03.271206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.292436+0000","last_change":"2023-10-09T15:37:14.285936+0000","last_active":"2023-10-09T15:37:14.292436+0000","last_peered":"2023-10-09T15:37:14.292436+0000","last_clean":"2023-10-09T15:37:14.292436+0000","last_became_active":"2023-10-09T15:37:14.285374+0000","last_became_peered":"2023-10-09T15:37:14.285374+0000","last_unstale":"2023-10-09T15:37:14.292436+0000","last_undegraded":"2023-10-09T15:37:14.292436+0000","last_fullsized":"2023-10-09T15:37:14.292436+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:32:56.188958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":16,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.531447+0000","last_change":"2023-10-09T15:37:13.286954+0000","last_active":"2023-10-09T15:37:14.531447+0000","last_peered":"2023-10-09T15:37:14.531447+0000","last_clean":"2023-10-09T15:37:14.531447+0000","last_became_active":"2023-10-09T15:37:13.286663+0000","last_became_peered":"2023-10-09T15:37:13.286663+0000","last_unstale":"2023-10-09T15:37:14.531447+0000","last_undegraded":"2023-10-09T15:37:14.531447+0000","last_fullsized":"2023-10-09T15:37:14.531447+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:29.120558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282356+0000","last_change":"2023-10-09T15:37:14.278482+0000","last_active":"2023-10-09T15:37:14.282356+0000","last_peered":"2023-10-09T15:37:14.282356+0000","last_clean":"2023-10-09T15:37:14.282356+0000","last_became_active":"2023-10-09T15:37:14.277837+0000","last_became_peered":"2023-10-09T15:37:14.277837+0000","last_unstale":"2023-10-09T15:37:14.282356+0000","last_undegraded":"2023-10-09T15:37:14.282356+0000","last_fullsized":"2023-10-09T15:37:14.282356+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:25:38.404772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.521994+0000","last_change":"2023-10-09T15:37:13.281780+0000","last_active":"2023-10-09T15:37:14.521994+0000","last_peered":"2023-10-09T15:37:14.521994+0000","last_clean":"2023-10-09T15:37:14.521994+0000","last_became_active":"2023-10-09T15:37:13.281426+0000","last_became_peered":"2023-10-09T15:37:13.281426+0000","last_unstale":"2023-10-09T15:37:14.521994+0000","last_undegraded":"2023-10-09T15:37:14.521994+0000","last_fullsized":"2023-10-09T15:37:14.521994+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:48:13.589689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283213+0000","last_change":"2023-10-09T15:37:14.281117+0000","last_active":"2023-10-09T15:37:14.283213+0000","last_peered":"2023-10-09T15:37:14.283213+0000","last_clean":"2023-10-09T15:37:14.283213+0000","last_became_active":"2023-10-09T15:37:14.280843+0000","last_became_peered":"2023-10-09T15:37:14.280843+0000","last_unstale":"2023-10-09T15:37:14.283213+0000","last_undegraded":"2023-10-09T15:37:14.283213+0000","last_fullsized":"2023-10-09T15:37:14.283213+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270097+0000","last_change":"2023-10-09T15:37:13.289688+0000","last_active":"2023-10-09T15:37:14.270097+0000","last_peered":"2023-10-09T15:37:14.270097+0000","last_clean":"2023-10-09T15:37:14.270097+0000","last_became_active":"2023-10-09T15:37:13.289475+0000","last_became_peered":"2023-10-09T15:37:13.289475+0000","last_unstale":"2023-10-09T15:37:14.270097+0000","last_undegraded":"2023-10-09T15:37:14.270097+0000","last_fullsized":"2023-10-09T15:37:14.270097+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282486+0000","last_change":"2023-10-09T15:37:14.280668+0000","last_active":"2023-10-09T15:37:14.282486+0000","last_peered":"2023-10-09T15:37:14.282486+0000","last_clean":"2023-10-09T15:37:14.282486+0000","last_became_active":"2023-10-09T15:37:14.280404+0000","last_became_peered":"2023-10-09T15:37:14.280404+0000","last_unstale":"2023-10-09T15:37:14.282486+0000","last_undegraded":"2023-10-09T15:37:14.282486+0000","last_fullsized":"2023-10-09T15:37:14.282486+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:30.543815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":18,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.528883+0000","last_change":"2023-10-09T15:37:13.292286+0000","last_active":"2023-10-09T15:37:14.528883+0000","last_peered":"2023-10-09T15:37:14.528883+0000","last_clean":"2023-10-09T15:37:14.528883+0000","last_became_active":"2023-10-09T15:37:13.291981+0000","last_became_peered":"2023-10-09T15:37:13.291981+0000","last_unstale":"2023-10-09T15:37:14.528883+0000","last_undegraded":"2023-10-09T15:37:14.528883+0000","last_fullsized":"2023-10-09T15:37:14.528883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:59.023666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.279576+0000","last_change":"2023-10-09T15:37:14.277490+0000","last_active":"2023-10-09T15:37:14.279576+0000","last_peered":"2023-10-09T15:37:14.279576+0000","last_clean":"2023-10-09T15:37:14.279576+0000","last_became_active":"2023-10-09T15:37:14.277198+0000","last_became_peered":"2023-10-09T15:37:14.277198+0000","last_unstale":"2023-10-09T15:37:14.279576+0000","last_undegraded":"2023-10-09T15:37:14.279576+0000","last_fullsized":"2023-10-09T15:37:14.279576+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:17.436456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.524200+0000","last_change":"2023-10-09T15:37:13.290785+0000","last_active":"2023-10-09T15:37:14.524200+0000","last_peered":"2023-10-09T15:37:14.524200+0000","last_clean":"2023-10-09T15:37:14.524200+0000","last_became_active":"2023-10-09T15:37:13.290382+0000","last_became_peered":"2023-10-09T15:37:13.290382+0000","last_unstale":"2023-10-09T15:37:14.524200+0000","last_undegraded":"2023-10-09T15:37:14.524200+0000","last_fullsized":"2023-10-09T15:37:14.524200+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:36:29.539970+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283221+0000","last_change":"2023-10-09T15:37:14.280688+0000","last_active":"2023-10-09T15:37:14.283221+0000","last_peered":"2023-10-09T15:37:14.283221+0000","last_clean":"2023-10-09T15:37:14.283221+0000","last_became_active":"2023-10-09T15:37:14.280389+0000","last_became_peered":"2023-10-09T15:37:14.280389+0000","last_unstale":"2023-10-09T15:37:14.283221+0000","last_undegraded":"2023-10-09T15:37:14.283221+0000","last_fullsized":"2023-10-09T15:37:14.283221+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:38:31.576956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523931+0000","last_change":"2023-10-09T15:37:13.278333+0000","last_active":"2023-10-09T15:37:14.523931+0000","last_peered":"2023-10-09T15:37:14.523931+0000","last_clean":"2023-10-09T15:37:14.523931+0000","last_became_active":"2023-10-09T15:37:13.277794+0000","last_became_peered":"2023-10-09T15:37:13.277794+0000","last_unstale":"2023-10-09T15:37:14.523931+0000","last_undegraded":"2023-10-09T15:37:14.523931+0000","last_fullsized":"2023-10-09T15:37:14.523931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:05.178115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288180+0000","last_change":"2023-10-09T15:37:14.283052+0000","last_active":"2023-10-09T15:37:14.288180+0000","last_peered":"2023-10-09T15:37:14.288180+0000","last_clean":"2023-10-09T15:37:14.288180+0000","last_became_active":"2023-10-09T15:37:14.282729+0000","last_became_peered":"2023-10-09T15:37:14.282729+0000","last_unstale":"2023-10-09T15:37:14.288180+0000","last_undegraded":"2023-10-09T15:37:14.288180+0000","last_fullsized":"2023-10-09T15:37:14.288180+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:07.389602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.523307+0000","last_change":"2023-10-09T15:37:13.274887+0000","last_active":"2023-10-09T15:37:14.523307+0000","last_peered":"2023-10-09T15:37:14.523307+0000","last_clean":"2023-10-09T15:37:14.523307+0000","last_became_active":"2023-10-09T15:37:13.274588+0000","last_became_peered":"2023-10-09T15:37:13.274588+0000","last_unstale":"2023-10-09T15:37:14.523307+0000","last_undegraded":"2023-10-09T15:37:14.523307+0000","last_fullsized":"2023-10-09T15:37:14.523307+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:28:19.812253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288683+0000","last_change":"2023-10-09T15:37:14.286725+0000","last_active":"2023-10-09T15:37:14.288683+0000","last_peered":"2023-10-09T15:37:14.288683+0000","last_clean":"2023-10-09T15:37:14.288683+0000","last_became_active":"2023-10-09T15:37:14.285111+0000","last_became_peered":"2023-10-09T15:37:14.285111+0000","last_unstale":"2023-10-09T15:37:14.288683+0000","last_undegraded":"2023-10-09T15:37:14.288683+0000","last_fullsized":"2023-10-09T15:37:14.288683+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:33:37.312176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270270+0000","last_change":"2023-10-09T15:37:13.288752+0000","last_active":"2023-10-09T15:37:14.270270+0000","last_peered":"2023-10-09T15:37:14.270270+0000","last_clean":"2023-10-09T15:37:14.270270+0000","last_became_active":"2023-10-09T15:37:13.288137+0000","last_became_peered":"2023-10-09T15:37:13.288137+0000","last_unstale":"2023-10-09T15:37:14.270270+0000","last_undegraded":"2023-10-09T15:37:14.270270+0000","last_fullsized":"2023-10-09T15:37:14.270270+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:39.123202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288118+0000","last_change":"2023-10-09T15:37:14.284986+0000","last_active":"2023-10-09T15:37:14.288118+0000","last_peered":"2023-10-09T15:37:14.288118+0000","last_clean":"2023-10-09T15:37:14.288118+0000","last_became_active":"2023-10-09T15:37:14.284646+0000","last_became_peered":"2023-10-09T15:37:14.284646+0000","last_unstale":"2023-10-09T15:37:14.288118+0000","last_undegraded":"2023-10-09T15:37:14.288118+0000","last_fullsized":"2023-10-09T15:37:14.288118+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:05.657948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526119+0000","last_change":"2023-10-09T15:37:13.283569+0000","last_active":"2023-10-09T15:37:14.526119+0000","last_peered":"2023-10-09T15:37:14.526119+0000","last_clean":"2023-10-09T15:37:14.526119+0000","last_became_active":"2023-10-09T15:37:13.283300+0000","last_became_peered":"2023-10-09T15:37:13.283300+0000","last_unstale":"2023-10-09T15:37:14.526119+0000","last_undegraded":"2023-10-09T15:37:14.526119+0000","last_fullsized":"2023-10-09T15:37:14.526119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:36:24.814922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285610+0000","last_change":"2023-10-09T15:37:14.284050+0000","last_active":"2023-10-09T15:37:14.285610+0000","last_peered":"2023-10-09T15:37:14.285610+0000","last_clean":"2023-10-09T15:37:14.285610+0000","last_became_active":"2023-10-09T15:37:14.283746+0000","last_became_peered":"2023-10-09T15:37:14.283746+0000","last_unstale":"2023-10-09T15:37:14.285610+0000","last_undegraded":"2023-10-09T15:37:14.285610+0000","last_fullsized":"2023-10-09T15:37:14.285610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:26.439686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264252+0000","last_change":"2023-10-09T15:37:13.282555+0000","last_active":"2023-10-09T15:37:14.264252+0000","last_peered":"2023-10-09T15:37:14.264252+0000","last_clean":"2023-10-09T15:37:14.264252+0000","last_became_active":"2023-10-09T15:37:13.282285+0000","last_became_peered":"2023-10-09T15:37:13.282285+0000","last_unstale":"2023-10-09T15:37:14.264252+0000","last_undegraded":"2023-10-09T15:37:14.264252+0000","last_fullsized":"2023-10-09T15:37:14.264252+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:56:57.308202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288595+0000","last_change":"2023-10-09T15:37:14.286551+0000","last_active":"2023-10-09T15:37:14.288595+0000","last_peered":"2023-10-09T15:37:14.288595+0000","last_clean":"2023-10-09T15:37:14.288595+0000","last_became_active":"2023-10-09T15:37:14.286174+0000","last_became_peered":"2023-10-09T15:37:14.286174+0000","last_unstale":"2023-10-09T15:37:14.288595+0000","last_undegraded":"2023-10-09T15:37:14.288595+0000","last_fullsized":"2023-10-09T15:37:14.288595+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:44.086352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.265707+0000","last_change":"2023-10-09T15:37:13.283869+0000","last_active":"2023-10-09T15:37:14.265707+0000","last_peered":"2023-10-09T15:37:14.265707+0000","last_clean":"2023-10-09T15:37:14.265707+0000","last_became_active":"2023-10-09T15:37:13.283553+0000","last_became_peered":"2023-10-09T15:37:13.283553+0000","last_unstale":"2023-10-09T15:37:14.265707+0000","last_undegraded":"2023-10-09T15:37:14.265707+0000","last_fullsized":"2023-10-09T15:37:14.265707+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282469+0000","last_change":"2023-10-09T15:37:14.278717+0000","last_active":"2023-10-09T15:37:14.282469+0000","last_peered":"2023-10-09T15:37:14.282469+0000","last_clean":"2023-10-09T15:37:14.282469+0000","last_became_active":"2023-10-09T15:37:14.278462+0000","last_became_peered":"2023-10-09T15:37:14.278462+0000","last_unstale":"2023-10-09T15:37:14.282469+0000","last_undegraded":"2023-10-09T15:37:14.282469+0000","last_fullsized":"2023-10-09T15:37:14.282469+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:20.242868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271806+0000","last_change":"2023-10-09T15:37:13.290871+0000","last_active":"2023-10-09T15:37:14.271806+0000","last_peered":"2023-10-09T15:37:14.271806+0000","last_clean":"2023-10-09T15:37:14.271806+0000","last_became_active":"2023-10-09T15:37:13.290518+0000","last_became_peered":"2023-10-09T15:37:13.290518+0000","last_unstale":"2023-10-09T15:37:14.271806+0000","last_undegraded":"2023-10-09T15:37:14.271806+0000","last_fullsized":"2023-10-09T15:37:14.271806+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:49.732124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280835+0000","last_change":"2023-10-09T15:37:14.277829+0000","last_active":"2023-10-09T15:37:14.280835+0000","last_peered":"2023-10-09T15:37:14.280835+0000","last_clean":"2023-10-09T15:37:14.280835+0000","last_became_active":"2023-10-09T15:37:14.277492+0000","last_became_peered":"2023-10-09T15:37:14.277492+0000","last_unstale":"2023-10-09T15:37:14.280835+0000","last_undegraded":"2023-10-09T15:37:14.280835+0000","last_fullsized":"2023-10-09T15:37:14.280835+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:39:04.322660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.526239+0000","last_change":"2023-10-09T15:37:13.287838+0000","last_active":"2023-10-09T15:37:14.526239+0000","last_peered":"2023-10-09T15:37:14.526239+0000","last_clean":"2023-10-09T15:37:14.526239+0000","last_became_active":"2023-10-09T15:37:13.287540+0000","last_became_peered":"2023-10-09T15:37:13.287540+0000","last_unstale":"2023-10-09T15:37:14.526239+0000","last_undegraded":"2023-10-09T15:37:14.526239+0000","last_fullsized":"2023-10-09T15:37:14.526239+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:53.625320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285564+0000","last_change":"2023-10-09T15:37:14.283276+0000","last_active":"2023-10-09T15:37:14.285564+0000","last_peered":"2023-10-09T15:37:14.285564+0000","last_clean":"2023-10-09T15:37:14.285564+0000","last_became_active":"2023-10-09T15:37:14.282833+0000","last_became_peered":"2023-10-09T15:37:14.282833+0000","last_unstale":"2023-10-09T15:37:14.285564+0000","last_undegraded":"2023-10-09T15:37:14.285564+0000","last_fullsized":"2023-10-09T15:37:14.285564+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:25:39.258683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270676+0000","last_change":"2023-10-09T15:37:13.272306+0000","last_active":"2023-10-09T15:37:14.270676+0000","last_peered":"2023-10-09T15:37:14.270676+0000","last_clean":"2023-10-09T15:37:14.270676+0000","last_became_active":"2023-10-09T15:37:13.272027+0000","last_became_peered":"2023-10-09T15:37:13.272027+0000","last_unstale":"2023-10-09T15:37:14.270676+0000","last_undegraded":"2023-10-09T15:37:14.270676+0000","last_fullsized":"2023-10-09T15:37:14.270676+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:40.238895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.285567+0000","last_change":"2023-10-09T15:37:14.283291+0000","last_active":"2023-10-09T15:37:14.285567+0000","last_peered":"2023-10-09T15:37:14.285567+0000","last_clean":"2023-10-09T15:37:14.285567+0000","last_became_active":"2023-10-09T15:37:14.282969+0000","last_became_peered":"2023-10-09T15:37:14.282969+0000","last_unstale":"2023-10-09T15:37:14.285567+0000","last_undegraded":"2023-10-09T15:37:14.285567+0000","last_fullsized":"2023-10-09T15:37:14.285567+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.870108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270833+0000","last_change":"2023-10-09T15:37:13.290899+0000","last_active":"2023-10-09T15:37:14.270833+0000","last_peered":"2023-10-09T15:37:14.270833+0000","last_clean":"2023-10-09T15:37:14.270833+0000","last_became_active":"2023-10-09T15:37:13.290629+0000","last_became_peered":"2023-10-09T15:37:13.290629+0000","last_unstale":"2023-10-09T15:37:14.270833+0000","last_undegraded":"2023-10-09T15:37:14.270833+0000","last_fullsized":"2023-10-09T15:37:14.270833+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:43.082507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.280037+0000","last_change":"2023-10-09T15:37:14.277632+0000","last_active":"2023-10-09T15:37:14.280037+0000","last_peered":"2023-10-09T15:37:14.280037+0000","last_clean":"2023-10-09T15:37:14.280037+0000","last_became_active":"2023-10-09T15:37:14.277302+0000","last_became_peered":"2023-10-09T15:37:14.277302+0000","last_unstale":"2023-10-09T15:37:14.280037+0000","last_undegraded":"2023-10-09T15:37:14.280037+0000","last_fullsized":"2023-10-09T15:37:14.280037+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:53:24.581298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270583+0000","last_change":"2023-10-09T15:37:13.282192+0000","last_active":"2023-10-09T15:37:14.270583+0000","last_peered":"2023-10-09T15:37:14.270583+0000","last_clean":"2023-10-09T15:37:14.270583+0000","last_became_active":"2023-10-09T15:37:13.281909+0000","last_became_peered":"2023-10-09T15:37:13.281909+0000","last_unstale":"2023-10-09T15:37:14.270583+0000","last_undegraded":"2023-10-09T15:37:14.270583+0000","last_fullsized":"2023-10-09T15:37:14.270583+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:05:03.473813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.282741+0000","last_change":"2023-10-09T15:37:14.277241+0000","last_active":"2023-10-09T15:37:14.282741+0000","last_peered":"2023-10-09T15:37:14.282741+0000","last_clean":"2023-10-09T15:37:14.282741+0000","last_became_active":"2023-10-09T15:37:14.276934+0000","last_became_peered":"2023-10-09T15:37:14.276934+0000","last_unstale":"2023-10-09T15:37:14.282741+0000","last_undegraded":"2023-10-09T15:37:14.282741+0000","last_fullsized":"2023-10-09T15:37:14.282741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:42.684885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.270280+0000","last_change":"2023-10-09T15:37:13.273755+0000","last_active":"2023-10-09T15:37:14.270280+0000","last_peered":"2023-10-09T15:37:14.270280+0000","last_clean":"2023-10-09T15:37:14.270280+0000","last_became_active":"2023-10-09T15:37:13.273413+0000","last_became_peered":"2023-10-09T15:37:13.273413+0000","last_unstale":"2023-10-09T15:37:14.270280+0000","last_undegraded":"2023-10-09T15:37:14.270280+0000","last_fullsized":"2023-10-09T15:37:14.270280+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:19:50.853353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.276198+0000","last_change":"2023-10-09T15:37:14.268829+0000","last_active":"2023-10-09T15:37:14.276198+0000","last_peered":"2023-10-09T15:37:14.276198+0000","last_clean":"2023-10-09T15:37:14.276198+0000","last_became_active":"2023-10-09T15:37:14.268521+0000","last_became_peered":"2023-10-09T15:37:14.268521+0000","last_unstale":"2023-10-09T15:37:14.276198+0000","last_undegraded":"2023-10-09T15:37:14.276198+0000","last_fullsized":"2023-10-09T15:37:14.276198+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:19:15.200178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.266069+0000","last_change":"2023-10-09T15:37:13.282267+0000","last_active":"2023-10-09T15:37:14.266069+0000","last_peered":"2023-10-09T15:37:14.266069+0000","last_clean":"2023-10-09T15:37:14.266069+0000","last_became_active":"2023-10-09T15:37:13.281978+0000","last_became_peered":"2023-10-09T15:37:13.281978+0000","last_unstale":"2023-10-09T15:37:14.266069+0000","last_undegraded":"2023-10-09T15:37:14.266069+0000","last_fullsized":"2023-10-09T15:37:14.266069+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:13.820884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.288617+0000","last_change":"2023-10-09T15:37:14.286705+0000","last_active":"2023-10-09T15:37:14.288617+0000","last_peered":"2023-10-09T15:37:14.288617+0000","last_clean":"2023-10-09T15:37:14.288617+0000","last_became_active":"2023-10-09T15:37:14.285909+0000","last_became_peered":"2023-10-09T15:37:14.285909+0000","last_unstale":"2023-10-09T15:37:14.288617+0000","last_undegraded":"2023-10-09T15:37:14.288617+0000","last_fullsized":"2023-10-09T15:37:14.288617+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:52:50.735969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.264214+0000","last_change":"2023-10-09T15:37:13.283202+0000","last_active":"2023-10-09T15:37:14.264214+0000","last_peered":"2023-10-09T15:37:14.264214+0000","last_clean":"2023-10-09T15:37:14.264214+0000","last_became_active":"2023-10-09T15:37:13.282829+0000","last_became_peered":"2023-10-09T15:37:13.282829+0000","last_unstale":"2023-10-09T15:37:14.264214+0000","last_undegraded":"2023-10-09T15:37:14.264214+0000","last_fullsized":"2023-10-09T15:37:14.264214+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:11.245573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283637+0000","last_change":"2023-10-09T15:37:14.278018+0000","last_active":"2023-10-09T15:37:14.283637+0000","last_peered":"2023-10-09T15:37:14.283637+0000","last_clean":"2023-10-09T15:37:14.283637+0000","last_became_active":"2023-10-09T15:37:14.277763+0000","last_became_peered":"2023-10-09T15:37:14.277763+0000","last_unstale":"2023-10-09T15:37:14.283637+0000","last_undegraded":"2023-10-09T15:37:14.283637+0000","last_fullsized":"2023-10-09T15:37:14.283637+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:38:42.318908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271669+0000","last_change":"2023-10-09T15:37:13.291282+0000","last_active":"2023-10-09T15:37:14.271669+0000","last_peered":"2023-10-09T15:37:14.271669+0000","last_clean":"2023-10-09T15:37:14.271669+0000","last_became_active":"2023-10-09T15:37:13.290934+0000","last_became_peered":"2023-10-09T15:37:13.290934+0000","last_unstale":"2023-10-09T15:37:14.271669+0000","last_undegraded":"2023-10-09T15:37:14.271669+0000","last_fullsized":"2023-10-09T15:37:14.271669+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:44:29.880569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":9,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.283235+0000","last_change":"2023-10-09T15:37:14.281494+0000","last_active":"2023-10-09T15:37:14.283235+0000","last_peered":"2023-10-09T15:37:14.283235+0000","last_clean":"2023-10-09T15:37:14.283235+0000","last_became_active":"2023-10-09T15:37:14.281215+0000","last_became_peered":"2023-10-09T15:37:14.281215+0000","last_unstale":"2023-10-09T15:37:14.283235+0000","last_undegraded":"2023-10-09T15:37:14.283235+0000","last_fullsized":"2023-10-09T15:37:14.283235+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:13.258265+0000","last_clean_scrub_stamp":"2023-10-09T15:37:13.258265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:59.366817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":10,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.271052+0000","last_change":"2023-10-09T15:37:13.288347+0000","last_active":"2023-10-09T15:37:14.271052+0000","last_peered":"2023-10-09T15:37:14.271052+0000","last_clean":"2023-10-09T15:37:14.271052+0000","last_became_active":"2023-10-09T15:37:13.288051+0000","last_became_peered":"2023-10-09T15:37:13.288051+0000","last_unstale":"2023-10-09T15:37:14.271052+0000","last_undegraded":"2023-10-09T15:37:14.271052+0000","last_fullsized":"2023-10-09T15:37:14.271052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:12.254420+0000","last_clean_scrub_stamp":"2023-10-09T15:37:12.254420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:52:17.797526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":230,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-10-09T15:37:14.278041+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:14.278041+0000","last_peered":"2023-10-09T15:37:14.278041+0000","last_clean":"2023-10-09T15:37:14.278041+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:14.278041+0000","last_undegraded":"2023-10-09T15:37:14.278041+0000","last_fullsized":"2023-10-09T15:37:14.278041+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574929,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303200,"kb_used_data":1816,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068640,"statfs":{"total":96636764160,"available":96326287360,"internally_reserved":0,"allocated":1859584,"data_stored":1133918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.626},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.51900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.502}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.45300000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57799999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.71299999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574929,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302616,"kb_used_data":1232,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069224,"statfs":{"total":96636764160,"available":96326885376,"internally_reserved":0,"allocated":1261568,"data_stored":543032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.70399999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.47299999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.59699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.57899999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.624},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.76000000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.66800000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574930,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302620,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069220,"statfs":{"total":96636764160,"available":96326881280,"internally_reserved":0,"allocated":1265664,"data_stored":543086,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.27700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.434},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.25900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.40699999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.63200000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.57399999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.54600000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.73099999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574928,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303208,"kb_used_data":1824,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068632,"statfs":{"total":96636764160,"available":96326279168,"internally_reserved":0,"allocated":1867776,"data_stored":1133967,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.375}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33500000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.57399999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.51600000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.78800000000000003},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.505}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.55700000000000005}]}]},{"osd":2,"up_from":13,"seq":55834574929,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.255}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.33700000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.38100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.68200000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.63600000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.72199999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.69599999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574927,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302628,"kb_used_data":1244,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069212,"statfs":{"total":96636764160,"available":96326873088,"internally_reserved":0,"allocated":1273856,"data_stored":544568,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.26600000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.23799999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.63800000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.68999999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.55100000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574928,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302612,"kb_used_data":1228,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069228,"statfs":{"total":96636764160,"available":96326889472,"internally_reserved":0,"allocated":1257472,"data_stored":542962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45500000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.627},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.48399999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.505}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.59699999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.64500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.67600000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.70499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574929,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":298524,"kb_used_data":1236,"kb_used_omap":0,"kb_used_meta":297280,"kb_avail":94073316,"statfs":{"total":96636764160,"available":96331075584,"internally_reserved":0,"allocated":1265664,"data_stored":543538,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304414720},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.64100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.499}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.57599999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.46600000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.59799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:23.577 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:37:23.577 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:37:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.737+0000 7f800801f700 1 Processor -- start 2023-10-09T15:37:23.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.737+0000 7f800801f700 1 -- start start 2023-10-09T15:37:23.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.738+0000 7f800801f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 0x7f800013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.738+0000 7f800801f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.738+0000 7f800801f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f800006d7b0 con 0x7f8000069a00 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.738+0000 7f800801f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800006a590 con 0x7f80000cc320 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.738+0000 7f800801f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800006f7d0 con 0x7f80000cc6f0 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8005dbb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 0x7f800013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8005dbb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 0x7f800013c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:37354/0 (socket says 172.21.15.33:37354) 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:37634/0 (socket says 172.21.15.33:37634) 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8005dbb700 1 -- 172.21.15.33:0/3957680875 learned_addr learned my addr 172.21.15.33:0/3957680875 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:23.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80065bc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8000069a00 0x7f8000069e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:51896/0 (socket says 172.21.15.33:51896) 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 -- 172.21.15.33:0/3957680875 >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 msgr2=0x7f800013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 --2- 172.21.15.33:0/3957680875 >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 0x7f800013c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 -- 172.21.15.33:0/3957680875 >> v1:172.21.15.59:6789/0 conn(0x7f8000069a00 legacy=0x7f8000069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 -- 172.21.15.33:0/3957680875 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800006e330 con 0x7f80000cc6f0 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f80055ba700 1 --2- 172.21.15.33:0/3957680875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40098e0 tx=0x7f7ff40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8ec2e96781c9cc66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8004db9700 1 -- 172.21.15.33:0/3957680875 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400b640 con 0x7f80000cc6f0 2023-10-09T15:37:23.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8004db9700 1 -- 172.21.15.33:0/3957680875 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff400b7a0 con 0x7f80000cc6f0 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.739+0000 7f8004db9700 1 -- 172.21.15.33:0/3957680875 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff400bb40 con 0x7f80000cc6f0 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 -- 172.21.15.33:0/3957680875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 msgr2=0x7f800013c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 --2- 172.21.15.33:0/3957680875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ff40098e0 tx=0x7f7ff40091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 -- 172.21.15.33:0/3957680875 shutdown_connections 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 --2- 172.21.15.33:0/3957680875 >> v2:172.21.15.59:3300/0 conn(0x7f80000cc320 0x7f800013c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 --2- 172.21.15.33:0/3957680875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800013c7e0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 -- 172.21.15.33:0/3957680875 >> 172.21.15.33:0/3957680875 conn(0x7f8000067f00 msgr2=0x7f8000068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 -- 172.21.15.33:0/3957680875 shutdown_connections 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.740+0000 7f800801f700 1 -- 172.21.15.33:0/3957680875 wait complete. 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.741+0000 7f800801f700 1 Processor -- start 2023-10-09T15:37:23.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.741+0000 7f800801f700 1 -- start start 2023-10-09T15:37:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 0x7f80000acd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800016d5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000aa570 con 0x7f80000cc320 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ab0f0 con 0x7f8000069a00 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f800801f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ab580 con 0x7f80000cc6f0 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39180/0 (socket says 172.21.15.33:39180) 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 -- 172.21.15.33:0/2891148350 learned_addr learned my addr 172.21.15.33:0/2891148350 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f8005dbb700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 0x7f80000acd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80065bc700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800016d5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 -- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 msgr2=0x7f800016d5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800016d5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 -- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 msgr2=0x7f80000acd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 0x7f80000acd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:23.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80055ba700 1 -- 172.21.15.33:0/2891148350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ff4009420 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f8005dbb700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 0x7f80000acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.742+0000 7f80065bc700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800016d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f80055ba700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009f80 tx=0x7f7ff4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff401bb60 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff401bcc0 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80000aa7c0 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff4011670 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.743+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000aad80 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.744+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80000ab280 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.744+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f7ff4011a20 con 0x7f80000cc320 2023-10-09T15:37:23.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.745+0000 7f7ffdffb700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 0x7f7fec069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:23.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.745+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7ff4085de0 con 0x7f80000cc320 2023-10-09T15:37:23.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.745+0000 7f8005dbb700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 0x7f7fec069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:23.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.745+0000 7f8005dbb700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 0x7f7fec069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009450 tx=0x7f7ff800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:23.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:23.749+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ff4052c40 con 0x7f80000cc320 2023-10-09T15:37:24.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.023+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f800004c3c0 con 0x7f80000cc320 2023-10-09T15:37:24.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.027+0000 7f7ffdffb700 1 -- 172.21.15.33:0/2891148350 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f7ff4056260 con 0x7f80000cc320 2023-10-09T15:37:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 msgr2=0x7f7fec069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 0x7f7fec069740 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8009450 tx=0x7f7ff800b040 comp rx=0 tx=0).stop 2023-10-09T15:37:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 msgr2=0x7f800013a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f7ff4009f80 tx=0x7f7ff4017000 comp rx=0 tx=0).stop 2023-10-09T15:37:24.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 shutdown_connections 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fec067290 0x7f7fec069740 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cc6f0 0x7f800016d5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8000069a00 0x7f80000acd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 --2- 172.21.15.33:0/2891148350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cc320 0x7f800013a870 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 >> 172.21.15.33:0/2891148350 conn(0x7f8000067f00 msgr2=0x7f8000153d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 shutdown_connections 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.029+0000 7f800801f700 1 -- 172.21.15.33:0/2891148350 wait complete. 2023-10-09T15:37:24.031 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:37:24.042 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.160+0000 7fc920d0a700 1 Processor -- start 2023-10-09T15:37:24.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.160+0000 7fc920d0a700 1 -- start start 2023-10-09T15:37:24.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc920d0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc91c0b07d0 0x7fc91c0ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc920d0a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc91c0cf200 0x7fc91c0cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc920d0a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c15a280 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc920d0a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c06e180 con 0x7fc91c0cf200 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc920d0a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c0cd540 con 0x7fc91c0b07d0 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc91c0cf200 0x7fc91c0cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc91c0cf200 0x7fc91c0cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39188/0 (socket says 172.21.15.33:39188) 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 -- 172.21.15.33:0/1238519241 learned_addr learned my addr 172.21.15.33:0/1238519241 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc91a59c700 1 --2- 172.21.15.33:0/1238519241 >> v2:172.21.15.59:3300/0 conn(0x7fc91c0b07d0 0x7fc91c0ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 -- 172.21.15.33:0/1238519241 >> v2:172.21.15.59:3300/0 conn(0x7fc91c0b07d0 msgr2=0x7fc91c0ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 --2- 172.21.15.33:0/1238519241 >> v2:172.21.15.59:3300/0 conn(0x7fc91c0b07d0 0x7fc91c0ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 -- 172.21.15.33:0/1238519241 >> v1:172.21.15.59:6789/0 conn(0x7fc91c0b0ba0 legacy=0x7fc91c06e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.161+0000 7fc919d9b700 1 -- 172.21.15.33:0/1238519241 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c06d850 con 0x7fc91c0cf200 2023-10-09T15:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc919d9b700 1 --2- 172.21.15.33:0/1238519241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0cf200 0x7fc91c0cd000 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc91c064720 tx=0x7fc910009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f14f79ff6f2d08 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc91959a700 1 -- 172.21.15.33:0/1238519241 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000b8f0 con 0x7fc91c0cf200 2023-10-09T15:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc91959a700 1 -- 172.21.15.33:0/1238519241 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91000ba50 con 0x7fc91c0cf200 2023-10-09T15:37:24.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc91959a700 1 -- 172.21.15.33:0/1238519241 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91000bdf0 con 0x7fc91c0cf200 2023-10-09T15:37:24.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 -- 172.21.15.33:0/1238519241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0cf200 msgr2=0x7fc91c0cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 --2- 172.21.15.33:0/1238519241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0cf200 0x7fc91c0cd000 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7fc91c064720 tx=0x7fc910009250 comp rx=0 tx=0).stop 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 -- 172.21.15.33:0/1238519241 shutdown_connections 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 --2- 172.21.15.33:0/1238519241 >> v2:172.21.15.59:3300/0 conn(0x7fc91c0b07d0 0x7fc91c0ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 --2- 172.21.15.33:0/1238519241 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0cf200 0x7fc91c0cd000 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 -- 172.21.15.33:0/1238519241 >> 172.21.15.33:0/1238519241 conn(0x7fc91c06ce80 msgr2=0x7fc91c0ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 -- 172.21.15.33:0/1238519241 shutdown_connections 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.162+0000 7fc920d0a700 1 -- 172.21.15.33:0/1238519241 wait complete. 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.163+0000 7fc920d0a700 1 Processor -- start 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.163+0000 7fc920d0a700 1 -- start start 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 0x7fc91c156b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc91c0cf200 0x7fc91c15ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0981d0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15da00 con 0x7fc91c0cf200 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc920d0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15b760 con 0x7fc91c0b07d0 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc919d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc919d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39204/0 (socket says 172.21.15.33:39204) 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc919d9b700 1 -- 172.21.15.33:0/4073036647 learned_addr learned my addr 172.21.15.33:0/4073036647 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc91ad9d700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc91c0cf200 0x7fc91c15ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.164+0000 7fc91a59c700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 0x7fc91c156b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 -- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 msgr2=0x7fc91c156b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 0x7fc91c156b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 -- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc91c0cf200 msgr2=0x7fc91c15ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc91c0cf200 0x7fc91c15ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 -- 172.21.15.33:0/4073036647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9100094f0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc91a59c700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 0x7fc91c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc919d9b700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc91c06af10 tx=0x7fc910017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91001a450 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91001a5b0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c15dcc0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c15b1a0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.165+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc91001a970 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.166+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c15de50 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.167+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fc91001b430 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.167+0000 7fc90a7fc700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 0x7fc8fc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.168+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc910086aa0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.168+0000 7fc91a59c700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 0x7fc8fc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.168+0000 7fc91a59c700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 0x7fc8fc069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc91c069180 tx=0x7fc90c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.171+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc910053980 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.408+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc91c04c3c0 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.409+0000 7fc90a7fc700 1 -- 172.21.15.33:0/4073036647 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 67 v67) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fc910015090 con 0x7fc91c0b0ba0 2023-10-09T15:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:24.410 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":67,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:24.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 msgr2=0x7fc8fc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 0x7fc8fc069740 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc91c069180 tx=0x7fc90c008040 comp rx=0 tx=0).stop 2023-10-09T15:37:24.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 msgr2=0x7fc91c09aeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7fc91c06af10 tx=0x7fc910017000 comp rx=0 tx=0).stop 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 shutdown_connections 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8fc067290 0x7fc8fc069740 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc91c0cf200 0x7fc91c15ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc91c0b07d0 0x7fc91c156b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 --2- 172.21.15.33:0/4073036647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc91c0b0ba0 0x7fc91c09aeb0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 >> 172.21.15.33:0/4073036647 conn(0x7fc91c06ce80 msgr2=0x7fc91c158e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 shutdown_connections 2023-10-09T15:37:24.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.411+0000 7fc920d0a700 1 -- 172.21.15.33:0/4073036647 wait complete. 2023-10-09T15:37:24.414 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 67 2023-10-09T15:37:24.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 67, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:37:13.678019+0000', 'modified': '2023-10-09T15:37:17.528789+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6795}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6795': {'gid': 6795, 'name': 'a', 'rank': 0, 'incarnation': 63, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6837/624790469', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6835', 'nonce': 624790469}, {'type': 'v1', 'addr': '172.21.15.33:6837', 'nonce': 624790469}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:37:24.826 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:37:24.826 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T15:37:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.951+0000 7fb148db9700 1 Processor -- start 2023-10-09T15:37:24.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.951+0000 7fb148db9700 1 -- start start 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb148db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb1441599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb148db9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1440c7f50 con 0x7fb1440675a0 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb148db9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb14406b740 con 0x7fb144067a10 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb148db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb14406bd00 con 0x7fb1441595d0 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb141d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb1440675a0 0x7fb14406acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55888/0 (socket says 172.21.15.33:55888) 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb141d9b700 1 -- 172.21.15.33:0/1833663739 learned_addr learned my addr 172.21.15.33:0/1833663739 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:24.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14259c700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb1441599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394265041 0 0) 0x7fb1440c7f50 con 0x7fb1440675a0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb130003570 con 0x7fb1440675a0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3755433417 0 0) 0x7fb14406b740 con 0x7fb144067a10 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb1440c7f50 con 0x7fb144067a10 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2970245561 0 0) 0x7fb130003570 con 0x7fb1440675a0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 msgr2=0x7fb1441599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb1441599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 >> v1:172.21.15.59:6789/0 conn(0x7fb144067a10 legacy=0x7fb1440c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb14406ba20 con 0x7fb1440675a0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fb12c001470 con 0x7fb1440675a0 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14259c700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb1441599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.952+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 >> v1:172.21.15.33:6789/0 conn(0x7fb1440675a0 legacy=0x7fb14406acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb130003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb130004160 0x7fb130004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb130004d50 0x7fb1300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bb70 con 0x7fb130004d50 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bce0 con 0x7fb130004160 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb13000bea0 con 0x7fb1441595d0 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb130004d50 0x7fb1300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14259c700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb130003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb141d9b700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb130004160 0x7fb130004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 -- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 msgr2=0x7fb130003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1441595d0 0x7fb130003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 -- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb130004160 msgr2=0x7fb130004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb130004160 0x7fb130004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 -- 172.21.15.33:0/1833663739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb134009a20 con 0x7fb130004d50 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb142d9d700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb130004d50 0x7fb1300051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001a10 tx=0x7fb13c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf9afd3db29c169 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00c5d0 con 0x7fb130004d50 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c00c730 con 0x7fb130004d50 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.953+0000 7fb14159a700 1 -- 172.21.15.33:0/1833663739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00cad0 con 0x7fb130004d50 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 -- 172.21.15.33:0/1833663739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb130004d50 msgr2=0x7fb1300051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 --2- 172.21.15.33:0/1833663739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb130004d50 0x7fb1300051c0 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fb13c001a10 tx=0x7fb13c007d30 comp rx=0 tx=0).stop 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb142d9d700 1 -- 172.21.15.33:0/1833663739 reap_dead start 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 -- 172.21.15.33:0/1833663739 shutdown_connections 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 -- 172.21.15.33:0/1833663739 >> 172.21.15.33:0/1833663739 conn(0x7fb1440cd400 msgr2=0x7fb1440cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 -- 172.21.15.33:0/1833663739 shutdown_connections 2023-10-09T15:37:24.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.954+0000 7fb148db9700 1 -- 172.21.15.33:0/1833663739 wait complete. 2023-10-09T15:37:24.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.955+0000 7fb148db9700 1 Processor -- start 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.955+0000 7fb148db9700 1 -- start start 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb130004d50 0x7fb1441435b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 0x7fb144155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb14415b040 con 0x7fb144157b20 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb144156390 con 0x7fb144155a00 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb148db9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb144158850 con 0x7fb130004d50 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39224/0 (socket says 172.21.15.33:39224) 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 -- 172.21.15.33:0/3850939985 learned_addr learned my addr 172.21.15.33:0/3850939985 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb14259c700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb130004d50 0x7fb1441435b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb141d9b700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 0x7fb144155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 -- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb130004d50 msgr2=0x7fb1441435b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb130004d50 0x7fb1441435b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 -- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 msgr2=0x7fb144155e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 0x7fb144155e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 -- 172.21.15.33:0/3850939985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb144158b30 con 0x7fb144157b20 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb141d9b700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 0x7fb144155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb142d9d700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00c3c0 tx=0x7fb13c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.956+0000 7fb13a7fc700 1 -- 172.21.15.33:0/3850939985 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c00c5d0 con 0x7fb144157b20 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.957+0000 7fb13a7fc700 1 -- 172.21.15.33:0/3850939985 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13c001360 con 0x7fb144157b20 2023-10-09T15:37:24.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.957+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb144158e10 con 0x7fb144157b20 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.957+0000 7fb13a7fc700 1 -- 172.21.15.33:0/3850939985 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c012dc0 con 0x7fb144157b20 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.957+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1441584c0 con 0x7fb144157b20 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.958+0000 7fb13a7fc700 1 -- 172.21.15.33:0/3850939985 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fb13c019070 con 0x7fb144157b20 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.959+0000 7fb13a7fc700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 0x7fb124069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.959+0000 7fb13a7fc700 1 -- 172.21.15.33:0/3850939985 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb13c085c70 con 0x7fb144157b20 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.959+0000 7fb14259c700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 0x7fb124069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.959+0000 7fb14259c700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 0x7fb124069770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb134009fd0 tx=0x7fb13400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 Processor -- start 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 -- start start 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7fd9d00 0x5600c7fb8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7f8bcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7ee6a70 con 0x5600c7f8fa50 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7ee4270 con 0x5600c7fb8f60 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c7ee0060 con 0x5600c7fd9d00 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb14259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb14259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39232/0 (socket says 172.21.15.33:39232) 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.961+0000 7fb14259c700 1 -- 172.21.15.33:0/877203656 learned_addr learned my addr 172.21.15.33:0/877203656 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb141d9b700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7fd9d00 0x5600c7fb8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb142d9d700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7f8bcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 -- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7fd9d00 msgr2=0x5600c7fb8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7fd9d00 0x5600c7fb8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 -- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 msgr2=0x5600c7f8bcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7f8bcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 -- 172.21.15.33:0/877203656 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c7d7a270 con 0x5600c7f8fa50 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb142d9d700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7f8bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb14259c700 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb134016730 tx=0x7fb13401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eddef2d6d8b9fd48 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb1237fe700 1 -- 172.21.15.33:0/877203656 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13400e040 con 0x5600c7f8fa50 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb1237fe700 1 -- 172.21.15.33:0/877203656 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400f040 con 0x5600c7f8fa50 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.962+0000 7fb1237fe700 1 -- 172.21.15.33:0/877203656 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb134023650 con 0x5600c7f8fa50 2023-10-09T15:37:24.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- 172.21.15.33:0/877203656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 msgr2=0x5600c7f8fe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fb134016730 tx=0x7fb13401a000 comp rx=0 tx=0).stop 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- 172.21.15.33:0/877203656 shutdown_connections 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7f8fa50 0x5600c7f8fe20 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7f8bcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/877203656 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7fd9d00 0x5600c7fb8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- 172.21.15.33:0/877203656 >> 172.21.15.33:0/877203656 conn(0x5600c7f91370 msgr2=0x5600c7f91740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- 172.21.15.33:0/877203656 shutdown_connections 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- 172.21.15.33:0/877203656 wait complete. 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 -- start start 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.963+0000 7fb1520b1b80 1 Processor -- start 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fe5d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fce420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7e8b890 con 0x5600c7fb8f60 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7ea6ea0 con 0x5600c7fd9d00 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c7d62e30 con 0x5600c7f8fa50 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb1520b1b80 10 client.0 _ll_register_callbacks cb 0x5600c7f53110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.964+0000 7fb141d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39238/0 (socket says 172.21.15.33:39238) 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 -- 172.21.15.33:0/3315857740 learned_addr learned my addr 172.21.15.33:0/3315857740 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb14259c700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fe5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb142d9d700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fce420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 -- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 msgr2=0x5600c7fe5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fe5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 -- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 msgr2=0x5600c7fce420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fce420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 -- 172.21.15.33:0/3315857740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb134016430 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb141d9b700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000e50 tx=0x7fb12c006040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cf43c57797befcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c01b070 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb12c018730 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5600c7f84b70 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb12c000c30 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb1520b1b80 10 client.6960 fetch_fsmap learned FSMap version 67 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x5600c7d1cfe0 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.965+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c025020 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb12c01e030 con 0x5600c7fb8f60 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 10 client.6960 fetch_fsmap finished waiting for FSMap version 67 2023-10-09T15:37:24.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 10 client.6960 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 20 client.6960 populate_metadata read hostname 'smithi033' 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd2730 0x5600c7fbf370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 4 client.6960 mds_command: new command op to 6795 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 --> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5600c7f61aa0 con 0x5600c7fd2730 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb14259c700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd2730 0x5600c7fbf370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb120ff9700 10 client.6960 ms_handle_connect on v2:172.21.15.33:6835/624790469 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.966+0000 7fb14259c700 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd2730 0x5600c7fbf370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d78a5e221c3ef64 server_cookie=576a56ffaf438644 in_seq=0 out_seq=0 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb120ff9700 1 -- 172.21.15.33:0/3315857740 <== mds.0 v2:172.21.15.33:6835/624790469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5600c7f61aa0 con 0x5600c7fd2730 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb120ff9700 10 client.6960 handle_command_reply: tid=0 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 client.6960 shutdown 2023-10-09T15:37:24.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 msgr2=0x5600c7fcf290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fb12c000e50 tx=0x7fb12c006040 comp rx=0 tx=0).stop 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 shutdown_connections 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd2730 0x5600c7fbf370 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fce420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fe5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb120ff9700 0 client.6960 ms_handle_reset on v2:172.21.15.33:6835/624790469 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/3315857740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fcf290 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 >> 172.21.15.33:0/3315857740 conn(0x5600c7f91370 msgr2=0x5600c7fd5550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 shutdown_connections 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 1 -- 172.21.15.33:0/3315857740 wait complete. 2023-10-09T15:37:24.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.967+0000 7fb1520b1b80 20 client.6960 trim_cache size 0 max 16384 2023-10-09T15:37:24.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.984+0000 7fb1520b1b80 1 Processor -- start 2023-10-09T15:37:24.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.984+0000 7fb1520b1b80 1 -- start start 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fcd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fb85a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7f6f510 con 0x5600c7fb8f60 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7f68410 con 0x5600c7fd9d00 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c7fd2e70 con 0x5600c7f8fa50 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39244/0 (socket says 172.21.15.33:39244) 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 -- 172.21.15.33:0/1495416273 learned_addr learned my addr 172.21.15.33:0/1495416273 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 -- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 msgr2=0x5600c7fcd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb142d9d700 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fb85a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb14259c700 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fcd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fcd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 -- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 msgr2=0x5600c7fb85a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fb85a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 -- 172.21.15.33:0/1495416273 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5600c7eae780 con 0x5600c7fb8f60 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb141d9b700 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0015f0 tx=0x7fb12c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42b0d2b9c31d712 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb123fff700 1 -- 172.21.15.33:0/1495416273 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c01b030 con 0x5600c7fb8f60 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb123fff700 1 -- 172.21.15.33:0/1495416273 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12c025040 con 0x5600c7fb8f60 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.985+0000 7fb123fff700 1 -- 172.21.15.33:0/1495416273 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12c000c30 con 0x5600c7fb8f60 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- 172.21.15.33:0/1495416273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 msgr2=0x5600c7fb8060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fb12c0015f0 tx=0x7fb12c017000 comp rx=0 tx=0).stop 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- 172.21.15.33:0/1495416273 shutdown_connections 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fd9d00 0x5600c7fb85a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7fcd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/1495416273 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8060 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- 172.21.15.33:0/1495416273 >> 172.21.15.33:0/1495416273 conn(0x5600c7f91370 msgr2=0x5600c7f8c6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- 172.21.15.33:0/1495416273 shutdown_connections 2023-10-09T15:37:24.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- 172.21.15.33:0/1495416273 wait complete. 2023-10-09T15:37:24.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 -- start start 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.986+0000 7fb1520b1b80 1 Processor -- start 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7f8b1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7fd89f0 con 0x5600c7fd9d00 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5600c7f8b710 con 0x5600c7fb8f60 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5600c802fc00 con 0x5600c7f8fa50 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.987+0000 7fb1520b1b80 10 client.0 _ll_register_callbacks cb 0x5600c7f53110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39260/0 (socket says 172.21.15.33:39260) 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 -- 172.21.15.33:0/423883765 learned_addr learned my addr 172.21.15.33:0/423883765 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:24.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb14259c700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7f8b1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb141d9b700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 -- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 msgr2=0x5600c7f8b1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7f8b1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 -- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 msgr2=0x5600c7fb8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 -- 172.21.15.33:0/423883765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5600c7d1cfe0 con 0x5600c7fd9d00 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb142d9d700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb13c056720 tx=0x7fb13c059040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6702c29bb063855b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb120ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb13c007a10 con 0x5600c7fd9d00 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb13c056790 con 0x5600c7fd9d00 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fb13400f040 con 0x5600c7fd9d00 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=67) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb13c0599e0 con 0x5600c7fd9d00 2023-10-09T15:37:24.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb1520b1b80 10 client.6966 fetch_fsmap learned FSMap version 67 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=67,monmap=2+}) v3 -- 0x5600c7e95470 con 0x5600c7fd9d00 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.988+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb13400f040 con 0x5600c7fd9d00 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 67) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fb13c072250 con 0x5600c7fd9d00 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 10 client.6966 fetch_fsmap finished waiting for FSMap version 67 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 10 client.6966 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 20 client.6966 populate_metadata read hostname 'smithi033' 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd1a20 0x5600c803f440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 4 client.6966 mds_command: new command op to 6795 tid=0[{"prefix": "status"}] 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 --> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5600c7e82e00 con 0x5600c7fd1a20 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb14259c700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd1a20 0x5600c803f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb120ff9700 10 client.6966 ms_handle_connect on v2:172.21.15.33:6835/624790469 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb14259c700 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd1a20 0x5600c803f440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fa5ae4f5e173e40c server_cookie=144a0767bf3cc1 in_seq=0 out_seq=0 2023-10-09T15:37:24.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb120ff9700 1 -- 172.21.15.33:0/423883765 <== mds.0 v2:172.21.15.33:6835/624790469 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x5600c7e82e00 con 0x5600c7fd1a20 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb120ff9700 10 client.6966 handle_command_reply: tid=0 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 client.6966 shutdown 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 msgr2=0x5600c7fd0e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fb13c056720 tx=0x7fb13c059040 comp rx=0 tx=0).stop 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 shutdown_connections 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5600c7fd9d00 0x5600c7fd0e00 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.33:6835/624790469,v1:172.21.15.33:6837/624790469] conn(0x5600c7fd1a20 0x5600c803f440 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5600c7f8fa50 0x5600c7f8b1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 --2- 172.21.15.33:0/423883765 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5600c7fb8f60 0x5600c7fb8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb120ff9700 0 client.6966 ms_handle_reset on v2:172.21.15.33:6835/624790469 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.989+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 >> 172.21.15.33:0/423883765 conn(0x5600c7f91370 msgr2=0x5600c8030e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 shutdown_connections 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb1520b1b80 1 -- 172.21.15.33:0/423883765 wait complete. 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb1520b1b80 20 client.6966 trim_cache size 0 max 16384 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 6795, 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:37:24.997 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.48063981, 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 67, 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 101, 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 101, 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 16.523767457999998 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:37:24.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 msgr2=0x7fb124069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 0x7fb124069770 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fb134009fd0 tx=0x7fb13400b040 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 msgr2=0x7fb144157f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fb13c00c3c0 tx=0x7fb13c015000 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 shutdown_connections 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb1240672c0 0x7fb124069770 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb144157b20 0x7fb144157f80 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb130004d50 0x7fb1441435b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 --2- 172.21.15.33:0/3850939985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb144155a00 0x7fb144155e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 >> 172.21.15.33:0/3850939985 conn(0x7fb1440cd400 msgr2=0x7fb144068da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 shutdown_connections 2023-10-09T15:37:24.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:24.990+0000 7fb148db9700 1 -- 172.21.15.33:0/3850939985 wait complete. 2023-10-09T15:37:25.003 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:37:25.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.121+0000 7f21168c8700 1 Processor -- start 2023-10-09T15:37:25.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.121+0000 7f21168c8700 1 -- start start 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f21168c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 0x7f2110159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f21168c8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211015ae40 con 0x7f21100cb5a0 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f21168c8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f211015ab60 con 0x7f211015a400 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f21168c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21100ce0f0 con 0x7f21100cb970 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f210ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21100cb5a0 0x7f21100cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55896/0 (socket says 172.21.15.33:55896) 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f210ffff700 1 -- 172.21.15.33:0/1646261189 learned_addr learned my addr 172.21.15.33:0/1646261189 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f210f7fe700 1 --2- 172.21.15.33:0/1646261189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 0x7f2110159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:25.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549530041 0 0) 0x7f211015ae40 con 0x7f21100cb5a0 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.122+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f20f8003570 con 0x7f21100cb5a0 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210f7fe700 1 -- 172.21.15.33:0/1646261189 >> v1:172.21.15.59:6789/0 conn(0x7f211015a400 legacy=0x7f2110156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3126639039 0 0) 0x7f211015ab60 con 0x7f211015a400 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210f7fe700 1 -- 172.21.15.33:0/1646261189 >> v1:172.21.15.33:6789/0 conn(0x7f21100cb5a0 legacy=0x7f21100cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210f7fe700 1 -- 172.21.15.33:0/1646261189 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21100ccf00 con 0x7f21100cb970 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210f7fe700 1 --2- 172.21.15.33:0/1646261189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 0x7f2110159ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2104009910 tx=0x7f21040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=39b81817638bbbcc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400b680 con 0x7f21100cb970 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400b7e0 con 0x7f21100cb970 2023-10-09T15:37:25.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f210effd700 1 -- 172.21.15.33:0/1646261189 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210400bb60 con 0x7f21100cb970 2023-10-09T15:37:25.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f21168c8700 1 -- 172.21.15.33:0/1646261189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 msgr2=0x7f2110159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.123+0000 7f21168c8700 1 --2- 172.21.15.33:0/1646261189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 0x7f2110159ec0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f2104009910 tx=0x7f21040091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.124+0000 7f21168c8700 1 -- 172.21.15.33:0/1646261189 shutdown_connections 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.124+0000 7f21168c8700 1 --2- 172.21.15.33:0/1646261189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21100cb970 0x7f2110159ec0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.124+0000 7f21168c8700 1 -- 172.21.15.33:0/1646261189 >> 172.21.15.33:0/1646261189 conn(0x7f2110070e30 msgr2=0x7f21100d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.124+0000 7f21168c8700 1 -- 172.21.15.33:0/1646261189 shutdown_connections 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.124+0000 7f21168c8700 1 -- 172.21.15.33:0/1646261189 wait complete. 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.125+0000 7f21168c8700 1 Processor -- start 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.125+0000 7f21168c8700 1 -- start start 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.125+0000 7f21168c8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21100cb5a0 0x7f21100b5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.125+0000 7f21168c8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:25.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.125+0000 7f21168c8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211015a400 0x7f211015c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f21168c8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21100cbde0 con 0x7f21100cb970 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f21168c8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2110152d50 con 0x7f21100cb5a0 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f21168c8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f211016a360 con 0x7f211015a400 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39274/0 (socket says 172.21.15.33:39274) 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 -- 172.21.15.33:0/3956279577 learned_addr learned my addr 172.21.15.33:0/3956279577 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210ffff700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21100cb5a0 0x7f21100b5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f2114e65700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211015a400 0x7f211015c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 -- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211015a400 msgr2=0x7f211015c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211015a400 0x7f211015c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 -- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21100cb5a0 msgr2=0x7f21100b5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21100cb5a0 0x7f21100b5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 -- 172.21.15.33:0/3956279577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2104009420 con 0x7f21100cb970 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f210f7fe700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2104009fb0 tx=0x7f2104017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f210401f070 con 0x7f21100cb970 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f210400b950 con 0x7f21100cb970 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f211016a640 con 0x7f21100cb970 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2104011670 con 0x7f21100cb970 2023-10-09T15:37:25.130 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.126+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f211016ac00 con 0x7f21100cb970 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.127+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f211004c3c0 con 0x7f21100cb970 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.128+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2104011a20 con 0x7f21100cb970 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.128+0000 7f20f7fff700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 0x7f20fc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.128+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2104085d40 con 0x7f21100cb970 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.128+0000 7f210ffff700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 0x7f20fc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:25.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.129+0000 7f210ffff700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 0x7f20fc069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f21100cfcd0 tx=0x7f2100009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:25.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.132+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2104052ba0 con 0x7f21100cb970 2023-10-09T15:37:25.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.371+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f21100b0600 con 0x7f21100cb970 2023-10-09T15:37:25.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.372+0000 7f20f7fff700 1 -- 172.21.15.33:0/3956279577 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2104015070 con 0x7f21100cb970 2023-10-09T15:37:25.373 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:37:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 msgr2=0x7f20fc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 0x7f20fc069740 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f21100cfcd0 tx=0x7f2100009040 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 msgr2=0x7f21100c8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f2104009fb0 tx=0x7f2104017000 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 shutdown_connections 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f20fc067290 0x7f20fc069740 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f211015a400 0x7f211015c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21100cb5a0 0x7f21100b5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 --2- 172.21.15.33:0/3956279577 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21100cb970 0x7f21100c8a30 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 >> 172.21.15.33:0/3956279577 conn(0x7f2110070e30 msgr2=0x7f21100b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 shutdown_connections 2023-10-09T15:37:25.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:25.374+0000 7f21168c8700 1 -- 172.21.15.33:0/3956279577 wait complete. 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:37:25.388 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:25.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.389 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:25.404 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42042sec preferred_lft 42042sec 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.405 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:37:25.406 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.407 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:25.407 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:37:25.407 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:37:25.407 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:25.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.407 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:37:25.467 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:37:25.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.469 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:37:25.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.525 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:37:25.525 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:37:25.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:37:25.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:37:25.526 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:37:25.526 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:37:25.626 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.627 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:37:25.641 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:37:25.641 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:37:25.642 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:25.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:37:25.707 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:25.707 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:25.763 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:25.763 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:25.763 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:25.817 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:37:25.817 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:37:25.817 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:25.898 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:25.898 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:25.898 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:25.906 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:25.906 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:25.906 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:25.906 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:25.906 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:25.928 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:37:25.929 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:37:25.931 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:37:25.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:25.931 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:25.997 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:37:26.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.155+0000 7ff1524ae700 1 Processor -- start 2023-10-09T15:37:26.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.155+0000 7ff1524ae700 1 -- start start 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff1524ae700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff14c0cb5a0 0x7ff14c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff1524ae700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff14c0cd9e0 0x7ff14c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff1524ae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff14c15ae40 con 0x7ff14c15a400 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff1524ae700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c0d13f0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff1524ae700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff14c15ab60 con 0x7ff14c0cb5a0 2023-10-09T15:37:26.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff14b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff14c0cd9e0 0x7ff14c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.156+0000 7ff14b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff14c0cd9e0 0x7ff14c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39288/0 (socket says 172.21.15.33:39288) 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 -- 172.21.15.33:0/3445794834 learned_addr learned my addr 172.21.15.33:0/3445794834 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14bfff700 1 --2- 172.21.15.33:0/3445794834 >> v2:172.21.15.59:3300/0 conn(0x7ff14c0cb5a0 0x7ff14c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 -- 172.21.15.33:0/3445794834 >> v2:172.21.15.59:3300/0 conn(0x7ff14c0cb5a0 msgr2=0x7ff14c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 --2- 172.21.15.33:0/3445794834 >> v2:172.21.15.59:3300/0 conn(0x7ff14c0cb5a0 0x7ff14c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 -- 172.21.15.33:0/3445794834 >> v1:172.21.15.59:6789/0 conn(0x7ff14c15a400 legacy=0x7ff14c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 -- 172.21.15.33:0/3445794834 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff14c0ccf00 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14b7fe700 1 --2- 172.21.15.33:0/3445794834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c159ec0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff1400099b0 tx=0x7ff140009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1be1d1ad9d93048d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14affd700 1 -- 172.21.15.33:0/3445794834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000b820 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14affd700 1 -- 172.21.15.33:0/3445794834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff14000b980 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.157+0000 7ff14affd700 1 -- 172.21.15.33:0/3445794834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff14000bd20 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 -- 172.21.15.33:0/3445794834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 msgr2=0x7ff14c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 --2- 172.21.15.33:0/3445794834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c159ec0 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7ff1400099b0 tx=0x7ff140009250 comp rx=0 tx=0).stop 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 -- 172.21.15.33:0/3445794834 shutdown_connections 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 --2- 172.21.15.33:0/3445794834 >> v2:172.21.15.59:3300/0 conn(0x7ff14c0cb5a0 0x7ff14c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 --2- 172.21.15.33:0/3445794834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c159ec0 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 -- 172.21.15.33:0/3445794834 >> 172.21.15.33:0/3445794834 conn(0x7ff14c070e30 msgr2=0x7ff14c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:26.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 -- 172.21.15.33:0/3445794834 shutdown_connections 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.158+0000 7ff1524ae700 1 -- 172.21.15.33:0/3445794834 wait complete. 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.159+0000 7ff1524ae700 1 Processor -- start 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.159+0000 7ff1524ae700 1 -- start start 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 0x7ff14c150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 0x7ff14c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c151ae0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c15fdd0 con 0x7ff14c15a400 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff1524ae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff14c150aa0 con 0x7ff14c0cb5a0 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39292/0 (socket says 172.21.15.33:39292) 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 -- 172.21.15.33:0/1064582955 learned_addr learned my addr 172.21.15.33:0/1064582955 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:26.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14bfff700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 0x7ff14c150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff150a4b700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 0x7ff14c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 -- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 msgr2=0x7ff14c150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 0x7ff14c150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 -- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 msgr2=0x7ff14c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 0x7ff14c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 -- 172.21.15.33:0/1064582955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1400094f0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14bfff700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 0x7ff14c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff150a4b700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 0x7ff14c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.160+0000 7ff14b7fe700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff1400094c0 tx=0x7ff140017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.161+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140024440 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.161+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1400245c0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.161+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff14c15f1c0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.161+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff140024980 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.161+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff14c15f780 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.162+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff14c04c3c0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.162+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7ff14001a420 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.162+0000 7ff133fff700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 0x7ff138069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.162+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff1400868e0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.163+0000 7ff14bfff700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 0x7ff138069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:26.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.163+0000 7ff14bfff700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 0x7ff138069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:26.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.167+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff140053740 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.409+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff14c0cd1e0 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.410+0000 7ff133fff700 1 -- 172.21.15.33:0/1064582955 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v67) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff140056d60 con 0x7ff14c0cd9e0 2023-10-09T15:37:26.411 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 msgr2=0x7ff138069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 0x7ff138069740 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7ff13c006fd0 tx=0x7ff13c008040 comp rx=0 tx=0).stop 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 msgr2=0x7ff14c15e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7ff1400094c0 tx=0x7ff140017000 comp rx=0 tx=0).stop 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 shutdown_connections 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff138067290 0x7ff138069740 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff14c15a400 0x7ff14c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff14c0cb5a0 0x7ff14c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 --2- 172.21.15.33:0/1064582955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff14c0cd9e0 0x7ff14c15e600 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:26.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 >> 172.21.15.33:0/1064582955 conn(0x7ff14c070e30 msgr2=0x7ff14c0b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:26.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 shutdown_connections 2023-10-09T15:37:26.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:26.412+0000 7ff1524ae700 1 -- 172.21.15.33:0/1064582955 wait complete. 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:37:26.425 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:26.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.426 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:37:26.444 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:26.445 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42049sec preferred_lft 42049sec 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:37:26.446 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:37:26.447 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:26.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.448 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:37:26.514 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:37:26.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.515 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:37:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:37:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:37:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:37:26.574 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:37:26.575 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:37:26.575 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.575 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:37:26.575 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:37:26.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:37:26.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:37:26.575 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:37:26.576 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:37:26.684 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.684 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:37:26.699 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:37:26.699 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:37:26.699 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:26.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.700 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:37:26.765 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:26.766 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:26.821 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:26.821 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:26.821 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:26.876 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:37:26.876 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:37:26.877 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:26.958 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:26.958 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:26.958 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:26.966 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:26.967 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:26.967 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:26.967 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:26.967 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:26.989 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:26.989 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:26.989 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:37:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:37:26.990 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:37:26.991 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:37:26.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:26.991 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:27.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:37:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.189+0000 7f1f9cb88700 1 Processor -- start 2023-10-09T15:37:27.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.189+0000 7f1f9cb88700 1 -- start start 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f9cb88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 0x7f1f9815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f9cb88700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1f98143070 0x7f1f980cbf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f9cb88700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1f9815d8d0 con 0x7f1f98142ca0 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f9cb88700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1f9815d2f0 con 0x7f1f98143070 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f9cb88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980cc630 con 0x7f1f980cb450 2023-10-09T15:37:27.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f977fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1f98142ca0 0x7f1f980cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55912/0 (socket says 172.21.15.33:55912) 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f977fe700 1 -- 172.21.15.33:0/2624551061 learned_addr learned my addr 172.21.15.33:0/2624551061 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f96ffd700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 0x7f1f9815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.190+0000 7f1f97fff700 1 --2- 172.21.15.33:0/2624551061 >> v2:172.21.15.59:3300/0 conn(0x7f1f98143070 0x7f1f980cbf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310699056 0 0) 0x7f1f9815d8d0 con 0x7f1f98142ca0 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1f80003570 con 0x7f1f98142ca0 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f97fff700 1 -- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 msgr2=0x7f1f9815dd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 313212208 0 0) 0x7f1f80003570 con 0x7f1f98142ca0 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f97fff700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 0x7f1f9815dd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f97fff700 1 -- 172.21.15.33:0/2624551061 >> v1:172.21.15.33:6789/0 conn(0x7f1f98142ca0 legacy=0x7f1f980cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f97fff700 1 -- 172.21.15.33:0/2624551061 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f9815d560 con 0x7f1f98143070 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f96ffd700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 0x7f1f9815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:27.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f97fff700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f98143070 0x7f1f980cbf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009e60 tx=0x7f1f90009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cb0a4a92f52b494 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f9000e070 con 0x7f1f98143070 2023-10-09T15:37:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f9000b7a0 con 0x7f1f98143070 2023-10-09T15:37:27.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.191+0000 7f1f967fc700 1 -- 172.21.15.33:0/2624551061 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f88001470 con 0x7f1f98143070 2023-10-09T15:37:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 -- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f98143070 msgr2=0x7f1f980cbf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f98143070 0x7f1f980cbf30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f1f90009e60 tx=0x7f1f90009780 comp rx=0 tx=0).stop 2023-10-09T15:37:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 -- 172.21.15.33:0/2624551061 shutdown_connections 2023-10-09T15:37:27.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f98143070 0x7f1f980cbf30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/2624551061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f980cb450 0x7f1f9815dd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 -- 172.21.15.33:0/2624551061 >> 172.21.15.33:0/2624551061 conn(0x7f1f98067c80 msgr2=0x7f1f98068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 -- 172.21.15.33:0/2624551061 shutdown_connections 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.192+0000 7f1f9cb88700 1 -- 172.21.15.33:0/2624551061 wait complete. 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.193+0000 7f1f9cb88700 1 Processor -- start 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.193+0000 7f1f9cb88700 1 -- start start 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f980cb450 0x7f1f980cac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f98143070 0x7f1f9813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ac740 con 0x7f1f98142ca0 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980ac9e0 con 0x7f1f980cb450 2023-10-09T15:37:27.197 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f9cb88700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1f980accc0 con 0x7f1f98143070 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39308/0 (socket says 172.21.15.33:39308) 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 -- 172.21.15.33:0/1567966882 learned_addr learned my addr 172.21.15.33:0/1567966882 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f977fe700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f980cb450 0x7f1f980cac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f97fff700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f98143070 0x7f1f9813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 -- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f98143070 msgr2=0x7f1f9813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f98143070 0x7f1f9813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 -- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f980cb450 msgr2=0x7f1f980cac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f980cb450 0x7f1f980cac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 -- 172.21.15.33:0/1567966882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f8c009420 con 0x7f1f98142ca0 2023-10-09T15:37:27.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.194+0000 7f1f96ffd700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00ec80 tx=0x7f1f8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.195+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00c920 con 0x7f1f98142ca0 2023-10-09T15:37:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.195+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1f8c00ca80 con 0x7f1f98142ca0 2023-10-09T15:37:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.195+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f90009a20 con 0x7f1f98142ca0 2023-10-09T15:37:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.195+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1f8c00ce00 con 0x7f1f98142ca0 2023-10-09T15:37:27.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.195+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f980ad280 con 0x7f1f98142ca0 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.196+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f9804c3c0 con 0x7f1f98142ca0 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.196+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f1f8c013680 con 0x7f1f98142ca0 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.196+0000 7f1f7f7fe700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 0x7f1f84069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.197+0000 7f1f977fe700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 0x7f1f84069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.197+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1f8c084e50 con 0x7f1f98142ca0 2023-10-09T15:37:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.197+0000 7f1f977fe700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 0x7f1f84069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1f880011e0 tx=0x7f1f88001aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:27.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.201+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1f8c051cb0 con 0x7f1f98142ca0 2023-10-09T15:37:27.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:27.440+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f1f980cb910 con 0x7f1f98142ca0 2023-10-09T15:37:28.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.382+0000 7f1f7f7fe700 1 -- 172.21.15.33:0/1567966882 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v68) v1 ==== 136+0+0 (secure 0 0 0) 0x7f1f8c0552d0 con 0x7f1f98142ca0 2023-10-09T15:37:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 msgr2=0x7f1f84069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 0x7f1f84069740 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f1f880011e0 tx=0x7f1f88001aa0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 msgr2=0x7f1f980ac200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f1f8c00ec80 tx=0x7f1f8c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 shutdown_connections 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1f84067290 0x7f1f84069740 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1f98143070 0x7f1f9813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1f980cb450 0x7f1f980cac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 --2- 172.21.15.33:0/1567966882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1f98142ca0 0x7f1f980ac200 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 >> 172.21.15.33:0/1567966882 conn(0x7f1f98067c80 msgr2=0x7f1f980c4720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 shutdown_connections 2023-10-09T15:37:28.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.385+0000 7f1f9cb88700 1 -- 172.21.15.33:0/1567966882 wait complete. 2023-10-09T15:37:28.401 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:37:28.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.528+0000 7fea7f59e700 1 Processor -- start 2023-10-09T15:37:28.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.528+0000 7fea7f59e700 1 -- start start 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7f59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea800ccac0 0x7fea800cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 0x7fea800a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7f59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea800cb460 con 0x7fea8006c8f0 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7f59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea800cb180 con 0x7fea800ccac0 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea8015db00 con 0x7fea800cbe30 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea800ccac0 0x7fea800cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fea800ccac0 0x7fea800cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39316/0 (socket says 172.21.15.33:39316) 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 -- 172.21.15.33:0/1914441013 learned_addr learned my addr 172.21.15.33:0/1914441013 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7ed9d700 1 --2- 172.21.15.33:0/1914441013 >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 0x7fea800a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 -- 172.21.15.33:0/1914441013 >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 msgr2=0x7fea800a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1914441013 >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 0x7fea800a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 -- 172.21.15.33:0/1914441013 >> v1:172.21.15.33:6789/0 conn(0x7fea8006c8f0 legacy=0x7fea8015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7dd9b700 1 -- 172.21.15.33:0/1914441013 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea8015dde0 con 0x7fea800ccac0 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.529+0000 7fea7ed9d700 1 --2- 172.21.15.33:0/1914441013 >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 0x7fea800a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1914441013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea800ccac0 0x7fea800cb8f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fea8015d1e0 tx=0x7fea74009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9ef29fbc1b7844 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7d59a700 1 -- 172.21.15.33:0/1914441013 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400b860 con 0x7fea800ccac0 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7d59a700 1 -- 172.21.15.33:0/1914441013 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea7400b9c0 con 0x7fea800ccac0 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7d59a700 1 -- 172.21.15.33:0/1914441013 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea7400bd60 con 0x7fea800ccac0 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 -- 172.21.15.33:0/1914441013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea800ccac0 msgr2=0x7fea800cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1914441013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea800ccac0 0x7fea800cb8f0 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7fea8015d1e0 tx=0x7fea74009250 comp rx=0 tx=0).stop 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 -- 172.21.15.33:0/1914441013 shutdown_connections 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1914441013 >> v2:172.21.15.59:3300/0 conn(0x7fea800cbe30 0x7fea800a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1914441013 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea800ccac0 0x7fea800cb8f0 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 -- 172.21.15.33:0/1914441013 >> 172.21.15.33:0/1914441013 conn(0x7fea8006e280 msgr2=0x7fea800cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 -- 172.21.15.33:0/1914441013 shutdown_connections 2023-10-09T15:37:28.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.530+0000 7fea7f59e700 1 -- 172.21.15.33:0/1914441013 wait complete. 2023-10-09T15:37:28.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.531+0000 7fea7f59e700 1 Processor -- start 2023-10-09T15:37:28.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 -- start start 2023-10-09T15:37:28.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 0x7fea800acb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 0x7fea800ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea800ad070 con 0x7fea8006c8f0 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea800ad310 con 0x7fea800ccac0 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea800ad5f0 con 0x7fea800cbe30 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39318/0 (socket says 172.21.15.33:39318) 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.532+0000 7fea7e59c700 1 -- 172.21.15.33:0/1922422151 learned_addr learned my addr 172.21.15.33:0/1922422151 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7ed9d700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 0x7fea800ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 0x7fea800acb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 -- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 msgr2=0x7fea800acb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 0x7fea800acb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 -- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 msgr2=0x7fea800ae3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 0x7fea800ae3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 -- 172.21.15.33:0/1922422151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea740094f0 con 0x7fea8006c8f0 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 0x7fea800acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7ed9d700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 0x7fea800ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:28.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7e59c700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c590 tx=0x7fea7000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011590 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea700116f0 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea800ad8d0 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea70011ab0 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.533+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea800ade90 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.535+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fea7001b3b0 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.535+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea8004c3c0 con 0x7fea8006c8f0 2023-10-09T15:37:28.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.535+0000 7fea6e7fc700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 0x7fea60069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.535+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fea70084020 con 0x7fea8006c8f0 2023-10-09T15:37:28.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.535+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 0x7fea60069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.536+0000 7fea7dd9b700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 0x7fea60069740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fea8015d1e0 tx=0x7fea74017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.539+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fea70050e80 con 0x7fea8006c8f0 2023-10-09T15:37:28.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.762+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fea8015e0c0 con 0x7fea60067290 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.763+0000 7fea6e7fc700 1 -- 172.21.15.33:0/1922422151 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fea8015e0c0 con 0x7fea60067290 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:28.764 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:37:28.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 msgr2=0x7fea60069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 0x7fea60069740 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fea8015d1e0 tx=0x7fea74017000 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 msgr2=0x7fea800c6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7fea7000c590 tx=0x7fea7000c950 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 shutdown_connections 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fea60067290 0x7fea60069740 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fea8006c8f0 0x7fea800c6a40 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fea800ccac0 0x7fea800ae3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 --2- 172.21.15.33:0/1922422151 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fea800cbe30 0x7fea800acb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 >> 172.21.15.33:0/1922422151 conn(0x7fea8006e280 msgr2=0x7fea800a9b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 shutdown_connections 2023-10-09T15:37:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.765+0000 7fea7f59e700 1 -- 172.21.15.33:0/1922422151 wait complete. 2023-10-09T15:37:28.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:37:28.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.898+0000 7f280f4f3700 1 Processor -- start 2023-10-09T15:37:28.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.899+0000 7f280f4f3700 1 -- start start 2023-10-09T15:37:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.899+0000 7f280f4f3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f28080c4580 0x7f28080cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.899+0000 7f280f4f3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080c9310 con 0x7f28081598c0 2023-10-09T15:37:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.899+0000 7f280f4f3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28080ce090 con 0x7f2808159c90 2023-10-09T15:37:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280f4f3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28080ad990 con 0x7f28080c4580 2023-10-09T15:37:28.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280d28f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f28081598c0 0x7f28080c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55920/0 (socket says 172.21.15.33:55920) 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280d28f700 1 -- 172.21.15.33:0/2629421044 learned_addr learned my addr 172.21.15.33:0/2629421044 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280ca8e700 1 --2- 172.21.15.33:0/2629421044 >> v2:172.21.15.33:3300/0 conn(0x7f28080c4580 0x7f28080cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f2807fff700 1 -- 172.21.15.33:0/2629421044 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2602184859 0 0) 0x7f28080c9310 con 0x7f28081598c0 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f2807fff700 1 -- 172.21.15.33:0/2629421044 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f27f0003570 con 0x7f28081598c0 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280ca8e700 1 -- 172.21.15.33:0/2629421044 >> v1:172.21.15.59:6789/0 conn(0x7f2808159c90 legacy=0x7f28080c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280ca8e700 1 -- 172.21.15.33:0/2629421044 >> v1:172.21.15.33:6789/0 conn(0x7f28081598c0 legacy=0x7f28080c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280ca8e700 1 -- 172.21.15.33:0/2629421044 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28080c8cc0 con 0x7f28080c4580 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f280ca8e700 1 --2- 172.21.15.33:0/2629421044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080cd460 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098e0 tx=0x7f27fc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0294ab94d2fec22 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f2807fff700 1 -- 172.21.15.33:0/2629421044 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00b640 con 0x7f28080c4580 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f2807fff700 1 -- 172.21.15.33:0/2629421044 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27fc00b7a0 con 0x7f28080c4580 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.900+0000 7f2807fff700 1 -- 172.21.15.33:0/2629421044 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27fc00bb40 con 0x7f28080c4580 2023-10-09T15:37:28.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 -- 172.21.15.33:0/2629421044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 msgr2=0x7f28080cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 --2- 172.21.15.33:0/2629421044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080cd460 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7f27fc0098e0 tx=0x7f27fc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 -- 172.21.15.33:0/2629421044 shutdown_connections 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 --2- 172.21.15.33:0/2629421044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080cd460 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 -- 172.21.15.33:0/2629421044 >> 172.21.15.33:0/2629421044 conn(0x7f2808088000 msgr2=0x7f28080883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 -- 172.21.15.33:0/2629421044 shutdown_connections 2023-10-09T15:37:28.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.901+0000 7f280f4f3700 1 -- 172.21.15.33:0/2629421044 wait complete. 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.902+0000 7f280f4f3700 1 Processor -- start 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.902+0000 7f280f4f3700 1 -- start start 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28081598c0 0x7f28080b2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2808159c90 0x7f280806e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b35e0 con 0x7f28080c4580 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b38c0 con 0x7f28081598c0 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280f4f3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28080b3ba0 con 0x7f2808159c90 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39326/0 (socket says 172.21.15.33:39326) 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 -- 172.21.15.33:0/4018381439 learned_addr learned my addr 172.21.15.33:0/4018381439 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 -- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2808159c90 msgr2=0x7f280806e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2808159c90 0x7f280806e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 -- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28081598c0 msgr2=0x7f28080b2d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28081598c0 0x7f28080b2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.903+0000 7f280d28f700 1 -- 172.21.15.33:0/4018381439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27fc009420 con 0x7f28080c4580 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f280d28f700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f280000cd30 tx=0x7f2800001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f280000ab70 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f280000acf0 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28080b3e80 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2800007340 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.904+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28080c5a90 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.905+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f280804c3c0 con 0x7f28080c4580 2023-10-09T15:37:28.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.905+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f2800007770 con 0x7f28080c4580 2023-10-09T15:37:28.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.906+0000 7f28057fa700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 0x7f27f4069770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:28.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.906+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2800085050 con 0x7f28080c4580 2023-10-09T15:37:28.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.906+0000 7f280ca8e700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 0x7f27f4069770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:28.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.906+0000 7f280ca8e700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 0x7f27f4069770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f28080c4980 tx=0x7f27fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:28.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:28.910+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2800051e30 con 0x7f28080c4580 2023-10-09T15:37:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.104+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f28080b2b00 con 0x7f28080c4580 2023-10-09T15:37:29.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.104+0000 7f28057fa700 1 -- 172.21.15.33:0/4018381439 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7f280000ae60 con 0x7f28080c4580 2023-10-09T15:37:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 msgr2=0x7f27f4069770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 0x7f27f4069770 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f28080c4980 tx=0x7f27fc017000 comp rx=0 tx=0).stop 2023-10-09T15:37:29.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 msgr2=0x7f28080c6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7f280000cd30 tx=0x7f2800001b10 comp rx=0 tx=0).stop 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 shutdown_connections 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f27f40672c0 0x7f27f4069770 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f28080c4580 0x7f28080c6d50 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2808159c90 0x7f280806e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 --2- 172.21.15.33:0/4018381439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f28081598c0 0x7f28080b2d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 >> 172.21.15.33:0/4018381439 conn(0x7f2808088000 msgr2=0x7f2808067ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 shutdown_connections 2023-10-09T15:37:29.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.106+0000 7f280f4f3700 1 -- 172.21.15.33:0/4018381439 wait complete. 2023-10-09T15:37:29.119 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume info cephfs 2023-10-09T15:37:29.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.239+0000 7f61f0bc1700 1 Processor -- start 2023-10-09T15:37:29.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.239+0000 7f61f0bc1700 1 -- start start 2023-10-09T15:37:29.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61f0bc1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61ec06dc70 0x7f61ec159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61f0bc1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec0ccfd0 con 0x7f61ec06e0e0 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61f0bc1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61ec15a3d0 con 0x7f61ec159530 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61f0bc1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61ec15a6b0 con 0x7f61ec06dc70 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61ead9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f61ec06e0e0 0x7f61ec0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55930/0 (socket says 172.21.15.33:55930) 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61ead9d700 1 -- 172.21.15.33:0/2901033487 learned_addr learned my addr 172.21.15.33:0/2901033487 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2901033487 >> v2:172.21.15.59:3300/0 conn(0x7f61ec06dc70 0x7f61ec159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727319066 0 0) 0x7f61ec0ccfd0 con 0x7f61ec06e0e0 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.240+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f61d8003570 con 0x7f61ec06e0e0 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1030511078 0 0) 0x7f61d8003570 con 0x7f61ec06e0e0 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 >> v2:172.21.15.59:3300/0 conn(0x7f61ec06dc70 msgr2=0x7f61ec159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 --2- 172.21.15.33:0/2901033487 >> v2:172.21.15.59:3300/0 conn(0x7f61ec06dc70 0x7f61ec159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 >> v1:172.21.15.59:6789/0 conn(0x7f61ec159530 legacy=0x7f61ec0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec15a990 con 0x7f61ec06e0e0 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f61dc001470 con 0x7f61ec06e0e0 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 >> v1:172.21.15.33:6789/0 conn(0x7f61ec06e0e0 legacy=0x7f61ec0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61d8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d8004810 0x7f61d8004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80051c0 0x7f61d800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec15a6b0 con 0x7f61d8003a60 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61d800c0d0 con 0x7f61d8004810 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61d800c290 con 0x7f61d80051c0 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61d8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d8004810 0x7f61d8004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ead9d700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80051c0 0x7f61d800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 -- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80051c0 msgr2=0x7f61d800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61d80051c0 0x7f61d800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 -- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d8004810 msgr2=0x7f61d8004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61d8004810 0x7f61d8004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 -- 172.21.15.33:0/2901033487 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61d8003570 con 0x7f61d8003a60 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ead9d700 1 -- 172.21.15.33:0/2901033487 reap_dead start 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.241+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61d8003e70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f61e4001fc0 tx=0x7f61e4001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dba3d4465302372 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4001950 con 0x7f61d8003a60 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400c8b0 con 0x7f61d8003a60 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61e959a700 1 -- 172.21.15.33:0/2901033487 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400cc50 con 0x7f61d8003a60 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 msgr2=0x7f61d8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61d8003e70 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f61e4001fc0 tx=0x7f61e4001640 comp rx=0 tx=0).stop 2023-10-09T15:37:29.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2901033487 shutdown_connections 2023-10-09T15:37:29.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2901033487 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61d8003e70 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2901033487 >> 172.21.15.33:0/2901033487 conn(0x7f61ec0703a0 msgr2=0x7f61ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:29.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2901033487 shutdown_connections 2023-10-09T15:37:29.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.242+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2901033487 wait complete. 2023-10-09T15:37:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.243+0000 7f61f0bc1700 1 Processor -- start 2023-10-09T15:37:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.243+0000 7f61f0bc1700 1 -- start start 2023-10-09T15:37:29.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 0x7f61ec15bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 0x7f61ec16ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec15c890 con 0x7f61d8003a60 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0b4520 con 0x7f61ec15c420 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61f0bc1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61ec0b50a0 con 0x7f61ec168e00 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39346/0 (socket says 172.21.15.33:39346) 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 -- 172.21.15.33:0/2859497311 learned_addr learned my addr 172.21.15.33:0/2859497311 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ead9d700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 0x7f61ec16ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 0x7f61ec15bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 -- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 msgr2=0x7f61ec15bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 0x7f61ec15bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 -- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 msgr2=0x7f61ec16ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 0x7f61ec16ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ea59c700 1 -- 172.21.15.33:0/2859497311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61ec0b4770 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61ead9d700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 0x7f61ec16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.244+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 0x7f61ec15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61ea59c700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c6a0 tx=0x7f61e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400ca20 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400cb80 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61ec0b4a50 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e4006df0 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.245+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61ec169270 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.246+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61ec169490 con 0x7f61d8003a60 2023-10-09T15:37:29.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.246+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f61e4019070 con 0x7f61d8003a60 2023-10-09T15:37:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.246+0000 7f61e27fc700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 0x7f61cc069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.247+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f61e4085900 con 0x7f61d8003a60 2023-10-09T15:37:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.247+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 0x7f61cc069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.247+0000 7f61e9d9b700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 0x7f61cc069740 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006d60 tx=0x7f61d4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.251+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61e4052760 con 0x7f61d8003a60 2023-10-09T15:37:29.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.475+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume info", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7f61ec0b5380 con 0x7f61cc067290 2023-10-09T15:37:29.481 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:37:29.480+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:37:29.481 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:37:29.480+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:37:29.481 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:37:29.480+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:37:29.481 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:37:29.480+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:37:29.481 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:37:29.480+0000 7f91f73a0700 -1 client.0 error registering admin socket command: (17) File exists 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.485+0000 7f61e27fc700 1 -- 172.21.15.33:0/2859497311 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+470 (secure 0 0 0) 0x7f61ec0b5380 con 0x7f61cc067290 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: "mon_addrs": [ 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.33:6789", 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6789", 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: "172.21.15.59:6790" 2023-10-09T15:37:29.486 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "pools": { 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "data": [ 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365977763840, 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_data", 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 0 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: ], 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "metadata": [ 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "avail": 365977763840, 2023-10-09T15:37:29.487 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs_metadata", 2023-10-09T15:37:29.488 INFO:teuthology.orchestra.run.smithi033.stdout: "used": 65536 2023-10-09T15:37:29.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:29.488 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:37:29.488 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:29.488 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 msgr2=0x7f61cc069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 0x7f61cc069740 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f61d4006d60 tx=0x7f61d4008040 comp rx=0 tx=0).stop 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 msgr2=0x7f61ec144ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f61e400c6a0 tx=0x7f61e4015000 comp rx=0 tx=0).stop 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 shutdown_connections 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61cc067290 0x7f61cc069740 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61d8003a60 0x7f61ec144ba0 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61ec15c420 0x7f61ec16ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 --2- 172.21.15.33:0/2859497311 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61ec168e00 0x7f61ec15bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 >> 172.21.15.33:0/2859497311 conn(0x7f61ec0703a0 msgr2=0x7f61ec0d0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:29.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 shutdown_connections 2023-10-09T15:37:29.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.487+0000 7f61f0bc1700 1 -- 172.21.15.33:0/2859497311 wait complete. 2023-10-09T15:37:29.500 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:37:29.501 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:29.538 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:29.584 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:37:29.584 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:37:29.584 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:37:29.584 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:29.623 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:37:29.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:29.623 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:37:29.678 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:37:29.678 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:37:29.678 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:29.722 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:37:29.722 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:29.722 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:37:29.779 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:29.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.897+0000 7fa09425a700 1 Processor -- start 2023-10-09T15:37:29.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.897+0000 7fa09425a700 1 -- start start 2023-10-09T15:37:29.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa09425a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa08c0b0910 0x7fa08c1579a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa09425a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c157510 con 0x7fa08c156f50 2023-10-09T15:37:29.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa09425a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08c0ae2f0 con 0x7fa08c155b70 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa09425a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa08c0ae5d0 con 0x7fa08c0b0910 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa08c0b0910 0x7fa08c1579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa08c0b0910 0x7fa08c1579a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39376/0 (socket says 172.21.15.33:39376) 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 -- 172.21.15.33:0/125576858 learned_addr learned my addr 172.21.15.33:0/125576858 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0927f7700 1 --1- 172.21.15.33:0/125576858 >> v1:172.21.15.33:6789/0 conn(0x7fa08c156f50 0x7fa08c157ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55932/0 (socket says 172.21.15.33:55932) 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 -- 172.21.15.33:0/125576858 >> v1:172.21.15.59:6789/0 conn(0x7fa08c155b70 legacy=0x7fa08c0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 -- 172.21.15.33:0/125576858 >> v1:172.21.15.33:6789/0 conn(0x7fa08c156f50 legacy=0x7fa08c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 -- 172.21.15.33:0/125576858 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c0ae8b0 con 0x7fa08c0b0910 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa0917f5700 1 --2- 172.21.15.33:0/125576858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1579a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc50 tx=0x7fa08000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d555e3039e01d4d4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa090ff4700 1 -- 172.21.15.33:0/125576858 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08000be60 con 0x7fa08c0b0910 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa090ff4700 1 -- 172.21.15.33:0/125576858 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa08000de00 con 0x7fa08c0b0910 2023-10-09T15:37:29.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.898+0000 7fa090ff4700 1 -- 172.21.15.33:0/125576858 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0800196b0 con 0x7fa08c0b0910 2023-10-09T15:37:29.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 -- 172.21.15.33:0/125576858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 msgr2=0x7fa08c1579a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 --2- 172.21.15.33:0/125576858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1579a0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc50 tx=0x7fa08000b4f0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 -- 172.21.15.33:0/125576858 shutdown_connections 2023-10-09T15:37:29.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 --2- 172.21.15.33:0/125576858 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1579a0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 -- 172.21.15.33:0/125576858 >> 172.21.15.33:0/125576858 conn(0x7fa08c06d170 msgr2=0x7fa08c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 -- 172.21.15.33:0/125576858 shutdown_connections 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.899+0000 7fa09425a700 1 -- 172.21.15.33:0/125576858 wait complete. 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.900+0000 7fa09425a700 1 Processor -- start 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.900+0000 7fa09425a700 1 -- start start 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 0x7fa08c148b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 0x7fa08c147b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c14afd0 con 0x7fa08c0b0910 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c151380 con 0x7fa08c155b70 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa09425a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c150d30 con 0x7fa08c156f50 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39392/0 (socket says 172.21.15.33:39392) 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 -- 172.21.15.33:0/3111450491 learned_addr learned my addr 172.21.15.33:0/3111450491 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa0927f7700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 0x7fa08c147b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa0917f5700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 0x7fa08c148b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 -- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 msgr2=0x7fa08c147b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 0x7fa08c147b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 -- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 msgr2=0x7fa08c148b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 0x7fa08c148b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 -- 172.21.15.33:0/3111450491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08000b790 con 0x7fa08c0b0910 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa0917f5700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 0x7fa08c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa0927f7700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 0x7fa08c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.901+0000 7fa091ff6700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa08400cb10 tx=0x7fa0840017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.902+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa084006ba0 con 0x7fa08c0b0910 2023-10-09T15:37:29.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.902+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa084006d00 con 0x7fa08c0b0910 2023-10-09T15:37:29.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.902+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa08c14a730 con 0x7fa08c0b0910 2023-10-09T15:37:29.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.902+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa08400a9b0 con 0x7fa08c0b0910 2023-10-09T15:37:29.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.902+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa08c14acf0 con 0x7fa08c0b0910 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.903+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08c04c3c0 con 0x7fa08c0b0910 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.903+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7fa084012420 con 0x7fa08c0b0910 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.904+0000 7fa089ffb700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 0x7fa078069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.904+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa084084940 con 0x7fa08c0b0910 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.904+0000 7fa0917f5700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 0x7fa078069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.904+0000 7fa0917f5700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 0x7fa078069740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc50 tx=0x7fa08001b000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:29.908+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa0840517a0 con 0x7fa08c0b0910 2023-10-09T15:37:30.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.146+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa08c06be60 con 0x7fa08c0b0910 2023-10-09T15:37:30.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.147+0000 7fa089ffb700 1 -- 172.21.15.33:0/3111450491 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fa084016090 con 0x7fa08c0b0910 2023-10-09T15:37:30.148 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:30.148 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:30.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 msgr2=0x7fa078069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 0x7fa078069740 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7fa08000bc50 tx=0x7fa08001b000 comp rx=0 tx=0).stop 2023-10-09T15:37:30.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 msgr2=0x7fa08c1507f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fa08400cb10 tx=0x7fa0840017b0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 shutdown_connections 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa078067290 0x7fa078069740 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c0b0910 0x7fa08c1507f0 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c156f50 0x7fa08c147b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 --2- 172.21.15.33:0/3111450491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c155b70 0x7fa08c148b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 >> 172.21.15.33:0/3111450491 conn(0x7fa08c06d170 msgr2=0x7fa08c153c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 shutdown_connections 2023-10-09T15:37:30.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.149+0000 7fa09425a700 1 -- 172.21.15.33:0/3111450491 wait complete. 2023-10-09T15:37:30.152 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 68 2023-10-09T15:37:30.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:30.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.282+0000 7f95674c3700 1 Processor -- start 2023-10-09T15:37:30.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.282+0000 7f95674c3700 1 -- start start 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f95674c3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95601393f0 0x7f95600cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f95674c3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95600cbb20 0x7f95600c3810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f95674c3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95600c3380 con 0x7f9560138bc0 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f95674c3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95600cbf60 con 0x7f95600cbb20 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f95674c3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f956006e010 con 0x7f95601393f0 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f9565a60700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95600cbb20 0x7f95600c3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f9565a60700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95600cbb20 0x7f95600c3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39404/0 (socket says 172.21.15.33:39404) 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f9565a60700 1 -- 172.21.15.33:0/3419388152 learned_addr learned my addr 172.21.15.33:0/3419388152 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.283+0000 7f9564a5e700 1 --2- 172.21.15.33:0/3419388152 >> v2:172.21.15.59:3300/0 conn(0x7f95601393f0 0x7f95600cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9565a60700 1 -- 172.21.15.33:0/3419388152 >> v2:172.21.15.59:3300/0 conn(0x7f95601393f0 msgr2=0x7f95600cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9565a60700 1 --2- 172.21.15.33:0/3419388152 >> v2:172.21.15.59:3300/0 conn(0x7f95601393f0 0x7f95600cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9565a60700 1 -- 172.21.15.33:0/3419388152 >> v1:172.21.15.59:6789/0 conn(0x7f9560138bc0 legacy=0x7f956006d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9565a60700 1 -- 172.21.15.33:0/3419388152 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95600c2a50 con 0x7f95600cbb20 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9565a60700 1 --2- 172.21.15.33:0/3419388152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95600cbb20 0x7f95600c3810 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f95601597d0 tx=0x7f9558009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99470f322b53a4de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9557fff700 1 -- 172.21.15.33:0/3419388152 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f955800e070 con 0x7f95600cbb20 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9557fff700 1 -- 172.21.15.33:0/3419388152 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f955800ba20 con 0x7f95600cbb20 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f9557fff700 1 -- 172.21.15.33:0/3419388152 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95580092e0 con 0x7f95600cbb20 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f95674c3700 1 -- 172.21.15.33:0/3419388152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95600cbb20 msgr2=0x7f95600c3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.284+0000 7f95674c3700 1 --2- 172.21.15.33:0/3419388152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95600cbb20 0x7f95600c3810 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f95601597d0 tx=0x7f9558009840 comp rx=0 tx=0).stop 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 -- 172.21.15.33:0/3419388152 shutdown_connections 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 --2- 172.21.15.33:0/3419388152 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95600cbb20 0x7f95600c3810 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 --2- 172.21.15.33:0/3419388152 >> v2:172.21.15.59:3300/0 conn(0x7f95601393f0 0x7f95600cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 -- 172.21.15.33:0/3419388152 >> 172.21.15.33:0/3419388152 conn(0x7f95600ccb60 msgr2=0x7f95600ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 -- 172.21.15.33:0/3419388152 shutdown_connections 2023-10-09T15:37:30.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.285+0000 7f95674c3700 1 -- 172.21.15.33:0/3419388152 wait complete. 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.286+0000 7f95674c3700 1 Processor -- start 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.286+0000 7f95674c3700 1 -- start start 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95600cbb20 0x7f9560141060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9560138bc0 0x7f95601583b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956013f130 con 0x7f95601393f0 2023-10-09T15:37:30.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f956013e520 con 0x7f95600cbb20 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f956013e800 con 0x7f9560138bc0 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39414/0 (socket says 172.21.15.33:39414) 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 -- 172.21.15.33:0/2699379809 learned_addr learned my addr 172.21.15.33:0/2699379809 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9564a5e700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9560138bc0 0x7f95601583b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f956525f700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95600cbb20 0x7f9560141060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 -- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9560138bc0 msgr2=0x7f95601583b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9560138bc0 0x7f95601583b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 -- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95600cbb20 msgr2=0x7f9560141060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95600cbb20 0x7f9560141060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 -- 172.21.15.33:0/2699379809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9558009ae0 con 0x7f95601393f0 2023-10-09T15:37:30.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f9565a60700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f95580072f0 tx=0x7f9558018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558008b00 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9558008c60 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f956013eae0 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.287+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9558026460 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.288+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95601415a0 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.288+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f956013f2e0 con 0x7f95601393f0 2023-10-09T15:37:30.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.289+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 11) v1 ==== 85046+0+0 (secure 0 0 0) 0x7f9558003040 con 0x7f95601393f0 2023-10-09T15:37:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.289+0000 7f95557fa700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 0x7f9544069740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.290+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f95580869d0 con 0x7f95601393f0 2023-10-09T15:37:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.290+0000 7f956525f700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 0x7f9544069740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.290+0000 7f956525f700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 0x7f9544069740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f955c003a80 tx=0x7f955c007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.294+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f956013f2e0 con 0x7f95601393f0 2023-10-09T15:37:30.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.395+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9558053ab0 con 0x7f95601393f0 2023-10-09T15:37:30.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.492+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f956004c3c0 con 0x7f95601393f0 2023-10-09T15:37:30.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.493+0000 7f95557fa700 1 -- 172.21.15.33:0/2699379809 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15308 (secure 0 0 0) 0x7f9558056d00 con 0x7f95601393f0 2023-10-09T15:37:30.494 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:30.494 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":101,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:15.262273+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 msgr2=0x7f9544069740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 0x7f9544069740 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f955c003a80 tx=0x7f955c007ec0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 msgr2=0x7f95601588f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f95580072f0 tx=0x7f9558018000 comp rx=0 tx=0).stop 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 shutdown_connections 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9544067290 0x7f9544069740 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95601393f0 0x7f95601588f0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95600cbb20 0x7f9560141060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 --2- 172.21.15.33:0/2699379809 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9560138bc0 0x7f95601583b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 >> 172.21.15.33:0/2699379809 conn(0x7f95600ccb60 msgr2=0x7f956006cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 shutdown_connections 2023-10-09T15:37:30.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.495+0000 7f95674c3700 1 -- 172.21.15.33:0/2699379809 wait complete. 2023-10-09T15:37:30.508 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:37:11.324365+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '100', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:37:12.655716+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '101', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:37:30.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:37:30.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.629+0000 7ff7b1fc0700 1 Processor -- start 2023-10-09T15:37:30.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.629+0000 7ff7b1fc0700 1 -- start start 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7b1fc0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff7ac0c4580 0x7ff7ac0cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7b1fc0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac0c9310 con 0x7ff7ac159c90 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7b1fc0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7ac0ce090 con 0x7ff7ac1598c0 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7b1fc0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff7ac0ad990 con 0x7ff7ac0c4580 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7aaffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff7ac0c4580 0x7ff7ac0cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7abfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff7ac159c90 0x7ff7ac0c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55944/0 (socket says 172.21.15.33:55944) 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7abfff700 1 -- 172.21.15.33:0/1609938038 learned_addr learned my addr 172.21.15.33:0/1609938038 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:30.633 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.630+0000 7ff7aaffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff7ac0c4580 0x7ff7ac0cd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39426/0 (socket says 172.21.15.33:39426) 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aaffd700 1 -- 172.21.15.33:0/1609938038 >> v1:172.21.15.59:6789/0 conn(0x7ff7ac1598c0 legacy=0x7ff7ac0c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aaffd700 1 -- 172.21.15.33:0/1609938038 >> v1:172.21.15.33:6789/0 conn(0x7ff7ac159c90 legacy=0x7ff7ac0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aaffd700 1 -- 172.21.15.33:0/1609938038 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7ac0c8cc0 con 0x7ff7ac0c4580 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aaffd700 1 --2- 172.21.15.33:0/1609938038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0cd460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00098e0 tx=0x7ff7a00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ec75970a86eee6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aa7fc700 1 -- 172.21.15.33:0/1609938038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a0009e80 con 0x7ff7ac0c4580 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aa7fc700 1 -- 172.21.15.33:0/1609938038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a000b860 con 0x7ff7ac0c4580 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7aa7fc700 1 -- 172.21.15.33:0/1609938038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a000bbe0 con 0x7ff7ac0c4580 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.631+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/1609938038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac0c4580 msgr2=0x7ff7ac0cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/1609938038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0cd460 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7ff7a00098e0 tx=0x7ff7a00091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/1609938038 shutdown_connections 2023-10-09T15:37:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/1609938038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0cd460 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/1609938038 >> 172.21.15.33:0/1609938038 conn(0x7ff7ac088000 msgr2=0x7ff7ac0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/1609938038 shutdown_connections 2023-10-09T15:37:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.632+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/1609938038 wait complete. 2023-10-09T15:37:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.633+0000 7ff7b1fc0700 1 Processor -- start 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.633+0000 7ff7b1fc0700 1 -- start start 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ac1598c0 0x7ff7ac0ac290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0b1c10 con 0x7ff7ac159c90 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0b1ef0 con 0x7ff7ac0c4580 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac0b21d0 con 0x7ff7ac1598c0 2023-10-09T15:37:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58662/0 (socket says 172.21.15.33:58662) 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 -- 172.21.15.33:0/2494139761 learned_addr learned my addr 172.21.15.33:0/2494139761 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7aaffd700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ac1598c0 0x7ff7ac0ac290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7ab7fe700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 -- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ac1598c0 msgr2=0x7ff7ac0ac290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ac1598c0 0x7ff7ac0ac290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 -- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 msgr2=0x7ff7ac0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 -- 172.21.15.33:0/2494139761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a0009420 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7ab7fe700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7abfff700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400cbc0 tx=0x7ff7a40019c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400a940 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7a400aaa0 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac0b24b0 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7a400ae20 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.634+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac0b17e0 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.635+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac0b29d0 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.636+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff7a4007300 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.636+0000 7ff7937fe700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 0x7ff7980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.636+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff7a40850b0 con 0x7ff7ac159c90 2023-10-09T15:37:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.636+0000 7ff7ab7fe700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 0x7ff7980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.637+0000 7ff7ab7fe700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 0x7ff7980697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0c73f0 tx=0x7ff79c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.641+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff7a4051cf0 con 0x7ff7ac159c90 2023-10-09T15:37:30.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.834+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff7ac04c3c0 con 0x7ff7ac159c90 2023-10-09T15:37:30.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.834+0000 7ff7937fe700 1 -- 172.21.15.33:0/2494139761 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v101) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff7a4055310 con 0x7ff7ac159c90 2023-10-09T15:37:30.835 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:37:30.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 msgr2=0x7ff7980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 0x7ff7980697d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7ff7ac0c73f0 tx=0x7ff79c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 msgr2=0x7ff7ac156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7ff7a400cbc0 tx=0x7ff7a40019c0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 shutdown_connections 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff798067320 0x7ff7980697d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff7ac159c90 0x7ff7ac156210 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff7ac0c4580 0x7ff7ac0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 --2- 172.21.15.33:0/2494139761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff7ac1598c0 0x7ff7ac0ac290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 >> 172.21.15.33:0/2494139761 conn(0x7ff7ac088000 msgr2=0x7ff7ac0cad70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 shutdown_connections 2023-10-09T15:37:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.836+0000 7ff7b1fc0700 1 -- 172.21.15.33:0/2494139761 wait complete. 2023-10-09T15:37:30.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:37:30.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.970+0000 7f4226bef700 1 Processor -- start 2023-10-09T15:37:30.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.970+0000 7f4226bef700 1 -- start start 2023-10-09T15:37:30.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f4226bef700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f42200af0c0 0x7f42200af920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f4226bef700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f42200c2ac0 0x7f422006d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f4226bef700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42201562a0 con 0x7f422006e9d0 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f4226bef700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200af490 con 0x7f42200c2ac0 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f4226bef700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42200c8050 con 0x7f42200af0c0 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f421ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f42200c2ac0 0x7f422006d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f421ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f42200c2ac0 0x7f422006d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58678/0 (socket says 172.21.15.33:58678) 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.971+0000 7f421ffff700 1 -- 172.21.15.33:0/1930961965 learned_addr learned my addr 172.21.15.33:0/1930961965 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f422498b700 1 --2- 172.21.15.33:0/1930961965 >> v2:172.21.15.59:3300/0 conn(0x7f42200af0c0 0x7f42200af920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421ffff700 1 -- 172.21.15.33:0/1930961965 >> v2:172.21.15.59:3300/0 conn(0x7f42200af0c0 msgr2=0x7f42200af920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:30.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421ffff700 1 --2- 172.21.15.33:0/1930961965 >> v2:172.21.15.59:3300/0 conn(0x7f42200af0c0 0x7f42200af920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421ffff700 1 -- 172.21.15.33:0/1930961965 >> v1:172.21.15.59:6789/0 conn(0x7f422006e9d0 legacy=0x7f42200c84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421ffff700 1 -- 172.21.15.33:0/1930961965 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42200c2f30 con 0x7f42200c2ac0 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421ffff700 1 --2- 172.21.15.33:0/1930961965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200c2ac0 0x7f422006d3e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f42200ca670 tx=0x7f4208009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78876c03a36d0909 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421f7fe700 1 -- 172.21.15.33:0/1930961965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800b820 con 0x7f42200c2ac0 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421f7fe700 1 -- 172.21.15.33:0/1930961965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f420800b980 con 0x7f42200c2ac0 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f421f7fe700 1 -- 172.21.15.33:0/1930961965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420800bd20 con 0x7f42200c2ac0 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f4226bef700 1 -- 172.21.15.33:0/1930961965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200c2ac0 msgr2=0x7f422006d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.972+0000 7f4226bef700 1 --2- 172.21.15.33:0/1930961965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200c2ac0 0x7f422006d3e0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f42200ca670 tx=0x7f4208009250 comp rx=0 tx=0).stop 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 -- 172.21.15.33:0/1930961965 shutdown_connections 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 --2- 172.21.15.33:0/1930961965 >> v2:172.21.15.59:3300/0 conn(0x7f42200af0c0 0x7f42200af920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 --2- 172.21.15.33:0/1930961965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200c2ac0 0x7f422006d3e0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 -- 172.21.15.33:0/1930961965 >> 172.21.15.33:0/1930961965 conn(0x7f42200ccb60 msgr2=0x7f42200ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:30.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 -- 172.21.15.33:0/1930961965 shutdown_connections 2023-10-09T15:37:30.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.973+0000 7f4226bef700 1 -- 172.21.15.33:0/1930961965 wait complete. 2023-10-09T15:37:30.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.974+0000 7f4226bef700 1 Processor -- start 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.974+0000 7f4226bef700 1 -- start start 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422006e9d0 0x7f42200a98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42200c2ac0 0x7f4220169990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4220158300 con 0x7f42200af0c0 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42201576f0 con 0x7f42200c2ac0 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f4226bef700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42201579d0 con 0x7f422006e9d0 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58682/0 (socket says 172.21.15.33:58682) 2023-10-09T15:37:30.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 -- 172.21.15.33:0/2574765965 learned_addr learned my addr 172.21.15.33:0/2574765965 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f422498b700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422006e9d0 0x7f42200a98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f422518c700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42200c2ac0 0x7f4220169990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 -- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422006e9d0 msgr2=0x7f42200a98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422006e9d0 0x7f42200a98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 -- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42200c2ac0 msgr2=0x7f4220169990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42200c2ac0 0x7f4220169990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 -- 172.21.15.33:0/2574765965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42080094f0 con 0x7f42200af0c0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421ffff700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4208003080 tx=0x7f4208016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4208011cc0 con 0x7f42200af0c0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.975+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4208020070 con 0x7f42200af0c0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.976+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4220157cb0 con 0x7f42200af0c0 2023-10-09T15:37:30.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.976+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f420801b6a0 con 0x7f42200af0c0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.976+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42200a9e20 con 0x7f42200af0c0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.976+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42201584b0 con 0x7f42200af0c0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.977+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4208022030 con 0x7f42200af0c0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.977+0000 7f421cff9700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 0x7f42000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.977+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4208086a70 con 0x7f42200af0c0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.977+0000 7f422498b700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 0x7f42000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:30.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.978+0000 7f422498b700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 0x7f42000697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4218007680 tx=0x7f42180098d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:30.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:30.982+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f42201584b0 con 0x7f42200af0c0 2023-10-09T15:37:31.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.174+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4220158670 con 0x7f42200af0c0 2023-10-09T15:37:31.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.175+0000 7f421cff9700 1 -- 172.21.15.33:0/2574765965 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v101) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4208053810 con 0x7f42200af0c0 2023-10-09T15:37:31.176 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:37:31.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 msgr2=0x7f42000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 0x7f42000697d0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f4218007680 tx=0x7f42180098d0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 msgr2=0x7f42200adbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f4208003080 tx=0x7f4208016000 comp rx=0 tx=0).stop 2023-10-09T15:37:31.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 shutdown_connections 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4200067320 0x7f42000697d0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f42200c2ac0 0x7f4220169990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f422006e9d0 0x7f42200a98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 --2- 172.21.15.33:0/2574765965 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f42200af0c0 0x7f42200adbb0 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 >> 172.21.15.33:0/2574765965 conn(0x7f42200ccb60 msgr2=0x7f42200b1c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 shutdown_connections 2023-10-09T15:37:31.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.177+0000 7f4226bef700 1 -- 172.21.15.33:0/2574765965 wait complete. 2023-10-09T15:37:31.190 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:37:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.314+0000 7fafce557700 1 Processor -- start 2023-10-09T15:37:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.314+0000 7fafce557700 1 -- start start 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafce557700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fafc80cc320 0x7fafc813c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafce557700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fafc80cc6f0 0x7fafc813c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafce557700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafc806d7b0 con 0x7fafc8069a00 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafce557700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc806a570 con 0x7fafc80cc6f0 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafce557700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafc806f7d0 con 0x7fafc80cc320 2023-10-09T15:37:31.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafbf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fafc80cc6f0 0x7fafc813c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafbf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fafc80cc6f0 0x7fafc813c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58692/0 (socket says 172.21.15.33:58692) 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafbf7fe700 1 -- 172.21.15.33:0/1242855081 learned_addr learned my addr 172.21.15.33:0/1242855081 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.315+0000 7fafc7fff700 1 --2- 172.21.15.33:0/1242855081 >> v2:172.21.15.59:3300/0 conn(0x7fafc80cc320 0x7fafc813c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafbf7fe700 1 -- 172.21.15.33:0/1242855081 >> v2:172.21.15.59:3300/0 conn(0x7fafc80cc320 msgr2=0x7fafc813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafbf7fe700 1 --2- 172.21.15.33:0/1242855081 >> v2:172.21.15.59:3300/0 conn(0x7fafc80cc320 0x7fafc813c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafbf7fe700 1 -- 172.21.15.33:0/1242855081 >> v1:172.21.15.59:6789/0 conn(0x7fafc8069a00 legacy=0x7fafc8069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafbf7fe700 1 -- 172.21.15.33:0/1242855081 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc806e330 con 0x7fafc80cc6f0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafbf7fe700 1 --2- 172.21.15.33:0/1242855081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc813c7e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fafc80cf510 tx=0x7fafb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f32020e83824483b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafc77fe700 1 -- 172.21.15.33:0/1242855081 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000b820 con 0x7fafc80cc6f0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafc77fe700 1 -- 172.21.15.33:0/1242855081 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb000b980 con 0x7fafc80cc6f0 2023-10-09T15:37:31.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafc77fe700 1 -- 172.21.15.33:0/1242855081 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb000bd20 con 0x7fafc80cc6f0 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafce557700 1 -- 172.21.15.33:0/1242855081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 msgr2=0x7fafc813c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.316+0000 7fafce557700 1 --2- 172.21.15.33:0/1242855081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc813c7e0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7fafc80cf510 tx=0x7fafb0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 -- 172.21.15.33:0/1242855081 shutdown_connections 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 --2- 172.21.15.33:0/1242855081 >> v2:172.21.15.59:3300/0 conn(0x7fafc80cc320 0x7fafc813c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 --2- 172.21.15.33:0/1242855081 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc813c7e0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 -- 172.21.15.33:0/1242855081 >> 172.21.15.33:0/1242855081 conn(0x7fafc8067f00 msgr2=0x7fafc8068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 -- 172.21.15.33:0/1242855081 shutdown_connections 2023-10-09T15:37:31.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.317+0000 7fafce557700 1 -- 172.21.15.33:0/1242855081 wait complete. 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.318+0000 7fafce557700 1 Processor -- start 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.318+0000 7fafce557700 1 -- start start 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.318+0000 7fafce557700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafc8069a00 0x7fafc816a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.318+0000 7fafce557700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc80cc320 0x7fafc813a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.318+0000 7fafce557700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafce557700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc813aea0 con 0x7fafc80cc6f0 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafce557700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafc813b180 con 0x7fafc80cc320 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafce557700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafc813b460 con 0x7fafc8069a00 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58702/0 (socket says 172.21.15.33:58702) 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 -- 172.21.15.33:0/735007660 learned_addr learned my addr 172.21.15.33:0/735007660 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafbf7fe700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc80cc320 0x7fafc813a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafc7fff700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafc8069a00 0x7fafc816a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 -- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafc8069a00 msgr2=0x7fafc816a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafc8069a00 0x7fafc816a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 -- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc80cc320 msgr2=0x7fafc813a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc80cc320 0x7fafc813a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 -- 172.21.15.33:0/735007660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb00094f0 con 0x7fafc80cc6f0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafccaf4700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c8e0 tx=0x7fafc0001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0012630 con 0x7fafc80cc6f0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafc0012790 con 0x7fafc80cc6f0 2023-10-09T15:37:31.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafc813b740 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafc0012b50 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.319+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafc813ab20 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.320+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafc804c3c0 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.321+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fafc001a3a0 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.321+0000 7fafc4ff9700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.321+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fafc0084e80 con 0x7fafc80cc6f0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.321+0000 7fafc7fff700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.322+0000 7fafc7fff700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 0x7fafa80697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fafb8006fd0 tx=0x7fafb8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.326+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fafc0051b10 con 0x7fafc80cc6f0 2023-10-09T15:37:31.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.519+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fafc806da00 con 0x7fafc80cc6f0 2023-10-09T15:37:31.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.520+0000 7fafc4ff9700 1 -- 172.21.15.33:0/735007660 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v101) v1 ==== 100+0+11 (secure 0 0 0) 0x7fafc0055130 con 0x7fafc80cc6f0 2023-10-09T15:37:31.521 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:37:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 msgr2=0x7fafa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 0x7fafa80697d0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fafb8006fd0 tx=0x7fafb8008040 comp rx=0 tx=0).stop 2023-10-09T15:37:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 msgr2=0x7fafc80c4350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7fafc000c8e0 tx=0x7fafc0001710 comp rx=0 tx=0).stop 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 shutdown_connections 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fafa8067320 0x7fafa80697d0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fafc80cc6f0 0x7fafc80c4350 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fafc8069a00 0x7fafc816a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 --2- 172.21.15.33:0/735007660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fafc80cc320 0x7fafc813a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 >> 172.21.15.33:0/735007660 conn(0x7fafc8067f00 msgr2=0x7fafc80b2330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 shutdown_connections 2023-10-09T15:37:31.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.522+0000 7fafce557700 1 -- 172.21.15.33:0/735007660 wait complete. 2023-10-09T15:37:31.535 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.653+0000 7f2f27e53700 1 Processor -- start 2023-10-09T15:37:31.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f27e53700 1 -- start start 2023-10-09T15:37:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f27e53700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f200cb5a0 0x7f2f200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f27e53700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2015ae40 con 0x7f2f2015a5d0 2023-10-09T15:37:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f27e53700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f2015ab60 con 0x7f2f200cd9e0 2023-10-09T15:37:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f27e53700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f200d13f0 con 0x7f2f200cb5a0 2023-10-09T15:37:31.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f25bef700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f200cb5a0 0x7f2f200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f25bef700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f200cb5a0 0x7f2f200cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58710/0 (socket says 172.21.15.33:58710) 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.654+0000 7f2f263f0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2f2015a5d0 0x7f2f20156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56728/0 (socket says 172.21.15.33:56728) 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f25bef700 1 -- 172.21.15.33:0/2586980631 learned_addr learned my addr 172.21.15.33:0/2586980631 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f25bef700 1 -- 172.21.15.33:0/2586980631 >> v1:172.21.15.59:6789/0 conn(0x7f2f200cd9e0 legacy=0x7f2f20159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f25bef700 1 -- 172.21.15.33:0/2586980631 >> v1:172.21.15.33:6789/0 conn(0x7f2f2015a5d0 legacy=0x7f2f20156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f25bef700 1 -- 172.21.15.33:0/2586980631 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f200ccf00 con 0x7f2f200cb5a0 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f25bef700 1 --2- 172.21.15.33:0/2586980631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f200cb5a0 0x7f2f200cb970 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0099e0 tx=0x7f2f1c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a9d325f425e112 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f24bed700 1 -- 172.21.15.33:0/2586980631 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00b7e0 con 0x7f2f200cb5a0 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f24bed700 1 -- 172.21.15.33:0/2586980631 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f1c00b940 con 0x7f2f200cb5a0 2023-10-09T15:37:31.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.655+0000 7f2f24bed700 1 -- 172.21.15.33:0/2586980631 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00bce0 con 0x7f2f200cb5a0 2023-10-09T15:37:31.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 -- 172.21.15.33:0/2586980631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f200cb5a0 msgr2=0x7f2f200cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 --2- 172.21.15.33:0/2586980631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f200cb5a0 0x7f2f200cb970 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0099e0 tx=0x7f2f1c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 -- 172.21.15.33:0/2586980631 shutdown_connections 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 --2- 172.21.15.33:0/2586980631 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f200cb5a0 0x7f2f200cb970 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 -- 172.21.15.33:0/2586980631 >> 172.21.15.33:0/2586980631 conn(0x7f2f20070e30 msgr2=0x7f2f200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 -- 172.21.15.33:0/2586980631 shutdown_connections 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.656+0000 7f2f27e53700 1 -- 172.21.15.33:0/2586980631 wait complete. 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.657+0000 7f2f27e53700 1 Processor -- start 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.657+0000 7f2f27e53700 1 -- start start 2023-10-09T15:37:31.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f200cb5a0 0x7f2f200b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 0x7f2f2016c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f20156f40 con 0x7f2f2015a5d0 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200b43b0 con 0x7f2f200cb5a0 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f200b4e60 con 0x7f2f200cd9e0 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58718/0 (socket says 172.21.15.33:58718) 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 -- 172.21.15.33:0/335481469 learned_addr learned my addr 172.21.15.33:0/335481469 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:31.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f253ee700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 0x7f2f2016c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f25bef700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f200cb5a0 0x7f2f200b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 -- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 msgr2=0x7f2f2016c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 0x7f2f2016c9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 -- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f200cb5a0 msgr2=0x7f2f200b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f200cb5a0 0x7f2f200b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 -- 172.21.15.33:0/335481469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f1c0094f0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f253ee700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 0x7f2f2016c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f263f0700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800cc70 tx=0x7f2f18001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004bb0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f18004d30 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f200b45c0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.658+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f18004ea0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.659+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f200b4b80 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.660+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f2004c3c0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.660+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f180070f0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.660+0000 7f2f15ffb700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 0x7f2f040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.660+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2f18084650 con 0x7f2f2015a5d0 2023-10-09T15:37:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.660+0000 7f2f25bef700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 0x7f2f040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:31.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.661+0000 7f2f25bef700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 0x7f2f040697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0099e0 tx=0x7f2f1c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:31.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.665+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f18051360 con 0x7f2f2015a5d0 2023-10-09T15:37:31.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.905+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2f200cd1e0 con 0x7f2f2015a5d0 2023-10-09T15:37:31.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.906+0000 7f2f15ffb700 1 -- 172.21.15.33:0/335481469 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f2f18054980 con 0x7f2f2015a5d0 2023-10-09T15:37:31.907 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:31.907 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 msgr2=0x7f2f040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 0x7f2f040697d0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0099e0 tx=0x7f2f1c016000 comp rx=0 tx=0).stop 2023-10-09T15:37:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 msgr2=0x7f2f2016cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:31.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f2f1800cc70 tx=0x7f2f18001a70 comp rx=0 tx=0).stop 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 shutdown_connections 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f04067320 0x7f2f040697d0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f2015a5d0 0x7f2f2016cf30 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f200cb5a0 0x7f2f200b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 --2- 172.21.15.33:0/335481469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f200cd9e0 0x7f2f2016c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 >> 172.21.15.33:0/335481469 conn(0x7f2f20070e30 msgr2=0x7f2f200b1c50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 shutdown_connections 2023-10-09T15:37:31.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:31.908+0000 7f2f27e53700 1 -- 172.21.15.33:0/335481469 wait complete. 2023-10-09T15:37:31.911 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 68 2023-10-09T15:37:31.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:32.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.039+0000 7ff9b7364700 1 Processor -- start 2023-10-09T15:37:32.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.039+0000 7ff9b7364700 1 -- start start 2023-10-09T15:37:32.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b7364700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9b015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b7364700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9b015de50 0x7ff9b00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b7364700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b015afd0 con 0x7ff9b00cef40 2023-10-09T15:37:32.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b7364700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b015b2b0 con 0x7ff9b015de50 2023-10-09T15:37:32.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b7364700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b015b590 con 0x7ff9b0153c30 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b6b63700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff9b00cef40 0x7ff9b006d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56744/0 (socket says 172.21.15.33:56744) 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b6b63700 1 -- 172.21.15.33:0/2692502626 learned_addr learned my addr 172.21.15.33:0/2692502626 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b6362700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9b015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b5b61700 1 --2- 172.21.15.33:0/2692502626 >> v2:172.21.15.59:3300/0 conn(0x7ff9b015de50 0x7ff9b00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2489012750 0 0) 0x7ff9b015afd0 con 0x7ff9b00cef40 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.040+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff998003570 con 0x7ff9b00cef40 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 892130624 0 0) 0x7ff998003570 con 0x7ff9b00cef40 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 msgr2=0x7ff9b015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9b015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 >> v2:172.21.15.59:3300/0 conn(0x7ff9b015de50 msgr2=0x7ff9b00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 --2- 172.21.15.33:0/2692502626 >> v2:172.21.15.59:3300/0 conn(0x7ff9b015de50 0x7ff9b00cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b015b870 con 0x7ff9b00cef40 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7ff9a8001470 con 0x7ff9b00cef40 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 >> v1:172.21.15.33:6789/0 conn(0x7ff9b00cef40 legacy=0x7ff9b006d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff998003a60 0x7ff998003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9980051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b015b2b0 con 0x7ff998003a60 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b015b590 con 0x7ff998004810 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff99800ba60 con 0x7ff9b0153c30 2023-10-09T15:37:32.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff998003a60 0x7ff998003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6b63700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9980051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5b61700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 -- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 msgr2=0x7ff9980051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b0153c30 0x7ff9980051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 -- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff998004810 msgr2=0x7ff998004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff998004810 0x7ff998004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 -- 172.21.15.33:0/2692502626 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff998003570 con 0x7ff998003a60 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b6362700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff998003a60 0x7ff998003e70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000e240 tx=0x7ff9a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcdbe6061e49a6e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000eaf0 con 0x7ff998003a60 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a000f040 con 0x7ff998003a60 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.041+0000 7ff9b5360700 1 -- 172.21.15.33:0/2692502626 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a000eea0 con 0x7ff998003a60 2023-10-09T15:37:32.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 -- 172.21.15.33:0/2692502626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff998003a60 msgr2=0x7ff998003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 --2- 172.21.15.33:0/2692502626 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff998003a60 0x7ff998003e70 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff9a000e240 tx=0x7ff9a000b040 comp rx=0 tx=0).stop 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b6b63700 1 -- 172.21.15.33:0/2692502626 reap_dead start 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 -- 172.21.15.33:0/2692502626 shutdown_connections 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 -- 172.21.15.33:0/2692502626 >> 172.21.15.33:0/2692502626 conn(0x7ff9b00703a0 msgr2=0x7ff9b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 -- 172.21.15.33:0/2692502626 shutdown_connections 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.042+0000 7ff9b7364700 1 -- 172.21.15.33:0/2692502626 wait complete. 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.043+0000 7ff9b7364700 1 Processor -- start 2023-10-09T15:37:32.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.043+0000 7ff9b7364700 1 -- start start 2023-10-09T15:37:32.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff998003a60 0x7ff9b0144c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 0x7ff9b00b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00b4850 con 0x7ff9b00b5c40 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b0141450 con 0x7ff9b00b4ce0 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b7364700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b00b3c40 con 0x7ff998003a60 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58738/0 (socket says 172.21.15.33:58738) 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 -- 172.21.15.33:0/3594135637 learned_addr learned my addr 172.21.15.33:0/3594135637 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b6362700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff998003a60 0x7ff9b0144c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b6b63700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 0x7ff9b00b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 -- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff998003a60 msgr2=0x7ff9b0144c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff998003a60 0x7ff9b0144c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 -- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 msgr2=0x7ff9b00b5160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 0x7ff9b00b5160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 -- 172.21.15.33:0/3594135637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b00b3f20 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b6b63700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 0x7ff9b00b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.044+0000 7ff9b5b61700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4011d40 tx=0x7ff9a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.045+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a400fac0 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.045+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9a400fc20 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.045+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b00b4200 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.045+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9a4014440 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.045+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b00b3810 con 0x7ff9b00b5c40 2023-10-09T15:37:32.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.046+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b00b46a0 con 0x7ff9b00b5c40 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.046+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9a4014870 con 0x7ff9b00b5c40 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.046+0000 7ff9ae7fc700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 0x7ff99c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.047+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9a4018030 con 0x7ff9b00b5c40 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.047+0000 7ff9b6362700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 0x7ff99c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.047+0000 7ff9b6362700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 0x7ff99c0697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00094a0 tx=0x7ff9a001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.051+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9a4052410 con 0x7ff9b00b5c40 2023-10-09T15:37:32.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.246+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9b004c3c0 con 0x7ff9b00b5c40 2023-10-09T15:37:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.247+0000 7ff9ae7fc700 1 -- 172.21.15.33:0/3594135637 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15308 (secure 0 0 0) 0x7ff9a4055a30 con 0x7ff9b00b5c40 2023-10-09T15:37:32.248 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:32.248 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":101,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:15.262273+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 msgr2=0x7ff99c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 0x7ff99c0697d0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7ff9a00094a0 tx=0x7ff9a001a000 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 msgr2=0x7ff9b00b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff9a4011d40 tx=0x7ff9a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 shutdown_connections 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff99c067320 0x7ff99c0697d0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b00b4ce0 0x7ff9b00b5160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff998003a60 0x7ff9b0144c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 --2- 172.21.15.33:0/3594135637 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b00b5c40 0x7ff9b00b32d0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 >> 172.21.15.33:0/3594135637 conn(0x7ff9b00703a0 msgr2=0x7ff9b00c69d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 shutdown_connections 2023-10-09T15:37:32.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.249+0000 7ff9b7364700 1 -- 172.21.15.33:0/3594135637 wait complete. 2023-10-09T15:37:32.263 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:37:32.263 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:32.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.381+0000 7f19d2d51700 1 Processor -- start 2023-10-09T15:37:32.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.381+0000 7f19d2d51700 1 -- start start 2023-10-09T15:37:32.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d2d51700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19cc0cb970 0x7f19cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d2d51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc15a400 0x7f19cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d2d51700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19cc15ae40 con 0x7f19cc0cb5a0 2023-10-09T15:37:32.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d2d51700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19cc0ce0f0 con 0x7f19cc0cb970 2023-10-09T15:37:32.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d2d51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0d13f0 con 0x7f19cc15a400 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19cc0cb970 0x7f19cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f19cc0cb970 0x7f19cc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58746/0 (socket says 172.21.15.33:58746) 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 -- 172.21.15.33:0/935254834 learned_addr learned my addr 172.21.15.33:0/935254834 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19d12ee700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc15a400 0x7f19cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 -- 172.21.15.33:0/935254834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc15a400 msgr2=0x7f19cc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc15a400 0x7f19cc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 -- 172.21.15.33:0/935254834 >> v1:172.21.15.59:6789/0 conn(0x7f19cc0cb5a0 legacy=0x7f19cc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 -- 172.21.15.33:0/935254834 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19cc15ab60 con 0x7f19cc0cb970 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.382+0000 7f19cbfff700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc0cb970 0x7f19cc159ec0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009f20 tx=0x7f19bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3194014f11aae18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19cb7fe700 1 -- 172.21.15.33:0/935254834 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc00e070 con 0x7f19cc0cb970 2023-10-09T15:37:32.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19cb7fe700 1 -- 172.21.15.33:0/935254834 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19bc00ba40 con 0x7f19cc0cb970 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19cb7fe700 1 -- 172.21.15.33:0/935254834 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19bc0092e0 con 0x7f19cc0cb970 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 -- 172.21.15.33:0/935254834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc0cb970 msgr2=0x7f19cc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc0cb970 0x7f19cc159ec0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f19bc009f20 tx=0x7f19bc009840 comp rx=0 tx=0).stop 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 -- 172.21.15.33:0/935254834 shutdown_connections 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc15a400 0x7f19cc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 --2- 172.21.15.33:0/935254834 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc0cb970 0x7f19cc159ec0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 -- 172.21.15.33:0/935254834 >> 172.21.15.33:0/935254834 conn(0x7f19cc070e30 msgr2=0x7f19cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 -- 172.21.15.33:0/935254834 shutdown_connections 2023-10-09T15:37:32.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.383+0000 7f19d2d51700 1 -- 172.21.15.33:0/935254834 wait complete. 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.384+0000 7f19d2d51700 1 Processor -- start 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.384+0000 7f19d2d51700 1 -- start start 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc0cb5a0 0x7f19cc168ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19cc0cb970 0x7f19cc0b3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc15b200 con 0x7f19cc15a400 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc169430 con 0x7f19cc0cb970 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d2d51700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19cc0b4810 con 0x7f19cc0cb5a0 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d12ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d12ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58760/0 (socket says 172.21.15.33:58760) 2023-10-09T15:37:32.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d12ee700 1 -- 172.21.15.33:0/4106453344 learned_addr learned my addr 172.21.15.33:0/4106453344 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19cbfff700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19cc0cb970 0x7f19cc0b3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.385+0000 7f19d0aed700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc0cb5a0 0x7f19cc168ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 -- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc0cb5a0 msgr2=0x7f19cc168ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc0cb5a0 0x7f19cc168ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 -- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19cc0cb970 msgr2=0x7f19cc0b3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19cc0cb970 0x7f19cc0b3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 -- 172.21.15.33:0/4106453344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19bc009ae0 con 0x7f19cc15a400 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d12ee700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f19c400d860 tx=0x7f19c4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c40125f0 con 0x7f19cc15a400 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19c4012790 con 0x7f19cc15a400 2023-10-09T15:37:32.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19cc0b4af0 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19c4012b50 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.386+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19cc0b50b0 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.387+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19cc15b370 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.387+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f19c4013480 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.388+0000 7f19c8ff9700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 0x7f19ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.388+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f19c4084fd0 con 0x7f19cc15a400 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.388+0000 7f19d0aed700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 0x7f19ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.388+0000 7f19d0aed700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 0x7f19ac0697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f19b4003a30 tx=0x7f19b4007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.392+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f19c4051c20 con 0x7f19cc15a400 2023-10-09T15:37:32.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.630+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f19cc04c3c0 con 0x7f19cc15a400 2023-10-09T15:37:32.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.631+0000 7f19c8ff9700 1 -- 172.21.15.33:0/4106453344 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4590 (secure 0 0 0) 0x7f19c4055240 con 0x7f19cc15a400 2023-10-09T15:37:32.632 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:32.632 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:32.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 msgr2=0x7f19ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 0x7f19ac0697d0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f19b4003a30 tx=0x7f19b4007ea0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 msgr2=0x7f19cc0cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f19c400d860 tx=0x7f19c4008040 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 shutdown_connections 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f19ac067320 0x7f19ac0697d0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f19cc15a400 0x7f19cc0cf200 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f19cc0cb5a0 0x7f19cc168ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 --2- 172.21.15.33:0/4106453344 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f19cc0cb970 0x7f19cc0b3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 >> 172.21.15.33:0/4106453344 conn(0x7f19cc070e30 msgr2=0x7f19cc0b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 shutdown_connections 2023-10-09T15:37:32.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.633+0000 7f19d2d51700 1 -- 172.21.15.33:0/4106453344 wait complete. 2023-10-09T15:37:32.636 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 68 2023-10-09T15:37:32.647 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:32.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.764+0000 7fecf3267700 1 Processor -- start 2023-10-09T15:37:32.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 -- start start 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb970 0x7fecec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fecec15a400 0x7fecec156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecec15ae40 con 0x7fecec0cb5a0 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecec0ce0f0 con 0x7fecec15a400 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.765+0000 7fecf3267700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0cbde0 con 0x7fecec0cb970 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1003700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fecec0cb5a0 0x7fecec0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56748/0 (socket says 172.21.15.33:56748) 2023-10-09T15:37:32.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1003700 1 -- 172.21.15.33:0/3573327649 learned_addr learned my addr 172.21.15.33:0/3573327649 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 --2- 172.21.15.33:0/3573327649 >> v2:172.21.15.33:3300/0 conn(0x7fecec15a400 0x7fecec156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf0802700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb970 0x7fecec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 -- 172.21.15.33:0/3573327649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb970 msgr2=0x7fecec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb970 0x7fecec159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 -- 172.21.15.33:0/3573327649 >> v1:172.21.15.33:6789/0 conn(0x7fecec0cb5a0 legacy=0x7fecec0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 -- 172.21.15.33:0/3573327649 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecec15ab60 con 0x7fecec15a400 2023-10-09T15:37:32.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecf1804700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec15a400 0x7fecec156e90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009e90 tx=0x7fecdc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd35608621d5dbb7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecebfff700 1 -- 172.21.15.33:0/3573327649 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc00e070 con 0x7fecec15a400 2023-10-09T15:37:32.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecebfff700 1 -- 172.21.15.33:0/3573327649 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecdc00bbf0 con 0x7fecec15a400 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.766+0000 7fecebfff700 1 -- 172.21.15.33:0/3573327649 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecdc012430 con 0x7fecec15a400 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 -- 172.21.15.33:0/3573327649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec15a400 msgr2=0x7fecec156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec15a400 0x7fecec156e90 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7fecdc009e90 tx=0x7fecdc009780 comp rx=0 tx=0).stop 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 -- 172.21.15.33:0/3573327649 shutdown_connections 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec15a400 0x7fecec156e90 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 --2- 172.21.15.33:0/3573327649 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb970 0x7fecec159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 -- 172.21.15.33:0/3573327649 >> 172.21.15.33:0/3573327649 conn(0x7fecec070e30 msgr2=0x7fecec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 -- 172.21.15.33:0/3573327649 shutdown_connections 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.767+0000 7fecf3267700 1 -- 172.21.15.33:0/3573327649 wait complete. 2023-10-09T15:37:32.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.768+0000 7fecf3267700 1 Processor -- start 2023-10-09T15:37:32.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.768+0000 7fecf3267700 1 -- start start 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb5a0 0x7fecec151390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec15a400 0x7fecec155630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b5a00 con 0x7fecec0cb970 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b6390 con 0x7fecec15a400 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf3267700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecec0b4960 con 0x7fecec0cb5a0 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf0802700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf0802700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58786/0 (socket says 172.21.15.33:58786) 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.769+0000 7fecf0802700 1 -- 172.21.15.33:0/2851750436 learned_addr learned my addr 172.21.15.33:0/2851750436 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:32.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf1003700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb5a0 0x7fecec151390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 -- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb5a0 msgr2=0x7fecec151390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb5a0 0x7fecec151390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 -- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec15a400 msgr2=0x7fecec155630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf1804700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec15a400 0x7fecec155630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec15a400 0x7fecec155630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 -- 172.21.15.33:0/2851750436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecdc009a20 con 0x7fecec0cb970 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf0802700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fece000ec80 tx=0x7fece00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece000c9d0 con 0x7fecec0cb970 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fece000cb30 con 0x7fecec0cb970 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecec0b4c40 con 0x7fecec0cb970 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fece0013470 con 0x7fecec0cb970 2023-10-09T15:37:32.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.770+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecec0b5200 con 0x7fecec0cb970 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.771+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecec04c3c0 con 0x7fecec0cb970 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.771+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fece0013820 con 0x7fecec0cb970 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.772+0000 7fece97fa700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 0x7fecd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.772+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fece0085060 con 0x7fecec0cb970 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.772+0000 7fecf1003700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 0x7fecd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:32.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.772+0000 7fecf1003700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 0x7fecd80697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fece4001700 tx=0x7fece4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:32.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:32.776+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fece0051cf0 con 0x7fecec0cb970 2023-10-09T15:37:33.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.016+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fecec0ccb80 con 0x7fecec0cb970 2023-10-09T15:37:33.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.016+0000 7fece97fa700 1 -- 172.21.15.33:0/2851750436 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) v1 ==== 94+0+4590 (secure 0 0 0) 0x7fece0055310 con 0x7fecec0cb970 2023-10-09T15:37:33.017 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:33.017 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":68,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62}],"filesystems":[{"mdsmap":{"epoch":67,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:13.678019+0000","modified":"2023-10-09T15:37:17.528789+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6795},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6795":{"gid":6795,"name":"a","rank":0,"incarnation":63,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/624790469","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":624790469},{"type":"v1","addr":"172.21.15.33:6837","nonce":624790469}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":8}]} 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 msgr2=0x7fecd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 0x7fecd80697d0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fece4001700 tx=0x7fece4009040 comp rx=0 tx=0).stop 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 msgr2=0x7fecec153710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7fece000ec80 tx=0x7fece00091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 shutdown_connections 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fecd8067320 0x7fecd80697d0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fecec15a400 0x7fecec155630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fecec0cb5a0 0x7fecec151390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.018+0000 7fecf3267700 1 --2- 172.21.15.33:0/2851750436 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fecec0cb970 0x7fecec153710 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.019+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 >> 172.21.15.33:0/2851750436 conn(0x7fecec070e30 msgr2=0x7fecec0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.019+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 shutdown_connections 2023-10-09T15:37:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.019+0000 7fecf3267700 1 -- 172.21.15.33:0/2851750436 wait complete. 2023-10-09T15:37:33.021 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 68 2023-10-09T15:37:33.032 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.151+0000 7fef9ae93700 1 Processor -- start 2023-10-09T15:37:33.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.151+0000 7fef9ae93700 1 -- start start 2023-10-09T15:37:33.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef9ae93700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef94153c30 0x7fef9415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef9ae93700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9415afd0 con 0x7fef9415de50 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef9ae93700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef9415b2b0 con 0x7fef940cf110 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef9ae93700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef9415b590 con 0x7fef94153c30 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef94153c30 0x7fef9415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef94153c30 0x7fef9415a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58790/0 (socket says 172.21.15.33:58790) 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 -- 172.21.15.33:0/694061777 learned_addr learned my addr 172.21.15.33:0/694061777 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 -- 172.21.15.33:0/694061777 >> v1:172.21.15.59:6789/0 conn(0x7fef940cf110 legacy=0x7fef9415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 -- 172.21.15.33:0/694061777 >> v1:172.21.15.33:6789/0 conn(0x7fef9415de50 legacy=0x7fef940cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.152+0000 7fef99e91700 1 -- 172.21.15.33:0/694061777 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9415b870 con 0x7fef94153c30 2023-10-09T15:37:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef99e91700 1 --2- 172.21.15.33:0/694061777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef9415a5e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0099b0 tx=0x7fef8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66881bb04984c24a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef98e8f700 1 -- 172.21.15.33:0/694061777 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00b820 con 0x7fef94153c30 2023-10-09T15:37:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef98e8f700 1 -- 172.21.15.33:0/694061777 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef8c00b980 con 0x7fef94153c30 2023-10-09T15:37:33.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef98e8f700 1 -- 172.21.15.33:0/694061777 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef8c00bd20 con 0x7fef94153c30 2023-10-09T15:37:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 -- 172.21.15.33:0/694061777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 msgr2=0x7fef9415a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 --2- 172.21.15.33:0/694061777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef9415a5e0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0099b0 tx=0x7fef8c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 -- 172.21.15.33:0/694061777 shutdown_connections 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 --2- 172.21.15.33:0/694061777 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef9415a5e0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 -- 172.21.15.33:0/694061777 >> 172.21.15.33:0/694061777 conn(0x7fef940703a0 msgr2=0x7fef940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 -- 172.21.15.33:0/694061777 shutdown_connections 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.153+0000 7fef9ae93700 1 -- 172.21.15.33:0/694061777 wait complete. 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.154+0000 7fef9ae93700 1 Processor -- start 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 -- start start 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef940cf110 0x7fef9416ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef9415de50 0x7fef940c85b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c9530 con 0x7fef94153c30 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9416b570 con 0x7fef9415de50 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef9ae93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef940c8f70 con 0x7fef940cf110 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef99690700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.155+0000 7fef99690700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58796/0 (socket says 172.21.15.33:58796) 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 -- 172.21.15.33:0/2361610044 learned_addr learned my addr 172.21.15.33:0/2361610044 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99e91700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef940cf110 0x7fef9416ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef9a692700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef9415de50 0x7fef940c85b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 -- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef940cf110 msgr2=0x7fef9416ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef940cf110 0x7fef9416ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 -- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef9415de50 msgr2=0x7fef940c85b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef9415de50 0x7fef940c85b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 -- 172.21.15.33:0/2361610044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8c0094f0 con 0x7fef94153c30 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef99690700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c4e0 tx=0x7fef8400c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84011590 con 0x7fef94153c30 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef84011710 con 0x7fef94153c30 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef940c9250 con 0x7fef94153c30 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef84011ad0 con 0x7fef94153c30 2023-10-09T15:37:33.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.156+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef94158e10 con 0x7fef94153c30 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.157+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9404c3c0 con 0x7fef94153c30 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.158+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fef8401b3b0 con 0x7fef94153c30 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.158+0000 7fef89ffb700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 0x7fef78069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.158+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fef84084030 con 0x7fef94153c30 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.158+0000 7fef99e91700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 0x7fef78069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.159+0000 7fef99e91700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 0x7fef78069800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0099b0 tx=0x7fef8c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.162+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef84050cc0 con 0x7fef94153c30 2023-10-09T15:37:33.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.358+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fef9416b6b0 con 0x7fef94153c30 2023-10-09T15:37:33.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.359+0000 7fef89ffb700 1 -- 172.21.15.33:0/2361610044 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+15308 (secure 0 0 0) 0x7fef84017070 con 0x7fef94153c30 2023-10-09T15:37:33.360 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:33.360 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":101,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:15.262273+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:11.324365+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:12.655716+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 msgr2=0x7fef78069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 0x7fef78069800 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0099b0 tx=0x7fef8c016000 comp rx=0 tx=0).stop 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 msgr2=0x7fef941588d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7fef8400c4e0 tx=0x7fef8400c7f0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 shutdown_connections 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef78067350 0x7fef78069800 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef9415de50 0x7fef940c85b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef940cf110 0x7fef9416ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 --2- 172.21.15.33:0/2361610044 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef94153c30 0x7fef941588d0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 >> 172.21.15.33:0/2361610044 conn(0x7fef940703a0 msgr2=0x7fef940cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 shutdown_connections 2023-10-09T15:37:33.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.361+0000 7fef9ae93700 1 -- 172.21.15.33:0/2361610044 wait complete. 2023-10-09T15:37:33.374 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:37:33.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.494+0000 7f06fb464700 1 Processor -- start 2023-10-09T15:37:33.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.495+0000 7f06fb464700 1 -- start start 2023-10-09T15:37:33.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.495+0000 7f06fb464700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 0x7f06f4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.495+0000 7f06fb464700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f415ae40 con 0x7f06f40cb5a0 2023-10-09T15:37:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.495+0000 7f06fb464700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f415ab60 con 0x7f06f40cb970 2023-10-09T15:37:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.495+0000 7f06fb464700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40ce0f0 con 0x7f06f415a5d0 2023-10-09T15:37:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9200700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f06f40cb5a0 0x7f06f40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56774/0 (socket says 172.21.15.33:56774) 2023-10-09T15:37:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9200700 1 -- 172.21.15.33:0/3449359795 learned_addr learned my addr 172.21.15.33:0/3449359795 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:33.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9a01700 1 --2- 172.21.15.33:0/3449359795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 0x7f06f4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3038362328 0 0) 0x7f06f415ae40 con 0x7f06f40cb5a0 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e0003570 con 0x7f06f40cb5a0 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 438891306 0 0) 0x7f06f415ab60 con 0x7f06f40cb970 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06f415ae40 con 0x7f06f40cb970 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9a01700 1 -- 172.21.15.33:0/3449359795 >> v1:172.21.15.59:6789/0 conn(0x7f06f40cb970 legacy=0x7f06f4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9a01700 1 -- 172.21.15.33:0/3449359795 >> v1:172.21.15.33:6789/0 conn(0x7f06f40cb5a0 legacy=0x7f06f40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9a01700 1 -- 172.21.15.33:0/3449359795 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f40ccf00 con 0x7f06f415a5d0 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.496+0000 7f06f9a01700 1 --2- 172.21.15.33:0/3449359795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 0x7f06f4156e90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e90 tx=0x7f06ec009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8790640612ee5255 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec00e070 con 0x7f06f415a5d0 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec00bb80 con 0x7f06f415a5d0 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06ebfff700 1 -- 172.21.15.33:0/3449359795 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec012430 con 0x7f06f415a5d0 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 -- 172.21.15.33:0/3449359795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 msgr2=0x7f06f4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 --2- 172.21.15.33:0/3449359795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 0x7f06f4156e90 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f06ec009e90 tx=0x7f06ec009780 comp rx=0 tx=0).stop 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 -- 172.21.15.33:0/3449359795 shutdown_connections 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 --2- 172.21.15.33:0/3449359795 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f415a5d0 0x7f06f4156e90 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 -- 172.21.15.33:0/3449359795 >> 172.21.15.33:0/3449359795 conn(0x7f06f4070e30 msgr2=0x7f06f40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 -- 172.21.15.33:0/3449359795 shutdown_connections 2023-10-09T15:37:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.497+0000 7f06fb464700 1 -- 172.21.15.33:0/3449359795 wait complete. 2023-10-09T15:37:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.498+0000 7f06fb464700 1 Processor -- start 2023-10-09T15:37:33.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 -- start start 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40cb5a0 0x7f06f40b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40cb970 0x7f06f41537b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f4153cf0 con 0x7f06f415a5d0 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b4aa0 con 0x7f06f40cb5a0 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.499+0000 7f06fb464700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f40b4d80 con 0x7f06f40cb970 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58804/0 (socket says 172.21.15.33:58804) 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 -- 172.21.15.33:0/3627302294 learned_addr learned my addr 172.21.15.33:0/3627302294 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9200700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40cb5a0 0x7f06f40b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f89ff700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40cb970 0x7f06f41537b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 -- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40cb970 msgr2=0x7f06f41537b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40cb970 0x7f06f41537b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 -- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40cb5a0 msgr2=0x7f06f40b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40cb5a0 0x7f06f40b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 -- 172.21.15.33:0/3627302294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06ec009a20 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06f9a01700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f06f406ea60 tx=0x7f06ec019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec012e00 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06ec01b630 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f40b5060 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06ec01b9f0 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.500+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f40b5620 con 0x7f06f415a5d0 2023-10-09T15:37:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.501+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f404c3c0 con 0x7f06f415a5d0 2023-10-09T15:37:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.502+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f06ec01c400 con 0x7f06f415a5d0 2023-10-09T15:37:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.502+0000 7f06e97fa700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 0x7f06d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.502+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f06ec086be0 con 0x7f06f415a5d0 2023-10-09T15:37:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.502+0000 7f06f9200700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 0x7f06d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.503+0000 7f06f9200700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 0x7f06d80697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f06f00058d0 tx=0x7f06f0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.507+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f06ec053760 con 0x7f06f415a5d0 2023-10-09T15:37:33.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.747+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f06f40d0d90 con 0x7f06f415a5d0 2023-10-09T15:37:33.749 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:37:33.748+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:37:33.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.752+0000 7f06e97fa700 1 -- 172.21.15.33:0/3627302294 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v69) v1 ==== 161+0+0 (secure 0 0 0) 0x7f06ec02a090 con 0x7f06f415a5d0 2023-10-09T15:37:33.754 INFO:tasks.ceph.mds.a.smithi033.stderr: -945> 2023-10-09T15:37:18.850+0000 7fa28fc96700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:37:33.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 msgr2=0x7f06d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 0x7f06d80697d0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f06f00058d0 tx=0x7f06f0009040 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 msgr2=0x7f06f40b1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f06f406ea60 tx=0x7f06ec019000 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 shutdown_connections 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f06d8067320 0x7f06d80697d0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f06f415a5d0 0x7f06f40b1d10 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f06f40cb5a0 0x7f06f40b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 --2- 172.21.15.33:0/3627302294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f06f40cb970 0x7f06f41537b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 >> 172.21.15.33:0/3627302294 conn(0x7f06f4070e30 msgr2=0x7f06f40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 shutdown_connections 2023-10-09T15:37:33.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.754+0000 7f06fb464700 1 -- 172.21.15.33:0/3627302294 wait complete. 2023-10-09T15:37:33.757 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:37:33.773 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:37:33.780 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:37:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.894+0000 7f01b8a66700 1 Processor -- start 2023-10-09T15:37:33.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.894+0000 7f01b8a66700 1 -- start start 2023-10-09T15:37:33.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b8a66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f01b40af0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b8a66700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b415c2f0 con 0x7f01b4157600 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b8a66700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b4070650 con 0x7f01b40c7ae0 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b8a66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b406c860 con 0x7f01b41579d0 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f01b4157600 0x7f01b40c73d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56796/0 (socket says 172.21.15.33:56796) 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b259c700 1 -- 172.21.15.33:0/3627163639 learned_addr learned my addr 172.21.15.33:0/3627163639 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f01b40af0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4237468829 0 0) 0x7f01b415c2f0 con 0x7f01b4157600 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f019c003570 con 0x7f01b4157600 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.895+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3093701023 0 0) 0x7f019c003570 con 0x7f01b4157600 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 msgr2=0x7f01b40af0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:33.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f01b40af0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 >> v1:172.21.15.59:6789/0 conn(0x7f01b40c7ae0 legacy=0x7f01b406ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b415ba50 con 0x7f01b4157600 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f01a40015f0 con 0x7f01b4157600 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 >> v1:172.21.15.33:6789/0 conn(0x7f01b4157600 legacy=0x7f01b40c73d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c003a90 0x7f019c003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f019c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f019c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b406c860 con 0x7f019c004d50 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f019c00bba0 con 0x7f019c003a90 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f019c00bd60 con 0x7f01b41579d0 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f019c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b259c700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c003a90 0x7f019c003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b1d9b700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f019c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 -- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 msgr2=0x7f019c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b41579d0 0x7f019c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 -- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c003a90 msgr2=0x7f019c003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f019c003a90 0x7f019c003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 -- 172.21.15.33:0/3627163639 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f019c003570 con 0x7f019c004d50 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f019c0051c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00e210 tx=0x7f01ac00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0251658252ae36e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00eac0 con 0x7f019c004d50 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac00f040 con 0x7f019c004d50 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.896+0000 7f01b159a700 1 -- 172.21.15.33:0/3627163639 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac00ee70 con 0x7f019c004d50 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 -- 172.21.15.33:0/3627163639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 msgr2=0x7f019c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 --2- 172.21.15.33:0/3627163639 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f019c0051c0 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f01ac00e210 tx=0x7f01ac00b040 comp rx=0 tx=0).stop 2023-10-09T15:37:33.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b2d9d700 1 -- 172.21.15.33:0/3627163639 reap_dead start 2023-10-09T15:37:33.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 -- 172.21.15.33:0/3627163639 shutdown_connections 2023-10-09T15:37:33.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 -- 172.21.15.33:0/3627163639 >> 172.21.15.33:0/3627163639 conn(0x7f01b40ccb60 msgr2=0x7f01b40ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:33.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 -- 172.21.15.33:0/3627163639 shutdown_connections 2023-10-09T15:37:33.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.897+0000 7f01b8a66700 1 -- 172.21.15.33:0/3627163639 wait complete. 2023-10-09T15:37:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.898+0000 7f01b8a66700 1 Processor -- start 2023-10-09T15:37:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.898+0000 7f01b8a66700 1 -- start start 2023-10-09T15:37:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b416cef0 0x7f01b40c3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b40c4150 0x7f01b40c5e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40c1900 con 0x7f019c004d50 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b416b830 con 0x7f01b416cef0 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b8a66700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b40c4580 con 0x7f01b40c4150 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58830/0 (socket says 172.21.15.33:58830) 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 -- 172.21.15.33:0/1742611975 learned_addr learned my addr 172.21.15.33:0/1742611975 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b2d9d700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b40c4150 0x7f01b40c5e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b1d9b700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b416cef0 0x7f01b40c3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 -- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b40c4150 msgr2=0x7f01b40c5e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b40c4150 0x7f01b40c5e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 -- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b416cef0 msgr2=0x7f01b40c3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b416cef0 0x7f01b40c3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.899+0000 7f01b259c700 1 -- 172.21.15.33:0/1742611975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b40c6bc0 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01b259c700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f01a400fc60 tx=0x7f01a4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40072e0 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a4007440 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a40057f0 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b40c1b50 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.900+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b416d360 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.901+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b40ae960 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.901+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f01a4005ba0 con 0x7f019c004d50 2023-10-09T15:37:33.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.902+0000 7f01a27fc700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 0x7f01940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.902+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f01a4084db0 con 0x7f019c004d50 2023-10-09T15:37:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.902+0000 7f01b1d9b700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 0x7f01940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.902+0000 7f01b1d9b700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 0x7f01940697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f01b415c830 tx=0x7f01a8007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:33.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:33.906+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01a4089070 con 0x7f019c004d50 2023-10-09T15:37:34.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.143+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f01b404c3c0 con 0x7f019c004d50 2023-10-09T15:37:34.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.752+0000 7f01a27fc700 1 -- 172.21.15.33:0/1742611975 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v70) v1 ==== 104+0+0 (secure 0 0 0) 0x7f01a40519f0 con 0x7f019c004d50 2023-10-09T15:37:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 msgr2=0x7f01940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 0x7f01940697d0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f01b415c830 tx=0x7f01a8007d30 comp rx=0 tx=0).stop 2023-10-09T15:37:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 msgr2=0x7f01b416b2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f01a400fc60 tx=0x7f01a4009040 comp rx=0 tx=0).stop 2023-10-09T15:37:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 shutdown_connections 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0194067320 0x7f01940697d0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f019c004d50 0x7f01b416b2f0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01b40c4150 0x7f01b40c5e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 --2- 172.21.15.33:0/1742611975 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01b416cef0 0x7f01b40c3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 >> 172.21.15.33:0/1742611975 conn(0x7f01b40ccb60 msgr2=0x7f01b40cb640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 shutdown_connections 2023-10-09T15:37:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.755+0000 7f01b8a66700 1 -- 172.21.15.33:0/1742611975 wait complete. 2023-10-09T15:37:34.770 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:37:34.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.937+0000 7f2792e7b700 1 Processor -- start 2023-10-09T15:37:34.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.937+0000 7f2792e7b700 1 -- start start 2023-10-09T15:37:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2792e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f278c0cbe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2792e7b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f278c1599b0 0x7f278c0ad780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2792e7b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f278c0cf340 con 0x7f278c0ce270 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2792e7b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f278c0ce730 con 0x7f278c1599b0 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2792e7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cea10 con 0x7f278c1595e0 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f278c0ce270 0x7f278c0cf7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56810/0 (socket says 172.21.15.33:56810) 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278bfff700 1 -- 172.21.15.33:0/1858832318 learned_addr learned my addr 172.21.15.33:0/1858832318 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1409605425 0 0) 0x7f278c0cf340 con 0x7f278c0ce270 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f277c003570 con 0x7f278c0ce270 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2790c17700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f278c0cbe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f2791418700 1 --2- 172.21.15.33:0/1858832318 >> v2:172.21.15.59:3300/0 conn(0x7f278c1599b0 0x7f278c0ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3816854830 0 0) 0x7f277c003570 con 0x7f278c0ce270 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 msgr2=0x7f278c0cbe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f278c0cbe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 >> v2:172.21.15.59:3300/0 conn(0x7f278c1599b0 msgr2=0x7f278c0ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 --2- 172.21.15.33:0/1858832318 >> v2:172.21.15.59:3300/0 conn(0x7f278c1599b0 0x7f278c0ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0cecf0 con 0x7f278c0ce270 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f2778001470 con 0x7f278c0ce270 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.938+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 >> v1:172.21.15.33:6789/0 conn(0x7f278c0ce270 legacy=0x7f278c0cf7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f277c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f277c003fe0 0x7f277c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277c004d50 0x7f277c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0ce730 con 0x7f277c003fe0 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cea10 con 0x7f277c004d50 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f277c00ba90 con 0x7f278c1595e0 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f277c003fe0 0x7f277c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f2790c17700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f277c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f2791418700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277c004d50 0x7f277c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 -- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 msgr2=0x7f277c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:34.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c1595e0 0x7f277c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 -- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277c004d50 msgr2=0x7f277c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f277c004d50 0x7f277c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 -- 172.21.15.33:0/1858832318 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f277c003570 con 0x7f277c003fe0 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278bfff700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f277c003fe0 0x7f277c004810 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f277800c390 tx=0x7f2778001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebf5ec460d01e268 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f277800cc00 con 0x7f277c003fe0 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f277800cd80 con 0x7f277c003fe0 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.939+0000 7f278b7fe700 1 -- 172.21.15.33:0/1858832318 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778005b70 con 0x7f277c003fe0 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 -- 172.21.15.33:0/1858832318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f277c003fe0 msgr2=0x7f277c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1858832318 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f277c003fe0 0x7f277c004810 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f277800c390 tx=0x7f2778001e90 comp rx=0 tx=0).stop 2023-10-09T15:37:34.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2791418700 1 -- 172.21.15.33:0/1858832318 reap_dead start 2023-10-09T15:37:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 -- 172.21.15.33:0/1858832318 shutdown_connections 2023-10-09T15:37:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 -- 172.21.15.33:0/1858832318 >> 172.21.15.33:0/1858832318 conn(0x7f278c0999c0 msgr2=0x7f278c070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 -- 172.21.15.33:0/1858832318 shutdown_connections 2023-10-09T15:37:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.940+0000 7f2792e7b700 1 -- 172.21.15.33:0/1858832318 wait complete. 2023-10-09T15:37:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.941+0000 7f2792e7b700 1 Processor -- start 2023-10-09T15:37:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.941+0000 7f2792e7b700 1 -- start start 2023-10-09T15:37:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c158010 0x7f278c0c8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 0x7f278c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cb9a0 con 0x7f278c1583e0 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278c09ceb0 con 0x7f278c0ca5f0 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2792e7b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f278c0cb3e0 con 0x7f278c158010 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58842/0 (socket says 172.21.15.33:58842) 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 -- 172.21.15.33:0/1893673141 learned_addr learned my addr 172.21.15.33:0/1893673141 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2790c17700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c158010 0x7f278c0c8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2791418700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 0x7f278c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 -- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c158010 msgr2=0x7f278c0c8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c158010 0x7f278c0c8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 -- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 msgr2=0x7f278c0caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 0x7f278c0caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 -- 172.21.15.33:0/1893673141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f278c0cb6c0 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f2791418700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 0x7f278c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.942+0000 7f278bfff700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f277c004730 tx=0x7f2778015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.943+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778022070 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.943+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2778001430 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.943+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f278c09cb40 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.943+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2778007320 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.943+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f278c0cafd0 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.944+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f278c04c3c0 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.944+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2778007690 con 0x7f278c1583e0 2023-10-09T15:37:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.944+0000 7f2788ff9700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 0x7f27700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:34.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.944+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(102..102 src has 1..102) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f2778085d70 con 0x7f278c1583e0 2023-10-09T15:37:34.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.944+0000 7f2790c17700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 0x7f27700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:34.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.945+0000 7f2790c17700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 0x7f27700697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2780006dc0 tx=0x7f2780008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:34.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:34.949+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f27780529f0 con 0x7f278c1583e0 2023-10-09T15:37:35.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.141+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f278c09ccd0 con 0x7f278c1583e0 2023-10-09T15:37:35.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.757+0000 7f2788ff9700 1 -- 172.21.15.33:0/1893673141 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v103) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2778055fd0 con 0x7f278c1583e0 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 msgr2=0x7f27700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 0x7f27700697d0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f2780006dc0 tx=0x7f2780008040 comp rx=0 tx=0).stop 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 msgr2=0x7f278c0c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f277c004730 tx=0x7f2778015000 comp rx=0 tx=0).stop 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 shutdown_connections 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2770067320 0x7f27700697d0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f278c0ca5f0 0x7f278c0caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f278c158010 0x7f278c0c8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 --2- 172.21.15.33:0/1893673141 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f278c1583e0 0x7f278c0c8b40 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 >> 172.21.15.33:0/1893673141 conn(0x7f278c0999c0 msgr2=0x7f278c0adfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 shutdown_connections 2023-10-09T15:37:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.761+0000 7f2792e7b700 1 -- 172.21.15.33:0/1893673141 wait complete. 2023-10-09T15:37:35.764 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:37:35.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:37:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.908+0000 7f7a9200d700 1 Processor -- start 2023-10-09T15:37:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.908+0000 7f7a9200d700 1 -- start start 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9200d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7a8c0cce90 0x7f7a8c0cd330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9200d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c15d570 con 0x7f7a8c0cb440 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9200d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a8c15d850 con 0x7f7a8c159fb0 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9200d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a8c15e180 con 0x7f7a8c0cce90 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9080a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7a8c0cce90 0x7f7a8c0cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9180c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f7a8c0cb440 0x7f7a8c0cb810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56824/0 (socket says 172.21.15.33:56824) 2023-10-09T15:37:35.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.909+0000 7f7a9180c700 1 -- 172.21.15.33:0/946903389 learned_addr learned my addr 172.21.15.33:0/946903389 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9080a700 1 -- 172.21.15.33:0/946903389 >> v1:172.21.15.59:6789/0 conn(0x7f7a8c159fb0 legacy=0x7f7a8c15a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9080a700 1 -- 172.21.15.33:0/946903389 >> v1:172.21.15.33:6789/0 conn(0x7f7a8c0cb440 legacy=0x7f7a8c0cb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a8bfff700 1 -- 172.21.15.33:0/946903389 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160508125 0 0) 0x7f7a8c15d570 con 0x7f7a8c0cb440 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9080a700 1 -- 172.21.15.33:0/946903389 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a8c15db30 con 0x7f7a8c0cce90 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9080a700 1 --2- 172.21.15.33:0/946903389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c0cd330 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098e0 tx=0x7f7a800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65e2fb929a5a609a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a8bfff700 1 -- 172.21.15.33:0/946903389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a80009e80 con 0x7f7a8c0cce90 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a8bfff700 1 -- 172.21.15.33:0/946903389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a8000b820 con 0x7f7a8c0cce90 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a8bfff700 1 -- 172.21.15.33:0/946903389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000bba0 con 0x7f7a8c0cce90 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 -- 172.21.15.33:0/946903389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 msgr2=0x7f7a8c0cd330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 --2- 172.21.15.33:0/946903389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c0cd330 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f7a800098e0 tx=0x7f7a800091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 -- 172.21.15.33:0/946903389 shutdown_connections 2023-10-09T15:37:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 --2- 172.21.15.33:0/946903389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c0cd330 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 -- 172.21.15.33:0/946903389 >> 172.21.15.33:0/946903389 conn(0x7f7a8c0703a0 msgr2=0x7f7a8c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 -- 172.21.15.33:0/946903389 shutdown_connections 2023-10-09T15:37:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.910+0000 7f7a9200d700 1 -- 172.21.15.33:0/946903389 wait complete. 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 Processor -- start 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 -- start start 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 0x7f7a8c14d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 0x7f7a8c148190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15be30 con 0x7f7a8c0cce90 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15ad70 con 0x7f7a8c0cb440 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9200d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a8c15b050 con 0x7f7a8c159fb0 2023-10-09T15:37:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.912+0000 7f7a9080a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58854/0 (socket says 172.21.15.33:58854) 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 -- 172.21.15.33:0/3387244354 learned_addr learned my addr 172.21.15.33:0/3387244354 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9180c700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 0x7f7a8c148190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 -- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 msgr2=0x7f7a8c148190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9100b700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 0x7f7a8c14d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 0x7f7a8c148190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 -- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 msgr2=0x7f7a8c14d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 0x7f7a8c14d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 -- 172.21.15.33:0/3387244354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a80009420 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9180c700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 0x7f7a8c148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9100b700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 0x7f7a8c14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9080a700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7a800030c0 tx=0x7f7a80016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8000ba90 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a80020070 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a8001b6a0 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a8c15b330 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.913+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a8c0c76a0 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.914+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a8c0c78c0 con 0x7f7a8c0cce90 2023-10-09T15:37:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.915+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7a80022030 con 0x7f7a8c0cce90 2023-10-09T15:37:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.915+0000 7f7a897fa700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 0x7f7a780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.915+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(103..103 src has 1..103) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f7a800869f0 con 0x7f7a8c0cce90 2023-10-09T15:37:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.915+0000 7f7a9100b700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 0x7f7a780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.915+0000 7f7a9100b700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 0x7f7a780697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c006fd0 tx=0x7f7a7c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:35.919+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7a800538f0 con 0x7f7a8c0cce90 2023-10-09T15:37:36.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.117+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f7a8c0c78c0 con 0x7f7a8c0cce90 2023-10-09T15:37:36.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:37:36.698 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:37:36.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.761+0000 7f7a897fa700 1 -- 172.21.15.33:0/3387244354 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v104) v1 ==== 169+0+0 (secure 0 0 0) 0x7f7a80056f10 con 0x7f7a8c0cce90 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.764+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 msgr2=0x7f7a780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.764+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 0x7f7a780697d0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c006fd0 tx=0x7f7a7c008040 comp rx=0 tx=0).stop 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 msgr2=0x7f7a8c15a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f7a800030c0 tx=0x7f7a80016000 comp rx=0 tx=0).stop 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 shutdown_connections 2023-10-09T15:37:36.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7a78067320 0x7f7a780697d0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7a8c159fb0 0x7f7a8c148190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7a8c0cb440 0x7f7a8c14d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 --2- 172.21.15.33:0/3387244354 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7a8c0cce90 0x7f7a8c15a6d0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 >> 172.21.15.33:0/3387244354 conn(0x7f7a8c0703a0 msgr2=0x7f7a8c0b2670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 shutdown_connections 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.765+0000 7f7a9200d700 1 -- 172.21.15.33:0/3387244354 wait complete. 2023-10-09T15:37:36.767 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:37:36.780 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:37:36.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.943+0000 7f90aff6e700 1 Processor -- start 2023-10-09T15:37:36.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.944+0000 7f90aff6e700 1 -- start start 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.944+0000 7f90aff6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f90a806a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.944+0000 7f90aff6e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a806f7d0 con 0x7f90a80cc320 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.944+0000 7f90aff6e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90a806d7b0 con 0x7f90a813c9b0 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.944+0000 7f90aff6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a806e330 con 0x7f90a80cc6f0 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90add0a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f90a80cc320 0x7f90a813c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56830/0 (socket says 172.21.15.33:56830) 2023-10-09T15:37:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90add0a700 1 -- 172.21.15.33:0/2615671399 learned_addr learned my addr 172.21.15.33:0/2615671399 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226618733 0 0) 0x7f90a806f7d0 con 0x7f90a80cc320 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9090003570 con 0x7f90a80cc320 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90ae50b700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f90a806a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1787134168 0 0) 0x7f9090003570 con 0x7f90a80cc320 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 msgr2=0x7f90a806a110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f90a806a110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 >> v1:172.21.15.59:6789/0 conn(0x7f90a813c9b0 legacy=0x7f90a8069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a806da00 con 0x7f90a80cc320 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f90a0001470 con 0x7f90a80cc320 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 >> v1:172.21.15.33:6789/0 conn(0x7f90a80cc320 legacy=0x7f90a813c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090003a90 0x7f9090003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f9090004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9090004d50 0x7f90900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a806e330 con 0x7f9090004d50 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f909000bba0 con 0x7f9090003a90 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f909000bd60 con 0x7f90a80cc6f0 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90ae50b700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9090004d50 0x7f90900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90ad509700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f9090004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.945+0000 7f90add0a700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090003a90 0x7f9090003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 -- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 msgr2=0x7f9090004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f9090004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 -- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090003a90 msgr2=0x7f9090003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090003a90 0x7f9090003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 -- 172.21.15.33:0/2615671399 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9090003570 con 0x7f9090004d50 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ad509700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a80cc6f0 0x7f9090004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90add0a700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9090003a90 0x7f9090003ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9090004d50 0x7f90900051c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f909800e210 tx=0x7f909800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656fda378f012ad6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800eac0 con 0x7f9090004d50 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909800f040 con 0x7f9090004d50 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90acd08700 1 -- 172.21.15.33:0/2615671399 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909800ee70 con 0x7f9090004d50 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90aff6e700 1 -- 172.21.15.33:0/2615671399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9090004d50 msgr2=0x7f90900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90aff6e700 1 --2- 172.21.15.33:0/2615671399 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9090004d50 0x7f90900051c0 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f909800e210 tx=0x7f909800b040 comp rx=0 tx=0).stop 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.946+0000 7f90ae50b700 1 -- 172.21.15.33:0/2615671399 reap_dead start 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.947+0000 7f90aff6e700 1 -- 172.21.15.33:0/2615671399 shutdown_connections 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.947+0000 7f90aff6e700 1 -- 172.21.15.33:0/2615671399 >> 172.21.15.33:0/2615671399 conn(0x7f90a8067f00 msgr2=0x7f90a8068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:36.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.947+0000 7f90aff6e700 1 -- 172.21.15.33:0/2615671399 shutdown_connections 2023-10-09T15:37:36.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.947+0000 7f90aff6e700 1 -- 172.21.15.33:0/2615671399 wait complete. 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 Processor -- start 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 -- start start 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90a813aa90 0x7f90a80ac780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a8155f00 0x7f90a8154b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a816ac40 con 0x7f90a8169c30 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90a80accc0 con 0x7f90a813aa90 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.948+0000 7f90aff6e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90a8156370 con 0x7f90a8155f00 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58866/0 (socket says 172.21.15.33:58866) 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 -- 172.21.15.33:0/1950969691 learned_addr learned my addr 172.21.15.33:0/1950969691 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90add0a700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90a813aa90 0x7f90a80ac780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ae50b700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a8155f00 0x7f90a8154b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 -- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a8155f00 msgr2=0x7f90a8154b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a8155f00 0x7f90a8154b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 -- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90a813aa90 msgr2=0x7f90a80ac780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90a813aa90 0x7f90a80ac780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:36.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 -- 172.21.15.33:0/1950969691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90a80ab3d0 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90ad509700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e570 tx=0x7f909c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c011460 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f909c010040 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f909c0117f0 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90a81546a0 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.949+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90a816a700 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.950+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90a8154470 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.951+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f909c011be0 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.951+0000 7f90a5ffb700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 0x7f90940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.951+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f909c083b80 con 0x7f90a8169c30 2023-10-09T15:37:36.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.951+0000 7f90add0a700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 0x7f90940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.951+0000 7f90add0a700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 0x7f90940697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001ed0 tx=0x7f90a0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:36.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:36.955+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f909c04d5a0 con 0x7f90a8169c30 2023-10-09T15:37:37.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.153+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f90a80ab3d0 con 0x7f90a8169c30 2023-10-09T15:37:37.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.157+0000 7f90a5ffb700 1 -- 172.21.15.33:0/1950969691 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f90a80ab3d0 con 0x7f90a8169c30 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 msgr2=0x7f90940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 0x7f90940697d0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f90a0001ed0 tx=0x7f90a0009040 comp rx=0 tx=0).stop 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 msgr2=0x7f90a81559c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f909c00e570 tx=0x7f909c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 shutdown_connections 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9094067320 0x7f90940697d0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f90a8155f00 0x7f90a8154b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90a813aa90 0x7f90a80ac780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 --2- 172.21.15.33:0/1950969691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90a8169c30 0x7f90a81559c0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 >> 172.21.15.33:0/1950969691 conn(0x7f90a8067f00 msgr2=0x7f90a80b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.159+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 shutdown_connections 2023-10-09T15:37:37.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.160+0000 7f90aff6e700 1 -- 172.21.15.33:0/1950969691 wait complete. 2023-10-09T15:37:37.173 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup' 2023-10-09T15:37:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.292+0000 7f3599b44700 1 Processor -- start 2023-10-09T15:37:37.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.292+0000 7f3599b44700 1 -- start start 2023-10-09T15:37:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f3599b44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f359406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f3599b44700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f359406e7f0 con 0x7f35940a8d00 2023-10-09T15:37:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f3599b44700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35940aeee0 con 0x7f359406e380 2023-10-09T15:37:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f3599b44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35940ae680 con 0x7f35940a90d0 2023-10-09T15:37:37.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35937fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f35940a8d00 0x7f35940cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56838/0 (socket says 172.21.15.33:56838) 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35937fe700 1 -- 172.21.15.33:0/2379576533 learned_addr learned my addr 172.21.15.33:0/2379576533 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f3592ffd700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f359406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 161437114 0 0) 0x7f359406e7f0 con 0x7f35940a8d00 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f357c003570 con 0x7f35940a8d00 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 655663550 0 0) 0x7f357c003570 con 0x7f35940a8d00 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 msgr2=0x7f359406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.293+0000 7f35927fc700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f359406de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 >> v1:172.21.15.59:6789/0 conn(0x7f359406e380 legacy=0x7f35940af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35940cf490 con 0x7f35940a8d00 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f35840015f0 con 0x7f35940a8d00 2023-10-09T15:37:37.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 >> v1:172.21.15.33:6789/0 conn(0x7f35940a8d00 legacy=0x7f35940cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f357c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357c003fd0 0x7f357c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f357c004d50 0x7f357c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35940ae680 con 0x7f357c004d50 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f357c00bb40 con 0x7f357c003fd0 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f357c00bd00 con 0x7f35940a90d0 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f357c004d50 0x7f357c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35937fe700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f357c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3592ffd700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357c003fd0 0x7f357c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 -- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 msgr2=0x7f357c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f35940a90d0 0x7f357c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 -- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357c003fd0 msgr2=0x7f357c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f357c003fd0 0x7f357c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 -- 172.21.15.33:0/2379576533 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f357c003570 con 0x7f357c004d50 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f3593fff700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f357c004d50 0x7f357c0051c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f358c0020a0 tx=0x7f358c0016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=127135e5c34e9b0e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c0019e0 con 0x7f357c004d50 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f358c00c8b0 con 0x7f357c004d50 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.294+0000 7f35927fc700 1 -- 172.21.15.33:0/2379576533 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358c00cc50 con 0x7f357c004d50 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 -- 172.21.15.33:0/2379576533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f357c004d50 msgr2=0x7f357c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 --2- 172.21.15.33:0/2379576533 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f357c004d50 0x7f357c0051c0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f358c0020a0 tx=0x7f358c0016d0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3593fff700 1 -- 172.21.15.33:0/2379576533 reap_dead start 2023-10-09T15:37:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 -- 172.21.15.33:0/2379576533 shutdown_connections 2023-10-09T15:37:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 -- 172.21.15.33:0/2379576533 >> 172.21.15.33:0/2379576533 conn(0x7f359406ce80 msgr2=0x7f35940ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 -- 172.21.15.33:0/2379576533 shutdown_connections 2023-10-09T15:37:37.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.295+0000 7f3599b44700 1 -- 172.21.15.33:0/2379576533 wait complete. 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.296+0000 7f3599b44700 1 Processor -- start 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.296+0000 7f3599b44700 1 -- start start 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3594151060 0x7f35940b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3594151830 0x7f3594158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359416cdd0 con 0x7f3594151430 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f359416d020 con 0x7f3594151060 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3599b44700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f359416d300 con 0x7f3594151830 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.303 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58890/0 (socket says 172.21.15.33:58890) 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 -- 172.21.15.33:0/1322780923 learned_addr learned my addr 172.21.15.33:0/1322780923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3593fff700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3594151830 0x7f3594158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f35937fe700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3594151060 0x7f35940b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 -- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3594151830 msgr2=0x7f3594158240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3594151830 0x7f3594158240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 -- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3594151060 msgr2=0x7f35940b3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3594151060 0x7f35940b3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.297+0000 7f3592ffd700 1 -- 172.21.15.33:0/1322780923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f359416d5e0 con 0x7f3594151430 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f3592ffd700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3588011b40 tx=0x7f3588009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3588005c10 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3588005d70 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f359416d8c0 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f358800f960 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.298+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3594158780 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.299+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35940b2290 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.299+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f358800fd10 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.300+0000 7f357b7fe700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 0x7f3580069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.300+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3588085200 con 0x7f3594151430 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.300+0000 7f35937fe700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 0x7f3580069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.300+0000 7f35937fe700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 0x7f3580069800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3584000ef0 tx=0x7f3584009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.304+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f35940b2290 con 0x7f3594151430 2023-10-09T15:37:37.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.576+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]} v 0) v1 -- 0x7f35940b2290 con 0x7f3594151430 2023-10-09T15:37:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.761+0000 7f357b7fe700 1 -- 172.21.15.33:0/1322780923 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_info_without_subvolumegroup"]}]=0 v322) v1 ==== 156+0+0 (secure 0 0 0) 0x7f35940b2290 con 0x7f3594151430 2023-10-09T15:37:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 msgr2=0x7f3580069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 0x7f3580069800 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f3584000ef0 tx=0x7f3584009040 comp rx=0 tx=0).stop 2023-10-09T15:37:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 msgr2=0x7f3594152350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f3588011b40 tx=0x7f3588009120 comp rx=0 tx=0).stop 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 shutdown_connections 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3580067350 0x7f3580069800 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3594151830 0x7f3594158240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3594151060 0x7f35940b3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 --2- 172.21.15.33:0/1322780923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3594151430 0x7f3594152350 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 >> 172.21.15.33:0/1322780923 conn(0x7f359406ce80 msgr2=0x7f35941593d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 shutdown_connections 2023-10-09T15:37:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.763+0000 7f3599b44700 1 -- 172.21.15.33:0/1322780923 wait complete. 2023-10-09T15:37:37.777 INFO:tasks.cephfs_test_runner:Tests the 'fs volume info' command without subvolume group ... ok 2023-10-09T15:37:37.777 INFO:tasks.cephfs_test_runner:Starting test: test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) That the existing and the newly created volumes can be listed and 2023-10-09T15:37:37.777 INFO:tasks.cephfs_test_runner:test_volume_ls (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:37:37.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-09T15:37:37.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.896+0000 7fdc5dfeb700 1 Processor -- start 2023-10-09T15:37:37.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.896+0000 7fdc5dfeb700 1 -- start start 2023-10-09T15:37:37.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc5dfeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc580cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc5dfeb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdc580cde50 0x7fdc58156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc5dfeb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc5815ae40 con 0x7fdc580cd9e0 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc5dfeb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc580d13f0 con 0x7fdc580cde50 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc5dfeb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5815ab60 con 0x7fdc580cb5a0 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc56ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdc580cd9e0 0x7fdc58159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56844/0 (socket says 172.21.15.33:56844) 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc56ffd700 1 -- 172.21.15.33:0/1170277246 learned_addr learned my addr 172.21.15.33:0/1170277246 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc577fe700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc580cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc57fff700 1 --2- 172.21.15.33:0/1170277246 >> v2:172.21.15.59:3300/0 conn(0x7fdc580cde50 0x7fdc58156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2661429099 0 0) 0x7fdc5815ae40 con 0x7fdc580cd9e0 2023-10-09T15:37:37.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc44003570 con 0x7fdc580cd9e0 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3267279570 0 0) 0x7fdc44003570 con 0x7fdc580cd9e0 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 msgr2=0x7fdc580cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.897+0000 7fdc567fc700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc580cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 >> v2:172.21.15.59:3300/0 conn(0x7fdc580cde50 msgr2=0x7fdc58156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 --2- 172.21.15.33:0/1170277246 >> v2:172.21.15.59:3300/0 conn(0x7fdc580cde50 0x7fdc58156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc580ccf00 con 0x7fdc580cd9e0 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fdc48001470 con 0x7fdc580cd9e0 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 >> v1:172.21.15.33:6789/0 conn(0x7fdc580cd9e0 legacy=0x7fdc58159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc44003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44003fe0 0x7fdc44004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44004d50 0x7fdc440051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc5815ab60 con 0x7fdc44004d50 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4400ba60 con 0x7fdc44003fe0 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc4400bbd0 con 0x7fdc580cb5a0 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44004d50 0x7fdc440051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc577fe700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc44003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc56ffd700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44003fe0 0x7fdc44004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 -- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 msgr2=0x7fdc44003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc580cb5a0 0x7fdc44003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 -- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44003fe0 msgr2=0x7fdc44004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc44003fe0 0x7fdc44004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 -- 172.21.15.33:0/1170277246 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc44003570 con 0x7fdc44004d50 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc57fff700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44004d50 0x7fdc440051c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000e210 tx=0x7fdc5000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60120ec082c66fef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000ea60 con 0x7fdc44004d50 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc5000f040 con 0x7fdc44004d50 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.898+0000 7fdc567fc700 1 -- 172.21.15.33:0/1170277246 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000ee10 con 0x7fdc44004d50 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/1170277246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44004d50 msgr2=0x7fdc440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/1170277246 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc44004d50 0x7fdc440051c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000e210 tx=0x7fdc5000b040 comp rx=0 tx=0).stop 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc57fff700 1 -- 172.21.15.33:0/1170277246 reap_dead start 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/1170277246 shutdown_connections 2023-10-09T15:37:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/1170277246 >> 172.21.15.33:0/1170277246 conn(0x7fdc58070e30 msgr2=0x7fdc580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/1170277246 shutdown_connections 2023-10-09T15:37:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.899+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/1170277246 wait complete. 2023-10-09T15:37:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.900+0000 7fdc5dfeb700 1 Processor -- start 2023-10-09T15:37:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.900+0000 7fdc5dfeb700 1 -- start start 2023-10-09T15:37:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 0x7fdc5816d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 0x7fdc58157f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580ca180 con 0x7fdc580b2010 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580b29d0 con 0x7fdc58154e20 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc5dfeb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc580b5270 con 0x7fdc58169450 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58906/0 (socket says 172.21.15.33:58906) 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 -- 172.21.15.33:0/21765856 learned_addr learned my addr 172.21.15.33:0/21765856 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc56ffd700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 0x7fdc58157f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc577fe700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 0x7fdc5816d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 -- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 msgr2=0x7fdc58157f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 0x7fdc58157f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 -- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 msgr2=0x7fdc5816d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 0x7fdc5816d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 -- 172.21.15.33:0/21765856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc581699a0 con 0x7fdc580b2010 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc56ffd700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 0x7fdc58157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc577fe700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 0x7fdc5816d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.901+0000 7fdc57fff700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdc44004730 tx=0x7fdc5001a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5000ee60 con 0x7fdc580b2010 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc50022070 con 0x7fdc580b2010 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc58169c80 con 0x7fdc580b2010 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc5001e890 con 0x7fdc580b2010 2023-10-09T15:37:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc5816a240 con 0x7fdc580b2010 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.902+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc5804c3c0 con 0x7fdc580b2010 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.903+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdc5001ec80 con 0x7fdc580b2010 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.903+0000 7fdc4f7fe700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 0x7fdc380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.903+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdc50024070 con 0x7fdc580b2010 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.903+0000 7fdc577fe700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 0x7fdc380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.904+0000 7fdc577fe700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 0x7fdc380697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc400093f0 tx=0x7fdc40008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:37.908+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdc50053ea0 con 0x7fdc580b2010 2023-10-09T15:37:38.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.193+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7fdc580cd1e0 con 0x7fdc580b2010 2023-10-09T15:37:38.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.765+0000 7fdc4f7fe700 1 -- 172.21.15.33:0/21765856 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v323) v1 ==== 134+0+0 (secure 0 0 0) 0x7fdc500574c0 con 0x7fdc580b2010 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 msgr2=0x7fdc380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 0x7fdc380697d0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fdc400093f0 tx=0x7fdc40008040 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 msgr2=0x7fdc580b2490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fdc44004730 tx=0x7fdc5001a000 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 shutdown_connections 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdc38067320 0x7fdc380697d0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdc580b2010 0x7fdc580b2490 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdc58154e20 0x7fdc5816d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 --2- 172.21.15.33:0/21765856 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdc58169450 0x7fdc58157f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 >> 172.21.15.33:0/21765856 conn(0x7fdc58070e30 msgr2=0x7fdc580c6ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 shutdown_connections 2023-10-09T15:37:38.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.767+0000 7fdc5dfeb700 1 -- 172.21.15.33:0/21765856 wait complete. 2023-10-09T15:37:38.783 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:37:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.910+0000 7f217f428700 1 Processor -- start 2023-10-09T15:37:38.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.910+0000 7f217f428700 1 -- start start 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217f428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f21780c94e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217f428700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21780b1150 0x7f21780ae050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217f428700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21780adbc0 con 0x7f21780c8bd0 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217f428700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21780c9d30 con 0x7f21780b1150 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217f428700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21780acfb0 con 0x7f21780c8800 2023-10-09T15:37:38.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217d9c5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21780b1150 0x7f21780ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217c9c3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21780c8bd0 0x7f21780b0a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56850/0 (socket says 172.21.15.33:56850) 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.911+0000 7f217c9c3700 1 -- 172.21.15.33:0/2977865904 learned_addr learned my addr 172.21.15.33:0/2977865904 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d1c4700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f21780c94e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d9c5700 1 -- 172.21.15.33:0/2977865904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 msgr2=0x7f21780c94e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d9c5700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f21780c94e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d9c5700 1 -- 172.21.15.33:0/2977865904 >> v1:172.21.15.33:6789/0 conn(0x7f21780c8bd0 legacy=0x7f21780b0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d9c5700 1 -- 172.21.15.33:0/2977865904 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21780ad290 con 0x7f21780b1150 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d1c4700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f21780c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f217d9c5700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f21780ae050 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2168009e60 tx=0x7f2168009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f366c4ae725df1bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f2177fff700 1 -- 172.21.15.33:0/2977865904 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f216800e070 con 0x7f21780b1150 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f2177fff700 1 -- 172.21.15.33:0/2977865904 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f216800bc30 con 0x7f21780b1150 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.912+0000 7f2177fff700 1 -- 172.21.15.33:0/2977865904 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2168012430 con 0x7f21780b1150 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 -- 172.21.15.33:0/2977865904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 msgr2=0x7f21780ae050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f21780ae050 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f2168009e60 tx=0x7f2168009780 comp rx=0 tx=0).stop 2023-10-09T15:37:38.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 -- 172.21.15.33:0/2977865904 shutdown_connections 2023-10-09T15:37:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f21780ae050 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 --2- 172.21.15.33:0/2977865904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f21780c94e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 -- 172.21.15.33:0/2977865904 >> 172.21.15.33:0/2977865904 conn(0x7f217806d170 msgr2=0x7f21780cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 -- 172.21.15.33:0/2977865904 shutdown_connections 2023-10-09T15:37:38.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.913+0000 7f217f428700 1 -- 172.21.15.33:0/2977865904 wait complete. 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.914+0000 7f217f428700 1 Processor -- start 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.914+0000 7f217f428700 1 -- start start 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f2178159110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 0x7f21780a60a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21781515b0 con 0x7f21780b1150 2023-10-09T15:37:38.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2178158c80 con 0x7f21780c8bd0 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217f428700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2178158070 con 0x7f21780c8800 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58912/0 (socket says 172.21.15.33:58912) 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 -- 172.21.15.33:0/1194616456 learned_addr learned my addr 172.21.15.33:0/1194616456 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217c9c3700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f2178159110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d9c5700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 0x7f21780a60a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 -- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 msgr2=0x7f2178159110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f2178159110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 -- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 msgr2=0x7f21780a60a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 0x7f21780a60a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 -- 172.21.15.33:0/1194616456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2168009a20 con 0x7f21780b1150 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217c9c3700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f2178159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d9c5700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 0x7f21780a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f217d1c4700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f217000c850 tx=0x7f2170008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:38.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.915+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170011600 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.916+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2170011760 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.916+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2178158350 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.916+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2170011b00 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.916+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2178158910 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.917+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f217804c3c0 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.917+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f21700073b0 con 0x7f21780b1150 2023-10-09T15:37:38.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.917+0000 7f21757fa700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 0x7f21640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.917+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f2170084a80 con 0x7f21780b1150 2023-10-09T15:37:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.917+0000 7f217c9c3700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 0x7f21640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.918+0000 7f217c9c3700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 0x7f21640697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2178156fb0 tx=0x7f216c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:38.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:38.922+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2170051900 con 0x7f21780b1150 2023-10-09T15:37:39.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.115+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f21780cb2e0 con 0x7f21780b1150 2023-10-09T15:37:39.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.121+0000 7f21757fa700 1 -- 172.21.15.33:0/1194616456 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7f2170054f20 con 0x7f21780b1150 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 msgr2=0x7f21640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 0x7f21640697d0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f2178156fb0 tx=0x7f216c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 msgr2=0x7f2178151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f217000c850 tx=0x7f2170008040 comp rx=0 tx=0).stop 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 shutdown_connections 2023-10-09T15:37:39.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2164067320 0x7f21640697d0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21780b1150 0x7f2178151070 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21780c8bd0 0x7f21780a60a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 --2- 172.21.15.33:0/1194616456 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21780c8800 0x7f2178159110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 >> 172.21.15.33:0/1194616456 conn(0x7f217806d170 msgr2=0x7f21780af8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 shutdown_connections 2023-10-09T15:37:39.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.123+0000 7f217f428700 1 -- 172.21.15.33:0/1194616456 wait complete. 2023-10-09T15:37:39.136 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:37:39.136 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:39.176 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:37:39.218 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:37:39.218 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:37:39.219 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:39.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 Processor -- start 2023-10-09T15:37:39.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 -- start start 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa9d8156f50 0x7fa9d81580b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d8157510 con 0x7fa9d80b0910 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9d80ae2f0 con 0x7fa9d8155b70 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9de3a1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9d80ae5d0 con 0x7fa9d8156f50 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.337+0000 7fa9dc93e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa9d8156f50 0x7fa9d81580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa9d80b0910 0x7fa9d81579a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56858/0 (socket says 172.21.15.33:56858) 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d77fe700 1 -- 172.21.15.33:0/4034199784 learned_addr learned my addr 172.21.15.33:0/4034199784 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9dc93e700 1 -- 172.21.15.33:0/4034199784 >> v1:172.21.15.59:6789/0 conn(0x7fa9d8155b70 legacy=0x7fa9d80b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:39.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9dc93e700 1 -- 172.21.15.33:0/4034199784 >> v1:172.21.15.33:6789/0 conn(0x7fa9d80b0910 legacy=0x7fa9d81579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9dc93e700 1 -- 172.21.15.33:0/4034199784 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d80ae8b0 con 0x7fa9d8156f50 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d6ffd700 1 -- 172.21.15.33:0/4034199784 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2359352127 0 0) 0x7fa9d8157510 con 0x7fa9d80b0910 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9dc93e700 1 --2- 172.21.15.33:0/4034199784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d8156f50 0x7fa9d81580b0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009e60 tx=0x7fa9d0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7ed6176e3817f60 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d6ffd700 1 -- 172.21.15.33:0/4034199784 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d000e070 con 0x7fa9d8156f50 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d6ffd700 1 -- 172.21.15.33:0/4034199784 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d000bbf0 con 0x7fa9d8156f50 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.338+0000 7fa9d6ffd700 1 -- 172.21.15.33:0/4034199784 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d0012430 con 0x7fa9d8156f50 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 -- 172.21.15.33:0/4034199784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d8156f50 msgr2=0x7fa9d81580b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/4034199784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d8156f50 0x7fa9d81580b0 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7fa9d0009e60 tx=0x7fa9d0009780 comp rx=0 tx=0).stop 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 -- 172.21.15.33:0/4034199784 shutdown_connections 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/4034199784 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d8156f50 0x7fa9d81580b0 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 -- 172.21.15.33:0/4034199784 >> 172.21.15.33:0/4034199784 conn(0x7fa9d806d170 msgr2=0x7fa9d80cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 -- 172.21.15.33:0/4034199784 shutdown_connections 2023-10-09T15:37:39.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.339+0000 7fa9de3a1700 1 -- 172.21.15.33:0/4034199784 wait complete. 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.340+0000 7fa9de3a1700 1 Processor -- start 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.340+0000 7fa9de3a1700 1 -- start start 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9d8155b70 0x7fa9d81580a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9d8156f50 0x7fa9d81585e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d814c5b0 con 0x7fa9d80b0910 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d8166840 con 0x7fa9d8155b70 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9d814bc80 con 0x7fa9d8156f50 2023-10-09T15:37:39.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58932/0 (socket says 172.21.15.33:58932) 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 -- 172.21.15.33:0/2838194895 learned_addr learned my addr 172.21.15.33:0/2838194895 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d77fe700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9d8155b70 0x7fa9d81580a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9dc93e700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9d8156f50 0x7fa9d81585e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 -- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9d8156f50 msgr2=0x7fa9d81585e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9d8156f50 0x7fa9d81585e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 -- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9d8155b70 msgr2=0x7fa9d81580a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9d8155b70 0x7fa9d81580a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 -- 172.21.15.33:0/2838194895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d0009a20 con 0x7fa9d80b0910 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9d7fff700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800b600 tx=0x7fa9c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800f510 con 0x7fa9d80b0910 2023-10-09T15:37:39.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9c800f670 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9d814bf60 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9c800fa30 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.341+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9d814ca40 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.342+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9d804c3c0 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.343+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa9c801a400 con 0x7fa9d80b0910 2023-10-09T15:37:39.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.343+0000 7fa9bffff700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 0x7fa9c4069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.343+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(104..104 src has 1..104) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa9c8084410 con 0x7fa9d80b0910 2023-10-09T15:37:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.343+0000 7fa9d77fe700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 0x7fa9c4069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.344+0000 7fa9d77fe700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 0x7fa9c4069800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80acd90 tx=0x7fa9cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.348+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa9c80514a0 con 0x7fa9d80b0910 2023-10-09T15:37:39.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.586+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa9d806be60 con 0x7fa9d80b0910 2023-10-09T15:37:39.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.587+0000 7fa9bffff700 1 -- 172.21.15.33:0/2838194895 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+3523 (secure 0 0 0) 0x7fa9c8054ac0 con 0x7fa9d80b0910 2023-10-09T15:37:39.588 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:39.588 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":70,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6334,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/667255551","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":667255551},{"type":"v1","addr":"172.21.15.59:6834","nonce":667255551}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6337,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/165285930","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":165285930},{"type":"v1","addr":"172.21.15.59:6835","nonce":165285930}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":6792,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2777066434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2777066434},{"type":"v1","addr":"172.21.15.33:6836","nonce":2777066434}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":62},{"gid":7101,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2770273984","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2770273984},{"type":"v1","addr":"172.21.15.33:6837","nonce":2770273984}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":70}],"filesystems":[]} 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 msgr2=0x7fa9c4069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 0x7fa9c4069800 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fa9d80acd90 tx=0x7fa9cc009040 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 msgr2=0x7fa9d8148f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7fa9c800b600 tx=0x7fa9c80091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 shutdown_connections 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa9c4067350 0x7fa9c4069800 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa9d80b0910 0x7fa9d8148f90 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa9d8156f50 0x7fa9d81585e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.588+0000 7fa9de3a1700 1 --2- 172.21.15.33:0/2838194895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa9d8155b70 0x7fa9d81580a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.589+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 >> 172.21.15.33:0/2838194895 conn(0x7fa9d806d170 msgr2=0x7fa9d8069c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:39.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.589+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 shutdown_connections 2023-10-09T15:37:39.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.589+0000 7fa9de3a1700 1 -- 172.21.15.33:0/2838194895 wait complete. 2023-10-09T15:37:39.591 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 70 2023-10-09T15:37:39.602 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:37:39.602 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:37:39.602 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:37:39.602 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:39.603 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:37:39.603 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:37:39.603 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:37:39.603 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:39.603 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:37:39.603 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:37:39.603 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:37:39.603 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:39.604 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:37:39.604 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:37:39.604 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:37:39.604 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:37:39.611 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:37:39.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:37:39.612 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:37:39.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:37:39.615 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:37:39.615 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:37:39.616 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:37:39.616 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:37:39.653 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:37:39.653 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:39.653 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:37:39.654 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:39.657 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:37:39.657 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:39.658 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:37:39.658 DEBUG:teuthology.parallel:result is None 2023-10-09T15:37:39.658 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:37:39.729 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:37:39.729 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:37:39.743 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:37:39.743 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:37:39.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.785+0000 7f7ddd19c700 1 Processor -- start 2023-10-09T15:37:39.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.785+0000 7f7ddd19c700 1 -- start start 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7ddd19c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7ddd19c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7dd806d280 0x7f7dd80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7ddd19c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7dd80ce1a0 con 0x7f7dd80ae780 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7ddd19c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80cd5d0 con 0x7f7dd80a8be0 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7ddd19c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7dd80cd870 con 0x7f7dd806d280 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7dd6d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7dd6d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58948/0 (socket says 172.21.15.33:58948) 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/637105095 learned_addr learned my addr 172.21.15.33:0/637105095 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.786+0000 7f7dd659c700 1 --2- 172.21.15.33:0/637105095 >> v2:172.21.15.59:3300/0 conn(0x7f7dd806d280 0x7f7dd80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/637105095 >> v2:172.21.15.59:3300/0 conn(0x7f7dd806d280 msgr2=0x7f7dd80b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd6d9d700 1 --2- 172.21.15.33:0/637105095 >> v2:172.21.15.59:3300/0 conn(0x7f7dd806d280 0x7f7dd80b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/637105095 >> v1:172.21.15.59:6789/0 conn(0x7f7dd80ae780 legacy=0x7f7dd80aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/637105095 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dd80cdb50 con 0x7f7dd80a8be0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd6d9d700 1 --2- 172.21.15.33:0/637105095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b0f60 tx=0x7f7dc8009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=250ff3f3e072c833 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd5d9b700 1 -- 172.21.15.33:0/637105095 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8005c10 con 0x7f7dd80a8be0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd5d9b700 1 -- 172.21.15.33:0/637105095 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8005d70 con 0x7f7dd80a8be0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7dd5d9b700 1 -- 172.21.15.33:0/637105095 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc8006260 con 0x7f7dd80a8be0 2023-10-09T15:37:39.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7ddd19c700 1 -- 172.21.15.33:0/637105095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd80a8be0 msgr2=0x7f7dd80a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/637105095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b0f60 tx=0x7f7dc8009220 comp rx=0 tx=0).stop 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7ddd19c700 1 -- 172.21.15.33:0/637105095 shutdown_connections 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.787+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/637105095 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd80a8be0 0x7f7dd80a8fb0 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.788+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/637105095 >> v2:172.21.15.59:3300/0 conn(0x7f7dd806d280 0x7f7dd80b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.788+0000 7f7ddd19c700 1 -- 172.21.15.33:0/637105095 >> 172.21.15.33:0/637105095 conn(0x7f7dd806ce80 msgr2=0x7f7dd80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.788+0000 7f7ddd19c700 1 -- 172.21.15.33:0/637105095 shutdown_connections 2023-10-09T15:37:39.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.788+0000 7f7ddd19c700 1 -- 172.21.15.33:0/637105095 wait complete. 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 Processor -- start 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 -- start start 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd80a8be0 0x7f7dd815c510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd80ae780 0x7f7dd80aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8167af0 con 0x7f7dd806d280 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd815d000 con 0x7f7dd80a8be0 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.789+0000 7f7ddd19c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7dd8168610 con 0x7f7dd80ae780 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58950/0 (socket says 172.21.15.33:58950) 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/2246139739 learned_addr learned my addr 172.21.15.33:0/2246139739 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd659c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd80a8be0 0x7f7dd815c510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd759e700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd80ae780 0x7f7dd80aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd80ae780 msgr2=0x7f7dd80aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd80ae780 0x7f7dd80aa8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd80a8be0 msgr2=0x7f7dd815c510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd80a8be0 0x7f7dd815c510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:39.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 -- 172.21.15.33:0/2246139739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7dc8009480 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dd6d9d700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8006360 tx=0x7f7dc8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800b750 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7dc8020070 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7dd8167ce0 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7dc800bb20 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7dd81682a0 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.791+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7dd804c3c0 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.792+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7dc8022030 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.792+0000 7f7dbeffd700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 0x7f7dc40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.792+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7dc80862d0 con 0x7f7dd806d280 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.792+0000 7f7dd659c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 0x7f7dc40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:39.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.793+0000 7f7dd659c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 0x7f7dc40697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b0cf0 tx=0x7f7dcc009120 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:39.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:39.797+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7dc8053470 con 0x7f7dd806d280 2023-10-09T15:37:40.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.003+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7dd8067b20 con 0x7f7dd806d280 2023-10-09T15:37:40.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.788+0000 7f7dbeffd700 1 -- 172.21.15.33:0/2246139739 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v109) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7dc8056a90 con 0x7f7dd806d280 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 msgr2=0x7f7dc40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 0x7f7dc40697d0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f7dd80b0cf0 tx=0x7f7dcc009120 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 msgr2=0x7f7dd8156ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8006360 tx=0x7f7dc8016000 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 shutdown_connections 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7dc4067320 0x7f7dc40697d0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7dd806d280 0x7f7dd8156ce0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7dd80ae780 0x7f7dd80aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 --2- 172.21.15.33:0/2246139739 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7dd80a8be0 0x7f7dd815c510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.790+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 >> 172.21.15.33:0/2246139739 conn(0x7f7dd806ce80 msgr2=0x7f7dd80b1490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.791+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 shutdown_connections 2023-10-09T15:37:40.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.791+0000 7f7ddd19c700 1 -- 172.21.15.33:0/2246139739 wait complete. 2023-10-09T15:37:40.793 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:37:40.806 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:37:40.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.930+0000 7f79befa6700 1 Processor -- start 2023-10-09T15:37:40.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.930+0000 7f79befa6700 1 -- start start 2023-10-09T15:37:40.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79b80cb5a0 0x7f79b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b80cd9e0 0x7f79b8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f79b80cde50 0x7f79b815a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b80d13f0 con 0x7f79b80cb5a0 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79b815a940 con 0x7f79b80cde50 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79befa6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b815ae40 con 0x7f79b80cd9e0 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79b80cb5a0 0x7f79b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f79b80cb5a0 0x7f79b80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35864/0 (socket says 172.21.15.33:35864) 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 -- 172.21.15.33:0/3738712466 learned_addr learned my addr 172.21.15.33:0/3738712466 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79b7fff700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b80cd9e0 0x7f79b8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bd543700 1 --2- 172.21.15.33:0/3738712466 >> v2:172.21.15.59:3300/0 conn(0x7f79b80cde50 0x7f79b815a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 -- 172.21.15.33:0/3738712466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b80cd9e0 msgr2=0x7f79b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b80cd9e0 0x7f79b8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 -- 172.21.15.33:0/3738712466 >> v2:172.21.15.59:3300/0 conn(0x7f79b80cde50 msgr2=0x7f79b815a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3738712466 >> v2:172.21.15.59:3300/0 conn(0x7f79b80cde50 0x7f79b815a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.931+0000 7f79bcd42700 1 -- 172.21.15.33:0/3738712466 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b815ab60 con 0x7f79b80cb5a0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b80cb970 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f79b80cbeb0 tx=0x7f79b0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb5716e597e7d260 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79b77fe700 1 -- 172.21.15.33:0/3738712466 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000b820 con 0x7f79b80cb5a0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79b77fe700 1 -- 172.21.15.33:0/3738712466 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b000b980 con 0x7f79b80cb5a0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79b77fe700 1 -- 172.21.15.33:0/3738712466 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b000bd20 con 0x7f79b80cb5a0 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 -- 172.21.15.33:0/3738712466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 msgr2=0x7f79b80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b80cb970 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7f79b80cbeb0 tx=0x7f79b0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:40.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 -- 172.21.15.33:0/3738712466 shutdown_connections 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 --2- 172.21.15.33:0/3738712466 >> v2:172.21.15.59:3300/0 conn(0x7f79b80cde50 0x7f79b815a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b80cb970 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 --2- 172.21.15.33:0/3738712466 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b80cd9e0 0x7f79b8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 -- 172.21.15.33:0/3738712466 >> 172.21.15.33:0/3738712466 conn(0x7f79b8070e30 msgr2=0x7f79b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 -- 172.21.15.33:0/3738712466 shutdown_connections 2023-10-09T15:37:40.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.932+0000 7f79befa6700 1 -- 172.21.15.33:0/3738712466 wait complete. 2023-10-09T15:37:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.933+0000 7f79befa6700 1 Processor -- start 2023-10-09T15:37:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 -- start start 2023-10-09T15:37:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b80cd9e0 0x7f79b815bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b815de40 0x7f79b80c8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b815c480 con 0x7f79b80cb5a0 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79b80c78f0 con 0x7f79b80cd9e0 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79befa6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79b8169ac0 con 0x7f79b815de40 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79bcd42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79bcd42700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35874/0 (socket says 172.21.15.33:35874) 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.934+0000 7f79bcd42700 1 -- 172.21.15.33:0/3053023030 learned_addr learned my addr 172.21.15.33:0/3053023030 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bd543700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b815de40 0x7f79b80c8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79b7fff700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b80cd9e0 0x7f79b815bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 -- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b815de40 msgr2=0x7f79b80c8960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b815de40 0x7f79b80c8960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 -- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b80cd9e0 msgr2=0x7f79b815bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b80cd9e0 0x7f79b815bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 -- 172.21.15.33:0/3053023030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79b00094f0 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79bcd42700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f79b00094c0 tx=0x7f79b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0024440 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79b00245a0 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79b8169da0 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79b0024940 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.935+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79b816a360 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.936+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79b804c3c0 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.937+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f79b001a420 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.937+0000 7f79b4ff9700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 0x7f79980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.937+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f79b0086740 con 0x7f79b80cb5a0 2023-10-09T15:37:40.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.937+0000 7f79b7fff700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 0x7f79980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:40.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.937+0000 7f79b7fff700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 0x7f79980697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f79b80b2ba0 tx=0x7f79a80097a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:40.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:40.941+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f79b0053720 con 0x7f79b80cb5a0 2023-10-09T15:37:41.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.215+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f79b80ccf00 con 0x7f79b80cb5a0 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.216+0000 7f79b4ff9700 1 -- 172.21.15.33:0/3053023030 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f79b0056d40 con 0x7f79b80cb5a0 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:37:41.217 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.218 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:41.219 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.220 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:37:41.221 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.222 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.223 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:37:41.224 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.225 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.226 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.227 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:41.228 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.229 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.230 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:37:41.231 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:37:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:37:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:41.232 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:37:41.232 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:37:41.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 msgr2=0x7f79980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 0x7f79980697d0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f79b80b2ba0 tx=0x7f79a80097a0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 msgr2=0x7f79b8169490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7f79b00094c0 tx=0x7f79b0017000 comp rx=0 tx=0).stop 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 shutdown_connections 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7998067320 0x7f79980697d0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79b80cb5a0 0x7f79b8169490 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79b815de40 0x7f79b80c8960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 --2- 172.21.15.33:0/3053023030 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79b80cd9e0 0x7f79b815bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 >> 172.21.15.33:0/3053023030 conn(0x7f79b8070e30 msgr2=0x7f79b80d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 shutdown_connections 2023-10-09T15:37:41.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.218+0000 7f79befa6700 1 -- 172.21.15.33:0/3053023030 wait complete. 2023-10-09T15:37:41.235 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:41.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.353+0000 7fdf681ce700 1 Processor -- start 2023-10-09T15:37:41.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 -- start start 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf601598b0 0x7fdf600af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 0x7fdf60163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf600ce9d0 con 0x7fdf60159c80 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf600afc30 con 0x7fdf601598b0 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.354+0000 7fdf681ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600aff10 con 0x7fdf600af790 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdf601598b0 0x7fdf600af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65769700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdf60159c80 0x7fdf600cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47016/0 (socket says 172.21.15.33:47016) 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65769700 1 -- 172.21.15.33:0/3444267211 learned_addr learned my addr 172.21.15.33:0/3444267211 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 -- 172.21.15.33:0/3444267211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 msgr2=0x7fdf60163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf6676b700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 0x7fdf60163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 0x7fdf60163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 -- 172.21.15.33:0/3444267211 >> v1:172.21.15.33:6789/0 conn(0x7fdf60159c80 legacy=0x7fdf600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf64f68700 1 -- 172.21.15.33:0/3444267211 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2674043527 0 0) 0x7fdf600ce9d0 con 0x7fdf60159c80 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 -- 172.21.15.33:0/3444267211 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf600ce380 con 0x7fdf601598b0 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf6676b700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 0x7fdf60163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf65f6a700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600af250 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdf580098e0 tx=0x7fdf580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=514ad093485d1f1f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf64f68700 1 -- 172.21.15.33:0/3444267211 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf58009e80 con 0x7fdf601598b0 2023-10-09T15:37:41.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf64f68700 1 -- 172.21.15.33:0/3444267211 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf5800b860 con 0x7fdf601598b0 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.355+0000 7fdf64f68700 1 -- 172.21.15.33:0/3444267211 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf5800bbe0 con 0x7fdf601598b0 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 -- 172.21.15.33:0/3444267211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 msgr2=0x7fdf600af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600af250 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fdf580098e0 tx=0x7fdf580091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 -- 172.21.15.33:0/3444267211 shutdown_connections 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf600af790 0x7fdf60163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 --2- 172.21.15.33:0/3444267211 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600af250 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 -- 172.21.15.33:0/3444267211 >> 172.21.15.33:0/3444267211 conn(0x7fdf60070e30 msgr2=0x7fdf600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 -- 172.21.15.33:0/3444267211 shutdown_connections 2023-10-09T15:37:41.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.356+0000 7fdf681ce700 1 -- 172.21.15.33:0/3444267211 wait complete. 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.357+0000 7fdf681ce700 1 Processor -- start 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.357+0000 7fdf681ce700 1 -- start start 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf600af790 0x7fdf60153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 0x7fdf6016c910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf60156ef0 con 0x7fdf601598b0 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600b26b0 con 0x7fdf600af790 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf600b2990 con 0x7fdf60159c80 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35898/0 (socket says 172.21.15.33:35898) 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 -- 172.21.15.33:0/295043366 learned_addr learned my addr 172.21.15.33:0/295043366 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf6676b700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 0x7fdf6016c910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65f6a700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf600af790 0x7fdf60153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 -- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 msgr2=0x7fdf6016c910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 0x7fdf6016c910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 -- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf600af790 msgr2=0x7fdf60153960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf600af790 0x7fdf60153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 -- 172.21.15.33:0/295043366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf58009420 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf6676b700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 0x7fdf6016c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf65769700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c5b0 tx=0x7fdf54001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54005b30 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf54005c90 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600b2c70 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.358+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf54007300 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.359+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf60156c60 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.359+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf60157380 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.360+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdf5401b3b0 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.360+0000 7fdf5dffb700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 0x7fdf4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.360+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fdf54083e50 con 0x7fdf601598b0 2023-10-09T15:37:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.360+0000 7fdf65f6a700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 0x7fdf4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.361+0000 7fdf65f6a700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 0x7fdf4c0697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf58003080 tx=0x7fdf58017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.364+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf60157380 con 0x7fdf601598b0 2023-10-09T15:37:41.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.559+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdf60157380 con 0x7fdf601598b0 2023-10-09T15:37:41.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.560+0000 7fdf5dffb700 1 -- 172.21.15.33:0/295043366 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) v1 ==== 74+0+12088 (secure 0 0 0) 0x7fdf60157380 con 0x7fdf601598b0 2023-10-09T15:37:41.561 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:41.561 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":109,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:40.782279+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:41.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 msgr2=0x7fdf4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 0x7fdf4c0697d0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fdf58003080 tx=0x7fdf58017000 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 msgr2=0x7fdf600b5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c5b0 tx=0x7fdf54001070 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 shutdown_connections 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdf4c067320 0x7fdf4c0697d0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf60159c80 0x7fdf6016c910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf600af790 0x7fdf60153960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 --2- 172.21.15.33:0/295043366 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf601598b0 0x7fdf600b5b60 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 >> 172.21.15.33:0/295043366 conn(0x7fdf60070e30 msgr2=0x7fdf60154a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 shutdown_connections 2023-10-09T15:37:41.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.562+0000 7fdf681ce700 1 -- 172.21.15.33:0/295043366 wait complete. 2023-10-09T15:37:41.576 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:37:41.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:37:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.697+0000 7f1cb6dea700 1 Processor -- start 2023-10-09T15:37:41.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.697+0000 7f1cb6dea700 1 -- start start 2023-10-09T15:37:41.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb6dea700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cb00cf110 0x7f1cb015de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb6dea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb015ac50 con 0x7f1cb0153dd0 2023-10-09T15:37:41.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb6dea700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cb015d010 con 0x7f1cb0153a00 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb6dea700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cb015af60 con 0x7f1cb00cf110 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb65e9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1cb00cf110 0x7f1cb015de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb55e7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1cb0153dd0 0x7f1cb00cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47028/0 (socket says 172.21.15.33:47028) 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb55e7700 1 -- 172.21.15.33:0/3976726563 learned_addr learned my addr 172.21.15.33:0/3976726563 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb65e9700 1 -- 172.21.15.33:0/3976726563 >> v1:172.21.15.59:6789/0 conn(0x7f1cb0153a00 legacy=0x7f1cb015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb65e9700 1 -- 172.21.15.33:0/3976726563 >> v1:172.21.15.33:6789/0 conn(0x7f1cb0153dd0 legacy=0x7f1cb00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb65e9700 1 -- 172.21.15.33:0/3976726563 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cb015b240 con 0x7f1cb00cf110 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.698+0000 7f1cb4de6700 1 -- 172.21.15.33:0/3976726563 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1091268334 0 0) 0x7f1cb015ac50 con 0x7f1cb0153dd0 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb65e9700 1 --2- 172.21.15.33:0/3976726563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb015de50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009e60 tx=0x7f1ca8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89720e9c9874a744 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb4de6700 1 -- 172.21.15.33:0/3976726563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca800e070 con 0x7f1cb00cf110 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb4de6700 1 -- 172.21.15.33:0/3976726563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ca800bc30 con 0x7f1cb00cf110 2023-10-09T15:37:41.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb4de6700 1 -- 172.21.15.33:0/3976726563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ca8012430 con 0x7f1cb00cf110 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 -- 172.21.15.33:0/3976726563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 msgr2=0x7f1cb015de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/3976726563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb015de50 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f1ca8009e60 tx=0x7f1ca8009780 comp rx=0 tx=0).stop 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 -- 172.21.15.33:0/3976726563 shutdown_connections 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/3976726563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb015de50 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 -- 172.21.15.33:0/3976726563 >> 172.21.15.33:0/3976726563 conn(0x7f1cb00703a0 msgr2=0x7f1cb00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 -- 172.21.15.33:0/3976726563 shutdown_connections 2023-10-09T15:37:41.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.699+0000 7f1cb6dea700 1 -- 172.21.15.33:0/3976726563 wait complete. 2023-10-09T15:37:41.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 Processor -- start 2023-10-09T15:37:41.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 -- start start 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb0153a00 0x7f1cb00c8ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb0153dd0 0x7f1cb00c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c8b60 con 0x7f1cb00cf110 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c7f50 con 0x7f1cb0153a00 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb6dea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cb00c8230 con 0x7f1cb0153dd0 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.701+0000 7f1cb5de8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35906/0 (socket says 172.21.15.33:35906) 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 -- 172.21.15.33:0/1679400450 learned_addr learned my addr 172.21.15.33:0/1679400450 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb55e7700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb0153a00 0x7f1cb00c8ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb65e9700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb0153dd0 0x7f1cb00c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 -- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb0153dd0 msgr2=0x7f1cb00c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb0153dd0 0x7f1cb00c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 -- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb0153a00 msgr2=0x7f1cb00c8ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb0153a00 0x7f1cb00c8ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 -- 172.21.15.33:0/1679400450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca8009a20 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb5de8700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c590 tx=0x7f1cac00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac011590 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cac011710 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cb00c8510 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cac011ad0 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.702+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cb014c7f0 con 0x7f1cb00cf110 2023-10-09T15:37:41.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.703+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cb004c3c0 con 0x7f1cb00cf110 2023-10-09T15:37:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.704+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1cac01b3b0 con 0x7f1cb00cf110 2023-10-09T15:37:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.704+0000 7f1ca5ffb700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 0x7f1c940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.704+0000 7f1cb55e7700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 0x7f1c940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.704+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f1cac083d50 con 0x7f1cb00cf110 2023-10-09T15:37:41.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.705+0000 7f1cb55e7700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 0x7f1c940697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00cd4c0 tx=0x7f1ca0007f50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:41.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.708+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cac050d30 con 0x7f1cb00cf110 2023-10-09T15:37:41.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.904+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1cb015b520 con 0x7f1cb00cf110 2023-10-09T15:37:41.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.904+0000 7f1ca5ffb700 1 -- 172.21.15.33:0/1679400450 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1cac017070 con 0x7f1cb00cf110 2023-10-09T15:37:41.905 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:37:41.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 msgr2=0x7f1c940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 0x7f1c940697d0 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f1cb00cd4c0 tx=0x7f1ca0007f50 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 msgr2=0x7f1cb014c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f1cac00c590 tx=0x7f1cac00c8a0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 shutdown_connections 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c94067320 0x7f1c940697d0 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1cb00cf110 0x7f1cb014c2b0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cb0153dd0 0x7f1cb00c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 --2- 172.21.15.33:0/1679400450 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cb0153a00 0x7f1cb00c8ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 >> 172.21.15.33:0/1679400450 conn(0x7f1cb00703a0 msgr2=0x7f1cb00d0d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 shutdown_connections 2023-10-09T15:37:41.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:41.906+0000 7f1cb6dea700 1 -- 172.21.15.33:0/1679400450 wait complete. 2023-10-09T15:37:41.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:37:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.038+0000 7f11bd035700 1 Processor -- start 2023-10-09T15:37:42.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.038+0000 7f11bd035700 1 -- start start 2023-10-09T15:37:42.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11b81595d0 0x7f11b81599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 0x7f11b806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f11b806b230 0x7f11b80c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b806bd00 con 0x7f11b81595d0 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11b80c7f50 con 0x7f11b806b230 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11bd035700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b806b740 con 0x7f11b80675a0 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11b81595d0 0x7f11b81599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f11b81595d0 0x7f11b81599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35918/0 (socket says 172.21.15.33:35918) 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 -- 172.21.15.33:0/3293485263 learned_addr learned my addr 172.21.15.33:0/3293485263 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b659c700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 0x7f11b806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b759e700 1 --2- 172.21.15.33:0/3293485263 >> v2:172.21.15.59:3300/0 conn(0x7f11b806b230 0x7f11b80c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 -- 172.21.15.33:0/3293485263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 msgr2=0x7f11b806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 0x7f11b806acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 -- 172.21.15.33:0/3293485263 >> v2:172.21.15.59:3300/0 conn(0x7f11b806b230 msgr2=0x7f11b80c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/3293485263 >> v2:172.21.15.59:3300/0 conn(0x7f11b806b230 0x7f11b80c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b6d9d700 1 -- 172.21.15.33:0/3293485263 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11b806ba20 con 0x7f11b81595d0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.039+0000 7f11b659c700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 0x7f11b806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b81599a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f11b8064a20 tx=0x7f11a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2f4384bf3910a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11b5d9b700 1 -- 172.21.15.33:0/3293485263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a800e070 con 0x7f11b81595d0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11b5d9b700 1 -- 172.21.15.33:0/3293485263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11a800ba50 con 0x7f11b81595d0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11b5d9b700 1 -- 172.21.15.33:0/3293485263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11a80092e0 con 0x7f11b81595d0 2023-10-09T15:37:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 -- 172.21.15.33:0/3293485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 msgr2=0x7f11b81599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b81599a0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f11b8064a20 tx=0x7f11a8009840 comp rx=0 tx=0).stop 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 -- 172.21.15.33:0/3293485263 shutdown_connections 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 --2- 172.21.15.33:0/3293485263 >> v2:172.21.15.59:3300/0 conn(0x7f11b806b230 0x7f11b80c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b81599a0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 --2- 172.21.15.33:0/3293485263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b80675a0 0x7f11b806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 -- 172.21.15.33:0/3293485263 >> 172.21.15.33:0/3293485263 conn(0x7f11b80cd400 msgr2=0x7f11b80cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 -- 172.21.15.33:0/3293485263 shutdown_connections 2023-10-09T15:37:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.040+0000 7f11bd035700 1 -- 172.21.15.33:0/3293485263 wait complete. 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.041+0000 7f11bd035700 1 Processor -- start 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.041+0000 7f11bd035700 1 -- start start 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b80675a0 0x7f11b80b1b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b806b230 0x7f11b81566e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815b9e0 con 0x7f11b81595d0 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815add0 con 0x7f11b80675a0 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11bd035700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11b815b0b0 con 0x7f11b806b230 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11b759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11b759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35932/0 (socket says 172.21.15.33:35932) 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11b759e700 1 -- 172.21.15.33:0/582585391 learned_addr learned my addr 172.21.15.33:0/582585391 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11b659c700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b806b230 0x7f11b81566e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.042+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b80675a0 0x7f11b80b1b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 -- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b806b230 msgr2=0x7f11b81566e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b806b230 0x7f11b81566e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 -- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b80675a0 msgr2=0x7f11b80b1b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b80675a0 0x7f11b80b1b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 -- 172.21.15.33:0/582585391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11a8009ae0 con 0x7f11b81595d0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11b759e700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f11b000d890 tx=0x7f11b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b00125f0 con 0x7f11b81595d0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11b0012750 con 0x7f11b81595d0 2023-10-09T15:37:42.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f11b815b390 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11b0012b10 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.043+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f11b815aa60 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.044+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11b815bb90 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.044+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f11b0013480 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.045+0000 7f11aeffd700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.045+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f11b0084c50 con 0x7f11b81595d0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.045+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.045+0000 7f11b6d9d700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 0x7f11980697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009880 tx=0x7f11a8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.049+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f11b815bb90 con 0x7f11b81595d0 2023-10-09T15:37:42.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.243+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f11b815bd70 con 0x7f11b81595d0 2023-10-09T15:37:42.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.243+0000 7f11aeffd700 1 -- 172.21.15.33:0/582585391 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v109) v1 ==== 84+0+65 (secure 0 0 0) 0x7f11b815bd70 con 0x7f11b81595d0 2023-10-09T15:37:42.244 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:42.244 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:37:42.245 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:42.245 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:37:42.245 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:37:42.245 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:42.245 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:37:42.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 msgr2=0x7f11980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 0x7f11980697d0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f11a8009880 tx=0x7f11a8018000 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 msgr2=0x7f11b8154ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f11b000d890 tx=0x7f11b0008040 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 shutdown_connections 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1198067320 0x7f11980697d0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f11b81595d0 0x7f11b8154ba0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f11b80675a0 0x7f11b80b1b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 --2- 172.21.15.33:0/582585391 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f11b806b230 0x7f11b81566e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 >> 172.21.15.33:0/582585391 conn(0x7f11b80cd400 msgr2=0x7f11b80c30d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 shutdown_connections 2023-10-09T15:37:42.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.245+0000 7f11bd035700 1 -- 172.21.15.33:0/582585391 wait complete. 2023-10-09T15:37:42.258 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:37:42.259 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:37:42.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.380+0000 7f2c5ad1b700 1 Processor -- start 2023-10-09T15:37:42.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.380+0000 7f2c5ad1b700 1 -- start start 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c5ad1b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c541574c0 0x7f2c540ae7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c5ad1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c540c9e40 0x7f2c54157890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c5ad1b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c5415bdd0 con 0x7f2c540aed20 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c5ad1b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c540ca2c0 con 0x7f2c541574c0 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c5ad1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540af1c0 con 0x7f2c540c9e40 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c58ab7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c541574c0 0x7f2c540ae7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c58ab7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2c541574c0 0x7f2c540ae7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35948/0 (socket says 172.21.15.33:35948) 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c58ab7700 1 -- 172.21.15.33:0/2127629959 learned_addr learned my addr 172.21.15.33:0/2127629959 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:42.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.381+0000 7f2c592b8700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c540c9e40 0x7f2c54157890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c58ab7700 1 -- 172.21.15.33:0/2127629959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c540c9e40 msgr2=0x7f2c54157890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c58ab7700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c540c9e40 0x7f2c54157890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c58ab7700 1 -- 172.21.15.33:0/2127629959 >> v1:172.21.15.59:6789/0 conn(0x7f2c540aed20 legacy=0x7f2c540c9730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c58ab7700 1 -- 172.21.15.33:0/2127629959 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c540ca4a0 con 0x7f2c541574c0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c58ab7700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c541574c0 0x7f2c540ae7e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2c440099e0 tx=0x7f2c44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a98ceaa61ed59b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c537fe700 1 -- 172.21.15.33:0/2127629959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400b820 con 0x7f2c541574c0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c537fe700 1 -- 172.21.15.33:0/2127629959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c4400b980 con 0x7f2c541574c0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.382+0000 7f2c537fe700 1 -- 172.21.15.33:0/2127629959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c4400bd20 con 0x7f2c541574c0 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/2127629959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c541574c0 msgr2=0x7f2c540ae7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c541574c0 0x7f2c540ae7e0 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f2c440099e0 tx=0x7f2c44009250 comp rx=0 tx=0).stop 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/2127629959 shutdown_connections 2023-10-09T15:37:42.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c540c9e40 0x7f2c54157890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/2127629959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c541574c0 0x7f2c540ae7e0 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/2127629959 >> 172.21.15.33:0/2127629959 conn(0x7f2c540675a0 msgr2=0x7f2c540679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/2127629959 shutdown_connections 2023-10-09T15:37:42.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.383+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/2127629959 wait complete. 2023-10-09T15:37:42.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.384+0000 7f2c5ad1b700 1 Processor -- start 2023-10-09T15:37:42.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.384+0000 7f2c5ad1b700 1 -- start start 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c540c9e40 0x7f2c540aaaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c541574c0 0x7f2c54141240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540aafe0 con 0x7f2c540aed20 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c540abe00 con 0x7f2c540c9e40 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c54141780 con 0x7f2c541574c0 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35958/0 (socket says 172.21.15.33:35958) 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 -- 172.21.15.33:0/270469371 learned_addr learned my addr 172.21.15.33:0/270469371 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c592b8700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c541574c0 0x7f2c54141240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c53fff700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c540c9e40 0x7f2c540aaaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 -- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c541574c0 msgr2=0x7f2c54141240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c541574c0 0x7f2c54141240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 -- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c540c9e40 msgr2=0x7f2c540aaaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c540c9e40 0x7f2c540aaaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 -- 172.21.15.33:0/270469371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c440094f0 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c58ab7700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009290 tx=0x7f2c44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44011d70 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c44024440 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c44024800 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.385+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c540ab1f0 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.386+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c540ab7b0 con 0x7f2c540aed20 2023-10-09T15:37:42.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.386+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c540cb1a0 con 0x7f2c540aed20 2023-10-09T15:37:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.387+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2c4402d440 con 0x7f2c540aed20 2023-10-09T15:37:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.387+0000 7f2c50ff9700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 0x7f2c400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.387+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(109..109 src has 1..109) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2c44086040 con 0x7f2c540aed20 2023-10-09T15:37:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.387+0000 7f2c53fff700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 0x7f2c400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:42.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.388+0000 7f2c53fff700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 0x7f2c400697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c48003a80 tx=0x7f2c48007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:42.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.391+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2c440b75a0 con 0x7f2c540aed20 2023-10-09T15:37:42.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:42.583+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f2c5404c3c0 con 0x7f2c540aed20 2023-10-09T15:37:43.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.267+0000 7f2c50ff9700 1 -- 172.21.15.33:0/270469371 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v110) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2c440530a0 con 0x7f2c540aed20 2023-10-09T15:37:43.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.270+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 msgr2=0x7f2c400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:43.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.270+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 0x7f2c400697d0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f2c48003a80 tx=0x7f2c48007ec0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.270+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 msgr2=0x7f2c54159f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:43.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.270+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009290 tx=0x7f2c44017000 comp rx=0 tx=0).stop 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 shutdown_connections 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2c40067320 0x7f2c400697d0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2c540aed20 0x7f2c54159f80 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2c541574c0 0x7f2c54141240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 --2- 172.21.15.33:0/270469371 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2c540c9e40 0x7f2c540aaaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 >> 172.21.15.33:0/270469371 conn(0x7f2c540675a0 msgr2=0x7f2c54153e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 shutdown_connections 2023-10-09T15:37:43.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.271+0000 7f2c5ad1b700 1 -- 172.21.15.33:0/270469371 wait complete. 2023-10-09T15:37:43.275 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:37:43.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:37:43.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.422+0000 7fb460399700 1 Processor -- start 2023-10-09T15:37:43.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.422+0000 7fb460399700 1 -- start start 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb4580c8d90 0x7fb45815b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb45806a3e0 0x7fb458157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580cc2e0 con 0x7fb45806a3e0 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4580cce60 con 0x7fb4580c8d90 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb460399700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580cc530 con 0x7fb4580c9160 2023-10-09T15:37:43.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb45806a3e0 0x7fb458157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb45806a3e0 0x7fb458157000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35966/0 (socket says 172.21.15.33:35966) 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 -- 172.21.15.33:0/646491337 learned_addr learned my addr 172.21.15.33:0/646491337 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45e936700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45e135700 1 --2- 172.21.15.33:0/646491337 >> v2:172.21.15.59:3300/0 conn(0x7fb4580c8d90 0x7fb45815b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 -- 172.21.15.33:0/646491337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 msgr2=0x7fb458157540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458157540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 -- 172.21.15.33:0/646491337 >> v2:172.21.15.59:3300/0 conn(0x7fb4580c8d90 msgr2=0x7fb45815b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 --2- 172.21.15.33:0/646491337 >> v2:172.21.15.59:3300/0 conn(0x7fb4580c8d90 0x7fb45815b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 -- 172.21.15.33:0/646491337 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4580cc810 con 0x7fb45806a3e0 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.423+0000 7fb45d934700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb45806a3e0 0x7fb458157000 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cf510 tx=0x7fb44c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70bd48a272e3e25c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb45d133700 1 -- 172.21.15.33:0/646491337 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00b640 con 0x7fb45806a3e0 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb45d133700 1 -- 172.21.15.33:0/646491337 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00b7a0 con 0x7fb45806a3e0 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb45d133700 1 -- 172.21.15.33:0/646491337 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00bb60 con 0x7fb45806a3e0 2023-10-09T15:37:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 -- 172.21.15.33:0/646491337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb45806a3e0 msgr2=0x7fb458157000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb45806a3e0 0x7fb458157000 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cf510 tx=0x7fb44c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 -- 172.21.15.33:0/646491337 shutdown_connections 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 --2- 172.21.15.33:0/646491337 >> v2:172.21.15.59:3300/0 conn(0x7fb4580c8d90 0x7fb45815b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458157540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 --2- 172.21.15.33:0/646491337 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb45806a3e0 0x7fb458157000 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 -- 172.21.15.33:0/646491337 >> 172.21.15.33:0/646491337 conn(0x7fb458067f00 msgr2=0x7fb458068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 -- 172.21.15.33:0/646491337 shutdown_connections 2023-10-09T15:37:43.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.424+0000 7fb460399700 1 -- 172.21.15.33:0/646491337 wait complete. 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.425+0000 7fb460399700 1 Processor -- start 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.425+0000 7fb460399700 1 -- start start 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb45806a3e0 0x7fb4581678e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458159d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4580c55b0 con 0x7fb4580c8d90 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a630 con 0x7fb45806a3e0 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb460399700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb45815a910 con 0x7fb4580c9160 2023-10-09T15:37:43.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb45d934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb45d934700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35974/0 (socket says 172.21.15.33:35974) 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb45d934700 1 -- 172.21.15.33:0/56023539 learned_addr learned my addr 172.21.15.33:0/56023539 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb45e135700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb45806a3e0 0x7fb4581678e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.426+0000 7fb45e936700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458159d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 -- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 msgr2=0x7fb458159d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458159d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 -- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb45806a3e0 msgr2=0x7fb4581678e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb45806a3e0 0x7fb4581678e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 -- 172.21.15.33:0/56023539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb44c0094f0 con 0x7fb4580c8d90 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb45d934700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cf610 tx=0x7fb44c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c00b910 con 0x7fb4580c8d90 2023-10-09T15:37:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb44c00ba70 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4580c5870 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb44c011630 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.427+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4581536b0 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.428+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb45804c3c0 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.429+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb44c0119a0 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.429+0000 7fb4567fc700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 0x7fb4440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.429+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fb44c086960 con 0x7fb4580c8d90 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.429+0000 7fb45e135700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 0x7fb4440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.429+0000 7fb45e135700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 0x7fb4440697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb450009db0 tx=0x7fb4500091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.433+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb44c053850 con 0x7fb4580c8d90 2023-10-09T15:37:43.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:43.625+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fb4580ccaf0 con 0x7fb4580c8d90 2023-10-09T15:37:44.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.273+0000 7fb4567fc700 1 -- 172.21.15.33:0/56023539 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v111) v1 ==== 170+0+0 (secure 0 0 0) 0x7fb44c056e70 con 0x7fb4580c8d90 2023-10-09T15:37:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 msgr2=0x7fb4440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 0x7fb4440697d0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fb450009db0 tx=0x7fb4500091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 msgr2=0x7fb458153170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7fb4580cf610 tx=0x7fb44c017000 comp rx=0 tx=0).stop 2023-10-09T15:37:44.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 shutdown_connections 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb444067320 0x7fb4440697d0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4580c9160 0x7fb458159d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb45806a3e0 0x7fb4581678e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 --2- 172.21.15.33:0/56023539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb4580c8d90 0x7fb458153170 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.288+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 >> 172.21.15.33:0/56023539 conn(0x7fb458067f00 msgr2=0x7fb458069680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.289+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 shutdown_connections 2023-10-09T15:37:44.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.289+0000 7fb460399700 1 -- 172.21.15.33:0/56023539 wait complete. 2023-10-09T15:37:44.293 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:37:44.305 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:37:44.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.429+0000 7facaf78c700 1 Processor -- start 2023-10-09T15:37:44.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.429+0000 7facaf78c700 1 -- start start 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facaf78c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7faca8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facaf78c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca80ccfd0 con 0x7faca806e0e0 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facaf78c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faca815a3d0 con 0x7faca8159530 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facaf78c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca815a6b0 con 0x7faca806dc70 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facadd29700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faca806e0e0 0x7faca80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47044/0 (socket says 172.21.15.33:47044) 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facadd29700 1 -- 172.21.15.33:0/1114004467 learned_addr learned my addr 172.21.15.33:0/1114004467 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7facacd27700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7faca8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2976652846 0 0) 0x7faca80ccfd0 con 0x7faca806e0e0 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac90003570 con 0x7faca806e0e0 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2851145664 0 0) 0x7fac90003570 con 0x7faca806e0e0 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 msgr2=0x7faca8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7faca8159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 >> v1:172.21.15.59:6789/0 conn(0x7faca8159530 legacy=0x7faca80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca815a990 con 0x7faca806e0e0 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7faca0001470 con 0x7faca806e0e0 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 >> v1:172.21.15.33:6789/0 conn(0x7faca806e0e0 legacy=0x7faca80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7fac90003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac90004810 0x7fac90004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7fac900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca815a6b0 con 0x7fac90003a90 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000bb10 con 0x7fac90004810 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.430+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac9000bcd0 con 0x7faca806dc70 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7fac90003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facacd27700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac90004810 0x7fac90004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facadd29700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7fac900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 -- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 msgr2=0x7fac900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca806dc70 0x7fac900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 -- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac90004810 msgr2=0x7fac90004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fac90004810 0x7fac90004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 -- 172.21.15.33:0/1114004467 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac90003570 con 0x7fac90003a90 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7facad528700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7fac90003e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fac98002060 tx=0x7fac980016e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41a36e3b9aa799a0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:44.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac980019f0 con 0x7fac90003a90 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9800c8b0 con 0x7fac90003a90 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.431+0000 7faca7fff700 1 -- 172.21.15.33:0/1114004467 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800cc30 con 0x7fac90003a90 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 -- 172.21.15.33:0/1114004467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 msgr2=0x7fac90003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 --2- 172.21.15.33:0/1114004467 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7fac90003e60 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7fac98002060 tx=0x7fac980016e0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facadd29700 1 -- 172.21.15.33:0/1114004467 reap_dead start 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 -- 172.21.15.33:0/1114004467 shutdown_connections 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 -- 172.21.15.33:0/1114004467 >> 172.21.15.33:0/1114004467 conn(0x7faca80703a0 msgr2=0x7faca80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 -- 172.21.15.33:0/1114004467 shutdown_connections 2023-10-09T15:37:44.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.432+0000 7facaf78c700 1 -- 172.21.15.33:0/1114004467 wait complete. 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.433+0000 7facaf78c700 1 Processor -- start 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.433+0000 7facaf78c700 1 -- start start 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 0x7faca8154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 0x7faca80cd8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca80cde20 con 0x7fac90003a90 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faca8158e10 con 0x7faca8154910 2023-10-09T15:37:44.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facaf78c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faca8155130 con 0x7faca80cd460 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35986/0 (socket says 172.21.15.33:35986) 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 -- 172.21.15.33:0/3512782352 learned_addr learned my addr 172.21.15.33:0/3512782352 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facacd27700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 0x7faca8154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 -- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 msgr2=0x7faca80cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facadd29700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 0x7faca80cd8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 0x7faca80cd8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 -- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 msgr2=0x7faca8154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 0x7faca8154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 -- 172.21.15.33:0/3512782352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faca8158890 con 0x7fac90003a90 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facacd27700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 0x7faca8154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:44.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facadd29700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 0x7faca80cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.434+0000 7facad528700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fac98012f40 tx=0x7fac98015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9800ca20 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac9800cb80 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac9801f640 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faca8158b30 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faca80c8560 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.435+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faca8154ce0 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.436+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fac9801f9f0 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.436+0000 7faca57fa700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 0x7fac940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.436+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5605+0+0 (secure 0 0 0) 0x7fac980868e0 con 0x7fac90003a90 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.437+0000 7facacd27700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 0x7fac940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:44.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.437+0000 7facacd27700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 0x7fac940697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac9c006dc0 tx=0x7fac9c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:44.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.441+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fac980535d0 con 0x7fac90003a90 2023-10-09T15:37:44.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:44.679+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7faca804c3c0 con 0x7fac90003a90 2023-10-09T15:37:45.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.274+0000 7faca57fa700 1 -- 172.21.15.33:0/3512782352 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v72) v1 ==== 174+0+0 (secure 0 0 0) 0x7fac9802c0c0 con 0x7fac90003a90 2023-10-09T15:37:45.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.282+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 msgr2=0x7fac940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.282+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 0x7fac940697d0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fac9c006dc0 tx=0x7fac9c008040 comp rx=0 tx=0).stop 2023-10-09T15:37:45.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.282+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 msgr2=0x7faca80c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.282+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fac98012f40 tx=0x7fac98015000 comp rx=0 tx=0).stop 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 shutdown_connections 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fac94067320 0x7fac940697d0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fac90003a90 0x7faca80c7790 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faca80cd460 0x7faca80cd8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 --2- 172.21.15.33:0/3512782352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faca8154910 0x7faca8154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.284+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 >> 172.21.15.33:0/3512782352 conn(0x7faca80703a0 msgr2=0x7faca815c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:45.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.285+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 shutdown_connections 2023-10-09T15:37:45.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.285+0000 7facaf78c700 1 -- 172.21.15.33:0/3512782352 wait complete. 2023-10-09T15:37:45.297 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 18 and data pool 19 2023-10-09T15:37:45.312 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.432+0000 7f1b17140700 1 Processor -- start 2023-10-09T15:37:45.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.432+0000 7f1b17140700 1 -- start start 2023-10-09T15:37:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b17140700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1b10164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b17140700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1015afd0 con 0x7f1b1015de50 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b17140700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1b1015b2b0 con 0x7f1b10153c30 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b17140700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1015b590 con 0x7f1b100cf110 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1593d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1b1015de50 0x7f1b100cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47058/0 (socket says 172.21.15.33:47058) 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1593d700 1 -- 172.21.15.33:0/791816699 learned_addr learned my addr 172.21.15.33:0/791816699 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1693f700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1b10164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523034984 0 0) 0x7f1b1015afd0 con 0x7f1b1015de50 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1af8003570 con 0x7f1b1015de50 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 474910330 0 0) 0x7f1b1015b2b0 con 0x7f1b10153c30 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.433+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1b1015afd0 con 0x7f1b10153c30 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1684114197 0 0) 0x7f1af8003570 con 0x7f1b1015de50 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 msgr2=0x7f1b10164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:45.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1b10164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 >> v1:172.21.15.59:6789/0 conn(0x7f1b10153c30 legacy=0x7f1b1015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b1015b870 con 0x7f1b1015de50 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1b04001470 con 0x7f1b1015de50 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 >> v1:172.21.15.33:6789/0 conn(0x7f1b1015de50 legacy=0x7f1b100cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1af8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1af8004180 0x7f1af8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004d50 0x7f1af80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b1015b590 con 0x7f1af8004180 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1af800bba0 con 0x7f1af8004d50 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1af800bd60 con 0x7f1b100cf110 2023-10-09T15:37:45.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1af8004180 0x7f1af8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1613e700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1af8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1693f700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004d50 0x7f1af80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 -- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 msgr2=0x7f1af8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100cf110 0x7f1af8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 -- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004d50 msgr2=0x7f1af80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004d50 0x7f1af80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 -- 172.21.15.33:0/791816699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1af8003570 con 0x7f1af8004180 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1693f700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004d50 0x7f1af80051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1593d700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1af8004180 0x7f1af8004810 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c2d0 tx=0x7f1b10159c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb2b18cbc84e609 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b0400cc00 con 0x7f1af8004180 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b0400cd60 con 0x7f1af8004180 2023-10-09T15:37:45.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.434+0000 7f1b1513c700 1 -- 172.21.15.33:0/791816699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b04005b70 con 0x7f1af8004180 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 -- 172.21.15.33:0/791816699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1af8004180 msgr2=0x7f1af8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 --2- 172.21.15.33:0/791816699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1af8004180 0x7f1af8004810 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f1b0400c2d0 tx=0x7f1b10159c60 comp rx=0 tx=0).stop 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b1693f700 1 -- 172.21.15.33:0/791816699 reap_dead start 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 -- 172.21.15.33:0/791816699 shutdown_connections 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 -- 172.21.15.33:0/791816699 >> 172.21.15.33:0/791816699 conn(0x7f1b100703a0 msgr2=0x7f1b100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 -- 172.21.15.33:0/791816699 shutdown_connections 2023-10-09T15:37:45.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.435+0000 7f1b17140700 1 -- 172.21.15.33:0/791816699 wait complete. 2023-10-09T15:37:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.436+0000 7f1b17140700 1 Processor -- start 2023-10-09T15:37:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.436+0000 7f1b17140700 1 -- start start 2023-10-09T15:37:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004180 0x7f1b100c88d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100b32d0 0x7f1b10169a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100c75e0 con 0x7f1b10169fa0 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1b100c8440 con 0x7f1af8004180 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b17140700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1b10152750 con 0x7f1b100b32d0 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36014/0 (socket says 172.21.15.33:36014) 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 -- 172.21.15.33:0/3603617989 learned_addr learned my addr 172.21.15.33:0/3603617989 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1613e700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004180 0x7f1b100c88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 -- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100b32d0 msgr2=0x7f1b10169a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100b32d0 0x7f1b10169a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 -- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004180 msgr2=0x7f1b100c88d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004180 0x7f1b100c88d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 -- 172.21.15.33:0/3603617989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1b100c7830 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b1693f700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1b08011590 tx=0x7f1b08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.437+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08015740 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.438+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b080158a0 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.438+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1b100c7b10 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.438+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b08015c40 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.438+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1b100c80d0 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.438+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1b1004c3c0 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.439+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1b0801e400 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.439+0000 7f1b0e7fc700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.439+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1b08085060 con 0x7f1b10169fa0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.439+0000 7f1b1613e700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.440+0000 7f1b1613e700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1b00002f30 tx=0x7f1b000017a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.444+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1b08051cb0 con 0x7f1b10169fa0 2023-10-09T15:37:45.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.640+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1b100c8580 con 0x7f1b10169fa0 2023-10-09T15:37:45.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.641+0000 7f1b0e7fc700 1 -- 172.21.15.33:0/3603617989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f1b08019090 con 0x7f1b10169fa0 2023-10-09T15:37:45.642 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:45.643 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":112,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:44.681541+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:45.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 msgr2=0x7f1afc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 0x7f1afc0697d0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f1b00002f30 tx=0x7f1b000017a0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 msgr2=0x7f1b100b3900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f1b08011590 tx=0x7f1b08008040 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 shutdown_connections 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1afc067320 0x7f1afc0697d0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1b10169fa0 0x7f1b100b3900 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1af8004180 0x7f1b100c88d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 --2- 172.21.15.33:0/3603617989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1b100b32d0 0x7f1b10169a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 >> 172.21.15.33:0/3603617989 conn(0x7f1b100703a0 msgr2=0x7f1b1015d1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:45.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 shutdown_connections 2023-10-09T15:37:45.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.643+0000 7f1b17140700 1 -- 172.21.15.33:0/3603617989 wait complete. 2023-10-09T15:37:45.657 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:45.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.774+0000 7f30006b4700 1 Processor -- start 2023-10-09T15:37:45.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.774+0000 7f30006b4700 1 -- start start 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.775+0000 7f30006b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.775+0000 7f30006b4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ff80aee90 0x7f2ff80b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.775+0000 7f30006b4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ff80ce1a0 con 0x7f2ff806d280 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.775+0000 7f30006b4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ff80cd5d0 con 0x7f2ff80aee90 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.775+0000 7f30006b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80cd870 con 0x7f2ff80a8be0 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffe450700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ff80aee90 0x7f2ff80b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffe450700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:36912/0 (socket says 172.21.15.33:36912) 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2ff80aee90 0x7f2ff80b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:42930/0 (socket says 172.21.15.33:42930) 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffe450700 1 -- 172.21.15.33:0/639691329 learned_addr learned my addr 172.21.15.33:0/639691329 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 -- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 msgr2=0x7f2ff80a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 -- 172.21.15.33:0/639691329 >> v1:172.21.15.59:6789/0 conn(0x7f2ff806d280 legacy=0x7f2ff80ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 -- 172.21.15.33:0/639691329 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff80cdb50 con 0x7f2ff80aee90 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffd44e700 1 -- 172.21.15.33:0/639691329 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2497096693 0 0) 0x7f2ff80ce1a0 con 0x7f2ff806d280 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffe450700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffec51700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff80aee90 0x7f2ff80b08c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009e60 tx=0x7f2ff4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=557ddf181f8d233a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffd44e700 1 -- 172.21.15.33:0/639691329 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff400e070 con 0x7f2ff80aee90 2023-10-09T15:37:45.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffd44e700 1 -- 172.21.15.33:0/639691329 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ff400bbf0 con 0x7f2ff80aee90 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.776+0000 7f2ffd44e700 1 -- 172.21.15.33:0/639691329 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ff4012430 con 0x7f2ff80aee90 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 -- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff80aee90 msgr2=0x7f2ff80b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff80aee90 0x7f2ff80b08c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f2ff4009e60 tx=0x7f2ff4009780 comp rx=0 tx=0).stop 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 -- 172.21.15.33:0/639691329 shutdown_connections 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff80aee90 0x7f2ff80b08c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 --2- 172.21.15.33:0/639691329 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80a8be0 0x7f2ff80a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 -- 172.21.15.33:0/639691329 >> 172.21.15.33:0/639691329 conn(0x7f2ff806ce80 msgr2=0x7f2ff80ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 -- 172.21.15.33:0/639691329 shutdown_connections 2023-10-09T15:37:45.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.777+0000 7f30006b4700 1 -- 172.21.15.33:0/639691329 wait complete. 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.778+0000 7f30006b4700 1 Processor -- start 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.778+0000 7f30006b4700 1 -- start start 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff806d280 0x7f2ff815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80aee90 0x7f2ff80acc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80c6b30 con 0x7f2ff80a8be0 2023-10-09T15:37:45.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff8168700 con 0x7f2ff806d280 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f30006b4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ff80ab3d0 con 0x7f2ff80aee90 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36030/0 (socket says 172.21.15.33:36030) 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 -- 172.21.15.33:0/2669758888 learned_addr learned my addr 172.21.15.33:0/2669758888 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffec51700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80aee90 0x7f2ff80acc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffe450700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff806d280 0x7f2ff815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 -- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80aee90 msgr2=0x7f2ff80acc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80aee90 0x7f2ff80acc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 -- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff806d280 msgr2=0x7f2ff815a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff806d280 0x7f2ff815a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.779+0000 7f2ffdc4f700 1 -- 172.21.15.33:0/2669758888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff0009480 con 0x7f2ff80a8be0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f2ffdc4f700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8001f00 tx=0x7f2fe8001060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011590 con 0x7f2ff80a8be0 2023-10-09T15:37:45.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fe80116f0 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ff4009a20 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fe8011ab0 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.780+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ff80ab060 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.781+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ff804c3c0 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.781+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2fe801b3b0 con 0x7f2ff80a8be0 2023-10-09T15:37:45.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.781+0000 7f2fee7fc700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 0x7f2fdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:45.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.782+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f2fe8083fd0 con 0x7f2ff80a8be0 2023-10-09T15:37:45.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.782+0000 7f2ffe450700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 0x7f2fdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:45.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.782+0000 7f2ffe450700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 0x7f2fdc0697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009f30 tx=0x7f2ff0009220 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:45.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.786+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2fe8050d10 con 0x7f2ff80a8be0 2023-10-09T15:37:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.977+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2ff80ab510 con 0x7f2ff80a8be0 2023-10-09T15:37:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.978+0000 7f2fee7fc700 1 -- 172.21.15.33:0/2669758888 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v112) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f2fe8017070 con 0x7f2ff80a8be0 2023-10-09T15:37:45.979 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:45.979 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":112,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:44.681541+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 msgr2=0x7f2fdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 0x7f2fdc0697d0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009f30 tx=0x7f2ff0009220 comp rx=0 tx=0).stop 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 msgr2=0x7f2ff81688c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f2fe8001f00 tx=0x7f2fe8001060 comp rx=0 tx=0).stop 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 shutdown_connections 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2fdc067320 0x7f2fdc0697d0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ff80aee90 0x7f2ff80acc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ff806d280 0x7f2ff815a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.980+0000 7f30006b4700 1 --2- 172.21.15.33:0/2669758888 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ff80a8be0 0x7f2ff81688c0 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.981+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 >> 172.21.15.33:0/2669758888 conn(0x7f2ff806ce80 msgr2=0x7f2ff80ce4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.981+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 shutdown_connections 2023-10-09T15:37:45.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:45.981+0000 7f30006b4700 1 -- 172.21.15.33:0/2669758888 wait complete. 2023-10-09T15:37:45.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:37:46.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.115+0000 7fd8f7fff700 1 Processor -- start 2023-10-09T15:37:46.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.115+0000 7fd8f7fff700 1 -- start start 2023-10-09T15:37:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f7fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f80cea00 0x7fd8f80cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f7fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f815ac50 con 0x7fd8f815de50 2023-10-09T15:37:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f7fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f815d010 con 0x7fd8f80cea00 2023-10-09T15:37:46.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f815af60 con 0x7fd8f8153a00 2023-10-09T15:37:46.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.116+0000 7fd8f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f80cea00 0x7fd8f80cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f6ffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8f80cea00 0x7fd8f80cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:42948/0 (socket says 172.21.15.33:42948) 2023-10-09T15:37:46.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f67fc700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fd8f815de50 0x7fd8f815a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:40932/0 (socket says 172.21.15.33:40932) 2023-10-09T15:37:46.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 -- 172.21.15.33:0/898498120 learned_addr learned my addr 172.21.15.33:0/898498120 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 -- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 msgr2=0x7fd8f8153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 -- 172.21.15.33:0/898498120 >> v1:172.21.15.59:6789/0 conn(0x7fd8f815de50 legacy=0x7fd8f815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 -- 172.21.15.33:0/898498120 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f815b240 con 0x7fd8f80cea00 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f5ffb700 1 -- 172.21.15.33:0/898498120 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4167579787 0 0) 0x7fd8f815ac50 con 0x7fd8f815de50 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f6ffd700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f80cee40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009f20 tx=0x7fd8e8009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=cabd29ade70576bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f5ffb700 1 -- 172.21.15.33:0/898498120 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e800e070 con 0x7fd8f80cea00 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f5ffb700 1 -- 172.21.15.33:0/898498120 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e800b9d0 con 0x7fd8f80cea00 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.117+0000 7fd8f5ffb700 1 -- 172.21.15.33:0/898498120 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e80092e0 con 0x7fd8f80cea00 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 -- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 msgr2=0x7fd8f80cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:46.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f80cee40 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fd8e8009f20 tx=0x7fd8e8009840 comp rx=0 tx=0).stop 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 -- 172.21.15.33:0/898498120 shutdown_connections 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f80cee40 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/898498120 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 -- 172.21.15.33:0/898498120 >> 172.21.15.33:0/898498120 conn(0x7fd8f80703a0 msgr2=0x7fd8f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 -- 172.21.15.33:0/898498120 shutdown_connections 2023-10-09T15:37:46.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.118+0000 7fd8f7fff700 1 -- 172.21.15.33:0/898498120 wait complete. 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.119+0000 7fd8f7fff700 1 Processor -- start 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.119+0000 7fd8f7fff700 1 -- start start 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f8153180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c75e0 con 0x7fd8f815de50 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c7830 con 0x7fd8f80cea00 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f7fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f80c7b10 con 0x7fd8f8153a00 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36044/0 (socket says 172.21.15.33:36044) 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 -- 172.21.15.33:0/258024024 learned_addr learned my addr 172.21.15.33:0/258024024 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f6ffd700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f8153180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f67fc700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 -- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 msgr2=0x7fd8f8169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 -- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 msgr2=0x7fd8f8153180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f8153180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.120+0000 7fd8f77fe700 1 -- 172.21.15.33:0/258024024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0009420 con 0x7fd8f815de50 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8f77fe700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b610 tx=0x7fd8e8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8008ad0 con 0x7fd8f815de50 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e8008c30 con 0x7fd8f815de50 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8e8009ae0 con 0x7fd8f815de50 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e8026460 con 0x7fd8f815de50 2023-10-09T15:37:46.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.121+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f81698b0 con 0x7fd8f815de50 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.122+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f804c3c0 con 0x7fd8f815de50 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.122+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd8e8003040 con 0x7fd8f815de50 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.122+0000 7fd8eeffd700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 0x7fd8d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.123+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8e8086b80 con 0x7fd8f815de50 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.123+0000 7fd8f6ffd700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 0x7fd8d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:46.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.123+0000 7fd8f6ffd700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 0x7fd8d80697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009f40 tx=0x7fd8f00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:46.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.127+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8e8053700 con 0x7fd8f815de50 2023-10-09T15:37:46.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:46.369+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fd8f815b520 con 0x7fd8f815de50 2023-10-09T15:37:47.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.296+0000 7fd8eeffd700 1 -- 172.21.15.33:0/258024024 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v74) v1 ==== 118+0+0 (secure 0 0 0) 0x7fd8e8056d20 con 0x7fd8f815de50 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 msgr2=0x7fd8d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 0x7fd8d80697d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0009f40 tx=0x7fd8f00091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 msgr2=0x7fd8f8158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7fd8e800b610 tx=0x7fd8e8018000 comp rx=0 tx=0).stop 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 shutdown_connections 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.298+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8d8067320 0x7fd8d80697d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8f815de50 0x7fd8f8158520 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8f80cea00 0x7fd8f8153180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 --2- 172.21.15.33:0/258024024 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8f8153a00 0x7fd8f8169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 >> 172.21.15.33:0/258024024 conn(0x7fd8f80703a0 msgr2=0x7fd8f80b0420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 shutdown_connections 2023-10-09T15:37:47.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.299+0000 7fd8f7fff700 1 -- 172.21.15.33:0/258024024 wait complete. 2023-10-09T15:37:47.315 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:37:47.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.443+0000 7f794640c700 1 Processor -- start 2023-10-09T15:37:47.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f794640c700 1 -- start start 2023-10-09T15:37:47.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f794640c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 0x7f79400cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f794640c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400c9310 con 0x7f79401598c0 2023-10-09T15:37:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f794640c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79400ce090 con 0x7f7940159c90 2023-10-09T15:37:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f794640c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400ad990 con 0x7f79400c4580 2023-10-09T15:37:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.444+0000 7f793ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f79401598c0 0x7f79400c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47066/0 (socket says 172.21.15.33:47066) 2023-10-09T15:37:47.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793ffff700 1 -- 172.21.15.33:0/2314527161 learned_addr learned my addr 172.21.15.33:0/2314527161 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:47.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793f7fe700 1 --2- 172.21.15.33:0/2314527161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 0x7f79400cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:47.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2106918608 0 0) 0x7f79400c9310 con 0x7f79401598c0 2023-10-09T15:37:47.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7928003570 con 0x7f79401598c0 2023-10-09T15:37:47.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 551806148 0 0) 0x7f79400ce090 con 0x7f7940159c90 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f79400c9310 con 0x7f7940159c90 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793f7fe700 1 -- 172.21.15.33:0/2314527161 >> v1:172.21.15.59:6789/0 conn(0x7f7940159c90 legacy=0x7f79400c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793f7fe700 1 -- 172.21.15.33:0/2314527161 >> v1:172.21.15.33:6789/0 conn(0x7f79401598c0 legacy=0x7f79400c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3910532087 0 0) 0x7f7928003570 con 0x7f79401598c0 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793f7fe700 1 -- 172.21.15.33:0/2314527161 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79400c8cc0 con 0x7f79400c4580 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793f7fe700 1 --2- 172.21.15.33:0/2314527161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 0x7f79400cd460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7934009910 tx=0x7f79340091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5b1821722e18a6a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.445+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930001470 con 0x7f79400c4580 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7934011420 con 0x7f79400c4580 2023-10-09T15:37:47.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f793effd700 1 -- 172.21.15.33:0/2314527161 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79340117c0 con 0x7f79400c4580 2023-10-09T15:37:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 -- 172.21.15.33:0/2314527161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 msgr2=0x7f79400cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 --2- 172.21.15.33:0/2314527161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 0x7f79400cd460 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7934009910 tx=0x7f79340091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 -- 172.21.15.33:0/2314527161 shutdown_connections 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 --2- 172.21.15.33:0/2314527161 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f79400c4580 0x7f79400cd460 secure :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f7934009910 tx=0x7f79340091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 -- 172.21.15.33:0/2314527161 >> 172.21.15.33:0/2314527161 conn(0x7f7940088000 msgr2=0x7f79400883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 -- 172.21.15.33:0/2314527161 shutdown_connections 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.446+0000 7f794640c700 1 -- 172.21.15.33:0/2314527161 wait complete. 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.447+0000 7f794640c700 1 Processor -- start 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.447+0000 7f794640c700 1 -- start start 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 0x7f7940156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:47.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 0x7f79400ac9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400acf30 con 0x7f79401598c0 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79400adad0 con 0x7f79400ac550 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f794640c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79400ae650 con 0x7f7940159c90 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f793ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f793ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36058/0 (socket says 172.21.15.33:36058) 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.448+0000 7f793ffff700 1 -- 172.21.15.33:0/4138895248 learned_addr learned my addr 172.21.15.33:0/4138895248 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793f7fe700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 0x7f7940156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 -- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 msgr2=0x7f7940156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f79449a9700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 0x7f79400ac9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 0x7f7940156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 -- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 msgr2=0x7f79400ac9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 0x7f79400ac9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 -- 172.21.15.33:0/4138895248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7934009420 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793f7fe700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 0x7f7940156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f79449a9700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 0x7f79400ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f793ffff700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f793000cbc0 tx=0x7f7930001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930007360 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79300074e0 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7930004830 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79400add20 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.449+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79400ae2e0 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.450+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f794004c3c0 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.450+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7930004bc0 con 0x7f79401598c0 2023-10-09T15:37:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.451+0000 7f7927fff700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 0x7f792c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.451+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7930084130 con 0x7f79401598c0 2023-10-09T15:37:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.451+0000 7f793f7fe700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 0x7f792c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.451+0000 7f793f7fe700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 0x7f792c0697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f79400b4500 tx=0x7f7934016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.455+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7930050dc0 con 0x7f79401598c0 2023-10-09T15:37:47.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:47.697+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f794006c120 con 0x7f79401598c0 2023-10-09T15:37:48.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.301+0000 7f7927fff700 1 -- 172.21.15.33:0/4138895248 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v75) v1 ==== 122+0+0 (secure 0 0 0) 0x7f79300543e0 con 0x7f79401598c0 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 msgr2=0x7f792c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 0x7f792c0697d0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f79400b4500 tx=0x7f7934016000 comp rx=0 tx=0).stop 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 msgr2=0x7f79400aeae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f793000cbc0 tx=0x7f7930001b50 comp rx=0 tx=0).stop 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 shutdown_connections 2023-10-09T15:37:48.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f792c067320 0x7f792c0697d0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f79401598c0 0x7f79400aeae0 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f79400ac550 0x7f79400ac9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 --2- 172.21.15.33:0/4138895248 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7940159c90 0x7f7940156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 >> 172.21.15.33:0/4138895248 conn(0x7f7940088000 msgr2=0x7f7940158900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 shutdown_connections 2023-10-09T15:37:48.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.304+0000 7f794640c700 1 -- 172.21.15.33:0/4138895248 wait complete. 2023-10-09T15:37:48.320 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.446+0000 7f3fceaaf700 1 Processor -- start 2023-10-09T15:37:48.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.446+0000 7f3fceaaf700 1 -- start start 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fc80cb5a0 0x7f3fc80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc815a400 0x7f3fc8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc80d13f0 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc815ae40 con 0x7f3fc80cb5a0 2023-10-09T15:37:48.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fceaaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815ab60 con 0x7f3fc815a400 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36066/0 (socket says 172.21.15.33:36066) 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 -- 172.21.15.33:0/3964848378 learned_addr learned my addr 172.21.15.33:0/3964848378 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fcd04c700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc815a400 0x7f3fc8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fcc84b700 1 --2- 172.21.15.33:0/3964848378 >> v2:172.21.15.59:3300/0 conn(0x7f3fc80cb5a0 0x7f3fc80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 -- 172.21.15.33:0/3964848378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc815a400 msgr2=0x7f3fc8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc815a400 0x7f3fc8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 -- 172.21.15.33:0/3964848378 >> v2:172.21.15.59:3300/0 conn(0x7f3fc80cb5a0 msgr2=0x7f3fc80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/3964848378 >> v2:172.21.15.59:3300/0 conn(0x7f3fc80cb5a0 0x7f3fc80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 -- 172.21.15.33:0/3964848378 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc80ccf00 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00099b0 tx=0x7f3fb0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea842e9cee139313 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc77fe700 1 -- 172.21.15.33:0/3964848378 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000b820 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc77fe700 1 -- 172.21.15.33:0/3964848378 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb000b980 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.447+0000 7f3fc77fe700 1 -- 172.21.15.33:0/3964848378 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb000bd20 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 -- 172.21.15.33:0/3964848378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80cd9e0 msgr2=0x7f3fc8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f3fb00099b0 tx=0x7f3fb0009250 comp rx=0 tx=0).stop 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 -- 172.21.15.33:0/3964848378 shutdown_connections 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/3964848378 >> v2:172.21.15.59:3300/0 conn(0x7f3fc80cb5a0 0x7f3fc80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc815a400 0x7f3fc8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/3964848378 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80cd9e0 0x7f3fc8159ec0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 -- 172.21.15.33:0/3964848378 >> 172.21.15.33:0/3964848378 conn(0x7f3fc8070e30 msgr2=0x7f3fc80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:48.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 -- 172.21.15.33:0/3964848378 shutdown_connections 2023-10-09T15:37:48.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.448+0000 7f3fceaaf700 1 -- 172.21.15.33:0/3964848378 wait complete. 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.449+0000 7f3fceaaf700 1 Processor -- start 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.449+0000 7f3fceaaf700 1 -- start start 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80cb5a0 0x7f3fc8169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc80cd9e0 0x7f3fc80af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80b4d60 con 0x7f3fc815a400 2023-10-09T15:37:48.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc815c150 con 0x7f3fc80cb5a0 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fceaaf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc80b4a30 con 0x7f3fc80cd9e0 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36070/0 (socket says 172.21.15.33:36070) 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 -- 172.21.15.33:0/1817477535 learned_addr learned my addr 172.21.15.33:0/1817477535 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcc84b700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80cb5a0 0x7f3fc8169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc80cd9e0 0x7f3fc80af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 -- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc80cd9e0 msgr2=0x7f3fc80af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc80cd9e0 0x7f3fc80af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 -- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80cb5a0 msgr2=0x7f3fc8169f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80cb5a0 0x7f3fc8169f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.450+0000 7f3fcd04c700 1 -- 172.21.15.33:0/1817477535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb00094f0 con 0x7f3fc815a400 2023-10-09T15:37:48.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fcd04c700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000d890 tx=0x7f3fc0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc00125f0 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc0012770 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0012b30 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc80c81d0 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.451+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc8166df0 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.452+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc80b4f10 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.452+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fc001e460 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.453+0000 7f3fc4ff9700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.453+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3fc00852a0 con 0x7f3fc815a400 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.453+0000 7f3fcc84b700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.453+0000 7f3fcc84b700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80075a0 tx=0x7f3fb80097a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.457+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fc80b4f10 con 0x7f3fc815a400 2023-10-09T15:37:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.695+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fc80b4f10 con 0x7f3fc815a400 2023-10-09T15:37:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.695+0000 7f3fc4ff9700 1 -- 172.21.15.33:0/1817477535 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f3fc80b4f10 con 0x7f3fc815a400 2023-10-09T15:37:48.696 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:48.696 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":5987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2568149060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2568149060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2568149060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1473081413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1473081413},{"type":"v1","addr":"172.21.15.33:6837","nonce":1473081413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 msgr2=0x7f3fa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3fb80075a0 tx=0x7f3fb80097a0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 msgr2=0x7f3fc81668b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f3fc000d890 tx=0x7f3fc0008040 comp rx=0 tx=0).stop 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 shutdown_connections 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc815a400 0x7f3fc81668b0 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80cb5a0 0x7f3fc8169f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 --2- 172.21.15.33:0/1817477535 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc80cd9e0 0x7f3fc80af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.697+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 >> 172.21.15.33:0/1817477535 conn(0x7f3fc8070e30 msgr2=0x7f3fc80b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.698+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 shutdown_connections 2023-10-09T15:37:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.698+0000 7f3fceaaf700 1 -- 172.21.15.33:0/1817477535 wait complete. 2023-10-09T15:37:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 75 2023-10-09T15:37:48.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:37:48.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.829+0000 7f0169906700 1 Processor -- start 2023-10-09T15:37:48.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.829+0000 7f0169906700 1 -- start start 2023-10-09T15:37:48.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f0169906700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f016406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f0169906700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f016406e380 0x7f01640af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f0169906700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f016406e7f0 con 0x7f01640a8d00 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f0169906700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01640ae680 con 0x7f016406e380 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f0169906700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01640aeee0 con 0x7f01640a90d0 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f01637fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f016406e380 0x7f01640af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f01637fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f016406e380 0x7f01640af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36086/0 (socket says 172.21.15.33:36086) 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.830+0000 7f01637fe700 1 -- 172.21.15.33:0/3874043461 learned_addr learned my addr 172.21.15.33:0/3874043461 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01627fc700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f016406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01637fe700 1 -- 172.21.15.33:0/3874043461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 msgr2=0x7f016406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01637fe700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f016406de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01637fe700 1 -- 172.21.15.33:0/3874043461 >> v1:172.21.15.59:6789/0 conn(0x7f01640a8d00 legacy=0x7f01640cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01637fe700 1 -- 172.21.15.33:0/3874043461 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01640cf490 con 0x7f016406e380 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f01637fe700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f01640af370 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0154009f20 tx=0x7f0154009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3983bb73093a37d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0161ffb700 1 -- 172.21.15.33:0/3874043461 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015400e070 con 0x7f016406e380 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0161ffb700 1 -- 172.21.15.33:0/3874043461 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015400ba40 con 0x7f016406e380 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0161ffb700 1 -- 172.21.15.33:0/3874043461 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01540092e0 con 0x7f016406e380 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0169906700 1 -- 172.21.15.33:0/3874043461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 msgr2=0x7f01640af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0169906700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f01640af370 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f0154009f20 tx=0x7f0154009840 comp rx=0 tx=0).stop 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0169906700 1 -- 172.21.15.33:0/3874043461 shutdown_connections 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0169906700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f01640af370 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.831+0000 7f0169906700 1 --2- 172.21.15.33:0/3874043461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f016406de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.832+0000 7f0169906700 1 -- 172.21.15.33:0/3874043461 >> 172.21.15.33:0/3874043461 conn(0x7f016406ce80 msgr2=0x7f01640ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:48.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.832+0000 7f0169906700 1 -- 172.21.15.33:0/3874043461 shutdown_connections 2023-10-09T15:37:48.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.832+0000 7f0169906700 1 -- 172.21.15.33:0/3874043461 wait complete. 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.833+0000 7f0169906700 1 Processor -- start 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.833+0000 7f0169906700 1 -- start start 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 0x7f016414e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f01640b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01640c3380 con 0x7f016406e380 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f016409a7e0 con 0x7f01640a8d00 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f016409aac0 con 0x7f01640a90d0 2023-10-09T15:37:48.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36100/0 (socket says 172.21.15.33:36100) 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 -- 172.21.15.33:0/3224713121 learned_addr learned my addr 172.21.15.33:0/3224713121 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f01627fc700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 0x7f016414e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f01637fe700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f01640b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 -- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 msgr2=0x7f01640b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f01640b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 -- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 msgr2=0x7f016414e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 0x7f016414e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 -- 172.21.15.33:0/3224713121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0154009ae0 con 0x7f016406e380 2023-10-09T15:37:48.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f01627fc700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 0x7f016414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f01637fe700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f01640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0162ffd700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c5b0 tx=0x7f015c0020e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c011590 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015c0116f0 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f016409ada0 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015c011a90 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.834+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f016414ecd0 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.835+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f016404c3c0 con 0x7f016406e380 2023-10-09T15:37:48.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.836+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f015c01c460 con 0x7f016406e380 2023-10-09T15:37:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.836+0000 7f015affd700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 0x7f01440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.836+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f015c084970 con 0x7f016406e380 2023-10-09T15:37:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.836+0000 7f01627fc700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 0x7f01440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:48.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.837+0000 7f01627fc700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 0x7f01440697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f016416cec0 tx=0x7f014c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:48.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:48.841+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f015c051600 con 0x7f016406e380 2023-10-09T15:37:49.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.035+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0164067b20 con 0x7f016406e380 2023-10-09T15:37:49.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.036+0000 7f015affd700 1 -- 172.21.15.33:0/3224713121 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v113) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f015c054c20 con 0x7f016406e380 2023-10-09T15:37:49.037 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:49.038 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":113,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:37:46.272771+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":111,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 msgr2=0x7f01440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 0x7f01440697d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f016416cec0 tx=0x7f014c008040 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 msgr2=0x7f016409bb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f015c00c5b0 tx=0x7f015c0020e0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 shutdown_connections 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0144067320 0x7f01440697d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f016406e380 0x7f016409bb90 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01640a90d0 0x7f01640b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 --2- 172.21.15.33:0/3224713121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01640a8d00 0x7f016414e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 >> 172.21.15.33:0/3224713121 conn(0x7f016406ce80 msgr2=0x7f01640af370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 shutdown_connections 2023-10-09T15:37:49.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.038+0000 7f0169906700 1 -- 172.21.15.33:0/3224713121 wait complete. 2023-10-09T15:37:49.052 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:37:49.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.170+0000 7ffa682d5700 1 Processor -- start 2023-10-09T15:37:49.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.170+0000 7ffa682d5700 1 -- start start 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa682d5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa682d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa682d5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa600ce9d0 con 0x7ffa60159c80 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa682d5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600afc30 con 0x7ffa601598b0 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa682d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600aff10 con 0x7ffa600af790 2023-10-09T15:37:49.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa66872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa66071700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa66071700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:42982/0 (socket says 172.21.15.33:42982) 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa66872700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:37004/0 (socket says 172.21.15.33:37004) 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa66071700 1 -- 172.21.15.33:0/3570203189 learned_addr learned my addr 172.21.15.33:0/3570203189 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.171+0000 7ffa65870700 1 --1- 172.21.15.33:0/3570203189 >> v1:172.21.15.59:6789/0 conn(0x7ffa60159c80 0x7ffa600cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:40958/0 (socket says 172.21.15.33:40958) 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66872700 1 -- 172.21.15.33:0/3570203189 >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 msgr2=0x7ffa600af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66872700 1 --2- 172.21.15.33:0/3570203189 >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66872700 1 -- 172.21.15.33:0/3570203189 >> v1:172.21.15.59:6789/0 conn(0x7ffa60159c80 legacy=0x7ffa600cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa6506f700 1 -- 172.21.15.33:0/3570203189 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 47683964 0 0) 0x7ffa600ce9d0 con 0x7ffa60159c80 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66872700 1 -- 172.21.15.33:0/3570203189 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600ce380 con 0x7ffa600af790 2023-10-09T15:37:49.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66071700 1 --2- 172.21.15.33:0/3570203189 >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa66872700 1 --2- 172.21.15.33:0/3570203189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e60 tx=0x7ffa50009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6e9171c4634429f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa6506f700 1 -- 172.21.15.33:0/3570203189 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5000e070 con 0x7ffa600af790 2023-10-09T15:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa6506f700 1 -- 172.21.15.33:0/3570203189 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5000bb60 con 0x7ffa600af790 2023-10-09T15:37:49.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.172+0000 7ffa6506f700 1 -- 172.21.15.33:0/3570203189 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa50012430 con 0x7ffa600af790 2023-10-09T15:37:49.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 -- 172.21.15.33:0/3570203189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 msgr2=0x7ffa60163590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 --2- 172.21.15.33:0/3570203189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ffa50009e60 tx=0x7ffa50009780 comp rx=0 tx=0).stop 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 -- 172.21.15.33:0/3570203189 shutdown_connections 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 --2- 172.21.15.33:0/3570203189 >> v2:172.21.15.59:3300/0 conn(0x7ffa601598b0 0x7ffa600af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 --2- 172.21.15.33:0/3570203189 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa60163590 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 -- 172.21.15.33:0/3570203189 >> 172.21.15.33:0/3570203189 conn(0x7ffa60070e30 msgr2=0x7ffa600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 -- 172.21.15.33:0/3570203189 shutdown_connections 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.173+0000 7ffa682d5700 1 -- 172.21.15.33:0/3570203189 wait complete. 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.174+0000 7ffa682d5700 1 Processor -- start 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.174+0000 7ffa682d5700 1 -- start start 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa600b5a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60159c80 0x7ffa6015a880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa601602b0 con 0x7ffa601598b0 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600b4980 con 0x7ffa60159c80 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600b4c60 con 0x7ffa600af790 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa66071700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa600b5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36106/0 (socket says 172.21.15.33:36106) 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 -- 172.21.15.33:0/842776048 learned_addr learned my addr 172.21.15.33:0/842776048 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa66872700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60159c80 0x7ffa6015a880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 -- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 msgr2=0x7ffa600b5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa600b5a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 -- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60159c80 msgr2=0x7ffa6015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60159c80 0x7ffa6015a880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 -- 172.21.15.33:0/842776048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa580094f0 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa66071700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa600b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa65870700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c5b0 tx=0x7ffa54001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54005a70 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54005bd0 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.175+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa50009a20 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.176+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa540070d0 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.176+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600b5220 con 0x7ffa601598b0 2023-10-09T15:37:49.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.177+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa6004c3c0 con 0x7ffa601598b0 2023-10-09T15:37:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.177+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa54007480 con 0x7ffa601598b0 2023-10-09T15:37:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.177+0000 7ffa5e7fc700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.177+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa540840c0 con 0x7ffa601598b0 2023-10-09T15:37:49.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.178+0000 7ffa66071700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.178+0000 7ffa66071700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffa58006d20 tx=0x7ffa58009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.182+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa54050d50 con 0x7ffa601598b0 2023-10-09T15:37:49.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.371+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffa600ce660 con 0x7ffa4c067320 2023-10-09T15:37:49.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.379+0000 7ffa5e7fc700 1 -- 172.21.15.33:0/842776048 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289872 (secure 0 0 0) 0x7ffa600ce660 con 0x7ffa4c067320 2023-10-09T15:37:49.384 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 msgr2=0x7ffa4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7ffa58006d20 tx=0x7ffa58009250 comp rx=0 tx=0).stop 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 msgr2=0x7ffa6015e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c5b0 tx=0x7ffa54001040 comp rx=0 tx=0).stop 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 shutdown_connections 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa60159c80 0x7ffa6015a880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa600af790 0x7ffa600b5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 --2- 172.21.15.33:0/842776048 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa601598b0 0x7ffa6015e090 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.382+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 >> 172.21.15.33:0/842776048 conn(0x7ffa60070e30 msgr2=0x7ffa600d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.383+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 shutdown_connections 2023-10-09T15:37:49.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.383+0000 7ffa682d5700 1 -- 172.21.15.33:0/842776048 wait complete. 2023-10-09T15:37:49.387 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:49.396 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-09T15:37:49.318233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423332,"kb_used_data":12260,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551388,"statfs":{"total":773094113280,"available":770612621312,"internally_reserved":0,"allocated":12554240,"data_stored":6075001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001045"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305035+0000","last_change":"2023-10-09T15:37:45.299829+0000","last_active":"2023-10-09T15:37:45.305035+0000","last_peered":"2023-10-09T15:37:45.305035+0000","last_clean":"2023-10-09T15:37:45.305035+0000","last_became_active":"2023-10-09T15:37:45.299191+0000","last_became_peered":"2023-10-09T15:37:45.299191+0000","last_unstale":"2023-10-09T15:37:45.305035+0000","last_undegraded":"2023-10-09T15:37:45.305035+0000","last_fullsized":"2023-10-09T15:37:45.305035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:00.907520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296996+0000","last_change":"2023-10-09T15:37:45.294029+0000","last_active":"2023-10-09T15:37:45.296996+0000","last_peered":"2023-10-09T15:37:45.296996+0000","last_clean":"2023-10-09T15:37:45.296996+0000","last_became_active":"2023-10-09T15:37:45.293605+0000","last_became_peered":"2023-10-09T15:37:45.293605+0000","last_unstale":"2023-10-09T15:37:45.296996+0000","last_undegraded":"2023-10-09T15:37:45.296996+0000","last_fullsized":"2023-10-09T15:37:45.296996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.313508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300614+0000","last_change":"2023-10-09T15:37:45.292847+0000","last_active":"2023-10-09T15:37:45.300614+0000","last_peered":"2023-10-09T15:37:45.300614+0000","last_clean":"2023-10-09T15:37:45.300614+0000","last_became_active":"2023-10-09T15:37:45.292551+0000","last_became_peered":"2023-10-09T15:37:45.292551+0000","last_unstale":"2023-10-09T15:37:45.300614+0000","last_undegraded":"2023-10-09T15:37:45.300614+0000","last_fullsized":"2023-10-09T15:37:45.300614+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:08.089895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296955+0000","last_change":"2023-10-09T15:37:45.286984+0000","last_active":"2023-10-09T15:37:45.296955+0000","last_peered":"2023-10-09T15:37:45.296955+0000","last_clean":"2023-10-09T15:37:45.296955+0000","last_became_active":"2023-10-09T15:37:45.286687+0000","last_became_peered":"2023-10-09T15:37:45.286687+0000","last_unstale":"2023-10-09T15:37:45.296955+0000","last_undegraded":"2023-10-09T15:37:45.296955+0000","last_fullsized":"2023-10-09T15:37:45.296955+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:28.398889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299827+0000","last_change":"2023-10-09T15:37:45.294624+0000","last_active":"2023-10-09T15:37:45.299827+0000","last_peered":"2023-10-09T15:37:45.299827+0000","last_clean":"2023-10-09T15:37:45.299827+0000","last_became_active":"2023-10-09T15:37:45.294344+0000","last_became_peered":"2023-10-09T15:37:45.294344+0000","last_unstale":"2023-10-09T15:37:45.299827+0000","last_undegraded":"2023-10-09T15:37:45.299827+0000","last_fullsized":"2023-10-09T15:37:45.299827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:24.974322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294253+0000","last_change":"2023-10-09T15:37:45.288689+0000","last_active":"2023-10-09T15:37:45.294253+0000","last_peered":"2023-10-09T15:37:45.294253+0000","last_clean":"2023-10-09T15:37:45.294253+0000","last_became_active":"2023-10-09T15:37:45.288412+0000","last_became_peered":"2023-10-09T15:37:45.288412+0000","last_unstale":"2023-10-09T15:37:45.294253+0000","last_undegraded":"2023-10-09T15:37:45.294253+0000","last_fullsized":"2023-10-09T15:37:45.294253+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:32.595404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294547+0000","last_change":"2023-10-09T15:37:45.290121+0000","last_active":"2023-10-09T15:37:45.294547+0000","last_peered":"2023-10-09T15:37:45.294547+0000","last_clean":"2023-10-09T15:37:45.294547+0000","last_became_active":"2023-10-09T15:37:45.289856+0000","last_became_peered":"2023-10-09T15:37:45.289856+0000","last_unstale":"2023-10-09T15:37:45.294547+0000","last_undegraded":"2023-10-09T15:37:45.294547+0000","last_fullsized":"2023-10-09T15:37:45.294547+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:25.642652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303371+0000","last_change":"2023-10-09T15:37:45.296953+0000","last_active":"2023-10-09T15:37:45.303371+0000","last_peered":"2023-10-09T15:37:45.303371+0000","last_clean":"2023-10-09T15:37:45.303371+0000","last_became_active":"2023-10-09T15:37:45.296669+0000","last_became_peered":"2023-10-09T15:37:45.296669+0000","last_unstale":"2023-10-09T15:37:45.303371+0000","last_undegraded":"2023-10-09T15:37:45.303371+0000","last_fullsized":"2023-10-09T15:37:45.303371+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:19.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300667+0000","last_change":"2023-10-09T15:37:45.293552+0000","last_active":"2023-10-09T15:37:45.300667+0000","last_peered":"2023-10-09T15:37:45.300667+0000","last_clean":"2023-10-09T15:37:45.300667+0000","last_became_active":"2023-10-09T15:37:45.293283+0000","last_became_peered":"2023-10-09T15:37:45.293283+0000","last_unstale":"2023-10-09T15:37:45.300667+0000","last_undegraded":"2023-10-09T15:37:45.300667+0000","last_fullsized":"2023-10-09T15:37:45.300667+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:10.021188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296976+0000","last_change":"2023-10-09T15:37:45.293869+0000","last_active":"2023-10-09T15:37:45.296976+0000","last_peered":"2023-10-09T15:37:45.296976+0000","last_clean":"2023-10-09T15:37:45.296976+0000","last_became_active":"2023-10-09T15:37:45.293244+0000","last_became_peered":"2023-10-09T15:37:45.293244+0000","last_unstale":"2023-10-09T15:37:45.296976+0000","last_undegraded":"2023-10-09T15:37:45.296976+0000","last_fullsized":"2023-10-09T15:37:45.296976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:34:48.768192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302157+0000","last_change":"2023-10-09T15:37:45.296879+0000","last_active":"2023-10-09T15:37:45.302157+0000","last_peered":"2023-10-09T15:37:45.302157+0000","last_clean":"2023-10-09T15:37:45.302157+0000","last_became_active":"2023-10-09T15:37:45.296128+0000","last_became_peered":"2023-10-09T15:37:45.296128+0000","last_unstale":"2023-10-09T15:37:45.302157+0000","last_undegraded":"2023-10-09T15:37:45.302157+0000","last_fullsized":"2023-10-09T15:37:45.302157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:52:46.055116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296210+0000","last_change":"2023-10-09T15:37:45.290989+0000","last_active":"2023-10-09T15:37:45.296210+0000","last_peered":"2023-10-09T15:37:45.296210+0000","last_clean":"2023-10-09T15:37:45.296210+0000","last_became_active":"2023-10-09T15:37:45.290699+0000","last_became_peered":"2023-10-09T15:37:45.290699+0000","last_unstale":"2023-10-09T15:37:45.296210+0000","last_undegraded":"2023-10-09T15:37:45.296210+0000","last_fullsized":"2023-10-09T15:37:45.296210+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304870+0000","last_change":"2023-10-09T15:37:45.299311+0000","last_active":"2023-10-09T15:37:45.304870+0000","last_peered":"2023-10-09T15:37:45.304870+0000","last_clean":"2023-10-09T15:37:45.304870+0000","last_became_active":"2023-10-09T15:37:45.298608+0000","last_became_peered":"2023-10-09T15:37:45.298608+0000","last_unstale":"2023-10-09T15:37:45.304870+0000","last_undegraded":"2023-10-09T15:37:45.304870+0000","last_fullsized":"2023-10-09T15:37:45.304870+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:06.226779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297044+0000","last_change":"2023-10-09T15:37:45.294592+0000","last_active":"2023-10-09T15:37:45.297044+0000","last_peered":"2023-10-09T15:37:45.297044+0000","last_clean":"2023-10-09T15:37:45.297044+0000","last_became_active":"2023-10-09T15:37:45.294299+0000","last_became_peered":"2023-10-09T15:37:45.294299+0000","last_unstale":"2023-10-09T15:37:45.297044+0000","last_undegraded":"2023-10-09T15:37:45.297044+0000","last_fullsized":"2023-10-09T15:37:45.297044+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:19.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305006+0000","last_change":"2023-10-09T15:37:45.300469+0000","last_active":"2023-10-09T15:37:45.305006+0000","last_peered":"2023-10-09T15:37:45.305006+0000","last_clean":"2023-10-09T15:37:45.305006+0000","last_became_active":"2023-10-09T15:37:45.300206+0000","last_became_peered":"2023-10-09T15:37:45.300206+0000","last_unstale":"2023-10-09T15:37:45.305006+0000","last_undegraded":"2023-10-09T15:37:45.305006+0000","last_fullsized":"2023-10-09T15:37:45.305006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:24:23.972451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303054+0000","last_change":"2023-10-09T15:37:45.296723+0000","last_active":"2023-10-09T15:37:45.303054+0000","last_peered":"2023-10-09T15:37:45.303054+0000","last_clean":"2023-10-09T15:37:45.303054+0000","last_became_active":"2023-10-09T15:37:45.296461+0000","last_became_peered":"2023-10-09T15:37:45.296461+0000","last_unstale":"2023-10-09T15:37:45.303054+0000","last_undegraded":"2023-10-09T15:37:45.303054+0000","last_fullsized":"2023-10-09T15:37:45.303054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.249730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295266+0000","last_change":"2023-10-09T15:37:45.292839+0000","last_active":"2023-10-09T15:37:45.295266+0000","last_peered":"2023-10-09T15:37:45.295266+0000","last_clean":"2023-10-09T15:37:45.295266+0000","last_became_active":"2023-10-09T15:37:45.292147+0000","last_became_peered":"2023-10-09T15:37:45.292147+0000","last_unstale":"2023-10-09T15:37:45.295266+0000","last_undegraded":"2023-10-09T15:37:45.295266+0000","last_fullsized":"2023-10-09T15:37:45.295266+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293273+0000","last_change":"2023-10-09T15:37:45.289992+0000","last_active":"2023-10-09T15:37:45.293273+0000","last_peered":"2023-10-09T15:37:45.293273+0000","last_clean":"2023-10-09T15:37:45.293273+0000","last_became_active":"2023-10-09T15:37:45.289739+0000","last_became_peered":"2023-10-09T15:37:45.289739+0000","last_unstale":"2023-10-09T15:37:45.293273+0000","last_undegraded":"2023-10-09T15:37:45.293273+0000","last_fullsized":"2023-10-09T15:37:45.293273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:24.974322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302827+0000","last_change":"2023-10-09T15:37:45.300977+0000","last_active":"2023-10-09T15:37:45.302827+0000","last_peered":"2023-10-09T15:37:45.302827+0000","last_clean":"2023-10-09T15:37:45.302827+0000","last_became_active":"2023-10-09T15:37:45.300592+0000","last_became_peered":"2023-10-09T15:37:45.300592+0000","last_unstale":"2023-10-09T15:37:45.302827+0000","last_undegraded":"2023-10-09T15:37:45.302827+0000","last_fullsized":"2023-10-09T15:37:45.302827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.754604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303023+0000","last_change":"2023-10-09T15:37:45.296534+0000","last_active":"2023-10-09T15:37:45.303023+0000","last_peered":"2023-10-09T15:37:45.303023+0000","last_clean":"2023-10-09T15:37:45.303023+0000","last_became_active":"2023-10-09T15:37:45.291544+0000","last_became_peered":"2023-10-09T15:37:45.291544+0000","last_unstale":"2023-10-09T15:37:45.303023+0000","last_undegraded":"2023-10-09T15:37:45.303023+0000","last_fullsized":"2023-10-09T15:37:45.303023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:14.330598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299845+0000","last_change":"2023-10-09T15:37:45.295957+0000","last_active":"2023-10-09T15:37:45.299845+0000","last_peered":"2023-10-09T15:37:45.299845+0000","last_clean":"2023-10-09T15:37:45.299845+0000","last_became_active":"2023-10-09T15:37:45.295688+0000","last_became_peered":"2023-10-09T15:37:45.295688+0000","last_unstale":"2023-10-09T15:37:45.299845+0000","last_undegraded":"2023-10-09T15:37:45.299845+0000","last_fullsized":"2023-10-09T15:37:45.299845+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:41.713275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302787+0000","last_change":"2023-10-09T15:37:45.298103+0000","last_active":"2023-10-09T15:37:45.302787+0000","last_peered":"2023-10-09T15:37:45.302787+0000","last_clean":"2023-10-09T15:37:45.302787+0000","last_became_active":"2023-10-09T15:37:45.297512+0000","last_became_peered":"2023-10-09T15:37:45.297512+0000","last_unstale":"2023-10-09T15:37:45.302787+0000","last_undegraded":"2023-10-09T15:37:45.302787+0000","last_fullsized":"2023-10-09T15:37:45.302787+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:57.049309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298829+0000","last_change":"2023-10-09T15:37:45.291468+0000","last_active":"2023-10-09T15:37:45.298829+0000","last_peered":"2023-10-09T15:37:45.298829+0000","last_clean":"2023-10-09T15:37:45.298829+0000","last_became_active":"2023-10-09T15:37:45.290881+0000","last_became_peered":"2023-10-09T15:37:45.290881+0000","last_unstale":"2023-10-09T15:37:45.298829+0000","last_undegraded":"2023-10-09T15:37:45.298829+0000","last_fullsized":"2023-10-09T15:37:45.298829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298636+0000","last_change":"2023-10-09T15:37:45.293915+0000","last_active":"2023-10-09T15:37:45.298636+0000","last_peered":"2023-10-09T15:37:45.298636+0000","last_clean":"2023-10-09T15:37:45.298636+0000","last_became_active":"2023-10-09T15:37:45.293614+0000","last_became_peered":"2023-10-09T15:37:45.293614+0000","last_unstale":"2023-10-09T15:37:45.298636+0000","last_undegraded":"2023-10-09T15:37:45.298636+0000","last_fullsized":"2023-10-09T15:37:45.298636+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:29.524289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303397+0000","last_change":"2023-10-09T15:37:45.298765+0000","last_active":"2023-10-09T15:37:45.303397+0000","last_peered":"2023-10-09T15:37:45.303397+0000","last_clean":"2023-10-09T15:37:45.303397+0000","last_became_active":"2023-10-09T15:37:45.298474+0000","last_became_peered":"2023-10-09T15:37:45.298474+0000","last_unstale":"2023-10-09T15:37:45.303397+0000","last_undegraded":"2023-10-09T15:37:45.303397+0000","last_fullsized":"2023-10-09T15:37:45.303397+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:10.021188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303965+0000","last_change":"2023-10-09T15:37:45.300683+0000","last_active":"2023-10-09T15:37:45.303965+0000","last_peered":"2023-10-09T15:37:45.303965+0000","last_clean":"2023-10-09T15:37:45.303965+0000","last_became_active":"2023-10-09T15:37:45.300386+0000","last_became_peered":"2023-10-09T15:37:45.300386+0000","last_unstale":"2023-10-09T15:37:45.303965+0000","last_undegraded":"2023-10-09T15:37:45.303965+0000","last_fullsized":"2023-10-09T15:37:45.303965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:41.713275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296908+0000","last_change":"2023-10-09T15:37:45.291004+0000","last_active":"2023-10-09T15:37:45.296908+0000","last_peered":"2023-10-09T15:37:45.296908+0000","last_clean":"2023-10-09T15:37:45.296908+0000","last_became_active":"2023-10-09T15:37:45.290756+0000","last_became_peered":"2023-10-09T15:37:45.290756+0000","last_unstale":"2023-10-09T15:37:45.296908+0000","last_undegraded":"2023-10-09T15:37:45.296908+0000","last_fullsized":"2023-10-09T15:37:45.296908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:15.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303207+0000","last_change":"2023-10-09T15:37:45.301365+0000","last_active":"2023-10-09T15:37:45.303207+0000","last_peered":"2023-10-09T15:37:45.303207+0000","last_clean":"2023-10-09T15:37:45.303207+0000","last_became_active":"2023-10-09T15:37:45.300973+0000","last_became_peered":"2023-10-09T15:37:45.300973+0000","last_unstale":"2023-10-09T15:37:45.303207+0000","last_undegraded":"2023-10-09T15:37:45.303207+0000","last_fullsized":"2023-10-09T15:37:45.303207+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:17.091714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304899+0000","last_change":"2023-10-09T15:37:45.299485+0000","last_active":"2023-10-09T15:37:45.304899+0000","last_peered":"2023-10-09T15:37:45.304899+0000","last_clean":"2023-10-09T15:37:45.304899+0000","last_became_active":"2023-10-09T15:37:45.299003+0000","last_became_peered":"2023-10-09T15:37:45.299003+0000","last_unstale":"2023-10-09T15:37:45.304899+0000","last_undegraded":"2023-10-09T15:37:45.304899+0000","last_fullsized":"2023-10-09T15:37:45.304899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:40.838569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304985+0000","last_change":"2023-10-09T15:37:45.300259+0000","last_active":"2023-10-09T15:37:45.304985+0000","last_peered":"2023-10-09T15:37:45.304985+0000","last_clean":"2023-10-09T15:37:45.304985+0000","last_became_active":"2023-10-09T15:37:45.299760+0000","last_became_peered":"2023-10-09T15:37:45.299760+0000","last_unstale":"2023-10-09T15:37:45.304985+0000","last_undegraded":"2023-10-09T15:37:45.304985+0000","last_fullsized":"2023-10-09T15:37:45.304985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:13.325394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301337+0000","last_change":"2023-10-09T15:37:45.297940+0000","last_active":"2023-10-09T15:37:45.301337+0000","last_peered":"2023-10-09T15:37:45.301337+0000","last_clean":"2023-10-09T15:37:45.301337+0000","last_became_active":"2023-10-09T15:37:45.297034+0000","last_became_peered":"2023-10-09T15:37:45.297034+0000","last_unstale":"2023-10-09T15:37:45.301337+0000","last_undegraded":"2023-10-09T15:37:45.301337+0000","last_fullsized":"2023-10-09T15:37:45.301337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:22.913860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293182+0000","last_change":"2023-10-09T15:37:45.285153+0000","last_active":"2023-10-09T15:37:45.293182+0000","last_peered":"2023-10-09T15:37:45.293182+0000","last_clean":"2023-10-09T15:37:45.293182+0000","last_became_active":"2023-10-09T15:37:45.284775+0000","last_became_peered":"2023-10-09T15:37:45.284775+0000","last_unstale":"2023-10-09T15:37:45.293182+0000","last_undegraded":"2023-10-09T15:37:45.293182+0000","last_fullsized":"2023-10-09T15:37:45.293182+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:16.221990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299130+0000","last_change":"2023-10-09T15:37:45.294005+0000","last_active":"2023-10-09T15:37:45.299130+0000","last_peered":"2023-10-09T15:37:45.299130+0000","last_clean":"2023-10-09T15:37:45.299130+0000","last_became_active":"2023-10-09T15:37:45.293713+0000","last_became_peered":"2023-10-09T15:37:45.293713+0000","last_unstale":"2023-10-09T15:37:45.299130+0000","last_undegraded":"2023-10-09T15:37:45.299130+0000","last_fullsized":"2023-10-09T15:37:45.299130+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:25.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303085+0000","last_change":"2023-10-09T15:37:44.292942+0000","last_active":"2023-10-09T15:37:45.303085+0000","last_peered":"2023-10-09T15:37:45.303085+0000","last_clean":"2023-10-09T15:37:45.303085+0000","last_became_active":"2023-10-09T15:37:44.292624+0000","last_became_peered":"2023-10-09T15:37:44.292624+0000","last_unstale":"2023-10-09T15:37:45.303085+0000","last_undegraded":"2023-10-09T15:37:45.303085+0000","last_fullsized":"2023-10-09T15:37:45.303085+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:37:59.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303077+0000","last_change":"2023-10-09T15:37:45.299603+0000","last_active":"2023-10-09T15:37:45.303077+0000","last_peered":"2023-10-09T15:37:45.303077+0000","last_clean":"2023-10-09T15:37:45.303077+0000","last_became_active":"2023-10-09T15:37:45.299321+0000","last_became_peered":"2023-10-09T15:37:45.299321+0000","last_unstale":"2023-10-09T15:37:45.303077+0000","last_undegraded":"2023-10-09T15:37:45.303077+0000","last_fullsized":"2023-10-09T15:37:45.303077+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:08.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297733+0000","last_change":"2023-10-09T15:37:44.289863+0000","last_active":"2023-10-09T15:37:45.297733+0000","last_peered":"2023-10-09T15:37:45.297733+0000","last_clean":"2023-10-09T15:37:45.297733+0000","last_became_active":"2023-10-09T15:37:44.289547+0000","last_became_peered":"2023-10-09T15:37:44.289547+0000","last_unstale":"2023-10-09T15:37:45.297733+0000","last_undegraded":"2023-10-09T15:37:45.297733+0000","last_fullsized":"2023-10-09T15:37:45.297733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:09.263107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300423+0000","last_change":"2023-10-09T15:37:45.291619+0000","last_active":"2023-10-09T15:37:45.300423+0000","last_peered":"2023-10-09T15:37:45.300423+0000","last_clean":"2023-10-09T15:37:45.300423+0000","last_became_active":"2023-10-09T15:37:45.291346+0000","last_became_peered":"2023-10-09T15:37:45.291346+0000","last_unstale":"2023-10-09T15:37:45.300423+0000","last_undegraded":"2023-10-09T15:37:45.300423+0000","last_fullsized":"2023-10-09T15:37:45.300423+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:14.330598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301810+0000","last_change":"2023-10-09T15:37:44.282934+0000","last_active":"2023-10-09T15:37:45.301810+0000","last_peered":"2023-10-09T15:37:45.301810+0000","last_clean":"2023-10-09T15:37:45.301810+0000","last_became_active":"2023-10-09T15:37:44.282604+0000","last_became_peered":"2023-10-09T15:37:44.282604+0000","last_unstale":"2023-10-09T15:37:45.301810+0000","last_undegraded":"2023-10-09T15:37:45.301810+0000","last_fullsized":"2023-10-09T15:37:45.301810+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:55.915575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299936+0000","last_change":"2023-10-09T15:37:45.294542+0000","last_active":"2023-10-09T15:37:45.299936+0000","last_peered":"2023-10-09T15:37:45.299936+0000","last_clean":"2023-10-09T15:37:45.299936+0000","last_became_active":"2023-10-09T15:37:45.294220+0000","last_became_peered":"2023-10-09T15:37:45.294220+0000","last_unstale":"2023-10-09T15:37:45.299936+0000","last_undegraded":"2023-10-09T15:37:45.299936+0000","last_fullsized":"2023-10-09T15:37:45.299936+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.249730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301679+0000","last_change":"2023-10-09T15:37:44.291341+0000","last_active":"2023-10-09T15:37:45.301679+0000","last_peered":"2023-10-09T15:37:45.301679+0000","last_clean":"2023-10-09T15:37:45.301679+0000","last_became_active":"2023-10-09T15:37:44.291067+0000","last_became_peered":"2023-10-09T15:37:44.291067+0000","last_unstale":"2023-10-09T15:37:45.301679+0000","last_undegraded":"2023-10-09T15:37:45.301679+0000","last_fullsized":"2023-10-09T15:37:45.301679+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:05.282011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293091+0000","last_change":"2023-10-09T15:37:45.285343+0000","last_active":"2023-10-09T15:37:45.293091+0000","last_peered":"2023-10-09T15:37:45.293091+0000","last_clean":"2023-10-09T15:37:45.293091+0000","last_became_active":"2023-10-09T15:37:45.285045+0000","last_became_peered":"2023-10-09T15:37:45.285045+0000","last_unstale":"2023-10-09T15:37:45.293091+0000","last_undegraded":"2023-10-09T15:37:45.293091+0000","last_fullsized":"2023-10-09T15:37:45.293091+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:52.414216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297335+0000","last_change":"2023-10-09T15:37:44.286017+0000","last_active":"2023-10-09T15:37:45.297335+0000","last_peered":"2023-10-09T15:37:45.297335+0000","last_clean":"2023-10-09T15:37:45.297335+0000","last_became_active":"2023-10-09T15:37:44.285765+0000","last_became_peered":"2023-10-09T15:37:44.285765+0000","last_unstale":"2023-10-09T15:37:45.297335+0000","last_undegraded":"2023-10-09T15:37:45.297335+0000","last_fullsized":"2023-10-09T15:37:45.297335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:22.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295292+0000","last_change":"2023-10-09T15:37:45.293718+0000","last_active":"2023-10-09T15:37:45.295292+0000","last_peered":"2023-10-09T15:37:45.295292+0000","last_clean":"2023-10-09T15:37:45.295292+0000","last_became_active":"2023-10-09T15:37:45.293482+0000","last_became_peered":"2023-10-09T15:37:45.293482+0000","last_unstale":"2023-10-09T15:37:45.295292+0000","last_undegraded":"2023-10-09T15:37:45.295292+0000","last_fullsized":"2023-10-09T15:37:45.295292+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294159+0000","last_change":"2023-10-09T15:37:44.287788+0000","last_active":"2023-10-09T15:37:45.294159+0000","last_peered":"2023-10-09T15:37:45.294159+0000","last_clean":"2023-10-09T15:37:45.294159+0000","last_became_active":"2023-10-09T15:37:44.287502+0000","last_became_peered":"2023-10-09T15:37:44.287502+0000","last_unstale":"2023-10-09T15:37:45.294159+0000","last_undegraded":"2023-10-09T15:37:45.294159+0000","last_fullsized":"2023-10-09T15:37:45.294159+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:24.640590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303353+0000","last_change":"2023-10-09T15:37:45.297074+0000","last_active":"2023-10-09T15:37:45.303353+0000","last_peered":"2023-10-09T15:37:45.303353+0000","last_clean":"2023-10-09T15:37:45.303353+0000","last_became_active":"2023-10-09T15:37:45.296732+0000","last_became_peered":"2023-10-09T15:37:45.296732+0000","last_unstale":"2023-10-09T15:37:45.303353+0000","last_undegraded":"2023-10-09T15:37:45.303353+0000","last_fullsized":"2023-10-09T15:37:45.303353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.313508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.277401+0000","last_change":"2023-10-09T15:37:44.291245+0000","last_active":"2023-10-09T15:37:45.277401+0000","last_peered":"2023-10-09T15:37:45.277401+0000","last_clean":"2023-10-09T15:37:45.277401+0000","last_became_active":"2023-10-09T15:37:44.290970+0000","last_became_peered":"2023-10-09T15:37:44.290970+0000","last_unstale":"2023-10-09T15:37:45.277401+0000","last_undegraded":"2023-10-09T15:37:45.277401+0000","last_fullsized":"2023-10-09T15:37:45.277401+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:58.043333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303426+0000","last_change":"2023-10-09T15:37:45.297971+0000","last_active":"2023-10-09T15:37:45.303426+0000","last_peered":"2023-10-09T15:37:45.303426+0000","last_clean":"2023-10-09T15:37:45.303426+0000","last_became_active":"2023-10-09T15:37:45.297644+0000","last_became_peered":"2023-10-09T15:37:45.297644+0000","last_unstale":"2023-10-09T15:37:45.303426+0000","last_undegraded":"2023-10-09T15:37:45.303426+0000","last_fullsized":"2023-10-09T15:37:45.303426+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:08.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.286389+0000","last_change":"2023-10-09T15:37:44.286756+0000","last_active":"2023-10-09T15:37:45.286389+0000","last_peered":"2023-10-09T15:37:45.286389+0000","last_clean":"2023-10-09T15:37:45.286389+0000","last_became_active":"2023-10-09T15:37:44.286054+0000","last_became_peered":"2023-10-09T15:37:44.286054+0000","last_unstale":"2023-10-09T15:37:45.286389+0000","last_undegraded":"2023-10-09T15:37:45.286389+0000","last_fullsized":"2023-10-09T15:37:45.286389+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:35.702618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304771+0000","last_change":"2023-10-09T15:37:45.296840+0000","last_active":"2023-10-09T15:37:45.304771+0000","last_peered":"2023-10-09T15:37:45.304771+0000","last_clean":"2023-10-09T15:37:45.304771+0000","last_became_active":"2023-10-09T15:37:45.296417+0000","last_became_peered":"2023-10-09T15:37:45.296417+0000","last_unstale":"2023-10-09T15:37:45.304771+0000","last_undegraded":"2023-10-09T15:37:45.304771+0000","last_fullsized":"2023-10-09T15:37:45.304771+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:12.649418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285521+0000","last_change":"2023-10-09T15:37:44.288789+0000","last_active":"2023-10-09T15:37:45.285521+0000","last_peered":"2023-10-09T15:37:45.285521+0000","last_clean":"2023-10-09T15:37:45.285521+0000","last_became_active":"2023-10-09T15:37:44.288361+0000","last_became_peered":"2023-10-09T15:37:44.288361+0000","last_unstale":"2023-10-09T15:37:45.285521+0000","last_undegraded":"2023-10-09T15:37:45.285521+0000","last_fullsized":"2023-10-09T15:37:45.285521+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:27.396828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302105+0000","last_change":"2023-10-09T15:37:45.298115+0000","last_active":"2023-10-09T15:37:45.302105+0000","last_peered":"2023-10-09T15:37:45.302105+0000","last_clean":"2023-10-09T15:37:45.302105+0000","last_became_active":"2023-10-09T15:37:45.297838+0000","last_became_peered":"2023-10-09T15:37:45.297838+0000","last_unstale":"2023-10-09T15:37:45.302105+0000","last_undegraded":"2023-10-09T15:37:45.302105+0000","last_fullsized":"2023-10-09T15:37:45.302105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:58.086915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.276548+0000","last_change":"2023-10-09T15:37:44.287671+0000","last_active":"2023-10-09T15:37:45.276548+0000","last_peered":"2023-10-09T15:37:45.276548+0000","last_clean":"2023-10-09T15:37:45.276548+0000","last_became_active":"2023-10-09T15:37:44.287392+0000","last_became_peered":"2023-10-09T15:37:44.287392+0000","last_unstale":"2023-10-09T15:37:45.276548+0000","last_undegraded":"2023-10-09T15:37:45.276548+0000","last_fullsized":"2023-10-09T15:37:45.276548+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:43.626487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303522+0000","last_change":"2023-10-09T15:37:45.300148+0000","last_active":"2023-10-09T15:37:45.303522+0000","last_peered":"2023-10-09T15:37:45.303522+0000","last_clean":"2023-10-09T15:37:45.303522+0000","last_became_active":"2023-10-09T15:37:45.299150+0000","last_became_peered":"2023-10-09T15:37:45.299150+0000","last_unstale":"2023-10-09T15:37:45.303522+0000","last_undegraded":"2023-10-09T15:37:45.303522+0000","last_fullsized":"2023-10-09T15:37:45.303522+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:25.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298286+0000","last_change":"2023-10-09T15:37:44.288062+0000","last_active":"2023-10-09T15:37:45.298286+0000","last_peered":"2023-10-09T15:37:45.298286+0000","last_clean":"2023-10-09T15:37:45.298286+0000","last_became_active":"2023-10-09T15:37:44.287748+0000","last_became_peered":"2023-10-09T15:37:44.287748+0000","last_unstale":"2023-10-09T15:37:45.298286+0000","last_undegraded":"2023-10-09T15:37:45.298286+0000","last_fullsized":"2023-10-09T15:37:45.298286+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.340098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303456+0000","last_change":"2023-10-09T15:37:45.298776+0000","last_active":"2023-10-09T15:37:45.303456+0000","last_peered":"2023-10-09T15:37:45.303456+0000","last_clean":"2023-10-09T15:37:45.303456+0000","last_became_active":"2023-10-09T15:37:45.298470+0000","last_became_peered":"2023-10-09T15:37:45.298470+0000","last_unstale":"2023-10-09T15:37:45.303456+0000","last_undegraded":"2023-10-09T15:37:45.303456+0000","last_fullsized":"2023-10-09T15:37:45.303456+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:47:57.822026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.306205+0000","last_change":"2023-10-09T15:37:44.291881+0000","last_active":"2023-10-09T15:37:45.306205+0000","last_peered":"2023-10-09T15:37:45.306205+0000","last_clean":"2023-10-09T15:37:45.306205+0000","last_became_active":"2023-10-09T15:37:44.291651+0000","last_became_peered":"2023-10-09T15:37:44.291651+0000","last_unstale":"2023-10-09T15:37:45.306205+0000","last_undegraded":"2023-10-09T15:37:45.306205+0000","last_fullsized":"2023-10-09T15:37:45.306205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:08.676113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302576+0000","last_change":"2023-10-09T15:37:45.293861+0000","last_active":"2023-10-09T15:37:45.302576+0000","last_peered":"2023-10-09T15:37:45.302576+0000","last_clean":"2023-10-09T15:37:45.302576+0000","last_became_active":"2023-10-09T15:37:45.293566+0000","last_became_peered":"2023-10-09T15:37:45.293566+0000","last_unstale":"2023-10-09T15:37:45.302576+0000","last_undegraded":"2023-10-09T15:37:45.302576+0000","last_fullsized":"2023-10-09T15:37:45.302576+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:57.446172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.287820+0000","last_change":"2023-10-09T15:37:44.284661+0000","last_active":"2023-10-09T15:37:45.287820+0000","last_peered":"2023-10-09T15:37:45.287820+0000","last_clean":"2023-10-09T15:37:45.287820+0000","last_became_active":"2023-10-09T15:37:44.284393+0000","last_became_peered":"2023-10-09T15:37:44.284393+0000","last_unstale":"2023-10-09T15:37:45.287820+0000","last_undegraded":"2023-10-09T15:37:45.287820+0000","last_fullsized":"2023-10-09T15:37:45.287820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:00.548239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301715+0000","last_change":"2023-10-09T15:37:45.296520+0000","last_active":"2023-10-09T15:37:45.301715+0000","last_peered":"2023-10-09T15:37:45.301715+0000","last_clean":"2023-10-09T15:37:45.301715+0000","last_became_active":"2023-10-09T15:37:45.296224+0000","last_became_peered":"2023-10-09T15:37:45.296224+0000","last_unstale":"2023-10-09T15:37:45.301715+0000","last_undegraded":"2023-10-09T15:37:45.301715+0000","last_fullsized":"2023-10-09T15:37:45.301715+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:36.504639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.282681+0000","last_change":"2023-10-09T15:37:44.287722+0000","last_active":"2023-10-09T15:37:45.282681+0000","last_peered":"2023-10-09T15:37:45.282681+0000","last_clean":"2023-10-09T15:37:45.282681+0000","last_became_active":"2023-10-09T15:37:44.287484+0000","last_became_peered":"2023-10-09T15:37:44.287484+0000","last_unstale":"2023-10-09T15:37:45.282681+0000","last_undegraded":"2023-10-09T15:37:45.282681+0000","last_fullsized":"2023-10-09T15:37:45.282681+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:39.836507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297102+0000","last_change":"2023-10-09T15:37:45.287609+0000","last_active":"2023-10-09T15:37:45.297102+0000","last_peered":"2023-10-09T15:37:45.297102+0000","last_clean":"2023-10-09T15:37:45.297102+0000","last_became_active":"2023-10-09T15:37:45.287321+0000","last_became_peered":"2023-10-09T15:37:45.287321+0000","last_unstale":"2023-10-09T15:37:45.297102+0000","last_undegraded":"2023-10-09T15:37:45.297102+0000","last_fullsized":"2023-10-09T15:37:45.297102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:36.504639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303655+0000","last_change":"2023-10-09T15:37:44.290775+0000","last_active":"2023-10-09T15:37:45.303655+0000","last_peered":"2023-10-09T15:37:45.303655+0000","last_clean":"2023-10-09T15:37:45.303655+0000","last_became_active":"2023-10-09T15:37:44.290470+0000","last_became_peered":"2023-10-09T15:37:44.290470+0000","last_unstale":"2023-10-09T15:37:45.303655+0000","last_undegraded":"2023-10-09T15:37:45.303655+0000","last_fullsized":"2023-10-09T15:37:45.303655+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:16.089652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303559+0000","last_change":"2023-10-09T15:37:45.299973+0000","last_active":"2023-10-09T15:37:45.303559+0000","last_peered":"2023-10-09T15:37:45.303559+0000","last_clean":"2023-10-09T15:37:45.303559+0000","last_became_active":"2023-10-09T15:37:45.299700+0000","last_became_peered":"2023-10-09T15:37:45.299700+0000","last_unstale":"2023-10-09T15:37:45.303559+0000","last_undegraded":"2023-10-09T15:37:45.303559+0000","last_fullsized":"2023-10-09T15:37:45.303559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:00.494410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299660+0000","last_change":"2023-10-09T15:37:44.287800+0000","last_active":"2023-10-09T15:37:45.299660+0000","last_peered":"2023-10-09T15:37:45.299660+0000","last_clean":"2023-10-09T15:37:45.299660+0000","last_became_active":"2023-10-09T15:37:44.287444+0000","last_became_peered":"2023-10-09T15:37:44.287444+0000","last_unstale":"2023-10-09T15:37:45.299660+0000","last_undegraded":"2023-10-09T15:37:45.299660+0000","last_fullsized":"2023-10-09T15:37:45.299660+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:12.323332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296038+0000","last_change":"2023-10-09T15:37:45.293682+0000","last_active":"2023-10-09T15:37:45.296038+0000","last_peered":"2023-10-09T15:37:45.296038+0000","last_clean":"2023-10-09T15:37:45.296038+0000","last_became_active":"2023-10-09T15:37:45.293302+0000","last_became_peered":"2023-10-09T15:37:45.293302+0000","last_unstale":"2023-10-09T15:37:45.296038+0000","last_undegraded":"2023-10-09T15:37:45.296038+0000","last_fullsized":"2023-10-09T15:37:45.296038+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:03.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300952+0000","last_change":"2023-10-09T15:37:44.288321+0000","last_active":"2023-10-09T15:37:45.300952+0000","last_peered":"2023-10-09T15:37:45.300952+0000","last_clean":"2023-10-09T15:37:45.300952+0000","last_became_active":"2023-10-09T15:37:44.288028+0000","last_became_peered":"2023-10-09T15:37:44.288028+0000","last_unstale":"2023-10-09T15:37:45.300952+0000","last_undegraded":"2023-10-09T15:37:45.300952+0000","last_fullsized":"2023-10-09T15:37:45.300952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:51.412154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296632+0000","last_change":"2023-10-09T15:37:45.289504+0000","last_active":"2023-10-09T15:37:45.296632+0000","last_peered":"2023-10-09T15:37:45.296632+0000","last_clean":"2023-10-09T15:37:45.296632+0000","last_became_active":"2023-10-09T15:37:45.289221+0000","last_became_peered":"2023-10-09T15:37:45.289221+0000","last_unstale":"2023-10-09T15:37:45.296632+0000","last_undegraded":"2023-10-09T15:37:45.296632+0000","last_fullsized":"2023-10-09T15:37:45.296632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:37.633572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296241+0000","last_change":"2023-10-09T15:37:44.283097+0000","last_active":"2023-10-09T15:37:45.296241+0000","last_peered":"2023-10-09T15:37:45.296241+0000","last_clean":"2023-10-09T15:37:45.296241+0000","last_became_active":"2023-10-09T15:37:44.282842+0000","last_became_peered":"2023-10-09T15:37:44.282842+0000","last_unstale":"2023-10-09T15:37:45.296241+0000","last_undegraded":"2023-10-09T15:37:45.296241+0000","last_fullsized":"2023-10-09T15:37:45.296241+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:53.906412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303393+0000","last_change":"2023-10-09T15:37:45.298469+0000","last_active":"2023-10-09T15:37:45.303393+0000","last_peered":"2023-10-09T15:37:45.303393+0000","last_clean":"2023-10-09T15:37:45.303393+0000","last_became_active":"2023-10-09T15:37:45.298201+0000","last_became_peered":"2023-10-09T15:37:45.298201+0000","last_unstale":"2023-10-09T15:37:45.303393+0000","last_undegraded":"2023-10-09T15:37:45.303393+0000","last_fullsized":"2023-10-09T15:37:45.303393+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:01.928861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285526+0000","last_change":"2023-10-09T15:37:44.289845+0000","last_active":"2023-10-09T15:37:45.285526+0000","last_peered":"2023-10-09T15:37:45.285526+0000","last_clean":"2023-10-09T15:37:45.285526+0000","last_became_active":"2023-10-09T15:37:44.289549+0000","last_became_peered":"2023-10-09T15:37:44.289549+0000","last_unstale":"2023-10-09T15:37:45.285526+0000","last_undegraded":"2023-10-09T15:37:45.285526+0000","last_fullsized":"2023-10-09T15:37:45.285526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:04.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304971+0000","last_change":"2023-10-09T15:37:45.300086+0000","last_active":"2023-10-09T15:37:45.304971+0000","last_peered":"2023-10-09T15:37:45.304971+0000","last_clean":"2023-10-09T15:37:45.304971+0000","last_became_active":"2023-10-09T15:37:45.299558+0000","last_became_peered":"2023-10-09T15:37:45.299558+0000","last_unstale":"2023-10-09T15:37:45.304971+0000","last_undegraded":"2023-10-09T15:37:45.304971+0000","last_fullsized":"2023-10-09T15:37:45.304971+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:44.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297589+0000","last_change":"2023-10-09T15:37:44.291101+0000","last_active":"2023-10-09T15:37:45.297589+0000","last_peered":"2023-10-09T15:37:45.297589+0000","last_clean":"2023-10-09T15:37:45.297589+0000","last_became_active":"2023-10-09T15:37:44.290823+0000","last_became_peered":"2023-10-09T15:37:44.290823+0000","last_unstale":"2023-10-09T15:37:45.297589+0000","last_undegraded":"2023-10-09T15:37:45.297589+0000","last_fullsized":"2023-10-09T15:37:45.297589+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:39.836507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293027+0000","last_change":"2023-10-09T15:37:45.289110+0000","last_active":"2023-10-09T15:37:45.293027+0000","last_peered":"2023-10-09T15:37:45.293027+0000","last_clean":"2023-10-09T15:37:45.293027+0000","last_became_active":"2023-10-09T15:37:45.288820+0000","last_became_peered":"2023-10-09T15:37:45.288820+0000","last_unstale":"2023-10-09T15:37:45.293027+0000","last_undegraded":"2023-10-09T15:37:45.293027+0000","last_fullsized":"2023-10-09T15:37:45.293027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:44.628549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275917+0000","last_change":"2023-10-09T15:37:44.286441+0000","last_active":"2023-10-09T15:37:45.275917+0000","last_peered":"2023-10-09T15:37:45.275917+0000","last_clean":"2023-10-09T15:37:45.275917+0000","last_became_active":"2023-10-09T15:37:44.286153+0000","last_became_peered":"2023-10-09T15:37:44.286153+0000","last_unstale":"2023-10-09T15:37:45.275917+0000","last_undegraded":"2023-10-09T15:37:45.275917+0000","last_fullsized":"2023-10-09T15:37:45.275917+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:37:59.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.292558+0000","last_change":"2023-10-09T15:37:45.290588+0000","last_active":"2023-10-09T15:37:45.292558+0000","last_peered":"2023-10-09T15:37:45.292558+0000","last_clean":"2023-10-09T15:37:45.292558+0000","last_became_active":"2023-10-09T15:37:45.290337+0000","last_became_peered":"2023-10-09T15:37:45.290337+0000","last_unstale":"2023-10-09T15:37:45.292558+0000","last_undegraded":"2023-10-09T15:37:45.292558+0000","last_fullsized":"2023-10-09T15:37:45.292558+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:00.494410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275288+0000","last_change":"2023-10-09T15:37:44.286620+0000","last_active":"2023-10-09T15:37:45.275288+0000","last_peered":"2023-10-09T15:37:45.275288+0000","last_clean":"2023-10-09T15:37:45.275288+0000","last_became_active":"2023-10-09T15:37:44.286304+0000","last_became_peered":"2023-10-09T15:37:44.286304+0000","last_unstale":"2023-10-09T15:37:45.275288+0000","last_undegraded":"2023-10-09T15:37:45.275288+0000","last_fullsized":"2023-10-09T15:37:45.275288+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:05.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301358+0000","last_change":"2023-10-09T15:37:45.298109+0000","last_active":"2023-10-09T15:37:45.301358+0000","last_peered":"2023-10-09T15:37:45.301358+0000","last_clean":"2023-10-09T15:37:45.301358+0000","last_became_active":"2023-10-09T15:37:45.297626+0000","last_became_peered":"2023-10-09T15:37:45.297626+0000","last_unstale":"2023-10-09T15:37:45.301358+0000","last_undegraded":"2023-10-09T15:37:45.301358+0000","last_fullsized":"2023-10-09T15:37:45.301358+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.917637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285275+0000","last_change":"2023-10-09T15:37:44.288663+0000","last_active":"2023-10-09T15:37:45.285275+0000","last_peered":"2023-10-09T15:37:45.285275+0000","last_clean":"2023-10-09T15:37:45.285275+0000","last_became_active":"2023-10-09T15:37:44.288098+0000","last_became_peered":"2023-10-09T15:37:44.288098+0000","last_unstale":"2023-10-09T15:37:45.285275+0000","last_undegraded":"2023-10-09T15:37:45.285275+0000","last_fullsized":"2023-10-09T15:37:45.285275+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:23.972260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294695+0000","last_change":"2023-10-09T15:37:45.291320+0000","last_active":"2023-10-09T15:37:45.294695+0000","last_peered":"2023-10-09T15:37:45.294695+0000","last_clean":"2023-10-09T15:37:45.294695+0000","last_became_active":"2023-10-09T15:37:45.290894+0000","last_became_peered":"2023-10-09T15:37:45.290894+0000","last_unstale":"2023-10-09T15:37:45.294695+0000","last_undegraded":"2023-10-09T15:37:45.294695+0000","last_fullsized":"2023-10-09T15:37:45.294695+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:47.661994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297408+0000","last_change":"2023-10-09T15:37:44.287314+0000","last_active":"2023-10-09T15:37:45.297408+0000","last_peered":"2023-10-09T15:37:45.297408+0000","last_clean":"2023-10-09T15:37:45.297408+0000","last_became_active":"2023-10-09T15:37:44.287042+0000","last_became_peered":"2023-10-09T15:37:44.287042+0000","last_unstale":"2023-10-09T15:37:45.297408+0000","last_undegraded":"2023-10-09T15:37:45.297408+0000","last_fullsized":"2023-10-09T15:37:45.297408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:08.409196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305056+0000","last_change":"2023-10-09T15:37:45.300003+0000","last_active":"2023-10-09T15:37:45.305056+0000","last_peered":"2023-10-09T15:37:45.305056+0000","last_clean":"2023-10-09T15:37:45.305056+0000","last_became_active":"2023-10-09T15:37:45.299561+0000","last_became_peered":"2023-10-09T15:37:45.299561+0000","last_unstale":"2023-10-09T15:37:45.305056+0000","last_undegraded":"2023-10-09T15:37:45.305056+0000","last_fullsized":"2023-10-09T15:37:45.305056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:35.999206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.280720+0000","last_change":"2023-10-09T15:37:44.293478+0000","last_active":"2023-10-09T15:37:45.280720+0000","last_peered":"2023-10-09T15:37:45.280720+0000","last_clean":"2023-10-09T15:37:45.280720+0000","last_became_active":"2023-10-09T15:37:44.293201+0000","last_became_peered":"2023-10-09T15:37:44.293201+0000","last_unstale":"2023-10-09T15:37:45.280720+0000","last_undegraded":"2023-10-09T15:37:45.280720+0000","last_fullsized":"2023-10-09T15:37:45.280720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:04.563201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293132+0000","last_change":"2023-10-09T15:37:45.291468+0000","last_active":"2023-10-09T15:37:45.293132+0000","last_peered":"2023-10-09T15:37:45.293132+0000","last_clean":"2023-10-09T15:37:45.293132+0000","last_became_active":"2023-10-09T15:37:45.291174+0000","last_became_peered":"2023-10-09T15:37:45.291174+0000","last_unstale":"2023-10-09T15:37:45.293132+0000","last_undegraded":"2023-10-09T15:37:45.293132+0000","last_fullsized":"2023-10-09T15:37:45.293132+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.286080+0000","last_change":"2023-10-09T15:37:44.286637+0000","last_active":"2023-10-09T15:37:45.286080+0000","last_peered":"2023-10-09T15:37:45.286080+0000","last_clean":"2023-10-09T15:37:45.286080+0000","last_became_active":"2023-10-09T15:37:44.286427+0000","last_became_peered":"2023-10-09T15:37:44.286427+0000","last_unstale":"2023-10-09T15:37:45.286080+0000","last_undegraded":"2023-10-09T15:37:45.286080+0000","last_fullsized":"2023-10-09T15:37:45.286080+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:21:52.035762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294877+0000","last_change":"2023-10-09T15:37:45.288239+0000","last_active":"2023-10-09T15:37:45.294877+0000","last_peered":"2023-10-09T15:37:45.294877+0000","last_clean":"2023-10-09T15:37:45.294877+0000","last_became_active":"2023-10-09T15:37:45.287946+0000","last_became_peered":"2023-10-09T15:37:45.287946+0000","last_unstale":"2023-10-09T15:37:45.294877+0000","last_undegraded":"2023-10-09T15:37:45.294877+0000","last_fullsized":"2023-10-09T15:37:45.294877+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:06.240371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.284887+0000","last_change":"2023-10-09T15:37:44.289557+0000","last_active":"2023-10-09T15:37:45.284887+0000","last_peered":"2023-10-09T15:37:45.284887+0000","last_clean":"2023-10-09T15:37:45.284887+0000","last_became_active":"2023-10-09T15:37:44.289200+0000","last_became_peered":"2023-10-09T15:37:44.289200+0000","last_unstale":"2023-10-09T15:37:45.284887+0000","last_undegraded":"2023-10-09T15:37:45.284887+0000","last_fullsized":"2023-10-09T15:37:45.284887+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:21.911798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299183+0000","last_change":"2023-10-09T15:37:45.290940+0000","last_active":"2023-10-09T15:37:45.299183+0000","last_peered":"2023-10-09T15:37:45.299183+0000","last_clean":"2023-10-09T15:37:45.299183+0000","last_became_active":"2023-10-09T15:37:45.290599+0000","last_became_peered":"2023-10-09T15:37:45.290599+0000","last_unstale":"2023-10-09T15:37:45.299183+0000","last_undegraded":"2023-10-09T15:37:45.299183+0000","last_fullsized":"2023-10-09T15:37:45.299183+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:26.966866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.282710+0000","last_change":"2023-10-09T15:37:44.288797+0000","last_active":"2023-10-09T15:37:45.282710+0000","last_peered":"2023-10-09T15:37:45.282710+0000","last_clean":"2023-10-09T15:37:45.282710+0000","last_became_active":"2023-10-09T15:37:44.288250+0000","last_became_peered":"2023-10-09T15:37:44.288250+0000","last_unstale":"2023-10-09T15:37:45.282710+0000","last_undegraded":"2023-10-09T15:37:45.282710+0000","last_fullsized":"2023-10-09T15:37:45.282710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:26.889256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302097+0000","last_change":"2023-10-09T15:37:45.298057+0000","last_active":"2023-10-09T15:37:45.302097+0000","last_peered":"2023-10-09T15:37:45.302097+0000","last_clean":"2023-10-09T15:37:45.302097+0000","last_became_active":"2023-10-09T15:37:45.297735+0000","last_became_peered":"2023-10-09T15:37:45.297735+0000","last_unstale":"2023-10-09T15:37:45.302097+0000","last_undegraded":"2023-10-09T15:37:45.302097+0000","last_fullsized":"2023-10-09T15:37:45.302097+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:09.678175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.281583+0000","last_change":"2023-10-09T15:37:44.293615+0000","last_active":"2023-10-09T15:37:45.281583+0000","last_peered":"2023-10-09T15:37:45.281583+0000","last_clean":"2023-10-09T15:37:45.281583+0000","last_became_active":"2023-10-09T15:37:44.293306+0000","last_became_peered":"2023-10-09T15:37:44.293306+0000","last_unstale":"2023-10-09T15:37:45.281583+0000","last_undegraded":"2023-10-09T15:37:45.281583+0000","last_fullsized":"2023-10-09T15:37:45.281583+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:05.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295682+0000","last_change":"2023-10-09T15:37:45.283388+0000","last_active":"2023-10-09T15:37:45.295682+0000","last_peered":"2023-10-09T15:37:45.295682+0000","last_clean":"2023-10-09T15:37:45.295682+0000","last_became_active":"2023-10-09T15:37:45.283109+0000","last_became_peered":"2023-10-09T15:37:45.283109+0000","last_unstale":"2023-10-09T15:37:45.295682+0000","last_undegraded":"2023-10-09T15:37:45.295682+0000","last_fullsized":"2023-10-09T15:37:45.295682+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:32.193331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275397+0000","last_change":"2023-10-09T15:37:44.286473+0000","last_active":"2023-10-09T15:37:45.275397+0000","last_peered":"2023-10-09T15:37:45.275397+0000","last_clean":"2023-10-09T15:37:45.275397+0000","last_became_active":"2023-10-09T15:37:44.286180+0000","last_became_peered":"2023-10-09T15:37:44.286180+0000","last_unstale":"2023-10-09T15:37:45.275397+0000","last_undegraded":"2023-10-09T15:37:45.275397+0000","last_fullsized":"2023-10-09T15:37:45.275397+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:04.563201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.292584+0000","last_change":"2023-10-09T15:37:45.291565+0000","last_active":"2023-10-09T15:37:45.292584+0000","last_peered":"2023-10-09T15:37:45.292584+0000","last_clean":"2023-10-09T15:37:45.292584+0000","last_became_active":"2023-10-09T15:37:45.291322+0000","last_became_peered":"2023-10-09T15:37:45.291322+0000","last_unstale":"2023-10-09T15:37:45.292584+0000","last_undegraded":"2023-10-09T15:37:45.292584+0000","last_fullsized":"2023-10-09T15:37:45.292584+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285381+0000","last_change":"2023-10-09T15:37:44.288346+0000","last_active":"2023-10-09T15:37:45.285381+0000","last_peered":"2023-10-09T15:37:45.285381+0000","last_clean":"2023-10-09T15:37:45.285381+0000","last_became_active":"2023-10-09T15:37:44.287776+0000","last_became_peered":"2023-10-09T15:37:44.287776+0000","last_unstale":"2023-10-09T15:37:45.285381+0000","last_undegraded":"2023-10-09T15:37:45.285381+0000","last_fullsized":"2023-10-09T15:37:45.285381+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:04.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303507+0000","last_change":"2023-10-09T15:37:45.299072+0000","last_active":"2023-10-09T15:37:45.303507+0000","last_peered":"2023-10-09T15:37:45.303507+0000","last_clean":"2023-10-09T15:37:45.303507+0000","last_became_active":"2023-10-09T15:37:45.298773+0000","last_became_peered":"2023-10-09T15:37:45.298773+0000","last_unstale":"2023-10-09T15:37:45.303507+0000","last_undegraded":"2023-10-09T15:37:45.303507+0000","last_fullsized":"2023-10-09T15:37:45.303507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:52.414216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302873+0000","last_change":"2023-10-09T15:37:44.292979+0000","last_active":"2023-10-09T15:37:45.302873+0000","last_peered":"2023-10-09T15:37:45.302873+0000","last_clean":"2023-10-09T15:37:45.302873+0000","last_became_active":"2023-10-09T15:37:44.292613+0000","last_became_peered":"2023-10-09T15:37:44.292613+0000","last_unstale":"2023-10-09T15:37:45.302873+0000","last_undegraded":"2023-10-09T15:37:45.302873+0000","last_fullsized":"2023-10-09T15:37:45.302873+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:09.019126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":239,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.280780+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:45.280780+0000","last_peered":"2023-10-09T15:37:45.280780+0000","last_clean":"2023-10-09T15:37:45.280780+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:45.280780+0000","last_undegraded":"2023-10-09T15:37:45.280780+0000","last_fullsized":"2023-10-09T15:37:45.280780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1203847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33300000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.499},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":612869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.75900000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":611333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.373},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.44},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.90200000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.93200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303340,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068500,"statfs":{"total":96636764160,"available":96326144000,"internally_reserved":0,"allocated":2002944,"data_stored":1200690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.307},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.377}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.437},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.84399999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.87},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.89700000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.97799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.82799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":611403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.78200000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.307},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.379},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.496},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:49.402 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:37:49.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.553+0000 7f4029029700 1 Processor -- start 2023-10-09T15:37:49.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.553+0000 7f4029029700 1 -- start start 2023-10-09T15:37:49.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4029029700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4024153d20 0x7f402406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4029029700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402415d9a0 0x7f4024068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4029029700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40240687b0 con 0x7f4024067e00 2023-10-09T15:37:49.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4029029700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f402415e280 con 0x7f4024153d20 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4029029700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f402415dfa0 con 0x7f402415d9a0 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f4023fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4024153d20 0x7f402406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f40237fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4024067e00 0x7f402415d290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47068/0 (socket says 172.21.15.33:47068) 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.554+0000 7f40237fe700 1 -- 172.21.15.33:0/4213928109 learned_addr learned my addr 172.21.15.33:0/4213928109 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4028828700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402415d9a0 0x7f4024068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4023fff700 1 -- 172.21.15.33:0/4213928109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402415d9a0 msgr2=0x7f4024068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4023fff700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402415d9a0 0x7f4024068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4023fff700 1 -- 172.21.15.33:0/4213928109 >> v1:172.21.15.33:6789/0 conn(0x7f4024067e00 legacy=0x7f402415d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4023fff700 1 -- 172.21.15.33:0/4213928109 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f402406a5b0 con 0x7f4024153d20 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4022ffd700 1 -- 172.21.15.33:0/4213928109 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213647086 0 0) 0x7f40240687b0 con 0x7f4024067e00 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4023fff700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f402406b090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f40140098e0 tx=0x7f40140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b905ea4382ba21b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4022ffd700 1 -- 172.21.15.33:0/4213928109 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400b640 con 0x7f4024153d20 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4022ffd700 1 -- 172.21.15.33:0/4213928109 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f401400b7a0 con 0x7f4024153d20 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.555+0000 7f4022ffd700 1 -- 172.21.15.33:0/4213928109 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f401400bb40 con 0x7f4024153d20 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 -- 172.21.15.33:0/4213928109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 msgr2=0x7f402406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f402406b090 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f40140098e0 tx=0x7f40140091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 -- 172.21.15.33:0/4213928109 shutdown_connections 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f402415d9a0 0x7f4024068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 --2- 172.21.15.33:0/4213928109 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f402406b090 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 -- 172.21.15.33:0/4213928109 >> 172.21.15.33:0/4213928109 conn(0x7f40240cca00 msgr2=0x7f40240cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 -- 172.21.15.33:0/4213928109 shutdown_connections 2023-10-09T15:37:49.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.556+0000 7f4029029700 1 -- 172.21.15.33:0/4213928109 wait complete. 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.557+0000 7f4029029700 1 Processor -- start 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.557+0000 7f4029029700 1 -- start start 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4024067e00 0x7f4024156a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 0x7f402414edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b0d30 con 0x7f4024153d20 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4024155ac0 con 0x7f402415d9a0 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40240b28a0 con 0x7f4024067e00 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36124/0 (socket says 172.21.15.33:36124) 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 -- 172.21.15.33:0/3623050994 learned_addr learned my addr 172.21.15.33:0/3623050994 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4023fff700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4024067e00 0x7f4024156a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4028828700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 0x7f402414edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 -- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4024067e00 msgr2=0x7f4024156a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4024067e00 0x7f4024156a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 -- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 msgr2=0x7f402414edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 0x7f402414edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 -- 172.21.15.33:0/3623050994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014009420 con 0x7f4024153d20 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4028828700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 0x7f402414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f40237fe700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f401800c7e0 tx=0x7f4018007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018005b30 con 0x7f4024153d20 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4018005c90 con 0x7f4024153d20 2023-10-09T15:37:49.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.558+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40241565e0 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.559+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4018007300 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.559+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4024155cb0 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.560+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40240abc50 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.560+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f40180076b0 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.560+0000 7f400bfff700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 0x7f40100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.560+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f40180841e0 con 0x7f4024153d20 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.560+0000 7f4023fff700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 0x7f40100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.561+0000 7f4023fff700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 0x7f40100697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40140097b0 tx=0x7f4014017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.564+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4018050e70 con 0x7f4024153d20 2023-10-09T15:37:49.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.753+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4024156770 con 0x7f4010067320 2023-10-09T15:37:49.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.762+0000 7f400bfff700 1 -- 172.21.15.33:0/3623050994 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289872 (secure 0 0 0) 0x7f4024156770 con 0x7f4010067320 2023-10-09T15:37:49.766 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 msgr2=0x7f40100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 0x7f40100697d0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f40140097b0 tx=0x7f4014017000 comp rx=0 tx=0).stop 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 msgr2=0x7f40240b2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f401800c7e0 tx=0x7f4018007df0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 shutdown_connections 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4010067320 0x7f40100697d0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f402415d9a0 0x7f402414edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4024067e00 0x7f4024156a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 --2- 172.21.15.33:0/3623050994 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4024153d20 0x7f40240b2360 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 >> 172.21.15.33:0/3623050994 conn(0x7f40240cca00 msgr2=0x7f4024159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 shutdown_connections 2023-10-09T15:37:49.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.765+0000 7f4029029700 1 -- 172.21.15.33:0/3623050994 wait complete. 2023-10-09T15:37:49.769 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:37:49.778 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":314,"stamp":"2023-10-09T15:37:49.318233+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":163,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2423332,"kb_used_data":12260,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752551388,"statfs":{"total":773094113280,"available":770612621312,"internally_reserved":0,"allocated":12554240,"data_stored":6075001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001045"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305035+0000","last_change":"2023-10-09T15:37:45.299829+0000","last_active":"2023-10-09T15:37:45.305035+0000","last_peered":"2023-10-09T15:37:45.305035+0000","last_clean":"2023-10-09T15:37:45.305035+0000","last_became_active":"2023-10-09T15:37:45.299191+0000","last_became_peered":"2023-10-09T15:37:45.299191+0000","last_unstale":"2023-10-09T15:37:45.305035+0000","last_undegraded":"2023-10-09T15:37:45.305035+0000","last_fullsized":"2023-10-09T15:37:45.305035+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:50:00.907520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296996+0000","last_change":"2023-10-09T15:37:45.294029+0000","last_active":"2023-10-09T15:37:45.296996+0000","last_peered":"2023-10-09T15:37:45.296996+0000","last_clean":"2023-10-09T15:37:45.296996+0000","last_became_active":"2023-10-09T15:37:45.293605+0000","last_became_peered":"2023-10-09T15:37:45.293605+0000","last_unstale":"2023-10-09T15:37:45.296996+0000","last_undegraded":"2023-10-09T15:37:45.296996+0000","last_fullsized":"2023-10-09T15:37:45.296996+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.313508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300614+0000","last_change":"2023-10-09T15:37:45.292847+0000","last_active":"2023-10-09T15:37:45.300614+0000","last_peered":"2023-10-09T15:37:45.300614+0000","last_clean":"2023-10-09T15:37:45.300614+0000","last_became_active":"2023-10-09T15:37:45.292551+0000","last_became_peered":"2023-10-09T15:37:45.292551+0000","last_unstale":"2023-10-09T15:37:45.300614+0000","last_undegraded":"2023-10-09T15:37:45.300614+0000","last_fullsized":"2023-10-09T15:37:45.300614+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:08.089895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296955+0000","last_change":"2023-10-09T15:37:45.286984+0000","last_active":"2023-10-09T15:37:45.296955+0000","last_peered":"2023-10-09T15:37:45.296955+0000","last_clean":"2023-10-09T15:37:45.296955+0000","last_became_active":"2023-10-09T15:37:45.286687+0000","last_became_peered":"2023-10-09T15:37:45.286687+0000","last_unstale":"2023-10-09T15:37:45.296955+0000","last_undegraded":"2023-10-09T15:37:45.296955+0000","last_fullsized":"2023-10-09T15:37:45.296955+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:28.398889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299827+0000","last_change":"2023-10-09T15:37:45.294624+0000","last_active":"2023-10-09T15:37:45.299827+0000","last_peered":"2023-10-09T15:37:45.299827+0000","last_clean":"2023-10-09T15:37:45.299827+0000","last_became_active":"2023-10-09T15:37:45.294344+0000","last_became_peered":"2023-10-09T15:37:45.294344+0000","last_unstale":"2023-10-09T15:37:45.299827+0000","last_undegraded":"2023-10-09T15:37:45.299827+0000","last_fullsized":"2023-10-09T15:37:45.299827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:24.974322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294253+0000","last_change":"2023-10-09T15:37:45.288689+0000","last_active":"2023-10-09T15:37:45.294253+0000","last_peered":"2023-10-09T15:37:45.294253+0000","last_clean":"2023-10-09T15:37:45.294253+0000","last_became_active":"2023-10-09T15:37:45.288412+0000","last_became_peered":"2023-10-09T15:37:45.288412+0000","last_unstale":"2023-10-09T15:37:45.294253+0000","last_undegraded":"2023-10-09T15:37:45.294253+0000","last_fullsized":"2023-10-09T15:37:45.294253+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:27:32.595404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294547+0000","last_change":"2023-10-09T15:37:45.290121+0000","last_active":"2023-10-09T15:37:45.294547+0000","last_peered":"2023-10-09T15:37:45.294547+0000","last_clean":"2023-10-09T15:37:45.294547+0000","last_became_active":"2023-10-09T15:37:45.289856+0000","last_became_peered":"2023-10-09T15:37:45.289856+0000","last_unstale":"2023-10-09T15:37:45.294547+0000","last_undegraded":"2023-10-09T15:37:45.294547+0000","last_fullsized":"2023-10-09T15:37:45.294547+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:25.642652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303371+0000","last_change":"2023-10-09T15:37:45.296953+0000","last_active":"2023-10-09T15:37:45.303371+0000","last_peered":"2023-10-09T15:37:45.303371+0000","last_clean":"2023-10-09T15:37:45.303371+0000","last_became_active":"2023-10-09T15:37:45.296669+0000","last_became_peered":"2023-10-09T15:37:45.296669+0000","last_unstale":"2023-10-09T15:37:45.303371+0000","last_undegraded":"2023-10-09T15:37:45.303371+0000","last_fullsized":"2023-10-09T15:37:45.303371+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:19.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300667+0000","last_change":"2023-10-09T15:37:45.293552+0000","last_active":"2023-10-09T15:37:45.300667+0000","last_peered":"2023-10-09T15:37:45.300667+0000","last_clean":"2023-10-09T15:37:45.300667+0000","last_became_active":"2023-10-09T15:37:45.293283+0000","last_became_peered":"2023-10-09T15:37:45.293283+0000","last_unstale":"2023-10-09T15:37:45.300667+0000","last_undegraded":"2023-10-09T15:37:45.300667+0000","last_fullsized":"2023-10-09T15:37:45.300667+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:10.021188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296976+0000","last_change":"2023-10-09T15:37:45.293869+0000","last_active":"2023-10-09T15:37:45.296976+0000","last_peered":"2023-10-09T15:37:45.296976+0000","last_clean":"2023-10-09T15:37:45.296976+0000","last_became_active":"2023-10-09T15:37:45.293244+0000","last_became_peered":"2023-10-09T15:37:45.293244+0000","last_unstale":"2023-10-09T15:37:45.296976+0000","last_undegraded":"2023-10-09T15:37:45.296976+0000","last_fullsized":"2023-10-09T15:37:45.296976+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:34:48.768192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302157+0000","last_change":"2023-10-09T15:37:45.296879+0000","last_active":"2023-10-09T15:37:45.302157+0000","last_peered":"2023-10-09T15:37:45.302157+0000","last_clean":"2023-10-09T15:37:45.302157+0000","last_became_active":"2023-10-09T15:37:45.296128+0000","last_became_peered":"2023-10-09T15:37:45.296128+0000","last_unstale":"2023-10-09T15:37:45.302157+0000","last_undegraded":"2023-10-09T15:37:45.302157+0000","last_fullsized":"2023-10-09T15:37:45.302157+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:52:46.055116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296210+0000","last_change":"2023-10-09T15:37:45.290989+0000","last_active":"2023-10-09T15:37:45.296210+0000","last_peered":"2023-10-09T15:37:45.296210+0000","last_clean":"2023-10-09T15:37:45.296210+0000","last_became_active":"2023-10-09T15:37:45.290699+0000","last_became_peered":"2023-10-09T15:37:45.290699+0000","last_unstale":"2023-10-09T15:37:45.296210+0000","last_undegraded":"2023-10-09T15:37:45.296210+0000","last_fullsized":"2023-10-09T15:37:45.296210+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304870+0000","last_change":"2023-10-09T15:37:45.299311+0000","last_active":"2023-10-09T15:37:45.304870+0000","last_peered":"2023-10-09T15:37:45.304870+0000","last_clean":"2023-10-09T15:37:45.304870+0000","last_became_active":"2023-10-09T15:37:45.298608+0000","last_became_peered":"2023-10-09T15:37:45.298608+0000","last_unstale":"2023-10-09T15:37:45.304870+0000","last_undegraded":"2023-10-09T15:37:45.304870+0000","last_fullsized":"2023-10-09T15:37:45.304870+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:30:06.226779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297044+0000","last_change":"2023-10-09T15:37:45.294592+0000","last_active":"2023-10-09T15:37:45.297044+0000","last_peered":"2023-10-09T15:37:45.297044+0000","last_clean":"2023-10-09T15:37:45.297044+0000","last_became_active":"2023-10-09T15:37:45.294299+0000","last_became_peered":"2023-10-09T15:37:45.294299+0000","last_unstale":"2023-10-09T15:37:45.297044+0000","last_undegraded":"2023-10-09T15:37:45.297044+0000","last_fullsized":"2023-10-09T15:37:45.297044+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:07:19.861870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305006+0000","last_change":"2023-10-09T15:37:45.300469+0000","last_active":"2023-10-09T15:37:45.305006+0000","last_peered":"2023-10-09T15:37:45.305006+0000","last_clean":"2023-10-09T15:37:45.305006+0000","last_became_active":"2023-10-09T15:37:45.300206+0000","last_became_peered":"2023-10-09T15:37:45.300206+0000","last_unstale":"2023-10-09T15:37:45.305006+0000","last_undegraded":"2023-10-09T15:37:45.305006+0000","last_fullsized":"2023-10-09T15:37:45.305006+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:24:23.972451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303054+0000","last_change":"2023-10-09T15:37:45.296723+0000","last_active":"2023-10-09T15:37:45.303054+0000","last_peered":"2023-10-09T15:37:45.303054+0000","last_clean":"2023-10-09T15:37:45.303054+0000","last_became_active":"2023-10-09T15:37:45.296461+0000","last_became_peered":"2023-10-09T15:37:45.296461+0000","last_unstale":"2023-10-09T15:37:45.303054+0000","last_undegraded":"2023-10-09T15:37:45.303054+0000","last_fullsized":"2023-10-09T15:37:45.303054+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.249730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295266+0000","last_change":"2023-10-09T15:37:45.292839+0000","last_active":"2023-10-09T15:37:45.295266+0000","last_peered":"2023-10-09T15:37:45.295266+0000","last_clean":"2023-10-09T15:37:45.295266+0000","last_became_active":"2023-10-09T15:37:45.292147+0000","last_became_peered":"2023-10-09T15:37:45.292147+0000","last_unstale":"2023-10-09T15:37:45.295266+0000","last_undegraded":"2023-10-09T15:37:45.295266+0000","last_fullsized":"2023-10-09T15:37:45.295266+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293273+0000","last_change":"2023-10-09T15:37:45.289992+0000","last_active":"2023-10-09T15:37:45.293273+0000","last_peered":"2023-10-09T15:37:45.293273+0000","last_clean":"2023-10-09T15:37:45.293273+0000","last_became_active":"2023-10-09T15:37:45.289739+0000","last_became_peered":"2023-10-09T15:37:45.289739+0000","last_unstale":"2023-10-09T15:37:45.293273+0000","last_undegraded":"2023-10-09T15:37:45.293273+0000","last_fullsized":"2023-10-09T15:37:45.293273+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:24.974322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302827+0000","last_change":"2023-10-09T15:37:45.300977+0000","last_active":"2023-10-09T15:37:45.302827+0000","last_peered":"2023-10-09T15:37:45.302827+0000","last_clean":"2023-10-09T15:37:45.302827+0000","last_became_active":"2023-10-09T15:37:45.300592+0000","last_became_peered":"2023-10-09T15:37:45.300592+0000","last_unstale":"2023-10-09T15:37:45.302827+0000","last_undegraded":"2023-10-09T15:37:45.302827+0000","last_fullsized":"2023-10-09T15:37:45.302827+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:24.754604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303023+0000","last_change":"2023-10-09T15:37:45.296534+0000","last_active":"2023-10-09T15:37:45.303023+0000","last_peered":"2023-10-09T15:37:45.303023+0000","last_clean":"2023-10-09T15:37:45.303023+0000","last_became_active":"2023-10-09T15:37:45.291544+0000","last_became_peered":"2023-10-09T15:37:45.291544+0000","last_unstale":"2023-10-09T15:37:45.303023+0000","last_undegraded":"2023-10-09T15:37:45.303023+0000","last_fullsized":"2023-10-09T15:37:45.303023+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:14.330598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299845+0000","last_change":"2023-10-09T15:37:45.295957+0000","last_active":"2023-10-09T15:37:45.299845+0000","last_peered":"2023-10-09T15:37:45.299845+0000","last_clean":"2023-10-09T15:37:45.299845+0000","last_became_active":"2023-10-09T15:37:45.295688+0000","last_became_peered":"2023-10-09T15:37:45.295688+0000","last_unstale":"2023-10-09T15:37:45.299845+0000","last_undegraded":"2023-10-09T15:37:45.299845+0000","last_fullsized":"2023-10-09T15:37:45.299845+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:41.713275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302787+0000","last_change":"2023-10-09T15:37:45.298103+0000","last_active":"2023-10-09T15:37:45.302787+0000","last_peered":"2023-10-09T15:37:45.302787+0000","last_clean":"2023-10-09T15:37:45.302787+0000","last_became_active":"2023-10-09T15:37:45.297512+0000","last_became_peered":"2023-10-09T15:37:45.297512+0000","last_unstale":"2023-10-09T15:37:45.302787+0000","last_undegraded":"2023-10-09T15:37:45.302787+0000","last_fullsized":"2023-10-09T15:37:45.302787+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:57.049309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298829+0000","last_change":"2023-10-09T15:37:45.291468+0000","last_active":"2023-10-09T15:37:45.298829+0000","last_peered":"2023-10-09T15:37:45.298829+0000","last_clean":"2023-10-09T15:37:45.298829+0000","last_became_active":"2023-10-09T15:37:45.290881+0000","last_became_peered":"2023-10-09T15:37:45.290881+0000","last_unstale":"2023-10-09T15:37:45.298829+0000","last_undegraded":"2023-10-09T15:37:45.298829+0000","last_fullsized":"2023-10-09T15:37:45.298829+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298636+0000","last_change":"2023-10-09T15:37:45.293915+0000","last_active":"2023-10-09T15:37:45.298636+0000","last_peered":"2023-10-09T15:37:45.298636+0000","last_clean":"2023-10-09T15:37:45.298636+0000","last_became_active":"2023-10-09T15:37:45.293614+0000","last_became_peered":"2023-10-09T15:37:45.293614+0000","last_unstale":"2023-10-09T15:37:45.298636+0000","last_undegraded":"2023-10-09T15:37:45.298636+0000","last_fullsized":"2023-10-09T15:37:45.298636+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:10:29.524289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303397+0000","last_change":"2023-10-09T15:37:45.298765+0000","last_active":"2023-10-09T15:37:45.303397+0000","last_peered":"2023-10-09T15:37:45.303397+0000","last_clean":"2023-10-09T15:37:45.303397+0000","last_became_active":"2023-10-09T15:37:45.298474+0000","last_became_peered":"2023-10-09T15:37:45.298474+0000","last_unstale":"2023-10-09T15:37:45.303397+0000","last_undegraded":"2023-10-09T15:37:45.303397+0000","last_fullsized":"2023-10-09T15:37:45.303397+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:10.021188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303965+0000","last_change":"2023-10-09T15:37:45.300683+0000","last_active":"2023-10-09T15:37:45.303965+0000","last_peered":"2023-10-09T15:37:45.303965+0000","last_clean":"2023-10-09T15:37:45.303965+0000","last_became_active":"2023-10-09T15:37:45.300386+0000","last_became_peered":"2023-10-09T15:37:45.300386+0000","last_unstale":"2023-10-09T15:37:45.303965+0000","last_undegraded":"2023-10-09T15:37:45.303965+0000","last_fullsized":"2023-10-09T15:37:45.303965+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:41.713275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296908+0000","last_change":"2023-10-09T15:37:45.291004+0000","last_active":"2023-10-09T15:37:45.296908+0000","last_peered":"2023-10-09T15:37:45.296908+0000","last_clean":"2023-10-09T15:37:45.296908+0000","last_became_active":"2023-10-09T15:37:45.290756+0000","last_became_peered":"2023-10-09T15:37:45.290756+0000","last_unstale":"2023-10-09T15:37:45.296908+0000","last_undegraded":"2023-10-09T15:37:45.296908+0000","last_fullsized":"2023-10-09T15:37:45.296908+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:15.358449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303207+0000","last_change":"2023-10-09T15:37:45.301365+0000","last_active":"2023-10-09T15:37:45.303207+0000","last_peered":"2023-10-09T15:37:45.303207+0000","last_clean":"2023-10-09T15:37:45.303207+0000","last_became_active":"2023-10-09T15:37:45.300973+0000","last_became_peered":"2023-10-09T15:37:45.300973+0000","last_unstale":"2023-10-09T15:37:45.303207+0000","last_undegraded":"2023-10-09T15:37:45.303207+0000","last_fullsized":"2023-10-09T15:37:45.303207+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:17.091714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304899+0000","last_change":"2023-10-09T15:37:45.299485+0000","last_active":"2023-10-09T15:37:45.304899+0000","last_peered":"2023-10-09T15:37:45.304899+0000","last_clean":"2023-10-09T15:37:45.304899+0000","last_became_active":"2023-10-09T15:37:45.299003+0000","last_became_peered":"2023-10-09T15:37:45.299003+0000","last_unstale":"2023-10-09T15:37:45.304899+0000","last_undegraded":"2023-10-09T15:37:45.304899+0000","last_fullsized":"2023-10-09T15:37:45.304899+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:40.838569+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304985+0000","last_change":"2023-10-09T15:37:45.300259+0000","last_active":"2023-10-09T15:37:45.304985+0000","last_peered":"2023-10-09T15:37:45.304985+0000","last_clean":"2023-10-09T15:37:45.304985+0000","last_became_active":"2023-10-09T15:37:45.299760+0000","last_became_peered":"2023-10-09T15:37:45.299760+0000","last_unstale":"2023-10-09T15:37:45.304985+0000","last_undegraded":"2023-10-09T15:37:45.304985+0000","last_fullsized":"2023-10-09T15:37:45.304985+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:13.325394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301337+0000","last_change":"2023-10-09T15:37:45.297940+0000","last_active":"2023-10-09T15:37:45.301337+0000","last_peered":"2023-10-09T15:37:45.301337+0000","last_clean":"2023-10-09T15:37:45.301337+0000","last_became_active":"2023-10-09T15:37:45.297034+0000","last_became_peered":"2023-10-09T15:37:45.297034+0000","last_unstale":"2023-10-09T15:37:45.301337+0000","last_undegraded":"2023-10-09T15:37:45.301337+0000","last_fullsized":"2023-10-09T15:37:45.301337+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:22.913860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293182+0000","last_change":"2023-10-09T15:37:45.285153+0000","last_active":"2023-10-09T15:37:45.293182+0000","last_peered":"2023-10-09T15:37:45.293182+0000","last_clean":"2023-10-09T15:37:45.293182+0000","last_became_active":"2023-10-09T15:37:45.284775+0000","last_became_peered":"2023-10-09T15:37:45.284775+0000","last_unstale":"2023-10-09T15:37:45.293182+0000","last_undegraded":"2023-10-09T15:37:45.293182+0000","last_fullsized":"2023-10-09T15:37:45.293182+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:16.221990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299130+0000","last_change":"2023-10-09T15:37:45.294005+0000","last_active":"2023-10-09T15:37:45.299130+0000","last_peered":"2023-10-09T15:37:45.299130+0000","last_clean":"2023-10-09T15:37:45.299130+0000","last_became_active":"2023-10-09T15:37:45.293713+0000","last_became_peered":"2023-10-09T15:37:45.293713+0000","last_unstale":"2023-10-09T15:37:45.299130+0000","last_undegraded":"2023-10-09T15:37:45.299130+0000","last_fullsized":"2023-10-09T15:37:45.299130+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:25.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"112'4","reported_seq":14,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303085+0000","last_change":"2023-10-09T15:37:44.292942+0000","last_active":"2023-10-09T15:37:45.303085+0000","last_peered":"2023-10-09T15:37:45.303085+0000","last_clean":"2023-10-09T15:37:45.303085+0000","last_became_active":"2023-10-09T15:37:44.292624+0000","last_became_peered":"2023-10-09T15:37:44.292624+0000","last_unstale":"2023-10-09T15:37:45.303085+0000","last_undegraded":"2023-10-09T15:37:45.303085+0000","last_fullsized":"2023-10-09T15:37:45.303085+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:37:59.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303077+0000","last_change":"2023-10-09T15:37:45.299603+0000","last_active":"2023-10-09T15:37:45.303077+0000","last_peered":"2023-10-09T15:37:45.303077+0000","last_clean":"2023-10-09T15:37:45.303077+0000","last_became_active":"2023-10-09T15:37:45.299321+0000","last_became_peered":"2023-10-09T15:37:45.299321+0000","last_unstale":"2023-10-09T15:37:45.303077+0000","last_undegraded":"2023-10-09T15:37:45.303077+0000","last_fullsized":"2023-10-09T15:37:45.303077+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:08.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297733+0000","last_change":"2023-10-09T15:37:44.289863+0000","last_active":"2023-10-09T15:37:45.297733+0000","last_peered":"2023-10-09T15:37:45.297733+0000","last_clean":"2023-10-09T15:37:45.297733+0000","last_became_active":"2023-10-09T15:37:44.289547+0000","last_became_peered":"2023-10-09T15:37:44.289547+0000","last_unstale":"2023-10-09T15:37:45.297733+0000","last_undegraded":"2023-10-09T15:37:45.297733+0000","last_fullsized":"2023-10-09T15:37:45.297733+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:26:09.263107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300423+0000","last_change":"2023-10-09T15:37:45.291619+0000","last_active":"2023-10-09T15:37:45.300423+0000","last_peered":"2023-10-09T15:37:45.300423+0000","last_clean":"2023-10-09T15:37:45.300423+0000","last_became_active":"2023-10-09T15:37:45.291346+0000","last_became_peered":"2023-10-09T15:37:45.291346+0000","last_unstale":"2023-10-09T15:37:45.300423+0000","last_undegraded":"2023-10-09T15:37:45.300423+0000","last_fullsized":"2023-10-09T15:37:45.300423+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:50:14.330598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301810+0000","last_change":"2023-10-09T15:37:44.282934+0000","last_active":"2023-10-09T15:37:45.301810+0000","last_peered":"2023-10-09T15:37:45.301810+0000","last_clean":"2023-10-09T15:37:45.301810+0000","last_became_active":"2023-10-09T15:37:44.282604+0000","last_became_peered":"2023-10-09T15:37:44.282604+0000","last_unstale":"2023-10-09T15:37:45.301810+0000","last_undegraded":"2023-10-09T15:37:45.301810+0000","last_fullsized":"2023-10-09T15:37:45.301810+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:55.915575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299936+0000","last_change":"2023-10-09T15:37:45.294542+0000","last_active":"2023-10-09T15:37:45.299936+0000","last_peered":"2023-10-09T15:37:45.299936+0000","last_clean":"2023-10-09T15:37:45.299936+0000","last_became_active":"2023-10-09T15:37:45.294220+0000","last_became_peered":"2023-10-09T15:37:45.294220+0000","last_unstale":"2023-10-09T15:37:45.299936+0000","last_undegraded":"2023-10-09T15:37:45.299936+0000","last_fullsized":"2023-10-09T15:37:45.299936+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:05.249730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301679+0000","last_change":"2023-10-09T15:37:44.291341+0000","last_active":"2023-10-09T15:37:45.301679+0000","last_peered":"2023-10-09T15:37:45.301679+0000","last_clean":"2023-10-09T15:37:45.301679+0000","last_became_active":"2023-10-09T15:37:44.291067+0000","last_became_peered":"2023-10-09T15:37:44.291067+0000","last_unstale":"2023-10-09T15:37:45.301679+0000","last_undegraded":"2023-10-09T15:37:45.301679+0000","last_fullsized":"2023-10-09T15:37:45.301679+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:05.282011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293091+0000","last_change":"2023-10-09T15:37:45.285343+0000","last_active":"2023-10-09T15:37:45.293091+0000","last_peered":"2023-10-09T15:37:45.293091+0000","last_clean":"2023-10-09T15:37:45.293091+0000","last_became_active":"2023-10-09T15:37:45.285045+0000","last_became_peered":"2023-10-09T15:37:45.285045+0000","last_unstale":"2023-10-09T15:37:45.293091+0000","last_undegraded":"2023-10-09T15:37:45.293091+0000","last_fullsized":"2023-10-09T15:37:45.293091+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:52.414216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297335+0000","last_change":"2023-10-09T15:37:44.286017+0000","last_active":"2023-10-09T15:37:45.297335+0000","last_peered":"2023-10-09T15:37:45.297335+0000","last_clean":"2023-10-09T15:37:45.297335+0000","last_became_active":"2023-10-09T15:37:44.285765+0000","last_became_peered":"2023-10-09T15:37:44.285765+0000","last_unstale":"2023-10-09T15:37:45.297335+0000","last_undegraded":"2023-10-09T15:37:45.297335+0000","last_fullsized":"2023-10-09T15:37:45.297335+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:22.567561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295292+0000","last_change":"2023-10-09T15:37:45.293718+0000","last_active":"2023-10-09T15:37:45.295292+0000","last_peered":"2023-10-09T15:37:45.295292+0000","last_clean":"2023-10-09T15:37:45.295292+0000","last_became_active":"2023-10-09T15:37:45.293482+0000","last_became_peered":"2023-10-09T15:37:45.293482+0000","last_unstale":"2023-10-09T15:37:45.295292+0000","last_undegraded":"2023-10-09T15:37:45.295292+0000","last_fullsized":"2023-10-09T15:37:45.295292+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294159+0000","last_change":"2023-10-09T15:37:44.287788+0000","last_active":"2023-10-09T15:37:45.294159+0000","last_peered":"2023-10-09T15:37:45.294159+0000","last_clean":"2023-10-09T15:37:45.294159+0000","last_became_active":"2023-10-09T15:37:44.287502+0000","last_became_peered":"2023-10-09T15:37:44.287502+0000","last_unstale":"2023-10-09T15:37:45.294159+0000","last_undegraded":"2023-10-09T15:37:45.294159+0000","last_fullsized":"2023-10-09T15:37:45.294159+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:54:24.640590+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303353+0000","last_change":"2023-10-09T15:37:45.297074+0000","last_active":"2023-10-09T15:37:45.303353+0000","last_peered":"2023-10-09T15:37:45.303353+0000","last_clean":"2023-10-09T15:37:45.303353+0000","last_became_active":"2023-10-09T15:37:45.296732+0000","last_became_peered":"2023-10-09T15:37:45.296732+0000","last_unstale":"2023-10-09T15:37:45.303353+0000","last_undegraded":"2023-10-09T15:37:45.303353+0000","last_fullsized":"2023-10-09T15:37:45.303353+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:30.313508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.277401+0000","last_change":"2023-10-09T15:37:44.291245+0000","last_active":"2023-10-09T15:37:45.277401+0000","last_peered":"2023-10-09T15:37:45.277401+0000","last_clean":"2023-10-09T15:37:45.277401+0000","last_became_active":"2023-10-09T15:37:44.290970+0000","last_became_peered":"2023-10-09T15:37:44.290970+0000","last_unstale":"2023-10-09T15:37:45.277401+0000","last_undegraded":"2023-10-09T15:37:45.277401+0000","last_fullsized":"2023-10-09T15:37:45.277401+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:58.043333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303426+0000","last_change":"2023-10-09T15:37:45.297971+0000","last_active":"2023-10-09T15:37:45.303426+0000","last_peered":"2023-10-09T15:37:45.303426+0000","last_clean":"2023-10-09T15:37:45.303426+0000","last_became_active":"2023-10-09T15:37:45.297644+0000","last_became_peered":"2023-10-09T15:37:45.297644+0000","last_unstale":"2023-10-09T15:37:45.303426+0000","last_undegraded":"2023-10-09T15:37:45.303426+0000","last_fullsized":"2023-10-09T15:37:45.303426+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:08.759955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.286389+0000","last_change":"2023-10-09T15:37:44.286756+0000","last_active":"2023-10-09T15:37:45.286389+0000","last_peered":"2023-10-09T15:37:45.286389+0000","last_clean":"2023-10-09T15:37:45.286389+0000","last_became_active":"2023-10-09T15:37:44.286054+0000","last_became_peered":"2023-10-09T15:37:44.286054+0000","last_unstale":"2023-10-09T15:37:45.286389+0000","last_undegraded":"2023-10-09T15:37:45.286389+0000","last_fullsized":"2023-10-09T15:37:45.286389+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:35.702618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304771+0000","last_change":"2023-10-09T15:37:45.296840+0000","last_active":"2023-10-09T15:37:45.304771+0000","last_peered":"2023-10-09T15:37:45.304771+0000","last_clean":"2023-10-09T15:37:45.304771+0000","last_became_active":"2023-10-09T15:37:45.296417+0000","last_became_peered":"2023-10-09T15:37:45.296417+0000","last_unstale":"2023-10-09T15:37:45.304771+0000","last_undegraded":"2023-10-09T15:37:45.304771+0000","last_fullsized":"2023-10-09T15:37:45.304771+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:08:12.649418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285521+0000","last_change":"2023-10-09T15:37:44.288789+0000","last_active":"2023-10-09T15:37:45.285521+0000","last_peered":"2023-10-09T15:37:45.285521+0000","last_clean":"2023-10-09T15:37:45.285521+0000","last_became_active":"2023-10-09T15:37:44.288361+0000","last_became_peered":"2023-10-09T15:37:44.288361+0000","last_unstale":"2023-10-09T15:37:45.285521+0000","last_undegraded":"2023-10-09T15:37:45.285521+0000","last_fullsized":"2023-10-09T15:37:45.285521+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:55:27.396828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302105+0000","last_change":"2023-10-09T15:37:45.298115+0000","last_active":"2023-10-09T15:37:45.302105+0000","last_peered":"2023-10-09T15:37:45.302105+0000","last_clean":"2023-10-09T15:37:45.302105+0000","last_became_active":"2023-10-09T15:37:45.297838+0000","last_became_peered":"2023-10-09T15:37:45.297838+0000","last_unstale":"2023-10-09T15:37:45.302105+0000","last_undegraded":"2023-10-09T15:37:45.302105+0000","last_fullsized":"2023-10-09T15:37:45.302105+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:58.086915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.276548+0000","last_change":"2023-10-09T15:37:44.287671+0000","last_active":"2023-10-09T15:37:45.276548+0000","last_peered":"2023-10-09T15:37:45.276548+0000","last_clean":"2023-10-09T15:37:45.276548+0000","last_became_active":"2023-10-09T15:37:44.287392+0000","last_became_peered":"2023-10-09T15:37:44.287392+0000","last_unstale":"2023-10-09T15:37:45.276548+0000","last_undegraded":"2023-10-09T15:37:45.276548+0000","last_fullsized":"2023-10-09T15:37:45.276548+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:43.626487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303522+0000","last_change":"2023-10-09T15:37:45.300148+0000","last_active":"2023-10-09T15:37:45.303522+0000","last_peered":"2023-10-09T15:37:45.303522+0000","last_clean":"2023-10-09T15:37:45.303522+0000","last_became_active":"2023-10-09T15:37:45.299150+0000","last_became_peered":"2023-10-09T15:37:45.299150+0000","last_unstale":"2023-10-09T15:37:45.303522+0000","last_undegraded":"2023-10-09T15:37:45.303522+0000","last_fullsized":"2023-10-09T15:37:45.303522+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:10:25.648883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"112'3","reported_seq":13,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.298286+0000","last_change":"2023-10-09T15:37:44.288062+0000","last_active":"2023-10-09T15:37:45.298286+0000","last_peered":"2023-10-09T15:37:45.298286+0000","last_clean":"2023-10-09T15:37:45.298286+0000","last_became_active":"2023-10-09T15:37:44.287748+0000","last_became_peered":"2023-10-09T15:37:44.287748+0000","last_unstale":"2023-10-09T15:37:45.298286+0000","last_undegraded":"2023-10-09T15:37:45.298286+0000","last_fullsized":"2023-10-09T15:37:45.298286+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:11:03.340098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303456+0000","last_change":"2023-10-09T15:37:45.298776+0000","last_active":"2023-10-09T15:37:45.303456+0000","last_peered":"2023-10-09T15:37:45.303456+0000","last_clean":"2023-10-09T15:37:45.303456+0000","last_became_active":"2023-10-09T15:37:45.298470+0000","last_became_peered":"2023-10-09T15:37:45.298470+0000","last_unstale":"2023-10-09T15:37:45.303456+0000","last_undegraded":"2023-10-09T15:37:45.303456+0000","last_fullsized":"2023-10-09T15:37:45.303456+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:47:57.822026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"112'6","reported_seq":16,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.306205+0000","last_change":"2023-10-09T15:37:44.291881+0000","last_active":"2023-10-09T15:37:45.306205+0000","last_peered":"2023-10-09T15:37:45.306205+0000","last_clean":"2023-10-09T15:37:45.306205+0000","last_became_active":"2023-10-09T15:37:44.291651+0000","last_became_peered":"2023-10-09T15:37:44.291651+0000","last_unstale":"2023-10-09T15:37:45.306205+0000","last_undegraded":"2023-10-09T15:37:45.306205+0000","last_fullsized":"2023-10-09T15:37:45.306205+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:08.676113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302576+0000","last_change":"2023-10-09T15:37:45.293861+0000","last_active":"2023-10-09T15:37:45.302576+0000","last_peered":"2023-10-09T15:37:45.302576+0000","last_clean":"2023-10-09T15:37:45.302576+0000","last_became_active":"2023-10-09T15:37:45.293566+0000","last_became_peered":"2023-10-09T15:37:45.293566+0000","last_unstale":"2023-10-09T15:37:45.302576+0000","last_undegraded":"2023-10-09T15:37:45.302576+0000","last_fullsized":"2023-10-09T15:37:45.302576+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:57:57.446172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.287820+0000","last_change":"2023-10-09T15:37:44.284661+0000","last_active":"2023-10-09T15:37:45.287820+0000","last_peered":"2023-10-09T15:37:45.287820+0000","last_clean":"2023-10-09T15:37:45.287820+0000","last_became_active":"2023-10-09T15:37:44.284393+0000","last_became_peered":"2023-10-09T15:37:44.284393+0000","last_unstale":"2023-10-09T15:37:45.287820+0000","last_undegraded":"2023-10-09T15:37:45.287820+0000","last_fullsized":"2023-10-09T15:37:45.287820+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:00.548239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301715+0000","last_change":"2023-10-09T15:37:45.296520+0000","last_active":"2023-10-09T15:37:45.301715+0000","last_peered":"2023-10-09T15:37:45.301715+0000","last_clean":"2023-10-09T15:37:45.301715+0000","last_became_active":"2023-10-09T15:37:45.296224+0000","last_became_peered":"2023-10-09T15:37:45.296224+0000","last_unstale":"2023-10-09T15:37:45.301715+0000","last_undegraded":"2023-10-09T15:37:45.301715+0000","last_fullsized":"2023-10-09T15:37:45.301715+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:36.504639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.282681+0000","last_change":"2023-10-09T15:37:44.287722+0000","last_active":"2023-10-09T15:37:45.282681+0000","last_peered":"2023-10-09T15:37:45.282681+0000","last_clean":"2023-10-09T15:37:45.282681+0000","last_became_active":"2023-10-09T15:37:44.287484+0000","last_became_peered":"2023-10-09T15:37:44.287484+0000","last_unstale":"2023-10-09T15:37:45.282681+0000","last_undegraded":"2023-10-09T15:37:45.282681+0000","last_fullsized":"2023-10-09T15:37:45.282681+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:39.836507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297102+0000","last_change":"2023-10-09T15:37:45.287609+0000","last_active":"2023-10-09T15:37:45.297102+0000","last_peered":"2023-10-09T15:37:45.297102+0000","last_clean":"2023-10-09T15:37:45.297102+0000","last_became_active":"2023-10-09T15:37:45.287321+0000","last_became_peered":"2023-10-09T15:37:45.287321+0000","last_unstale":"2023-10-09T15:37:45.297102+0000","last_undegraded":"2023-10-09T15:37:45.297102+0000","last_fullsized":"2023-10-09T15:37:45.297102+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:19:36.504639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"112'8","reported_seq":18,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303655+0000","last_change":"2023-10-09T15:37:44.290775+0000","last_active":"2023-10-09T15:37:45.303655+0000","last_peered":"2023-10-09T15:37:45.303655+0000","last_clean":"2023-10-09T15:37:45.303655+0000","last_became_active":"2023-10-09T15:37:44.290470+0000","last_became_peered":"2023-10-09T15:37:44.290470+0000","last_unstale":"2023-10-09T15:37:45.303655+0000","last_undegraded":"2023-10-09T15:37:45.303655+0000","last_fullsized":"2023-10-09T15:37:45.303655+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:18:16.089652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303559+0000","last_change":"2023-10-09T15:37:45.299973+0000","last_active":"2023-10-09T15:37:45.303559+0000","last_peered":"2023-10-09T15:37:45.303559+0000","last_clean":"2023-10-09T15:37:45.303559+0000","last_became_active":"2023-10-09T15:37:45.299700+0000","last_became_peered":"2023-10-09T15:37:45.299700+0000","last_unstale":"2023-10-09T15:37:45.303559+0000","last_undegraded":"2023-10-09T15:37:45.303559+0000","last_fullsized":"2023-10-09T15:37:45.303559+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:00.494410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299660+0000","last_change":"2023-10-09T15:37:44.287800+0000","last_active":"2023-10-09T15:37:45.299660+0000","last_peered":"2023-10-09T15:37:45.299660+0000","last_clean":"2023-10-09T15:37:45.299660+0000","last_became_active":"2023-10-09T15:37:44.287444+0000","last_became_peered":"2023-10-09T15:37:44.287444+0000","last_unstale":"2023-10-09T15:37:45.299660+0000","last_undegraded":"2023-10-09T15:37:45.299660+0000","last_fullsized":"2023-10-09T15:37:45.299660+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:39:12.323332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296038+0000","last_change":"2023-10-09T15:37:45.293682+0000","last_active":"2023-10-09T15:37:45.296038+0000","last_peered":"2023-10-09T15:37:45.296038+0000","last_clean":"2023-10-09T15:37:45.296038+0000","last_became_active":"2023-10-09T15:37:45.293302+0000","last_became_peered":"2023-10-09T15:37:45.293302+0000","last_unstale":"2023-10-09T15:37:45.296038+0000","last_undegraded":"2023-10-09T15:37:45.296038+0000","last_fullsized":"2023-10-09T15:37:45.296038+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:48:03.955598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.300952+0000","last_change":"2023-10-09T15:37:44.288321+0000","last_active":"2023-10-09T15:37:45.300952+0000","last_peered":"2023-10-09T15:37:45.300952+0000","last_clean":"2023-10-09T15:37:45.300952+0000","last_became_active":"2023-10-09T15:37:44.288028+0000","last_became_peered":"2023-10-09T15:37:44.288028+0000","last_unstale":"2023-10-09T15:37:45.300952+0000","last_undegraded":"2023-10-09T15:37:45.300952+0000","last_fullsized":"2023-10-09T15:37:45.300952+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:51.412154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296632+0000","last_change":"2023-10-09T15:37:45.289504+0000","last_active":"2023-10-09T15:37:45.296632+0000","last_peered":"2023-10-09T15:37:45.296632+0000","last_clean":"2023-10-09T15:37:45.296632+0000","last_became_active":"2023-10-09T15:37:45.289221+0000","last_became_peered":"2023-10-09T15:37:45.289221+0000","last_unstale":"2023-10-09T15:37:45.296632+0000","last_undegraded":"2023-10-09T15:37:45.296632+0000","last_fullsized":"2023-10-09T15:37:45.296632+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:20:37.633572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"112'1","reported_seq":11,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.296241+0000","last_change":"2023-10-09T15:37:44.283097+0000","last_active":"2023-10-09T15:37:45.296241+0000","last_peered":"2023-10-09T15:37:45.296241+0000","last_clean":"2023-10-09T15:37:45.296241+0000","last_became_active":"2023-10-09T15:37:44.282842+0000","last_became_peered":"2023-10-09T15:37:44.282842+0000","last_unstale":"2023-10-09T15:37:45.296241+0000","last_undegraded":"2023-10-09T15:37:45.296241+0000","last_fullsized":"2023-10-09T15:37:45.296241+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:09:53.906412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303393+0000","last_change":"2023-10-09T15:37:45.298469+0000","last_active":"2023-10-09T15:37:45.303393+0000","last_peered":"2023-10-09T15:37:45.303393+0000","last_clean":"2023-10-09T15:37:45.303393+0000","last_became_active":"2023-10-09T15:37:45.298201+0000","last_became_peered":"2023-10-09T15:37:45.298201+0000","last_unstale":"2023-10-09T15:37:45.303393+0000","last_undegraded":"2023-10-09T15:37:45.303393+0000","last_fullsized":"2023-10-09T15:37:45.303393+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:04:01.928861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285526+0000","last_change":"2023-10-09T15:37:44.289845+0000","last_active":"2023-10-09T15:37:45.285526+0000","last_peered":"2023-10-09T15:37:45.285526+0000","last_clean":"2023-10-09T15:37:45.285526+0000","last_became_active":"2023-10-09T15:37:44.289549+0000","last_became_peered":"2023-10-09T15:37:44.289549+0000","last_unstale":"2023-10-09T15:37:45.285526+0000","last_undegraded":"2023-10-09T15:37:45.285526+0000","last_fullsized":"2023-10-09T15:37:45.285526+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:11:04.874532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.304971+0000","last_change":"2023-10-09T15:37:45.300086+0000","last_active":"2023-10-09T15:37:45.304971+0000","last_peered":"2023-10-09T15:37:45.304971+0000","last_clean":"2023-10-09T15:37:45.304971+0000","last_became_active":"2023-10-09T15:37:45.299558+0000","last_became_peered":"2023-10-09T15:37:45.299558+0000","last_unstale":"2023-10-09T15:37:45.304971+0000","last_undegraded":"2023-10-09T15:37:45.304971+0000","last_fullsized":"2023-10-09T15:37:45.304971+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:40:44.934811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297589+0000","last_change":"2023-10-09T15:37:44.291101+0000","last_active":"2023-10-09T15:37:45.297589+0000","last_peered":"2023-10-09T15:37:45.297589+0000","last_clean":"2023-10-09T15:37:45.297589+0000","last_became_active":"2023-10-09T15:37:44.290823+0000","last_became_peered":"2023-10-09T15:37:44.290823+0000","last_unstale":"2023-10-09T15:37:45.297589+0000","last_undegraded":"2023-10-09T15:37:45.297589+0000","last_fullsized":"2023-10-09T15:37:45.297589+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:39.836507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293027+0000","last_change":"2023-10-09T15:37:45.289110+0000","last_active":"2023-10-09T15:37:45.293027+0000","last_peered":"2023-10-09T15:37:45.293027+0000","last_clean":"2023-10-09T15:37:45.293027+0000","last_became_active":"2023-10-09T15:37:45.288820+0000","last_became_peered":"2023-10-09T15:37:45.288820+0000","last_unstale":"2023-10-09T15:37:45.293027+0000","last_undegraded":"2023-10-09T15:37:45.293027+0000","last_fullsized":"2023-10-09T15:37:45.293027+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:44.628549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275917+0000","last_change":"2023-10-09T15:37:44.286441+0000","last_active":"2023-10-09T15:37:45.275917+0000","last_peered":"2023-10-09T15:37:45.275917+0000","last_clean":"2023-10-09T15:37:45.275917+0000","last_became_active":"2023-10-09T15:37:44.286153+0000","last_became_peered":"2023-10-09T15:37:44.286153+0000","last_unstale":"2023-10-09T15:37:45.275917+0000","last_undegraded":"2023-10-09T15:37:45.275917+0000","last_fullsized":"2023-10-09T15:37:45.275917+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:37:59.492349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.292558+0000","last_change":"2023-10-09T15:37:45.290588+0000","last_active":"2023-10-09T15:37:45.292558+0000","last_peered":"2023-10-09T15:37:45.292558+0000","last_clean":"2023-10-09T15:37:45.292558+0000","last_became_active":"2023-10-09T15:37:45.290337+0000","last_became_peered":"2023-10-09T15:37:45.290337+0000","last_unstale":"2023-10-09T15:37:45.292558+0000","last_undegraded":"2023-10-09T15:37:45.292558+0000","last_fullsized":"2023-10-09T15:37:45.292558+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:38:00.494410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275288+0000","last_change":"2023-10-09T15:37:44.286620+0000","last_active":"2023-10-09T15:37:45.275288+0000","last_peered":"2023-10-09T15:37:45.275288+0000","last_clean":"2023-10-09T15:37:45.275288+0000","last_became_active":"2023-10-09T15:37:44.286304+0000","last_became_peered":"2023-10-09T15:37:44.286304+0000","last_unstale":"2023-10-09T15:37:45.275288+0000","last_undegraded":"2023-10-09T15:37:45.275288+0000","last_fullsized":"2023-10-09T15:37:45.275288+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:05.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.301358+0000","last_change":"2023-10-09T15:37:45.298109+0000","last_active":"2023-10-09T15:37:45.301358+0000","last_peered":"2023-10-09T15:37:45.301358+0000","last_clean":"2023-10-09T15:37:45.301358+0000","last_became_active":"2023-10-09T15:37:45.297626+0000","last_became_peered":"2023-10-09T15:37:45.297626+0000","last_unstale":"2023-10-09T15:37:45.301358+0000","last_undegraded":"2023-10-09T15:37:45.301358+0000","last_fullsized":"2023-10-09T15:37:45.301358+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.917637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285275+0000","last_change":"2023-10-09T15:37:44.288663+0000","last_active":"2023-10-09T15:37:45.285275+0000","last_peered":"2023-10-09T15:37:45.285275+0000","last_clean":"2023-10-09T15:37:45.285275+0000","last_became_active":"2023-10-09T15:37:44.288098+0000","last_became_peered":"2023-10-09T15:37:44.288098+0000","last_unstale":"2023-10-09T15:37:45.285275+0000","last_undegraded":"2023-10-09T15:37:45.285275+0000","last_fullsized":"2023-10-09T15:37:45.285275+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:23.972260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294695+0000","last_change":"2023-10-09T15:37:45.291320+0000","last_active":"2023-10-09T15:37:45.294695+0000","last_peered":"2023-10-09T15:37:45.294695+0000","last_clean":"2023-10-09T15:37:45.294695+0000","last_became_active":"2023-10-09T15:37:45.290894+0000","last_became_peered":"2023-10-09T15:37:45.290894+0000","last_unstale":"2023-10-09T15:37:45.294695+0000","last_undegraded":"2023-10-09T15:37:45.294695+0000","last_fullsized":"2023-10-09T15:37:45.294695+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:47.661994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.297408+0000","last_change":"2023-10-09T15:37:44.287314+0000","last_active":"2023-10-09T15:37:45.297408+0000","last_peered":"2023-10-09T15:37:45.297408+0000","last_clean":"2023-10-09T15:37:45.297408+0000","last_became_active":"2023-10-09T15:37:44.287042+0000","last_became_peered":"2023-10-09T15:37:44.287042+0000","last_unstale":"2023-10-09T15:37:45.297408+0000","last_undegraded":"2023-10-09T15:37:45.297408+0000","last_fullsized":"2023-10-09T15:37:45.297408+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:08.409196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.305056+0000","last_change":"2023-10-09T15:37:45.300003+0000","last_active":"2023-10-09T15:37:45.305056+0000","last_peered":"2023-10-09T15:37:45.305056+0000","last_clean":"2023-10-09T15:37:45.305056+0000","last_became_active":"2023-10-09T15:37:45.299561+0000","last_became_peered":"2023-10-09T15:37:45.299561+0000","last_unstale":"2023-10-09T15:37:45.305056+0000","last_undegraded":"2023-10-09T15:37:45.305056+0000","last_fullsized":"2023-10-09T15:37:45.305056+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:42:35.999206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.280720+0000","last_change":"2023-10-09T15:37:44.293478+0000","last_active":"2023-10-09T15:37:45.280720+0000","last_peered":"2023-10-09T15:37:45.280720+0000","last_clean":"2023-10-09T15:37:45.280720+0000","last_became_active":"2023-10-09T15:37:44.293201+0000","last_became_peered":"2023-10-09T15:37:44.293201+0000","last_unstale":"2023-10-09T15:37:45.280720+0000","last_undegraded":"2023-10-09T15:37:45.280720+0000","last_fullsized":"2023-10-09T15:37:45.280720+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:04.563201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.293132+0000","last_change":"2023-10-09T15:37:45.291468+0000","last_active":"2023-10-09T15:37:45.293132+0000","last_peered":"2023-10-09T15:37:45.293132+0000","last_clean":"2023-10-09T15:37:45.293132+0000","last_became_active":"2023-10-09T15:37:45.291174+0000","last_became_peered":"2023-10-09T15:37:45.291174+0000","last_unstale":"2023-10-09T15:37:45.293132+0000","last_undegraded":"2023-10-09T15:37:45.293132+0000","last_fullsized":"2023-10-09T15:37:45.293132+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:05.565262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.286080+0000","last_change":"2023-10-09T15:37:44.286637+0000","last_active":"2023-10-09T15:37:45.286080+0000","last_peered":"2023-10-09T15:37:45.286080+0000","last_clean":"2023-10-09T15:37:45.286080+0000","last_became_active":"2023-10-09T15:37:44.286427+0000","last_became_peered":"2023-10-09T15:37:44.286427+0000","last_unstale":"2023-10-09T15:37:45.286080+0000","last_undegraded":"2023-10-09T15:37:45.286080+0000","last_fullsized":"2023-10-09T15:37:45.286080+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:21:52.035762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.294877+0000","last_change":"2023-10-09T15:37:45.288239+0000","last_active":"2023-10-09T15:37:45.294877+0000","last_peered":"2023-10-09T15:37:45.294877+0000","last_clean":"2023-10-09T15:37:45.294877+0000","last_became_active":"2023-10-09T15:37:45.287946+0000","last_became_peered":"2023-10-09T15:37:45.287946+0000","last_unstale":"2023-10-09T15:37:45.294877+0000","last_undegraded":"2023-10-09T15:37:45.294877+0000","last_fullsized":"2023-10-09T15:37:45.294877+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:06.240371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.284887+0000","last_change":"2023-10-09T15:37:44.289557+0000","last_active":"2023-10-09T15:37:45.284887+0000","last_peered":"2023-10-09T15:37:45.284887+0000","last_clean":"2023-10-09T15:37:45.284887+0000","last_became_active":"2023-10-09T15:37:44.289200+0000","last_became_peered":"2023-10-09T15:37:44.289200+0000","last_unstale":"2023-10-09T15:37:45.284887+0000","last_undegraded":"2023-10-09T15:37:45.284887+0000","last_fullsized":"2023-10-09T15:37:45.284887+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:21.911798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.299183+0000","last_change":"2023-10-09T15:37:45.290940+0000","last_active":"2023-10-09T15:37:45.299183+0000","last_peered":"2023-10-09T15:37:45.299183+0000","last_clean":"2023-10-09T15:37:45.299183+0000","last_became_active":"2023-10-09T15:37:45.290599+0000","last_became_peered":"2023-10-09T15:37:45.290599+0000","last_unstale":"2023-10-09T15:37:45.299183+0000","last_undegraded":"2023-10-09T15:37:45.299183+0000","last_fullsized":"2023-10-09T15:37:45.299183+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:24:26.966866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.282710+0000","last_change":"2023-10-09T15:37:44.288797+0000","last_active":"2023-10-09T15:37:45.282710+0000","last_peered":"2023-10-09T15:37:45.282710+0000","last_clean":"2023-10-09T15:37:45.282710+0000","last_became_active":"2023-10-09T15:37:44.288250+0000","last_became_peered":"2023-10-09T15:37:44.288250+0000","last_unstale":"2023-10-09T15:37:45.282710+0000","last_undegraded":"2023-10-09T15:37:45.282710+0000","last_fullsized":"2023-10-09T15:37:45.282710+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:33:26.889256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302097+0000","last_change":"2023-10-09T15:37:45.298057+0000","last_active":"2023-10-09T15:37:45.302097+0000","last_peered":"2023-10-09T15:37:45.302097+0000","last_clean":"2023-10-09T15:37:45.302097+0000","last_became_active":"2023-10-09T15:37:45.297735+0000","last_became_peered":"2023-10-09T15:37:45.297735+0000","last_unstale":"2023-10-09T15:37:45.302097+0000","last_undegraded":"2023-10-09T15:37:45.302097+0000","last_fullsized":"2023-10-09T15:37:45.302097+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:12:09.678175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.281583+0000","last_change":"2023-10-09T15:37:44.293615+0000","last_active":"2023-10-09T15:37:45.281583+0000","last_peered":"2023-10-09T15:37:45.281583+0000","last_clean":"2023-10-09T15:37:45.281583+0000","last_became_active":"2023-10-09T15:37:44.293306+0000","last_became_peered":"2023-10-09T15:37:44.293306+0000","last_unstale":"2023-10-09T15:37:45.281583+0000","last_undegraded":"2023-10-09T15:37:45.281583+0000","last_fullsized":"2023-10-09T15:37:45.281583+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:05.592944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.295682+0000","last_change":"2023-10-09T15:37:45.283388+0000","last_active":"2023-10-09T15:37:45.295682+0000","last_peered":"2023-10-09T15:37:45.295682+0000","last_clean":"2023-10-09T15:37:45.295682+0000","last_became_active":"2023-10-09T15:37:45.283109+0000","last_became_peered":"2023-10-09T15:37:45.283109+0000","last_unstale":"2023-10-09T15:37:45.295682+0000","last_undegraded":"2023-10-09T15:37:45.295682+0000","last_fullsized":"2023-10-09T15:37:45.295682+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:07:32.193331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.275397+0000","last_change":"2023-10-09T15:37:44.286473+0000","last_active":"2023-10-09T15:37:45.275397+0000","last_peered":"2023-10-09T15:37:45.275397+0000","last_clean":"2023-10-09T15:37:45.275397+0000","last_became_active":"2023-10-09T15:37:44.286180+0000","last_became_peered":"2023-10-09T15:37:44.286180+0000","last_unstale":"2023-10-09T15:37:45.275397+0000","last_undegraded":"2023-10-09T15:37:45.275397+0000","last_fullsized":"2023-10-09T15:37:45.275397+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:21:04.563201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.292584+0000","last_change":"2023-10-09T15:37:45.291565+0000","last_active":"2023-10-09T15:37:45.292584+0000","last_peered":"2023-10-09T15:37:45.292584+0000","last_clean":"2023-10-09T15:37:45.292584+0000","last_became_active":"2023-10-09T15:37:45.291322+0000","last_became_peered":"2023-10-09T15:37:45.291322+0000","last_unstale":"2023-10-09T15:37:45.292584+0000","last_undegraded":"2023-10-09T15:37:45.292584+0000","last_fullsized":"2023-10-09T15:37:45.292584+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:06.595006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":10,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.285381+0000","last_change":"2023-10-09T15:37:44.288346+0000","last_active":"2023-10-09T15:37:45.285381+0000","last_peered":"2023-10-09T15:37:45.285381+0000","last_clean":"2023-10-09T15:37:45.285381+0000","last_became_active":"2023-10-09T15:37:44.287776+0000","last_became_peered":"2023-10-09T15:37:44.287776+0000","last_unstale":"2023-10-09T15:37:45.285381+0000","last_undegraded":"2023-10-09T15:37:45.285381+0000","last_fullsized":"2023-10-09T15:37:45.285381+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:58:04.247668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":9,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.303507+0000","last_change":"2023-10-09T15:37:45.299072+0000","last_active":"2023-10-09T15:37:45.303507+0000","last_peered":"2023-10-09T15:37:45.303507+0000","last_clean":"2023-10-09T15:37:45.303507+0000","last_became_active":"2023-10-09T15:37:45.298773+0000","last_became_peered":"2023-10-09T15:37:45.298773+0000","last_unstale":"2023-10-09T15:37:45.303507+0000","last_undegraded":"2023-10-09T15:37:45.303507+0000","last_fullsized":"2023-10-09T15:37:45.303507+0000","mapping_epoch":111,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:44.264751+0000","last_clean_scrub_stamp":"2023-10-09T15:37:44.264751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:52.414216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"112'2","reported_seq":12,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.302873+0000","last_change":"2023-10-09T15:37:44.292979+0000","last_active":"2023-10-09T15:37:45.302873+0000","last_peered":"2023-10-09T15:37:45.302873+0000","last_clean":"2023-10-09T15:37:45.302873+0000","last_became_active":"2023-10-09T15:37:44.292613+0000","last_became_peered":"2023-10-09T15:37:44.292613+0000","last_unstale":"2023-10-09T15:37:45.302873+0000","last_undegraded":"2023-10-09T15:37:45.302873+0000","last_fullsized":"2023-10-09T15:37:45.302873+0000","mapping_epoch":110,"log_start":"0'0","ondisk_log_start":"0'0","created":110,"last_epoch_clean":111,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:37:43.262689+0000","last_clean_scrub_stamp":"2023-10-09T15:37:43.262689+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:09.019126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":239,"reported_epoch":112,"state":"active+clean","last_fresh":"2023-10-09T15:37:45.280780+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:37:45.280780+0000","last_peered":"2023-10-09T15:37:45.280780+0000","last_clean":"2023-10-09T15:37:45.280780+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:37:45.280780+0000","last_undegraded":"2023-10-09T15:37:45.280780+0000","last_fullsized":"2023-10-09T15:37:45.280780+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574935,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303368,"kb_used_data":1984,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068472,"statfs":{"total":96636764160,"available":96326115328,"internally_reserved":0,"allocated":2031616,"data_stored":1203847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.53700000000000003,"15min":0.50900000000000001},"min":{"1min":0.38,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.74199999999999999,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54600000000000004,"15min":0.53300000000000003},"min":{"1min":0.371,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.70699999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.44400000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.42799999999999999,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.67700000000000005,"5min":0.874,"15min":0.874},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.55100000000000005,"15min":0.54700000000000004},"min":{"1min":0.40300000000000002,"5min":0.35299999999999998,"15min":0.33900000000000002},"max":{"1min":0.747,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.33300000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.56200000000000006,"15min":0.53400000000000003},"min":{"1min":0.37,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.67300000000000004,"5min":0.81000000000000005,"15min":0.81000000000000005},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.56200000000000006,"15min":0.54900000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.59699999999999998,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.73599999999999999,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.499},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.59699999999999998,"15min":0.60699999999999998},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56299999999999994,"15min":0.53300000000000003},"min":{"1min":0.36599999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.81100000000000005,"5min":0.89000000000000001,"15min":0.89000000000000001},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59899999999999998,"15min":0.55200000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.33500000000000002},"max":{"1min":0.84399999999999997,"5min":0.88,"15min":0.88},"last":0.35899999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.40100000000000002,"5min":0.376,"15min":0.376},"max":{"1min":0.75800000000000001,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.377},{"interface":"front","average":{"1min":0.626,"5min":0.625,"15min":0.58799999999999997},"min":{"1min":0.41799999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.48799999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:05 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.68000000000000005,"15min":0.65000000000000002},"min":{"1min":0.46899999999999997,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.97099999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.68000000000000005,"15min":0.64900000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.90900000000000003,"5min":0.93000000000000005,"15min":0.93000000000000005},"last":0.54000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302776,"kb_used_data":1392,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069064,"statfs":{"total":96636764160,"available":96326721536,"internally_reserved":0,"allocated":1425408,"data_stored":612869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.498},"min":{"1min":0.36399999999999999,"5min":0.32500000000000001,"15min":0.252},"max":{"1min":0.83799999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.38700000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76800000000000002,"5min":0.90400000000000003,"15min":0.90400000000000003},"last":0.46100000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51700000000000002,"15min":0.55600000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.63400000000000001,"5min":0.81899999999999995,"15min":1.379},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.38800000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73799999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.70899999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55300000000000005,"15min":0.59499999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.76400000000000001,"5min":0.88600000000000001,"15min":1.3999999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.54900000000000004,"15min":0.78100000000000003},"min":{"1min":0.41199999999999998,"5min":0.36599999999999999,"15min":0.35799999999999998},"max":{"1min":0.68100000000000005,"5min":0.87,"15min":7.3419999999999996},"last":0.58399999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58099999999999996,"15min":0.61599999999999999},"min":{"1min":0.46999999999999997,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.72499999999999998,"5min":0.85199999999999998,"15min":1.3560000000000001},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60099999999999998,"15min":0.64000000000000001},"min":{"1min":0.51500000000000001,"5min":0.40200000000000002,"15min":0.34699999999999998},"max":{"1min":0.69199999999999995,"5min":0.92300000000000004,"15min":1.4399999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.76900000000000002,"5min":0.93600000000000005,"15min":0.93600000000000005},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.60199999999999998,"15min":0.57299999999999995},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.79900000000000004,"5min":0.872,"15min":0.872},"last":0.75900000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59199999999999997,"15min":0.59499999999999997},"min":{"1min":0.377,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.81699999999999995,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.73999999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.61099999999999999,"15min":0.63100000000000001},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.82299999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.67300000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:37:04 2023","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.63900000000000001,"15min":0.65000000000000002},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.78900000000000003,"5min":1.004,"15min":1.004},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.67300000000000004,"15min":0.66900000000000004},"min":{"1min":0.501,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.90100000000000002,"5min":0.96699999999999997,"15min":0.96699999999999997},"last":0.78800000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302764,"kb_used_data":1380,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069076,"statfs":{"total":96636764160,"available":96326733824,"internally_reserved":0,"allocated":1413120,"data_stored":611333,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.35299999999999998},"min":{"1min":0.22500000000000001,"5min":0.217,"15min":0.215},"max":{"1min":0.63,"5min":0.63,"15min":0.90200000000000002},"last":0.373},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.34599999999999997,"15min":0.38500000000000001},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.51900000000000002,"5min":0.55300000000000005,"15min":1.512},"last":0.41799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.33100000000000002,"15min":0.36899999999999999},"min":{"1min":0.23899999999999999,"5min":0.221,"15min":0.221},"max":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":1.286},"last":0.44},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.378,"15min":0.40799999999999997},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.49299999999999999,"5min":0.59699999999999998,"15min":1.0249999999999999},"last":0.53000000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.41599999999999998,"15min":0.443},"min":{"1min":0.312,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.54200000000000004,"5min":0.63400000000000001,"15min":0.96899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.40699999999999997,"15min":0.44600000000000001},"min":{"1min":0.33700000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.49199999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.57399999999999995,"15min":0.60599999999999998},"min":{"1min":0.377,"5min":0.374,"15min":0.374},"max":{"1min":0.76800000000000002,"5min":0.877,"15min":1.222},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.58599999999999997,"15min":0.626},"min":{"1min":0.41399999999999998,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.86099999999999999,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59199999999999997,"15min":0.625},"min":{"1min":0.41899999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.83699999999999997,"5min":0.999,"15min":1.4410000000000001},"last":0.78900000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.58499999999999996,"15min":0.61799999999999999},"min":{"1min":0.37,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.78900000000000003,"5min":0.84799999999999998,"15min":1.1850000000000001},"last":0.81999999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63200000000000001,"15min":0.79600000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.80300000000000005,"5min":0.92200000000000004,"15min":5.5010000000000003},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.63700000000000001,"15min":0.67200000000000004},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.877,"5min":0.93600000000000005,"15min":1.258},"last":0.90200000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:36:59 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.64200000000000002,"15min":0.66600000000000004},"min":{"1min":0.45900000000000002,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.77000000000000002,"5min":0.996,"15min":0.997},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.63300000000000001,"15min":0.80100000000000005},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.93300000000000005,"5min":0.98499999999999999,"15min":5.5819999999999999},"last":0.93200000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303340,"kb_used_data":1956,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068500,"statfs":{"total":96636764160,"available":96326144000,"internally_reserved":0,"allocated":2002944,"data_stored":1200690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.35499999999999998,"15min":0.378},"min":{"1min":0.29799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":2.1520000000000001,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.307},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.40200000000000002,"15min":0.42199999999999999},"min":{"1min":0.31900000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":2.0859999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.377}]},{"osd":2,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72699999999999998,"5min":0.42899999999999999,"15min":0.41199999999999998},"min":{"1min":0.313,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":6.484,"5min":6.484,"15min":6.484},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.71099999999999997,"5min":0.41799999999999998,"15min":0.53700000000000003},"min":{"1min":0.28699999999999998,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":6.2859999999999996,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.32900000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.52700000000000002},"min":{"1min":0.26700000000000002,"5min":0.215,"15min":0.215},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.438,"15min":0.60999999999999999},"min":{"1min":0.34499999999999997,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":2.109,"5min":2.109,"15min":4.5890000000000004},"last":0.39000000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.72899999999999998,"5min":0.59399999999999997,"15min":0.64100000000000001},"min":{"1min":0.41899999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":1.921,"5min":1.921,"15min":1.921},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.57699999999999996,"15min":0.65600000000000003},"min":{"1min":0.42999999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.74299999999999999,"5min":0.83099999999999996,"15min":1.508},"last":0.498}]},{"osd":5,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.57999999999999996,"15min":0.624},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.77000000000000002,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.81799999999999995,"5min":0.63700000000000001,"15min":0.64400000000000002},"min":{"1min":0.44600000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":4.1020000000000003,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.58799999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.85099999999999998,"5min":0.66400000000000003,"15min":0.69199999999999995},"min":{"1min":0.49299999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":3.9009999999999998,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.79300000000000004,"5min":0.64800000000000002,"15min":0.68700000000000006},"min":{"1min":0.55600000000000005,"5min":0.443,"15min":0.443},"max":{"1min":1.9810000000000001,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.60599999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:10 2023","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.65400000000000003,"15min":0.70699999999999996},"min":{"1min":0.51700000000000002,"5min":0.378,"15min":0.378},"max":{"1min":2.032,"5min":2.032,"15min":2.032},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.63800000000000001,"15min":0.67000000000000004},"min":{"1min":0.46300000000000002,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.61599999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574935,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.32900000000000001},"min":{"1min":0.214,"5min":0.20000000000000001,"15min":0.187},"max":{"1min":0.56399999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.437},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.34799999999999998,"15min":0.35899999999999999},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.495,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.5}]},{"osd":1,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.373,"15min":0.36499999999999999},"min":{"1min":0.26400000000000001,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.46899999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.38400000000000001,"15min":0.38600000000000001},"min":{"1min":0.22600000000000001,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.50700000000000001,"5min":0.64900000000000002,"15min":0.73699999999999999},"last":0.53700000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.36199999999999999,"5min":0.36299999999999999,"15min":0.36399999999999999},"min":{"1min":0.23899999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.49399999999999999,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.42999999999999999,"15min":0.434},"min":{"1min":0.32300000000000001,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.53600000000000003,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.52400000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.59499999999999997,"15min":0.64800000000000002},"min":{"1min":0.44600000000000001,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.77700000000000002,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.71199999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.60799999999999998},"min":{"1min":0.40000000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81399999999999995,"5min":0.85399999999999998,"15min":0.93899999999999995},"last":0.84399999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.48999999999999999,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77300000000000002,"5min":0.79000000000000004,"15min":0.80800000000000005},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60899999999999999,"15min":0.68400000000000005},"min":{"1min":0.432,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.84499999999999997,"15min":2.5249999999999999},"last":0.77200000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.629,"15min":0.67900000000000005},"min":{"1min":0.439,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.81999999999999995,"5min":0.96099999999999997,"15min":1.5189999999999999},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.63800000000000001,"15min":0.65800000000000003},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.83299999999999996,"5min":0.92200000000000004,"15min":0.97199999999999998},"last":0.85899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:06 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.64600000000000002,"15min":0.68400000000000005},"min":{"1min":0.51600000000000001,"5min":0.44,"15min":0.44},"max":{"1min":0.83799999999999997,"5min":0.90800000000000003,"15min":1.407},"last":0.87},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63700000000000001,"15min":0.65900000000000003},"min":{"1min":0.44400000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.92000000000000004},"last":0.83499999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.32300000000000001,"15min":0.36299999999999999},"min":{"1min":0.23200000000000001,"5min":0.19900000000000001,"15min":0.19900000000000001},"max":{"1min":0.57399999999999995,"5min":0.57499999999999996,"15min":1.2270000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.371,"5min":0.34100000000000003,"15min":0.86199999999999999},"min":{"1min":0.26000000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.33100000000000002,"15min":0.64900000000000002},"min":{"1min":0.253,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.41799999999999998,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.495},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.36599999999999999,"15min":0.41599999999999998},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.61299999999999999,"5min":0.63300000000000001,"15min":1.3049999999999999},"last":0.60099999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.35799999999999998,"15min":1.333},"min":{"1min":0.28699999999999998,"5min":0.247,"15min":0.247},"max":{"1min":0.66500000000000004,"5min":0.68100000000000005,"15min":16.937999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38200000000000001,"15min":0.72199999999999998},"min":{"1min":0.30599999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.51500000000000001,"5min":0.59599999999999997,"15min":10.451000000000001},"last":0.58699999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.57499999999999996,"15min":1.073},"min":{"1min":0.42199999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.874,"5min":0.93600000000000005,"15min":17.02},"last":0.996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.626,"15min":0.89700000000000002},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.81000000000000005,"5min":5.3630000000000004,"15min":9.6969999999999992},"last":0.89700000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.63800000000000001,"15min":0.626},"min":{"1min":0.42799999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.78400000000000003,"5min":5.3460000000000001,"15min":5.3460000000000001},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.626,"5min":0.58899999999999997,"15min":1.101},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.879,"15min":16.984999999999999},"last":1.0249999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.60699999999999998,"15min":0.90700000000000003},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.43099999999999999},"max":{"1min":0.84899999999999998,"5min":0.96799999999999997,"15min":9.7319999999999993},"last":0.92700000000000005},{"interface":"front","average":{"1min":0.67300000000000004,"5min":0.64500000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.86099999999999999,"5min":0.873,"15min":1.278},"last":0.97799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:37:08 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.63,"15min":1.145},"min":{"1min":0.498,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.83899999999999997,"5min":0.98999999999999999,"15min":17.053999999999998},"last":0.93799999999999994},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.64400000000000002,"15min":0.92400000000000004},"min":{"1min":0.49199999999999999,"5min":0.45600000000000002,"15min":0.45600000000000002},"max":{"1min":0.82099999999999995,"5min":0.91400000000000003,"15min":9.6029999999999998},"last":0.82799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302768,"kb_used_data":1384,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069072,"statfs":{"total":96636764160,"available":96326729728,"internally_reserved":0,"allocated":1417216,"data_stored":611403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.28299999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.71599999999999997,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.57899999999999996,"15min":0.58099999999999996},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.83999999999999997,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.58499999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.59199999999999997,"15min":0.65400000000000003},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79400000000000004,"5min":0.91900000000000004,"15min":2.879},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.56200000000000006,"15min":0.56299999999999994},"min":{"1min":0.36099999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.72199999999999998,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.56299999999999994}]},{"osd":2,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.35999999999999999,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.35999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.76400000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.40600000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.73299999999999998,"5min":0.78600000000000003,"15min":0.79600000000000004},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.60399999999999998},"min":{"1min":0.376,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.95199999999999996,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.745}]},{"osd":5,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.28199999999999997},"max":{"1min":0.877,"5min":0.877,"15min":0.90300000000000002},"last":0.90600000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.60399999999999998,"15min":0.625},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.80000000000000004,"5min":0.878,"15min":0.89900000000000002},"last":0.78200000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.57599999999999996,"15min":0.57799999999999996},"min":{"1min":0.378,"5min":0.32200000000000001,"15min":0.311},"max":{"1min":1.0029999999999999,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.67600000000000005,"5min":0.66000000000000003,"15min":0.67900000000000005},"min":{"1min":0.48499999999999999,"5min":0.45600000000000002,"15min":0.433},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:37:02 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.60299999999999998,"15min":0.627},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.86299999999999999,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.92200000000000004},{"interface":"front","average":{"1min":0.68500000000000005,"5min":0.65300000000000002,"15min":0.66700000000000004},"min":{"1min":0.46600000000000003,"5min":0.41199999999999998,"15min":0.40000000000000002},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.83499999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574935,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302772,"kb_used_data":1388,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94069068,"statfs":{"total":96636764160,"available":96326725632,"internally_reserved":0,"allocated":1421312,"data_stored":611445,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.50700000000000001,"15min":0.51700000000000002},"min":{"1min":0.32000000000000001,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.72799999999999998,"5min":0.81399999999999995,"15min":0.87},"last":0.307},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.42799999999999999,"5min":0.32200000000000001,"15min":0.32100000000000001},"max":{"1min":0.68400000000000005,"5min":1.165,"15min":1.165},"last":0.53400000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.55100000000000005,"15min":0.53600000000000003},"min":{"1min":0.34899999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.70299999999999996,"5min":2.089,"15min":2.089},"last":0.379},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53100000000000003,"15min":0.54900000000000004},"min":{"1min":0.36799999999999999,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73599999999999999,"5min":0.76600000000000001,"15min":0.94199999999999995},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.55400000000000005,"15min":0.88200000000000001},"min":{"1min":0.443,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.79000000000000004,"5min":0.95599999999999996,"15min":11.055},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.57099999999999995,"15min":0.90300000000000002},"min":{"1min":0.40500000000000003,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.64700000000000002,"5min":2.1640000000000001,"15min":11.092000000000001},"last":0.55000000000000004}]},{"osd":3,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58499999999999996,"15min":0.90800000000000003},"min":{"1min":0.36799999999999999,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.746,"5min":1.1000000000000001,"15min":11.164999999999999},"last":0.496},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60199999999999998,"15min":0.59999999999999998},"min":{"1min":0.49399999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.76600000000000001,"5min":2.2000000000000002,"15min":2.2000000000000002},"last":0.50900000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.53400000000000003,"15min":0.54000000000000004},"min":{"1min":0.27700000000000002,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.74299999999999999,"5min":2.3290000000000002,"15min":2.3290000000000002},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58099999999999996,"15min":0.58699999999999997},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":1.0569999999999999,"15min":1.0569999999999999},"last":0.59499999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.57699999999999996,"15min":0.57499999999999996},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.80400000000000005,"5min":2.2349999999999999,"15min":2.2349999999999999},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.57299999999999995,"15min":0.59799999999999998},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.754,"5min":0.89400000000000002,"15min":0.90200000000000002},"last":0.52400000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:37:00 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.59999999999999998,"15min":0.61399999999999999},"min":{"1min":0.307,"5min":0.307,"15min":0.307},"max":{"1min":0.95999999999999996,"5min":1.016,"15min":1.016},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.45700000000000002,"5min":0.432,"15min":0.432},"max":{"1min":0.82899999999999996,"5min":2.9359999999999999,"15min":2.9359999999999999},"last":0.58299999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:37:49.784 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:37:49.785 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:37:49.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.943+0000 7f0f967ed700 1 Processor -- start 2023-10-09T15:37:49.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.943+0000 7f0f967ed700 1 -- start start 2023-10-09T15:37:49.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f967ed700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f90159380 0x7f0f90159750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f967ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 0x7f0f9015dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f967ed700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f900ccfa0 con 0x7f0f900cea00 2023-10-09T15:37:49.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f967ed700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f900cb880 con 0x7f0f90159380 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f967ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900cbb60 con 0x7f0f900cb3f0 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f95fec700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f900cea00 0x7f0f900cedf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47084/0 (socket says 172.21.15.33:47084) 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f95fec700 1 -- 172.21.15.33:0/1702032405 learned_addr learned my addr 172.21.15.33:0/1702032405 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f94fea700 1 --2- 172.21.15.33:0/1702032405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 0x7f0f9015dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.944+0000 7f0f957eb700 1 --2- 172.21.15.33:0/1702032405 >> v2:172.21.15.59:3300/0 conn(0x7f0f90159380 0x7f0f90159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2928632824 0 0) 0x7f0f900ccfa0 con 0x7f0f900cea00 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f78003570 con 0x7f0f900cea00 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f94fea700 1 -- 172.21.15.33:0/1702032405 >> v2:172.21.15.59:3300/0 conn(0x7f0f90159380 msgr2=0x7f0f90159750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f94fea700 1 --2- 172.21.15.33:0/1702032405 >> v2:172.21.15.59:3300/0 conn(0x7f0f90159380 0x7f0f90159750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f94fea700 1 -- 172.21.15.33:0/1702032405 >> v1:172.21.15.33:6789/0 conn(0x7f0f900cea00 legacy=0x7f0f900cedf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2202063571 0 0) 0x7f0f78003570 con 0x7f0f900cea00 2023-10-09T15:37:49.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f94fea700 1 -- 172.21.15.33:0/1702032405 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f900cbe40 con 0x7f0f900cb3f0 2023-10-09T15:37:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f94fea700 1 --2- 172.21.15.33:0/1702032405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 0x7f0f9015dc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f840098e0 tx=0x7f0f840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8bd2e53f567cf17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f800017f0 con 0x7f0f900cb3f0 2023-10-09T15:37:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f84011420 con 0x7f0f900cb3f0 2023-10-09T15:37:49.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.945+0000 7f0f8ffff700 1 -- 172.21.15.33:0/1702032405 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f840117c0 con 0x7f0f900cb3f0 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 -- 172.21.15.33:0/1702032405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 msgr2=0x7f0f9015dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 --2- 172.21.15.33:0/1702032405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 0x7f0f9015dc00 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f0f840098e0 tx=0x7f0f840091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 -- 172.21.15.33:0/1702032405 shutdown_connections 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 --2- 172.21.15.33:0/1702032405 >> v2:172.21.15.59:3300/0 conn(0x7f0f90159380 0x7f0f90159750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 --2- 172.21.15.33:0/1702032405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f900cb3f0 0x7f0f9015dc00 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 -- 172.21.15.33:0/1702032405 >> 172.21.15.33:0/1702032405 conn(0x7f0f900703a0 msgr2=0x7f0f900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 -- 172.21.15.33:0/1702032405 shutdown_connections 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.946+0000 7f0f967ed700 1 -- 172.21.15.33:0/1702032405 wait complete. 2023-10-09T15:37:49.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.947+0000 7f0f967ed700 1 Processor -- start 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.947+0000 7f0f967ed700 1 -- start start 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 0x7f0f900c9870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f90159380 0x7f0f900b20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c7f50 con 0x7f0f900cea00 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c8230 con 0x7f0f900cb3f0 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f967ed700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f900c8510 con 0x7f0f90159380 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36136/0 (socket says 172.21.15.33:36136) 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 -- 172.21.15.33:0/150684593 learned_addr learned my addr 172.21.15.33:0/150684593 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f95fec700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f90159380 0x7f0f900b20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f957eb700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 0x7f0f900c9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 -- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f90159380 msgr2=0x7f0f900b20b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f90159380 0x7f0f900b20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 -- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 msgr2=0x7f0f900c9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 0x7f0f900c9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f94fea700 1 -- 172.21.15.33:0/150684593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f84009420 con 0x7f0f900cea00 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.948+0000 7f0f957eb700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 0x7f0f900c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f94fea700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0f840030c0 tx=0x7f0f84016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401cc90 con 0x7f0f900cea00 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8401cdf0 con 0x7f0f900cea00 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f9015a6b0 con 0x7f0f900cea00 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8401a6a0 con 0x7f0f900cea00 2023-10-09T15:37:49.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.949+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f900c7b20 con 0x7f0f900cea00 2023-10-09T15:37:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.950+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f900c8370 con 0x7f0f900cea00 2023-10-09T15:37:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.950+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f8401aad0 con 0x7f0f900cea00 2023-10-09T15:37:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.950+0000 7f0f8d7fa700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 0x7f0f7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:49.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.951+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f84086660 con 0x7f0f900cea00 2023-10-09T15:37:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.951+0000 7f0f957eb700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 0x7f0f7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:49.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.951+0000 7f0f957eb700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 0x7f0f7c0697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006f00 tx=0x7f0f88008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:49.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:49.955+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f900c8370 con 0x7f0f900cea00 2023-10-09T15:37:50.132 INFO:tasks.ceph.mds.c.smithi033.stderr:2023-10-09T15:37:50.131+0000 7fdbbbed2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:37:50.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.228+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0f9015a510 con 0x7f0f900cea00 2023-10-09T15:37:50.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.232+0000 7f0f8d7fa700 1 -- 172.21.15.33:0/150684593 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0f9015a510 con 0x7f0f900cea00 2023-10-09T15:37:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 msgr2=0x7f0f7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 0x7f0f7c0697d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f0f88006f00 tx=0x7f0f88008040 comp rx=0 tx=0).stop 2023-10-09T15:37:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 msgr2=0x7f0f900c75e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f0f840030c0 tx=0x7f0f84016000 comp rx=0 tx=0).stop 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 shutdown_connections 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f7c067320 0x7f0f7c0697d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f90159380 0x7f0f900b20b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f900cb3f0 0x7f0f900c9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 --2- 172.21.15.33:0/150684593 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f900cea00 0x7f0f900c75e0 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 >> 172.21.15.33:0/150684593 conn(0x7f0f900703a0 msgr2=0x7f0f900cedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 shutdown_connections 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.234+0000 7f0f967ed700 1 -- 172.21.15.33:0/150684593 wait complete. 2023-10-09T15:37:50.236 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:37:50.247 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:37:50.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.367+0000 7fa12e729700 1 Processor -- start 2023-10-09T15:37:50.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.367+0000 7fa12e729700 1 -- start start 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12e729700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 0x7fa12815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12e729700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1280cf110 0x7fa12815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12e729700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa12815afd0 con 0x7fa12815de50 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12e729700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa12815b2b0 con 0x7fa1280cf110 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12e729700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815b590 con 0x7fa128153c30 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1280cf110 0x7fa12815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa1280cf110 0x7fa12815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36138/0 (socket says 172.21.15.33:36138) 2023-10-09T15:37:50.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 -- 172.21.15.33:0/3407884256 learned_addr learned my addr 172.21.15.33:0/3407884256 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12cf26700 1 --1- 172.21.15.33:0/3407884256 >> v1:172.21.15.33:6789/0 conn(0x7fa12815de50 0x7fa1280cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47088/0 (socket says 172.21.15.33:47088) 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12d727700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 0x7fa12815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 -- 172.21.15.33:0/3407884256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 msgr2=0x7fa12815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 0x7fa12815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 -- 172.21.15.33:0/3407884256 >> v1:172.21.15.33:6789/0 conn(0x7fa12815de50 legacy=0x7fa1280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa127fff700 1 -- 172.21.15.33:0/3407884256 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500999417 0 0) 0x7fa12815afd0 con 0x7fa12815de50 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12df28700 1 -- 172.21.15.33:0/3407884256 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa12815b870 con 0x7fa1280cf110 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.368+0000 7fa12d727700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 0x7fa12815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12df28700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1280cf110 0x7fa12815c070 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa118009f20 tx=0x7fa118009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=465126645a1b93a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa127fff700 1 -- 172.21.15.33:0/3407884256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11800e070 con 0x7fa1280cf110 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa127fff700 1 -- 172.21.15.33:0/3407884256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11800ba80 con 0x7fa1280cf110 2023-10-09T15:37:50.372 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa127fff700 1 -- 172.21.15.33:0/3407884256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1180092e0 con 0x7fa1280cf110 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 -- 172.21.15.33:0/3407884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1280cf110 msgr2=0x7fa12815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1280cf110 0x7fa12815c070 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7fa118009f20 tx=0x7fa118009840 comp rx=0 tx=0).stop 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 -- 172.21.15.33:0/3407884256 shutdown_connections 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa1280cf110 0x7fa12815c070 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 --2- 172.21.15.33:0/3407884256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa128153c30 0x7fa12815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 -- 172.21.15.33:0/3407884256 >> 172.21.15.33:0/3407884256 conn(0x7fa1280703a0 msgr2=0x7fa1280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.369+0000 7fa12e729700 1 -- 172.21.15.33:0/3407884256 shutdown_connections 2023-10-09T15:37:50.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.370+0000 7fa12e729700 1 -- 172.21.15.33:0/3407884256 wait complete. 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 Processor -- start 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 -- start start 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 0x7fa12815e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12815de50 0x7fa1280b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12814c630 con 0x7fa128153c30 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa12815f2e0 con 0x7fa1280cf110 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.371+0000 7fa12e729700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1280c7780 con 0x7fa12815de50 2023-10-09T15:37:50.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36146/0 (socket says 172.21.15.33:36146) 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 -- 172.21.15.33:0/2032813515 learned_addr learned my addr 172.21.15.33:0/2032813515 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12d727700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 0x7fa12815e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12df28700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12815de50 0x7fa1280b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 -- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12815de50 msgr2=0x7fa1280b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12815de50 0x7fa1280b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 -- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 msgr2=0x7fa12815e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 0x7fa12815e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 -- 172.21.15.33:0/2032813515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118009ae0 con 0x7fa128153c30 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12d727700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 0x7fa12815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12cf26700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c5b0 tx=0x7fa11c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:50.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c005a70 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa11c005bd0 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1280c7a60 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa11c0070d0 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.372+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa12815ebc0 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.373+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa12815f490 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.374+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa11c007440 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.374+0000 7fa1257fa700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 0x7fa1140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.374+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa11c084110 con 0x7fa128153c30 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.374+0000 7fa12d727700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 0x7fa1140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:50.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.375+0000 7fa12d727700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 0x7fa1140697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa120006f00 tx=0x7fa120008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:50.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.378+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa12815f490 con 0x7fa128153c30 2023-10-09T15:37:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.617+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa12815f450 con 0x7fa128153c30 2023-10-09T15:37:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.617+0000 7fa1257fa700 1 -- 172.21.15.33:0/2032813515 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 75 v75) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fa11c050da0 con 0x7fa128153c30 2023-10-09T15:37:50.619 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:37:50.619 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":75,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":5987,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/2568149060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":2568149060},{"type":"v1","addr":"172.21.15.59:6835","nonce":2568149060}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6577,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/1473081413","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":1473081413},{"type":"v1","addr":"172.21.15.33:6837","nonce":1473081413}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 msgr2=0x7fa1140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 0x7fa1140697d0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fa120006f00 tx=0x7fa120008040 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 msgr2=0x7fa12815f770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7fa11c00c5b0 tx=0x7fa11c001040 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 shutdown_connections 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa114067320 0x7fa1140697d0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa12815de50 0x7fa1280b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa1280cf110 0x7fa12815e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 --2- 172.21.15.33:0/2032813515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa128153c30 0x7fa12815f770 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 >> 172.21.15.33:0/2032813515 conn(0x7fa1280703a0 msgr2=0x7fa1280b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 shutdown_connections 2023-10-09T15:37:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:50.619+0000 7fa12e729700 1 -- 172.21.15.33:0/2032813515 wait complete. 2023-10-09T15:37:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 75 2023-10-09T15:37:51.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 75, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:37:44.681850+0000', 'modified': '2023-10-09T15:37:48.296249+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7164}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7164': {'gid': 7164, 'name': 'c', 'rank': 0, 'incarnation': 72, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6836/1579213165', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6834', 'nonce': 1579213165}, {'type': 'v1', 'addr': '172.21.15.33:6836', 'nonce': 1579213165}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:37:51.034 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:37:51.034 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T15:37:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.159+0000 7fe718c35700 1 Processor -- start 2023-10-09T15:37:51.160 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.159+0000 7fe718c35700 1 -- start start 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe718c35700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe714157420 0x7fe7140b13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe718c35700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe71406d250 0x7fe7140aefa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe718c35700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7140ac840 con 0x7fe7140ceac0 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe718c35700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7140b18f0 con 0x7fe71406d250 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe718c35700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7140abf50 con 0x7fe714157420 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe712ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe71406d250 0x7fe7140aefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.163 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe713fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe7140ceac0 0x7fe7140accd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60198/0 (socket says 172.21.15.33:60198) 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe713fff700 1 -- 172.21.15.33:0/3907845198 learned_addr learned my addr 172.21.15.33:0/3907845198 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe712ffd700 1 -- 172.21.15.33:0/3907845198 >> v2:172.21.15.59:3300/0 conn(0x7fe714157420 msgr2=0x7fe7140b13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe7137fe700 1 --2- 172.21.15.33:0/3907845198 >> v2:172.21.15.59:3300/0 conn(0x7fe714157420 0x7fe7140b13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe712ffd700 1 --2- 172.21.15.33:0/3907845198 >> v2:172.21.15.59:3300/0 conn(0x7fe714157420 0x7fe7140b13b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe712ffd700 1 -- 172.21.15.33:0/3907845198 >> v1:172.21.15.33:6789/0 conn(0x7fe7140ceac0 legacy=0x7fe7140accd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe7127fc700 1 -- 172.21.15.33:0/3907845198 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 257142464 0 0) 0x7fe7140ac840 con 0x7fe7140ceac0 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.160+0000 7fe712ffd700 1 -- 172.21.15.33:0/3907845198 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7140aea60 con 0x7fe71406d250 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe712ffd700 1 --2- 172.21.15.33:0/3907845198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe7140aefa0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe7140b0e70 tx=0x7fe7080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88d3164f9171795f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.164 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe7127fc700 1 -- 172.21.15.33:0/3907845198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800b6b0 con 0x7fe71406d250 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe7127fc700 1 -- 172.21.15.33:0/3907845198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70800b810 con 0x7fe71406d250 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe7127fc700 1 -- 172.21.15.33:0/3907845198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70800bbb0 con 0x7fe71406d250 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 -- 172.21.15.33:0/3907845198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 msgr2=0x7fe7140aefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 --2- 172.21.15.33:0/3907845198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe7140aefa0 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7fe7140b0e70 tx=0x7fe7080091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 -- 172.21.15.33:0/3907845198 shutdown_connections 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 --2- 172.21.15.33:0/3907845198 >> v2:172.21.15.59:3300/0 conn(0x7fe714157420 0x7fe7140b13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 --2- 172.21.15.33:0/3907845198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe7140aefa0 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 -- 172.21.15.33:0/3907845198 >> 172.21.15.33:0/3907845198 conn(0x7fe71406ce80 msgr2=0x7fe7140ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 -- 172.21.15.33:0/3907845198 shutdown_connections 2023-10-09T15:37:51.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.161+0000 7fe718c35700 1 -- 172.21.15.33:0/3907845198 wait complete. 2023-10-09T15:37:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 Processor -- start 2023-10-09T15:37:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 -- start start 2023-10-09T15:37:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 0x7fe714156360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe714157420 0x7fe714099930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7141568a0 con 0x7fe71406d250 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe714154020 con 0x7fe7140ceac0 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe718c35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe714154300 con 0x7fe714157420 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe7137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.163+0000 7fe7137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34830/0 (socket says 172.21.15.33:34830) 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 -- 172.21.15.33:0/810361730 learned_addr learned my addr 172.21.15.33:0/810361730 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe712ffd700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 0x7fe714156360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe713fff700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe714157420 0x7fe714099930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 -- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe714157420 msgr2=0x7fe714099930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe714157420 0x7fe714099930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 -- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 msgr2=0x7fe714156360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 0x7fe714156360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 -- 172.21.15.33:0/810361730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe708009420 con 0x7fe71406d250 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe712ffd700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 0x7fe714156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe7137fe700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c7d0 tx=0x7fe704008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe6fb7fe700 1 -- 172.21.15.33:0/810361730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704011600 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe6fb7fe700 1 -- 172.21.15.33:0/810361730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe704011760 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7141545e0 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe6fb7fe700 1 -- 172.21.15.33:0/810361730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe704011b20 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.164+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe714154ba0 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.165+0000 7fe6fb7fe700 1 -- 172.21.15.33:0/810361730 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe7040193f0 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.166+0000 7fe6fb7fe700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 0x7fe7000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.166+0000 7fe6fb7fe700 1 -- 172.21.15.33:0/810361730 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe704085190 con 0x7fe71406d250 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.166+0000 7fe712ffd700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 0x7fe7000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.166+0000 7fe712ffd700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 0x7fe7000697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe71406d650 tx=0x7fe708017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.168+0000 7fe72318fb80 1 Processor -- start 2023-10-09T15:37:51.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.168+0000 7fe72318fb80 1 -- start start 2023-10-09T15:37:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9ce87d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d09850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9c15a70 con 0x55b7e9cbeb80 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9c13270 con 0x55b7e9cbc5f0 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9c0f060 con 0x55b7e9d09480 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34846/0 (socket says 172.21.15.33:34846) 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 -- 172.21.15.33:0/1119505526 learned_addr learned my addr 172.21.15.33:0/1119505526 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe7137fe700 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9ce87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe712ffd700 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d09850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 -- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 msgr2=0x55b7e9ce87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9ce87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 -- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 msgr2=0x55b7e9d09850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d09850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 -- 172.21.15.33:0/1119505526 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e9aa9270 con 0x55b7e9cbeb80 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe713fff700 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe70c002180 tx=0x7fe70c009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7564b30276b7c6e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe6f8ff9700 1 -- 172.21.15.33:0/1119505526 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c00b070 con 0x55b7e9cbeb80 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe6f8ff9700 1 -- 172.21.15.33:0/1119505526 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c00dc00 con 0x55b7e9cbeb80 2023-10-09T15:37:51.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.169+0000 7fe6f8ff9700 1 -- 172.21.15.33:0/1119505526 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c013470 con 0x55b7e9cbeb80 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 -- 172.21.15.33:0/1119505526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 msgr2=0x55b7e9cbeff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fe70c002180 tx=0x7fe70c009040 comp rx=0 tx=0).stop 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 -- 172.21.15.33:0/1119505526 shutdown_connections 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cbeff0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9ce87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1119505526 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d09850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 -- 172.21.15.33:0/1119505526 >> 172.21.15.33:0/1119505526 conn(0x55b7e9cc00c0 msgr2=0x55b7e9cc08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 -- 172.21.15.33:0/1119505526 shutdown_connections 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.170+0000 7fe72318fb80 1 -- 172.21.15.33:0/1119505526 wait complete. 2023-10-09T15:37:51.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.171+0000 7fe72318fb80 1 -- start start 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.171+0000 7fe72318fb80 1 Processor -- start 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce87b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 0x55b7e9ce98e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9bba890 con 0x55b7e9d09480 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9bd5ea0 con 0x55b7e9cbc5f0 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9a91e30 con 0x55b7e9cbeb80 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 10 client.0 _ll_register_callbacks cb 0x55b7e9c822c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:37:51.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34860/0 (socket says 172.21.15.33:34860) 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 -- 172.21.15.33:0/2349080053 learned_addr learned my addr 172.21.15.33:0/2349080053 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe7137fe700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce87b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe712ffd700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 0x55b7e9ce98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 -- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 msgr2=0x55b7e9ce98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 0x55b7e9ce98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 -- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 msgr2=0x55b7e9ce87b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce87b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 -- 172.21.15.33:0/2349080053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe70c001d00 con 0x55b7e9d09480 2023-10-09T15:37:51.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe712ffd700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 0x55b7e9ce98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe713fff700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d710 tx=0x7fe70c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cef06e69da038d66 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe6f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70c0017b0 con 0x55b7e9d09480 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe70c00dd70 con 0x55b7e9d09480 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.172+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b7e9cb3cd0 con 0x55b7e9d09480 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe70c01e630 con 0x55b7e9d09480 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 10 client.7308 fetch_fsmap learned FSMap version 75 2023-10-09T15:37:51.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55b7e9a4bfe0 con 0x55b7e9d09480 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b7e9cb3cd0 con 0x55b7e9d09480 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe70c01e790 con 0x55b7e9d09480 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 10 client.7308 fetch_fsmap finished waiting for FSMap version 75 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 10 client.7308 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 20 client.7308 populate_metadata read hostname 'smithi033' 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9cb5770 0x55b7e9cb5b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 4 client.7308 mds_command: new command op to 7164 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 --> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b7e9c90aa0 con 0x55b7e9cb5770 2023-10-09T15:37:51.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.173+0000 7fe7137fe700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9cb5770 0x55b7e9cb5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe6f1ffb700 10 client.7308 ms_handle_connect on v2:172.21.15.33:6834/1579213165 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe7137fe700 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9cb5770 0x55b7e9cb5b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a54d3ed6cf7ea440 server_cookie=5c2ec9f616e0e9e9 in_seq=0 out_seq=0 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/2349080053 <== mds.0 v2:172.21.15.33:6834/1579213165 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55b7e9c90aa0 con 0x55b7e9cb5770 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe6f1ffb700 10 client.7308 handle_command_reply: tid=0 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 client.7308 shutdown 2023-10-09T15:37:51.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 msgr2=0x55b7e9d18f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d710 tx=0x7fe70c018000 comp rx=0 tx=0).stop 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 shutdown_connections 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9cb5770 0x55b7e9cb5b40 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9d09480 0x55b7e9d18f60 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce87b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe6f1ffb700 0 client.7308 ms_handle_reset on v2:172.21.15.33:6834/1579213165 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2349080053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9cbeb80 0x55b7e9ce98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 >> 172.21.15.33:0/2349080053 conn(0x55b7e9cc00c0 msgr2=0x55b7e9cbef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.174+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 shutdown_connections 2023-10-09T15:37:51.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.175+0000 7fe72318fb80 1 -- 172.21.15.33:0/2349080053 wait complete. 2023-10-09T15:37:51.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.175+0000 7fe72318fb80 20 client.7308 trim_cache size 0 max 16384 2023-10-09T15:37:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 Processor -- start 2023-10-09T15:37:51.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 -- start start 2023-10-09T15:37:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9cbc9c0 con 0x55b7e9cbeb80 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9d07e80 con 0x55b7e9cbc5f0 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.192+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9cb64e0 con 0x55b7e9d09480 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34864/0 (socket says 172.21.15.33:34864) 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 -- 172.21.15.33:0/2141754570 learned_addr learned my addr 172.21.15.33:0/2141754570 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe713fff700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe7137fe700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 -- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 msgr2=0x55b7e9d14570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 -- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 msgr2=0x55b7e9ce4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 -- 172.21.15.33:0/2141754570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b7e9ce88e0 con 0x55b7e9cbeb80 2023-10-09T15:37:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe713fff700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:51.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe712ffd700 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe71406ad70 tx=0x7fe70801e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55317f367469073d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe6f97fa700 1 -- 172.21.15.33:0/2141754570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe70802f070 con 0x55b7e9cbeb80 2023-10-09T15:37:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe6f97fa700 1 -- 172.21.15.33:0/2141754570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70801cc30 con 0x55b7e9cbeb80 2023-10-09T15:37:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.193+0000 7fe6f97fa700 1 -- 172.21.15.33:0/2141754570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708034460 con 0x55b7e9cbeb80 2023-10-09T15:37:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- 172.21.15.33:0/2141754570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 msgr2=0x55b7e9ce74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7fe71406ad70 tx=0x7fe70801e040 comp rx=0 tx=0).stop 2023-10-09T15:37:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- 172.21.15.33:0/2141754570 shutdown_connections 2023-10-09T15:37:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9ce4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 --2- 172.21.15.33:0/2141754570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9ce74a0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- 172.21.15.33:0/2141754570 >> 172.21.15.33:0/2141754570 conn(0x55b7e9cc00c0 msgr2=0x55b7e9cc08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- 172.21.15.33:0/2141754570 shutdown_connections 2023-10-09T15:37:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- 172.21.15.33:0/2141754570 wait complete. 2023-10-09T15:37:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 -- start start 2023-10-09T15:37:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.194+0000 7fe72318fb80 1 Processor -- start 2023-10-09T15:37:51.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d69580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9ce7b60 con 0x55b7e9cbeb80 2023-10-09T15:37:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9d180c0 con 0x55b7e9cbc5f0 2023-10-09T15:37:51.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b7e9d69ac0 con 0x55b7e9d09480 2023-10-09T15:37:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe72318fb80 10 client.0 _ll_register_callbacks cb 0x55b7e9c822c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:37:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34870/0 (socket says 172.21.15.33:34870) 2023-10-09T15:37:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 -- 172.21.15.33:0/1322584301 learned_addr learned my addr 172.21.15.33:0/1322584301 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.206 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe7137fe700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d69580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe713fff700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 -- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 msgr2=0x55b7e9d14570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 -- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 msgr2=0x55b7e9d69580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d69580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe712ffd700 1 -- 172.21.15.33:0/1322584301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe708022070 con 0x55b7e9cbeb80 2023-10-09T15:37:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.195+0000 7fe7137fe700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d69580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe712ffd700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x55b7e9ced360 tx=0x7fe70802f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fbe4e08ef2d3b8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:37:51.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe708034af0 con 0x55b7e9cbeb80 2023-10-09T15:37:51.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe708034c50 con 0x55b7e9cbeb80 2023-10-09T15:37:51.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe70c00dc00 con 0x55b7e9cbeb80 2023-10-09T15:37:51.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=75) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe708034e30 con 0x55b7e9cbeb80 2023-10-09T15:37:51.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 10 client.7314 fetch_fsmap learned FSMap version 75 2023-10-09T15:37:51.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=75,monmap=2+}) v3 -- 0x55b7e9cc1550 con 0x55b7e9cbeb80 2023-10-09T15:37:51.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe70c00dc00 con 0x55b7e9cbeb80 2023-10-09T15:37:51.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 75) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe70801a640 con 0x55b7e9cbeb80 2023-10-09T15:37:51.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 10 client.7314 fetch_fsmap finished waiting for FSMap version 75 2023-10-09T15:37:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 10 client.7314 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:37:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 20 client.7314 populate_metadata read hostname 'smithi033' 2023-10-09T15:37:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9d6fbd0 0x55b7e9d6ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 4 client.7314 mds_command: new command op to 7164 tid=0[{"prefix": "status"}] 2023-10-09T15:37:51.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 --> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b7e9bb1e00 con 0x55b7e9d6fbd0 2023-10-09T15:37:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.196+0000 7fe7137fe700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9d6fbd0 0x55b7e9d6ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe7137fe700 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9d6fbd0 0x55b7e9d6ffa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f2feb99a96b612a server_cookie=29a7087e03a19c72 in_seq=0 out_seq=0 2023-10-09T15:37:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe6f1ffb700 10 client.7314 ms_handle_connect on v2:172.21.15.33:6834/1579213165 2023-10-09T15:37:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe6f1ffb700 1 -- 172.21.15.33:0/1322584301 <== mds.0 v2:172.21.15.33:6834/1579213165 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55b7e9bb1e00 con 0x55b7e9d6fbd0 2023-10-09T15:37:51.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe6f1ffb700 10 client.7314 handle_command_reply: tid=0 2023-10-09T15:37:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 client.7314 shutdown 2023-10-09T15:37:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 msgr2=0x55b7e9cb5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x55b7e9ced360 tx=0x7fe70802f000 comp rx=0 tx=0).stop 2023-10-09T15:37:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 shutdown_connections 2023-10-09T15:37:51.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:6834/1579213165,v1:172.21.15.33:6836/1579213165] conn(0x55b7e9d6fbd0 0x55b7e9d6ffa0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55b7e9d09480 0x55b7e9d14570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe6f1ffb700 0 client.7314 ms_handle_reset on v2:172.21.15.33:6834/1579213165 2023-10-09T15:37:51.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55b7e9cbc5f0 0x55b7e9d69580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 --2- 172.21.15.33:0/1322584301 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55b7e9cbeb80 0x55b7e9cb5cd0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 >> 172.21.15.33:0/1322584301 conn(0x55b7e9cc00c0 msgr2=0x55b7e9cc08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 shutdown_connections 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 1 -- 172.21.15.33:0/1322584301 wait complete. 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.197+0000 7fe72318fb80 20 client.7314 trim_cache size 0 max 16384 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:37:51.215 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 7164, 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9253467049999999, 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 75, 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 113, 2023-10-09T15:37:51.216 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 113, 2023-10-09T15:37:51.217 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.466876331 2023-10-09T15:37:51.217 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:37:51.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 msgr2=0x7fe7000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 0x7fe7000697d0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe71406d650 tx=0x7fe708017000 comp rx=0 tx=0).stop 2023-10-09T15:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 msgr2=0x7fe714153960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7fe70400c7d0 tx=0x7fe704008040 comp rx=0 tx=0).stop 2023-10-09T15:37:51.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 shutdown_connections 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe700067320 0x7fe7000697d0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe71406d250 0x7fe714153960 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe714157420 0x7fe714099930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 --2- 172.21.15.33:0/810361730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe7140ceac0 0x7fe714156360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 >> 172.21.15.33:0/810361730 conn(0x7fe71406ce80 msgr2=0x7fe714150ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 shutdown_connections 2023-10-09T15:37:51.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.198+0000 7fe718c35700 1 -- 172.21.15.33:0/810361730 wait complete. 2023-10-09T15:37:51.222 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:37:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 Processor -- start 2023-10-09T15:37:51.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 -- start start 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ed0159c80 0x7f8ed00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed00cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed00ce9d0 con 0x7f8ed01598b0 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ed00af960 con 0x7f8ed0159c80 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.342+0000 7f8ed6687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00afc30 con 0x7f8ed00cfe70 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ed0159c80 0x7f8ed00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8ed0159c80 0x7f8ed00cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34884/0 (socket says 172.21.15.33:34884) 2023-10-09T15:37:51.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 -- 172.21.15.33:0/2318655294 learned_addr learned my addr 172.21.15.33:0/2318655294 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ed4c24700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed00cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 -- 172.21.15.33:0/2318655294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 msgr2=0x7f8ed00cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed00cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 -- 172.21.15.33:0/2318655294 >> v1:172.21.15.59:6789/0 conn(0x7f8ed01598b0 legacy=0x7f8ed00af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 -- 172.21.15.33:0/2318655294 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed00aff10 con 0x7f8ed0159c80 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8ecf7fe700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed00cb6f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40099b0 tx=0x7f8ec4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=416bf88d2967ccd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8eceffd700 1 -- 172.21.15.33:0/2318655294 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec4009ea0 con 0x7f8ed0159c80 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8eceffd700 1 -- 172.21.15.33:0/2318655294 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec400b860 con 0x7f8ed0159c80 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.343+0000 7f8eceffd700 1 -- 172.21.15.33:0/2318655294 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec400bc00 con 0x7f8ed0159c80 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 -- 172.21.15.33:0/2318655294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 msgr2=0x7f8ed00cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed00cb6f0 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f8ec40099b0 tx=0x7f8ec4009250 comp rx=0 tx=0).stop 2023-10-09T15:37:51.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 -- 172.21.15.33:0/2318655294 shutdown_connections 2023-10-09T15:37:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed00cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 --2- 172.21.15.33:0/2318655294 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed00cb6f0 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 -- 172.21.15.33:0/2318655294 >> 172.21.15.33:0/2318655294 conn(0x7f8ed0070e30 msgr2=0x7f8ed00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 -- 172.21.15.33:0/2318655294 shutdown_connections 2023-10-09T15:37:51.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.344+0000 7f8ed6687700 1 -- 172.21.15.33:0/2318655294 wait complete. 2023-10-09T15:37:51.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.345+0000 7f8ed6687700 1 Processor -- start 2023-10-09T15:37:51.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.345+0000 7f8ed6687700 1 -- start start 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed0145a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed01598b0 0x7f8ed0145f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0146800 con 0x7f8ed0159c80 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0146ae0 con 0x7f8ed01598b0 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed6687700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed0146dc0 con 0x7f8ed00cfe70 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34892/0 (socket says 172.21.15.33:34892) 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 -- 172.21.15.33:0/4184280761 learned_addr learned my addr 172.21.15.33:0/4184280761 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ecf7fe700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed01598b0 0x7f8ed0145f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ecffff700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed0145a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 -- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 msgr2=0x7f8ed0145a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed0145a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 -- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed01598b0 msgr2=0x7f8ed0145f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed01598b0 0x7f8ed0145f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 -- 172.21.15.33:0/4184280761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec40094f0 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8ed4c24700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ef0 tx=0x7f8ec800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.346+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800cc50 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.347+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800f040 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.347+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed01470a0 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.347+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec8014480 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.347+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed015e980 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.347+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed004c3c0 con 0x7f8ed0159c80 2023-10-09T15:37:51.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.348+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8ec8014830 con 0x7f8ed0159c80 2023-10-09T15:37:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.348+0000 7f8eb7fff700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 0x7f8ebc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.349+0000 7f8ecffff700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 0x7f8ebc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.349+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ec8085bb0 con 0x7f8ed0159c80 2023-10-09T15:37:51.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.349+0000 7f8ecffff700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 0x7f8ebc0697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00016d0 tx=0x7f8ec0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:51.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.353+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ec8052730 con 0x7f8ed0159c80 2023-10-09T15:37:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.592+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f8ed00ce380 con 0x7f8ed0159c80 2023-10-09T15:37:51.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.592+0000 7f8eb7fff700 1 -- 172.21.15.33:0/4184280761 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8ec8055d50 con 0x7f8ed0159c80 2023-10-09T15:37:51.594 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:37:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 msgr2=0x7f8ebc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 0x7f8ebc0697d0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8ec00016d0 tx=0x7f8ec0009040 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 msgr2=0x7f8ed0156370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8009ef0 tx=0x7f8ec800b040 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 shutdown_connections 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8ebc067320 0x7f8ebc0697d0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ed0159c80 0x7f8ed0156370 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ed00cfe70 0x7f8ed0145a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 --2- 172.21.15.33:0/4184280761 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ed01598b0 0x7f8ed0145f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 >> 172.21.15.33:0/4184280761 conn(0x7f8ed0070e30 msgr2=0x7f8ed00b5b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:51.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 shutdown_connections 2023-10-09T15:37:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:51.594+0000 7f8ed6687700 1 -- 172.21.15.33:0/4184280761 wait complete. 2023-10-09T15:37:51.607 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:37:51.607 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:37:51.608 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:51.608 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.608 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:51.624 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 42016sec preferred_lft 42016sec 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:37:51.625 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:37:51.626 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:37:51.627 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:51.627 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.627 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:37:51.687 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:37:51.689 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.689 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:37:51.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:37:51.746 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:37:51.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.847 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:37:51.862 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:37:51.862 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:37:51.862 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:51.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:51.863 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:37:51.928 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:51.928 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:51.983 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:37:51.984 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:51.984 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:52.038 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:37:52.038 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:37:52.038 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:52.118 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:52.118 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:52.118 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:52.127 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:52.127 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:52.127 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:52.127 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:52.127 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:37:52.150 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:37:52.152 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:37:52.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.152 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:37:52.218 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:37:52.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 Processor -- start 2023-10-09T15:37:52.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 -- start start 2023-10-09T15:37:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9ec0cb5a0 0x7ff9ec0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec15ae40 con 0x7ff9ec15a5d0 2023-10-09T15:37:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9ec15ab60 con 0x7ff9ec0cd9e0 2023-10-09T15:37:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.378+0000 7ff9f209f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9ec0d13f0 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9eb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9ec0cb5a0 0x7ff9ec0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ebfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff9ec15a5d0 0x7ff9ec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60206/0 (socket says 172.21.15.33:60206) 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ebfff700 1 -- 172.21.15.33:0/995998363 learned_addr learned my addr 172.21.15.33:0/995998363 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/995998363 >> v1:172.21.15.59:6789/0 conn(0x7ff9ec0cd9e0 legacy=0x7ff9ec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/995998363 >> v1:172.21.15.33:6789/0 conn(0x7ff9ec15a5d0 legacy=0x7ff9ec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/995998363 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9ec0ccf00 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ea7fc700 1 -- 172.21.15.33:0/995998363 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163103310 0 0) 0x7ff9ec15ae40 con 0x7ff9ec15a5d0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/995998363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec0cb970 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009910 tx=0x7ff9dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5caacc89b00b238b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ea7fc700 1 -- 172.21.15.33:0/995998363 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00b820 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ea7fc700 1 -- 172.21.15.33:0/995998363 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc00b980 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.379+0000 7ff9ea7fc700 1 -- 172.21.15.33:0/995998363 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc00bd20 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 -- 172.21.15.33:0/995998363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 msgr2=0x7ff9ec0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 --2- 172.21.15.33:0/995998363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec0cb970 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc009910 tx=0x7ff9dc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 -- 172.21.15.33:0/995998363 shutdown_connections 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 --2- 172.21.15.33:0/995998363 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec0cb970 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 -- 172.21.15.33:0/995998363 >> 172.21.15.33:0/995998363 conn(0x7ff9ec070e30 msgr2=0x7ff9ec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 -- 172.21.15.33:0/995998363 shutdown_connections 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.380+0000 7ff9f209f700 1 -- 172.21.15.33:0/995998363 wait complete. 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.381+0000 7ff9f209f700 1 Processor -- start 2023-10-09T15:37:52.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.381+0000 7ff9f209f700 1 -- start start 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9ec0cd9e0 0x7ff9ec152410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9ec15a5d0 0x7ff9ec152950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec0c8b10 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec153c00 con 0x7ff9ec15a5d0 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9f209f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9ec152ff0 con 0x7ff9ec0cd9e0 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34908/0 (socket says 172.21.15.33:34908) 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/3010484647 learned_addr learned my addr 172.21.15.33:0/3010484647 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9ec0cd9e0 msgr2=0x7ff9ec152410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9ec0cd9e0 0x7ff9ec152410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9ec15a5d0 msgr2=0x7ff9ec152950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9ec15a5d0 0x7ff9ec152950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 -- 172.21.15.33:0/3010484647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9dc009420 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9eb7fe700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06ea60 tx=0x7ff9dc017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.382+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc024440 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.383+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9dc0245c0 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.383+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9ec1532d0 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.383+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9dc024980 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.383+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9ec153890 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.383+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9ec04c3c0 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.384+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff9dc01a420 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.384+0000 7ff9d37fe700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 0x7ff9d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.384+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff9dc086c70 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.384+0000 7ff9eaffd700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 0x7ff9d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:52.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.385+0000 7ff9eaffd700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 0x7ff9d80697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0ca220 tx=0x7ff9e0007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:52.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.389+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff9dc053900 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.628+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ff9ec0cd1e0 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.628+0000 7ff9d37fe700 1 -- 172.21.15.33:0/3010484647 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v75) v1 ==== 53+0+73 (secure 0 0 0) 0x7ff9dc015070 con 0x7ff9ec0cb5a0 2023-10-09T15:37:52.629 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:37:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 msgr2=0x7ff9d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 0x7ff9d80697d0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec0ca220 tx=0x7ff9e0007b40 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 msgr2=0x7ff9ec1501c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec06ea60 tx=0x7ff9dc017000 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 shutdown_connections 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff9d8067320 0x7ff9d80697d0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9ec0cb5a0 0x7ff9ec1501c0 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9ec15a5d0 0x7ff9ec152950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 --2- 172.21.15.33:0/3010484647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9ec0cd9e0 0x7ff9ec152410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 >> 172.21.15.33:0/3010484647 conn(0x7ff9ec070e30 msgr2=0x7ff9ec1552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 shutdown_connections 2023-10-09T15:37:52.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:52.630+0000 7ff9f209f700 1 -- 172.21.15.33:0/3010484647 wait complete. 2023-10-09T15:37:52.643 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:37:52.643 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:37:52.643 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:37:52.643 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:37:52.643 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:52.644 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:37:52.644 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:37:52.644 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:37:52.644 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:52.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.644 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:37:52.663 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:37:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:37:52.663 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 42023sec preferred_lft 42023sec 2023-10-09T15:37:52.664 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:37:52.665 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:37:52.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.666 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:37:52.731 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:37:52.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.733 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:37:52.791 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.791 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:37:52.791 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:37:52.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:37:52.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:37:52.792 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:37:52.792 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:37:52.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.899 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:37:52.914 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:37:52.914 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:37:52.915 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:52.915 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:52.915 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:37:52.980 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:52.981 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:53.036 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:37:53.036 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:37:53.036 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:53.091 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:37:53.091 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:37:53.091 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:53.173 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:53.173 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:53.173 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:53.181 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:53.181 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:53.182 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:53.182 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:53.182 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:37:53.204 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:37:53.205 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:37:53.205 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:37:53.206 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:37:53.206 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:37:53.206 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:37:53.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:37:53.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.409+0000 7f7e29433700 1 Processor -- start 2023-10-09T15:37:53.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.409+0000 7f7e29433700 1 -- start start 2023-10-09T15:37:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e29433700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e240cb030 0x7f7e2406d0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e29433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e241599d0 0x7f7e2406d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e29433700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e2406db30 con 0x7f7e24159600 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e29433700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e2406dd70 con 0x7f7e240cb030 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e29433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240aa370 con 0x7f7e241599d0 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e240cb030 0x7f7e2406d0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7e240cb030 0x7f7e2406d0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34914/0 (socket says 172.21.15.33:34914) 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 -- 172.21.15.33:0/2099056710 learned_addr learned my addr 172.21.15.33:0/2099056710 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e237fe700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e241599d0 0x7f7e2406d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 -- 172.21.15.33:0/2099056710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e241599d0 msgr2=0x7f7e2406d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e241599d0 0x7f7e2406d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 -- 172.21.15.33:0/2099056710 >> v1:172.21.15.59:6789/0 conn(0x7f7e24159600 legacy=0x7f7e240ca920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 -- 172.21.15.33:0/2099056710 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e240a9a80 con 0x7f7e240cb030 2023-10-09T15:37:53.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e227fc700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e240cb030 0x7f7e2406d0b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0099b0 tx=0x7f7e0c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0655ccffbce5851 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e21ffb700 1 -- 172.21.15.33:0/2099056710 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c009ea0 con 0x7f7e240cb030 2023-10-09T15:37:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e21ffb700 1 -- 172.21.15.33:0/2099056710 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00b860 con 0x7f7e240cb030 2023-10-09T15:37:53.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.410+0000 7f7e21ffb700 1 -- 172.21.15.33:0/2099056710 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c00bc00 con 0x7f7e240cb030 2023-10-09T15:37:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 -- 172.21.15.33:0/2099056710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e240cb030 msgr2=0x7f7e2406d0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e240cb030 0x7f7e2406d0b0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c0099b0 tx=0x7f7e0c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:53.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 -- 172.21.15.33:0/2099056710 shutdown_connections 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e241599d0 0x7f7e2406d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 --2- 172.21.15.33:0/2099056710 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e240cb030 0x7f7e2406d0b0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 -- 172.21.15.33:0/2099056710 >> 172.21.15.33:0/2099056710 conn(0x7f7e2406edb0 msgr2=0x7f7e2406f1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 -- 172.21.15.33:0/2099056710 shutdown_connections 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.411+0000 7f7e29433700 1 -- 172.21.15.33:0/2099056710 wait complete. 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.412+0000 7f7e29433700 1 Processor -- start 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.412+0000 7f7e29433700 1 -- start start 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e240cb030 0x7f7e2416d120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241599d0 0x7f7e241519e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c6430 con 0x7f7e24159600 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e240c8550 con 0x7f7e241599d0 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e29433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2416d700 con 0x7f7e240cb030 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34922/0 (socket says 172.21.15.33:34922) 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e227fc700 1 -- 172.21.15.33:0/282532602 learned_addr learned my addr 172.21.15.33:0/282532602 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e22ffd700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e240cb030 0x7f7e2416d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.413+0000 7f7e237fe700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241599d0 0x7f7e241519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 -- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e240cb030 msgr2=0x7f7e2416d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e240cb030 0x7f7e2416d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 -- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241599d0 msgr2=0x7f7e241519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:53.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241599d0 0x7f7e241519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 -- 172.21.15.33:0/282532602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e0c0094f0 con 0x7f7e24159600 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e227fc700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7e24069ec0 tx=0x7f7e0c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c000d10 con 0x7f7e24159600 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c00bbe0 con 0x7f7e24159600 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c011670 con 0x7f7e24159600 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e2416d9e0 con 0x7f7e24159600 2023-10-09T15:37:53.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.414+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e2416dfa0 con 0x7f7e24159600 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.415+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e240c8700 con 0x7f7e24159600 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.415+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7e0c011a60 con 0x7f7e24159600 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.416+0000 7f7e1affd700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 0x7f7e040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.416+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7e0c086440 con 0x7f7e24159600 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.416+0000 7f7e22ffd700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 0x7f7e040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:53.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.416+0000 7f7e22ffd700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 0x7f7e040697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e14007fd0 tx=0x7f7e140016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:53.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.421+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7e240c8700 con 0x7f7e24159600 2023-10-09T15:37:53.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:53.660+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f7e240c86c0 con 0x7f7e24159600 2023-10-09T15:37:54.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.322+0000 7f7e1affd700 1 -- 172.21.15.33:0/282532602 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v76) v1 ==== 136+0+0 (secure 0 0 0) 0x7f7e0c0530d0 con 0x7f7e24159600 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.324+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 msgr2=0x7f7e040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.324+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 0x7f7e040697d0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f7e14007fd0 tx=0x7f7e140016f0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.324+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 msgr2=0x7f7e240c45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.324+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f7e24069ec0 tx=0x7f7e0c017000 comp rx=0 tx=0).stop 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 shutdown_connections 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7e04067320 0x7f7e040697d0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7e241599d0 0x7f7e241519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7e240cb030 0x7f7e2416d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 --2- 172.21.15.33:0/282532602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7e24159600 0x7f7e240c45b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 >> 172.21.15.33:0/282532602 conn(0x7f7e2406edb0 msgr2=0x7f7e240c19d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 shutdown_connections 2023-10-09T15:37:54.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.325+0000 7f7e29433700 1 -- 172.21.15.33:0/282532602 wait complete. 2023-10-09T15:37:54.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:37:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 Processor -- start 2023-10-09T15:37:54.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 -- start start 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe93c0cb5a0 0x7fe93c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe93c0cd9e0 0x7fe93c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe93c15ae40 con 0x7fe93c15a400 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c0d13f0 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.462+0000 7fe942949700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe93c15ab60 con 0x7fe93c0cb5a0 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe93c0cd9e0 0x7fe93c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe93c0cd9e0 0x7fe93c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34928/0 (socket says 172.21.15.33:34928) 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 -- 172.21.15.33:0/3555564452 learned_addr learned my addr 172.21.15.33:0/3555564452 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93bfff700 1 --2- 172.21.15.33:0/3555564452 >> v2:172.21.15.59:3300/0 conn(0x7fe93c0cb5a0 0x7fe93c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 -- 172.21.15.33:0/3555564452 >> v2:172.21.15.59:3300/0 conn(0x7fe93c0cb5a0 msgr2=0x7fe93c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 --2- 172.21.15.33:0/3555564452 >> v2:172.21.15.59:3300/0 conn(0x7fe93c0cb5a0 0x7fe93c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 -- 172.21.15.33:0/3555564452 >> v1:172.21.15.59:6789/0 conn(0x7fe93c15a400 legacy=0x7fe93c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 -- 172.21.15.33:0/3555564452 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93c0ccf00 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93b7fe700 1 --2- 172.21.15.33:0/3555564452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c159ec0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0099b0 tx=0x7fe92c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c72e2100ae3c2871 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93affd700 1 -- 172.21.15.33:0/3555564452 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00b820 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93affd700 1 -- 172.21.15.33:0/3555564452 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c00b980 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.463+0000 7fe93affd700 1 -- 172.21.15.33:0/3555564452 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c00bd20 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 -- 172.21.15.33:0/3555564452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0cd9e0 msgr2=0x7fe93c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 --2- 172.21.15.33:0/3555564452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c159ec0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0099b0 tx=0x7fe92c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 -- 172.21.15.33:0/3555564452 shutdown_connections 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 --2- 172.21.15.33:0/3555564452 >> v2:172.21.15.59:3300/0 conn(0x7fe93c0cb5a0 0x7fe93c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 --2- 172.21.15.33:0/3555564452 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c159ec0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 -- 172.21.15.33:0/3555564452 >> 172.21.15.33:0/3555564452 conn(0x7fe93c070e30 msgr2=0x7fe93c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 -- 172.21.15.33:0/3555564452 shutdown_connections 2023-10-09T15:37:54.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.464+0000 7fe942949700 1 -- 172.21.15.33:0/3555564452 wait complete. 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.465+0000 7fe942949700 1 Processor -- start 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.465+0000 7fe942949700 1 -- start start 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 0x7fe93c16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c153360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c169e50 con 0x7fe93c15a400 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c16a0e0 con 0x7fe93c0cd9e0 2023-10-09T15:37:54.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93c15a090 con 0x7fe93c0cb5a0 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34936/0 (socket says 172.21.15.33:34936) 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 -- 172.21.15.33:0/4142658802 learned_addr learned my addr 172.21.15.33:0/4142658802 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe93bfff700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 0x7fe93c16d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe93b7fe700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c153360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 -- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 msgr2=0x7fe93c16d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 0x7fe93c16d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 -- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 msgr2=0x7fe93c153360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c153360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 -- 172.21.15.33:0/4142658802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe92c0094f0 con 0x7fe93c15a400 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe93bfff700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 0x7fe93c16d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:54.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe93b7fe700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe940ee6700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c840 tx=0x7fe934001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012630 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe9340127b0 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe93c16e3e0 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe934012b70 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.466+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93c16de20 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.467+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93c16a250 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.468+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe934003030 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.468+0000 7fe933fff700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 0x7fe91c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.468+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe934084c50 con 0x7fe93c15a400 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.468+0000 7fe93bfff700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 0x7fe91c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.469+0000 7fe93bfff700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 0x7fe91c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe924006fd0 tx=0x7fe924008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.473+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe9340518a0 con 0x7fe93c15a400 2023-10-09T15:37:54.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.696+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fe93c04c3c0 con 0x7fe91c067320 2023-10-09T15:37:54.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.697+0000 7fe933fff700 1 -- 172.21.15.33:0/4142658802 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fe93c04c3c0 con 0x7fe91c067320 2023-10-09T15:37:54.697 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:37:54.697 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:54.697 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:37:54.698 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:54.698 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 msgr2=0x7fe91c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 0x7fe91c0697d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fe924006fd0 tx=0x7fe924008040 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 msgr2=0x7fe93c156c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7fe93400c840 tx=0x7fe934001670 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 shutdown_connections 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe91c067320 0x7fe91c0697d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe93c15a400 0x7fe93c156c60 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe93c0cb5a0 0x7fe93c16d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 --2- 172.21.15.33:0/4142658802 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe93c0cd9e0 0x7fe93c153360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.699+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 >> 172.21.15.33:0/4142658802 conn(0x7fe93c070e30 msgr2=0x7fe93c0cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.700+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 shutdown_connections 2023-10-09T15:37:54.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.700+0000 7fe942949700 1 -- 172.21.15.33:0/4142658802 wait complete. 2023-10-09T15:37:54.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:37:54.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.833+0000 7feda2ade700 1 Processor -- start 2023-10-09T15:37:54.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.833+0000 7feda2ade700 1 -- start start 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda2ade700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed9c1576d0 0x7fed9c0ae590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda2ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c0b1be0 0x7fed9c161350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda2ade700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9c0cc060 con 0x7fed9c0aead0 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda2ade700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9c0cb450 con 0x7fed9c1576d0 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda2ade700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c0cb730 con 0x7fed9c0b1be0 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda087a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed9c1576d0 0x7fed9c0ae590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda087a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fed9c1576d0 0x7fed9c0ae590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34952/0 (socket says 172.21.15.33:34952) 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.834+0000 7feda087a700 1 -- 172.21.15.33:0/2894224490 learned_addr learned my addr 172.21.15.33:0/2894224490 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:54.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda107b700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c0b1be0 0x7fed9c161350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda087a700 1 -- 172.21.15.33:0/2894224490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c0b1be0 msgr2=0x7fed9c161350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda087a700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c0b1be0 0x7fed9c161350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda087a700 1 -- 172.21.15.33:0/2894224490 >> v1:172.21.15.59:6789/0 conn(0x7fed9c0aead0 legacy=0x7fed9c0b14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda087a700 1 -- 172.21.15.33:0/2894224490 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9c0cba10 con 0x7fed9c1576d0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda087a700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c1576d0 0x7fed9c0ae590 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0099b0 tx=0x7fed8c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c2b48818ad937c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7fed9b7fe700 1 -- 172.21.15.33:0/2894224490 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c009ea0 con 0x7fed9c1576d0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7fed9b7fe700 1 -- 172.21.15.33:0/2894224490 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c00b860 con 0x7fed9c1576d0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7fed9b7fe700 1 -- 172.21.15.33:0/2894224490 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c00bc00 con 0x7fed9c1576d0 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda2ade700 1 -- 172.21.15.33:0/2894224490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c1576d0 msgr2=0x7fed9c0ae590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.835+0000 7feda2ade700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c1576d0 0x7fed9c0ae590 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0099b0 tx=0x7fed8c009250 comp rx=0 tx=0).stop 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 -- 172.21.15.33:0/2894224490 shutdown_connections 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c0b1be0 0x7fed9c161350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 --2- 172.21.15.33:0/2894224490 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c1576d0 0x7fed9c0ae590 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 -- 172.21.15.33:0/2894224490 >> 172.21.15.33:0/2894224490 conn(0x7fed9c06d170 msgr2=0x7fed9c0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 -- 172.21.15.33:0/2894224490 shutdown_connections 2023-10-09T15:37:54.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.836+0000 7feda2ade700 1 -- 172.21.15.33:0/2894224490 wait complete. 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.837+0000 7feda2ade700 1 Processor -- start 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.837+0000 7feda2ade700 1 -- start start 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.837+0000 7feda2ade700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 0x7fed9c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1576d0 0x7fed9c155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c159b00 con 0x7fed9c0b1be0 2023-10-09T15:37:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c159de0 con 0x7fed9c0aead0 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9c15a0c0 con 0x7fed9c1576d0 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34966/0 (socket says 172.21.15.33:34966) 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 -- 172.21.15.33:0/1980860202 learned_addr learned my addr 172.21.15.33:0/1980860202 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda107b700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1576d0 0x7fed9c155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda087a700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 0x7fed9c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 -- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1576d0 msgr2=0x7fed9c155560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1576d0 0x7fed9c155560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 -- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 msgr2=0x7fed9c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 0x7fed9c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 -- 172.21.15.33:0/1980860202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed8c0094f0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda087a700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 0x7fed9c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed9bfff700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c590 tx=0x7fed9000c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011590 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed90011710 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed9c15a3a0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed90011ad0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.838+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed9c159810 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.839+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9c15a8c0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.840+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fed9001b3b0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.840+0000 7fed98ff9700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 0x7fed880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.840+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed900841b0 con 0x7fed9c0b1be0 2023-10-09T15:37:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.840+0000 7feda087a700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 0x7fed880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:54.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.841+0000 7feda087a700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 0x7fed880697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0099b0 tx=0x7fed8c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:54.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:54.844+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed9c15a8c0 con 0x7fed9c0b1be0 2023-10-09T15:37:55.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.037+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fed9c15a8c0 con 0x7fed9c0b1be0 2023-10-09T15:37:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.038+0000 7fed98ff9700 1 -- 172.21.15.33:0/1980860202 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v22)=0 v22) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed9c15a8c0 con 0x7fed9c0b1be0 2023-10-09T15:37:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 msgr2=0x7fed880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 0x7fed880697d0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fed8c0099b0 tx=0x7fed8c017000 comp rx=0 tx=0).stop 2023-10-09T15:37:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 msgr2=0x7fed9c148dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fed9000c590 tx=0x7fed9000c8a0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 shutdown_connections 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed88067320 0x7fed880697d0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed9c1576d0 0x7fed9c155560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed9c0aead0 0x7fed9c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 --2- 172.21.15.33:0/1980860202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed9c0b1be0 0x7fed9c148dc0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 >> 172.21.15.33:0/1980860202 conn(0x7fed9c06d170 msgr2=0x7fed9c0adf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 shutdown_connections 2023-10-09T15:37:55.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.040+0000 7feda2ade700 1 -- 172.21.15.33:0/1980860202 wait complete. 2023-10-09T15:37:55.052 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:37:55.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.172+0000 7fed5a389700 1 Processor -- start 2023-10-09T15:37:55.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.172+0000 7fed5a389700 1 -- start start 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed5a389700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 0x7fed540cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed5a389700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415ae40 con 0x7fed540cd9e0 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed5a389700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed5415ab60 con 0x7fed540cde50 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed5a389700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540d13f0 con 0x7fed540cb5a0 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed537fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fed540cd9e0 0x7fed54159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60210/0 (socket says 172.21.15.33:60210) 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed537fe700 1 -- 172.21.15.33:0/1153612077 learned_addr learned my addr 172.21.15.33:0/1153612077 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.173+0000 7fed53fff700 1 --2- 172.21.15.33:0/1153612077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 0x7fed540cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1413545973 0 0) 0x7fed5415ae40 con 0x7fed540cd9e0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed3c003570 con 0x7fed540cd9e0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3529953316 0 0) 0x7fed5415ab60 con 0x7fed540cde50 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed5415ae40 con 0x7fed540cde50 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2298361415 0 0) 0x7fed3c003570 con 0x7fed540cd9e0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed53fff700 1 -- 172.21.15.33:0/1153612077 >> v1:172.21.15.59:6789/0 conn(0x7fed540cde50 legacy=0x7fed54156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed53fff700 1 -- 172.21.15.33:0/1153612077 >> v1:172.21.15.33:6789/0 conn(0x7fed540cd9e0 legacy=0x7fed54159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed53fff700 1 -- 172.21.15.33:0/1153612077 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed540ccf00 con 0x7fed540cb5a0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed53fff700 1 --2- 172.21.15.33:0/1153612077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 0x7fed540cb970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed44009910 tx=0x7fed440091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd004b4a08a01492 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed48001470 con 0x7fed540cb5a0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed44011420 con 0x7fed540cb5a0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.174+0000 7fed52ffd700 1 -- 172.21.15.33:0/1153612077 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed440117a0 con 0x7fed540cb5a0 2023-10-09T15:37:55.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 -- 172.21.15.33:0/1153612077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 msgr2=0x7fed540cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 --2- 172.21.15.33:0/1153612077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 0x7fed540cb970 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fed44009910 tx=0x7fed440091a0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 -- 172.21.15.33:0/1153612077 shutdown_connections 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 --2- 172.21.15.33:0/1153612077 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cb5a0 0x7fed540cb970 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 -- 172.21.15.33:0/1153612077 >> 172.21.15.33:0/1153612077 conn(0x7fed54070e30 msgr2=0x7fed540d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 -- 172.21.15.33:0/1153612077 shutdown_connections 2023-10-09T15:37:55.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.175+0000 7fed5a389700 1 -- 172.21.15.33:0/1153612077 wait complete. 2023-10-09T15:37:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.176+0000 7fed5a389700 1 Processor -- start 2023-10-09T15:37:55.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.176+0000 7fed5a389700 1 -- start start 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cd9e0 0x7fed54158440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5415dbf0 0x7fed54158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540b3ff0 con 0x7fed540cb5a0 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed540b42d0 con 0x7fed5415dbf0 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed5a389700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed540b45b0 con 0x7fed540cd9e0 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34980/0 (socket says 172.21.15.33:34980) 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 -- 172.21.15.33:0/1328123800 learned_addr learned my addr 172.21.15.33:0/1328123800 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed537fe700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cd9e0 0x7fed54158440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 -- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cd9e0 msgr2=0x7fed54158440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cd9e0 0x7fed54158440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 -- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5415dbf0 msgr2=0x7fed54158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5415dbf0 0x7fed54158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.177+0000 7fed53fff700 1 -- 172.21.15.33:0/1328123800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed44009420 con 0x7fed540cb5a0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed53fff700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fed44009860 tx=0x7fed44016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4401cc50 con 0x7fed540cb5a0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed4401cdd0 con 0x7fed540cb5a0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed540b4890 con 0x7fed540cb5a0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed4401a6a0 con 0x7fed540cb5a0 2023-10-09T15:37:55.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.178+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed541597c0 con 0x7fed540cb5a0 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.179+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed540b4d90 con 0x7fed540cb5a0 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.179+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fed4401aad0 con 0x7fed540cb5a0 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.179+0000 7fed3bfff700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 0x7fed400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.180+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fed44086550 con 0x7fed540cb5a0 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.180+0000 7fed537fe700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 0x7fed400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.180+0000 7fed537fe700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 0x7fed400697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fed480011e0 tx=0x7fed48009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.184+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fed440531e0 con 0x7fed540cb5a0 2023-10-09T15:37:55.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.410+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fed540b4440 con 0x7fed40067320 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.411+0000 7fed3bfff700 1 -- 172.21.15.33:0/1328123800 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fed540b4440 con 0x7fed40067320 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:37:55.411 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:37:55.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 msgr2=0x7fed400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 0x7fed400697d0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fed480011e0 tx=0x7fed48009040 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 msgr2=0x7fed5415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fed44009860 tx=0x7fed44016000 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 shutdown_connections 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fed40067320 0x7fed400697d0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fed540cb5a0 0x7fed5415d6b0 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fed5415dbf0 0x7fed54158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 --2- 172.21.15.33:0/1328123800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fed540cd9e0 0x7fed54158440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 >> 172.21.15.33:0/1328123800 conn(0x7fed54070e30 msgr2=0x7fed54159d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 shutdown_connections 2023-10-09T15:37:55.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.413+0000 7fed5a389700 1 -- 172.21.15.33:0/1328123800 wait complete. 2023-10-09T15:37:55.425 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000286639 2023-10-09T15:37:55.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.547+0000 7f9457c3c700 1 Processor -- start 2023-10-09T15:37:55.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.547+0000 7f9457c3c700 1 -- start start 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f9457c3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f94500ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f9457c3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f94500ccba0 0x7f94500cd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f9457c3c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94500c32a0 con 0x7f9450157930 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f9457c3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94500c9730 con 0x7f94500ccba0 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f9457c3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500cd560 con 0x7f94500ca2c0 2023-10-09T15:37:55.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f94559d8700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9450157930 0x7f94500ab070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60216/0 (socket says 172.21.15.33:60216) 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.548+0000 7f94559d8700 1 -- 172.21.15.33:0/914654685 learned_addr learned my addr 172.21.15.33:0/914654685 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94561d9700 1 --2- 172.21.15.33:0/914654685 >> v2:172.21.15.59:3300/0 conn(0x7f94500ccba0 0x7f94500cd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4261189901 0 0) 0x7f94500c32a0 con 0x7f9450157930 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9438003570 con 0x7f9450157930 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94551d7700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f94500ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4188710247 0 0) 0x7f9438003570 con 0x7f9450157930 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 msgr2=0x7f94500ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f94500ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 >> v2:172.21.15.59:3300/0 conn(0x7f94500ccba0 msgr2=0x7f94500cd020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 --2- 172.21.15.33:0/914654685 >> v2:172.21.15.59:3300/0 conn(0x7f94500ccba0 0x7f94500cd020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500c4100 con 0x7f9450157930 2023-10-09T15:37:55.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f9448001470 con 0x7f9450157930 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 >> v1:172.21.15.33:6789/0 conn(0x7f9450157930 legacy=0x7f94500ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f9438004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004d50 0x7f94380051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c9730 con 0x7f9438004d50 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500cd560 con 0x7f9438003a90 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f943800bb10 con 0x7f94500ca2c0 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94561d9700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004d50 0x7f94380051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94551d7700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f9438004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.549+0000 7f94559d8700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 -- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 msgr2=0x7f9438004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:55.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f94500ca2c0 0x7f9438004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 -- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9438003a90 msgr2=0x7f9438003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9438003a90 0x7f9438003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 -- 172.21.15.33:0/914654685 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9438003570 con 0x7f9438004d50 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004d50 0x7f94380051c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f944000e210 tx=0x7f944000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c7acbf3921bc1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000eac0 con 0x7f9438004d50 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944000f040 con 0x7f9438004d50 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94549d6700 1 -- 172.21.15.33:0/914654685 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944000ee70 con 0x7f9438004d50 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f9457c3c700 1 -- 172.21.15.33:0/914654685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004d50 msgr2=0x7f94380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f9457c3c700 1 --2- 172.21.15.33:0/914654685 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9438004d50 0x7f94380051c0 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7f944000e210 tx=0x7f944000b040 comp rx=0 tx=0).stop 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f94561d9700 1 -- 172.21.15.33:0/914654685 reap_dead start 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.550+0000 7f9457c3c700 1 -- 172.21.15.33:0/914654685 shutdown_connections 2023-10-09T15:37:55.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.551+0000 7f9457c3c700 1 -- 172.21.15.33:0/914654685 >> 172.21.15.33:0/914654685 conn(0x7f9450088000 msgr2=0x7f94500883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:55.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.551+0000 7f9457c3c700 1 -- 172.21.15.33:0/914654685 shutdown_connections 2023-10-09T15:37:55.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.551+0000 7f9457c3c700 1 -- 172.21.15.33:0/914654685 wait complete. 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 Processor -- start 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 -- start start 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9450152360 0x7f9450152730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500ae940 0x7f94500aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500ad190 con 0x7f94500ac7e0 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c56e0 con 0x7f94500ae940 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.552+0000 7f9457c3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94500c5980 con 0x7f9450152360 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:34998/0 (socket says 172.21.15.33:34998) 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 -- 172.21.15.33:0/1481346374 learned_addr learned my addr 172.21.15.33:0/1481346374 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94559d8700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9450152360 0x7f9450152730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94561d9700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500ae940 0x7f94500aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 -- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9450152360 msgr2=0x7f9450152730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9450152360 0x7f9450152730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 -- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500ae940 msgr2=0x7f94500aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500ae940 0x7f94500aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:55.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 -- 172.21.15.33:0/1481346374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94500c5c60 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f94551d7700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9444010aa0 tx=0x7f9444008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9444010ee0 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f944400e8d0 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94500c5f40 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.553+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f944400ec70 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.554+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94500af300 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.554+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f945004c3c0 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.555+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9444014640 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.555+0000 7f944dffb700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 0x7f943c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.555+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9444085330 con 0x7f94500ac7e0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.555+0000 7f94559d8700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 0x7f943c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:55.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.556+0000 7f94559d8700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 0x7f943c0697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9448001120 tx=0x7f9448001e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:55.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.559+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9444051fc0 con 0x7f94500ac7e0 2023-10-09T15:37:55.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:55.784+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000286639", "target": ["mon-mgr", ""]}) v1 -- 0x7f94500c45c0 con 0x7f943c067320 2023-10-09T15:37:58.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.334+0000 7f944dffb700 1 -- 172.21.15.33:0/1481346374 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f94500c45c0 con 0x7f943c067320 2023-10-09T15:37:58.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.338+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 msgr2=0x7f943c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.338+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 0x7f943c0697d0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f9448001120 tx=0x7f9448001e50 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 msgr2=0x7f94500acc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f9444010aa0 tx=0x7f9444008040 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 shutdown_connections 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f943c067320 0x7f943c0697d0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f94500ae940 0x7f94500aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9450152360 0x7f9450152730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 --2- 172.21.15.33:0/1481346374 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f94500ac7e0 0x7f94500acc50 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.339+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 >> 172.21.15.33:0/1481346374 conn(0x7f9450088000 msgr2=0x7f94500cb7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:58.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.341+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 shutdown_connections 2023-10-09T15:37:58.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.341+0000 7f9457c3c700 1 -- 172.21.15.33:0/1481346374 wait complete. 2023-10-09T15:37:58.343 INFO:teuthology.orchestra.run.smithi033.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T15:37:58.358 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create volume_0000000000286640 2023-10-09T15:37:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.494+0000 7f75cc72b700 1 Processor -- start 2023-10-09T15:37:58.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.494+0000 7f75cc72b700 1 -- start start 2023-10-09T15:37:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cc72b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cc72b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c40ccfd0 con 0x7f75c406dc70 2023-10-09T15:37:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cc72b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75c415a3d0 con 0x7f75c4159530 2023-10-09T15:37:58.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cc72b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c415a6b0 con 0x7f75c406e0e0 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c9cc6700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f75c406dc70 0x7f75c4159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60224/0 (socket says 172.21.15.33:60224) 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c9cc6700 1 -- 172.21.15.33:0/3094599824 learned_addr learned my addr 172.21.15.33:0/3094599824 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cacc8700 1 --2- 172.21.15.33:0/3094599824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3089441104 0 0) 0x7f75c40ccfd0 con 0x7f75c406dc70 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75ac003570 con 0x7f75c406dc70 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1191446160 0 0) 0x7f75c415a3d0 con 0x7f75c4159530 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75c40ccfd0 con 0x7f75c4159530 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cacc8700 1 -- 172.21.15.33:0/3094599824 >> v1:172.21.15.59:6789/0 conn(0x7f75c4159530 legacy=0x7f75c40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cacc8700 1 -- 172.21.15.33:0/3094599824 >> v1:172.21.15.33:6789/0 conn(0x7f75c406dc70 legacy=0x7f75c4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 181305852 0 0) 0x7f75ac003570 con 0x7f75c406dc70 2023-10-09T15:37:58.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cacc8700 1 -- 172.21.15.33:0/3094599824 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75c415a990 con 0x7f75c406e0e0 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.495+0000 7f75cacc8700 1 --2- 172.21.15.33:0/3094599824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40cb6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e90 tx=0x7f75bc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e0d3996444ac3ba8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc00e070 con 0x7f75c406e0e0 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc00bb80 con 0x7f75c406e0e0 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75c94c5700 1 -- 172.21.15.33:0/3094599824 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc012430 con 0x7f75c406e0e0 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 -- 172.21.15.33:0/3094599824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 msgr2=0x7f75c40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3094599824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40cb6f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f75bc009e90 tx=0x7f75bc009780 comp rx=0 tx=0).stop 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 -- 172.21.15.33:0/3094599824 shutdown_connections 2023-10-09T15:37:58.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3094599824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40cb6f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 -- 172.21.15.33:0/3094599824 >> 172.21.15.33:0/3094599824 conn(0x7f75c40703a0 msgr2=0x7f75c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:37:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 -- 172.21.15.33:0/3094599824 shutdown_connections 2023-10-09T15:37:58.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.496+0000 7f75cc72b700 1 -- 172.21.15.33:0/3094599824 wait complete. 2023-10-09T15:37:58.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.497+0000 7f75cc72b700 1 Processor -- start 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.497+0000 7f75cc72b700 1 -- start start 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c406dc70 0x7f75c40c8760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40c9e40 con 0x7f75c4159530 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40b3510 con 0x7f75c406dc70 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cc72b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75c40c8d40 con 0x7f75c406e0e0 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cacc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:58.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cacc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35012/0 (socket says 172.21.15.33:35012) 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75cacc8700 1 -- 172.21.15.33:0/3586133980 learned_addr learned my addr 172.21.15.33:0/3586133980 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75c9cc6700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.498+0000 7f75ca4c7700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c406dc70 0x7f75c40c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 -- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 msgr2=0x7f75c40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 -- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c406dc70 msgr2=0x7f75c40c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c406dc70 0x7f75c40c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 -- 172.21.15.33:0/3586133980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75bc009a20 con 0x7f75c4159530 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75c9cc6700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cacc8700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f75bc013000 tx=0x7f75bc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc012e40 con 0x7f75c4159530 2023-10-09T15:37:58.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75bc01d630 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75c40c9020 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75bc01d9f0 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.499+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75c40c95e0 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.500+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75c40b36c0 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.500+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f75bc024070 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.501+0000 7f75c27fc700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 0x7f75b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.501+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 6603+0+0 (secure 0 0 0) 0x7f75bc087820 con 0x7f75c4159530 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.501+0000 7f75ca4c7700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 0x7f75b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:37:58.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.501+0000 7f75ca4c7700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 0x7f75b00697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f75b40037e0 tx=0x7f75b4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:37:58.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.505+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75c40b36c0 con 0x7f75c4159530 2023-10-09T15:37:58.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:37:58.727+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "volume_0000000000286640", "target": ["mon-mgr", ""]}) v1 -- 0x7f75c40b3680 con 0x7f75b0067320 2023-10-09T15:38:00.133 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:38:00.133+0000 7fd6b0b9c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:01.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.377+0000 7f75c27fc700 1 -- 172.21.15.33:0/3586133980 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) v1 ==== 60+0+0 (secure 0 0 0) 0x7f75c40b3680 con 0x7f75b0067320 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.379+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 msgr2=0x7f75b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.379+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 0x7f75b00697d0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f75b40037e0 tx=0x7f75b4009040 comp rx=0 tx=0).stop 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.379+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 msgr2=0x7f75c4156380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.379+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7f75bc013000 tx=0x7f75bc019000 comp rx=0 tx=0).stop 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 shutdown_connections 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75b0067320 0x7f75b00697d0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75c4159530 0x7f75c4156380 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75c406dc70 0x7f75c40c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 --2- 172.21.15.33:0/3586133980 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75c406e0e0 0x7f75c40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 >> 172.21.15.33:0/3586133980 conn(0x7f75c40703a0 msgr2=0x7f75c4155010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 shutdown_connections 2023-10-09T15:38:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.380+0000 7f75cc72b700 1 -- 172.21.15.33:0/3586133980 wait complete. 2023-10-09T15:38:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:Volume created successfully (no MDS daemons created) 2023-10-09T15:38:01.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:38:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.538+0000 7f9c01c7e700 1 Processor -- start 2023-10-09T15:38:01.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.538+0000 7f9c01c7e700 1 -- start start 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9c01c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9bfc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9c01c7e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc06c7d0 con 0x7f9bfc15aa20 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9c01c7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bfc0c37a0 con 0x7f9bfc0c3250 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9c01c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc1171e0 con 0x7f9bfc143200 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfbfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9bfc15aa20 0x7f9bfc163430 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60548/0 (socket says 172.21.15.33:60548) 2023-10-09T15:38:01.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfbfff700 1 -- 172.21.15.33:0/2863783542 learned_addr learned my addr 172.21.15.33:0/2863783542 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2775038019 0 0) 0x7f9bfc06c7d0 con 0x7f9bfc15aa20 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9bfc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be4003570 con 0x7f9bfc15aa20 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2340894852 0 0) 0x7f9be4003570 con 0x7f9bfc15aa20 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 msgr2=0x7f9bfc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9bfc159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 >> v1:172.21.15.59:6789/0 conn(0x7f9bfc0c3250 legacy=0x7f9bfc15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc0cc090 con 0x7f9bfc15aa20 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f9bf40017f0 con 0x7f9bfc15aa20 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 >> v1:172.21.15.33:6789/0 conn(0x7f9bfc15aa20 legacy=0x7f9bfc163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9be4003a90 0x7f9be4003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4004810 0x7f9be4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9be40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400bb10 con 0x7f9be4003a90 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400bc50 con 0x7f9be4004810 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.539+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400be10 con 0x7f9bfc143200 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9be4003a90 0x7f9be4003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfaffd700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4004810 0x7f9be4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfbfff700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9be40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 msgr2=0x7f9be40051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc143200 0x7f9be40051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4004810 msgr2=0x7f9be4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4004810 0x7f9be4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 -- 172.21.15.33:0/2863783542 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4003570 con 0x7f9be4003a90 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfaffd700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4004810 0x7f9be4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9be4003a90 0x7f9be4003e60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009c00 tx=0x7f9bec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58dafc7f3e839d19 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00e710 con 0x7f9be4003a90 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bec00e870 con 0x7f9be4003a90 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.540+0000 7f9bfa7fc700 1 -- 172.21.15.33:0/2863783542 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bec00ec30 con 0x7f9be4003a90 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 -- 172.21.15.33:0/2863783542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9be4003a90 msgr2=0x7f9be4003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/2863783542 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9be4003a90 0x7f9be4003e60 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f9bec009c00 tx=0x7f9bec0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9bfbfff700 1 -- 172.21.15.33:0/2863783542 reap_dead start 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 -- 172.21.15.33:0/2863783542 shutdown_connections 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 -- 172.21.15.33:0/2863783542 >> 172.21.15.33:0/2863783542 conn(0x7f9bfc0ccb60 msgr2=0x7f9bfc0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:01.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 -- 172.21.15.33:0/2863783542 shutdown_connections 2023-10-09T15:38:01.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.541+0000 7f9c01c7e700 1 -- 172.21.15.33:0/2863783542 wait complete. 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.542+0000 7f9c01c7e700 1 Processor -- start 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.542+0000 7f9c01c7e700 1 -- start start 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4003a90 0x7f9bfc13c850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc15e110 0x7f9bfc144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15dc80 con 0x7f9bfc145390 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15d070 con 0x7f9be4003a90 2023-10-09T15:38:01.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9c01c7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bfc15d350 con 0x7f9bfc15e110 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39284/0 (socket says 172.21.15.33:39284) 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 -- 172.21.15.33:0/3041076370 learned_addr learned my addr 172.21.15.33:0/3041076370 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfaffd700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc15e110 0x7f9bfc144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4003a90 0x7f9bfc13c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 -- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc15e110 msgr2=0x7f9bfc144e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc15e110 0x7f9bfc144e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 -- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4003a90 msgr2=0x7f9bfc13c850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4003a90 0x7f9bfc13c850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 -- 172.21.15.33:0/3041076370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bfc15d630 con 0x7f9bfc145390 2023-10-09T15:38:01.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9bfbfff700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0cbfc0 tx=0x7f9bfc06c740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf400aac0 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.543+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf400ac60 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.544+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bfc15d910 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.544+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf40133f0 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.544+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bfc13cd90 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.544+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bfc15de30 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.545+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9bf4013760 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.545+0000 7f9be37fe700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 0x7f9be80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.546+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 7501+0+0 (secure 0 0 0) 0x7f9bf4085d30 con 0x7f9bfc145390 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.546+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 0x7f9be80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.546+0000 7f9bfb7fe700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 0x7f9be80697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0091e0 tx=0x7f9bec01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.550+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9bfc15de30 con 0x7f9bfc145390 2023-10-09T15:38:01.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.771+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9bfc04c3c0 con 0x7f9be8067320 2023-10-09T15:38:01.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.772+0000 7f9be37fe700 1 -- 172.21.15.33:0/3041076370 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+151 (secure 0 0 0) 0x7f9bfc04c3c0 con 0x7f9be8067320 2023-10-09T15:38:01.772 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:38:01.772 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000286639" 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000286640" 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:01.773 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:38:01.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 msgr2=0x7f9be80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 0x7f9be80697d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f9bec0091e0 tx=0x7f9bec01a000 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 msgr2=0x7f9bfc1461c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f9bfc0cbfc0 tx=0x7f9bfc06c740 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 shutdown_connections 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9be8067320 0x7f9be80697d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9bfc145390 0x7f9bfc1461c0 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9be4003a90 0x7f9bfc13c850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 --2- 172.21.15.33:0/3041076370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9bfc15e110 0x7f9bfc144e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 >> 172.21.15.33:0/3041076370 conn(0x7f9bfc0ccb60 msgr2=0x7f9bfc06a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:01.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 shutdown_connections 2023-10-09T15:38:01.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.774+0000 7f9c01c7e700 1 -- 172.21.15.33:0/3041076370 wait complete. 2023-10-09T15:38:01.787 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000286639 --yes-i-really-mean-it 2023-10-09T15:38:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.909+0000 7ff9b3fff700 1 Processor -- start 2023-10-09T15:38:01.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.909+0000 7ff9b3fff700 1 -- start start 2023-10-09T15:38:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9b415dfd0 0x7ff9b40aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b3fff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff9b4159920 0x7ff9b40ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b3fff700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9b40acc00 con 0x7ff9b4159550 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b3fff700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40abff0 con 0x7ff9b415dfd0 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b3fff700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff9b40ac2d0 con 0x7ff9b4159920 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b27fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9b415dfd0 0x7ff9b40aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b27fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff9b415dfd0 0x7ff9b40aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39294/0 (socket says 172.21.15.33:39294) 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b27fc700 1 -- 172.21.15.33:0/1222521091 learned_addr learned my addr 172.21.15.33:0/1222521091 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.910+0000 7ff9b37fe700 1 --2- 172.21.15.33:0/1222521091 >> v2:172.21.15.59:3300/0 conn(0x7ff9b4159920 0x7ff9b40ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b27fc700 1 -- 172.21.15.33:0/1222521091 >> v2:172.21.15.59:3300/0 conn(0x7ff9b4159920 msgr2=0x7ff9b40ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b27fc700 1 --2- 172.21.15.33:0/1222521091 >> v2:172.21.15.59:3300/0 conn(0x7ff9b4159920 0x7ff9b40ad090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b27fc700 1 -- 172.21.15.33:0/1222521091 >> v1:172.21.15.59:6789/0 conn(0x7ff9b4159550 legacy=0x7ff9b40ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b27fc700 1 -- 172.21.15.33:0/1222521091 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b40ac5b0 con 0x7ff9b415dfd0 2023-10-09T15:38:01.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b27fc700 1 --2- 172.21.15.33:0/1222521091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b415dfd0 0x7ff9b40aedb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406b0f0 tx=0x7ff99c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95ac1204d0f82984 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b1ffb700 1 -- 172.21.15.33:0/1222521091 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00b860 con 0x7ff9b415dfd0 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b1ffb700 1 -- 172.21.15.33:0/1222521091 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c00b9c0 con 0x7ff9b415dfd0 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b1ffb700 1 -- 172.21.15.33:0/1222521091 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c00bd60 con 0x7ff9b415dfd0 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 -- 172.21.15.33:0/1222521091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b415dfd0 msgr2=0x7ff9b40aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/1222521091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b415dfd0 0x7ff9b40aedb0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406b0f0 tx=0x7ff99c009250 comp rx=0 tx=0).stop 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 -- 172.21.15.33:0/1222521091 shutdown_connections 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/1222521091 >> v2:172.21.15.59:3300/0 conn(0x7ff9b4159920 0x7ff9b40ad090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/1222521091 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b415dfd0 0x7ff9b40aedb0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 -- 172.21.15.33:0/1222521091 >> 172.21.15.33:0/1222521091 conn(0x7ff9b406ce80 msgr2=0x7ff9b40ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 -- 172.21.15.33:0/1222521091 shutdown_connections 2023-10-09T15:38:01.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.911+0000 7ff9b3fff700 1 -- 172.21.15.33:0/1222521091 wait complete. 2023-10-09T15:38:01.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 Processor -- start 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 -- start start 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 0x7ff9b4148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b415dfd0 0x7ff9b414f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4169c90 con 0x7ff9b4159920 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4149080 con 0x7ff9b415dfd0 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b3fff700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b4169eb0 con 0x7ff9b4159550 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b27fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39310/0 (socket says 172.21.15.33:39310) 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.913+0000 7ff9b27fc700 1 -- 172.21.15.33:0/3278541050 learned_addr learned my addr 172.21.15.33:0/3278541050 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:01.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b37fe700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b415dfd0 0x7ff9b414f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b2ffd700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 0x7ff9b4148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 -- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 msgr2=0x7ff9b4148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 0x7ff9b4148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 -- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b415dfd0 msgr2=0x7ff9b414f8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b415dfd0 0x7ff9b414f8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 -- 172.21.15.33:0/3278541050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c0094f0 con 0x7ff9b4159920 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b2ffd700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 0x7ff9b4148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b27fc700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406ad70 tx=0x7ff99c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c024440 con 0x7ff9b4159920 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff99c0245a0 con 0x7ff9b4159920 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b416a190 con 0x7ff9b4159920 2023-10-09T15:38:01.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff99c024960 con 0x7ff9b4159920 2023-10-09T15:38:01.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.914+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b416a750 con 0x7ff9b4159920 2023-10-09T15:38:01.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.915+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9b404c3c0 con 0x7ff9b4159920 2023-10-09T15:38:01.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.916+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff99c024d50 con 0x7ff9b4159920 2023-10-09T15:38:01.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.916+0000 7ff9aaffd700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:01.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.916+0000 7ff9b2ffd700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:01.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.916+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 7501+0+0 (secure 0 0 0) 0x7ff99c086d50 con 0x7ff9b4159920 2023-10-09T15:38:01.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.917+0000 7ff9b2ffd700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 0x7ff9940697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007fd0 tx=0x7ff9ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:01.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:01.921+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff99c0533e0 con 0x7ff9b4159920 2023-10-09T15:38:02.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:02.144+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000286639", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7ff9b406e7c0 con 0x7ff994067320 2023-10-09T15:38:02.147 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:38:02.148+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:38:02.153 INFO:tasks.ceph.mds.a.smithi033.stderr: -67> 2023-10-09T15:38:00.133+0000 7fd6b0b9c700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:02.173 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:38:05.134 INFO:tasks.ceph.mds.d.smithi059.stderr:2023-10-09T15:38:05.133+0000 7fb9a9a61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:05.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.179+0000 7ff9aaffd700 1 -- 172.21.15.33:0/3278541050 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7ff9b406e7c0 con 0x7ff994067320 2023-10-09T15:38:05.179 INFO:teuthology.orchestra.run.smithi033.stdout:metadata pool: cephfs.volume_0000000000286639.meta data pool: ['cephfs.volume_0000000000286639.data'] removed 2023-10-09T15:38:05.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 msgr2=0x7ff9940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:05.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 0x7ff9940697d0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7ff9ac007fd0 tx=0x7ff9ac009040 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 msgr2=0x7ff9b414c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7ff9b406ad70 tx=0x7ff99c017000 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 shutdown_connections 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff994067320 0x7ff9940697d0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff9b415dfd0 0x7ff9b414f8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff9b4159550 0x7ff9b4148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 --2- 172.21.15.33:0/3278541050 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff9b4159920 0x7ff9b414c660 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 >> 172.21.15.33:0/3278541050 conn(0x7ff9b406ce80 msgr2=0x7ff9b40b0380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 shutdown_connections 2023-10-09T15:38:05.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.182+0000 7ff9b3fff700 1 -- 172.21.15.33:0/3278541050 wait complete. 2023-10-09T15:38:05.198 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm volume_0000000000286640 --yes-i-really-mean-it 2023-10-09T15:38:05.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.332+0000 7fc84f9c1700 1 Processor -- start 2023-10-09T15:38:05.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.332+0000 7fc84f9c1700 1 -- start start 2023-10-09T15:38:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84f9c1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc848159530 0x7fc8480ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84f9c1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc84806dc70 0x7fc848159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84f9c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8480ccfd0 con 0x7fc84806e0e0 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84f9c1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8480cf0e0 con 0x7fc848159530 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84f9c1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc84815a3d0 con 0x7fc84806dc70 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc848159530 0x7fc8480ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc848159530 0x7fc8480ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39348/0 (socket says 172.21.15.33:39348) 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 -- 172.21.15.33:0/2440938764 learned_addr learned my addr 172.21.15.33:0/2440938764 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84cf5c700 1 --2- 172.21.15.33:0/2440938764 >> v2:172.21.15.59:3300/0 conn(0x7fc84806dc70 0x7fc848159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 -- 172.21.15.33:0/2440938764 >> v2:172.21.15.59:3300/0 conn(0x7fc84806dc70 msgr2=0x7fc848159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 --2- 172.21.15.33:0/2440938764 >> v2:172.21.15.59:3300/0 conn(0x7fc84806dc70 0x7fc848159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 -- 172.21.15.33:0/2440938764 >> v1:172.21.15.59:6789/0 conn(0x7fc84806e0e0 legacy=0x7fc8480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 -- 172.21.15.33:0/2440938764 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc84815a6b0 con 0x7fc848159530 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.333+0000 7fc84d75d700 1 --2- 172.21.15.33:0/2440938764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc848159530 0x7fc8480ceba0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc8480b66e0 tx=0x7fc838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce350c32c096c21a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:05.335 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc847fff700 1 -- 172.21.15.33:0/2440938764 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800b820 con 0x7fc848159530 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc847fff700 1 -- 172.21.15.33:0/2440938764 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc83800b980 con 0x7fc848159530 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc847fff700 1 -- 172.21.15.33:0/2440938764 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83800bd20 con 0x7fc848159530 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 -- 172.21.15.33:0/2440938764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc848159530 msgr2=0x7fc8480ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/2440938764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc848159530 0x7fc8480ceba0 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7fc8480b66e0 tx=0x7fc838009250 comp rx=0 tx=0).stop 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 -- 172.21.15.33:0/2440938764 shutdown_connections 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/2440938764 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc848159530 0x7fc8480ceba0 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/2440938764 >> v2:172.21.15.59:3300/0 conn(0x7fc84806dc70 0x7fc848159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 -- 172.21.15.33:0/2440938764 >> 172.21.15.33:0/2440938764 conn(0x7fc8480703a0 msgr2=0x7fc8480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 -- 172.21.15.33:0/2440938764 shutdown_connections 2023-10-09T15:38:05.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.334+0000 7fc84f9c1700 1 -- 172.21.15.33:0/2440938764 wait complete. 2023-10-09T15:38:05.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.335+0000 7fc84f9c1700 1 Processor -- start 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.335+0000 7fc84f9c1700 1 -- start start 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84806e0e0 0x7fc848151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc848159530 0x7fc8480b5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480b6580 con 0x7fc84806dc70 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8481520d0 con 0x7fc848159530 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84f9c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8480b5fc0 con 0x7fc84806e0e0 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84d75d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84d75d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39352/0 (socket says 172.21.15.33:39352) 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84d75d700 1 -- 172.21.15.33:0/1400356182 learned_addr learned my addr 172.21.15.33:0/1400356182 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:05.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84cf5c700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84806e0e0 0x7fc848151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.336+0000 7fc84df5e700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc848159530 0x7fc8480b5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 -- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84806e0e0 msgr2=0x7fc848151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84806e0e0 0x7fc848151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 -- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc848159530 msgr2=0x7fc8480b5790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc848159530 0x7fc8480b5790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 -- 172.21.15.33:0/1400356182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8380094f0 con 0x7fc84806dc70 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84d75d700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc838009290 tx=0x7fc838016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc838011e20 con 0x7fc84806dc70 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc838020070 con 0x7fc84806dc70 2023-10-09T15:38:05.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8480b62a0 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc83801b6a0 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.337+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8480c7c10 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.338+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8480c7770 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.338+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc838022030 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.339+0000 7fc8457fa700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 0x7fc8340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.339+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 6689+0+0 (secure 0 0 0) 0x7fc838086f60 con 0x7fc84806dc70 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.339+0000 7fc84cf5c700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 0x7fc8340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:05.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.339+0000 7fc84cf5c700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 0x7fc8340697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006fd0 tx=0x7fc83c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:05.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.343+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc838053920 con 0x7fc84806dc70 2023-10-09T15:38:05.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:05.566+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "volume_0000000000286640", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fc8480c7770 con 0x7fc834067320 2023-10-09T15:38:05.569 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:38:05.570+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:38:05.576 INFO:tasks.ceph.mds.d.smithi059.stderr: -35> 2023-10-09T15:38:05.133+0000 7fb9a9a61700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:05.598 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:38:06.760 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:38:06.763 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:38:08.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.580+0000 7fc8457fa700 1 -- 172.21.15.33:0/1400356182 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+110 (secure 0 0 0) 0x7fc8480c7770 con 0x7fc834067320 2023-10-09T15:38:08.581 INFO:teuthology.orchestra.run.smithi033.stdout:metadata pool: cephfs.volume_0000000000286640.meta data pool: ['cephfs.volume_0000000000286640.data'] removed 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.584+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 msgr2=0x7fc8340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.584+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 0x7fc8340697d0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fc83c006fd0 tx=0x7fc83c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.584+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 msgr2=0x7fc8480ca1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.584+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc838009290 tx=0x7fc838016000 comp rx=0 tx=0).stop 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 shutdown_connections 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc834067320 0x7fc8340697d0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc84806dc70 0x7fc8480ca1e0 secure :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc838009290 tx=0x7fc838016000 comp rx=0 tx=0).stop 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc848159530 0x7fc8480b5790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 --2- 172.21.15.33:0/1400356182 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc84806e0e0 0x7fc848151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 >> 172.21.15.33:0/1400356182 conn(0x7fc8480703a0 msgr2=0x7fc848153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 shutdown_connections 2023-10-09T15:38:08.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.585+0000 7fc84f9c1700 1 -- 172.21.15.33:0/1400356182 wait complete. 2023-10-09T15:38:08.601 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:38:08.601 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:08.644 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:08.691 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:38:08.691 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:38:08.692 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:38:08.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:08.737 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:38:08.737 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:08.737 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:38:08.753 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:38:08.753 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:38:08.753 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:08.795 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:38:08.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:08.795 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:38:08.851 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 Processor -- start 2023-10-09T15:38:08.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 -- start start 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0078159850 0x7f00780adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0078159c20 0x7f00780ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00780adb20 con 0x7f00780b0930 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00780ccdc0 con 0x7f0078159c20 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.975+0000 7f007dfcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00780acf10 con 0x7f0078159850 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f0077fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f00780b0930 0x7f00780c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60556/0 (socket says 172.21.15.33:60556) 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f0077fff700 1 -- 172.21.15.33:0/2349707237 learned_addr learned my addr 172.21.15.33:0/2349707237 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00777fe700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0078159850 0x7f00780adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> v2:172.21.15.59:3300/0 conn(0x7f0078159c20 0x7f00780ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3752072701 0 0) 0x7f00780adb20 con 0x7f00780b0930 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0060003570 con 0x7f00780b0930 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 266576324 0 0) 0x7f0060003570 con 0x7f00780b0930 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0078159850 msgr2=0x7f00780adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0078159850 0x7f00780adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 >> v2:172.21.15.59:3300/0 conn(0x7f0078159c20 msgr2=0x7f00780ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 --2- 172.21.15.33:0/2349707237 >> v2:172.21.15.59:3300/0 conn(0x7f0078159c20 0x7f00780ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00780ad1f0 con 0x7f00780b0930 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f00700017f0 con 0x7f00780b0930 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 >> v1:172.21.15.33:6789/0 conn(0x7f00780b0930 legacy=0x7f00780c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060003a60 0x7f0060003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0060004810 0x7f0060004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00600051c0 0x7f006000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780ccdc0 con 0x7f0060004810 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780acf10 con 0x7f00600051c0 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f006000bfa0 con 0x7f0060003a60 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f00777fe700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0078159850 0x7f00780adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> v2:172.21.15.59:3300/0 conn(0x7f0078159c20 0x7f00780ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.976+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0060004810 0x7f0060004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f00777fe700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060003a60 0x7f0060003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0077fff700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00600051c0 0x7f006000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 -- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060003a60 msgr2=0x7f0060003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060003a60 0x7f0060003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 -- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00600051c0 msgr2=0x7f006000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:08.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00600051c0 0x7f006000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 -- 172.21.15.33:0/2349707237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0060003570 con 0x7f0060004810 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f00777fe700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060003a60 0x7f0060003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0060004810 0x7f0060004c80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f006c009db0 tx=0x7f006c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73bfd0441d06bea1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c009740 con 0x7f0060004810 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006c00e920 con 0x7f0060004810 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.977+0000 7f00767fc700 1 -- 172.21.15.33:0/2349707237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006c00eca0 con 0x7f0060004810 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 -- 172.21.15.33:0/2349707237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0060004810 msgr2=0x7f0060004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2349707237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0060004810 0x7f0060004c80 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f006c009db0 tx=0x7f006c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f0077fff700 1 -- 172.21.15.33:0/2349707237 reap_dead start 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 -- 172.21.15.33:0/2349707237 shutdown_connections 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 -- 172.21.15.33:0/2349707237 >> 172.21.15.33:0/2349707237 conn(0x7f007806d170 msgr2=0x7f00780cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:08.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 -- 172.21.15.33:0/2349707237 shutdown_connections 2023-10-09T15:38:08.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.978+0000 7f007dfcb700 1 -- 172.21.15.33:0/2349707237 wait complete. 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.979+0000 7f007dfcb700 1 Processor -- start 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.979+0000 7f007dfcb700 1 -- start start 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060004810 0x7f0078157690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0078151290 0x7f0078152080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0078157bd0 con 0x7f0078158b20 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00781525c0 con 0x7f0078151290 2023-10-09T15:38:08.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0078166d40 con 0x7f0060004810 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39378/0 (socket says 172.21.15.33:39378) 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 -- 172.21.15.33:0/2885690534 learned_addr learned my addr 172.21.15.33:0/2885690534 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0076ffd700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0078151290 0x7f0078152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f00777fe700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060004810 0x7f0078157690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 -- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060004810 msgr2=0x7f0078157690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060004810 0x7f0078157690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 -- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0078151290 msgr2=0x7f0078152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0078151290 0x7f0078152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 -- 172.21.15.33:0/2885690534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0078158920 con 0x7f0078158b20 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f0077fff700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f00780683d0 tx=0x7f0070002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:08.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700017d0 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000ad80 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0078166130 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.980+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070013620 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.981+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00781666f0 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.982+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0078166eb0 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.982+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00700139d0 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.982+0000 7f005f7fe700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 0x7f00640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.982+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f00700856c0 con 0x7f0078158b20 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.982+0000 7f00777fe700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 0x7f00640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:08.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.983+0000 7f00777fe700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 0x7f00640697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0068006dc0 tx=0x7f0068008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:08.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:08.987+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00700522a0 con 0x7f0078158b20 2023-10-09T15:38:09.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.229+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f007804c3c0 con 0x7f0078158b20 2023-10-09T15:38:09.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.230+0000 7f005f7fe700 1 -- 172.21.15.33:0/2885690534 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f00700558c0 con 0x7f0078158b20 2023-10-09T15:38:09.230 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:09.230 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4218052350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4218052350},{"type":"v1","addr":"172.21.15.59:6835","nonce":4218052350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3967750705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3967750705},{"type":"v1","addr":"172.21.15.33:6837","nonce":3967750705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 msgr2=0x7f00640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 0x7f00640697d0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f0068006dc0 tx=0x7f0068008040 comp rx=0 tx=0).stop 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 msgr2=0x7f0078155b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f00780683d0 tx=0x7f0070002210 comp rx=0 tx=0).stop 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 shutdown_connections 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0064067320 0x7f00640697d0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0078158b20 0x7f0078155b00 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0060004810 0x7f0078157690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 --2- 172.21.15.33:0/2885690534 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0078151290 0x7f0078152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 >> 172.21.15.33:0/2885690534 conn(0x7f007806d170 msgr2=0x7f007806e3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 shutdown_connections 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.232+0000 7f007dfcb700 1 -- 172.21.15.33:0/2885690534 wait complete. 2023-10-09T15:38:09.233 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 85 2023-10-09T15:38:09.244 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.367+0000 7f4cabe64700 1 Processor -- start 2023-10-09T15:38:09.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.367+0000 7f4cabe64700 1 -- start start 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4cabe64700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ca41576a0 0x7f4ca40c4d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4cabe64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca40c8040 0x7f4ca40cc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4cabe64700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ca4157a70 con 0x7f4ca40c5510 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4cabe64700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ca40c8800 con 0x7f4ca41576a0 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4cabe64700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40cb780 con 0x7f4ca40c8040 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ca41576a0 0x7f4ca40c4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ca41576a0 0x7f4ca40c4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39380/0 (socket says 172.21.15.33:39380) 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 -- 172.21.15.33:0/4125929443 learned_addr learned my addr 172.21.15.33:0/4125929443 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca93ff700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca40c8040 0x7f4ca40cc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 -- 172.21.15.33:0/4125929443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca40c8040 msgr2=0x7f4ca40cc260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca40c8040 0x7f4ca40cc260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 -- 172.21.15.33:0/4125929443 >> v1:172.21.15.59:6789/0 conn(0x7f4ca40c5510 legacy=0x7f4ca40c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 -- 172.21.15.33:0/4125929443 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca40cba60 con 0x7f4ca41576a0 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca8bfe700 1 -- 172.21.15.33:0/4125929443 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4235837179 0 0) 0x7f4ca4157a70 con 0x7f4ca40c5510 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.369+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41576a0 0x7f4ca40c4d80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00099b0 tx=0x7f4ca0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7be732cd9fd5e0e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4ca8bfe700 1 -- 172.21.15.33:0/4125929443 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca0009ea0 con 0x7f4ca41576a0 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4ca8bfe700 1 -- 172.21.15.33:0/4125929443 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ca000b860 con 0x7f4ca41576a0 2023-10-09T15:38:09.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4ca8bfe700 1 -- 172.21.15.33:0/4125929443 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ca000bc00 con 0x7f4ca41576a0 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 -- 172.21.15.33:0/4125929443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41576a0 msgr2=0x7f4ca40c4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41576a0 0x7f4ca40c4d80 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00099b0 tx=0x7f4ca0009250 comp rx=0 tx=0).stop 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 -- 172.21.15.33:0/4125929443 shutdown_connections 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca41576a0 0x7f4ca40c4d80 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 --2- 172.21.15.33:0/4125929443 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca40c8040 0x7f4ca40cc260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 -- 172.21.15.33:0/4125929443 >> 172.21.15.33:0/4125929443 conn(0x7f4ca40ccb60 msgr2=0x7f4ca40ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 -- 172.21.15.33:0/4125929443 shutdown_connections 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.370+0000 7f4cabe64700 1 -- 172.21.15.33:0/4125929443 wait complete. 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.371+0000 7f4cabe64700 1 Processor -- start 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 -- start start 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 0x7f4ca414cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca41576a0 0x7f4ca4147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca414d530 con 0x7f4ca40c8040 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca40c2ea0 con 0x7f4ca40c5510 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4cabe64700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ca414d740 con 0x7f4ca41576a0 2023-10-09T15:38:09.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4ca93ff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4ca93ff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39390/0 (socket says 172.21.15.33:39390) 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4ca93ff700 1 -- 172.21.15.33:0/1333111328 learned_addr learned my addr 172.21.15.33:0/1333111328 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 0x7f4ca414cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.372+0000 7f4caa401700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca41576a0 0x7f4ca4147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 -- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca41576a0 msgr2=0x7f4ca4147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca41576a0 0x7f4ca4147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 -- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 msgr2=0x7f4ca414cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 0x7f4ca414cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 -- 172.21.15.33:0/1333111328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ca00094f0 con 0x7f4ca40c8040 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 0x7f4ca414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4ca93ff700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400ec80 tx=0x7f4c940091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.376 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400c850 con 0x7f4ca40c8040 2023-10-09T15:38:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c9400c9b0 con 0x7f4ca40c8040 2023-10-09T15:38:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ca414da20 con 0x7f4ca40c8040 2023-10-09T15:38:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c9400cd50 con 0x7f4ca40c8040 2023-10-09T15:38:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.373+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ca4156b90 con 0x7f4ca40c8040 2023-10-09T15:38:09.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.374+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ca40c3050 con 0x7f4ca40c8040 2023-10-09T15:38:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.375+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4c94013680 con 0x7f4ca40c8040 2023-10-09T15:38:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.375+0000 7f4c99ffb700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 0x7f4c880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.375+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f4c94084fc0 con 0x7f4ca40c8040 2023-10-09T15:38:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.375+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 0x7f4c880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.376+0000 7f4ca9c00700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 0x7f4c880697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00099b0 tx=0x7f4ca0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.379 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.379+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4ca40c3050 con 0x7f4ca40c8040 2023-10-09T15:38:09.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.575+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4ca40c3010 con 0x7f4ca40c8040 2023-10-09T15:38:09.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.576+0000 7f4c99ffb700 1 -- 172.21.15.33:0/1333111328 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f4c94051ba0 con 0x7f4ca40c8040 2023-10-09T15:38:09.576 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:09.576 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":128,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:08.575063+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.59:6833/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.33:6837/1473081413":"2023-10-10T15:38:02.148196+0000","172.21.15.33:6835/1473081413":"2023-10-10T15:38:02.148196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 msgr2=0x7f4c880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 0x7f4c880697d0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f4ca00099b0 tx=0x7f4ca0017000 comp rx=0 tx=0).stop 2023-10-09T15:38:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 msgr2=0x7f4ca415c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f4c9400ec80 tx=0x7f4c940091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 shutdown_connections 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c88067320 0x7f4c880697d0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ca41576a0 0x7f4ca4147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ca40c5510 0x7f4ca414cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 --2- 172.21.15.33:0/1333111328 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ca40c8040 0x7f4ca415c0d0 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 >> 172.21.15.33:0/1333111328 conn(0x7f4ca40ccb60 msgr2=0x7f4ca40ca8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 shutdown_connections 2023-10-09T15:38:09.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.578+0000 7f4cabe64700 1 -- 172.21.15.33:0/1333111328 wait complete. 2023-10-09T15:38:09.591 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:37:42.614953+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '112', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:37:43.656847+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '113', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:38:09.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:38:09.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.713+0000 7f95c314d700 1 Processor -- start 2023-10-09T15:38:09.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.713+0000 7f95c314d700 1 -- start start 2023-10-09T15:38:09.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c314d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95bc13c9b0 0x7f95bc069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c314d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc06f7d0 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c314d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95bc06d7b0 con 0x7f95bc0cc320 2023-10-09T15:38:09.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c314d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95bc06e330 con 0x7f95bc13c9b0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c16ea700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f95bc0cc6f0 0x7f95bc069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:60568/0 (socket says 172.21.15.33:60568) 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95c16ea700 1 -- 172.21.15.33:0/3032198 learned_addr learned my addr 172.21.15.33:0/3032198 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bbfff700 1 --2- 172.21.15.33:0/3032198 >> v2:172.21.15.59:3300/0 conn(0x7f95bc13c9b0 0x7f95bc069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649271740 0 0) 0x7f95bc06f7d0 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f95ac003570 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1836623502 0 0) 0x7f95ac003570 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 >> v2:172.21.15.59:3300/0 conn(0x7f95bc13c9b0 msgr2=0x7f95bc069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 --2- 172.21.15.33:0/3032198 >> v2:172.21.15.59:3300/0 conn(0x7f95bc13c9b0 0x7f95bc069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 >> v1:172.21.15.59:6789/0 conn(0x7f95bc0cc320 legacy=0x7f95bc13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc06da00 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f95b40017f0 con 0x7f95bc0cc6f0 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.714+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 >> v1:172.21.15.33:6789/0 conn(0x7f95bc0cc6f0 legacy=0x7f95bc069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95ac003ab0 0x7f95ac003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95ac004810 0x7f95ac004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95ac00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc06e330 con 0x7f95ac005210 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00c1b0 con 0x7f95ac004810 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95ac00c370 con 0x7f95ac003ab0 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95ac00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bbfff700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95ac004810 0x7f95ac004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c0ee9700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95ac003ab0 0x7f95ac003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 -- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95ac003ab0 msgr2=0x7f95ac003ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:09.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95ac003ab0 0x7f95ac003ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 -- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95ac004810 msgr2=0x7f95ac004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95ac004810 0x7f95ac004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 -- 172.21.15.33:0/3032198 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac003570 con 0x7f95ac005210 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 -- 172.21.15.33:0/3032198 reap_dead start 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95c16ea700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95ac00ba60 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f95b400a860 tx=0x7f95b4002100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7edfe26ebd980b79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b40070f0 con 0x7f95ac005210 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b4007270 con 0x7f95ac005210 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.715+0000 7f95bb7fe700 1 -- 172.21.15.33:0/3032198 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b4007630 con 0x7f95ac005210 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 -- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 msgr2=0x7f95ac00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95ac00ba60 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f95b400a860 tx=0x7f95b4002100 comp rx=0 tx=0).stop 2023-10-09T15:38:09.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 -- 172.21.15.33:0/3032198 shutdown_connections 2023-10-09T15:38:09.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 --2- 172.21.15.33:0/3032198 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95ac00ba60 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 -- 172.21.15.33:0/3032198 >> 172.21.15.33:0/3032198 conn(0x7f95bc067f00 msgr2=0x7f95bc068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:09.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 -- 172.21.15.33:0/3032198 shutdown_connections 2023-10-09T15:38:09.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.716+0000 7f95c314d700 1 -- 172.21.15.33:0/3032198 wait complete. 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.717+0000 7f95c314d700 1 Processor -- start 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.717+0000 7f95c314d700 1 -- start start 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95bc0c6730 0x7f95bc137c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95bc0cb460 0x7f95bc0c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c8eb0 con 0x7f95ac005210 2023-10-09T15:38:09.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c9150 con 0x7f95bc0c6730 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c314d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95bc0c9430 con 0x7f95bc0cb460 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39420/0 (socket says 172.21.15.33:39420) 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 -- 172.21.15.33:0/3339644779 learned_addr learned my addr 172.21.15.33:0/3339644779 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c16ea700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95bc0cb460 0x7f95bc0c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95bbfff700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95bc0c6730 0x7f95bc137c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 -- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95bc0cb460 msgr2=0x7f95bc0c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95bc0cb460 0x7f95bc0c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 -- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95bc0c6730 msgr2=0x7f95bc137c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95bc0c6730 0x7f95bc137c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 -- 172.21.15.33:0/3339644779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95bc0cba30 con 0x7f95ac005210 2023-10-09T15:38:09.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.718+0000 7f95c0ee9700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f95b0002950 tx=0x7f95b0007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.719+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b0002e90 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.719+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95b000f8d0 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.719+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95bc0ae070 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.719+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95b000fc90 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.719+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95bc1381b0 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.720+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95bc04c3c0 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.720+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f95b0006820 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.720+0000 7f95b8ff9700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 0x7f95a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.720+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f95b0084e90 con 0x7f95ac005210 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.721+0000 7f95bbfff700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 0x7f95a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:09.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.721+0000 7f95bbfff700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 0x7f95a00697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f95a8006ed0 tx=0x7f95a8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:09.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.725+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f95b0051a70 con 0x7f95ac005210 2023-10-09T15:38:09.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.916+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95bc06dce0 con 0x7f95ac005210 2023-10-09T15:38:09.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.916+0000 7f95b8ff9700 1 -- 172.21.15.33:0/3339644779 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v128) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95b0055090 con 0x7f95ac005210 2023-10-09T15:38:09.916 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 msgr2=0x7f95a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 0x7f95a00697d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f95a8006ed0 tx=0x7f95a8008040 comp rx=0 tx=0).stop 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 msgr2=0x7f95bc0adb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7f95b0002950 tx=0x7f95b0007d30 comp rx=0 tx=0).stop 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 shutdown_connections 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f95a0067320 0x7f95a00697d0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95ac005210 0x7f95bc0adb30 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95bc0cb460 0x7f95bc0c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 --2- 172.21.15.33:0/3339644779 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95bc0c6730 0x7f95bc137c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 >> 172.21.15.33:0/3339644779 conn(0x7f95bc067f00 msgr2=0x7f95bc06e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 shutdown_connections 2023-10-09T15:38:09.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:09.918+0000 7f95c314d700 1 -- 172.21.15.33:0/3339644779 wait complete. 2023-10-09T15:38:09.930 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:38:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.053+0000 7f3c4e17a700 1 Processor -- start 2023-10-09T15:38:10.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 -- start start 2023-10-09T15:38:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c48155b60 0x7f3c480b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c48156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c481575a0 con 0x7f3c481599d0 2023-10-09T15:38:10.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c48156990 con 0x7f3c48155b60 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c4e17a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48156c70 con 0x7f3c48155f30 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.054+0000 7f3c477fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c48155b60 0x7f3c480b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3c48155b60 0x7f3c480b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39428/0 (socket says 172.21.15.33:39428) 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 -- 172.21.15.33:0/1585085974 learned_addr learned my addr 172.21.15.33:0/1585085974 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c46ffd700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c48156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 -- 172.21.15.33:0/1585085974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 msgr2=0x7f3c48156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c48156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 -- 172.21.15.33:0/1585085974 >> v1:172.21.15.59:6789/0 conn(0x7f3c481599d0 legacy=0x7f3c480add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 -- 172.21.15.33:0/1585085974 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c48156f50 con 0x7f3c48155b60 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c477fe700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c48155b60 0x7f3c480b0730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800ab50 tx=0x7f3c3800a3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a661ab641302d85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c467fc700 1 -- 172.21.15.33:0/1585085974 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c3800ca40 con 0x7f3c48155b60 2023-10-09T15:38:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c467fc700 1 -- 172.21.15.33:0/1585085974 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c3800cba0 con 0x7f3c48155b60 2023-10-09T15:38:10.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.055+0000 7f3c467fc700 1 -- 172.21.15.33:0/1585085974 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c38018400 con 0x7f3c48155b60 2023-10-09T15:38:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 -- 172.21.15.33:0/1585085974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c48155b60 msgr2=0x7f3c480b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c48155b60 0x7f3c480b0730 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800ab50 tx=0x7f3c3800a3f0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 -- 172.21.15.33:0/1585085974 shutdown_connections 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c48155b60 0x7f3c480b0730 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/1585085974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c48156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 -- 172.21.15.33:0/1585085974 >> 172.21.15.33:0/1585085974 conn(0x7f3c4806d170 msgr2=0x7f3c480cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 -- 172.21.15.33:0/1585085974 shutdown_connections 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.056+0000 7f3c4e17a700 1 -- 172.21.15.33:0/1585085974 wait complete. 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.057+0000 7f3c4e17a700 1 Processor -- start 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.057+0000 7f3c4e17a700 1 -- start start 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c48155b60 0x7f3c48140040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c480c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4813d660 con 0x7f3c481599d0 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c480cb8a0 con 0x7f3c48155b60 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c4e17a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c48140580 con 0x7f3c48155f30 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39430/0 (socket says 172.21.15.33:39430) 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 -- 172.21.15.33:0/3248334345 learned_addr learned my addr 172.21.15.33:0/3248334345 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c477fe700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c48155b60 0x7f3c48140040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c46ffd700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c480c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 -- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 msgr2=0x7f3c480c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c480c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 -- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c48155b60 msgr2=0x7f3c48140040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c48155b60 0x7f3c48140040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 -- 172.21.15.33:0/3248334345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c3800a690 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.058+0000 7f3c47fff700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c840 tx=0x7f3c40001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.059+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40012630 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.059+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400127b0 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.059+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c480cac90 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.059+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40012b70 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.059+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c480cb250 con 0x7f3c481599d0 2023-10-09T15:38:10.062 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.060+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c480cba30 con 0x7f3c481599d0 2023-10-09T15:38:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.060+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3c4001a3a0 con 0x7f3c481599d0 2023-10-09T15:38:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.060+0000 7f3c2f7fe700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 0x7f3c340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.061+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f3c40084e80 con 0x7f3c481599d0 2023-10-09T15:38:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.061+0000 7f3c477fe700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 0x7f3c340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.061+0000 7f3c477fe700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 0x7f3c340697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800ab50 tx=0x7f3c3801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.065+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3c40051a60 con 0x7f3c481599d0 2023-10-09T15:38:10.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.257+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c48157230 con 0x7f3c481599d0 2023-10-09T15:38:10.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.257+0000 7f3c2f7fe700 1 -- 172.21.15.33:0/3248334345 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v128) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c40055080 con 0x7f3c481599d0 2023-10-09T15:38:10.257 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:38:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 msgr2=0x7f3c340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 0x7f3c340697d0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f3c3800ab50 tx=0x7f3c3801a000 comp rx=0 tx=0).stop 2023-10-09T15:38:10.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 msgr2=0x7f3c480c11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c840 tx=0x7f3c40001670 comp rx=0 tx=0).stop 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 shutdown_connections 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3c34067320 0x7f3c340697d0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3c481599d0 0x7f3c480c11a0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3c48155b60 0x7f3c48140040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 --2- 172.21.15.33:0/3248334345 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3c48155f30 0x7f3c480c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 >> 172.21.15.33:0/3248334345 conn(0x7f3c4806d170 msgr2=0x7f3c480ae200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 shutdown_connections 2023-10-09T15:38:10.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.259+0000 7f3c4e17a700 1 -- 172.21.15.33:0/3248334345 wait complete. 2023-10-09T15:38:10.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:38:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.393+0000 7eff37ea9700 1 Processor -- start 2023-10-09T15:38:10.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.393+0000 7eff37ea9700 1 -- start start 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff37ea9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff30159530 0x7eff300ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff37ea9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 0x7eff30159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff37ea9700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff300ccfd0 con 0x7eff3006e0e0 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff37ea9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff300cf0e0 con 0x7eff30159530 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff37ea9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff3015a3d0 con 0x7eff3006dc70 2023-10-09T15:38:10.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff30159530 0x7eff300ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff30159530 0x7eff300ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39432/0 (socket says 172.21.15.33:39432) 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 -- 172.21.15.33:0/3549700929 learned_addr learned my addr 172.21.15.33:0/3549700929 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35444700 1 --2- 172.21.15.33:0/3549700929 >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 0x7eff30159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 -- 172.21.15.33:0/3549700929 >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 msgr2=0x7eff30159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 --2- 172.21.15.33:0/3549700929 >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 0x7eff30159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 -- 172.21.15.33:0/3549700929 >> v1:172.21.15.59:6789/0 conn(0x7eff3006e0e0 legacy=0x7eff300cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 -- 172.21.15.33:0/3549700929 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff3015a6b0 con 0x7eff30159530 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35444700 1 --2- 172.21.15.33:0/3549700929 >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 0x7eff30159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.394+0000 7eff35c45700 1 --2- 172.21.15.33:0/3549700929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff30159530 0x7eff300ceba0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7eff300b66e0 tx=0x7eff20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7032c2ec68a3fa0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff34c43700 1 -- 172.21.15.33:0/3549700929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000b820 con 0x7eff30159530 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff34c43700 1 -- 172.21.15.33:0/3549700929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff2000b980 con 0x7eff30159530 2023-10-09T15:38:10.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff34c43700 1 -- 172.21.15.33:0/3549700929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2000bd20 con 0x7eff30159530 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 -- 172.21.15.33:0/3549700929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff30159530 msgr2=0x7eff300ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3549700929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff30159530 0x7eff300ceba0 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7eff300b66e0 tx=0x7eff20009250 comp rx=0 tx=0).stop 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 -- 172.21.15.33:0/3549700929 shutdown_connections 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3549700929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff30159530 0x7eff300ceba0 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3549700929 >> v2:172.21.15.59:3300/0 conn(0x7eff3006dc70 0x7eff30159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 -- 172.21.15.33:0/3549700929 >> 172.21.15.33:0/3549700929 conn(0x7eff300703a0 msgr2=0x7eff300707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 -- 172.21.15.33:0/3549700929 shutdown_connections 2023-10-09T15:38:10.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.395+0000 7eff37ea9700 1 -- 172.21.15.33:0/3549700929 wait complete. 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.396+0000 7eff37ea9700 1 Processor -- start 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.396+0000 7eff37ea9700 1 -- start start 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3006e0e0 0x7eff3014c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff30159530 0x7eff300c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff30151250 con 0x7eff3006dc70 2023-10-09T15:38:10.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff300b39c0 con 0x7eff30159530 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff37ea9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff30150640 con 0x7eff3006e0e0 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39440/0 (socket says 172.21.15.33:39440) 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 -- 172.21.15.33:0/3954366142 learned_addr learned my addr 172.21.15.33:0/3954366142 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 -- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3006e0e0 msgr2=0x7eff3014c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3006e0e0 0x7eff3014c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 -- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff30159530 msgr2=0x7eff300c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff30159530 0x7eff300c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.397+0000 7eff35c45700 1 -- 172.21.15.33:0/3954366142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff200094f0 con 0x7eff3006dc70 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff35c45700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7eff20009880 tx=0x7eff20016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff20011de0 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff20020070 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff30150920 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff2001b6a0 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.398+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff30150ee0 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.399+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff3004c3c0 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.399+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff20022030 con 0x7eff3006dc70 2023-10-09T15:38:10.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.400+0000 7eff2dffb700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 0x7eff1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.400+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7eff20086bd0 con 0x7eff3006dc70 2023-10-09T15:38:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.400+0000 7eff35444700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 0x7eff1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.400+0000 7eff35444700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 0x7eff1c0697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7eff3015b150 tx=0x7eff24008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.404+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff20053880 con 0x7eff3006dc70 2023-10-09T15:38:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.598+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7eff3004c3c0 con 0x7eff3006dc70 2023-10-09T15:38:10.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.598+0000 7eff2dffb700 1 -- 172.21.15.33:0/3954366142 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v128) v1 ==== 100+0+11 (secure 0 0 0) 0x7eff20086e60 con 0x7eff3006dc70 2023-10-09T15:38:10.598 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 msgr2=0x7eff1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 0x7eff1c0697d0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7eff3015b150 tx=0x7eff24008040 comp rx=0 tx=0).stop 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 msgr2=0x7eff300b3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7eff20009880 tx=0x7eff20016000 comp rx=0 tx=0).stop 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 shutdown_connections 2023-10-09T15:38:10.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff1c067320 0x7eff1c0697d0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff3006dc70 0x7eff300b3480 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff30159530 0x7eff300c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 --2- 172.21.15.33:0/3954366142 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff3006e0e0 0x7eff3014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.600+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 >> 172.21.15.33:0/3954366142 conn(0x7eff300703a0 msgr2=0x7eff300d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.601+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 shutdown_connections 2023-10-09T15:38:10.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.601+0000 7eff37ea9700 1 -- 172.21.15.33:0/3954366142 wait complete. 2023-10-09T15:38:10.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:10.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.731+0000 7f5be79f8700 1 Processor -- start 2023-10-09T15:38:10.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.732+0000 7f5be79f8700 1 -- start start 2023-10-09T15:38:10.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.732+0000 7f5be79f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 0x7f5be0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.732+0000 7f5be79f8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be015ae40 con 0x7f5be00cb5a0 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.732+0000 7f5be79f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5be015ab60 con 0x7f5be015a400 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.732+0000 7f5be79f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00ce0f0 con 0x7f5be00cb970 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be5794700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5be00cb5a0 0x7f5be00cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59000/0 (socket says 172.21.15.33:59000) 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be5794700 1 -- 172.21.15.33:0/4290545159 learned_addr learned my addr 172.21.15.33:0/4290545159 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be4f93700 1 --2- 172.21.15.33:0/4290545159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 0x7f5be0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818287117 0 0) 0x7f5be015ae40 con 0x7f5be00cb5a0 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5bc8003570 con 0x7f5be00cb5a0 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001478730 0 0) 0x7f5be015ab60 con 0x7f5be015a400 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be015ae40 con 0x7f5be015a400 2023-10-09T15:38:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3335164792 0 0) 0x7f5bc8003570 con 0x7f5be00cb5a0 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be4f93700 1 -- 172.21.15.33:0/4290545159 >> v1:172.21.15.59:6789/0 conn(0x7f5be015a400 legacy=0x7f5be0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be4f93700 1 -- 172.21.15.33:0/4290545159 >> v1:172.21.15.33:6789/0 conn(0x7f5be00cb5a0 legacy=0x7f5be00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be4f93700 1 -- 172.21.15.33:0/4290545159 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be00ccf00 con 0x7f5be00cb970 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.733+0000 7f5be4f93700 1 --2- 172.21.15.33:0/4290545159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 0x7f5be0159ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009910 tx=0x7f5bd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=265da13b009276b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd8001470 con 0x7f5be00cb970 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd4011420 con 0x7f5be00cb970 2023-10-09T15:38:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5bdffff700 1 -- 172.21.15.33:0/4290545159 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd40117c0 con 0x7f5be00cb970 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 -- 172.21.15.33:0/4290545159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 msgr2=0x7f5be0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 --2- 172.21.15.33:0/4290545159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 0x7f5be0159ec0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f5bd4009910 tx=0x7f5bd40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 -- 172.21.15.33:0/4290545159 shutdown_connections 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 --2- 172.21.15.33:0/4290545159 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb970 0x7f5be0159ec0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 -- 172.21.15.33:0/4290545159 >> 172.21.15.33:0/4290545159 conn(0x7f5be0070e30 msgr2=0x7f5be00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 -- 172.21.15.33:0/4290545159 shutdown_connections 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.734+0000 7f5be79f8700 1 -- 172.21.15.33:0/4290545159 wait complete. 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.735+0000 7f5be79f8700 1 Processor -- start 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.735+0000 7f5be79f8700 1 -- start start 2023-10-09T15:38:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 0x7f5be016c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be015a400 0x7f5be0169510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be00cbde0 con 0x7f5be00ca040 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be016c920 con 0x7f5be015a400 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be79f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be0169a50 con 0x7f5be00cb5a0 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be5f95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be5f95700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50860/0 (socket says 172.21.15.33:50860) 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be5f95700 1 -- 172.21.15.33:0/2033401859 learned_addr learned my addr 172.21.15.33:0/2033401859 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.736+0000 7f5be5794700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 0x7f5be016c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be4f93700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be015a400 0x7f5be0169510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 -- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 msgr2=0x7f5be016c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 0x7f5be016c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 -- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be015a400 msgr2=0x7f5be0169510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be015a400 0x7f5be0169510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 -- 172.21.15.33:0/2033401859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd4009420 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5794700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 0x7f5be016c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be5f95700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c940 tx=0x7f5bd00027a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000a7a0 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bd000a920 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be0158420 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bd000ace0 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.737+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be0157dd0 con 0x7f5be00ca040 2023-10-09T15:38:10.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.738+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be0157c30 con 0x7f5be00ca040 2023-10-09T15:38:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.738+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5bd0012630 con 0x7f5be00ca040 2023-10-09T15:38:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.739+0000 7f5bdd7fa700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 0x7f5bcc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.739+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f5bd0085100 con 0x7f5be00ca040 2023-10-09T15:38:10.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.739+0000 7f5be5794700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 0x7f5bcc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:10.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.739+0000 7f5be5794700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 0x7f5bcc0697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80011e0 tx=0x7f5bd8000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:10.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.743+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5be0157c30 con 0x7f5be00ca040 2023-10-09T15:38:10.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.982+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5be0157c30 con 0x7f5be00ca040 2023-10-09T15:38:10.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.983+0000 7f5bdd7fa700 1 -- 172.21.15.33:0/2033401859 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f5be0157c30 con 0x7f5be00ca040 2023-10-09T15:38:10.983 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:10.983 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4218052350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4218052350},{"type":"v1","addr":"172.21.15.59:6835","nonce":4218052350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3967750705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3967750705},{"type":"v1","addr":"172.21.15.33:6837","nonce":3967750705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 msgr2=0x7f5bcc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 0x7f5bcc0697d0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f5bd80011e0 tx=0x7f5bd8000bc0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 msgr2=0x7f5be016cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f5bd000c940 tx=0x7f5bd00027a0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 shutdown_connections 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bcc067320 0x7f5bcc0697d0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be00ca040 0x7f5be016cb10 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5be00cb5a0 0x7f5be016c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 --2- 172.21.15.33:0/2033401859 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be015a400 0x7f5be0169510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 >> 172.21.15.33:0/2033401859 conn(0x7f5be0070e30 msgr2=0x7f5be00b1c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 shutdown_connections 2023-10-09T15:38:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:10.985+0000 7f5be79f8700 1 -- 172.21.15.33:0/2033401859 wait complete. 2023-10-09T15:38:10.987 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 85 2023-10-09T15:38:10.997 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 Processor -- start 2023-10-09T15:38:11.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 -- start start 2023-10-09T15:38:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2544150c90 0x7f2544158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2544158c80 con 0x7f25441508c0 2023-10-09T15:38:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2544158f60 con 0x7f254415a7d0 2023-10-09T15:38:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.116+0000 7f254abd0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f254415afc0 con 0x7f2544150c90 2023-10-09T15:38:11.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2544150c90 0x7f2544158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2544150c90 0x7f2544158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50872/0 (socket says 172.21.15.33:50872) 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 -- 172.21.15.33:0/449364327 learned_addr learned my addr 172.21.15.33:0/449364327 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 -- 172.21.15.33:0/449364327 >> v1:172.21.15.59:6789/0 conn(0x7f254415a7d0 legacy=0x7f2544154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 -- 172.21.15.33:0/449364327 >> v1:172.21.15.33:6789/0 conn(0x7f25441508c0 legacy=0x7f254415a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 -- 172.21.15.33:0/449364327 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2544159240 con 0x7f2544150c90 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f254916d700 1 --2- 172.21.15.33:0/449364327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2544150c90 0x7f2544158650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f252c00bc50 tx=0x7f252c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc3f2d7abe8c683 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f25437fe700 1 -- 172.21.15.33:0/449364327 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c00be60 con 0x7f2544150c90 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f25437fe700 1 -- 172.21.15.33:0/449364327 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c00de00 con 0x7f2544150c90 2023-10-09T15:38:11.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.117+0000 7f25437fe700 1 -- 172.21.15.33:0/449364327 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c0196b0 con 0x7f2544150c90 2023-10-09T15:38:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 -- 172.21.15.33:0/449364327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2544150c90 msgr2=0x7f2544158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 --2- 172.21.15.33:0/449364327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2544150c90 0x7f2544158650 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7f252c00bc50 tx=0x7f252c00b4f0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 -- 172.21.15.33:0/449364327 shutdown_connections 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 --2- 172.21.15.33:0/449364327 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2544150c90 0x7f2544158650 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 -- 172.21.15.33:0/449364327 >> 172.21.15.33:0/449364327 conn(0x7f25440cded0 msgr2=0x7f254406add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 -- 172.21.15.33:0/449364327 shutdown_connections 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.118+0000 7f254abd0700 1 -- 172.21.15.33:0/449364327 wait complete. 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.119+0000 7f254abd0700 1 Processor -- start 2023-10-09T15:38:11.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.119+0000 7f254abd0700 1 -- start start 2023-10-09T15:38:11.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 0x7f2544156820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2544150c90 0x7f2544151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544156d60 con 0x7f254415a7d0 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2544152050 con 0x7f2544150c90 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254abd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2544152260 con 0x7f25441508c0 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50886/0 (socket says 172.21.15.33:50886) 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 -- 172.21.15.33:0/1233898202 learned_addr learned my addr 172.21.15.33:0/1233898202 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254896c700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 0x7f2544156820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f2543fff700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2544150c90 0x7f2544151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 -- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 msgr2=0x7f2544156820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 0x7f2544156820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 -- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2544150c90 msgr2=0x7f2544151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2544150c90 0x7f2544151b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254916d700 1 -- 172.21.15.33:0/1233898202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f252c00b790 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.120+0000 7f254896c700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 0x7f2544156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f254916d700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f254406f240 tx=0x7f252c01b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c01ae50 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252c010b00 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2544152540 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252c010ea0 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.121+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2544152b80 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.122+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f254404c3c0 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.122+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f252c022030 con 0x7f254415a7d0 2023-10-09T15:38:11.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.122+0000 7f2540ff9700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 0x7f25240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.123+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f252c014070 con 0x7f254415a7d0 2023-10-09T15:38:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.123+0000 7f254896c700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 0x7f25240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.123+0000 7f254896c700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 0x7f25240697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f253c007fd0 tx=0x7f253c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.127+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f252c055f80 con 0x7f254415a7d0 2023-10-09T15:38:11.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.322+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2544159520 con 0x7f254415a7d0 2023-10-09T15:38:11.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.323+0000 7f2540ff9700 1 -- 172.21.15.33:0/1233898202 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f252c0595a0 con 0x7f254415a7d0 2023-10-09T15:38:11.323 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:11.323 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":128,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:08.575063+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.59:6833/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.33:6837/1473081413":"2023-10-10T15:38:02.148196+0000","172.21.15.33:6835/1473081413":"2023-10-10T15:38:02.148196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:11.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 msgr2=0x7f25240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 0x7f25240697d0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f253c007fd0 tx=0x7f253c009040 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 msgr2=0x7f254414df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7f254406f240 tx=0x7f252c01b000 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 shutdown_connections 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2524067320 0x7f25240697d0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f254415a7d0 0x7f254414df40 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25441508c0 0x7f2544156820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 --2- 172.21.15.33:0/1233898202 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2544150c90 0x7f2544151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 >> 172.21.15.33:0/1233898202 conn(0x7f25440cded0 msgr2=0x7f254414fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:11.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.325+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 shutdown_connections 2023-10-09T15:38:11.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.326+0000 7f254abd0700 1 -- 172.21.15.33:0/1233898202 wait complete. 2023-10-09T15:38:11.338 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:38:11.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.456+0000 7fd844a33700 1 Processor -- start 2023-10-09T15:38:11.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.456+0000 7fd844a33700 1 -- start start 2023-10-09T15:38:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd844a33700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd840159850 0x7fd8400adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd844a33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd840159c20 0x7fd8400ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd844a33700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8400adb20 con 0x7fd8400b0930 2023-10-09T15:38:11.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd844a33700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8400ccdc0 con 0x7fd840159850 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd844a33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8400acf10 con 0x7fd840159c20 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.457+0000 7fd83e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd840159850 0x7fd8400adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd840159850 0x7fd8400adfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50890/0 (socket says 172.21.15.33:50890) 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83ed9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd8400b0930 0x7fd8400c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59016/0 (socket says 172.21.15.33:59016) 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 -- 172.21.15.33:0/2974601392 learned_addr learned my addr 172.21.15.33:0/2974601392 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83dd9b700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd840159c20 0x7fd8400ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 -- 172.21.15.33:0/2974601392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd840159c20 msgr2=0x7fd8400ae4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd840159c20 0x7fd8400ae4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 -- 172.21.15.33:0/2974601392 >> v1:172.21.15.33:6789/0 conn(0x7fd8400b0930 legacy=0x7fd8400c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 -- 172.21.15.33:0/2974601392 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8400ad1f0 con 0x7fd840159850 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83e59c700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159850 0x7fd8400adfb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd8380099b0 tx=0x7fd838009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eddd3a6ef7011c6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83d59a700 1 -- 172.21.15.33:0/2974601392 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800b860 con 0x7fd840159850 2023-10-09T15:38:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83d59a700 1 -- 172.21.15.33:0/2974601392 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83800b9c0 con 0x7fd840159850 2023-10-09T15:38:11.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.458+0000 7fd83d59a700 1 -- 172.21.15.33:0/2974601392 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83800bd60 con 0x7fd840159850 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 -- 172.21.15.33:0/2974601392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159850 msgr2=0x7fd8400adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159850 0x7fd8400adfb0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7fd8380099b0 tx=0x7fd838009250 comp rx=0 tx=0).stop 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 -- 172.21.15.33:0/2974601392 shutdown_connections 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159850 0x7fd8400adfb0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 --2- 172.21.15.33:0/2974601392 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd840159c20 0x7fd8400ae4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 -- 172.21.15.33:0/2974601392 >> 172.21.15.33:0/2974601392 conn(0x7fd84006d170 msgr2=0x7fd8400cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:11.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 -- 172.21.15.33:0/2974601392 shutdown_connections 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.459+0000 7fd844a33700 1 -- 172.21.15.33:0/2974601392 wait complete. 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.460+0000 7fd844a33700 1 Processor -- start 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.460+0000 7fd844a33700 1 -- start start 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8400b0930 0x7fd84014be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 0x7fd84006b260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd84014d660 con 0x7fd840159c20 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd840155df0 con 0x7fd840159850 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd844a33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd840147bf0 con 0x7fd8400b0930 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50892/0 (socket says 172.21.15.33:50892) 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 -- 172.21.15.33:0/1964339972 learned_addr learned my addr 172.21.15.33:0/1964339972 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83e59c700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8400b0930 0x7fd84014be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83dd9b700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 0x7fd84006b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 -- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8400b0930 msgr2=0x7fd84014be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8400b0930 0x7fd84014be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 -- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 msgr2=0x7fd84006b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 0x7fd84006b260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 -- 172.21.15.33:0/1964339972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8380094f0 con 0x7fd840159c20 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83dd9b700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 0x7fd84006b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd83ed9d700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd83000cc70 tx=0x7fd830001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd830005df0 con 0x7fd840159c20 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.461+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd83000a660 con 0x7fd840159c20 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.462+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd84014d7f0 con 0x7fd840159c20 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.462+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd83000a9e0 con 0x7fd840159c20 2023-10-09T15:38:11.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.462+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd840148400 con 0x7fd840159c20 2023-10-09T15:38:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.463+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd84004c3c0 con 0x7fd840159c20 2023-10-09T15:38:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.463+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd8300070f0 con 0x7fd840159c20 2023-10-09T15:38:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.463+0000 7fd8367fc700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 0x7fd8200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.463+0000 7fd83e59c700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 0x7fd8200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.463+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7fd830084da0 con 0x7fd840159c20 2023-10-09T15:38:11.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.464+0000 7fd83e59c700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 0x7fd8200697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8380099b0 tx=0x7fd838017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.468+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd830051ab0 con 0x7fd840159c20 2023-10-09T15:38:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.710+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd840159630 con 0x7fd840159c20 2023-10-09T15:38:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.710+0000 7fd8367fc700 1 -- 172.21.15.33:0/1964339972 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7fd8300550d0 con 0x7fd840159c20 2023-10-09T15:38:11.711 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:11.711 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4218052350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4218052350},{"type":"v1","addr":"172.21.15.59:6835","nonce":4218052350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3967750705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3967750705},{"type":"v1","addr":"172.21.15.33:6837","nonce":3967750705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 msgr2=0x7fd8200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 0x7fd8200697d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fd8380099b0 tx=0x7fd838017000 comp rx=0 tx=0).stop 2023-10-09T15:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 msgr2=0x7fd840146980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7fd83000cc70 tx=0x7fd830001a70 comp rx=0 tx=0).stop 2023-10-09T15:38:11.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 shutdown_connections 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd820067320 0x7fd8200697d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd840159c20 0x7fd840146980 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8400b0930 0x7fd84014be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 --2- 172.21.15.33:0/1964339972 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd840159850 0x7fd84006b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 >> 172.21.15.33:0/1964339972 conn(0x7fd84006d170 msgr2=0x7fd840069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 shutdown_connections 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.713+0000 7fd844a33700 1 -- 172.21.15.33:0/1964339972 wait complete. 2023-10-09T15:38:11.714 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 85 2023-10-09T15:38:11.725 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.844+0000 7f687f59e700 1 Processor -- start 2023-10-09T15:38:11.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.844+0000 7f687f59e700 1 -- start start 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.844+0000 7f687f59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 0x7f68800aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.844+0000 7f687f59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68801579a0 0x7f68800c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687f59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68800c3d00 con 0x7f68800caa00 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687f59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800c3110 con 0x7f68801579a0 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687f59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68800c33d0 con 0x7f68800c95c0 2023-10-09T15:38:11.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68801579a0 0x7f68800c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f68801579a0 0x7f68800c9990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50902/0 (socket says 172.21.15.33:50902) 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 -- 172.21.15.33:0/1576342043 learned_addr learned my addr 172.21.15.33:0/1576342043 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687e59c700 1 --2- 172.21.15.33:0/1576342043 >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 0x7f68800aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 -- 172.21.15.33:0/1576342043 >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 msgr2=0x7f68800aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 --2- 172.21.15.33:0/1576342043 >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 0x7f68800aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 -- 172.21.15.33:0/1576342043 >> v1:172.21.15.33:6789/0 conn(0x7f68800caa00 legacy=0x7f6880157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 -- 172.21.15.33:0/1576342043 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68800c36b0 con 0x7f68801579a0 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687e59c700 1 --2- 172.21.15.33:0/1576342043 >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 0x7f68800aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687ed9d700 1 --2- 172.21.15.33:0/1576342043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68801579a0 0x7f68800c9990 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f688006fa50 tx=0x7f6870009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fcfe01311c3715 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687d59a700 1 -- 172.21.15.33:0/1576342043 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f687000e070 con 0x7f68801579a0 2023-10-09T15:38:11.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687d59a700 1 -- 172.21.15.33:0/1576342043 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f687000ba50 con 0x7f68801579a0 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.845+0000 7f687d59a700 1 -- 172.21.15.33:0/1576342043 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68700092e0 con 0x7f68801579a0 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 -- 172.21.15.33:0/1576342043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68801579a0 msgr2=0x7f68800c9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 --2- 172.21.15.33:0/1576342043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68801579a0 0x7f68800c9990 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f688006fa50 tx=0x7f6870009840 comp rx=0 tx=0).stop 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 -- 172.21.15.33:0/1576342043 shutdown_connections 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 --2- 172.21.15.33:0/1576342043 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68801579a0 0x7f68800c9990 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 --2- 172.21.15.33:0/1576342043 >> v2:172.21.15.59:3300/0 conn(0x7f68800c95c0 0x7f68800aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 -- 172.21.15.33:0/1576342043 >> 172.21.15.33:0/1576342043 conn(0x7f6880088000 msgr2=0x7f68800ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 -- 172.21.15.33:0/1576342043 shutdown_connections 2023-10-09T15:38:11.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.846+0000 7f687f59e700 1 -- 172.21.15.33:0/1576342043 wait complete. 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.847+0000 7f687f59e700 1 Processor -- start 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.847+0000 7f687f59e700 1 -- start start 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 0x7f688006e6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68800ae360 0x7f6880151ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688006ec20 con 0x7f68800c95c0 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688006ee60 con 0x7f68801579a0 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687f59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68800ab9f0 con 0x7f68800ae360 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50914/0 (socket says 172.21.15.33:50914) 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 -- 172.21.15.33:0/3724893509 learned_addr learned my addr 172.21.15.33:0/3724893509 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687ed9d700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68800ae360 0x7f6880151ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687dd9b700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 0x7f688006e6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 -- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68800ae360 msgr2=0x7f6880151ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68800ae360 0x7f6880151ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 -- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 msgr2=0x7f688006e6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 0x7f688006e6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:11.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 -- 172.21.15.33:0/3724893509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6870009ae0 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687dd9b700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 0x7f688006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.848+0000 7f687e59c700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f687800c830 tx=0x7f6878008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.849+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878005a00 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.849+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6878005b60 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.849+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f68800abcd0 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.849+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6878011600 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.849+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68800ac290 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.850+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f68800ac4b0 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.850+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6878011970 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.850+0000 7f68767fc700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 0x7f68600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.850+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f6878084c80 con 0x7f68800c95c0 2023-10-09T15:38:11.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.850+0000 7f687dd9b700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 0x7f68600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:11.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.851+0000 7f687dd9b700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 0x7f68600697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6868007fd0 tx=0x7f6868009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:11.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:11.855+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6878051750 con 0x7f68800c95c0 2023-10-09T15:38:12.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.092+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f688004c3c0 con 0x7f68800c95c0 2023-10-09T15:38:12.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.093+0000 7f68767fc700 1 -- 172.21.15.33:0/3724893509 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) v1 ==== 94+0+4599 (secure 0 0 0) 0x7f6878054d70 con 0x7f68800c95c0 2023-10-09T15:38:12.093 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:12.093 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":85,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4218052350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4218052350},{"type":"v1","addr":"172.21.15.59:6835","nonce":4218052350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3967750705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3967750705},{"type":"v1","addr":"172.21.15.33:6837","nonce":3967750705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83}],"filesystems":[{"mdsmap":{"epoch":75,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:37:44.681850+0000","modified":"2023-10-09T15:37:48.296249+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7164},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7164":{"gid":7164,"name":"c","rank":0,"incarnation":72,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/1579213165","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1579213165},{"type":"v1","addr":"172.21.15.33:6836","nonce":1579213165}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":9}]} 2023-10-09T15:38:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 msgr2=0x7f68600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 0x7f68600697d0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f6868007fd0 tx=0x7f6868009040 comp rx=0 tx=0).stop 2023-10-09T15:38:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 msgr2=0x7f68800b1e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f687800c830 tx=0x7f6878008040 comp rx=0 tx=0).stop 2023-10-09T15:38:12.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 shutdown_connections 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6860067320 0x7f68600697d0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f68800c95c0 0x7f68800b1e00 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f68800ae360 0x7f6880151ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 --2- 172.21.15.33:0/3724893509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f68801579a0 0x7f688006e6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 >> 172.21.15.33:0/3724893509 conn(0x7f6880088000 msgr2=0x7f6880152f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 shutdown_connections 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.095+0000 7f687f59e700 1 -- 172.21.15.33:0/3724893509 wait complete. 2023-10-09T15:38:12.096 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 85 2023-10-09T15:38:12.107 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:12.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.226+0000 7f75f81bf700 1 Processor -- start 2023-10-09T15:38:12.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.226+0000 7f75f81bf700 1 -- start start 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f81bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75f00cb5a0 0x7f75f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f81bf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f015ae40 con 0x7f75f00cd9e0 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f81bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75f015ab60 con 0x7f75f015a5d0 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f81bf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75f00d13f0 con 0x7f75f00cb5a0 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f5f5b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75f00cb5a0 0x7f75f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f5f5b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f75f00cb5a0 0x7f75f00cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50922/0 (socket says 172.21.15.33:50922) 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f5f5b700 1 -- 172.21.15.33:0/4121032023 learned_addr learned my addr 172.21.15.33:0/4121032023 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.227+0000 7f75f575a700 1 --1- 172.21.15.33:0/4121032023 >> v1:172.21.15.33:6789/0 conn(0x7f75f00cd9e0 0x7f75f0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59042/0 (socket says 172.21.15.33:59042) 2023-10-09T15:38:12.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f5f5b700 1 -- 172.21.15.33:0/4121032023 >> v1:172.21.15.59:6789/0 conn(0x7f75f015a5d0 legacy=0x7f75f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f5f5b700 1 -- 172.21.15.33:0/4121032023 >> v1:172.21.15.33:6789/0 conn(0x7f75f00cd9e0 legacy=0x7f75f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f5f5b700 1 -- 172.21.15.33:0/4121032023 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75f00ccf00 con 0x7f75f00cb5a0 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f5f5b700 1 --2- 172.21.15.33:0/4121032023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cb5a0 0x7f75f00cb970 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f75e80099e0 tx=0x7f75e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a8db3368fd0f1c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f4f59700 1 -- 172.21.15.33:0/4121032023 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800b7e0 con 0x7f75f00cb5a0 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f4f59700 1 -- 172.21.15.33:0/4121032023 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e800b940 con 0x7f75f00cb5a0 2023-10-09T15:38:12.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f4f59700 1 -- 172.21.15.33:0/4121032023 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e800bce0 con 0x7f75f00cb5a0 2023-10-09T15:38:12.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f81bf700 1 -- 172.21.15.33:0/4121032023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cb5a0 msgr2=0x7f75f00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f81bf700 1 --2- 172.21.15.33:0/4121032023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cb5a0 0x7f75f00cb970 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f75e80099e0 tx=0x7f75e8009250 comp rx=0 tx=0).stop 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f81bf700 1 -- 172.21.15.33:0/4121032023 shutdown_connections 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f81bf700 1 --2- 172.21.15.33:0/4121032023 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cb5a0 0x7f75f00cb970 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.228+0000 7f75f81bf700 1 -- 172.21.15.33:0/4121032023 >> 172.21.15.33:0/4121032023 conn(0x7f75f0070e30 msgr2=0x7f75f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.229+0000 7f75f81bf700 1 -- 172.21.15.33:0/4121032023 shutdown_connections 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.229+0000 7f75f81bf700 1 -- 172.21.15.33:0/4121032023 wait complete. 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 Processor -- start 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 -- start start 2023-10-09T15:38:12.232 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f00cb5a0 0x7f75f01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f015a5d0 0x7f75f00b50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f0157070 con 0x7f75f00cd9e0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00c9f60 con 0x7f75f00cb5a0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f81bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75f00ca240 con 0x7f75f015a5d0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f575a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f575a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50926/0 (socket says 172.21.15.33:50926) 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.230+0000 7f75f575a700 1 -- 172.21.15.33:0/532895096 learned_addr learned my addr 172.21.15.33:0/532895096 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f5f5b700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f00cb5a0 0x7f75f01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f675c700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f015a5d0 0x7f75f00b50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 -- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f015a5d0 msgr2=0x7f75f00b50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.233 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f015a5d0 0x7f75f00b50f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 -- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f00cb5a0 msgr2=0x7f75f01560e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f00cb5a0 0x7f75f01560e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 -- 172.21.15.33:0/532895096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75e80094f0 con 0x7f75f00cd9e0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f575a700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c7c0 tx=0x7f75e4007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e4005a70 con 0x7f75f00cd9e0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75e4005bd0 con 0x7f75f00cd9e0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75e40070d0 con 0x7f75f00cd9e0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75f00ca520 con 0x7f75f00cd9e0 2023-10-09T15:38:12.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.231+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75f0156620 con 0x7f75f00cd9e0 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.232+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75f004c3c0 con 0x7f75f00cd9e0 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.233+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f75e4007480 con 0x7f75f00cd9e0 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.233+0000 7f75edffb700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 0x7f75dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.233+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f75e4084130 con 0x7f75f00cd9e0 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.233+0000 7f75f5f5b700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 0x7f75dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.234+0000 7f75f5f5b700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 0x7f75dc0697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75e80099e0 tx=0x7f75e8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.237+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f75e4050d10 con 0x7f75f00cd9e0 2023-10-09T15:38:12.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.435+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75f01571b0 con 0x7f75f00cd9e0 2023-10-09T15:38:12.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.436+0000 7f75edffb700 1 -- 172.21.15.33:0/532895096 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) v1 ==== 74+0+15575 (secure 0 0 0) 0x7f75e4054330 con 0x7f75f00cd9e0 2023-10-09T15:38:12.436 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:12.436 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":128,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:08.575063+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:37:42.614953+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"112","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-10-09T15:37:43.656847+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"113","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.59:6835/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.59:6833/2568149060":"2023-10-10T15:38:05.570187+0000","172.21.15.33:6837/1473081413":"2023-10-10T15:38:02.148196+0000","172.21.15.33:6835/1473081413":"2023-10-10T15:38:02.148196+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:12.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 msgr2=0x7f75dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 0x7f75dc0697d0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f75e80099e0 tx=0x7f75e8016000 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 msgr2=0x7f75f00b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f75e400c7c0 tx=0x7f75e4007f70 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 shutdown_connections 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f75dc067320 0x7f75dc0697d0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f75f015a5d0 0x7f75f00b50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f75f00cb5a0 0x7f75f01560e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 --2- 172.21.15.33:0/532895096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f75f00cd9e0 0x7f75f00b4bb0 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 >> 172.21.15.33:0/532895096 conn(0x7f75f0070e30 msgr2=0x7f75f00b2720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 shutdown_connections 2023-10-09T15:38:12.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.438+0000 7f75f81bf700 1 -- 172.21.15.33:0/532895096 wait complete. 2023-10-09T15:38:12.450 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:38:12.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.570+0000 7f2996f37700 1 Processor -- start 2023-10-09T15:38:12.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.570+0000 7f2996f37700 1 -- start start 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f2996f37700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29900cb970 0x7f2990159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f2996f37700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299015ae40 con 0x7f299015a400 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f2996f37700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f299015ab60 con 0x7f29900cb5a0 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f2996f37700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29900ce0f0 con 0x7f29900cb970 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f298ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29900cb970 0x7f2990159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f298ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f29900cb970 0x7f2990159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50930/0 (socket says 172.21.15.33:50930) 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.571+0000 7f298ffff700 1 -- 172.21.15.33:0/1856167997 learned_addr learned my addr 172.21.15.33:0/1856167997 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298ffff700 1 -- 172.21.15.33:0/1856167997 >> v1:172.21.15.59:6789/0 conn(0x7f29900cb5a0 legacy=0x7f29900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:12.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298ffff700 1 -- 172.21.15.33:0/1856167997 >> v1:172.21.15.33:6789/0 conn(0x7f299015a400 legacy=0x7f2990156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298ffff700 1 -- 172.21.15.33:0/1856167997 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29900ccf00 con 0x7f29900cb970 2023-10-09T15:38:12.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298ffff700 1 --2- 172.21.15.33:0/1856167997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f2990159ec0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29800099b0 tx=0x7f2980009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ce2e9111705d1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298f7fe700 1 -- 172.21.15.33:0/1856167997 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000b820 con 0x7f29900cb970 2023-10-09T15:38:12.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298f7fe700 1 -- 172.21.15.33:0/1856167997 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298000b980 con 0x7f29900cb970 2023-10-09T15:38:12.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f298f7fe700 1 -- 172.21.15.33:0/1856167997 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298000bd20 con 0x7f29900cb970 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 -- 172.21.15.33:0/1856167997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 msgr2=0x7f2990159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 --2- 172.21.15.33:0/1856167997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f2990159ec0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f29800099b0 tx=0x7f2980009250 comp rx=0 tx=0).stop 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 -- 172.21.15.33:0/1856167997 shutdown_connections 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 --2- 172.21.15.33:0/1856167997 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f2990159ec0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 -- 172.21.15.33:0/1856167997 >> 172.21.15.33:0/1856167997 conn(0x7f2990070e30 msgr2=0x7f29900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 -- 172.21.15.33:0/1856167997 shutdown_connections 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.572+0000 7f2996f37700 1 -- 172.21.15.33:0/1856167997 wait complete. 2023-10-09T15:38:12.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.573+0000 7f2996f37700 1 Processor -- start 2023-10-09T15:38:12.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 -- start start 2023-10-09T15:38:12.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29900cb5a0 0x7f2990151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 0x7f29900b4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29900b4860 con 0x7f29900cb970 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2990159800 con 0x7f29900cb5a0 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.574+0000 7f2996f37700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2990151bc0 con 0x7f299015a400 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50944/0 (socket says 172.21.15.33:50944) 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 -- 172.21.15.33:0/1858091439 learned_addr learned my addr 172.21.15.33:0/1858091439 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f2994cd3700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29900cb5a0 0x7f2990151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f29954d4700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 0x7f29900b4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 -- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 msgr2=0x7f29900b4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 0x7f29900b4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 -- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29900cb5a0 msgr2=0x7f2990151680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29900cb5a0 0x7f2990151680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 -- 172.21.15.33:0/1858091439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29800094f0 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f29954d4700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 0x7f29900b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298ffff700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f298000c010 tx=0x7f2980016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298001b470 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f298001b5d0 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29900b42a0 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f298001b970 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.575+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2990156de0 con 0x7f29900cb970 2023-10-09T15:38:12.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.576+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2990156c40 con 0x7f29900cb970 2023-10-09T15:38:12.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.577+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f298001bce0 con 0x7f29900cb970 2023-10-09T15:38:12.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.577+0000 7f298cff9700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 0x7f29700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.577+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 5877+0+0 (secure 0 0 0) 0x7f2980086a10 con 0x7f29900cb970 2023-10-09T15:38:12.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.577+0000 7f2994cd3700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 0x7f29700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.578+0000 7f2994cd3700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 0x7f29700697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f299015de30 tx=0x7f2988009760 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.581+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2990156c40 con 0x7f29900cb970 2023-10-09T15:38:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.822+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2990156c40 con 0x7f29900cb970 2023-10-09T15:38:12.822 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:38:12.823+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:38:12.827 INFO:tasks.ceph.mds.c.smithi033.stderr: -1430> 2023-10-09T15:37:50.131+0000 7fdbbbed2700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:12.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.832+0000 7f298cff9700 1 -- 172.21.15.33:0/1858091439 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2990156c40 con 0x7f29900cb970 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 msgr2=0x7f29700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 0x7f29700697d0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f299015de30 tx=0x7f2988009760 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 msgr2=0x7f29901589f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f298000c010 tx=0x7f2980016000 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 shutdown_connections 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2970067320 0x7f29700697d0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f299015a400 0x7f29900b4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f29900cb5a0 0x7f2990151680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 --2- 172.21.15.33:0/1858091439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f29900cb970 0x7f29901589f0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 >> 172.21.15.33:0/1858091439 conn(0x7f2990070e30 msgr2=0x7f29900b1b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 shutdown_connections 2023-10-09T15:38:12.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.834+0000 7f2996f37700 1 -- 172.21.15.33:0/1858091439 wait complete. 2023-10-09T15:38:12.836 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:38:12.847 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:38:12.850 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:38:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.968+0000 7fd3cbd21700 1 Processor -- start 2023-10-09T15:38:12.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.968+0000 7fd3cbd21700 1 -- start start 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3cbd21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c4159530 0x7fd3c40ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3cbd21700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3cbd21700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3c40ccfd0 con 0x7fd3c406dc70 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3cbd21700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3c40cf0e0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3cbd21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c415a3d0 con 0x7fd3c4159530 2023-10-09T15:38:12.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3ca2be700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3ca2be700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50966/0 (socket says 172.21.15.33:50966) 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3ca2be700 1 -- 172.21.15.33:0/3825094441 learned_addr learned my addr 172.21.15.33:0/3825094441 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.969+0000 7fd3c9abd700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c4159530 0x7fd3c40ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3ca2be700 1 -- 172.21.15.33:0/3825094441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c4159530 msgr2=0x7fd3c40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3ca2be700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c4159530 0x7fd3c40ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3ca2be700 1 -- 172.21.15.33:0/3825094441 >> v1:172.21.15.59:6789/0 conn(0x7fd3c406dc70 legacy=0x7fd3c4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3ca2be700 1 -- 172.21.15.33:0/3825094441 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3c415a6b0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3ca2be700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40099b0 tx=0x7fd3b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f94c07a3f81458 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3c8abb700 1 -- 172.21.15.33:0/3825094441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400b860 con 0x7fd3c406e0e0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3c8abb700 1 -- 172.21.15.33:0/3825094441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b400b9c0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3c8abb700 1 -- 172.21.15.33:0/3825094441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b400bd60 con 0x7fd3c406e0e0 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3cbd21700 1 -- 172.21.15.33:0/3825094441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 msgr2=0x7fd3c40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fd3b40099b0 tx=0x7fd3b4009250 comp rx=0 tx=0).stop 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3cbd21700 1 -- 172.21.15.33:0/3825094441 shutdown_connections 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.970+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c40cb6f0 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.971+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/3825094441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c4159530 0x7fd3c40ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.971+0000 7fd3cbd21700 1 -- 172.21.15.33:0/3825094441 >> 172.21.15.33:0/3825094441 conn(0x7fd3c40703a0 msgr2=0x7fd3c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.971+0000 7fd3cbd21700 1 -- 172.21.15.33:0/3825094441 shutdown_connections 2023-10-09T15:38:12.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.971+0000 7fd3cbd21700 1 -- 172.21.15.33:0/3825094441 wait complete. 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 Processor -- start 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 -- start start 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c406dc70 0x7fd3c4169690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c4159530 0x7fd3c4151cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c4143a00 con 0x7fd3c406e0e0 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c414eed0 con 0x7fd3c4159530 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.972+0000 7fd3cbd21700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3c40c81f0 con 0x7fd3c406dc70 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50970/0 (socket says 172.21.15.33:50970) 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c9abd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c406dc70 0x7fd3c4169690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 -- 172.21.15.33:0/443620672 learned_addr learned my addr 172.21.15.33:0/443620672 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3ca2be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c4159530 0x7fd3c4151cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 -- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c406dc70 msgr2=0x7fd3c4169690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c406dc70 0x7fd3c4169690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 -- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c4159530 msgr2=0x7fd3c4151cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c4159530 0x7fd3c4151cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 -- 172.21.15.33:0/443620672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3b40094f0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c92bc700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c5c0 tx=0x7fd3b800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8011590 con 0x7fd3c406e0e0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3b8011710 con 0x7fd3c406e0e0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3b8011ad0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3c40c78c0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.973+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3c40c7e80 con 0x7fd3c406e0e0 2023-10-09T15:38:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.974+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3c404c3c0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.975+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd3b801b3b0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.975+0000 7fd3c1ffb700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 0x7fd3b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.975+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5963+0+0 (secure 0 0 0) 0x7fd3b80841f0 con 0x7fd3c406e0e0 2023-10-09T15:38:12.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.975+0000 7fd3c9abd700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 0x7fd3b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:12.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.975+0000 7fd3c9abd700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 0x7fd3b00697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0075a0 tx=0x7fd3bc0097b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:12.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:12.979+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd3b8050d80 con 0x7fd3c406e0e0 2023-10-09T15:38:13.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.216+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd3c40c8330 con 0x7fd3c406e0e0 2023-10-09T15:38:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.830+0000 7fd3c1ffb700 1 -- 172.21.15.33:0/443620672 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd3b80543a0 con 0x7fd3c406e0e0 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 msgr2=0x7fd3b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 0x7fd3b00697d0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fd3bc0075a0 tx=0x7fd3bc0097b0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 msgr2=0x7fd3c414e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fd3b800c5c0 tx=0x7fd3b800c8d0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 shutdown_connections 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd3b0067320 0x7fd3b00697d0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd3c4159530 0x7fd3c4151cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd3c406dc70 0x7fd3c4169690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.832+0000 7fd3cbd21700 1 --2- 172.21.15.33:0/443620672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd3c406e0e0 0x7fd3c414e580 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.833+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 >> 172.21.15.33:0/443620672 conn(0x7fd3c40703a0 msgr2=0x7fd3c40b0870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.833+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 shutdown_connections 2023-10-09T15:38:13.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:13.833+0000 7fd3cbd21700 1 -- 172.21.15.33:0/443620672 wait complete. 2023-10-09T15:38:13.846 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:38:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.012+0000 7f8e95c3c700 1 Processor -- start 2023-10-09T15:38:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.012+0000 7f8e95c3c700 1 -- start start 2023-10-09T15:38:14.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e95c3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 0x7f8e900c6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e95c3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e95c3c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e9006a550 con 0x7f8e90156fa0 2023-10-09T15:38:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e95c3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e900c75f0 con 0x7f8e9006e330 2023-10-09T15:38:14.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e95c3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900c78d0 con 0x7f8e900cba80 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 0x7f8e900c6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58308/0 (socket says 172.21.15.33:58308) 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8f7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 0x7f8e900c6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53496/0 (socket says 172.21.15.33:53496) 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 -- 172.21.15.33:0/278429393 learned_addr learned my addr 172.21.15.33:0/278429393 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8effd700 1 --1- 172.21.15.33:0/278429393 >> v1:172.21.15.59:6789/0 conn(0x7f8e90156fa0 0x7f8e900cb370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:46852/0 (socket says 172.21.15.33:46852) 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 -- 172.21.15.33:0/278429393 >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 msgr2=0x7f8e900c6dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 --2- 172.21.15.33:0/278429393 >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 0x7f8e900c6dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 -- 172.21.15.33:0/278429393 >> v1:172.21.15.59:6789/0 conn(0x7f8e90156fa0 legacy=0x7f8e900cb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.013+0000 7f8e8ffff700 1 -- 172.21.15.33:0/278429393 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e900c7bb0 con 0x7f8e900cba80 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e8ffff700 1 --2- 172.21.15.33:0/278429393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800d1a0 tx=0x7f8e8800ba50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=742df9139bc0b98d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e8e7fc700 1 -- 172.21.15.33:0/278429393 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88010070 con 0x7f8e900cba80 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e8e7fc700 1 -- 172.21.15.33:0/278429393 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8800de10 con 0x7f8e900cba80 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e8e7fc700 1 -- 172.21.15.33:0/278429393 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800b320 con 0x7f8e900cba80 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 -- 172.21.15.33:0/278429393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 msgr2=0x7f8e9006aa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/278429393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800d1a0 tx=0x7f8e8800ba50 comp rx=0 tx=0).stop 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 -- 172.21.15.33:0/278429393 shutdown_connections 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/278429393 >> v2:172.21.15.59:3300/0 conn(0x7f8e9006e330 0x7f8e900c6dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/278429393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9006aa00 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.014+0000 7f8e95c3c700 1 -- 172.21.15.33:0/278429393 >> 172.21.15.33:0/278429393 conn(0x7f8e9006d170 msgr2=0x7f8e900cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.015+0000 7f8e95c3c700 1 -- 172.21.15.33:0/278429393 shutdown_connections 2023-10-09T15:38:14.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.015+0000 7f8e95c3c700 1 -- 172.21.15.33:0/278429393 wait complete. 2023-10-09T15:38:14.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 Processor -- start 2023-10-09T15:38:14.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 -- start start 2023-10-09T15:38:14.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e9006e330 0x7f8e9014a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9014b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900b01f0 con 0x7f8e90156fa0 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9014a6b0 con 0x7f8e9006e330 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.016+0000 7f8e95c3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e900af5e0 con 0x7f8e900cba80 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50984/0 (socket says 172.21.15.33:50984) 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 -- 172.21.15.33:0/1492762890 learned_addr learned my addr 172.21.15.33:0/1492762890 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8effd700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9014b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8f7fe700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e9006e330 0x7f8e9014a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 -- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 msgr2=0x7f8e9014b5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9014b5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 -- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e9006e330 msgr2=0x7f8e9014a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e9006e330 0x7f8e9014a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 -- 172.21.15.33:0/1492762890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8800bcf0 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e8ffff700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c7a10 tx=0x7f8e8801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8800ac00 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8800ad60 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e900af8c0 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88028690 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.017+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e900afe80 con 0x7f8e90156fa0 2023-10-09T15:38:14.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.018+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9004c3c0 con 0x7f8e90156fa0 2023-10-09T15:38:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.019+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8e88003040 con 0x7f8e90156fa0 2023-10-09T15:38:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.019+0000 7f8e777fe700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 0x7f8e7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.019+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(129..129 src has 1..129) v4 ==== 5963+0+0 (secure 0 0 0) 0x7f8e88088ec0 con 0x7f8e90156fa0 2023-10-09T15:38:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.019+0000 7f8e8f7fe700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 0x7f8e7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.020+0000 7f8e8f7fe700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 0x7f8e7c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c6540 tx=0x7f8e800091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.023+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e88055940 con 0x7f8e90156fa0 2023-10-09T15:38:14.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.218+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e900c7300 con 0x7f8e90156fa0 2023-10-09T15:38:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.833+0000 7f8e777fe700 1 -- 172.21.15.33:0/1492762890 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v130) v1 ==== 181+0+0 (secure 0 0 0) 0x7f8e8802d0d0 con 0x7f8e90156fa0 2023-10-09T15:38:14.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 msgr2=0x7f8e7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 0x7f8e7c0697d0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c6540 tx=0x7f8e800091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 msgr2=0x7f8e900c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f8e900c7a10 tx=0x7f8e8801a000 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 shutdown_connections 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e7c067320 0x7f8e7c0697d0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e90156fa0 0x7f8e900c36d0 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e9006e330 0x7f8e9014a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 --2- 172.21.15.33:0/1492762890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e900cba80 0x7f8e9014b5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.836+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 >> 172.21.15.33:0/1492762890 conn(0x7f8e9006d170 msgr2=0x7f8e900c9520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:14.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.837+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 shutdown_connections 2023-10-09T15:38:14.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.837+0000 7f8e95c3c700 1 -- 172.21.15.33:0/1492762890 wait complete. 2023-10-09T15:38:14.838 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:38:14.852 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:38:14.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.982+0000 7f8762bec700 1 Processor -- start 2023-10-09T15:38:14.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.982+0000 7f8762bec700 1 -- start start 2023-10-09T15:38:14.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8762bec700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f875c06d770 0x7f875c159790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8762bec700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875c0ac310 con 0x7f875c1593c0 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8762bec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f875c06a5d0 con 0x7f875c06c6a0 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8762bec700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875c15e200 con 0x7f875c06d770 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8761bea700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f875c1593c0 0x7f875c0c7da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59050/0 (socket says 172.21.15.33:59050) 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8761bea700 1 -- 172.21.15.33:0/1557717867 learned_addr learned my addr 172.21.15.33:0/1557717867 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2966611555 0 0) 0x7f8754001110 con 0x7f875c1593c0 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.983+0000 7f87623eb700 1 --2- 172.21.15.33:0/1557717867 >> v2:172.21.15.59:3300/0 conn(0x7f875c06d770 0x7f875c159790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8744003570 con 0x7f875c1593c0 2023-10-09T15:38:14.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49599241 0 0) 0x7f8744003570 con 0x7f875c1593c0 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 >> v2:172.21.15.59:3300/0 conn(0x7f875c06d770 msgr2=0x7f875c159790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 --2- 172.21.15.33:0/1557717867 >> v2:172.21.15.59:3300/0 conn(0x7f875c06d770 0x7f875c159790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 >> v1:172.21.15.59:6789/0 conn(0x7f875c06c6a0 legacy=0x7f875c06d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c15d960 con 0x7f875c1593c0 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8754001600 con 0x7f875c1593c0 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 >> v1:172.21.15.33:6789/0 conn(0x7f875c1593c0 legacy=0x7f875c0c7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8744003a60 0x7f8744003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8744004810 0x7f8744004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 0x7f874400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c15e200 con 0x7f87440051c0 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f874400c160 con 0x7f8744004810 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f874400c320 con 0x7f8744003a60 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 0x7f874400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87613e9700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8744004810 0x7f8744004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8761bea700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8744003a60 0x7f8744003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 -- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8744003a60 msgr2=0x7f8744003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8744003a60 0x7f8744003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 -- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8744004810 msgr2=0x7f8744004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:14.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8744004810 0x7f8744004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 -- 172.21.15.33:0/1557717867 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8744003570 con 0x7f87440051c0 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f8761bea700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8744003a60 0x7f8744003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.984+0000 7f87623eb700 1 -- 172.21.15.33:0/1557717867 reap_dead start 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f87623eb700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 0x7f874400ba60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f875c06db70 tx=0x7f874c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e11764a00c3d07 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00ea90 con 0x7f87440051c0 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874c00f040 con 0x7f87440051c0 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8760be8700 1 -- 172.21.15.33:0/1557717867 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874c00ee40 con 0x7f87440051c0 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 -- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 msgr2=0x7f874400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 0x7f874400ba60 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f875c06db70 tx=0x7f874c00b040 comp rx=0 tx=0).stop 2023-10-09T15:38:14.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 -- 172.21.15.33:0/1557717867 shutdown_connections 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 --2- 172.21.15.33:0/1557717867 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87440051c0 0x7f874400ba60 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 -- 172.21.15.33:0/1557717867 >> 172.21.15.33:0/1557717867 conn(0x7f875c0cca00 msgr2=0x7f875c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 -- 172.21.15.33:0/1557717867 shutdown_connections 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.985+0000 7f8762bec700 1 -- 172.21.15.33:0/1557717867 wait complete. 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.986+0000 7f8762bec700 1 Processor -- start 2023-10-09T15:38:14.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 -- start start 2023-10-09T15:38:14.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87440051c0 0x7f875c148570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f875c0cba70 0x7f875c0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c148ab0 con 0x7f875c0ad630 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f875c0cc420 con 0x7f875c0cba70 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8762bec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f875c159ba0 con 0x7f87440051c0 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f87613e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f87613e9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51004/0 (socket says 172.21.15.33:51004) 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f87613e9700 1 -- 172.21.15.33:0/3443774284 learned_addr learned my addr 172.21.15.33:0/3443774284 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:14.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f8761bea700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87440051c0 0x7f875c148570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.987+0000 7f87623eb700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f875c0cba70 0x7f875c0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 -- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87440051c0 msgr2=0x7f875c148570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87440051c0 0x7f875c148570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 -- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f875c0cba70 msgr2=0x7f875c0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f875c0cba70 0x7f875c0cbee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 -- 172.21.15.33:0/3443774284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f875c0ae1a0 con 0x7f875c0ad630 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f87613e9700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8750002980 tx=0x7f8750007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750013600 con 0x7f875c0ad630 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750013760 con 0x7f875c0ad630 2023-10-09T15:38:14.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750013b20 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f875c0ae480 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.988+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f875c159830 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.989+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875c04c3c0 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.989+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f875000f400 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.990+0000 7f8759ffb700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 0x7f87480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.990+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(130..130 src has 1..130) v4 ==== 5525+0+0 (secure 0 0 0) 0x7f8750084910 con 0x7f875c0ad630 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.990+0000 7f8761bea700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 0x7f87480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:14.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.990+0000 7f8761bea700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 0x7f87480697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8754001730 tx=0x7f8754007040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:14.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:14.994+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8750051610 con 0x7f875c0ad630 2023-10-09T15:38:15.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.196+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f875c159ce0 con 0x7f875c0ad630 2023-10-09T15:38:15.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.840+0000 7f8759ffb700 1 -- 172.21.15.33:0/3443774284 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v131) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8750054c30 con 0x7f875c0ad630 2023-10-09T15:38:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 msgr2=0x7f87480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 0x7f87480697d0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f8754001730 tx=0x7f8754007040 comp rx=0 tx=0).stop 2023-10-09T15:38:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 msgr2=0x7f875c0adaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f8750002980 tx=0x7f8750007d30 comp rx=0 tx=0).stop 2023-10-09T15:38:15.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 shutdown_connections 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.845+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8748067320 0x7f87480697d0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f875c0cba70 0x7f875c0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87440051c0 0x7f875c148570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 --2- 172.21.15.33:0/3443774284 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f875c0ad630 0x7f875c0adaa0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 >> 172.21.15.33:0/3443774284 conn(0x7f875c0cca00 msgr2=0x7f875c06cbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 shutdown_connections 2023-10-09T15:38:15.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.846+0000 7f8762bec700 1 -- 172.21.15.33:0/3443774284 wait complete. 2023-10-09T15:38:15.848 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:38:15.862 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:38:15.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.989+0000 7f00c604d700 1 Processor -- start 2023-10-09T15:38:15.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 -- start start 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f00c0159860 0x7f00c00ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00c00ccfa0 0x7f00c00cd400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00c00cf510 con 0x7f00c00cbd90 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c00d00b0 con 0x7f00c00ccfa0 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00c604d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00c00cc210 con 0x7f00c0159860 2023-10-09T15:38:15.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.990+0000 7f00bffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00c00ccfa0 0x7f00c00cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f00c00ccfa0 0x7f00c00cd400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51012/0 (socket says 172.21.15.33:51012) 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 -- 172.21.15.33:0/2427232212 learned_addr learned my addr 172.21.15.33:0/2427232212 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bf7fe700 1 --2- 172.21.15.33:0/2427232212 >> v2:172.21.15.59:3300/0 conn(0x7f00c0159860 0x7f00c00ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 -- 172.21.15.33:0/2427232212 >> v2:172.21.15.59:3300/0 conn(0x7f00c0159860 msgr2=0x7f00c00ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 --2- 172.21.15.33:0/2427232212 >> v2:172.21.15.59:3300/0 conn(0x7f00c0159860 0x7f00c00ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 -- 172.21.15.33:0/2427232212 >> v1:172.21.15.59:6789/0 conn(0x7f00c00cbd90 legacy=0x7f00c00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 -- 172.21.15.33:0/2427232212 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00c00ce900 con 0x7f00c00ccfa0 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00bffff700 1 --2- 172.21.15.33:0/2427232212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c00ccfa0 0x7f00c00cd400 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f00c0088e40 tx=0x7f00b8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3686a90fab70c9db server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00be7fc700 1 -- 172.21.15.33:0/2427232212 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b800e070 con 0x7f00c00ccfa0 2023-10-09T15:38:15.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00be7fc700 1 -- 172.21.15.33:0/2427232212 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b800ba10 con 0x7f00c00ccfa0 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.991+0000 7f00be7fc700 1 -- 172.21.15.33:0/2427232212 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b80092e0 con 0x7f00c00ccfa0 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 -- 172.21.15.33:0/2427232212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c00ccfa0 msgr2=0x7f00c00cd400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 --2- 172.21.15.33:0/2427232212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c00ccfa0 0x7f00c00cd400 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f00c0088e40 tx=0x7f00b8009840 comp rx=0 tx=0).stop 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 -- 172.21.15.33:0/2427232212 shutdown_connections 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 --2- 172.21.15.33:0/2427232212 >> v2:172.21.15.59:3300/0 conn(0x7f00c0159860 0x7f00c00ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 --2- 172.21.15.33:0/2427232212 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c00ccfa0 0x7f00c00cd400 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 -- 172.21.15.33:0/2427232212 >> 172.21.15.33:0/2427232212 conn(0x7f00c00999b0 msgr2=0x7f00c0070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 -- 172.21.15.33:0/2427232212 shutdown_connections 2023-10-09T15:38:15.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.992+0000 7f00c604d700 1 -- 172.21.15.33:0/2427232212 wait complete. 2023-10-09T15:38:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.993+0000 7f00c604d700 1 Processor -- start 2023-10-09T15:38:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.993+0000 7f00c604d700 1 -- start start 2023-10-09T15:38:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c00cbd90 0x7f00c015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:15.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00c00ccfa0 0x7f00c015a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c015b650 con 0x7f00c0159860 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00c0169690 con 0x7f00c00cbd90 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00c604d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00c015ab30 con 0x7f00c00ccfa0 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51016/0 (socket says 172.21.15.33:51016) 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 -- 172.21.15.33:0/2746126192 learned_addr learned my addr 172.21.15.33:0/2746126192 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bf7fe700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c00cbd90 0x7f00c015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:15.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00beffd700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00c00ccfa0 0x7f00c015a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 -- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00c00ccfa0 msgr2=0x7f00c015a5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00c00ccfa0 0x7f00c015a5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 -- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c00cbd90 msgr2=0x7f00c015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c00cbd90 0x7f00c015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 -- 172.21.15.33:0/2746126192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00b8009ae0 con 0x7f00c0159860 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.994+0000 7f00bffff700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009fd0 tx=0x7f00b8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.995+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b8012e90 con 0x7f00c0159860 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.995+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00b80092e0 con 0x7f00c0159860 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.995+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00c015adb0 con 0x7f00c0159860 2023-10-09T15:38:15.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.995+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00b801e640 con 0x7f00c0159860 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.995+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00c015b370 con 0x7f00c0159860 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.996+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00c004c3c0 con 0x7f00c0159860 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.996+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f00b801ea70 con 0x7f00c0159860 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.996+0000 7f00a77fe700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 0x7f00ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.997+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f00b8086820 con 0x7f00c0159860 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.997+0000 7f00bf7fe700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 0x7f00ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:15.997+0000 7f00bf7fe700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 0x7f00ac0697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00b000aa40 tx=0x7f00b0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.001+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f00b80535f0 con 0x7f00c0159860 2023-10-09T15:38:16.196 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.196+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f00c00cebe0 con 0x7f00c0159860 2023-10-09T15:38:16.199 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.200+0000 7f00a77fe700 1 -- 172.21.15.33:0/2746126192 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v23) v1 ==== 104+0+0 (secure 0 0 0) 0x7f00b8056c10 con 0x7f00c0159860 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 msgr2=0x7f00ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 0x7f00ac0697d0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f00b000aa40 tx=0x7f00b0008040 comp rx=0 tx=0).stop 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 msgr2=0x7f00c0157c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f00b8009fd0 tx=0x7f00b8017000 comp rx=0 tx=0).stop 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 shutdown_connections 2023-10-09T15:38:16.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f00ac067320 0x7f00ac0697d0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f00c0159860 0x7f00c0157c70 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f00c00cbd90 0x7f00c015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 --2- 172.21.15.33:0/2746126192 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f00c00ccfa0 0x7f00c015a5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 >> 172.21.15.33:0/2746126192 conn(0x7f00c00999b0 msgr2=0x7f00c00b34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 shutdown_connections 2023-10-09T15:38:16.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.202+0000 7f00c604d700 1 -- 172.21.15.33:0/2746126192 wait complete. 2023-10-09T15:38:16.214 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls' 2023-10-09T15:38:16.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.334+0000 7ffb6f87f700 1 Processor -- start 2023-10-09T15:38:16.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.334+0000 7ffb6f87f700 1 -- start start 2023-10-09T15:38:16.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6f87f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb68159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6f87f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb6815a400 0x7ffb68156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6f87f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb6815ae40 con 0x7ffb680cb5a0 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6f87f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb680ce0f0 con 0x7ffb6815a400 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6f87f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680cbde0 con 0x7ffb680cb970 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb6815a400 0x7ffb68156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffb6815a400 0x7ffb68156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51028/0 (socket says 172.21.15.33:51028) 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 -- 172.21.15.33:0/2688896495 learned_addr learned my addr 172.21.15.33:0/2688896495 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6ce1a700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb68159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 -- 172.21.15.33:0/2688896495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 msgr2=0x7ffb68159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb68159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 -- 172.21.15.33:0/2688896495 >> v1:172.21.15.59:6789/0 conn(0x7ffb680cb5a0 legacy=0x7ffb680cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:16.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 -- 172.21.15.33:0/2688896495 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb6815ab60 con 0x7ffb6815a400 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.335+0000 7ffb6de1c700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb68156e90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009f50 tx=0x7ffb58009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd3fda09610bb927 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb67fff700 1 -- 172.21.15.33:0/2688896495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5800e070 con 0x7ffb6815a400 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb67fff700 1 -- 172.21.15.33:0/2688896495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb5800ba30 con 0x7ffb6815a400 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb67fff700 1 -- 172.21.15.33:0/2688896495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580092e0 con 0x7ffb6815a400 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 -- 172.21.15.33:0/2688896495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 msgr2=0x7ffb68156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb68156e90 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ffb58009f50 tx=0x7ffb58009840 comp rx=0 tx=0).stop 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 -- 172.21.15.33:0/2688896495 shutdown_connections 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb68156e90 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/2688896495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb68159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 -- 172.21.15.33:0/2688896495 >> 172.21.15.33:0/2688896495 conn(0x7ffb68070e30 msgr2=0x7ffb680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:16.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 -- 172.21.15.33:0/2688896495 shutdown_connections 2023-10-09T15:38:16.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.336+0000 7ffb6f87f700 1 -- 172.21.15.33:0/2688896495 wait complete. 2023-10-09T15:38:16.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.337+0000 7ffb6f87f700 1 Processor -- start 2023-10-09T15:38:16.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.337+0000 7ffb6f87f700 1 -- start start 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680cb5a0 0x7ffb6815c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb6815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb680b6420 con 0x7ffb6815a400 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6815de80 con 0x7ffb680cb5a0 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6f87f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb6815c8a0 con 0x7ffb680cb970 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6de1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6de1c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51038/0 (socket says 172.21.15.33:51038) 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6de1c700 1 -- 172.21.15.33:0/4026738090 learned_addr learned my addr 172.21.15.33:0/4026738090 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.338+0000 7ffb6ce1a700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb6815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 -- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 msgr2=0x7ffb6815d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb6815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 -- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680cb5a0 msgr2=0x7ffb6815c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6d61b700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680cb5a0 0x7ffb6815c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680cb5a0 0x7ffb6815c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 -- 172.21.15.33:0/4026738090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb58009ae0 con 0x7ffb6815a400 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6de1c700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806ea60 tx=0x7ffb58017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb580032f0 con 0x7ffb6815a400 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb58012e60 con 0x7ffb6815a400 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb6815cb80 con 0x7ffb6815a400 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb5801d670 con 0x7ffb6815a400 2023-10-09T15:38:16.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.339+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb6815d140 con 0x7ffb6815a400 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.340+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb6804c3c0 con 0x7ffb6815a400 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.340+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffb5801da60 con 0x7ffb6815a400 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.341+0000 7ffb657fa700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 0x7ffb540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.341+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5111+0+0 (secure 0 0 0) 0x7ffb58086320 con 0x7ffb6815a400 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.341+0000 7ffb6d61b700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 0x7ffb540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.344 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.341+0000 7ffb6d61b700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 0x7ffb540697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ffb680cd440 tx=0x7ffb60008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.345+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffb580530f0 con 0x7ffb6815a400 2023-10-09T15:38:16.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.619+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]} v 0) v1 -- 0x7ffb680b0600 con 0x7ffb6815a400 2023-10-09T15:38:16.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.838+0000 7ffb657fa700 1 -- 172.21.15.33:0/4026738090 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_ls"]}]=0 v359) v1 ==== 131+0+0 (secure 0 0 0) 0x7ffb58056710 con 0x7ffb6815a400 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 msgr2=0x7ffb540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 0x7ffb540697d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ffb680cd440 tx=0x7ffb60008040 comp rx=0 tx=0).stop 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 msgr2=0x7ffb680b3e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ffb6806ea60 tx=0x7ffb58017000 comp rx=0 tx=0).stop 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 shutdown_connections 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffb54067320 0x7ffb540697d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffb6815a400 0x7ffb680b3e50 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffb680cb5a0 0x7ffb6815c1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 --2- 172.21.15.33:0/4026738090 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffb680cb970 0x7ffb6815d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 >> 172.21.15.33:0/4026738090 conn(0x7ffb68070e30 msgr2=0x7ffb680b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:16.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 shutdown_connections 2023-10-09T15:38:16.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.841+0000 7ffb6f87f700 1 -- 172.21.15.33:0/4026738090 wait complete. 2023-10-09T15:38:16.853 INFO:tasks.cephfs_test_runner:That the existing and the newly created volumes can be listed and ... ok 2023-10-09T15:38:16.853 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) That volume, its file system and pools, can be renamed. 2023-10-09T15:38:16.853 INFO:tasks.cephfs_test_runner:test_volume_rename (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:38:16.854 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-09T15:38:16.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.974+0000 7ff1aa4b2700 1 Processor -- start 2023-10-09T15:38:16.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.974+0000 7ff1aa4b2700 1 -- start start 2023-10-09T15:38:16.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1aa4b2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1a415a5d0 0x7ff1a4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1aa4b2700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a415ae40 con 0x7ff1a40cb970 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1aa4b2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1a415ab60 con 0x7ff1a40cb5a0 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1aa4b2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1a40ce0f0 con 0x7ff1a415a5d0 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a8a4f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff1a415a5d0 0x7ff1a4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff1a40cb970 0x7ff1a4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59062/0 (socket says 172.21.15.33:59062) 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a37fe700 1 -- 172.21.15.33:0/1901690790 learned_addr learned my addr 172.21.15.33:0/1901690790 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/1901690790 >> v1:172.21.15.59:6789/0 conn(0x7ff1a40cb5a0 legacy=0x7ff1a40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/1901690790 >> v1:172.21.15.33:6789/0 conn(0x7ff1a40cb970 legacy=0x7ff1a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a2ffd700 1 -- 172.21.15.33:0/1901690790 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2573738451 0 0) 0x7ff1a415ae40 con 0x7ff1a40cb970 2023-10-09T15:38:16.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/1901690790 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1a40ccf00 con 0x7ff1a415a5d0 2023-10-09T15:38:16.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a8a4f700 1 --2- 172.21.15.33:0/1901690790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a4156e90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009e60 tx=0x7ff19c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b566114faa61c5a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.975+0000 7ff1a2ffd700 1 -- 172.21.15.33:0/1901690790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c00e070 con 0x7ff1a415a5d0 2023-10-09T15:38:16.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1a2ffd700 1 -- 172.21.15.33:0/1901690790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c00bbf0 con 0x7ff1a415a5d0 2023-10-09T15:38:16.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1a2ffd700 1 -- 172.21.15.33:0/1901690790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c012430 con 0x7ff1a415a5d0 2023-10-09T15:38:16.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/1901690790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 msgr2=0x7ff1a4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/1901690790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a4156e90 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff19c009e60 tx=0x7ff19c009780 comp rx=0 tx=0).stop 2023-10-09T15:38:16.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/1901690790 shutdown_connections 2023-10-09T15:38:16.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/1901690790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a4156e90 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/1901690790 >> 172.21.15.33:0/1901690790 conn(0x7ff1a4070e30 msgr2=0x7ff1a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/1901690790 shutdown_connections 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.976+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/1901690790 wait complete. 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.977+0000 7ff1aa4b2700 1 Processor -- start 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.977+0000 7ff1aa4b2700 1 -- start start 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a40cb5a0 0x7ff1a4153610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a40cb970 0x7ff1a415d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40b3f10 con 0x7ff1a415a5d0 2023-10-09T15:38:16.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a40b4d70 con 0x7ff1a40cb5a0 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1aa4b2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1a4156c60 con 0x7ff1a40cb970 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a8a4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a8a4f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51064/0 (socket says 172.21.15.33:51064) 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/3825997098 learned_addr learned my addr 172.21.15.33:0/3825997098 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a3fff700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a40cb5a0 0x7ff1a4153610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a40cb970 msgr2=0x7ff1a415d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.978+0000 7ff1a37fe700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a40cb970 0x7ff1a415d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1a8a4f700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a40cb970 0x7ff1a415d070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a40cb5a0 msgr2=0x7ff1a4153610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1a8a4f700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a40cb5a0 0x7ff1a4153610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1a8a4f700 1 -- 172.21.15.33:0/3825997098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff19c009a20 con 0x7ff1a415a5d0 2023-10-09T15:38:16.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1a8a4f700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00b6c0 tx=0x7ff19c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c01d710 con 0x7ff1a415a5d0 2023-10-09T15:38:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff19c01d870 con 0x7ff1a415a5d0 2023-10-09T15:38:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1a40b4160 con 0x7ff1a415a5d0 2023-10-09T15:38:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff19c01dc30 con 0x7ff1a415a5d0 2023-10-09T15:38:16.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.979+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1a40b4720 con 0x7ff1a415a5d0 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.980+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1a40b4ee0 con 0x7ff1a415a5d0 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.980+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff19c024070 con 0x7ff1a415a5d0 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.981+0000 7ff18bfff700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 0x7ff1900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.981+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5111+0+0 (secure 0 0 0) 0x7ff19c0875c0 con 0x7ff1a415a5d0 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.981+0000 7ff1a3fff700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 0x7ff1900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:16.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.981+0000 7ff1a3fff700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 0x7ff1900697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff1940027e0 tx=0x7ff194009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:16.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:16.985+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff19c0544a0 con 0x7ff1a415a5d0 2023-10-09T15:38:17.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.255+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7ff1a404c3c0 con 0x7ff1a415a5d0 2023-10-09T15:38:17.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.841+0000 7ff18bfff700 1 -- 172.21.15.33:0/3825997098 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v360) v1 ==== 138+0+0 (secure 0 0 0) 0x7ff19c057ac0 con 0x7ff1a415a5d0 2023-10-09T15:38:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 msgr2=0x7ff1900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 0x7ff1900697d0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff1940027e0 tx=0x7ff194009040 comp rx=0 tx=0).stop 2023-10-09T15:38:17.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 msgr2=0x7ff1a415d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff19c00b6c0 tx=0x7ff19c018000 comp rx=0 tx=0).stop 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 shutdown_connections 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff190067320 0x7ff1900697d0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff1a415a5d0 0x7ff1a415d5b0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1a40cb5a0 0x7ff1a4153610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 --2- 172.21.15.33:0/3825997098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1a40cb970 0x7ff1a415d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 >> 172.21.15.33:0/3825997098 conn(0x7ff1a4070e30 msgr2=0x7ff1a40b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 shutdown_connections 2023-10-09T15:38:17.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.843+0000 7ff1aa4b2700 1 -- 172.21.15.33:0/3825997098 wait complete. 2023-10-09T15:38:17.857 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:38:17.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.980+0000 7f1464837700 1 Processor -- start 2023-10-09T15:38:17.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.980+0000 7f1464837700 1 -- start start 2023-10-09T15:38:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f1464837700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1460153a00 0x7f1460153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f1464837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f1464837700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f146015ac50 con 0x7f146015de50 2023-10-09T15:38:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f1464837700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f146015d010 con 0x7f1460153a00 2023-10-09T15:38:17.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f1464837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14600cf3c0 con 0x7f14600cea00 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f145ed9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1460153a00 0x7f1460153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f145f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f145f59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58372/0 (socket says 172.21.15.33:58372) 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f145f59e700 1 -- 172.21.15.33:0/3632520631 learned_addr learned my addr 172.21.15.33:0/3632520631 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.981+0000 7f145e59c700 1 --1- 172.21.15.33:0/3632520631 >> v1:172.21.15.59:6789/0 conn(0x7f146015de50 0x7f146015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:46924/0 (socket says 172.21.15.33:46924) 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145dd9b700 1 -- 172.21.15.33:0/3632520631 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2620575060 0 0) 0x7f146015ac50 con 0x7f146015de50 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145dd9b700 1 -- 172.21.15.33:0/3632520631 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f144c003570 con 0x7f146015de50 2023-10-09T15:38:17.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145f59e700 1 -- 172.21.15.33:0/3632520631 >> v2:172.21.15.59:3300/0 conn(0x7f1460153a00 msgr2=0x7f1460153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145f59e700 1 --2- 172.21.15.33:0/3632520631 >> v2:172.21.15.59:3300/0 conn(0x7f1460153a00 0x7f1460153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145f59e700 1 -- 172.21.15.33:0/3632520631 >> v1:172.21.15.59:6789/0 conn(0x7f146015de50 legacy=0x7f146015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145f59e700 1 -- 172.21.15.33:0/3632520631 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f146015af60 con 0x7f14600cea00 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145f59e700 1 --2- 172.21.15.33:0/3632520631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14580099b0 tx=0x7f1458009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6d4f262499676c6b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145dd9b700 1 -- 172.21.15.33:0/3632520631 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800b680 con 0x7f14600cea00 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145dd9b700 1 -- 172.21.15.33:0/3632520631 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f145800b7e0 con 0x7f14600cea00 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.982+0000 7f145dd9b700 1 -- 172.21.15.33:0/3632520631 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f145800bb80 con 0x7f14600cea00 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 -- 172.21.15.33:0/3632520631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 msgr2=0x7f14600cee80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 --2- 172.21.15.33:0/3632520631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f14580099b0 tx=0x7f1458009250 comp rx=0 tx=0).stop 2023-10-09T15:38:17.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 -- 172.21.15.33:0/3632520631 shutdown_connections 2023-10-09T15:38:17.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 --2- 172.21.15.33:0/3632520631 >> v2:172.21.15.59:3300/0 conn(0x7f1460153a00 0x7f1460153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 --2- 172.21.15.33:0/3632520631 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14600cea00 0x7f14600cee80 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 -- 172.21.15.33:0/3632520631 >> 172.21.15.33:0/3632520631 conn(0x7f14600703a0 msgr2=0x7f14600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:17.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 -- 172.21.15.33:0/3632520631 shutdown_connections 2023-10-09T15:38:17.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.983+0000 7f1464837700 1 -- 172.21.15.33:0/3632520631 wait complete. 2023-10-09T15:38:17.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.984+0000 7f1464837700 1 Processor -- start 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.984+0000 7f1464837700 1 -- start start 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600cea00 0x7f1460140ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146015de50 0x7f14600c9d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1460158160 con 0x7f1460153a00 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14600ca2c0 con 0x7f14600cea00 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1460157550 con 0x7f146015de50 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51070/0 (socket says 172.21.15.33:51070) 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 -- 172.21.15.33:0/3746154484 learned_addr learned my addr 172.21.15.33:0/3746154484 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145ed9d700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600cea00 0x7f1460140ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145f59e700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146015de50 0x7f14600c9d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 -- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146015de50 msgr2=0x7f14600c9d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146015de50 0x7f14600c9d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 -- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600cea00 msgr2=0x7f1460140ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600cea00 0x7f1460140ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 -- 172.21.15.33:0/3746154484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14580094f0 con 0x7f1460153a00 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f145e59c700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f144800c590 tx=0x7f1448007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1448005a70 con 0x7f1460153a00 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1448005bf0 con 0x7f1460153a00 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14480070d0 con 0x7f1460153a00 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1460157830 con 0x7f1460153a00 2023-10-09T15:38:17.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.985+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1460157df0 con 0x7f1460153a00 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.986+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1460157f80 con 0x7f1460153a00 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.987+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f14480074c0 con 0x7f1460153a00 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.987+0000 7f1456ffd700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 0x7f14400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.987+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f1448083e80 con 0x7f1460153a00 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.987+0000 7f145ed9d700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 0x7f14400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:17.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.988+0000 7f145ed9d700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 0x7f14400697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f145000f570 tx=0x7f145000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:17.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:17.992+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1448050d60 con 0x7f1460153a00 2023-10-09T15:38:18.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.186+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f146004c3c0 con 0x7f1460153a00 2023-10-09T15:38:18.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.190+0000 7f1456ffd700 1 -- 172.21.15.33:0/3746154484 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f1448017070 con 0x7f1460153a00 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 msgr2=0x7f14400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 0x7f14400697d0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f145000f570 tx=0x7f145000b040 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 msgr2=0x7f14600c9840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7f144800c590 tx=0x7f1448007e00 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 shutdown_connections 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1440067320 0x7f14400697d0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f146015de50 0x7f14600c9d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14600cea00 0x7f1460140ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 --2- 172.21.15.33:0/3746154484 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1460153a00 0x7f14600c9840 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 >> 172.21.15.33:0/3746154484 conn(0x7f14600703a0 msgr2=0x7f14600d0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:18.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 shutdown_connections 2023-10-09T15:38:18.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.192+0000 7f1464837700 1 -- 172.21.15.33:0/3746154484 wait complete. 2023-10-09T15:38:18.205 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:38:18.205 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:18.243 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:18.294 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:38:18.295 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:38:18.295 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:18.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.413+0000 7f3442ad1700 1 Processor -- start 2023-10-09T15:38:18.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.413+0000 7f3442ad1700 1 -- start start 2023-10-09T15:38:18.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.413+0000 7f3442ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 0x7f343c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.413+0000 7f3442ad1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f343c1579d0 0x7f343c0b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.413+0000 7f3442ad1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f343c158210 con 0x7f343c0ccba0 2023-10-09T15:38:18.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f3442ad1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f343c0cb850 con 0x7f343c1579d0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f3442ad1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0cb290 con 0x7f343c157600 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f343c1579d0 0x7f343c0b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f344106e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f343c0ccba0 0x7f343c1586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59076/0 (socket says 172.21.15.33:59076) 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f344106e700 1 -- 172.21.15.33:0/3662680308 learned_addr learned my addr 172.21.15.33:0/3662680308 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f344086d700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 0x7f343c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 -- 172.21.15.33:0/3662680308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 msgr2=0x7f343c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 0x7f343c0b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 -- 172.21.15.33:0/3662680308 >> v1:172.21.15.33:6789/0 conn(0x7f343c0ccba0 legacy=0x7f343c1586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 -- 172.21.15.33:0/3662680308 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f343c0cb570 con 0x7f343c1579d0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343b7fe700 1 -- 172.21.15.33:0/3662680308 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718468477 0 0) 0x7f343c158210 con 0x7f343c0ccba0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f344086d700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 0x7f343c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343bfff700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c1579d0 0x7f343c0b1950 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e60 tx=0x7f342c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daadfd4fbeee99ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343b7fe700 1 -- 172.21.15.33:0/3662680308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c00e070 con 0x7f343c1579d0 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343b7fe700 1 -- 172.21.15.33:0/3662680308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c00bc30 con 0x7f343c1579d0 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.414+0000 7f343b7fe700 1 -- 172.21.15.33:0/3662680308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c012430 con 0x7f343c1579d0 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 -- 172.21.15.33:0/3662680308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c1579d0 msgr2=0x7f343c0b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c1579d0 0x7f343c0b1950 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f342c009e60 tx=0x7f342c009780 comp rx=0 tx=0).stop 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 -- 172.21.15.33:0/3662680308 shutdown_connections 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c157600 0x7f343c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 --2- 172.21.15.33:0/3662680308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c1579d0 0x7f343c0b1950 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 -- 172.21.15.33:0/3662680308 >> 172.21.15.33:0/3662680308 conn(0x7f343c06d170 msgr2=0x7f343c0cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 -- 172.21.15.33:0/3662680308 shutdown_connections 2023-10-09T15:38:18.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.415+0000 7f3442ad1700 1 -- 172.21.15.33:0/3662680308 wait complete. 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.416+0000 7f3442ad1700 1 Processor -- start 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.416+0000 7f3442ad1700 1 -- start start 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 0x7f343c168d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 0x7f343c0a54d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c143680 con 0x7f343c157600 2023-10-09T15:38:18.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f343c0c6de0 con 0x7f343c0ccba0 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f3442ad1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f343c169260 con 0x7f343c1579d0 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51082/0 (socket says 172.21.15.33:51082) 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 -- 172.21.15.33:0/2631965686 learned_addr learned my addr 172.21.15.33:0/2631965686 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f344106e700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 0x7f343c0a54d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 -- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 msgr2=0x7f343c0a54d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 0x7f343c0a54d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 -- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 msgr2=0x7f343c168d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f344086d700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 0x7f343c168d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 0x7f343c168d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f343bfff700 1 -- 172.21.15.33:0/2631965686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f342c009a20 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f344106e700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 0x7f343c0a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.417+0000 7f344086d700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 0x7f343c168d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f343bfff700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f342c00b6c0 tx=0x7f342c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c012e00 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f342c027470 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f343c0c61d0 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f342c027830 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.418+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f343c0c6790 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.419+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f343c04c3c0 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.419+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f342c024070 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.419+0000 7f3438ff9700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 0x7f341c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.419+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(131..131 src has 1..131) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f342c0870d0 con 0x7f343c157600 2023-10-09T15:38:18.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.419+0000 7f344086d700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 0x7f341c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.420+0000 7f344086d700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 0x7f341c0697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3424006f00 tx=0x7f3424008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.424+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f342c053fb0 con 0x7f343c157600 2023-10-09T15:38:18.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.661+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f343c0ae4d0 con 0x7f343c157600 2023-10-09T15:38:18.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.661+0000 7f3438ff9700 1 -- 172.21.15.33:0/2631965686 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) v1 ==== 94+0+3526 (secure 0 0 0) 0x7f342c0575d0 con 0x7f343c157600 2023-10-09T15:38:18.662 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:18.663 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":87,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5984,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1286951150","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1286951150},{"type":"v1","addr":"172.21.15.59:6834","nonce":1286951150}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":71},{"gid":6137,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/4218052350","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":4218052350},{"type":"v1","addr":"172.21.15.59:6835","nonce":4218052350}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":85},{"gid":7386,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3967750705","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3967750705},{"type":"v1","addr":"172.21.15.33:6837","nonce":3967750705}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":83},{"gid":7476,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/783758493","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":783758493},{"type":"v1","addr":"172.21.15.33:6836","nonce":783758493}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":87}],"filesystems":[]} 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 msgr2=0x7f341c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 0x7f341c0697d0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f3424006f00 tx=0x7f3424008040 comp rx=0 tx=0).stop 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 msgr2=0x7f343c0b0400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f342c00b6c0 tx=0x7f342c019000 comp rx=0 tx=0).stop 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 shutdown_connections 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f341c067320 0x7f341c0697d0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f343c1579d0 0x7f343c0a54d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f343c0ccba0 0x7f343c168d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 --2- 172.21.15.33:0/2631965686 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f343c157600 0x7f343c0b0400 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 >> 172.21.15.33:0/2631965686 conn(0x7f343c06d170 msgr2=0x7f343c15a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 shutdown_connections 2023-10-09T15:38:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.663+0000 7f3442ad1700 1 -- 172.21.15.33:0/2631965686 wait complete. 2023-10-09T15:38:18.666 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 87 2023-10-09T15:38:18.677 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:38:18.677 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:38:18.677 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:38:18.677 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:18.677 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:38:18.677 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:38:18.678 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:38:18.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:18.678 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:38:18.678 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:38:18.678 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:38:18.678 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:18.679 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:38:18.679 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:38:18.679 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:38:18.679 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:18.686 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:38:18.686 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:38:18.687 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:38:18.687 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:38:18.689 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:38:18.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:38:18.690 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:38:18.690 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:38:18.728 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:38:18.728 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:18.728 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:38:18.729 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:18.732 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:38:18.732 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:18.732 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:38:18.733 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:18.733 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:38:18.804 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:38:18.804 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:38:18.817 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:38:18.817 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:38:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.859+0000 7f0a136b3700 1 Processor -- start 2023-10-09T15:38:18.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.859+0000 7f0a136b3700 1 -- start start 2023-10-09T15:38:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a136b3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0a0c15c210 0x7f0a0c1536c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a136b3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c15ad50 con 0x7f0a0c15cf20 2023-10-09T15:38:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a136b3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a0c15a140 con 0x7f0a0c15cb50 2023-10-09T15:38:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a136b3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a0c15a420 con 0x7f0a0c15c210 2023-10-09T15:38:18.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a11c50700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0a0c15c210 0x7f0a0c1536c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a10c4e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0a0c15cf20 0x7f0a0c0b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59100/0 (socket says 172.21.15.33:59100) 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a11c50700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0a0c15c210 0x7f0a0c1536c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51118/0 (socket says 172.21.15.33:51118) 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a10c4e700 1 -- 172.21.15.33:0/3501182261 learned_addr learned my addr 172.21.15.33:0/3501182261 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a11c50700 1 -- 172.21.15.33:0/3501182261 >> v1:172.21.15.59:6789/0 conn(0x7f0a0c15cb50 legacy=0x7f0a0c0b01d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a11c50700 1 -- 172.21.15.33:0/3501182261 >> v1:172.21.15.33:6789/0 conn(0x7f0a0c15cf20 legacy=0x7f0a0c0b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a03fff700 1 -- 172.21.15.33:0/3501182261 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3482943162 0 0) 0x7f0a0c15ad50 con 0x7f0a0c15cf20 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.860+0000 7f0a11c50700 1 -- 172.21.15.33:0/3501182261 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0c15a700 con 0x7f0a0c15c210 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a11c50700 1 --2- 172.21.15.33:0/3501182261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c1536c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e60 tx=0x7f0a04009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=906a86d041cc16b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a03fff700 1 -- 172.21.15.33:0/3501182261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0400e070 con 0x7f0a0c15c210 2023-10-09T15:38:18.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a03fff700 1 -- 172.21.15.33:0/3501182261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0400bc30 con 0x7f0a0c15c210 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a03fff700 1 -- 172.21.15.33:0/3501182261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a04012430 con 0x7f0a0c15c210 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 -- 172.21.15.33:0/3501182261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 msgr2=0x7f0a0c1536c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 --2- 172.21.15.33:0/3501182261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c1536c0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f0a04009e60 tx=0x7f0a04009780 comp rx=0 tx=0).stop 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 -- 172.21.15.33:0/3501182261 shutdown_connections 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 --2- 172.21.15.33:0/3501182261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c1536c0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 -- 172.21.15.33:0/3501182261 >> 172.21.15.33:0/3501182261 conn(0x7f0a0c0cded0 msgr2=0x7f0a0c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.861+0000 7f0a136b3700 1 -- 172.21.15.33:0/3501182261 shutdown_connections 2023-10-09T15:38:18.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.862+0000 7f0a136b3700 1 -- 172.21.15.33:0/3501182261 wait complete. 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.863+0000 7f0a136b3700 1 Processor -- start 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.863+0000 7f0a136b3700 1 -- start start 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.863+0000 7f0a136b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.863+0000 7f0a136b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0c15cb50 0x7f0a0c16a5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.863+0000 7f0a136b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0c15cf20 0x7f0a0c0af2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a136b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0acd10 con 0x7f0a0c15c210 2023-10-09T15:38:18.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a136b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0ad890 con 0x7f0a0c15cf20 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a136b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0c0acf60 con 0x7f0a0c15cb50 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51128/0 (socket says 172.21.15.33:51128) 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 -- 172.21.15.33:0/4032875219 learned_addr learned my addr 172.21.15.33:0/4032875219 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a11c50700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0c15cf20 0x7f0a0c0af2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a10c4e700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0c15cb50 0x7f0a0c16a5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 -- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0c15cb50 msgr2=0x7f0a0c16a5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0c15cb50 0x7f0a0c16a5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 -- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0c15cf20 msgr2=0x7f0a0c0af2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:18.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0c15cf20 0x7f0a0c0af2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 -- 172.21.15.33:0/4032875219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a04009a20 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a1144f700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c790 tx=0x7f0a08007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08011590 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a08011710 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a0c0ad240 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a08011ad0 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.864+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a0c155890 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.865+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a0c04c3c0 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.866+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0a0801b3b0 con 0x7f0a0c15c210 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.866+0000 7f0a017fa700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 0x7f09f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.866+0000 7f0a10c4e700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 0x7f09f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:18.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.866+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5111+0+0 (secure 0 0 0) 0x7f0a08083dd0 con 0x7f0a0c15c210 2023-10-09T15:38:18.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.867+0000 7f0a10c4e700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 0x7f09f00697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c15e540 tx=0x7f09fc007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:18.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:18.871+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0a08050cb0 con 0x7f0a0c15c210 2023-10-09T15:38:19.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.081+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f0a0c06b020 con 0x7f0a0c15c210 2023-10-09T15:38:19.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.863+0000 7f0a017fa700 1 -- 172.21.15.33:0/4032875219 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v136) v1 ==== 97+0+0 (secure 0 0 0) 0x7f0a08017070 con 0x7f0a0c15c210 2023-10-09T15:38:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 msgr2=0x7f09f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 0x7f09f00697d0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0a0c15e540 tx=0x7f09fc007d30 comp rx=0 tx=0).stop 2023-10-09T15:38:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 msgr2=0x7f0a0c155350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f0a0800c790 tx=0x7f0a08007f40 comp rx=0 tx=0).stop 2023-10-09T15:38:19.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 shutdown_connections 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f09f0067320 0x7f09f00697d0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0a0c15c210 0x7f0a0c155350 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0a0c15cf20 0x7f0a0c0af2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 --2- 172.21.15.33:0/4032875219 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0a0c15cb50 0x7f0a0c16a5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 >> 172.21.15.33:0/4032875219 conn(0x7f0a0c0cded0 msgr2=0x7f0a0c0b27d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 shutdown_connections 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:19.866+0000 7f0a136b3700 1 -- 172.21.15.33:0/4032875219 wait complete. 2023-10-09T15:38:19.868 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:38:19.882 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:38:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.007+0000 7fb6f318e700 1 Processor -- start 2023-10-09T15:38:20.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.007+0000 7fb6f318e700 1 -- start start 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f318e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f318e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f318e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6ec15ae40 con 0x7fb6ec0cde50 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f318e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6ec0d13f0 con 0x7fb6ec0cb5a0 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f318e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15ab60 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f0f2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:58450/0 (socket says 172.21.15.33:58450) 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f0f2a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:53630/0 (socket says 172.21.15.33:53630) 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6ebfff700 1 -- 172.21.15.33:0/256086277 learned_addr learned my addr 172.21.15.33:0/256086277 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.008+0000 7fb6f172b700 1 --1- 172.21.15.33:0/256086277 >> v1:172.21.15.59:6789/0 conn(0x7fb6ec0cde50 0x7fb6ec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:46944/0 (socket says 172.21.15.33:46944) 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6ebfff700 1 -- 172.21.15.33:0/256086277 >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 msgr2=0x7fb6ec0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6ebfff700 1 --2- 172.21.15.33:0/256086277 >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6ebfff700 1 -- 172.21.15.33:0/256086277 >> v1:172.21.15.59:6789/0 conn(0x7fb6ec0cde50 legacy=0x7fb6ec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6ebfff700 1 -- 172.21.15.33:0/256086277 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6ec0ccf00 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6f0f2a700 1 --2- 172.21.15.33:0/256086277 >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6ebfff700 1 --2- 172.21.15.33:0/256086277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00099b0 tx=0x7fb6e0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6c05a2f49c05ef39 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6eb7fe700 1 -- 172.21.15.33:0/256086277 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e0009ea0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6eb7fe700 1 -- 172.21.15.33:0/256086277 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e000b860 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.009+0000 7fb6eb7fe700 1 -- 172.21.15.33:0/256086277 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000bc00 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 -- 172.21.15.33:0/256086277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 msgr2=0x7fb6ec159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 --2- 172.21.15.33:0/256086277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fb6e00099b0 tx=0x7fb6e0009250 comp rx=0 tx=0).stop 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 -- 172.21.15.33:0/256086277 shutdown_connections 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 --2- 172.21.15.33:0/256086277 >> v2:172.21.15.59:3300/0 conn(0x7fb6ec0cb5a0 0x7fb6ec0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 --2- 172.21.15.33:0/256086277 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0cd9e0 0x7fb6ec159ec0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 -- 172.21.15.33:0/256086277 >> 172.21.15.33:0/256086277 conn(0x7fb6ec070e30 msgr2=0x7fb6ec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 -- 172.21.15.33:0/256086277 shutdown_connections 2023-10-09T15:38:20.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.010+0000 7fb6f318e700 1 -- 172.21.15.33:0/256086277 wait complete. 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.011+0000 7fb6f318e700 1 Processor -- start 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.011+0000 7fb6f318e700 1 -- start start 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 0x7fb6ec15cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0b4cc0 0x7fb6ec0c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec16dd40 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec15d430 con 0x7fb6ec0cb5a0 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f318e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ec169ab0 con 0x7fb6ec0b4cc0 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51136/0 (socket says 172.21.15.33:51136) 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 -- 172.21.15.33:0/2285534455 learned_addr learned my addr 172.21.15.33:0/2285534455 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f0f2a700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 0x7fb6ec15cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f172b700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0b4cc0 0x7fb6ec0c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 -- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0b4cc0 msgr2=0x7fb6ec0c8b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0b4cc0 0x7fb6ec0c8b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 -- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 msgr2=0x7fb6ec15cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 0x7fb6ec15cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 -- 172.21.15.33:0/2285534455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6e4009a20 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6f0f2a700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 0x7fb6ec15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.012+0000 7fb6ebfff700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec15aca0 tx=0x7fb6e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.013+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e000bbe0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.013+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb6e0011420 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.013+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6e00094f0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.013+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6e00117c0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.013+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ec16a070 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.014+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ec16a290 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.014+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb6e0011bb0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.014+0000 7fb6e8ff9700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 0x7fb6d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.014+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fb6e0086250 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.014+0000 7fb6f0f2a700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 0x7fb6d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.015+0000 7fb6f0f2a700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 0x7fb6d80697d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40099f0 tx=0x7fb6e400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.019+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb6e0053230 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.294+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb6ec04c3c0 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.294+0000 7fb6e8ff9700 1 -- 172.21.15.33:0/2285534455 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb6e0011e60 con 0x7fb6ec0cd9e0 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.296 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.298 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:38:20.299 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.300 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:38:20.301 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.302 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.303 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:38:20.304 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.305 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.306 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.307 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:38:20.308 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:38:20.309 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:20.310 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:38:20.311 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.296+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 msgr2=0x7fb6d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 0x7fb6d80697d0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb6e40099f0 tx=0x7fb6e400b040 comp rx=0 tx=0).stop 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 msgr2=0x7fb6ec16d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb6ec15aca0 tx=0x7fb6e0017000 comp rx=0 tx=0).stop 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 shutdown_connections 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb6d8067320 0x7fb6d80697d0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6ec0b4cc0 0x7fb6ec0c8b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6ec0cb5a0 0x7fb6ec15cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 --2- 172.21.15.33:0/2285534455 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6ec0cd9e0 0x7fb6ec16d800 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 >> 172.21.15.33:0/2285534455 conn(0x7fb6ec070e30 msgr2=0x7fb6ec0b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 shutdown_connections 2023-10-09T15:38:20.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.297+0000 7fb6f318e700 1 -- 172.21.15.33:0/2285534455 wait complete. 2023-10-09T15:38:20.313 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:20.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.431+0000 7f48d24c1700 1 Processor -- start 2023-10-09T15:38:20.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.431+0000 7f48d24c1700 1 -- start start 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d24c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 0x7f48cc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d24c1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f48cc15a400 0x7f48cc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d24c1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48cc15ae40 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d24c1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48cc0ce0f0 con 0x7f48cc15a400 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d24c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc0cbde0 con 0x7f48cc0cb970 2023-10-09T15:38:20.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48d0a5e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f48cc15a400 0x7f48cc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48cbfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f48cc0cb5a0 0x7f48cc0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:59106/0 (socket says 172.21.15.33:59106) 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48cbfff700 1 -- 172.21.15.33:0/1344254130 learned_addr learned my addr 172.21.15.33:0/1344254130 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.432+0000 7f48cb7fe700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 0x7f48cc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d0a5e700 1 -- 172.21.15.33:0/1344254130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 msgr2=0x7f48cc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d0a5e700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 0x7f48cc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d0a5e700 1 -- 172.21.15.33:0/1344254130 >> v1:172.21.15.33:6789/0 conn(0x7f48cc0cb5a0 legacy=0x7f48cc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48caffd700 1 -- 172.21.15.33:0/1344254130 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3076936662 0 0) 0x7f48cc15ae40 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d0a5e700 1 -- 172.21.15.33:0/1344254130 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48cc15ab60 con 0x7f48cc15a400 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48cb7fe700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 0x7f48cc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d0a5e700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc15a400 0x7f48cc156e90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009e90 tx=0x7f48c4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cbdd4a372c925c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48caffd700 1 -- 172.21.15.33:0/1344254130 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c400e070 con 0x7f48cc15a400 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48caffd700 1 -- 172.21.15.33:0/1344254130 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c400bbf0 con 0x7f48cc15a400 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48caffd700 1 -- 172.21.15.33:0/1344254130 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c4012430 con 0x7f48cc15a400 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 -- 172.21.15.33:0/1344254130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc15a400 msgr2=0x7f48cc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc15a400 0x7f48cc156e90 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f48c4009e90 tx=0x7f48c4009780 comp rx=0 tx=0).stop 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 -- 172.21.15.33:0/1344254130 shutdown_connections 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc15a400 0x7f48cc156e90 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 --2- 172.21.15.33:0/1344254130 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc0cb970 0x7f48cc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 -- 172.21.15.33:0/1344254130 >> 172.21.15.33:0/1344254130 conn(0x7f48cc070e30 msgr2=0x7f48cc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 -- 172.21.15.33:0/1344254130 shutdown_connections 2023-10-09T15:38:20.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.433+0000 7f48d24c1700 1 -- 172.21.15.33:0/1344254130 wait complete. 2023-10-09T15:38:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 Processor -- start 2023-10-09T15:38:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 -- start start 2023-10-09T15:38:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48cc0cb970 0x7f48cc15d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 0x7f48cc0c91f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc16d730 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc152560 con 0x7f48cc0cb970 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.435+0000 7f48d24c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48cc16ce00 con 0x7f48cc15a400 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51154/0 (socket says 172.21.15.33:51154) 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 -- 172.21.15.33:0/976247914 learned_addr learned my addr 172.21.15.33:0/976247914 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48d0a5e700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 0x7f48cc0c91f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cb7fe700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48cc0cb970 0x7f48cc15d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 -- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 msgr2=0x7f48cc0c91f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 0x7f48cc0c91f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 -- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48cc0cb970 msgr2=0x7f48cc15d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48cc0cb970 0x7f48cc15d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 -- 172.21.15.33:0/976247914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48c4009a20 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48d0a5e700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 0x7f48cc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48cbfff700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c5b0 tx=0x7f48b4001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4005b30 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48b4005c90 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48b4007300 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48cc16d0e0 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.436+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48cc16dbc0 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.437+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48cc04c3c0 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.438+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f48b401b3b0 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.438+0000 7f48c3fff700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 0x7f48ac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.438+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f48b4083e50 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.438+0000 7f48cb7fe700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 0x7f48ac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.439+0000 7f48cb7fe700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 0x7f48ac0697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006f00 tx=0x7f48bc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.443+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f48b4050e30 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.637+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48cc16da10 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.638+0000 7f48c3fff700 1 -- 172.21.15.33:0/976247914 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f48b4017090 con 0x7f48cc0cb5a0 2023-10-09T15:38:20.639 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:20.639 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":136,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:19.857611+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":118,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":119,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 msgr2=0x7f48ac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 0x7f48ac0697d0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f48bc006f00 tx=0x7f48bc008040 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 msgr2=0x7f48cc152020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f48b400c5b0 tx=0x7f48b4001070 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 shutdown_connections 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f48ac067320 0x7f48ac0697d0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f48cc0cb5a0 0x7f48cc152020 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f48cc15a400 0x7f48cc0c91f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 --2- 172.21.15.33:0/976247914 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f48cc0cb970 0x7f48cc15d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 >> 172.21.15.33:0/976247914 conn(0x7f48cc070e30 msgr2=0x7f48cc0c66d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 shutdown_connections 2023-10-09T15:38:20.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.640+0000 7f48d24c1700 1 -- 172.21.15.33:0/976247914 wait complete. 2023-10-09T15:38:20.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:38:20.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:38:20.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.775+0000 7f3e8a895700 1 Processor -- start 2023-10-09T15:38:20.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.775+0000 7f3e8a895700 1 -- start start 2023-10-09T15:38:20.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e8a895700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 0x7f3e840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e8a895700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e8406e0e0 0x7f3e840cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e8a895700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e840ccfd0 con 0x7f3e8406dc70 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e8a895700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e840cf0e0 con 0x7f3e8406e0e0 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e8a895700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e8415a3d0 con 0x7f3e84159530 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e8406e0e0 0x7f3e840cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3e8406e0e0 0x7f3e840cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36736/0 (socket says 172.21.15.33:36736) 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e837fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3e8406dc70 0x7f3e84159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55530/0 (socket says 172.21.15.33:55530) 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 -- 172.21.15.33:0/1048054326 learned_addr learned my addr 172.21.15.33:0/1048054326 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e83fff700 1 --2- 172.21.15.33:0/1048054326 >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 0x7f3e840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 -- 172.21.15.33:0/1048054326 >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 msgr2=0x7f3e840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 --2- 172.21.15.33:0/1048054326 >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 0x7f3e840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 -- 172.21.15.33:0/1048054326 >> v1:172.21.15.33:6789/0 conn(0x7f3e8406dc70 legacy=0x7f3e84159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 -- 172.21.15.33:0/1048054326 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e8415a6b0 con 0x7f3e8406e0e0 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e82ffd700 1 -- 172.21.15.33:0/1048054326 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245368479 0 0) 0x7f3e840ccfd0 con 0x7f3e8406dc70 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e83fff700 1 --2- 172.21.15.33:0/1048054326 >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 0x7f3e840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.776+0000 7f3e88e32700 1 --2- 172.21.15.33:0/1048054326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cb6f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3e8406d630 tx=0x7f3e7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ea1c97e44e06b8d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e82ffd700 1 -- 172.21.15.33:0/1048054326 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c00e070 con 0x7f3e8406e0e0 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e82ffd700 1 -- 172.21.15.33:0/1048054326 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c00ba50 con 0x7f3e8406e0e0 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e82ffd700 1 -- 172.21.15.33:0/1048054326 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c0092e0 con 0x7f3e8406e0e0 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 -- 172.21.15.33:0/1048054326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e8406e0e0 msgr2=0x7f3e840cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 --2- 172.21.15.33:0/1048054326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cb6f0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f3e8406d630 tx=0x7f3e7c009840 comp rx=0 tx=0).stop 2023-10-09T15:38:20.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 -- 172.21.15.33:0/1048054326 shutdown_connections 2023-10-09T15:38:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 --2- 172.21.15.33:0/1048054326 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cb6f0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 --2- 172.21.15.33:0/1048054326 >> v2:172.21.15.59:3300/0 conn(0x7f3e84159530 0x7f3e840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 -- 172.21.15.33:0/1048054326 >> 172.21.15.33:0/1048054326 conn(0x7f3e840703a0 msgr2=0x7f3e840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 -- 172.21.15.33:0/1048054326 shutdown_connections 2023-10-09T15:38:20.781 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.777+0000 7f3e8a895700 1 -- 172.21.15.33:0/1048054326 wait complete. 2023-10-09T15:38:20.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.778+0000 7f3e8a895700 1 Processor -- start 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.778+0000 7f3e8a895700 1 -- start start 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 0x7f3e840cb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cbba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e84143cc0 con 0x7f3e84159530 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840ca610 con 0x7f3e8406e0e0 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e8a895700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e840c9a00 con 0x7f3e8406dc70 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e88e32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e88e32700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36748/0 (socket says 172.21.15.33:36748) 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.779+0000 7f3e88e32700 1 -- 172.21.15.33:0/303861340 learned_addr learned my addr 172.21.15.33:0/303861340 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e837fe700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cbba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e83fff700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 0x7f3e840cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 -- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 msgr2=0x7f3e840cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 0x7f3e840cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 -- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 msgr2=0x7f3e840cbba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cbba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 -- 172.21.15.33:0/303861340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c009ae0 con 0x7f3e84159530 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e83fff700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 0x7f3e840cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e837fe700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e88e32700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009ab0 tx=0x7f3e7c018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c008e40 con 0x7f3e84159530 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e7c026460 con 0x7f3e84159530 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e840c9ce0 con 0x7f3e84159530 2023-10-09T15:38:20.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e7c026800 con 0x7f3e84159530 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.780+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e840ca2a0 con 0x7f3e84159530 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.781+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e8404c3c0 con 0x7f3e84159530 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.781+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3e7c003040 con 0x7f3e84159530 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.782+0000 7f3e6bfff700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 0x7f3e700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.782+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3e7c086be0 con 0x7f3e84159530 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.782+0000 7f3e83fff700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 0x7f3e700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:20.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.782+0000 7f3e83fff700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 0x7f3e700697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3e78006fd0 tx=0x7f3e78008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:20.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.786+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3e7c053b20 con 0x7f3e84159530 2023-10-09T15:38:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.980+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3e8415a990 con 0x7f3e84159530 2023-10-09T15:38:20.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.980+0000 7f3e6bfff700 1 -- 172.21.15.33:0/303861340 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v136) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3e7c0210a0 con 0x7f3e84159530 2023-10-09T15:38:20.981 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 msgr2=0x7f3e700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 0x7f3e700697d0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f3e78006fd0 tx=0x7f3e78008040 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 msgr2=0x7f3e84157d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f3e7c009ab0 tx=0x7f3e7c018000 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 shutdown_connections 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3e70067320 0x7f3e700697d0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3e84159530 0x7f3e84157d70 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3e8406dc70 0x7f3e840cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 --2- 172.21.15.33:0/303861340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3e8406e0e0 0x7f3e840cbba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:20.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 >> 172.21.15.33:0/303861340 conn(0x7f3e840703a0 msgr2=0x7f3e840d0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:20.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 shutdown_connections 2023-10-09T15:38:20.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:20.982+0000 7f3e8a895700 1 -- 172.21.15.33:0/303861340 wait complete. 2023-10-09T15:38:20.995 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:38:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.113+0000 7f419d704700 1 Processor -- start 2023-10-09T15:38:21.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.113+0000 7f419d704700 1 -- start start 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f419d704700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41980cb970 0x7f4198159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f419d704700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419815ae40 con 0x7f41980cb5a0 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f419d704700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419815ab60 con 0x7f419815a400 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f419d704700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41980ce0f0 con 0x7f41980cb970 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f4196ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f41980cb5a0 0x7f41980cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55544/0 (socket says 172.21.15.33:55544) 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f4196ffd700 1 -- 172.21.15.33:0/1272370949 learned_addr learned my addr 172.21.15.33:0/1272370949 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.114+0000 7f41967fc700 1 --2- 172.21.15.33:0/1272370949 >> v2:172.21.15.33:3300/0 conn(0x7f41980cb970 0x7f4198159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f41967fc700 1 -- 172.21.15.33:0/1272370949 >> v1:172.21.15.59:6789/0 conn(0x7f419815a400 legacy=0x7f4198156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f41967fc700 1 -- 172.21.15.33:0/1272370949 >> v1:172.21.15.33:6789/0 conn(0x7f41980cb5a0 legacy=0x7f41980cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f41967fc700 1 -- 172.21.15.33:0/1272370949 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41980ccf00 con 0x7f41980cb970 2023-10-09T15:38:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f4195ffb700 1 -- 172.21.15.33:0/1272370949 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3413511657 0 0) 0x7f419815ae40 con 0x7f41980cb5a0 2023-10-09T15:38:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f41967fc700 1 --2- 172.21.15.33:0/1272370949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41980cb970 0x7f4198159ec0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f41800098e0 tx=0x7f41800091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42856fda02d02dd9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f4195ffb700 1 -- 172.21.15.33:0/1272370949 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4180009e80 con 0x7f41980cb970 2023-10-09T15:38:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f4195ffb700 1 -- 172.21.15.33:0/1272370949 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418000b820 con 0x7f41980cb970 2023-10-09T15:38:21.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f4195ffb700 1 -- 172.21.15.33:0/1272370949 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418000bba0 con 0x7f41980cb970 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 -- 172.21.15.33:0/1272370949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41980cb970 msgr2=0x7f4198159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 --2- 172.21.15.33:0/1272370949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41980cb970 0x7f4198159ec0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f41800098e0 tx=0x7f41800091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 -- 172.21.15.33:0/1272370949 shutdown_connections 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 --2- 172.21.15.33:0/1272370949 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41980cb970 0x7f4198159ec0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 -- 172.21.15.33:0/1272370949 >> 172.21.15.33:0/1272370949 conn(0x7f4198070e30 msgr2=0x7f41980d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 -- 172.21.15.33:0/1272370949 shutdown_connections 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.115+0000 7f419d704700 1 -- 172.21.15.33:0/1272370949 wait complete. 2023-10-09T15:38:21.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 Processor -- start 2023-10-09T15:38:21.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 -- start start 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 0x7f41981530a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 0x7f41980af250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980b6550 con 0x7f419815a400 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f419815c320 con 0x7f41980cb970 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.117+0000 7f419d704700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f419815d180 con 0x7f41980cb5a0 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36768/0 (socket says 172.21.15.33:36768) 2023-10-09T15:38:21.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 -- 172.21.15.33:0/2999380933 learned_addr learned my addr 172.21.15.33:0/2999380933 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41967fc700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 0x7f41980af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f4196ffd700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 0x7f41981530a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 -- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 msgr2=0x7f41981530a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 0x7f41981530a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 -- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 msgr2=0x7f41980af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 0x7f41980af250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 -- 172.21.15.33:0/2999380933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4180009420 con 0x7f419815a400 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f4196ffd700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 0x7f41981530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41967fc700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 0x7f41980af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f41977fe700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f419000c5e0 tx=0x7f4190007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011590 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4190011710 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4190011ad0 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419815c570 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.118+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f419815cb30 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.119+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f419804c3c0 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.120+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f419001c460 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.120+0000 7f418effd700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 0x7f41780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.120+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f41900845b0 con 0x7f419815a400 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.120+0000 7f4196ffd700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 0x7f41780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.120+0000 7f4196ffd700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 0x7f41780697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f418800e280 tx=0x7f4188009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.124+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4190051590 con 0x7f419815a400 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.323+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f419815d2c0 con 0x7f419815a400 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.323+0000 7f418effd700 1 -- 172.21.15.33:0/2999380933 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4190054bb0 con 0x7f419815a400 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:21.324 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:38:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:38:21.325 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:21.325 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 msgr2=0x7f41780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 0x7f41780697d0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f418800e280 tx=0x7f4188009040 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 msgr2=0x7f419815d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f419000c5e0 tx=0x7f4190007f60 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 shutdown_connections 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4178067320 0x7f41780697d0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f419815a400 0x7f419815d610 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41980cb5a0 0x7f41981530a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 --2- 172.21.15.33:0/2999380933 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41980cb970 0x7f41980af250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 >> 172.21.15.33:0/2999380933 conn(0x7f4198070e30 msgr2=0x7f41980b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 shutdown_connections 2023-10-09T15:38:21.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.325+0000 7f419d704700 1 -- 172.21.15.33:0/2999380933 wait complete. 2023-10-09T15:38:21.338 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:38:21.339 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:38:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.460+0000 7f096e630700 1 Processor -- start 2023-10-09T15:38:21.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.460+0000 7f096e630700 1 -- start start 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096e630700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0968142ca0 0x7f096815dd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096e630700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096815d8d0 con 0x7f0968143070 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096e630700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f096815d2f0 con 0x7f09680cb450 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096e630700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09680cc630 con 0x7f0968142ca0 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096ce2d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0968143070 0x7f09680cad40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55556/0 (socket says 172.21.15.33:55556) 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096ce2d700 1 -- 172.21.15.33:0/1166544137 learned_addr learned my addr 172.21.15.33:0/1166544137 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f096d62e700 1 --2- 172.21.15.33:0/1166544137 >> v2:172.21.15.59:3300/0 conn(0x7f0968142ca0 0x7f096815dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4198540285 0 0) 0x7f096815d8d0 con 0x7f0968143070 2023-10-09T15:38:21.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.461+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0950003570 con 0x7f0968143070 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2727616779 0 0) 0x7f096815d2f0 con 0x7f09680cb450 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f096815d8d0 con 0x7f09680cb450 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f096d62e700 1 -- 172.21.15.33:0/1166544137 >> v1:172.21.15.59:6789/0 conn(0x7f09680cb450 legacy=0x7f096806dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f096d62e700 1 -- 172.21.15.33:0/1166544137 >> v1:172.21.15.33:6789/0 conn(0x7f0968143070 legacy=0x7f09680cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f096d62e700 1 -- 172.21.15.33:0/1166544137 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096815d560 con 0x7f0968142ca0 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f096d62e700 1 --2- 172.21.15.33:0/1166544137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f096815dd60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e60 tx=0x7f0958009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=452449ac8e31dee2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800e070 con 0x7f0968142ca0 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095800bab0 con 0x7f0968142ca0 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.462+0000 7f0967fff700 1 -- 172.21.15.33:0/1166544137 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095800be70 con 0x7f0968142ca0 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 -- 172.21.15.33:0/1166544137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 msgr2=0x7f096815dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 --2- 172.21.15.33:0/1166544137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f096815dd60 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f0958009e60 tx=0x7f0958009780 comp rx=0 tx=0).stop 2023-10-09T15:38:21.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 -- 172.21.15.33:0/1166544137 shutdown_connections 2023-10-09T15:38:21.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 --2- 172.21.15.33:0/1166544137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f096815dd60 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 -- 172.21.15.33:0/1166544137 >> 172.21.15.33:0/1166544137 conn(0x7f0968067c80 msgr2=0x7f0968068080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:21.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 -- 172.21.15.33:0/1166544137 shutdown_connections 2023-10-09T15:38:21.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.463+0000 7f096e630700 1 -- 172.21.15.33:0/1166544137 wait complete. 2023-10-09T15:38:21.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.464+0000 7f096e630700 1 Processor -- start 2023-10-09T15:38:21.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.464+0000 7f096e630700 1 -- start start 2023-10-09T15:38:21.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09680cb450 0x7f096815c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f0968158ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680ae220 con 0x7f0968143070 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b33c0 con 0x7f0968142ca0 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b30e0 con 0x7f09680cb450 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36772/0 (socket says 172.21.15.33:36772) 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 -- 172.21.15.33:0/1849371439 learned_addr learned my addr 172.21.15.33:0/1849371439 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096ce2d700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f0968158ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096d62e700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09680cb450 0x7f096815c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 -- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09680cb450 msgr2=0x7f096815c1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09680cb450 0x7f096815c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 -- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 msgr2=0x7f0968158ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f0968158ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 -- 172.21.15.33:0/1849371439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0958009a20 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096ce2d700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f0968158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096de2f700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f096000c4b0 tx=0x7f0960007d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011590 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09680adbd0 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09680c4e90 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0960011900 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.465+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0960011a70 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.466+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096804c3c0 con 0x7f0968143070 2023-10-09T15:38:21.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.467+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f096001c460 con 0x7f0968143070 2023-10-09T15:38:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.467+0000 7f09657fa700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.467+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0960084610 con 0x7f0968143070 2023-10-09T15:38:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.467+0000 7f096d62e700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:21.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.468+0000 7f096d62e700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0958009460 tx=0x7f0958019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:21.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.472+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f09600515f0 con 0x7f0968143070 2023-10-09T15:38:21.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:21.667+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f09680cc910 con 0x7f0968143070 2023-10-09T15:38:22.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.277+0000 7f09657fa700 1 -- 172.21.15.33:0/1849371439 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) v1 ==== 138+0+0 (secure 0 0 0) 0x7f0960054c10 con 0x7f0968143070 2023-10-09T15:38:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 msgr2=0x7f09540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0958009460 tx=0x7f0958019000 comp rx=0 tx=0).stop 2023-10-09T15:38:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 msgr2=0x7f0968159020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f096000c4b0 tx=0x7f0960007d50 comp rx=0 tx=0).stop 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 shutdown_connections 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0968143070 0x7f0968159020 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f09680cb450 0x7f096815c1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 --2- 172.21.15.33:0/1849371439 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968142ca0 0x7f0968158ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 >> 172.21.15.33:0/1849371439 conn(0x7f0968067c80 msgr2=0x7f09680c32a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 shutdown_connections 2023-10-09T15:38:22.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.280+0000 7f096e630700 1 -- 172.21.15.33:0/1849371439 wait complete. 2023-10-09T15:38:22.283 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:38:22.298 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:38:22.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 Processor -- start 2023-10-09T15:38:22.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 -- start start 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67a8159530 0x7f67a80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 0x7f67a8159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67a80ccfd0 con 0x7f67a806e0e0 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67a80cf0e0 con 0x7f67a8159530 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.428+0000 7f67b0405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a815a3d0 con 0x7f67a806dc70 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ae9a2700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f67a806e0e0 0x7f67a80cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55570/0 (socket says 172.21.15.33:55570) 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ae9a2700 1 -- 172.21.15.33:0/473308788 learned_addr learned my addr 172.21.15.33:0/473308788 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/473308788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 0x7f67a8159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ae1a1700 1 --2- 172.21.15.33:0/473308788 >> v2:172.21.15.59:3300/0 conn(0x7f67a8159530 0x7f67a80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3390528290 0 0) 0x7f67a80ccfd0 con 0x7f67a806e0e0 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6790003570 con 0x7f67a806e0e0 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 -- 172.21.15.33:0/473308788 >> v2:172.21.15.59:3300/0 conn(0x7f67a8159530 msgr2=0x7f67a80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/473308788 >> v2:172.21.15.59:3300/0 conn(0x7f67a8159530 0x7f67a80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 -- 172.21.15.33:0/473308788 >> v1:172.21.15.33:6789/0 conn(0x7f67a806e0e0 legacy=0x7f67a80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3798689601 0 0) 0x7f6790003570 con 0x7f67a806e0e0 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 -- 172.21.15.33:0/473308788 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a815a6b0 con 0x7f67a806dc70 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.429+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/473308788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 0x7f67a8159900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f679c0098e0 tx=0x7f679c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93a379bbd48ec754 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a0001470 con 0x7f67a806dc70 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679c011420 con 0x7f67a806dc70 2023-10-09T15:38:22.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67ad19f700 1 -- 172.21.15.33:0/473308788 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679c0117c0 con 0x7f67a806dc70 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 -- 172.21.15.33:0/473308788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 msgr2=0x7f67a8159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 --2- 172.21.15.33:0/473308788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 0x7f67a8159900 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f679c0098e0 tx=0x7f679c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 -- 172.21.15.33:0/473308788 shutdown_connections 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 --2- 172.21.15.33:0/473308788 >> v2:172.21.15.59:3300/0 conn(0x7f67a8159530 0x7f67a80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 --2- 172.21.15.33:0/473308788 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a806dc70 0x7f67a8159900 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 -- 172.21.15.33:0/473308788 >> 172.21.15.33:0/473308788 conn(0x7f67a80703a0 msgr2=0x7f67a80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:22.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 -- 172.21.15.33:0/473308788 shutdown_connections 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.430+0000 7f67b0405700 1 -- 172.21.15.33:0/473308788 wait complete. 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.431+0000 7f67b0405700 1 Processor -- start 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.431+0000 7f67b0405700 1 -- start start 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67a806e0e0 0x7f67a8153bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 0x7f67a80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a816dd80 con 0x7f67a806dc70 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67a816d170 con 0x7f67a806e0e0 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67b0405700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67a816d450 con 0x7f67a8159530 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67ae1a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67ae1a1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36788/0 (socket says 172.21.15.33:36788) 2023-10-09T15:38:22.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67ae1a1700 1 -- 172.21.15.33:0/926878614 learned_addr learned my addr 172.21.15.33:0/926878614 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.432+0000 7f67ae9a2700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 0x7f67a80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67a806e0e0 0x7f67a8153bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 -- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 msgr2=0x7f67a80b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 0x7f67a80b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 -- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67a806e0e0 msgr2=0x7f67a8153bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67a806e0e0 0x7f67a8153bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 -- 172.21.15.33:0/926878614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f679c009420 con 0x7f67a806dc70 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae9a2700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 0x7f67a80b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67ae1a1700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f6798009e50 tx=0x7f679800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f679800cc20 con 0x7f67a806dc70 2023-10-09T15:38:22.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f679800f040 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67a816d730 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6798014480 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.433+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67a80b5c40 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.434+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67a80c7770 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.434+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f67980147f0 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.435+0000 7f67a67fc700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 0x7f67940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.435+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f6798085860 con 0x7f67a806dc70 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.435+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 0x7f67940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:22.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.435+0000 7f67ad9a0700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 0x7f67940697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67a80b6510 tx=0x7f679c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:22.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.439+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67980525c0 con 0x7f67a806dc70 2023-10-09T15:38:22.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:22.636+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f67a804c3c0 con 0x7f67a806dc70 2023-10-09T15:38:23.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.281+0000 7f67a67fc700 1 -- 172.21.15.33:0/926878614 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) v1 ==== 170+0+0 (secure 0 0 0) 0x7f6798055be0 con 0x7f67a806dc70 2023-10-09T15:38:23.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.286+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 msgr2=0x7f67940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.286+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 0x7f67940697d0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f67a80b6510 tx=0x7f679c016000 comp rx=0 tx=0).stop 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.286+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 msgr2=0x7f67a80b5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.286+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f6798009e50 tx=0x7f679800b040 comp rx=0 tx=0).stop 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 shutdown_connections 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6794067320 0x7f67940697d0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67a806dc70 0x7f67a80b5700 secure :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7f6798009e50 tx=0x7f679800b040 comp rx=0 tx=0).stop 2023-10-09T15:38:23.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67a8159530 0x7f67a80b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 --2- 172.21.15.33:0/926878614 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67a806e0e0 0x7f67a8153bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.287+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 >> 172.21.15.33:0/926878614 conn(0x7f67a80703a0 msgr2=0x7f67a80cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:23.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.289+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 shutdown_connections 2023-10-09T15:38:23.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.290+0000 7f67b0405700 1 -- 172.21.15.33:0/926878614 wait complete. 2023-10-09T15:38:23.300 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:38:23.314 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:38:23.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.440+0000 7f1e89253700 1 Processor -- start 2023-10-09T15:38:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.440+0000 7f1e89253700 1 -- start start 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e89253700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e89253700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e84159c90 0x7f1e840c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e89253700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e840c9310 con 0x7f1e840cd460 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e89253700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e840ad990 con 0x7f1e84159c90 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e89253700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840ce090 con 0x7f1e841598c0 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e8259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e84159c90 0x7f1e840c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e8359e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1e840cd460 0x7f1e840cd8e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55584/0 (socket says 172.21.15.33:55584) 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e8359e700 1 -- 172.21.15.33:0/3273134007 learned_addr learned my addr 172.21.15.33:0/3273134007 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.441+0000 7f1e82d9d700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e8259c700 1 -- 172.21.15.33:0/3273134007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 msgr2=0x7f1e840c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e8259c700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e8259c700 1 -- 172.21.15.33:0/3273134007 >> v1:172.21.15.33:6789/0 conn(0x7f1e840cd460 legacy=0x7f1e840cd8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e8259c700 1 -- 172.21.15.33:0/3273134007 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e840c8cc0 con 0x7f1e84159c90 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e81d9b700 1 -- 172.21.15.33:0/3273134007 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4197132983 0 0) 0x7f1e840c9310 con 0x7f1e840cd460 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e8259c700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840c43b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0098e0 tx=0x7f1e6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e3e8b4e1f5f8bff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e81d9b700 1 -- 172.21.15.33:0/3273134007 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00b640 con 0x7f1e84159c90 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e81d9b700 1 -- 172.21.15.33:0/3273134007 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c00b7a0 con 0x7f1e84159c90 2023-10-09T15:38:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e81d9b700 1 -- 172.21.15.33:0/3273134007 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c00bb40 con 0x7f1e84159c90 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e89253700 1 -- 172.21.15.33:0/3273134007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 msgr2=0x7f1e840c43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.442+0000 7f1e89253700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840c43b0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c0098e0 tx=0x7f1e6c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 -- 172.21.15.33:0/3273134007 shutdown_connections 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 --2- 172.21.15.33:0/3273134007 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840c43b0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 -- 172.21.15.33:0/3273134007 >> 172.21.15.33:0/3273134007 conn(0x7f1e84088000 msgr2=0x7f1e840883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 -- 172.21.15.33:0/3273134007 shutdown_connections 2023-10-09T15:38:23.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.443+0000 7f1e89253700 1 -- 172.21.15.33:0/3273134007 wait complete. 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.444+0000 7f1e89253700 1 Processor -- start 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.444+0000 7f1e89253700 1 -- start start 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e840cd460 0x7f1e8414a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840b4100 con 0x7f1e84159c90 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e8414a970 con 0x7f1e840cd460 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e840c6e80 con 0x7f1e841598c0 2023-10-09T15:38:23.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36802/0 (socket says 172.21.15.33:36802) 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 -- 172.21.15.33:0/935324689 learned_addr learned my addr 172.21.15.33:0/935324689 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8259c700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e82d9d700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e840cd460 0x7f1e8414a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 -- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 msgr2=0x7f1e840adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 -- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e840cd460 msgr2=0x7f1e8414a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e840cd460 0x7f1e8414a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 -- 172.21.15.33:0/935324689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009420 con 0x7f1e84159c90 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e8359e700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c7e0 tx=0x7f1e74007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:23.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74005c00 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e74005d80 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e840b1de0 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e74007320 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.445+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e840ae050 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.446+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e840c6ff0 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.447+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e7401b3b0 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.447+0000 7f1e7affd700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 0x7f1e640697a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.447+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f1e74084050 con 0x7f1e84159c90 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.447+0000 7f1e82d9d700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 0x7f1e640697a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:23.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.448+0000 7f1e82d9d700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 0x7f1e640697a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00f570 tx=0x7f1e7c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:23.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.452+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e840c6ff0 con 0x7f1e84159c90 2023-10-09T15:38:23.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:23.689+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f1e840c6ff0 con 0x7f1e84159c90 2023-10-09T15:38:24.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.308+0000 7f1e7affd700 1 -- 172.21.15.33:0/935324689 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v89) v1 ==== 174+0+0 (secure 0 0 0) 0x7f1e840c6ff0 con 0x7f1e84159c90 2023-10-09T15:38:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.318+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 msgr2=0x7f1e640697a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.318+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 0x7f1e640697a0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f1e7c00f570 tx=0x7f1e7c00b040 comp rx=0 tx=0).stop 2023-10-09T15:38:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.318+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 msgr2=0x7f1e840b38b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.318+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f1e7400c7e0 tx=0x7f1e74007d90 comp rx=0 tx=0).stop 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 shutdown_connections 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e640672f0 0x7f1e640697a0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e84159c90 0x7f1e840b38b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e840cd460 0x7f1e8414a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 --2- 172.21.15.33:0/935324689 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e841598c0 0x7f1e840adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 >> 172.21.15.33:0/935324689 conn(0x7f1e84088000 msgr2=0x7f1e840ca2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 shutdown_connections 2023-10-09T15:38:24.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.319+0000 7f1e89253700 1 -- 172.21.15.33:0/935324689 wait complete. 2023-10-09T15:38:24.325 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 24 and data pool 25 2023-10-09T15:38:24.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.456+0000 7fa08708f700 1 Processor -- start 2023-10-09T15:38:24.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.456+0000 7fa08708f700 1 -- start start 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08708f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa080159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08708f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08015ae40 con 0x7fa08015a400 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08708f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa08015ab60 con 0x7fa0800cb5a0 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08708f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800ce0f0 con 0x7fa0800cb970 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08562c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa08015a400 0x7fa080156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55588/0 (socket says 172.21.15.33:55588) 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa08562c700 1 -- 172.21.15.33:0/2131767843 learned_addr learned my addr 172.21.15.33:0/2131767843 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07ffff700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa080159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2680029916 0 0) 0x7fa08015ae40 con 0x7fa08015a400 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa070003570 con 0x7fa08015a400 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 809235878 0 0) 0x7fa070003570 con 0x7fa08015a400 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 msgr2=0x7fa080159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa080159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 >> v1:172.21.15.59:6789/0 conn(0x7fa0800cb5a0 legacy=0x7fa0800cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800ccf00 con 0x7fa08015a400 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa0780017f0 con 0x7fa08015a400 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.457+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 >> v1:172.21.15.33:6789/0 conn(0x7fa08015a400 legacy=0x7fa080156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa070003a90 0x7fa070003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa070004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070004d50 0x7fa0700051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800ce0f0 con 0x7fa070003a90 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07000bb40 con 0x7fa070004d50 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07000bd00 con 0x7fa0800cb970 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa070003a90 0x7fa070003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07ffff700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa070004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa08562c700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070004d50 0x7fa0700051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 -- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 msgr2=0x7fa070004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800cb970 0x7fa070004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 -- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070004d50 msgr2=0x7fa0700051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070004d50 0x7fa0700051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 -- 172.21.15.33:0/2131767843 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa070003570 con 0x7fa070003a90 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa084e2b700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa070003a90 0x7fa070003e60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa0740019a0 tx=0x7fa074007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61b4f6a05884d6b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400c5d0 con 0x7fa070003a90 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07400c730 con 0x7fa070003a90 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.458+0000 7fa07f7fe700 1 -- 172.21.15.33:0/2131767843 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07400cad0 con 0x7fa070003a90 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 -- 172.21.15.33:0/2131767843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa070003a90 msgr2=0x7fa070003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 --2- 172.21.15.33:0/2131767843 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa070003a90 0x7fa070003e60 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fa0740019a0 tx=0x7fa074007d10 comp rx=0 tx=0).stop 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08562c700 1 -- 172.21.15.33:0/2131767843 reap_dead start 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 -- 172.21.15.33:0/2131767843 shutdown_connections 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 -- 172.21.15.33:0/2131767843 >> 172.21.15.33:0/2131767843 conn(0x7fa080070e30 msgr2=0x7fa0800d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 -- 172.21.15.33:0/2131767843 shutdown_connections 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.459+0000 7fa08708f700 1 -- 172.21.15.33:0/2131767843 wait complete. 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.460+0000 7fa08708f700 1 Processor -- start 2023-10-09T15:38:24.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.460+0000 7fa08708f700 1 -- start start 2023-10-09T15:38:24.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 0x7fa0801523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800b05b0 0x7fa0800b0a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800cbde0 con 0x7fa0801539b0 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800b0f90 con 0x7fa070003a90 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08708f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0800c8ed0 con 0x7fa0800b05b0 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36828/0 (socket says 172.21.15.33:36828) 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 -- 172.21.15.33:0/1215022100 learned_addr learned my addr 172.21.15.33:0/1215022100 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa084e2b700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 0x7fa0801523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa08562c700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800b05b0 0x7fa0800b0a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 -- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800b05b0 msgr2=0x7fa0800b0a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800b05b0 0x7fa0800b0a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 -- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 msgr2=0x7fa0801523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 0x7fa0801523d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa07ffff700 1 -- 172.21.15.33:0/1215022100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0800c9d30 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.461+0000 7fa084e2b700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 0x7fa0801523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa07ffff700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa06c011d70 tx=0x7fa06c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00fac0 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00fc20 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c014440 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa080152910 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.462+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0800c9400 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.463+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa08004c3c0 con 0x7fa0801539b0 2023-10-09T15:38:24.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.463+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa06c014870 con 0x7fa0801539b0 2023-10-09T15:38:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.463+0000 7fa07cff9700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 0x7fa0640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.464+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa06c018030 con 0x7fa0801539b0 2023-10-09T15:38:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.464+0000 7fa084e2b700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 0x7fa0640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.464+0000 7fa084e2b700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 0x7fa0640697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa074008fd0 tx=0x7fa074015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.468+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa06c052320 con 0x7fa0801539b0 2023-10-09T15:38:24.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.663+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0800cc2e0 con 0x7fa0801539b0 2023-10-09T15:38:24.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.664+0000 7fa07cff9700 1 -- 172.21.15.33:0/1215022100 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fa06c055940 con 0x7fa0801539b0 2023-10-09T15:38:24.665 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:24.665 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":139,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:23.691419+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:22.667405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 msgr2=0x7fa0640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 0x7fa0640697d0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fa074008fd0 tx=0x7fa074015000 comp rx=0 tx=0).stop 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 msgr2=0x7fa080151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fa06c011d70 tx=0x7fa06c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 shutdown_connections 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa064067320 0x7fa0640697d0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0800b05b0 0x7fa0800b0a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa070003a90 0x7fa0801523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 --2- 172.21.15.33:0/1215022100 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0801539b0 0x7fa080151110 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 >> 172.21.15.33:0/1215022100 conn(0x7fa080070e30 msgr2=0x7fa0800b16f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 shutdown_connections 2023-10-09T15:38:24.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.666+0000 7fa08708f700 1 -- 172.21.15.33:0/1215022100 wait complete. 2023-10-09T15:38:24.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:24.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.798+0000 7fd1f651b700 1 Processor -- start 2023-10-09T15:38:24.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.798+0000 7fd1f651b700 1 -- start start 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f651b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd1f015de50 0x7fd1f00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f651b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f00cf3c0 con 0x7fd1f00cef40 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f651b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1f015afd0 con 0x7fd1f0153c30 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f651b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1f015b2b0 con 0x7fd1f015de50 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f4d18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd1f015de50 0x7fd1f00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f5d1a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd1f00cef40 0x7fd1f015c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55594/0 (socket says 172.21.15.33:55594) 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f5d1a700 1 -- 172.21.15.33:0/2988853828 learned_addr learned my addr 172.21.15.33:0/2988853828 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:24.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f4d18700 1 -- 172.21.15.33:0/2988853828 >> v1:172.21.15.59:6789/0 conn(0x7fd1f0153c30 legacy=0x7fd1f015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f4d18700 1 -- 172.21.15.33:0/2988853828 >> v1:172.21.15.33:6789/0 conn(0x7fd1f00cef40 legacy=0x7fd1f015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.799+0000 7fd1f4d18700 1 -- 172.21.15.33:0/2988853828 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1f015b590 con 0x7fd1f015de50 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f4d18700 1 --2- 172.21.15.33:0/2988853828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015de50 0x7fd1f00cea00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40098e0 tx=0x7fd1e40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a910d4647b9fb51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1effff700 1 -- 172.21.15.33:0/2988853828 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e4009e80 con 0x7fd1f015de50 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1effff700 1 -- 172.21.15.33:0/2988853828 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e400b860 con 0x7fd1f015de50 2023-10-09T15:38:24.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1effff700 1 -- 172.21.15.33:0/2988853828 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e400bbe0 con 0x7fd1f015de50 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 -- 172.21.15.33:0/2988853828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015de50 msgr2=0x7fd1f00cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 --2- 172.21.15.33:0/2988853828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015de50 0x7fd1f00cea00 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40098e0 tx=0x7fd1e40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 -- 172.21.15.33:0/2988853828 shutdown_connections 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 --2- 172.21.15.33:0/2988853828 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f015de50 0x7fd1f00cea00 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 -- 172.21.15.33:0/2988853828 >> 172.21.15.33:0/2988853828 conn(0x7fd1f00703a0 msgr2=0x7fd1f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 -- 172.21.15.33:0/2988853828 shutdown_connections 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.800+0000 7fd1f651b700 1 -- 172.21.15.33:0/2988853828 wait complete. 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 Processor -- start 2023-10-09T15:38:24.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 -- start start 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1f0153c30 0x7fd1f00c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f015de50 0x7fd1f013e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00b5500 con 0x7fd1f00cef40 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00b4950 con 0x7fd1f015de50 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.802+0000 7fd1f651b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1f00b4bd0 con 0x7fd1f0153c30 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36838/0 (socket says 172.21.15.33:36838) 2023-10-09T15:38:24.806 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 -- 172.21.15.33:0/3077306408 learned_addr learned my addr 172.21.15.33:0/3077306408 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f4d18700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1f0153c30 0x7fd1f00c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5d1a700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f015de50 0x7fd1f013e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 -- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1f0153c30 msgr2=0x7fd1f00c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1f0153c30 0x7fd1f00c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 -- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f015de50 msgr2=0x7fd1f013e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f015de50 0x7fd1f013e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 -- 172.21.15.33:0/3077306408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1e4009420 con 0x7fd1f00cef40 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f5519700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000cb10 tx=0x7fd1e00017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000ce20 con 0x7fd1f00cef40 2023-10-09T15:38:24.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1e000a7e0 con 0x7fd1f00cef40 2023-10-09T15:38:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1f00b4eb0 con 0x7fd1f00cef40 2023-10-09T15:38:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1e000aba0 con 0x7fd1f00cef40 2023-10-09T15:38:24.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.803+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1f00ca1e0 con 0x7fd1f00cef40 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.804+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1f004c3c0 con 0x7fd1f00cef40 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.805+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd1e0003030 con 0x7fd1f00cef40 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.805+0000 7fd1ed7fa700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 0x7fd1dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.805+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd1e0084c50 con 0x7fd1f00cef40 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.805+0000 7fd1f4d18700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 0x7fd1dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:24.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.805+0000 7fd1f4d18700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 0x7fd1dc0697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40091e0 tx=0x7fd1e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:24.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:24.809+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd1e00518e0 con 0x7fd1f00cef40 2023-10-09T15:38:25.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.002+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd1f015db00 con 0x7fd1f00cef40 2023-10-09T15:38:25.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.003+0000 7fd1ed7fa700 1 -- 172.21.15.33:0/3077306408 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fd1e0054f00 con 0x7fd1f00cef40 2023-10-09T15:38:25.004 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:25.005 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":139,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:23.691419+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:22.667405+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 msgr2=0x7fd1dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 0x7fd1dc0697d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fd1e40091e0 tx=0x7fd1e4017000 comp rx=0 tx=0).stop 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 msgr2=0x7fd1f00cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fd1e000cb10 tx=0x7fd1e00017b0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 shutdown_connections 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd1dc067320 0x7fd1dc0697d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd1f00cef40 0x7fd1f00cccd0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd1f015de50 0x7fd1f013e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 --2- 172.21.15.33:0/3077306408 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd1f0153c30 0x7fd1f00c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 >> 172.21.15.33:0/3077306408 conn(0x7fd1f00703a0 msgr2=0x7fd1f01510b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:25.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 shutdown_connections 2023-10-09T15:38:25.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.005+0000 7fd1f651b700 1 -- 172.21.15.33:0/3077306408 wait complete. 2023-10-09T15:38:25.019 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:38:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.140+0000 7f4b75979700 1 Processor -- start 2023-10-09T15:38:25.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.140+0000 7f4b75979700 1 -- start start 2023-10-09T15:38:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b75979700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b700cc320 0x7f4b7013c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b75979700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7006d7b0 con 0x7f4b700cc6f0 2023-10-09T15:38:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b75979700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b7006e330 con 0x7f4b7006a110 2023-10-09T15:38:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b75979700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b7006a570 con 0x7f4b700cc320 2023-10-09T15:38:25.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6effd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4b700cc320 0x7f4b7013c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6e7fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4b700cc6f0 0x7f4b70069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55602/0 (socket says 172.21.15.33:55602) 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6e7fc700 1 -- 172.21.15.33:0/265263561 learned_addr learned my addr 172.21.15.33:0/265263561 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6effd700 1 -- 172.21.15.33:0/265263561 >> v1:172.21.15.59:6789/0 conn(0x7f4b7006a110 legacy=0x7f4b7006e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6effd700 1 -- 172.21.15.33:0/265263561 >> v1:172.21.15.33:6789/0 conn(0x7f4b700cc6f0 legacy=0x7f4b70069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.141+0000 7f4b6effd700 1 -- 172.21.15.33:0/265263561 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b7006da00 con 0x7f4b700cc320 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b6effd700 1 --2- 172.21.15.33:0/265263561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc320 0x7f4b7013c2a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009e60 tx=0x7f4b60009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32f963aa5a42166 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b6dffb700 1 -- 172.21.15.33:0/265263561 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6000e070 con 0x7f4b700cc320 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b6dffb700 1 -- 172.21.15.33:0/265263561 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6000bbf0 con 0x7f4b700cc320 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b6dffb700 1 -- 172.21.15.33:0/265263561 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b60012430 con 0x7f4b700cc320 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 -- 172.21.15.33:0/265263561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc320 msgr2=0x7f4b7013c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 --2- 172.21.15.33:0/265263561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc320 0x7f4b7013c2a0 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7f4b60009e60 tx=0x7f4b60009780 comp rx=0 tx=0).stop 2023-10-09T15:38:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 -- 172.21.15.33:0/265263561 shutdown_connections 2023-10-09T15:38:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 --2- 172.21.15.33:0/265263561 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc320 0x7f4b7013c2a0 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 -- 172.21.15.33:0/265263561 >> 172.21.15.33:0/265263561 conn(0x7f4b70067f00 msgr2=0x7f4b70068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 -- 172.21.15.33:0/265263561 shutdown_connections 2023-10-09T15:38:25.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.142+0000 7f4b75979700 1 -- 172.21.15.33:0/265263561 wait complete. 2023-10-09T15:38:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.143+0000 7f4b75979700 1 Processor -- start 2023-10-09T15:38:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 -- start start 2023-10-09T15:38:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7006a110 0x7f4b700c78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:25.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700cc320 0x7f4b700adb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700ae780 con 0x7f4b700cc6f0 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700aea60 con 0x7f4b700cc320 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b75979700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b700aef60 con 0x7f4b7006a110 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b6f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b6f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36850/0 (socket says 172.21.15.33:36850) 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.144+0000 7f4b6f7fe700 1 -- 172.21.15.33:0/2071884086 learned_addr learned my addr 172.21.15.33:0/2071884086 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6e7fc700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700cc320 0x7f4b700adb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6effd700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7006a110 0x7f4b700c78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 -- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7006a110 msgr2=0x7f4b700c78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.148 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7006a110 0x7f4b700c78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 -- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700cc320 msgr2=0x7f4b700adb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700cc320 0x7f4b700adb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 -- 172.21.15.33:0/2071884086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b60009a20 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b6f7fe700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c5b0 tx=0x7f4b68007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011590 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b68011710 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b700af240 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b68011ad0 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.145+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b7016a660 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.146+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b7016a8e0 con 0x7f4b700cc6f0 2023-10-09T15:38:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.146+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4b6801c460 con 0x7f4b700cc6f0 2023-10-09T15:38:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.147+0000 7f4b66ffd700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 0x7f4b500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.147+0000 7f4b6effd700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 0x7f4b500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:25.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.147+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4b68084940 con 0x7f4b700cc6f0 2023-10-09T15:38:25.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.147+0000 7f4b6effd700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 0x7f4b500697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b600099f0 tx=0x7f4b60018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:25.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.151+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4b680515d0 con 0x7f4b700cc6f0 2023-10-09T15:38:25.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:25.393+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4b7004c3c0 con 0x7f4b700cc6f0 2023-10-09T15:38:26.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.314+0000 7f4b66ffd700 1 -- 172.21.15.33:0/2071884086 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v92) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4b68054bf0 con 0x7f4b700cc6f0 2023-10-09T15:38:26.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 msgr2=0x7f4b500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 0x7f4b500697d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4b600099f0 tx=0x7f4b60018000 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 msgr2=0x7f4b700ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7f4b6800c5b0 tx=0x7f4b68007f60 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 shutdown_connections 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4b50067320 0x7f4b500697d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4b700cc6f0 0x7f4b700ae070 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4b7006a110 0x7f4b700c78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 --2- 172.21.15.33:0/2071884086 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4b700cc320 0x7f4b700adb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.316+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 >> 172.21.15.33:0/2071884086 conn(0x7f4b70067f00 msgr2=0x7f4b700b12a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:26.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.317+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 shutdown_connections 2023-10-09T15:38:26.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.317+0000 7f4b75979700 1 -- 172.21.15.33:0/2071884086 wait complete. 2023-10-09T15:38:26.332 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:38:26.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.461+0000 7f89c0b60700 1 Processor -- start 2023-10-09T15:38:26.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.461+0000 7f89c0b60700 1 -- start start 2023-10-09T15:38:26.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89c0b60700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f89bc06e0e0 0x7f89bc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:26.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89c0b60700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc0ccfd0 con 0x7f89bc06dc70 2023-10-09T15:38:26.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89c0b60700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89bc15a3d0 con 0x7f89bc159530 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89c0b60700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89bc15a6b0 con 0x7f89bc06e0e0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b9d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f89bc06dc70 0x7f89bc159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55610/0 (socket says 172.21.15.33:55610) 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89bad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f89bc06e0e0 0x7f89bc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b9d9b700 1 -- 172.21.15.33:0/4060157180 learned_addr learned my addr 172.21.15.33:0/4060157180 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89bad9d700 1 -- 172.21.15.33:0/4060157180 >> v1:172.21.15.59:6789/0 conn(0x7f89bc159530 legacy=0x7f89bc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89bad9d700 1 -- 172.21.15.33:0/4060157180 >> v1:172.21.15.33:6789/0 conn(0x7f89bc06dc70 legacy=0x7f89bc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89bad9d700 1 -- 172.21.15.33:0/4060157180 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89bc15a990 con 0x7f89bc06e0e0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b959a700 1 -- 172.21.15.33:0/4060157180 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 722112310 0 0) 0x7f89bc0ccfd0 con 0x7f89bc06dc70 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89bad9d700 1 --2- 172.21.15.33:0/4060157180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0cb6f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009e60 tx=0x7f89b4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6068c2ad7a0fb46 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b959a700 1 -- 172.21.15.33:0/4060157180 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b400e070 con 0x7f89bc06e0e0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b959a700 1 -- 172.21.15.33:0/4060157180 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89b400bbf0 con 0x7f89bc06e0e0 2023-10-09T15:38:26.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.462+0000 7f89b959a700 1 -- 172.21.15.33:0/4060157180 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89b4012430 con 0x7f89bc06e0e0 2023-10-09T15:38:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 -- 172.21.15.33:0/4060157180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 msgr2=0x7f89bc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 --2- 172.21.15.33:0/4060157180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0cb6f0 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7f89b4009e60 tx=0x7f89b4009780 comp rx=0 tx=0).stop 2023-10-09T15:38:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 -- 172.21.15.33:0/4060157180 shutdown_connections 2023-10-09T15:38:26.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 --2- 172.21.15.33:0/4060157180 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0cb6f0 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 -- 172.21.15.33:0/4060157180 >> 172.21.15.33:0/4060157180 conn(0x7f89bc0703a0 msgr2=0x7f89bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 -- 172.21.15.33:0/4060157180 shutdown_connections 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.463+0000 7f89c0b60700 1 -- 172.21.15.33:0/4060157180 wait complete. 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.464+0000 7f89c0b60700 1 Processor -- start 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.464+0000 7f89c0b60700 1 -- start start 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc06dc70 0x7f89bc16a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc159530 0x7f89bc0c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc1697f0 con 0x7f89bc06e0e0 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0ca470 con 0x7f89bc159530 2023-10-09T15:38:26.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89c0b60700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89bc0c7b70 con 0x7f89bc06dc70 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36862/0 (socket says 172.21.15.33:36862) 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 -- 172.21.15.33:0/3913354486 learned_addr learned my addr 172.21.15.33:0/3913354486 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89bad9d700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc159530 0x7f89bc0c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89ba59c700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc06dc70 0x7f89bc16a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 -- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc06dc70 msgr2=0x7f89bc16a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc06dc70 0x7f89bc16a9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.465+0000 7f89b9d9b700 1 -- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc159530 msgr2=0x7f89bc0c97b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b9d9b700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc159530 0x7f89bc0c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b9d9b700 1 -- 172.21.15.33:0/3913354486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b4009a20 con 0x7f89bc06e0e0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b9d9b700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c7e0 tx=0x7f89a4007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4005b30 con 0x7f89bc06e0e0 2023-10-09T15:38:26.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a4005c90 con 0x7f89bc06e0e0 2023-10-09T15:38:26.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89bc0c7e50 con 0x7f89bc06e0e0 2023-10-09T15:38:26.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a4007300 con 0x7f89bc06e0e0 2023-10-09T15:38:26.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.466+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89bc0c8410 con 0x7f89bc06e0e0 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.467+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89bc169940 con 0x7f89bc06e0e0 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.467+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f89a401b400 con 0x7f89bc06e0e0 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.468+0000 7f89b27fc700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 0x7f899c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.468+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f89a40847f0 con 0x7f89bc06e0e0 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.468+0000 7f89ba59c700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 0x7f899c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:26.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.468+0000 7f89ba59c700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 0x7f899c0697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0c9520 tx=0x7f89ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:26.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.472+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89bc169940 con 0x7f89bc06e0e0 2023-10-09T15:38:26.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:26.714+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f89bc169940 con 0x7f89bc06e0e0 2023-10-09T15:38:27.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.315+0000 7f89b27fc700 1 -- 172.21.15.33:0/3913354486 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v93) v1 ==== 122+0+0 (secure 0 0 0) 0x7f89bc169940 con 0x7f89bc06e0e0 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 msgr2=0x7f899c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 0x7f899c0697d0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f89bc0c9520 tx=0x7f89ac008040 comp rx=0 tx=0).stop 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 msgr2=0x7f89bc0b5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7f89a400c7e0 tx=0x7f89a4007df0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 shutdown_connections 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f899c067320 0x7f899c0697d0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89bc159530 0x7f89bc0c97b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89bc06dc70 0x7f89bc16a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 --2- 172.21.15.33:0/3913354486 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89bc06e0e0 0x7f89bc0b5390 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 >> 172.21.15.33:0/3913354486 conn(0x7f89bc0703a0 msgr2=0x7f89bc154e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.317+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 shutdown_connections 2023-10-09T15:38:27.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.318+0000 7f89c0b60700 1 -- 172.21.15.33:0/3913354486 wait complete. 2023-10-09T15:38:27.333 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:27.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.457+0000 7f952fea2700 1 Processor -- start 2023-10-09T15:38:27.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 -- start start 2023-10-09T15:38:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95281595d0 0x7f95281599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f95280675a0 0x7f952806acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952806b230 0x7f95280c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f952806bd00 con 0x7f95281595d0 2023-10-09T15:38:27.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95280c7f50 con 0x7f95280675a0 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.458+0000 7f952fea2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952806b740 con 0x7f952806b230 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95281595d0 0x7f95281599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f95281595d0 0x7f95281599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36866/0 (socket says 172.21.15.33:36866) 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 -- 172.21.15.33:0/672057199 learned_addr learned my addr 172.21.15.33:0/672057199 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952d43d700 1 --2- 172.21.15.33:0/672057199 >> v2:172.21.15.59:3300/0 conn(0x7f95280675a0 0x7f952806acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952e43f700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952806b230 0x7f95280c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 -- 172.21.15.33:0/672057199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952806b230 msgr2=0x7f95280c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952806b230 0x7f95280c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 -- 172.21.15.33:0/672057199 >> v2:172.21.15.59:3300/0 conn(0x7f95280675a0 msgr2=0x7f952806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 --2- 172.21.15.33:0/672057199 >> v2:172.21.15.59:3300/0 conn(0x7f95280675a0 0x7f952806acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 -- 172.21.15.33:0/672057199 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f952806ba20 con 0x7f95281595d0 2023-10-09T15:38:27.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952dc3e700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95281595d0 0x7f95281599a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f95280ce450 tx=0x7f9518009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4072e0fb6c0e4c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952cc3c700 1 -- 172.21.15.33:0/672057199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951800e070 con 0x7f95281595d0 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952cc3c700 1 -- 172.21.15.33:0/672057199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951800ba50 con 0x7f95281595d0 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.459+0000 7f952cc3c700 1 -- 172.21.15.33:0/672057199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95180092e0 con 0x7f95281595d0 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 -- 172.21.15.33:0/672057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95281595d0 msgr2=0x7f95281599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95281595d0 0x7f95281599a0 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7f95280ce450 tx=0x7f9518009840 comp rx=0 tx=0).stop 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 -- 172.21.15.33:0/672057199 shutdown_connections 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f952806b230 0x7f95280c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 --2- 172.21.15.33:0/672057199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f95281595d0 0x7f95281599a0 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 --2- 172.21.15.33:0/672057199 >> v2:172.21.15.59:3300/0 conn(0x7f95280675a0 0x7f952806acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 -- 172.21.15.33:0/672057199 >> 172.21.15.33:0/672057199 conn(0x7f95280cd400 msgr2=0x7f95280cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:27.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 -- 172.21.15.33:0/672057199 shutdown_connections 2023-10-09T15:38:27.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.460+0000 7f952fea2700 1 -- 172.21.15.33:0/672057199 wait complete. 2023-10-09T15:38:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.461+0000 7f952fea2700 1 Processor -- start 2023-10-09T15:38:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.461+0000 7f952fea2700 1 -- start start 2023-10-09T15:38:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 0x7f952815b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 0x7f952815f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f952815af30 con 0x7f952806b230 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9528154bd0 con 0x7f95281595d0 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952fea2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f952815a380 con 0x7f95280675a0 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36878/0 (socket says 172.21.15.33:36878) 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 -- 172.21.15.33:0/1874057265 learned_addr learned my addr 172.21.15.33:0/1874057265 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952dc3e700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 0x7f952815b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952e43f700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 0x7f952815f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 -- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 msgr2=0x7f952815b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 0x7f952815b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 -- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 msgr2=0x7f952815f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.467 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 0x7f952815f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 -- 172.21.15.33:0/1874057265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9518009ae0 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952dc3e700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 0x7f952815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952e43f700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 0x7f952815f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f952d43d700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c800 tx=0x7f951c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.462+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c011600 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.463+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f951c011760 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.463+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f952815a600 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.463+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f951c011b20 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.463+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f952815abc0 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.464+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f952815b0e0 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.464+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f951c0193f0 con 0x7f952806b230 2023-10-09T15:38:27.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.465+0000 7f9525ffb700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 0x7f95140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.465+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f951c085220 con 0x7f952806b230 2023-10-09T15:38:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.465+0000 7f952dc3e700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 0x7f95140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.465+0000 7f952dc3e700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 0x7f95140697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9518009880 tx=0x7f9518018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.469+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f952815b0e0 con 0x7f952806b230 2023-10-09T15:38:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.708+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f952815b0e0 con 0x7f952806b230 2023-10-09T15:38:27.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.709+0000 7f9525ffb700 1 -- 172.21.15.33:0/1874057265 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f952815b0e0 con 0x7f952806b230 2023-10-09T15:38:27.710 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:27.710 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:27.313125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 msgr2=0x7f95140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 0x7f95140697d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f9518009880 tx=0x7f9518018000 comp rx=0 tx=0).stop 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 msgr2=0x7f9528154690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f951c00c800 tx=0x7f951c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 shutdown_connections 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9514067320 0x7f95140697d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f95281595d0 0x7f952815f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f95280675a0 0x7f952815b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 --2- 172.21.15.33:0/1874057265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f952806b230 0x7f9528154690 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 >> 172.21.15.33:0/1874057265 conn(0x7f95280cd400 msgr2=0x7f95280b2b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 shutdown_connections 2023-10-09T15:38:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.711+0000 7f952fea2700 1 -- 172.21.15.33:0/1874057265 wait complete. 2023-10-09T15:38:27.713 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 93 2023-10-09T15:38:27.724 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:27.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.841+0000 7f0175497700 1 Processor -- start 2023-10-09T15:38:27.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.841+0000 7f0175497700 1 -- start start 2023-10-09T15:38:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0175497700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0170153c30 0x7f017015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0175497700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01700cf110 0x7f017015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0175497700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f017015afd0 con 0x7f017015de50 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0175497700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f017015b2b0 con 0x7f0170153c30 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0175497700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017015b590 con 0x7f01700cf110 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f016f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f017015de50 0x7f01700cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:55612/0 (socket says 172.21.15.33:55612) 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f016f7fe700 1 -- 172.21.15.33:0/2409118928 learned_addr learned my addr 172.21.15.33:0/2409118928 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f016ffff700 1 --2- 172.21.15.33:0/2409118928 >> v2:172.21.15.59:3300/0 conn(0x7f0170153c30 0x7f017015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f0174c96700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01700cf110 0x7f017015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.842+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2906619258 0 0) 0x7f017015afd0 con 0x7f017015de50 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f015c003570 con 0x7f017015de50 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3586588784 0 0) 0x7f015c003570 con 0x7f017015de50 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01700cf110 msgr2=0x7f017015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01700cf110 0x7f017015c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 >> v2:172.21.15.59:3300/0 conn(0x7f0170153c30 msgr2=0x7f017015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 --2- 172.21.15.33:0/2409118928 >> v2:172.21.15.59:3300/0 conn(0x7f0170153c30 0x7f017015a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f017015b870 con 0x7f017015de50 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0158001470 con 0x7f017015de50 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 >> v1:172.21.15.33:6789/0 conn(0x7f017015de50 legacy=0x7f01700cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c003a60 0x7f015c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f015c004810 0x7f015c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f015c0051c0 0x7f015c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017015b2b0 con 0x7f015c004810 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f017015b590 con 0x7f015c0051c0 2023-10-09T15:38:27.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f015c00bfa0 con 0x7f015c003a60 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016ffff700 1 --2- 172.21.15.33:0/2409118928 >> v2:172.21.15.59:3300/0 conn(0x7f0170153c30 0x7f017015a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f0174c96700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01700cf110 0x7f017015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f015c004810 0x7f015c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016ffff700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c003a60 0x7f015c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f0174c96700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f015c0051c0 0x7f015c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 -- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c003a60 msgr2=0x7f015c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c003a60 0x7f015c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 -- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f015c0051c0 msgr2=0x7f015c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f015c0051c0 0x7f015c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 -- 172.21.15.33:0/2409118928 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f015c003570 con 0x7f015c004810 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.843+0000 7f016f7fe700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f015c004810 0x7f015c004c80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f015800c3c0 tx=0x7f017015a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ee861c5193afd6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015800cc90 con 0x7f015c004810 2023-10-09T15:38:27.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f015800ce30 con 0x7f015c004810 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f016effd700 1 -- 172.21.15.33:0/2409118928 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158005b70 con 0x7f015c004810 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 -- 172.21.15.33:0/2409118928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f015c004810 msgr2=0x7f015c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 --2- 172.21.15.33:0/2409118928 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f015c004810 0x7f015c004c80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f015800c3c0 tx=0x7f017015a170 comp rx=0 tx=0).stop 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0174c96700 1 -- 172.21.15.33:0/2409118928 reap_dead start 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 -- 172.21.15.33:0/2409118928 shutdown_connections 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 -- 172.21.15.33:0/2409118928 >> 172.21.15.33:0/2409118928 conn(0x7f01700703a0 msgr2=0x7f01700707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 -- 172.21.15.33:0/2409118928 shutdown_connections 2023-10-09T15:38:27.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.844+0000 7f0175497700 1 -- 172.21.15.33:0/2409118928 wait complete. 2023-10-09T15:38:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.845+0000 7f0175497700 1 Processor -- start 2023-10-09T15:38:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 -- start start 2023-10-09T15:38:27.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c004810 0x7f017014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 0x7f017015fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01701500b0 con 0x7f01700b3540 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c75e0 con 0x7f01700b39b0 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0175497700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01700c8440 con 0x7f015c004810 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f016f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36904/0 (socket says 172.21.15.33:36904) 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f016f7fe700 1 -- 172.21.15.33:0/1139835121 learned_addr learned my addr 172.21.15.33:0/1139835121 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f016ffff700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c004810 0x7f017014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.846+0000 7f0174c96700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 0x7f017015fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 -- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c004810 msgr2=0x7f017014fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c004810 0x7f017014fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 -- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 msgr2=0x7f017015fcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 0x7f017015fcc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 -- 172.21.15.33:0/1139835121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01700c7830 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0174c96700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 0x7f017015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f016f7fe700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0158011000 tx=0x7f0158015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f015800cc90 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01580070d0 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01700c7b10 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0158007470 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.847+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01700c80d0 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.848+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f017004c3c0 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.848+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0158019070 con 0x7f01700b3540 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.849+0000 7f0167fff700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 0x7f01500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:27.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.849+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0158085ac0 con 0x7f01700b3540 2023-10-09T15:38:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.849+0000 7f016ffff700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 0x7f01500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.849+0000 7f016ffff700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 0x7f01500697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0170160630 tx=0x7f0160008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:27.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:27.853+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01580528c0 con 0x7f01700b3540 2023-10-09T15:38:28.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.048+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01700c8580 con 0x7f01700b3540 2023-10-09T15:38:28.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.048+0000 7f0167fff700 1 -- 172.21.15.33:0/1139835121 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f0158055ee0 con 0x7f01700b3540 2023-10-09T15:38:28.050 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:28.050 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":140,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:25.305152+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":25,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:22.667405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 msgr2=0x7f01500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 0x7f01500697d0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f0170160630 tx=0x7f0160008040 comp rx=0 tx=0).stop 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 msgr2=0x7f017015f780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f0158011000 tx=0x7f0158015000 comp rx=0 tx=0).stop 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 shutdown_connections 2023-10-09T15:38:28.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0150067320 0x7f01500697d0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01700b39b0 0x7f017015fcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f015c004810 0x7f017014fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 --2- 172.21.15.33:0/1139835121 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01700b3540 0x7f017015f780 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 >> 172.21.15.33:0/1139835121 conn(0x7f01700703a0 msgr2=0x7f017015c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 shutdown_connections 2023-10-09T15:38:28.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.051+0000 7f0175497700 1 -- 172.21.15.33:0/1139835121 wait complete. 2023-10-09T15:38:28.064 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:38:28.064 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:38:28.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.183+0000 7f314359e700 1 Processor -- start 2023-10-09T15:38:28.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.183+0000 7f314359e700 1 -- start start 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f314359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f314359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31440cef40 0x7f314415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f314359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f314415afd0 con 0x7f3144153c30 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f314359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f314415b2b0 con 0x7f31440cef40 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f314359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f314415b590 con 0x7f314415de50 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31440cef40 0x7f314415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f31440cef40 0x7f314415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36910/0 (socket says 172.21.15.33:36910) 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 -- 172.21.15.33:0/2828571012 learned_addr learned my addr 172.21.15.33:0/2828571012 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3141d9b700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 -- 172.21.15.33:0/2828571012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 msgr2=0x7f31440cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 -- 172.21.15.33:0/2828571012 >> v1:172.21.15.59:6789/0 conn(0x7f3144153c30 legacy=0x7f314415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 -- 172.21.15.33:0/2828571012 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f314415b870 con 0x7f31440cef40 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.184+0000 7f3142d9d700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f314415c070 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f313c009f20 tx=0x7f313c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0db4401d3494a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314159a700 1 -- 172.21.15.33:0/2828571012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c00e070 con 0x7f31440cef40 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314159a700 1 -- 172.21.15.33:0/2828571012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313c00ba80 con 0x7f31440cef40 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314159a700 1 -- 172.21.15.33:0/2828571012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313c0092e0 con 0x7f31440cef40 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 -- 172.21.15.33:0/2828571012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 msgr2=0x7f314415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f314415c070 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f313c009f20 tx=0x7f313c009840 comp rx=0 tx=0).stop 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 -- 172.21.15.33:0/2828571012 shutdown_connections 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f314415c070 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 --2- 172.21.15.33:0/2828571012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 -- 172.21.15.33:0/2828571012 >> 172.21.15.33:0/2828571012 conn(0x7f31440703a0 msgr2=0x7f31440707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 -- 172.21.15.33:0/2828571012 shutdown_connections 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.185+0000 7f314359e700 1 -- 172.21.15.33:0/2828571012 wait complete. 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.186+0000 7f314359e700 1 Processor -- start 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.186+0000 7f314359e700 1 -- start start 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3144153c30 0x7f31440d0450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3144147730 con 0x7f31440cef40 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31440b41c0 con 0x7f3144153c30 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31440c8750 con 0x7f314415de50 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36920/0 (socket says 172.21.15.33:36920) 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f314259c700 1 -- 172.21.15.33:0/3354654341 learned_addr learned my addr 172.21.15.33:0/3354654341 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f3141d9b700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3144153c30 0x7f31440d0450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.187+0000 7f3142d9d700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 -- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 msgr2=0x7f31440d0990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440d0990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 -- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3144153c30 msgr2=0x7f31440d0450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3144153c30 0x7f31440d0450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 -- 172.21.15.33:0/3354654341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313c009ae0 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314259c700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f313400c590 tx=0x7f313400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134011590 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31340116f0 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134011ab0 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31440c8a30 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.188+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31440b3490 con 0x7f31440cef40 2023-10-09T15:38:28.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.189+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31440b5760 con 0x7f31440cef40 2023-10-09T15:38:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.189+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f313401b3b0 con 0x7f31440cef40 2023-10-09T15:38:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.190+0000 7f31327fc700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 0x7f31240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.190+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3134084220 con 0x7f31440cef40 2023-10-09T15:38:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.190+0000 7f3141d9b700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 0x7f31240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.190+0000 7f3141d9b700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 0x7f31240697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3144159020 tx=0x7f3138008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.194+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3134050eb0 con 0x7f31440cef40 2023-10-09T15:38:28.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.388+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f31440c85b0 con 0x7f3124067320 2023-10-09T15:38:28.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.396+0000 7f31327fc700 1 -- 172.21.15.33:0/3354654341 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286751 (secure 0 0 0) 0x7f31440c85b0 con 0x7f3124067320 2023-10-09T15:38:28.400 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:28.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 msgr2=0x7f31240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 0x7f31240697d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f3144159020 tx=0x7f3138008040 comp rx=0 tx=0).stop 2023-10-09T15:38:28.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 msgr2=0x7f31441471f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f313400c590 tx=0x7f313400c950 comp rx=0 tx=0).stop 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 shutdown_connections 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3124067320 0x7f31240697d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31440cef40 0x7f31441471f0 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f314415de50 0x7f31440d0990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 --2- 172.21.15.33:0/3354654341 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3144153c30 0x7f31440d0450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 >> 172.21.15.33:0/3354654341 conn(0x7f31440703a0 msgr2=0x7f31440cd120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 shutdown_connections 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.399+0000 7f314359e700 1 -- 172.21.15.33:0/3354654341 wait complete. 2023-10-09T15:38:28.403 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:38:28.412 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T15:38:27.325356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425764,"kb_used_data":14692,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548956,"statfs":{"total":773094113280,"available":770610130944,"internally_reserved":0,"allocated":15044608,"data_stored":7376917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.048125"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290759+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284362+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287537+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:54.694037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286490+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289327+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.880417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286576+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284185+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290979+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289777+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293616+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284710+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284018+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285686+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289187+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282965+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290532+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289966+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.336017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287062+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.294845+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289574+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:34.339565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:06.533296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293849+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286634+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290037+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283029+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284873+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287042+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287583+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:00:05.071983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288402+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285052+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:18.506474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289477+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295090+0000","last_change":"2023-10-09T15:38:23.295090+0000","last_active":"2023-10-09T15:38:23.295090+0000","last_peered":"2023-10-09T15:38:23.295090+0000","last_clean":"2023-10-09T15:38:23.295090+0000","last_became_active":"2023-10-09T15:38:23.294818+0000","last_became_peered":"2023-10-09T15:38:23.294818+0000","last_unstale":"2023-10-09T15:38:23.295090+0000","last_undegraded":"2023-10-09T15:38:23.295090+0000","last_fullsized":"2023-10-09T15:38:23.295090+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:18.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293417+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296219+0000","last_change":"2023-10-09T15:38:23.296219+0000","last_active":"2023-10-09T15:38:23.296219+0000","last_peered":"2023-10-09T15:38:23.296219+0000","last_clean":"2023-10-09T15:38:23.296219+0000","last_became_active":"2023-10-09T15:38:23.295917+0000","last_became_peered":"2023-10-09T15:38:23.295917+0000","last_unstale":"2023-10-09T15:38:23.296219+0000","last_undegraded":"2023-10-09T15:38:23.296219+0000","last_fullsized":"2023-10-09T15:38:23.296219+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:46.687122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286193+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296950+0000","last_change":"2023-10-09T15:38:23.296950+0000","last_active":"2023-10-09T15:38:23.296950+0000","last_peered":"2023-10-09T15:38:23.296950+0000","last_clean":"2023-10-09T15:38:23.296950+0000","last_became_active":"2023-10-09T15:38:23.296679+0000","last_became_peered":"2023-10-09T15:38:23.296679+0000","last_unstale":"2023-10-09T15:38:23.296950+0000","last_undegraded":"2023-10-09T15:38:23.296950+0000","last_fullsized":"2023-10-09T15:38:23.296950+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:13.408056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287884+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:19.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292974+0000","last_change":"2023-10-09T15:38:23.292974+0000","last_active":"2023-10-09T15:38:23.292974+0000","last_peered":"2023-10-09T15:38:23.292974+0000","last_clean":"2023-10-09T15:38:23.292974+0000","last_became_active":"2023-10-09T15:38:23.292685+0000","last_became_peered":"2023-10-09T15:38:23.292685+0000","last_unstale":"2023-10-09T15:38:23.292974+0000","last_undegraded":"2023-10-09T15:38:23.292974+0000","last_fullsized":"2023-10-09T15:38:23.292974+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:47.539894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292978+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302270+0000","last_change":"2023-10-09T15:38:23.302270+0000","last_active":"2023-10-09T15:38:23.302270+0000","last_peered":"2023-10-09T15:38:23.302270+0000","last_clean":"2023-10-09T15:38:23.302270+0000","last_became_active":"2023-10-09T15:38:23.301957+0000","last_became_peered":"2023-10-09T15:38:23.301957+0000","last_unstale":"2023-10-09T15:38:23.302270+0000","last_undegraded":"2023-10-09T15:38:23.302270+0000","last_fullsized":"2023-10-09T15:38:23.302270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:32.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288589+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297340+0000","last_change":"2023-10-09T15:38:23.297340+0000","last_active":"2023-10-09T15:38:23.297340+0000","last_peered":"2023-10-09T15:38:23.297340+0000","last_clean":"2023-10-09T15:38:23.297340+0000","last_became_active":"2023-10-09T15:38:23.297078+0000","last_became_peered":"2023-10-09T15:38:23.297078+0000","last_unstale":"2023-10-09T15:38:23.297340+0000","last_undegraded":"2023-10-09T15:38:23.297340+0000","last_fullsized":"2023-10-09T15:38:23.297340+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.790798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295423+0000","last_change":"2023-10-09T15:38:23.295423+0000","last_active":"2023-10-09T15:38:23.295423+0000","last_peered":"2023-10-09T15:38:23.295423+0000","last_clean":"2023-10-09T15:38:23.295423+0000","last_became_active":"2023-10-09T15:38:23.295145+0000","last_became_peered":"2023-10-09T15:38:23.295145+0000","last_unstale":"2023-10-09T15:38:23.295423+0000","last_undegraded":"2023-10-09T15:38:23.295423+0000","last_fullsized":"2023-10-09T15:38:23.295423+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285606+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.293275+0000","last_change":"2023-10-09T15:38:23.293275+0000","last_active":"2023-10-09T15:38:23.293275+0000","last_peered":"2023-10-09T15:38:23.293275+0000","last_clean":"2023-10-09T15:38:23.293275+0000","last_became_active":"2023-10-09T15:38:23.292861+0000","last_became_peered":"2023-10-09T15:38:23.292861+0000","last_unstale":"2023-10-09T15:38:23.293275+0000","last_undegraded":"2023-10-09T15:38:23.293275+0000","last_fullsized":"2023-10-09T15:38:23.293275+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:36.984873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286683+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292482+0000","last_change":"2023-10-09T15:38:23.292482+0000","last_active":"2023-10-09T15:38:23.292482+0000","last_peered":"2023-10-09T15:38:23.292482+0000","last_clean":"2023-10-09T15:38:23.292482+0000","last_became_active":"2023-10-09T15:38:23.292197+0000","last_became_peered":"2023-10-09T15:38:23.292197+0000","last_unstale":"2023-10-09T15:38:23.292482+0000","last_undegraded":"2023-10-09T15:38:23.292482+0000","last_fullsized":"2023-10-09T15:38:23.292482+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:52.049098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285426+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297633+0000","last_change":"2023-10-09T15:38:23.297633+0000","last_active":"2023-10-09T15:38:23.297633+0000","last_peered":"2023-10-09T15:38:23.297633+0000","last_clean":"2023-10-09T15:38:23.297633+0000","last_became_active":"2023-10-09T15:38:23.297339+0000","last_became_peered":"2023-10-09T15:38:23.297339+0000","last_unstale":"2023-10-09T15:38:23.297633+0000","last_undegraded":"2023-10-09T15:38:23.297633+0000","last_fullsized":"2023-10-09T15:38:23.297633+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:03.400037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291957+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.300928+0000","last_change":"2023-10-09T15:38:23.300928+0000","last_active":"2023-10-09T15:38:23.300928+0000","last_peered":"2023-10-09T15:38:23.300928+0000","last_clean":"2023-10-09T15:38:23.300928+0000","last_became_active":"2023-10-09T15:38:23.300605+0000","last_became_peered":"2023-10-09T15:38:23.300605+0000","last_unstale":"2023-10-09T15:38:23.300928+0000","last_undegraded":"2023-10-09T15:38:23.300928+0000","last_fullsized":"2023-10-09T15:38:23.300928+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:47.398116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285014+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295000+0000","last_change":"2023-10-09T15:38:23.295000+0000","last_active":"2023-10-09T15:38:23.295000+0000","last_peered":"2023-10-09T15:38:23.295000+0000","last_clean":"2023-10-09T15:38:23.295000+0000","last_became_active":"2023-10-09T15:38:23.294725+0000","last_became_peered":"2023-10-09T15:38:23.294725+0000","last_unstale":"2023-10-09T15:38:23.295000+0000","last_undegraded":"2023-10-09T15:38:23.295000+0000","last_fullsized":"2023-10-09T15:38:23.295000+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283566+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304386+0000","last_change":"2023-10-09T15:38:23.304386+0000","last_active":"2023-10-09T15:38:23.304386+0000","last_peered":"2023-10-09T15:38:23.304386+0000","last_clean":"2023-10-09T15:38:23.304386+0000","last_became_active":"2023-10-09T15:38:23.304054+0000","last_became_peered":"2023-10-09T15:38:23.304054+0000","last_unstale":"2023-10-09T15:38:23.304386+0000","last_undegraded":"2023-10-09T15:38:23.304386+0000","last_fullsized":"2023-10-09T15:38:23.304386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287352+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297947+0000","last_change":"2023-10-09T15:38:23.297947+0000","last_active":"2023-10-09T15:38:23.297947+0000","last_peered":"2023-10-09T15:38:23.297947+0000","last_clean":"2023-10-09T15:38:23.297947+0000","last_became_active":"2023-10-09T15:38:23.297632+0000","last_became_peered":"2023-10-09T15:38:23.297632+0000","last_unstale":"2023-10-09T15:38:23.297947+0000","last_undegraded":"2023-10-09T15:38:23.297947+0000","last_fullsized":"2023-10-09T15:38:23.297947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:40.606930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291159+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.305407+0000","last_change":"2023-10-09T15:38:23.305407+0000","last_active":"2023-10-09T15:38:23.305407+0000","last_peered":"2023-10-09T15:38:23.305407+0000","last_clean":"2023-10-09T15:38:23.305407+0000","last_became_active":"2023-10-09T15:38:23.305183+0000","last_became_peered":"2023-10-09T15:38:23.305183+0000","last_unstale":"2023-10-09T15:38:23.305407+0000","last_undegraded":"2023-10-09T15:38:23.305407+0000","last_fullsized":"2023-10-09T15:38:23.305407+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:09.115911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291363+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297590+0000","last_change":"2023-10-09T15:38:23.297590+0000","last_active":"2023-10-09T15:38:23.297590+0000","last_peered":"2023-10-09T15:38:23.297590+0000","last_clean":"2023-10-09T15:38:23.297590+0000","last_became_active":"2023-10-09T15:38:23.297269+0000","last_became_peered":"2023-10-09T15:38:23.297269+0000","last_unstale":"2023-10-09T15:38:23.297590+0000","last_undegraded":"2023-10-09T15:38:23.297590+0000","last_fullsized":"2023-10-09T15:38:23.297590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289249+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298760+0000","last_change":"2023-10-09T15:38:23.298760+0000","last_active":"2023-10-09T15:38:23.298760+0000","last_peered":"2023-10-09T15:38:23.298760+0000","last_clean":"2023-10-09T15:38:23.298760+0000","last_became_active":"2023-10-09T15:38:23.298273+0000","last_became_peered":"2023-10-09T15:38:23.298273+0000","last_unstale":"2023-10-09T15:38:23.298760+0000","last_undegraded":"2023-10-09T15:38:23.298760+0000","last_fullsized":"2023-10-09T15:38:23.298760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:43.720905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287116+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.308128+0000","last_change":"2023-10-09T15:38:23.308128+0000","last_active":"2023-10-09T15:38:23.308128+0000","last_peered":"2023-10-09T15:38:23.308128+0000","last_clean":"2023-10-09T15:38:23.308128+0000","last_became_active":"2023-10-09T15:38:23.307889+0000","last_became_peered":"2023-10-09T15:38:23.307889+0000","last_unstale":"2023-10-09T15:38:23.308128+0000","last_undegraded":"2023-10-09T15:38:23.308128+0000","last_fullsized":"2023-10-09T15:38:23.308128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.291888+0000","last_change":"2023-10-09T15:38:23.291888+0000","last_active":"2023-10-09T15:38:23.291888+0000","last_peered":"2023-10-09T15:38:23.291888+0000","last_clean":"2023-10-09T15:38:23.291888+0000","last_became_active":"2023-10-09T15:38:23.291632+0000","last_became_peered":"2023-10-09T15:38:23.291632+0000","last_unstale":"2023-10-09T15:38:23.291888+0000","last_undegraded":"2023-10-09T15:38:23.291888+0000","last_fullsized":"2023-10-09T15:38:23.291888+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:25.041292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:18.335498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303601+0000","last_change":"2023-10-09T15:38:23.303601+0000","last_active":"2023-10-09T15:38:23.303601+0000","last_peered":"2023-10-09T15:38:23.303601+0000","last_clean":"2023-10-09T15:38:23.303601+0000","last_became_active":"2023-10-09T15:38:23.303304+0000","last_became_peered":"2023-10-09T15:38:23.303304+0000","last_unstale":"2023-10-09T15:38:23.303601+0000","last_undegraded":"2023-10-09T15:38:23.303601+0000","last_fullsized":"2023-10-09T15:38:23.303601+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:28.987172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282973+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296816+0000","last_change":"2023-10-09T15:38:23.296816+0000","last_active":"2023-10-09T15:38:23.296816+0000","last_peered":"2023-10-09T15:38:23.296816+0000","last_clean":"2023-10-09T15:38:23.296816+0000","last_became_active":"2023-10-09T15:38:23.296537+0000","last_became_peered":"2023-10-09T15:38:23.296537+0000","last_unstale":"2023-10-09T15:38:23.296816+0000","last_undegraded":"2023-10-09T15:38:23.296816+0000","last_fullsized":"2023-10-09T15:38:23.296816+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:28.097883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283703+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303399+0000","last_change":"2023-10-09T15:38:23.303399+0000","last_active":"2023-10-09T15:38:23.303399+0000","last_peered":"2023-10-09T15:38:23.303399+0000","last_clean":"2023-10-09T15:38:23.303399+0000","last_became_active":"2023-10-09T15:38:23.303050+0000","last_became_peered":"2023-10-09T15:38:23.303050+0000","last_unstale":"2023-10-09T15:38:23.303399+0000","last_undegraded":"2023-10-09T15:38:23.303399+0000","last_fullsized":"2023-10-09T15:38:23.303399+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:05.168451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285135+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:57.266935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294087+0000","last_change":"2023-10-09T15:38:23.294087+0000","last_active":"2023-10-09T15:38:23.294087+0000","last_peered":"2023-10-09T15:38:23.294087+0000","last_clean":"2023-10-09T15:38:23.294087+0000","last_became_active":"2023-10-09T15:38:23.293793+0000","last_became_peered":"2023-10-09T15:38:23.293793+0000","last_unstale":"2023-10-09T15:38:23.294087+0000","last_undegraded":"2023-10-09T15:38:23.294087+0000","last_fullsized":"2023-10-09T15:38:23.294087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:19.327125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284288+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:27:32.345656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304358+0000","last_change":"2023-10-09T15:38:23.304358+0000","last_active":"2023-10-09T15:38:23.304358+0000","last_peered":"2023-10-09T15:38:23.304358+0000","last_clean":"2023-10-09T15:38:23.304358+0000","last_became_active":"2023-10-09T15:38:23.304068+0000","last_became_peered":"2023-10-09T15:38:23.304068+0000","last_unstale":"2023-10-09T15:38:23.304358+0000","last_undegraded":"2023-10-09T15:38:23.304358+0000","last_fullsized":"2023-10-09T15:38:23.304358+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:08:14.986194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291423+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307329+0000","last_change":"2023-10-09T15:38:23.307329+0000","last_active":"2023-10-09T15:38:23.307329+0000","last_peered":"2023-10-09T15:38:23.307329+0000","last_clean":"2023-10-09T15:38:23.307329+0000","last_became_active":"2023-10-09T15:38:23.307005+0000","last_became_peered":"2023-10-09T15:38:23.307005+0000","last_unstale":"2023-10-09T15:38:23.307329+0000","last_undegraded":"2023-10-09T15:38:23.307329+0000","last_fullsized":"2023-10-09T15:38:23.307329+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292932+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307773+0000","last_change":"2023-10-09T15:38:23.307773+0000","last_active":"2023-10-09T15:38:23.307773+0000","last_peered":"2023-10-09T15:38:23.307773+0000","last_clean":"2023-10-09T15:38:23.307773+0000","last_became_active":"2023-10-09T15:38:23.306984+0000","last_became_peered":"2023-10-09T15:38:23.306984+0000","last_unstale":"2023-10-09T15:38:23.307773+0000","last_undegraded":"2023-10-09T15:38:23.307773+0000","last_fullsized":"2023-10-09T15:38:23.307773+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288021+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294901+0000","last_change":"2023-10-09T15:38:23.294901+0000","last_active":"2023-10-09T15:38:23.294901+0000","last_peered":"2023-10-09T15:38:23.294901+0000","last_clean":"2023-10-09T15:38:23.294901+0000","last_became_active":"2023-10-09T15:38:23.294632+0000","last_became_peered":"2023-10-09T15:38:23.294632+0000","last_unstale":"2023-10-09T15:38:23.294901+0000","last_undegraded":"2023-10-09T15:38:23.294901+0000","last_fullsized":"2023-10-09T15:38:23.294901+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.899576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286938+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302381+0000","last_change":"2023-10-09T15:38:23.302381+0000","last_active":"2023-10-09T15:38:23.302381+0000","last_peered":"2023-10-09T15:38:23.302381+0000","last_clean":"2023-10-09T15:38:23.302381+0000","last_became_active":"2023-10-09T15:38:23.302101+0000","last_became_peered":"2023-10-09T15:38:23.302101+0000","last_unstale":"2023-10-09T15:38:23.302381+0000","last_undegraded":"2023-10-09T15:38:23.302381+0000","last_fullsized":"2023-10-09T15:38:23.302381+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:10.713775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287306+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295663+0000","last_change":"2023-10-09T15:38:23.295663+0000","last_active":"2023-10-09T15:38:23.295663+0000","last_peered":"2023-10-09T15:38:23.295663+0000","last_clean":"2023-10-09T15:38:23.295663+0000","last_became_active":"2023-10-09T15:38:23.295394+0000","last_became_peered":"2023-10-09T15:38:23.295394+0000","last_unstale":"2023-10-09T15:38:23.295663+0000","last_undegraded":"2023-10-09T15:38:23.295663+0000","last_fullsized":"2023-10-09T15:38:23.295663+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:21.992427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282815+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296120+0000","last_change":"2023-10-09T15:38:23.296120+0000","last_active":"2023-10-09T15:38:23.296120+0000","last_peered":"2023-10-09T15:38:23.296120+0000","last_clean":"2023-10-09T15:38:23.296120+0000","last_became_active":"2023-10-09T15:38:23.295855+0000","last_became_peered":"2023-10-09T15:38:23.295855+0000","last_unstale":"2023-10-09T15:38:23.296120+0000","last_undegraded":"2023-10-09T15:38:23.296120+0000","last_fullsized":"2023-10-09T15:38:23.296120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:07.415921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284293+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:35.338209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303281+0000","last_change":"2023-10-09T15:38:23.303281+0000","last_active":"2023-10-09T15:38:23.303281+0000","last_peered":"2023-10-09T15:38:23.303281+0000","last_clean":"2023-10-09T15:38:23.303281+0000","last_became_active":"2023-10-09T15:38:23.302987+0000","last_became_peered":"2023-10-09T15:38:23.302987+0000","last_unstale":"2023-10-09T15:38:23.303281+0000","last_undegraded":"2023-10-09T15:38:23.303281+0000","last_fullsized":"2023-10-09T15:38:23.303281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:52.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292383+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298197+0000","last_change":"2023-10-09T15:38:23.298197+0000","last_active":"2023-10-09T15:38:23.298197+0000","last_peered":"2023-10-09T15:38:23.298197+0000","last_clean":"2023-10-09T15:38:23.298197+0000","last_became_active":"2023-10-09T15:38:23.297932+0000","last_became_peered":"2023-10-09T15:38:23.297932+0000","last_unstale":"2023-10-09T15:38:23.298197+0000","last_undegraded":"2023-10-09T15:38:23.298197+0000","last_fullsized":"2023-10-09T15:38:23.298197+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:56.430748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T15:38:22.286689+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:22.286689+0000","last_peered":"2023-10-09T15:38:22.286689+0000","last_clean":"2023-10-09T15:38:22.286689+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:22.286689+0000","last_undegraded":"2023-10-09T15:38:22.286689+0000","last_fullsized":"2023-10-09T15:38:22.286689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1365017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.312}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1364006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.434}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.245}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.313},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.29399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.376}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:38:28.418 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:38:28.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.571+0000 7fbc0bd89700 1 Processor -- start 2023-10-09T15:38:28.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 -- start start 2023-10-09T15:38:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 0x7fbc04159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc0415a400 0x7fbc04156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc0415ae40 con 0x7fbc040cb5a0 2023-10-09T15:38:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc040ce0f0 con 0x7fbc0415a400 2023-10-09T15:38:28.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0bd89700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc040d13f0 con 0x7fbc040cb970 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.572+0000 7fbc0a326700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc0415a400 0x7fbc04156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc0415a400 0x7fbc04156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36926/0 (socket says 172.21.15.33:36926) 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 -- 172.21.15.33:0/2161984495 learned_addr learned my addr 172.21.15.33:0/2161984495 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc09324700 1 --2- 172.21.15.33:0/2161984495 >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 0x7fbc04159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 -- 172.21.15.33:0/2161984495 >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 msgr2=0x7fbc04159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 --2- 172.21.15.33:0/2161984495 >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 0x7fbc04159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 -- 172.21.15.33:0/2161984495 >> v1:172.21.15.59:6789/0 conn(0x7fbc040cb5a0 legacy=0x7fbc040cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 -- 172.21.15.33:0/2161984495 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc0415ab60 con 0x7fbc0415a400 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc09324700 1 --2- 172.21.15.33:0/2161984495 >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 0x7fbc04159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc0a326700 1 --2- 172.21.15.33:0/2161984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc0415a400 0x7fbc04156e90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbc040d1780 tx=0x7fbbf4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a37ed3f82923e295 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc08b23700 1 -- 172.21.15.33:0/2161984495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400b820 con 0x7fbc0415a400 2023-10-09T15:38:28.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc08b23700 1 -- 172.21.15.33:0/2161984495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf400b980 con 0x7fbc0415a400 2023-10-09T15:38:28.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.573+0000 7fbc08b23700 1 -- 172.21.15.33:0/2161984495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf400bd20 con 0x7fbc0415a400 2023-10-09T15:38:28.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2161984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc0415a400 msgr2=0x7fbc04156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2161984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc0415a400 0x7fbc04156e90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fbc040d1780 tx=0x7fbbf4009250 comp rx=0 tx=0).stop 2023-10-09T15:38:28.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2161984495 shutdown_connections 2023-10-09T15:38:28.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2161984495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc0415a400 0x7fbc04156e90 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2161984495 >> v2:172.21.15.59:3300/0 conn(0x7fbc040cb970 0x7fbc04159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2161984495 >> 172.21.15.33:0/2161984495 conn(0x7fbc04070e30 msgr2=0x7fbc040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2161984495 shutdown_connections 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.574+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2161984495 wait complete. 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.575+0000 7fbc0bd89700 1 Processor -- start 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.575+0000 7fbc0bd89700 1 -- start start 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040cb5a0 0x7fbc041521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0415a400 0x7fbc040cf230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0415c830 con 0x7fbc040cb970 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc0415c540 con 0x7fbc0415a400 2023-10-09T15:38:28.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc040c9170 con 0x7fbc040cb5a0 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36932/0 (socket says 172.21.15.33:36932) 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 -- 172.21.15.33:0/2988243416 learned_addr learned my addr 172.21.15.33:0/2988243416 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0a326700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0415a400 0x7fbc040cf230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 -- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040cb5a0 msgr2=0x7fbc041521d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09b25700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040cb5a0 0x7fbc041521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040cb5a0 0x7fbc041521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 -- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0415a400 msgr2=0x7fbc040cf230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0415a400 0x7fbc040cf230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 -- 172.21.15.33:0/2988243416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf40094f0 con 0x7fbc040cb970 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc09324700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800c830 tx=0x7fbbf8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011600 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf8011760 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc040c9450 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.576+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf8011b20 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.577+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc04152710 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.577+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc0404c3c0 con 0x7fbc040cb970 2023-10-09T15:38:28.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.578+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbbf800a3e0 con 0x7fbc040cb970 2023-10-09T15:38:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.578+0000 7fbc01ffb700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 0x7fbbf00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.579+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbbf8084e50 con 0x7fbc040cb970 2023-10-09T15:38:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.579+0000 7fbc09b25700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 0x7fbbf00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.579+0000 7fbc09b25700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 0x7fbbf00697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.583+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbbf80519d0 con 0x7fbc040cb970 2023-10-09T15:38:28.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.773+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbc0415c970 con 0x7fbbf0067320 2023-10-09T15:38:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.781+0000 7fbc01ffb700 1 -- 172.21.15.33:0/2988243416 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286751 (secure 0 0 0) 0x7fbc0415c970 con 0x7fbbf0067320 2023-10-09T15:38:28.785 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:28.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 msgr2=0x7fbbf00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 0x7fbbf00697d0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fbbfc007fd0 tx=0x7fbbfc009040 comp rx=0 tx=0).stop 2023-10-09T15:38:28.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 msgr2=0x7fbc040c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fbbf800c830 tx=0x7fbbf8008040 comp rx=0 tx=0).stop 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 shutdown_connections 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbbf0067320 0x7fbbf00697d0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc0415a400 0x7fbc040cf230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc040cb5a0 0x7fbc041521d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 --2- 172.21.15.33:0/2988243416 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc040cb970 0x7fbc040c8790 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 >> 172.21.15.33:0/2988243416 conn(0x7fbc04070e30 msgr2=0x7fbc040c54b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 shutdown_connections 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.784+0000 7fbc0bd89700 1 -- 172.21.15.33:0/2988243416 wait complete. 2023-10-09T15:38:28.788 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:38:28.797 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T15:38:27.325356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425764,"kb_used_data":14692,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548956,"statfs":{"total":773094113280,"available":770610130944,"internally_reserved":0,"allocated":15044608,"data_stored":7376917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.048125"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290759+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284362+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287537+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:54.694037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286490+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289327+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.880417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286576+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284185+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290979+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289777+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293616+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284710+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284018+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285686+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289187+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282965+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290532+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289966+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.336017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287062+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.294845+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289574+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:34.339565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:06.533296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293849+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286634+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290037+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283029+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284873+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287042+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287583+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:00:05.071983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288402+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285052+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:18.506474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289477+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295090+0000","last_change":"2023-10-09T15:38:23.295090+0000","last_active":"2023-10-09T15:38:23.295090+0000","last_peered":"2023-10-09T15:38:23.295090+0000","last_clean":"2023-10-09T15:38:23.295090+0000","last_became_active":"2023-10-09T15:38:23.294818+0000","last_became_peered":"2023-10-09T15:38:23.294818+0000","last_unstale":"2023-10-09T15:38:23.295090+0000","last_undegraded":"2023-10-09T15:38:23.295090+0000","last_fullsized":"2023-10-09T15:38:23.295090+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:18.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293417+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296219+0000","last_change":"2023-10-09T15:38:23.296219+0000","last_active":"2023-10-09T15:38:23.296219+0000","last_peered":"2023-10-09T15:38:23.296219+0000","last_clean":"2023-10-09T15:38:23.296219+0000","last_became_active":"2023-10-09T15:38:23.295917+0000","last_became_peered":"2023-10-09T15:38:23.295917+0000","last_unstale":"2023-10-09T15:38:23.296219+0000","last_undegraded":"2023-10-09T15:38:23.296219+0000","last_fullsized":"2023-10-09T15:38:23.296219+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:46.687122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286193+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296950+0000","last_change":"2023-10-09T15:38:23.296950+0000","last_active":"2023-10-09T15:38:23.296950+0000","last_peered":"2023-10-09T15:38:23.296950+0000","last_clean":"2023-10-09T15:38:23.296950+0000","last_became_active":"2023-10-09T15:38:23.296679+0000","last_became_peered":"2023-10-09T15:38:23.296679+0000","last_unstale":"2023-10-09T15:38:23.296950+0000","last_undegraded":"2023-10-09T15:38:23.296950+0000","last_fullsized":"2023-10-09T15:38:23.296950+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:13.408056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287884+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:19.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292974+0000","last_change":"2023-10-09T15:38:23.292974+0000","last_active":"2023-10-09T15:38:23.292974+0000","last_peered":"2023-10-09T15:38:23.292974+0000","last_clean":"2023-10-09T15:38:23.292974+0000","last_became_active":"2023-10-09T15:38:23.292685+0000","last_became_peered":"2023-10-09T15:38:23.292685+0000","last_unstale":"2023-10-09T15:38:23.292974+0000","last_undegraded":"2023-10-09T15:38:23.292974+0000","last_fullsized":"2023-10-09T15:38:23.292974+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:47.539894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292978+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302270+0000","last_change":"2023-10-09T15:38:23.302270+0000","last_active":"2023-10-09T15:38:23.302270+0000","last_peered":"2023-10-09T15:38:23.302270+0000","last_clean":"2023-10-09T15:38:23.302270+0000","last_became_active":"2023-10-09T15:38:23.301957+0000","last_became_peered":"2023-10-09T15:38:23.301957+0000","last_unstale":"2023-10-09T15:38:23.302270+0000","last_undegraded":"2023-10-09T15:38:23.302270+0000","last_fullsized":"2023-10-09T15:38:23.302270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:32.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288589+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297340+0000","last_change":"2023-10-09T15:38:23.297340+0000","last_active":"2023-10-09T15:38:23.297340+0000","last_peered":"2023-10-09T15:38:23.297340+0000","last_clean":"2023-10-09T15:38:23.297340+0000","last_became_active":"2023-10-09T15:38:23.297078+0000","last_became_peered":"2023-10-09T15:38:23.297078+0000","last_unstale":"2023-10-09T15:38:23.297340+0000","last_undegraded":"2023-10-09T15:38:23.297340+0000","last_fullsized":"2023-10-09T15:38:23.297340+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.790798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295423+0000","last_change":"2023-10-09T15:38:23.295423+0000","last_active":"2023-10-09T15:38:23.295423+0000","last_peered":"2023-10-09T15:38:23.295423+0000","last_clean":"2023-10-09T15:38:23.295423+0000","last_became_active":"2023-10-09T15:38:23.295145+0000","last_became_peered":"2023-10-09T15:38:23.295145+0000","last_unstale":"2023-10-09T15:38:23.295423+0000","last_undegraded":"2023-10-09T15:38:23.295423+0000","last_fullsized":"2023-10-09T15:38:23.295423+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285606+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.293275+0000","last_change":"2023-10-09T15:38:23.293275+0000","last_active":"2023-10-09T15:38:23.293275+0000","last_peered":"2023-10-09T15:38:23.293275+0000","last_clean":"2023-10-09T15:38:23.293275+0000","last_became_active":"2023-10-09T15:38:23.292861+0000","last_became_peered":"2023-10-09T15:38:23.292861+0000","last_unstale":"2023-10-09T15:38:23.293275+0000","last_undegraded":"2023-10-09T15:38:23.293275+0000","last_fullsized":"2023-10-09T15:38:23.293275+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:36.984873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286683+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292482+0000","last_change":"2023-10-09T15:38:23.292482+0000","last_active":"2023-10-09T15:38:23.292482+0000","last_peered":"2023-10-09T15:38:23.292482+0000","last_clean":"2023-10-09T15:38:23.292482+0000","last_became_active":"2023-10-09T15:38:23.292197+0000","last_became_peered":"2023-10-09T15:38:23.292197+0000","last_unstale":"2023-10-09T15:38:23.292482+0000","last_undegraded":"2023-10-09T15:38:23.292482+0000","last_fullsized":"2023-10-09T15:38:23.292482+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:52.049098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285426+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297633+0000","last_change":"2023-10-09T15:38:23.297633+0000","last_active":"2023-10-09T15:38:23.297633+0000","last_peered":"2023-10-09T15:38:23.297633+0000","last_clean":"2023-10-09T15:38:23.297633+0000","last_became_active":"2023-10-09T15:38:23.297339+0000","last_became_peered":"2023-10-09T15:38:23.297339+0000","last_unstale":"2023-10-09T15:38:23.297633+0000","last_undegraded":"2023-10-09T15:38:23.297633+0000","last_fullsized":"2023-10-09T15:38:23.297633+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:03.400037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291957+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.300928+0000","last_change":"2023-10-09T15:38:23.300928+0000","last_active":"2023-10-09T15:38:23.300928+0000","last_peered":"2023-10-09T15:38:23.300928+0000","last_clean":"2023-10-09T15:38:23.300928+0000","last_became_active":"2023-10-09T15:38:23.300605+0000","last_became_peered":"2023-10-09T15:38:23.300605+0000","last_unstale":"2023-10-09T15:38:23.300928+0000","last_undegraded":"2023-10-09T15:38:23.300928+0000","last_fullsized":"2023-10-09T15:38:23.300928+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:47.398116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285014+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295000+0000","last_change":"2023-10-09T15:38:23.295000+0000","last_active":"2023-10-09T15:38:23.295000+0000","last_peered":"2023-10-09T15:38:23.295000+0000","last_clean":"2023-10-09T15:38:23.295000+0000","last_became_active":"2023-10-09T15:38:23.294725+0000","last_became_peered":"2023-10-09T15:38:23.294725+0000","last_unstale":"2023-10-09T15:38:23.295000+0000","last_undegraded":"2023-10-09T15:38:23.295000+0000","last_fullsized":"2023-10-09T15:38:23.295000+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283566+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304386+0000","last_change":"2023-10-09T15:38:23.304386+0000","last_active":"2023-10-09T15:38:23.304386+0000","last_peered":"2023-10-09T15:38:23.304386+0000","last_clean":"2023-10-09T15:38:23.304386+0000","last_became_active":"2023-10-09T15:38:23.304054+0000","last_became_peered":"2023-10-09T15:38:23.304054+0000","last_unstale":"2023-10-09T15:38:23.304386+0000","last_undegraded":"2023-10-09T15:38:23.304386+0000","last_fullsized":"2023-10-09T15:38:23.304386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287352+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297947+0000","last_change":"2023-10-09T15:38:23.297947+0000","last_active":"2023-10-09T15:38:23.297947+0000","last_peered":"2023-10-09T15:38:23.297947+0000","last_clean":"2023-10-09T15:38:23.297947+0000","last_became_active":"2023-10-09T15:38:23.297632+0000","last_became_peered":"2023-10-09T15:38:23.297632+0000","last_unstale":"2023-10-09T15:38:23.297947+0000","last_undegraded":"2023-10-09T15:38:23.297947+0000","last_fullsized":"2023-10-09T15:38:23.297947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:40.606930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291159+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.305407+0000","last_change":"2023-10-09T15:38:23.305407+0000","last_active":"2023-10-09T15:38:23.305407+0000","last_peered":"2023-10-09T15:38:23.305407+0000","last_clean":"2023-10-09T15:38:23.305407+0000","last_became_active":"2023-10-09T15:38:23.305183+0000","last_became_peered":"2023-10-09T15:38:23.305183+0000","last_unstale":"2023-10-09T15:38:23.305407+0000","last_undegraded":"2023-10-09T15:38:23.305407+0000","last_fullsized":"2023-10-09T15:38:23.305407+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:09.115911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291363+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297590+0000","last_change":"2023-10-09T15:38:23.297590+0000","last_active":"2023-10-09T15:38:23.297590+0000","last_peered":"2023-10-09T15:38:23.297590+0000","last_clean":"2023-10-09T15:38:23.297590+0000","last_became_active":"2023-10-09T15:38:23.297269+0000","last_became_peered":"2023-10-09T15:38:23.297269+0000","last_unstale":"2023-10-09T15:38:23.297590+0000","last_undegraded":"2023-10-09T15:38:23.297590+0000","last_fullsized":"2023-10-09T15:38:23.297590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289249+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298760+0000","last_change":"2023-10-09T15:38:23.298760+0000","last_active":"2023-10-09T15:38:23.298760+0000","last_peered":"2023-10-09T15:38:23.298760+0000","last_clean":"2023-10-09T15:38:23.298760+0000","last_became_active":"2023-10-09T15:38:23.298273+0000","last_became_peered":"2023-10-09T15:38:23.298273+0000","last_unstale":"2023-10-09T15:38:23.298760+0000","last_undegraded":"2023-10-09T15:38:23.298760+0000","last_fullsized":"2023-10-09T15:38:23.298760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:43.720905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287116+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.308128+0000","last_change":"2023-10-09T15:38:23.308128+0000","last_active":"2023-10-09T15:38:23.308128+0000","last_peered":"2023-10-09T15:38:23.308128+0000","last_clean":"2023-10-09T15:38:23.308128+0000","last_became_active":"2023-10-09T15:38:23.307889+0000","last_became_peered":"2023-10-09T15:38:23.307889+0000","last_unstale":"2023-10-09T15:38:23.308128+0000","last_undegraded":"2023-10-09T15:38:23.308128+0000","last_fullsized":"2023-10-09T15:38:23.308128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.291888+0000","last_change":"2023-10-09T15:38:23.291888+0000","last_active":"2023-10-09T15:38:23.291888+0000","last_peered":"2023-10-09T15:38:23.291888+0000","last_clean":"2023-10-09T15:38:23.291888+0000","last_became_active":"2023-10-09T15:38:23.291632+0000","last_became_peered":"2023-10-09T15:38:23.291632+0000","last_unstale":"2023-10-09T15:38:23.291888+0000","last_undegraded":"2023-10-09T15:38:23.291888+0000","last_fullsized":"2023-10-09T15:38:23.291888+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:25.041292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:18.335498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303601+0000","last_change":"2023-10-09T15:38:23.303601+0000","last_active":"2023-10-09T15:38:23.303601+0000","last_peered":"2023-10-09T15:38:23.303601+0000","last_clean":"2023-10-09T15:38:23.303601+0000","last_became_active":"2023-10-09T15:38:23.303304+0000","last_became_peered":"2023-10-09T15:38:23.303304+0000","last_unstale":"2023-10-09T15:38:23.303601+0000","last_undegraded":"2023-10-09T15:38:23.303601+0000","last_fullsized":"2023-10-09T15:38:23.303601+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:28.987172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282973+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296816+0000","last_change":"2023-10-09T15:38:23.296816+0000","last_active":"2023-10-09T15:38:23.296816+0000","last_peered":"2023-10-09T15:38:23.296816+0000","last_clean":"2023-10-09T15:38:23.296816+0000","last_became_active":"2023-10-09T15:38:23.296537+0000","last_became_peered":"2023-10-09T15:38:23.296537+0000","last_unstale":"2023-10-09T15:38:23.296816+0000","last_undegraded":"2023-10-09T15:38:23.296816+0000","last_fullsized":"2023-10-09T15:38:23.296816+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:28.097883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283703+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303399+0000","last_change":"2023-10-09T15:38:23.303399+0000","last_active":"2023-10-09T15:38:23.303399+0000","last_peered":"2023-10-09T15:38:23.303399+0000","last_clean":"2023-10-09T15:38:23.303399+0000","last_became_active":"2023-10-09T15:38:23.303050+0000","last_became_peered":"2023-10-09T15:38:23.303050+0000","last_unstale":"2023-10-09T15:38:23.303399+0000","last_undegraded":"2023-10-09T15:38:23.303399+0000","last_fullsized":"2023-10-09T15:38:23.303399+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:05.168451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285135+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:57.266935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294087+0000","last_change":"2023-10-09T15:38:23.294087+0000","last_active":"2023-10-09T15:38:23.294087+0000","last_peered":"2023-10-09T15:38:23.294087+0000","last_clean":"2023-10-09T15:38:23.294087+0000","last_became_active":"2023-10-09T15:38:23.293793+0000","last_became_peered":"2023-10-09T15:38:23.293793+0000","last_unstale":"2023-10-09T15:38:23.294087+0000","last_undegraded":"2023-10-09T15:38:23.294087+0000","last_fullsized":"2023-10-09T15:38:23.294087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:19.327125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284288+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:27:32.345656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304358+0000","last_change":"2023-10-09T15:38:23.304358+0000","last_active":"2023-10-09T15:38:23.304358+0000","last_peered":"2023-10-09T15:38:23.304358+0000","last_clean":"2023-10-09T15:38:23.304358+0000","last_became_active":"2023-10-09T15:38:23.304068+0000","last_became_peered":"2023-10-09T15:38:23.304068+0000","last_unstale":"2023-10-09T15:38:23.304358+0000","last_undegraded":"2023-10-09T15:38:23.304358+0000","last_fullsized":"2023-10-09T15:38:23.304358+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:08:14.986194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291423+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307329+0000","last_change":"2023-10-09T15:38:23.307329+0000","last_active":"2023-10-09T15:38:23.307329+0000","last_peered":"2023-10-09T15:38:23.307329+0000","last_clean":"2023-10-09T15:38:23.307329+0000","last_became_active":"2023-10-09T15:38:23.307005+0000","last_became_peered":"2023-10-09T15:38:23.307005+0000","last_unstale":"2023-10-09T15:38:23.307329+0000","last_undegraded":"2023-10-09T15:38:23.307329+0000","last_fullsized":"2023-10-09T15:38:23.307329+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292932+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307773+0000","last_change":"2023-10-09T15:38:23.307773+0000","last_active":"2023-10-09T15:38:23.307773+0000","last_peered":"2023-10-09T15:38:23.307773+0000","last_clean":"2023-10-09T15:38:23.307773+0000","last_became_active":"2023-10-09T15:38:23.306984+0000","last_became_peered":"2023-10-09T15:38:23.306984+0000","last_unstale":"2023-10-09T15:38:23.307773+0000","last_undegraded":"2023-10-09T15:38:23.307773+0000","last_fullsized":"2023-10-09T15:38:23.307773+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288021+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294901+0000","last_change":"2023-10-09T15:38:23.294901+0000","last_active":"2023-10-09T15:38:23.294901+0000","last_peered":"2023-10-09T15:38:23.294901+0000","last_clean":"2023-10-09T15:38:23.294901+0000","last_became_active":"2023-10-09T15:38:23.294632+0000","last_became_peered":"2023-10-09T15:38:23.294632+0000","last_unstale":"2023-10-09T15:38:23.294901+0000","last_undegraded":"2023-10-09T15:38:23.294901+0000","last_fullsized":"2023-10-09T15:38:23.294901+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.899576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286938+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302381+0000","last_change":"2023-10-09T15:38:23.302381+0000","last_active":"2023-10-09T15:38:23.302381+0000","last_peered":"2023-10-09T15:38:23.302381+0000","last_clean":"2023-10-09T15:38:23.302381+0000","last_became_active":"2023-10-09T15:38:23.302101+0000","last_became_peered":"2023-10-09T15:38:23.302101+0000","last_unstale":"2023-10-09T15:38:23.302381+0000","last_undegraded":"2023-10-09T15:38:23.302381+0000","last_fullsized":"2023-10-09T15:38:23.302381+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:10.713775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287306+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295663+0000","last_change":"2023-10-09T15:38:23.295663+0000","last_active":"2023-10-09T15:38:23.295663+0000","last_peered":"2023-10-09T15:38:23.295663+0000","last_clean":"2023-10-09T15:38:23.295663+0000","last_became_active":"2023-10-09T15:38:23.295394+0000","last_became_peered":"2023-10-09T15:38:23.295394+0000","last_unstale":"2023-10-09T15:38:23.295663+0000","last_undegraded":"2023-10-09T15:38:23.295663+0000","last_fullsized":"2023-10-09T15:38:23.295663+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:21.992427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282815+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296120+0000","last_change":"2023-10-09T15:38:23.296120+0000","last_active":"2023-10-09T15:38:23.296120+0000","last_peered":"2023-10-09T15:38:23.296120+0000","last_clean":"2023-10-09T15:38:23.296120+0000","last_became_active":"2023-10-09T15:38:23.295855+0000","last_became_peered":"2023-10-09T15:38:23.295855+0000","last_unstale":"2023-10-09T15:38:23.296120+0000","last_undegraded":"2023-10-09T15:38:23.296120+0000","last_fullsized":"2023-10-09T15:38:23.296120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:07.415921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284293+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:35.338209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303281+0000","last_change":"2023-10-09T15:38:23.303281+0000","last_active":"2023-10-09T15:38:23.303281+0000","last_peered":"2023-10-09T15:38:23.303281+0000","last_clean":"2023-10-09T15:38:23.303281+0000","last_became_active":"2023-10-09T15:38:23.302987+0000","last_became_peered":"2023-10-09T15:38:23.302987+0000","last_unstale":"2023-10-09T15:38:23.303281+0000","last_undegraded":"2023-10-09T15:38:23.303281+0000","last_fullsized":"2023-10-09T15:38:23.303281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:52.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292383+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298197+0000","last_change":"2023-10-09T15:38:23.298197+0000","last_active":"2023-10-09T15:38:23.298197+0000","last_peered":"2023-10-09T15:38:23.298197+0000","last_clean":"2023-10-09T15:38:23.298197+0000","last_became_active":"2023-10-09T15:38:23.297932+0000","last_became_peered":"2023-10-09T15:38:23.297932+0000","last_unstale":"2023-10-09T15:38:23.298197+0000","last_undegraded":"2023-10-09T15:38:23.298197+0000","last_fullsized":"2023-10-09T15:38:23.298197+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:56.430748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T15:38:22.286689+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:22.286689+0000","last_peered":"2023-10-09T15:38:22.286689+0000","last_clean":"2023-10-09T15:38:22.286689+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:22.286689+0000","last_undegraded":"2023-10-09T15:38:22.286689+0000","last_fullsized":"2023-10-09T15:38:22.286689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1365017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.312}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1364006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.434}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.245}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.313},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.29399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.376}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:38:28.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:38:28.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.956+0000 7f3378298700 1 Processor -- start 2023-10-09T15:38:28.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.956+0000 7f3378298700 1 -- start start 2023-10-09T15:38:28.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3378298700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33701595d0 0x7f33701599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3378298700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3370067a40 0x7f33700c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3378298700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33700c7f50 con 0x7f33700675a0 2023-10-09T15:38:28.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3378298700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337006bd00 con 0x7f33701595d0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3378298700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f337006b740 con 0x7f3370067a40 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33701595d0 0x7f33701599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f33701595d0 0x7f33701599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36942/0 (socket says 172.21.15.33:36942) 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 -- 172.21.15.33:0/2187066736 learned_addr learned my addr 172.21.15.33:0/2187066736 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376835700 1 --2- 172.21.15.33:0/2187066736 >> v2:172.21.15.59:3300/0 conn(0x7f3370067a40 0x7f33700c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 -- 172.21.15.33:0/2187066736 >> v2:172.21.15.59:3300/0 conn(0x7f3370067a40 msgr2=0x7f33700c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 --2- 172.21.15.33:0/2187066736 >> v2:172.21.15.59:3300/0 conn(0x7f3370067a40 0x7f33700c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 -- 172.21.15.33:0/2187066736 >> v1:172.21.15.59:6789/0 conn(0x7f33700675a0 legacy=0x7f337006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 -- 172.21.15.33:0/2187066736 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f337006ba20 con 0x7f33701595d0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3376034700 1 --2- 172.21.15.33:0/2187066736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f33701599a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f33700c7ec0 tx=0x7f3360009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3349b7490c1a0e02 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.957+0000 7f3375032700 1 -- 172.21.15.33:0/2187066736 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f336000e070 con 0x7f33701595d0 2023-10-09T15:38:28.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3375032700 1 -- 172.21.15.33:0/2187066736 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f336000ba10 con 0x7f33701595d0 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3375032700 1 -- 172.21.15.33:0/2187066736 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33600092e0 con 0x7f33701595d0 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 -- 172.21.15.33:0/2187066736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 msgr2=0x7f33701599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 --2- 172.21.15.33:0/2187066736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f33701599a0 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f33700c7ec0 tx=0x7f3360009840 comp rx=0 tx=0).stop 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 -- 172.21.15.33:0/2187066736 shutdown_connections 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 --2- 172.21.15.33:0/2187066736 >> v2:172.21.15.59:3300/0 conn(0x7f3370067a40 0x7f33700c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 --2- 172.21.15.33:0/2187066736 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f33701599a0 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 -- 172.21.15.33:0/2187066736 >> 172.21.15.33:0/2187066736 conn(0x7f33700cd400 msgr2=0x7f33700cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 -- 172.21.15.33:0/2187066736 shutdown_connections 2023-10-09T15:38:28.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.958+0000 7f3378298700 1 -- 172.21.15.33:0/2187066736 wait complete. 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.959+0000 7f3378298700 1 Processor -- start 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.959+0000 7f3378298700 1 -- start start 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33700675a0 0x7f3370154880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3370067a40 0x7f337015d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700b2b50 con 0x7f33701595d0 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33700b1f40 con 0x7f3370067a40 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3378298700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33700b2220 con 0x7f33700675a0 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36954/0 (socket says 172.21.15.33:36954) 2023-10-09T15:38:28.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 -- 172.21.15.33:0/919300011 learned_addr learned my addr 172.21.15.33:0/919300011 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376034700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33700675a0 0x7f3370154880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 -- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33700675a0 msgr2=0x7f3370154880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33700675a0 0x7f3370154880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3375833700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3370067a40 0x7f337015d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 -- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3370067a40 msgr2=0x7f337015d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3370067a40 0x7f337015d400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.960+0000 7f3376835700 1 -- 172.21.15.33:0/919300011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360009ae0 con 0x7f33701595d0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f3376835700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f336800d890 tx=0x7f3368008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33680125f0 con 0x7f33701595d0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3368012770 con 0x7f33701595d0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3368012b30 con 0x7f33701595d0 2023-10-09T15:38:28.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33700b2500 con 0x7f33701595d0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.961+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33701550d0 con 0x7f33701595d0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.962+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f337004c3c0 con 0x7f33701595d0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.962+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f336801e460 con 0x7f33701595d0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.962+0000 7f336e7fc700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 0x7f335c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.963+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3368085460 con 0x7f33701595d0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.963+0000 7f3376034700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 0x7f335c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:28.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.963+0000 7f3376034700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 0x7f335c0697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f33700c7430 tx=0x7f3360017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:28.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:28.967+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3368055b40 con 0x7f33701595d0 2023-10-09T15:38:29.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.156+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f33700c7be0 con 0x7f335c067320 2023-10-09T15:38:29.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.165+0000 7f336e7fc700 1 -- 172.21.15.33:0/919300011 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+286751 (secure 0 0 0) 0x7f33700c7be0 con 0x7f335c067320 2023-10-09T15:38:29.169 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 msgr2=0x7f335c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 0x7f335c0697d0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f33700c7430 tx=0x7f3360017000 comp rx=0 tx=0).stop 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 msgr2=0x7f337015db90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f336800d890 tx=0x7f3368008040 comp rx=0 tx=0).stop 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 shutdown_connections 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f335c067320 0x7f335c0697d0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f33701595d0 0x7f337015db90 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f33700675a0 0x7f3370154880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 --2- 172.21.15.33:0/919300011 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3370067a40 0x7f337015d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 >> 172.21.15.33:0/919300011 conn(0x7f33700cd400 msgr2=0x7f337006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 shutdown_connections 2023-10-09T15:38:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.168+0000 7f3378298700 1 -- 172.21.15.33:0/919300011 wait complete. 2023-10-09T15:38:29.172 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:38:29.181 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":360,"stamp":"2023-10-09T15:38:27.325356+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":13,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2425764,"kb_used_data":14692,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548956,"statfs":{"total":773094113280,"available":770610130944,"internally_reserved":0,"allocated":15044608,"data_stored":7376917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.048125"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290759+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284362+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287537+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:11:54.694037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286490+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289327+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:34:26.880417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286576+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284185+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290979+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289777+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293616+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284710+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284018+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285686+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289187+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282965+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290532+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289966+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:20.336017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287062+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.294845+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289574+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:50:34.339565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:49:06.533296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293849+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286634+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290037+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283029+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284873+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287042+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287583+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:00:05.071983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288402+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285052+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285676+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:56:18.506474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289477+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295090+0000","last_change":"2023-10-09T15:38:23.295090+0000","last_active":"2023-10-09T15:38:23.295090+0000","last_peered":"2023-10-09T15:38:23.295090+0000","last_clean":"2023-10-09T15:38:23.295090+0000","last_became_active":"2023-10-09T15:38:23.294818+0000","last_became_peered":"2023-10-09T15:38:23.294818+0000","last_unstale":"2023-10-09T15:38:23.295090+0000","last_undegraded":"2023-10-09T15:38:23.295090+0000","last_fullsized":"2023-10-09T15:38:23.295090+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:18.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.293417+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296219+0000","last_change":"2023-10-09T15:38:23.296219+0000","last_active":"2023-10-09T15:38:23.296219+0000","last_peered":"2023-10-09T15:38:23.296219+0000","last_clean":"2023-10-09T15:38:23.296219+0000","last_became_active":"2023-10-09T15:38:23.295917+0000","last_became_peered":"2023-10-09T15:38:23.295917+0000","last_unstale":"2023-10-09T15:38:23.296219+0000","last_undegraded":"2023-10-09T15:38:23.296219+0000","last_fullsized":"2023-10-09T15:38:23.296219+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:46.687122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286193+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296950+0000","last_change":"2023-10-09T15:38:23.296950+0000","last_active":"2023-10-09T15:38:23.296950+0000","last_peered":"2023-10-09T15:38:23.296950+0000","last_clean":"2023-10-09T15:38:23.296950+0000","last_became_active":"2023-10-09T15:38:23.296679+0000","last_became_peered":"2023-10-09T15:38:23.296679+0000","last_unstale":"2023-10-09T15:38:23.296950+0000","last_undegraded":"2023-10-09T15:38:23.296950+0000","last_fullsized":"2023-10-09T15:38:23.296950+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:13.408056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287884+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:43:19.323002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292974+0000","last_change":"2023-10-09T15:38:23.292974+0000","last_active":"2023-10-09T15:38:23.292974+0000","last_peered":"2023-10-09T15:38:23.292974+0000","last_clean":"2023-10-09T15:38:23.292974+0000","last_became_active":"2023-10-09T15:38:23.292685+0000","last_became_peered":"2023-10-09T15:38:23.292685+0000","last_unstale":"2023-10-09T15:38:23.292974+0000","last_undegraded":"2023-10-09T15:38:23.292974+0000","last_fullsized":"2023-10-09T15:38:23.292974+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:47.539894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292978+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302270+0000","last_change":"2023-10-09T15:38:23.302270+0000","last_active":"2023-10-09T15:38:23.302270+0000","last_peered":"2023-10-09T15:38:23.302270+0000","last_clean":"2023-10-09T15:38:23.302270+0000","last_became_active":"2023-10-09T15:38:23.301957+0000","last_became_peered":"2023-10-09T15:38:23.301957+0000","last_unstale":"2023-10-09T15:38:23.302270+0000","last_undegraded":"2023-10-09T15:38:23.302270+0000","last_fullsized":"2023-10-09T15:38:23.302270+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:32.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288589+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297340+0000","last_change":"2023-10-09T15:38:23.297340+0000","last_active":"2023-10-09T15:38:23.297340+0000","last_peered":"2023-10-09T15:38:23.297340+0000","last_clean":"2023-10-09T15:38:23.297340+0000","last_became_active":"2023-10-09T15:38:23.297078+0000","last_became_peered":"2023-10-09T15:38:23.297078+0000","last_unstale":"2023-10-09T15:38:23.297340+0000","last_undegraded":"2023-10-09T15:38:23.297340+0000","last_fullsized":"2023-10-09T15:38:23.297340+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.790798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295423+0000","last_change":"2023-10-09T15:38:23.295423+0000","last_active":"2023-10-09T15:38:23.295423+0000","last_peered":"2023-10-09T15:38:23.295423+0000","last_clean":"2023-10-09T15:38:23.295423+0000","last_became_active":"2023-10-09T15:38:23.295145+0000","last_became_peered":"2023-10-09T15:38:23.295145+0000","last_unstale":"2023-10-09T15:38:23.295423+0000","last_undegraded":"2023-10-09T15:38:23.295423+0000","last_fullsized":"2023-10-09T15:38:23.295423+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285606+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.293275+0000","last_change":"2023-10-09T15:38:23.293275+0000","last_active":"2023-10-09T15:38:23.293275+0000","last_peered":"2023-10-09T15:38:23.293275+0000","last_clean":"2023-10-09T15:38:23.293275+0000","last_became_active":"2023-10-09T15:38:23.292861+0000","last_became_peered":"2023-10-09T15:38:23.292861+0000","last_unstale":"2023-10-09T15:38:23.293275+0000","last_undegraded":"2023-10-09T15:38:23.293275+0000","last_fullsized":"2023-10-09T15:38:23.293275+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:36.984873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286683+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.292482+0000","last_change":"2023-10-09T15:38:23.292482+0000","last_active":"2023-10-09T15:38:23.292482+0000","last_peered":"2023-10-09T15:38:23.292482+0000","last_clean":"2023-10-09T15:38:23.292482+0000","last_became_active":"2023-10-09T15:38:23.292197+0000","last_became_peered":"2023-10-09T15:38:23.292197+0000","last_unstale":"2023-10-09T15:38:23.292482+0000","last_undegraded":"2023-10-09T15:38:23.292482+0000","last_fullsized":"2023-10-09T15:38:23.292482+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:52.049098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285426+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297633+0000","last_change":"2023-10-09T15:38:23.297633+0000","last_active":"2023-10-09T15:38:23.297633+0000","last_peered":"2023-10-09T15:38:23.297633+0000","last_clean":"2023-10-09T15:38:23.297633+0000","last_became_active":"2023-10-09T15:38:23.297339+0000","last_became_peered":"2023-10-09T15:38:23.297339+0000","last_unstale":"2023-10-09T15:38:23.297633+0000","last_undegraded":"2023-10-09T15:38:23.297633+0000","last_fullsized":"2023-10-09T15:38:23.297633+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:03.400037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291957+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.300928+0000","last_change":"2023-10-09T15:38:23.300928+0000","last_active":"2023-10-09T15:38:23.300928+0000","last_peered":"2023-10-09T15:38:23.300928+0000","last_clean":"2023-10-09T15:38:23.300928+0000","last_became_active":"2023-10-09T15:38:23.300605+0000","last_became_peered":"2023-10-09T15:38:23.300605+0000","last_unstale":"2023-10-09T15:38:23.300928+0000","last_undegraded":"2023-10-09T15:38:23.300928+0000","last_fullsized":"2023-10-09T15:38:23.300928+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:47.398116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285014+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295000+0000","last_change":"2023-10-09T15:38:23.295000+0000","last_active":"2023-10-09T15:38:23.295000+0000","last_peered":"2023-10-09T15:38:23.295000+0000","last_clean":"2023-10-09T15:38:23.295000+0000","last_became_active":"2023-10-09T15:38:23.294725+0000","last_became_peered":"2023-10-09T15:38:23.294725+0000","last_unstale":"2023-10-09T15:38:23.295000+0000","last_undegraded":"2023-10-09T15:38:23.295000+0000","last_fullsized":"2023-10-09T15:38:23.295000+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283566+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304386+0000","last_change":"2023-10-09T15:38:23.304386+0000","last_active":"2023-10-09T15:38:23.304386+0000","last_peered":"2023-10-09T15:38:23.304386+0000","last_clean":"2023-10-09T15:38:23.304386+0000","last_became_active":"2023-10-09T15:38:23.304054+0000","last_became_peered":"2023-10-09T15:38:23.304054+0000","last_unstale":"2023-10-09T15:38:23.304386+0000","last_undegraded":"2023-10-09T15:38:23.304386+0000","last_fullsized":"2023-10-09T15:38:23.304386+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287352+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297947+0000","last_change":"2023-10-09T15:38:23.297947+0000","last_active":"2023-10-09T15:38:23.297947+0000","last_peered":"2023-10-09T15:38:23.297947+0000","last_clean":"2023-10-09T15:38:23.297947+0000","last_became_active":"2023-10-09T15:38:23.297632+0000","last_became_peered":"2023-10-09T15:38:23.297632+0000","last_unstale":"2023-10-09T15:38:23.297947+0000","last_undegraded":"2023-10-09T15:38:23.297947+0000","last_fullsized":"2023-10-09T15:38:23.297947+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:40.606930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291159+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.305407+0000","last_change":"2023-10-09T15:38:23.305407+0000","last_active":"2023-10-09T15:38:23.305407+0000","last_peered":"2023-10-09T15:38:23.305407+0000","last_clean":"2023-10-09T15:38:23.305407+0000","last_became_active":"2023-10-09T15:38:23.305183+0000","last_became_peered":"2023-10-09T15:38:23.305183+0000","last_unstale":"2023-10-09T15:38:23.305407+0000","last_undegraded":"2023-10-09T15:38:23.305407+0000","last_fullsized":"2023-10-09T15:38:23.305407+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:09.115911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291363+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.297590+0000","last_change":"2023-10-09T15:38:23.297590+0000","last_active":"2023-10-09T15:38:23.297590+0000","last_peered":"2023-10-09T15:38:23.297590+0000","last_clean":"2023-10-09T15:38:23.297590+0000","last_became_active":"2023-10-09T15:38:23.297269+0000","last_became_peered":"2023-10-09T15:38:23.297269+0000","last_unstale":"2023-10-09T15:38:23.297590+0000","last_undegraded":"2023-10-09T15:38:23.297590+0000","last_fullsized":"2023-10-09T15:38:23.297590+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.289249+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298760+0000","last_change":"2023-10-09T15:38:23.298760+0000","last_active":"2023-10-09T15:38:23.298760+0000","last_peered":"2023-10-09T15:38:23.298760+0000","last_clean":"2023-10-09T15:38:23.298760+0000","last_became_active":"2023-10-09T15:38:23.298273+0000","last_became_peered":"2023-10-09T15:38:23.298273+0000","last_unstale":"2023-10-09T15:38:23.298760+0000","last_undegraded":"2023-10-09T15:38:23.298760+0000","last_fullsized":"2023-10-09T15:38:23.298760+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:43.720905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287116+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.308128+0000","last_change":"2023-10-09T15:38:23.308128+0000","last_active":"2023-10-09T15:38:23.308128+0000","last_peered":"2023-10-09T15:38:23.308128+0000","last_clean":"2023-10-09T15:38:23.308128+0000","last_became_active":"2023-10-09T15:38:23.307889+0000","last_became_peered":"2023-10-09T15:38:23.307889+0000","last_unstale":"2023-10-09T15:38:23.308128+0000","last_undegraded":"2023-10-09T15:38:23.308128+0000","last_fullsized":"2023-10-09T15:38:23.308128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283756+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.291888+0000","last_change":"2023-10-09T15:38:23.291888+0000","last_active":"2023-10-09T15:38:23.291888+0000","last_peered":"2023-10-09T15:38:23.291888+0000","last_clean":"2023-10-09T15:38:23.291888+0000","last_became_active":"2023-10-09T15:38:23.291632+0000","last_became_peered":"2023-10-09T15:38:23.291632+0000","last_unstale":"2023-10-09T15:38:23.291888+0000","last_undegraded":"2023-10-09T15:38:23.291888+0000","last_fullsized":"2023-10-09T15:38:23.291888+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:25.041292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.290733+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:32:18.335498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303601+0000","last_change":"2023-10-09T15:38:23.303601+0000","last_active":"2023-10-09T15:38:23.303601+0000","last_peered":"2023-10-09T15:38:23.303601+0000","last_clean":"2023-10-09T15:38:23.303601+0000","last_became_active":"2023-10-09T15:38:23.303304+0000","last_became_peered":"2023-10-09T15:38:23.303304+0000","last_unstale":"2023-10-09T15:38:23.303601+0000","last_undegraded":"2023-10-09T15:38:23.303601+0000","last_fullsized":"2023-10-09T15:38:23.303601+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:28.987172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282973+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296816+0000","last_change":"2023-10-09T15:38:23.296816+0000","last_active":"2023-10-09T15:38:23.296816+0000","last_peered":"2023-10-09T15:38:23.296816+0000","last_clean":"2023-10-09T15:38:23.296816+0000","last_became_active":"2023-10-09T15:38:23.296537+0000","last_became_peered":"2023-10-09T15:38:23.296537+0000","last_unstale":"2023-10-09T15:38:23.296816+0000","last_undegraded":"2023-10-09T15:38:23.296816+0000","last_fullsized":"2023-10-09T15:38:23.296816+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:28.097883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.283703+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303399+0000","last_change":"2023-10-09T15:38:23.303399+0000","last_active":"2023-10-09T15:38:23.303399+0000","last_peered":"2023-10-09T15:38:23.303399+0000","last_clean":"2023-10-09T15:38:23.303399+0000","last_became_active":"2023-10-09T15:38:23.303050+0000","last_became_peered":"2023-10-09T15:38:23.303050+0000","last_unstale":"2023-10-09T15:38:23.303399+0000","last_undegraded":"2023-10-09T15:38:23.303399+0000","last_fullsized":"2023-10-09T15:38:23.303399+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:05.168451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.285135+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:52:57.266935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294087+0000","last_change":"2023-10-09T15:38:23.294087+0000","last_active":"2023-10-09T15:38:23.294087+0000","last_peered":"2023-10-09T15:38:23.294087+0000","last_clean":"2023-10-09T15:38:23.294087+0000","last_became_active":"2023-10-09T15:38:23.293793+0000","last_became_peered":"2023-10-09T15:38:23.293793+0000","last_unstale":"2023-10-09T15:38:23.294087+0000","last_undegraded":"2023-10-09T15:38:23.294087+0000","last_fullsized":"2023-10-09T15:38:23.294087+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:19.327125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284288+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:27:32.345656+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.304358+0000","last_change":"2023-10-09T15:38:23.304358+0000","last_active":"2023-10-09T15:38:23.304358+0000","last_peered":"2023-10-09T15:38:23.304358+0000","last_clean":"2023-10-09T15:38:23.304358+0000","last_became_active":"2023-10-09T15:38:23.304068+0000","last_became_peered":"2023-10-09T15:38:23.304068+0000","last_unstale":"2023-10-09T15:38:23.304358+0000","last_undegraded":"2023-10-09T15:38:23.304358+0000","last_fullsized":"2023-10-09T15:38:23.304358+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:08:14.986194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.291423+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[7],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307329+0000","last_change":"2023-10-09T15:38:23.307329+0000","last_active":"2023-10-09T15:38:23.307329+0000","last_peered":"2023-10-09T15:38:23.307329+0000","last_clean":"2023-10-09T15:38:23.307329+0000","last_became_active":"2023-10-09T15:38:23.307005+0000","last_became_peered":"2023-10-09T15:38:23.307005+0000","last_unstale":"2023-10-09T15:38:23.307329+0000","last_undegraded":"2023-10-09T15:38:23.307329+0000","last_fullsized":"2023-10-09T15:38:23.307329+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292932+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.307773+0000","last_change":"2023-10-09T15:38:23.307773+0000","last_active":"2023-10-09T15:38:23.307773+0000","last_peered":"2023-10-09T15:38:23.307773+0000","last_clean":"2023-10-09T15:38:23.307773+0000","last_became_active":"2023-10-09T15:38:23.306984+0000","last_became_peered":"2023-10-09T15:38:23.306984+0000","last_unstale":"2023-10-09T15:38:23.307773+0000","last_undegraded":"2023-10-09T15:38:23.307773+0000","last_fullsized":"2023-10-09T15:38:23.307773+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.288021+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.294901+0000","last_change":"2023-10-09T15:38:23.294901+0000","last_active":"2023-10-09T15:38:23.294901+0000","last_peered":"2023-10-09T15:38:23.294901+0000","last_clean":"2023-10-09T15:38:23.294901+0000","last_became_active":"2023-10-09T15:38:23.294632+0000","last_became_peered":"2023-10-09T15:38:23.294632+0000","last_unstale":"2023-10-09T15:38:23.294901+0000","last_undegraded":"2023-10-09T15:38:23.294901+0000","last_fullsized":"2023-10-09T15:38:23.294901+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.899576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.286938+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.302381+0000","last_change":"2023-10-09T15:38:23.302381+0000","last_active":"2023-10-09T15:38:23.302381+0000","last_peered":"2023-10-09T15:38:23.302381+0000","last_clean":"2023-10-09T15:38:23.302381+0000","last_became_active":"2023-10-09T15:38:23.302101+0000","last_became_peered":"2023-10-09T15:38:23.302101+0000","last_unstale":"2023-10-09T15:38:23.302381+0000","last_undegraded":"2023-10-09T15:38:23.302381+0000","last_fullsized":"2023-10-09T15:38:23.302381+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:10.713775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.287306+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.295663+0000","last_change":"2023-10-09T15:38:23.295663+0000","last_active":"2023-10-09T15:38:23.295663+0000","last_peered":"2023-10-09T15:38:23.295663+0000","last_clean":"2023-10-09T15:38:23.295663+0000","last_became_active":"2023-10-09T15:38:23.295394+0000","last_became_peered":"2023-10-09T15:38:23.295394+0000","last_unstale":"2023-10-09T15:38:23.295663+0000","last_undegraded":"2023-10-09T15:38:23.295663+0000","last_fullsized":"2023-10-09T15:38:23.295663+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:21.992427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.282815+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.296120+0000","last_change":"2023-10-09T15:38:23.296120+0000","last_active":"2023-10-09T15:38:23.296120+0000","last_peered":"2023-10-09T15:38:23.296120+0000","last_clean":"2023-10-09T15:38:23.296120+0000","last_became_active":"2023-10-09T15:38:23.295855+0000","last_became_peered":"2023-10-09T15:38:23.295855+0000","last_unstale":"2023-10-09T15:38:23.296120+0000","last_undegraded":"2023-10-09T15:38:23.296120+0000","last_fullsized":"2023-10-09T15:38:23.296120+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:07.415921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.284293+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:35.338209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.303281+0000","last_change":"2023-10-09T15:38:23.303281+0000","last_active":"2023-10-09T15:38:23.303281+0000","last_peered":"2023-10-09T15:38:23.303281+0000","last_clean":"2023-10-09T15:38:23.303281+0000","last_became_active":"2023-10-09T15:38:23.302987+0000","last_became_peered":"2023-10-09T15:38:23.302987+0000","last_unstale":"2023-10-09T15:38:23.303281+0000","last_undegraded":"2023-10-09T15:38:23.303281+0000","last_fullsized":"2023-10-09T15:38:23.303281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:52.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"creating+peering","last_fresh":"2023-10-09T15:38:23.276855+0000","last_change":"2023-10-09T15:38:23.292383+0000","last_active":"2023-10-09T15:38:23.276855+0000","last_peered":"2023-10-09T15:38:23.276855+0000","last_clean":"2023-10-09T15:38:23.276855+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-10-09T15:38:23.276855+0000","last_undegraded":"2023-10-09T15:38:23.276855+0000","last_fullsized":"2023-10-09T15:38:23.276855+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[6],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":8,"reported_epoch":138,"state":"active+clean","last_fresh":"2023-10-09T15:38:23.298197+0000","last_change":"2023-10-09T15:38:23.298197+0000","last_active":"2023-10-09T15:38:23.298197+0000","last_peered":"2023-10-09T15:38:23.298197+0000","last_clean":"2023-10-09T15:38:23.298197+0000","last_became_active":"2023-10-09T15:38:23.297932+0000","last_became_peered":"2023-10-09T15:38:23.297932+0000","last_unstale":"2023-10-09T15:38:23.298197+0000","last_undegraded":"2023-10-09T15:38:23.298197+0000","last_fullsized":"2023-10-09T15:38:23.298197+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:56.430748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":262,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-10-09T15:38:22.286689+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:22.286689+0000","last_peered":"2023-10-09T15:38:22.286689+0000","last_clean":"2023-10-09T15:38:22.286689+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:22.286689+0000","last_undegraded":"2023-10-09T15:38:22.286689+0000","last_fullsized":"2023-10-09T15:38:22.286689+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574942,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303656,"kb_used_data":2272,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068184,"statfs":{"total":96636764160,"available":96325820416,"internally_reserved":0,"allocated":2326528,"data_stored":1365017,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.70799999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.54900000000000004}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.68600000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.77100000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.34599999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.36599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.47299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.34799999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.50800000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.72799999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.625},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.70499999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.80300000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.85999999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574943,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.27500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.312}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.34399999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.52100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.63800000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574941,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303652,"kb_used_data":2268,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068188,"statfs":{"total":96636764160,"available":96325824512,"internally_reserved":0,"allocated":2322432,"data_stored":1364006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.47999999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.434}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.58199999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.61699999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.78900000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.89000000000000001},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.77800000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.83799999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.76100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574942,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.245}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.313},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.29399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.376}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.501},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.56399999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.47999999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53200000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58099999999999996}]}]},{"osd":3,"up_from":13,"seq":55834574940,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.27000000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.35799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.372}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.69699999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.59199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.77900000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.76200000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574941,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.505},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.59999999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.52700000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.64900000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.66700000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.622}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.76900000000000002}]}]},{"osd":5,"up_from":13,"seq":55834574942,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303076,"kb_used_data":1692,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068764,"statfs":{"total":96636764160,"available":96326414336,"internally_reserved":0,"allocated":1732608,"data_stored":774649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.49399999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.57099999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.68200000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.71199999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.69799999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.75600000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.76900000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3f is not active+clean 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.290759+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3e is not active+clean 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284362+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3d is not active+clean 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287537+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:11:54.694037+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3c is not active+clean 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286490+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3b is not active+clean 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289327+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:34:26.880417+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3a is not active+clean 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286576+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.39 is not active+clean 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284185+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.38 is not active+clean 2023-10-09T15:38:29.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.290979+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.37 is not active+clean 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289777+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.36 is not active+clean 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.293616+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.35 is not active+clean 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284710+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.34 is not active+clean 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284018+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.33 is not active+clean 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285686+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.32 is not active+clean 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289187+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.31 is not active+clean 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.282965+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:25:51.031752+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.30 is not active+clean 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.290532+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2f is not active+clean 2023-10-09T15:38:29.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289966+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:22:20.336017+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2e is not active+clean 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287062+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2d is not active+clean 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.294845+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2c is not active+clean 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289574+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:50:34.339565+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2b is not active+clean 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287676+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:49:06.533296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2a is not active+clean 2023-10-09T15:38:29.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.293849+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.29 is not active+clean 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286634+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.28 is not active+clean 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.290037+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:34:48.563920+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.27 is not active+clean 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283029+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.26 is not active+clean 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284873+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.25 is not active+clean 2023-10-09T15:38:29.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287042+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.24 is not active+clean 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287583+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:00:05.071983+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.23 is not active+clean 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283756+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:31:18.834207+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.22 is not active+clean 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.288402+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.21 is not active+clean 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285052+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.20 is not active+clean 2023-10-09T15:38:29.193 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285676+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:56:18.506474+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1e is not active+clean 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289477+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1f is not active+clean 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.293417+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1c is not active+clean 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286193+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1d is not active+clean 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287884+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:43:19.323002+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1a is not active+clean 2023-10-09T15:38:29.194 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.292978+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1b is not active+clean 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.288589+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.19 is not active+clean 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283733+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.16 is not active+clean 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285606+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.17 is not active+clean 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286683+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:33:24.516290+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.14 is not active+clean 2023-10-09T15:38:29.195 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285426+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.15 is not active+clean 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.291957+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:24:09.908468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.12 is not active+clean 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285014+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.13 is not active+clean 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283566+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.10 is not active+clean 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287352+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.196 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.11 is not active+clean 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.291159+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:04:18.768395+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.e is not active+clean 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.291363+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.f is not active+clean 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.289249+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:24:48.865653+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.c is not active+clean 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287116+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.d is not active+clean 2023-10-09T15:38:29.197 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283756+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.a is not active+clean 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.290733+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T00:32:18.335498+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [2], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.b is not active+clean 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.282973+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.8 is not active+clean 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.283703+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.9 is not active+clean 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.285135+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T21:52:57.266935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.6 is not active+clean 2023-10-09T15:38:29.198 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284288+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T02:27:32.345656+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.7 is not active+clean 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.291423+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [7], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.4 is not active+clean 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.292932+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.5 is not active+clean 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.288021+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:14:35.053595+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.2 is not active+clean 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.286938+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:49:33.728664+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:38:29.199 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.3 is not active+clean 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.287306+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T16:55:53.944973+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.0 is not active+clean 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.282815+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T18:21:37.303057+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.1 is not active+clean 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.284293+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-10T19:24:35.338209+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:PG 25.18 is not active+clean 2023-10-09T15:38:29.200 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '25.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'creating+peering', 'last_fresh': '2023-10-09T15:38:23.276855+0000', 'last_change': '2023-10-09T15:38:23.292383+0000', 'last_active': '2023-10-09T15:38:23.276855+0000', 'last_peered': '2023-10-09T15:38:23.276855+0000', 'last_clean': '2023-10-09T15:38:23.276855+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-10-09T15:38:23.276855+0000', 'last_undegraded': '2023-10-09T15:38:23.276855+0000', 'last_fullsized': '2023-10-09T15:38:23.276855+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'last_clean_scrub_stamp': '2023-10-09T15:38:23.276855+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [6], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-10-09T15:38:29.201 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-10-09T15:38:29.201 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:38:29.195+0000 7f3c43791700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:29.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.317+0000 7fbc48d17700 1 Processor -- start 2023-10-09T15:38:29.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.317+0000 7fbc48d17700 1 -- start start 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc48d17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a8d00 0x7fbc440cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc48d17700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc4406e550 0x7fbc440af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc48d17700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc440aeee0 con 0x7fbc440a90d0 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc48d17700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc440ae680 con 0x7fbc4406e550 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc48d17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc440cf490 con 0x7fbc440a8d00 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc42d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc4406e550 0x7fbc440af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc42d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbc4406e550 0x7fbc440af370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36964/0 (socket says 172.21.15.33:36964) 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.318+0000 7fbc42d9d700 1 -- 172.21.15.33:0/1592605340 learned_addr learned my addr 172.21.15.33:0/1592605340 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc4259c700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a8d00 0x7fbc440cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc42d9d700 1 -- 172.21.15.33:0/1592605340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a8d00 msgr2=0x7fbc440cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc42d9d700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a8d00 0x7fbc440cddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc42d9d700 1 -- 172.21.15.33:0/1592605340 >> v1:172.21.15.59:6789/0 conn(0x7fbc440a90d0 legacy=0x7fbc4406de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc42d9d700 1 -- 172.21.15.33:0/1592605340 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc440ce330 con 0x7fbc4406e550 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc42d9d700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc440af370 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009f20 tx=0x7fbc3c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6afba7d933a445b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc4159a700 1 -- 172.21.15.33:0/1592605340 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c00e070 con 0x7fbc4406e550 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc4159a700 1 -- 172.21.15.33:0/1592605340 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc3c00ba80 con 0x7fbc4406e550 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.319+0000 7fbc4159a700 1 -- 172.21.15.33:0/1592605340 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc3c0092e0 con 0x7fbc4406e550 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 -- 172.21.15.33:0/1592605340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 msgr2=0x7fbc440af370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc440af370 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7fbc3c009f20 tx=0x7fbc3c009840 comp rx=0 tx=0).stop 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 -- 172.21.15.33:0/1592605340 shutdown_connections 2023-10-09T15:38:29.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc440af370 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 --2- 172.21.15.33:0/1592605340 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a8d00 0x7fbc440cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 -- 172.21.15.33:0/1592605340 >> 172.21.15.33:0/1592605340 conn(0x7fbc4406ce80 msgr2=0x7fbc440ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 -- 172.21.15.33:0/1592605340 shutdown_connections 2023-10-09T15:38:29.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.320+0000 7fbc48d17700 1 -- 172.21.15.33:0/1592605340 wait complete. 2023-10-09T15:38:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.321+0000 7fbc48d17700 1 Processor -- start 2023-10-09T15:38:29.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.321+0000 7fbc48d17700 1 -- start start 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc440a8d00 0x7fbc44158b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a90d0 0x7fbc440b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc44098910 con 0x7fbc4406e550 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4416d510 con 0x7fbc440a8d00 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc48d17700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4416d790 con 0x7fbc440a90d0 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc4259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36976/0 (socket says 172.21.15.33:36976) 2023-10-09T15:38:29.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.322+0000 7fbc4259c700 1 -- 172.21.15.33:0/3706880206 learned_addr learned my addr 172.21.15.33:0/3706880206 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc42d9d700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a90d0 0x7fbc440b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc41d9b700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc440a8d00 0x7fbc44158b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 -- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a90d0 msgr2=0x7fbc440b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a90d0 0x7fbc440b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 -- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc440a8d00 msgr2=0x7fbc44158b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc440a8d00 0x7fbc44158b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 -- 172.21.15.33:0/3706880206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c009ae0 con 0x7fbc4406e550 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc4259c700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400d840 tx=0x7fbc34008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34014620 con 0x7fbc4406e550 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.323+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc34014780 con 0x7fbc4406e550 2023-10-09T15:38:29.327 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.324+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4416da70 con 0x7fbc4406e550 2023-10-09T15:38:29.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.324+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc34014b40 con 0x7fbc4406e550 2023-10-09T15:38:29.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.324+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc440985a0 con 0x7fbc4406e550 2023-10-09T15:38:29.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.325+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc4404c3c0 con 0x7fbc4406e550 2023-10-09T15:38:29.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.325+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fbc3401d400 con 0x7fbc4406e550 2023-10-09T15:38:29.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.325+0000 7fbc3a7fc700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 0x7fbc240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.326+0000 7fbc41d9b700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 0x7fbc240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.326+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fbc340855d0 con 0x7fbc4406e550 2023-10-09T15:38:29.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.326+0000 7fbc41d9b700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 0x7fbc240697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0037f0 tx=0x7fbc2c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.330+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fbc34052260 con 0x7fbc4406e550 2023-10-09T15:38:29.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.607+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbc44067b20 con 0x7fbc4406e550 2023-10-09T15:38:29.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.608+0000 7fbc3a7fc700 1 -- 172.21.15.33:0/3706880206 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1458 (secure 0 0 0) 0x7fbc34055880 con 0x7fbc4406e550 2023-10-09T15:38:29.609 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:29.609 INFO:teuthology.orchestra.run.smithi033.stdout:{"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":468,"monmap":{"epoch":1,"min_mon_release_name":"quincy","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1696865452,"num_in_osds":8,"osd_in_since":1696865443,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2483982336,"bytes_avail":770610130944,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":93,"id":12,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":12,"rank":0,"name":"a","status":"up:active","gid":7533}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":9,"modified":"2023-10-09T15:38:13.322995+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-10-09T15:38:29.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 msgr2=0x7fbc240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 0x7fbc240697d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0037f0 tx=0x7fbc2c009040 comp rx=0 tx=0).stop 2023-10-09T15:38:29.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 msgr2=0x7fbc4416cfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7fbc3400d840 tx=0x7fbc34008040 comp rx=0 tx=0).stop 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 shutdown_connections 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fbc24067320 0x7fbc240697d0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbc4406e550 0x7fbc4416cfd0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbc440a90d0 0x7fbc440b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 --2- 172.21.15.33:0/3706880206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbc440a8d00 0x7fbc44158b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 >> 172.21.15.33:0/3706880206 conn(0x7fbc4406ce80 msgr2=0x7fbc4415ea70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 shutdown_connections 2023-10-09T15:38:29.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.610+0000 7fbc48d17700 1 -- 172.21.15.33:0/3706880206 wait complete. 2023-10-09T15:38:29.623 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-10-09T15:38:29.623 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:38:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.741+0000 7ff3743b8700 1 Processor -- start 2023-10-09T15:38:29.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.741+0000 7ff3743b8700 1 -- start start 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff3743b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff36c15a7d0 0x7ff36c158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff3743b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c0af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff3743b8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff36c158c80 con 0x7ff36c1508c0 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff3743b8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff36c15afc0 con 0x7ff36c15a7d0 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff3743b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c0af820 con 0x7ff36c150c90 2023-10-09T15:38:29.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff371953700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff36c15a7d0 0x7ff36c158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.742+0000 7ff371953700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff36c15a7d0 0x7ff36c158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36988/0 (socket says 172.21.15.33:36988) 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 -- 172.21.15.33:0/1738908162 learned_addr learned my addr 172.21.15.33:0/1738908162 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff372955700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c0af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 -- 172.21.15.33:0/1738908162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 msgr2=0x7ff36c0af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c0af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 -- 172.21.15.33:0/1738908162 >> v1:172.21.15.59:6789/0 conn(0x7ff36c1508c0 legacy=0x7ff36c15a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 -- 172.21.15.33:0/1738908162 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff36c155710 con 0x7ff36c15a7d0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371953700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c15a7d0 0x7ff36c158650 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099b0 tx=0x7ff360009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3718532adf97c73e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371152700 1 -- 172.21.15.33:0/1738908162 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000b820 con 0x7ff36c15a7d0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371152700 1 -- 172.21.15.33:0/1738908162 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff36000b980 con 0x7ff36c15a7d0 2023-10-09T15:38:29.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.743+0000 7ff371152700 1 -- 172.21.15.33:0/1738908162 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff36000bd20 con 0x7ff36c15a7d0 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 -- 172.21.15.33:0/1738908162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c15a7d0 msgr2=0x7ff36c158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c15a7d0 0x7ff36c158650 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099b0 tx=0x7ff360009250 comp rx=0 tx=0).stop 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 -- 172.21.15.33:0/1738908162 shutdown_connections 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c0af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1738908162 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c15a7d0 0x7ff36c158650 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 -- 172.21.15.33:0/1738908162 >> 172.21.15.33:0/1738908162 conn(0x7ff36c0cded0 msgr2=0x7ff36c06add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 -- 172.21.15.33:0/1738908162 shutdown_connections 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.744+0000 7ff3743b8700 1 -- 172.21.15.33:0/1738908162 wait complete. 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.745+0000 7ff3743b8700 1 Processor -- start 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.745+0000 7ff3743b8700 1 -- start start 2023-10-09T15:38:29.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c151380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c15a7d0 0x7ff36c14fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c152900 con 0x7ff36c1508c0 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c151cf0 con 0x7ff36c15a7d0 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff36c151fd0 con 0x7ff36c150c90 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:37000/0 (socket says 172.21.15.33:37000) 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 -- 172.21.15.33:0/1511666346 learned_addr learned my addr 172.21.15.33:0/1511666346 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 -- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 msgr2=0x7ff36c151380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c151380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 -- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c15a7d0 msgr2=0x7ff36c14fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c15a7d0 0x7ff36c14fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 -- 172.21.15.33:0/1511666346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3600094f0 con 0x7ff36c1508c0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff372154700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00bc30 tx=0x7ff35c009820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c00c9b0 con 0x7ff36c1508c0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff35c00cb50 con 0x7ff36c1508c0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff36c1522b0 con 0x7ff36c1508c0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff35c014410 con 0x7ff36c1508c0 2023-10-09T15:38:29.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.746+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff36c16a560 con 0x7ff36c1508c0 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.747+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff36c152c70 con 0x7ff36c1508c0 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.748+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff35c014800 con 0x7ff36c1508c0 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.748+0000 7ff36a7fc700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 0x7ff3580697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.748+0000 7ff371953700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 0x7ff3580697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.748+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff35c084d20 con 0x7ff36c1508c0 2023-10-09T15:38:29.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.749+0000 7ff371953700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 0x7ff3580697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099b0 tx=0x7ff360016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:29.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.753+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff35c04c5a0 con 0x7ff36c1508c0 2023-10-09T15:38:29.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.942+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff36c152a40 con 0x7ff358067320 2023-10-09T15:38:29.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.951+0000 7ff36a7fc700 1 -- 172.21.15.33:0/1511666346 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289734 (secure 0 0 0) 0x7ff360020070 con 0x7ff358067320 2023-10-09T15:38:29.955 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 msgr2=0x7ff3580697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 0x7ff3580697d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7ff3600099b0 tx=0x7ff360016000 comp rx=0 tx=0).stop 2023-10-09T15:38:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 msgr2=0x7ff36c16a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7ff35c00bc30 tx=0x7ff35c009820 comp rx=0 tx=0).stop 2023-10-09T15:38:29.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 shutdown_connections 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff358067320 0x7ff3580697d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff36c1508c0 0x7ff36c16a020 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff36c15a7d0 0x7ff36c14fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 --2- 172.21.15.33:0/1511666346 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff36c150c90 0x7ff36c151380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 >> 172.21.15.33:0/1511666346 conn(0x7ff36c0cded0 msgr2=0x7ff36c0686a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 shutdown_connections 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:29.954+0000 7ff3743b8700 1 -- 172.21.15.33:0/1511666346 wait complete. 2023-10-09T15:38:29.958 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:38:29.967 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":361,"stamp":"2023-10-09T15:38:29.325708+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426116,"kb_used_data":15044,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548604,"statfs":{"total":773094113280,"available":770609770496,"internally_reserved":0,"allocated":15405056,"data_stored":7536041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.046000"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329068+0000","last_change":"2023-10-09T15:38:24.323193+0000","last_active":"2023-10-09T15:38:24.329068+0000","last_peered":"2023-10-09T15:38:24.329068+0000","last_clean":"2023-10-09T15:38:24.329068+0000","last_became_active":"2023-10-09T15:38:24.322929+0000","last_became_peered":"2023-10-09T15:38:24.322929+0000","last_unstale":"2023-10-09T15:38:24.329068+0000","last_undegraded":"2023-10-09T15:38:24.329068+0000","last_fullsized":"2023-10-09T15:38:24.329068+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310773+0000","last_change":"2023-10-09T15:38:24.305323+0000","last_active":"2023-10-09T15:38:24.310773+0000","last_peered":"2023-10-09T15:38:24.310773+0000","last_clean":"2023-10-09T15:38:24.310773+0000","last_became_active":"2023-10-09T15:38:24.304972+0000","last_became_peered":"2023-10-09T15:38:24.304972+0000","last_unstale":"2023-10-09T15:38:24.310773+0000","last_undegraded":"2023-10-09T15:38:24.310773+0000","last_fullsized":"2023-10-09T15:38:24.310773+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324606+0000","last_change":"2023-10-09T15:38:24.319146+0000","last_active":"2023-10-09T15:38:24.324606+0000","last_peered":"2023-10-09T15:38:24.324606+0000","last_clean":"2023-10-09T15:38:24.324606+0000","last_became_active":"2023-10-09T15:38:24.318864+0000","last_became_peered":"2023-10-09T15:38:24.318864+0000","last_unstale":"2023-10-09T15:38:24.324606+0000","last_undegraded":"2023-10-09T15:38:24.324606+0000","last_fullsized":"2023-10-09T15:38:24.324606+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:43.413439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313304+0000","last_change":"2023-10-09T15:38:24.306533+0000","last_active":"2023-10-09T15:38:24.313304+0000","last_peered":"2023-10-09T15:38:24.313304+0000","last_clean":"2023-10-09T15:38:24.313304+0000","last_became_active":"2023-10-09T15:38:24.306262+0000","last_became_peered":"2023-10-09T15:38:24.306262+0000","last_unstale":"2023-10-09T15:38:24.313304+0000","last_undegraded":"2023-10-09T15:38:24.313304+0000","last_fullsized":"2023-10-09T15:38:24.313304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:36.787180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323024+0000","last_change":"2023-10-09T15:38:24.322013+0000","last_active":"2023-10-09T15:38:24.323024+0000","last_peered":"2023-10-09T15:38:24.323024+0000","last_clean":"2023-10-09T15:38:24.323024+0000","last_became_active":"2023-10-09T15:38:24.319750+0000","last_became_peered":"2023-10-09T15:38:24.319750+0000","last_unstale":"2023-10-09T15:38:24.323024+0000","last_undegraded":"2023-10-09T15:38:24.323024+0000","last_fullsized":"2023-10-09T15:38:24.323024+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:07.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323970+0000","last_change":"2023-10-09T15:38:24.317319+0000","last_active":"2023-10-09T15:38:24.323970+0000","last_peered":"2023-10-09T15:38:24.323970+0000","last_clean":"2023-10-09T15:38:24.323970+0000","last_became_active":"2023-10-09T15:38:24.316611+0000","last_became_peered":"2023-10-09T15:38:24.316611+0000","last_unstale":"2023-10-09T15:38:24.323970+0000","last_undegraded":"2023-10-09T15:38:24.323970+0000","last_fullsized":"2023-10-09T15:38:24.323970+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:16:50.740204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326230+0000","last_change":"2023-10-09T15:38:24.323874+0000","last_active":"2023-10-09T15:38:24.326230+0000","last_peered":"2023-10-09T15:38:24.326230+0000","last_clean":"2023-10-09T15:38:24.326230+0000","last_became_active":"2023-10-09T15:38:24.323571+0000","last_became_peered":"2023-10-09T15:38:24.323571+0000","last_unstale":"2023-10-09T15:38:24.326230+0000","last_undegraded":"2023-10-09T15:38:24.326230+0000","last_fullsized":"2023-10-09T15:38:24.326230+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321229+0000","last_change":"2023-10-09T15:38:24.314353+0000","last_active":"2023-10-09T15:38:24.321229+0000","last_peered":"2023-10-09T15:38:24.321229+0000","last_clean":"2023-10-09T15:38:24.321229+0000","last_became_active":"2023-10-09T15:38:24.314081+0000","last_became_peered":"2023-10-09T15:38:24.314081+0000","last_unstale":"2023-10-09T15:38:24.321229+0000","last_undegraded":"2023-10-09T15:38:24.321229+0000","last_fullsized":"2023-10-09T15:38:24.321229+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:55.948897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328455+0000","last_change":"2023-10-09T15:38:24.325074+0000","last_active":"2023-10-09T15:38:24.328455+0000","last_peered":"2023-10-09T15:38:24.328455+0000","last_clean":"2023-10-09T15:38:24.328455+0000","last_became_active":"2023-10-09T15:38:24.324534+0000","last_became_peered":"2023-10-09T15:38:24.324534+0000","last_unstale":"2023-10-09T15:38:24.328455+0000","last_undegraded":"2023-10-09T15:38:24.328455+0000","last_fullsized":"2023-10-09T15:38:24.328455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319974+0000","last_change":"2023-10-09T15:38:24.309304+0000","last_active":"2023-10-09T15:38:24.319974+0000","last_peered":"2023-10-09T15:38:24.319974+0000","last_clean":"2023-10-09T15:38:24.319974+0000","last_became_active":"2023-10-09T15:38:24.309049+0000","last_became_peered":"2023-10-09T15:38:24.309049+0000","last_unstale":"2023-10-09T15:38:24.319974+0000","last_undegraded":"2023-10-09T15:38:24.319974+0000","last_fullsized":"2023-10-09T15:38:24.319974+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325073+0000","last_change":"2023-10-09T15:38:24.317856+0000","last_active":"2023-10-09T15:38:24.325073+0000","last_peered":"2023-10-09T15:38:24.325073+0000","last_clean":"2023-10-09T15:38:24.325073+0000","last_became_active":"2023-10-09T15:38:24.317521+0000","last_became_peered":"2023-10-09T15:38:24.317521+0000","last_unstale":"2023-10-09T15:38:24.325073+0000","last_undegraded":"2023-10-09T15:38:24.325073+0000","last_fullsized":"2023-10-09T15:38:24.325073+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328628+0000","last_change":"2023-10-09T15:38:24.319324+0000","last_active":"2023-10-09T15:38:24.328628+0000","last_peered":"2023-10-09T15:38:24.328628+0000","last_clean":"2023-10-09T15:38:24.328628+0000","last_became_active":"2023-10-09T15:38:24.318216+0000","last_became_peered":"2023-10-09T15:38:24.318216+0000","last_unstale":"2023-10-09T15:38:24.328628+0000","last_undegraded":"2023-10-09T15:38:24.328628+0000","last_fullsized":"2023-10-09T15:38:24.328628+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.318323+0000","last_change":"2023-10-09T15:38:24.309688+0000","last_active":"2023-10-09T15:38:24.318323+0000","last_peered":"2023-10-09T15:38:24.318323+0000","last_clean":"2023-10-09T15:38:24.318323+0000","last_became_active":"2023-10-09T15:38:24.309363+0000","last_became_peered":"2023-10-09T15:38:24.309363+0000","last_unstale":"2023-10-09T15:38:24.318323+0000","last_undegraded":"2023-10-09T15:38:24.318323+0000","last_fullsized":"2023-10-09T15:38:24.318323+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:51:34.277988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326738+0000","last_change":"2023-10-09T15:38:24.324304+0000","last_active":"2023-10-09T15:38:24.326738+0000","last_peered":"2023-10-09T15:38:24.326738+0000","last_clean":"2023-10-09T15:38:24.326738+0000","last_became_active":"2023-10-09T15:38:24.323997+0000","last_became_peered":"2023-10-09T15:38:24.323997+0000","last_unstale":"2023-10-09T15:38:24.326738+0000","last_undegraded":"2023-10-09T15:38:24.326738+0000","last_fullsized":"2023-10-09T15:38:24.326738+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328619+0000","last_change":"2023-10-09T15:38:24.317448+0000","last_active":"2023-10-09T15:38:24.328619+0000","last_peered":"2023-10-09T15:38:24.328619+0000","last_clean":"2023-10-09T15:38:24.328619+0000","last_became_active":"2023-10-09T15:38:24.317176+0000","last_became_peered":"2023-10-09T15:38:24.317176+0000","last_unstale":"2023-10-09T15:38:24.328619+0000","last_undegraded":"2023-10-09T15:38:24.328619+0000","last_fullsized":"2023-10-09T15:38:24.328619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322083+0000","last_change":"2023-10-09T15:38:24.321246+0000","last_active":"2023-10-09T15:38:24.322083+0000","last_peered":"2023-10-09T15:38:24.322083+0000","last_clean":"2023-10-09T15:38:24.322083+0000","last_became_active":"2023-10-09T15:38:24.320289+0000","last_became_peered":"2023-10-09T15:38:24.320289+0000","last_unstale":"2023-10-09T15:38:24.322083+0000","last_undegraded":"2023-10-09T15:38:24.322083+0000","last_fullsized":"2023-10-09T15:38:24.322083+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:20.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314136+0000","last_change":"2023-10-09T15:38:24.308178+0000","last_active":"2023-10-09T15:38:24.314136+0000","last_peered":"2023-10-09T15:38:24.314136+0000","last_clean":"2023-10-09T15:38:24.314136+0000","last_became_active":"2023-10-09T15:38:24.307923+0000","last_became_peered":"2023-10-09T15:38:24.307923+0000","last_unstale":"2023-10-09T15:38:24.314136+0000","last_undegraded":"2023-10-09T15:38:24.314136+0000","last_fullsized":"2023-10-09T15:38:24.314136+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:11.722667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327319+0000","last_change":"2023-10-09T15:38:24.320402+0000","last_active":"2023-10-09T15:38:24.327319+0000","last_peered":"2023-10-09T15:38:24.327319+0000","last_clean":"2023-10-09T15:38:24.327319+0000","last_became_active":"2023-10-09T15:38:24.319191+0000","last_became_peered":"2023-10-09T15:38:24.319191+0000","last_unstale":"2023-10-09T15:38:24.327319+0000","last_undegraded":"2023-10-09T15:38:24.327319+0000","last_fullsized":"2023-10-09T15:38:24.327319+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321304+0000","last_change":"2023-10-09T15:38:24.318348+0000","last_active":"2023-10-09T15:38:24.321304+0000","last_peered":"2023-10-09T15:38:24.321304+0000","last_clean":"2023-10-09T15:38:24.321304+0000","last_became_active":"2023-10-09T15:38:24.318080+0000","last_became_peered":"2023-10-09T15:38:24.318080+0000","last_unstale":"2023-10-09T15:38:24.321304+0000","last_undegraded":"2023-10-09T15:38:24.321304+0000","last_fullsized":"2023-10-09T15:38:24.321304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:02.127776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.318020+0000","last_change":"2023-10-09T15:38:24.315336+0000","last_active":"2023-10-09T15:38:24.318020+0000","last_peered":"2023-10-09T15:38:24.318020+0000","last_clean":"2023-10-09T15:38:24.318020+0000","last_became_active":"2023-10-09T15:38:24.315063+0000","last_became_peered":"2023-10-09T15:38:24.315063+0000","last_unstale":"2023-10-09T15:38:24.318020+0000","last_undegraded":"2023-10-09T15:38:24.318020+0000","last_fullsized":"2023-10-09T15:38:24.318020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:30.489921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322300+0000","last_change":"2023-10-09T15:38:24.320005+0000","last_active":"2023-10-09T15:38:24.322300+0000","last_peered":"2023-10-09T15:38:24.322300+0000","last_clean":"2023-10-09T15:38:24.322300+0000","last_became_active":"2023-10-09T15:38:24.319430+0000","last_became_peered":"2023-10-09T15:38:24.319430+0000","last_unstale":"2023-10-09T15:38:24.322300+0000","last_undegraded":"2023-10-09T15:38:24.322300+0000","last_fullsized":"2023-10-09T15:38:24.322300+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:47.696014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321028+0000","last_change":"2023-10-09T15:38:24.312193+0000","last_active":"2023-10-09T15:38:24.321028+0000","last_peered":"2023-10-09T15:38:24.321028+0000","last_clean":"2023-10-09T15:38:24.321028+0000","last_became_active":"2023-10-09T15:38:24.311946+0000","last_became_peered":"2023-10-09T15:38:24.311946+0000","last_unstale":"2023-10-09T15:38:24.321028+0000","last_undegraded":"2023-10-09T15:38:24.321028+0000","last_fullsized":"2023-10-09T15:38:24.321028+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:20.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323999+0000","last_change":"2023-10-09T15:38:24.316739+0000","last_active":"2023-10-09T15:38:24.323999+0000","last_peered":"2023-10-09T15:38:24.323999+0000","last_clean":"2023-10-09T15:38:24.323999+0000","last_became_active":"2023-10-09T15:38:24.316444+0000","last_became_peered":"2023-10-09T15:38:24.316444+0000","last_unstale":"2023-10-09T15:38:24.323999+0000","last_undegraded":"2023-10-09T15:38:24.323999+0000","last_fullsized":"2023-10-09T15:38:24.323999+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:10.124804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313615+0000","last_change":"2023-10-09T15:38:24.312465+0000","last_active":"2023-10-09T15:38:24.313615+0000","last_peered":"2023-10-09T15:38:24.313615+0000","last_clean":"2023-10-09T15:38:24.313615+0000","last_became_active":"2023-10-09T15:38:24.312183+0000","last_became_peered":"2023-10-09T15:38:24.312183+0000","last_unstale":"2023-10-09T15:38:24.313615+0000","last_undegraded":"2023-10-09T15:38:24.313615+0000","last_fullsized":"2023-10-09T15:38:24.313615+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310776+0000","last_change":"2023-10-09T15:38:24.306404+0000","last_active":"2023-10-09T15:38:24.310776+0000","last_peered":"2023-10-09T15:38:24.310776+0000","last_clean":"2023-10-09T15:38:24.310776+0000","last_became_active":"2023-10-09T15:38:24.306151+0000","last_became_peered":"2023-10-09T15:38:24.306151+0000","last_unstale":"2023-10-09T15:38:24.310776+0000","last_undegraded":"2023-10-09T15:38:24.310776+0000","last_fullsized":"2023-10-09T15:38:24.310776+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326466+0000","last_change":"2023-10-09T15:38:24.323677+0000","last_active":"2023-10-09T15:38:24.326466+0000","last_peered":"2023-10-09T15:38:24.326466+0000","last_clean":"2023-10-09T15:38:24.326466+0000","last_became_active":"2023-10-09T15:38:24.323392+0000","last_became_peered":"2023-10-09T15:38:24.323392+0000","last_unstale":"2023-10-09T15:38:24.326466+0000","last_undegraded":"2023-10-09T15:38:24.326466+0000","last_fullsized":"2023-10-09T15:38:24.326466+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324587+0000","last_change":"2023-10-09T15:38:24.318166+0000","last_active":"2023-10-09T15:38:24.324587+0000","last_peered":"2023-10-09T15:38:24.324587+0000","last_clean":"2023-10-09T15:38:24.324587+0000","last_became_active":"2023-10-09T15:38:24.317607+0000","last_became_peered":"2023-10-09T15:38:24.317607+0000","last_unstale":"2023-10-09T15:38:24.324587+0000","last_undegraded":"2023-10-09T15:38:24.324587+0000","last_fullsized":"2023-10-09T15:38:24.324587+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:57.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313944+0000","last_change":"2023-10-09T15:38:24.306887+0000","last_active":"2023-10-09T15:38:24.313944+0000","last_peered":"2023-10-09T15:38:24.313944+0000","last_clean":"2023-10-09T15:38:24.313944+0000","last_became_active":"2023-10-09T15:38:24.306600+0000","last_became_peered":"2023-10-09T15:38:24.306600+0000","last_unstale":"2023-10-09T15:38:24.313944+0000","last_undegraded":"2023-10-09T15:38:24.313944+0000","last_fullsized":"2023-10-09T15:38:24.313944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:23.001319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328529+0000","last_change":"2023-10-09T15:38:24.318738+0000","last_active":"2023-10-09T15:38:24.328529+0000","last_peered":"2023-10-09T15:38:24.328529+0000","last_clean":"2023-10-09T15:38:24.328529+0000","last_became_active":"2023-10-09T15:38:24.318438+0000","last_became_peered":"2023-10-09T15:38:24.318438+0000","last_unstale":"2023-10-09T15:38:24.328529+0000","last_undegraded":"2023-10-09T15:38:24.328529+0000","last_fullsized":"2023-10-09T15:38:24.328529+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324429+0000","last_change":"2023-10-09T15:38:24.318921+0000","last_active":"2023-10-09T15:38:24.324429+0000","last_peered":"2023-10-09T15:38:24.324429+0000","last_clean":"2023-10-09T15:38:24.324429+0000","last_became_active":"2023-10-09T15:38:24.318611+0000","last_became_peered":"2023-10-09T15:38:24.318611+0000","last_unstale":"2023-10-09T15:38:24.324429+0000","last_undegraded":"2023-10-09T15:38:24.324429+0000","last_fullsized":"2023-10-09T15:38:24.324429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328483+0000","last_change":"2023-10-09T15:38:24.327128+0000","last_active":"2023-10-09T15:38:24.328483+0000","last_peered":"2023-10-09T15:38:24.328483+0000","last_clean":"2023-10-09T15:38:24.328483+0000","last_became_active":"2023-10-09T15:38:24.326839+0000","last_became_peered":"2023-10-09T15:38:24.326839+0000","last_unstale":"2023-10-09T15:38:24.328483+0000","last_undegraded":"2023-10-09T15:38:24.328483+0000","last_fullsized":"2023-10-09T15:38:24.328483+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314094+0000","last_change":"2023-10-09T15:38:24.309046+0000","last_active":"2023-10-09T15:38:24.314094+0000","last_peered":"2023-10-09T15:38:24.314094+0000","last_clean":"2023-10-09T15:38:24.314094+0000","last_became_active":"2023-10-09T15:38:24.308798+0000","last_became_peered":"2023-10-09T15:38:24.308798+0000","last_unstale":"2023-10-09T15:38:24.314094+0000","last_undegraded":"2023-10-09T15:38:24.314094+0000","last_fullsized":"2023-10-09T15:38:24.314094+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:04.865892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321730+0000","last_change":"2023-10-09T15:38:24.318269+0000","last_active":"2023-10-09T15:38:24.321730+0000","last_peered":"2023-10-09T15:38:24.321730+0000","last_clean":"2023-10-09T15:38:24.321730+0000","last_became_active":"2023-10-09T15:38:24.318006+0000","last_became_peered":"2023-10-09T15:38:24.318006+0000","last_unstale":"2023-10-09T15:38:24.321730+0000","last_undegraded":"2023-10-09T15:38:24.321730+0000","last_fullsized":"2023-10-09T15:38:24.321730+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:48.054838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326231+0000","last_change":"2023-10-09T15:38:23.295090+0000","last_active":"2023-10-09T15:38:24.326231+0000","last_peered":"2023-10-09T15:38:24.326231+0000","last_clean":"2023-10-09T15:38:24.326231+0000","last_became_active":"2023-10-09T15:38:23.294818+0000","last_became_peered":"2023-10-09T15:38:23.294818+0000","last_unstale":"2023-10-09T15:38:24.326231+0000","last_undegraded":"2023-10-09T15:38:24.326231+0000","last_fullsized":"2023-10-09T15:38:24.326231+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:18.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319886+0000","last_change":"2023-10-09T15:38:24.307210+0000","last_active":"2023-10-09T15:38:24.319886+0000","last_peered":"2023-10-09T15:38:24.319886+0000","last_clean":"2023-10-09T15:38:24.319886+0000","last_became_active":"2023-10-09T15:38:24.306994+0000","last_became_peered":"2023-10-09T15:38:24.306994+0000","last_unstale":"2023-10-09T15:38:24.319886+0000","last_undegraded":"2023-10-09T15:38:24.319886+0000","last_fullsized":"2023-10-09T15:38:24.319886+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:55.948897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329298+0000","last_change":"2023-10-09T15:38:23.296219+0000","last_active":"2023-10-09T15:38:24.329298+0000","last_peered":"2023-10-09T15:38:24.329298+0000","last_clean":"2023-10-09T15:38:24.329298+0000","last_became_active":"2023-10-09T15:38:23.295917+0000","last_became_peered":"2023-10-09T15:38:23.295917+0000","last_unstale":"2023-10-09T15:38:24.329298+0000","last_undegraded":"2023-10-09T15:38:24.329298+0000","last_fullsized":"2023-10-09T15:38:24.329298+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:46.687122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319660+0000","last_change":"2023-10-09T15:38:24.313735+0000","last_active":"2023-10-09T15:38:24.319660+0000","last_peered":"2023-10-09T15:38:24.319660+0000","last_clean":"2023-10-09T15:38:24.319660+0000","last_became_active":"2023-10-09T15:38:24.313466+0000","last_became_peered":"2023-10-09T15:38:24.313466+0000","last_unstale":"2023-10-09T15:38:24.319660+0000","last_undegraded":"2023-10-09T15:38:24.319660+0000","last_fullsized":"2023-10-09T15:38:24.319660+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:36.787180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324967+0000","last_change":"2023-10-09T15:38:23.296950+0000","last_active":"2023-10-09T15:38:24.324967+0000","last_peered":"2023-10-09T15:38:24.324967+0000","last_clean":"2023-10-09T15:38:24.324967+0000","last_became_active":"2023-10-09T15:38:23.296679+0000","last_became_peered":"2023-10-09T15:38:23.296679+0000","last_unstale":"2023-10-09T15:38:24.324967+0000","last_undegraded":"2023-10-09T15:38:24.324967+0000","last_fullsized":"2023-10-09T15:38:24.324967+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:13.408056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328071+0000","last_change":"2023-10-09T15:38:24.326307+0000","last_active":"2023-10-09T15:38:24.328071+0000","last_peered":"2023-10-09T15:38:24.328071+0000","last_clean":"2023-10-09T15:38:24.328071+0000","last_became_active":"2023-10-09T15:38:24.326026+0000","last_became_peered":"2023-10-09T15:38:24.326026+0000","last_unstale":"2023-10-09T15:38:24.328071+0000","last_undegraded":"2023-10-09T15:38:24.328071+0000","last_fullsized":"2023-10-09T15:38:24.328071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327486+0000","last_change":"2023-10-09T15:38:23.292974+0000","last_active":"2023-10-09T15:38:24.327486+0000","last_peered":"2023-10-09T15:38:24.327486+0000","last_clean":"2023-10-09T15:38:24.327486+0000","last_became_active":"2023-10-09T15:38:23.292685+0000","last_became_peered":"2023-10-09T15:38:23.292685+0000","last_unstale":"2023-10-09T15:38:24.327486+0000","last_undegraded":"2023-10-09T15:38:24.327486+0000","last_fullsized":"2023-10-09T15:38:24.327486+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:47.539894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320999+0000","last_change":"2023-10-09T15:38:24.310253+0000","last_active":"2023-10-09T15:38:24.320999+0000","last_peered":"2023-10-09T15:38:24.320999+0000","last_clean":"2023-10-09T15:38:24.320999+0000","last_became_active":"2023-10-09T15:38:24.309975+0000","last_became_peered":"2023-10-09T15:38:24.309975+0000","last_unstale":"2023-10-09T15:38:24.320999+0000","last_undegraded":"2023-10-09T15:38:24.320999+0000","last_fullsized":"2023-10-09T15:38:24.320999+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:49.174307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327674+0000","last_change":"2023-10-09T15:38:23.302270+0000","last_active":"2023-10-09T15:38:24.327674+0000","last_peered":"2023-10-09T15:38:24.327674+0000","last_clean":"2023-10-09T15:38:24.327674+0000","last_became_active":"2023-10-09T15:38:23.301957+0000","last_became_peered":"2023-10-09T15:38:23.301957+0000","last_unstale":"2023-10-09T15:38:24.327674+0000","last_undegraded":"2023-10-09T15:38:24.327674+0000","last_fullsized":"2023-10-09T15:38:24.327674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:32.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323502+0000","last_change":"2023-10-09T15:38:24.318756+0000","last_active":"2023-10-09T15:38:24.323502+0000","last_peered":"2023-10-09T15:38:24.323502+0000","last_clean":"2023-10-09T15:38:24.323502+0000","last_became_active":"2023-10-09T15:38:24.318508+0000","last_became_peered":"2023-10-09T15:38:24.318508+0000","last_unstale":"2023-10-09T15:38:24.323502+0000","last_undegraded":"2023-10-09T15:38:24.323502+0000","last_fullsized":"2023-10-09T15:38:24.323502+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:54.258636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324410+0000","last_change":"2023-10-09T15:38:23.297340+0000","last_active":"2023-10-09T15:38:24.324410+0000","last_peered":"2023-10-09T15:38:24.324410+0000","last_clean":"2023-10-09T15:38:24.324410+0000","last_became_active":"2023-10-09T15:38:23.297078+0000","last_became_peered":"2023-10-09T15:38:23.297078+0000","last_unstale":"2023-10-09T15:38:24.324410+0000","last_undegraded":"2023-10-09T15:38:24.324410+0000","last_fullsized":"2023-10-09T15:38:24.324410+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.790798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325062+0000","last_change":"2023-10-09T15:38:24.317085+0000","last_active":"2023-10-09T15:38:24.325062+0000","last_peered":"2023-10-09T15:38:24.325062+0000","last_clean":"2023-10-09T15:38:24.325062+0000","last_became_active":"2023-10-09T15:38:24.316804+0000","last_became_peered":"2023-10-09T15:38:24.316804+0000","last_unstale":"2023-10-09T15:38:24.325062+0000","last_undegraded":"2023-10-09T15:38:24.325062+0000","last_fullsized":"2023-10-09T15:38:24.325062+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313483+0000","last_change":"2023-10-09T15:38:23.295423+0000","last_active":"2023-10-09T15:38:24.313483+0000","last_peered":"2023-10-09T15:38:24.313483+0000","last_clean":"2023-10-09T15:38:24.313483+0000","last_became_active":"2023-10-09T15:38:23.295145+0000","last_became_peered":"2023-10-09T15:38:23.295145+0000","last_unstale":"2023-10-09T15:38:24.313483+0000","last_undegraded":"2023-10-09T15:38:24.313483+0000","last_fullsized":"2023-10-09T15:38:24.313483+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310531+0000","last_change":"2023-10-09T15:38:24.308536+0000","last_active":"2023-10-09T15:38:24.310531+0000","last_peered":"2023-10-09T15:38:24.310531+0000","last_clean":"2023-10-09T15:38:24.310531+0000","last_became_active":"2023-10-09T15:38:24.308238+0000","last_became_peered":"2023-10-09T15:38:24.308238+0000","last_unstale":"2023-10-09T15:38:24.310531+0000","last_undegraded":"2023-10-09T15:38:24.310531+0000","last_fullsized":"2023-10-09T15:38:24.310531+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:42.369907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.302869+0000","last_change":"2023-10-09T15:38:23.293275+0000","last_active":"2023-10-09T15:38:24.302869+0000","last_peered":"2023-10-09T15:38:24.302869+0000","last_clean":"2023-10-09T15:38:24.302869+0000","last_became_active":"2023-10-09T15:38:23.292861+0000","last_became_peered":"2023-10-09T15:38:23.292861+0000","last_unstale":"2023-10-09T15:38:24.302869+0000","last_undegraded":"2023-10-09T15:38:24.302869+0000","last_fullsized":"2023-10-09T15:38:24.302869+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:36.984873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.312879+0000","last_change":"2023-10-09T15:38:24.306368+0000","last_active":"2023-10-09T15:38:24.312879+0000","last_peered":"2023-10-09T15:38:24.312879+0000","last_clean":"2023-10-09T15:38:24.312879+0000","last_became_active":"2023-10-09T15:38:24.306049+0000","last_became_peered":"2023-10-09T15:38:24.306049+0000","last_unstale":"2023-10-09T15:38:24.312879+0000","last_undegraded":"2023-10-09T15:38:24.312879+0000","last_fullsized":"2023-10-09T15:38:24.312879+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:49.174307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.304834+0000","last_change":"2023-10-09T15:38:23.292482+0000","last_active":"2023-10-09T15:38:24.304834+0000","last_peered":"2023-10-09T15:38:24.304834+0000","last_clean":"2023-10-09T15:38:24.304834+0000","last_became_active":"2023-10-09T15:38:23.292197+0000","last_became_peered":"2023-10-09T15:38:23.292197+0000","last_unstale":"2023-10-09T15:38:24.304834+0000","last_undegraded":"2023-10-09T15:38:24.304834+0000","last_fullsized":"2023-10-09T15:38:24.304834+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:52.049098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326155+0000","last_change":"2023-10-09T15:38:24.324658+0000","last_active":"2023-10-09T15:38:24.326155+0000","last_peered":"2023-10-09T15:38:24.326155+0000","last_clean":"2023-10-09T15:38:24.326155+0000","last_became_active":"2023-10-09T15:38:24.324348+0000","last_became_peered":"2023-10-09T15:38:24.324348+0000","last_unstale":"2023-10-09T15:38:24.326155+0000","last_undegraded":"2023-10-09T15:38:24.326155+0000","last_fullsized":"2023-10-09T15:38:24.326155+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323252+0000","last_change":"2023-10-09T15:38:23.297633+0000","last_active":"2023-10-09T15:38:24.323252+0000","last_peered":"2023-10-09T15:38:24.323252+0000","last_clean":"2023-10-09T15:38:24.323252+0000","last_became_active":"2023-10-09T15:38:23.297339+0000","last_became_peered":"2023-10-09T15:38:23.297339+0000","last_unstale":"2023-10-09T15:38:24.323252+0000","last_undegraded":"2023-10-09T15:38:24.323252+0000","last_fullsized":"2023-10-09T15:38:24.323252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:03.400037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319816+0000","last_change":"2023-10-09T15:38:24.307850+0000","last_active":"2023-10-09T15:38:24.319816+0000","last_peered":"2023-10-09T15:38:24.319816+0000","last_clean":"2023-10-09T15:38:24.319816+0000","last_became_active":"2023-10-09T15:38:24.307558+0000","last_became_peered":"2023-10-09T15:38:24.307558+0000","last_unstale":"2023-10-09T15:38:24.319816+0000","last_undegraded":"2023-10-09T15:38:24.319816+0000","last_fullsized":"2023-10-09T15:38:24.319816+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"139'6","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329841+0000","last_change":"2023-10-09T15:38:23.300928+0000","last_active":"2023-10-09T15:38:24.329841+0000","last_peered":"2023-10-09T15:38:24.329841+0000","last_clean":"2023-10-09T15:38:24.329841+0000","last_became_active":"2023-10-09T15:38:23.300605+0000","last_became_peered":"2023-10-09T15:38:23.300605+0000","last_unstale":"2023-10-09T15:38:24.329841+0000","last_undegraded":"2023-10-09T15:38:24.329841+0000","last_fullsized":"2023-10-09T15:38:24.329841+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:47.398116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325013+0000","last_change":"2023-10-09T15:38:24.323785+0000","last_active":"2023-10-09T15:38:24.325013+0000","last_peered":"2023-10-09T15:38:24.325013+0000","last_clean":"2023-10-09T15:38:24.325013+0000","last_became_active":"2023-10-09T15:38:24.323523+0000","last_became_peered":"2023-10-09T15:38:24.323523+0000","last_unstale":"2023-10-09T15:38:24.325013+0000","last_undegraded":"2023-10-09T15:38:24.325013+0000","last_fullsized":"2023-10-09T15:38:24.325013+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:16.328982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327355+0000","last_change":"2023-10-09T15:38:23.295000+0000","last_active":"2023-10-09T15:38:24.327355+0000","last_peered":"2023-10-09T15:38:24.327355+0000","last_clean":"2023-10-09T15:38:24.327355+0000","last_became_active":"2023-10-09T15:38:23.294725+0000","last_became_peered":"2023-10-09T15:38:23.294725+0000","last_unstale":"2023-10-09T15:38:24.327355+0000","last_undegraded":"2023-10-09T15:38:24.327355+0000","last_fullsized":"2023-10-09T15:38:24.327355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325442+0000","last_change":"2023-10-09T15:38:24.323184+0000","last_active":"2023-10-09T15:38:24.325442+0000","last_peered":"2023-10-09T15:38:24.325442+0000","last_clean":"2023-10-09T15:38:24.325442+0000","last_became_active":"2023-10-09T15:38:24.322890+0000","last_became_peered":"2023-10-09T15:38:24.322890+0000","last_unstale":"2023-10-09T15:38:24.325442+0000","last_undegraded":"2023-10-09T15:38:24.325442+0000","last_fullsized":"2023-10-09T15:38:24.325442+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301365+0000","last_change":"2023-10-09T15:38:23.304386+0000","last_active":"2023-10-09T15:38:24.301365+0000","last_peered":"2023-10-09T15:38:24.301365+0000","last_clean":"2023-10-09T15:38:24.301365+0000","last_became_active":"2023-10-09T15:38:23.304054+0000","last_became_peered":"2023-10-09T15:38:23.304054+0000","last_unstale":"2023-10-09T15:38:24.301365+0000","last_undegraded":"2023-10-09T15:38:24.301365+0000","last_fullsized":"2023-10-09T15:38:24.301365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324624+0000","last_change":"2023-10-09T15:38:24.321448+0000","last_active":"2023-10-09T15:38:24.324624+0000","last_peered":"2023-10-09T15:38:24.324624+0000","last_clean":"2023-10-09T15:38:24.324624+0000","last_became_active":"2023-10-09T15:38:24.321139+0000","last_became_peered":"2023-10-09T15:38:24.321139+0000","last_unstale":"2023-10-09T15:38:24.324624+0000","last_undegraded":"2023-10-09T15:38:24.324624+0000","last_fullsized":"2023-10-09T15:38:24.324624+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.297556+0000","last_change":"2023-10-09T15:38:23.297947+0000","last_active":"2023-10-09T15:38:24.297556+0000","last_peered":"2023-10-09T15:38:24.297556+0000","last_clean":"2023-10-09T15:38:24.297556+0000","last_became_active":"2023-10-09T15:38:23.297632+0000","last_became_peered":"2023-10-09T15:38:23.297632+0000","last_unstale":"2023-10-09T15:38:24.297556+0000","last_undegraded":"2023-10-09T15:38:24.297556+0000","last_fullsized":"2023-10-09T15:38:24.297556+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:40.606930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320736+0000","last_change":"2023-10-09T15:38:24.312650+0000","last_active":"2023-10-09T15:38:24.320736+0000","last_peered":"2023-10-09T15:38:24.320736+0000","last_clean":"2023-10-09T15:38:24.320736+0000","last_became_active":"2023-10-09T15:38:24.312392+0000","last_became_peered":"2023-10-09T15:38:24.312392+0000","last_unstale":"2023-10-09T15:38:24.320736+0000","last_undegraded":"2023-10-09T15:38:24.320736+0000","last_fullsized":"2023-10-09T15:38:24.320736+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"139'8","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329311+0000","last_change":"2023-10-09T15:38:23.305407+0000","last_active":"2023-10-09T15:38:24.329311+0000","last_peered":"2023-10-09T15:38:24.329311+0000","last_clean":"2023-10-09T15:38:24.329311+0000","last_became_active":"2023-10-09T15:38:23.305183+0000","last_became_peered":"2023-10-09T15:38:23.305183+0000","last_unstale":"2023-10-09T15:38:24.329311+0000","last_undegraded":"2023-10-09T15:38:24.329311+0000","last_fullsized":"2023-10-09T15:38:24.329311+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:09.115911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320965+0000","last_change":"2023-10-09T15:38:24.311047+0000","last_active":"2023-10-09T15:38:24.320965+0000","last_peered":"2023-10-09T15:38:24.320965+0000","last_clean":"2023-10-09T15:38:24.320965+0000","last_became_active":"2023-10-09T15:38:24.310776+0000","last_became_peered":"2023-10-09T15:38:24.310776+0000","last_unstale":"2023-10-09T15:38:24.320965+0000","last_undegraded":"2023-10-09T15:38:24.320965+0000","last_fullsized":"2023-10-09T15:38:24.320965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323051+0000","last_change":"2023-10-09T15:38:23.297590+0000","last_active":"2023-10-09T15:38:24.323051+0000","last_peered":"2023-10-09T15:38:24.323051+0000","last_clean":"2023-10-09T15:38:24.323051+0000","last_became_active":"2023-10-09T15:38:23.297269+0000","last_became_peered":"2023-10-09T15:38:23.297269+0000","last_unstale":"2023-10-09T15:38:24.323051+0000","last_undegraded":"2023-10-09T15:38:24.323051+0000","last_fullsized":"2023-10-09T15:38:24.323051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328435+0000","last_change":"2023-10-09T15:38:24.324822+0000","last_active":"2023-10-09T15:38:24.328435+0000","last_peered":"2023-10-09T15:38:24.328435+0000","last_clean":"2023-10-09T15:38:24.328435+0000","last_became_active":"2023-10-09T15:38:24.323808+0000","last_became_peered":"2023-10-09T15:38:24.323808+0000","last_unstale":"2023-10-09T15:38:24.328435+0000","last_undegraded":"2023-10-09T15:38:24.328435+0000","last_fullsized":"2023-10-09T15:38:24.328435+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326715+0000","last_change":"2023-10-09T15:38:23.298760+0000","last_active":"2023-10-09T15:38:24.326715+0000","last_peered":"2023-10-09T15:38:24.326715+0000","last_clean":"2023-10-09T15:38:24.326715+0000","last_became_active":"2023-10-09T15:38:23.298273+0000","last_became_peered":"2023-10-09T15:38:23.298273+0000","last_unstale":"2023-10-09T15:38:24.326715+0000","last_undegraded":"2023-10-09T15:38:24.326715+0000","last_fullsized":"2023-10-09T15:38:24.326715+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:43.720905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320006+0000","last_change":"2023-10-09T15:38:24.317684+0000","last_active":"2023-10-09T15:38:24.320006+0000","last_peered":"2023-10-09T15:38:24.320006+0000","last_clean":"2023-10-09T15:38:24.320006+0000","last_became_active":"2023-10-09T15:38:24.317151+0000","last_became_peered":"2023-10-09T15:38:24.317151+0000","last_unstale":"2023-10-09T15:38:24.320006+0000","last_undegraded":"2023-10-09T15:38:24.320006+0000","last_fullsized":"2023-10-09T15:38:24.320006+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:51:34.277988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328479+0000","last_change":"2023-10-09T15:38:23.308128+0000","last_active":"2023-10-09T15:38:24.328479+0000","last_peered":"2023-10-09T15:38:24.328479+0000","last_clean":"2023-10-09T15:38:24.328479+0000","last_became_active":"2023-10-09T15:38:23.307889+0000","last_became_peered":"2023-10-09T15:38:23.307889+0000","last_unstale":"2023-10-09T15:38:24.328479+0000","last_undegraded":"2023-10-09T15:38:24.328479+0000","last_fullsized":"2023-10-09T15:38:24.328479+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.317353+0000","last_change":"2023-10-09T15:38:24.307071+0000","last_active":"2023-10-09T15:38:24.317353+0000","last_peered":"2023-10-09T15:38:24.317353+0000","last_clean":"2023-10-09T15:38:24.317353+0000","last_became_active":"2023-10-09T15:38:24.306761+0000","last_became_peered":"2023-10-09T15:38:24.306761+0000","last_unstale":"2023-10-09T15:38:24.317353+0000","last_undegraded":"2023-10-09T15:38:24.317353+0000","last_fullsized":"2023-10-09T15:38:24.317353+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.303167+0000","last_change":"2023-10-09T15:38:23.291888+0000","last_active":"2023-10-09T15:38:24.303167+0000","last_peered":"2023-10-09T15:38:24.303167+0000","last_clean":"2023-10-09T15:38:24.303167+0000","last_became_active":"2023-10-09T15:38:23.291632+0000","last_became_peered":"2023-10-09T15:38:23.291632+0000","last_unstale":"2023-10-09T15:38:24.303167+0000","last_undegraded":"2023-10-09T15:38:24.303167+0000","last_fullsized":"2023-10-09T15:38:24.303167+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:25.041292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320049+0000","last_change":"2023-10-09T15:38:24.305300+0000","last_active":"2023-10-09T15:38:24.320049+0000","last_peered":"2023-10-09T15:38:24.320049+0000","last_clean":"2023-10-09T15:38:24.320049+0000","last_became_active":"2023-10-09T15:38:24.305009+0000","last_became_peered":"2023-10-09T15:38:24.305009+0000","last_unstale":"2023-10-09T15:38:24.320049+0000","last_undegraded":"2023-10-09T15:38:24.320049+0000","last_fullsized":"2023-10-09T15:38:24.320049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:44.729797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324128+0000","last_change":"2023-10-09T15:38:23.303601+0000","last_active":"2023-10-09T15:38:24.324128+0000","last_peered":"2023-10-09T15:38:24.324128+0000","last_clean":"2023-10-09T15:38:24.324128+0000","last_became_active":"2023-10-09T15:38:23.303304+0000","last_became_peered":"2023-10-09T15:38:23.303304+0000","last_unstale":"2023-10-09T15:38:24.324128+0000","last_undegraded":"2023-10-09T15:38:24.324128+0000","last_fullsized":"2023-10-09T15:38:24.324128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:28.987172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322687+0000","last_change":"2023-10-09T15:38:24.314567+0000","last_active":"2023-10-09T15:38:24.322687+0000","last_peered":"2023-10-09T15:38:24.322687+0000","last_clean":"2023-10-09T15:38:24.322687+0000","last_became_active":"2023-10-09T15:38:24.314289+0000","last_became_peered":"2023-10-09T15:38:24.314289+0000","last_unstale":"2023-10-09T15:38:24.322687+0000","last_undegraded":"2023-10-09T15:38:24.322687+0000","last_fullsized":"2023-10-09T15:38:24.322687+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.303594+0000","last_change":"2023-10-09T15:38:23.296816+0000","last_active":"2023-10-09T15:38:24.303594+0000","last_peered":"2023-10-09T15:38:24.303594+0000","last_clean":"2023-10-09T15:38:24.303594+0000","last_became_active":"2023-10-09T15:38:23.296537+0000","last_became_peered":"2023-10-09T15:38:23.296537+0000","last_unstale":"2023-10-09T15:38:24.303594+0000","last_undegraded":"2023-10-09T15:38:24.303594+0000","last_fullsized":"2023-10-09T15:38:24.303594+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:28.097883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328545+0000","last_change":"2023-10-09T15:38:24.318765+0000","last_active":"2023-10-09T15:38:24.328545+0000","last_peered":"2023-10-09T15:38:24.328545+0000","last_clean":"2023-10-09T15:38:24.328545+0000","last_became_active":"2023-10-09T15:38:24.318366+0000","last_became_peered":"2023-10-09T15:38:24.318366+0000","last_unstale":"2023-10-09T15:38:24.328545+0000","last_undegraded":"2023-10-09T15:38:24.328545+0000","last_fullsized":"2023-10-09T15:38:24.328545+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.306524+0000","last_change":"2023-10-09T15:38:23.303399+0000","last_active":"2023-10-09T15:38:24.306524+0000","last_peered":"2023-10-09T15:38:24.306524+0000","last_clean":"2023-10-09T15:38:24.306524+0000","last_became_active":"2023-10-09T15:38:23.303050+0000","last_became_peered":"2023-10-09T15:38:23.303050+0000","last_unstale":"2023-10-09T15:38:24.306524+0000","last_undegraded":"2023-10-09T15:38:24.306524+0000","last_fullsized":"2023-10-09T15:38:24.306524+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:05.168451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.316748+0000","last_change":"2023-10-09T15:38:24.311671+0000","last_active":"2023-10-09T15:38:24.316748+0000","last_peered":"2023-10-09T15:38:24.316748+0000","last_clean":"2023-10-09T15:38:24.316748+0000","last_became_active":"2023-10-09T15:38:24.311385+0000","last_became_peered":"2023-10-09T15:38:24.311385+0000","last_unstale":"2023-10-09T15:38:24.316748+0000","last_undegraded":"2023-10-09T15:38:24.316748+0000","last_fullsized":"2023-10-09T15:38:24.316748+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.308367+0000","last_change":"2023-10-09T15:38:23.294087+0000","last_active":"2023-10-09T15:38:24.308367+0000","last_peered":"2023-10-09T15:38:24.308367+0000","last_clean":"2023-10-09T15:38:24.308367+0000","last_became_active":"2023-10-09T15:38:23.293793+0000","last_became_peered":"2023-10-09T15:38:23.293793+0000","last_unstale":"2023-10-09T15:38:24.308367+0000","last_undegraded":"2023-10-09T15:38:24.308367+0000","last_fullsized":"2023-10-09T15:38:24.308367+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:19.327125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314604+0000","last_change":"2023-10-09T15:38:24.311687+0000","last_active":"2023-10-09T15:38:24.314604+0000","last_peered":"2023-10-09T15:38:24.314604+0000","last_clean":"2023-10-09T15:38:24.314604+0000","last_became_active":"2023-10-09T15:38:24.311419+0000","last_became_peered":"2023-10-09T15:38:24.311419+0000","last_unstale":"2023-10-09T15:38:24.314604+0000","last_undegraded":"2023-10-09T15:38:24.314604+0000","last_fullsized":"2023-10-09T15:38:24.314604+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328672+0000","last_change":"2023-10-09T15:38:23.304358+0000","last_active":"2023-10-09T15:38:24.328672+0000","last_peered":"2023-10-09T15:38:24.328672+0000","last_clean":"2023-10-09T15:38:24.328672+0000","last_became_active":"2023-10-09T15:38:23.304068+0000","last_became_peered":"2023-10-09T15:38:23.304068+0000","last_unstale":"2023-10-09T15:38:24.328672+0000","last_undegraded":"2023-10-09T15:38:24.328672+0000","last_fullsized":"2023-10-09T15:38:24.328672+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:08:14.986194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320820+0000","last_change":"2023-10-09T15:38:24.316989+0000","last_active":"2023-10-09T15:38:24.320820+0000","last_peered":"2023-10-09T15:38:24.320820+0000","last_clean":"2023-10-09T15:38:24.320820+0000","last_became_active":"2023-10-09T15:38:24.316736+0000","last_became_peered":"2023-10-09T15:38:24.316736+0000","last_unstale":"2023-10-09T15:38:24.320820+0000","last_undegraded":"2023-10-09T15:38:24.320820+0000","last_fullsized":"2023-10-09T15:38:24.320820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301287+0000","last_change":"2023-10-09T15:38:23.307329+0000","last_active":"2023-10-09T15:38:24.301287+0000","last_peered":"2023-10-09T15:38:24.301287+0000","last_clean":"2023-10-09T15:38:24.301287+0000","last_became_active":"2023-10-09T15:38:23.307005+0000","last_became_peered":"2023-10-09T15:38:23.307005+0000","last_unstale":"2023-10-09T15:38:24.301287+0000","last_undegraded":"2023-10-09T15:38:24.301287+0000","last_fullsized":"2023-10-09T15:38:24.301287+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313231+0000","last_change":"2023-10-09T15:38:24.311153+0000","last_active":"2023-10-09T15:38:24.313231+0000","last_peered":"2023-10-09T15:38:24.313231+0000","last_clean":"2023-10-09T15:38:24.313231+0000","last_became_active":"2023-10-09T15:38:24.310906+0000","last_became_peered":"2023-10-09T15:38:24.310906+0000","last_unstale":"2023-10-09T15:38:24.313231+0000","last_undegraded":"2023-10-09T15:38:24.313231+0000","last_fullsized":"2023-10-09T15:38:24.313231+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:15.041929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301971+0000","last_change":"2023-10-09T15:38:23.307773+0000","last_active":"2023-10-09T15:38:24.301971+0000","last_peered":"2023-10-09T15:38:24.301971+0000","last_clean":"2023-10-09T15:38:24.301971+0000","last_became_active":"2023-10-09T15:38:23.306984+0000","last_became_peered":"2023-10-09T15:38:23.306984+0000","last_unstale":"2023-10-09T15:38:24.301971+0000","last_undegraded":"2023-10-09T15:38:24.301971+0000","last_fullsized":"2023-10-09T15:38:24.301971+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321804+0000","last_change":"2023-10-09T15:38:24.318490+0000","last_active":"2023-10-09T15:38:24.321804+0000","last_peered":"2023-10-09T15:38:24.321804+0000","last_clean":"2023-10-09T15:38:24.321804+0000","last_became_active":"2023-10-09T15:38:24.317963+0000","last_became_peered":"2023-10-09T15:38:24.317963+0000","last_unstale":"2023-10-09T15:38:24.321804+0000","last_undegraded":"2023-10-09T15:38:24.321804+0000","last_fullsized":"2023-10-09T15:38:24.321804+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:02.127776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.297712+0000","last_change":"2023-10-09T15:38:23.294901+0000","last_active":"2023-10-09T15:38:24.297712+0000","last_peered":"2023-10-09T15:38:24.297712+0000","last_clean":"2023-10-09T15:38:24.297712+0000","last_became_active":"2023-10-09T15:38:23.294632+0000","last_became_peered":"2023-10-09T15:38:23.294632+0000","last_unstale":"2023-10-09T15:38:24.297712+0000","last_undegraded":"2023-10-09T15:38:24.297712+0000","last_fullsized":"2023-10-09T15:38:24.297712+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.899576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329198+0000","last_change":"2023-10-09T15:38:24.324946+0000","last_active":"2023-10-09T15:38:24.329198+0000","last_peered":"2023-10-09T15:38:24.329198+0000","last_clean":"2023-10-09T15:38:24.329198+0000","last_became_active":"2023-10-09T15:38:24.324662+0000","last_became_peered":"2023-10-09T15:38:24.324662+0000","last_unstale":"2023-10-09T15:38:24.329198+0000","last_undegraded":"2023-10-09T15:38:24.329198+0000","last_fullsized":"2023-10-09T15:38:24.329198+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:44.729797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310226+0000","last_change":"2023-10-09T15:38:23.302381+0000","last_active":"2023-10-09T15:38:24.310226+0000","last_peered":"2023-10-09T15:38:24.310226+0000","last_clean":"2023-10-09T15:38:24.310226+0000","last_became_active":"2023-10-09T15:38:23.302101+0000","last_became_peered":"2023-10-09T15:38:23.302101+0000","last_unstale":"2023-10-09T15:38:24.310226+0000","last_undegraded":"2023-10-09T15:38:24.310226+0000","last_fullsized":"2023-10-09T15:38:24.310226+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:10.713775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329475+0000","last_change":"2023-10-09T15:38:24.327567+0000","last_active":"2023-10-09T15:38:24.329475+0000","last_peered":"2023-10-09T15:38:24.329475+0000","last_clean":"2023-10-09T15:38:24.329475+0000","last_became_active":"2023-10-09T15:38:24.326962+0000","last_became_peered":"2023-10-09T15:38:24.326962+0000","last_unstale":"2023-10-09T15:38:24.329475+0000","last_undegraded":"2023-10-09T15:38:24.329475+0000","last_fullsized":"2023-10-09T15:38:24.329475+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.308332+0000","last_change":"2023-10-09T15:38:23.295663+0000","last_active":"2023-10-09T15:38:24.308332+0000","last_peered":"2023-10-09T15:38:24.308332+0000","last_clean":"2023-10-09T15:38:24.308332+0000","last_became_active":"2023-10-09T15:38:23.295394+0000","last_became_peered":"2023-10-09T15:38:23.295394+0000","last_unstale":"2023-10-09T15:38:24.308332+0000","last_undegraded":"2023-10-09T15:38:24.308332+0000","last_fullsized":"2023-10-09T15:38:24.308332+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:21.992427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320293+0000","last_change":"2023-10-09T15:38:24.314691+0000","last_active":"2023-10-09T15:38:24.320293+0000","last_peered":"2023-10-09T15:38:24.320293+0000","last_clean":"2023-10-09T15:38:24.320293+0000","last_became_active":"2023-10-09T15:38:24.314428+0000","last_became_peered":"2023-10-09T15:38:24.314428+0000","last_unstale":"2023-10-09T15:38:24.320293+0000","last_undegraded":"2023-10-09T15:38:24.320293+0000","last_fullsized":"2023-10-09T15:38:24.320293+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.300719+0000","last_change":"2023-10-09T15:38:23.296120+0000","last_active":"2023-10-09T15:38:24.300719+0000","last_peered":"2023-10-09T15:38:24.300719+0000","last_clean":"2023-10-09T15:38:24.300719+0000","last_became_active":"2023-10-09T15:38:23.295855+0000","last_became_peered":"2023-10-09T15:38:23.295855+0000","last_unstale":"2023-10-09T15:38:24.300719+0000","last_undegraded":"2023-10-09T15:38:24.300719+0000","last_fullsized":"2023-10-09T15:38:24.300719+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:07.415921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.316729+0000","last_change":"2023-10-09T15:38:24.309776+0000","last_active":"2023-10-09T15:38:24.316729+0000","last_peered":"2023-10-09T15:38:24.316729+0000","last_clean":"2023-10-09T15:38:24.316729+0000","last_became_active":"2023-10-09T15:38:24.309547+0000","last_became_peered":"2023-10-09T15:38:24.309547+0000","last_unstale":"2023-10-09T15:38:24.316729+0000","last_undegraded":"2023-10-09T15:38:24.316729+0000","last_fullsized":"2023-10-09T15:38:24.316729+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:33.460866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.307925+0000","last_change":"2023-10-09T15:38:23.303281+0000","last_active":"2023-10-09T15:38:24.307925+0000","last_peered":"2023-10-09T15:38:24.307925+0000","last_clean":"2023-10-09T15:38:24.307925+0000","last_became_active":"2023-10-09T15:38:23.302987+0000","last_became_peered":"2023-10-09T15:38:23.302987+0000","last_unstale":"2023-10-09T15:38:24.307925+0000","last_undegraded":"2023-10-09T15:38:24.307925+0000","last_fullsized":"2023-10-09T15:38:24.307925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:52.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321165+0000","last_change":"2023-10-09T15:38:24.317468+0000","last_active":"2023-10-09T15:38:24.321165+0000","last_peered":"2023-10-09T15:38:24.321165+0000","last_clean":"2023-10-09T15:38:24.321165+0000","last_became_active":"2023-10-09T15:38:24.317212+0000","last_became_peered":"2023-10-09T15:38:24.317212+0000","last_unstale":"2023-10-09T15:38:24.321165+0000","last_undegraded":"2023-10-09T15:38:24.321165+0000","last_fullsized":"2023-10-09T15:38:24.321165+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314031+0000","last_change":"2023-10-09T15:38:23.298197+0000","last_active":"2023-10-09T15:38:24.314031+0000","last_peered":"2023-10-09T15:38:24.314031+0000","last_clean":"2023-10-09T15:38:24.314031+0000","last_became_active":"2023-10-09T15:38:23.297932+0000","last_became_peered":"2023-10-09T15:38:23.297932+0000","last_unstale":"2023-10-09T15:38:24.314031+0000","last_undegraded":"2023-10-09T15:38:24.314031+0000","last_fullsized":"2023-10-09T15:38:24.314031+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:56.430748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313668+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:24.313668+0000","last_peered":"2023-10-09T15:38:24.313668+0000","last_clean":"2023-10-09T15:38:24.313668+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:24.313668+0000","last_undegraded":"2023-10-09T15:38:24.313668+0000","last_fullsized":"2023-10-09T15:38:24.313668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1384435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36399999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.628}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1769472,"data_stored":793963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":795499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.624}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1383342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.498},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.41099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":794629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.629},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":794157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.316},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.377},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.498},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303128,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068712,"statfs":{"total":96636764160,"available":96326361088,"internally_reserved":0,"allocated":1785856,"data_stored":796053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.497}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.36799999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1769472,"data_stored":793963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:38:32.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:38:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.106+0000 7f4560d7e700 1 Processor -- start 2023-10-09T15:38:33.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.107+0000 7f4560d7e700 1 -- start start 2023-10-09T15:38:33.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f4560d7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 0x7f455c0c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f4560d7e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455c0c7f50 con 0x7f455c1595d0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f4560d7e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f455c06b740 con 0x7f455c1599a0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f4560d7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c06bd00 con 0x7f455c0c83e0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455a59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f455c1595d0 0x7f455c0675a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40962/0 (socket says 172.21.15.33:40962) 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455a59c700 1 -- 172.21.15.33:0/922645294 learned_addr learned my addr 172.21.15.33:0/922645294 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455ad9d700 1 --2- 172.21.15.33:0/922645294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 0x7f455c0c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 112080429 0 0) 0x7f455c0c7f50 con 0x7f455c1595d0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4544003570 con 0x7f455c1595d0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331278861 0 0) 0x7f455c06b740 con 0x7f455c1599a0 2023-10-09T15:38:33.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f455c0c7f50 con 0x7f455c1599a0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455ad9d700 1 -- 172.21.15.33:0/922645294 >> v1:172.21.15.59:6789/0 conn(0x7f455c1599a0 legacy=0x7f455c06acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2191950398 0 0) 0x7f4544003570 con 0x7f455c1595d0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455ad9d700 1 -- 172.21.15.33:0/922645294 >> v1:172.21.15.33:6789/0 conn(0x7f455c1595d0 legacy=0x7f455c0675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.108+0000 7f455ad9d700 1 -- 172.21.15.33:0/922645294 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f455c06ba20 con 0x7f455c0c83e0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f455ad9d700 1 --2- 172.21.15.33:0/922645294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 0x7f455c0c8840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4554009e90 tx=0x7f4554009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6a6f182da01292 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455400e070 con 0x7f455c0c83e0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f455400b870 con 0x7f455c0c83e0 2023-10-09T15:38:33.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f455959a700 1 -- 172.21.15.33:0/922645294 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f454c001470 con 0x7f455c0c83e0 2023-10-09T15:38:33.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 -- 172.21.15.33:0/922645294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 msgr2=0x7f455c0c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 --2- 172.21.15.33:0/922645294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 0x7f455c0c8840 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f4554009e90 tx=0x7f4554009780 comp rx=0 tx=0).stop 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 -- 172.21.15.33:0/922645294 shutdown_connections 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 --2- 172.21.15.33:0/922645294 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c0c83e0 0x7f455c0c8840 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 -- 172.21.15.33:0/922645294 >> 172.21.15.33:0/922645294 conn(0x7f455c0cd400 msgr2=0x7f455c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 -- 172.21.15.33:0/922645294 shutdown_connections 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.109+0000 7f4560d7e700 1 -- 172.21.15.33:0/922645294 wait complete. 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 Processor -- start 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 -- start start 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f455c0c83e0 0x7f455c147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c1595d0 0x7f455c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c1557a0 con 0x7f455c1599a0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f455c15ebb0 con 0x7f455c0c83e0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f4560d7e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f455c15ee90 con 0x7f455c1595d0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.111+0000 7f455ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35304/0 (socket says 172.21.15.33:35304) 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 -- 172.21.15.33:0/2958771178 learned_addr learned my addr 172.21.15.33:0/2958771178 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455a59c700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f455c0c83e0 0x7f455c147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f4559d9b700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c1595d0 0x7f455c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 -- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c1595d0 msgr2=0x7f455c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c1595d0 0x7f455c0b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 -- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f455c0c83e0 msgr2=0x7f455c147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f455c0c83e0 0x7f455c147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 -- 172.21.15.33:0/2958771178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4554009a20 con 0x7f455c1599a0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f455ad9d700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f455c06f1a0 tx=0x7f4554017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4554012c20 con 0x7f455c1599a0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4554012d80 con 0x7f455c1599a0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f455c15d400 con 0x7f455c1599a0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f455401e6a0 con 0x7f455c1599a0 2023-10-09T15:38:33.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.112+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f455c15d9c0 con 0x7f455c1599a0 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.113+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f455c15dbb0 con 0x7f455c1599a0 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.114+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f455401ead0 con 0x7f455c1599a0 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.114+0000 7f454a7fc700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 0x7f453c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.114+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4554086c30 con 0x7f455c1599a0 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.114+0000 7f455a59c700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 0x7f453c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.115+0000 7f455a59c700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 0x7f453c0697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f454c0015a0 tx=0x7f454c000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.119+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45540537b0 con 0x7f455c1599a0 2023-10-09T15:38:33.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.308+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f455c04c3c0 con 0x7f453c067320 2023-10-09T15:38:33.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.316+0000 7f454a7fc700 1 -- 172.21.15.33:0/2958771178 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289734 (secure 0 0 0) 0x7f455c04c3c0 con 0x7f453c067320 2023-10-09T15:38:33.320 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:33.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 msgr2=0x7f453c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 0x7f453c0697d0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f454c0015a0 tx=0x7f454c000bc0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 msgr2=0x7f455c0b2830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f455c06f1a0 tx=0x7f4554017000 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 shutdown_connections 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f453c067320 0x7f453c0697d0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f455c1599a0 0x7f455c0b2830 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f455c0c83e0 0x7f455c147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 --2- 172.21.15.33:0/2958771178 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f455c1595d0 0x7f455c0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 >> 172.21.15.33:0/2958771178 conn(0x7f455c0cd400 msgr2=0x7f455c0cb1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 shutdown_connections 2023-10-09T15:38:33.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.320+0000 7f4560d7e700 1 -- 172.21.15.33:0/2958771178 wait complete. 2023-10-09T15:38:33.324 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:38:33.333 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":362,"stamp":"2023-10-09T15:38:31.326315+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2426116,"kb_used_data":15044,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752548604,"statfs":{"total":773094113280,"available":770609770496,"internally_reserved":0,"allocated":15405056,"data_stored":7536041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":32,"apply_latency_ms":32,"commit_latency_ns":32000000,"apply_latency_ns":32000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001596"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329068+0000","last_change":"2023-10-09T15:38:24.323193+0000","last_active":"2023-10-09T15:38:24.329068+0000","last_peered":"2023-10-09T15:38:24.329068+0000","last_clean":"2023-10-09T15:38:24.329068+0000","last_became_active":"2023-10-09T15:38:24.322929+0000","last_became_peered":"2023-10-09T15:38:24.322929+0000","last_unstale":"2023-10-09T15:38:24.329068+0000","last_undegraded":"2023-10-09T15:38:24.329068+0000","last_fullsized":"2023-10-09T15:38:24.329068+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:04.799690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310773+0000","last_change":"2023-10-09T15:38:24.305323+0000","last_active":"2023-10-09T15:38:24.310773+0000","last_peered":"2023-10-09T15:38:24.310773+0000","last_clean":"2023-10-09T15:38:24.310773+0000","last_became_active":"2023-10-09T15:38:24.304972+0000","last_became_peered":"2023-10-09T15:38:24.304972+0000","last_unstale":"2023-10-09T15:38:24.310773+0000","last_undegraded":"2023-10-09T15:38:24.310773+0000","last_fullsized":"2023-10-09T15:38:24.310773+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:27:47.972450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324606+0000","last_change":"2023-10-09T15:38:24.319146+0000","last_active":"2023-10-09T15:38:24.324606+0000","last_peered":"2023-10-09T15:38:24.324606+0000","last_clean":"2023-10-09T15:38:24.324606+0000","last_became_active":"2023-10-09T15:38:24.318864+0000","last_became_peered":"2023-10-09T15:38:24.318864+0000","last_unstale":"2023-10-09T15:38:24.324606+0000","last_undegraded":"2023-10-09T15:38:24.324606+0000","last_fullsized":"2023-10-09T15:38:24.324606+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:03:43.413439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313304+0000","last_change":"2023-10-09T15:38:24.306533+0000","last_active":"2023-10-09T15:38:24.313304+0000","last_peered":"2023-10-09T15:38:24.313304+0000","last_clean":"2023-10-09T15:38:24.313304+0000","last_became_active":"2023-10-09T15:38:24.306262+0000","last_became_peered":"2023-10-09T15:38:24.306262+0000","last_unstale":"2023-10-09T15:38:24.313304+0000","last_undegraded":"2023-10-09T15:38:24.313304+0000","last_fullsized":"2023-10-09T15:38:24.313304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:36.787180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323024+0000","last_change":"2023-10-09T15:38:24.322013+0000","last_active":"2023-10-09T15:38:24.323024+0000","last_peered":"2023-10-09T15:38:24.323024+0000","last_clean":"2023-10-09T15:38:24.323024+0000","last_became_active":"2023-10-09T15:38:24.319750+0000","last_became_peered":"2023-10-09T15:38:24.319750+0000","last_unstale":"2023-10-09T15:38:24.323024+0000","last_undegraded":"2023-10-09T15:38:24.323024+0000","last_fullsized":"2023-10-09T15:38:24.323024+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:58:07.050781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323970+0000","last_change":"2023-10-09T15:38:24.317319+0000","last_active":"2023-10-09T15:38:24.323970+0000","last_peered":"2023-10-09T15:38:24.323970+0000","last_clean":"2023-10-09T15:38:24.323970+0000","last_became_active":"2023-10-09T15:38:24.316611+0000","last_became_peered":"2023-10-09T15:38:24.316611+0000","last_unstale":"2023-10-09T15:38:24.323970+0000","last_undegraded":"2023-10-09T15:38:24.323970+0000","last_fullsized":"2023-10-09T15:38:24.323970+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:16:50.740204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326230+0000","last_change":"2023-10-09T15:38:24.323874+0000","last_active":"2023-10-09T15:38:24.326230+0000","last_peered":"2023-10-09T15:38:24.326230+0000","last_clean":"2023-10-09T15:38:24.326230+0000","last_became_active":"2023-10-09T15:38:24.323571+0000","last_became_peered":"2023-10-09T15:38:24.323571+0000","last_unstale":"2023-10-09T15:38:24.326230+0000","last_undegraded":"2023-10-09T15:38:24.326230+0000","last_fullsized":"2023-10-09T15:38:24.326230+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:33.599606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321229+0000","last_change":"2023-10-09T15:38:24.314353+0000","last_active":"2023-10-09T15:38:24.321229+0000","last_peered":"2023-10-09T15:38:24.321229+0000","last_clean":"2023-10-09T15:38:24.321229+0000","last_became_active":"2023-10-09T15:38:24.314081+0000","last_became_peered":"2023-10-09T15:38:24.314081+0000","last_unstale":"2023-10-09T15:38:24.321229+0000","last_undegraded":"2023-10-09T15:38:24.321229+0000","last_fullsized":"2023-10-09T15:38:24.321229+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:55.948897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328455+0000","last_change":"2023-10-09T15:38:24.325074+0000","last_active":"2023-10-09T15:38:24.328455+0000","last_peered":"2023-10-09T15:38:24.328455+0000","last_clean":"2023-10-09T15:38:24.328455+0000","last_became_active":"2023-10-09T15:38:24.324534+0000","last_became_peered":"2023-10-09T15:38:24.324534+0000","last_unstale":"2023-10-09T15:38:24.328455+0000","last_undegraded":"2023-10-09T15:38:24.328455+0000","last_fullsized":"2023-10-09T15:38:24.328455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:01:58.886351+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319974+0000","last_change":"2023-10-09T15:38:24.309304+0000","last_active":"2023-10-09T15:38:24.319974+0000","last_peered":"2023-10-09T15:38:24.319974+0000","last_clean":"2023-10-09T15:38:24.319974+0000","last_became_active":"2023-10-09T15:38:24.309049+0000","last_became_peered":"2023-10-09T15:38:24.309049+0000","last_unstale":"2023-10-09T15:38:24.319974+0000","last_undegraded":"2023-10-09T15:38:24.319974+0000","last_fullsized":"2023-10-09T15:38:24.319974+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325073+0000","last_change":"2023-10-09T15:38:24.317856+0000","last_active":"2023-10-09T15:38:24.325073+0000","last_peered":"2023-10-09T15:38:24.325073+0000","last_clean":"2023-10-09T15:38:24.325073+0000","last_became_active":"2023-10-09T15:38:24.317521+0000","last_became_peered":"2023-10-09T15:38:24.317521+0000","last_unstale":"2023-10-09T15:38:24.325073+0000","last_undegraded":"2023-10-09T15:38:24.325073+0000","last_fullsized":"2023-10-09T15:38:24.325073+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:03:47.480992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328628+0000","last_change":"2023-10-09T15:38:24.319324+0000","last_active":"2023-10-09T15:38:24.328628+0000","last_peered":"2023-10-09T15:38:24.328628+0000","last_clean":"2023-10-09T15:38:24.328628+0000","last_became_active":"2023-10-09T15:38:24.318216+0000","last_became_peered":"2023-10-09T15:38:24.318216+0000","last_unstale":"2023-10-09T15:38:24.328628+0000","last_undegraded":"2023-10-09T15:38:24.328628+0000","last_fullsized":"2023-10-09T15:38:24.328628+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:06.177343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.318323+0000","last_change":"2023-10-09T15:38:24.309688+0000","last_active":"2023-10-09T15:38:24.318323+0000","last_peered":"2023-10-09T15:38:24.318323+0000","last_clean":"2023-10-09T15:38:24.318323+0000","last_became_active":"2023-10-09T15:38:24.309363+0000","last_became_peered":"2023-10-09T15:38:24.309363+0000","last_unstale":"2023-10-09T15:38:24.318323+0000","last_undegraded":"2023-10-09T15:38:24.318323+0000","last_fullsized":"2023-10-09T15:38:24.318323+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:51:34.277988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326738+0000","last_change":"2023-10-09T15:38:24.324304+0000","last_active":"2023-10-09T15:38:24.326738+0000","last_peered":"2023-10-09T15:38:24.326738+0000","last_clean":"2023-10-09T15:38:24.326738+0000","last_became_active":"2023-10-09T15:38:24.323997+0000","last_became_peered":"2023-10-09T15:38:24.323997+0000","last_unstale":"2023-10-09T15:38:24.326738+0000","last_undegraded":"2023-10-09T15:38:24.326738+0000","last_fullsized":"2023-10-09T15:38:24.326738+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:30:48.615362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328619+0000","last_change":"2023-10-09T15:38:24.317448+0000","last_active":"2023-10-09T15:38:24.328619+0000","last_peered":"2023-10-09T15:38:24.328619+0000","last_clean":"2023-10-09T15:38:24.328619+0000","last_became_active":"2023-10-09T15:38:24.317176+0000","last_became_peered":"2023-10-09T15:38:24.317176+0000","last_unstale":"2023-10-09T15:38:24.328619+0000","last_undegraded":"2023-10-09T15:38:24.328619+0000","last_fullsized":"2023-10-09T15:38:24.328619+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:48.407008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322083+0000","last_change":"2023-10-09T15:38:24.321246+0000","last_active":"2023-10-09T15:38:24.322083+0000","last_peered":"2023-10-09T15:38:24.322083+0000","last_clean":"2023-10-09T15:38:24.322083+0000","last_became_active":"2023-10-09T15:38:24.320289+0000","last_became_peered":"2023-10-09T15:38:24.320289+0000","last_unstale":"2023-10-09T15:38:24.322083+0000","last_undegraded":"2023-10-09T15:38:24.322083+0000","last_fullsized":"2023-10-09T15:38:24.322083+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:20.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314136+0000","last_change":"2023-10-09T15:38:24.308178+0000","last_active":"2023-10-09T15:38:24.314136+0000","last_peered":"2023-10-09T15:38:24.314136+0000","last_clean":"2023-10-09T15:38:24.314136+0000","last_became_active":"2023-10-09T15:38:24.307923+0000","last_became_peered":"2023-10-09T15:38:24.307923+0000","last_unstale":"2023-10-09T15:38:24.314136+0000","last_undegraded":"2023-10-09T15:38:24.314136+0000","last_fullsized":"2023-10-09T15:38:24.314136+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:11.722667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327319+0000","last_change":"2023-10-09T15:38:24.320402+0000","last_active":"2023-10-09T15:38:24.327319+0000","last_peered":"2023-10-09T15:38:24.327319+0000","last_clean":"2023-10-09T15:38:24.327319+0000","last_became_active":"2023-10-09T15:38:24.319191+0000","last_became_peered":"2023-10-09T15:38:24.319191+0000","last_unstale":"2023-10-09T15:38:24.327319+0000","last_undegraded":"2023-10-09T15:38:24.327319+0000","last_fullsized":"2023-10-09T15:38:24.327319+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:41.615822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321304+0000","last_change":"2023-10-09T15:38:24.318348+0000","last_active":"2023-10-09T15:38:24.321304+0000","last_peered":"2023-10-09T15:38:24.321304+0000","last_clean":"2023-10-09T15:38:24.321304+0000","last_became_active":"2023-10-09T15:38:24.318080+0000","last_became_peered":"2023-10-09T15:38:24.318080+0000","last_unstale":"2023-10-09T15:38:24.321304+0000","last_undegraded":"2023-10-09T15:38:24.321304+0000","last_fullsized":"2023-10-09T15:38:24.321304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:02.127776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.318020+0000","last_change":"2023-10-09T15:38:24.315336+0000","last_active":"2023-10-09T15:38:24.318020+0000","last_peered":"2023-10-09T15:38:24.318020+0000","last_clean":"2023-10-09T15:38:24.318020+0000","last_became_active":"2023-10-09T15:38:24.315063+0000","last_became_peered":"2023-10-09T15:38:24.315063+0000","last_unstale":"2023-10-09T15:38:24.318020+0000","last_undegraded":"2023-10-09T15:38:24.318020+0000","last_fullsized":"2023-10-09T15:38:24.318020+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:46:30.489921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322300+0000","last_change":"2023-10-09T15:38:24.320005+0000","last_active":"2023-10-09T15:38:24.322300+0000","last_peered":"2023-10-09T15:38:24.322300+0000","last_clean":"2023-10-09T15:38:24.322300+0000","last_became_active":"2023-10-09T15:38:24.319430+0000","last_became_peered":"2023-10-09T15:38:24.319430+0000","last_unstale":"2023-10-09T15:38:24.322300+0000","last_undegraded":"2023-10-09T15:38:24.322300+0000","last_fullsized":"2023-10-09T15:38:24.322300+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:47.696014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321028+0000","last_change":"2023-10-09T15:38:24.312193+0000","last_active":"2023-10-09T15:38:24.321028+0000","last_peered":"2023-10-09T15:38:24.321028+0000","last_clean":"2023-10-09T15:38:24.321028+0000","last_became_active":"2023-10-09T15:38:24.311946+0000","last_became_peered":"2023-10-09T15:38:24.311946+0000","last_unstale":"2023-10-09T15:38:24.321028+0000","last_undegraded":"2023-10-09T15:38:24.321028+0000","last_fullsized":"2023-10-09T15:38:24.321028+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:20.591509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323999+0000","last_change":"2023-10-09T15:38:24.316739+0000","last_active":"2023-10-09T15:38:24.323999+0000","last_peered":"2023-10-09T15:38:24.323999+0000","last_clean":"2023-10-09T15:38:24.323999+0000","last_became_active":"2023-10-09T15:38:24.316444+0000","last_became_peered":"2023-10-09T15:38:24.316444+0000","last_unstale":"2023-10-09T15:38:24.323999+0000","last_undegraded":"2023-10-09T15:38:24.323999+0000","last_fullsized":"2023-10-09T15:38:24.323999+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:10.124804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313615+0000","last_change":"2023-10-09T15:38:24.312465+0000","last_active":"2023-10-09T15:38:24.313615+0000","last_peered":"2023-10-09T15:38:24.313615+0000","last_clean":"2023-10-09T15:38:24.313615+0000","last_became_active":"2023-10-09T15:38:24.312183+0000","last_became_peered":"2023-10-09T15:38:24.312183+0000","last_unstale":"2023-10-09T15:38:24.313615+0000","last_undegraded":"2023-10-09T15:38:24.313615+0000","last_fullsized":"2023-10-09T15:38:24.313615+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:10:34.122053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310776+0000","last_change":"2023-10-09T15:38:24.306404+0000","last_active":"2023-10-09T15:38:24.310776+0000","last_peered":"2023-10-09T15:38:24.310776+0000","last_clean":"2023-10-09T15:38:24.310776+0000","last_became_active":"2023-10-09T15:38:24.306151+0000","last_became_peered":"2023-10-09T15:38:24.306151+0000","last_unstale":"2023-10-09T15:38:24.310776+0000","last_undegraded":"2023-10-09T15:38:24.310776+0000","last_fullsized":"2023-10-09T15:38:24.310776+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:10.947704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326466+0000","last_change":"2023-10-09T15:38:24.323677+0000","last_active":"2023-10-09T15:38:24.326466+0000","last_peered":"2023-10-09T15:38:24.326466+0000","last_clean":"2023-10-09T15:38:24.326466+0000","last_became_active":"2023-10-09T15:38:24.323392+0000","last_became_peered":"2023-10-09T15:38:24.323392+0000","last_unstale":"2023-10-09T15:38:24.326466+0000","last_undegraded":"2023-10-09T15:38:24.326466+0000","last_fullsized":"2023-10-09T15:38:24.326466+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:59.035181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324587+0000","last_change":"2023-10-09T15:38:24.318166+0000","last_active":"2023-10-09T15:38:24.324587+0000","last_peered":"2023-10-09T15:38:24.324587+0000","last_clean":"2023-10-09T15:38:24.324587+0000","last_became_active":"2023-10-09T15:38:24.317607+0000","last_became_peered":"2023-10-09T15:38:24.317607+0000","last_unstale":"2023-10-09T15:38:24.324587+0000","last_undegraded":"2023-10-09T15:38:24.324587+0000","last_fullsized":"2023-10-09T15:38:24.324587+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:57.439640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313944+0000","last_change":"2023-10-09T15:38:24.306887+0000","last_active":"2023-10-09T15:38:24.313944+0000","last_peered":"2023-10-09T15:38:24.313944+0000","last_clean":"2023-10-09T15:38:24.313944+0000","last_became_active":"2023-10-09T15:38:24.306600+0000","last_became_peered":"2023-10-09T15:38:24.306600+0000","last_unstale":"2023-10-09T15:38:24.313944+0000","last_undegraded":"2023-10-09T15:38:24.313944+0000","last_fullsized":"2023-10-09T15:38:24.313944+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:23.001319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328529+0000","last_change":"2023-10-09T15:38:24.318738+0000","last_active":"2023-10-09T15:38:24.328529+0000","last_peered":"2023-10-09T15:38:24.328529+0000","last_clean":"2023-10-09T15:38:24.328529+0000","last_became_active":"2023-10-09T15:38:24.318438+0000","last_became_peered":"2023-10-09T15:38:24.318438+0000","last_unstale":"2023-10-09T15:38:24.328529+0000","last_undegraded":"2023-10-09T15:38:24.328529+0000","last_fullsized":"2023-10-09T15:38:24.328529+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:53.530760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324429+0000","last_change":"2023-10-09T15:38:24.318921+0000","last_active":"2023-10-09T15:38:24.324429+0000","last_peered":"2023-10-09T15:38:24.324429+0000","last_clean":"2023-10-09T15:38:24.324429+0000","last_became_active":"2023-10-09T15:38:24.318611+0000","last_became_peered":"2023-10-09T15:38:24.318611+0000","last_unstale":"2023-10-09T15:38:24.324429+0000","last_undegraded":"2023-10-09T15:38:24.324429+0000","last_fullsized":"2023-10-09T15:38:24.324429+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:26.050185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328483+0000","last_change":"2023-10-09T15:38:24.327128+0000","last_active":"2023-10-09T15:38:24.328483+0000","last_peered":"2023-10-09T15:38:24.328483+0000","last_clean":"2023-10-09T15:38:24.328483+0000","last_became_active":"2023-10-09T15:38:24.326839+0000","last_became_peered":"2023-10-09T15:38:24.326839+0000","last_unstale":"2023-10-09T15:38:24.328483+0000","last_undegraded":"2023-10-09T15:38:24.328483+0000","last_fullsized":"2023-10-09T15:38:24.328483+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314094+0000","last_change":"2023-10-09T15:38:24.309046+0000","last_active":"2023-10-09T15:38:24.314094+0000","last_peered":"2023-10-09T15:38:24.314094+0000","last_clean":"2023-10-09T15:38:24.314094+0000","last_became_active":"2023-10-09T15:38:24.308798+0000","last_became_peered":"2023-10-09T15:38:24.308798+0000","last_unstale":"2023-10-09T15:38:24.314094+0000","last_undegraded":"2023-10-09T15:38:24.314094+0000","last_fullsized":"2023-10-09T15:38:24.314094+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:35:04.865892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321730+0000","last_change":"2023-10-09T15:38:24.318269+0000","last_active":"2023-10-09T15:38:24.321730+0000","last_peered":"2023-10-09T15:38:24.321730+0000","last_clean":"2023-10-09T15:38:24.321730+0000","last_became_active":"2023-10-09T15:38:24.318006+0000","last_became_peered":"2023-10-09T15:38:24.318006+0000","last_unstale":"2023-10-09T15:38:24.321730+0000","last_undegraded":"2023-10-09T15:38:24.321730+0000","last_fullsized":"2023-10-09T15:38:24.321730+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:01:48.054838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"139'4","reported_seq":14,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326231+0000","last_change":"2023-10-09T15:38:23.295090+0000","last_active":"2023-10-09T15:38:24.326231+0000","last_peered":"2023-10-09T15:38:24.326231+0000","last_clean":"2023-10-09T15:38:24.326231+0000","last_became_active":"2023-10-09T15:38:23.294818+0000","last_became_peered":"2023-10-09T15:38:23.294818+0000","last_unstale":"2023-10-09T15:38:24.326231+0000","last_undegraded":"2023-10-09T15:38:24.326231+0000","last_fullsized":"2023-10-09T15:38:24.326231+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:59:18.552186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319886+0000","last_change":"2023-10-09T15:38:24.307210+0000","last_active":"2023-10-09T15:38:24.319886+0000","last_peered":"2023-10-09T15:38:24.319886+0000","last_clean":"2023-10-09T15:38:24.319886+0000","last_became_active":"2023-10-09T15:38:24.306994+0000","last_became_peered":"2023-10-09T15:38:24.306994+0000","last_unstale":"2023-10-09T15:38:24.319886+0000","last_undegraded":"2023-10-09T15:38:24.319886+0000","last_fullsized":"2023-10-09T15:38:24.319886+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:55.948897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329298+0000","last_change":"2023-10-09T15:38:23.296219+0000","last_active":"2023-10-09T15:38:24.329298+0000","last_peered":"2023-10-09T15:38:24.329298+0000","last_clean":"2023-10-09T15:38:24.329298+0000","last_became_active":"2023-10-09T15:38:23.295917+0000","last_became_peered":"2023-10-09T15:38:23.295917+0000","last_unstale":"2023-10-09T15:38:24.329298+0000","last_undegraded":"2023-10-09T15:38:24.329298+0000","last_fullsized":"2023-10-09T15:38:24.329298+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:46.687122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319660+0000","last_change":"2023-10-09T15:38:24.313735+0000","last_active":"2023-10-09T15:38:24.319660+0000","last_peered":"2023-10-09T15:38:24.319660+0000","last_clean":"2023-10-09T15:38:24.319660+0000","last_became_active":"2023-10-09T15:38:24.313466+0000","last_became_peered":"2023-10-09T15:38:24.313466+0000","last_unstale":"2023-10-09T15:38:24.319660+0000","last_undegraded":"2023-10-09T15:38:24.319660+0000","last_fullsized":"2023-10-09T15:38:24.319660+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:58:36.787180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324967+0000","last_change":"2023-10-09T15:38:23.296950+0000","last_active":"2023-10-09T15:38:24.324967+0000","last_peered":"2023-10-09T15:38:24.324967+0000","last_clean":"2023-10-09T15:38:24.324967+0000","last_became_active":"2023-10-09T15:38:23.296679+0000","last_became_peered":"2023-10-09T15:38:23.296679+0000","last_unstale":"2023-10-09T15:38:24.324967+0000","last_undegraded":"2023-10-09T15:38:24.324967+0000","last_fullsized":"2023-10-09T15:38:24.324967+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:13.408056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328071+0000","last_change":"2023-10-09T15:38:24.326307+0000","last_active":"2023-10-09T15:38:24.328071+0000","last_peered":"2023-10-09T15:38:24.328071+0000","last_clean":"2023-10-09T15:38:24.328071+0000","last_became_active":"2023-10-09T15:38:24.326026+0000","last_became_peered":"2023-10-09T15:38:24.326026+0000","last_unstale":"2023-10-09T15:38:24.328071+0000","last_undegraded":"2023-10-09T15:38:24.328071+0000","last_fullsized":"2023-10-09T15:38:24.328071+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:36:32.163826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327486+0000","last_change":"2023-10-09T15:38:23.292974+0000","last_active":"2023-10-09T15:38:24.327486+0000","last_peered":"2023-10-09T15:38:24.327486+0000","last_clean":"2023-10-09T15:38:24.327486+0000","last_became_active":"2023-10-09T15:38:23.292685+0000","last_became_peered":"2023-10-09T15:38:23.292685+0000","last_unstale":"2023-10-09T15:38:24.327486+0000","last_undegraded":"2023-10-09T15:38:24.327486+0000","last_fullsized":"2023-10-09T15:38:24.327486+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:47.539894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320999+0000","last_change":"2023-10-09T15:38:24.310253+0000","last_active":"2023-10-09T15:38:24.320999+0000","last_peered":"2023-10-09T15:38:24.320999+0000","last_clean":"2023-10-09T15:38:24.320999+0000","last_became_active":"2023-10-09T15:38:24.309975+0000","last_became_peered":"2023-10-09T15:38:24.309975+0000","last_unstale":"2023-10-09T15:38:24.320999+0000","last_undegraded":"2023-10-09T15:38:24.320999+0000","last_fullsized":"2023-10-09T15:38:24.320999+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:49.174307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327674+0000","last_change":"2023-10-09T15:38:23.302270+0000","last_active":"2023-10-09T15:38:24.327674+0000","last_peered":"2023-10-09T15:38:24.327674+0000","last_clean":"2023-10-09T15:38:24.327674+0000","last_became_active":"2023-10-09T15:38:23.301957+0000","last_became_peered":"2023-10-09T15:38:23.301957+0000","last_unstale":"2023-10-09T15:38:24.327674+0000","last_undegraded":"2023-10-09T15:38:24.327674+0000","last_fullsized":"2023-10-09T15:38:24.327674+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:32.538972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323502+0000","last_change":"2023-10-09T15:38:24.318756+0000","last_active":"2023-10-09T15:38:24.323502+0000","last_peered":"2023-10-09T15:38:24.323502+0000","last_clean":"2023-10-09T15:38:24.323502+0000","last_became_active":"2023-10-09T15:38:24.318508+0000","last_became_peered":"2023-10-09T15:38:24.318508+0000","last_unstale":"2023-10-09T15:38:24.323502+0000","last_undegraded":"2023-10-09T15:38:24.323502+0000","last_fullsized":"2023-10-09T15:38:24.323502+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:35:54.258636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324410+0000","last_change":"2023-10-09T15:38:23.297340+0000","last_active":"2023-10-09T15:38:24.324410+0000","last_peered":"2023-10-09T15:38:24.324410+0000","last_clean":"2023-10-09T15:38:24.324410+0000","last_became_active":"2023-10-09T15:38:23.297078+0000","last_became_peered":"2023-10-09T15:38:23.297078+0000","last_unstale":"2023-10-09T15:38:24.324410+0000","last_undegraded":"2023-10-09T15:38:24.324410+0000","last_fullsized":"2023-10-09T15:38:24.324410+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.790798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325062+0000","last_change":"2023-10-09T15:38:24.317085+0000","last_active":"2023-10-09T15:38:24.325062+0000","last_peered":"2023-10-09T15:38:24.325062+0000","last_clean":"2023-10-09T15:38:24.325062+0000","last_became_active":"2023-10-09T15:38:24.316804+0000","last_became_peered":"2023-10-09T15:38:24.316804+0000","last_unstale":"2023-10-09T15:38:24.325062+0000","last_undegraded":"2023-10-09T15:38:24.325062+0000","last_fullsized":"2023-10-09T15:38:24.325062+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:09:58.265501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313483+0000","last_change":"2023-10-09T15:38:23.295423+0000","last_active":"2023-10-09T15:38:24.313483+0000","last_peered":"2023-10-09T15:38:24.313483+0000","last_clean":"2023-10-09T15:38:24.313483+0000","last_became_active":"2023-10-09T15:38:23.295145+0000","last_became_peered":"2023-10-09T15:38:23.295145+0000","last_unstale":"2023-10-09T15:38:24.313483+0000","last_undegraded":"2023-10-09T15:38:24.313483+0000","last_fullsized":"2023-10-09T15:38:24.313483+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310531+0000","last_change":"2023-10-09T15:38:24.308536+0000","last_active":"2023-10-09T15:38:24.310531+0000","last_peered":"2023-10-09T15:38:24.310531+0000","last_clean":"2023-10-09T15:38:24.310531+0000","last_became_active":"2023-10-09T15:38:24.308238+0000","last_became_peered":"2023-10-09T15:38:24.308238+0000","last_unstale":"2023-10-09T15:38:24.310531+0000","last_undegraded":"2023-10-09T15:38:24.310531+0000","last_fullsized":"2023-10-09T15:38:24.310531+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:42.369907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.302869+0000","last_change":"2023-10-09T15:38:23.293275+0000","last_active":"2023-10-09T15:38:24.302869+0000","last_peered":"2023-10-09T15:38:24.302869+0000","last_clean":"2023-10-09T15:38:24.302869+0000","last_became_active":"2023-10-09T15:38:23.292861+0000","last_became_peered":"2023-10-09T15:38:23.292861+0000","last_unstale":"2023-10-09T15:38:24.302869+0000","last_undegraded":"2023-10-09T15:38:24.302869+0000","last_fullsized":"2023-10-09T15:38:24.302869+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:36.984873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.312879+0000","last_change":"2023-10-09T15:38:24.306368+0000","last_active":"2023-10-09T15:38:24.312879+0000","last_peered":"2023-10-09T15:38:24.312879+0000","last_clean":"2023-10-09T15:38:24.312879+0000","last_became_active":"2023-10-09T15:38:24.306049+0000","last_became_peered":"2023-10-09T15:38:24.306049+0000","last_unstale":"2023-10-09T15:38:24.312879+0000","last_undegraded":"2023-10-09T15:38:24.312879+0000","last_fullsized":"2023-10-09T15:38:24.312879+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:49.174307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.304834+0000","last_change":"2023-10-09T15:38:23.292482+0000","last_active":"2023-10-09T15:38:24.304834+0000","last_peered":"2023-10-09T15:38:24.304834+0000","last_clean":"2023-10-09T15:38:24.304834+0000","last_became_active":"2023-10-09T15:38:23.292197+0000","last_became_peered":"2023-10-09T15:38:23.292197+0000","last_unstale":"2023-10-09T15:38:24.304834+0000","last_undegraded":"2023-10-09T15:38:24.304834+0000","last_fullsized":"2023-10-09T15:38:24.304834+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:37:52.049098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326155+0000","last_change":"2023-10-09T15:38:24.324658+0000","last_active":"2023-10-09T15:38:24.326155+0000","last_peered":"2023-10-09T15:38:24.326155+0000","last_clean":"2023-10-09T15:38:24.326155+0000","last_became_active":"2023-10-09T15:38:24.324348+0000","last_became_peered":"2023-10-09T15:38:24.324348+0000","last_unstale":"2023-10-09T15:38:24.326155+0000","last_undegraded":"2023-10-09T15:38:24.326155+0000","last_fullsized":"2023-10-09T15:38:24.326155+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:33.846362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"139'3","reported_seq":13,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323252+0000","last_change":"2023-10-09T15:38:23.297633+0000","last_active":"2023-10-09T15:38:24.323252+0000","last_peered":"2023-10-09T15:38:24.323252+0000","last_clean":"2023-10-09T15:38:24.323252+0000","last_became_active":"2023-10-09T15:38:23.297339+0000","last_became_peered":"2023-10-09T15:38:23.297339+0000","last_unstale":"2023-10-09T15:38:24.323252+0000","last_undegraded":"2023-10-09T15:38:24.323252+0000","last_fullsized":"2023-10-09T15:38:24.323252+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:49:03.400037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.319816+0000","last_change":"2023-10-09T15:38:24.307850+0000","last_active":"2023-10-09T15:38:24.319816+0000","last_peered":"2023-10-09T15:38:24.319816+0000","last_clean":"2023-10-09T15:38:24.319816+0000","last_became_active":"2023-10-09T15:38:24.307558+0000","last_became_peered":"2023-10-09T15:38:24.307558+0000","last_unstale":"2023-10-09T15:38:24.319816+0000","last_undegraded":"2023-10-09T15:38:24.319816+0000","last_fullsized":"2023-10-09T15:38:24.319816+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:56:52.080581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"139'6","reported_seq":16,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329841+0000","last_change":"2023-10-09T15:38:23.300928+0000","last_active":"2023-10-09T15:38:24.329841+0000","last_peered":"2023-10-09T15:38:24.329841+0000","last_clean":"2023-10-09T15:38:24.329841+0000","last_became_active":"2023-10-09T15:38:23.300605+0000","last_became_peered":"2023-10-09T15:38:23.300605+0000","last_unstale":"2023-10-09T15:38:24.329841+0000","last_undegraded":"2023-10-09T15:38:24.329841+0000","last_fullsized":"2023-10-09T15:38:24.329841+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:12:47.398116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325013+0000","last_change":"2023-10-09T15:38:24.323785+0000","last_active":"2023-10-09T15:38:24.325013+0000","last_peered":"2023-10-09T15:38:24.325013+0000","last_clean":"2023-10-09T15:38:24.325013+0000","last_became_active":"2023-10-09T15:38:24.323523+0000","last_became_peered":"2023-10-09T15:38:24.323523+0000","last_unstale":"2023-10-09T15:38:24.325013+0000","last_undegraded":"2023-10-09T15:38:24.325013+0000","last_fullsized":"2023-10-09T15:38:24.325013+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:16.328982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.327355+0000","last_change":"2023-10-09T15:38:23.295000+0000","last_active":"2023-10-09T15:38:24.327355+0000","last_peered":"2023-10-09T15:38:24.327355+0000","last_clean":"2023-10-09T15:38:24.327355+0000","last_became_active":"2023-10-09T15:38:23.294725+0000","last_became_peered":"2023-10-09T15:38:23.294725+0000","last_unstale":"2023-10-09T15:38:24.327355+0000","last_undegraded":"2023-10-09T15:38:24.327355+0000","last_fullsized":"2023-10-09T15:38:24.327355+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.325442+0000","last_change":"2023-10-09T15:38:24.323184+0000","last_active":"2023-10-09T15:38:24.325442+0000","last_peered":"2023-10-09T15:38:24.325442+0000","last_clean":"2023-10-09T15:38:24.325442+0000","last_became_active":"2023-10-09T15:38:24.322890+0000","last_became_peered":"2023-10-09T15:38:24.322890+0000","last_unstale":"2023-10-09T15:38:24.325442+0000","last_undegraded":"2023-10-09T15:38:24.325442+0000","last_fullsized":"2023-10-09T15:38:24.325442+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:28:33.324070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301365+0000","last_change":"2023-10-09T15:38:23.304386+0000","last_active":"2023-10-09T15:38:24.301365+0000","last_peered":"2023-10-09T15:38:24.301365+0000","last_clean":"2023-10-09T15:38:24.301365+0000","last_became_active":"2023-10-09T15:38:23.304054+0000","last_became_peered":"2023-10-09T15:38:23.304054+0000","last_unstale":"2023-10-09T15:38:24.301365+0000","last_undegraded":"2023-10-09T15:38:24.301365+0000","last_fullsized":"2023-10-09T15:38:24.301365+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:57:18.002861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324624+0000","last_change":"2023-10-09T15:38:24.321448+0000","last_active":"2023-10-09T15:38:24.324624+0000","last_peered":"2023-10-09T15:38:24.324624+0000","last_clean":"2023-10-09T15:38:24.324624+0000","last_became_active":"2023-10-09T15:38:24.321139+0000","last_became_peered":"2023-10-09T15:38:24.321139+0000","last_unstale":"2023-10-09T15:38:24.324624+0000","last_undegraded":"2023-10-09T15:38:24.324624+0000","last_fullsized":"2023-10-09T15:38:24.324624+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:43:22.942960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.297556+0000","last_change":"2023-10-09T15:38:23.297947+0000","last_active":"2023-10-09T15:38:24.297556+0000","last_peered":"2023-10-09T15:38:24.297556+0000","last_clean":"2023-10-09T15:38:24.297556+0000","last_became_active":"2023-10-09T15:38:23.297632+0000","last_became_peered":"2023-10-09T15:38:23.297632+0000","last_unstale":"2023-10-09T15:38:24.297556+0000","last_undegraded":"2023-10-09T15:38:24.297556+0000","last_fullsized":"2023-10-09T15:38:24.297556+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:05:40.606930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320736+0000","last_change":"2023-10-09T15:38:24.312650+0000","last_active":"2023-10-09T15:38:24.320736+0000","last_peered":"2023-10-09T15:38:24.320736+0000","last_clean":"2023-10-09T15:38:24.320736+0000","last_became_active":"2023-10-09T15:38:24.312392+0000","last_became_peered":"2023-10-09T15:38:24.312392+0000","last_unstale":"2023-10-09T15:38:24.320736+0000","last_undegraded":"2023-10-09T15:38:24.320736+0000","last_fullsized":"2023-10-09T15:38:24.320736+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:22:49.211885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"139'8","reported_seq":18,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329311+0000","last_change":"2023-10-09T15:38:23.305407+0000","last_active":"2023-10-09T15:38:24.329311+0000","last_peered":"2023-10-09T15:38:24.329311+0000","last_clean":"2023-10-09T15:38:24.329311+0000","last_became_active":"2023-10-09T15:38:23.305183+0000","last_became_peered":"2023-10-09T15:38:23.305183+0000","last_unstale":"2023-10-09T15:38:24.329311+0000","last_undegraded":"2023-10-09T15:38:24.329311+0000","last_fullsized":"2023-10-09T15:38:24.329311+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:59:09.115911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320965+0000","last_change":"2023-10-09T15:38:24.311047+0000","last_active":"2023-10-09T15:38:24.320965+0000","last_peered":"2023-10-09T15:38:24.320965+0000","last_clean":"2023-10-09T15:38:24.320965+0000","last_became_active":"2023-10-09T15:38:24.310776+0000","last_became_peered":"2023-10-09T15:38:24.310776+0000","last_unstale":"2023-10-09T15:38:24.320965+0000","last_undegraded":"2023-10-09T15:38:24.320965+0000","last_fullsized":"2023-10-09T15:38:24.320965+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:38:59.133407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.323051+0000","last_change":"2023-10-09T15:38:23.297590+0000","last_active":"2023-10-09T15:38:24.323051+0000","last_peered":"2023-10-09T15:38:24.323051+0000","last_clean":"2023-10-09T15:38:24.323051+0000","last_became_active":"2023-10-09T15:38:23.297269+0000","last_became_peered":"2023-10-09T15:38:23.297269+0000","last_unstale":"2023-10-09T15:38:24.323051+0000","last_undegraded":"2023-10-09T15:38:24.323051+0000","last_fullsized":"2023-10-09T15:38:24.323051+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:25.375168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328435+0000","last_change":"2023-10-09T15:38:24.324822+0000","last_active":"2023-10-09T15:38:24.328435+0000","last_peered":"2023-10-09T15:38:24.328435+0000","last_clean":"2023-10-09T15:38:24.328435+0000","last_became_active":"2023-10-09T15:38:24.323808+0000","last_became_peered":"2023-10-09T15:38:24.323808+0000","last_unstale":"2023-10-09T15:38:24.328435+0000","last_undegraded":"2023-10-09T15:38:24.328435+0000","last_fullsized":"2023-10-09T15:38:24.328435+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:37.993766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.326715+0000","last_change":"2023-10-09T15:38:23.298760+0000","last_active":"2023-10-09T15:38:24.326715+0000","last_peered":"2023-10-09T15:38:24.326715+0000","last_clean":"2023-10-09T15:38:24.326715+0000","last_became_active":"2023-10-09T15:38:23.298273+0000","last_became_peered":"2023-10-09T15:38:23.298273+0000","last_unstale":"2023-10-09T15:38:24.326715+0000","last_undegraded":"2023-10-09T15:38:24.326715+0000","last_fullsized":"2023-10-09T15:38:24.326715+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:43.720905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320006+0000","last_change":"2023-10-09T15:38:24.317684+0000","last_active":"2023-10-09T15:38:24.320006+0000","last_peered":"2023-10-09T15:38:24.320006+0000","last_clean":"2023-10-09T15:38:24.320006+0000","last_became_active":"2023-10-09T15:38:24.317151+0000","last_became_peered":"2023-10-09T15:38:24.317151+0000","last_unstale":"2023-10-09T15:38:24.320006+0000","last_undegraded":"2023-10-09T15:38:24.320006+0000","last_fullsized":"2023-10-09T15:38:24.320006+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:51:34.277988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"139'1","reported_seq":11,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328479+0000","last_change":"2023-10-09T15:38:23.308128+0000","last_active":"2023-10-09T15:38:24.328479+0000","last_peered":"2023-10-09T15:38:24.328479+0000","last_clean":"2023-10-09T15:38:24.328479+0000","last_became_active":"2023-10-09T15:38:23.307889+0000","last_became_peered":"2023-10-09T15:38:23.307889+0000","last_unstale":"2023-10-09T15:38:24.328479+0000","last_undegraded":"2023-10-09T15:38:24.328479+0000","last_fullsized":"2023-10-09T15:38:24.328479+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.317353+0000","last_change":"2023-10-09T15:38:24.307071+0000","last_active":"2023-10-09T15:38:24.317353+0000","last_peered":"2023-10-09T15:38:24.317353+0000","last_clean":"2023-10-09T15:38:24.317353+0000","last_became_active":"2023-10-09T15:38:24.306761+0000","last_became_peered":"2023-10-09T15:38:24.306761+0000","last_unstale":"2023-10-09T15:38:24.317353+0000","last_undegraded":"2023-10-09T15:38:24.317353+0000","last_fullsized":"2023-10-09T15:38:24.317353+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:29.996064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.303167+0000","last_change":"2023-10-09T15:38:23.291888+0000","last_active":"2023-10-09T15:38:24.303167+0000","last_peered":"2023-10-09T15:38:24.303167+0000","last_clean":"2023-10-09T15:38:24.303167+0000","last_became_active":"2023-10-09T15:38:23.291632+0000","last_became_peered":"2023-10-09T15:38:23.291632+0000","last_unstale":"2023-10-09T15:38:24.303167+0000","last_undegraded":"2023-10-09T15:38:24.303167+0000","last_fullsized":"2023-10-09T15:38:24.303167+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:34:25.041292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320049+0000","last_change":"2023-10-09T15:38:24.305300+0000","last_active":"2023-10-09T15:38:24.320049+0000","last_peered":"2023-10-09T15:38:24.320049+0000","last_clean":"2023-10-09T15:38:24.320049+0000","last_became_active":"2023-10-09T15:38:24.305009+0000","last_became_peered":"2023-10-09T15:38:24.305009+0000","last_unstale":"2023-10-09T15:38:24.320049+0000","last_undegraded":"2023-10-09T15:38:24.320049+0000","last_fullsized":"2023-10-09T15:38:24.320049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:44.729797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.324128+0000","last_change":"2023-10-09T15:38:23.303601+0000","last_active":"2023-10-09T15:38:24.324128+0000","last_peered":"2023-10-09T15:38:24.324128+0000","last_clean":"2023-10-09T15:38:24.324128+0000","last_became_active":"2023-10-09T15:38:23.303304+0000","last_became_peered":"2023-10-09T15:38:23.303304+0000","last_unstale":"2023-10-09T15:38:24.324128+0000","last_undegraded":"2023-10-09T15:38:24.324128+0000","last_fullsized":"2023-10-09T15:38:24.324128+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:09:28.987172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.322687+0000","last_change":"2023-10-09T15:38:24.314567+0000","last_active":"2023-10-09T15:38:24.322687+0000","last_peered":"2023-10-09T15:38:24.322687+0000","last_clean":"2023-10-09T15:38:24.322687+0000","last_became_active":"2023-10-09T15:38:24.314289+0000","last_became_peered":"2023-10-09T15:38:24.314289+0000","last_unstale":"2023-10-09T15:38:24.322687+0000","last_undegraded":"2023-10-09T15:38:24.322687+0000","last_fullsized":"2023-10-09T15:38:24.322687+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:48:17.097976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.303594+0000","last_change":"2023-10-09T15:38:23.296816+0000","last_active":"2023-10-09T15:38:24.303594+0000","last_peered":"2023-10-09T15:38:24.303594+0000","last_clean":"2023-10-09T15:38:24.303594+0000","last_became_active":"2023-10-09T15:38:23.296537+0000","last_became_peered":"2023-10-09T15:38:23.296537+0000","last_unstale":"2023-10-09T15:38:24.303594+0000","last_undegraded":"2023-10-09T15:38:24.303594+0000","last_fullsized":"2023-10-09T15:38:24.303594+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:28.097883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328545+0000","last_change":"2023-10-09T15:38:24.318765+0000","last_active":"2023-10-09T15:38:24.328545+0000","last_peered":"2023-10-09T15:38:24.328545+0000","last_clean":"2023-10-09T15:38:24.328545+0000","last_became_active":"2023-10-09T15:38:24.318366+0000","last_became_peered":"2023-10-09T15:38:24.318366+0000","last_unstale":"2023-10-09T15:38:24.328545+0000","last_undegraded":"2023-10-09T15:38:24.328545+0000","last_fullsized":"2023-10-09T15:38:24.328545+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:43.346769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.306524+0000","last_change":"2023-10-09T15:38:23.303399+0000","last_active":"2023-10-09T15:38:24.306524+0000","last_peered":"2023-10-09T15:38:24.306524+0000","last_clean":"2023-10-09T15:38:24.306524+0000","last_became_active":"2023-10-09T15:38:23.303050+0000","last_became_peered":"2023-10-09T15:38:23.303050+0000","last_unstale":"2023-10-09T15:38:24.306524+0000","last_undegraded":"2023-10-09T15:38:24.306524+0000","last_fullsized":"2023-10-09T15:38:24.306524+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:06:05.168451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.316748+0000","last_change":"2023-10-09T15:38:24.311671+0000","last_active":"2023-10-09T15:38:24.316748+0000","last_peered":"2023-10-09T15:38:24.316748+0000","last_clean":"2023-10-09T15:38:24.316748+0000","last_became_active":"2023-10-09T15:38:24.311385+0000","last_became_peered":"2023-10-09T15:38:24.311385+0000","last_unstale":"2023-10-09T15:38:24.316748+0000","last_undegraded":"2023-10-09T15:38:24.316748+0000","last_fullsized":"2023-10-09T15:38:24.316748+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:01:48.548787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.308367+0000","last_change":"2023-10-09T15:38:23.294087+0000","last_active":"2023-10-09T15:38:24.308367+0000","last_peered":"2023-10-09T15:38:24.308367+0000","last_clean":"2023-10-09T15:38:24.308367+0000","last_became_active":"2023-10-09T15:38:23.293793+0000","last_became_peered":"2023-10-09T15:38:23.293793+0000","last_unstale":"2023-10-09T15:38:24.308367+0000","last_undegraded":"2023-10-09T15:38:24.308367+0000","last_fullsized":"2023-10-09T15:38:24.308367+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:19.327125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314604+0000","last_change":"2023-10-09T15:38:24.311687+0000","last_active":"2023-10-09T15:38:24.314604+0000","last_peered":"2023-10-09T15:38:24.314604+0000","last_clean":"2023-10-09T15:38:24.314604+0000","last_became_active":"2023-10-09T15:38:24.311419+0000","last_became_peered":"2023-10-09T15:38:24.311419+0000","last_unstale":"2023-10-09T15:38:24.314604+0000","last_undegraded":"2023-10-09T15:38:24.314604+0000","last_fullsized":"2023-10-09T15:38:24.314604+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:08.424813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"139'2","reported_seq":12,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.328672+0000","last_change":"2023-10-09T15:38:23.304358+0000","last_active":"2023-10-09T15:38:24.328672+0000","last_peered":"2023-10-09T15:38:24.328672+0000","last_clean":"2023-10-09T15:38:24.328672+0000","last_became_active":"2023-10-09T15:38:23.304068+0000","last_became_peered":"2023-10-09T15:38:23.304068+0000","last_unstale":"2023-10-09T15:38:24.328672+0000","last_undegraded":"2023-10-09T15:38:24.328672+0000","last_fullsized":"2023-10-09T15:38:24.328672+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:08:14.986194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320820+0000","last_change":"2023-10-09T15:38:24.316989+0000","last_active":"2023-10-09T15:38:24.320820+0000","last_peered":"2023-10-09T15:38:24.320820+0000","last_clean":"2023-10-09T15:38:24.320820+0000","last_became_active":"2023-10-09T15:38:24.316736+0000","last_became_peered":"2023-10-09T15:38:24.316736+0000","last_unstale":"2023-10-09T15:38:24.320820+0000","last_undegraded":"2023-10-09T15:38:24.320820+0000","last_fullsized":"2023-10-09T15:38:24.320820+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:29:41.757830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301287+0000","last_change":"2023-10-09T15:38:23.307329+0000","last_active":"2023-10-09T15:38:24.301287+0000","last_peered":"2023-10-09T15:38:24.301287+0000","last_clean":"2023-10-09T15:38:24.301287+0000","last_became_active":"2023-10-09T15:38:23.307005+0000","last_became_peered":"2023-10-09T15:38:23.307005+0000","last_unstale":"2023-10-09T15:38:24.301287+0000","last_undegraded":"2023-10-09T15:38:24.301287+0000","last_fullsized":"2023-10-09T15:38:24.301287+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:15.320090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313231+0000","last_change":"2023-10-09T15:38:24.311153+0000","last_active":"2023-10-09T15:38:24.313231+0000","last_peered":"2023-10-09T15:38:24.313231+0000","last_clean":"2023-10-09T15:38:24.313231+0000","last_became_active":"2023-10-09T15:38:24.310906+0000","last_became_peered":"2023-10-09T15:38:24.310906+0000","last_unstale":"2023-10-09T15:38:24.313231+0000","last_undegraded":"2023-10-09T15:38:24.313231+0000","last_fullsized":"2023-10-09T15:38:24.313231+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:30:15.041929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.301971+0000","last_change":"2023-10-09T15:38:23.307773+0000","last_active":"2023-10-09T15:38:24.301971+0000","last_peered":"2023-10-09T15:38:24.301971+0000","last_clean":"2023-10-09T15:38:24.301971+0000","last_became_active":"2023-10-09T15:38:23.306984+0000","last_became_peered":"2023-10-09T15:38:23.306984+0000","last_unstale":"2023-10-09T15:38:24.301971+0000","last_undegraded":"2023-10-09T15:38:24.301971+0000","last_fullsized":"2023-10-09T15:38:24.301971+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:51.988119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321804+0000","last_change":"2023-10-09T15:38:24.318490+0000","last_active":"2023-10-09T15:38:24.321804+0000","last_peered":"2023-10-09T15:38:24.321804+0000","last_clean":"2023-10-09T15:38:24.321804+0000","last_became_active":"2023-10-09T15:38:24.317963+0000","last_became_peered":"2023-10-09T15:38:24.317963+0000","last_unstale":"2023-10-09T15:38:24.321804+0000","last_undegraded":"2023-10-09T15:38:24.321804+0000","last_fullsized":"2023-10-09T15:38:24.321804+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:02.127776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.297712+0000","last_change":"2023-10-09T15:38:23.294901+0000","last_active":"2023-10-09T15:38:24.297712+0000","last_peered":"2023-10-09T15:38:24.297712+0000","last_clean":"2023-10-09T15:38:24.297712+0000","last_became_active":"2023-10-09T15:38:23.294632+0000","last_became_peered":"2023-10-09T15:38:23.294632+0000","last_unstale":"2023-10-09T15:38:24.297712+0000","last_undegraded":"2023-10-09T15:38:24.297712+0000","last_fullsized":"2023-10-09T15:38:24.297712+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:08.899576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329198+0000","last_change":"2023-10-09T15:38:24.324946+0000","last_active":"2023-10-09T15:38:24.329198+0000","last_peered":"2023-10-09T15:38:24.329198+0000","last_clean":"2023-10-09T15:38:24.329198+0000","last_became_active":"2023-10-09T15:38:24.324662+0000","last_became_peered":"2023-10-09T15:38:24.324662+0000","last_unstale":"2023-10-09T15:38:24.329198+0000","last_undegraded":"2023-10-09T15:38:24.329198+0000","last_fullsized":"2023-10-09T15:38:24.329198+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:44.729797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.310226+0000","last_change":"2023-10-09T15:38:23.302381+0000","last_active":"2023-10-09T15:38:24.310226+0000","last_peered":"2023-10-09T15:38:24.310226+0000","last_clean":"2023-10-09T15:38:24.310226+0000","last_became_active":"2023-10-09T15:38:23.302101+0000","last_became_peered":"2023-10-09T15:38:23.302101+0000","last_unstale":"2023-10-09T15:38:24.310226+0000","last_undegraded":"2023-10-09T15:38:24.310226+0000","last_fullsized":"2023-10-09T15:38:24.310226+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:10.713775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.329475+0000","last_change":"2023-10-09T15:38:24.327567+0000","last_active":"2023-10-09T15:38:24.329475+0000","last_peered":"2023-10-09T15:38:24.329475+0000","last_clean":"2023-10-09T15:38:24.329475+0000","last_became_active":"2023-10-09T15:38:24.326962+0000","last_became_peered":"2023-10-09T15:38:24.326962+0000","last_unstale":"2023-10-09T15:38:24.329475+0000","last_undegraded":"2023-10-09T15:38:24.329475+0000","last_fullsized":"2023-10-09T15:38:24.329475+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:58:35.038641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.308332+0000","last_change":"2023-10-09T15:38:23.295663+0000","last_active":"2023-10-09T15:38:24.308332+0000","last_peered":"2023-10-09T15:38:24.308332+0000","last_clean":"2023-10-09T15:38:24.308332+0000","last_became_active":"2023-10-09T15:38:23.295394+0000","last_became_peered":"2023-10-09T15:38:23.295394+0000","last_unstale":"2023-10-09T15:38:24.308332+0000","last_undegraded":"2023-10-09T15:38:24.308332+0000","last_fullsized":"2023-10-09T15:38:24.308332+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:21.992427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.320293+0000","last_change":"2023-10-09T15:38:24.314691+0000","last_active":"2023-10-09T15:38:24.320293+0000","last_peered":"2023-10-09T15:38:24.320293+0000","last_clean":"2023-10-09T15:38:24.320293+0000","last_became_active":"2023-10-09T15:38:24.314428+0000","last_became_peered":"2023-10-09T15:38:24.314428+0000","last_unstale":"2023-10-09T15:38:24.320293+0000","last_undegraded":"2023-10-09T15:38:24.320293+0000","last_fullsized":"2023-10-09T15:38:24.320293+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:58:14.416948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.300719+0000","last_change":"2023-10-09T15:38:23.296120+0000","last_active":"2023-10-09T15:38:24.300719+0000","last_peered":"2023-10-09T15:38:24.300719+0000","last_clean":"2023-10-09T15:38:24.300719+0000","last_became_active":"2023-10-09T15:38:23.295855+0000","last_became_peered":"2023-10-09T15:38:23.295855+0000","last_unstale":"2023-10-09T15:38:24.300719+0000","last_undegraded":"2023-10-09T15:38:24.300719+0000","last_fullsized":"2023-10-09T15:38:24.300719+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:07.415921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.316729+0000","last_change":"2023-10-09T15:38:24.309776+0000","last_active":"2023-10-09T15:38:24.316729+0000","last_peered":"2023-10-09T15:38:24.316729+0000","last_clean":"2023-10-09T15:38:24.316729+0000","last_became_active":"2023-10-09T15:38:24.309547+0000","last_became_peered":"2023-10-09T15:38:24.309547+0000","last_unstale":"2023-10-09T15:38:24.316729+0000","last_undegraded":"2023-10-09T15:38:24.316729+0000","last_fullsized":"2023-10-09T15:38:24.316729+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:45:33.460866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.307925+0000","last_change":"2023-10-09T15:38:23.303281+0000","last_active":"2023-10-09T15:38:24.307925+0000","last_peered":"2023-10-09T15:38:24.307925+0000","last_clean":"2023-10-09T15:38:24.307925+0000","last_became_active":"2023-10-09T15:38:23.302987+0000","last_became_peered":"2023-10-09T15:38:23.302987+0000","last_unstale":"2023-10-09T15:38:24.307925+0000","last_undegraded":"2023-10-09T15:38:24.307925+0000","last_fullsized":"2023-10-09T15:38:24.307925+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:47:52.521867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":9,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.321165+0000","last_change":"2023-10-09T15:38:24.317468+0000","last_active":"2023-10-09T15:38:24.321165+0000","last_peered":"2023-10-09T15:38:24.321165+0000","last_clean":"2023-10-09T15:38:24.321165+0000","last_became_active":"2023-10-09T15:38:24.317212+0000","last_became_peered":"2023-10-09T15:38:24.317212+0000","last_unstale":"2023-10-09T15:38:24.321165+0000","last_undegraded":"2023-10-09T15:38:24.321165+0000","last_fullsized":"2023-10-09T15:38:24.321165+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:23.276855+0000","last_clean_scrub_stamp":"2023-10-09T15:38:23.276855+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:24:24.970190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":10,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.314031+0000","last_change":"2023-10-09T15:38:23.298197+0000","last_active":"2023-10-09T15:38:24.314031+0000","last_peered":"2023-10-09T15:38:24.314031+0000","last_clean":"2023-10-09T15:38:24.314031+0000","last_became_active":"2023-10-09T15:38:23.297932+0000","last_became_peered":"2023-10-09T15:38:23.297932+0000","last_unstale":"2023-10-09T15:38:24.314031+0000","last_undegraded":"2023-10-09T15:38:24.314031+0000","last_fullsized":"2023-10-09T15:38:24.314031+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:22.267963+0000","last_clean_scrub_stamp":"2023-10-09T15:38:22.267963+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:46:56.430748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":264,"reported_epoch":139,"state":"active+clean","last_fresh":"2023-10-09T15:38:24.313668+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:24.313668+0000","last_peered":"2023-10-09T15:38:24.313668+0000","last_clean":"2023-10-09T15:38:24.313668+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:24.313668+0000","last_undegraded":"2023-10-09T15:38:24.313668+0000","last_fullsized":"2023-10-09T15:38:24.313668+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574943,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303700,"kb_used_data":2316,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068140,"statfs":{"total":96636764160,"available":96325775360,"internally_reserved":0,"allocated":2371584,"data_stored":1384435,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.36399999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.44800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.438}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.39500000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.628}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.503},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.51600000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.53800000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1769472,"data_stored":793963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.61099999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.42499999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.503},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.66500000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.57599999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.69999999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.68700000000000006}]}]},{"osd":1,"up_from":13,"seq":55834574944,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":795499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.46800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.54600000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.59299999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.624}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.67000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.75700000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574942,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1383342,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.34699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.61499999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.44800000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.498},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.41099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.57099999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":794629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.48799999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.55300000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.71699999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.629},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.81699999999999995},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.72699999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574941,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303124,"kb_used_data":1740,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068716,"statfs":{"total":96636764160,"available":96326365184,"internally_reserved":0,"allocated":1781760,"data_stored":794157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.316},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.40500000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.377},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.51100000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.498},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.63200000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.60399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.62}]}]},{"osd":4,"up_from":13,"seq":55834574942,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303128,"kb_used_data":1744,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068712,"statfs":{"total":96636764160,"available":96326361088,"internally_reserved":0,"allocated":1785856,"data_stored":796053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.497}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.36799999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.44}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.47599999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.46500000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.61199999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.56699999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574943,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303112,"kb_used_data":1728,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068728,"statfs":{"total":96636764160,"available":96326377472,"internally_reserved":0,"allocated":1769472,"data_stored":793963,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.44800000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.78800000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.624}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.71099999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.755}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.56699999999999995}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.77200000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2090,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:38:33.339 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:38:33.340 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:38:33.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.499+0000 7ff4395e1700 1 Processor -- start 2023-10-09T15:38:33.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.499+0000 7ff4395e1700 1 -- start start 2023-10-09T15:38:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff4395e1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff434159530 0x7ff4340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff4395e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 0x7ff4340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff4395e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4340ccfd0 con 0x7ff43406dc70 2023-10-09T15:38:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff4395e1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4340cf0e0 con 0x7ff434159530 2023-10-09T15:38:33.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff4395e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff43415a3d0 con 0x7ff43406e0e0 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff432ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff434159530 0x7ff4340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff432ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff434159530 0x7ff4340ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35320/0 (socket says 172.21.15.33:35320) 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.500+0000 7ff432ffd700 1 -- 172.21.15.33:0/3615054520 learned_addr learned my addr 172.21.15.33:0/3615054520 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff432ffd700 1 -- 172.21.15.33:0/3615054520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 msgr2=0x7ff4340cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff4337fe700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 0x7ff4340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff432ffd700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 0x7ff4340cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff432ffd700 1 -- 172.21.15.33:0/3615054520 >> v1:172.21.15.59:6789/0 conn(0x7ff43406dc70 legacy=0x7ff434159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff432ffd700 1 -- 172.21.15.33:0/3615054520 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff43415a6b0 con 0x7ff434159530 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff4337fe700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 0x7ff4340cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff432ffd700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434159530 0x7ff4340ceba0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93d79ad81091ada1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff431ffb700 1 -- 172.21.15.33:0/3615054520 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00b820 con 0x7ff434159530 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff431ffb700 1 -- 172.21.15.33:0/3615054520 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c00b980 con 0x7ff434159530 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.501+0000 7ff431ffb700 1 -- 172.21.15.33:0/3615054520 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c00bd20 con 0x7ff434159530 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 -- 172.21.15.33:0/3615054520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434159530 msgr2=0x7ff4340ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434159530 0x7ff4340ceba0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7ff42c0099b0 tx=0x7ff42c009250 comp rx=0 tx=0).stop 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 -- 172.21.15.33:0/3615054520 shutdown_connections 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff43406e0e0 0x7ff4340cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 --2- 172.21.15.33:0/3615054520 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff434159530 0x7ff4340ceba0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 -- 172.21.15.33:0/3615054520 >> 172.21.15.33:0/3615054520 conn(0x7ff4340703a0 msgr2=0x7ff4340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 -- 172.21.15.33:0/3615054520 shutdown_connections 2023-10-09T15:38:33.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.502+0000 7ff4395e1700 1 -- 172.21.15.33:0/3615054520 wait complete. 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.503+0000 7ff4395e1700 1 Processor -- start 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.503+0000 7ff4395e1700 1 -- start start 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff43406e0e0 0x7ff43414c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff434159530 0x7ff43415e9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434158a00 con 0x7ff43406dc70 2023-10-09T15:38:33.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff434157f50 con 0x7ff43406e0e0 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4340cf4e0 con 0x7ff434159530 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35334/0 (socket says 172.21.15.33:35334) 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 -- 172.21.15.33:0/1725673323 learned_addr learned my addr 172.21.15.33:0/1725673323 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4337fe700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff434159530 0x7ff43415e9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4327fc700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff43406e0e0 0x7ff43414c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 -- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff434159530 msgr2=0x7ff43415e9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff434159530 0x7ff43415e9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 -- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff43406e0e0 msgr2=0x7ff43414c720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff43406e0e0 0x7ff43414c720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 -- 172.21.15.33:0/1725673323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c0094f0 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff432ffd700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009290 tx=0x7ff42c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c011d70 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c020070 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff434153150 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c01b6a0 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.504+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff434158440 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.505+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43404c3c0 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.506+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff42c022030 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.506+0000 7ff42affd700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.506+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff42c0869d0 con 0x7ff43406dc70 2023-10-09T15:38:33.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.506+0000 7ff4327fc700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.507+0000 7ff4327fc700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 0x7ff4140697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff434152180 tx=0x7ff41c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.510+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff42c053770 con 0x7ff43406dc70 2023-10-09T15:38:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.785+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7ff43404c3c0 con 0x7ff43406dc70 2023-10-09T15:38:33.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.791+0000 7ff42affd700 1 -- 172.21.15.33:0/1725673323 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7ff42c056d90 con 0x7ff43406dc70 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 msgr2=0x7ff4140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 0x7ff4140697d0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7ff434152180 tx=0x7ff41c009040 comp rx=0 tx=0).stop 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 msgr2=0x7ff434157a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009290 tx=0x7ff42c016000 comp rx=0 tx=0).stop 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 shutdown_connections 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff414067320 0x7ff4140697d0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff43406dc70 0x7ff434157a10 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff434159530 0x7ff43415e9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 --2- 172.21.15.33:0/1725673323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff43406e0e0 0x7ff43414c720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 >> 172.21.15.33:0/1725673323 conn(0x7ff4340703a0 msgr2=0x7ff4340cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 shutdown_connections 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.793+0000 7ff4395e1700 1 -- 172.21.15.33:0/1725673323 wait complete. 2023-10-09T15:38:33.796 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:38:33.807 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.925+0000 7f35098e1700 1 Processor -- start 2023-10-09T15:38:33.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.925+0000 7f35098e1700 1 -- start start 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35098e1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3504159790 0x7f35040703a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35098e1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350406c740 con 0x7f350406ade0 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35098e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f350406c9b0 con 0x7f350406d490 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35098e1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f350406cc90 con 0x7f3504159790 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f3502ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3504159790 0x7f35040703a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35027fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f350406ade0 0x7f35040c7030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40964/0 (socket says 172.21.15.33:40964) 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f35027fc700 1 -- 172.21.15.33:0/4237020010 learned_addr learned my addr 172.21.15.33:0/4237020010 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f3502ffd700 1 -- 172.21.15.33:0/4237020010 >> v1:172.21.15.59:6789/0 conn(0x7f350406d490 legacy=0x7f35040c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:33.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3502ffd700 1 -- 172.21.15.33:0/4237020010 >> v1:172.21.15.33:6789/0 conn(0x7f350406ade0 legacy=0x7f35040c7030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.926+0000 7f3501ffb700 1 -- 172.21.15.33:0/4237020010 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4007334 0 0) 0x7f350406c740 con 0x7f350406ade0 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3502ffd700 1 -- 172.21.15.33:0/4237020010 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f350406cf70 con 0x7f3504159790 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3502ffd700 1 --2- 172.21.15.33:0/4237020010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3504159790 0x7f35040703a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9936aa514320e3d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3501ffb700 1 -- 172.21.15.33:0/4237020010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc00e070 con 0x7f3504159790 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3501ffb700 1 -- 172.21.15.33:0/4237020010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34fc00bc30 con 0x7f3504159790 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f3501ffb700 1 -- 172.21.15.33:0/4237020010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34fc012430 con 0x7f3504159790 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 -- 172.21.15.33:0/4237020010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3504159790 msgr2=0x7f35040703a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 --2- 172.21.15.33:0/4237020010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3504159790 0x7f35040703a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc009780 comp rx=0 tx=0).stop 2023-10-09T15:38:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 -- 172.21.15.33:0/4237020010 shutdown_connections 2023-10-09T15:38:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 --2- 172.21.15.33:0/4237020010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3504159790 0x7f35040703a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 -- 172.21.15.33:0/4237020010 >> 172.21.15.33:0/4237020010 conn(0x7f350406ecd0 msgr2=0x7f350406f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 -- 172.21.15.33:0/4237020010 shutdown_connections 2023-10-09T15:38:33.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.927+0000 7f35098e1700 1 -- 172.21.15.33:0/4237020010 wait complete. 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 Processor -- start 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 -- start start 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350406ade0 0x7f3504158390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3504159790 0x7f35040c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504156b70 con 0x7f350406d490 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3504158970 con 0x7f350406ade0 2023-10-09T15:38:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35098e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3504156520 con 0x7f3504159790 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.929+0000 7f35027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35350/0 (socket says 172.21.15.33:35350) 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 -- 172.21.15.33:0/1006682512 learned_addr learned my addr 172.21.15.33:0/1006682512 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f3502ffd700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350406ade0 0x7f3504158390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35037fe700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3504159790 0x7f35040c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 -- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3504159790 msgr2=0x7f35040c6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3504159790 0x7f35040c6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 -- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350406ade0 msgr2=0x7f3504158390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350406ade0 0x7f3504158390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 -- 172.21.15.33:0/1006682512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc009a20 con 0x7f350406d490 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35027fc700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00c7e0 tx=0x7f34ec007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec005b30 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec005c90 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3504156800 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec007300 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.930+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3504157000 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.931+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3504157250 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.932+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f34ec01b3b0 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.932+0000 7f34faffd700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 0x7f34e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.932+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f34ec084190 con 0x7f350406d490 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.932+0000 7f3502ffd700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 0x7f34e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.932+0000 7f3502ffd700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 0x7f34e40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:33.936+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3504157250 con 0x7f350406d490 2023-10-09T15:38:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.173+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3504157250 con 0x7f350406d490 2023-10-09T15:38:34.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.173+0000 7f34faffd700 1 -- 172.21.15.33:0/1006682512 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) v1 ==== 94+0+4592 (secure 0 0 0) 0x7f3504157250 con 0x7f350406d490 2023-10-09T15:38:34.175 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:34.175 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":93,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":93,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:27.313125+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.175+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 msgr2=0x7f34e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.175+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 0x7f34e40697d0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f34fc009e60 tx=0x7f34fc019000 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.175+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 msgr2=0x7f350414d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.175+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00c7e0 tx=0x7f34ec007df0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 shutdown_connections 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f34e4067320 0x7f34e40697d0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3504159790 0x7f35040c6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f350406ade0 0x7f3504158390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 --2- 172.21.15.33:0/1006682512 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f350406d490 0x7f350414d590 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 >> 172.21.15.33:0/1006682512 conn(0x7f350406ecd0 msgr2=0x7f350414e250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 shutdown_connections 2023-10-09T15:38:34.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.176+0000 7f35098e1700 1 -- 172.21.15.33:0/1006682512 wait complete. 2023-10-09T15:38:34.178 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 93 2023-10-09T15:38:34.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 93, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:38:23.691735+0000', 'modified': '2023-10-09T15:38:27.313125+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7533}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7533': {'gid': 7533, 'name': 'a', 'rank': 0, 'incarnation': 89, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6836/859677101', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6834', 'nonce': 859677101}, {'type': 'v1', 'addr': '172.21.15.33:6836', 'nonce': 859677101}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:38:34.591 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:38:34.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T15:38:34.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.713+0000 7fe196ac3700 1 Processor -- start 2023-10-09T15:38:34.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.713+0000 7fe196ac3700 1 -- start start 2023-10-09T15:38:34.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.713+0000 7fe196ac3700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1900cb970 0x7fe190159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.713+0000 7fe196ac3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19015ae40 con 0x7fe19015a400 2023-10-09T15:38:34.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.713+0000 7fe196ac3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe19015ab60 con 0x7fe1900cb5a0 2023-10-09T15:38:34.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe196ac3700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1900ce0f0 con 0x7fe1900cb970 2023-10-09T15:38:34.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe195060700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe19015a400 0x7fe190156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40980/0 (socket says 172.21.15.33:40980) 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe195060700 1 -- 172.21.15.33:0/468519175 learned_addr learned my addr 172.21.15.33:0/468519175 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18ffff700 1 --2- 172.21.15.33:0/468519175 >> v2:172.21.15.59:3300/0 conn(0x7fe1900cb970 0x7fe190159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 210519654 0 0) 0x7fe19015ae40 con 0x7fe19015a400 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe178003570 con 0x7fe19015a400 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4072153736 0 0) 0x7fe19015ab60 con 0x7fe1900cb5a0 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe19015ae40 con 0x7fe1900cb5a0 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18ffff700 1 -- 172.21.15.33:0/468519175 >> v1:172.21.15.59:6789/0 conn(0x7fe1900cb5a0 legacy=0x7fe1900cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18ffff700 1 -- 172.21.15.33:0/468519175 >> v1:172.21.15.33:6789/0 conn(0x7fe19015a400 legacy=0x7fe190156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18ffff700 1 -- 172.21.15.33:0/468519175 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1900ccf00 con 0x7fe1900cb970 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.714+0000 7fe18ffff700 1 --2- 172.21.15.33:0/468519175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190159ec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe1840098e0 tx=0x7fe1840091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f2a20c1f16227 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184011630 con 0x7fe1900cb970 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe184011790 con 0x7fe1900cb970 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe18f7fe700 1 -- 172.21.15.33:0/468519175 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184011b10 con 0x7fe1900cb970 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 -- 172.21.15.33:0/468519175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 msgr2=0x7fe190159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 --2- 172.21.15.33:0/468519175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190159ec0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fe1840098e0 tx=0x7fe1840091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 -- 172.21.15.33:0/468519175 shutdown_connections 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 --2- 172.21.15.33:0/468519175 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190159ec0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 -- 172.21.15.33:0/468519175 >> 172.21.15.33:0/468519175 conn(0x7fe190070e30 msgr2=0x7fe1900d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 -- 172.21.15.33:0/468519175 shutdown_connections 2023-10-09T15:38:34.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.715+0000 7fe196ac3700 1 -- 172.21.15.33:0/468519175 wait complete. 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.716+0000 7fe196ac3700 1 Processor -- start 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.716+0000 7fe196ac3700 1 -- start start 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190153af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 0x7fe1900c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c92d0 con 0x7fe1900cb5a0 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c95b0 con 0x7fe1900cb970 2023-10-09T15:38:34.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe196ac3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1900c9890 con 0x7fe19015a400 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe19485f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe19485f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35360/0 (socket says 172.21.15.33:35360) 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe19485f700 1 -- 172.21.15.33:0/912295808 learned_addr learned my addr 172.21.15.33:0/912295808 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.717+0000 7fe18ffff700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190153af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe195060700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 0x7fe1900c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 -- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 msgr2=0x7fe1900c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 0x7fe1900c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 -- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 msgr2=0x7fe190153af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190153af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 -- 172.21.15.33:0/912295808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe184009420 con 0x7fe1900cb5a0 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe18ffff700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:34.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe195060700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 0x7fe1900c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe19485f700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe18800cb10 tx=0x7fe188002820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe18cff9700 1 -- 172.21.15.33:0/912295808 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800a760 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1900c9b70 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe18cff9700 1 -- 172.21.15.33:0/912295808 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18800a8c0 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe18cff9700 1 -- 172.21.15.33:0/912295808 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18800ac60 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.718+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe190154030 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.719+0000 7fe18cff9700 1 -- 172.21.15.33:0/912295808 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe188012630 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.720+0000 7fe18cff9700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.720+0000 7fe18cff9700 1 -- 172.21.15.33:0/912295808 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1880850e0 con 0x7fe1900cb5a0 2023-10-09T15:38:34.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.720+0000 7fe18ffff700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.720+0000 7fe18ffff700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 0x7fe17c0697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b6660 tx=0x7fe184017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.722+0000 7fe19fdbbb80 1 Processor -- start 2023-10-09T15:38:34.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.722+0000 7fe19fdbbb80 1 -- start start 2023-10-09T15:38:34.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.722+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929e3be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.722+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e37cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929d92a70 con 0x55e929e85d00 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929d90270 con 0x55e929e3ba50 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e929d8c060 con 0x55e929e64f60 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35372/0 (socket says 172.21.15.33:35372) 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 -- 172.21.15.33:0/3845451049 learned_addr learned my addr 172.21.15.33:0/3845451049 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe19485f700 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929e3be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe195060700 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e37cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 -- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 msgr2=0x55e929e37cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e37cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 -- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 msgr2=0x55e929e3be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929e3be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 -- 172.21.15.33:0/3845451049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e929c26270 con 0x55e929e85d00 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fe184011ae0 tx=0x7fe18401e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f40e825c78ead0b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe175ffb700 1 -- 172.21.15.33:0/3845451049 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18401cbb0 con 0x55e929e85d00 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe175ffb700 1 -- 172.21.15.33:0/3845451049 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18401cd10 con 0x55e929e85d00 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.723+0000 7fe175ffb700 1 -- 172.21.15.33:0/3845451049 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18401a640 con 0x55e929e85d00 2023-10-09T15:38:34.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3845451049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 msgr2=0x55e929e64a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fe184011ae0 tx=0x7fe18401e040 comp rx=0 tx=0).stop 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3845451049 shutdown_connections 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e37cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929e3be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3845451049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e64a20 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3845451049 >> 172.21.15.33:0/3845451049 conn(0x55e929e3d370 msgr2=0x55e929e3d740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3845451049 shutdown_connections 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.724+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3845451049 wait complete. 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.725+0000 7fe19fdbbb80 1 -- start start 2023-10-09T15:38:34.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.725+0000 7fe19fdbbb80 1 Processor -- start 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e64f60 0x55e929e7da20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e85d00 0x55e929e7bef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929d37890 con 0x55e929e3ba50 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929d52ea0 con 0x55e929e64f60 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e929c0ee30 con 0x55e929e85d00 2023-10-09T15:38:34.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 10 client.0 _ll_register_callbacks cb 0x55e929dff110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35380/0 (socket says 172.21.15.33:35380) 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 -- 172.21.15.33:0/3860337312 learned_addr learned my addr 172.21.15.33:0/3860337312 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e64f60 0x55e929e7da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe195060700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e85d00 0x55e929e7bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 -- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e85d00 msgr2=0x55e929e7bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e85d00 0x55e929e7bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 -- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e64f60 msgr2=0x55e929e7da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e64f60 0x55e929e7da20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 -- 172.21.15.33:0/3860337312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe184022070 con 0x55e929e3ba50 2023-10-09T15:38:34.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19485f700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe188002a90 tx=0x7fe188085040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed6f01946fec4bf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe16effd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188053ed0 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe18807ee20 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e929e30b70 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe188054f20 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.726+0000 7fe19fdbbb80 10 client.7716 fetch_fsmap learned FSMap version 93 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55e929bc8fe0 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188060030 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe18805c540 con 0x55e929e3ba50 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 10 client.7716 fetch_fsmap finished waiting for FSMap version 93 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 10 client.7716 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 20 client.7716 populate_metadata read hostname 'smithi033' 2023-10-09T15:38:34.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e7ebc0 0x55e929e7ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 4 client.7716 mds_command: new command op to 7533 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 --> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e929e0daa0 con 0x55e929e7ebc0 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e7ebc0 0x55e929e7ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe16effd700 10 client.7716 ms_handle_connect on v2:172.21.15.33:6834/859677101 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.727+0000 7fe18ffff700 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e7ebc0 0x55e929e7ef90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42198ee7af850fd1 server_cookie=9ed9c2d759a90747 in_seq=0 out_seq=0 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe16effd700 1 -- 172.21.15.33:0/3860337312 <== mds.0 v2:172.21.15.33:6834/859677101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55e929e0daa0 con 0x55e929e7ebc0 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe16effd700 10 client.7716 handle_command_reply: tid=0 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 client.7716 shutdown 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 msgr2=0x55e929e82b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe188002a90 tx=0x7fe188085040 comp rx=0 tx=0).stop 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 shutdown_connections 2023-10-09T15:38:34.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e3ba50 0x55e929e82b40 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e7ebc0 0x55e929e7ef90 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e85d00 0x55e929e7bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe16effd700 0 client.7716 ms_handle_reset on v2:172.21.15.33:6834/859677101 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/3860337312 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e64f60 0x55e929e7da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 >> 172.21.15.33:0/3860337312 conn(0x55e929e3d370 msgr2=0x55e929e81550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 shutdown_connections 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/3860337312 wait complete. 2023-10-09T15:38:34.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.728+0000 7fe19fdbbb80 20 client.7716 trim_cache size 0 max 16384 2023-10-09T15:38:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.745+0000 7fe19fdbbb80 1 Processor -- start 2023-10-09T15:38:34.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.745+0000 7fe19fdbbb80 1 -- start start 2023-10-09T15:38:34.748 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e3ba50 0x55e929e94a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e85d00 0x55e929e81760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929e3be20 con 0x55e929e64f60 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929e80760 con 0x55e929e85d00 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e929e34790 con 0x55e929e3ba50 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35382/0 (socket says 172.21.15.33:35382) 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 -- 172.21.15.33:0/270650064 learned_addr learned my addr 172.21.15.33:0/270650064 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 -- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e3ba50 msgr2=0x55e929e94a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e3ba50 0x55e929e94a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 -- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e85d00 msgr2=0x55e929e81760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e85d00 0x55e929e81760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.746+0000 7fe18ffff700 1 -- 172.21.15.33:0/270650064 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e929d5a780 con 0x55e929e64f60 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe18ffff700 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe18401ca50 tx=0x7fe184033040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=999c9ed80c90db8c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe1767fc700 1 -- 172.21.15.33:0/270650064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe184011d90 con 0x55e929e64f60 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe1767fc700 1 -- 172.21.15.33:0/270650064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18401de90 con 0x55e929e64f60 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe1767fc700 1 -- 172.21.15.33:0/270650064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe18401a430 con 0x55e929e64f60 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/270650064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 msgr2=0x55e929e7bc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe18401ca50 tx=0x7fe184033040 comp rx=0 tx=0).stop 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/270650064 shutdown_connections 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e85d00 0x55e929e81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e3ba50 0x55e929e94a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/270650064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e64f60 0x55e929e7bc30 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/270650064 >> 172.21.15.33:0/270650064 conn(0x55e929e3d370 msgr2=0x55e929e386d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/270650064 shutdown_connections 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.747+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/270650064 wait complete. 2023-10-09T15:38:34.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.748+0000 7fe19fdbbb80 1 -- start start 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.748+0000 7fe19fdbbb80 1 Processor -- start 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929ee7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e6b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929e9abb0 con 0x55e929e85d00 2023-10-09T15:38:34.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e929e860d0 con 0x55e929e3ba50 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e929e86f30 con 0x55e929e64f60 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19fdbbb80 10 client.0 _ll_register_callbacks cb 0x55e929dff110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35392/0 (socket says 172.21.15.33:35392) 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 -- 172.21.15.33:0/2694604818 learned_addr learned my addr 172.21.15.33:0/2694604818 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe18ffff700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e6b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19485f700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929ee7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 -- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 msgr2=0x55e929e6b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e6b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 -- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 msgr2=0x55e929ee7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929ee7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 -- 172.21.15.33:0/2694604818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55e929c26270 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe18ffff700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e6b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe19485f700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929ee7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe195060700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe1800133e0 tx=0x7fe180009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=638f940d40452120 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe16effd700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.749+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe180013e10 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe180005900 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fe18401cd10 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=93) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe180005cd0 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 10 client.7722 fetch_fsmap learned FSMap version 93 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=93,monmap=2+}) v3 -- 0x55e929d41470 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe18401cd10 con 0x55e929e85d00 2023-10-09T15:38:34.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 93) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fe1800070d0 con 0x55e929e85d00 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 10 client.7722 fetch_fsmap finished waiting for FSMap version 93 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 10 client.7722 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 20 client.7722 populate_metadata read hostname 'smithi033' 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e81c80 0x55e929e99870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 4 client.7722 mds_command: new command op to 7533 tid=0[{"prefix": "status"}] 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 --> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e929d2ee00 con 0x55e929e81c80 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19485f700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e81c80 0x55e929e99870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe19485f700 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e81c80 0x55e929e99870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b4f7d71b22c0708 server_cookie=1815939e00c6e007 in_seq=0 out_seq=0 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.750+0000 7fe16effd700 10 client.7722 ms_handle_connect on v2:172.21.15.33:6834/859677101 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe16effd700 1 -- 172.21.15.33:0/2694604818 <== mds.0 v2:172.21.15.33:6834/859677101 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x55e929d2ee00 con 0x55e929e81c80 2023-10-09T15:38:34.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe16effd700 10 client.7722 handle_command_reply: tid=0 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 client.7722 shutdown 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 msgr2=0x55e929e6b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe1800133e0 tx=0x7fe180009040 comp rx=0 tx=0).stop 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 shutdown_connections 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55e929e85d00 0x55e929e6b8a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.33:6834/859677101,v1:172.21.15.33:6836/859677101] conn(0x55e929e81c80 0x55e929e99870 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55e929e3ba50 0x55e929ee7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 --2- 172.21.15.33:0/2694604818 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55e929e64f60 0x55e929e6b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe16effd700 0 client.7722 ms_handle_reset on v2:172.21.15.33:6834/859677101 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 >> 172.21.15.33:0/2694604818 conn(0x55e929e3d370 msgr2=0x55e929e94a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 shutdown_connections 2023-10-09T15:38:34.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 1 -- 172.21.15.33:0/2694604818 wait complete. 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe19fdbbb80 20 client.7722 trim_cache size 0 max 16384 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 7533, 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 10.443886274, 2023-10-09T15:38:34.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 93, 2023-10-09T15:38:34.761 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 140, 2023-10-09T15:38:34.761 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 140, 2023-10-09T15:38:34.761 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 15.946354829000001 2023-10-09T15:38:34.761 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:38:34.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 msgr2=0x7fe17c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 0x7fe17c0697d0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fe1900b6660 tx=0x7fe184017000 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 msgr2=0x7fe1900ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fe18800cb10 tx=0x7fe188002820 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 shutdown_connections 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.751+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe17c067320 0x7fe17c0697d0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1900cb5a0 0x7fe1900ca370 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe19015a400 0x7fe1900c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 --2- 172.21.15.33:0/912295808 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1900cb970 0x7fe190153af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 >> 172.21.15.33:0/912295808 conn(0x7fe190070e30 msgr2=0x7fe1900cf5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 shutdown_connections 2023-10-09T15:38:34.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.752+0000 7fe196ac3700 1 -- 172.21.15.33:0/912295808 wait complete. 2023-10-09T15:38:34.764 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:38:34.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 Processor -- start 2023-10-09T15:38:34.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 -- start start 2023-10-09T15:38:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fddb4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb415ae40 con 0x7fddb40cb5a0 2023-10-09T15:38:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddb415ab60 con 0x7fddb40cb970 2023-10-09T15:38:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.883+0000 7fddb9bd3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40ce0f0 con 0x7fddb415a5d0 2023-10-09T15:38:34.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fddb40cb5a0 0x7fddb40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40982/0 (socket says 172.21.15.33:40982) 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb37fe700 1 -- 172.21.15.33:0/1548412760 learned_addr learned my addr 172.21.15.33:0/1548412760 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb3fff700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fddb4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696912272 0 0) 0x7fddb415ae40 con 0x7fddb40cb5a0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd9c003570 con 0x7fddb40cb5a0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3939282448 0 0) 0x7fdd9c003570 con 0x7fddb40cb5a0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 msgr2=0x7fddb4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fddb4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 >> v1:172.21.15.59:6789/0 conn(0x7fddb40cb970 legacy=0x7fddb4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb40ccf00 con 0x7fddb40cb5a0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fdda4001470 con 0x7fddb40cb5a0 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 >> v1:172.21.15.33:6789/0 conn(0x7fddb40cb5a0 legacy=0x7fddb40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fdd9c003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fdd9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd9c004d50 0x7fdd9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb40ce0f0 con 0x7fdd9c003fd0 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c00bba0 con 0x7fdd9c004d50 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9c00bd60 con 0x7fddb415a5d0 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fdd9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb37fe700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fdd9c003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.884+0000 7fddb3fff700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd9c004d50 0x7fdd9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 -- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 msgr2=0x7fdd9c003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415a5d0 0x7fdd9c003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 -- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd9c004d50 msgr2=0x7fdd9c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:34.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd9c004d50 0x7fdd9c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 -- 172.21.15.33:0/1548412760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9c003570 con 0x7fdd9c003fd0 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fdd9c004810 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fdda80019a0 tx=0x7fdda8007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c5d4289ec0238a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800c5d0 con 0x7fdd9c003fd0 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda800c750 con 0x7fdd9c003fd0 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb27fc700 1 -- 172.21.15.33:0/1548412760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda800cb10 con 0x7fdd9c003fd0 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb9bd3700 1 -- 172.21.15.33:0/1548412760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 msgr2=0x7fdd9c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/1548412760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fdd9c004810 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fdda80019a0 tx=0x7fdda8007d10 comp rx=0 tx=0).stop 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.885+0000 7fddb3fff700 1 -- 172.21.15.33:0/1548412760 reap_dead start 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.886+0000 7fddb9bd3700 1 -- 172.21.15.33:0/1548412760 shutdown_connections 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.886+0000 7fddb9bd3700 1 -- 172.21.15.33:0/1548412760 >> 172.21.15.33:0/1548412760 conn(0x7fddb4070e30 msgr2=0x7fddb40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.886+0000 7fddb9bd3700 1 -- 172.21.15.33:0/1548412760 shutdown_connections 2023-10-09T15:38:34.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.886+0000 7fddb9bd3700 1 -- 172.21.15.33:0/1548412760 wait complete. 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.887+0000 7fddb9bd3700 1 Processor -- start 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.887+0000 7fddb9bd3700 1 -- start start 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddb415c830 0x7fddb40c9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 0x7fddb40c9e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb415de70 con 0x7fdd9c003fd0 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddb415d260 con 0x7fddb415c830 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddb415d540 con 0x7fddb415cca0 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35410/0 (socket says 172.21.15.33:35410) 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 -- 172.21.15.33:0/4079123744 learned_addr learned my addr 172.21.15.33:0/4079123744 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddb415c830 0x7fddb40c9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb3fff700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 0x7fddb40c9e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 -- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 msgr2=0x7fddb40c9e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 0x7fddb40c9e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 -- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddb415c830 msgr2=0x7fddb40c9910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:34.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddb415c830 0x7fddb40c9910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 -- 172.21.15.33:0/4079123744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddb415d820 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb3fff700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 0x7fddb40c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb37fe700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fdda4007390 tx=0x7fdda4001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda4018030 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdda4000f50 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdda400fb40 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddb415db00 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.888+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddb416c420 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.889+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddb404c3c0 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.890+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdda401b070 con 0x7fdd9c003fd0 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.890+0000 7fdd9b7fe700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 0x7fdda00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:34.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.891+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 0x7fdda00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.891+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdda4019070 con 0x7fdd9c003fd0 2023-10-09T15:38:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.891+0000 7fddb2ffd700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 0x7fdda00697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdda8008fd0 tx=0x7fdda8015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:34.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:34.895+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdda40516d0 con 0x7fdd9c003fd0 2023-10-09T15:38:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.136+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fddb40883f0 con 0x7fdd9c003fd0 2023-10-09T15:38:35.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.137+0000 7fdd9b7fe700 1 -- 172.21.15.33:0/4079123744 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdda4054cf0 con 0x7fdd9c003fd0 2023-10-09T15:38:35.138 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 msgr2=0x7fdda00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 0x7fdda00697d0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fdda8008fd0 tx=0x7fdda8015000 comp rx=0 tx=0).stop 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 msgr2=0x7fddb4153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fdda4007390 tx=0x7fdda4001da0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 shutdown_connections 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdda0067320 0x7fdda00697d0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd9c003fd0 0x7fddb4153130 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fddb415cca0 0x7fddb40c9e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 --2- 172.21.15.33:0/4079123744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fddb415c830 0x7fddb40c9910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 >> 172.21.15.33:0/4079123744 conn(0x7fddb4070e30 msgr2=0x7fddb40b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 shutdown_connections 2023-10-09T15:38:35.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.139+0000 7fddb9bd3700 1 -- 172.21.15.33:0/4079123744 wait complete. 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:38:35.152 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:38:35.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.153 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.168 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41972sec preferred_lft 41972sec 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:38:35.169 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:38:35.170 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:35.171 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.171 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:38:35.231 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:38:35.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.233 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:38:35.289 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:38:35.290 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:38:35.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.391 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:38:35.406 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:38:35.406 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:38:35.406 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:38:35.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:38:35.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:38:35.471 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:35.525 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:38:35.525 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:38:35.526 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:35.580 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:38:35.580 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:38:35.580 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:38:35.661 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:38:35.661 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:38:35.661 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:38:35.669 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:38:35.669 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:38:35.669 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:38:35.669 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:38:35.669 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:38:35.692 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:38:35.692 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:38:35.693 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:38:35.694 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:38:35.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:35.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:35.760 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:38:35.918 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.917+0000 7ffa67c52700 1 Processor -- start 2023-10-09T15:38:35.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.918+0000 7ffa67c52700 1 -- start start 2023-10-09T15:38:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.918+0000 7ffa67c52700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa6015a5d0 0x7ffa60156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.918+0000 7ffa67c52700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6015ae40 con 0x7ffa600cb970 2023-10-09T15:38:35.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.918+0000 7ffa67c52700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa6015ab60 con 0x7ffa600cb5a0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.918+0000 7ffa67c52700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa600ce0f0 con 0x7ffa6015a5d0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa661ef700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa6015a5d0 0x7ffa60156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa651ed700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ffa600cb970 0x7ffa60159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40984/0 (socket says 172.21.15.33:40984) 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa651ed700 1 -- 172.21.15.33:0/2765367463 learned_addr learned my addr 172.21.15.33:0/2765367463 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa661ef700 1 -- 172.21.15.33:0/2765367463 >> v1:172.21.15.59:6789/0 conn(0x7ffa600cb5a0 legacy=0x7ffa600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa661ef700 1 -- 172.21.15.33:0/2765367463 >> v1:172.21.15.33:6789/0 conn(0x7ffa600cb970 legacy=0x7ffa60159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa649ec700 1 -- 172.21.15.33:0/2765367463 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3643690009 0 0) 0x7ffa6015ae40 con 0x7ffa600cb970 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa661ef700 1 -- 172.21.15.33:0/2765367463 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa600ccf00 con 0x7ffa6015a5d0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa661ef700 1 --2- 172.21.15.33:0/2765367463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa6015a5d0 0x7ffa60156e90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ffa580098e0 tx=0x7ffa580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57604feb8abdfccc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa649ec700 1 -- 172.21.15.33:0/2765367463 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa58009e80 con 0x7ffa6015a5d0 2023-10-09T15:38:35.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa649ec700 1 -- 172.21.15.33:0/2765367463 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa5800b860 con 0x7ffa6015a5d0 2023-10-09T15:38:35.922 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.919+0000 7ffa649ec700 1 -- 172.21.15.33:0/2765367463 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa5800bbe0 con 0x7ffa6015a5d0 2023-10-09T15:38:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 -- 172.21.15.33:0/2765367463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa6015a5d0 msgr2=0x7ffa60156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 --2- 172.21.15.33:0/2765367463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa6015a5d0 0x7ffa60156e90 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7ffa580098e0 tx=0x7ffa580091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 -- 172.21.15.33:0/2765367463 shutdown_connections 2023-10-09T15:38:35.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 --2- 172.21.15.33:0/2765367463 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa6015a5d0 0x7ffa60156e90 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 -- 172.21.15.33:0/2765367463 >> 172.21.15.33:0/2765367463 conn(0x7ffa60070e30 msgr2=0x7ffa600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 -- 172.21.15.33:0/2765367463 shutdown_connections 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.920+0000 7ffa67c52700 1 -- 172.21.15.33:0/2765367463 wait complete. 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.921+0000 7ffa67c52700 1 Processor -- start 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.921+0000 7ffa67c52700 1 -- start start 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa600cb5a0 0x7ffa60168e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6015a5d0 0x7ffa600b46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa601693a0 con 0x7ffa600cb970 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600b3e70 con 0x7ffa600cb5a0 2023-10-09T15:38:35.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa67c52700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa600c7860 con 0x7ffa6015a5d0 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35426/0 (socket says 172.21.15.33:35426) 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 -- 172.21.15.33:0/1146105147 learned_addr learned my addr 172.21.15.33:0/1146105147 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa659ee700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa600cb5a0 0x7ffa60168e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa661ef700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6015a5d0 0x7ffa600b46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 -- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6015a5d0 msgr2=0x7ffa600b46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6015a5d0 0x7ffa600b46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 -- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa600cb5a0 msgr2=0x7ffa60168e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa600cb5a0 0x7ffa60168e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 -- 172.21.15.33:0/1146105147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa58009420 con 0x7ffa600cb970 2023-10-09T15:38:35.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa651ed700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c810 tx=0x7ffa54007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:35.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.922+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54005c00 con 0x7ffa600cb970 2023-10-09T15:38:35.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.923+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa54005d60 con 0x7ffa600cb970 2023-10-09T15:38:35.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.923+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa600c9ba0 con 0x7ffa600cb970 2023-10-09T15:38:35.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.923+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa54007320 con 0x7ffa600cb970 2023-10-09T15:38:35.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.923+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa600c7b00 con 0x7ffa600cb970 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.924+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa600c7cf0 con 0x7ffa600cb970 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.924+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa5401b3b0 con 0x7ffa600cb970 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.924+0000 7ffa5dffb700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.925+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ffa540841a0 con 0x7ffa600cb970 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.925+0000 7ffa659ee700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:35.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.925+0000 7ffa659ee700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa500016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:35.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:35.929+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa54050e30 con 0x7ffa600cb970 2023-10-09T15:38:36.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.167+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7ffa6004c3c0 con 0x7ffa600cb970 2023-10-09T15:38:36.168 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.167+0000 7ffa5dffb700 1 -- 172.21.15.33:0/1146105147 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v93) v1 ==== 53+0+73 (secure 0 0 0) 0x7ffa54054450 con 0x7ffa600cb970 2023-10-09T15:38:36.168 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:38:36.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 msgr2=0x7ffa4c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7ffa50007fd0 tx=0x7ffa500016f0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 msgr2=0x7ffa600c9660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7ffa5400c810 tx=0x7ffa54007d90 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 shutdown_connections 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa4c067320 0x7ffa4c0697d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa6015a5d0 0x7ffa600b46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa600cb5a0 0x7ffa60168e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 --2- 172.21.15.33:0/1146105147 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa600cb970 0x7ffa600c9660 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 >> 172.21.15.33:0/1146105147 conn(0x7ffa60070e30 msgr2=0x7ffa60155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:36.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 shutdown_connections 2023-10-09T15:38:36.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.169+0000 7ffa67c52700 1 -- 172.21.15.33:0/1146105147 wait complete. 2023-10-09T15:38:36.182 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:38:36.182 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:38:36.182 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:38:36.183 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:38:36.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.183 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:38:36.202 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41980sec preferred_lft 41980sec 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:38:36.203 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:38:36.204 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:38:36.205 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:38:36.205 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.205 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:38:36.268 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:38:36.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.271 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:38:36.328 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:38:36.328 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:38:36.329 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:38:36.329 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:38:36.329 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:38:36.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:38:36.329 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:38:36.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.435 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:38:36.450 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:38:36.450 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:38:36.451 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:38:36.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.451 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:38:36.516 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:38:36.516 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:36.571 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:38:36.571 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:38:36.571 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:36.625 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:38:36.625 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:38:36.625 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:38:36.706 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:38:36.706 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:38:36.706 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:38:36.714 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:38:36.715 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:38:36.715 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:38:36.715 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:38:36.715 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:38:36.736 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:38:36.736 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:38:36.736 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:38:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:38:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:38:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:38:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:38:36.737 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:38:36.738 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:38:36.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:36.739 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:36.803 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:38:36.826 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:38:36.849 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:38:36.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.936+0000 7f37dca62700 1 Processor -- start 2023-10-09T15:38:36.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.936+0000 7f37dca62700 1 -- start start 2023-10-09T15:38:36.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37dca62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 0x7f37d815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37dca62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d80cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37dca62700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37d80cd830 con 0x7f37d80cd3d0 2023-10-09T15:38:36.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37dca62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37d815e180 con 0x7f37d8159fb0 2023-10-09T15:38:36.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37dca62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d815d570 con 0x7f37d815a8c0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37d7fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f37d80cd3d0 0x7f37d806d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40996/0 (socket says 172.21.15.33:40996) 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37d7fff700 1 -- 172.21.15.33:0/937410951 learned_addr learned my addr 172.21.15.33:0/937410951 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/937410951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d80cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.937+0000 7f37d77fe700 1 --2- 172.21.15.33:0/937410951 >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 0x7f37d815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3715189994 0 0) 0x7f37d0001490 con 0x7f37d80cd3d0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f37c0003570 con 0x7f37d80cd3d0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3472175663 0 0) 0x7f37c0003570 con 0x7f37d80cd3d0 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d6ffd700 1 -- 172.21.15.33:0/937410951 >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 msgr2=0x7f37d815a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/937410951 >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 0x7f37d815a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d6ffd700 1 -- 172.21.15.33:0/937410951 >> v1:172.21.15.33:6789/0 conn(0x7f37d80cd3d0 legacy=0x7f37d806d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d6ffd700 1 -- 172.21.15.33:0/937410951 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37d815d850 con 0x7f37d815a8c0 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d77fe700 1 --2- 172.21.15.33:0/937410951 >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 0x7f37d815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/937410951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d80cce90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0098e0 tx=0x7f37cc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d347e19adb3cf104 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37d0001980 con 0x7f37d815a8c0 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37cc011420 con 0x7f37d815a8c0 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.938+0000 7f37d67fc700 1 -- 172.21.15.33:0/937410951 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37cc0117c0 con 0x7f37d815a8c0 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 -- 172.21.15.33:0/937410951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 msgr2=0x7f37d80cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 --2- 172.21.15.33:0/937410951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d80cce90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f37cc0098e0 tx=0x7f37cc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 -- 172.21.15.33:0/937410951 shutdown_connections 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 --2- 172.21.15.33:0/937410951 >> v2:172.21.15.59:3300/0 conn(0x7f37d8159fb0 0x7f37d815a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 --2- 172.21.15.33:0/937410951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d80cce90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 -- 172.21.15.33:0/937410951 >> 172.21.15.33:0/937410951 conn(0x7f37d80703a0 msgr2=0x7f37d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:36.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 -- 172.21.15.33:0/937410951 shutdown_connections 2023-10-09T15:38:36.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.939+0000 7f37dca62700 1 -- 172.21.15.33:0/937410951 wait complete. 2023-10-09T15:38:36.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.940+0000 7f37dca62700 1 Processor -- start 2023-10-09T15:38:36.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.940+0000 7f37dca62700 1 -- start start 2023-10-09T15:38:36.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 0x7f37d815b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d815bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80b6250 con 0x7f37d80cd3d0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37d80b4270 con 0x7f37d8159fb0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37dca62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37d8143860 con 0x7f37d815a8c0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35436/0 (socket says 172.21.15.33:35436) 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 -- 172.21.15.33:0/2990782308 learned_addr learned my addr 172.21.15.33:0/2990782308 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d7fff700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d815bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 0x7f37d815b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 -- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 msgr2=0x7f37d815bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d815bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 -- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 msgr2=0x7f37d815b840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 0x7f37d815b840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 -- 172.21.15.33:0/2990782308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37c8009420 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 0x7f37d815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.941+0000 7f37d77fe700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f37c800ec80 tx=0x7f37c80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.942+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800c9d0 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.942+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f37c800cb30 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.942+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37cc009420 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.942+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37c800ceb0 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.942+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37d81440c0 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.943+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f37d81443a0 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.943+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f37c8013680 con 0x7f37d80cd3d0 2023-10-09T15:38:36.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.943+0000 7f37bf7fe700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 0x7f37c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.944+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f37c80850b0 con 0x7f37d80cd3d0 2023-10-09T15:38:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.944+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 0x7f37c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.944+0000 7f37d6ffd700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 0x7f37c40697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f37d80c8890 tx=0x7f37cc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:36.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:36.948+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f37c8051d00 con 0x7f37d80cd3d0 2023-10-09T15:38:37.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.186+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f37d80b2f00 con 0x7f37d80cd3d0 2023-10-09T15:38:37.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.347+0000 7f37bf7fe700 1 -- 172.21.15.33:0/2990782308 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v94) v1 ==== 136+0+0 (secure 0 0 0) 0x7f37c8055320 con 0x7f37d80cd3d0 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 msgr2=0x7f37c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 0x7f37c40697d0 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f37d80c8890 tx=0x7f37cc016000 comp rx=0 tx=0).stop 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 msgr2=0x7f37d80b5d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7f37c800ec80 tx=0x7f37c80091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 shutdown_connections 2023-10-09T15:38:37.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f37c4067320 0x7f37c40697d0 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37d80cd3d0 0x7f37d80b5d10 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37d815a8c0 0x7f37d815bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 --2- 172.21.15.33:0/2990782308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f37d8159fb0 0x7f37d815b840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 >> 172.21.15.33:0/2990782308 conn(0x7f37d80703a0 msgr2=0x7f37d80cb440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 shutdown_connections 2023-10-09T15:38:37.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.350+0000 7f37dca62700 1 -- 172.21.15.33:0/2990782308 wait complete. 2023-10-09T15:38:37.363 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:38:37.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.522+0000 7f3293427700 1 Processor -- start 2023-10-09T15:38:37.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.522+0000 7f3293427700 1 -- start start 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f3293427700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f3293427700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c15ae40 con 0x7f328c0cde50 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f3293427700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f328c15ab60 con 0x7f328c0cd9e0 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f3293427700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0d13f0 con 0x7f328c0cb5a0 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f32919c4700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f328c0cde50 0x7f328c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41000/0 (socket says 172.21.15.33:41000) 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f32919c4700 1 -- 172.21.15.33:0/1066830379 learned_addr learned my addr 172.21.15.33:0/1066830379 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.523+0000 7f32911c3700 1 --2- 172.21.15.33:0/1066830379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1930254116 0 0) 0x7f328c15ae40 con 0x7f328c0cde50 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3274003570 con 0x7f328c0cde50 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714077620 0 0) 0x7f328c15ab60 con 0x7f328c0cd9e0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f328c15ae40 con 0x7f328c0cd9e0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f32911c3700 1 -- 172.21.15.33:0/1066830379 >> v1:172.21.15.59:6789/0 conn(0x7f328c0cd9e0 legacy=0x7f328c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f32911c3700 1 -- 172.21.15.33:0/1066830379 >> v1:172.21.15.33:6789/0 conn(0x7f328c0cde50 legacy=0x7f328c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f32911c3700 1 -- 172.21.15.33:0/1066830379 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f328c0ccf00 con 0x7f328c0cb5a0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f32911c3700 1 --2- 172.21.15.33:0/1066830379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c0cb970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f327c009910 tx=0x7f327c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2940aed0062b3ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011630 con 0x7f328c0cb5a0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c011790 con 0x7f328c0cb5a0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.524+0000 7f328bfff700 1 -- 172.21.15.33:0/1066830379 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011b30 con 0x7f328c0cb5a0 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 -- 172.21.15.33:0/1066830379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 msgr2=0x7f328c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 --2- 172.21.15.33:0/1066830379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c0cb970 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f327c009910 tx=0x7f327c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 -- 172.21.15.33:0/1066830379 shutdown_connections 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 --2- 172.21.15.33:0/1066830379 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c0cb970 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 -- 172.21.15.33:0/1066830379 >> 172.21.15.33:0/1066830379 conn(0x7f328c070e30 msgr2=0x7f328c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 -- 172.21.15.33:0/1066830379 shutdown_connections 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.525+0000 7f3293427700 1 -- 172.21.15.33:0/1066830379 wait complete. 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.526+0000 7f3293427700 1 Processor -- start 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.526+0000 7f3293427700 1 -- start start 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c169970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 0x7f328c1531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 0x7f328c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0c96c0 con 0x7f328c0c98e0 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f328c0c79f0 con 0x7f328c0cd9e0 2023-10-09T15:38:37.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f3293427700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f328c16a9b0 con 0x7f328c0cb5a0 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32919c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 0x7f328c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c169970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32909c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 0x7f328c1531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32919c4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 0x7f328c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35444/0 (socket says 172.21.15.33:35444) 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32919c4700 1 -- 172.21.15.33:0/1590284165 learned_addr learned my addr 172.21.15.33:0/1590284165 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 -- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 msgr2=0x7f328c1531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 0x7f328c1531f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 -- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 msgr2=0x7f328c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 0x7f328c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32911c3700 1 -- 172.21.15.33:0/1590284165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f327c009420 con 0x7f328c0cb5a0 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.527+0000 7f32909c2700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 0x7f328c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:37.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f32911c3700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c169970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cbeb0 tx=0x7f327c017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c027070 con 0x7f328c0cb5a0 2023-10-09T15:38:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f327c002f70 con 0x7f328c0cb5a0 2023-10-09T15:38:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f328c169eb0 con 0x7f328c0cb5a0 2023-10-09T15:38:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f327c011900 con 0x7f328c0cb5a0 2023-10-09T15:38:37.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.528+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f328c16a3f0 con 0x7f328c0cb5a0 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.529+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f328c0c77a0 con 0x7f328c0cb5a0 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.529+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f327c02b070 con 0x7f328c0cb5a0 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.530+0000 7f32897fa700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 0x7f32780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.530+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f327c08e980 con 0x7f328c0cb5a0 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.530+0000 7f32909c2700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 0x7f32780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.530+0000 7f32909c2700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 0x7f32780697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f328c153f10 tx=0x7f3280007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.535+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mon.2 v2:172.21.15.59:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f327c05b610 con 0x7f328c0cb5a0 2023-10-09T15:38:37.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.760+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f328c04c3c0 con 0x7f3278067320 2023-10-09T15:38:37.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.762+0000 7f32897fa700 1 -- 172.21.15.33:0/1590284165 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f328c04c3c0 con 0x7f3278067320 2023-10-09T15:38:37.763 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:38:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:38:37.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:37.763 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:38:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 msgr2=0x7f32780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 0x7f32780697d0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f328c153f10 tx=0x7f3280007d50 comp rx=0 tx=0).stop 2023-10-09T15:38:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 msgr2=0x7f328c169970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c169970 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f328c0cbeb0 tx=0x7f327c017000 comp rx=0 tx=0).stop 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 shutdown_connections 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3278067320 0x7f32780697d0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f328c0c98e0 0x7f328c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f328c0cb5a0 0x7f328c169970 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 --2- 172.21.15.33:0/1590284165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f328c0cd9e0 0x7f328c1531f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 >> 172.21.15.33:0/1590284165 conn(0x7f328c070e30 msgr2=0x7f328c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 shutdown_connections 2023-10-09T15:38:37.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.764+0000 7f3293427700 1 -- 172.21.15.33:0/1590284165 wait complete. 2023-10-09T15:38:37.777 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:38:37.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.898+0000 7f130d936700 1 Processor -- start 2023-10-09T15:38:37.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.898+0000 7f130d936700 1 -- start start 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f130d936700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f13081594d0 0x7f13080cea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f130d936700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080cb1a0 0x7f13080cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f130d936700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f130815e010 con 0x7f13081598a0 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f130d936700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f130815d420 con 0x7f13081594d0 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f130d936700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f130815d6e0 con 0x7f13080cb1a0 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f13077fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f13081598a0 0x7f13080ccfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41004/0 (socket says 172.21.15.33:41004) 2023-10-09T15:38:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f13077fe700 1 -- 172.21.15.33:0/276464780 learned_addr learned my addr 172.21.15.33:0/276464780 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f13067fc700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080cb1a0 0x7f13080cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.899+0000 7f1306ffd700 1 --2- 172.21.15.33:0/276464780 >> v2:172.21.15.59:3300/0 conn(0x7f13081594d0 0x7f13080cea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118480055 0 0) 0x7f130815e010 con 0x7f13081598a0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f12f4003570 con 0x7f13081598a0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3106889 0 0) 0x7f12f4003570 con 0x7f13081598a0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080cb1a0 msgr2=0x7f13080cefb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080cb1a0 0x7f13080cefb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 >> v2:172.21.15.59:3300/0 conn(0x7f13081594d0 msgr2=0x7f13080cea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 --2- 172.21.15.33:0/276464780 >> v2:172.21.15.59:3300/0 conn(0x7f13081594d0 0x7f13080cea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130815d9c0 con 0x7f13081598a0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f12f8001470 con 0x7f13081598a0 2023-10-09T15:38:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 >> v1:172.21.15.33:6789/0 conn(0x7f13081598a0 legacy=0x7f13080ccfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12f4003a60 0x7f12f4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12f4004810 0x7f12f4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f40051c0 0x7f12f400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130815d420 con 0x7f12f40051c0 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130815d6e0 con 0x7f12f4003a60 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12f400bfa0 con 0x7f12f4004810 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13067fc700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080cb1a0 0x7f13080cefb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1306ffd700 1 --2- 172.21.15.33:0/276464780 >> v2:172.21.15.59:3300/0 conn(0x7f13081594d0 0x7f13080cea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f40051c0 0x7f12f400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13067fc700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12f4004810 0x7f12f4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1306ffd700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12f4003a60 0x7f12f4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 -- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12f4004810 msgr2=0x7f12f4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12f4004810 0x7f12f4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 -- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12f4003a60 msgr2=0x7f12f4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12f4003a60 0x7f12f4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f13077fe700 1 -- 172.21.15.33:0/276464780 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12f4003570 con 0x7f12f40051c0 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.900+0000 7f1306ffd700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12f4003a60 0x7f12f4003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f13077fe700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f40051c0 0x7f12f400ba60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3c0 tx=0x7f12f8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3eb73fabe6c616c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f800cc90 con 0x7f12f40051c0 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f800ce30 con 0x7f12f40051c0 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f1305ffb700 1 -- 172.21.15.33:0/276464780 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f8005b70 con 0x7f12f40051c0 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 -- 172.21.15.33:0/276464780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f40051c0 msgr2=0x7f12f400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 --2- 172.21.15.33:0/276464780 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12f40051c0 0x7f12f400ba60 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f12f800c3c0 tx=0x7f12f8001e90 comp rx=0 tx=0).stop 2023-10-09T15:38:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f13077fe700 1 -- 172.21.15.33:0/276464780 reap_dead start 2023-10-09T15:38:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 -- 172.21.15.33:0/276464780 shutdown_connections 2023-10-09T15:38:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 -- 172.21.15.33:0/276464780 >> 172.21.15.33:0/276464780 conn(0x7f13080703a0 msgr2=0x7f1308070770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 -- 172.21.15.33:0/276464780 shutdown_connections 2023-10-09T15:38:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.901+0000 7f130d936700 1 -- 172.21.15.33:0/276464780 wait complete. 2023-10-09T15:38:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 Processor -- start 2023-10-09T15:38:37.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 -- start start 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080b1a70 0x7f13080b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13080b3760 0x7f1308149c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130816d640 con 0x7f13080b32f0 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f130816b180 con 0x7f13080b3760 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f130d936700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13080b2380 con 0x7f13080b1a70 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f13067fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f13067fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35472/0 (socket says 172.21.15.33:35472) 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.903+0000 7f13067fc700 1 -- 172.21.15.33:0/1264877475 learned_addr learned my addr 172.21.15.33:0/1264877475 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f1306ffd700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080b1a70 0x7f13080b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13077fe700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13080b3760 0x7f1308149c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 -- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080b1a70 msgr2=0x7f13080b1e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080b1a70 0x7f13080b1e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 -- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13080b3760 msgr2=0x7f1308149c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13080b3760 0x7f1308149c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 -- 172.21.15.33:0/1264877475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f130816a570 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f13067fc700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f12f0011910 tx=0x7f12f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0015670 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12f00157d0 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f130816a850 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12f0015b90 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.904+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f130816ae10 con 0x7f13080b32f0 2023-10-09T15:38:37.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.905+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f130816b350 con 0x7f13080b32f0 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.905+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f12f0013410 con 0x7f13080b32f0 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.906+0000 7f12feffd700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 0x7f12e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.906+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12f0085580 con 0x7f13080b32f0 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.906+0000 7f1306ffd700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 0x7f12e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.906+0000 7f1306ffd700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 0x7f12e80697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1300009fd0 tx=0x7f130000b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:37.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:37.910+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f130816b350 con 0x7f13080b32f0 2023-10-09T15:38:38.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.102+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f130816b2f0 con 0x7f13080b32f0 2023-10-09T15:38:38.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.102+0000 7f12feffd700 1 -- 172.21.15.33:0/1264877475 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v24)=0 v24) v1 ==== 122+0+0 (secure 0 0 0) 0x7f12f00521d0 con 0x7f13080b32f0 2023-10-09T15:38:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.104+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 msgr2=0x7f12e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.104+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 0x7f12e80697d0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f1300009fd0 tx=0x7f130000b040 comp rx=0 tx=0).stop 2023-10-09T15:38:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.104+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 msgr2=0x7f1308149730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.104+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7f12f0011910 tx=0x7f12f0008040 comp rx=0 tx=0).stop 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 shutdown_connections 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12e8067320 0x7f12e80697d0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13080b3760 0x7f1308149c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f13080b1a70 0x7f13080b1e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 --2- 172.21.15.33:0/1264877475 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13080b32f0 0x7f1308149730 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 >> 172.21.15.33:0/1264877475 conn(0x7f13080703a0 msgr2=0x7f130815e3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 shutdown_connections 2023-10-09T15:38:38.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.105+0000 7f130d936700 1 -- 172.21.15.33:0/1264877475 wait complete. 2023-10-09T15:38:38.118 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:38:38.118 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:38:38.118 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:38:38.156 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:38:38.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:38.157 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:38:38.212 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:38:38.212 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:38:38.212 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:38:38.261 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:38:38.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:38.262 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:38:38.278 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:38:38.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:38.279 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T15:38:38.293 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:38:38.294 INFO:teuthology.orchestra.run.smithi033.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T15:38:38.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:38:38.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:38:38.294 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T15:38:38.335 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:38:38.335 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T15:38:38.335 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000107790 --yes-i-really-mean-it 2023-10-09T15:38:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.457+0000 7ff17b015700 1 Processor -- start 2023-10-09T15:38:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff17b015700 1 -- start start 2023-10-09T15:38:38.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff17b015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1740cd5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff17b015700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1740ce360 con 0x7ff1740cb320 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff17b015700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1740cb970 con 0x7ff1740caeb0 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff17b015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740cb750 con 0x7ff1740cd200 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.458+0000 7ff1795b2700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff1740cb320 0x7ff17415a160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41014/0 (socket says 172.21.15.33:41014) 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1795b2700 1 -- 172.21.15.33:0/2922481096 learned_addr learned my addr 172.21.15.33:0/2922481096 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff178db1700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1740cd5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701331787 0 0) 0x7ff1740ce360 con 0x7ff1740cb320 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff160003570 con 0x7ff1740cb320 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3862608244 0 0) 0x7ff160003570 con 0x7ff1740cb320 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 msgr2=0x7ff1740cd5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1740cd5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 >> v1:172.21.15.59:6789/0 conn(0x7ff1740caeb0 legacy=0x7ff1741502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740cbc50 con 0x7ff1740cb320 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7ff15c001470 con 0x7ff1740cb320 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 >> v1:172.21.15.33:6789/0 conn(0x7ff1740cb320 legacy=0x7ff17415a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff160003a90 0x7ff160003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff160004810 0x7ff160004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740cb750 con 0x7ff160004810 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff16000bb10 con 0x7ff160003a90 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff16000bcd0 con 0x7ff1740cd200 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff173fff700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff160004810 0x7ff160004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff178db1700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff160003a90 0x7ff160003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.459+0000 7ff1795b2700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 -- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 msgr2=0x7ff1600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff1740cd200 0x7ff1600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 -- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff160003a90 msgr2=0x7ff160003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff160003a90 0x7ff160003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 -- 172.21.15.33:0/2922481096 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff160003570 con 0x7ff160004810 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff178db1700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff160003a90 0x7ff160003e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff173fff700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff160004810 0x7ff160004c80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff1640020a0 tx=0x7ff1640016d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78199b1bd1c7ed88 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1640019e0 con 0x7ff160004810 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff16400c8b0 con 0x7ff160004810 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff1737fe700 1 -- 172.21.15.33:0/2922481096 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff16400cc50 con 0x7ff160004810 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 -- 172.21.15.33:0/2922481096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff160004810 msgr2=0x7ff160004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 --2- 172.21.15.33:0/2922481096 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff160004810 0x7ff160004c80 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7ff1640020a0 tx=0x7ff1640016d0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff1795b2700 1 -- 172.21.15.33:0/2922481096 reap_dead start 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 -- 172.21.15.33:0/2922481096 shutdown_connections 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 -- 172.21.15.33:0/2922481096 >> 172.21.15.33:0/2922481096 conn(0x7ff1740999c0 msgr2=0x7ff174070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 -- 172.21.15.33:0/2922481096 shutdown_connections 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.460+0000 7ff17b015700 1 -- 172.21.15.33:0/2922481096 wait complete. 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.461+0000 7ff17b015700 1 Processor -- start 2023-10-09T15:38:38.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 -- start start 2023-10-09T15:38:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff160004810 0x7ff17414e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1740b6010 0x7ff17414ee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c8e60 con 0x7ff17416d170 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740ca5d0 con 0x7ff1740b6010 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.462+0000 7ff17b015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1740c8250 con 0x7ff160004810 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:35476/0 (socket says 172.21.15.33:35476) 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 -- 172.21.15.33:0/1756414002 learned_addr learned my addr 172.21.15.33:0/1756414002 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff173fff700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1740b6010 0x7ff17414ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff178db1700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff160004810 0x7ff17414e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 -- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff160004810 msgr2=0x7ff17414e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff160004810 0x7ff17414e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 -- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1740b6010 msgr2=0x7ff17414ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1740b6010 0x7ff17414ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:38.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 -- 172.21.15.33:0/1756414002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1740c8530 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff1795b2700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff15c000c00 tx=0x7ff15c000f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c012590 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c012710 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1740c8810 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c012ad0 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.463+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff17414f340 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.464+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff17404c3c0 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.465+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff15c01d460 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.465+0000 7ff170ff9700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.465+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff15c0848d0 con 0x7ff17416d170 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.465+0000 7ff178db1700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:38.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.465+0000 7ff178db1700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 0x7ff1540697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009e40 tx=0x7ff16c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:38.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.469+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff15c051620 con 0x7ff17416d170 2023-10-09T15:38:38.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:38.695+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000107790", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7ff1740cbf30 con 0x7ff154067320 2023-10-09T15:38:41.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.363+0000 7ff170ff9700 1 -- 172.21.15.33:0/1756414002 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7ff1740cbf30 con 0x7ff154067320 2023-10-09T15:38:41.364 INFO:teuthology.orchestra.run.smithi033.stdout:FS volume 'cephfs' renamed to 'volume_0000000000107790' 2023-10-09T15:38:41.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 msgr2=0x7ff1540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 0x7ff1540697d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009e40 tx=0x7ff16c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 msgr2=0x7ff17416d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7ff15c000c00 tx=0x7ff15c000f80 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 shutdown_connections 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff154067320 0x7ff1540697d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff17416d170 0x7ff17416d5c0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff160004810 0x7ff17414e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.365+0000 7ff17b015700 1 --2- 172.21.15.33:0/1756414002 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff1740b6010 0x7ff17414ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.366+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 >> 172.21.15.33:0/1756414002 conn(0x7ff1740999c0 msgr2=0x7ff1741522c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:41.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.366+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 shutdown_connections 2023-10-09T15:38:41.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.366+0000 7ff17b015700 1 -- 172.21.15.33:0/1756414002 wait complete. 2023-10-09T15:38:41.381 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:38:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.506+0000 7f9c60499700 1 Processor -- start 2023-10-09T15:38:41.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.506+0000 7f9c60499700 1 -- start start 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c60499700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c5815cb50 0x7f9c580b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c60499700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9c5815cf20 0x7f9c580b27d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c60499700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c5815ad50 con 0x7f9c580b0710 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c60499700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5815a140 con 0x7f9c5815cb50 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c60499700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5815a420 con 0x7f9c5815cf20 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c5e235700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c5815cb50 0x7f9c580b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c5e235700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9c5815cb50 0x7f9c580b01d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39326/0 (socket says 172.21.15.33:39326) 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.507+0000 7f9c5e235700 1 -- 172.21.15.33:0/2121711387 learned_addr learned my addr 172.21.15.33:0/2121711387 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5da34700 1 --2- 172.21.15.33:0/2121711387 >> v2:172.21.15.59:3300/0 conn(0x7f9c5815cf20 0x7f9c580b27d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5e235700 1 -- 172.21.15.33:0/2121711387 >> v2:172.21.15.59:3300/0 conn(0x7f9c5815cf20 msgr2=0x7f9c580b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5e235700 1 --2- 172.21.15.33:0/2121711387 >> v2:172.21.15.59:3300/0 conn(0x7f9c5815cf20 0x7f9c580b27d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5e235700 1 -- 172.21.15.33:0/2121711387 >> v1:172.21.15.59:6789/0 conn(0x7f9c580b0710 legacy=0x7f9c581536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5e235700 1 -- 172.21.15.33:0/2121711387 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c5815a700 con 0x7f9c5815cb50 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5e235700 1 --2- 172.21.15.33:0/2121711387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c580b01d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a880 tx=0x7f9c50009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53e71f4d05d4cfeb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5d233700 1 -- 172.21.15.33:0/2121711387 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000b860 con 0x7f9c5815cb50 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5d233700 1 -- 172.21.15.33:0/2121711387 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c5000b9c0 con 0x7f9c5815cb50 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.508+0000 7f9c5d233700 1 -- 172.21.15.33:0/2121711387 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c5000bd60 con 0x7f9c5815cb50 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 -- 172.21.15.33:0/2121711387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 msgr2=0x7f9c580b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 --2- 172.21.15.33:0/2121711387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c580b01d0 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a880 tx=0x7f9c50009250 comp rx=0 tx=0).stop 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 -- 172.21.15.33:0/2121711387 shutdown_connections 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 --2- 172.21.15.33:0/2121711387 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c580b01d0 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 --2- 172.21.15.33:0/2121711387 >> v2:172.21.15.59:3300/0 conn(0x7f9c5815cf20 0x7f9c580b27d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 -- 172.21.15.33:0/2121711387 >> 172.21.15.33:0/2121711387 conn(0x7f9c580cded0 msgr2=0x7f9c5806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 -- 172.21.15.33:0/2121711387 shutdown_connections 2023-10-09T15:38:41.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.509+0000 7f9c60499700 1 -- 172.21.15.33:0/2121711387 wait complete. 2023-10-09T15:38:41.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.510+0000 7f9c60499700 1 Processor -- start 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.510+0000 7f9c60499700 1 -- start start 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.510+0000 7f9c60499700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c580b0710 0x7f9c580c21b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5815cf20 0x7f9c58156d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c581695b0 con 0x7f9c5815cb50 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5816a390 con 0x7f9c580b0710 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5814a440 con 0x7f9c5815cf20 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39338/0 (socket says 172.21.15.33:39338) 2023-10-09T15:38:41.515 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 -- 172.21.15.33:0/3485264206 learned_addr learned my addr 172.21.15.33:0/3485264206 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5e235700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c580b0710 0x7f9c580c21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5ea36700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5815cf20 0x7f9c58156d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 -- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5815cf20 msgr2=0x7f9c58156d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5815cf20 0x7f9c58156d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 -- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c580b0710 msgr2=0x7f9c580c21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c580b0710 0x7f9c580c21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 -- 172.21.15.33:0/3485264206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c500094f0 con 0x7f9c5815cb50 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c5da34700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006b00 tx=0x7f9c4c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c0125f0 con 0x7f9c5815cb50 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c4c012770 con 0x7f9c5815cb50 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c581697c0 con 0x7f9c5815cb50 2023-10-09T15:38:41.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c012b30 con 0x7f9c5815cb50 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.511+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c58169d40 con 0x7f9c5815cb50 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.512+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5816a520 con 0x7f9c5815cb50 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.513+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9c4c01e460 con 0x7f9c5815cb50 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.513+0000 7f9c567fc700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 0x7f9c440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.513+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f9c4c085120 con 0x7f9c5815cb50 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.513+0000 7f9c5e235700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 0x7f9c440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.514+0000 7f9c5e235700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 0x7f9c440697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a880 tx=0x7f9c50017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.518+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9c4c051e10 con 0x7f9c5815cb50 2023-10-09T15:38:41.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.740+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f9c5804c3c0 con 0x7f9c44067320 2023-10-09T15:38:41.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.741+0000 7f9c567fc700 1 -- 172.21.15.33:0/3485264206 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f9c5804c3c0 con 0x7f9c44067320 2023-10-09T15:38:41.742 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:38:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:41.742 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000107790" 2023-10-09T15:38:41.743 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:41.743 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:38:41.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 msgr2=0x7f9c440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 0x7f9c440697d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9c5806a880 tx=0x7f9c50017000 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 msgr2=0x7f9c58149f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c006b00 tx=0x7f9c4c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 shutdown_connections 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9c44067320 0x7f9c440697d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9c5815cf20 0x7f9c58156d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9c580b0710 0x7f9c580c21b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 --2- 172.21.15.33:0/3485264206 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9c5815cb50 0x7f9c58149f00 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 >> 172.21.15.33:0/3485264206 conn(0x7f9c580cded0 msgr2=0x7f9c580675a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:41.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 shutdown_connections 2023-10-09T15:38:41.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.743+0000 7f9c60499700 1 -- 172.21.15.33:0/3485264206 wait complete. 2023-10-09T15:38:41.756 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:41.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.874+0000 7fe277622700 1 Processor -- start 2023-10-09T15:38:41.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.874+0000 7fe277622700 1 -- start start 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2701508c0 0x7fe270158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 0x7fe2700af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe27015a0c0 0x7fe27015a520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe27015afc0 con 0x7fe27015a0c0 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2700af820 con 0x7fe270150c90 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe277622700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27015aa60 con 0x7fe2701508c0 2023-10-09T15:38:41.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe275bbf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe27015a0c0 0x7fe27015a520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe275bbf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe27015a0c0 0x7fe27015a520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39354/0 (socket says 172.21.15.33:39354) 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.875+0000 7fe275bbf700 1 -- 172.21.15.33:0/403355139 learned_addr learned my addr 172.21.15.33:0/403355139 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe2753be700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2701508c0 0x7fe270158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe274bbd700 1 --2- 172.21.15.33:0/403355139 >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 0x7fe2700af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 -- 172.21.15.33:0/403355139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2701508c0 msgr2=0x7fe270158650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2701508c0 0x7fe270158650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 -- 172.21.15.33:0/403355139 >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 msgr2=0x7fe2700af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 --2- 172.21.15.33:0/403355139 >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 0x7fe2700af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 -- 172.21.15.33:0/403355139 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe270158c80 con 0x7fe27015a0c0 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe274bbd700 1 --2- 172.21.15.33:0/403355139 >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 0x7fe2700af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe275bbf700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe27015a0c0 0x7fe27015a520 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe270063560 tx=0x7fe268009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a91462d04e9788 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe26ffff700 1 -- 172.21.15.33:0/403355139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800b860 con 0x7fe27015a0c0 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe26ffff700 1 -- 172.21.15.33:0/403355139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe26800b9c0 con 0x7fe27015a0c0 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe26ffff700 1 -- 172.21.15.33:0/403355139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe26800bd60 con 0x7fe27015a0c0 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe277622700 1 -- 172.21.15.33:0/403355139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe27015a0c0 msgr2=0x7fe27015a520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe277622700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe27015a0c0 0x7fe27015a520 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7fe270063560 tx=0x7fe268009250 comp rx=0 tx=0).stop 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe277622700 1 -- 172.21.15.33:0/403355139 shutdown_connections 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.876+0000 7fe277622700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe27015a0c0 0x7fe27015a520 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.877+0000 7fe277622700 1 --2- 172.21.15.33:0/403355139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe2701508c0 0x7fe270158650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.877+0000 7fe277622700 1 --2- 172.21.15.33:0/403355139 >> v2:172.21.15.59:3300/0 conn(0x7fe270150c90 0x7fe2700af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.877+0000 7fe277622700 1 -- 172.21.15.33:0/403355139 >> 172.21.15.33:0/403355139 conn(0x7fe2700cded0 msgr2=0x7fe27006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.877+0000 7fe277622700 1 -- 172.21.15.33:0/403355139 shutdown_connections 2023-10-09T15:38:41.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.877+0000 7fe277622700 1 -- 172.21.15.33:0/403355139 wait complete. 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.878+0000 7fe277622700 1 Processor -- start 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.878+0000 7fe277622700 1 -- start start 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2701508c0 0x7fe27014ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe27015a0c0 0x7fe2700cbd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.883 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe270156970 con 0x7fe270150c90 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe27014d500 con 0x7fe2701508c0 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe27014d7e0 con 0x7fe27015a0c0 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39366/0 (socket says 172.21.15.33:39366) 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 -- 172.21.15.33:0/540965675 learned_addr learned my addr 172.21.15.33:0/540965675 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe275bbf700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe27015a0c0 0x7fe2700cbd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe2753be700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2701508c0 0x7fe27014ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 -- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe27015a0c0 msgr2=0x7fe2700cbd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe27015a0c0 0x7fe2700cbd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 -- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2701508c0 msgr2=0x7fe27014ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2701508c0 0x7fe27014ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:41.884 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 -- 172.21.15.33:0/540965675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2680094f0 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe274bbd700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c850 tx=0x7fe264008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264011600 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe264011760 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe27014dac0 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe264011b00 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.879+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2700c9820 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.881+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe270156dd0 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.881+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe2640223a0 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.881+0000 7fe26d7fa700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 0x7fe25c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.881+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe264084f50 con 0x7fe270150c90 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.881+0000 7fe2753be700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 0x7fe25c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:41.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.882+0000 7fe2753be700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 0x7fe25c0697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2600075a0 tx=0x7fe2600097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:41.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:41.886+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe264051a80 con 0x7fe270150c90 2023-10-09T15:38:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.128+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe270156f80 con 0x7fe270150c90 2023-10-09T15:38:42.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.128+0000 7fe26d7fa700 1 -- 172.21.15.33:0/540965675 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4609 (secure 0 0 0) 0x7fe26401e090 con 0x7fe270150c90 2023-10-09T15:38:42.129 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:42.129 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:39.349472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000107790","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 msgr2=0x7fe25c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 0x7fe25c0697d0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fe2600075a0 tx=0x7fe2600097e0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 msgr2=0x7fe2700cb800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe26400c850 tx=0x7fe264008040 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 shutdown_connections 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe25c067320 0x7fe25c0697d0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe27015a0c0 0x7fe2700cbd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe2701508c0 0x7fe27014ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 --2- 172.21.15.33:0/540965675 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe270150c90 0x7fe2700cb800 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 >> 172.21.15.33:0/540965675 conn(0x7fe2700cded0 msgr2=0x7fe2700b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 shutdown_connections 2023-10-09T15:38:42.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.130+0000 7fe277622700 1 -- 172.21.15.33:0/540965675 wait complete. 2023-10-09T15:38:42.133 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 95 2023-10-09T15:38:42.143 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:42.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.262+0000 7fc8117ba700 1 Processor -- start 2023-10-09T15:38:42.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.262+0000 7fc8117ba700 1 -- start start 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc8117ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cb5a0 0x7fc80c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc8117ba700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80c0cde50 0x7fc80c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc8117ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc80c15ae40 con 0x7fc80c0cd9e0 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc8117ba700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc80c0d13f0 con 0x7fc80c0cde50 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc8117ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c15ab60 con 0x7fc80c0cb5a0 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80c0cde50 0x7fc80c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc80c0cde50 0x7fc80c156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39382/0 (socket says 172.21.15.33:39382) 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 -- 172.21.15.33:0/1517776969 learned_addr learned my addr 172.21.15.33:0/1517776969 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:42.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80affd700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cb5a0 0x7fc80c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 -- 172.21.15.33:0/1517776969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cb5a0 msgr2=0x7fc80c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cb5a0 0x7fc80c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 -- 172.21.15.33:0/1517776969 >> v1:172.21.15.59:6789/0 conn(0x7fc80c0cd9e0 legacy=0x7fc80c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.263+0000 7fc80b7fe700 1 -- 172.21.15.33:0/1517776969 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc80c0ccf00 con 0x7fc80c0cde50 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0cde50 0x7fc80c156e90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009f20 tx=0x7fc7fc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=870fd101a2888504 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc809ffb700 1 -- 172.21.15.33:0/1517776969 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc00e070 con 0x7fc80c0cde50 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc809ffb700 1 -- 172.21.15.33:0/1517776969 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc00b9d0 con 0x7fc80c0cde50 2023-10-09T15:38:42.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc809ffb700 1 -- 172.21.15.33:0/1517776969 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc0092e0 con 0x7fc80c0cde50 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 -- 172.21.15.33:0/1517776969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0cde50 msgr2=0x7fc80c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0cde50 0x7fc80c156e90 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc009f20 tx=0x7fc7fc009840 comp rx=0 tx=0).stop 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 -- 172.21.15.33:0/1517776969 shutdown_connections 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c0cde50 0x7fc80c156e90 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 --2- 172.21.15.33:0/1517776969 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cb5a0 0x7fc80c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 -- 172.21.15.33:0/1517776969 >> 172.21.15.33:0/1517776969 conn(0x7fc80c070e30 msgr2=0x7fc80c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 -- 172.21.15.33:0/1517776969 shutdown_connections 2023-10-09T15:38:42.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.264+0000 7fc8117ba700 1 -- 172.21.15.33:0/1517776969 wait complete. 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 Processor -- start 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 -- start start 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 0x7fc80c15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cd9e0 0x7fc80c16cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0ca240 con 0x7fc80c1562e0 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c15deb0 con 0x7fc80c0cb5a0 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.266+0000 7fc8117ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc80c0c9c30 con 0x7fc80c0cd9e0 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39388/0 (socket says 172.21.15.33:39388) 2023-10-09T15:38:42.270 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 -- 172.21.15.33:0/4087561929 learned_addr learned my addr 172.21.15.33:0/4087561929 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80affd700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 0x7fc80c15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80a7fc700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cd9e0 0x7fc80c16cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 -- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cd9e0 msgr2=0x7fc80c16cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cd9e0 0x7fc80c16cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 -- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 msgr2=0x7fc80c15c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 0x7fc80c15c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 -- 172.21.15.33:0/4087561929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7fc009ae0 con 0x7fc80c1562e0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80affd700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 0x7fc80c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc80b7fe700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00b610 tx=0x7fc7fc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc008b80 con 0x7fc80c1562e0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7fc008ce0 con 0x7fc80c1562e0 2023-10-09T15:38:42.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc80c0ca6d0 con 0x7fc80c1562e0 2023-10-09T15:38:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7fc025690 con 0x7fc80c1562e0 2023-10-09T15:38:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.267+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc80c0c9ed0 con 0x7fc80c1562e0 2023-10-09T15:38:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.268+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc80c0c9aa0 con 0x7fc80c1562e0 2023-10-09T15:38:42.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.269+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc7fc003040 con 0x7fc80c1562e0 2023-10-09T15:38:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.269+0000 7fc802ffd700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 0x7fc7ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.269+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fc7fc0869d0 con 0x7fc80c1562e0 2023-10-09T15:38:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.269+0000 7fc80affd700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 0x7fc7ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.269+0000 7fc80affd700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 0x7fc7ec0697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc804009d80 tx=0x7fc804008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.273+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc7fc0535b0 con 0x7fc80c1562e0 2023-10-09T15:38:42.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.471+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc80c04c3c0 con 0x7fc80c1562e0 2023-10-09T15:38:42.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.472+0000 7fc802ffd700 1 -- 172.21.15.33:0/4087561929 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fc7fc056bd0 con 0x7fc80c1562e0 2023-10-09T15:38:42.473 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:42.473 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":143,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:41.359545+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000107790.meta","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000107790"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000107790.data","create_time":"2023-10-09T15:38:22.667405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000107790"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 msgr2=0x7fc7ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 0x7fc7ec0697d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc804009d80 tx=0x7fc804008040 comp rx=0 tx=0).stop 2023-10-09T15:38:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 msgr2=0x7fc80c16d4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fc7fc00b610 tx=0x7fc7fc018000 comp rx=0 tx=0).stop 2023-10-09T15:38:42.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 shutdown_connections 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc7ec067320 0x7fc7ec0697d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc80c1562e0 0x7fc80c16d4b0 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc80c0cb5a0 0x7fc80c15c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 --2- 172.21.15.33:0/4087561929 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc80c0cd9e0 0x7fc80c16cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 >> 172.21.15.33:0/4087561929 conn(0x7fc80c070e30 msgr2=0x7fc80c0b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 shutdown_connections 2023-10-09T15:38:42.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.474+0000 7fc8117ba700 1 -- 172.21.15.33:0/4087561929 wait complete. 2023-10-09T15:38:42.487 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:38:42.488 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:42.528 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:42.578 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:38:42.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:42.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.696+0000 7f6de1b13700 1 Processor -- start 2023-10-09T15:38:42.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.696+0000 7f6de1b13700 1 -- start start 2023-10-09T15:38:42.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1b13700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ddc15de50 0x7f6ddc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1b13700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc0cf3c0 con 0x7f6ddc0cef40 2023-10-09T15:38:42.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1b13700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ddc15afd0 con 0x7f6ddc153c30 2023-10-09T15:38:42.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1b13700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ddc15b2b0 con 0x7f6ddc15de50 2023-10-09T15:38:42.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6ddbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6ddc15de50 0x7f6ddc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1312700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ddc0cef40 0x7f6ddc15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52632/0 (socket says 172.21.15.33:52632) 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6de1312700 1 -- 172.21.15.33:0/536885185 learned_addr learned my addr 172.21.15.33:0/536885185 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6ddbfff700 1 -- 172.21.15.33:0/536885185 >> v1:172.21.15.59:6789/0 conn(0x7f6ddc153c30 legacy=0x7f6ddc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6ddbfff700 1 -- 172.21.15.33:0/536885185 >> v1:172.21.15.33:6789/0 conn(0x7f6ddc0cef40 legacy=0x7f6ddc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6ddbfff700 1 -- 172.21.15.33:0/536885185 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc15b590 con 0x7f6ddc15de50 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.697+0000 7f6ddb7fe700 1 -- 172.21.15.33:0/536885185 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3877698944 0 0) 0x7f6ddc0cf3c0 con 0x7f6ddc0cef40 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6ddbfff700 1 --2- 172.21.15.33:0/536885185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0cea00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0098e0 tx=0x7f6dcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=206d371642c2d2eb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6ddb7fe700 1 -- 172.21.15.33:0/536885185 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc009e80 con 0x7f6ddc15de50 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6ddb7fe700 1 -- 172.21.15.33:0/536885185 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc00b860 con 0x7f6ddc15de50 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6ddb7fe700 1 -- 172.21.15.33:0/536885185 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc00bbe0 con 0x7f6ddc15de50 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 -- 172.21.15.33:0/536885185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 msgr2=0x7f6ddc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 --2- 172.21.15.33:0/536885185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0cea00 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc0098e0 tx=0x7f6dcc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 -- 172.21.15.33:0/536885185 shutdown_connections 2023-10-09T15:38:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 --2- 172.21.15.33:0/536885185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0cea00 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 -- 172.21.15.33:0/536885185 >> 172.21.15.33:0/536885185 conn(0x7f6ddc0703a0 msgr2=0x7f6ddc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 -- 172.21.15.33:0/536885185 shutdown_connections 2023-10-09T15:38:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.698+0000 7f6de1b13700 1 -- 172.21.15.33:0/536885185 wait complete. 2023-10-09T15:38:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.699+0000 7f6de1b13700 1 Processor -- start 2023-10-09T15:38:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 -- start start 2023-10-09T15:38:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ddc0cef40 0x7f6ddc146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 0x7f6ddc0c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0ca120 con 0x7f6ddc15de50 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c9510 con 0x7f6ddc0cef40 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1b13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc0c97f0 con 0x7f6ddc153c30 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1312700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1312700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39408/0 (socket says 172.21.15.33:39408) 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de1312700 1 -- 172.21.15.33:0/1321111560 learned_addr learned my addr 172.21.15.33:0/1321111560 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6de0b11700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ddc0cef40 0x7f6ddc146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.700+0000 7f6ddbfff700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 0x7f6ddc0c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 -- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 msgr2=0x7f6ddc0c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 0x7f6ddc0c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 -- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ddc0cef40 msgr2=0x7f6ddc146e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ddc0cef40 0x7f6ddc146e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 -- 172.21.15.33:0/1321111560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dcc009420 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6ddbfff700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 0x7f6ddc0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1312700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c530 tx=0x7f6dc4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4005b30 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc4005c90 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc0c9ad0 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc4007320 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.701+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc147360 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.702+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc147550 con 0x7f6ddc15de50 2023-10-09T15:38:42.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.702+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6dc401b3b0 con 0x7f6ddc15de50 2023-10-09T15:38:42.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.703+0000 7f6dd8ff9700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 0x7f6dbc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:42.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.703+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6dc40841c0 con 0x7f6ddc15de50 2023-10-09T15:38:42.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.703+0000 7f6de0b11700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 0x7f6dbc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:42.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.703+0000 7f6de0b11700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 0x7f6dbc0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007fd0 tx=0x7f6dd40016f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:42.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.707+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ddc147550 con 0x7f6ddc15de50 2023-10-09T15:38:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.944+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ddc147550 con 0x7f6ddc15de50 2023-10-09T15:38:42.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.945+0000 7f6dd8ff9700 1 -- 172.21.15.33:0/1321111560 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f6ddc147550 con 0x7f6ddc15de50 2023-10-09T15:38:42.946 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:42.946 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:39.349472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000107790","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 msgr2=0x7f6dbc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 0x7f6dbc0697d0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f6dd4007fd0 tx=0x7f6dd40016f0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 msgr2=0x7f6ddc0c5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:42.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f6dc400c530 tx=0x7f6dc4007f90 comp rx=0 tx=0).stop 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 shutdown_connections 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6dbc067320 0x7f6dbc0697d0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ddc15de50 0x7f6ddc0c5b80 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ddc0cef40 0x7f6ddc146e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 --2- 172.21.15.33:0/1321111560 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ddc153c30 0x7f6ddc0c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 >> 172.21.15.33:0/1321111560 conn(0x7f6ddc0703a0 msgr2=0x7f6ddc0b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 shutdown_connections 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:42.947+0000 7f6de1b13700 1 -- 172.21.15.33:0/1321111560 wait complete. 2023-10-09T15:38:42.949 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 95 2023-10-09T15:38:42.960 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.079+0000 7fa0a359e700 1 Processor -- start 2023-10-09T15:38:43.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.079+0000 7fa0a359e700 1 -- start start 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa0a4164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a415afd0 con 0x7fa0a415de50 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa0a415b2b0 con 0x7fa0a4153c30 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415b590 con 0x7fa0a40cf110 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a1d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa0a415de50 0x7fa0a40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52636/0 (socket says 172.21.15.33:52636) 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a1d9b700 1 -- 172.21.15.33:0/136946668 learned_addr learned my addr 172.21.15.33:0/136946668 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa0a4164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2010575809 0 0) 0x7fa0a415afd0 con 0x7fa0a415de50 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.080+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa08c003570 con 0x7fa0a415de50 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2594231905 0 0) 0x7fa08c003570 con 0x7fa0a415de50 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 msgr2=0x7fa0a4164600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa0a4164600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 >> v1:172.21.15.59:6789/0 conn(0x7fa0a4153c30 legacy=0x7fa0a415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a415b870 con 0x7fa0a415de50 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa098001470 con 0x7fa0a415de50 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 >> v1:172.21.15.33:6789/0 conn(0x7fa0a415de50 legacy=0x7fa0a40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c003a90 0x7fa08c003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa08c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a415b590 con 0x7fa08c003a90 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c00bb40 con 0x7fa08c004810 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa08c00bd00 con 0x7fa0a40cf110 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c003a90 0x7fa08c003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa08c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a1d9b700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 -- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 msgr2=0x7fa08c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa08c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 -- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c004810 msgr2=0x7fa08c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa08c004810 0x7fa08c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 -- 172.21.15.33:0/136946668 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa08c003570 con 0x7fa08c003a90 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa0a40cf110 0x7fa08c0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a259c700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c003a90 0x7fa08c003e60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa0940019a0 tx=0x7fa094007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=342af26a8e774b18 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400c5d0 con 0x7fa08c003a90 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09400c730 con 0x7fa08c003a90 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.081+0000 7fa0a159a700 1 -- 172.21.15.33:0/136946668 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09400cad0 con 0x7fa08c003a90 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 -- 172.21.15.33:0/136946668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c003a90 msgr2=0x7fa08c003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 --2- 172.21.15.33:0/136946668 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa08c003a90 0x7fa08c003e60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fa0940019a0 tx=0x7fa094007d10 comp rx=0 tx=0).stop 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a2d9d700 1 -- 172.21.15.33:0/136946668 reap_dead start 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 -- 172.21.15.33:0/136946668 shutdown_connections 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 -- 172.21.15.33:0/136946668 >> 172.21.15.33:0/136946668 conn(0x7fa0a40703a0 msgr2=0x7fa0a40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 -- 172.21.15.33:0/136946668 shutdown_connections 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.082+0000 7fa0a359e700 1 -- 172.21.15.33:0/136946668 wait complete. 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.083+0000 7fa0a359e700 1 Processor -- start 2023-10-09T15:38:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.083+0000 7fa0a359e700 1 -- start start 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c003a90 0x7fa0a4169f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a40c8500 0x7fa0a4158560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a4159a10 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40cc400 con 0x7fa0a40c8500 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa0a40b4630 con 0x7fa08c003a90 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39434/0 (socket says 172.21.15.33:39434) 2023-10-09T15:38:43.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 -- 172.21.15.33:0/1329725611 learned_addr learned my addr 172.21.15.33:0/1329725611 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a259c700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c003a90 0x7fa0a4169f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a1d9b700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a40c8500 0x7fa0a4158560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 -- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c003a90 msgr2=0x7fa0a4169f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c003a90 0x7fa0a4169f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 -- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a40c8500 msgr2=0x7fa0a4158560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a40c8500 0x7fa0a4158560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 -- 172.21.15.33:0/1329725611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0a416a490 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.084+0000 7fa0a2d9d700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009f80 tx=0x7fa09c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.085+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c00e050 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.085+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa09c00f040 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.085+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa0a4159730 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.085+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa09c015440 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.085+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0a40cc090 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.086+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa0a404c3c0 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.086+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa09c003020 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.087+0000 7fa0927fc700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 0x7fa0840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.087+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fa09c085240 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.087+0000 7fa0a259c700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 0x7fa0840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.087+0000 7fa0a259c700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 0x7fa0840697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ca5e0 tx=0x7fa094015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.091+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa09c051d70 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.287+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa0a40cc540 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.288+0000 7fa0927fc700 1 -- 172.21.15.33:0/1329725611 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fa09c055390 con 0x7fa0a40b3ca0 2023-10-09T15:38:43.289 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:43.289 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":143,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:41.359545+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000107790.meta","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000107790"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000107790.data","create_time":"2023-10-09T15:38:22.667405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000107790"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:43.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 msgr2=0x7fa0840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 0x7fa0840697d0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fa0a40ca5e0 tx=0x7fa094015000 comp rx=0 tx=0).stop 2023-10-09T15:38:43.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 msgr2=0x7fa0a40b40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7fa09c009f80 tx=0x7fa09c00b040 comp rx=0 tx=0).stop 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 shutdown_connections 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa084067320 0x7fa0840697d0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa0a40b3ca0 0x7fa0a40b40f0 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa08c003a90 0x7fa0a4169f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 --2- 172.21.15.33:0/1329725611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa0a40c8500 0x7fa0a4158560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 >> 172.21.15.33:0/1329725611 conn(0x7fa0a40703a0 msgr2=0x7fa0a415bf10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 shutdown_connections 2023-10-09T15:38:43.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.290+0000 7fa0a359e700 1 -- 172.21.15.33:0/1329725611 wait complete. 2023-10-09T15:38:43.303 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 24, 'pool_name': 'cephfs.volume_0000000000107790.meta', 'create_time': '2023-10-09T15:38:21.698407+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000107790'}}}, {'pool': 25, 'pool_name': 'cephfs.volume_0000000000107790.data', 'create_time': '2023-10-09T15:38:22.667405+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000107790'}}}] 2023-10-09T15:38:43.304 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:38:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.426+0000 7f520ee89700 1 Processor -- start 2023-10-09T15:38:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.426+0000 7f520ee89700 1 -- start start 2023-10-09T15:38:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 0x7f52080ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f52080cbd90 0x7f52080cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f52080cd420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080cf510 con 0x7f52080cbd90 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52080cc210 con 0x7f5208159860 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520ee89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52080cd960 con 0x7f52080ccfa0 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f5207fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f52080cbd90 0x7f52080cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f5207fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f52080cbd90 0x7f52080cf9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39446/0 (socket says 172.21.15.33:39446) 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f5207fff700 1 -- 172.21.15.33:0/1428309883 learned_addr learned my addr 172.21.15.33:0/1428309883 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520d426700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f52080cd420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.427+0000 7f520cc25700 1 --2- 172.21.15.33:0/1428309883 >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 0x7f52080ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 -- 172.21.15.33:0/1428309883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 msgr2=0x7f52080cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f52080cd420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 -- 172.21.15.33:0/1428309883 >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 msgr2=0x7f52080ce220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 --2- 172.21.15.33:0/1428309883 >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 0x7f52080ce220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 -- 172.21.15.33:0/1428309883 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52080ce900 con 0x7f52080cbd90 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520d426700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f52080cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520cc25700 1 --2- 172.21.15.33:0/1428309883 >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 0x7f52080ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f5207fff700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f52080cf9a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5208088e40 tx=0x7f51fc009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a0eb77fd0295072 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f52077fe700 1 -- 172.21.15.33:0/1428309883 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc005c10 con 0x7f52080cbd90 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f52077fe700 1 -- 172.21.15.33:0/1428309883 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51fc005d70 con 0x7f52080cbd90 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f52077fe700 1 -- 172.21.15.33:0/1428309883 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51fc00b880 con 0x7f52080cbd90 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 -- 172.21.15.33:0/1428309883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 msgr2=0x7f52080cf9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f52080cf9a0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f5208088e40 tx=0x7f51fc009220 comp rx=0 tx=0).stop 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 -- 172.21.15.33:0/1428309883 shutdown_connections 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 --2- 172.21.15.33:0/1428309883 >> v2:172.21.15.59:3300/0 conn(0x7f5208159860 0x7f52080ce220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f52080cd420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 --2- 172.21.15.33:0/1428309883 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f52080cf9a0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.428+0000 7f520ee89700 1 -- 172.21.15.33:0/1428309883 >> 172.21.15.33:0/1428309883 conn(0x7f52080999b0 msgr2=0x7f5208070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.429+0000 7f520ee89700 1 -- 172.21.15.33:0/1428309883 shutdown_connections 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.429+0000 7f520ee89700 1 -- 172.21.15.33:0/1428309883 wait complete. 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.430+0000 7f520ee89700 1 Processor -- start 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.430+0000 7f520ee89700 1 -- start start 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f520809ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.436 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 0x7f520809d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52080c9160 con 0x7f52080cbd90 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f520809e280 con 0x7f5208159860 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f520809d9e0 con 0x7f52080ccfa0 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39456/0 (socket says 172.21.15.33:39456) 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 -- 172.21.15.33:0/154080333 learned_addr learned my addr 172.21.15.33:0/154080333 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f5207fff700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f520809ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520d426700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 0x7f520809d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 -- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 msgr2=0x7f520809ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f520809ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 -- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 msgr2=0x7f520809d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 0x7f520809d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 -- 172.21.15.33:0/154080333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51fc009480 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520d426700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 0x7f520809d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520cc25700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f51f800d810 tx=0x7f51f8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f8005a00 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51f8005b60 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f520809dcc0 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51f80125f0 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.431+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52080b2db0 con 0x7f52080cbd90 2023-10-09T15:38:43.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.432+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52080c9440 con 0x7f52080cbd90 2023-10-09T15:38:43.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.433+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f51f80129e0 con 0x7f52080cbd90 2023-10-09T15:38:43.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.433+0000 7f5204ff9700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 0x7f51f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.433+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f51f80848d0 con 0x7f52080cbd90 2023-10-09T15:38:43.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.433+0000 7f5207fff700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 0x7f51f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.433+0000 7f5207fff700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 0x7f51f40697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f520809a850 tx=0x7f51fc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.437+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51f804d5a0 con 0x7f52080cbd90 2023-10-09T15:38:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.629+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f520804c3c0 con 0x7f52080cbd90 2023-10-09T15:38:43.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.629+0000 7f5204ff9700 1 -- 172.21.15.33:0/154080333 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) v1 ==== 93+0+10 (secure 0 0 0) 0x7f51f8051510 con 0x7f52080cbd90 2023-10-09T15:38:43.631 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 msgr2=0x7f51f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 0x7f51f40697d0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f520809a850 tx=0x7f51fc016000 comp rx=0 tx=0).stop 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 msgr2=0x7f5208158b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f51f800d810 tx=0x7f51f8008040 comp rx=0 tx=0).stop 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 shutdown_connections 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51f4067320 0x7f51f40697d0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f52080cbd90 0x7f5208158b90 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5208159860 0x7f520809d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.631+0000 7f520ee89700 1 --2- 172.21.15.33:0/154080333 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f52080ccfa0 0x7f520809ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.632+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 >> 172.21.15.33:0/154080333 conn(0x7f52080999b0 msgr2=0x7f52080b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.632+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 shutdown_connections 2023-10-09T15:38:43.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.632+0000 7f520ee89700 1 -- 172.21.15.33:0/154080333 wait complete. 2023-10-09T15:38:43.645 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000107790.meta pg_num 2023-10-09T15:38:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.766+0000 7faa2ebac700 1 Processor -- start 2023-10-09T15:38:43.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.766+0000 7faa2ebac700 1 -- start start 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2ebac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2815dfd0 0x7faa280aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2ebac700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa28159920 0x7faa280ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2ebac700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280acc00 con 0x7faa28159550 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2ebac700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280abff0 con 0x7faa28159920 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2ebac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280ac2d0 con 0x7faa2815dfd0 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2e3ab700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa28159920 0x7faa280ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2e3ab700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa28159920 0x7faa280ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39468/0 (socket says 172.21.15.33:39468) 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2e3ab700 1 -- 172.21.15.33:0/2735490026 learned_addr learned my addr 172.21.15.33:0/2735490026 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.767+0000 7faa2d3a9700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2815dfd0 0x7faa280aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2e3ab700 1 -- 172.21.15.33:0/2735490026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2815dfd0 msgr2=0x7faa280aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:43.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2e3ab700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2815dfd0 0x7faa280aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2e3ab700 1 -- 172.21.15.33:0/2735490026 >> v1:172.21.15.59:6789/0 conn(0x7faa28159550 legacy=0x7faa280ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2e3ab700 1 -- 172.21.15.33:0/2735490026 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280ac5b0 con 0x7faa28159920 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2e3ab700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa28159920 0x7faa280ad090 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7faa18009f20 tx=0x7faa18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49dfff907a8823a5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2cba8700 1 -- 172.21.15.33:0/2735490026 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800e070 con 0x7faa28159920 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2cba8700 1 -- 172.21.15.33:0/2735490026 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1800b9d0 con 0x7faa28159920 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2cba8700 1 -- 172.21.15.33:0/2735490026 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa180092e0 con 0x7faa28159920 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2ebac700 1 -- 172.21.15.33:0/2735490026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa28159920 msgr2=0x7faa280ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.768+0000 7faa2ebac700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa28159920 0x7faa280ad090 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7faa18009f20 tx=0x7faa18009840 comp rx=0 tx=0).stop 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 -- 172.21.15.33:0/2735490026 shutdown_connections 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa28159920 0x7faa280ad090 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 --2- 172.21.15.33:0/2735490026 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2815dfd0 0x7faa280aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 -- 172.21.15.33:0/2735490026 >> 172.21.15.33:0/2735490026 conn(0x7faa2806ce80 msgr2=0x7faa280ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 -- 172.21.15.33:0/2735490026 shutdown_connections 2023-10-09T15:38:43.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.769+0000 7faa2ebac700 1 -- 172.21.15.33:0/2735490026 wait complete. 2023-10-09T15:38:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 Processor -- start 2023-10-09T15:38:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 -- start start 2023-10-09T15:38:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa28159550 0x7faa281506a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa28159920 0x7faa2814ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa28150c80 con 0x7faa2815dfd0 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa280c86a0 con 0x7faa28159550 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.770+0000 7faa2ebac700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa280c8980 con 0x7faa28159920 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39474/0 (socket says 172.21.15.33:39474) 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 -- 172.21.15.33:0/1982981875 learned_addr learned my addr 172.21.15.33:0/1982981875 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2dbaa700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa28159550 0x7faa281506a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2d3a9700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa28159920 0x7faa2814ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 -- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa28159920 msgr2=0x7faa2814ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa28159920 0x7faa2814ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 -- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa28159550 msgr2=0x7faa281506a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa28159550 0x7faa281506a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 -- 172.21.15.33:0/1982981875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18009ae0 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2e3ab700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b610 tx=0x7faa18018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18008ad0 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa18008c30 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa280c8c60 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18026460 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.771+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa280c8340 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.772+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2804c3c0 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.773+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faa18003040 con 0x7faa2815dfd0 2023-10-09T15:38:43.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.773+0000 7faa25ffb700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 0x7faa140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.773+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7faa18086c90 con 0x7faa2815dfd0 2023-10-09T15:38:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.773+0000 7faa2dbaa700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 0x7faa140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:43.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.774+0000 7faa2dbaa700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 0x7faa140697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faa20003a80 tx=0x7faa20007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:43.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.778+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa180537c0 con 0x7faa2815dfd0 2023-10-09T15:38:43.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.969+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000107790.meta", "var": "pg_num"} v 0) v1 -- 0x7faa280afed0 con 0x7faa2815dfd0 2023-10-09T15:38:43.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.969+0000 7faa25ffb700 1 -- 172.21.15.33:0/1982981875 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000107790.meta", "var": "pg_num"}]=0 v143) v1 ==== 124+0+11 (secure 0 0 0) 0x7faa18056de0 con 0x7faa2815dfd0 2023-10-09T15:38:43.970 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:38:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 msgr2=0x7faa140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 0x7faa140697d0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7faa20003a80 tx=0x7faa20007ec0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 msgr2=0x7faa2806e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7faa1800b610 tx=0x7faa18018000 comp rx=0 tx=0).stop 2023-10-09T15:38:43.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 shutdown_connections 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa14067320 0x7faa140697d0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2815dfd0 0x7faa2806e9e0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa28159550 0x7faa281506a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 --2- 172.21.15.33:0/1982981875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa28159920 0x7faa2814ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 >> 172.21.15.33:0/1982981875 conn(0x7faa2806ce80 msgr2=0x7faa280b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 shutdown_connections 2023-10-09T15:38:43.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:43.971+0000 7faa2ebac700 1 -- 172.21.15.33:0/1982981875 wait complete. 2023-10-09T15:38:43.984 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000107790.data pg_num 2023-10-09T15:38:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 Processor -- start 2023-10-09T15:38:44.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 -- start start 2023-10-09T15:38:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efed00c9d30 0x7efed00ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 0x7efed015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efed006c6a0 con 0x7efed00a98f0 2023-10-09T15:38:44.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efed006cc60 con 0x7efed00c9d30 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.106+0000 7efed59da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed015dde0 con 0x7efed015d390 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efed00c9d30 0x7efed00ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7efed00c9d30 0x7efed00ca100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39476/0 (socket says 172.21.15.33:39476) 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 -- 172.21.15.33:0/3114517469 learned_addr learned my addr 172.21.15.33:0/3114517469 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efece7fc700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 0x7efed015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 -- 172.21.15.33:0/3114517469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 msgr2=0x7efed015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 0x7efed015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 -- 172.21.15.33:0/3114517469 >> v1:172.21.15.59:6789/0 conn(0x7efed00a98f0 legacy=0x7efed006d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 -- 172.21.15.33:0/3114517469 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efed015e0c0 con 0x7efed00c9d30 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efece7fc700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 0x7efed015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efeceffd700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00c9d30 0x7efed00ca100 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7efec00099b0 tx=0x7efec0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a5686ca83fe4b5b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efecdffb700 1 -- 172.21.15.33:0/3114517469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000b860 con 0x7efed00c9d30 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efecdffb700 1 -- 172.21.15.33:0/3114517469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec000b9c0 con 0x7efed00c9d30 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.107+0000 7efecdffb700 1 -- 172.21.15.33:0/3114517469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec000bd60 con 0x7efed00c9d30 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 -- 172.21.15.33:0/3114517469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00c9d30 msgr2=0x7efed00ca100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00c9d30 0x7efed00ca100 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7efec00099b0 tx=0x7efec0009250 comp rx=0 tx=0).stop 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 -- 172.21.15.33:0/3114517469 shutdown_connections 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00c9d30 0x7efed00ca100 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 --2- 172.21.15.33:0/3114517469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed015d390 0x7efed015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 -- 172.21.15.33:0/3114517469 >> 172.21.15.33:0/3114517469 conn(0x7efed00675a0 msgr2=0x7efed00679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 -- 172.21.15.33:0/3114517469 shutdown_connections 2023-10-09T15:38:44.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.108+0000 7efed59da700 1 -- 172.21.15.33:0/3114517469 wait complete. 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.109+0000 7efed59da700 1 Processor -- start 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.109+0000 7efed59da700 1 -- start start 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 0x7efed00cd3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 0x7efed00ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed0155f80 con 0x7efed00a98f0 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efed00ccf10 con 0x7efed015d390 2023-10-09T15:38:44.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efed00cd8e0 con 0x7efed00c9d30 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39492/0 (socket says 172.21.15.33:39492) 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 -- 172.21.15.33:0/3341740667 learned_addr learned my addr 172.21.15.33:0/3341740667 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efece7fc700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 0x7efed00cd3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efecf7fe700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 0x7efed00ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 -- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 msgr2=0x7efed00cd3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 0x7efed00cd3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 -- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 msgr2=0x7efed00ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 0x7efed00ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 -- 172.21.15.33:0/3341740667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efec00094f0 con 0x7efed00a98f0 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efecf7fe700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 0x7efed00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:44.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efece7fc700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 0x7efed00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeceffd700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0026480 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efec001f070 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.110+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efed00cc300 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.111+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efec0026830 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.111+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efed00cc8c0 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.111+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efed004c3c0 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.113+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7efec0026ba0 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.113+0000 7efeb6ffd700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 0x7efebc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.113+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7efec0021070 con 0x7efed00a98f0 2023-10-09T15:38:44.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.113+0000 7efece7fc700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 0x7efebc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.113+0000 7efece7fc700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 0x7efebc0697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efec4006f00 tx=0x7efec4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.116+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7efec0053dc0 con 0x7efed00a98f0 2023-10-09T15:38:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.313+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000107790.data", "var": "pg_num"} v 0) v1 -- 0x7efed00ca9e0 con 0x7efed00a98f0 2023-10-09T15:38:44.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.313+0000 7efeb6ffd700 1 -- 172.21.15.33:0/3341740667 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000107790.data", "var": "pg_num"}]=0 v143) v1 ==== 124+0+11 (secure 0 0 0) 0x7efec00573e0 con 0x7efed00a98f0 2023-10-09T15:38:44.314 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 msgr2=0x7efebc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 0x7efebc0697d0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7efec4006f00 tx=0x7efec4008040 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 msgr2=0x7efed0155a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7efec00090b0 tx=0x7efec0017000 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 shutdown_connections 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7efebc067320 0x7efebc0697d0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7efed00a98f0 0x7efed0155a40 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7efed015d390 0x7efed00ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 --2- 172.21.15.33:0/3341740667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7efed00c9d30 0x7efed00cd3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.315+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 >> 172.21.15.33:0/3341740667 conn(0x7efed00675a0 msgr2=0x7efed00abd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:44.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.316+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 shutdown_connections 2023-10-09T15:38:44.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.316+0000 7efed59da700 1 -- 172.21.15.33:0/3341740667 wait complete. 2023-10-09T15:38:44.329 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.447+0000 7f2a27d2c700 1 Processor -- start 2023-10-09T15:38:44.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.447+0000 7f2a27d2c700 1 -- start start 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a27d2c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2a200cb5a0 0x7f2a200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a27d2c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015ae40 con 0x7f2a200cd9e0 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a27d2c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2015ab60 con 0x7f2a2015a5d0 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a27d2c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a200d13f0 con 0x7f2a200cb5a0 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a25ac8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2a200cb5a0 0x7f2a200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a252c7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2a200cd9e0 0x7f2a20159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52640/0 (socket says 172.21.15.33:52640) 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a252c7700 1 -- 172.21.15.33:0/342410440 learned_addr learned my addr 172.21.15.33:0/342410440 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a25ac8700 1 -- 172.21.15.33:0/342410440 >> v1:172.21.15.59:6789/0 conn(0x7f2a2015a5d0 legacy=0x7f2a20156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a25ac8700 1 -- 172.21.15.33:0/342410440 >> v1:172.21.15.33:6789/0 conn(0x7f2a200cd9e0 legacy=0x7f2a20159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a25ac8700 1 -- 172.21.15.33:0/342410440 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a200ccf00 con 0x7f2a200cb5a0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a24ac6700 1 -- 172.21.15.33:0/342410440 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 943605230 0 0) 0x7f2a2015ae40 con 0x7f2a200cd9e0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a25ac8700 1 --2- 172.21.15.33:0/342410440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cb5a0 0x7f2a200cb970 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009910 tx=0x7f2a1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2db6127162462a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a24ac6700 1 -- 172.21.15.33:0/342410440 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00b7e0 con 0x7f2a200cb5a0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a24ac6700 1 -- 172.21.15.33:0/342410440 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a1c00b940 con 0x7f2a200cb5a0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.448+0000 7f2a24ac6700 1 -- 172.21.15.33:0/342410440 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c00bce0 con 0x7f2a200cb5a0 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 -- 172.21.15.33:0/342410440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cb5a0 msgr2=0x7f2a200cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/342410440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cb5a0 0x7f2a200cb970 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c009910 tx=0x7f2a1c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 -- 172.21.15.33:0/342410440 shutdown_connections 2023-10-09T15:38:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/342410440 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cb5a0 0x7f2a200cb970 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 -- 172.21.15.33:0/342410440 >> 172.21.15.33:0/342410440 conn(0x7f2a20070e30 msgr2=0x7f2a200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 -- 172.21.15.33:0/342410440 shutdown_connections 2023-10-09T15:38:44.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.449+0000 7f2a27d2c700 1 -- 172.21.15.33:0/342410440 wait complete. 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.450+0000 7f2a27d2c700 1 Processor -- start 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.450+0000 7f2a27d2c700 1 -- start start 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 0x7f2a20152820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 0x7f2a20155280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20158120 con 0x7f2a200cd9e0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20158f40 con 0x7f2a2015a5d0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a27d2c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a20158330 con 0x7f2a200cb5a0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39506/0 (socket says 172.21.15.33:39506) 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 -- 172.21.15.33:0/2326879655 learned_addr learned my addr 172.21.15.33:0/2326879655 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a25ac8700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 0x7f2a20152820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a262c9700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 0x7f2a20155280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 -- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 msgr2=0x7f2a20152820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 0x7f2a20152820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 -- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 msgr2=0x7f2a20155280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 0x7f2a20155280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 -- 172.21.15.33:0/2326879655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a1c009420 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a262c9700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 0x7f2a20155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a25ac8700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 0x7f2a20152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.451+0000 7f2a252c7700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c7e0 tx=0x7f2a10007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.452+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10005b30 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.452+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a10005c90 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.452+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a10007300 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.452+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a20158610 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.452+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a20158bd0 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.453+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2004c3c0 con 0x7f2a200cd9e0 2023-10-09T15:38:44.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.453+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2a1001b400 con 0x7f2a200cd9e0 2023-10-09T15:38:44.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.454+0000 7f2a15ffb700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 0x7f2a040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.454+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2a10084880 con 0x7f2a200cd9e0 2023-10-09T15:38:44.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.454+0000 7f2a25ac8700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 0x7f2a040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.454+0000 7f2a25ac8700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 0x7f2a040697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0030c0 tx=0x7f2a1c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.458+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2a10051500 con 0x7f2a200cd9e0 2023-10-09T15:38:44.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.697+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2a200cd1e0 con 0x7f2a200cd9e0 2023-10-09T15:38:44.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.697+0000 7f2a15ffb700 1 -- 172.21.15.33:0/2326879655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f2a10054b20 con 0x7f2a200cd9e0 2023-10-09T15:38:44.699 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:44.699 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:39.349472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000107790","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.699+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 msgr2=0x7f2a040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.699+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 0x7f2a040697d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0030c0 tx=0x7f2a1c016000 comp rx=0 tx=0).stop 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.699+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 msgr2=0x7f2a201593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.699+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000c7e0 tx=0x7f2a10007df0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 shutdown_connections 2023-10-09T15:38:44.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2a04067320 0x7f2a040697d0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2a2015a5d0 0x7f2a20155280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2a200cb5a0 0x7f2a20152820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 --2- 172.21.15.33:0/2326879655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2a200cd9e0 0x7f2a201593d0 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 >> 172.21.15.33:0/2326879655 conn(0x7f2a20070e30 msgr2=0x7f2a200b25c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 shutdown_connections 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.700+0000 7f2a27d2c700 1 -- 172.21.15.33:0/2326879655 wait complete. 2023-10-09T15:38:44.702 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 95 2023-10-09T15:38:44.713 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:44.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.830+0000 7fe8213cb700 1 Processor -- start 2023-10-09T15:38:44.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.830+0000 7fe8213cb700 1 -- start start 2023-10-09T15:38:44.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.831+0000 7fe8213cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.831+0000 7fe8213cb700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.831+0000 7fe8213cb700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe81c06c7d0 con 0x7fe81c143200 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.831+0000 7fe8213cb700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe81c1171e0 con 0x7fe81c15aa20 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.831+0000 7fe8213cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c0c37a0 con 0x7fe81c0c3250 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81affd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fe81c143200 0x7fe81c159dd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:50496/0 (socket says 172.21.15.33:50496) 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81affd700 1 -- 172.21.15.33:0/2377494271 learned_addr learned my addr 172.21.15.33:0/2377494271 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:44.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:54358/0 (socket says 172.21.15.33:54358) 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81b7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:45392/0 (socket says 172.21.15.33:45392) 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 -- 172.21.15.33:0/2377494271 >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 msgr2=0x7fe81c163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 --2- 172.21.15.33:0/2377494271 >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 -- 172.21.15.33:0/2377494271 >> v1:172.21.15.59:6789/0 conn(0x7fe81c143200 legacy=0x7fe81c159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 -- 172.21.15.33:0/2377494271 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe81c0cc090 con 0x7fe81c0c3250 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81b7fe700 1 --2- 172.21.15.33:0/2377494271 >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.832+0000 7fe81a7fc700 1 --2- 172.21.15.33:0/2377494271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8040098e0 tx=0x7fe8040091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cb5df45bdd36947 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe819ffb700 1 -- 172.21.15.33:0/2377494271 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400b640 con 0x7fe81c0c3250 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe819ffb700 1 -- 172.21.15.33:0/2377494271 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80400b7a0 con 0x7fe81c0c3250 2023-10-09T15:38:44.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe819ffb700 1 -- 172.21.15.33:0/2377494271 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80400bb40 con 0x7fe81c0c3250 2023-10-09T15:38:44.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 -- 172.21.15.33:0/2377494271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 msgr2=0x7fe81c15a4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 --2- 172.21.15.33:0/2377494271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe8040098e0 tx=0x7fe8040091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 -- 172.21.15.33:0/2377494271 shutdown_connections 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 --2- 172.21.15.33:0/2377494271 >> v2:172.21.15.59:3300/0 conn(0x7fe81c15aa20 0x7fe81c163430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 --2- 172.21.15.33:0/2377494271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c15a4e0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 -- 172.21.15.33:0/2377494271 >> 172.21.15.33:0/2377494271 conn(0x7fe81c0ccb60 msgr2=0x7fe81c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 -- 172.21.15.33:0/2377494271 shutdown_connections 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.833+0000 7fe8213cb700 1 -- 172.21.15.33:0/2377494271 wait complete. 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.834+0000 7fe8213cb700 1 Processor -- start 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 -- start start 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c12dc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 0x7fe81c0ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16acd0 con 0x7fe81c15aa20 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16a100 con 0x7fe81c143200 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe8213cb700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe81c16a3a0 con 0x7fe81c0c3250 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe81b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39520/0 (socket says 172.21.15.33:39520) 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.835+0000 7fe81b7fe700 1 -- 172.21.15.33:0/835338237 learned_addr learned my addr 172.21.15.33:0/835338237 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81a7fc700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 0x7fe81c0ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81affd700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c12dc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 -- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 msgr2=0x7fe81c12dc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c12dc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 -- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 msgr2=0x7fe81c0ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:44.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 0x7fe81c0ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 -- 172.21.15.33:0/835338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe80c009a20 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81a7fc700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 0x7fe81c0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe81b7fe700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009f20 tx=0x7fe80c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c00cbd0 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe80c00f040 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe804009420 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe80c014480 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.836+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe81c16a960 con 0x7fe81c15aa20 2023-10-09T15:38:44.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.837+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe81c16ae40 con 0x7fe81c15aa20 2023-10-09T15:38:44.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.838+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe80c003020 con 0x7fe81c15aa20 2023-10-09T15:38:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.838+0000 7fe812ffd700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 0x7fe7fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.838+0000 7fe81affd700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 0x7fe7fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.838+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe80c085750 con 0x7fe81c15aa20 2023-10-09T15:38:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.839+0000 7fe81affd700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 0x7fe7fc0697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe814007fd0 tx=0x7fe814009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:44.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:44.843+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe80c0522a0 con 0x7fe81c15aa20 2023-10-09T15:38:45.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.037+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe81c04c3c0 con 0x7fe81c15aa20 2023-10-09T15:38:45.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.037+0000 7fe812ffd700 1 -- 172.21.15.33:0/835338237 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fe80c0558c0 con 0x7fe81c15aa20 2023-10-09T15:38:45.039 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:45.039 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":143,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:41.359545+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000107790.meta","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000107790"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000107790.data","create_time":"2023-10-09T15:38:22.667405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000107790"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:45.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 msgr2=0x7fe7fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 0x7fe7fc0697d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fe814007fd0 tx=0x7fe814009040 comp rx=0 tx=0).stop 2023-10-09T15:38:45.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 msgr2=0x7fe81c0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7fe80c009f20 tx=0x7fe80c00b040 comp rx=0 tx=0).stop 2023-10-09T15:38:45.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 shutdown_connections 2023-10-09T15:38:45.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe7fc067320 0x7fe7fc0697d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe81c15aa20 0x7fe81c0caa70 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe81c0c3250 0x7fe81c12dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 --2- 172.21.15.33:0/835338237 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe81c143200 0x7fe81c0ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.039+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 >> 172.21.15.33:0/835338237 conn(0x7fe81c0ccb60 msgr2=0x7fe81c13edb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.040+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 shutdown_connections 2023-10-09T15:38:45.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.040+0000 7fe8213cb700 1 -- 172.21.15.33:0/835338237 wait complete. 2023-10-09T15:38:45.053 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000107790 and related pools 2023-10-09T15:38:45.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:45.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 Processor -- start 2023-10-09T15:38:45.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 -- start start 2023-10-09T15:38:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f97ec0cb5a0 0x7f97ec0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec15ae40 con 0x7f97ec0cd9e0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97ec15ab60 con 0x7f97ec15a5d0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.172+0000 7f97f2174700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97ec0d13f0 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eaffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f97ec0cd9e0 0x7f97ec159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52644/0 (socket says 172.21.15.33:52644) 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eaffd700 1 -- 172.21.15.33:0/2092917378 learned_addr learned my addr 172.21.15.33:0/2092917378 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eb7fe700 1 --2- 172.21.15.33:0/2092917378 >> v2:172.21.15.59:3300/0 conn(0x7f97ec0cb5a0 0x7f97ec0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1019050193 0 0) 0x7f97ec15ae40 con 0x7f97ec0cd9e0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97d4003570 con 0x7f97ec0cd9e0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 860083749 0 0) 0x7f97ec15ab60 con 0x7f97ec15a5d0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f97ec15ae40 con 0x7f97ec15a5d0 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eb7fe700 1 -- 172.21.15.33:0/2092917378 >> v1:172.21.15.59:6789/0 conn(0x7f97ec15a5d0 legacy=0x7f97ec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eb7fe700 1 -- 172.21.15.33:0/2092917378 >> v1:172.21.15.33:6789/0 conn(0x7f97ec0cd9e0 legacy=0x7f97ec159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3895800534 0 0) 0x7f97d4003570 con 0x7f97ec0cd9e0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eb7fe700 1 -- 172.21.15.33:0/2092917378 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97ec0ccf00 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.173+0000 7f97eb7fe700 1 --2- 172.21.15.33:0/2092917378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cb5a0 0x7f97ec0cb970 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009910 tx=0x7f97dc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5fb88a169a03186f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e0001470 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc011420 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97ea7fc700 1 -- 172.21.15.33:0/2092917378 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0117c0 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 -- 172.21.15.33:0/2092917378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cb5a0 msgr2=0x7f97ec0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 --2- 172.21.15.33:0/2092917378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cb5a0 0x7f97ec0cb970 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f97dc009910 tx=0x7f97dc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 -- 172.21.15.33:0/2092917378 shutdown_connections 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 --2- 172.21.15.33:0/2092917378 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cb5a0 0x7f97ec0cb970 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 -- 172.21.15.33:0/2092917378 >> 172.21.15.33:0/2092917378 conn(0x7f97ec070e30 msgr2=0x7f97ec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 -- 172.21.15.33:0/2092917378 shutdown_connections 2023-10-09T15:38:45.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.174+0000 7f97f2174700 1 -- 172.21.15.33:0/2092917378 wait complete. 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.175+0000 7f97f2174700 1 Processor -- start 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.175+0000 7f97f2174700 1 -- start start 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97ec0cb5a0 0x7f97ec159610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cd9e0 0x7f97ec14ff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec153310 con 0x7f97ec15a5d0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1524d0 con 0x7f97ec0cd9e0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97f2174700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97ec1577a0 con 0x7f97ec0cb5a0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97ebfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39530/0 (socket says 172.21.15.33:39530) 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97ebfff700 1 -- 172.21.15.33:0/424433430 learned_addr learned my addr 172.21.15.33:0/424433430 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97eb7fe700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97ec0cb5a0 0x7f97ec159610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.176+0000 7f97eaffd700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cd9e0 0x7f97ec14ff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 -- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97ec0cb5a0 msgr2=0x7f97ec159610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97ec0cb5a0 0x7f97ec159610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 -- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cd9e0 msgr2=0x7f97ec14ff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cd9e0 0x7f97ec14ff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 -- 172.21.15.33:0/424433430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009420 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97ebfff700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c860 tx=0x7f97e4002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4002030 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97e40021b0 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97ec157a40 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97e4012630 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.177+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec1537a0 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.178+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97ec153a80 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.178+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97e4012a20 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.179+0000 7f97d37fe700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 0x7f97d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.179+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f97e4084d60 con 0x7f97ec15a5d0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.179+0000 7f97eb7fe700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 0x7f97d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.179+0000 7f97eb7fe700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 0x7f97d80697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0093f0 tx=0x7f97dc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.183+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97e40519a0 con 0x7f97ec15a5d0 2023-10-09T15:38:45.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.420+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97ec04c3c0 con 0x7f97ec15a5d0 2023-10-09T15:38:45.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.421+0000 7f97d37fe700 1 -- 172.21.15.33:0/424433430 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f97e4054fc0 con 0x7f97ec15a5d0 2023-10-09T15:38:45.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:45.422 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:39.349472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000107790","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 msgr2=0x7f97d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 0x7f97d80697d0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f97dc0093f0 tx=0x7f97dc016000 comp rx=0 tx=0).stop 2023-10-09T15:38:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 msgr2=0x7f97ec151dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f97e400c860 tx=0x7f97e4002700 comp rx=0 tx=0).stop 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 shutdown_connections 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97d8067320 0x7f97d80697d0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f97ec15a5d0 0x7f97ec151dd0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f97ec0cb5a0 0x7f97ec159610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 --2- 172.21.15.33:0/424433430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f97ec0cd9e0 0x7f97ec14ff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 >> 172.21.15.33:0/424433430 conn(0x7f97ec070e30 msgr2=0x7f97ec0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 shutdown_connections 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.423+0000 7f97f2174700 1 -- 172.21.15.33:0/424433430 wait complete. 2023-10-09T15:38:45.425 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 95 2023-10-09T15:38:45.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.554+0000 7f8e860ba700 1 Processor -- start 2023-10-09T15:38:45.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.554+0000 7f8e860ba700 1 -- start start 2023-10-09T15:38:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e860ba700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e801595d0 0x7f8e801599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e860ba700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8e800675a0 0x7f8e8006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e860ba700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e800c7f50 con 0x7f8e8006b230 2023-10-09T15:38:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e860ba700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006bd00 con 0x7f8e801595d0 2023-10-09T15:38:45.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e860ba700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e8006b740 con 0x7f8e800675a0 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e7f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e801595d0 0x7f8e801599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e7f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e801595d0 0x7f8e801599a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39532/0 (socket says 172.21.15.33:39532) 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.555+0000 7f8e7f7fe700 1 -- 172.21.15.33:0/448888002 learned_addr learned my addr 172.21.15.33:0/448888002 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7effd700 1 --2- 172.21.15.33:0/448888002 >> v2:172.21.15.59:3300/0 conn(0x7f8e800675a0 0x7f8e8006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7f7fe700 1 -- 172.21.15.33:0/448888002 >> v2:172.21.15.59:3300/0 conn(0x7f8e800675a0 msgr2=0x7f8e8006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7f7fe700 1 --2- 172.21.15.33:0/448888002 >> v2:172.21.15.59:3300/0 conn(0x7f8e800675a0 0x7f8e8006acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7f7fe700 1 -- 172.21.15.33:0/448888002 >> v1:172.21.15.59:6789/0 conn(0x7f8e8006b230 legacy=0x7f8e800c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7f7fe700 1 -- 172.21.15.33:0/448888002 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e8006ba20 con 0x7f8e801595d0 2023-10-09T15:38:45.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7f7fe700 1 --2- 172.21.15.33:0/448888002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e801595d0 0x7f8e801599a0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8e800ce450 tx=0x7f8e70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3ebc22206813fc1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7e7fc700 1 -- 172.21.15.33:0/448888002 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000b820 con 0x7f8e801595d0 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7e7fc700 1 -- 172.21.15.33:0/448888002 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e7000b980 con 0x7f8e801595d0 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e7e7fc700 1 -- 172.21.15.33:0/448888002 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e7000bd20 con 0x7f8e801595d0 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e860ba700 1 -- 172.21.15.33:0/448888002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e801595d0 msgr2=0x7f8e801599a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.556+0000 7f8e860ba700 1 --2- 172.21.15.33:0/448888002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e801595d0 0x7f8e801599a0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7f8e800ce450 tx=0x7f8e70009250 comp rx=0 tx=0).stop 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 -- 172.21.15.33:0/448888002 shutdown_connections 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 --2- 172.21.15.33:0/448888002 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e801595d0 0x7f8e801599a0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 --2- 172.21.15.33:0/448888002 >> v2:172.21.15.59:3300/0 conn(0x7f8e800675a0 0x7f8e8006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 -- 172.21.15.33:0/448888002 >> 172.21.15.33:0/448888002 conn(0x7f8e800cd400 msgr2=0x7f8e800cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 -- 172.21.15.33:0/448888002 shutdown_connections 2023-10-09T15:38:45.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.557+0000 7f8e860ba700 1 -- 172.21.15.33:0/448888002 wait complete. 2023-10-09T15:38:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.558+0000 7f8e860ba700 1 Processor -- start 2023-10-09T15:38:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.558+0000 7f8e860ba700 1 -- start start 2023-10-09T15:38:45.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e800675a0 0x7f8e8016bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e801595d0 0x7f8e800b2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8016c6d0 con 0x7f8e8006b230 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8016c9b0 con 0x7f8e801595d0 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8016cc90 con 0x7f8e800675a0 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39538/0 (socket says 172.21.15.33:39538) 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 -- 172.21.15.33:0/1722754794 learned_addr learned my addr 172.21.15.33:0/1722754794 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7f7fe700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e800675a0 0x7f8e8016bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7ffff700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e801595d0 0x7f8e800b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 -- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e800675a0 msgr2=0x7f8e8016bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e800675a0 0x7f8e8016bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 -- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e801595d0 msgr2=0x7f8e800b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e801595d0 0x7f8e800b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 -- 172.21.15.33:0/1722754794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e700094f0 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e7effd700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c880 tx=0x7f8e74008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74011600 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e74011760 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e800b2080 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e74011b20 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.559+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e8016c310 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.560+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e8004c3c0 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.561+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8e74018360 con 0x7f8e8006b230 2023-10-09T15:38:45.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.561+0000 7f8e677fe700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 0x7f8e6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.561+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f8e74084cd0 con 0x7f8e8006b230 2023-10-09T15:38:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.561+0000 7f8e7f7fe700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 0x7f8e6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.562+0000 7f8e7f7fe700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 0x7f8e6c0697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8e800ce450 tx=0x7f8e70016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.565+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e74051800 con 0x7f8e8006b230 2023-10-09T15:38:45.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.802+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8e800c7be0 con 0x7f8e8006b230 2023-10-09T15:38:45.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.803+0000 7f8e677fe700 1 -- 172.21.15.33:0/1722754794 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) v1 ==== 94+0+4609 (secure 0 0 0) 0x7f8e74015090 con 0x7f8e8006b230 2023-10-09T15:38:45.804 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:45.804 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":95,"default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88}],"filesystems":[{"mdsmap":{"epoch":95,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:23.691735+0000","modified":"2023-10-09T15:38:39.349472+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7533},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7533":{"gid":7533,"name":"a","rank":0,"incarnation":89,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6836/859677101","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":859677101},{"type":"v1","addr":"172.21.15.33:6836","nonce":859677101}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"volume_0000000000107790","balancer":"","standby_count_wanted":0},"id":12}]} 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 msgr2=0x7f8e6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 0x7f8e6c0697d0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8e800ce450 tx=0x7f8e70016000 comp rx=0 tx=0).stop 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 msgr2=0x7f8e80155a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f8e7400c880 tx=0x7f8e74008040 comp rx=0 tx=0).stop 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 shutdown_connections 2023-10-09T15:38:45.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e6c067320 0x7f8e6c0697d0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e801595d0 0x7f8e800b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e800675a0 0x7f8e8016bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 --2- 172.21.15.33:0/1722754794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e8006b230 0x7f8e80155a70 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 >> 172.21.15.33:0/1722754794 conn(0x7f8e800cd400 msgr2=0x7f8e8006c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 shutdown_connections 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.805+0000 7f8e860ba700 1 -- 172.21.15.33:0/1722754794 wait complete. 2023-10-09T15:38:45.808 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 95 2023-10-09T15:38:45.818 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:45.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 Processor -- start 2023-10-09T15:38:45.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 -- start start 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e80ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0e80cf200 0x7fe0e80cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 0x7fe0e806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e815a280 con 0x7fe0e80cf200 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0e806e180 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.936+0000 7fe0ee459700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80cd540 con 0x7fe0e80b07d0 2023-10-09T15:38:45.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0e80cf200 0x7fe0e80cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe0e80cf200 0x7fe0e80cd000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39542/0 (socket says 172.21.15.33:39542) 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 -- 172.21.15.33:0/4066197670 learned_addr learned my addr 172.21.15.33:0/4066197670 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0ec9f6700 1 --2- 172.21.15.33:0/4066197670 >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 0x7fe0e806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e7fff700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e80ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 -- 172.21.15.33:0/4066197670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 msgr2=0x7fe0e80ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e80ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 -- 172.21.15.33:0/4066197670 >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 msgr2=0x7fe0e806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/4066197670 >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 0x7fe0e806e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 -- 172.21.15.33:0/4066197670 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e806d850 con 0x7fe0e80cf200 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0ec9f6700 1 --2- 172.21.15.33:0/4066197670 >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 0x7fe0e806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:45.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80cf200 0x7fe0e80cd000 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80c8ae0 tx=0x7fe0d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae2ce49751f65a25 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e6ffd700 1 -- 172.21.15.33:0/4066197670 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800b8f0 con 0x7fe0e80cf200 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e6ffd700 1 -- 172.21.15.33:0/4066197670 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d800ba50 con 0x7fe0e80cf200 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.937+0000 7fe0e6ffd700 1 -- 172.21.15.33:0/4066197670 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d800bdf0 con 0x7fe0e80cf200 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 -- 172.21.15.33:0/4066197670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80cf200 msgr2=0x7fe0e80cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80cf200 0x7fe0e80cd000 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fe0e80c8ae0 tx=0x7fe0d8009250 comp rx=0 tx=0).stop 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 -- 172.21.15.33:0/4066197670 shutdown_connections 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 --2- 172.21.15.33:0/4066197670 >> v2:172.21.15.59:3300/0 conn(0x7fe0e80b0ba0 0x7fe0e806e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e80ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 --2- 172.21.15.33:0/4066197670 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80cf200 0x7fe0e80cd000 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 -- 172.21.15.33:0/4066197670 >> 172.21.15.33:0/4066197670 conn(0x7fe0e806ce80 msgr2=0x7fe0e80ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 -- 172.21.15.33:0/4066197670 shutdown_connections 2023-10-09T15:38:45.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.938+0000 7fe0ee459700 1 -- 172.21.15.33:0/4066197670 wait complete. 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.939+0000 7fe0ee459700 1 Processor -- start 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.939+0000 7fe0ee459700 1 -- start start 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e8150fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0e80cf200 0x7fe0e8152180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c7160 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c7440 con 0x7fe0e80cf200 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0ee459700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0e80c7720 con 0x7fe0e80b07d0 2023-10-09T15:38:45.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39548/0 (socket says 172.21.15.33:39548) 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 -- 172.21.15.33:0/1130912360 learned_addr learned my addr 172.21.15.33:0/1130912360 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e7fff700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e8150fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 -- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 msgr2=0x7fe0e8150fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e8150fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 -- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0e80cf200 msgr2=0x7fe0e8152180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0e80cf200 0x7fe0e8152180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.940+0000 7fe0e77fe700 1 -- 172.21.15.33:0/1130912360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0d80094f0 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0e77fe700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe0e806af10 tx=0x7fe0d8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d8011e60 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0d801a630 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0e80c7a00 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0d801a9f0 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.941+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0e80c6510 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.942+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0e804c3c0 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.942+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe0d80233e0 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.943+0000 7fe0dffff700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 0x7fe0c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.943+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fe0d8086770 con 0x7fe0e80b0ba0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.943+0000 7fe0e7fff700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 0x7fe0c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:45.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.943+0000 7fe0e7fff700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 0x7fe0c80697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009970 tx=0x7fe0d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:45.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:45.947+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe0d80533d0 con 0x7fe0e80b0ba0 2023-10-09T15:38:46.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.141+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe0e806db30 con 0x7fe0e80b0ba0 2023-10-09T15:38:46.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.142+0000 7fe0dffff700 1 -- 172.21.15.33:0/1130912360 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fe0d80569f0 con 0x7fe0e80b0ba0 2023-10-09T15:38:46.143 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:46.143 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":143,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:41.359545+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":24,"pool_name":"cephfs.volume_0000000000107790.meta","create_time":"2023-10-09T15:38:21.698407+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000107790"}}},{"pool":25,"pool_name":"cephfs.volume_0000000000107790.data","create_time":"2023-10-09T15:38:22.667405+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000107790"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.143+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 msgr2=0x7fe0c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 0x7fe0c80697d0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7fe0d0009970 tx=0x7fe0d0008040 comp rx=0 tx=0).stop 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 msgr2=0x7fe0e80c5fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7fe0e806af10 tx=0x7fe0d8017000 comp rx=0 tx=0).stop 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 shutdown_connections 2023-10-09T15:38:46.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe0c8067320 0x7fe0c80697d0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe0e80cf200 0x7fe0e8152180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe0e80b07d0 0x7fe0e8150fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 --2- 172.21.15.33:0/1130912360 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe0e80b0ba0 0x7fe0e80c5fd0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 >> 172.21.15.33:0/1130912360 conn(0x7fe0e806ce80 msgr2=0x7fe0e80c9400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 shutdown_connections 2023-10-09T15:38:46.146 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.144+0000 7fe0ee459700 1 -- 172.21.15.33:0/1130912360 wait complete. 2023-10-09T15:38:46.157 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000107790 2023-10-09T15:38:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.277+0000 7f76d57db700 1 Processor -- start 2023-10-09T15:38:46.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.277+0000 7f76d57db700 1 -- start start 2023-10-09T15:38:46.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.277+0000 7f76d57db700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f76d0159c20 0x7f76d00b0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76d57db700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00adb20 con 0x7f76d00b0e70 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76d57db700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00b12b0 con 0x7f76d0159850 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76d57db700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00ccdc0 con 0x7f76d0159c20 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cf7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f76d00b0e70 0x7f76d00c93e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52648/0 (socket says 172.21.15.33:52648) 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cf7fe700 1 -- 172.21.15.33:0/4001275340 learned_addr learned my addr 172.21.15.33:0/4001275340 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76ce7fc700 1 --2- 172.21.15.33:0/4001275340 >> v2:172.21.15.59:3300/0 conn(0x7f76d0159c20 0x7f76d00b0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331409774 0 0) 0x7f76d00adb20 con 0x7f76d00b0e70 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76b8003570 con 0x7f76d00b0e70 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2922382443 0 0) 0x7f76d00b12b0 con 0x7f76d0159850 2023-10-09T15:38:46.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f76d00adb20 con 0x7f76d0159850 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76ce7fc700 1 -- 172.21.15.33:0/4001275340 >> v1:172.21.15.59:6789/0 conn(0x7f76d0159850 legacy=0x7f76d00adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76ce7fc700 1 -- 172.21.15.33:0/4001275340 >> v1:172.21.15.33:6789/0 conn(0x7f76d00b0e70 legacy=0x7f76d00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76ce7fc700 1 -- 172.21.15.33:0/4001275340 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00acf10 con 0x7f76d0159c20 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.278+0000 7f76ce7fc700 1 --2- 172.21.15.33:0/4001275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d00b0930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098e0 tx=0x7f76c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d479c9ad3d6b7f17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4011630 con 0x7f76d0159c20 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4011790 con 0x7f76d0159c20 2023-10-09T15:38:46.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76cdffb700 1 -- 172.21.15.33:0/4001275340 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4011b30 con 0x7f76d0159c20 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 -- 172.21.15.33:0/4001275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 msgr2=0x7f76d00b0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 --2- 172.21.15.33:0/4001275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d00b0930 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098e0 tx=0x7f76c40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 -- 172.21.15.33:0/4001275340 shutdown_connections 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 --2- 172.21.15.33:0/4001275340 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d00b0930 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 -- 172.21.15.33:0/4001275340 >> 172.21.15.33:0/4001275340 conn(0x7f76d006d170 msgr2=0x7f76d00cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 -- 172.21.15.33:0/4001275340 shutdown_connections 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.279+0000 7f76d57db700 1 -- 172.21.15.33:0/4001275340 wait complete. 2023-10-09T15:38:46.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.280+0000 7f76d57db700 1 Processor -- start 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.280+0000 7f76d57db700 1 -- start start 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00b0e70 0x7f76d014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d0150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d0151830 con 0x7f76d0159850 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d014fca0 con 0x7f76d0159c20 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76d57db700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d014ff80 con 0x7f76d00b0e70 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76ce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76ce7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39564/0 (socket says 172.21.15.33:39564) 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.281+0000 7f76ce7fc700 1 -- 172.21.15.33:0/916757655 learned_addr learned my addr 172.21.15.33:0/916757655 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ceffd700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00b0e70 0x7f76d014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76cf7fe700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d0150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 -- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00b0e70 msgr2=0x7f76d014cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00b0e70 0x7f76d014cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 -- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 msgr2=0x7f76d0150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d0150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 -- 172.21.15.33:0/916757655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c4009420 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76cf7fe700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d0150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76ce7fc700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b1440 tx=0x7f76c4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c401f070 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c4000bc0 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4025420 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d0150260 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.282+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d0150820 con 0x7f76d0159850 2023-10-09T15:38:46.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.283+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d004c3c0 con 0x7f76d0159850 2023-10-09T15:38:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.283+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f76c4023070 con 0x7f76d0159850 2023-10-09T15:38:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.284+0000 7f76b6ffd700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.284+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f76c4086040 con 0x7f76d0159850 2023-10-09T15:38:46.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.284+0000 7f76ceffd700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.284+0000 7f76ceffd700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f76c0003870 tx=0x7f76c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.288+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76c40b75a0 con 0x7f76d0159850 2023-10-09T15:38:46.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.529+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000107790"} v 0) v1 -- 0x7f76d00ad1f0 con 0x7f76d0159850 2023-10-09T15:38:46.530 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:38:46.529+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:38:46.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.534+0000 7f76b6ffd700 1 -- 172.21.15.33:0/916757655 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000107790"}]=0 volume_0000000000107790 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v96) v1 ==== 195+0+0 (secure 0 0 0) 0x7f76c402a0a0 con 0x7f76d0159850 2023-10-09T15:38:46.535 INFO:tasks.ceph.mds.a.smithi033.stderr: -851> 2023-10-09T15:38:29.195+0000 7f3c43791700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 msgr2=0x7f76bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f76c0003870 tx=0x7f76c0009040 comp rx=0 tx=0).stop 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 msgr2=0x7f76d01544c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f76d00b1440 tx=0x7f76c4017000 comp rx=0 tx=0).stop 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 shutdown_connections 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.536+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159c20 0x7f76d0150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.537+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00b0e70 0x7f76d014cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.537+0000 7f76d57db700 1 --2- 172.21.15.33:0/916757655 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d0159850 0x7f76d01544c0 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.537+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 >> 172.21.15.33:0/916757655 conn(0x7f76d006d170 msgr2=0x7f76d00af5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.537+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 shutdown_connections 2023-10-09T15:38:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.537+0000 7f76d57db700 1 -- 172.21.15.33:0/916757655 wait complete. 2023-10-09T15:38:46.539 INFO:teuthology.orchestra.run.smithi033.stderr:volume_0000000000107790 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:38:46.550 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000107790 --yes-i-really-mean-it 2023-10-09T15:38:46.556 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:38:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 Processor -- start 2023-10-09T15:38:46.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 -- start start 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c15b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 0x7f3d1c157000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d1c0c9160 0x7f3d1c157540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0cc2e0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d1c0cce60 con 0x7f3d1c06a3e0 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.671+0000 7f3d20948700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0cc530 con 0x7f3d1c0c8d90 2023-10-09T15:38:46.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d1c0c9160 0x7f3d1c157540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d1c0c9160 0x7f3d1c157540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39578/0 (socket says 172.21.15.33:39578) 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/781869255 learned_addr learned my addr 172.21.15.33:0/781869255 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1a59c700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c15b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d11d9b700 1 --2- 172.21.15.33:0/781869255 >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 0x7f3d1c157000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/781869255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 msgr2=0x7f3d1c15b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c15b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/781869255 >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 msgr2=0x7f3d1c157000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/781869255 >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 0x7f3d1c157000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/781869255 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d1c0cc810 con 0x7f3d1c0c9160 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1a59c700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d11d9b700 1 --2- 172.21.15.33:0/781869255 >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 0x7f3d1c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:46.675 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c157540 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06bb70 tx=0x7f3d14009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdffdfbedb7940e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d19d9b700 1 -- 172.21.15.33:0/781869255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1400e070 con 0x7f3d1c0c9160 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d19d9b700 1 -- 172.21.15.33:0/781869255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1400ba50 con 0x7f3d1c0c9160 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.672+0000 7f3d19d9b700 1 -- 172.21.15.33:0/781869255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140092e0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 -- 172.21.15.33:0/781869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 msgr2=0x7f3d1c157540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c157540 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c06bb70 tx=0x7f3d14009840 comp rx=0 tx=0).stop 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 -- 172.21.15.33:0/781869255 shutdown_connections 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c157540 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 --2- 172.21.15.33:0/781869255 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c15b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 --2- 172.21.15.33:0/781869255 >> v2:172.21.15.59:3300/0 conn(0x7f3d1c06a3e0 0x7f3d1c157000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 -- 172.21.15.33:0/781869255 >> 172.21.15.33:0/781869255 conn(0x7f3d1c067f00 msgr2=0x7f3d1c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 -- 172.21.15.33:0/781869255 shutdown_connections 2023-10-09T15:38:46.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.673+0000 7f3d20948700 1 -- 172.21.15.33:0/781869255 wait complete. 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.674+0000 7f3d20948700 1 Processor -- start 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.674+0000 7f3d20948700 1 -- start start 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d1c06a3e0 0x7f3d1c15a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c0b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c0b2090 con 0x7f3d1c0c9160 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c158b70 con 0x7f3d1c06a3e0 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d20948700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d1c158890 con 0x7f3d1c0c8d90 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39592/0 (socket says 172.21.15.33:39592) 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/3924429636 learned_addr learned my addr 172.21.15.33:0/3924429636 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d11d9b700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c0b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1a59c700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d1c06a3e0 0x7f3d1c15a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 msgr2=0x7f3d1c0b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c0b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d1c06a3e0 msgr2=0x7f3d1c15a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d1c06a3e0 0x7f3d1c15a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:46.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d1ad9d700 1 -- 172.21.15.33:0/3924429636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d14009ae0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.675+0000 7f3d11d9b700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d1ad9d700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009fd0 tx=0x7f3d14018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140032f0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d14008e40 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d1c0b1a40 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d140256b0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.676+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d1c15a8e0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.677+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d1c0b2200 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.677+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3d14003040 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.677+0000 7f3d12ffd700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.678+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f3d14086aa0 con 0x7f3d1c0c9160 2023-10-09T15:38:46.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.678+0000 7f3d1a59c700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:46.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.678+0000 7f3d1a59c700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 0x7f3cfc0697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c006fd0 tx=0x7f3d0c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:46.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.682+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d14053580 con 0x7f3d1c0c9160 2023-10-09T15:38:46.921 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:46.920+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000107790", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f3d1c04c3c0 con 0x7f3d1c0c9160 2023-10-09T15:38:47.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.545+0000 7f3d12ffd700 1 -- 172.21.15.33:0/3924429636 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000107790", "yes_i_really_mean_it": true}]=0 v97) v1 ==== 121+0+0 (secure 0 0 0) 0x7f3d14056ba0 con 0x7f3d1c0c9160 2023-10-09T15:38:47.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.548+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 msgr2=0x7f3cfc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.548+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 0x7f3cfc0697d0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3d0c006fd0 tx=0x7f3d0c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.548+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 msgr2=0x7f3d1c150d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.548+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f3d14009fd0 tx=0x7f3d14018000 comp rx=0 tx=0).stop 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 shutdown_connections 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3cfc067320 0x7f3cfc0697d0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d1c0c9160 0x7f3d1c150d30 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d1c06a3e0 0x7f3d1c15a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 --2- 172.21.15.33:0/3924429636 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d1c0c8d90 0x7f3d1c0b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 >> 172.21.15.33:0/3924429636 conn(0x7f3d1c067f00 msgr2=0x7f3d1c14bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 shutdown_connections 2023-10-09T15:38:47.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.549+0000 7f3d20948700 1 -- 172.21.15.33:0/3924429636 wait complete. 2023-10-09T15:38:47.566 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000107790.meta cephfs.volume_0000000000107790.meta --yes-i-really-really-mean-it 2023-10-09T15:38:47.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.734+0000 7fa3b6eb4700 1 Processor -- start 2023-10-09T15:38:47.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.734+0000 7fa3b6eb4700 1 -- start start 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b6eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b015de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b6eb4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa3b0068220 0x7fa3b0159dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b6eb4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b015d9f0 con 0x7fa3b015a300 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b6eb4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b015d3c0 con 0x7fa3b0068220 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b6eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b015a8f0 con 0x7fa3b0067e50 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa3b0068220 0x7fa3b0159dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b5451700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa3b015a300 0x7fa3b00c8c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52652/0 (socket says 172.21.15.33:52652) 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b5451700 1 -- 172.21.15.33:0/1470557607 learned_addr learned my addr 172.21.15.33:0/1470557607 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:47.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3b4c50700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b015de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 -- 172.21.15.33:0/1470557607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 msgr2=0x7fa3b015de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b015de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 -- 172.21.15.33:0/1470557607 >> v1:172.21.15.33:6789/0 conn(0x7fa3b015a300 legacy=0x7fa3b00c8c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 -- 172.21.15.33:0/1470557607 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b015abd0 con 0x7fa3b0068220 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3af7fe700 1 -- 172.21.15.33:0/1470557607 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 563692197 0 0) 0x7fa3b015d9f0 con 0x7fa3b015a300 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.735+0000 7fa3affff700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b0068220 0x7fa3b0159dc0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40098e0 tx=0x7fa3a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4139fa7586246f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3af7fe700 1 -- 172.21.15.33:0/1470557607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a4009e80 con 0x7fa3b0068220 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3af7fe700 1 -- 172.21.15.33:0/1470557607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a400b860 con 0x7fa3b0068220 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3af7fe700 1 -- 172.21.15.33:0/1470557607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a400bbe0 con 0x7fa3b0068220 2023-10-09T15:38:47.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/1470557607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b0068220 msgr2=0x7fa3b0159dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b0068220 0x7fa3b0159dc0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7fa3a40098e0 tx=0x7fa3a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/1470557607 shutdown_connections 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b015de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/1470557607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b0068220 0x7fa3b0159dc0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/1470557607 >> 172.21.15.33:0/1470557607 conn(0x7fa3b00ce4a0 msgr2=0x7fa3b00ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/1470557607 shutdown_connections 2023-10-09T15:38:47.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.736+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/1470557607 wait complete. 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.737+0000 7fa3b6eb4700 1 Processor -- start 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.737+0000 7fa3b6eb4700 1 -- start start 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b0159c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b0068220 0x7fa3b00c4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b1750 con 0x7fa3b015a300 2023-10-09T15:38:47.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b1a30 con 0x7fa3b0068220 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b6eb4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00b1d10 con 0x7fa3b0067e50 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b5451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b5451700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39618/0 (socket says 172.21.15.33:39618) 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b5451700 1 -- 172.21.15.33:0/3589102249 learned_addr learned my addr 172.21.15.33:0/3589102249 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.738+0000 7fa3b4c50700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b0159c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 -- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 msgr2=0x7fa3b0159c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b0159c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 -- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b0068220 msgr2=0x7fa3b00c4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b0068220 0x7fa3b00c4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 -- 172.21.15.33:0/3589102249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a4009420 con 0x7fa3b015a300 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b4c50700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b0159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:47.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b5451700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800cc90 tx=0x7fa3a8001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a800cea0 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a800ab70 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b0169df0 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a80070f0 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.739+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b0150f00 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.740+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b0169c50 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.740+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa3a80074a0 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.741+0000 7fa3acff9700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 0x7fa39c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.741+0000 7fa3b4c50700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 0x7fa39c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.741+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(145..145 src has 1..145) v4 ==== 5927+0+0 (secure 0 0 0) 0x7fa3a80851f0 con 0x7fa3b015a300 2023-10-09T15:38:47.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.741+0000 7fa3b4c50700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 0x7fa39c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0006fd0 tx=0x7fa3a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:47.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.745+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa3b0169c50 con 0x7fa3b015a300 2023-10-09T15:38:47.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:47.940+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000107790.meta", "pool2": "cephfs.volume_0000000000107790.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3b0169c50 con 0x7fa3b015a300 2023-10-09T15:38:48.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.544+0000 7fa3acff9700 1 -- 172.21.15.33:0/3589102249 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000107790.meta", "pool2": "cephfs.volume_0000000000107790.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000107790.meta' removed v146) v1 ==== 241+0+0 (secure 0 0 0) 0x7fa3b0169c50 con 0x7fa3b015a300 2023-10-09T15:38:48.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.548+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 msgr2=0x7fa39c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.548+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 0x7fa39c0697d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0006fd0 tx=0x7fa3a0008040 comp rx=0 tx=0).stop 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 msgr2=0x7fa3b016a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800cc90 tx=0x7fa3a8001a80 comp rx=0 tx=0).stop 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 shutdown_connections 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa39c067320 0x7fa39c0697d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa3b015a300 0x7fa3b016a310 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa3b0067e50 0x7fa3b0159c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 --2- 172.21.15.33:0/3589102249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa3b0068220 0x7fa3b00c4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.549+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 >> 172.21.15.33:0/3589102249 conn(0x7fa3b00ce4a0 msgr2=0x7fa3b006efc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.550+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 shutdown_connections 2023-10-09T15:38:48.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.550+0000 7fa3b6eb4700 1 -- 172.21.15.33:0/3589102249 wait complete. 2023-10-09T15:38:48.553 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000107790.meta' removed 2023-10-09T15:38:48.568 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000107790.data cephfs.volume_0000000000107790.data --yes-i-really-really-mean-it 2023-10-09T15:38:48.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.691+0000 7f5af54df700 1 Processor -- start 2023-10-09T15:38:48.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.691+0000 7f5af54df700 1 -- start start 2023-10-09T15:38:48.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5af54df700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5af0159530 0x7f5af00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5af54df700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5af006dcf0 0x7f5af0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5af54df700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af00ccfd0 con 0x7f5af0159e40 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5af54df700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af015a410 con 0x7f5af006dcf0 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5af54df700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af015a6f0 con 0x7f5af0159530 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5af006dcf0 0x7f5af0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5af006dcf0 0x7f5af0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39628/0 (socket says 172.21.15.33:39628) 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 -- 172.21.15.33:0/545956923 learned_addr learned my addr 172.21.15.33:0/545956923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 -- 172.21.15.33:0/545956923 >> v2:172.21.15.59:3300/0 conn(0x7f5af0159530 msgr2=0x7f5af00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aeeffd700 1 --2- 172.21.15.33:0/545956923 >> v2:172.21.15.59:3300/0 conn(0x7f5af0159530 0x7f5af00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 --2- 172.21.15.33:0/545956923 >> v2:172.21.15.59:3300/0 conn(0x7f5af0159530 0x7f5af00ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 -- 172.21.15.33:0/545956923 >> v1:172.21.15.59:6789/0 conn(0x7f5af0159e40 legacy=0x7f5af00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:48.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 -- 172.21.15.33:0/545956923 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af015a9d0 con 0x7f5af006dcf0 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.692+0000 7f5aee7fc700 1 --2- 172.21.15.33:0/545956923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af0159900 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5af006d630 tx=0x7f5ad8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c6dae0017c2e61 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5aedffb700 1 -- 172.21.15.33:0/545956923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800b820 con 0x7f5af006dcf0 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5aedffb700 1 -- 172.21.15.33:0/545956923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ad800b980 con 0x7f5af006dcf0 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5aedffb700 1 -- 172.21.15.33:0/545956923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ad800bd20 con 0x7f5af006dcf0 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 -- 172.21.15.33:0/545956923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 msgr2=0x7f5af0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 --2- 172.21.15.33:0/545956923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af0159900 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f5af006d630 tx=0x7f5ad8009250 comp rx=0 tx=0).stop 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 -- 172.21.15.33:0/545956923 shutdown_connections 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 --2- 172.21.15.33:0/545956923 >> v2:172.21.15.59:3300/0 conn(0x7f5af0159530 0x7f5af00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 --2- 172.21.15.33:0/545956923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af0159900 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 -- 172.21.15.33:0/545956923 >> 172.21.15.33:0/545956923 conn(0x7f5af00703a0 msgr2=0x7f5af00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:48.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 -- 172.21.15.33:0/545956923 shutdown_connections 2023-10-09T15:38:48.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.693+0000 7f5af54df700 1 -- 172.21.15.33:0/545956923 wait complete. 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.694+0000 7f5af54df700 1 Processor -- start 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.694+0000 7f5af54df700 1 -- start start 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af0159530 0x7f5af00c8140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af0159e40 0x7f5af015d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00b4a50 con 0x7f5af006dcf0 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00c89f0 con 0x7f5af0159e40 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5af54df700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00c8cd0 con 0x7f5af0159530 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:48.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39634/0 (socket says 172.21.15.33:39634) 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 -- 172.21.15.33:0/278205309 learned_addr learned my addr 172.21.15.33:0/278205309 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 -- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af0159530 msgr2=0x7f5af00c8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af0159530 0x7f5af00c8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 -- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af0159e40 msgr2=0x7f5af015d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.695+0000 7f5aeeffd700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af0159e40 0x7f5af015d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5aeeffd700 1 -- 172.21.15.33:0/278205309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ad80094f0 con 0x7f5af006dcf0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5aeeffd700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000cfc0 tx=0x7f5ae00078b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0016430 con 0x7f5af006dcf0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0016590 con 0x7f5af006dcf0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0016930 con 0x7f5af006dcf0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af00c8fb0 con 0x7f5af006dcf0 2023-10-09T15:38:48.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.696+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af00b45e0 con 0x7f5af006dcf0 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.697+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af004c3c0 con 0x7f5af006dcf0 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.697+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5ae0003020 con 0x7f5af006dcf0 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.698+0000 7f5ae6ffd700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.698+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(146..146 src has 1..146) v4 ==== 5452+0+0 (secure 0 0 0) 0x7f5ae0012070 con 0x7f5af006dcf0 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.698+0000 7f5aee7fc700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:48.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.698+0000 7f5aee7fc700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5af006d630 tx=0x7f5ad8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:48.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.702+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ae00528c0 con 0x7f5af006dcf0 2023-10-09T15:38:48.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:48.897+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000107790.data", "pool2": "cephfs.volume_0000000000107790.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5af015cff0 con 0x7f5af006dcf0 2023-10-09T15:38:49.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.555+0000 7f5ae6ffd700 1 -- 172.21.15.33:0/278205309 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000107790.data", "pool2": "cephfs.volume_0000000000107790.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000107790.data' removed v147) v1 ==== 241+0+0 (secure 0 0 0) 0x7f5ae0055ee0 con 0x7f5af006dcf0 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 msgr2=0x7f5ad00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5af006d630 tx=0x7f5ad8016000 comp rx=0 tx=0).stop 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 msgr2=0x7f5af01532d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000cfc0 tx=0x7f5ae00078b0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 shutdown_connections 2023-10-09T15:38:49.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 secure :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f5af006d630 tx=0x7f5ad8016000 comp rx=0 tx=0).stop 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af006dcf0 0x7f5af01532d0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af0159e40 0x7f5af015d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 --2- 172.21.15.33:0/278205309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af0159530 0x7f5af00c8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 >> 172.21.15.33:0/278205309 conn(0x7f5af00703a0 msgr2=0x7f5af00cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 shutdown_connections 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.560+0000 7f5af54df700 1 -- 172.21.15.33:0/278205309 wait complete. 2023-10-09T15:38:49.562 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000107790.data' removed 2023-10-09T15:38:49.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:38:49.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.699+0000 7f5c01125700 1 Processor -- start 2023-10-09T15:38:49.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.699+0000 7f5c01125700 1 -- start start 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5c01125700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5bfc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5c01125700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc0ccfd0 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5c01125700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bfc15a3d0 con 0x7f5bfc159530 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5c01125700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc15a6b0 con 0x7f5bfc06dc70 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5bfb59e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5bfc06e0e0 0x7f5bfc0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:52654/0 (socket says 172.21.15.33:52654) 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5bfb59e700 1 -- 172.21.15.33:0/1505938941 learned_addr learned my addr 172.21.15.33:0/1505938941 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 735139829 0 0) 0x7f5bfc0ccfd0 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5be8003570 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.700+0000 7f5bfa59c700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5bfc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3026047701 0 0) 0x7f5be8003570 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 msgr2=0x7f5bfc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5bfc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 >> v1:172.21.15.59:6789/0 conn(0x7f5bfc159530 legacy=0x7f5bfc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc15a990 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5bf4001470 con 0x7f5bfc06e0e0 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 >> v1:172.21.15.33:6789/0 conn(0x7f5bfc06e0e0 legacy=0x7f5bfc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be8003a90 0x7f5be8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5be8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be8004d50 0x7f5be80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc15a6b0 con 0x7f5be8004d50 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be800bb70 con 0x7f5be8003a90 2023-10-09T15:38:49.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5be800bd30 con 0x7f5bfc06dc70 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be8004d50 0x7f5be80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfad9d700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be8003a90 0x7f5be8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfa59c700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5be8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 -- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 msgr2=0x7f5be8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc06dc70 0x7f5be8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 -- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be8003a90 msgr2=0x7f5be8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5be8003a90 0x7f5be8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 -- 172.21.15.33:0/1505938941 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5be8003570 con 0x7f5be8004d50 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be8004d50 0x7f5be80051c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400c390 tx=0x7f5bf4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ea82a56ca4bb09 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf400cc60 con 0x7f5be8004d50 2023-10-09T15:38:49.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bf400cdc0 con 0x7f5be8004d50 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.701+0000 7f5bf9d9b700 1 -- 172.21.15.33:0/1505938941 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bf4005b50 con 0x7f5be8004d50 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 -- 172.21.15.33:0/1505938941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be8004d50 msgr2=0x7f5be80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 --2- 172.21.15.33:0/1505938941 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5be8004d50 0x7f5be80051c0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400c390 tx=0x7f5bf4001e50 comp rx=0 tx=0).stop 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5bfb59e700 1 -- 172.21.15.33:0/1505938941 reap_dead start 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 -- 172.21.15.33:0/1505938941 shutdown_connections 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 -- 172.21.15.33:0/1505938941 >> 172.21.15.33:0/1505938941 conn(0x7f5bfc0703a0 msgr2=0x7f5bfc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 -- 172.21.15.33:0/1505938941 shutdown_connections 2023-10-09T15:38:49.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.702+0000 7f5c01125700 1 -- 172.21.15.33:0/1505938941 wait complete. 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.703+0000 7f5c01125700 1 Processor -- start 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.703+0000 7f5c01125700 1 -- start start 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bfc155490 0x7f5bfc15dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 0x7f5bfc15bce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc15c220 con 0x7f5bfc0b4720 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0b4cc0 con 0x7f5bfc155490 2023-10-09T15:38:49.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5c01125700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bfc0b4fa0 con 0x7f5bfc15b870 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39656/0 (socket says 172.21.15.33:39656) 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 -- 172.21.15.33:0/304679880 learned_addr learned my addr 172.21.15.33:0/304679880 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 0x7f5bfc15bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfad9d700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bfc155490 0x7f5bfc15dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 -- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 msgr2=0x7f5bfc15bce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 0x7f5bfc15bce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 -- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bfc155490 msgr2=0x7f5bfc15dba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bfc155490 0x7f5bfc15dba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfa59c700 1 -- 172.21.15.33:0/304679880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bfc0b5280 con 0x7f5bfc0b4720 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.704+0000 7f5bfb59e700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 0x7f5bfc15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:49.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5bfa59c700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f5be4006ac0 tx=0x7f5be40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be400fa10 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be400fb70 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bfc0b5560 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be4014440 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.705+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bfc15e0e0 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.706+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bfc04c3c0 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.706+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5be4014830 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.707+0000 7f5bf2ffd700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 0x7f5bdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.707+0000 7f5bfad9d700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 0x7f5bdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.707+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5be4018030 con 0x7f5bfc0b4720 2023-10-09T15:38:49.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.707+0000 7f5bfad9d700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 0x7f5bdc0697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5bec001780 tx=0x7f5bec001670 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:49.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.711+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5be40523a0 con 0x7f5bfc0b4720 2023-10-09T15:38:49.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.905+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5bfc15ac70 con 0x7f5bfc0b4720 2023-10-09T15:38:49.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.908+0000 7f5bf2ffd700 1 -- 172.21.15.33:0/304679880 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v25) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5be40559c0 con 0x7f5bfc0b4720 2023-10-09T15:38:49.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 msgr2=0x7f5bdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 0x7f5bdc0697d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5bec001780 tx=0x7f5bec001670 comp rx=0 tx=0).stop 2023-10-09T15:38:49.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 msgr2=0x7f5bfc0b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:49.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f5be4006ac0 tx=0x7f5be40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 shutdown_connections 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5bdc067320 0x7f5bdc0697d0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5bfc15b870 0x7f5bfc15bce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5bfc155490 0x7f5bfc15dba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 --2- 172.21.15.33:0/304679880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5bfc0b4720 0x7f5bfc0b5d60 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 >> 172.21.15.33:0/304679880 conn(0x7f5bfc0703a0 msgr2=0x7f5bfc1582d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 shutdown_connections 2023-10-09T15:38:49.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:49.911+0000 7f5c01125700 1 -- 172.21.15.33:0/304679880 wait complete. 2023-10-09T15:38:49.924 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename' 2023-10-09T15:38:50.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.042+0000 7f5d1ddab700 1 Processor -- start 2023-10-09T15:38:50.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.042+0000 7f5d1ddab700 1 -- start start 2023-10-09T15:38:50.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.043+0000 7f5d1ddab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 0x7f5d180af930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.043+0000 7f5d1ddab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.043+0000 7f5d1ddab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d1815bdd0 con 0x7f5d18157710 2023-10-09T15:38:50.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.043+0000 7f5d1ddab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d180aee50 con 0x7f5d18157340 2023-10-09T15:38:50.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.043+0000 7f5d1ddab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180af130 con 0x7f5d180ad2d0 2023-10-09T15:38:50.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1cda9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 0x7f5d180af930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:54490/0 (socket says 172.21.15.33:54490) 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1cda9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 0x7f5d180af930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:45558/0 (socket says 172.21.15.33:45558) 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d17fff700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5d18157710 0x7f5d180acbc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:50584/0 (socket says 172.21.15.33:50584) 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 -- 172.21.15.33:0/1323456239 learned_addr learned my addr 172.21.15.33:0/1323456239 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 -- 172.21.15.33:0/1323456239 >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 msgr2=0x7f5d180af930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 --2- 172.21.15.33:0/1323456239 >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 0x7f5d180af930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 -- 172.21.15.33:0/1323456239 >> v1:172.21.15.59:6789/0 conn(0x7f5d18157710 legacy=0x7f5d180acbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d177fe700 1 -- 172.21.15.33:0/1323456239 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 975264393 0 0) 0x7f5d1815bdd0 con 0x7f5d18157710 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 -- 172.21.15.33:0/1323456239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d180af410 con 0x7f5d180ad2d0 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d1d5aa700 1 --2- 172.21.15.33:0/1323456239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d100099b0 tx=0x7f5d10009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a79bd359304c76d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d177fe700 1 -- 172.21.15.33:0/1323456239 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d10009ea0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d177fe700 1 -- 172.21.15.33:0/1323456239 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d1000b860 con 0x7f5d180ad2d0 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.044+0000 7f5d177fe700 1 -- 172.21.15.33:0/1323456239 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d1000bc00 con 0x7f5d180ad2d0 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 -- 172.21.15.33:0/1323456239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 msgr2=0x7f5d1815b0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/1323456239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f5d100099b0 tx=0x7f5d10009250 comp rx=0 tx=0).stop 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 -- 172.21.15.33:0/1323456239 shutdown_connections 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/1323456239 >> v2:172.21.15.59:3300/0 conn(0x7f5d18157340 0x7f5d180af930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/1323456239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d180ad2d0 0x7f5d1815b0a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 -- 172.21.15.33:0/1323456239 >> 172.21.15.33:0/1323456239 conn(0x7f5d1806e280 msgr2=0x7f5d180cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 -- 172.21.15.33:0/1323456239 shutdown_connections 2023-10-09T15:38:50.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.045+0000 7f5d1ddab700 1 -- 172.21.15.33:0/1323456239 wait complete. 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.046+0000 7f5d1ddab700 1 Processor -- start 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.046+0000 7f5d1ddab700 1 -- start start 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d18157340 0x7f5d180c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d18157710 0x7f5d180675a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180ad0b0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180c65e0 con 0x7f5d18157710 2023-10-09T15:38:50.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1ddab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d180c68c0 con 0x7f5d18157340 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:39664/0 (socket says 172.21.15.33:39664) 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 -- 172.21.15.33:0/4209620279 learned_addr learned my addr 172.21.15.33:0/4209620279 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d17fff700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d18157340 0x7f5d180c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1d5aa700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d18157710 0x7f5d180675a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 -- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d18157340 msgr2=0x7f5d180c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d18157340 0x7f5d180c5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 -- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d18157710 msgr2=0x7f5d180675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d18157710 0x7f5d180675a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.047+0000 7f5d1cda9700 1 -- 172.21.15.33:0/4209620279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d100094f0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d1cda9700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000ec80 tx=0x7f5d000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d0000c9d0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d0000cb30 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d00013470 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d180c6ba0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.048+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d180c5840 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.049+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d180b02d0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.049+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5d00013820 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.050+0000 7f5d14ff9700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 0x7f5cf80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.050+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5d00084cb0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.050+0000 7f5d17fff700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 0x7f5cf80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.050+0000 7f5d17fff700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 0x7f5cf80697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c16f0 tx=0x7f5d08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.054+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5d00051c00 con 0x7f5d180ad2d0 2023-10-09T15:38:50.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.325+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]} v 0) v1 -- 0x7f5d1804c3c0 con 0x7f5d180ad2d0 2023-10-09T15:38:50.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.552+0000 7f5d14ff9700 1 -- 172.21.15.33:0/4209620279 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename"]}]=0 v391) v1 ==== 135+0+0 (secure 0 0 0) 0x7f5d00055220 con 0x7f5d180ad2d0 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 msgr2=0x7f5cf80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 0x7f5cf80697d0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5d180c16f0 tx=0x7f5d08009040 comp rx=0 tx=0).stop 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 msgr2=0x7f5d180acb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000ec80 tx=0x7f5d000091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 shutdown_connections 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5cf8067320 0x7f5cf80697d0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5d180ad2d0 0x7f5d180acb70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5d18157710 0x7f5d180675a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 --2- 172.21.15.33:0/4209620279 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5d18157340 0x7f5d180c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.554+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 >> 172.21.15.33:0/4209620279 conn(0x7f5d1806e280 msgr2=0x7f5d181566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.555+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 shutdown_connections 2023-10-09T15:38:50.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.555+0000 7f5d1ddab700 1 -- 172.21.15.33:0/4209620279 wait complete. 2023-10-09T15:38:50.568 INFO:tasks.cephfs_test_runner:That volume, its file system and pools, can be renamed. ... ok 2023-10-09T15:38:50.568 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) That renaming volume fails without --yes-i-really-mean-it flag. 2023-10-09T15:38:50.568 INFO:tasks.cephfs_test_runner:test_volume_rename_fails_without_confirmation_flag (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:38:50.568 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-09T15:38:50.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.690+0000 7f5af4a2a700 1 Processor -- start 2023-10-09T15:38:50.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.690+0000 7f5af4a2a700 1 -- start start 2023-10-09T15:38:50.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5af4a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 0x7f5af00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5af4a2a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5af00cd9e0 0x7f5af0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5af4a2a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5af015ae40 con 0x7f5af00cde50 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5af4a2a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5af00d13f0 con 0x7f5af00cd9e0 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5af4a2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af015ab60 con 0x7f5af00cb5a0 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5af00cd9e0 0x7f5af0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aeed9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5af00cde50 0x7f5af0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36692/0 (socket says 172.21.15.33:36692) 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aeed9d700 1 -- 172.21.15.33:0/1460101393 learned_addr learned my addr 172.21.15.33:0/1460101393 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aee59c700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 0x7f5af00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 -- 172.21.15.33:0/1460101393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 msgr2=0x7f5af00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 0x7f5af00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 -- 172.21.15.33:0/1460101393 >> v1:172.21.15.33:6789/0 conn(0x7f5af00cde50 legacy=0x7f5af0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aed59a700 1 -- 172.21.15.33:0/1460101393 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3419206573 0 0) 0x7f5af015ae40 con 0x7f5af00cde50 2023-10-09T15:38:50.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 -- 172.21.15.33:0/1460101393 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af00ccf00 con 0x7f5af00cd9e0 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aee59c700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 0x7f5af00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.691+0000 7f5aedd9b700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cd9e0 0x7f5af0159ec0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098e0 tx=0x7f5ae40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4de869aa737c578 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5aed59a700 1 -- 172.21.15.33:0/1460101393 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4009e80 con 0x7f5af00cd9e0 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5aed59a700 1 -- 172.21.15.33:0/1460101393 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae400b860 con 0x7f5af00cd9e0 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5aed59a700 1 -- 172.21.15.33:0/1460101393 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae400bbe0 con 0x7f5af00cd9e0 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 -- 172.21.15.33:0/1460101393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cd9e0 msgr2=0x7f5af0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cd9e0 0x7f5af0159ec0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40098e0 tx=0x7f5ae40091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 -- 172.21.15.33:0/1460101393 shutdown_connections 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af00cb5a0 0x7f5af00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/1460101393 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cd9e0 0x7f5af0159ec0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 -- 172.21.15.33:0/1460101393 >> 172.21.15.33:0/1460101393 conn(0x7f5af0070e30 msgr2=0x7f5af00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:50.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 -- 172.21.15.33:0/1460101393 shutdown_connections 2023-10-09T15:38:50.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.692+0000 7f5af4a2a700 1 -- 172.21.15.33:0/1460101393 wait complete. 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.693+0000 7f5af4a2a700 1 Processor -- start 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.693+0000 7f5af4a2a700 1 -- start start 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af00cd9e0 0x7f5af00c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af015dbb0 0x7f5af01424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00c8c20 con 0x7f5af00cb5a0 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00c8010 con 0x7f5af00cd9e0 2023-10-09T15:38:50.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5af4a2a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af00c82f0 con 0x7f5af015dbb0 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58786/0 (socket says 172.21.15.33:58786) 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 -- 172.21.15.33:0/394113267 learned_addr learned my addr 172.21.15.33:0/394113267 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 -- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af015dbb0 msgr2=0x7f5af01424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af015dbb0 0x7f5af01424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 -- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af00cd9e0 msgr2=0x7f5af00c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af00cd9e0 0x7f5af00c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.694+0000 7f5aee59c700 1 -- 172.21.15.33:0/394113267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ae4009420 con 0x7f5af00cb5a0 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5aee59c700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c830 tx=0x7f5ae0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011600 con 0x7f5af00cb5a0 2023-10-09T15:38:50.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ae0011760 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5af00c85d0 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ae0011b20 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.695+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5af00c7d00 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.696+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5af00c95f0 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.696+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5ae000a3e0 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.696+0000 7f5ade7fc700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.697+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5ae0084b20 con 0x7f5af00cb5a0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.697+0000 7f5aedd9b700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:50.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.697+0000 7f5aedd9b700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40091e0 tx=0x7f5ae4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:50.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.701+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ae00519a0 con 0x7f5af00cb5a0 2023-10-09T15:38:50.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:50.978+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f5af004c3c0 con 0x7f5af00cb5a0 2023-10-09T15:38:51.554 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.554+0000 7f5ade7fc700 1 -- 172.21.15.33:0/394113267 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v392) v1 ==== 170+0+0 (secure 0 0 0) 0x7f5ae00150f0 con 0x7f5af00cb5a0 2023-10-09T15:38:51.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 msgr2=0x7f5ad00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f5ae40091e0 tx=0x7f5ae4017000 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 msgr2=0x7f5af00c90b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7f5ae000c830 tx=0x7f5ae0008040 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 shutdown_connections 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5ad0067320 0x7f5ad00697d0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5af00cb5a0 0x7f5af00c90b0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5af015dbb0 0x7f5af01424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 --2- 172.21.15.33:0/394113267 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5af00cd9e0 0x7f5af00c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 >> 172.21.15.33:0/394113267 conn(0x7f5af0070e30 msgr2=0x7f5af00b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:51.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 shutdown_connections 2023-10-09T15:38:51.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.556+0000 7f5af4a2a700 1 -- 172.21.15.33:0/394113267 wait complete. 2023-10-09T15:38:51.572 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:38:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.701+0000 7f49ef59e700 1 Processor -- start 2023-10-09T15:38:51.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.701+0000 7f49ef59e700 1 -- start start 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f49f0153a00 0x7f49f0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49f015de50 0x7f49f015a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f00cea00 0x7f49f00cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f00cf3c0 con 0x7f49f015de50 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49f015af60 con 0x7f49f0153a00 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49ef59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f015b240 con 0x7f49f00cea00 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49edd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49f015de50 0x7f49f015a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49edd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f49f015de50 0x7f49f015a540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58796/0 (socket says 172.21.15.33:58796) 2023-10-09T15:38:51.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49edd9b700 1 -- 172.21.15.33:0/3118547203 learned_addr learned my addr 172.21.15.33:0/3118547203 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.702+0000 7f49eed9d700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f00cea00 0x7f49f00cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ee59c700 1 --2- 172.21.15.33:0/3118547203 >> v2:172.21.15.59:3300/0 conn(0x7f49f0153a00 0x7f49f0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 -- 172.21.15.33:0/3118547203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f00cea00 msgr2=0x7f49f00cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f00cea00 0x7f49f00cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 -- 172.21.15.33:0/3118547203 >> v2:172.21.15.59:3300/0 conn(0x7f49f0153a00 msgr2=0x7f49f0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 --2- 172.21.15.33:0/3118547203 >> v2:172.21.15.59:3300/0 conn(0x7f49f0153a00 0x7f49f0153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 -- 172.21.15.33:0/3118547203 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49f015b520 con 0x7f49f015de50 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49edd9b700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f015de50 0x7f49f015a540 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f49f00cac20 tx=0x7f49d8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73e2838ae8cbe64b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ed59a700 1 -- 172.21.15.33:0/3118547203 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800b860 con 0x7f49f015de50 2023-10-09T15:38:51.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ed59a700 1 -- 172.21.15.33:0/3118547203 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49d800b9c0 con 0x7f49f015de50 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ed59a700 1 -- 172.21.15.33:0/3118547203 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49d800bd60 con 0x7f49f015de50 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ef59e700 1 -- 172.21.15.33:0/3118547203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f015de50 msgr2=0x7f49f015a540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.703+0000 7f49ef59e700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f015de50 0x7f49f015a540 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7f49f00cac20 tx=0x7f49d8009250 comp rx=0 tx=0).stop 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 -- 172.21.15.33:0/3118547203 shutdown_connections 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 --2- 172.21.15.33:0/3118547203 >> v2:172.21.15.59:3300/0 conn(0x7f49f0153a00 0x7f49f0153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f00cea00 0x7f49f00cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 --2- 172.21.15.33:0/3118547203 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f015de50 0x7f49f015a540 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 -- 172.21.15.33:0/3118547203 >> 172.21.15.33:0/3118547203 conn(0x7f49f00703a0 msgr2=0x7f49f00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 -- 172.21.15.33:0/3118547203 shutdown_connections 2023-10-09T15:38:51.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.704+0000 7f49ef59e700 1 -- 172.21.15.33:0/3118547203 wait complete. 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 Processor -- start 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 -- start start 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 0x7f49f01470c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49f015de50 0x7f49f00c9db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00ca490 con 0x7f49f00cea00 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b5950 con 0x7f49f015de50 2023-10-09T15:38:51.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.705+0000 7f49ef59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49f00b5bf0 con 0x7f49f0153a00 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58798/0 (socket says 172.21.15.33:58798) 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 -- 172.21.15.33:0/756744513 learned_addr learned my addr 172.21.15.33:0/756744513 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49eed9d700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49f015de50 0x7f49f00c9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49edd9b700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 0x7f49f01470c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 -- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 msgr2=0x7f49f01470c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 0x7f49f01470c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 -- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49f015de50 msgr2=0x7f49f00c9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49f015de50 0x7f49f00c9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 -- 172.21.15.33:0/756744513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49d80094f0 con 0x7f49f00cea00 2023-10-09T15:38:51.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49edd9b700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 0x7f49f01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ee59c700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f49e000ce10 tx=0x7f49e0007810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e000ab90 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49e000acf0 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f00b5ed0 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f49e0017660 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.706+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f00d03d0 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.707+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f004c3c0 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.708+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f49e0003020 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.708+0000 7f49e67fc700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 0x7f49d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.708+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f49e0013070 con 0x7f49f00cea00 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.708+0000 7f49edd9b700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 0x7f49d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:51.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.708+0000 7f49edd9b700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 0x7f49d00697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49f00cac20 tx=0x7f49d8017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:51.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.712+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f49e0051de0 con 0x7f49f00cea00 2023-10-09T15:38:51.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.904+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f49f00caef0 con 0x7f49f00cea00 2023-10-09T15:38:51.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.908+0000 7f49e67fc700 1 -- 172.21.15.33:0/756744513 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f49e000ae60 con 0x7f49f00cea00 2023-10-09T15:38:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 msgr2=0x7f49d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 0x7f49d00697d0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f49f00cac20 tx=0x7f49d8017000 comp rx=0 tx=0).stop 2023-10-09T15:38:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 msgr2=0x7f49f00c77e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:51.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f49e000ce10 tx=0x7f49e0007810 comp rx=0 tx=0).stop 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 shutdown_connections 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f49d0067320 0x7f49d00697d0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f49f00cea00 0x7f49f00c77e0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f49f015de50 0x7f49f00c9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 --2- 172.21.15.33:0/756744513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f49f0153a00 0x7f49f01470c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 >> 172.21.15.33:0/756744513 conn(0x7f49f00703a0 msgr2=0x7f49f00b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 shutdown_connections 2023-10-09T15:38:51.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:51.910+0000 7f49ef59e700 1 -- 172.21.15.33:0/756744513 wait complete. 2023-10-09T15:38:51.923 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:38:51.923 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:51.966 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:38:52.015 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:38:52.015 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:38:52.015 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:38:52.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.133+0000 7f51a265d700 1 Processor -- start 2023-10-09T15:38:52.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.133+0000 7f51a265d700 1 -- start start 2023-10-09T15:38:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f51a265d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f519c0cbe00 0x7f519c1645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f51a265d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0ce9d0 con 0x7f519c159c80 2023-10-09T15:38:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f51a265d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f519c0af960 con 0x7f519c1598b0 2023-10-09T15:38:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f51a265d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f519c0afc30 con 0x7f519c0cbe00 2023-10-09T15:38:52.136 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f51a0bfa700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f519c0cbe00 0x7f519c1645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.134+0000 7f519b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f519c159c80 0x7f519c0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36698/0 (socket says 172.21.15.33:36698) 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f519b7fe700 1 -- 172.21.15.33:0/534813778 learned_addr learned my addr 172.21.15.33:0/534813778 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f51a0bfa700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f519c0cbe00 0x7f519c1645a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58812/0 (socket says 172.21.15.33:58812) 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f51a0bfa700 1 -- 172.21.15.33:0/534813778 >> v1:172.21.15.59:6789/0 conn(0x7f519c1598b0 legacy=0x7f519c0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f51a0bfa700 1 -- 172.21.15.33:0/534813778 >> v1:172.21.15.33:6789/0 conn(0x7f519c159c80 legacy=0x7f519c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f519affd700 1 -- 172.21.15.33:0/534813778 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 26139267 0 0) 0x7f519c0ce9d0 con 0x7f519c159c80 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f51a0bfa700 1 -- 172.21.15.33:0/534813778 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f519c0aff10 con 0x7f519c0cbe00 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f51a0bfa700 1 --2- 172.21.15.33:0/534813778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c1645a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5194009e60 tx=0x7f5194009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb30544df71fa975 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f519affd700 1 -- 172.21.15.33:0/534813778 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f519400e070 con 0x7f519c0cbe00 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f519affd700 1 -- 172.21.15.33:0/534813778 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f519400bc30 con 0x7f519c0cbe00 2023-10-09T15:38:52.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.135+0000 7f519affd700 1 -- 172.21.15.33:0/534813778 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5194012430 con 0x7f519c0cbe00 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 -- 172.21.15.33:0/534813778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 msgr2=0x7f519c1645a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 --2- 172.21.15.33:0/534813778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c1645a0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5194009e60 tx=0x7f5194009780 comp rx=0 tx=0).stop 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 -- 172.21.15.33:0/534813778 shutdown_connections 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 --2- 172.21.15.33:0/534813778 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c1645a0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 -- 172.21.15.33:0/534813778 >> 172.21.15.33:0/534813778 conn(0x7f519c070e30 msgr2=0x7f519c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:52.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 -- 172.21.15.33:0/534813778 shutdown_connections 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.136+0000 7f51a265d700 1 -- 172.21.15.33:0/534813778 wait complete. 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.137+0000 7f51a265d700 1 Processor -- start 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.137+0000 7f51a265d700 1 -- start start 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519c1598b0 0x7f519c0c9b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519c159c80 0x7f519c0ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c15fee0 con 0x7f519c0cbe00 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f519c15b020 con 0x7f519c159c80 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a265d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f519c15f920 con 0x7f519c1598b0 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58818/0 (socket says 172.21.15.33:58818) 2023-10-09T15:38:52.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 -- 172.21.15.33:0/1135637317 learned_addr learned my addr 172.21.15.33:0/1135637317 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519b7fe700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519c1598b0 0x7f519c0c9b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f51a0bfa700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519c159c80 0x7f519c0ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 -- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519c1598b0 msgr2=0x7f519c0c9b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519c1598b0 0x7f519c0c9b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 -- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519c159c80 msgr2=0x7f519c0ca0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519c159c80 0x7f519c0ca0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 -- 172.21.15.33:0/1135637317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5194009a20 con 0x7f519c0cbe00 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.138+0000 7f519bfff700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c590 tx=0x7f518c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.139+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011590 con 0x7f519c0cbe00 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.139+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f518c0116f0 con 0x7f519c0cbe00 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.139+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f518c011ab0 con 0x7f519c0cbe00 2023-10-09T15:38:52.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.139+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f519c15fc00 con 0x7f519c0cbe00 2023-10-09T15:38:52.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.139+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f519c0c83b0 con 0x7f519c0cbe00 2023-10-09T15:38:52.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.140+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f519c04c3c0 con 0x7f519c0cbe00 2023-10-09T15:38:52.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.140+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f518c01b3b0 con 0x7f519c0cbe00 2023-10-09T15:38:52.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.140+0000 7f5183fff700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 0x7f5188069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.140+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(147..147 src has 1..147) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f518c083e70 con 0x7f519c0cbe00 2023-10-09T15:38:52.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.140+0000 7f519b7fe700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 0x7f5188069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.141+0000 7f519b7fe700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 0x7f5188069800 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f519000c8f0 tx=0x7f5190009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.145+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f518c050e00 con 0x7f519c0cbe00 2023-10-09T15:38:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.381+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f519c0ce380 con 0x7f519c0cbe00 2023-10-09T15:38:52.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.381+0000 7f5183fff700 1 -- 172.21.15.33:0/1135637317 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 97 v97) v1 ==== 94+0+3523 (secure 0 0 0) 0x7f518c017070 con 0x7f519c0cbe00 2023-10-09T15:38:52.383 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:52.383 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":97,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6862,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/230879661","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":230879661},{"type":"v1","addr":"172.21.15.33:6837","nonce":230879661}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6874,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1657986601","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1657986601},{"type":"v1","addr":"172.21.15.59:6834","nonce":1657986601}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":6877,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/420044108","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":420044108},{"type":"v1","addr":"172.21.15.59:6835","nonce":420044108}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":88},{"gid":7857,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2024982377","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2024982377},{"type":"v1","addr":"172.21.15.33:6836","nonce":2024982377}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":97}],"filesystems":[]} 2023-10-09T15:38:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 msgr2=0x7f5188069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 0x7f5188069800 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f519000c8f0 tx=0x7f5190009040 comp rx=0 tx=0).stop 2023-10-09T15:38:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 msgr2=0x7f519c15eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f518c00c590 tx=0x7f518c00c950 comp rx=0 tx=0).stop 2023-10-09T15:38:52.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 shutdown_connections 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5188067350 0x7f5188069800 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f519c0cbe00 0x7f519c15eed0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f519c159c80 0x7f519c0ca0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 --2- 172.21.15.33:0/1135637317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f519c1598b0 0x7f519c0c9b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 >> 172.21.15.33:0/1135637317 conn(0x7f519c070e30 msgr2=0x7f519c0b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 shutdown_connections 2023-10-09T15:38:52.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.383+0000 7f51a265d700 1 -- 172.21.15.33:0/1135637317 wait complete. 2023-10-09T15:38:52.387 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 97 2023-10-09T15:38:52.397 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:38:52.397 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:38:52.397 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:38:52.397 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:52.397 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:38:52.398 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:38:52.398 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:38:52.398 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:52.398 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:38:52.398 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:38:52.399 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:38:52.399 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:52.399 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:38:52.399 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:38:52.399 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:38:52.400 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:38:52.406 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:38:52.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:38:52.407 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:38:52.407 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:38:52.410 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:38:52.411 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:38:52.411 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:38:52.412 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:38:52.448 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:38:52.448 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:52.449 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:38:52.449 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:52.454 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:38:52.454 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:52.454 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:38:52.455 DEBUG:teuthology.parallel:result is None 2023-10-09T15:38:52.455 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:38:52.525 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:38:52.525 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:38:52.538 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:38:52.539 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:38:52.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 Processor -- start 2023-10-09T15:38:52.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 -- start start 2023-10-09T15:38:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870143200 0x7f7870159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f787015aa20 0x7f7870163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787006c7d0 con 0x7f78700c3250 2023-10-09T15:38:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78701171e0 con 0x7f787015aa20 2023-10-09T15:38:52.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.584+0000 7f7876650700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78700c37a0 con 0x7f7870143200 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f787015aa20 0x7f7870163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f78700c3250 0x7f787015a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36720/0 (socket says 172.21.15.33:36720) 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786f7fe700 1 -- 172.21.15.33:0/3278433602 learned_addr learned my addr 172.21.15.33:0/3278433602 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786ffff700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870143200 0x7f7870159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 -- 172.21.15.33:0/3278433602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870143200 msgr2=0x7f7870159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870143200 0x7f7870159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 -- 172.21.15.33:0/3278433602 >> v1:172.21.15.33:6789/0 conn(0x7f78700c3250 legacy=0x7f787015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 -- 172.21.15.33:0/3278433602 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78700cc090 con 0x7f787015aa20 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786effd700 1 -- 172.21.15.33:0/3278433602 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2845085068 0 0) 0x7f787006c7d0 con 0x7f78700c3250 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f7874bed700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787015aa20 0x7f7870163430 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7868009e60 tx=0x7f7868009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8155643a14faf6f9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786effd700 1 -- 172.21.15.33:0/3278433602 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786800e070 con 0x7f787015aa20 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786effd700 1 -- 172.21.15.33:0/3278433602 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786800bb60 con 0x7f787015aa20 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.585+0000 7f786effd700 1 -- 172.21.15.33:0/3278433602 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7868012430 con 0x7f787015aa20 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 -- 172.21.15.33:0/3278433602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787015aa20 msgr2=0x7f7870163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787015aa20 0x7f7870163430 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f7868009e60 tx=0x7f7868009780 comp rx=0 tx=0).stop 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 -- 172.21.15.33:0/3278433602 shutdown_connections 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787015aa20 0x7f7870163430 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3278433602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7870143200 0x7f7870159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 -- 172.21.15.33:0/3278433602 >> 172.21.15.33:0/3278433602 conn(0x7f78700ccb60 msgr2=0x7f78700ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 -- 172.21.15.33:0/3278433602 shutdown_connections 2023-10-09T15:38:52.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.586+0000 7f7876650700 1 -- 172.21.15.33:0/3278433602 wait complete. 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.587+0000 7f7876650700 1 Processor -- start 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.587+0000 7f7876650700 1 -- start start 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700c3250 0x7f7870134a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787015aa20 0x7f78701398a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787015a7f0 con 0x7f7870143200 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7870135ce0 con 0x7f78700c3250 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7876650700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7870139de0 con 0x7f787015aa20 2023-10-09T15:38:52.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58846/0 (socket says 172.21.15.33:58846) 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 -- 172.21.15.33:0/3485414690 learned_addr learned my addr 172.21.15.33:0/3485414690 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786ffff700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700c3250 0x7f7870134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f7874bed700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787015aa20 0x7f78701398a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 -- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787015aa20 msgr2=0x7f78701398a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787015aa20 0x7f78701398a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 -- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700c3250 msgr2=0x7f7870134a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.588+0000 7f786f7fe700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700c3250 0x7f7870134a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f786f7fe700 1 -- 172.21.15.33:0/3485414690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7868009a20 con 0x7f7870143200 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f786f7fe700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f786400c810 tx=0x7f7864007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864005b30 con 0x7f7870143200 2023-10-09T15:38:52.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7864005c90 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78701350d0 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7864007300 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.589+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7870135690 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.590+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7870135e90 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.590+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f786401b3b0 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.591+0000 7f7857fff700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 0x7f785c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.591+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7864083e20 con 0x7f7870143200 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.591+0000 7f786ffff700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 0x7f785c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.591+0000 7f786ffff700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 0x7f785c0697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7860009db0 tx=0x7f78600091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:52.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.595+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7870135e90 con 0x7f7870143200 2023-10-09T15:38:52.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:52.807+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7870135e90 con 0x7f7870143200 2023-10-09T15:38:53.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.583+0000 7f7857fff700 1 -- 172.21.15.33:0/3485414690 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v152) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7870135e90 con 0x7f7870143200 2023-10-09T15:38:53.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 msgr2=0x7f785c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 0x7f785c0697d0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f7860009db0 tx=0x7f78600091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 msgr2=0x7f787015a2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f786400c810 tx=0x7f7864007df0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 shutdown_connections 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f785c067320 0x7f785c0697d0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787015aa20 0x7f78701398a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f78700c3250 0x7f7870134a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 --2- 172.21.15.33:0/3485414690 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7870143200 0x7f787015a2b0 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 >> 172.21.15.33:0/3485414690 conn(0x7f78700ccb60 msgr2=0x7f7870141b00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 shutdown_connections 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.586+0000 7f7876650700 1 -- 172.21.15.33:0/3485414690 wait complete. 2023-10-09T15:38:53.588 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:38:53.602 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:38:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.726+0000 7f412d114700 1 Processor -- start 2023-10-09T15:38:53.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.726+0000 7f412d114700 1 -- start start 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412d114700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41280aee90 0x7f41280a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412d114700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f41280b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412d114700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41280ce1a0 con 0x7f41280a8be0 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412d114700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41280cd5d0 con 0x7f41280aee90 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412d114700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41280cd870 con 0x7f412806d280 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41280aee90 0x7f41280a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41280aee90 0x7f41280a8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58850/0 (socket says 172.21.15.33:58850) 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f4126d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f41280a8be0 0x7f41280ae780 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36726/0 (socket says 172.21.15.33:36726) 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.727+0000 7f412659c700 1 -- 172.21.15.33:0/2662727923 learned_addr learned my addr 172.21.15.33:0/2662727923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412759e700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f41280b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412659c700 1 -- 172.21.15.33:0/2662727923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 msgr2=0x7f41280b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412659c700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f41280b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412659c700 1 -- 172.21.15.33:0/2662727923 >> v1:172.21.15.33:6789/0 conn(0x7f41280a8be0 legacy=0x7f41280ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412659c700 1 -- 172.21.15.33:0/2662727923 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41280cdb50 con 0x7f41280aee90 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f4125d9b700 1 -- 172.21.15.33:0/2662727923 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4019191820 0 0) 0x7f41280ce1a0 con 0x7f41280a8be0 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412659c700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f41280a8fb0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4110009990 tx=0x7f4110009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9234a81136eb40 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f4125d9b700 1 -- 172.21.15.33:0/2662727923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4110005c10 con 0x7f41280aee90 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f4125d9b700 1 -- 172.21.15.33:0/2662727923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4110005d70 con 0x7f41280aee90 2023-10-09T15:38:53.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f4125d9b700 1 -- 172.21.15.33:0/2662727923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f411000b910 con 0x7f41280aee90 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 -- 172.21.15.33:0/2662727923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 msgr2=0x7f41280a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f41280a8fb0 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f4110009990 tx=0x7f4110009220 comp rx=0 tx=0).stop 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 -- 172.21.15.33:0/2662727923 shutdown_connections 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f41280b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 --2- 172.21.15.33:0/2662727923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f41280a8fb0 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.728+0000 7f412d114700 1 -- 172.21.15.33:0/2662727923 >> 172.21.15.33:0/2662727923 conn(0x7f412806ce80 msgr2=0x7f41280ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.729+0000 7f412d114700 1 -- 172.21.15.33:0/2662727923 shutdown_connections 2023-10-09T15:38:53.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.729+0000 7f412d114700 1 -- 172.21.15.33:0/2662727923 wait complete. 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 Processor -- start 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 -- start start 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f4128156b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41280a8be0 0x7f412815b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412815d0a0 con 0x7f41280aee90 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f412815cc10 con 0x7f41280a8be0 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.730+0000 7f412d114700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4128157080 con 0x7f412806d280 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58856/0 (socket says 172.21.15.33:58856) 2023-10-09T15:38:53.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 -- 172.21.15.33:0/4120272803 learned_addr learned my addr 172.21.15.33:0/4120272803 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f4126d9d700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f4128156b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412659c700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41280a8be0 0x7f412815b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 -- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 msgr2=0x7f4128156b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f4128156b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 -- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41280a8be0 msgr2=0x7f412815b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41280a8be0 0x7f412815b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 -- 172.21.15.33:0/4120272803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4110009480 con 0x7f41280aee90 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412759e700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f412000d8c0 tx=0x7f4120008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41200095b0 con 0x7f41280aee90 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4120009750 con 0x7f41280aee90 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4120009b10 con 0x7f41280aee90 2023-10-09T15:38:53.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f412815c000 con 0x7f41280aee90 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.731+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f412815c5c0 con 0x7f41280aee90 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.732+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41280af320 con 0x7f41280aee90 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.733+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4120014410 con 0x7f41280aee90 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.733+0000 7f411effd700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 0x7f41080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.733+0000 7f4126d9d700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 0x7f41080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.733+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4120084d80 con 0x7f41280aee90 2023-10-09T15:38:53.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.734+0000 7f4126d9d700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 0x7f41080697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4118007fd0 tx=0x7f4118009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:53.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:53.738+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4120051d60 con 0x7f41280aee90 2023-10-09T15:38:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.014+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f412804c3c0 con 0x7f41280aee90 2023-10-09T15:38:54.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.015+0000 7f411effd700 1 -- 172.21.15.33:0/4120272803 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f4120055380 con 0x7f41280aee90 2023-10-09T15:38:54.016 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.017 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.018 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.019 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:38:54.020 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.021 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.022 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.023 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.024 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:38:54.025 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.026 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:54.027 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.028 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:38:54.029 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.030 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.031 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:54.032 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:38:54.032 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 msgr2=0x7f41080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 0x7f41080697d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4118007fd0 tx=0x7f4118009040 comp rx=0 tx=0).stop 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 msgr2=0x7f4128099e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f412000d8c0 tx=0x7f4120008040 comp rx=0 tx=0).stop 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 shutdown_connections 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4108067320 0x7f41080697d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41280aee90 0x7f4128099e90 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f412806d280 0x7f4128156b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 --2- 172.21.15.33:0/4120272803 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41280a8be0 0x7f412815b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 >> 172.21.15.33:0/4120272803 conn(0x7f412806ce80 msgr2=0x7f41280b18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 shutdown_connections 2023-10-09T15:38:54.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.017+0000 7f412d114700 1 -- 172.21.15.33:0/4120272803 wait complete. 2023-10-09T15:38:54.037 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:54.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.156+0000 7f5b4c99d700 1 Processor -- start 2023-10-09T15:38:54.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.156+0000 7f5b4c99d700 1 -- start start 2023-10-09T15:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4c99d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 0x7f5b480aec90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4c99d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b4815df20 0x7f5b4806cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4c99d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b4806d050 con 0x7f5b4806c6a0 2023-10-09T15:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4c99d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b4815a750 con 0x7f5b4815df20 2023-10-09T15:38:54.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4c99d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b4815e3a0 con 0x7f5b4815d440 2023-10-09T15:38:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b46d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5b4815df20 0x7f5b4806cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b4659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 0x7f5b480aec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b45d9b700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f5b4806c6a0 0x7f5b4815d810 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:40300/0 (socket says 172.21.15.33:40300) 2023-10-09T15:38:54.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.157+0000 7f5b45d9b700 1 -- 172.21.15.33:0/569932082 learned_addr learned my addr 172.21.15.33:0/569932082 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b46d9d700 1 -- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 msgr2=0x7f5b480aec90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b46d9d700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 0x7f5b480aec90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b46d9d700 1 -- 172.21.15.33:0/569932082 >> v1:172.21.15.59:6789/0 conn(0x7f5b4806c6a0 legacy=0x7f5b4815d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b46d9d700 1 -- 172.21.15.33:0/569932082 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b48159e40 con 0x7f5b4815df20 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4659c700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 0x7f5b480aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b46d9d700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815df20 0x7f5b4806cb10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009e60 tx=0x7f5b40009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=820e0a9ac77f77c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4559a700 1 -- 172.21.15.33:0/569932082 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b4000e070 con 0x7f5b4815df20 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4559a700 1 -- 172.21.15.33:0/569932082 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b4000bb60 con 0x7f5b4815df20 2023-10-09T15:38:54.161 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4559a700 1 -- 172.21.15.33:0/569932082 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40012430 con 0x7f5b4815df20 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4c99d700 1 -- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815df20 msgr2=0x7f5b4806cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.158+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815df20 0x7f5b4806cb10 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f5b40009e60 tx=0x7f5b40009780 comp rx=0 tx=0).stop 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 -- 172.21.15.33:0/569932082 shutdown_connections 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815df20 0x7f5b4806cb10 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/569932082 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4815d440 0x7f5b480aec90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 -- 172.21.15.33:0/569932082 >> 172.21.15.33:0/569932082 conn(0x7f5b4806f190 msgr2=0x7f5b480ae580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 -- 172.21.15.33:0/569932082 shutdown_connections 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.159+0000 7f5b4c99d700 1 -- 172.21.15.33:0/569932082 wait complete. 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 Processor -- start 2023-10-09T15:38:54.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 -- start start 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4806c6a0 0x7f5b4813f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815d440 0x7f5b4814ff80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.160+0000 7f5b4c99d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480b1e20 con 0x7f5b4815df20 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b4c99d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480b2100 con 0x7f5b4815d440 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b4c99d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b480b23e0 con 0x7f5b4806c6a0 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58870/0 (socket says 172.21.15.33:58870) 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 -- 172.21.15.33:0/1965514840 learned_addr learned my addr 172.21.15.33:0/1965514840 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b4659c700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4806c6a0 0x7f5b4813f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b45d9b700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815d440 0x7f5b4814ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 -- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4806c6a0 msgr2=0x7f5b4813f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4806c6a0 0x7f5b4813f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 -- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815d440 msgr2=0x7f5b4814ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815d440 0x7f5b4814ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 -- 172.21.15.33:0/1965514840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b38009420 con 0x7f5b4815df20 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b46d9d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5b4806f590 tx=0x7f5b40019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40012ea0 con 0x7f5b4815df20 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b40027470 con 0x7f5b4815df20 2023-10-09T15:38:54.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b40009a20 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.161+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b40027850 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.162+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b48152310 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.162+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b481525c0 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.163+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5b40024070 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.163+0000 7f5b3e7fc700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 0x7f5b280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.163+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f5b400872e0 con 0x7f5b4815df20 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.163+0000 7f5b4659c700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 0x7f5b280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.167 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.164+0000 7f5b4659c700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 0x7f5b280697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009f40 tx=0x7f5b380091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.168+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b481525c0 con 0x7f5b4815df20 2023-10-09T15:38:54.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.362+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5b480b2880 con 0x7f5b4815df20 2023-10-09T15:38:54.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.363+0000 7f5b3e7fc700 1 -- 172.21.15.33:0/1965514840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+12096 (secure 0 0 0) 0x7f5b480b2880 con 0x7f5b4815df20 2023-10-09T15:38:54.364 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:54.364 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":152,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:53.581218+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":145,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 msgr2=0x7f5b280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 0x7f5b280697d0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f5b38009f40 tx=0x7f5b380091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 msgr2=0x7f5b481504c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7f5b4806f590 tx=0x7f5b40019000 comp rx=0 tx=0).stop 2023-10-09T15:38:54.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 shutdown_connections 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b28067320 0x7f5b280697d0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b4815df20 0x7f5b481504c0 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b4806c6a0 0x7f5b4813f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 --2- 172.21.15.33:0/1965514840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b4815d440 0x7f5b4814ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 >> 172.21.15.33:0/1965514840 conn(0x7f5b4806f190 msgr2=0x7f5b4815d810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 shutdown_connections 2023-10-09T15:38:54.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.365+0000 7f5b4c99d700 1 -- 172.21.15.33:0/1965514840 wait complete. 2023-10-09T15:38:54.378 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:38:54.378 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:38:54.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.499+0000 7f239743d700 1 Processor -- start 2023-10-09T15:38:54.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f239743d700 1 -- start start 2023-10-09T15:38:54.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f239743d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f239006dc70 0x7f2390159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f239743d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900ccfd0 con 0x7f239006e0e0 2023-10-09T15:38:54.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f239743d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f239015a3d0 con 0x7f2390159530 2023-10-09T15:38:54.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f239743d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f239015a6b0 con 0x7f239006dc70 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.500+0000 7f23949d8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f239006dc70 0x7f2390159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23959da700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f239006e0e0 0x7f23900cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36734/0 (socket says 172.21.15.33:36734) 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23959da700 1 -- 172.21.15.33:0/2326570059 learned_addr learned my addr 172.21.15.33:0/2326570059 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23949d8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f239006dc70 0x7f2390159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58874/0 (socket says 172.21.15.33:58874) 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23949d8700 1 -- 172.21.15.33:0/2326570059 >> v1:172.21.15.59:6789/0 conn(0x7f2390159530 legacy=0x7f23900ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23949d8700 1 -- 172.21.15.33:0/2326570059 >> v1:172.21.15.33:6789/0 conn(0x7f239006e0e0 legacy=0x7f23900cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23949d8700 1 -- 172.21.15.33:0/2326570059 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f239015a990 con 0x7f239006dc70 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f238ffff700 1 -- 172.21.15.33:0/2326570059 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2433976808 0 0) 0x7f23900ccfd0 con 0x7f239006e0e0 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f23949d8700 1 --2- 172.21.15.33:0/2326570059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006dc70 0x7f2390159900 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f23840098e0 tx=0x7f23840091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ece01aaf267afbd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f238ffff700 1 -- 172.21.15.33:0/2326570059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384009e80 con 0x7f239006dc70 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f238ffff700 1 -- 172.21.15.33:0/2326570059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238400b820 con 0x7f239006dc70 2023-10-09T15:38:54.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.501+0000 7f238ffff700 1 -- 172.21.15.33:0/2326570059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400bba0 con 0x7f239006dc70 2023-10-09T15:38:54.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 -- 172.21.15.33:0/2326570059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006dc70 msgr2=0x7f2390159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 --2- 172.21.15.33:0/2326570059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006dc70 0x7f2390159900 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f23840098e0 tx=0x7f23840091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 -- 172.21.15.33:0/2326570059 shutdown_connections 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 --2- 172.21.15.33:0/2326570059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006dc70 0x7f2390159900 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 -- 172.21.15.33:0/2326570059 >> 172.21.15.33:0/2326570059 conn(0x7f23900703a0 msgr2=0x7f23900707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 -- 172.21.15.33:0/2326570059 shutdown_connections 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.502+0000 7f239743d700 1 -- 172.21.15.33:0/2326570059 wait complete. 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.503+0000 7f239743d700 1 Processor -- start 2023-10-09T15:38:54.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.503+0000 7f239743d700 1 -- start start 2023-10-09T15:38:54.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239006dc70 0x7f2390140cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 0x7f23900b1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2390169f40 con 0x7f239006e0e0 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900b4fd0 con 0x7f239006dc70 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f239743d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900b51e0 con 0x7f2390159530 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58884/0 (socket says 172.21.15.33:58884) 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 -- 172.21.15.33:0/3234927570 learned_addr learned my addr 172.21.15.33:0/3234927570 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23959da700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 0x7f23900b1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23951d9700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239006dc70 0x7f2390140cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 -- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 msgr2=0x7f23900b1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 0x7f23900b1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 -- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239006dc70 msgr2=0x7f2390140cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239006dc70 0x7f2390140cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23949d8700 1 -- 172.21.15.33:0/3234927570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2384009420 con 0x7f239006e0e0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.504+0000 7f23959da700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 0x7f23900b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f23949d8700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f23840030c0 tx=0x7f2384016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238400ba10 con 0x7f239006e0e0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384020070 con 0x7f239006e0e0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23900b54c0 con 0x7f239006e0e0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238401b6a0 con 0x7f239006e0e0 2023-10-09T15:38:54.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.505+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900b5a80 con 0x7f239006e0e0 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.506+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23900b5c70 con 0x7f239006e0e0 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.506+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2384022030 con 0x7f239006e0e0 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.507+0000 7f238d7fa700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 0x7f237c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.507+0000 7f23951d9700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 0x7f237c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.507+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f23840868a0 con 0x7f239006e0e0 2023-10-09T15:38:54.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.507+0000 7f23951d9700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 0x7f237c0697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f23900b6480 tx=0x7f2380007420 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.512 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.511+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2384053990 con 0x7f239006e0e0 2023-10-09T15:38:54.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.705+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f23900b5c70 con 0x7f239006e0e0 2023-10-09T15:38:54.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.705+0000 7f238d7fa700 1 -- 172.21.15.33:0/3234927570 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v152) v1 ==== 93+0+10 (secure 0 0 0) 0x7f238400bbb0 con 0x7f239006e0e0 2023-10-09T15:38:54.706 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:38:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 msgr2=0x7f237c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 0x7f237c0697d0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f23900b6480 tx=0x7f2380007420 comp rx=0 tx=0).stop 2023-10-09T15:38:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 msgr2=0x7f23900c81a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7f23840030c0 tx=0x7f2384016000 comp rx=0 tx=0).stop 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 shutdown_connections 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f237c067320 0x7f237c0697d0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2390159530 0x7f23900b1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f239006dc70 0x7f2390140cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 --2- 172.21.15.33:0/3234927570 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f239006e0e0 0x7f23900c81a0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 >> 172.21.15.33:0/3234927570 conn(0x7f23900703a0 msgr2=0x7f2390153c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 shutdown_connections 2023-10-09T15:38:54.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.707+0000 7f239743d700 1 -- 172.21.15.33:0/3234927570 wait complete. 2023-10-09T15:38:54.720 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:38:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.838+0000 7f3744edc700 1 Processor -- start 2023-10-09T15:38:54.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.838+0000 7f3744edc700 1 -- start start 2023-10-09T15:38:54.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f3744edc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37400cb5a0 0x7f37400cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f3744edc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f37400cd9e0 0x7f3740159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f3744edc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f374015ae40 con 0x7f374015a400 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f3744edc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37400d13f0 con 0x7f37400cb5a0 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f3744edc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374015ab60 con 0x7f37400cd9e0 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f373e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37400cb5a0 0x7f37400cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f373e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37400cb5a0 0x7f37400cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58900/0 (socket says 172.21.15.33:58900) 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.839+0000 7f373e59c700 1 -- 172.21.15.33:0/4127793103 learned_addr learned my addr 172.21.15.33:0/4127793103 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373dd9b700 1 --2- 172.21.15.33:0/4127793103 >> v2:172.21.15.59:3300/0 conn(0x7f37400cd9e0 0x7f3740159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373e59c700 1 -- 172.21.15.33:0/4127793103 >> v2:172.21.15.59:3300/0 conn(0x7f37400cd9e0 msgr2=0x7f3740159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373e59c700 1 --2- 172.21.15.33:0/4127793103 >> v2:172.21.15.59:3300/0 conn(0x7f37400cd9e0 0x7f3740159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373e59c700 1 -- 172.21.15.33:0/4127793103 >> v1:172.21.15.59:6789/0 conn(0x7f374015a400 legacy=0x7f3740156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373e59c700 1 -- 172.21.15.33:0/4127793103 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37400ccf00 con 0x7f37400cb5a0 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373e59c700 1 --2- 172.21.15.33:0/4127793103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37400cb970 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3730009f20 tx=0x7f3730009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3b46f79a7361abb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373d59a700 1 -- 172.21.15.33:0/4127793103 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373000e070 con 0x7f37400cb5a0 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373d59a700 1 -- 172.21.15.33:0/4127793103 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373000ba00 con 0x7f37400cb5a0 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f373d59a700 1 -- 172.21.15.33:0/4127793103 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37300092e0 con 0x7f37400cb5a0 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 -- 172.21.15.33:0/4127793103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 msgr2=0x7f37400cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 --2- 172.21.15.33:0/4127793103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37400cb970 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f3730009f20 tx=0x7f3730009840 comp rx=0 tx=0).stop 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 -- 172.21.15.33:0/4127793103 shutdown_connections 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 --2- 172.21.15.33:0/4127793103 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37400cb970 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 --2- 172.21.15.33:0/4127793103 >> v2:172.21.15.59:3300/0 conn(0x7f37400cd9e0 0x7f3740159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 -- 172.21.15.33:0/4127793103 >> 172.21.15.33:0/4127793103 conn(0x7f3740070e30 msgr2=0x7f37400d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:54.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.840+0000 7f3744edc700 1 -- 172.21.15.33:0/4127793103 shutdown_connections 2023-10-09T15:38:54.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.841+0000 7f3744edc700 1 -- 172.21.15.33:0/4127793103 wait complete. 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 Processor -- start 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 -- start start 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37400cd9e0 0x7f3740151a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374015a400 0x7f3740157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3740154a10 con 0x7f37400cb5a0 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37401552b0 con 0x7f374015a400 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f3744edc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3740152370 con 0x7f37400cd9e0 2023-10-09T15:38:54.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f373e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f373e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58902/0 (socket says 172.21.15.33:58902) 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.842+0000 7f373e59c700 1 -- 172.21.15.33:0/2700490154 learned_addr learned my addr 172.21.15.33:0/2700490154 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373dd9b700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37400cd9e0 0x7f3740151a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373ed9d700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374015a400 0x7f3740157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 -- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37400cd9e0 msgr2=0x7f3740151a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37400cd9e0 0x7f3740151a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 -- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374015a400 msgr2=0x7f3740157830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374015a400 0x7f3740157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 -- 172.21.15.33:0/2700490154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3730009ae0 con 0x7f37400cb5a0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f373e59c700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f373000b6c0 tx=0x7f3730017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3730012ad0 con 0x7f37400cb5a0 2023-10-09T15:38:54.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3730012c30 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3740154c60 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373001d420 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.843+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3740151f60 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.844+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f374004c3c0 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.845+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f373001d870 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.845+0000 7f37367fc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 0x7f37200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.845+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f37300861a0 con 0x7f37400cb5a0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.845+0000 7f373dd9b700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 0x7f37200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:54.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.845+0000 7f373dd9b700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 0x7f37200697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f37400cca30 tx=0x7f3728008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:54.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:54.849+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3730053070 con 0x7f37400cb5a0 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.044+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f3740155100 con 0x7f37400cb5a0 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.045+0000 7f37367fc700 1 -- 172.21.15.33:0/2700490154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v152) v1 ==== 84+0+65 (secure 0 0 0) 0x7f3730056690 con 0x7f37400cb5a0 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:38:55.046 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:38:55.047 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:38:55.047 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:38:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 msgr2=0x7f37200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 0x7f37200697d0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f37400cca30 tx=0x7f3728008040 comp rx=0 tx=0).stop 2023-10-09T15:38:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 msgr2=0x7f37401504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f373000b6c0 tx=0x7f3730017000 comp rx=0 tx=0).stop 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 shutdown_connections 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3720067320 0x7f37200697d0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37400cb5a0 0x7f37401504d0 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f374015a400 0x7f3740157830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 --2- 172.21.15.33:0/2700490154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37400cd9e0 0x7f3740151a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 >> 172.21.15.33:0/2700490154 conn(0x7f3740070e30 msgr2=0x7f37400b05b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 shutdown_connections 2023-10-09T15:38:55.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.047+0000 7f3744edc700 1 -- 172.21.15.33:0/2700490154 wait complete. 2023-10-09T15:38:55.060 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:38:55.060 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:38:55.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.181+0000 7f273a15c700 1 Processor -- start 2023-10-09T15:38:55.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 -- start start 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2734159530 0x7f27340ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f27340cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27340cc090 con 0x7f273406dcf0 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27340ccfd0 con 0x7f2734159530 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.182+0000 7f273a15c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f273415a410 con 0x7f27340cb6f0 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f2732ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f273406dcf0 0x7f2734159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36744/0 (socket says 172.21.15.33:36744) 2023-10-09T15:38:55.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f2732ffd700 1 -- 172.21.15.33:0/2568527985 learned_addr learned my addr 172.21.15.33:0/2568527985 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f2733fff700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f27340cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27337fe700 1 --2- 172.21.15.33:0/2568527985 >> v2:172.21.15.59:3300/0 conn(0x7f2734159530 0x7f27340ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3246758311 0 0) 0x7f2728001110 con 0x7f273406dcf0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f271c003570 con 0x7f273406dcf0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2130580614 0 0) 0x7f271c003570 con 0x7f273406dcf0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 msgr2=0x7f27340cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f27340cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 >> v2:172.21.15.59:3300/0 conn(0x7f2734159530 msgr2=0x7f27340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 --2- 172.21.15.33:0/2568527985 >> v2:172.21.15.59:3300/0 conn(0x7f2734159530 0x7f27340ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273415a6f0 con 0x7f273406dcf0 2023-10-09T15:38:55.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f2728001600 con 0x7f273406dcf0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 >> v1:172.21.15.33:6789/0 conn(0x7f273406dcf0 legacy=0x7f2734159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f271c003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f271c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c004d50 0x7f271c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340ccfd0 con 0x7f271c003fe0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f273415a410 con 0x7f271c004d50 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271c00ba90 con 0x7f27340cb6f0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f2732ffd700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f271c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f27337fe700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f271c003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.183+0000 7f2733fff700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c004d50 0x7f271c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 -- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 msgr2=0x7f271c003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f27340cb6f0 0x7f271c003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 -- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c004d50 msgr2=0x7f271c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f271c004d50 0x7f271c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 -- 172.21.15.33:0/2568527985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f271c003570 con 0x7f271c003fe0 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2732ffd700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f271c004810 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f272800c5f0 tx=0x7f2728007a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=516111bfb22579ed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f272800cd90 con 0x7f271c003fe0 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2728005920 con 0x7f271c003fe0 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f27327fc700 1 -- 172.21.15.33:0/2568527985 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2728005ce0 con 0x7f271c003fe0 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f273a15c700 1 -- 172.21.15.33:0/2568527985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 msgr2=0x7f271c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f273a15c700 1 --2- 172.21.15.33:0/2568527985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f271c004810 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f272800c5f0 tx=0x7f2728007a80 comp rx=0 tx=0).stop 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f2733fff700 1 -- 172.21.15.33:0/2568527985 reap_dead start 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.184+0000 7f273a15c700 1 -- 172.21.15.33:0/2568527985 shutdown_connections 2023-10-09T15:38:55.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.185+0000 7f273a15c700 1 -- 172.21.15.33:0/2568527985 >> 172.21.15.33:0/2568527985 conn(0x7f27340703a0 msgr2=0x7f27340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.185+0000 7f273a15c700 1 -- 172.21.15.33:0/2568527985 shutdown_connections 2023-10-09T15:38:55.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.185+0000 7f273a15c700 1 -- 172.21.15.33:0/2568527985 wait complete. 2023-10-09T15:38:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.186+0000 7f273a15c700 1 Processor -- start 2023-10-09T15:38:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.186+0000 7f273a15c700 1 -- start start 2023-10-09T15:38:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273416b8e0 0x7f27340c5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27340c59c0 0x7f273416a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340b60f0 con 0x7f271c003fe0 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27340c5e30 con 0x7f27340c59c0 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27341558f0 con 0x7f273416b8e0 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58914/0 (socket says 172.21.15.33:58914) 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 -- 172.21.15.33:0/823876125 learned_addr learned my addr 172.21.15.33:0/823876125 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f2732ffd700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273416b8e0 0x7f27340c5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 -- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273416b8e0 msgr2=0x7f27340c5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273416b8e0 0x7f27340c5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 -- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27340c59c0 msgr2=0x7f273416a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f2733fff700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27340c59c0 0x7f273416a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27340c59c0 0x7f273416a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 -- 172.21.15.33:0/823876125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f273416b6b0 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f27337fe700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2724011d70 tx=0x7f27240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724009e20 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f272400fc50 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f273416b3d0 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2724014440 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2734155580 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.188+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f273404c3c0 con 0x7f271c003fe0 2023-10-09T15:38:55.194 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.189+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2724014870 con 0x7f271c003fe0 2023-10-09T15:38:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.189+0000 7f271b7fe700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 0x7f27200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.189+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f2724018030 con 0x7f271c003fe0 2023-10-09T15:38:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.189+0000 7f2732ffd700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 0x7f27200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.190+0000 7f2732ffd700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 0x7f27200697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2728008fd0 tx=0x7f2728015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.195 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.195+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2724052430 con 0x7f271c003fe0 2023-10-09T15:38:55.387 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.386+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f273415a9d0 con 0x7f271c003fe0 2023-10-09T15:38:55.590 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.589+0000 7f271b7fe700 1 -- 172.21.15.33:0/823876125 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v153) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2724055a50 con 0x7f271c003fe0 2023-10-09T15:38:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 msgr2=0x7f27200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 0x7f27200697d0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f2728008fd0 tx=0x7f2728015000 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 msgr2=0x7f273416d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f2724011d70 tx=0x7f27240091a0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 shutdown_connections 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2720067320 0x7f27200697d0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f271c003fe0 0x7f273416d680 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f27340c59c0 0x7f273416a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 --2- 172.21.15.33:0/823876125 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f273416b8e0 0x7f27340c5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.593+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 >> 172.21.15.33:0/823876125 conn(0x7f27340703a0 msgr2=0x7f27340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:55.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.594+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 shutdown_connections 2023-10-09T15:38:55.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.594+0000 7f273a15c700 1 -- 172.21.15.33:0/823876125 wait complete. 2023-10-09T15:38:55.597 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:38:55.609 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:38:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.734+0000 7f4c50d18700 1 Processor -- start 2023-10-09T15:38:55.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.734+0000 7f4c50d18700 1 -- start start 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c4c159530 0x7f4c4c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c4c06dc70 0x7f4c4c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c06e0e0 0x7f4c4c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0ccfd0 con 0x7f4c4c159530 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c4c0cf0e0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c50d18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c15a3d0 con 0x7f4c4c06e0e0 2023-10-09T15:38:55.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c4a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c4c159530 0x7f4c4c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c4a59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c4c159530 0x7f4c4c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58922/0 (socket says 172.21.15.33:58922) 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.735+0000 7f4c4a59c700 1 -- 172.21.15.33:0/2264538099 learned_addr learned my addr 172.21.15.33:0/2264538099 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c49d9b700 1 --2- 172.21.15.33:0/2264538099 >> v2:172.21.15.59:3300/0 conn(0x7f4c4c06dc70 0x7f4c4c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4ad9d700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c06e0e0 0x7f4c4c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 -- 172.21.15.33:0/2264538099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c06e0e0 msgr2=0x7f4c4c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c06e0e0 0x7f4c4c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 -- 172.21.15.33:0/2264538099 >> v2:172.21.15.59:3300/0 conn(0x7f4c4c06dc70 msgr2=0x7f4c4c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/2264538099 >> v2:172.21.15.59:3300/0 conn(0x7f4c4c06dc70 0x7f4c4c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 -- 172.21.15.33:0/2264538099 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c4c15a6b0 con 0x7f4c4c159530 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c159530 0x7f4c4c0ceba0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b66e0 tx=0x7f4c3c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b36facb703ac5725 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.739 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4959a700 1 -- 172.21.15.33:0/2264538099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00b640 con 0x7f4c4c159530 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4959a700 1 -- 172.21.15.33:0/2264538099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00b7a0 con 0x7f4c4c159530 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.736+0000 7f4c4959a700 1 -- 172.21.15.33:0/2264538099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c00bb60 con 0x7f4c4c159530 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 -- 172.21.15.33:0/2264538099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c159530 msgr2=0x7f4c4c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c159530 0x7f4c4c0ceba0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b66e0 tx=0x7f4c3c009250 comp rx=0 tx=0).stop 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 -- 172.21.15.33:0/2264538099 shutdown_connections 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c06e0e0 0x7f4c4c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 --2- 172.21.15.33:0/2264538099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c159530 0x7f4c4c0ceba0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 --2- 172.21.15.33:0/2264538099 >> v2:172.21.15.59:3300/0 conn(0x7f4c4c06dc70 0x7f4c4c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 -- 172.21.15.33:0/2264538099 >> 172.21.15.33:0/2264538099 conn(0x7f4c4c0703a0 msgr2=0x7f4c4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 -- 172.21.15.33:0/2264538099 shutdown_connections 2023-10-09T15:38:55.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.737+0000 7f4c50d18700 1 -- 172.21.15.33:0/2264538099 wait complete. 2023-10-09T15:38:55.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.738+0000 7f4c50d18700 1 Processor -- start 2023-10-09T15:38:55.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.738+0000 7f4c50d18700 1 -- start start 2023-10-09T15:38:55.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4c06e0e0 0x7f4c4c16ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c159530 0x7f4c4c0c9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c151fc0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c0caad0 con 0x7f4c4c06e0e0 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c50d18700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c4c15cd40 con 0x7f4c4c159530 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58936/0 (socket says 172.21.15.33:58936) 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 -- 172.21.15.33:0/1398027074 learned_addr learned my addr 172.21.15.33:0/1398027074 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4ad9d700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c159530 0x7f4c4c0c9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c49d9b700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4c06e0e0 0x7f4c4c16ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 -- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c159530 msgr2=0x7f4c4c0c9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c159530 0x7f4c4c0c9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.744 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 -- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4c06e0e0 msgr2=0x7f4c4c16ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4c06e0e0 0x7f4c4c16ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 -- 172.21.15.33:0/1398027074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c3c0094f0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c4a59c700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c089650 tx=0x7f4c3c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.739+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c000d10 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.740+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c3c00bb20 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.740+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c4c15d4f0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.740+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c3c011670 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.740+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c4c15dab0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.741+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c4c04c3c0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.741+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4c3c0119e0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.742+0000 7f4c427fc700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 0x7f4c2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:55.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.742+0000 7f4c49d9b700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 0x7f4c2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:55.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.742+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f4c3c0861e0 con 0x7f4c4c06dc70 2023-10-09T15:38:55.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.742+0000 7f4c49d9b700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 0x7f4c2c0697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b3810 tx=0x7f4c34008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:55.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.747+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c3c053050 con 0x7f4c4c06dc70 2023-10-09T15:38:55.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:55.939+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f4c4c15a990 con 0x7f4c4c06dc70 2023-10-09T15:38:56.593 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.593+0000 7f4c427fc700 1 -- 172.21.15.33:0/1398027074 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v154) v1 ==== 170+0+0 (secure 0 0 0) 0x7f4c3c056670 con 0x7f4c4c06dc70 2023-10-09T15:38:56.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.598+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 msgr2=0x7f4c2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.598+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 0x7f4c2c0697d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b3810 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.598+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 msgr2=0x7f4c4c151a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.598+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c089650 tx=0x7f4c3c017000 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 shutdown_connections 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c2c067320 0x7f4c2c0697d0 secure :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b3810 tx=0x7f4c34008040 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c4c06dc70 0x7f4c4c151a80 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c4c159530 0x7f4c4c0c9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 --2- 172.21.15.33:0/1398027074 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c4c06e0e0 0x7f4c4c16ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.599+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 >> 172.21.15.33:0/1398027074 conn(0x7f4c4c0703a0 msgr2=0x7f4c4c0b2810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:56.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.600+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 shutdown_connections 2023-10-09T15:38:56.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.604+0000 7f4c50d18700 1 -- 172.21.15.33:0/1398027074 wait complete. 2023-10-09T15:38:56.611 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:38:56.626 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:38:56.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.753+0000 7f1850504700 1 Processor -- start 2023-10-09T15:38:56.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.753+0000 7f1850504700 1 -- start start 2023-10-09T15:38:56.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f1850504700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18480cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f1850504700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18480ccfd0 con 0x7f1848159530 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f1850504700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f184815a3d0 con 0x7f184806dc70 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f1850504700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f184815a6b0 con 0x7f184806e0e0 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184e2a0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1848159530 0x7f18480ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36754/0 (socket says 172.21.15.33:36754) 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184e2a0700 1 -- 172.21.15.33:0/397192599 learned_addr learned my addr 172.21.15.33:0/397192599 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184eaa1700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18480cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1707655702 0 0) 0x7f18480ccfd0 con 0x7f1848159530 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1830003570 con 0x7f1848159530 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4062920701 0 0) 0x7f184815a3d0 con 0x7f184806dc70 2023-10-09T15:38:56.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18480ccfd0 con 0x7f184806dc70 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3165473197 0 0) 0x7f1830003570 con 0x7f1848159530 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 msgr2=0x7f18480cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18480cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 >> v1:172.21.15.59:6789/0 conn(0x7f184806dc70 legacy=0x7f1848159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f184815a990 con 0x7f1848159530 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1838001470 con 0x7f1848159530 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184eaa1700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18480cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 >> v1:172.21.15.33:6789/0 conn(0x7f1848159530 legacy=0x7f18480ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1830003c20 0x7f1830004010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1830004810 0x7f1830004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18300051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.754+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f184815a6b0 con 0x7f1830003c20 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183000bb70 con 0x7f1830004810 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f183000bd30 con 0x7f184806e0e0 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1830003c20 0x7f1830004010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184da9f700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1830004810 0x7f1830004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184eaa1700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18300051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 -- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 msgr2=0x7f18300051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f184806e0e0 0x7f18300051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 -- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1830004810 msgr2=0x7f1830004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1830004810 0x7f1830004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 -- 172.21.15.33:0/397192599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1840009a20 con 0x7f1830003c20 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184da9f700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1830004810 0x7f1830004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:56.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184e2a0700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1830003c20 0x7f1830004010 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f183800c2d0 tx=0x7f1838001e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=692632d67110299b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f183800cba0 con 0x7f1830003c20 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f183800cd00 con 0x7f1830003c20 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.755+0000 7f184d29e700 1 -- 172.21.15.33:0/397192599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1838005b70 con 0x7f1830003c20 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 -- 172.21.15.33:0/397192599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1830003c20 msgr2=0x7f1830004010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 --2- 172.21.15.33:0/397192599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1830003c20 0x7f1830004010 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f183800c2d0 tx=0x7f1838001e10 comp rx=0 tx=0).stop 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f184eaa1700 1 -- 172.21.15.33:0/397192599 reap_dead start 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 -- 172.21.15.33:0/397192599 shutdown_connections 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 -- 172.21.15.33:0/397192599 >> 172.21.15.33:0/397192599 conn(0x7f18480703a0 msgr2=0x7f18480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 -- 172.21.15.33:0/397192599 shutdown_connections 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.756+0000 7f1850504700 1 -- 172.21.15.33:0/397192599 wait complete. 2023-10-09T15:38:56.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.757+0000 7f1850504700 1 Processor -- start 2023-10-09T15:38:56.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.757+0000 7f1850504700 1 -- start start 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.757+0000 7f1850504700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 0x7f184816dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.757+0000 7f1850504700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18480b5da0 0x7f18481422c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c9c20 con 0x7f18480ca0b0 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c79e0 con 0x7f18480b5da0 2023-10-09T15:38:56.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18480c92f0 con 0x7f1830003c20 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184e2a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 0x7f184816dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58948/0 (socket says 172.21.15.33:58948) 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184e2a0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 0x7f184816dc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:34720/0 (socket says 172.21.15.33:34720) 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184da9f700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18480b5da0 0x7f18481422c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 -- 172.21.15.33:0/348758049 learned_addr learned my addr 172.21.15.33:0/348758049 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 -- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 msgr2=0x7f184816dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 0x7f184816dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 -- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18480b5da0 msgr2=0x7f18481422c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18480b5da0 0x7f18481422c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 -- 172.21.15.33:0/348758049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18480c95d0 con 0x7f18480ca0b0 2023-10-09T15:38:56.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f184eaa1700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f18480b3220 tx=0x7f184000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f184000e070 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1840011bf0 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18480c98b0 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1840016470 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.758+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1848142800 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.759+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18480c9d90 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.760+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1840016820 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.760+0000 7f18467fc700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 0x7f18340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.760+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(154..154 src has 1..154) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f1840085900 con 0x7f18480ca0b0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.760+0000 7f184e2a0700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 0x7f18340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:56.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.761+0000 7f184e2a0700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 0x7f18340697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1838007c90 tx=0x7f1838015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:56.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:56.765+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18400524a0 con 0x7f18480ca0b0 2023-10-09T15:38:57.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.003+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f184804c3c0 con 0x7f18480ca0b0 2023-10-09T15:38:57.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.632+0000 7f18467fc700 1 -- 172.21.15.33:0/348758049 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v99) v1 ==== 174+0+0 (secure 0 0 0) 0x7f18400580c0 con 0x7f18480ca0b0 2023-10-09T15:38:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.640+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 msgr2=0x7f18340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.640+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 0x7f18340697d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f1838007c90 tx=0x7f1838015000 comp rx=0 tx=0).stop 2023-10-09T15:38:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.640+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 msgr2=0x7f18480ca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.640+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f18480b3220 tx=0x7f184000b040 comp rx=0 tx=0).stop 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 shutdown_connections 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1834067320 0x7f18340697d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18480ca0b0 0x7f18480ca520 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1830003c20 0x7f184816dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 --2- 172.21.15.33:0/348758049 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18480b5da0 0x7f18481422c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.645+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 >> 172.21.15.33:0/348758049 conn(0x7f18480703a0 msgr2=0x7f1848070a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:57.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.646+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 shutdown_connections 2023-10-09T15:38:57.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.647+0000 7f1850504700 1 -- 172.21.15.33:0/348758049 wait complete. 2023-10-09T15:38:57.647 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 26 and data pool 27 2023-10-09T15:38:57.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:57.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.784+0000 7f313e48b700 1 Processor -- start 2023-10-09T15:38:57.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.784+0000 7f313e48b700 1 -- start start 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313e48b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 0x7f3138164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313e48b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313815afd0 con 0x7f313815de50 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313e48b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f313815b2b0 con 0x7f3138153c30 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313e48b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f313815b590 con 0x7f31380cf110 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313cc88700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f313815de50 0x7f31380cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36758/0 (socket says 172.21.15.33:36758) 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313cc88700 1 -- 172.21.15.33:0/1419440374 learned_addr learned my addr 172.21.15.33:0/1419440374 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f313dc8a700 1 --2- 172.21.15.33:0/1419440374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 0x7f3138164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2967012649 0 0) 0x7f313815afd0 con 0x7f313815de50 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.785+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3124003570 con 0x7f313815de50 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251906385 0 0) 0x7f313815b2b0 con 0x7f3138153c30 2023-10-09T15:38:57.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f313815afd0 con 0x7f3138153c30 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f313dc8a700 1 -- 172.21.15.33:0/1419440374 >> v1:172.21.15.59:6789/0 conn(0x7f3138153c30 legacy=0x7f313815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1539195288 0 0) 0x7f3124003570 con 0x7f313815de50 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f313dc8a700 1 -- 172.21.15.33:0/1419440374 >> v1:172.21.15.33:6789/0 conn(0x7f313815de50 legacy=0x7f31380cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f313dc8a700 1 -- 172.21.15.33:0/1419440374 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f313815b870 con 0x7f31380cf110 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f313dc8a700 1 --2- 172.21.15.33:0/1419440374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 0x7f3138164600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3130009e90 tx=0x7f3130009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=65396585218c1785 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f313000e070 con 0x7f31380cf110 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f313000b870 con 0x7f31380cf110 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.786+0000 7f312ffff700 1 -- 172.21.15.33:0/1419440374 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3128001470 con 0x7f31380cf110 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 -- 172.21.15.33:0/1419440374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 msgr2=0x7f3138164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 --2- 172.21.15.33:0/1419440374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 0x7f3138164600 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3130009e90 tx=0x7f3130009780 comp rx=0 tx=0).stop 2023-10-09T15:38:57.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 -- 172.21.15.33:0/1419440374 shutdown_connections 2023-10-09T15:38:57.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 --2- 172.21.15.33:0/1419440374 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31380cf110 0x7f3138164600 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 -- 172.21.15.33:0/1419440374 >> 172.21.15.33:0/1419440374 conn(0x7f31380703a0 msgr2=0x7f31380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:57.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 -- 172.21.15.33:0/1419440374 shutdown_connections 2023-10-09T15:38:57.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.787+0000 7f313e48b700 1 -- 172.21.15.33:0/1419440374 wait complete. 2023-10-09T15:38:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.788+0000 7f313e48b700 1 Processor -- start 2023-10-09T15:38:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.788+0000 7f313e48b700 1 -- start start 2023-10-09T15:38:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3138153c30 0x7f31380b4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:57.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313815de50 0x7f31380b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380cbfb0 con 0x7f31380cf110 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31380cc290 con 0x7f313815de50 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31380cc570 con 0x7f3138153c30 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58950/0 (socket says 172.21.15.33:58950) 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 -- 172.21.15.33:0/1238787204 learned_addr learned my addr 172.21.15.33:0/1238787204 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313dc8a700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313815de50 0x7f31380b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313cc88700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3138153c30 0x7f31380b4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 -- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3138153c30 msgr2=0x7f31380b4e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3138153c30 0x7f31380b4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 -- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313815de50 msgr2=0x7f31380b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313815de50 0x7f31380b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 -- 172.21.15.33:0/1238787204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3130009a20 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313d489700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f313400c790 tx=0x7f3134007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134010510 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31380cc850 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3134010670 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3134010a10 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.789+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31381690c0 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.790+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f313804c3c0 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.791+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f313401b400 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.791+0000 7f312d7fa700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 0x7f311c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.791+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3134084a90 con 0x7f31380cf110 2023-10-09T15:38:57.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.791+0000 7f313cc88700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 0x7f311c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:57.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.792+0000 7f313cc88700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 0x7f311c0697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f31280015a0 tx=0x7f3128009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:57.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.796+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3134051720 con 0x7f31380cf110 2023-10-09T15:38:57.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.989+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31380c77d0 con 0x7f31380cf110 2023-10-09T15:38:57.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.989+0000 7f312d7fa700 1 -- 172.21.15.33:0/1238787204 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f3134054d40 con 0x7f31380cf110 2023-10-09T15:38:57.990 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:57.990 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":155,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:57.003947+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 msgr2=0x7f311c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 0x7f311c0697d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f31280015a0 tx=0x7f3128009040 comp rx=0 tx=0).stop 2023-10-09T15:38:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 msgr2=0x7f31380b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f313400c790 tx=0x7f3134007e10 comp rx=0 tx=0).stop 2023-10-09T15:38:57.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 shutdown_connections 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f311c067320 0x7f311c0697d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f31380cf110 0x7f31380b32d0 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f313815de50 0x7f31380b5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 --2- 172.21.15.33:0/1238787204 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3138153c30 0x7f31380b4e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 >> 172.21.15.33:0/1238787204 conn(0x7f31380703a0 msgr2=0x7f31380d0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 shutdown_connections 2023-10-09T15:38:57.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:57.992+0000 7f313e48b700 1 -- 172.21.15.33:0/1238787204 wait complete. 2023-10-09T15:38:58.004 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:38:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.124+0000 7fba37ff2700 1 Processor -- start 2023-10-09T15:38:58.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.124+0000 7fba37ff2700 1 -- start start 2023-10-09T15:38:58.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba37ff2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba30159850 0x7fba300adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba37ff2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba30159c20 0x7fba300ae4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba37ff2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba300adb20 con 0x7fba300b0930 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba37ff2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300ccdc0 con 0x7fba30159c20 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba37ff2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300acf10 con 0x7fba30159850 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba30159c20 0x7fba300ae4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fba30159c20 0x7fba300ae4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58954/0 (socket says 172.21.15.33:58954) 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 -- 172.21.15.33:0/3836032038 learned_addr learned my addr 172.21.15.33:0/3836032038 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba35d8e700 1 --2- 172.21.15.33:0/3836032038 >> v2:172.21.15.59:3300/0 conn(0x7fba30159850 0x7fba300adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 -- 172.21.15.33:0/3836032038 >> v2:172.21.15.59:3300/0 conn(0x7fba30159850 msgr2=0x7fba300adfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 --2- 172.21.15.33:0/3836032038 >> v2:172.21.15.59:3300/0 conn(0x7fba30159850 0x7fba300adfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 -- 172.21.15.33:0/3836032038 >> v1:172.21.15.59:6789/0 conn(0x7fba300b0930 legacy=0x7fba300c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 -- 172.21.15.33:0/3836032038 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300ad1f0 con 0x7fba30159c20 2023-10-09T15:38:58.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.125+0000 7fba3558d700 1 --2- 172.21.15.33:0/3836032038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba30159c20 0x7fba300ae4f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fba30069620 tx=0x7fba20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1db4dd7823d809a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba34d8c700 1 -- 172.21.15.33:0/3836032038 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000b860 con 0x7fba30159c20 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba34d8c700 1 -- 172.21.15.33:0/3836032038 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000b9c0 con 0x7fba30159c20 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba34d8c700 1 -- 172.21.15.33:0/3836032038 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000bd60 con 0x7fba30159c20 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 -- 172.21.15.33:0/3836032038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba30159c20 msgr2=0x7fba300ae4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3836032038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba30159c20 0x7fba300ae4f0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fba30069620 tx=0x7fba20009250 comp rx=0 tx=0).stop 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 -- 172.21.15.33:0/3836032038 shutdown_connections 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3836032038 >> v2:172.21.15.59:3300/0 conn(0x7fba30159850 0x7fba300adfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3836032038 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba30159c20 0x7fba300ae4f0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 -- 172.21.15.33:0/3836032038 >> 172.21.15.33:0/3836032038 conn(0x7fba3006d170 msgr2=0x7fba300cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 -- 172.21.15.33:0/3836032038 shutdown_connections 2023-10-09T15:38:58.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.126+0000 7fba37ff2700 1 -- 172.21.15.33:0/3836032038 wait complete. 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.127+0000 7fba37ff2700 1 Processor -- start 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.127+0000 7fba37ff2700 1 -- start start 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba30159850 0x7fba30154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30159c20 0x7fba3016a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.131 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014daa0 con 0x7fba300b0930 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014ce90 con 0x7fba30159c20 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba37ff2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014d170 con 0x7fba30159850 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58970/0 (socket says 172.21.15.33:58970) 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 -- 172.21.15.33:0/3676065523 learned_addr learned my addr 172.21.15.33:0/3676065523 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba3558d700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba30159850 0x7fba30154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba3658f700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30159c20 0x7fba3016a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 -- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba30159850 msgr2=0x7fba30154270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba30159850 0x7fba30154270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 -- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30159c20 msgr2=0x7fba3016a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30159c20 0x7fba3016a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.132 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.128+0000 7fba35d8e700 1 -- 172.21.15.33:0/3676065523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba200094f0 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba35d8e700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00d890 tx=0x7fba2c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c0125f0 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2c012770 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2c012b30 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba3014d450 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.129+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba30157680 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.130+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3004c3c0 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.130+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fba2c01e460 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.131+0000 7fba25ffb700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 0x7fba140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.131+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fba2c085280 con 0x7fba300b0930 2023-10-09T15:38:58.133 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.131+0000 7fba3558d700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 0x7fba140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.134 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.131+0000 7fba3558d700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 0x7fba140697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba30069620 tx=0x7fba20017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.135 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.135+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba2c051ed0 con 0x7fba300b0930 2023-10-09T15:38:58.332 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.332+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fba300ad4d0 con 0x7fba300b0930 2023-10-09T15:38:58.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.333+0000 7fba25ffb700 1 -- 172.21.15.33:0/3676065523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v155) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fba2c0554f0 con 0x7fba300b0930 2023-10-09T15:38:58.333 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:38:58.333 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":155,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:57.003947+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.335+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 msgr2=0x7fba140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.335+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 0x7fba140697d0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fba30069620 tx=0x7fba20017000 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.335+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 msgr2=0x7fba3014c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.335+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00d890 tx=0x7fba2c008040 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 shutdown_connections 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba14067320 0x7fba140697d0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba300b0930 0x7fba3014c540 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba30159c20 0x7fba3016a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 --2- 172.21.15.33:0/3676065523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba30159850 0x7fba30154270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 >> 172.21.15.33:0/3676065523 conn(0x7fba3006d170 msgr2=0x7fba300af440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:58.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 shutdown_connections 2023-10-09T15:38:58.337 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.336+0000 7fba37ff2700 1 -- 172.21.15.33:0/3676065523 wait complete. 2023-10-09T15:38:58.348 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:38:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.471+0000 7f3dd0a20700 1 Processor -- start 2023-10-09T15:38:58.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.471+0000 7f3dd0a20700 1 -- start start 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3dcc159530 0x7f3dcc0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dcc06dc70 0x7f3dcc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0ccfd0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3dcc0cf0e0 con 0x7f3dcc159530 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dd0a20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc15a3d0 con 0x7f3dcc06e0e0 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dc9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dcc06dc70 0x7f3dcc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dc9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3dcc06dc70 0x7f3dcc159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58984/0 (socket says 172.21.15.33:58984) 2023-10-09T15:38:58.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.472+0000 7f3dc9d9b700 1 -- 172.21.15.33:0/4214754242 learned_addr learned my addr 172.21.15.33:0/4214754242 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dca59c700 1 --2- 172.21.15.33:0/4214754242 >> v2:172.21.15.59:3300/0 conn(0x7f3dcc159530 0x7f3dcc0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dcad9d700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 -- 172.21.15.33:0/4214754242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 msgr2=0x7f3dcc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 -- 172.21.15.33:0/4214754242 >> v2:172.21.15.59:3300/0 conn(0x7f3dcc159530 msgr2=0x7f3dcc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/4214754242 >> v2:172.21.15.59:3300/0 conn(0x7f3dcc159530 0x7f3dcc0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 -- 172.21.15.33:0/4214754242 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dcc15a6b0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc159900 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06d630 tx=0x7f3db4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96c3148567e6a547 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc959a700 1 -- 172.21.15.33:0/4214754242 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400b860 con 0x7f3dcc06dc70 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc959a700 1 -- 172.21.15.33:0/4214754242 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3db400b9c0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dc959a700 1 -- 172.21.15.33:0/4214754242 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3db400bd60 con 0x7f3dcc06dc70 2023-10-09T15:38:58.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dd0a20700 1 -- 172.21.15.33:0/4214754242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 msgr2=0x7f3dcc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.473+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc159900 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06d630 tx=0x7f3db4009250 comp rx=0 tx=0).stop 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 -- 172.21.15.33:0/4214754242 shutdown_connections 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/4214754242 >> v2:172.21.15.59:3300/0 conn(0x7f3dcc159530 0x7f3dcc0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/4214754242 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc159900 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 -- 172.21.15.33:0/4214754242 >> 172.21.15.33:0/4214754242 conn(0x7f3dcc0703a0 msgr2=0x7f3dcc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 -- 172.21.15.33:0/4214754242 shutdown_connections 2023-10-09T15:38:58.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.474+0000 7f3dd0a20700 1 -- 172.21.15.33:0/4214754242 wait complete. 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 Processor -- start 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 -- start start 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0d02d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 0x7f3dcc0b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc1514b0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc0ca950 con 0x7f3dcc159530 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.475+0000 7f3dd0a20700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3dcc16db00 con 0x7f3dcc06e0e0 2023-10-09T15:38:58.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58992/0 (socket says 172.21.15.33:58992) 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 -- 172.21.15.33:0/2001517431 learned_addr learned my addr 172.21.15.33:0/2001517431 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dcad9d700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 0x7f3dcc0b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0d02d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 -- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 msgr2=0x7f3dcc0d02d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0d02d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 -- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 msgr2=0x7f3dcc0b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 0x7f3dcc0b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 -- 172.21.15.33:0/2001517431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db40094f0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dcad9d700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 0x7f3dcc0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dca59c700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00d890 tx=0x7f3dbc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc009610 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dbc009770 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3dcc0ca390 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dbc009b30 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.476+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3dcc16d790 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.477+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3dcc16d920 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.477+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3dbc01e460 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.478+0000 7f3dc27fc700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 0x7f3dac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.478+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(155..155 src has 1..155) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3dbc085220 con 0x7f3dcc06dc70 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.478+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 0x7f3dac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:58.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.478+0000 7f3dc9d9b700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 0x7f3dac0697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06d630 tx=0x7f3db4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:58.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.482+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3dbc051eb0 con 0x7f3dcc06dc70 2023-10-09T15:38:58.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:58.731+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f3dcc16dde0 con 0x7f3dcc06dc70 2023-10-09T15:38:59.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.643+0000 7f3dc27fc700 1 -- 172.21.15.33:0/2001517431 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v102) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3dbc0554d0 con 0x7f3dcc06dc70 2023-10-09T15:38:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 msgr2=0x7f3dac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 0x7f3dac0697d0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f3dcc06d630 tx=0x7f3db4017000 comp rx=0 tx=0).stop 2023-10-09T15:38:59.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 msgr2=0x7f3dcc150f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc00d890 tx=0x7f3dbc008040 comp rx=0 tx=0).stop 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 shutdown_connections 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3dac067320 0x7f3dac0697d0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3dcc06dc70 0x7f3dcc150f70 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3dcc159530 0x7f3dcc0b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 --2- 172.21.15.33:0/2001517431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3dcc06e0e0 0x7f3dcc0d02d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 >> 172.21.15.33:0/2001517431 conn(0x7f3dcc0703a0 msgr2=0x7f3dcc154590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 shutdown_connections 2023-10-09T15:38:59.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.646+0000 7f3dd0a20700 1 -- 172.21.15.33:0/2001517431 wait complete. 2023-10-09T15:38:59.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:38:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.790+0000 7f31a0c93700 1 Processor -- start 2023-10-09T15:38:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.790+0000 7f31a0c93700 1 -- start start 2023-10-09T15:38:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.791+0000 7f31a0c93700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f319c0cd2b0 0x7f319c0ca730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.791+0000 7f31a0c93700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0c32a0 con 0x7f319c0ca2c0 2023-10-09T15:38:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.791+0000 7f31a0c93700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f319c0c4100 con 0x7f319c157930 2023-10-09T15:38:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.791+0000 7f31a0c93700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f319c0c9730 con 0x7f319c0cd2b0 2023-10-09T15:38:59.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.791+0000 7f3199d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f319c0ca2c0 0x7f319c0ccba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:36774/0 (socket says 172.21.15.33:36774) 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f3199d9b700 1 -- 172.21.15.33:0/1563158524 learned_addr learned my addr 172.21.15.33:0/1563158524 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319ad9d700 1 --2- 172.21.15.33:0/1563158524 >> v2:172.21.15.59:3300/0 conn(0x7f319c0cd2b0 0x7f319c0ca730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1588267550 0 0) 0x7f319c0c32a0 con 0x7f319c0ca2c0 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3188003570 con 0x7f319c0ca2c0 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3553815230 0 0) 0x7f319c0c4100 con 0x7f319c157930 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f319c0c32a0 con 0x7f319c157930 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 424829821 0 0) 0x7f3188003570 con 0x7f319c0ca2c0 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 >> v2:172.21.15.59:3300/0 conn(0x7f319c0cd2b0 msgr2=0x7f319c0ca730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 --2- 172.21.15.33:0/1563158524 >> v2:172.21.15.59:3300/0 conn(0x7f319c0cd2b0 0x7f319c0ca730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 >> v1:172.21.15.59:6789/0 conn(0x7f319c157930 legacy=0x7f319c0ab070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c0c34f0 con 0x7f319c0ca2c0 2023-10-09T15:38:59.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3184001470 con 0x7f319c0ca2c0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 >> v1:172.21.15.33:6789/0 conn(0x7f319c0ca2c0 legacy=0x7f319c0ccba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 0x7f3188003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188004810 0x7f3188004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31880051c0 0x7f318800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0c9730 con 0x7f3188003bf0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f318800c160 con 0x7f3188004810 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f318800c320 con 0x7f31880051c0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319ad9d700 1 --2- 172.21.15.33:0/1563158524 >> v2:172.21.15.59:3300/0 conn(0x7f319c0cd2b0 0x7f319c0ca730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319a59c700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 0x7f3188003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f3199d9b700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188004810 0x7f3188004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.792+0000 7f319ad9d700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31880051c0 0x7f318800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 -- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31880051c0 msgr2=0x7f318800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f31880051c0 0x7f318800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 -- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188004810 msgr2=0x7f3188004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188004810 0x7f3188004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 -- 172.21.15.33:0/1563158524 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3188003570 con 0x7f3188003bf0 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319ad9d700 1 -- 172.21.15.33:0/1563158524 reap_dead start 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319a59c700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 0x7f3188003fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3194001050 tx=0x7f3194007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb594d7afa79b7a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400c5d0 con 0x7f3188003bf0 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f319400c750 con 0x7f3188003bf0 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f319959a700 1 -- 172.21.15.33:0/1563158524 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f319400cb10 con 0x7f3188003bf0 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f31a0c93700 1 -- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 msgr2=0x7f3188003fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.793+0000 7f31a0c93700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 0x7f3188003fe0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7f3194001050 tx=0x7f3194007d10 comp rx=0 tx=0).stop 2023-10-09T15:38:59.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.794+0000 7f31a0c93700 1 -- 172.21.15.33:0/1563158524 shutdown_connections 2023-10-09T15:38:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.794+0000 7f31a0c93700 1 --2- 172.21.15.33:0/1563158524 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3188003bf0 0x7f3188003fe0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.794+0000 7f31a0c93700 1 -- 172.21.15.33:0/1563158524 >> 172.21.15.33:0/1563158524 conn(0x7f319c088000 msgr2=0x7f319c0883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:38:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.794+0000 7f31a0c93700 1 -- 172.21.15.33:0/1563158524 shutdown_connections 2023-10-09T15:38:59.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.794+0000 7f31a0c93700 1 -- 172.21.15.33:0/1563158524 wait complete. 2023-10-09T15:38:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.795+0000 7f31a0c93700 1 Processor -- start 2023-10-09T15:38:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.795+0000 7f31a0c93700 1 -- start start 2023-10-09T15:38:59.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.795+0000 7f31a0c93700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188003bf0 0x7f319c0b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.795+0000 7f31a0c93700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.795+0000 7f31a0c93700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319c0c6160 0x7f319c153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31a0c93700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c154590 con 0x7f319c0b0850 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31a0c93700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f319c0afff0 con 0x7f3188003bf0 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31a0c93700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f319c06d950 con 0x7f319c0c6160 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59004/0 (socket says 172.21.15.33:59004) 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 -- 172.21.15.33:0/2890649135 learned_addr learned my addr 172.21.15.33:0/2890649135 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f319a59c700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188003bf0 0x7f319c0b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f319ad9d700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319c0c6160 0x7f319c153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 -- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319c0c6160 msgr2=0x7f319c153150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319c0c6160 0x7f319c153150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 -- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188003bf0 msgr2=0x7f319c0b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188003bf0 0x7f319c0b12a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 -- 172.21.15.33:0/2890649135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f319c06dc30 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f3199d9b700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f318400e840 tx=0x7f3184000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184010520 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31840106a0 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f319c06df10 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3184010a60 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.796+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f319c153850 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.797+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f319c06d7b0 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.798+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f318401d3b0 con 0x7f319c0b0850 2023-10-09T15:38:59.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.798+0000 7f31927fc700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 0x7f317c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:38:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.798+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3184084420 con 0x7f319c0b0850 2023-10-09T15:38:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.798+0000 7f319a59c700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 0x7f317c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:38:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.798+0000 7f319a59c700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 0x7f317c0697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3194000c00 tx=0x7f3194015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:38:59.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:38:59.802+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f319c06d7b0 con 0x7f319c0b0850 2023-10-09T15:39:00.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.040+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f319c06d7b0 con 0x7f319c0b0850 2023-10-09T15:39:00.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.644+0000 7f31927fc700 1 -- 172.21.15.33:0/2890649135 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v103) v1 ==== 122+0+0 (secure 0 0 0) 0x7f319c06d7b0 con 0x7f319c0b0850 2023-10-09T15:39:00.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 msgr2=0x7f317c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 0x7f317c0697d0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f3194000c00 tx=0x7f3194015000 comp rx=0 tx=0).stop 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 msgr2=0x7f319c0c5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7f318400e840 tx=0x7f3184000bc0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 shutdown_connections 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f317c067320 0x7f317c0697d0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f319c0c6160 0x7f319c153150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3188003bf0 0x7f319c0b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 --2- 172.21.15.33:0/2890649135 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f319c0b0850 0x7f319c0c5c20 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 >> 172.21.15.33:0/2890649135 conn(0x7f319c088000 msgr2=0x7f319c0ad080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 shutdown_connections 2023-10-09T15:39:00.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.647+0000 7f31a0c93700 1 -- 172.21.15.33:0/2890649135 wait complete. 2023-10-09T15:39:00.662 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:00.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.788+0000 7f03ac34f700 1 Processor -- start 2023-10-09T15:39:00.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.788+0000 7f03ac34f700 1 -- start start 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a40cb5a0 0x7f03a40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 0x7f03a4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 0x7f03a415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a40d13f0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03a415a940 con 0x7f03a40cde50 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03ac34f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a415ae40 con 0x7f03a40cd9e0 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03aa0eb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a40cb5a0 0x7f03a40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03aa0eb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f03a40cb5a0 0x7f03a40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60870/0 (socket says 172.21.15.33:60870) 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03aa0eb700 1 -- 172.21.15.33:0/3695639196 learned_addr learned my addr 172.21.15.33:0/3695639196 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03a98ea700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 0x7f03a4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.789+0000 7f03aa8ec700 1 --2- 172.21.15.33:0/3695639196 >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 0x7f03a415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 -- 172.21.15.33:0/3695639196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 msgr2=0x7f03a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 0x7f03a4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 -- 172.21.15.33:0/3695639196 >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 msgr2=0x7f03a415a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/3695639196 >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 0x7f03a415a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 -- 172.21.15.33:0/3695639196 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03a415ab60 con 0x7f03a40cb5a0 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03a98ea700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 0x7f03a4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa8ec700 1 --2- 172.21.15.33:0/3695639196 >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 0x7f03a415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a40cb970 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f03a40cbeb0 tx=0x7f0394009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d3b6676389c5c85 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:00.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03a90e9700 1 -- 172.21.15.33:0/3695639196 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f039400e070 con 0x7f03a40cb5a0 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03a90e9700 1 -- 172.21.15.33:0/3695639196 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f039400ba40 con 0x7f03a40cb5a0 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03a90e9700 1 -- 172.21.15.33:0/3695639196 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940092e0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03ac34f700 1 -- 172.21.15.33:0/3695639196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 msgr2=0x7f03a40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.790+0000 7f03ac34f700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a40cb970 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f03a40cbeb0 tx=0x7f0394009840 comp rx=0 tx=0).stop 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 -- 172.21.15.33:0/3695639196 shutdown_connections 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 --2- 172.21.15.33:0/3695639196 >> v2:172.21.15.59:3300/0 conn(0x7f03a40cde50 0x7f03a415a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a40cb970 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 --2- 172.21.15.33:0/3695639196 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40cd9e0 0x7f03a4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 -- 172.21.15.33:0/3695639196 >> 172.21.15.33:0/3695639196 conn(0x7f03a4070e30 msgr2=0x7f03a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 -- 172.21.15.33:0/3695639196 shutdown_connections 2023-10-09T15:39:00.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.791+0000 7f03ac34f700 1 -- 172.21.15.33:0/3695639196 wait complete. 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.792+0000 7f03ac34f700 1 Processor -- start 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.792+0000 7f03ac34f700 1 -- start start 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.792+0000 7f03ac34f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.792+0000 7f03ac34f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a40cd9e0 0x7f03a40b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 0x7f03a415d060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40b2a80 con 0x7f03a40cb5a0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40c9260 con 0x7f03a40cd9e0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03a40c8650 con 0x7f03a40b25e0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60880/0 (socket says 172.21.15.33:60880) 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 -- 172.21.15.33:0/2407192370 learned_addr learned my addr 172.21.15.33:0/2407192370 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03a98ea700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a40cd9e0 0x7f03a40b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa8ec700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 0x7f03a415d060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 -- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 msgr2=0x7f03a415d060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 0x7f03a415d060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 -- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a40cd9e0 msgr2=0x7f03a40b20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a40cd9e0 0x7f03a40b20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:00.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 -- 172.21.15.33:0/2407192370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0394009ae0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa8ec700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 0x7f03a415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03aa0eb700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0394012000 tx=0x7f0394018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f03940088b0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0394008a50 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03a40c8930 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0394008e10 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.793+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03a40c8ef0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.794+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03a404c3c0 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.795+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0394003040 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.795+0000 7f03a27fc700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 0x7f03900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.795+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0394086a00 con 0x7f03a40cb5a0 2023-10-09T15:39:00.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.795+0000 7f03a98ea700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 0x7f03900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:00.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.796+0000 7f03a98ea700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 0x7f03900697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f03a40cb9e0 tx=0x7f0398008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:00.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:00.799+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0394053580 con 0x7f03a40cb5a0 2023-10-09T15:39:01.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.039+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f03a40ccf00 con 0x7f03a40cb5a0 2023-10-09T15:39:01.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.039+0000 7f03a27fc700 1 -- 172.21.15.33:0/2407192370 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4597 (secure 0 0 0) 0x7f0394056ba0 con 0x7f03a40cb5a0 2023-10-09T15:39:01.040 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:01.040 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:01.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 msgr2=0x7f03900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 0x7f03900697d0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f03a40cb9e0 tx=0x7f0398008040 comp rx=0 tx=0).stop 2023-10-09T15:39:01.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 msgr2=0x7f03a4156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f0394012000 tx=0x7f0394018000 comp rx=0 tx=0).stop 2023-10-09T15:39:01.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 shutdown_connections 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0390067320 0x7f03900697d0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f03a40cb5a0 0x7f03a4156160 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f03a40b25e0 0x7f03a415d060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 --2- 172.21.15.33:0/2407192370 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f03a40cd9e0 0x7f03a40b20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 >> 172.21.15.33:0/2407192370 conn(0x7f03a4070e30 msgr2=0x7f03a40b0ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 shutdown_connections 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.042+0000 7f03ac34f700 1 -- 172.21.15.33:0/2407192370 wait complete. 2023-10-09T15:39:01.043 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 103 2023-10-09T15:39:01.054 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.173+0000 7fcad0d9e700 1 Processor -- start 2023-10-09T15:39:01.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.173+0000 7fcad0d9e700 1 -- start start 2023-10-09T15:39:01.175 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcacc0cb5a0 0x7fcacc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcacc0cd9e0 0x7fcacc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc15a400 0x7fcacc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc0d13f0 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcacc15ae40 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcad0d9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc15ab60 con 0x7fcacc15a400 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcacc0cd9e0 0x7fcacc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fcacc0cd9e0 0x7fcacc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60882/0 (socket says 172.21.15.33:60882) 2023-10-09T15:39:01.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 -- 172.21.15.33:0/2878440434 learned_addr learned my addr 172.21.15.33:0/2878440434 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcacad9d700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc15a400 0x7fcacc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcaca59c700 1 --2- 172.21.15.33:0/2878440434 >> v2:172.21.15.59:3300/0 conn(0x7fcacc0cb5a0 0x7fcacc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 -- 172.21.15.33:0/2878440434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc15a400 msgr2=0x7fcacc156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc15a400 0x7fcacc156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 -- 172.21.15.33:0/2878440434 >> v2:172.21.15.59:3300/0 conn(0x7fcacc0cb5a0 msgr2=0x7fcacc0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2878440434 >> v2:172.21.15.59:3300/0 conn(0x7fcacc0cb5a0 0x7fcacc0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 -- 172.21.15.33:0/2878440434 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcacc0ccf00 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cd9e0 0x7fcacc159ec0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcac00099b0 tx=0x7fcac0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c9c1bd3c75efd49 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.174+0000 7fcac959a700 1 -- 172.21.15.33:0/2878440434 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000b820 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcac959a700 1 -- 172.21.15.33:0/2878440434 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcac000b980 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcac959a700 1 -- 172.21.15.33:0/2878440434 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcac000bd20 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2878440434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cd9e0 msgr2=0x7fcacc159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cd9e0 0x7fcacc159ec0 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fcac00099b0 tx=0x7fcac0009250 comp rx=0 tx=0).stop 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2878440434 shutdown_connections 2023-10-09T15:39:01.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2878440434 >> v2:172.21.15.59:3300/0 conn(0x7fcacc0cb5a0 0x7fcacc0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc15a400 0x7fcacc156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2878440434 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cd9e0 0x7fcacc159ec0 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2878440434 >> 172.21.15.33:0/2878440434 conn(0x7fcacc070e30 msgr2=0x7fcacc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2878440434 shutdown_connections 2023-10-09T15:39:01.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.175+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2878440434 wait complete. 2023-10-09T15:39:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.176+0000 7fcad0d9e700 1 Processor -- start 2023-10-09T15:39:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.176+0000 7fcad0d9e700 1 -- start start 2023-10-09T15:39:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc0cd9e0 0x7fcacc0af640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcacc15a400 0x7fcacc1668b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0b4d60 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc15c150 con 0x7fcacc15a400 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcad0d9e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcacc0b4a30 con 0x7fcacc0cd9e0 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60892/0 (socket says 172.21.15.33:60892) 2023-10-09T15:39:01.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 -- 172.21.15.33:0/2614993944 learned_addr learned my addr 172.21.15.33:0/2614993944 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc0cd9e0 0x7fcacc0af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcacad9d700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcacc15a400 0x7fcacc1668b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 -- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc0cd9e0 msgr2=0x7fcacc0af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc0cd9e0 0x7fcacc0af640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 -- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcacc15a400 msgr2=0x7fcacc1668b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcacc15a400 0x7fcacc1668b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.177+0000 7fcaca59c700 1 -- 172.21.15.33:0/2614993944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac00094f0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcaca59c700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00d8c0 tx=0x7fcabc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00de60 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcabc00b780 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcacc0c81d0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcabc00bb20 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.178+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcacc166df0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.179+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcacc04c3c0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.179+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcabc01e460 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.179+0000 7fcaba7fc700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 0x7fcaac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.179+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcabc085350 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.179+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 0x7fcaac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.180+0000 7fcac9d9b700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 0x7fcaac0697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcac00099b0 tx=0x7fcac0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.184+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcabc051fa0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.377+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcacc0cd1e0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.378 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.378+0000 7fcaba7fc700 1 -- 172.21.15.33:0/2614993944 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fcabc0555c0 con 0x7fcacc0cb5a0 2023-10-09T15:39:01.378 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:01.378 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":156,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:58.625337+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 msgr2=0x7fcaac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 0x7fcaac0697d0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcac00099b0 tx=0x7fcac0017000 comp rx=0 tx=0).stop 2023-10-09T15:39:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 msgr2=0x7fcacc169f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fcabc00d8c0 tx=0x7fcabc008040 comp rx=0 tx=0).stop 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 shutdown_connections 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcaac067320 0x7fcaac0697d0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcacc0cb5a0 0x7fcacc169f00 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcacc15a400 0x7fcacc1668b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 --2- 172.21.15.33:0/2614993944 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcacc0cd9e0 0x7fcacc0af640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 >> 172.21.15.33:0/2614993944 conn(0x7fcacc070e30 msgr2=0x7fcacc0b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 shutdown_connections 2023-10-09T15:39:01.381 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.380+0000 7fcad0d9e700 1 -- 172.21.15.33:0/2614993944 wait complete. 2023-10-09T15:39:01.392 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:39:01.392 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:39:01.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.511+0000 7f41cc16d700 1 Processor -- start 2023-10-09T15:39:01.511 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.511+0000 7f41cc16d700 1 -- start start 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41cc16d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41c415a5d0 0x7f41c4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41cc16d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c415ae40 con 0x7f41c40cb5a0 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41cc16d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f41c415ab60 con 0x7f41c40cb970 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41cc16d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41c40ce0f0 con 0x7f41c415a5d0 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41ca70a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41c415a5d0 0x7f41c4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41ca70a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f41c415a5d0 0x7f41c4156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60894/0 (socket says 172.21.15.33:60894) 2023-10-09T15:39:01.513 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41ca70a700 1 -- 172.21.15.33:0/1202650204 learned_addr learned my addr 172.21.15.33:0/1202650204 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.512+0000 7f41c9f09700 1 --1- 172.21.15.33:0/1202650204 >> v1:172.21.15.33:6789/0 conn(0x7f41c40cb5a0 0x7f41c40cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54828/0 (socket says 172.21.15.33:54828) 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41ca70a700 1 -- 172.21.15.33:0/1202650204 >> v1:172.21.15.59:6789/0 conn(0x7f41c40cb970 legacy=0x7f41c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41ca70a700 1 -- 172.21.15.33:0/1202650204 >> v1:172.21.15.33:6789/0 conn(0x7f41c40cb5a0 legacy=0x7f41c40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41c8f07700 1 -- 172.21.15.33:0/1202650204 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 166942101 0 0) 0x7f41c415ae40 con 0x7f41c40cb5a0 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41ca70a700 1 -- 172.21.15.33:0/1202650204 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41c40ccf00 con 0x7f41c415a5d0 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41ca70a700 1 --2- 172.21.15.33:0/1202650204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c415a5d0 0x7f41c4156e90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009f20 tx=0x7f41bc009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a27982bf2512f42 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41c8f07700 1 -- 172.21.15.33:0/1202650204 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc00e070 con 0x7f41c415a5d0 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41c8f07700 1 -- 172.21.15.33:0/1202650204 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41bc00ba80 con 0x7f41c415a5d0 2023-10-09T15:39:01.514 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41c8f07700 1 -- 172.21.15.33:0/1202650204 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41bc0092e0 con 0x7f41c415a5d0 2023-10-09T15:39:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41cc16d700 1 -- 172.21.15.33:0/1202650204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c415a5d0 msgr2=0x7f41c4156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.513+0000 7f41cc16d700 1 --2- 172.21.15.33:0/1202650204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c415a5d0 0x7f41c4156e90 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f41bc009f20 tx=0x7f41bc009840 comp rx=0 tx=0).stop 2023-10-09T15:39:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.514+0000 7f41cc16d700 1 -- 172.21.15.33:0/1202650204 shutdown_connections 2023-10-09T15:39:01.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.514+0000 7f41cc16d700 1 --2- 172.21.15.33:0/1202650204 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c415a5d0 0x7f41c4156e90 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.514+0000 7f41cc16d700 1 -- 172.21.15.33:0/1202650204 >> 172.21.15.33:0/1202650204 conn(0x7f41c4070e30 msgr2=0x7f41c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.514+0000 7f41cc16d700 1 -- 172.21.15.33:0/1202650204 shutdown_connections 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.514+0000 7f41cc16d700 1 -- 172.21.15.33:0/1202650204 wait complete. 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 Processor -- start 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 -- start start 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 0x7f41c40c8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 0x7f41c40b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.515+0000 7f41cc16d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40c8570 con 0x7f41c40cb5a0 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41cc16d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40c7960 con 0x7f41c40cb970 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41cc16d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41c40c7c40 con 0x7f41c415a5d0 2023-10-09T15:39:01.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60902/0 (socket says 172.21.15.33:60902) 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 -- 172.21.15.33:0/746702635 learned_addr learned my addr 172.21.15.33:0/746702635 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41ca70a700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 0x7f41c40b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9708700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 0x7f41c40c8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 -- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 msgr2=0x7f41c40b5600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 0x7f41c40b5600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 -- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 msgr2=0x7f41c40c8a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 0x7f41c40c8a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 -- 172.21.15.33:0/746702635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41bc009ae0 con 0x7f41c40cb5a0 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9708700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 0x7f41c40c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:01.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41ca70a700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 0x7f41c40b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c9f09700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c810 tx=0x7f41b4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b40073d0 con 0x7f41c40cb5a0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41b4007550 con 0x7f41c40cb5a0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41c40c7f20 con 0x7f41c40cb5a0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41b4004a80 con 0x7f41c40cb5a0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.516+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41c4153a40 con 0x7f41c40cb5a0 2023-10-09T15:39:01.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.517+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f41c404c3c0 con 0x7f41c40cb5a0 2023-10-09T15:39:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.518+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f41b401c3b0 con 0x7f41c40cb5a0 2023-10-09T15:39:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.518+0000 7f41c1ffb700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 0x7f41b00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.518+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f41b40841a0 con 0x7f41c40cb5a0 2023-10-09T15:39:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.518+0000 7f41c9708700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 0x7f41b00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.519+0000 7f41c9708700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 0x7f41b00697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.523+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f41b4050e30 con 0x7f41c40cb5a0 2023-10-09T15:39:01.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.713+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f41c40c86b0 con 0x7f41b0067320 2023-10-09T15:39:01.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.721+0000 7f41c1ffb700 1 -- 172.21.15.33:0/746702635 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289717 (secure 0 0 0) 0x7f41b8001d20 con 0x7f41b0067320 2023-10-09T15:39:01.724 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:01.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 msgr2=0x7f41b00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 0x7f41b00697d0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f41b8007fd0 tx=0x7f41b8009040 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 msgr2=0x7f41c4153500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f41b400c810 tx=0x7f41b4007d90 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 shutdown_connections 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f41b0067320 0x7f41b00697d0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41c40cb5a0 0x7f41c4153500 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41c415a5d0 0x7f41c40b5600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 --2- 172.21.15.33:0/746702635 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41c40cb970 0x7f41c40c8a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 >> 172.21.15.33:0/746702635 conn(0x7f41c4070e30 msgr2=0x7f41c40ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 shutdown_connections 2023-10-09T15:39:01.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.724+0000 7f41cc16d700 1 -- 172.21.15.33:0/746702635 wait complete. 2023-10-09T15:39:01.728 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:39:01.736 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-09T15:39:01.332237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427588,"kb_used_data":16516,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547132,"statfs":{"total":773094113280,"available":770608263168,"internally_reserved":0,"allocated":16912384,"data_stored":8226454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743171"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632983+0000","last_change":"2023-10-09T15:38:57.632983+0000","last_active":"2023-10-09T15:38:57.632983+0000","last_peered":"2023-10-09T15:38:57.632983+0000","last_clean":"2023-10-09T15:38:57.632983+0000","last_became_active":"2023-10-09T15:38:57.632750+0000","last_became_peered":"2023-10-09T15:38:57.632750+0000","last_unstale":"2023-10-09T15:38:57.632983+0000","last_undegraded":"2023-10-09T15:38:57.632983+0000","last_fullsized":"2023-10-09T15:38:57.632983+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:50.201959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626987+0000","last_change":"2023-10-09T15:38:57.626987+0000","last_active":"2023-10-09T15:38:57.626987+0000","last_peered":"2023-10-09T15:38:57.626987+0000","last_clean":"2023-10-09T15:38:57.626987+0000","last_became_active":"2023-10-09T15:38:57.626695+0000","last_became_peered":"2023-10-09T15:38:57.626695+0000","last_unstale":"2023-10-09T15:38:57.626987+0000","last_undegraded":"2023-10-09T15:38:57.626987+0000","last_fullsized":"2023-10-09T15:38:57.626987+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:02.628619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631974+0000","last_change":"2023-10-09T15:38:57.631974+0000","last_active":"2023-10-09T15:38:57.631974+0000","last_peered":"2023-10-09T15:38:57.631974+0000","last_clean":"2023-10-09T15:38:57.631974+0000","last_became_active":"2023-10-09T15:38:57.631683+0000","last_became_peered":"2023-10-09T15:38:57.631683+0000","last_unstale":"2023-10-09T15:38:57.631974+0000","last_undegraded":"2023-10-09T15:38:57.631974+0000","last_fullsized":"2023-10-09T15:38:57.631974+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:35.201760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643428+0000","last_change":"2023-10-09T15:38:57.643428+0000","last_active":"2023-10-09T15:38:57.643428+0000","last_peered":"2023-10-09T15:38:57.643428+0000","last_clean":"2023-10-09T15:38:57.643428+0000","last_became_active":"2023-10-09T15:38:57.643177+0000","last_became_peered":"2023-10-09T15:38:57.643177+0000","last_unstale":"2023-10-09T15:38:57.643428+0000","last_undegraded":"2023-10-09T15:38:57.643428+0000","last_fullsized":"2023-10-09T15:38:57.643428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:43.383441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643029+0000","last_change":"2023-10-09T15:38:57.643029+0000","last_active":"2023-10-09T15:38:57.643029+0000","last_peered":"2023-10-09T15:38:57.643029+0000","last_clean":"2023-10-09T15:38:57.643029+0000","last_became_active":"2023-10-09T15:38:57.642739+0000","last_became_peered":"2023-10-09T15:38:57.642739+0000","last_unstale":"2023-10-09T15:38:57.643029+0000","last_undegraded":"2023-10-09T15:38:57.643029+0000","last_fullsized":"2023-10-09T15:38:57.643029+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:49.635616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.641577+0000","last_change":"2023-10-09T15:38:57.641577+0000","last_active":"2023-10-09T15:38:57.641577+0000","last_peered":"2023-10-09T15:38:57.641577+0000","last_clean":"2023-10-09T15:38:57.641577+0000","last_became_active":"2023-10-09T15:38:57.641321+0000","last_became_peered":"2023-10-09T15:38:57.641321+0000","last_unstale":"2023-10-09T15:38:57.641577+0000","last_undegraded":"2023-10-09T15:38:57.641577+0000","last_fullsized":"2023-10-09T15:38:57.641577+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:55.607975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640073+0000","last_change":"2023-10-09T15:38:57.640073+0000","last_active":"2023-10-09T15:38:57.640073+0000","last_peered":"2023-10-09T15:38:57.640073+0000","last_clean":"2023-10-09T15:38:57.640073+0000","last_became_active":"2023-10-09T15:38:57.639445+0000","last_became_peered":"2023-10-09T15:38:57.639445+0000","last_unstale":"2023-10-09T15:38:57.640073+0000","last_undegraded":"2023-10-09T15:38:57.640073+0000","last_fullsized":"2023-10-09T15:38:57.640073+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:28.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636131+0000","last_change":"2023-10-09T15:38:57.636131+0000","last_active":"2023-10-09T15:38:57.636131+0000","last_peered":"2023-10-09T15:38:57.636131+0000","last_clean":"2023-10-09T15:38:57.636131+0000","last_became_active":"2023-10-09T15:38:57.635849+0000","last_became_peered":"2023-10-09T15:38:57.635849+0000","last_unstale":"2023-10-09T15:38:57.636131+0000","last_undegraded":"2023-10-09T15:38:57.636131+0000","last_fullsized":"2023-10-09T15:38:57.636131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:49.355345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633938+0000","last_change":"2023-10-09T15:38:57.633938+0000","last_active":"2023-10-09T15:38:57.633938+0000","last_peered":"2023-10-09T15:38:57.633938+0000","last_clean":"2023-10-09T15:38:57.633938+0000","last_became_active":"2023-10-09T15:38:57.633689+0000","last_became_peered":"2023-10-09T15:38:57.633689+0000","last_unstale":"2023-10-09T15:38:57.633938+0000","last_undegraded":"2023-10-09T15:38:57.633938+0000","last_fullsized":"2023-10-09T15:38:57.633938+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:15.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630252+0000","last_change":"2023-10-09T15:38:57.630252+0000","last_active":"2023-10-09T15:38:57.630252+0000","last_peered":"2023-10-09T15:38:57.630252+0000","last_clean":"2023-10-09T15:38:57.630252+0000","last_became_active":"2023-10-09T15:38:57.627852+0000","last_became_peered":"2023-10-09T15:38:57.627852+0000","last_unstale":"2023-10-09T15:38:57.630252+0000","last_undegraded":"2023-10-09T15:38:57.630252+0000","last_fullsized":"2023-10-09T15:38:57.630252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:11.124611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627362+0000","last_change":"2023-10-09T15:38:57.627362+0000","last_active":"2023-10-09T15:38:57.627362+0000","last_peered":"2023-10-09T15:38:57.627362+0000","last_clean":"2023-10-09T15:38:57.627362+0000","last_became_active":"2023-10-09T15:38:57.627096+0000","last_became_peered":"2023-10-09T15:38:57.627096+0000","last_unstale":"2023-10-09T15:38:57.627362+0000","last_undegraded":"2023-10-09T15:38:57.627362+0000","last_fullsized":"2023-10-09T15:38:57.627362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:22.486211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.638135+0000","last_change":"2023-10-09T15:38:57.638135+0000","last_active":"2023-10-09T15:38:57.638135+0000","last_peered":"2023-10-09T15:38:57.638135+0000","last_clean":"2023-10-09T15:38:57.638135+0000","last_became_active":"2023-10-09T15:38:57.637801+0000","last_became_peered":"2023-10-09T15:38:57.637801+0000","last_unstale":"2023-10-09T15:38:57.638135+0000","last_undegraded":"2023-10-09T15:38:57.638135+0000","last_fullsized":"2023-10-09T15:38:57.638135+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:56.140984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633445+0000","last_change":"2023-10-09T15:38:57.633445+0000","last_active":"2023-10-09T15:38:57.633445+0000","last_peered":"2023-10-09T15:38:57.633445+0000","last_clean":"2023-10-09T15:38:57.633445+0000","last_became_active":"2023-10-09T15:38:57.632132+0000","last_became_peered":"2023-10-09T15:38:57.632132+0000","last_unstale":"2023-10-09T15:38:57.633445+0000","last_undegraded":"2023-10-09T15:38:57.633445+0000","last_fullsized":"2023-10-09T15:38:57.633445+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:49.260232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629059+0000","last_change":"2023-10-09T15:38:57.629059+0000","last_active":"2023-10-09T15:38:57.629059+0000","last_peered":"2023-10-09T15:38:57.629059+0000","last_clean":"2023-10-09T15:38:57.629059+0000","last_became_active":"2023-10-09T15:38:57.628796+0000","last_became_peered":"2023-10-09T15:38:57.628796+0000","last_unstale":"2023-10-09T15:38:57.629059+0000","last_undegraded":"2023-10-09T15:38:57.629059+0000","last_fullsized":"2023-10-09T15:38:57.629059+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:05.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630943+0000","last_change":"2023-10-09T15:38:57.630943+0000","last_active":"2023-10-09T15:38:57.630943+0000","last_peered":"2023-10-09T15:38:57.630943+0000","last_clean":"2023-10-09T15:38:57.630943+0000","last_became_active":"2023-10-09T15:38:57.630633+0000","last_became_peered":"2023-10-09T15:38:57.630633+0000","last_unstale":"2023-10-09T15:38:57.630943+0000","last_undegraded":"2023-10-09T15:38:57.630943+0000","last_fullsized":"2023-10-09T15:38:57.630943+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:20.011794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633083+0000","last_change":"2023-10-09T15:38:57.633083+0000","last_active":"2023-10-09T15:38:57.633083+0000","last_peered":"2023-10-09T15:38:57.633083+0000","last_clean":"2023-10-09T15:38:57.633083+0000","last_became_active":"2023-10-09T15:38:57.632847+0000","last_became_peered":"2023-10-09T15:38:57.632847+0000","last_unstale":"2023-10-09T15:38:57.633083+0000","last_undegraded":"2023-10-09T15:38:57.633083+0000","last_fullsized":"2023-10-09T15:38:57.633083+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:56.751437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632884+0000","last_change":"2023-10-09T15:38:57.632884+0000","last_active":"2023-10-09T15:38:57.632884+0000","last_peered":"2023-10-09T15:38:57.632884+0000","last_clean":"2023-10-09T15:38:57.632884+0000","last_became_active":"2023-10-09T15:38:57.632617+0000","last_became_peered":"2023-10-09T15:38:57.632617+0000","last_unstale":"2023-10-09T15:38:57.632884+0000","last_undegraded":"2023-10-09T15:38:57.632884+0000","last_fullsized":"2023-10-09T15:38:57.632884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:20.966730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631042+0000","last_change":"2023-10-09T15:38:57.631042+0000","last_active":"2023-10-09T15:38:57.631042+0000","last_peered":"2023-10-09T15:38:57.631042+0000","last_clean":"2023-10-09T15:38:57.631042+0000","last_became_active":"2023-10-09T15:38:57.630284+0000","last_became_peered":"2023-10-09T15:38:57.630284+0000","last_unstale":"2023-10-09T15:38:57.631042+0000","last_undegraded":"2023-10-09T15:38:57.631042+0000","last_fullsized":"2023-10-09T15:38:57.631042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:28.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.628045+0000","last_change":"2023-10-09T15:38:57.628045+0000","last_active":"2023-10-09T15:38:57.628045+0000","last_peered":"2023-10-09T15:38:57.628045+0000","last_clean":"2023-10-09T15:38:57.628045+0000","last_became_active":"2023-10-09T15:38:57.627753+0000","last_became_peered":"2023-10-09T15:38:57.627753+0000","last_unstale":"2023-10-09T15:38:57.628045+0000","last_undegraded":"2023-10-09T15:38:57.628045+0000","last_fullsized":"2023-10-09T15:38:57.628045+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:58.236257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631855+0000","last_change":"2023-10-09T15:38:57.631855+0000","last_active":"2023-10-09T15:38:57.631855+0000","last_peered":"2023-10-09T15:38:57.631855+0000","last_clean":"2023-10-09T15:38:57.631855+0000","last_became_active":"2023-10-09T15:38:57.631530+0000","last_became_peered":"2023-10-09T15:38:57.631530+0000","last_unstale":"2023-10-09T15:38:57.631855+0000","last_undegraded":"2023-10-09T15:38:57.631855+0000","last_fullsized":"2023-10-09T15:38:57.631855+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:08.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646115+0000","last_change":"2023-10-09T15:38:57.646115+0000","last_active":"2023-10-09T15:38:57.646115+0000","last_peered":"2023-10-09T15:38:57.646115+0000","last_clean":"2023-10-09T15:38:57.646115+0000","last_became_active":"2023-10-09T15:38:57.644939+0000","last_became_peered":"2023-10-09T15:38:57.644939+0000","last_unstale":"2023-10-09T15:38:57.646115+0000","last_undegraded":"2023-10-09T15:38:57.646115+0000","last_fullsized":"2023-10-09T15:38:57.646115+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:28.735851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631214+0000","last_change":"2023-10-09T15:38:57.631214+0000","last_active":"2023-10-09T15:38:57.631214+0000","last_peered":"2023-10-09T15:38:57.631214+0000","last_clean":"2023-10-09T15:38:57.631214+0000","last_became_active":"2023-10-09T15:38:57.630911+0000","last_became_peered":"2023-10-09T15:38:57.630911+0000","last_unstale":"2023-10-09T15:38:57.631214+0000","last_undegraded":"2023-10-09T15:38:57.631214+0000","last_fullsized":"2023-10-09T15:38:57.631214+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:10.284400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643966+0000","last_change":"2023-10-09T15:38:57.643966+0000","last_active":"2023-10-09T15:38:57.643966+0000","last_peered":"2023-10-09T15:38:57.643966+0000","last_clean":"2023-10-09T15:38:57.643966+0000","last_became_active":"2023-10-09T15:38:57.643668+0000","last_became_peered":"2023-10-09T15:38:57.643668+0000","last_unstale":"2023-10-09T15:38:57.643966+0000","last_undegraded":"2023-10-09T15:38:57.643966+0000","last_fullsized":"2023-10-09T15:38:57.643966+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:07.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640234+0000","last_change":"2023-10-09T15:38:57.640234+0000","last_active":"2023-10-09T15:38:57.640234+0000","last_peered":"2023-10-09T15:38:57.640234+0000","last_clean":"2023-10-09T15:38:57.640234+0000","last_became_active":"2023-10-09T15:38:57.639730+0000","last_became_peered":"2023-10-09T15:38:57.639730+0000","last_unstale":"2023-10-09T15:38:57.640234+0000","last_undegraded":"2023-10-09T15:38:57.640234+0000","last_fullsized":"2023-10-09T15:38:57.640234+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:15:42.935666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629131+0000","last_change":"2023-10-09T15:38:57.629131+0000","last_active":"2023-10-09T15:38:57.629131+0000","last_peered":"2023-10-09T15:38:57.629131+0000","last_clean":"2023-10-09T15:38:57.629131+0000","last_became_active":"2023-10-09T15:38:57.628883+0000","last_became_peered":"2023-10-09T15:38:57.628883+0000","last_unstale":"2023-10-09T15:38:57.629131+0000","last_undegraded":"2023-10-09T15:38:57.629131+0000","last_fullsized":"2023-10-09T15:38:57.629131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:40:26.512104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633943+0000","last_change":"2023-10-09T15:38:57.633943+0000","last_active":"2023-10-09T15:38:57.633943+0000","last_peered":"2023-10-09T15:38:57.633943+0000","last_clean":"2023-10-09T15:38:57.633943+0000","last_became_active":"2023-10-09T15:38:57.633664+0000","last_became_peered":"2023-10-09T15:38:57.633664+0000","last_unstale":"2023-10-09T15:38:57.633943+0000","last_undegraded":"2023-10-09T15:38:57.633943+0000","last_fullsized":"2023-10-09T15:38:57.633943+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:03.133090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.637824+0000","last_change":"2023-10-09T15:38:57.637824+0000","last_active":"2023-10-09T15:38:57.637824+0000","last_peered":"2023-10-09T15:38:57.637824+0000","last_clean":"2023-10-09T15:38:57.637824+0000","last_became_active":"2023-10-09T15:38:57.637538+0000","last_became_peered":"2023-10-09T15:38:57.637538+0000","last_unstale":"2023-10-09T15:38:57.637824+0000","last_undegraded":"2023-10-09T15:38:57.637824+0000","last_fullsized":"2023-10-09T15:38:57.637824+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:01.022018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636309+0000","last_change":"2023-10-09T15:38:57.636309+0000","last_active":"2023-10-09T15:38:57.636309+0000","last_peered":"2023-10-09T15:38:57.636309+0000","last_clean":"2023-10-09T15:38:57.636309+0000","last_became_active":"2023-10-09T15:38:57.636013+0000","last_became_peered":"2023-10-09T15:38:57.636013+0000","last_unstale":"2023-10-09T15:38:57.636309+0000","last_undegraded":"2023-10-09T15:38:57.636309+0000","last_fullsized":"2023-10-09T15:38:57.636309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:31.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.638382+0000","last_change":"2023-10-09T15:38:57.638382+0000","last_active":"2023-10-09T15:38:57.638382+0000","last_peered":"2023-10-09T15:38:57.638382+0000","last_clean":"2023-10-09T15:38:57.638382+0000","last_became_active":"2023-10-09T15:38:57.638130+0000","last_became_peered":"2023-10-09T15:38:57.638130+0000","last_unstale":"2023-10-09T15:38:57.638382+0000","last_undegraded":"2023-10-09T15:38:57.638382+0000","last_fullsized":"2023-10-09T15:38:57.638382+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:16.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644673+0000","last_change":"2023-10-09T15:38:57.644673+0000","last_active":"2023-10-09T15:38:57.644673+0000","last_peered":"2023-10-09T15:38:57.644673+0000","last_clean":"2023-10-09T15:38:57.644673+0000","last_became_active":"2023-10-09T15:38:57.644453+0000","last_became_peered":"2023-10-09T15:38:57.644453+0000","last_unstale":"2023-10-09T15:38:57.644673+0000","last_undegraded":"2023-10-09T15:38:57.644673+0000","last_fullsized":"2023-10-09T15:38:57.644673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:01.022018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632051+0000","last_change":"2023-10-09T15:38:57.632051+0000","last_active":"2023-10-09T15:38:57.632051+0000","last_peered":"2023-10-09T15:38:57.632051+0000","last_clean":"2023-10-09T15:38:57.632051+0000","last_became_active":"2023-10-09T15:38:57.631797+0000","last_became_peered":"2023-10-09T15:38:57.631797+0000","last_unstale":"2023-10-09T15:38:57.632051+0000","last_undegraded":"2023-10-09T15:38:57.632051+0000","last_fullsized":"2023-10-09T15:38:57.632051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:20.966730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634890+0000","last_change":"2023-10-09T15:38:57.634890+0000","last_active":"2023-10-09T15:38:57.634890+0000","last_peered":"2023-10-09T15:38:57.634890+0000","last_clean":"2023-10-09T15:38:57.634890+0000","last_became_active":"2023-10-09T15:38:57.634636+0000","last_became_peered":"2023-10-09T15:38:57.634636+0000","last_unstale":"2023-10-09T15:38:57.634890+0000","last_undegraded":"2023-10-09T15:38:57.634890+0000","last_fullsized":"2023-10-09T15:38:57.634890+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:02.534593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630259+0000","last_change":"2023-10-09T15:38:57.630259+0000","last_active":"2023-10-09T15:38:57.630259+0000","last_peered":"2023-10-09T15:38:57.630259+0000","last_clean":"2023-10-09T15:38:57.630259+0000","last_became_active":"2023-10-09T15:38:57.629972+0000","last_became_peered":"2023-10-09T15:38:57.629972+0000","last_unstale":"2023-10-09T15:38:57.630259+0000","last_undegraded":"2023-10-09T15:38:57.630259+0000","last_fullsized":"2023-10-09T15:38:57.630259+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:46:02.841409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"155'4","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.648692+0000","last_change":"2023-10-09T15:38:56.609661+0000","last_active":"2023-10-09T15:38:57.648692+0000","last_peered":"2023-10-09T15:38:57.648692+0000","last_clean":"2023-10-09T15:38:57.648692+0000","last_became_active":"2023-10-09T15:38:56.609382+0000","last_became_peered":"2023-10-09T15:38:56.609382+0000","last_unstale":"2023-10-09T15:38:57.648692+0000","last_undegraded":"2023-10-09T15:38:57.648692+0000","last_fullsized":"2023-10-09T15:38:57.648692+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:13.414739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642903+0000","last_change":"2023-10-09T15:38:57.642903+0000","last_active":"2023-10-09T15:38:57.642903+0000","last_peered":"2023-10-09T15:38:57.642903+0000","last_clean":"2023-10-09T15:38:57.642903+0000","last_became_active":"2023-10-09T15:38:57.642582+0000","last_became_peered":"2023-10-09T15:38:57.642582+0000","last_unstale":"2023-10-09T15:38:57.642903+0000","last_undegraded":"2023-10-09T15:38:57.642903+0000","last_fullsized":"2023-10-09T15:38:57.642903+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:47:27.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.620590+0000","last_change":"2023-10-09T15:38:56.609605+0000","last_active":"2023-10-09T15:38:57.620590+0000","last_peered":"2023-10-09T15:38:57.620590+0000","last_clean":"2023-10-09T15:38:57.620590+0000","last_became_active":"2023-10-09T15:38:56.609268+0000","last_became_peered":"2023-10-09T15:38:56.609268+0000","last_unstale":"2023-10-09T15:38:57.620590+0000","last_undegraded":"2023-10-09T15:38:57.620590+0000","last_fullsized":"2023-10-09T15:38:57.620590+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:31.441201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639411+0000","last_change":"2023-10-09T15:38:57.639411+0000","last_active":"2023-10-09T15:38:57.639411+0000","last_peered":"2023-10-09T15:38:57.639411+0000","last_clean":"2023-10-09T15:38:57.639411+0000","last_became_active":"2023-10-09T15:38:57.638950+0000","last_became_peered":"2023-10-09T15:38:57.638950+0000","last_unstale":"2023-10-09T15:38:57.639411+0000","last_undegraded":"2023-10-09T15:38:57.639411+0000","last_fullsized":"2023-10-09T15:38:57.639411+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:56.751437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.648428+0000","last_change":"2023-10-09T15:38:56.606832+0000","last_active":"2023-10-09T15:38:57.648428+0000","last_peered":"2023-10-09T15:38:57.648428+0000","last_clean":"2023-10-09T15:38:57.648428+0000","last_became_active":"2023-10-09T15:38:56.606261+0000","last_became_peered":"2023-10-09T15:38:56.606261+0000","last_unstale":"2023-10-09T15:38:57.648428+0000","last_undegraded":"2023-10-09T15:38:57.648428+0000","last_fullsized":"2023-10-09T15:38:57.648428+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:37.107485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634807+0000","last_change":"2023-10-09T15:38:57.634807+0000","last_active":"2023-10-09T15:38:57.634807+0000","last_peered":"2023-10-09T15:38:57.634807+0000","last_clean":"2023-10-09T15:38:57.634807+0000","last_became_active":"2023-10-09T15:38:57.634479+0000","last_became_peered":"2023-10-09T15:38:57.634479+0000","last_unstale":"2023-10-09T15:38:57.634807+0000","last_undegraded":"2023-10-09T15:38:57.634807+0000","last_fullsized":"2023-10-09T15:38:57.634807+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:05.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649038+0000","last_change":"2023-10-09T15:38:56.611018+0000","last_active":"2023-10-09T15:38:57.649038+0000","last_peered":"2023-10-09T15:38:57.649038+0000","last_clean":"2023-10-09T15:38:57.649038+0000","last_became_active":"2023-10-09T15:38:56.610751+0000","last_became_peered":"2023-10-09T15:38:56.610751+0000","last_unstale":"2023-10-09T15:38:57.649038+0000","last_undegraded":"2023-10-09T15:38:57.649038+0000","last_fullsized":"2023-10-09T15:38:57.649038+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.202997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646105+0000","last_change":"2023-10-09T15:38:57.646105+0000","last_active":"2023-10-09T15:38:57.646105+0000","last_peered":"2023-10-09T15:38:57.646105+0000","last_clean":"2023-10-09T15:38:57.646105+0000","last_became_active":"2023-10-09T15:38:57.645817+0000","last_became_peered":"2023-10-09T15:38:57.645817+0000","last_unstale":"2023-10-09T15:38:57.646105+0000","last_undegraded":"2023-10-09T15:38:57.646105+0000","last_fullsized":"2023-10-09T15:38:57.646105+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:26.814232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629882+0000","last_change":"2023-10-09T15:38:56.608488+0000","last_active":"2023-10-09T15:38:57.629882+0000","last_peered":"2023-10-09T15:38:57.629882+0000","last_clean":"2023-10-09T15:38:57.629882+0000","last_became_active":"2023-10-09T15:38:56.608199+0000","last_became_peered":"2023-10-09T15:38:56.608199+0000","last_unstale":"2023-10-09T15:38:57.629882+0000","last_undegraded":"2023-10-09T15:38:57.629882+0000","last_fullsized":"2023-10-09T15:38:57.629882+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:15:38.107470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642058+0000","last_change":"2023-10-09T15:38:57.642058+0000","last_active":"2023-10-09T15:38:57.642058+0000","last_peered":"2023-10-09T15:38:57.642058+0000","last_clean":"2023-10-09T15:38:57.642058+0000","last_became_active":"2023-10-09T15:38:57.641819+0000","last_became_peered":"2023-10-09T15:38:57.641819+0000","last_unstale":"2023-10-09T15:38:57.642058+0000","last_undegraded":"2023-10-09T15:38:57.642058+0000","last_fullsized":"2023-10-09T15:38:57.642058+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:06.795286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611215+0000","last_change":"2023-10-09T15:38:56.607841+0000","last_active":"2023-10-09T15:38:56.611215+0000","last_peered":"2023-10-09T15:38:56.611215+0000","last_clean":"2023-10-09T15:38:56.611215+0000","last_became_active":"2023-10-09T15:38:56.607536+0000","last_became_peered":"2023-10-09T15:38:56.607536+0000","last_unstale":"2023-10-09T15:38:56.611215+0000","last_undegraded":"2023-10-09T15:38:56.611215+0000","last_fullsized":"2023-10-09T15:38:56.611215+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:06.594946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643480+0000","last_change":"2023-10-09T15:38:57.643480+0000","last_active":"2023-10-09T15:38:57.643480+0000","last_peered":"2023-10-09T15:38:57.643480+0000","last_clean":"2023-10-09T15:38:57.643480+0000","last_became_active":"2023-10-09T15:38:57.643200+0000","last_became_peered":"2023-10-09T15:38:57.643200+0000","last_unstale":"2023-10-09T15:38:57.643480+0000","last_undegraded":"2023-10-09T15:38:57.643480+0000","last_fullsized":"2023-10-09T15:38:57.643480+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:03.900018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.614254+0000","last_change":"2023-10-09T15:38:56.607329+0000","last_active":"2023-10-09T15:38:56.614254+0000","last_peered":"2023-10-09T15:38:56.614254+0000","last_clean":"2023-10-09T15:38:56.614254+0000","last_became_active":"2023-10-09T15:38:56.607042+0000","last_became_peered":"2023-10-09T15:38:56.607042+0000","last_unstale":"2023-10-09T15:38:56.614254+0000","last_undegraded":"2023-10-09T15:38:56.614254+0000","last_fullsized":"2023-10-09T15:38:56.614254+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:14.515060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649907+0000","last_change":"2023-10-09T15:38:57.649907+0000","last_active":"2023-10-09T15:38:57.649907+0000","last_peered":"2023-10-09T15:38:57.649907+0000","last_clean":"2023-10-09T15:38:57.649907+0000","last_became_active":"2023-10-09T15:38:57.649630+0000","last_became_peered":"2023-10-09T15:38:57.649630+0000","last_unstale":"2023-10-09T15:38:57.649907+0000","last_undegraded":"2023-10-09T15:38:57.649907+0000","last_fullsized":"2023-10-09T15:38:57.649907+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:59.466759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617508+0000","last_change":"2023-10-09T15:38:56.615056+0000","last_active":"2023-10-09T15:38:56.617508+0000","last_peered":"2023-10-09T15:38:56.617508+0000","last_clean":"2023-10-09T15:38:56.617508+0000","last_became_active":"2023-10-09T15:38:56.614734+0000","last_became_peered":"2023-10-09T15:38:56.614734+0000","last_unstale":"2023-10-09T15:38:56.617508+0000","last_undegraded":"2023-10-09T15:38:56.617508+0000","last_fullsized":"2023-10-09T15:38:56.617508+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:31.372908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626466+0000","last_change":"2023-10-09T15:38:57.626466+0000","last_active":"2023-10-09T15:38:57.626466+0000","last_peered":"2023-10-09T15:38:57.626466+0000","last_clean":"2023-10-09T15:38:57.626466+0000","last_became_active":"2023-10-09T15:38:57.626162+0000","last_became_peered":"2023-10-09T15:38:57.626162+0000","last_unstale":"2023-10-09T15:38:57.626466+0000","last_undegraded":"2023-10-09T15:38:57.626466+0000","last_fullsized":"2023-10-09T15:38:57.626466+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:21.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.616718+0000","last_change":"2023-10-09T15:38:56.609732+0000","last_active":"2023-10-09T15:38:56.616718+0000","last_peered":"2023-10-09T15:38:56.616718+0000","last_clean":"2023-10-09T15:38:56.616718+0000","last_became_active":"2023-10-09T15:38:56.609535+0000","last_became_peered":"2023-10-09T15:38:56.609535+0000","last_unstale":"2023-10-09T15:38:56.616718+0000","last_undegraded":"2023-10-09T15:38:56.616718+0000","last_fullsized":"2023-10-09T15:38:56.616718+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:55.136875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646870+0000","last_change":"2023-10-09T15:38:57.646870+0000","last_active":"2023-10-09T15:38:57.646870+0000","last_peered":"2023-10-09T15:38:57.646870+0000","last_clean":"2023-10-09T15:38:57.646870+0000","last_became_active":"2023-10-09T15:38:57.646621+0000","last_became_peered":"2023-10-09T15:38:57.646621+0000","last_unstale":"2023-10-09T15:38:57.646870+0000","last_undegraded":"2023-10-09T15:38:57.646870+0000","last_fullsized":"2023-10-09T15:38:57.646870+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:08.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"155'3","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644157+0000","last_change":"2023-10-09T15:38:56.610279+0000","last_active":"2023-10-09T15:38:57.644157+0000","last_peered":"2023-10-09T15:38:57.644157+0000","last_clean":"2023-10-09T15:38:57.644157+0000","last_became_active":"2023-10-09T15:38:56.609972+0000","last_became_peered":"2023-10-09T15:38:56.609972+0000","last_unstale":"2023-10-09T15:38:57.644157+0000","last_undegraded":"2023-10-09T15:38:57.644157+0000","last_fullsized":"2023-10-09T15:38:57.644157+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:01.634787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634280+0000","last_change":"2023-10-09T15:38:57.634280+0000","last_active":"2023-10-09T15:38:57.634280+0000","last_peered":"2023-10-09T15:38:57.634280+0000","last_clean":"2023-10-09T15:38:57.634280+0000","last_became_active":"2023-10-09T15:38:57.634012+0000","last_became_peered":"2023-10-09T15:38:57.634012+0000","last_unstale":"2023-10-09T15:38:57.634280+0000","last_undegraded":"2023-10-09T15:38:57.634280+0000","last_fullsized":"2023-10-09T15:38:57.634280+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:52.341877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"155'6","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.650857+0000","last_change":"2023-10-09T15:38:56.607563+0000","last_active":"2023-10-09T15:38:57.650857+0000","last_peered":"2023-10-09T15:38:57.650857+0000","last_clean":"2023-10-09T15:38:57.650857+0000","last_became_active":"2023-10-09T15:38:56.607309+0000","last_became_peered":"2023-10-09T15:38:56.607309+0000","last_unstale":"2023-10-09T15:38:57.650857+0000","last_undegraded":"2023-10-09T15:38:57.650857+0000","last_fullsized":"2023-10-09T15:38:57.650857+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:43.252016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642281+0000","last_change":"2023-10-09T15:38:57.642281+0000","last_active":"2023-10-09T15:38:57.642281+0000","last_peered":"2023-10-09T15:38:57.642281+0000","last_clean":"2023-10-09T15:38:57.642281+0000","last_became_active":"2023-10-09T15:38:57.641558+0000","last_became_peered":"2023-10-09T15:38:57.641558+0000","last_unstale":"2023-10-09T15:38:57.642281+0000","last_undegraded":"2023-10-09T15:38:57.642281+0000","last_fullsized":"2023-10-09T15:38:57.642281+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:59.466759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.647718+0000","last_change":"2023-10-09T15:38:56.608202+0000","last_active":"2023-10-09T15:38:57.647718+0000","last_peered":"2023-10-09T15:38:57.647718+0000","last_clean":"2023-10-09T15:38:57.647718+0000","last_became_active":"2023-10-09T15:38:56.607919+0000","last_became_peered":"2023-10-09T15:38:56.607919+0000","last_unstale":"2023-10-09T15:38:57.647718+0000","last_undegraded":"2023-10-09T15:38:57.647718+0000","last_fullsized":"2023-10-09T15:38:57.647718+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:15.754495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.635911+0000","last_change":"2023-10-09T15:38:57.635911+0000","last_active":"2023-10-09T15:38:57.635911+0000","last_peered":"2023-10-09T15:38:57.635911+0000","last_clean":"2023-10-09T15:38:57.635911+0000","last_became_active":"2023-10-09T15:38:57.635657+0000","last_became_peered":"2023-10-09T15:38:57.635657+0000","last_unstale":"2023-10-09T15:38:57.635911+0000","last_undegraded":"2023-10-09T15:38:57.635911+0000","last_fullsized":"2023-10-09T15:38:57.635911+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:12.734027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.607478+0000","last_change":"2023-10-09T15:38:56.606842+0000","last_active":"2023-10-09T15:38:56.607478+0000","last_peered":"2023-10-09T15:38:56.607478+0000","last_clean":"2023-10-09T15:38:56.607478+0000","last_became_active":"2023-10-09T15:38:56.606550+0000","last_became_peered":"2023-10-09T15:38:56.606550+0000","last_unstale":"2023-10-09T15:38:56.607478+0000","last_undegraded":"2023-10-09T15:38:56.607478+0000","last_fullsized":"2023-10-09T15:38:56.607478+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:00.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627006+0000","last_change":"2023-10-09T15:38:57.627006+0000","last_active":"2023-10-09T15:38:57.627006+0000","last_peered":"2023-10-09T15:38:57.627006+0000","last_clean":"2023-10-09T15:38:57.627006+0000","last_became_active":"2023-10-09T15:38:57.626549+0000","last_became_peered":"2023-10-09T15:38:57.626549+0000","last_unstale":"2023-10-09T15:38:57.627006+0000","last_undegraded":"2023-10-09T15:38:57.627006+0000","last_fullsized":"2023-10-09T15:38:57.627006+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:53.903413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.612092+0000","last_change":"2023-10-09T15:38:56.606015+0000","last_active":"2023-10-09T15:38:56.612092+0000","last_peered":"2023-10-09T15:38:56.612092+0000","last_clean":"2023-10-09T15:38:56.612092+0000","last_became_active":"2023-10-09T15:38:56.605715+0000","last_became_peered":"2023-10-09T15:38:56.605715+0000","last_unstale":"2023-10-09T15:38:56.612092+0000","last_undegraded":"2023-10-09T15:38:56.612092+0000","last_fullsized":"2023-10-09T15:38:56.612092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:13.836597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640249+0000","last_change":"2023-10-09T15:38:57.640249+0000","last_active":"2023-10-09T15:38:57.640249+0000","last_peered":"2023-10-09T15:38:57.640249+0000","last_clean":"2023-10-09T15:38:57.640249+0000","last_became_active":"2023-10-09T15:38:57.639815+0000","last_became_peered":"2023-10-09T15:38:57.639815+0000","last_unstale":"2023-10-09T15:38:57.640249+0000","last_undegraded":"2023-10-09T15:38:57.640249+0000","last_fullsized":"2023-10-09T15:38:57.640249+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:12.734027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"155'8","reported_seq":17,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649006+0000","last_change":"2023-10-09T15:38:56.604662+0000","last_active":"2023-10-09T15:38:57.649006+0000","last_peered":"2023-10-09T15:38:57.649006+0000","last_clean":"2023-10-09T15:38:57.649006+0000","last_became_active":"2023-10-09T15:38:56.604394+0000","last_became_peered":"2023-10-09T15:38:56.604394+0000","last_unstale":"2023-10-09T15:38:57.649006+0000","last_undegraded":"2023-10-09T15:38:57.649006+0000","last_fullsized":"2023-10-09T15:38:57.649006+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:07.346436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634113+0000","last_change":"2023-10-09T15:38:57.634113+0000","last_active":"2023-10-09T15:38:57.634113+0000","last_peered":"2023-10-09T15:38:57.634113+0000","last_clean":"2023-10-09T15:38:57.634113+0000","last_became_active":"2023-10-09T15:38:57.633817+0000","last_became_peered":"2023-10-09T15:38:57.633817+0000","last_unstale":"2023-10-09T15:38:57.634113+0000","last_undegraded":"2023-10-09T15:38:57.634113+0000","last_fullsized":"2023-10-09T15:38:57.634113+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:44.364244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.625900+0000","last_change":"2023-10-09T15:38:56.612759+0000","last_active":"2023-10-09T15:38:57.625900+0000","last_peered":"2023-10-09T15:38:57.625900+0000","last_clean":"2023-10-09T15:38:57.625900+0000","last_became_active":"2023-10-09T15:38:56.612515+0000","last_became_peered":"2023-10-09T15:38:56.612515+0000","last_unstale":"2023-10-09T15:38:57.625900+0000","last_undegraded":"2023-10-09T15:38:57.625900+0000","last_fullsized":"2023-10-09T15:38:57.625900+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:58.825513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629775+0000","last_change":"2023-10-09T15:38:57.629775+0000","last_active":"2023-10-09T15:38:57.629775+0000","last_peered":"2023-10-09T15:38:57.629775+0000","last_clean":"2023-10-09T15:38:57.629775+0000","last_became_active":"2023-10-09T15:38:57.629361+0000","last_became_peered":"2023-10-09T15:38:57.629361+0000","last_unstale":"2023-10-09T15:38:57.629775+0000","last_undegraded":"2023-10-09T15:38:57.629775+0000","last_fullsized":"2023-10-09T15:38:57.629775+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:30.936679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.647212+0000","last_change":"2023-10-09T15:38:56.606044+0000","last_active":"2023-10-09T15:38:57.647212+0000","last_peered":"2023-10-09T15:38:57.647212+0000","last_clean":"2023-10-09T15:38:57.647212+0000","last_became_active":"2023-10-09T15:38:56.605765+0000","last_became_peered":"2023-10-09T15:38:56.605765+0000","last_unstale":"2023-10-09T15:38:57.647212+0000","last_undegraded":"2023-10-09T15:38:57.647212+0000","last_fullsized":"2023-10-09T15:38:57.647212+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:34.435571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629231+0000","last_change":"2023-10-09T15:38:57.629231+0000","last_active":"2023-10-09T15:38:57.629231+0000","last_peered":"2023-10-09T15:38:57.629231+0000","last_clean":"2023-10-09T15:38:57.629231+0000","last_became_active":"2023-10-09T15:38:57.628968+0000","last_became_peered":"2023-10-09T15:38:57.628968+0000","last_unstale":"2023-10-09T15:38:57.629231+0000","last_undegraded":"2023-10-09T15:38:57.629231+0000","last_fullsized":"2023-10-09T15:38:57.629231+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:01.733325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.622447+0000","last_change":"2023-10-09T15:38:56.609121+0000","last_active":"2023-10-09T15:38:57.622447+0000","last_peered":"2023-10-09T15:38:57.622447+0000","last_clean":"2023-10-09T15:38:57.622447+0000","last_became_active":"2023-10-09T15:38:56.608842+0000","last_became_peered":"2023-10-09T15:38:56.608842+0000","last_unstale":"2023-10-09T15:38:57.622447+0000","last_undegraded":"2023-10-09T15:38:57.622447+0000","last_fullsized":"2023-10-09T15:38:57.622447+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:06.770826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631806+0000","last_change":"2023-10-09T15:38:57.631806+0000","last_active":"2023-10-09T15:38:57.631806+0000","last_peered":"2023-10-09T15:38:57.631806+0000","last_clean":"2023-10-09T15:38:57.631806+0000","last_became_active":"2023-10-09T15:38:57.631546+0000","last_became_peered":"2023-10-09T15:38:57.631546+0000","last_unstale":"2023-10-09T15:38:57.631806+0000","last_undegraded":"2023-10-09T15:38:57.631806+0000","last_fullsized":"2023-10-09T15:38:57.631806+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.918104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611578+0000","last_change":"2023-10-09T15:38:56.608918+0000","last_active":"2023-10-09T15:38:56.611578+0000","last_peered":"2023-10-09T15:38:56.611578+0000","last_clean":"2023-10-09T15:38:56.611578+0000","last_became_active":"2023-10-09T15:38:56.608673+0000","last_became_peered":"2023-10-09T15:38:56.608673+0000","last_unstale":"2023-10-09T15:38:56.611578+0000","last_undegraded":"2023-10-09T15:38:56.611578+0000","last_fullsized":"2023-10-09T15:38:56.611578+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:14.065625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634991+0000","last_change":"2023-10-09T15:38:57.634991+0000","last_active":"2023-10-09T15:38:57.634991+0000","last_peered":"2023-10-09T15:38:57.634991+0000","last_clean":"2023-10-09T15:38:57.634991+0000","last_became_active":"2023-10-09T15:38:57.634727+0000","last_became_peered":"2023-10-09T15:38:57.634727+0000","last_unstale":"2023-10-09T15:38:57.634991+0000","last_undegraded":"2023-10-09T15:38:57.634991+0000","last_fullsized":"2023-10-09T15:38:57.634991+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:21.700154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644869+0000","last_change":"2023-10-09T15:38:56.609480+0000","last_active":"2023-10-09T15:38:57.644869+0000","last_peered":"2023-10-09T15:38:57.644869+0000","last_clean":"2023-10-09T15:38:57.644869+0000","last_became_active":"2023-10-09T15:38:56.609240+0000","last_became_peered":"2023-10-09T15:38:56.609240+0000","last_unstale":"2023-10-09T15:38:57.644869+0000","last_undegraded":"2023-10-09T15:38:57.644869+0000","last_fullsized":"2023-10-09T15:38:57.644869+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:17.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636432+0000","last_change":"2023-10-09T15:38:57.636432+0000","last_active":"2023-10-09T15:38:57.636432+0000","last_peered":"2023-10-09T15:38:57.636432+0000","last_clean":"2023-10-09T15:38:57.636432+0000","last_became_active":"2023-10-09T15:38:57.636123+0000","last_became_peered":"2023-10-09T15:38:57.636123+0000","last_unstale":"2023-10-09T15:38:57.636432+0000","last_undegraded":"2023-10-09T15:38:57.636432+0000","last_fullsized":"2023-10-09T15:38:57.636432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:14.418848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611392+0000","last_change":"2023-10-09T15:38:56.609629+0000","last_active":"2023-10-09T15:38:56.611392+0000","last_peered":"2023-10-09T15:38:56.611392+0000","last_clean":"2023-10-09T15:38:56.611392+0000","last_became_active":"2023-10-09T15:38:56.609261+0000","last_became_peered":"2023-10-09T15:38:56.609261+0000","last_unstale":"2023-10-09T15:38:56.611392+0000","last_undegraded":"2023-10-09T15:38:56.611392+0000","last_fullsized":"2023-10-09T15:38:56.611392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:54.603867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.635689+0000","last_change":"2023-10-09T15:38:57.635689+0000","last_active":"2023-10-09T15:38:57.635689+0000","last_peered":"2023-10-09T15:38:57.635689+0000","last_clean":"2023-10-09T15:38:57.635689+0000","last_became_active":"2023-10-09T15:38:57.635409+0000","last_became_peered":"2023-10-09T15:38:57.635409+0000","last_unstale":"2023-10-09T15:38:57.635689+0000","last_undegraded":"2023-10-09T15:38:57.635689+0000","last_fullsized":"2023-10-09T15:38:57.635689+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:57:57.180222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.610007+0000","last_change":"2023-10-09T15:38:56.607906+0000","last_active":"2023-10-09T15:38:56.610007+0000","last_peered":"2023-10-09T15:38:56.610007+0000","last_clean":"2023-10-09T15:38:56.610007+0000","last_became_active":"2023-10-09T15:38:56.606539+0000","last_became_peered":"2023-10-09T15:38:56.606539+0000","last_unstale":"2023-10-09T15:38:56.610007+0000","last_undegraded":"2023-10-09T15:38:56.610007+0000","last_fullsized":"2023-10-09T15:38:56.610007+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:48.631507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639233+0000","last_change":"2023-10-09T15:38:57.639233+0000","last_active":"2023-10-09T15:38:57.639233+0000","last_peered":"2023-10-09T15:38:57.639233+0000","last_clean":"2023-10-09T15:38:57.639233+0000","last_became_active":"2023-10-09T15:38:57.638957+0000","last_became_peered":"2023-10-09T15:38:57.638957+0000","last_unstale":"2023-10-09T15:38:57.639233+0000","last_undegraded":"2023-10-09T15:38:57.639233+0000","last_fullsized":"2023-10-09T15:38:57.639233+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:08.129777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617417+0000","last_change":"2023-10-09T15:38:56.612898+0000","last_active":"2023-10-09T15:38:56.617417+0000","last_peered":"2023-10-09T15:38:56.617417+0000","last_clean":"2023-10-09T15:38:56.617417+0000","last_became_active":"2023-10-09T15:38:56.612618+0000","last_became_peered":"2023-10-09T15:38:56.612618+0000","last_unstale":"2023-10-09T15:38:56.617417+0000","last_undegraded":"2023-10-09T15:38:56.617417+0000","last_fullsized":"2023-10-09T15:38:56.617417+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:43.382840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632742+0000","last_change":"2023-10-09T15:38:57.632742+0000","last_active":"2023-10-09T15:38:57.632742+0000","last_peered":"2023-10-09T15:38:57.632742+0000","last_clean":"2023-10-09T15:38:57.632742+0000","last_became_active":"2023-10-09T15:38:57.632410+0000","last_became_peered":"2023-10-09T15:38:57.632410+0000","last_unstale":"2023-10-09T15:38:57.632742+0000","last_undegraded":"2023-10-09T15:38:57.632742+0000","last_fullsized":"2023-10-09T15:38:57.632742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:44.364244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.650653+0000","last_change":"2023-10-09T15:38:56.609904+0000","last_active":"2023-10-09T15:38:57.650653+0000","last_peered":"2023-10-09T15:38:57.650653+0000","last_clean":"2023-10-09T15:38:57.650653+0000","last_became_active":"2023-10-09T15:38:56.609545+0000","last_became_peered":"2023-10-09T15:38:56.609545+0000","last_unstale":"2023-10-09T15:38:57.650653+0000","last_undegraded":"2023-10-09T15:38:57.650653+0000","last_fullsized":"2023-10-09T15:38:57.650653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:07.361390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627315+0000","last_change":"2023-10-09T15:38:57.627315+0000","last_active":"2023-10-09T15:38:57.627315+0000","last_peered":"2023-10-09T15:38:57.627315+0000","last_clean":"2023-10-09T15:38:57.627315+0000","last_became_active":"2023-10-09T15:38:57.627012+0000","last_became_peered":"2023-10-09T15:38:57.627012+0000","last_unstale":"2023-10-09T15:38:57.627315+0000","last_undegraded":"2023-10-09T15:38:57.627315+0000","last_fullsized":"2023-10-09T15:38:57.627315+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:49.100994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.616668+0000","last_change":"2023-10-09T15:38:56.612070+0000","last_active":"2023-10-09T15:38:56.616668+0000","last_peered":"2023-10-09T15:38:56.616668+0000","last_clean":"2023-10-09T15:38:56.616668+0000","last_became_active":"2023-10-09T15:38:56.611816+0000","last_became_peered":"2023-10-09T15:38:56.611816+0000","last_unstale":"2023-10-09T15:38:56.616668+0000","last_undegraded":"2023-10-09T15:38:56.616668+0000","last_fullsized":"2023-10-09T15:38:56.616668+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:31.372908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627693+0000","last_change":"2023-10-09T15:38:57.627693+0000","last_active":"2023-10-09T15:38:57.627693+0000","last_peered":"2023-10-09T15:38:57.627693+0000","last_clean":"2023-10-09T15:38:57.627693+0000","last_became_active":"2023-10-09T15:38:57.627308+0000","last_became_peered":"2023-10-09T15:38:57.627308+0000","last_unstale":"2023-10-09T15:38:57.627693+0000","last_undegraded":"2023-10-09T15:38:57.627693+0000","last_fullsized":"2023-10-09T15:38:57.627693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:49.260232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611181+0000","last_change":"2023-10-09T15:38:56.607952+0000","last_active":"2023-10-09T15:38:56.611181+0000","last_peered":"2023-10-09T15:38:56.611181+0000","last_clean":"2023-10-09T15:38:56.611181+0000","last_became_active":"2023-10-09T15:38:56.607671+0000","last_became_peered":"2023-10-09T15:38:56.607671+0000","last_unstale":"2023-10-09T15:38:56.611181+0000","last_undegraded":"2023-10-09T15:38:56.611181+0000","last_fullsized":"2023-10-09T15:38:56.611181+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:50.590586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643233+0000","last_change":"2023-10-09T15:38:57.643233+0000","last_active":"2023-10-09T15:38:57.643233+0000","last_peered":"2023-10-09T15:38:57.643233+0000","last_clean":"2023-10-09T15:38:57.643233+0000","last_became_active":"2023-10-09T15:38:57.642869+0000","last_became_peered":"2023-10-09T15:38:57.642869+0000","last_unstale":"2023-10-09T15:38:57.643233+0000","last_undegraded":"2023-10-09T15:38:57.643233+0000","last_fullsized":"2023-10-09T15:38:57.643233+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:59.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611596+0000","last_change":"2023-10-09T15:38:56.610569+0000","last_active":"2023-10-09T15:38:56.611596+0000","last_peered":"2023-10-09T15:38:56.611596+0000","last_clean":"2023-10-09T15:38:56.611596+0000","last_became_active":"2023-10-09T15:38:56.610291+0000","last_became_peered":"2023-10-09T15:38:56.610291+0000","last_unstale":"2023-10-09T15:38:56.611596+0000","last_undegraded":"2023-10-09T15:38:56.611596+0000","last_fullsized":"2023-10-09T15:38:56.611596+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:56.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639095+0000","last_change":"2023-10-09T15:38:57.639095+0000","last_active":"2023-10-09T15:38:57.639095+0000","last_peered":"2023-10-09T15:38:57.639095+0000","last_clean":"2023-10-09T15:38:57.639095+0000","last_became_active":"2023-10-09T15:38:57.638786+0000","last_became_peered":"2023-10-09T15:38:57.638786+0000","last_unstale":"2023-10-09T15:38:57.639095+0000","last_undegraded":"2023-10-09T15:38:57.639095+0000","last_fullsized":"2023-10-09T15:38:57.639095+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.918104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611613+0000","last_change":"2023-10-09T15:38:56.608471+0000","last_active":"2023-10-09T15:38:56.611613+0000","last_peered":"2023-10-09T15:38:56.611613+0000","last_clean":"2023-10-09T15:38:56.611613+0000","last_became_active":"2023-10-09T15:38:56.608168+0000","last_became_peered":"2023-10-09T15:38:56.608168+0000","last_unstale":"2023-10-09T15:38:56.611613+0000","last_undegraded":"2023-10-09T15:38:56.611613+0000","last_fullsized":"2023-10-09T15:38:56.611613+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:29.203588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633615+0000","last_change":"2023-10-09T15:38:57.633615+0000","last_active":"2023-10-09T15:38:57.633615+0000","last_peered":"2023-10-09T15:38:57.633615+0000","last_clean":"2023-10-09T15:38:57.633615+0000","last_became_active":"2023-10-09T15:38:57.633186+0000","last_became_peered":"2023-10-09T15:38:57.633186+0000","last_unstale":"2023-10-09T15:38:57.633615+0000","last_undegraded":"2023-10-09T15:38:57.633615+0000","last_fullsized":"2023-10-09T15:38:57.633615+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:15.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617453+0000","last_change":"2023-10-09T15:38:56.612974+0000","last_active":"2023-10-09T15:38:56.617453+0000","last_peered":"2023-10-09T15:38:56.617453+0000","last_clean":"2023-10-09T15:38:56.617453+0000","last_became_active":"2023-10-09T15:38:56.612684+0000","last_became_peered":"2023-10-09T15:38:56.612684+0000","last_unstale":"2023-10-09T15:38:56.617453+0000","last_undegraded":"2023-10-09T15:38:56.617453+0000","last_fullsized":"2023-10-09T15:38:56.617453+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:07.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626819+0000","last_change":"2023-10-09T15:38:57.626819+0000","last_active":"2023-10-09T15:38:57.626819+0000","last_peered":"2023-10-09T15:38:57.626819+0000","last_clean":"2023-10-09T15:38:57.626819+0000","last_became_active":"2023-10-09T15:38:57.626146+0000","last_became_peered":"2023-10-09T15:38:57.626146+0000","last_unstale":"2023-10-09T15:38:57.626819+0000","last_undegraded":"2023-10-09T15:38:57.626819+0000","last_fullsized":"2023-10-09T15:38:57.626819+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:57:29.260800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.605073+0000","last_change":"2023-10-09T15:38:56.601115+0000","last_active":"2023-10-09T15:38:56.605073+0000","last_peered":"2023-10-09T15:38:56.605073+0000","last_clean":"2023-10-09T15:38:56.605073+0000","last_became_active":"2023-10-09T15:38:56.600551+0000","last_became_peered":"2023-10-09T15:38:56.600551+0000","last_unstale":"2023-10-09T15:38:56.605073+0000","last_undegraded":"2023-10-09T15:38:56.605073+0000","last_fullsized":"2023-10-09T15:38:56.605073+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:43.360136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626787+0000","last_change":"2023-10-09T15:38:57.626787+0000","last_active":"2023-10-09T15:38:57.626787+0000","last_peered":"2023-10-09T15:38:57.626787+0000","last_clean":"2023-10-09T15:38:57.626787+0000","last_became_active":"2023-10-09T15:38:57.626465+0000","last_became_peered":"2023-10-09T15:38:57.626465+0000","last_unstale":"2023-10-09T15:38:57.626787+0000","last_undegraded":"2023-10-09T15:38:57.626787+0000","last_fullsized":"2023-10-09T15:38:57.626787+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:41.388467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611477+0000","last_change":"2023-10-09T15:38:56.607257+0000","last_active":"2023-10-09T15:38:56.611477+0000","last_peered":"2023-10-09T15:38:56.611477+0000","last_clean":"2023-10-09T15:38:56.611477+0000","last_became_active":"2023-10-09T15:38:56.606943+0000","last_became_peered":"2023-10-09T15:38:56.606943+0000","last_unstale":"2023-10-09T15:38:56.611477+0000","last_undegraded":"2023-10-09T15:38:56.611477+0000","last_fullsized":"2023-10-09T15:38:56.611477+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:30.449353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630283+0000","last_change":"2023-10-09T15:38:57.630283+0000","last_active":"2023-10-09T15:38:57.630283+0000","last_peered":"2023-10-09T15:38:57.630283+0000","last_clean":"2023-10-09T15:38:57.630283+0000","last_became_active":"2023-10-09T15:38:57.630006+0000","last_became_peered":"2023-10-09T15:38:57.630006+0000","last_unstale":"2023-10-09T15:38:57.630283+0000","last_undegraded":"2023-10-09T15:38:57.630283+0000","last_fullsized":"2023-10-09T15:38:57.630283+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:16.334537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.622216+0000","last_change":"2023-10-09T15:38:56.611561+0000","last_active":"2023-10-09T15:38:57.622216+0000","last_peered":"2023-10-09T15:38:57.622216+0000","last_clean":"2023-10-09T15:38:57.622216+0000","last_became_active":"2023-10-09T15:38:56.611187+0000","last_became_peered":"2023-10-09T15:38:56.611187+0000","last_unstale":"2023-10-09T15:38:57.622216+0000","last_undegraded":"2023-10-09T15:38:57.622216+0000","last_fullsized":"2023-10-09T15:38:57.622216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.197652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.603410+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:56.603410+0000","last_peered":"2023-10-09T15:38:56.603410+0000","last_clean":"2023-10-09T15:38:56.603410+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:56.603410+0000","last_undegraded":"2023-10-09T15:38:56.603410+0000","last_fullsized":"2023-10-09T15:38:56.603410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1473219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.85499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.748},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.76700000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.81299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":881869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303308,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068532,"statfs":{"total":96636764160,"available":96326176768,"internally_reserved":0,"allocated":1970176,"data_stored":881371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.252}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.313},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1470762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.31},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.504},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.49099999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.628},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.64600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303300,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":1961984,"data_stored":881315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.495}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":881497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.47399999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303288,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068552,"statfs":{"total":96636764160,"available":96326197248,"internally_reserved":0,"allocated":1949696,"data_stored":874552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81399999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.84099999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":881869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.503},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.47899999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.436},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:39:01.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:39:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.895+0000 7fc04b8b3700 1 Processor -- start 2023-10-09T15:39:01.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.895+0000 7fc04b8b3700 1 -- start start 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04b8b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 0x7fc044159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04b8b3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc04415a400 0x7fc044156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04b8b3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc04415ae40 con 0x7fc0440cb5a0 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04b8b3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0440ce0f0 con 0x7fc04415a400 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04b8b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440cbde0 con 0x7fc0440cb970 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc049e50700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc04415a400 0x7fc044156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04964f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc0440cb5a0 0x7fc0440cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54844/0 (socket says 172.21.15.33:54844) 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc04964f700 1 -- 172.21.15.33:0/687722947 learned_addr learned my addr 172.21.15.33:0/687722947 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:01.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.896+0000 7fc048e4e700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 0x7fc044159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc043fff700 1 -- 172.21.15.33:0/687722947 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758344866 0 0) 0x7fc04415ae40 con 0x7fc0440cb5a0 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc043fff700 1 -- 172.21.15.33:0/687722947 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc02c003570 con 0x7fc0440cb5a0 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc049e50700 1 -- 172.21.15.33:0/687722947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 msgr2=0x7fc044159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc049e50700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 0x7fc044159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc049e50700 1 -- 172.21.15.33:0/687722947 >> v1:172.21.15.33:6789/0 conn(0x7fc0440cb5a0 legacy=0x7fc0440cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc049e50700 1 -- 172.21.15.33:0/687722947 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04415ab60 con 0x7fc04415a400 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc048e4e700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 0x7fc044159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc049e50700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc04415a400 0x7fc044156e90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc034009910 tx=0x7fc0340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9d5b59b53be675 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc043fff700 1 -- 172.21.15.33:0/687722947 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400b640 con 0x7fc04415a400 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc043fff700 1 -- 172.21.15.33:0/687722947 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03400b7a0 con 0x7fc04415a400 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc043fff700 1 -- 172.21.15.33:0/687722947 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03400bb60 con 0x7fc04415a400 2023-10-09T15:39:01.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 -- 172.21.15.33:0/687722947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc04415a400 msgr2=0x7fc044156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc04415a400 0x7fc044156e90 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7fc034009910 tx=0x7fc0340091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 -- 172.21.15.33:0/687722947 shutdown_connections 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc04415a400 0x7fc044156e90 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/687722947 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0440cb970 0x7fc044159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.897+0000 7fc04b8b3700 1 -- 172.21.15.33:0/687722947 >> 172.21.15.33:0/687722947 conn(0x7fc044070e30 msgr2=0x7fc0440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.898+0000 7fc04b8b3700 1 -- 172.21.15.33:0/687722947 shutdown_connections 2023-10-09T15:39:01.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.898+0000 7fc04b8b3700 1 -- 172.21.15.33:0/687722947 wait complete. 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.899+0000 7fc04b8b3700 1 Processor -- start 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.899+0000 7fc04b8b3700 1 -- start start 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0440cb970 0x7fc044169d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 0x7fc0440ca2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440ca7e0 con 0x7fc0440cb5a0 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b4160 con 0x7fc0440cb970 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0440b3550 con 0x7fc04415a400 2023-10-09T15:39:01.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60918/0 (socket says 172.21.15.33:60918) 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 -- 172.21.15.33:0/795381238 learned_addr learned my addr 172.21.15.33:0/795381238 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc049e50700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 0x7fc0440ca2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc048e4e700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0440cb970 0x7fc044169d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 -- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 msgr2=0x7fc0440ca2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 0x7fc0440ca2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 -- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0440cb970 msgr2=0x7fc044169d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0440cb970 0x7fc044169d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 -- 172.21.15.33:0/795381238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc034009420 con 0x7fc0440cb5a0 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc049e50700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 0x7fc0440ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04964f700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00cc40 tx=0x7fc03c001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c00a9c0 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc03c00ab40 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0440b3830 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc03c0070f0 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.900+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0440b3df0 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.901+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0440cc5f0 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.902+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc03c007520 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.902+0000 7fc0417fa700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 0x7fc0300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.902+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc03c085190 con 0x7fc0440cb5a0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.902+0000 7fc048e4e700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 0x7fc0300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:01.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.903+0000 7fc048e4e700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 0x7fc0300697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc038006f00 tx=0x7fc038008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:01.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:01.906+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc03c051e60 con 0x7fc0440cb5a0 2023-10-09T15:39:02.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.096+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc0440b42a0 con 0x7fc030067320 2023-10-09T15:39:02.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.104+0000 7fc0417fa700 1 -- 172.21.15.33:0/795381238 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289717 (secure 0 0 0) 0x7fc038010640 con 0x7fc030067320 2023-10-09T15:39:02.107 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.107+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 msgr2=0x7fc0300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.107+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 0x7fc0300697d0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc038006f00 tx=0x7fc038008040 comp rx=0 tx=0).stop 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.107+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 msgr2=0x7fc044151110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.107+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7fc03c00cc40 tx=0x7fc03c001a70 comp rx=0 tx=0).stop 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 shutdown_connections 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc030067320 0x7fc0300697d0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0440cb5a0 0x7fc044151110 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc04415a400 0x7fc0440ca2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 --2- 172.21.15.33:0/795381238 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0440cb970 0x7fc044169d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 >> 172.21.15.33:0/795381238 conn(0x7fc044070e30 msgr2=0x7fc0440cea50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 shutdown_connections 2023-10-09T15:39:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.108+0000 7fc04b8b3700 1 -- 172.21.15.33:0/795381238 wait complete. 2023-10-09T15:39:02.111 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:39:02.120 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":393,"stamp":"2023-10-09T15:39:01.332237+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2427588,"kb_used_data":16516,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752547132,"statfs":{"total":773094113280,"available":770608263168,"internally_reserved":0,"allocated":16912384,"data_stored":8226454,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.743171"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632983+0000","last_change":"2023-10-09T15:38:57.632983+0000","last_active":"2023-10-09T15:38:57.632983+0000","last_peered":"2023-10-09T15:38:57.632983+0000","last_clean":"2023-10-09T15:38:57.632983+0000","last_became_active":"2023-10-09T15:38:57.632750+0000","last_became_peered":"2023-10-09T15:38:57.632750+0000","last_unstale":"2023-10-09T15:38:57.632983+0000","last_undegraded":"2023-10-09T15:38:57.632983+0000","last_fullsized":"2023-10-09T15:38:57.632983+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:50.201959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626987+0000","last_change":"2023-10-09T15:38:57.626987+0000","last_active":"2023-10-09T15:38:57.626987+0000","last_peered":"2023-10-09T15:38:57.626987+0000","last_clean":"2023-10-09T15:38:57.626987+0000","last_became_active":"2023-10-09T15:38:57.626695+0000","last_became_peered":"2023-10-09T15:38:57.626695+0000","last_unstale":"2023-10-09T15:38:57.626987+0000","last_undegraded":"2023-10-09T15:38:57.626987+0000","last_fullsized":"2023-10-09T15:38:57.626987+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:23:02.628619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631974+0000","last_change":"2023-10-09T15:38:57.631974+0000","last_active":"2023-10-09T15:38:57.631974+0000","last_peered":"2023-10-09T15:38:57.631974+0000","last_clean":"2023-10-09T15:38:57.631974+0000","last_became_active":"2023-10-09T15:38:57.631683+0000","last_became_peered":"2023-10-09T15:38:57.631683+0000","last_unstale":"2023-10-09T15:38:57.631974+0000","last_undegraded":"2023-10-09T15:38:57.631974+0000","last_fullsized":"2023-10-09T15:38:57.631974+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:35.201760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643428+0000","last_change":"2023-10-09T15:38:57.643428+0000","last_active":"2023-10-09T15:38:57.643428+0000","last_peered":"2023-10-09T15:38:57.643428+0000","last_clean":"2023-10-09T15:38:57.643428+0000","last_became_active":"2023-10-09T15:38:57.643177+0000","last_became_peered":"2023-10-09T15:38:57.643177+0000","last_unstale":"2023-10-09T15:38:57.643428+0000","last_undegraded":"2023-10-09T15:38:57.643428+0000","last_fullsized":"2023-10-09T15:38:57.643428+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:43.383441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643029+0000","last_change":"2023-10-09T15:38:57.643029+0000","last_active":"2023-10-09T15:38:57.643029+0000","last_peered":"2023-10-09T15:38:57.643029+0000","last_clean":"2023-10-09T15:38:57.643029+0000","last_became_active":"2023-10-09T15:38:57.642739+0000","last_became_peered":"2023-10-09T15:38:57.642739+0000","last_unstale":"2023-10-09T15:38:57.643029+0000","last_undegraded":"2023-10-09T15:38:57.643029+0000","last_fullsized":"2023-10-09T15:38:57.643029+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:49.635616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.641577+0000","last_change":"2023-10-09T15:38:57.641577+0000","last_active":"2023-10-09T15:38:57.641577+0000","last_peered":"2023-10-09T15:38:57.641577+0000","last_clean":"2023-10-09T15:38:57.641577+0000","last_became_active":"2023-10-09T15:38:57.641321+0000","last_became_peered":"2023-10-09T15:38:57.641321+0000","last_unstale":"2023-10-09T15:38:57.641577+0000","last_undegraded":"2023-10-09T15:38:57.641577+0000","last_fullsized":"2023-10-09T15:38:57.641577+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:55.607975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640073+0000","last_change":"2023-10-09T15:38:57.640073+0000","last_active":"2023-10-09T15:38:57.640073+0000","last_peered":"2023-10-09T15:38:57.640073+0000","last_clean":"2023-10-09T15:38:57.640073+0000","last_became_active":"2023-10-09T15:38:57.639445+0000","last_became_peered":"2023-10-09T15:38:57.639445+0000","last_unstale":"2023-10-09T15:38:57.640073+0000","last_undegraded":"2023-10-09T15:38:57.640073+0000","last_fullsized":"2023-10-09T15:38:57.640073+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:28.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636131+0000","last_change":"2023-10-09T15:38:57.636131+0000","last_active":"2023-10-09T15:38:57.636131+0000","last_peered":"2023-10-09T15:38:57.636131+0000","last_clean":"2023-10-09T15:38:57.636131+0000","last_became_active":"2023-10-09T15:38:57.635849+0000","last_became_peered":"2023-10-09T15:38:57.635849+0000","last_unstale":"2023-10-09T15:38:57.636131+0000","last_undegraded":"2023-10-09T15:38:57.636131+0000","last_fullsized":"2023-10-09T15:38:57.636131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:49.355345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633938+0000","last_change":"2023-10-09T15:38:57.633938+0000","last_active":"2023-10-09T15:38:57.633938+0000","last_peered":"2023-10-09T15:38:57.633938+0000","last_clean":"2023-10-09T15:38:57.633938+0000","last_became_active":"2023-10-09T15:38:57.633689+0000","last_became_peered":"2023-10-09T15:38:57.633689+0000","last_unstale":"2023-10-09T15:38:57.633938+0000","last_undegraded":"2023-10-09T15:38:57.633938+0000","last_fullsized":"2023-10-09T15:38:57.633938+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:15.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630252+0000","last_change":"2023-10-09T15:38:57.630252+0000","last_active":"2023-10-09T15:38:57.630252+0000","last_peered":"2023-10-09T15:38:57.630252+0000","last_clean":"2023-10-09T15:38:57.630252+0000","last_became_active":"2023-10-09T15:38:57.627852+0000","last_became_peered":"2023-10-09T15:38:57.627852+0000","last_unstale":"2023-10-09T15:38:57.630252+0000","last_undegraded":"2023-10-09T15:38:57.630252+0000","last_fullsized":"2023-10-09T15:38:57.630252+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:11.124611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627362+0000","last_change":"2023-10-09T15:38:57.627362+0000","last_active":"2023-10-09T15:38:57.627362+0000","last_peered":"2023-10-09T15:38:57.627362+0000","last_clean":"2023-10-09T15:38:57.627362+0000","last_became_active":"2023-10-09T15:38:57.627096+0000","last_became_peered":"2023-10-09T15:38:57.627096+0000","last_unstale":"2023-10-09T15:38:57.627362+0000","last_undegraded":"2023-10-09T15:38:57.627362+0000","last_fullsized":"2023-10-09T15:38:57.627362+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:50:22.486211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.638135+0000","last_change":"2023-10-09T15:38:57.638135+0000","last_active":"2023-10-09T15:38:57.638135+0000","last_peered":"2023-10-09T15:38:57.638135+0000","last_clean":"2023-10-09T15:38:57.638135+0000","last_became_active":"2023-10-09T15:38:57.637801+0000","last_became_peered":"2023-10-09T15:38:57.637801+0000","last_unstale":"2023-10-09T15:38:57.638135+0000","last_undegraded":"2023-10-09T15:38:57.638135+0000","last_fullsized":"2023-10-09T15:38:57.638135+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:56.140984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633445+0000","last_change":"2023-10-09T15:38:57.633445+0000","last_active":"2023-10-09T15:38:57.633445+0000","last_peered":"2023-10-09T15:38:57.633445+0000","last_clean":"2023-10-09T15:38:57.633445+0000","last_became_active":"2023-10-09T15:38:57.632132+0000","last_became_peered":"2023-10-09T15:38:57.632132+0000","last_unstale":"2023-10-09T15:38:57.633445+0000","last_undegraded":"2023-10-09T15:38:57.633445+0000","last_fullsized":"2023-10-09T15:38:57.633445+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:49.260232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629059+0000","last_change":"2023-10-09T15:38:57.629059+0000","last_active":"2023-10-09T15:38:57.629059+0000","last_peered":"2023-10-09T15:38:57.629059+0000","last_clean":"2023-10-09T15:38:57.629059+0000","last_became_active":"2023-10-09T15:38:57.628796+0000","last_became_peered":"2023-10-09T15:38:57.628796+0000","last_unstale":"2023-10-09T15:38:57.629059+0000","last_undegraded":"2023-10-09T15:38:57.629059+0000","last_fullsized":"2023-10-09T15:38:57.629059+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:05.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630943+0000","last_change":"2023-10-09T15:38:57.630943+0000","last_active":"2023-10-09T15:38:57.630943+0000","last_peered":"2023-10-09T15:38:57.630943+0000","last_clean":"2023-10-09T15:38:57.630943+0000","last_became_active":"2023-10-09T15:38:57.630633+0000","last_became_peered":"2023-10-09T15:38:57.630633+0000","last_unstale":"2023-10-09T15:38:57.630943+0000","last_undegraded":"2023-10-09T15:38:57.630943+0000","last_fullsized":"2023-10-09T15:38:57.630943+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:20.011794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633083+0000","last_change":"2023-10-09T15:38:57.633083+0000","last_active":"2023-10-09T15:38:57.633083+0000","last_peered":"2023-10-09T15:38:57.633083+0000","last_clean":"2023-10-09T15:38:57.633083+0000","last_became_active":"2023-10-09T15:38:57.632847+0000","last_became_peered":"2023-10-09T15:38:57.632847+0000","last_unstale":"2023-10-09T15:38:57.633083+0000","last_undegraded":"2023-10-09T15:38:57.633083+0000","last_fullsized":"2023-10-09T15:38:57.633083+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:56.751437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632884+0000","last_change":"2023-10-09T15:38:57.632884+0000","last_active":"2023-10-09T15:38:57.632884+0000","last_peered":"2023-10-09T15:38:57.632884+0000","last_clean":"2023-10-09T15:38:57.632884+0000","last_became_active":"2023-10-09T15:38:57.632617+0000","last_became_peered":"2023-10-09T15:38:57.632617+0000","last_unstale":"2023-10-09T15:38:57.632884+0000","last_undegraded":"2023-10-09T15:38:57.632884+0000","last_fullsized":"2023-10-09T15:38:57.632884+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:20.966730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631042+0000","last_change":"2023-10-09T15:38:57.631042+0000","last_active":"2023-10-09T15:38:57.631042+0000","last_peered":"2023-10-09T15:38:57.631042+0000","last_clean":"2023-10-09T15:38:57.631042+0000","last_became_active":"2023-10-09T15:38:57.630284+0000","last_became_peered":"2023-10-09T15:38:57.630284+0000","last_unstale":"2023-10-09T15:38:57.631042+0000","last_undegraded":"2023-10-09T15:38:57.631042+0000","last_fullsized":"2023-10-09T15:38:57.631042+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:28.933588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.628045+0000","last_change":"2023-10-09T15:38:57.628045+0000","last_active":"2023-10-09T15:38:57.628045+0000","last_peered":"2023-10-09T15:38:57.628045+0000","last_clean":"2023-10-09T15:38:57.628045+0000","last_became_active":"2023-10-09T15:38:57.627753+0000","last_became_peered":"2023-10-09T15:38:57.627753+0000","last_unstale":"2023-10-09T15:38:57.628045+0000","last_undegraded":"2023-10-09T15:38:57.628045+0000","last_fullsized":"2023-10-09T15:38:57.628045+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:20:58.236257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631855+0000","last_change":"2023-10-09T15:38:57.631855+0000","last_active":"2023-10-09T15:38:57.631855+0000","last_peered":"2023-10-09T15:38:57.631855+0000","last_clean":"2023-10-09T15:38:57.631855+0000","last_became_active":"2023-10-09T15:38:57.631530+0000","last_became_peered":"2023-10-09T15:38:57.631530+0000","last_unstale":"2023-10-09T15:38:57.631855+0000","last_undegraded":"2023-10-09T15:38:57.631855+0000","last_fullsized":"2023-10-09T15:38:57.631855+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:08.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646115+0000","last_change":"2023-10-09T15:38:57.646115+0000","last_active":"2023-10-09T15:38:57.646115+0000","last_peered":"2023-10-09T15:38:57.646115+0000","last_clean":"2023-10-09T15:38:57.646115+0000","last_became_active":"2023-10-09T15:38:57.644939+0000","last_became_peered":"2023-10-09T15:38:57.644939+0000","last_unstale":"2023-10-09T15:38:57.646115+0000","last_undegraded":"2023-10-09T15:38:57.646115+0000","last_fullsized":"2023-10-09T15:38:57.646115+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:28.735851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631214+0000","last_change":"2023-10-09T15:38:57.631214+0000","last_active":"2023-10-09T15:38:57.631214+0000","last_peered":"2023-10-09T15:38:57.631214+0000","last_clean":"2023-10-09T15:38:57.631214+0000","last_became_active":"2023-10-09T15:38:57.630911+0000","last_became_peered":"2023-10-09T15:38:57.630911+0000","last_unstale":"2023-10-09T15:38:57.631214+0000","last_undegraded":"2023-10-09T15:38:57.631214+0000","last_fullsized":"2023-10-09T15:38:57.631214+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:10.284400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643966+0000","last_change":"2023-10-09T15:38:57.643966+0000","last_active":"2023-10-09T15:38:57.643966+0000","last_peered":"2023-10-09T15:38:57.643966+0000","last_clean":"2023-10-09T15:38:57.643966+0000","last_became_active":"2023-10-09T15:38:57.643668+0000","last_became_peered":"2023-10-09T15:38:57.643668+0000","last_unstale":"2023-10-09T15:38:57.643966+0000","last_undegraded":"2023-10-09T15:38:57.643966+0000","last_fullsized":"2023-10-09T15:38:57.643966+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:07.599054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640234+0000","last_change":"2023-10-09T15:38:57.640234+0000","last_active":"2023-10-09T15:38:57.640234+0000","last_peered":"2023-10-09T15:38:57.640234+0000","last_clean":"2023-10-09T15:38:57.640234+0000","last_became_active":"2023-10-09T15:38:57.639730+0000","last_became_peered":"2023-10-09T15:38:57.639730+0000","last_unstale":"2023-10-09T15:38:57.640234+0000","last_undegraded":"2023-10-09T15:38:57.640234+0000","last_fullsized":"2023-10-09T15:38:57.640234+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:15:42.935666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629131+0000","last_change":"2023-10-09T15:38:57.629131+0000","last_active":"2023-10-09T15:38:57.629131+0000","last_peered":"2023-10-09T15:38:57.629131+0000","last_clean":"2023-10-09T15:38:57.629131+0000","last_became_active":"2023-10-09T15:38:57.628883+0000","last_became_peered":"2023-10-09T15:38:57.628883+0000","last_unstale":"2023-10-09T15:38:57.629131+0000","last_undegraded":"2023-10-09T15:38:57.629131+0000","last_fullsized":"2023-10-09T15:38:57.629131+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:40:26.512104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633943+0000","last_change":"2023-10-09T15:38:57.633943+0000","last_active":"2023-10-09T15:38:57.633943+0000","last_peered":"2023-10-09T15:38:57.633943+0000","last_clean":"2023-10-09T15:38:57.633943+0000","last_became_active":"2023-10-09T15:38:57.633664+0000","last_became_peered":"2023-10-09T15:38:57.633664+0000","last_unstale":"2023-10-09T15:38:57.633943+0000","last_undegraded":"2023-10-09T15:38:57.633943+0000","last_fullsized":"2023-10-09T15:38:57.633943+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:03.133090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.637824+0000","last_change":"2023-10-09T15:38:57.637824+0000","last_active":"2023-10-09T15:38:57.637824+0000","last_peered":"2023-10-09T15:38:57.637824+0000","last_clean":"2023-10-09T15:38:57.637824+0000","last_became_active":"2023-10-09T15:38:57.637538+0000","last_became_peered":"2023-10-09T15:38:57.637538+0000","last_unstale":"2023-10-09T15:38:57.637824+0000","last_undegraded":"2023-10-09T15:38:57.637824+0000","last_fullsized":"2023-10-09T15:38:57.637824+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:01.022018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636309+0000","last_change":"2023-10-09T15:38:57.636309+0000","last_active":"2023-10-09T15:38:57.636309+0000","last_peered":"2023-10-09T15:38:57.636309+0000","last_clean":"2023-10-09T15:38:57.636309+0000","last_became_active":"2023-10-09T15:38:57.636013+0000","last_became_peered":"2023-10-09T15:38:57.636013+0000","last_unstale":"2023-10-09T15:38:57.636309+0000","last_undegraded":"2023-10-09T15:38:57.636309+0000","last_fullsized":"2023-10-09T15:38:57.636309+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:31.453461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.638382+0000","last_change":"2023-10-09T15:38:57.638382+0000","last_active":"2023-10-09T15:38:57.638382+0000","last_peered":"2023-10-09T15:38:57.638382+0000","last_clean":"2023-10-09T15:38:57.638382+0000","last_became_active":"2023-10-09T15:38:57.638130+0000","last_became_peered":"2023-10-09T15:38:57.638130+0000","last_unstale":"2023-10-09T15:38:57.638382+0000","last_undegraded":"2023-10-09T15:38:57.638382+0000","last_fullsized":"2023-10-09T15:38:57.638382+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:16.758604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644673+0000","last_change":"2023-10-09T15:38:57.644673+0000","last_active":"2023-10-09T15:38:57.644673+0000","last_peered":"2023-10-09T15:38:57.644673+0000","last_clean":"2023-10-09T15:38:57.644673+0000","last_became_active":"2023-10-09T15:38:57.644453+0000","last_became_peered":"2023-10-09T15:38:57.644453+0000","last_unstale":"2023-10-09T15:38:57.644673+0000","last_undegraded":"2023-10-09T15:38:57.644673+0000","last_fullsized":"2023-10-09T15:38:57.644673+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:01.022018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632051+0000","last_change":"2023-10-09T15:38:57.632051+0000","last_active":"2023-10-09T15:38:57.632051+0000","last_peered":"2023-10-09T15:38:57.632051+0000","last_clean":"2023-10-09T15:38:57.632051+0000","last_became_active":"2023-10-09T15:38:57.631797+0000","last_became_peered":"2023-10-09T15:38:57.631797+0000","last_unstale":"2023-10-09T15:38:57.632051+0000","last_undegraded":"2023-10-09T15:38:57.632051+0000","last_fullsized":"2023-10-09T15:38:57.632051+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:20.966730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634890+0000","last_change":"2023-10-09T15:38:57.634890+0000","last_active":"2023-10-09T15:38:57.634890+0000","last_peered":"2023-10-09T15:38:57.634890+0000","last_clean":"2023-10-09T15:38:57.634890+0000","last_became_active":"2023-10-09T15:38:57.634636+0000","last_became_peered":"2023-10-09T15:38:57.634636+0000","last_unstale":"2023-10-09T15:38:57.634890+0000","last_undegraded":"2023-10-09T15:38:57.634890+0000","last_fullsized":"2023-10-09T15:38:57.634890+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:02.534593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630259+0000","last_change":"2023-10-09T15:38:57.630259+0000","last_active":"2023-10-09T15:38:57.630259+0000","last_peered":"2023-10-09T15:38:57.630259+0000","last_clean":"2023-10-09T15:38:57.630259+0000","last_became_active":"2023-10-09T15:38:57.629972+0000","last_became_peered":"2023-10-09T15:38:57.629972+0000","last_unstale":"2023-10-09T15:38:57.630259+0000","last_undegraded":"2023-10-09T15:38:57.630259+0000","last_fullsized":"2023-10-09T15:38:57.630259+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:46:02.841409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"155'4","reported_seq":13,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.648692+0000","last_change":"2023-10-09T15:38:56.609661+0000","last_active":"2023-10-09T15:38:57.648692+0000","last_peered":"2023-10-09T15:38:57.648692+0000","last_clean":"2023-10-09T15:38:57.648692+0000","last_became_active":"2023-10-09T15:38:56.609382+0000","last_became_peered":"2023-10-09T15:38:56.609382+0000","last_unstale":"2023-10-09T15:38:57.648692+0000","last_undegraded":"2023-10-09T15:38:57.648692+0000","last_fullsized":"2023-10-09T15:38:57.648692+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:13.414739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642903+0000","last_change":"2023-10-09T15:38:57.642903+0000","last_active":"2023-10-09T15:38:57.642903+0000","last_peered":"2023-10-09T15:38:57.642903+0000","last_clean":"2023-10-09T15:38:57.642903+0000","last_became_active":"2023-10-09T15:38:57.642582+0000","last_became_peered":"2023-10-09T15:38:57.642582+0000","last_unstale":"2023-10-09T15:38:57.642903+0000","last_undegraded":"2023-10-09T15:38:57.642903+0000","last_fullsized":"2023-10-09T15:38:57.642903+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:47:27.157600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.620590+0000","last_change":"2023-10-09T15:38:56.609605+0000","last_active":"2023-10-09T15:38:57.620590+0000","last_peered":"2023-10-09T15:38:57.620590+0000","last_clean":"2023-10-09T15:38:57.620590+0000","last_became_active":"2023-10-09T15:38:56.609268+0000","last_became_peered":"2023-10-09T15:38:56.609268+0000","last_unstale":"2023-10-09T15:38:57.620590+0000","last_undegraded":"2023-10-09T15:38:57.620590+0000","last_fullsized":"2023-10-09T15:38:57.620590+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:39:31.441201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639411+0000","last_change":"2023-10-09T15:38:57.639411+0000","last_active":"2023-10-09T15:38:57.639411+0000","last_peered":"2023-10-09T15:38:57.639411+0000","last_clean":"2023-10-09T15:38:57.639411+0000","last_became_active":"2023-10-09T15:38:57.638950+0000","last_became_peered":"2023-10-09T15:38:57.638950+0000","last_unstale":"2023-10-09T15:38:57.639411+0000","last_undegraded":"2023-10-09T15:38:57.639411+0000","last_fullsized":"2023-10-09T15:38:57.639411+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:56.751437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.648428+0000","last_change":"2023-10-09T15:38:56.606832+0000","last_active":"2023-10-09T15:38:57.648428+0000","last_peered":"2023-10-09T15:38:57.648428+0000","last_clean":"2023-10-09T15:38:57.648428+0000","last_became_active":"2023-10-09T15:38:56.606261+0000","last_became_peered":"2023-10-09T15:38:56.606261+0000","last_unstale":"2023-10-09T15:38:57.648428+0000","last_undegraded":"2023-10-09T15:38:57.648428+0000","last_fullsized":"2023-10-09T15:38:57.648428+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:37.107485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634807+0000","last_change":"2023-10-09T15:38:57.634807+0000","last_active":"2023-10-09T15:38:57.634807+0000","last_peered":"2023-10-09T15:38:57.634807+0000","last_clean":"2023-10-09T15:38:57.634807+0000","last_became_active":"2023-10-09T15:38:57.634479+0000","last_became_peered":"2023-10-09T15:38:57.634479+0000","last_unstale":"2023-10-09T15:38:57.634807+0000","last_undegraded":"2023-10-09T15:38:57.634807+0000","last_fullsized":"2023-10-09T15:38:57.634807+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:10:05.189420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649038+0000","last_change":"2023-10-09T15:38:56.611018+0000","last_active":"2023-10-09T15:38:57.649038+0000","last_peered":"2023-10-09T15:38:57.649038+0000","last_clean":"2023-10-09T15:38:57.649038+0000","last_became_active":"2023-10-09T15:38:56.610751+0000","last_became_peered":"2023-10-09T15:38:56.610751+0000","last_unstale":"2023-10-09T15:38:57.649038+0000","last_undegraded":"2023-10-09T15:38:57.649038+0000","last_fullsized":"2023-10-09T15:38:57.649038+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:58:49.202997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646105+0000","last_change":"2023-10-09T15:38:57.646105+0000","last_active":"2023-10-09T15:38:57.646105+0000","last_peered":"2023-10-09T15:38:57.646105+0000","last_clean":"2023-10-09T15:38:57.646105+0000","last_became_active":"2023-10-09T15:38:57.645817+0000","last_became_peered":"2023-10-09T15:38:57.645817+0000","last_unstale":"2023-10-09T15:38:57.646105+0000","last_undegraded":"2023-10-09T15:38:57.646105+0000","last_fullsized":"2023-10-09T15:38:57.646105+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:26.814232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629882+0000","last_change":"2023-10-09T15:38:56.608488+0000","last_active":"2023-10-09T15:38:57.629882+0000","last_peered":"2023-10-09T15:38:57.629882+0000","last_clean":"2023-10-09T15:38:57.629882+0000","last_became_active":"2023-10-09T15:38:56.608199+0000","last_became_peered":"2023-10-09T15:38:56.608199+0000","last_unstale":"2023-10-09T15:38:57.629882+0000","last_undegraded":"2023-10-09T15:38:57.629882+0000","last_fullsized":"2023-10-09T15:38:57.629882+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:15:38.107470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642058+0000","last_change":"2023-10-09T15:38:57.642058+0000","last_active":"2023-10-09T15:38:57.642058+0000","last_peered":"2023-10-09T15:38:57.642058+0000","last_clean":"2023-10-09T15:38:57.642058+0000","last_became_active":"2023-10-09T15:38:57.641819+0000","last_became_peered":"2023-10-09T15:38:57.641819+0000","last_unstale":"2023-10-09T15:38:57.642058+0000","last_undegraded":"2023-10-09T15:38:57.642058+0000","last_fullsized":"2023-10-09T15:38:57.642058+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:01:06.795286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611215+0000","last_change":"2023-10-09T15:38:56.607841+0000","last_active":"2023-10-09T15:38:56.611215+0000","last_peered":"2023-10-09T15:38:56.611215+0000","last_clean":"2023-10-09T15:38:56.611215+0000","last_became_active":"2023-10-09T15:38:56.607536+0000","last_became_peered":"2023-10-09T15:38:56.607536+0000","last_unstale":"2023-10-09T15:38:56.611215+0000","last_undegraded":"2023-10-09T15:38:56.611215+0000","last_fullsized":"2023-10-09T15:38:56.611215+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:06.594946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643480+0000","last_change":"2023-10-09T15:38:57.643480+0000","last_active":"2023-10-09T15:38:57.643480+0000","last_peered":"2023-10-09T15:38:57.643480+0000","last_clean":"2023-10-09T15:38:57.643480+0000","last_became_active":"2023-10-09T15:38:57.643200+0000","last_became_peered":"2023-10-09T15:38:57.643200+0000","last_unstale":"2023-10-09T15:38:57.643480+0000","last_undegraded":"2023-10-09T15:38:57.643480+0000","last_fullsized":"2023-10-09T15:38:57.643480+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:03.900018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.614254+0000","last_change":"2023-10-09T15:38:56.607329+0000","last_active":"2023-10-09T15:38:56.614254+0000","last_peered":"2023-10-09T15:38:56.614254+0000","last_clean":"2023-10-09T15:38:56.614254+0000","last_became_active":"2023-10-09T15:38:56.607042+0000","last_became_peered":"2023-10-09T15:38:56.607042+0000","last_unstale":"2023-10-09T15:38:56.614254+0000","last_undegraded":"2023-10-09T15:38:56.614254+0000","last_fullsized":"2023-10-09T15:38:56.614254+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:14.515060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649907+0000","last_change":"2023-10-09T15:38:57.649907+0000","last_active":"2023-10-09T15:38:57.649907+0000","last_peered":"2023-10-09T15:38:57.649907+0000","last_clean":"2023-10-09T15:38:57.649907+0000","last_became_active":"2023-10-09T15:38:57.649630+0000","last_became_peered":"2023-10-09T15:38:57.649630+0000","last_unstale":"2023-10-09T15:38:57.649907+0000","last_undegraded":"2023-10-09T15:38:57.649907+0000","last_fullsized":"2023-10-09T15:38:57.649907+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:59.466759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617508+0000","last_change":"2023-10-09T15:38:56.615056+0000","last_active":"2023-10-09T15:38:56.617508+0000","last_peered":"2023-10-09T15:38:56.617508+0000","last_clean":"2023-10-09T15:38:56.617508+0000","last_became_active":"2023-10-09T15:38:56.614734+0000","last_became_peered":"2023-10-09T15:38:56.614734+0000","last_unstale":"2023-10-09T15:38:56.617508+0000","last_undegraded":"2023-10-09T15:38:56.617508+0000","last_fullsized":"2023-10-09T15:38:56.617508+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:31.372908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626466+0000","last_change":"2023-10-09T15:38:57.626466+0000","last_active":"2023-10-09T15:38:57.626466+0000","last_peered":"2023-10-09T15:38:57.626466+0000","last_clean":"2023-10-09T15:38:57.626466+0000","last_became_active":"2023-10-09T15:38:57.626162+0000","last_became_peered":"2023-10-09T15:38:57.626162+0000","last_unstale":"2023-10-09T15:38:57.626466+0000","last_undegraded":"2023-10-09T15:38:57.626466+0000","last_fullsized":"2023-10-09T15:38:57.626466+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:21.366741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.616718+0000","last_change":"2023-10-09T15:38:56.609732+0000","last_active":"2023-10-09T15:38:56.616718+0000","last_peered":"2023-10-09T15:38:56.616718+0000","last_clean":"2023-10-09T15:38:56.616718+0000","last_became_active":"2023-10-09T15:38:56.609535+0000","last_became_peered":"2023-10-09T15:38:56.609535+0000","last_unstale":"2023-10-09T15:38:56.616718+0000","last_undegraded":"2023-10-09T15:38:56.616718+0000","last_fullsized":"2023-10-09T15:38:56.616718+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:48:55.136875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.646870+0000","last_change":"2023-10-09T15:38:57.646870+0000","last_active":"2023-10-09T15:38:57.646870+0000","last_peered":"2023-10-09T15:38:57.646870+0000","last_clean":"2023-10-09T15:38:57.646870+0000","last_became_active":"2023-10-09T15:38:57.646621+0000","last_became_peered":"2023-10-09T15:38:57.646621+0000","last_unstale":"2023-10-09T15:38:57.646870+0000","last_undegraded":"2023-10-09T15:38:57.646870+0000","last_fullsized":"2023-10-09T15:38:57.646870+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:36:08.566006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"155'3","reported_seq":12,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644157+0000","last_change":"2023-10-09T15:38:56.610279+0000","last_active":"2023-10-09T15:38:57.644157+0000","last_peered":"2023-10-09T15:38:57.644157+0000","last_clean":"2023-10-09T15:38:57.644157+0000","last_became_active":"2023-10-09T15:38:56.609972+0000","last_became_peered":"2023-10-09T15:38:56.609972+0000","last_unstale":"2023-10-09T15:38:57.644157+0000","last_undegraded":"2023-10-09T15:38:57.644157+0000","last_fullsized":"2023-10-09T15:38:57.644157+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:01.634787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634280+0000","last_change":"2023-10-09T15:38:57.634280+0000","last_active":"2023-10-09T15:38:57.634280+0000","last_peered":"2023-10-09T15:38:57.634280+0000","last_clean":"2023-10-09T15:38:57.634280+0000","last_became_active":"2023-10-09T15:38:57.634012+0000","last_became_peered":"2023-10-09T15:38:57.634012+0000","last_unstale":"2023-10-09T15:38:57.634280+0000","last_undegraded":"2023-10-09T15:38:57.634280+0000","last_fullsized":"2023-10-09T15:38:57.634280+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:37:52.341877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"155'6","reported_seq":15,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.650857+0000","last_change":"2023-10-09T15:38:56.607563+0000","last_active":"2023-10-09T15:38:57.650857+0000","last_peered":"2023-10-09T15:38:57.650857+0000","last_clean":"2023-10-09T15:38:57.650857+0000","last_became_active":"2023-10-09T15:38:56.607309+0000","last_became_peered":"2023-10-09T15:38:56.607309+0000","last_unstale":"2023-10-09T15:38:57.650857+0000","last_undegraded":"2023-10-09T15:38:57.650857+0000","last_fullsized":"2023-10-09T15:38:57.650857+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:43.252016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.642281+0000","last_change":"2023-10-09T15:38:57.642281+0000","last_active":"2023-10-09T15:38:57.642281+0000","last_peered":"2023-10-09T15:38:57.642281+0000","last_clean":"2023-10-09T15:38:57.642281+0000","last_became_active":"2023-10-09T15:38:57.641558+0000","last_became_peered":"2023-10-09T15:38:57.641558+0000","last_unstale":"2023-10-09T15:38:57.642281+0000","last_undegraded":"2023-10-09T15:38:57.642281+0000","last_fullsized":"2023-10-09T15:38:57.642281+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:30:59.466759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.647718+0000","last_change":"2023-10-09T15:38:56.608202+0000","last_active":"2023-10-09T15:38:57.647718+0000","last_peered":"2023-10-09T15:38:57.647718+0000","last_clean":"2023-10-09T15:38:57.647718+0000","last_became_active":"2023-10-09T15:38:56.607919+0000","last_became_peered":"2023-10-09T15:38:56.607919+0000","last_unstale":"2023-10-09T15:38:57.647718+0000","last_undegraded":"2023-10-09T15:38:57.647718+0000","last_fullsized":"2023-10-09T15:38:57.647718+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:20:15.754495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.635911+0000","last_change":"2023-10-09T15:38:57.635911+0000","last_active":"2023-10-09T15:38:57.635911+0000","last_peered":"2023-10-09T15:38:57.635911+0000","last_clean":"2023-10-09T15:38:57.635911+0000","last_became_active":"2023-10-09T15:38:57.635657+0000","last_became_peered":"2023-10-09T15:38:57.635657+0000","last_unstale":"2023-10-09T15:38:57.635911+0000","last_undegraded":"2023-10-09T15:38:57.635911+0000","last_fullsized":"2023-10-09T15:38:57.635911+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:12.734027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.607478+0000","last_change":"2023-10-09T15:38:56.606842+0000","last_active":"2023-10-09T15:38:56.607478+0000","last_peered":"2023-10-09T15:38:56.607478+0000","last_clean":"2023-10-09T15:38:56.607478+0000","last_became_active":"2023-10-09T15:38:56.606550+0000","last_became_peered":"2023-10-09T15:38:56.606550+0000","last_unstale":"2023-10-09T15:38:56.607478+0000","last_undegraded":"2023-10-09T15:38:56.607478+0000","last_fullsized":"2023-10-09T15:38:56.607478+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:29:00.017909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627006+0000","last_change":"2023-10-09T15:38:57.627006+0000","last_active":"2023-10-09T15:38:57.627006+0000","last_peered":"2023-10-09T15:38:57.627006+0000","last_clean":"2023-10-09T15:38:57.627006+0000","last_became_active":"2023-10-09T15:38:57.626549+0000","last_became_peered":"2023-10-09T15:38:57.626549+0000","last_unstale":"2023-10-09T15:38:57.627006+0000","last_undegraded":"2023-10-09T15:38:57.627006+0000","last_fullsized":"2023-10-09T15:38:57.627006+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:23:53.903413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.612092+0000","last_change":"2023-10-09T15:38:56.606015+0000","last_active":"2023-10-09T15:38:56.612092+0000","last_peered":"2023-10-09T15:38:56.612092+0000","last_clean":"2023-10-09T15:38:56.612092+0000","last_became_active":"2023-10-09T15:38:56.605715+0000","last_became_peered":"2023-10-09T15:38:56.605715+0000","last_unstale":"2023-10-09T15:38:56.612092+0000","last_undegraded":"2023-10-09T15:38:56.612092+0000","last_fullsized":"2023-10-09T15:38:56.612092+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:13.836597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.640249+0000","last_change":"2023-10-09T15:38:57.640249+0000","last_active":"2023-10-09T15:38:57.640249+0000","last_peered":"2023-10-09T15:38:57.640249+0000","last_clean":"2023-10-09T15:38:57.640249+0000","last_became_active":"2023-10-09T15:38:57.639815+0000","last_became_peered":"2023-10-09T15:38:57.639815+0000","last_unstale":"2023-10-09T15:38:57.640249+0000","last_undegraded":"2023-10-09T15:38:57.640249+0000","last_fullsized":"2023-10-09T15:38:57.640249+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:12.734027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"155'8","reported_seq":17,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.649006+0000","last_change":"2023-10-09T15:38:56.604662+0000","last_active":"2023-10-09T15:38:57.649006+0000","last_peered":"2023-10-09T15:38:57.649006+0000","last_clean":"2023-10-09T15:38:57.649006+0000","last_became_active":"2023-10-09T15:38:56.604394+0000","last_became_peered":"2023-10-09T15:38:56.604394+0000","last_unstale":"2023-10-09T15:38:57.649006+0000","last_undegraded":"2023-10-09T15:38:57.649006+0000","last_fullsized":"2023-10-09T15:38:57.649006+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:59:07.346436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634113+0000","last_change":"2023-10-09T15:38:57.634113+0000","last_active":"2023-10-09T15:38:57.634113+0000","last_peered":"2023-10-09T15:38:57.634113+0000","last_clean":"2023-10-09T15:38:57.634113+0000","last_became_active":"2023-10-09T15:38:57.633817+0000","last_became_peered":"2023-10-09T15:38:57.633817+0000","last_unstale":"2023-10-09T15:38:57.634113+0000","last_undegraded":"2023-10-09T15:38:57.634113+0000","last_fullsized":"2023-10-09T15:38:57.634113+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:44.364244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.625900+0000","last_change":"2023-10-09T15:38:56.612759+0000","last_active":"2023-10-09T15:38:57.625900+0000","last_peered":"2023-10-09T15:38:57.625900+0000","last_clean":"2023-10-09T15:38:57.625900+0000","last_became_active":"2023-10-09T15:38:56.612515+0000","last_became_peered":"2023-10-09T15:38:56.612515+0000","last_unstale":"2023-10-09T15:38:57.625900+0000","last_undegraded":"2023-10-09T15:38:57.625900+0000","last_fullsized":"2023-10-09T15:38:57.625900+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:58.825513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629775+0000","last_change":"2023-10-09T15:38:57.629775+0000","last_active":"2023-10-09T15:38:57.629775+0000","last_peered":"2023-10-09T15:38:57.629775+0000","last_clean":"2023-10-09T15:38:57.629775+0000","last_became_active":"2023-10-09T15:38:57.629361+0000","last_became_peered":"2023-10-09T15:38:57.629361+0000","last_unstale":"2023-10-09T15:38:57.629775+0000","last_undegraded":"2023-10-09T15:38:57.629775+0000","last_fullsized":"2023-10-09T15:38:57.629775+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:30.936679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.647212+0000","last_change":"2023-10-09T15:38:56.606044+0000","last_active":"2023-10-09T15:38:57.647212+0000","last_peered":"2023-10-09T15:38:57.647212+0000","last_clean":"2023-10-09T15:38:57.647212+0000","last_became_active":"2023-10-09T15:38:56.605765+0000","last_became_peered":"2023-10-09T15:38:56.605765+0000","last_unstale":"2023-10-09T15:38:57.647212+0000","last_undegraded":"2023-10-09T15:38:57.647212+0000","last_fullsized":"2023-10-09T15:38:57.647212+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:34.435571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.629231+0000","last_change":"2023-10-09T15:38:57.629231+0000","last_active":"2023-10-09T15:38:57.629231+0000","last_peered":"2023-10-09T15:38:57.629231+0000","last_clean":"2023-10-09T15:38:57.629231+0000","last_became_active":"2023-10-09T15:38:57.628968+0000","last_became_peered":"2023-10-09T15:38:57.628968+0000","last_unstale":"2023-10-09T15:38:57.629231+0000","last_undegraded":"2023-10-09T15:38:57.629231+0000","last_fullsized":"2023-10-09T15:38:57.629231+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:45:01.733325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.622447+0000","last_change":"2023-10-09T15:38:56.609121+0000","last_active":"2023-10-09T15:38:57.622447+0000","last_peered":"2023-10-09T15:38:57.622447+0000","last_clean":"2023-10-09T15:38:57.622447+0000","last_became_active":"2023-10-09T15:38:56.608842+0000","last_became_peered":"2023-10-09T15:38:56.608842+0000","last_unstale":"2023-10-09T15:38:57.622447+0000","last_undegraded":"2023-10-09T15:38:57.622447+0000","last_fullsized":"2023-10-09T15:38:57.622447+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:22:06.770826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.631806+0000","last_change":"2023-10-09T15:38:57.631806+0000","last_active":"2023-10-09T15:38:57.631806+0000","last_peered":"2023-10-09T15:38:57.631806+0000","last_clean":"2023-10-09T15:38:57.631806+0000","last_became_active":"2023-10-09T15:38:57.631546+0000","last_became_peered":"2023-10-09T15:38:57.631546+0000","last_unstale":"2023-10-09T15:38:57.631806+0000","last_undegraded":"2023-10-09T15:38:57.631806+0000","last_fullsized":"2023-10-09T15:38:57.631806+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.918104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611578+0000","last_change":"2023-10-09T15:38:56.608918+0000","last_active":"2023-10-09T15:38:56.611578+0000","last_peered":"2023-10-09T15:38:56.611578+0000","last_clean":"2023-10-09T15:38:56.611578+0000","last_became_active":"2023-10-09T15:38:56.608673+0000","last_became_peered":"2023-10-09T15:38:56.608673+0000","last_unstale":"2023-10-09T15:38:56.611578+0000","last_undegraded":"2023-10-09T15:38:56.611578+0000","last_fullsized":"2023-10-09T15:38:56.611578+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:30:14.065625+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.634991+0000","last_change":"2023-10-09T15:38:57.634991+0000","last_active":"2023-10-09T15:38:57.634991+0000","last_peered":"2023-10-09T15:38:57.634991+0000","last_clean":"2023-10-09T15:38:57.634991+0000","last_became_active":"2023-10-09T15:38:57.634727+0000","last_became_peered":"2023-10-09T15:38:57.634727+0000","last_unstale":"2023-10-09T15:38:57.634991+0000","last_undegraded":"2023-10-09T15:38:57.634991+0000","last_fullsized":"2023-10-09T15:38:57.634991+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:21.700154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.644869+0000","last_change":"2023-10-09T15:38:56.609480+0000","last_active":"2023-10-09T15:38:57.644869+0000","last_peered":"2023-10-09T15:38:57.644869+0000","last_clean":"2023-10-09T15:38:57.644869+0000","last_became_active":"2023-10-09T15:38:56.609240+0000","last_became_peered":"2023-10-09T15:38:56.609240+0000","last_unstale":"2023-10-09T15:38:57.644869+0000","last_undegraded":"2023-10-09T15:38:57.644869+0000","last_fullsized":"2023-10-09T15:38:57.644869+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:17.528064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.636432+0000","last_change":"2023-10-09T15:38:57.636432+0000","last_active":"2023-10-09T15:38:57.636432+0000","last_peered":"2023-10-09T15:38:57.636432+0000","last_clean":"2023-10-09T15:38:57.636432+0000","last_became_active":"2023-10-09T15:38:57.636123+0000","last_became_peered":"2023-10-09T15:38:57.636123+0000","last_unstale":"2023-10-09T15:38:57.636432+0000","last_undegraded":"2023-10-09T15:38:57.636432+0000","last_fullsized":"2023-10-09T15:38:57.636432+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:27:14.418848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611392+0000","last_change":"2023-10-09T15:38:56.609629+0000","last_active":"2023-10-09T15:38:56.611392+0000","last_peered":"2023-10-09T15:38:56.611392+0000","last_clean":"2023-10-09T15:38:56.611392+0000","last_became_active":"2023-10-09T15:38:56.609261+0000","last_became_peered":"2023-10-09T15:38:56.609261+0000","last_unstale":"2023-10-09T15:38:56.611392+0000","last_undegraded":"2023-10-09T15:38:56.611392+0000","last_fullsized":"2023-10-09T15:38:56.611392+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:54.603867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.635689+0000","last_change":"2023-10-09T15:38:57.635689+0000","last_active":"2023-10-09T15:38:57.635689+0000","last_peered":"2023-10-09T15:38:57.635689+0000","last_clean":"2023-10-09T15:38:57.635689+0000","last_became_active":"2023-10-09T15:38:57.635409+0000","last_became_peered":"2023-10-09T15:38:57.635409+0000","last_unstale":"2023-10-09T15:38:57.635689+0000","last_undegraded":"2023-10-09T15:38:57.635689+0000","last_fullsized":"2023-10-09T15:38:57.635689+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:57:57.180222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.610007+0000","last_change":"2023-10-09T15:38:56.607906+0000","last_active":"2023-10-09T15:38:56.610007+0000","last_peered":"2023-10-09T15:38:56.610007+0000","last_clean":"2023-10-09T15:38:56.610007+0000","last_became_active":"2023-10-09T15:38:56.606539+0000","last_became_peered":"2023-10-09T15:38:56.606539+0000","last_unstale":"2023-10-09T15:38:56.610007+0000","last_undegraded":"2023-10-09T15:38:56.610007+0000","last_fullsized":"2023-10-09T15:38:56.610007+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:49:48.631507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639233+0000","last_change":"2023-10-09T15:38:57.639233+0000","last_active":"2023-10-09T15:38:57.639233+0000","last_peered":"2023-10-09T15:38:57.639233+0000","last_clean":"2023-10-09T15:38:57.639233+0000","last_became_active":"2023-10-09T15:38:57.638957+0000","last_became_peered":"2023-10-09T15:38:57.638957+0000","last_unstale":"2023-10-09T15:38:57.639233+0000","last_undegraded":"2023-10-09T15:38:57.639233+0000","last_fullsized":"2023-10-09T15:38:57.639233+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:08.129777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617417+0000","last_change":"2023-10-09T15:38:56.612898+0000","last_active":"2023-10-09T15:38:56.617417+0000","last_peered":"2023-10-09T15:38:56.617417+0000","last_clean":"2023-10-09T15:38:56.617417+0000","last_became_active":"2023-10-09T15:38:56.612618+0000","last_became_peered":"2023-10-09T15:38:56.612618+0000","last_unstale":"2023-10-09T15:38:56.617417+0000","last_undegraded":"2023-10-09T15:38:56.617417+0000","last_fullsized":"2023-10-09T15:38:56.617417+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:50:43.382840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.632742+0000","last_change":"2023-10-09T15:38:57.632742+0000","last_active":"2023-10-09T15:38:57.632742+0000","last_peered":"2023-10-09T15:38:57.632742+0000","last_clean":"2023-10-09T15:38:57.632742+0000","last_became_active":"2023-10-09T15:38:57.632410+0000","last_became_peered":"2023-10-09T15:38:57.632410+0000","last_unstale":"2023-10-09T15:38:57.632742+0000","last_undegraded":"2023-10-09T15:38:57.632742+0000","last_fullsized":"2023-10-09T15:38:57.632742+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:44.364244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"155'2","reported_seq":11,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.650653+0000","last_change":"2023-10-09T15:38:56.609904+0000","last_active":"2023-10-09T15:38:57.650653+0000","last_peered":"2023-10-09T15:38:57.650653+0000","last_clean":"2023-10-09T15:38:57.650653+0000","last_became_active":"2023-10-09T15:38:56.609545+0000","last_became_peered":"2023-10-09T15:38:56.609545+0000","last_unstale":"2023-10-09T15:38:57.650653+0000","last_undegraded":"2023-10-09T15:38:57.650653+0000","last_fullsized":"2023-10-09T15:38:57.650653+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:15:07.361390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627315+0000","last_change":"2023-10-09T15:38:57.627315+0000","last_active":"2023-10-09T15:38:57.627315+0000","last_peered":"2023-10-09T15:38:57.627315+0000","last_clean":"2023-10-09T15:38:57.627315+0000","last_became_active":"2023-10-09T15:38:57.627012+0000","last_became_peered":"2023-10-09T15:38:57.627012+0000","last_unstale":"2023-10-09T15:38:57.627315+0000","last_undegraded":"2023-10-09T15:38:57.627315+0000","last_fullsized":"2023-10-09T15:38:57.627315+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:49.100994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.616668+0000","last_change":"2023-10-09T15:38:56.612070+0000","last_active":"2023-10-09T15:38:56.616668+0000","last_peered":"2023-10-09T15:38:56.616668+0000","last_clean":"2023-10-09T15:38:56.616668+0000","last_became_active":"2023-10-09T15:38:56.611816+0000","last_became_peered":"2023-10-09T15:38:56.611816+0000","last_unstale":"2023-10-09T15:38:56.616668+0000","last_undegraded":"2023-10-09T15:38:56.616668+0000","last_fullsized":"2023-10-09T15:38:56.616668+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:10:31.372908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.627693+0000","last_change":"2023-10-09T15:38:57.627693+0000","last_active":"2023-10-09T15:38:57.627693+0000","last_peered":"2023-10-09T15:38:57.627693+0000","last_clean":"2023-10-09T15:38:57.627693+0000","last_became_active":"2023-10-09T15:38:57.627308+0000","last_became_peered":"2023-10-09T15:38:57.627308+0000","last_unstale":"2023-10-09T15:38:57.627693+0000","last_undegraded":"2023-10-09T15:38:57.627693+0000","last_fullsized":"2023-10-09T15:38:57.627693+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:08:49.260232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611181+0000","last_change":"2023-10-09T15:38:56.607952+0000","last_active":"2023-10-09T15:38:56.611181+0000","last_peered":"2023-10-09T15:38:56.611181+0000","last_clean":"2023-10-09T15:38:56.611181+0000","last_became_active":"2023-10-09T15:38:56.607671+0000","last_became_peered":"2023-10-09T15:38:56.607671+0000","last_unstale":"2023-10-09T15:38:56.611181+0000","last_undegraded":"2023-10-09T15:38:56.611181+0000","last_fullsized":"2023-10-09T15:38:56.611181+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:57:50.590586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.643233+0000","last_change":"2023-10-09T15:38:57.643233+0000","last_active":"2023-10-09T15:38:57.643233+0000","last_peered":"2023-10-09T15:38:57.643233+0000","last_clean":"2023-10-09T15:38:57.643233+0000","last_became_active":"2023-10-09T15:38:57.642869+0000","last_became_peered":"2023-10-09T15:38:57.642869+0000","last_unstale":"2023-10-09T15:38:57.643233+0000","last_undegraded":"2023-10-09T15:38:57.643233+0000","last_fullsized":"2023-10-09T15:38:57.643233+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:59.829621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611596+0000","last_change":"2023-10-09T15:38:56.610569+0000","last_active":"2023-10-09T15:38:56.611596+0000","last_peered":"2023-10-09T15:38:56.611596+0000","last_clean":"2023-10-09T15:38:56.611596+0000","last_became_active":"2023-10-09T15:38:56.610291+0000","last_became_peered":"2023-10-09T15:38:56.610291+0000","last_unstale":"2023-10-09T15:38:56.611596+0000","last_undegraded":"2023-10-09T15:38:56.611596+0000","last_fullsized":"2023-10-09T15:38:56.611596+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:33:56.824085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.639095+0000","last_change":"2023-10-09T15:38:57.639095+0000","last_active":"2023-10-09T15:38:57.639095+0000","last_peered":"2023-10-09T15:38:57.639095+0000","last_clean":"2023-10-09T15:38:57.639095+0000","last_became_active":"2023-10-09T15:38:57.638786+0000","last_became_peered":"2023-10-09T15:38:57.638786+0000","last_unstale":"2023-10-09T15:38:57.639095+0000","last_undegraded":"2023-10-09T15:38:57.639095+0000","last_fullsized":"2023-10-09T15:38:57.639095+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:00.918104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611613+0000","last_change":"2023-10-09T15:38:56.608471+0000","last_active":"2023-10-09T15:38:56.611613+0000","last_peered":"2023-10-09T15:38:56.611613+0000","last_clean":"2023-10-09T15:38:56.611613+0000","last_became_active":"2023-10-09T15:38:56.608168+0000","last_became_peered":"2023-10-09T15:38:56.608168+0000","last_unstale":"2023-10-09T15:38:56.611613+0000","last_undegraded":"2023-10-09T15:38:56.611613+0000","last_fullsized":"2023-10-09T15:38:56.611613+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:10:29.203588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.633615+0000","last_change":"2023-10-09T15:38:57.633615+0000","last_active":"2023-10-09T15:38:57.633615+0000","last_peered":"2023-10-09T15:38:57.633615+0000","last_clean":"2023-10-09T15:38:57.633615+0000","last_became_active":"2023-10-09T15:38:57.633186+0000","last_became_peered":"2023-10-09T15:38:57.633186+0000","last_unstale":"2023-10-09T15:38:57.633615+0000","last_undegraded":"2023-10-09T15:38:57.633615+0000","last_fullsized":"2023-10-09T15:38:57.633615+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:15.519169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.617453+0000","last_change":"2023-10-09T15:38:56.612974+0000","last_active":"2023-10-09T15:38:56.617453+0000","last_peered":"2023-10-09T15:38:56.617453+0000","last_clean":"2023-10-09T15:38:56.617453+0000","last_became_active":"2023-10-09T15:38:56.612684+0000","last_became_peered":"2023-10-09T15:38:56.612684+0000","last_unstale":"2023-10-09T15:38:56.617453+0000","last_undegraded":"2023-10-09T15:38:56.617453+0000","last_fullsized":"2023-10-09T15:38:56.617453+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:18:07.125668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626819+0000","last_change":"2023-10-09T15:38:57.626819+0000","last_active":"2023-10-09T15:38:57.626819+0000","last_peered":"2023-10-09T15:38:57.626819+0000","last_clean":"2023-10-09T15:38:57.626819+0000","last_became_active":"2023-10-09T15:38:57.626146+0000","last_became_peered":"2023-10-09T15:38:57.626146+0000","last_unstale":"2023-10-09T15:38:57.626819+0000","last_undegraded":"2023-10-09T15:38:57.626819+0000","last_fullsized":"2023-10-09T15:38:57.626819+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:57:29.260800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.605073+0000","last_change":"2023-10-09T15:38:56.601115+0000","last_active":"2023-10-09T15:38:56.605073+0000","last_peered":"2023-10-09T15:38:56.605073+0000","last_clean":"2023-10-09T15:38:56.605073+0000","last_became_active":"2023-10-09T15:38:56.600551+0000","last_became_peered":"2023-10-09T15:38:56.600551+0000","last_unstale":"2023-10-09T15:38:56.605073+0000","last_undegraded":"2023-10-09T15:38:56.605073+0000","last_fullsized":"2023-10-09T15:38:56.605073+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:12:43.360136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.626787+0000","last_change":"2023-10-09T15:38:57.626787+0000","last_active":"2023-10-09T15:38:57.626787+0000","last_peered":"2023-10-09T15:38:57.626787+0000","last_clean":"2023-10-09T15:38:57.626787+0000","last_became_active":"2023-10-09T15:38:57.626465+0000","last_became_peered":"2023-10-09T15:38:57.626465+0000","last_unstale":"2023-10-09T15:38:57.626787+0000","last_undegraded":"2023-10-09T15:38:57.626787+0000","last_fullsized":"2023-10-09T15:38:57.626787+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:21:41.388467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":9,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.611477+0000","last_change":"2023-10-09T15:38:56.607257+0000","last_active":"2023-10-09T15:38:56.611477+0000","last_peered":"2023-10-09T15:38:56.611477+0000","last_clean":"2023-10-09T15:38:56.611477+0000","last_became_active":"2023-10-09T15:38:56.606943+0000","last_became_peered":"2023-10-09T15:38:56.606943+0000","last_unstale":"2023-10-09T15:38:56.611477+0000","last_undegraded":"2023-10-09T15:38:56.611477+0000","last_fullsized":"2023-10-09T15:38:56.611477+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:30.449353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":8,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.630283+0000","last_change":"2023-10-09T15:38:57.630283+0000","last_active":"2023-10-09T15:38:57.630283+0000","last_peered":"2023-10-09T15:38:57.630283+0000","last_clean":"2023-10-09T15:38:57.630283+0000","last_became_active":"2023-10-09T15:38:57.630006+0000","last_became_peered":"2023-10-09T15:38:57.630006+0000","last_unstale":"2023-10-09T15:38:57.630283+0000","last_undegraded":"2023-10-09T15:38:57.630283+0000","last_fullsized":"2023-10-09T15:38:57.630283+0000","mapping_epoch":154,"log_start":"0'0","ondisk_log_start":"0'0","created":154,"last_epoch_clean":155,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:56.588759+0000","last_clean_scrub_stamp":"2023-10-09T15:38:56.588759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:16.334537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"155'1","reported_seq":10,"reported_epoch":155,"state":"active+clean","last_fresh":"2023-10-09T15:38:57.622216+0000","last_change":"2023-10-09T15:38:56.611561+0000","last_active":"2023-10-09T15:38:57.622216+0000","last_peered":"2023-10-09T15:38:57.622216+0000","last_clean":"2023-10-09T15:38:57.622216+0000","last_became_active":"2023-10-09T15:38:56.611187+0000","last_became_peered":"2023-10-09T15:38:56.611187+0000","last_unstale":"2023-10-09T15:38:57.622216+0000","last_undegraded":"2023-10-09T15:38:57.622216+0000","last_fullsized":"2023-10-09T15:38:57.622216+0000","mapping_epoch":153,"log_start":"0'0","ondisk_log_start":"0'0","created":153,"last_epoch_clean":154,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:38:55.584650+0000","last_clean_scrub_stamp":"2023-10-09T15:38:55.584650+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:34.197652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":276,"reported_epoch":154,"state":"active+clean","last_fresh":"2023-10-09T15:38:56.603410+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:38:56.603410+0000","last_peered":"2023-10-09T15:38:56.603410+0000","last_clean":"2023-10-09T15:38:56.603410+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:38:56.603410+0000","last_undegraded":"2023-10-09T15:38:56.603410+0000","last_fullsized":"2023-10-09T15:38:56.603410+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303892,"kb_used_data":2508,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067948,"statfs":{"total":96636764160,"available":96325578752,"internally_reserved":0,"allocated":2568192,"data_stored":1473219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.53200000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71499999999999997,"5min":0.77500000000000002,"15min":0.77500000000000002},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.54700000000000004,"15min":0.53600000000000003},"min":{"1min":0.44400000000000001,"5min":0.36899999999999999,"15min":0.28299999999999997},"max":{"1min":0.77300000000000002,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.85499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53300000000000003,"15min":0.51800000000000002},"min":{"1min":0.35399999999999998,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.82699999999999996,"5min":0.874,"15min":0.874},"last":0.748},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.53700000000000003},"min":{"1min":0.40100000000000002,"5min":0.33800000000000002,"15min":0.313},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55000000000000004},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.44500000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.58899999999999997,"15min":0.56999999999999995},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.82599999999999996,"5min":0.82899999999999996,"15min":0.83999999999999997},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.434,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76700000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.68999999999999995}]},{"osd":4,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.54600000000000004,"15min":0.53400000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58599999999999997,"15min":0.55500000000000005},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.33500000000000002},"max":{"1min":0.77700000000000002,"5min":0.84399999999999997,"15min":0.88},"last":0.76700000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.57699999999999996,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.376,"15min":0.376},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.36699999999999999,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.79800000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.57599999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:38:06 2023","interfaces":[{"interface":"back","average":{"1min":0.66300000000000003,"5min":0.66700000000000004,"15min":0.65200000000000002},"min":{"1min":0.48499999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.84299999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.70999999999999996},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.66500000000000004,"15min":0.65100000000000002},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82699999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.81299999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574949,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":881869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52700000000000002,"15min":0.501},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.77100000000000002,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.33300000000000002,"15min":0.30599999999999999},"max":{"1min":0.77900000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.52900000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.51800000000000002,"15min":0.55400000000000005},"min":{"1min":0.374,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":1.379},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.39600000000000002,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.70999999999999996,"5min":0.80700000000000005,"15min":0.86199999999999999},"last":0.32300000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.54900000000000004,"15min":0.59099999999999997},"min":{"1min":0.39600000000000002,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.749,"5min":0.83499999999999996,"15min":1.3999999999999999},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54500000000000004,"15min":0.75800000000000001},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.73099999999999998,"5min":0.76000000000000001,"15min":7.3419999999999996},"last":0.42999999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57799999999999996,"15min":0.61199999999999999},"min":{"1min":0.42499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.77900000000000003,"5min":0.80300000000000005,"15min":1.3560000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.59099999999999997,"15min":0.63600000000000001},"min":{"1min":0.376,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.78400000000000003,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.55600000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.52600000000000002,"5min":0.54300000000000004,"15min":0.55000000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73099999999999998,"5min":0.76900000000000002,"15min":0.93600000000000005},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.39300000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.85499999999999998,"15min":0.872},"last":0.46800000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57799999999999996,"15min":0.59199999999999997},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.73999999999999999,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.59599999999999997,"15min":0.626},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.77500000000000002,"5min":0.82299999999999995,"15min":0.89700000000000002},"last":0.60999999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.622,"15min":0.64600000000000002},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.745,"5min":0.81299999999999994,"15min":1.004},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.624,"5min":0.65300000000000002,"15min":0.66600000000000004},"min":{"1min":0.47099999999999997,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.78800000000000003,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.63700000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574950,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303308,"kb_used_data":1924,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068532,"statfs":{"total":96636764160,"available":96326176768,"internally_reserved":0,"allocated":1970176,"data_stored":881371,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.33700000000000002,"15min":0.35099999999999998},"min":{"1min":0.224,"5min":0.217,"15min":0.215},"max":{"1min":0.496,"5min":0.63,"15min":0.90200000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.38200000000000001},"min":{"1min":0.24099999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.54800000000000004,"5min":0.55300000000000005,"15min":1.512},"last":0.252}]},{"osd":2,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33200000000000002,"15min":0.36699999999999999},"min":{"1min":0.251,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.52200000000000002,"5min":0.56399999999999995,"15min":1.286},"last":0.313},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.375,"15min":0.40500000000000003},"min":{"1min":0.25900000000000001,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.432,"5min":0.41899999999999998,"15min":0.441},"min":{"1min":0.32800000000000001,"5min":0.311,"15min":0.29499999999999998},"max":{"1min":0.59699999999999998,"5min":0.62,"15min":0.96899999999999997},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.40300000000000002,"15min":0.442},"min":{"1min":0.32600000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.60799999999999998,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.40500000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.63900000000000001,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.44800000000000001,"5min":0.377,"15min":0.374},"max":{"1min":0.874,"5min":0.877,"15min":1.222},"last":0.70699999999999996},{"interface":"front","average":{"1min":0.60799999999999998,"5min":0.59599999999999997,"15min":0.624},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.82999999999999996,"5min":0.94799999999999995,"15min":0.94799999999999995},"last":0.622}]},{"osd":5,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.60699999999999998,"15min":0.626},"min":{"1min":0.43099999999999999,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.92900000000000005,"5min":0.999,"15min":1.4410000000000001},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.60899999999999999,"15min":0.62},"min":{"1min":0.41499999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.69699999999999995,"5min":0.64900000000000002,"15min":0.78400000000000003},"min":{"1min":0.46200000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":1.0009999999999999,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.65100000000000002,"15min":0.67200000000000004},"min":{"1min":0.51300000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.91300000000000003,"5min":0.93600000000000005,"15min":1.258},"last":0.72799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:01 2023","interfaces":[{"interface":"back","average":{"1min":0.68700000000000006,"5min":0.65400000000000003,"15min":0.66600000000000004},"min":{"1min":0.497,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.91600000000000004,"5min":0.996,"15min":0.997},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.64900000000000002,"15min":0.78900000000000003},"min":{"1min":0.52700000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.024,"5min":1.024,"15min":5.5819999999999999},"last":0.68500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1470762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.377},"min":{"1min":0.25600000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.49099999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.40699999999999997,"15min":0.42099999999999999},"min":{"1min":0.33400000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.51200000000000001,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.29399999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.434,"15min":0.41199999999999998},"min":{"1min":0.26900000000000002,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.89600000000000002,"5min":6.484,"15min":6.484},"last":0.31},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.42299999999999999,"15min":0.52300000000000002},"min":{"1min":0.29799999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.55100000000000005,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.34699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.36499999999999999,"15min":0.51100000000000001},"min":{"1min":0.24099999999999999,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.57399999999999995,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.439,"15min":0.59299999999999997},"min":{"1min":0.33200000000000002,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.624,"5min":2.109,"15min":4.5890000000000004},"last":0.38800000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.60299999999999998,"15min":0.63700000000000001},"min":{"1min":0.52100000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":1.921,"15min":1.921},"last":0.504},{"interface":"front","average":{"1min":0.621,"5min":0.58299999999999996,"15min":0.65100000000000002},"min":{"1min":0.377,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80000000000000004,"5min":0.83099999999999996,"15min":1.508},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58299999999999996,"15min":0.62},"min":{"1min":0.42499999999999999,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.78400000000000003,"5min":0.81399999999999995,"15min":1.0509999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.629,"5min":0.64000000000000001,"15min":0.64300000000000002},"min":{"1min":0.45300000000000001,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.82699999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.49099999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.65200000000000002,"5min":0.67100000000000004,"15min":0.68899999999999995},"min":{"1min":0.47999999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78800000000000003,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.64900000000000002,"5min":0.65400000000000003,"15min":0.68300000000000005},"min":{"1min":0.505,"5min":0.443,"15min":0.443},"max":{"1min":0.81599999999999995,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.48099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:38:15 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.66100000000000003,"15min":0.70299999999999996},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.84299999999999997,"5min":2.032,"15min":2.032},"last":0.628},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.65000000000000002,"15min":0.66900000000000004},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.81999999999999995,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.64600000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574949,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303300,"kb_used_data":1916,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068540,"statfs":{"total":96636764160,"available":96326184960,"internally_reserved":0,"allocated":1961984,"data_stored":881315,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.371,"5min":0.34000000000000002,"15min":0.33200000000000002},"min":{"1min":0.27200000000000002,"5min":0.21199999999999999,"15min":0.187},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34999999999999998,"15min":0.35799999999999998},"min":{"1min":0.246,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.56100000000000005,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.42799999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.38,"15min":0.36799999999999999},"min":{"1min":0.28199999999999997,"5min":0.24199999999999999,"15min":0.22500000000000001},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.38600000000000001,"15min":0.38700000000000001},"min":{"1min":0.24099999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.73699999999999999},"last":0.30499999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.36899999999999999,"15min":0.36599999999999999},"min":{"1min":0.26200000000000001,"5min":0.23899999999999999,"15min":0.22700000000000001},"max":{"1min":0.58499999999999996,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.433,"15min":0.435},"min":{"1min":0.34000000000000002,"5min":0.31,"15min":0.30199999999999999},"max":{"1min":0.72099999999999997,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.39200000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.59399999999999997,"15min":0.64400000000000002},"min":{"1min":0.40899999999999997,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.85499999999999998,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.59799999999999998,"15min":0.60899999999999999},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.57799999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.59399999999999997,"15min":0.60699999999999998},"min":{"1min":0.443,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.628,"5min":0.61799999999999999,"15min":0.67800000000000005},"min":{"1min":0.42599999999999999,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.59399999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.63900000000000001,"15min":0.67700000000000005},"min":{"1min":0.443,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.997,"5min":0.997,"15min":1.5189999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.69999999999999996,"5min":0.65400000000000003,"15min":0.66000000000000003},"min":{"1min":0.50700000000000001,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":1.0780000000000001,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.61099999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:38:07 2023","interfaces":[{"interface":"back","average":{"1min":0.69199999999999995,"5min":0.66000000000000003,"15min":0.68300000000000005},"min":{"1min":0.53200000000000003,"5min":0.44,"15min":0.44},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.407},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.65700000000000003,"5min":0.64300000000000002,"15min":0.65800000000000003},"min":{"1min":0.44900000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.495}]}]},{"osd":3,"up_from":13,"seq":55834574947,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303312,"kb_used_data":1928,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068528,"statfs":{"total":96636764160,"available":96326172672,"internally_reserved":0,"allocated":1974272,"data_stored":881497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.318,"15min":0.35899999999999999},"min":{"1min":0.19400000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.45400000000000001,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34200000000000003,"15min":0.81000000000000005},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54300000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33100000000000002,"15min":0.61899999999999999},"min":{"1min":0.248,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.495,"5min":0.57399999999999995,"15min":9.6600000000000001},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.36699999999999999,"15min":0.41199999999999998},"min":{"1min":0.23799999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":1.3049999999999999},"last":0.317}]},{"osd":2,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.35699999999999998,"15min":1.2370000000000001},"min":{"1min":0.27400000000000002,"5min":0.247,"15min":0.247},"max":{"1min":0.61899999999999999,"5min":0.66500000000000004,"15min":16.937999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.38400000000000001,"15min":0.68999999999999995},"min":{"1min":0.28899999999999998,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":10.451000000000001},"last":0.377}]},{"osd":4,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57599999999999996,"15min":1.0229999999999999},"min":{"1min":0.42299999999999999,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":0.996,"15min":17.02},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.57299999999999995,"15min":0.86799999999999999},"min":{"1min":0.40100000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":9.6969999999999992},"last":0.48799999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57799999999999996,"15min":0.623},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84299999999999997,"5min":0.84299999999999997,"15min":5.3460000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58999999999999997,"15min":1.05},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":1.0249999999999999,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.47399999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.60899999999999999,"15min":0.879},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.63600000000000001,"15min":0.66800000000000004},"min":{"1min":0.502,"5min":0.436,"15min":0.436},"max":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":1.278},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:38:11 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.625,"15min":1.093},"min":{"1min":0.45000000000000001,"5min":0.437,"15min":0.42899999999999999},"max":{"1min":0.93799999999999994,"5min":0.93799999999999994,"15min":17.053999999999998},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.63400000000000001,"15min":0.89400000000000002},"min":{"1min":0.44700000000000001,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.82899999999999996,"5min":0.91200000000000003,"15min":9.6029999999999998},"last":0.56999999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574948,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303288,"kb_used_data":1904,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068552,"statfs":{"total":96636764160,"available":96326197248,"internally_reserved":0,"allocated":1949696,"data_stored":874552,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.54800000000000004,"15min":0.54400000000000004},"min":{"1min":0.308,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.58799999999999997,"15min":0.58299999999999996},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.83099999999999996,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.81399999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58799999999999997,"15min":0.65000000000000002},"min":{"1min":0.42499999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.83799999999999997,"5min":0.871,"15min":2.879},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.56299999999999994},"min":{"1min":0.33600000000000002,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.96899999999999997},"last":0.73699999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53900000000000003,"15min":0.52200000000000002},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70899999999999996},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41599999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82999999999999996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.77800000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.55300000000000005,"15min":0.54400000000000004},"min":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.90200000000000002,"5min":0.95199999999999996,"15min":0.95199999999999996},"last":0.79200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55000000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.90600000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.61799999999999999,"15min":0.626},"min":{"1min":0.36399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.85099999999999998,"5min":0.878,"15min":0.89900000000000002},"last":0.67100000000000004}]},{"osd":6,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.58499999999999996,"15min":0.57999999999999996},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.83999999999999997,"5min":1.0029999999999999,"15min":1.0029999999999999},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.69799999999999995,"5min":0.67000000000000004,"15min":0.67900000000000005},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89900000000000002,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.84099999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:38:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.61399999999999999,"15min":0.626},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.92200000000000004,"5min":0.93200000000000005,"15min":0.94499999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.90200000000000002,"5min":1.048,"15min":1.048},"last":0.749}]}]},{"osd":5,"up_from":13,"seq":55834574949,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303304,"kb_used_data":1920,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068536,"statfs":{"total":96636764160,"available":96326180864,"internally_reserved":0,"allocated":1966080,"data_stored":881869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.501,"15min":0.51600000000000001},"min":{"1min":0.307,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.73599999999999999,"5min":0.755,"15min":0.87},"last":0.503},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73299999999999998,"5min":0.90900000000000003,"15min":1.165},"last":0.47899999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.52700000000000002,"15min":0.53600000000000003},"min":{"1min":0.308,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.871,"5min":0.871,"15min":2.089},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.54900000000000004},"min":{"1min":0.40799999999999997,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.70699999999999996,"5min":0.73599999999999999,"15min":0.94199999999999995},"last":0.58099999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.54100000000000004,"15min":0.84699999999999998},"min":{"1min":0.33900000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.73299999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.436},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.872},"min":{"1min":0.41699999999999998,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.68899999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57199999999999995,"15min":0.876},"min":{"1min":0.40300000000000002,"5min":0.34200000000000003,"15min":0.34000000000000002},"max":{"1min":0.84599999999999997,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58599999999999997,"15min":0.60199999999999998},"min":{"1min":0.47399999999999998,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.94199999999999995,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.56200000000000006}]},{"osd":4,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.52100000000000002,"15min":0.54200000000000004},"min":{"1min":0.38200000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.80800000000000005,"5min":0.81599999999999995,"15min":2.3290000000000002},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.57699999999999996,"15min":0.58699999999999997},"min":{"1min":0.41999999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.872,"15min":1.0569999999999999},"last":0.53400000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.56699999999999995,"15min":0.57799999999999996},"min":{"1min":0.40500000000000003,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.97999999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.57199999999999995,"15min":0.59899999999999998},"min":{"1min":0.442,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.63}]},{"osd":7,"last update":"Mon Oct 9 15:38:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.59799999999999998,"15min":0.61599999999999999},"min":{"1min":0.45900000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.97599999999999998,"5min":0.97599999999999998,"15min":1.016},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.68799999999999994,"5min":0.63300000000000001,"15min":0.65600000000000003},"min":{"1min":0.45000000000000001,"5min":0.432,"15min":0.432},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.71299999999999997}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1640,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:39:02.126 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:39:02.126 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:39:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.286+0000 7f7883c2e700 1 Processor -- start 2023-10-09T15:39:02.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 -- start start 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f787c159530 0x7f787c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 0x7f787c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f787c0ccfd0 con 0x7f787c06e0e0 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c0cf0e0 con 0x7f787c159530 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.287+0000 7f7883c2e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f787c15a3d0 con 0x7f787c06dc70 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f787c159530 0x7f787c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f787c159530 0x7f787c0ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60928/0 (socket says 172.21.15.33:60928) 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 -- 172.21.15.33:0/2113819361 learned_addr learned my addr 172.21.15.33:0/2113819361 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78811c9700 1 --2- 172.21.15.33:0/2113819361 >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 0x7f787c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 -- 172.21.15.33:0/2113819361 >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 msgr2=0x7f787c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 --2- 172.21.15.33:0/2113819361 >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 0x7f787c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 -- 172.21.15.33:0/2113819361 >> v1:172.21.15.59:6789/0 conn(0x7f787c06e0e0 legacy=0x7f787c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 -- 172.21.15.33:0/2113819361 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f787c15a6b0 con 0x7f787c159530 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78811c9700 1 --2- 172.21.15.33:0/2113819361 >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 0x7f787c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78819ca700 1 --2- 172.21.15.33:0/2113819361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c159530 0x7f787c0ceba0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b66e0 tx=0x7f786c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=811df7082814d04c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78809c8700 1 -- 172.21.15.33:0/2113819361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c00e070 con 0x7f787c159530 2023-10-09T15:39:02.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78809c8700 1 -- 172.21.15.33:0/2113819361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c00ba10 con 0x7f787c159530 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.288+0000 7f78809c8700 1 -- 172.21.15.33:0/2113819361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c0092e0 con 0x7f787c159530 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 -- 172.21.15.33:0/2113819361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c159530 msgr2=0x7f787c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 --2- 172.21.15.33:0/2113819361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c159530 0x7f787c0ceba0 secure :-1 s=READY pgs=1364 cs=0 l=1 rev1=1 crypto rx=0x7f787c0b66e0 tx=0x7f786c009840 comp rx=0 tx=0).stop 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 -- 172.21.15.33:0/2113819361 shutdown_connections 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 --2- 172.21.15.33:0/2113819361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c159530 0x7f787c0ceba0 unknown :-1 s=CLOSED pgs=1364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 --2- 172.21.15.33:0/2113819361 >> v2:172.21.15.59:3300/0 conn(0x7f787c06dc70 0x7f787c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 -- 172.21.15.33:0/2113819361 >> 172.21.15.33:0/2113819361 conn(0x7f787c0703a0 msgr2=0x7f787c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 -- 172.21.15.33:0/2113819361 shutdown_connections 2023-10-09T15:39:02.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.289+0000 7f7883c2e700 1 -- 172.21.15.33:0/2113819361 wait complete. 2023-10-09T15:39:02.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.290+0000 7f7883c2e700 1 Processor -- start 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.290+0000 7f7883c2e700 1 -- start start 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c06e0e0 0x7f787c0cf2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c159530 0x7f787c0cf7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c1539b0 con 0x7f787c06dc70 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f787c153520 con 0x7f787c06e0e0 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f7883c2e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f787c152910 con 0x7f787c159530 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60930/0 (socket says 172.21.15.33:60930) 2023-10-09T15:39:02.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 -- 172.21.15.33:0/1329198264 learned_addr learned my addr 172.21.15.33:0/1329198264 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 -- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c159530 msgr2=0x7f787c0cf7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78821cb700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c159530 0x7f787c0cf7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78811c9700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c06e0e0 0x7f787c0cf2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c159530 0x7f787c0cf7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 -- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c06e0e0 msgr2=0x7f787c0cf2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c06e0e0 0x7f787c0cf2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 -- 172.21.15.33:0/1329198264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f786c009ae0 con 0x7f787c06dc70 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.291+0000 7f78819ca700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f787c089650 tx=0x7f786c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.292+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c012aa0 con 0x7f787c06dc70 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.292+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f786c012c40 con 0x7f787c06dc70 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.292+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f787c152bf0 con 0x7f787c06dc70 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.292+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f786c01d420 con 0x7f787c06dc70 2023-10-09T15:39:02.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.292+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f787c1531b0 con 0x7f787c06dc70 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.293+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f787c04c3c0 con 0x7f787c06dc70 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.293+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f786c01d790 con 0x7f787c06dc70 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.294+0000 7f7879ffb700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 0x7f78680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.294+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f786c086460 con 0x7f787c06dc70 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.294+0000 7f78811c9700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 0x7f78680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.294+0000 7f78811c9700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 0x7f78680697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7870008a50 tx=0x7f7870008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.298+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f786c052fa0 con 0x7f787c06dc70 2023-10-09T15:39:02.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.573+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f787c153800 con 0x7f787c06dc70 2023-10-09T15:39:02.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.577+0000 7f7879ffb700 1 -- 172.21.15.33:0/1329198264 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) v1 ==== 190+0+0 (secure 0 0 0) 0x7f786c009940 con 0x7f787c06dc70 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 msgr2=0x7f78680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 0x7f78680697d0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f7870008a50 tx=0x7f7870008040 comp rx=0 tx=0).stop 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 msgr2=0x7f787c0b5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f787c089650 tx=0x7f786c017000 comp rx=0 tx=0).stop 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 shutdown_connections 2023-10-09T15:39:02.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7868067320 0x7f78680697d0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f787c06dc70 0x7f787c0b5f30 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f787c159530 0x7f787c0cf7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 --2- 172.21.15.33:0/1329198264 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f787c06e0e0 0x7f787c0cf2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 >> 172.21.15.33:0/1329198264 conn(0x7f787c0703a0 msgr2=0x7f787c0c6df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 shutdown_connections 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.579+0000 7f7883c2e700 1 -- 172.21.15.33:0/1329198264 wait complete. 2023-10-09T15:39:02.581 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:39:02.591 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.710+0000 7fcf78b04700 1 Processor -- start 2023-10-09T15:39:02.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.710+0000 7fcf78b04700 1 -- start start 2023-10-09T15:39:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf78b04700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 0x7fcf740cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf78b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf78b04700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf7415ae40 con 0x7fcf740cde50 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf78b04700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf740d13f0 con 0x7fcf740cb5a0 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf78b04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415ab60 con 0x7fcf740cd9e0 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf7259c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 0x7fcf740cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:46378/0 (socket says 172.21.15.33:46378) 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf72d9d700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fcf740cde50 0x7fcf74156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:51826/0 (socket says 172.21.15.33:51826) 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 -- 172.21.15.33:0/1667360489 learned_addr learned my addr 172.21.15.33:0/1667360489 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 -- 172.21.15.33:0/1667360489 >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 msgr2=0x7fcf740cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 --2- 172.21.15.33:0/1667360489 >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 0x7fcf740cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 -- 172.21.15.33:0/1667360489 >> v1:172.21.15.59:6789/0 conn(0x7fcf740cde50 legacy=0x7fcf74156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf71d9b700 1 -- 172.21.15.33:0/1667360489 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf740ccf00 con 0x7fcf740cd9e0 2023-10-09T15:39:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.711+0000 7fcf7259c700 1 --2- 172.21.15.33:0/1667360489 >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 0x7fcf740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:02.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.712+0000 7fcf71d9b700 1 --2- 172.21.15.33:0/1667360489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0099b0 tx=0x7fcf5c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dbbf40a3e3600d4d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.712+0000 7fcf7159a700 1 -- 172.21.15.33:0/1667360489 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c009ea0 con 0x7fcf740cd9e0 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.712+0000 7fcf7159a700 1 -- 172.21.15.33:0/1667360489 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c00b860 con 0x7fcf740cd9e0 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.712+0000 7fcf7159a700 1 -- 172.21.15.33:0/1667360489 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c00bc00 con 0x7fcf740cd9e0 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 -- 172.21.15.33:0/1667360489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 msgr2=0x7fcf74159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 --2- 172.21.15.33:0/1667360489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c0099b0 tx=0x7fcf5c009250 comp rx=0 tx=0).stop 2023-10-09T15:39:02.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 -- 172.21.15.33:0/1667360489 shutdown_connections 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 --2- 172.21.15.33:0/1667360489 >> v2:172.21.15.59:3300/0 conn(0x7fcf740cb5a0 0x7fcf740cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 --2- 172.21.15.33:0/1667360489 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cd9e0 0x7fcf74159ec0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 -- 172.21.15.33:0/1667360489 >> 172.21.15.33:0/1667360489 conn(0x7fcf74070e30 msgr2=0x7fcf740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 -- 172.21.15.33:0/1667360489 shutdown_connections 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.713+0000 7fcf78b04700 1 -- 172.21.15.33:0/1667360489 wait complete. 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.714+0000 7fcf78b04700 1 Processor -- start 2023-10-09T15:39:02.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.714+0000 7fcf78b04700 1 -- start start 2023-10-09T15:39:02.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cb5a0 0x7fcf7415cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf740cd9e0 0x7fcf7416d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7416dd40 con 0x7fcf740b4cc0 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf7415d430 con 0x7fcf740cd9e0 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf78b04700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf74169ab0 con 0x7fcf740cb5a0 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60934/0 (socket says 172.21.15.33:60934) 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 -- 172.21.15.33:0/2661370461 learned_addr learned my addr 172.21.15.33:0/2661370461 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf7259c700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cb5a0 0x7fcf7415cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf71d9b700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf740cd9e0 0x7fcf7416d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 -- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cb5a0 msgr2=0x7fcf7415cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cb5a0 0x7fcf7415cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 -- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf740cd9e0 msgr2=0x7fcf7416d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf740cd9e0 0x7fcf7416d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 -- 172.21.15.33:0/2661370461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf64009a20 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf72d9d700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c4e0 tx=0x7fcf6c007f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.715+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c00ce90 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.716+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf6c005a70 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.716+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf5c0094f0 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.716+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf6c005e10 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.716+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74169e40 con 0x7fcf740b4cc0 2023-10-09T15:39:02.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.716+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf7416a2b0 con 0x7fcf740b4cc0 2023-10-09T15:39:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.717+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcf6c0072e0 con 0x7fcf740b4cc0 2023-10-09T15:39:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.717+0000 7fcf6a7fc700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 0x7fcf540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.717+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcf6c083fa0 con 0x7fcf740b4cc0 2023-10-09T15:39:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.717+0000 7fcf7259c700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 0x7fcf540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:02.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.718+0000 7fcf7259c700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 0x7fcf540697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009fd0 tx=0x7fcf6400b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:02.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.722+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcf6c050c30 con 0x7fcf740b4cc0 2023-10-09T15:39:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.958+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcf7404c3c0 con 0x7fcf740b4cc0 2023-10-09T15:39:02.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.958+0000 7fcf6a7fc700 1 -- 172.21.15.33:0/2661370461 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 103 v103) v1 ==== 95+0+4597 (secure 0 0 0) 0x7fcf6c017020 con 0x7fcf740b4cc0 2023-10-09T15:39:02.958 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:02.959 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":103,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 msgr2=0x7fcf540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 0x7fcf540697d0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fcf64009fd0 tx=0x7fcf6400b040 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 msgr2=0x7fcf740c8b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c00c4e0 tx=0x7fcf6c007f50 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 shutdown_connections 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcf54067320 0x7fcf540697d0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcf740b4cc0 0x7fcf740c8b40 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcf740cb5a0 0x7fcf7415cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 --2- 172.21.15.33:0/2661370461 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcf740cd9e0 0x7fcf7416d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 >> 172.21.15.33:0/2661370461 conn(0x7fcf74070e30 msgr2=0x7fcf740b0d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 shutdown_connections 2023-10-09T15:39:02.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:02.960+0000 7fcf78b04700 1 -- 172.21.15.33:0/2661370461 wait complete. 2023-10-09T15:39:02.962 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 103 2023-10-09T15:39:03.285 INFO:tasks.ceph.mds.b.smithi059.stderr:2023-10-09T15:39:03.284+0000 7fef06e83700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:39:03.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 103, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:38:57.004256+0000', 'modified': '2023-10-09T15:39:00.641970+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7935}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7935': {'gid': 7935, 'name': 'b', 'rank': 0, 'incarnation': 99, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6834/924608067', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 924608067}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 924608067}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:39:03.375 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:39:03.375 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-10-09T15:39:03.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.499+0000 7f1c65a62700 1 Processor -- start 2023-10-09T15:39:03.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.499+0000 7f1c65a62700 1 -- start start 2023-10-09T15:39:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c65a62700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1c600cb970 0x7f1c60159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c65a62700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6015ae40 con 0x7f1c6015a400 2023-10-09T15:39:03.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c65a62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c6015ab60 con 0x7f1c600cb5a0 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c65a62700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c600ce0f0 con 0x7f1c600cb970 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c5ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1c6015a400 0x7f1c60156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54848/0 (socket says 172.21.15.33:54848) 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.500+0000 7f1c5ffff700 1 -- 172.21.15.33:0/1689511826 learned_addr learned my addr 172.21.15.33:0/1689511826 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5effd700 1 --2- 172.21.15.33:0/1689511826 >> v2:172.21.15.59:3300/0 conn(0x7f1c600cb970 0x7f1c60159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4271971052 0 0) 0x7f1c6015ae40 con 0x7f1c6015a400 2023-10-09T15:39:03.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1c48003570 con 0x7f1c6015a400 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2495552845 0 0) 0x7f1c48003570 con 0x7f1c6015a400 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 >> v2:172.21.15.59:3300/0 conn(0x7f1c600cb970 msgr2=0x7f1c60159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 --2- 172.21.15.33:0/1689511826 >> v2:172.21.15.59:3300/0 conn(0x7f1c600cb970 0x7f1c60159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 >> v1:172.21.15.59:6789/0 conn(0x7f1c600cb5a0 legacy=0x7f1c600cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600ccf00 con 0x7f1c6015a400 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1c580017f0 con 0x7f1c6015a400 2023-10-09T15:39:03.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 >> v1:172.21.15.33:6789/0 conn(0x7f1c6015a400 legacy=0x7f1c60156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c48003a60 0x7f1c48003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c48004810 0x7f1c48004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 0x7f1c4800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600ce0f0 con 0x7f1c480051c0 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4800c050 con 0x7f1c48003a60 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c4800c210 con 0x7f1c48004810 2023-10-09T15:39:03.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 0x7f1c4800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5effd700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c48004810 0x7f1c48004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.501+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c48003a60 0x7f1c48003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 -- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c48004810 msgr2=0x7f1c48004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c48004810 0x7f1c48004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 -- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c48003a60 msgr2=0x7f1c48003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c48003a60 0x7f1c48003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 -- 172.21.15.33:0/1689511826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c48003570 con 0x7f1c480051c0 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5effd700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c48004810 0x7f1c48004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 -- 172.21.15.33:0/1689511826 reap_dead start 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 0x7f1c4800ba60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a950 tx=0x7f1c580021f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cddd4bddbfddd3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580070d0 con 0x7f1c480051c0 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c58007270 con 0x7f1c480051c0 2023-10-09T15:39:03.508 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c5e7fc700 1 -- 172.21.15.33:0/1689511826 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58007630 con 0x7f1c480051c0 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 -- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 msgr2=0x7f1c4800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 0x7f1c4800ba60 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f1c5800a950 tx=0x7f1c580021f0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 -- 172.21.15.33:0/1689511826 shutdown_connections 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 --2- 172.21.15.33:0/1689511826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c480051c0 0x7f1c4800ba60 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 -- 172.21.15.33:0/1689511826 >> 172.21.15.33:0/1689511826 conn(0x7f1c60070e30 msgr2=0x7f1c600d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 -- 172.21.15.33:0/1689511826 shutdown_connections 2023-10-09T15:39:03.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.502+0000 7f1c65a62700 1 -- 172.21.15.33:0/1689511826 wait complete. 2023-10-09T15:39:03.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 Processor -- start 2023-10-09T15:39:03.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 -- start start 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 0x7f1c60152bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 0x7f1c600b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c60146000 con 0x7f1c60154e30 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c601557e0 con 0x7f1c480051c0 2023-10-09T15:39:03.518 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c65a62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c600b5000 con 0x7f1c60145bb0 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.504+0000 7f1c5ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60950/0 (socket says 172.21.15.33:60950) 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 -- 172.21.15.33:0/698770511 learned_addr learned my addr 172.21.15.33:0/698770511 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 0x7f1c60152bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5effd700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 0x7f1c600b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 -- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 msgr2=0x7f1c600b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 0x7f1c600b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 -- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 msgr2=0x7f1c60152bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 0x7f1c60152bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 -- 172.21.15.33:0/698770511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c600b4cb0 con 0x7f1c60154e30 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 0x7f1c60152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5effd700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 0x7f1c600b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1c60064ad0 tx=0x7f1c58015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c477fe700 1 -- 172.21.15.33:0/698770511 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c580070d0 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c477fe700 1 -- 172.21.15.33:0/698770511 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c580017b0 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c600b3ce0 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c477fe700 1 -- 172.21.15.33:0/698770511 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c58001fd0 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.505+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c600b42a0 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.506+0000 7f1c477fe700 1 -- 172.21.15.33:0/698770511 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1c5801a040 con 0x7f1c60154e30 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.507+0000 7f1c477fe700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 0x7f1c4c069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.521 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.507+0000 7f1c477fe700 1 -- 172.21.15.33:0/698770511 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c58087010 con 0x7f1c60154e30 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.507+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 0x7f1c4c069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.507+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 0x7f1c4c069800 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1c50003c50 tx=0x7f1c50009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.509+0000 7f1c6ed5ab80 1 Processor -- start 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.509+0000 7f1c6ed5ab80 1 -- start start 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7fcbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7f26a70 con 0x5645b7fcfa50 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7f24270 con 0x5645b7ff8f60 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645b7f20060 con 0x5645b8019d00 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60952/0 (socket says 172.21.15.33:60952) 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3927478020 learned_addr learned my addr 172.21.15.33:0/3927478020 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7fcbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 msgr2=0x5645b7ff8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 msgr2=0x5645b7fcbcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7fcbcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3927478020 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645b7dba270 con 0x5645b7fcfa50 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1c50002f30 tx=0x7f1c50017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=817e232e7a794750 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c44ff9700 1 -- 172.21.15.33:0/3927478020 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50021450 con 0x5645b7fcfa50 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c44ff9700 1 -- 172.21.15.33:0/3927478020 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500215b0 con 0x5645b7fcfa50 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.510+0000 7f1c44ff9700 1 -- 172.21.15.33:0/3927478020 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50021930 con 0x5645b7fcfa50 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3927478020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 msgr2=0x5645b7fcfe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7f1c50002f30 tx=0x7f1c50017000 comp rx=0 tx=0).stop 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3927478020 shutdown_connections 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7fcfe20 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7fcbcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3927478020 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3927478020 >> 172.21.15.33:0/3927478020 conn(0x5645b7fd1370 msgr2=0x5645b7fd1740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3927478020 shutdown_connections 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.511+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3927478020 wait complete. 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.512+0000 7f1c6ed5ab80 1 -- start start 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.512+0000 7f1c6ed5ab80 1 Processor -- start 2023-10-09T15:39:03.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b7ff8f60 0x5645b7ffee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b8019d00 0x5645b7fff3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7ecb890 con 0x5645b7fcfa50 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7ee6ea0 con 0x5645b8019d00 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645b7da2e30 con 0x5645b7ff8f60 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c6ed5ab80 10 client.0 _ll_register_callbacks cb 0x5645b7f93110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:39:03.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60964/0 (socket says 172.21.15.33:60964) 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3791109522 learned_addr learned my addr 172.21.15.33:0/3791109522 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b8019d00 0x5645b7fff3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b7ff8f60 0x5645b7ffee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b7ff8f60 msgr2=0x5645b7ffee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b7ff8f60 0x5645b7ffee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b8019d00 msgr2=0x5645b7fff3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b8019d00 0x5645b7fff3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3791109522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c50002b40 con 0x5645b7fcfa50 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1c50023040 tx=0x7f1c5001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a06230489b3c5ec server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.513+0000 7f1c3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002c630 con 0x5645b7fcfa50 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c5001a030 con 0x5645b7fcfa50 2023-10-09T15:39:03.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5645b7fc4b70 con 0x5645b7fcfa50 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5002c9a0 con 0x5645b7fcfa50 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 10 client.8067 fetch_fsmap learned FSMap version 103 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x5645b7d5cfe0 con 0x5645b7fcfa50 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5645b7fc4b70 con 0x5645b7fcfa50 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 103) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1c5002cb00 con 0x5645b7fcfa50 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 10 client.8067 fetch_fsmap finished waiting for FSMap version 103 2023-10-09T15:39:03.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 10 client.8067 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 20 client.8067 populate_metadata read hostname 'smithi033' 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b80141f0 0x5645b800e480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 4 client.8067 mds_command: new command op to 7935 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 --> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5645b7fa1aa0 con 0x5645b80141f0 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.514+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b80141f0 0x5645b800e480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.515+0000 7f1c3dffb700 10 client.8067 ms_handle_connect on v2:172.21.15.59:6832/924608067 2023-10-09T15:39:03.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.515+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b80141f0 0x5645b800e480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dccfd8c03025be0 server_cookie=194ab3d1899c8aa7 in_seq=0 out_seq=0 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3791109522 <== mds.0 v2:172.21.15.59:6832/924608067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x5645b7fa1aa0 con 0x5645b80141f0 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c3dffb700 10 client.8067 handle_command_reply: tid=0 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 client.8067 shutdown 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 msgr2=0x5645b8013cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f1c50023040 tx=0x7f1c5001b000 comp rx=0 tx=0).stop 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 shutdown_connections 2023-10-09T15:39:03.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b80141f0 0x5645b800e480 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8013cb0 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c3dffb700 0 client.8067 ms_handle_reset on v2:172.21.15.59:6832/924608067 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b8019d00 0x5645b7fff3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3791109522 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b7ff8f60 0x5645b7ffee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 >> 172.21.15.33:0/3791109522 conn(0x5645b7fd1370 msgr2=0x5645b7fcc780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 shutdown_connections 2023-10-09T15:39:03.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3791109522 wait complete. 2023-10-09T15:39:03.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.516+0000 7f1c6ed5ab80 20 client.8067 trim_cache size 0 max 16384 2023-10-09T15:39:03.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.533+0000 7f1c6ed5ab80 1 Processor -- start 2023-10-09T15:39:03.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.533+0000 7f1c6ed5ab80 1 -- start start 2023-10-09T15:39:03.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b8011db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ffece0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7fcd8d0 con 0x5645b7fcfa50 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b800ee30 con 0x5645b7ff8f60 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645b7ffcaa0 con 0x5645b8019d00 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60976/0 (socket says 172.21.15.33:60976) 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/1675476509 learned_addr learned my addr 172.21.15.33:0/1675476509 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 msgr2=0x5645b7ffece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ffece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 msgr2=0x5645b8011db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b8011db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/1675476509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5645b7eee780 con 0x5645b7fcfa50 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.534+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1c500029a0 tx=0x7f1c5002f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f08ea1a8860e4e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c457fa700 1 -- 172.21.15.33:0/1675476509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50003940 con 0x5645b7fcfa50 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c457fa700 1 -- 172.21.15.33:0/1675476509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c50015c00 con 0x5645b7fcfa50 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c457fa700 1 -- 172.21.15.33:0/1675476509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c50003aa0 con 0x5645b7fcfa50 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/1675476509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 msgr2=0x5645b7ffc560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f1c500029a0 tx=0x7f1c5002f070 comp rx=0 tx=0).stop 2023-10-09T15:39:03.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/1675476509 shutdown_connections 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b7ffc560 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ffece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/1675476509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b8011db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/1675476509 >> 172.21.15.33:0/1675476509 conn(0x5645b7fd1370 msgr2=0x5645b7fd2bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/1675476509 shutdown_connections 2023-10-09T15:39:03.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.535+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/1675476509 wait complete. 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 -- start start 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 Processor -- start 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7ff76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b807d080 con 0x5645b7fcfa50 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x5645b7fff900 con 0x5645b7ff8f60 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x5645b7ffefd0 con 0x5645b8019d00 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.536+0000 7f1c6ed5ab80 10 client.0 _ll_register_callbacks cb 0x5645b7f93110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60988/0 (socket says 172.21.15.33:60988) 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3716675726 learned_addr learned my addr 172.21.15.33:0/3716675726 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.546 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5ffff700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 msgr2=0x5645b7ff7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7ff76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 msgr2=0x5645b7ff76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7ff76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 -- 172.21.15.33:0/3716675726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x5645b7d5cfe0 con 0x5645b7fcfa50 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7ff76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c5f7fe700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1c500029a0 tx=0x7f1c50043000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53d0a2b67d93c8d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c5002c630 con 0x5645b7fcfa50 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1c5001a070 con 0x5645b7fcfa50 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f1c500215b0 con 0x5645b7fcfa50 2023-10-09T15:39:03.548 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=103) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1c5002cbb0 con 0x5645b7fcfa50 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 10 client.8073 fetch_fsmap learned FSMap version 103 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=103,monmap=2+}) v3 -- 0x5645b7ed5470 con 0x5645b7fcfa50 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c500215b0 con 0x5645b7fcfa50 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 103) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f1c5004b070 con 0x5645b7fcfa50 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 10 client.8073 fetch_fsmap finished waiting for FSMap version 103 2023-10-09T15:39:03.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 10 client.8073 resolve_mds: resolved name 'b' to daemon mds.b 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.537+0000 7f1c6ed5ab80 20 client.8073 populate_metadata read hostname 'smithi033' 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b807bd20 0x5645b807c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 4 client.8073 mds_command: new command op to 7935 tid=0[{"prefix": "status"}] 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 --> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5645b7ec2e00 con 0x5645b807bd20 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b807bd20 0x5645b807c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c3dffb700 10 client.8073 ms_handle_connect on v2:172.21.15.59:6832/924608067 2023-10-09T15:39:03.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c5effd700 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b807bd20 0x5645b807c0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5f006f90af3b6b8 server_cookie=ff5dd6cc560e94b1 in_seq=0 out_seq=0 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c3dffb700 1 -- 172.21.15.33:0/3716675726 <== mds.0 v2:172.21.15.59:6832/924608067 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+334 (crc 0 0 0) 0x5645b7ec2e00 con 0x5645b807bd20 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c3dffb700 10 client.8073 handle_command_reply: tid=0 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 client.8073 shutdown 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 msgr2=0x5645b8079020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f1c500029a0 tx=0x7f1c50043000 comp rx=0 tx=0).stop 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 shutdown_connections 2023-10-09T15:39:03.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:6832/924608067,v1:172.21.15.59:6834/924608067] conn(0x5645b807bd20 0x5645b807c0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x5645b7fcfa50 0x5645b8079020 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c3dffb700 0 client.8073 ms_handle_reset on v2:172.21.15.59:6832/924608067 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x5645b8019d00 0x5645b7ff7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 --2- 172.21.15.33:0/3716675726 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x5645b7ff8f60 0x5645b7ff76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.538+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 >> 172.21.15.33:0/3716675726 conn(0x5645b7fd1370 msgr2=0x5645b8012050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 shutdown_connections 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c6ed5ab80 1 -- 172.21.15.33:0/3716675726 wait complete. 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c6ed5ab80 20 client.8073 trim_cache size 0 max 16384 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:39:03.553 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 7935, 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9117756129999997, 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 103, 2023-10-09T15:39:03.554 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 156, 2023-10-09T15:39:03.555 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 156, 2023-10-09T15:39:03.555 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 10.998143865999999 2023-10-09T15:39:03.555 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:39:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 msgr2=0x7f1c4c069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 0x7f1c4c069800 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f1c50003c50 tx=0x7f1c50009040 comp rx=0 tx=0).stop 2023-10-09T15:39:03.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 msgr2=0x7f1c601552a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f1c60064ad0 tx=0x7f1c58015000 comp rx=0 tx=0).stop 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 shutdown_connections 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1c4c067350 0x7f1c4c069800 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1c60154e30 0x7f1c601552a0 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1c480051c0 0x7f1c60152bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 --2- 172.21.15.33:0/698770511 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1c60145bb0 0x7f1c600b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 >> 172.21.15.33:0/698770511 conn(0x7f1c60070e30 msgr2=0x7f1c600b1f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 shutdown_connections 2023-10-09T15:39:03.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.539+0000 7f1c65a62700 1 -- 172.21.15.33:0/698770511 wait complete. 2023-10-09T15:39:03.558 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:39:03.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.677+0000 7f81af27f700 1 Processor -- start 2023-10-09T15:39:03.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.677+0000 7f81af27f700 1 -- start start 2023-10-09T15:39:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81af27f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a80c95c0 0x7f81a80aaec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.689 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81af27f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f81a81579a0 0x7f81a80c9990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81af27f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81a80c3d00 con 0x7f81a80caa00 2023-10-09T15:39:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81af27f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80c3110 con 0x7f81a81579a0 2023-10-09T15:39:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81af27f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80c33d0 con 0x7f81a80c95c0 2023-10-09T15:39:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81ada7c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f81a80caa00 0x7f81a8157290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54854/0 (socket says 172.21.15.33:54854) 2023-10-09T15:39:03.690 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81ada7c700 1 -- 172.21.15.33:0/2133652995 learned_addr learned my addr 172.21.15.33:0/2133652995 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a80c95c0 0x7f81a80aaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2133652995 >> v2:172.21.15.59:3300/0 conn(0x7f81a81579a0 0x7f81a80c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3959515307 0 0) 0x7f81a80c3d00 con 0x7f81a80caa00 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.678+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8190003570 con 0x7f81a80caa00 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3050421093 0 0) 0x7f8190003570 con 0x7f81a80caa00 2023-10-09T15:39:03.691 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a80c95c0 msgr2=0x7f81a80aaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a80c95c0 0x7f81a80aaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 >> v2:172.21.15.59:3300/0 conn(0x7f81a81579a0 msgr2=0x7f81a80c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 --2- 172.21.15.33:0/2133652995 >> v2:172.21.15.59:3300/0 conn(0x7f81a81579a0 0x7f81a80c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80c36b0 con 0x7f81a80caa00 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f819c001470 con 0x7f81a80caa00 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 >> v1:172.21.15.33:6789/0 conn(0x7f81a80caa00 legacy=0x7f81a8157290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190003a60 0x7f8190003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8190004810 0x7f8190004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81900051c0 0x7f819000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80c3110 con 0x7f81900051c0 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80c33d0 con 0x7f8190003a60 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f819000bfa0 con 0x7f8190004810 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a80c95c0 0x7f81a80aaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81900051c0 0x7f819000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ada7c700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8190004810 0x7f8190004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190003a60 0x7f8190003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 -- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8190004810 msgr2=0x7f8190004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8190004810 0x7f8190004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 -- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190003a60 msgr2=0x7f8190003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190003a60 0x7f8190003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 -- 172.21.15.33:0/2133652995 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8190003570 con 0x7f81900051c0 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8190003a60 0x7f8190003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81900051c0 0x7f819000ba60 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f819800e210 tx=0x7f819800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51458b6b9473a989 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.679+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800eac0 con 0x7f81900051c0 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819800f040 con 0x7f81900051c0 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81ad27b700 1 -- 172.21.15.33:0/2133652995 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800ee70 con 0x7f81900051c0 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 -- 172.21.15.33:0/2133652995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81900051c0 msgr2=0x7f819000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 --2- 172.21.15.33:0/2133652995 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81900051c0 0x7f819000ba60 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f819800e210 tx=0x7f819800b040 comp rx=0 tx=0).stop 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81aea7e700 1 -- 172.21.15.33:0/2133652995 reap_dead start 2023-10-09T15:39:03.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 -- 172.21.15.33:0/2133652995 shutdown_connections 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 -- 172.21.15.33:0/2133652995 >> 172.21.15.33:0/2133652995 conn(0x7f81a8088000 msgr2=0x7f81a80ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 -- 172.21.15.33:0/2133652995 shutdown_connections 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.680+0000 7f81af27f700 1 -- 172.21.15.33:0/2133652995 wait complete. 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.681+0000 7f81af27f700 1 Processor -- start 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.681+0000 7f81af27f700 1 -- start start 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81900051c0 0x7f81a80b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a81537f0 0x7f81a81599d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a8069940 con 0x7f81a8068f60 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b2300 con 0x7f81900051c0 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81af27f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80b16f0 con 0x7f81a81537f0 2023-10-09T15:39:03.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32772/0 (socket says 172.21.15.33:32772) 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 -- 172.21.15.33:0/2756530599 learned_addr learned my addr 172.21.15.33:0/2756530599 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81ada7c700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a81537f0 0x7f81a81599d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81900051c0 0x7f81a80b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 -- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a81537f0 msgr2=0x7f81a81599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a81537f0 0x7f81a81599d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 -- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81900051c0 msgr2=0x7f81a80b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81900051c0 0x7f81a80b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 -- 172.21.15.33:0/2756530599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80b19d0 con 0x7f81a8068f60 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.682+0000 7f81aea7e700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f8198002230 tx=0x7f819801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819800ec90 con 0x7f81a8068f60 2023-10-09T15:39:03.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f819801e640 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80b1cb0 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f819801e9e0 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a8159f10 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.683+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a804c3c0 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.684+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8198026410 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.684+0000 7f81a67fc700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 0x7f81940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.685+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8198086530 con 0x7f81a8068f60 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.685+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 0x7f81940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.685+0000 7f81ae27d700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 0x7f81940697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f81a00090f0 tx=0x7f81a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:03.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.689+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8198053340 con 0x7f81a8068f60 2023-10-09T15:39:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.926+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f81a80b2440 con 0x7f81a8068f60 2023-10-09T15:39:03.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.927+0000 7f81a67fc700 1 -- 172.21.15.33:0/2756530599 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) v1 ==== 53+0+73 (secure 0 0 0) 0x7f8198056960 con 0x7f81a8068f60 2023-10-09T15:39:03.927 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 msgr2=0x7f81940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 0x7f81940697d0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f81a00090f0 tx=0x7f81a0008040 comp rx=0 tx=0).stop 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 msgr2=0x7f81a8069400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f8198002230 tx=0x7f819801a000 comp rx=0 tx=0).stop 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 shutdown_connections 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8194067320 0x7f81940697d0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81a8068f60 0x7f81a8069400 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81900051c0 0x7f81a80b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.928+0000 7f81af27f700 1 --2- 172.21.15.33:0/2756530599 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81a81537f0 0x7f81a81599d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.929+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 >> 172.21.15.33:0/2756530599 conn(0x7f81a8088000 msgr2=0x7f81a80ad450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.929+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 shutdown_connections 2023-10-09T15:39:03.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:03.929+0000 7f81af27f700 1 -- 172.21.15.33:0/2756530599 wait complete. 2023-10-09T15:39:03.940 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:39:03.941 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:03.942 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:03.942 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:39:03.957 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:39:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:39:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:39:03.957 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:39:03.958 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:39:03.959 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41943sec preferred_lft 41943sec 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:03.960 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.961 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:03.962 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:39:03.962 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:39:03.962 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:03.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:03.962 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:39:04.021 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:39:04.023 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.023 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:39:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:39:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:39:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:39:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:39:04.079 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:39:04.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:39:04.080 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:39:04.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.180 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:39:04.195 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:39:04.195 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:39:04.195 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:04.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.196 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:39:04.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:04.261 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:04.317 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:04.317 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:04.317 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:04.371 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:39:04.371 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:39:04.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:04.453 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:04.453 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:04.453 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:04.461 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:04.483 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:39:04.484 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:39:04.484 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:39:04.486 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:39:04.486 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.486 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:04.551 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:39:04.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.712+0000 7f775fde6700 1 Processor -- start 2023-10-09T15:39:04.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.712+0000 7f775fde6700 1 -- start start 2023-10-09T15:39:04.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775fde6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f7758159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775fde6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f775806c7d0 con 0x7f77580c3250 2023-10-09T15:39:04.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775fde6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77580c37a0 con 0x7f775815aa20 2023-10-09T15:39:04.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775fde6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77581171e0 con 0x7f7758143200 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775d381700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f77580c3250 0x7f775815a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54868/0 (socket says 172.21.15.33:54868) 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775d381700 1 -- 172.21.15.33:0/504808898 learned_addr learned my addr 172.21.15.33:0/504808898 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775db82700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f7758159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 667910697 0 0) 0x7f775806c7d0 con 0x7f77580c3250 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7740003570 con 0x7f77580c3250 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1194613050 0 0) 0x7f7740003570 con 0x7f77580c3250 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 msgr2=0x7f7758159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f7758159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 >> v1:172.21.15.59:6789/0 conn(0x7f775815aa20 legacy=0x7f7758163430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77580cc090 con 0x7f77580c3250 2023-10-09T15:39:04.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f774c001470 con 0x7f77580c3250 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 >> v1:172.21.15.33:6789/0 conn(0x7f77580c3250 legacy=0x7f775815a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.713+0000 7f775cb80700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7740003a90 0x7f7740003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7740004810 0x7f7740004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f77400051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774000bb10 con 0x7f7740003a90 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f774000bc50 con 0x7f7740004810 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f774000be10 con 0x7f7758143200 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7740003a90 0x7f7740003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775d381700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7740004810 0x7f7740004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775e383700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f77400051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 -- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 msgr2=0x7f77400051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:04.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758143200 0x7f77400051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 -- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7740004810 msgr2=0x7f7740004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7740004810 0x7f7740004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 -- 172.21.15.33:0/504808898 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7740003570 con 0x7f7740003a90 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775d381700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7740004810 0x7f7740004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775db82700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7740003a90 0x7f7740003e60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f774800e210 tx=0x7f774800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5210ce3b52656a7a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800eac0 con 0x7f7740003a90 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f774800f040 con 0x7f7740003a90 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.714+0000 7f775cb80700 1 -- 172.21.15.33:0/504808898 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f774800ee70 con 0x7f7740003a90 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 -- 172.21.15.33:0/504808898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7740003a90 msgr2=0x7f7740003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 --2- 172.21.15.33:0/504808898 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7740003a90 0x7f7740003e60 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f774800e210 tx=0x7f774800b040 comp rx=0 tx=0).stop 2023-10-09T15:39:04.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775e383700 1 -- 172.21.15.33:0/504808898 reap_dead start 2023-10-09T15:39:04.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 -- 172.21.15.33:0/504808898 shutdown_connections 2023-10-09T15:39:04.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 -- 172.21.15.33:0/504808898 >> 172.21.15.33:0/504808898 conn(0x7f77580ccb60 msgr2=0x7f77580ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:04.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 -- 172.21.15.33:0/504808898 shutdown_connections 2023-10-09T15:39:04.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.715+0000 7f775fde6700 1 -- 172.21.15.33:0/504808898 wait complete. 2023-10-09T15:39:04.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.716+0000 7f775fde6700 1 Processor -- start 2023-10-09T15:39:04.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.716+0000 7f775fde6700 1 -- start start 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7758133590 0x7f77581343e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758169fd0 0x7f7758135c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7758136610 con 0x7f7758136170 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77581355d0 con 0x7f7758133590 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77581349c0 con 0x7f7758169fd0 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32782/0 (socket says 172.21.15.33:32782) 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 -- 172.21.15.33:0/2619418449 learned_addr learned my addr 172.21.15.33:0/2619418449 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775d381700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758169fd0 0x7f7758135c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775db82700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7758133590 0x7f77581343e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.722 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 -- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758169fd0 msgr2=0x7f7758135c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758169fd0 0x7f7758135c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 -- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7758133590 msgr2=0x7f77581343e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7758133590 0x7f77581343e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 -- 172.21.15.33:0/2619418449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7758134ca0 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775e383700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f77580cbfc0 tx=0x7f7750009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750013420 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77500135a0 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7758134f80 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.717+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7750013960 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.718+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f775816a440 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.719+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7758135740 con 0x7f7758136170 2023-10-09T15:39:04.723 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.719+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7750013cd0 con 0x7f7758136170 2023-10-09T15:39:04.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.719+0000 7f7755ffb700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 0x7f77440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:04.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.720+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7750084aa0 con 0x7f7758136170 2023-10-09T15:39:04.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.720+0000 7f775db82700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 0x7f77440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:04.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.720+0000 7f775db82700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 0x7f77440697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7758069750 tx=0x7f774801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:04.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.724+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f77500517f0 con 0x7f7758136170 2023-10-09T15:39:04.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.963+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f775804c3c0 con 0x7f7758136170 2023-10-09T15:39:04.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.963+0000 7f7755ffb700 1 -- 172.21.15.33:0/2619418449 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v103) v1 ==== 53+0+73 (secure 0 0 0) 0x7f7750054e10 con 0x7f7758136170 2023-10-09T15:39:04.963 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 msgr2=0x7f77440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 0x7f77440697d0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7758069750 tx=0x7f774801a000 comp rx=0 tx=0).stop 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 msgr2=0x7f7758139e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f77580cbfc0 tx=0x7f7750009040 comp rx=0 tx=0).stop 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 shutdown_connections 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7744067320 0x7f77440697d0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7758136170 0x7f7758139e40 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7758133590 0x7f77581343e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 --2- 172.21.15.33:0/2619418449 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7758169fd0 0x7f7758135c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:04.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 >> 172.21.15.33:0/2619418449 conn(0x7f77580ccb60 msgr2=0x7f77580c9830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:04.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 shutdown_connections 2023-10-09T15:39:04.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:04.965+0000 7f775fde6700 1 -- 172.21.15.33:0/2619418449 wait complete. 2023-10-09T15:39:04.977 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:39:04.977 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:39:04.978 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:04.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:04.978 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:39:04.997 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:39:04.997 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:39:04.997 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:39:04.998 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41951sec preferred_lft 41951sec 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:04.999 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:05.000 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:39:05.001 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:39:05.001 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:05.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.001 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:39:05.066 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:39:05.068 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.068 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:39:05.126 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:39:05.126 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:39:05.126 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:39:05.127 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:39:05.127 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:39:05.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:39:05.127 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:39:05.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.237 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:39:05.252 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:39:05.253 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:39:05.253 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:05.253 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.253 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:39:05.319 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:05.319 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:05.375 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:05.375 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:05.375 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:05.430 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:39:05.430 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:39:05.431 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:05.512 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:05.512 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:05.513 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:05.522 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:05.522 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:05.522 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:05.522 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:05.522 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:05.543 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:05.544 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:05.544 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:39:05.544 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:39:05.544 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:39:05.546 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:39:05.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:05.546 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:05.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:39:05.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.747+0000 7ff57eef4700 1 Processor -- start 2023-10-09T15:39:05.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.747+0000 7ff57eef4700 1 -- start start 2023-10-09T15:39:05.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57eef4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff578159fb0 0x7ff57815a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57eef4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff5780cd5a0 0x7ff5780cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57eef4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff57815d570 con 0x7ff57815a8c0 2023-10-09T15:39:05.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57eef4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57815e180 con 0x7ff578159fb0 2023-10-09T15:39:05.750 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57eef4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff57815d850 con 0x7ff5780cd5a0 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57def2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff578159fb0 0x7ff57815a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57d6f1700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff57815a8c0 0x7ff5780cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54876/0 (socket says 172.21.15.33:54876) 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57d6f1700 1 -- 172.21.15.33:0/3269241255 learned_addr learned my addr 172.21.15.33:0/3269241255 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57e6f3700 1 --2- 172.21.15.33:0/3269241255 >> v2:172.21.15.59:3300/0 conn(0x7ff5780cd5a0 0x7ff5780cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57def2700 1 -- 172.21.15.33:0/3269241255 >> v2:172.21.15.59:3300/0 conn(0x7ff5780cd5a0 msgr2=0x7ff5780cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57def2700 1 --2- 172.21.15.33:0/3269241255 >> v2:172.21.15.59:3300/0 conn(0x7ff5780cd5a0 0x7ff5780cb440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57def2700 1 -- 172.21.15.33:0/3269241255 >> v1:172.21.15.33:6789/0 conn(0x7ff57815a8c0 legacy=0x7ff5780cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57def2700 1 -- 172.21.15.33:0/3269241255 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff57815db30 con 0x7ff578159fb0 2023-10-09T15:39:05.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.748+0000 7ff57cef0700 1 -- 172.21.15.33:0/3269241255 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1798713213 0 0) 0x7ff57815d570 con 0x7ff57815a8c0 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57def2700 1 --2- 172.21.15.33:0/3269241255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff578159fb0 0x7ff57815a380 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ff578089710 tx=0x7ff5700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41d9015914a62d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57cef0700 1 -- 172.21.15.33:0/3269241255 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57000b6b0 con 0x7ff578159fb0 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57cef0700 1 -- 172.21.15.33:0/3269241255 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff57000b810 con 0x7ff578159fb0 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57cef0700 1 -- 172.21.15.33:0/3269241255 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff57000bbb0 con 0x7ff578159fb0 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 -- 172.21.15.33:0/3269241255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff578159fb0 msgr2=0x7ff57815a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 --2- 172.21.15.33:0/3269241255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff578159fb0 0x7ff57815a380 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7ff578089710 tx=0x7ff5700091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 -- 172.21.15.33:0/3269241255 shutdown_connections 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 --2- 172.21.15.33:0/3269241255 >> v2:172.21.15.59:3300/0 conn(0x7ff5780cd5a0 0x7ff5780cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 --2- 172.21.15.33:0/3269241255 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff578159fb0 0x7ff57815a380 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 -- 172.21.15.33:0/3269241255 >> 172.21.15.33:0/3269241255 conn(0x7ff5780703a0 msgr2=0x7ff5780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:05.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 -- 172.21.15.33:0/3269241255 shutdown_connections 2023-10-09T15:39:05.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.749+0000 7ff57eef4700 1 -- 172.21.15.33:0/3269241255 wait complete. 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 Processor -- start 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 -- start start 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5780cd5a0 0x7ff57816d330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff578159fb0 0x7ff57814ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c5740 con 0x7ff57815a8c0 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c8720 con 0x7ff578159fb0 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57eef4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5780c8a00 con 0x7ff5780cd5a0 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57e6f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57e6f3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32808/0 (socket says 172.21.15.33:32808) 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57e6f3700 1 -- 172.21.15.33:0/1611269692 learned_addr learned my addr 172.21.15.33:0/1611269692 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.751+0000 7ff57d6f1700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff578159fb0 0x7ff57814ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57def2700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5780cd5a0 0x7ff57816d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 -- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5780cd5a0 msgr2=0x7ff57816d330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5780cd5a0 0x7ff57816d330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 -- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff578159fb0 msgr2=0x7ff57814ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff578159fb0 0x7ff57814ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 -- 172.21.15.33:0/1611269692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff570009420 con 0x7ff57815a8c0 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57e6f3700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ceb0 tx=0x7ff568007870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:05.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff56800ad90 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff568016430 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5780c8ce0 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5680167d0 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.752+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57816da30 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.753+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5780c58f0 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.754+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff568003020 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.754+0000 7ff575ffb700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 0x7ff5640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.754+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff568012070 con 0x7ff57815a8c0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.754+0000 7ff57def2700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 0x7ff5640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:05.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.755+0000 7ff57def2700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 0x7ff5640697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff5700093f0 tx=0x7ff570017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:05.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.758+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff5680526e0 con 0x7ff57815a8c0 2023-10-09T15:39:05.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:05.997+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff57804c3c0 con 0x7ff57815a8c0 2023-10-09T15:39:06.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.295+0000 7ff575ffb700 1 -- 172.21.15.33:0/1611269692 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v104) v1 ==== 136+0+0 (secure 0 0 0) 0x7ff568055d00 con 0x7ff57815a8c0 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 msgr2=0x7ff5640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 0x7ff5640697d0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff5700093f0 tx=0x7ff570017000 comp rx=0 tx=0).stop 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 msgr2=0x7ff57814d200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7ff56800ceb0 tx=0x7ff568007870 comp rx=0 tx=0).stop 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 shutdown_connections 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff564067320 0x7ff5640697d0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff57815a8c0 0x7ff57814d200 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff5780cd5a0 0x7ff57816d330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 --2- 172.21.15.33:0/1611269692 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff578159fb0 0x7ff57814ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 >> 172.21.15.33:0/1611269692 conn(0x7ff5780703a0 msgr2=0x7ff5781582e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 shutdown_connections 2023-10-09T15:39:06.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.297+0000 7ff57eef4700 1 -- 172.21.15.33:0/1611269692 wait complete. 2023-10-09T15:39:06.310 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:39:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.430+0000 7f8c037ab700 1 Processor -- start 2023-10-09T15:39:06.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.430+0000 7f8c037ab700 1 -- start start 2023-10-09T15:39:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c037ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc159c80 0x7f8bfc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c037ab700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c037ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bfc0ce9d0 con 0x7f8bfc1598b0 2023-10-09T15:39:06.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c037ab700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bfc0af960 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c037ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc0afc30 con 0x7f8bfc159c80 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c01d48700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.431+0000 7f8c01d48700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32810/0 (socket says 172.21.15.33:32810) 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 -- 172.21.15.33:0/312775783 learned_addr learned my addr 172.21.15.33:0/312775783 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c00d46700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc159c80 0x7f8bfc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 -- 172.21.15.33:0/312775783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc159c80 msgr2=0x7f8bfc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc159c80 0x7f8bfc0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 -- 172.21.15.33:0/312775783 >> v1:172.21.15.59:6789/0 conn(0x7f8bfc1598b0 legacy=0x7f8bfc0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 -- 172.21.15.33:0/312775783 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bfc0aff10 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8c01d48700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009f20 tx=0x7f8bec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdcd9bae141d226b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8bfbfff700 1 -- 172.21.15.33:0/312775783 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec00e070 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8bfbfff700 1 -- 172.21.15.33:0/312775783 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec00ba80 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.435 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.432+0000 7f8bfbfff700 1 -- 172.21.15.33:0/312775783 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0092e0 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 -- 172.21.15.33:0/312775783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc0cfe70 msgr2=0x7f8bfc0cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 secure :-1 s=READY pgs=1384 cs=0 l=1 rev1=1 crypto rx=0x7f8bec009f20 tx=0x7f8bec009840 comp rx=0 tx=0).stop 2023-10-09T15:39:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 -- 172.21.15.33:0/312775783 shutdown_connections 2023-10-09T15:39:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc0cbc30 unknown :-1 s=CLOSED pgs=1384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 --2- 172.21.15.33:0/312775783 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc159c80 0x7f8bfc0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 -- 172.21.15.33:0/312775783 >> 172.21.15.33:0/312775783 conn(0x7f8bfc070e30 msgr2=0x7f8bfc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 -- 172.21.15.33:0/312775783 shutdown_connections 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.433+0000 7f8c037ab700 1 -- 172.21.15.33:0/312775783 wait complete. 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.434+0000 7f8c037ab700 1 Processor -- start 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.434+0000 7f8c037ab700 1 -- start start 2023-10-09T15:39:06.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc15ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc1598b0 0x7f8bfc169480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc15c880 con 0x7f8bfc159c80 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc15bc00 con 0x7f8bfc0cfe70 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c037ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bfc15bee0 con 0x7f8bfc1598b0 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.440 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32824/0 (socket says 172.21.15.33:32824) 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 -- 172.21.15.33:0/3768590851 learned_addr learned my addr 172.21.15.33:0/3768590851 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01547700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc15ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c00d46700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc1598b0 0x7f8bfc169480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 -- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc1598b0 msgr2=0x7f8bfc169480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc1598b0 0x7f8bfc169480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 -- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 msgr2=0x7f8bfc15ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc15ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 -- 172.21.15.33:0/3768590851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bec009ae0 con 0x7f8bfc159c80 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01547700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.435+0000 7f8c01d48700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06cd60 tx=0x7f8bec018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.436+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec0032f0 con 0x7f8bfc159c80 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.436+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bec008e80 con 0x7f8bfc159c80 2023-10-09T15:39:06.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.436+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bfc15c1c0 con 0x7f8bfc159c80 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.436+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bec026690 con 0x7f8bfc159c80 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.436+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bfc15b820 con 0x7f8bfc159c80 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.437+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bfc15c9c0 con 0x7f8bfc159c80 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.437+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8bec003040 con 0x7f8bfc159c80 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.438+0000 7f8bf97fa700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 0x7f8be80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.438+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8bec086720 con 0x7f8bfc159c80 2023-10-09T15:39:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.438+0000 7f8c01547700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 0x7f8be80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.438+0000 7f8c01547700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 0x7f8be80697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001840 tx=0x7f8bf4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.444 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.442+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8bfc15c9c0 con 0x7f8bfc159c80 2023-10-09T15:39:06.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.664+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f8bfc15c9c0 con 0x7f8be8067320 2023-10-09T15:39:06.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.665+0000 7f8bf97fa700 1 -- 172.21.15.33:0/3768590851 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f8bfc15c9c0 con 0x7f8be8067320 2023-10-09T15:39:06.666 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:39:06.666 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:06.666 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:39:06.666 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:06.666 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:39:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 msgr2=0x7f8be80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 0x7f8be80697d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f8bf4001840 tx=0x7f8bf4009040 comp rx=0 tx=0).stop 2023-10-09T15:39:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 msgr2=0x7f8bfc1699c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc06cd60 tx=0x7f8bec018000 comp rx=0 tx=0).stop 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 shutdown_connections 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8be8067320 0x7f8be80697d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bfc159c80 0x7f8bfc1699c0 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bfc0cfe70 0x7f8bfc15ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 --2- 172.21.15.33:0/3768590851 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bfc1598b0 0x7f8bfc169480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 >> 172.21.15.33:0/3768590851 conn(0x7f8bfc070e30 msgr2=0x7f8bfc0ced60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 shutdown_connections 2023-10-09T15:39:06.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.667+0000 7f8c037ab700 1 -- 172.21.15.33:0/3768590851 wait complete. 2023-10-09T15:39:06.679 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:39:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.801+0000 7f096f791700 1 Processor -- start 2023-10-09T15:39:06.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.801+0000 7f096f791700 1 -- start start 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096f791700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0968159530 0x7f09680ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096f791700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f096806e0e0 0x7f09680cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096f791700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09680ccfd0 con 0x7f096806dc70 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096f791700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09680cf0e0 con 0x7f0968159530 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096f791700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f096815a3d0 con 0x7f096806e0e0 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096dd2e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f096806e0e0 0x7f09680cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096d52d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0968159530 0x7f09680ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096cd2c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f096806dc70 0x7f0968159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:51870/0 (socket says 172.21.15.33:51870) 2023-10-09T15:39:06.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096cd2c700 1 -- 172.21.15.33:0/1897978431 learned_addr learned my addr 172.21.15.33:0/1897978431 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096d52d700 1 -- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f096806e0e0 msgr2=0x7f09680cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096d52d700 1 --2- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f096806e0e0 0x7f09680cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096d52d700 1 -- 172.21.15.33:0/1897978431 >> v1:172.21.15.59:6789/0 conn(0x7f096806dc70 legacy=0x7f0968159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.802+0000 7f096d52d700 1 -- 172.21.15.33:0/1897978431 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f096815a6b0 con 0x7f0968159530 2023-10-09T15:39:06.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096d52d700 1 --2- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968159530 0x7f09680ceba0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f09600098e0 tx=0x7f09600091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=790f5c53dab170b4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f0967fff700 1 -- 172.21.15.33:0/1897978431 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000b640 con 0x7f0968159530 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f0967fff700 1 -- 172.21.15.33:0/1897978431 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f096000b7a0 con 0x7f0968159530 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f0967fff700 1 -- 172.21.15.33:0/1897978431 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f096000bb40 con 0x7f0968159530 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 -- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968159530 msgr2=0x7f09680ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 --2- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968159530 0x7f09680ceba0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f09600098e0 tx=0x7f09600091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 -- 172.21.15.33:0/1897978431 shutdown_connections 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 --2- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0968159530 0x7f09680ceba0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 --2- 172.21.15.33:0/1897978431 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f096806e0e0 0x7f09680cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 -- 172.21.15.33:0/1897978431 >> 172.21.15.33:0/1897978431 conn(0x7f09680703a0 msgr2=0x7f09680707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.803+0000 7f096f791700 1 -- 172.21.15.33:0/1897978431 shutdown_connections 2023-10-09T15:39:06.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.804+0000 7f096f791700 1 -- 172.21.15.33:0/1897978431 wait complete. 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 Processor -- start 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 -- start start 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 0x7f09680b6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0968159530 0x7f09680c98d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b6560 con 0x7f096806e0e0 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b38a0 con 0x7f096806dc70 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.805+0000 7f096f791700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09680b4140 con 0x7f0968159530 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32836/0 (socket says 172.21.15.33:32836) 2023-10-09T15:39:06.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 -- 172.21.15.33:0/3309055005 learned_addr learned my addr 172.21.15.33:0/3309055005 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096d52d700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 0x7f09680b6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096dd2e700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0968159530 0x7f09680c98d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 -- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0968159530 msgr2=0x7f09680c98d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0968159530 0x7f09680c98d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 -- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 msgr2=0x7f09680b6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 0x7f09680b6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 -- 172.21.15.33:0/3309055005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0960009420 con 0x7f096806e0e0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096d52d700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 0x7f09680b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096cd2c700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c7c0 tx=0x7f095c007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c005b30 con 0x7f096806e0e0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f095c005c90 con 0x7f096806e0e0 2023-10-09T15:39:06.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09680c9e10 con 0x7f096806e0e0 2023-10-09T15:39:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f095c004a80 con 0x7f096806e0e0 2023-10-09T15:39:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.806+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09680b3af0 con 0x7f096806e0e0 2023-10-09T15:39:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.807+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f096804c3c0 con 0x7f096806e0e0 2023-10-09T15:39:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.808+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f095c0070d0 con 0x7f096806e0e0 2023-10-09T15:39:06.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.808+0000 7f09657fa700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.808+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f095c083fb0 con 0x7f096806e0e0 2023-10-09T15:39:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.808+0000 7f096d52d700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:06.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.809+0000 7f096d52d700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f09600093f0 tx=0x7f0960017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:06.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:06.812+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f095c050c40 con 0x7f096806e0e0 2023-10-09T15:39:06.911 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:39:06.913 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:39:07.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.006+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f096815a990 con 0x7f096806e0e0 2023-10-09T15:39:07.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.006+0000 7f09657fa700 1 -- 172.21.15.33:0/3309055005 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v26)=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7f095c054260 con 0x7f096806e0e0 2023-10-09T15:39:07.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 msgr2=0x7f09540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f09600093f0 tx=0x7f0960017000 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 msgr2=0x7f09680c9390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f095c00c7c0 tx=0x7f095c007f70 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 shutdown_connections 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0954067320 0x7f09540697d0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0968159530 0x7f09680c98d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f096806dc70 0x7f09680b6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 --2- 172.21.15.33:0/3309055005 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f096806e0e0 0x7f09680c9390 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 >> 172.21.15.33:0/3309055005 conn(0x7f09680703a0 msgr2=0x7f0968153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 shutdown_connections 2023-10-09T15:39:07.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.008+0000 7f096f791700 1 -- 172.21.15.33:0/3309055005 wait complete. 2023-10-09T15:39:07.020 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000613700 2023-10-09T15:39:07.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.182+0000 7f0ad0aaa700 1 Processor -- start 2023-10-09T15:39:07.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.183+0000 7f0ad0aaa700 1 -- start start 2023-10-09T15:39:07.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.183+0000 7f0ad0aaa700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0acc155b60 0x7f0acc0b0730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ad0aaa700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0acc15a0e0 0x7f0acc156380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ad0aaa700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0acc1575a0 con 0x7f0acc155f30 2023-10-09T15:39:07.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ad0aaa700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc156990 con 0x7f0acc155b60 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ad0aaa700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0acc156c70 con 0x7f0acc15a0e0 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0acc155b60 0x7f0acc0b0730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0acc155b60 0x7f0acc0b0730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32852/0 (socket says 172.21.15.33:32852) 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 -- 172.21.15.33:0/2963958032 learned_addr learned my addr 172.21.15.33:0/2963958032 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0acad9d700 1 --2- 172.21.15.33:0/2963958032 >> v2:172.21.15.59:3300/0 conn(0x7f0acc15a0e0 0x7f0acc156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 -- 172.21.15.33:0/2963958032 >> v2:172.21.15.59:3300/0 conn(0x7f0acc15a0e0 msgr2=0x7f0acc156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 --2- 172.21.15.33:0/2963958032 >> v2:172.21.15.59:3300/0 conn(0x7f0acc15a0e0 0x7f0acc156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 -- 172.21.15.33:0/2963958032 >> v1:172.21.15.59:6789/0 conn(0x7f0acc155f30 legacy=0x7f0acc1599d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:07.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 -- 172.21.15.33:0/2963958032 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0acc156f50 con 0x7f0acc155b60 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0aca59c700 1 --2- 172.21.15.33:0/2963958032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155b60 0x7f0acc0b0730 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0acc064650 tx=0x7f0ac4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b43cbfcf2fcc1ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ac959a700 1 -- 172.21.15.33:0/2963958032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac400e070 con 0x7f0acc155b60 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ac959a700 1 -- 172.21.15.33:0/2963958032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ac400ba50 con 0x7f0acc155b60 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.184+0000 7f0ac959a700 1 -- 172.21.15.33:0/2963958032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ac40092e0 con 0x7f0acc155b60 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/2963958032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155b60 msgr2=0x7f0acc0b0730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 --2- 172.21.15.33:0/2963958032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155b60 0x7f0acc0b0730 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f0acc064650 tx=0x7f0ac4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/2963958032 shutdown_connections 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 --2- 172.21.15.33:0/2963958032 >> v2:172.21.15.59:3300/0 conn(0x7f0acc15a0e0 0x7f0acc156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 --2- 172.21.15.33:0/2963958032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155b60 0x7f0acc0b0730 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/2963958032 >> 172.21.15.33:0/2963958032 conn(0x7f0acc06d170 msgr2=0x7f0acc0cc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:07.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/2963958032 shutdown_connections 2023-10-09T15:39:07.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.185+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/2963958032 wait complete. 2023-10-09T15:39:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.186+0000 7f0ad0aaa700 1 Processor -- start 2023-10-09T15:39:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.186+0000 7f0ad0aaa700 1 -- start start 2023-10-09T15:39:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0acc155b60 0x7f0acc0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155f30 0x7f0acc1510d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0acc15a0e0 0x7f0acc153a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc14c7f0 con 0x7f0acc155f30 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc0c8920 con 0x7f0acc15a0e0 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ad0aaa700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0acc151f90 con 0x7f0acc155b60 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155f30 0x7f0acc1510d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155f30 0x7f0acc1510d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32864/0 (socket says 172.21.15.33:32864) 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 -- 172.21.15.33:0/3548140034 learned_addr learned my addr 172.21.15.33:0/3548140034 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0acad9d700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0acc15a0e0 0x7f0acc153a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0aca59c700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0acc155b60 0x7f0acc0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 -- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0acc155b60 msgr2=0x7f0acc0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0acc155b60 0x7f0acc0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 -- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0acc15a0e0 msgr2=0x7f0acc153a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0acc15a0e0 0x7f0acc153a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 -- 172.21.15.33:0/3548140034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ac4009ae0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0aca59c700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0acc155b60 0x7f0acc0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac9d9b700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0acc155f30 0x7f0acc1510d0 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f0ab400c7c0 tx=0x7f0ab4007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.187+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011590 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.188+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ab40116f0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.188+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/3548140034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0acc1519d0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.188+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ab4011ab0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.188+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/3548140034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0acc151d60 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.188+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/3548140034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0acc1530a0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.189+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0ab401b3b0 con 0x7f0acc155f30 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.189+0000 7f0ac27fc700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0aac067320 0x7f0aac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.190+0000 7f0aca59c700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0aac067320 0x7f0aac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.190+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ab4084130 con 0x7f0acc155f30 2023-10-09T15:39:07.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.190+0000 7f0aca59c700 1 --2- 172.21.15.33:0/3548140034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0aac067320 0x7f0aac0697d0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f0ac4009ab0 tx=0x7f0ac4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.193 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.194+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ab4050dc0 con 0x7f0acc155f30 2023-10-09T15:39:07.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.418+0000 7f0ad0aaa700 1 -- 172.21.15.33:0/3548140034 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000613700", "target": ["mon-mgr", ""]}) v1 -- 0x7f0acc04c3c0 con 0x7f0aac067320 2023-10-09T15:39:07.418 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:39:07.419+0000 7f91f73a0700 -1 mgr.server reply reply (1) Operation not permitted WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-09T15:39:07.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.419+0000 7f0ac27fc700 1 -- 172.21.15.33:0/3548140034 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: -1 WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue.) v1 ==== 283+0+0 (secure 0 0 0) 0x7f0acc04c3c0 con 0x7f0aac067320 2023-10-09T15:39:07.420 INFO:teuthology.orchestra.run.smithi033.stderr:Error EPERM: WARNING: This will rename the filesystem and possibly its pools. It is a potentially disruptive operation, clients' cephx credentials need reauthorized to access the file system and its pools with the new name. Add --yes-i-really-mean-it if you are sure you wish to continue. 2023-10-09T15:39:07.423 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:39:07.424 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:39:07.424 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:07.470 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:07.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:39:07.516 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:39:07.516 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:39:07.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:07.554 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:39:07.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:07.554 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:39:07.610 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:39:07.610 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:39:07.610 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:07.657 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:39:07.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:07.658 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:39:07.675 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:07.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.794+0000 7f0040f2b700 1 Processor -- start 2023-10-09T15:39:07.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.794+0000 7f0040f2b700 1 -- start start 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f0040f2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c15de50 0x7f003c0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f0040f2b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f003c0cef40 0x7f003c15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f0040f2b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f003c15afd0 con 0x7f003c153c30 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f0040f2b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f003c15b2b0 con 0x7f003c0cef40 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f0040f2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c15b590 con 0x7f003c15de50 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f003bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f003c0cef40 0x7f003c15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f003b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f003c153c30 0x7f003c15a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54878/0 (socket says 172.21.15.33:54878) 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f003b7fe700 1 -- 172.21.15.33:0/3554343191 learned_addr learned my addr 172.21.15.33:0/3554343191 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f003affd700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c15de50 0x7f003c0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.795+0000 7f003bfff700 1 -- 172.21.15.33:0/3554343191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c15de50 msgr2=0x7f003c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003bfff700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c15de50 0x7f003c0cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003bfff700 1 -- 172.21.15.33:0/3554343191 >> v1:172.21.15.33:6789/0 conn(0x7f003c153c30 legacy=0x7f003c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003a7fc700 1 -- 172.21.15.33:0/3554343191 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2870027221 0 0) 0x7f003c15afd0 con 0x7f003c153c30 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003bfff700 1 -- 172.21.15.33:0/3554343191 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c15b870 con 0x7f003c0cef40 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003bfff700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c0cef40 0x7f003c15c070 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0034009e60 tx=0x7f0034009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cda4b026b7c450f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003a7fc700 1 -- 172.21.15.33:0/3554343191 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f003400e070 con 0x7f003c0cef40 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003a7fc700 1 -- 172.21.15.33:0/3554343191 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f003400bb60 con 0x7f003c0cef40 2023-10-09T15:39:07.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f003a7fc700 1 -- 172.21.15.33:0/3554343191 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034012430 con 0x7f003c0cef40 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 -- 172.21.15.33:0/3554343191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c0cef40 msgr2=0x7f003c15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c0cef40 0x7f003c15c070 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f0034009e60 tx=0x7f0034009780 comp rx=0 tx=0).stop 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 -- 172.21.15.33:0/3554343191 shutdown_connections 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c0cef40 0x7f003c15c070 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 --2- 172.21.15.33:0/3554343191 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c15de50 0x7f003c0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.796+0000 7f0040f2b700 1 -- 172.21.15.33:0/3554343191 >> 172.21.15.33:0/3554343191 conn(0x7f003c0703a0 msgr2=0x7f003c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.797+0000 7f0040f2b700 1 -- 172.21.15.33:0/3554343191 shutdown_connections 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.797+0000 7f0040f2b700 1 -- 172.21.15.33:0/3554343191 wait complete. 2023-10-09T15:39:07.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.798+0000 7f0040f2b700 1 Processor -- start 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.798+0000 7f0040f2b700 1 -- start start 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c0cef40 0x7f003c0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c153c30 0x7f003c0b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0ca3e0 con 0x7f003c15de50 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0c8e00 con 0x7f003c153c30 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f003c0c90e0 con 0x7f003c0cef40 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32882/0 (socket says 172.21.15.33:32882) 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 -- 172.21.15.33:0/2061613640 learned_addr learned my addr 172.21.15.33:0/2061613640 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:07.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003b7fe700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c0cef40 0x7f003c0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003affd700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c153c30 0x7f003c0b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 -- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c0cef40 msgr2=0x7f003c0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c0cef40 0x7f003c0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 -- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c153c30 msgr2=0x7f003c0b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c153c30 0x7f003c0b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 -- 172.21.15.33:0/2061613640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0034009a20 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f003bfff700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f003c06eb00 tx=0x7f0034019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034012ea0 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0034027470 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f003c0c93c0 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0034027830 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.799+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f003c0c9980 con 0x7f003c15de50 2023-10-09T15:39:07.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.801+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f003c0c9b70 con 0x7f003c15de50 2023-10-09T15:39:07.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.801+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0034024070 con 0x7f003c15de50 2023-10-09T15:39:07.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.801+0000 7f00237fe700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 0x7f00280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:07.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.801+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f00340873d0 con 0x7f003c15de50 2023-10-09T15:39:07.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.801+0000 7f003b7fe700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 0x7f00280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:07.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.802+0000 7f003b7fe700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 0x7f00280697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f002c007fd0 tx=0x7f002c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:07.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:07.806+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0034054060 con 0x7f003c15de50 2023-10-09T15:39:08.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.042+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f003c04c3c0 con 0x7f003c15de50 2023-10-09T15:39:08.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.042+0000 7f00237fe700 1 -- 172.21.15.33:0/2061613640 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4597 (secure 0 0 0) 0x7f0034057680 con 0x7f003c15de50 2023-10-09T15:39:08.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:08.042 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:08.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 msgr2=0x7f00280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 0x7f00280697d0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f002c007fd0 tx=0x7f002c007d30 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 msgr2=0x7f003c152ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f003c06eb00 tx=0x7f0034019000 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 shutdown_connections 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0028067320 0x7f00280697d0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f003c15de50 0x7f003c152ed0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f003c0cef40 0x7f003c0c9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 --2- 172.21.15.33:0/2061613640 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f003c153c30 0x7f003c0b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 >> 172.21.15.33:0/2061613640 conn(0x7f003c0703a0 msgr2=0x7f003c0c6db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 shutdown_connections 2023-10-09T15:39:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.044+0000 7f0040f2b700 1 -- 172.21.15.33:0/2061613640 wait complete. 2023-10-09T15:39:08.046 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 104 2023-10-09T15:39:08.057 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:08.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.176+0000 7fb1a900c700 1 Processor -- start 2023-10-09T15:39:08.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.176+0000 7fb1a900c700 1 -- start start 2023-10-09T15:39:08.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a900c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb1a4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a900c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415ae40 con 0x7fb1a40cb970 2023-10-09T15:39:08.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a900c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1a415ab60 con 0x7fb1a40cb5a0 2023-10-09T15:39:08.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a900c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40ce0f0 con 0x7fb1a415a5d0 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb1a40cb970 0x7fb1a4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54890/0 (socket says 172.21.15.33:54890) 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a259c700 1 -- 172.21.15.33:0/2621444058 learned_addr learned my addr 172.21.15.33:0/2621444058 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a359e700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb1a4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 947408701 0 0) 0x7fb1a415ae40 con 0x7fb1a40cb970 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb190003570 con 0x7fb1a40cb970 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1993195495 0 0) 0x7fb190003570 con 0x7fb1a40cb970 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 msgr2=0x7fb1a4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb1a4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 >> v1:172.21.15.59:6789/0 conn(0x7fb1a40cb5a0 legacy=0x7fb1a40cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.177+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a40ccf00 con 0x7fb1a40cb970 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fb18c001470 con 0x7fb1a40cb970 2023-10-09T15:39:08.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 >> v1:172.21.15.33:6789/0 conn(0x7fb1a40cb970 legacy=0x7fb1a4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb190003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb190004010 0x7fb190004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb190004d50 0x7fb1900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40ce0f0 con 0x7fb190004d50 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bbf0 con 0x7fb190004010 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb19000bdb0 con 0x7fb1a415a5d0 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb190004d50 0x7fb1900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a2d9d700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb190003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a259c700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb190004010 0x7fb190004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 -- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 msgr2=0x7fb190003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb190003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 -- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb190004010 msgr2=0x7fb190004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb190004010 0x7fb190004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 -- 172.21.15.33:0/2621444058 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb190003570 con 0x7fb190004d50 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a259c700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb190004010 0x7fb190004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a2d9d700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a415a5d0 0x7fb190003a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a359e700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb190004d50 0x7fb1900051c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fb19c006f00 tx=0x7fb19c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=871d2141f672b937 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00e710 con 0x7fb190004d50 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c00e870 con 0x7fb190004d50 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.178+0000 7fb1a1d9b700 1 -- 172.21.15.33:0/2621444058 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00ec30 con 0x7fb190004d50 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 -- 172.21.15.33:0/2621444058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb190004d50 msgr2=0x7fb1900051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 --2- 172.21.15.33:0/2621444058 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb190004d50 0x7fb1900051c0 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7fb19c006f00 tx=0x7fb19c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a359e700 1 -- 172.21.15.33:0/2621444058 reap_dead start 2023-10-09T15:39:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 -- 172.21.15.33:0/2621444058 shutdown_connections 2023-10-09T15:39:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 -- 172.21.15.33:0/2621444058 >> 172.21.15.33:0/2621444058 conn(0x7fb1a4070e30 msgr2=0x7fb1a40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 -- 172.21.15.33:0/2621444058 shutdown_connections 2023-10-09T15:39:08.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.179+0000 7fb1a900c700 1 -- 172.21.15.33:0/2621444058 wait complete. 2023-10-09T15:39:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.180+0000 7fb1a900c700 1 Processor -- start 2023-10-09T15:39:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.180+0000 7fb1a900c700 1 -- start start 2023-10-09T15:39:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a4150560 0x7fb1a4157610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a4157b50 0x7fb1a40b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40b3690 con 0x7fb1a40b4600 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a4158960 con 0x7fb1a4150560 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a900c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1a40b3c30 con 0x7fb1a4157b50 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32894/0 (socket says 172.21.15.33:32894) 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 -- 172.21.15.33:0/457209131 learned_addr learned my addr 172.21.15.33:0/457209131 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a259c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a4157b50 0x7fb1a40b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a2d9d700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a4150560 0x7fb1a4157610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 -- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a4157b50 msgr2=0x7fb1a40b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a4157b50 0x7fb1a40b40c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 -- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a4150560 msgr2=0x7fb1a4157610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a4150560 0x7fb1a4157610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.181+0000 7fb1a359e700 1 -- 172.21.15.33:0/457209131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1a4150930 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb1a359e700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00e4b0 tx=0x7fb19c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c022070 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb19c013de0 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1a41583a0 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb19c00e710 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.182+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1a40b38c0 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.183+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1a404c3c0 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.183+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb19c01c950 con 0x7fb1a40b4600 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.184+0000 7fb19affd700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 0x7fb1840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.184+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb19c000e40 con 0x7fb1a40b4600 2023-10-09T15:39:08.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.184+0000 7fb1a2d9d700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 0x7fb1840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.184+0000 7fb1a2d9d700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 0x7fb1840697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb194004290 tx=0x7fb194009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.188+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb19c0531e0 con 0x7fb1a40b4600 2023-10-09T15:39:08.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.388+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1a415f820 con 0x7fb1a40b4600 2023-10-09T15:39:08.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.389+0000 7fb19affd700 1 -- 172.21.15.33:0/457209131 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15316 (secure 0 0 0) 0x7fb19c056800 con 0x7fb1a40b4600 2023-10-09T15:39:08.389 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:08.389 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":156,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:58.625337+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:08.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 msgr2=0x7fb1840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 0x7fb1840697d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fb194004290 tx=0x7fb194009040 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 msgr2=0x7fb1a40b4a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fb19c00e4b0 tx=0x7fb19c01a000 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 shutdown_connections 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb184067320 0x7fb1840697d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb1a40b4600 0x7fb1a40b4a70 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1a4150560 0x7fb1a4157610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 --2- 172.21.15.33:0/457209131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb1a4157b50 0x7fb1a40b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 >> 172.21.15.33:0/457209131 conn(0x7fb1a4070e30 msgr2=0x7fb1a4154ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 shutdown_connections 2023-10-09T15:39:08.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.391+0000 7fb1a900c700 1 -- 172.21.15.33:0/457209131 wait complete. 2023-10-09T15:39:08.404 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 26, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:38:55.417760+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '155', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 27, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:38:55.969518+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '156', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:39:08.404 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:39:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.527+0000 7f6a5371c700 1 Processor -- start 2023-10-09T15:39:08.527 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.527+0000 7f6a5371c700 1 -- start start 2023-10-09T15:39:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a5371c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a5371c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a5371c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a4c0ccfd0 con 0x7f6a4c159530 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a5371c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a4c15a3d0 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a5371c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c15a6b0 con 0x7f6a4c06dc70 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32906/0 (socket says 172.21.15.33:32906) 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 -- 172.21.15.33:0/2871722687 learned_addr learned my addr 172.21.15.33:0/2871722687 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a50cb7700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 -- 172.21.15.33:0/2871722687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 msgr2=0x7f6a4c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 -- 172.21.15.33:0/2871722687 >> v1:172.21.15.59:6789/0 conn(0x7f6a4c159530 legacy=0x7f6a4c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 -- 172.21.15.33:0/2871722687 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a4c15a990 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a51cb9700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6a440099b0 tx=0x7f6a44009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b10a553376b9d2e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.528+0000 7f6a4bfff700 1 -- 172.21.15.33:0/2871722687 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44009ea0 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a4bfff700 1 -- 172.21.15.33:0/2871722687 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a4400b860 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a4bfff700 1 -- 172.21.15.33:0/2871722687 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a4400bc00 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 -- 172.21.15.33:0/2871722687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c06e0e0 msgr2=0x7f6a4c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f6a440099b0 tx=0x7f6a44009250 comp rx=0 tx=0).stop 2023-10-09T15:39:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 -- 172.21.15.33:0/2871722687 shutdown_connections 2023-10-09T15:39:08.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c0cb6f0 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 --2- 172.21.15.33:0/2871722687 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 -- 172.21.15.33:0/2871722687 >> 172.21.15.33:0/2871722687 conn(0x7f6a4c0703a0 msgr2=0x7f6a4c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 -- 172.21.15.33:0/2871722687 shutdown_connections 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.529+0000 7f6a5371c700 1 -- 172.21.15.33:0/2871722687 wait complete. 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.530+0000 7f6a5371c700 1 Processor -- start 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.530+0000 7f6a5371c700 1 -- start start 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.534 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c154d90 con 0x7f6a4c159530 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c84b0 con 0x7f6a4c06e0e0 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a5371c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a4c0c8940 con 0x7f6a4c06dc70 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a51cb9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a51cb9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32912/0 (socket says 172.21.15.33:32912) 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.531+0000 7f6a51cb9700 1 -- 172.21.15.33:0/4148152457 learned_addr learned my addr 172.21.15.33:0/4148152457 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a50cb7700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a514b8700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 -- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 msgr2=0x7f6a4c0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.535 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 -- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 msgr2=0x7f6a4c153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 -- 172.21.15.33:0/4148152457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a440094f0 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a50cb7700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a51cb9700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c089650 tx=0x7f6a44017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011630 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a44011790 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a44011b50 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a4c0c78a0 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.532+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a4c0c7ee0 con 0x7f6a4c159530 2023-10-09T15:39:08.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.533+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a4c0c8620 con 0x7f6a4c159530 2023-10-09T15:39:08.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.533+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6a440253f0 con 0x7f6a4c159530 2023-10-09T15:39:08.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.534+0000 7f6a497fa700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 0x7f6a380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.534+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6a44086660 con 0x7f6a4c159530 2023-10-09T15:39:08.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.534+0000 7f6a514b8700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 0x7f6a380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.534+0000 7f6a514b8700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 0x7f6a380697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007fd0 tx=0x7f6a3c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.538+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6a440533f0 con 0x7f6a4c159530 2023-10-09T15:39:08.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.730+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6a4c0c8200 con 0x7f6a4c159530 2023-10-09T15:39:08.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.730+0000 7f6a497fa700 1 -- 172.21.15.33:0/4148152457 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v156) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6a44056a10 con 0x7f6a4c159530 2023-10-09T15:39:08.731 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.732+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 msgr2=0x7f6a380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.732+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 0x7f6a380697d0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f6a3c007fd0 tx=0x7f6a3c009040 comp rx=0 tx=0).stop 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.732+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 msgr2=0x7f6a4c0b5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.732+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f6a4c089650 tx=0x7f6a44017000 comp rx=0 tx=0).stop 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 shutdown_connections 2023-10-09T15:39:08.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6a38067320 0x7f6a380697d0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6a4c159530 0x7f6a4c0b5950 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6a4c06dc70 0x7f6a4c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 --2- 172.21.15.33:0/4148152457 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6a4c06e0e0 0x7f6a4c153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 >> 172.21.15.33:0/4148152457 conn(0x7f6a4c0703a0 msgr2=0x7f6a4c0cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 shutdown_connections 2023-10-09T15:39:08.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.733+0000 7f6a5371c700 1 -- 172.21.15.33:0/4148152457 wait complete. 2023-10-09T15:39:08.745 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:39:08.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.866+0000 7fdbbb409700 1 Processor -- start 2023-10-09T15:39:08.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.867+0000 7fdbbb409700 1 -- start start 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.867+0000 7fdbbb409700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdbb40c4580 0x7fdbb40cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.867+0000 7fdbbb409700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb40c9310 con 0x7fdbb41598c0 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.867+0000 7fdbbb409700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbb40ce090 con 0x7fdbb4159c90 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.867+0000 7fdbbb409700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbb40ad990 con 0x7fdbb40c4580 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb91a5700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdbb41598c0 0x7fdbb40c3e70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54906/0 (socket says 172.21.15.33:54906) 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb91a5700 1 -- 172.21.15.33:0/2782107591 learned_addr learned my addr 172.21.15.33:0/2782107591 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb89a4700 1 --2- 172.21.15.33:0/2782107591 >> v2:172.21.15.59:3300/0 conn(0x7fdbb40c4580 0x7fdbb40cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 36705366 0 0) 0x7fdbb40c9310 con 0x7fdbb41598c0 2023-10-09T15:39:08.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdba0003570 con 0x7fdbb41598c0 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1948041048 0 0) 0x7fdbb40ce090 con 0x7fdbb4159c90 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdbb40c9310 con 0x7fdbb4159c90 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2197781247 0 0) 0x7fdba0003570 con 0x7fdbb41598c0 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 >> v2:172.21.15.59:3300/0 conn(0x7fdbb40c4580 msgr2=0x7fdbb40cd460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 --2- 172.21.15.33:0/2782107591 >> v2:172.21.15.59:3300/0 conn(0x7fdbb40c4580 0x7fdbb40cd460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 >> v1:172.21.15.59:6789/0 conn(0x7fdbb4159c90 legacy=0x7fdbb40c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40c8cc0 con 0x7fdbb41598c0 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fdbb0001470 con 0x7fdbb41598c0 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 >> v1:172.21.15.33:6789/0 conn(0x7fdbb41598c0 legacy=0x7fdbb40c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba0003bf0 0x7fdba0003fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba0004810 0x7fdba0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 0x7fdba000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40ad990 con 0x7fdba00051c0 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdba000c0b0 con 0x7fdba0004810 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdba000c270 con 0x7fdba0003bf0 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb99a6700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 0x7fdba000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb89a4700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba0004810 0x7fdba0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.868+0000 7fdbb91a5700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba0003bf0 0x7fdba0003fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 -- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba0003bf0 msgr2=0x7fdba0003fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba0003bf0 0x7fdba0003fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 -- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba0004810 msgr2=0x7fdba0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdba0004810 0x7fdba0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 -- 172.21.15.33:0/2782107591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdba0003570 con 0x7fdba00051c0 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 -- 172.21.15.33:0/2782107591 reap_dead start 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbb99a6700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 0x7fdba000ba60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdbac002120 tx=0x7fdbac0017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6726641ef6568003 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac001ab0 con 0x7fdba00051c0 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbac00c980 con 0x7fdba00051c0 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbabfff700 1 -- 172.21.15.33:0/2782107591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbac00cd00 con 0x7fdba00051c0 2023-10-09T15:39:08.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbbb409700 1 -- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 msgr2=0x7fdba000ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbbb409700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 0x7fdba000ba60 secure :-1 s=READY pgs=1398 cs=0 l=1 rev1=1 crypto rx=0x7fdbac002120 tx=0x7fdbac0017a0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbbb409700 1 -- 172.21.15.33:0/2782107591 shutdown_connections 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.869+0000 7fdbbb409700 1 --2- 172.21.15.33:0/2782107591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdba00051c0 0x7fdba000ba60 unknown :-1 s=CLOSED pgs=1398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.870+0000 7fdbbb409700 1 -- 172.21.15.33:0/2782107591 >> 172.21.15.33:0/2782107591 conn(0x7fdbb4088000 msgr2=0x7fdbb40883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.870+0000 7fdbbb409700 1 -- 172.21.15.33:0/2782107591 shutdown_connections 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.870+0000 7fdbbb409700 1 -- 172.21.15.33:0/2782107591 wait complete. 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.871+0000 7fdbbb409700 1 Processor -- start 2023-10-09T15:39:08.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.871+0000 7fdbbb409700 1 -- start start 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00051c0 0x7fdbb416a250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbb40afe50 0x7fdbb40adad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40b02c0 con 0x7fdbb40af9e0 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40b05a0 con 0x7fdbb40afe50 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbb40b0880 con 0x7fdba00051c0 2023-10-09T15:39:08.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32922/0 (socket says 172.21.15.33:32922) 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 -- 172.21.15.33:0/884734826 learned_addr learned my addr 172.21.15.33:0/884734826 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb91a5700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00051c0 0x7fdbb416a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 -- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00051c0 msgr2=0x7fdbb416a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00051c0 0x7fdbb416a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 -- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbb40afe50 msgr2=0x7fdbb40adad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb99a6700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbb40afe50 0x7fdbb40adad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbb40afe50 0x7fdbb40adad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:08.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 -- 172.21.15.33:0/884734826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbb40b0b60 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbb89a4700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009fd0 tx=0x7fdba40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400f940 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdba400faa0 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdba400fe20 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbb4166e40 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.872+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbb40ae250 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.873+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbb40b2480 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.874+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdba4014650 con 0x7fdbb40af9e0 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.874+0000 7fdba97fa700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 0x7fdb980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:08.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.874+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fdba4018030 con 0x7fdbb40af9e0 2023-10-09T15:39:08.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.874+0000 7fdbb91a5700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 0x7fdb980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:08.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.875+0000 7fdbb91a5700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 0x7fdb980697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000e10 tx=0x7fdbb0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:08.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:08.878+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdba4052370 con 0x7fdbb40af9e0 2023-10-09T15:39:09.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.071+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fdbb40ae4d0 con 0x7fdbb40af9e0 2023-10-09T15:39:09.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.072+0000 7fdba97fa700 1 -- 172.21.15.33:0/884734826 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v156) v1 ==== 104+0+11 (secure 0 0 0) 0x7fdba4055990 con 0x7fdbb40af9e0 2023-10-09T15:39:09.072 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:39:09.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 msgr2=0x7fdb980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 0x7fdb980697d0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdbb0000e10 tx=0x7fdbb0009040 comp rx=0 tx=0).stop 2023-10-09T15:39:09.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 msgr2=0x7fdbb4166900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7fdba4009fd0 tx=0x7fdba40091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.074 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 shutdown_connections 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdb98067320 0x7fdb980697d0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdbb40afe50 0x7fdbb40adad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdba00051c0 0x7fdbb416a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 --2- 172.21.15.33:0/884734826 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdbb40af9e0 0x7fdbb4166900 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 >> 172.21.15.33:0/884734826 conn(0x7fdbb4088000 msgr2=0x7fdbb4069580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 shutdown_connections 2023-10-09T15:39:09.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.074+0000 7fdbbb409700 1 -- 172.21.15.33:0/884734826 wait complete. 2023-10-09T15:39:09.086 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:39:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.208+0000 7f9a2c8e5700 1 Processor -- start 2023-10-09T15:39:09.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.208+0000 7f9a2c8e5700 1 -- start start 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a28142c00 0x7f9a2806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9a2806bd20 0x7f9a280c7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 0x7f9a280c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a280ca480 con 0x7f9a2806bd20 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a2815e240 con 0x7f9a28142fd0 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2c8e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2806b350 con 0x7f9a28142c00 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9a2806bd20 0x7f9a280c7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9a2806bd20 0x7f9a280c7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32930/0 (socket says 172.21.15.33:32930) 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 -- 172.21.15.33:0/1066334890 learned_addr learned my addr 172.21.15.33:0/1066334890 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a26d9d700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a28142c00 0x7f9a2806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 -- 172.21.15.33:0/1066334890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a28142c00 msgr2=0x7f9a2806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a28142c00 0x7f9a2806b7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 -- 172.21.15.33:0/1066334890 >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 msgr2=0x7f9a280c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2759e700 1 --2- 172.21.15.33:0/1066334890 >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 0x7f9a280c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 --2- 172.21.15.33:0/1066334890 >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 0x7f9a280c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 -- 172.21.15.33:0/1066334890 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a2815df60 con 0x7f9a2806bd20 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2759e700 1 --2- 172.21.15.33:0/1066334890 >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 0x7f9a280c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:09.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.209+0000 7f9a2659c700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2806bd20 0x7f9a280c7880 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ca8c0 tx=0x7f9a10009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78861ad5f68107bb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a25d9b700 1 -- 172.21.15.33:0/1066334890 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000b860 con 0x7f9a2806bd20 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a25d9b700 1 -- 172.21.15.33:0/1066334890 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a1000b9c0 con 0x7f9a2806bd20 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a25d9b700 1 -- 172.21.15.33:0/1066334890 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a1000bd80 con 0x7f9a2806bd20 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/1066334890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2806bd20 msgr2=0x7f9a280c7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2806bd20 0x7f9a280c7880 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f9a280ca8c0 tx=0x7f9a10009250 comp rx=0 tx=0).stop 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/1066334890 shutdown_connections 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/1066334890 >> v2:172.21.15.59:3300/0 conn(0x7f9a28142fd0 0x7f9a280c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a28142c00 0x7f9a2806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/1066334890 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a2806bd20 0x7f9a280c7880 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.213 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/1066334890 >> 172.21.15.33:0/1066334890 conn(0x7f9a280675a0 msgr2=0x7f9a280679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/1066334890 shutdown_connections 2023-10-09T15:39:09.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.210+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/1066334890 wait complete. 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.211+0000 7f9a2c8e5700 1 Processor -- start 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.211+0000 7f9a2c8e5700 1 -- start start 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a2806bd20 0x7f9a280b0e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a28142c00 0x7f9a2813bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28169d70 con 0x7f9a28142fd0 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a2816abd0 con 0x7f9a28142c00 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2c8e5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a28169fc0 con 0x7f9a2806bd20 2023-10-09T15:39:09.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32934/0 (socket says 172.21.15.33:32934) 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2759e700 1 -- 172.21.15.33:0/2802264143 learned_addr learned my addr 172.21.15.33:0/2802264143 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a26d9d700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a2806bd20 0x7f9a280b0e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2659c700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a28142c00 0x7f9a2813bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2759e700 1 -- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a2806bd20 msgr2=0x7f9a280b0e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.212+0000 7f9a2759e700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a2806bd20 0x7f9a280b0e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2759e700 1 -- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a28142c00 msgr2=0x7f9a2813bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2759e700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a28142c00 0x7f9a2813bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2759e700 1 -- 172.21.15.33:0/2802264143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100094f0 con 0x7f9a28142fd0 2023-10-09T15:39:09.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2759e700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c880 tx=0x7f9a18008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18011600 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a18011760 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a2816a2a0 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a18011b20 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.213+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a2816a860 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.214+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a280ca910 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.214+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9a18018350 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.215+0000 7f9a1effd700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 0x7f9a080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.215+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9a18084b80 con 0x7f9a28142fd0 2023-10-09T15:39:09.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.215+0000 7f9a26d9d700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 0x7f9a080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.215+0000 7f9a26d9d700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 0x7f9a080697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9a281679a0 tx=0x7f9a200077f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.219+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9a18051700 con 0x7f9a28142fd0 2023-10-09T15:39:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.413+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9a2804c3c0 con 0x7f9a28142fd0 2023-10-09T15:39:09.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.413+0000 7f9a1effd700 1 -- 172.21.15.33:0/2802264143 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v156) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9a1801e0a0 con 0x7f9a28142fd0 2023-10-09T15:39:09.413 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 msgr2=0x7f9a080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 0x7f9a080697d0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9a281679a0 tx=0x7f9a200077f0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 msgr2=0x7f9a280c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f9a1800c880 tx=0x7f9a18008040 comp rx=0 tx=0).stop 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 shutdown_connections 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9a08067320 0x7f9a080697d0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9a28142fd0 0x7f9a280c5870 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9a2806bd20 0x7f9a280b0e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 --2- 172.21.15.33:0/2802264143 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9a28142c00 0x7f9a2813bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 >> 172.21.15.33:0/2802264143 conn(0x7f9a280675a0 msgr2=0x7f9a280c1fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 shutdown_connections 2023-10-09T15:39:09.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.415+0000 7f9a2c8e5700 1 -- 172.21.15.33:0/2802264143 wait complete. 2023-10-09T15:39:09.427 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:09.549 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.547+0000 7f408d50f700 1 Processor -- start 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.547+0000 7f408d50f700 1 -- start start 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f408d50f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40880cb970 0x7f4088159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f408d50f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408815ae40 con 0x7f408815a400 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f408d50f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f408815ab60 con 0x7f40880cb5a0 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f408d50f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40880ce0f0 con 0x7f40880cb970 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40880cb970 0x7f4088159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40880cb970 0x7f4088159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32950/0 (socket says 172.21.15.33:32950) 2023-10-09T15:39:09.550 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40877fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f408815a400 0x7f4088156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:54916/0 (socket says 172.21.15.33:54916) 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 -- 172.21.15.33:0/4152648891 learned_addr learned my addr 172.21.15.33:0/4152648891 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 -- 172.21.15.33:0/4152648891 >> v1:172.21.15.59:6789/0 conn(0x7f40880cb5a0 legacy=0x7f40880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 -- 172.21.15.33:0/4152648891 >> v1:172.21.15.33:6789/0 conn(0x7f408815a400 legacy=0x7f4088156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 -- 172.21.15.33:0/4152648891 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40880ccf00 con 0x7f40880cb970 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f4085ffb700 1 -- 172.21.15.33:0/4152648891 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4172809449 0 0) 0x7f408815ae40 con 0x7f408815a400 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.548+0000 7f40867fc700 1 --2- 172.21.15.33:0/4152648891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb970 0x7f4088159ec0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f40700099b0 tx=0x7f4070009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=965bc366eb86968c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f4085ffb700 1 -- 172.21.15.33:0/4152648891 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000b820 con 0x7f40880cb970 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f4085ffb700 1 -- 172.21.15.33:0/4152648891 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f407000b980 con 0x7f40880cb970 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f4085ffb700 1 -- 172.21.15.33:0/4152648891 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f407000bd20 con 0x7f40880cb970 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 -- 172.21.15.33:0/4152648891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb970 msgr2=0x7f4088159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 --2- 172.21.15.33:0/4152648891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb970 0x7f4088159ec0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f40700099b0 tx=0x7f4070009250 comp rx=0 tx=0).stop 2023-10-09T15:39:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 -- 172.21.15.33:0/4152648891 shutdown_connections 2023-10-09T15:39:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 --2- 172.21.15.33:0/4152648891 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb970 0x7f4088159ec0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 -- 172.21.15.33:0/4152648891 >> 172.21.15.33:0/4152648891 conn(0x7f4088070e30 msgr2=0x7f40880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 -- 172.21.15.33:0/4152648891 shutdown_connections 2023-10-09T15:39:09.552 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.549+0000 7f408d50f700 1 -- 172.21.15.33:0/4152648891 wait complete. 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.550+0000 7f408d50f700 1 Processor -- start 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.550+0000 7f408d50f700 1 -- start start 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 0x7f40880b0620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408815a400 0x7f40880b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c8480 con 0x7f40880cb5a0 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c8760 con 0x7f40880cb970 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f408d50f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40880c8a40 con 0x7f408815a400 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f4086ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.555 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f4086ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32954/0 (socket says 172.21.15.33:32954) 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f4086ffd700 1 -- 172.21.15.33:0/4107755229 learned_addr learned my addr 172.21.15.33:0/4107755229 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f40867fc700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 0x7f40880b0620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.551+0000 7f40877fe700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408815a400 0x7f40880b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 -- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408815a400 msgr2=0x7f40880b0b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408815a400 0x7f40880b0b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 -- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 msgr2=0x7f40880b0620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 0x7f40880b0620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 -- 172.21.15.33:0/4107755229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40700094f0 con 0x7f40880cb5a0 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f40867fc700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 0x7f40880b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:09.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f4086ffd700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f408000bbb0 tx=0x7f4080009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40800092e0 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408000c7a0 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40880c8d20 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408000cb40 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.552+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40880c9520 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.553+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40880c9240 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.553+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4080012070 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.554+0000 7f407effd700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 0x7f40680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.554+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4080084940 con 0x7f40880cb5a0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.554+0000 7f40867fc700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 0x7f40680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.554+0000 7f40867fc700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 0x7f40680697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f40700099b0 tx=0x7f4070016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.558+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40800515d0 con 0x7f40880cb5a0 2023-10-09T15:39:09.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.798+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40880b3030 con 0x7f40880cb5a0 2023-10-09T15:39:09.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.798+0000 7f407effd700 1 -- 172.21.15.33:0/4107755229 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4597 (secure 0 0 0) 0x7f4080054bf0 con 0x7f40880cb5a0 2023-10-09T15:39:09.800 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:09.801 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.800+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 msgr2=0x7f40680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.800+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 0x7f40680697d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f40700099b0 tx=0x7f4070016000 comp rx=0 tx=0).stop 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.800+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 msgr2=0x7f4088151580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.800+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f408000bbb0 tx=0x7f4080009840 comp rx=0 tx=0).stop 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 shutdown_connections 2023-10-09T15:39:09.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4068067320 0x7f40680697d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40880cb5a0 0x7f4088151580 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f408815a400 0x7f40880b0b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 --2- 172.21.15.33:0/4107755229 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40880cb970 0x7f40880b0620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 >> 172.21.15.33:0/4107755229 conn(0x7f4088070e30 msgr2=0x7f4088155f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 shutdown_connections 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.801+0000 7f408d50f700 1 -- 172.21.15.33:0/4107755229 wait complete. 2023-10-09T15:39:09.803 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 104 2023-10-09T15:39:09.814 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:09.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.933+0000 7f0e2f11b700 1 Processor -- start 2023-10-09T15:39:09.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.933+0000 7f0e2f11b700 1 -- start start 2023-10-09T15:39:09.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2f11b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb970 0x7f0e28159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2f11b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2815a400 0x7f0e28156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2f11b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e2815ae40 con 0x7f0e280cb5a0 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2f11b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e280ce0f0 con 0x7f0e2815a400 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2f11b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280cbde0 con 0x7f0e280cb970 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2815a400 0x7f0e28156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0e2815a400 0x7f0e28156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32960/0 (socket says 172.21.15.33:32960) 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/57820517 learned_addr learned my addr 172.21.15.33:0/57820517 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e27fff700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb970 0x7f0e28159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/57820517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb970 msgr2=0x7f0e28159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb970 0x7f0e28159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/57820517 >> v1:172.21.15.59:6789/0 conn(0x7f0e280cb5a0 legacy=0x7f0e280cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.934+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/57820517 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e2815ab60 con 0x7f0e2815a400 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2d6b8700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e28156e90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0e180099e0 tx=0x7f0e18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af897a77976b4e4a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e277fe700 1 -- 172.21.15.33:0/57820517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800b820 con 0x7f0e2815a400 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e277fe700 1 -- 172.21.15.33:0/57820517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1800b980 con 0x7f0e2815a400 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e277fe700 1 -- 172.21.15.33:0/57820517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1800bd20 con 0x7f0e2815a400 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 -- 172.21.15.33:0/57820517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 msgr2=0x7f0e28156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e28156e90 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7f0e180099e0 tx=0x7f0e18009250 comp rx=0 tx=0).stop 2023-10-09T15:39:09.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 -- 172.21.15.33:0/57820517 shutdown_connections 2023-10-09T15:39:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e28156e90 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/57820517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb970 0x7f0e28159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 -- 172.21.15.33:0/57820517 >> 172.21.15.33:0/57820517 conn(0x7f0e28070e30 msgr2=0x7f0e280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 -- 172.21.15.33:0/57820517 shutdown_connections 2023-10-09T15:39:09.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.935+0000 7f0e2f11b700 1 -- 172.21.15.33:0/57820517 wait complete. 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.936+0000 7f0e2f11b700 1 Processor -- start 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 -- start start 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb5a0 0x7f0e280af6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e280cb970 0x7f0e280ca1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280afc30 con 0x7f0e2815a400 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e280b4b50 con 0x7f0e280cb970 2023-10-09T15:39:09.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2f11b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e28169d30 con 0x7f0e280cb5a0 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2d6b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2d6b8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32970/0 (socket says 172.21.15.33:32970) 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.937+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/1393914557 learned_addr learned my addr 172.21.15.33:0/1393914557 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e27fff700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e280cb970 0x7f0e280ca1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2ceb7700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb5a0 0x7f0e280af6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb5a0 msgr2=0x7f0e280af6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb5a0 0x7f0e280af6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e280cb970 msgr2=0x7f0e280ca1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:09.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e280cb970 0x7f0e280ca1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 -- 172.21.15.33:0/1393914557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e180094f0 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2d6b8700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009930 tx=0x7f0e18017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e18011e80 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e1801a630 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e280b4870 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e1801a9f0 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.938+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e2816a2b0 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.939+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e28169b90 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.940+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0e1802d440 con 0x7f0e2815a400 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.940+0000 7f0e24ff9700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 0x7f0e140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:09.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.940+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0e18086840 con 0x7f0e2815a400 2023-10-09T15:39:09.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.940+0000 7f0e2ceb7700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 0x7f0e140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:09.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.941+0000 7f0e2ceb7700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 0x7f0e140697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e20007fd0 tx=0x7f0e20001650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:09.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:09.944+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0e28169b90 con 0x7f0e2815a400 2023-10-09T15:39:10.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.138+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e28169b90 con 0x7f0e2815a400 2023-10-09T15:39:10.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.139+0000 7f0e24ff9700 1 -- 172.21.15.33:0/1393914557 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f0e28169b90 con 0x7f0e2815a400 2023-10-09T15:39:10.183 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:10.184 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":156,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:58.625337+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 msgr2=0x7f0e140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 0x7f0e140697d0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f0e20007fd0 tx=0x7f0e20001650 comp rx=0 tx=0).stop 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 msgr2=0x7f0e2815c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009930 tx=0x7f0e18017000 comp rx=0 tx=0).stop 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 shutdown_connections 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0e14067320 0x7f0e140697d0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0e2815a400 0x7f0e2815c480 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0e280cb5a0 0x7f0e280af6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 --2- 172.21.15.33:0/1393914557 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0e280cb970 0x7f0e280ca1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 >> 172.21.15.33:0/1393914557 conn(0x7f0e28070e30 msgr2=0x7f0e280b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:10.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 shutdown_connections 2023-10-09T15:39:10.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.141+0000 7f0e2f11b700 1 -- 172.21.15.33:0/1393914557 wait complete. 2023-10-09T15:39:10.187 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:39:10.188 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:10.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.309+0000 7fc4bb59e700 1 Processor -- start 2023-10-09T15:39:10.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.309+0000 7fc4bb59e700 1 -- start start 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bb59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4bc0cf110 0x7fc4bc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bb59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4bc15afd0 con 0x7fc4bc15de50 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bb59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4bc15b2b0 con 0x7fc4bc0cf110 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc15b590 con 0x7fc4bc153c30 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4bc0cf110 0x7fc4bc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4bc0cf110 0x7fc4bc15c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32986/0 (socket says 172.21.15.33:32986) 2023-10-09T15:39:10.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2132632925 learned_addr learned my addr 172.21.15.33:0/2132632925 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.310+0000 7fc4ba59c700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2132632925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 msgr2=0x7fc4bc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bad9d700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2132632925 >> v1:172.21.15.59:6789/0 conn(0x7fc4bc15de50 legacy=0x7fc4bc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2132632925 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc15b870 con 0x7fc4bc0cf110 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bad9d700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc15c070 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009f20 tx=0x7fc4b4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=735e7bfb32c347c9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4b959a700 1 -- 172.21.15.33:0/2132632925 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b400e070 con 0x7fc4bc0cf110 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4b959a700 1 -- 172.21.15.33:0/2132632925 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b400b9d0 con 0x7fc4bc0cf110 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4b959a700 1 -- 172.21.15.33:0/2132632925 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b40092e0 con 0x7fc4bc0cf110 2023-10-09T15:39:10.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2132632925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc0cf110 msgr2=0x7fc4bc15c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc15c070 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fc4b4009f20 tx=0x7fc4b4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2132632925 shutdown_connections 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc15c070 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2132632925 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2132632925 >> 172.21.15.33:0/2132632925 conn(0x7fc4bc0703a0 msgr2=0x7fc4bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.311+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2132632925 shutdown_connections 2023-10-09T15:39:10.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.312+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2132632925 wait complete. 2023-10-09T15:39:10.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 Processor -- start 2023-10-09T15:39:10.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 -- start start 2023-10-09T15:39:10.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc169670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b3ca0 con 0x7fc4bc15de50 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b41d0 con 0x7fc4bc0cf110 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bb59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0b3ef0 con 0x7fc4bc153c30 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33000/0 (socket says 172.21.15.33:33000) 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2424775071 learned_addr learned my addr 172.21.15.33:0/2424775071 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:10.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4ba59c700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.313+0000 7fc4b9d9b700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc169670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 msgr2=0x7fc4bc169670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc169670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 msgr2=0x7fc4bc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 -- 172.21.15.33:0/2424775071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b4009ae0 con 0x7fc4bc15de50 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4ba59c700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4b9d9b700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bad9d700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b610 tx=0x7fc4b4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4008c30 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b4008d90 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc0c8b60 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b4026690 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.314+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc0c9120 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.315+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc04c3c0 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.315+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc4b4003040 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.316+0000 7fc4aa7fc700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 0x7fc49c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.316+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4b4086d30 con 0x7fc4bc15de50 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.316+0000 7fc4ba59c700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 0x7fc49c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.316+0000 7fc4ba59c700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 0x7fc49c0697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d80 tx=0x7fc4ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.320+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4b40538b0 con 0x7fc4bc15de50 2023-10-09T15:39:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.556+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4bc15bb50 con 0x7fc4bc15de50 2023-10-09T15:39:10.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.557+0000 7fc4aa7fc700 1 -- 172.21.15.33:0/2424775071 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4597 (secure 0 0 0) 0x7fc4b4056ed0 con 0x7fc4bc15de50 2023-10-09T15:39:10.557 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:10.558 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:10.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 msgr2=0x7fc49c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 0x7fc49c0697d0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac009d80 tx=0x7fc4ac008040 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 msgr2=0x7fc4bc153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fc4b400b610 tx=0x7fc4b4018000 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 shutdown_connections 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc49c067320 0x7fc49c0697d0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4bc15de50 0x7fc4bc153080 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4bc0cf110 0x7fc4bc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 --2- 172.21.15.33:0/2424775071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4bc153c30 0x7fc4bc169670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 >> 172.21.15.33:0/2424775071 conn(0x7fc4bc0703a0 msgr2=0x7fc4bc0c5eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:10.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 shutdown_connections 2023-10-09T15:39:10.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.559+0000 7fc4bb59e700 1 -- 172.21.15.33:0/2424775071 wait complete. 2023-10-09T15:39:10.561 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 104 2023-10-09T15:39:10.573 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:10.692 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.692+0000 7fc8ee72c700 1 Processor -- start 2023-10-09T15:39:10.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.692+0000 7fc8ee72c700 1 -- start start 2023-10-09T15:39:10.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8ee72c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8ee72c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8e80cde50 0x7fc8e8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8ee72c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8e815ae40 con 0x7fc8e80cd9e0 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8ee72c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8e80d13f0 con 0x7fc8e80cde50 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8ee72c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e815ab60 con 0x7fc8e80cb5a0 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8eccc9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8e80cde50 0x7fc8e8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8eccc9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc8e80cde50 0x7fc8e8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41748/0 (socket says 172.21.15.33:41748) 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3168611133 learned_addr learned my addr 172.21.15.33:0/3168611133 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.693+0000 7fc8e7fff700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3168611133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 msgr2=0x7fc8e80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:10.695 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8eccc9700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3168611133 >> v1:172.21.15.59:6789/0 conn(0x7fc8e80cd9e0 legacy=0x7fc8e8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3168611133 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e80ccf00 con 0x7fc8e80cde50 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8eccc9700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80cde50 0x7fc8e8156e90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009f20 tx=0x7fc8e0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b6408191b11cecf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8e6ffd700 1 -- 172.21.15.33:0/3168611133 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e000e070 con 0x7fc8e80cde50 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8e6ffd700 1 -- 172.21.15.33:0/3168611133 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e000ba40 con 0x7fc8e80cde50 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8e6ffd700 1 -- 172.21.15.33:0/3168611133 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00092e0 con 0x7fc8e80cde50 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3168611133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80cde50 msgr2=0x7fc8e8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80cde50 0x7fc8e8156e90 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7fc8e0009f20 tx=0x7fc8e0009840 comp rx=0 tx=0).stop 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3168611133 shutdown_connections 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80cde50 0x7fc8e8156e90 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3168611133 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.694+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3168611133 >> 172.21.15.33:0/3168611133 conn(0x7fc8e8070e30 msgr2=0x7fc8e80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.695+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3168611133 shutdown_connections 2023-10-09T15:39:10.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.695+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3168611133 wait complete. 2023-10-09T15:39:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 Processor -- start 2023-10-09T15:39:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 -- start start 2023-10-09T15:39:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e81560d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e80cd9e0 0x7fc8e80c8180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e8156f40 con 0x7fc8e80c86c0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80c8b40 con 0x7fc8e80cd9e0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.696+0000 7fc8ee72c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8e80c8e20 con 0x7fc8e80cb5a0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41762/0 (socket says 172.21.15.33:41762) 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3232351722 learned_addr learned my addr 172.21.15.33:0/3232351722 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8e7fff700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e81560d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8e77fe700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e80cd9e0 0x7fc8e80c8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 msgr2=0x7fc8e81560d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e81560d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e80cd9e0 msgr2=0x7fc8e80c8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e80cd9e0 0x7fc8e80c8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 -- 172.21.15.33:0/3232351722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8e0009ae0 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8eccc9700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc8e806ea60 tx=0x7fc8e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e00032f0 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e0012d00 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e001d650 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8e80c9100 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.697+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8e8156610 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.698+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8e8156830 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.699+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc8e001da40 con 0x7fc8e80c86c0 2023-10-09T15:39:10.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.699+0000 7fc8dffff700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 0x7fc8c80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:10.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.699+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc8e0086500 con 0x7fc8e80c86c0 2023-10-09T15:39:10.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.699+0000 7fc8e7fff700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 0x7fc8c80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:10.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.700+0000 7fc8e7fff700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 0x7fc8c80697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0006fd0 tx=0x7fc8d0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:10.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.703+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc8e0053080 con 0x7fc8e80c86c0 2023-10-09T15:39:10.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.939+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc8e8156d10 con 0x7fc8e80c86c0 2023-10-09T15:39:10.940 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.940+0000 7fc8dffff700 1 -- 172.21.15.33:0/3232351722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) v1 ==== 95+0+4597 (secure 0 0 0) 0x7fc8e8156d10 con 0x7fc8e80c86c0 2023-10-09T15:39:10.940 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:10.940 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":104,"default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[{"mdsmap":{"epoch":103,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:38:57.004256+0000","modified":"2023-10-09T15:39:00.641970+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7935},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7935":{"gid":7935,"name":"b","rank":0,"incarnation":99,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/924608067","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":924608067},{"type":"v1","addr":"172.21.15.59:6834","nonce":924608067}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":13}]} 2023-10-09T15:39:10.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 msgr2=0x7fc8c80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 0x7fc8c80697d0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fc8d0006fd0 tx=0x7fc8d0008040 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 msgr2=0x7fc8e80b4740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7fc8e806ea60 tx=0x7fc8e0017000 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 shutdown_connections 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc8c8067320 0x7fc8c80697d0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc8e80c86c0 0x7fc8e80b4740 unknown :-1 s=CLOSED pgs=1410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc8e80cb5a0 0x7fc8e81560d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 --2- 172.21.15.33:0/3232351722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc8e80cd9e0 0x7fc8e80c8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 >> 172.21.15.33:0/3232351722 conn(0x7fc8e8070e30 msgr2=0x7fc8e80b0bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 shutdown_connections 2023-10-09T15:39:10.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:10.942+0000 7fc8ee72c700 1 -- 172.21.15.33:0/3232351722 wait complete. 2023-10-09T15:39:10.944 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 104 2023-10-09T15:39:10.954 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:11.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.074+0000 7f69829c0700 1 Processor -- start 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.074+0000 7f69829c0700 1 -- start start 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f69829c0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 0x7f697c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f69829c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f69829c0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f697c15ae40 con 0x7f697c0cb5a0 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f69829c0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f697c0ce0f0 con 0x7f697c0cb970 2023-10-09T15:39:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f69829c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0d13f0 con 0x7f697c15a400 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f697bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f697c0cb5a0 0x7f697c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51568/0 (socket says 172.21.15.33:51568) 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f697bfff700 1 -- 172.21.15.33:0/2165177309 learned_addr learned my addr 172.21.15.33:0/2165177309 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f6980f5d700 1 --2- 172.21.15.33:0/2165177309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f697b7fe700 1 --2- 172.21.15.33:0/2165177309 >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 0x7f697c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f697affd700 1 -- 172.21.15.33:0/2165177309 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2160536620 0 0) 0x7f697c15ae40 con 0x7f697c0cb5a0 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f697affd700 1 -- 172.21.15.33:0/2165177309 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6964003570 con 0x7f697c0cb5a0 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f6980f5d700 1 -- 172.21.15.33:0/2165177309 >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 msgr2=0x7f697c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f6980f5d700 1 --2- 172.21.15.33:0/2165177309 >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 0x7f697c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f6980f5d700 1 -- 172.21.15.33:0/2165177309 >> v1:172.21.15.33:6789/0 conn(0x7f697c0cb5a0 legacy=0x7f697c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.075+0000 7f6980f5d700 1 -- 172.21.15.33:0/2165177309 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f697c15ab60 con 0x7f697c15a400 2023-10-09T15:39:11.079 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f697b7fe700 1 --2- 172.21.15.33:0/2165177309 >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 0x7f697c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f6980f5d700 1 --2- 172.21.15.33:0/2165177309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c156e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6974009e60 tx=0x7f6974009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6085f621f3adf56f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f697affd700 1 -- 172.21.15.33:0/2165177309 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400e070 con 0x7f697c15a400 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f697affd700 1 -- 172.21.15.33:0/2165177309 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697400bab0 con 0x7f697c15a400 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f697affd700 1 -- 172.21.15.33:0/2165177309 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697400be70 con 0x7f697c15a400 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 -- 172.21.15.33:0/2165177309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 msgr2=0x7f697c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 --2- 172.21.15.33:0/2165177309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c156e90 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f6974009e60 tx=0x7f6974009780 comp rx=0 tx=0).stop 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 -- 172.21.15.33:0/2165177309 shutdown_connections 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 --2- 172.21.15.33:0/2165177309 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c156e90 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 --2- 172.21.15.33:0/2165177309 >> v2:172.21.15.59:3300/0 conn(0x7f697c0cb970 0x7f697c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 -- 172.21.15.33:0/2165177309 >> 172.21.15.33:0/2165177309 conn(0x7f697c070e30 msgr2=0x7f697c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.076+0000 7f69829c0700 1 -- 172.21.15.33:0/2165177309 shutdown_connections 2023-10-09T15:39:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.077+0000 7f69829c0700 1 -- 172.21.15.33:0/2165177309 wait complete. 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 Processor -- start 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 -- start start 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c0cb5a0 0x7f697c151e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c154d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0b4840 con 0x7f697c0cb970 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.078+0000 7f69829c0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f697c1523d0 con 0x7f697c0cb5a0 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f69829c0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f697c0b3c30 con 0x7f697c15a400 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41770/0 (socket says 172.21.15.33:41770) 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 -- 172.21.15.33:0/3575795156 learned_addr learned my addr 172.21.15.33:0/3575795156 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697bfff700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c0cb5a0 0x7f697c151e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f6980f5d700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c154d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 -- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 msgr2=0x7f697c154d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c154d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 -- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c0cb5a0 msgr2=0x7f697c151e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c0cb5a0 0x7f697c151e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 -- 172.21.15.33:0/3575795156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6970009420 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f697b7fe700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f697000ec80 tx=0x7f69700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000c920 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f697000ca80 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6974009a20 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f697000ce00 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.079+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f697c0b41f0 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.080+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f697c0b49b0 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.081+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6970013680 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.081+0000 7f6963fff700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 0x7f69680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.081+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6970085050 con 0x7f697c0cb970 2023-10-09T15:39:11.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.081+0000 7f697bfff700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 0x7f69680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.082+0000 7f697bfff700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 0x7f69680697d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f696c007fd0 tx=0x7f696c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.085+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6970051ce0 con 0x7f697c0cb970 2023-10-09T15:39:11.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.282+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f697c04c3c0 con 0x7f697c0cb970 2023-10-09T15:39:11.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.283+0000 7f6963fff700 1 -- 172.21.15.33:0/3575795156 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v156) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f6970055300 con 0x7f697c0cb970 2023-10-09T15:39:11.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:11.283 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":156,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:38:58.625337+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:38:55.417760+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"155","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":27,"pool_name":"cephfs_data","create_time":"2023-10-09T15:38:55.969518+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"156","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 msgr2=0x7f69680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 0x7f69680697d0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f696c007fd0 tx=0x7f696c009040 comp rx=0 tx=0).stop 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 msgr2=0x7f697c15d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f697000ec80 tx=0x7f69700091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 shutdown_connections 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6968067320 0x7f69680697d0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.286 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f697c15a400 0x7f697c154d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f697c0cb5a0 0x7f697c151e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 --2- 172.21.15.33:0/3575795156 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f697c0cb970 0x7f697c15d9e0 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 >> 172.21.15.33:0/3575795156 conn(0x7f697c070e30 msgr2=0x7f697c0b0620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:11.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 shutdown_connections 2023-10-09T15:39:11.287 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.285+0000 7f69829c0700 1 -- 172.21.15.33:0/3575795156 wait complete. 2023-10-09T15:39:11.298 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.418+0000 7f80a55a6700 1 Processor -- start 2023-10-09T15:39:11.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.418+0000 7f80a55a6700 1 -- start start 2023-10-09T15:39:11.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f80a55a6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80a015de50 0x7f80a00cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f80a55a6700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a00cf3c0 con 0x7f80a00cef40 2023-10-09T15:39:11.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f80a55a6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80a015afd0 con 0x7f80a0153c30 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f80a55a6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a015b2b0 con 0x7f80a015de50 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80a015de50 0x7f80a00cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80a015de50 0x7f80a00cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41786/0 (socket says 172.21.15.33:41786) 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 -- 172.21.15.33:0/39856040 learned_addr learned my addr 172.21.15.33:0/39856040 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f80a4da5700 1 --1- 172.21.15.33:0/39856040 >> v1:172.21.15.33:6789/0 conn(0x7f80a00cef40 0x7f80a015c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51584/0 (socket says 172.21.15.33:51584) 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 -- 172.21.15.33:0/39856040 >> v1:172.21.15.59:6789/0 conn(0x7f80a0153c30 legacy=0x7f80a015a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 -- 172.21.15.33:0/39856040 >> v1:172.21.15.33:6789/0 conn(0x7f80a00cef40 legacy=0x7f80a015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809effd700 1 -- 172.21.15.33:0/39856040 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305792982 0 0) 0x7f80a00cf3c0 con 0x7f80a00cef40 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 -- 172.21.15.33:0/39856040 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a015b590 con 0x7f80a015de50 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.419+0000 7f809f7fe700 1 --2- 172.21.15.33:0/39856040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a015de50 0x7f80a00cea00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f80940099b0 tx=0x7f8094009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe046bdfb080f45 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f809effd700 1 -- 172.21.15.33:0/39856040 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400b860 con 0x7f80a015de50 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f809effd700 1 -- 172.21.15.33:0/39856040 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809400b9c0 con 0x7f80a015de50 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f809effd700 1 -- 172.21.15.33:0/39856040 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809400bd60 con 0x7f80a015de50 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 -- 172.21.15.33:0/39856040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a015de50 msgr2=0x7f80a00cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 --2- 172.21.15.33:0/39856040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a015de50 0x7f80a00cea00 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7f80940099b0 tx=0x7f8094009250 comp rx=0 tx=0).stop 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 -- 172.21.15.33:0/39856040 shutdown_connections 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 --2- 172.21.15.33:0/39856040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a015de50 0x7f80a00cea00 unknown :-1 s=CLOSED pgs=1414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 -- 172.21.15.33:0/39856040 >> 172.21.15.33:0/39856040 conn(0x7f80a00703a0 msgr2=0x7f80a00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 -- 172.21.15.33:0/39856040 shutdown_connections 2023-10-09T15:39:11.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.420+0000 7f80a55a6700 1 -- 172.21.15.33:0/39856040 wait complete. 2023-10-09T15:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.421+0000 7f80a55a6700 1 Processor -- start 2023-10-09T15:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.421+0000 7f80a55a6700 1 -- start start 2023-10-09T15:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 0x7f80a00c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 0x7f80a00c5b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00ca120 con 0x7f80a00cef40 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c9510 con 0x7f80a015de50 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f80a55a6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a00c97f0 con 0x7f80a0153c30 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f809ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f809ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41790/0 (socket says 172.21.15.33:41790) 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f809ffff700 1 -- 172.21.15.33:0/2555533051 learned_addr learned my addr 172.21.15.33:0/2555533051 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.422+0000 7f809f7fe700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 0x7f80a00c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f80a4da5700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 0x7f80a00c5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 -- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 msgr2=0x7f80a00c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 0x7f80a00c5640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 -- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 msgr2=0x7f80a00c5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 0x7f80a00c5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 -- 172.21.15.33:0/2555533051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80940094f0 con 0x7f80a00cef40 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809f7fe700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 0x7f80a00c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f80a4da5700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 0x7f80a00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f809ffff700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f809000c590 tx=0x7f809000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090012630 con 0x7f80a00cef40 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8090012790 con 0x7f80a00cef40 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a00c9ad0 con 0x7f80a00cef40 2023-10-09T15:39:11.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8090012b50 con 0x7f80a00cef40 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.423+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80a0147360 con 0x7f80a00cef40 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.424+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a0147550 con 0x7f80a00cef40 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.424+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f809001b400 con 0x7f80a00cef40 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.425+0000 7f8087fff700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 0x7f808c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.425+0000 7f809f7fe700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 0x7f808c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.425+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(156..156 src has 1..156) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f80900848c0 con 0x7f80a00cef40 2023-10-09T15:39:11.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.425+0000 7f809f7fe700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 0x7f808c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f80940099b0 tx=0x7f8094017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.429+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f80a0147550 con 0x7f80a00cef40 2023-10-09T15:39:11.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.667+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f80a0147550 con 0x7f80a00cef40 2023-10-09T15:39:11.667 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:39:11.668+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:39:11.673 INFO:tasks.ceph.mds.b.smithi059.stderr: -627> 2023-10-09T15:39:03.284+0000 7fef06e83700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:39:11.674 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.673+0000 7f8087fff700 1 -- 172.21.15.33:0/2555533051 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v105) v1 ==== 161+0+0 (secure 0 0 0) 0x7f80a0147550 con 0x7f80a00cef40 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.675+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 msgr2=0x7f808c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 0x7f808c0697d0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f80940099b0 tx=0x7f8094017000 comp rx=0 tx=0).stop 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 msgr2=0x7f80a0146e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7f809000c590 tx=0x7f809000c950 comp rx=0 tx=0).stop 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 shutdown_connections 2023-10-09T15:39:11.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f808c067320 0x7f808c0697d0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80a00cef40 0x7f80a0146e20 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80a015de50 0x7f80a00c5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 --2- 172.21.15.33:0/2555533051 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80a0153c30 0x7f80a00c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 >> 172.21.15.33:0/2555533051 conn(0x7f80a00703a0 msgr2=0x7f80a00b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 shutdown_connections 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.676+0000 7f80a55a6700 1 -- 172.21.15.33:0/2555533051 wait complete. 2023-10-09T15:39:11.677 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:39:11.688 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:39:11.696 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:39:11.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.810+0000 7f8f3359e700 1 Processor -- start 2023-10-09T15:39:11.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.810+0000 7f8f3359e700 1 -- start start 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f34153a00 0x7f8f34153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3415ac50 con 0x7f8f340cea00 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f3415d010 con 0x7f8f3415de50 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f3415af60 con 0x7f8f34153a00 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f34153a00 0x7f8f34153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f32d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8f340cea00 0x7f8f340cee80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51588/0 (socket says 172.21.15.33:51588) 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f32d9d700 1 -- 172.21.15.33:0/2268835859 learned_addr learned my addr 172.21.15.33:0/2268835859 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3259c700 1 -- 172.21.15.33:0/2268835859 >> v1:172.21.15.59:6789/0 conn(0x7f8f3415de50 legacy=0x7f8f3415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3259c700 1 -- 172.21.15.33:0/2268835859 >> v1:172.21.15.33:6789/0 conn(0x7f8f340cea00 legacy=0x7f8f340cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.811+0000 7f8f3259c700 1 -- 172.21.15.33:0/2268835859 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f3415b240 con 0x7f8f34153a00 2023-10-09T15:39:11.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3259c700 1 --2- 172.21.15.33:0/2268835859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34153dd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e60 tx=0x7f8f24009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=432f48969dd14a84 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3159a700 1 -- 172.21.15.33:0/2268835859 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400e070 con 0x7f8f34153a00 2023-10-09T15:39:11.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3159a700 1 -- 172.21.15.33:0/2268835859 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400bc30 con 0x7f8f34153a00 2023-10-09T15:39:11.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3159a700 1 -- 172.21.15.33:0/2268835859 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f24012430 con 0x7f8f34153a00 2023-10-09T15:39:11.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 -- 172.21.15.33:0/2268835859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 msgr2=0x7f8f34153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2268835859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34153dd0 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e60 tx=0x7f8f24009780 comp rx=0 tx=0).stop 2023-10-09T15:39:11.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 -- 172.21.15.33:0/2268835859 shutdown_connections 2023-10-09T15:39:11.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2268835859 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34153dd0 unknown :-1 s=CLOSED pgs=1417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 -- 172.21.15.33:0/2268835859 >> 172.21.15.33:0/2268835859 conn(0x7f8f340703a0 msgr2=0x7f8f340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 -- 172.21.15.33:0/2268835859 shutdown_connections 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.812+0000 7f8f3359e700 1 -- 172.21.15.33:0/2268835859 wait complete. 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.813+0000 7f8f3359e700 1 Processor -- start 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 -- start start 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f340cea00 0x7f8f3406d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3415de50 0x7f8f34140bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34141100 con 0x7f8f34153a00 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f34154090 con 0x7f8f340cea00 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f3416d950 con 0x7f8f3415de50 2023-10-09T15:39:11.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f31d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41822/0 (socket says 172.21.15.33:41822) 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f31d9b700 1 -- 172.21.15.33:0/2009360591 learned_addr learned my addr 172.21.15.33:0/2009360591 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f3259c700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f340cea00 0x7f8f3406d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.814+0000 7f8f32d9d700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3415de50 0x7f8f34140bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 -- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3415de50 msgr2=0x7f8f34140bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3415de50 0x7f8f34140bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 -- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f340cea00 msgr2=0x7f8f3406d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f340cea00 0x7f8f3406d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 -- 172.21.15.33:0/2009360591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f24009a20 con 0x7f8f34153a00 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f31d9b700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c5c0 tx=0x7f8f1c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011590 con 0x7f8f34153a00 2023-10-09T15:39:11.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f1c011710 con 0x7f8f34153a00 2023-10-09T15:39:11.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f3416dc30 con 0x7f8f34153a00 2023-10-09T15:39:11.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f1c011ad0 con 0x7f8f34153a00 2023-10-09T15:39:11.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.815+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f3416dfc0 con 0x7f8f34153a00 2023-10-09T15:39:11.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.816+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f340b2f00 con 0x7f8f34153a00 2023-10-09T15:39:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.817+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f1c01b3b0 con 0x7f8f34153a00 2023-10-09T15:39:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.817+0000 7f8f2a7fc700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 0x7f8f140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.817+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8f1c0840d0 con 0x7f8f34153a00 2023-10-09T15:39:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.817+0000 7f8f3259c700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 0x7f8f140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:11.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.818+0000 7f8f3259c700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 0x7f8f140697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e60 tx=0x7f8f24019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:11.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:11.821+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f1c050d10 con 0x7f8f34153a00 2023-10-09T15:39:12.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.059+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f8f3404c3c0 con 0x7f8f34153a00 2023-10-09T15:39:12.673 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.673+0000 7f8f2a7fc700 1 -- 172.21.15.33:0/2009360591 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v106) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8f1c054330 con 0x7f8f34153a00 2023-10-09T15:39:12.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 msgr2=0x7f8f140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 0x7f8f140697d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009e60 tx=0x7f8f24019000 comp rx=0 tx=0).stop 2023-10-09T15:39:12.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 msgr2=0x7f8f34140680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c00c5c0 tx=0x7f8f1c00c8d0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 shutdown_connections 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f14067320 0x7f8f140697d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f3415de50 0x7f8f34140bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f340cea00 0x7f8f3406d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 --2- 172.21.15.33:0/2009360591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f34153a00 0x7f8f34140680 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 >> 172.21.15.33:0/2009360591 conn(0x7f8f340703a0 msgr2=0x7f8f340c5db0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 shutdown_connections 2023-10-09T15:39:12.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.676+0000 7f8f3359e700 1 -- 172.21.15.33:0/2009360591 wait complete. 2023-10-09T15:39:12.691 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:39:12.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.821+0000 7fb117f78700 1 Processor -- start 2023-10-09T15:39:12.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.821+0000 7fb117f78700 1 -- start start 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb117f78700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb110159530 0x7fb1100ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb117f78700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb1100cb6f0 0x7fb1100cbb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb117f78700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1100ccfd0 con 0x7fb11006dcf0 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb117f78700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1100cc040 con 0x7fb110159530 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb117f78700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb11015a410 con 0x7fb1100cb6f0 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115d14700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb110159530 0x7fb1100ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115513700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb11006dcf0 0x7fb110159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51600/0 (socket says 172.21.15.33:51600) 2023-10-09T15:39:12.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115513700 1 -- 172.21.15.33:0/481167474 learned_addr learned my addr 172.21.15.33:0/481167474 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb116515700 1 --2- 172.21.15.33:0/481167474 >> v2:172.21.15.59:3300/0 conn(0x7fb1100cb6f0 0x7fb1100cbb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115d14700 1 -- 172.21.15.33:0/481167474 >> v2:172.21.15.59:3300/0 conn(0x7fb1100cb6f0 msgr2=0x7fb1100cbb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115d14700 1 --2- 172.21.15.33:0/481167474 >> v2:172.21.15.59:3300/0 conn(0x7fb1100cb6f0 0x7fb1100cbb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115d14700 1 -- 172.21.15.33:0/481167474 >> v1:172.21.15.33:6789/0 conn(0x7fb11006dcf0 legacy=0x7fb110159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb114d12700 1 -- 172.21.15.33:0/481167474 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3601348668 0 0) 0x7fb1100ccfd0 con 0x7fb11006dcf0 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.822+0000 7fb115d14700 1 -- 172.21.15.33:0/481167474 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11015a6f0 con 0x7fb110159530 2023-10-09T15:39:12.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb115d14700 1 --2- 172.21.15.33:0/481167474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb110159530 0x7fb1100ceba0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb1100caef0 tx=0x7fb100009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2700ef6e40cb2b1a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb114d12700 1 -- 172.21.15.33:0/481167474 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10000e070 con 0x7fb110159530 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb114d12700 1 -- 172.21.15.33:0/481167474 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10000bc30 con 0x7fb110159530 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb114d12700 1 -- 172.21.15.33:0/481167474 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100012430 con 0x7fb110159530 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 -- 172.21.15.33:0/481167474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb110159530 msgr2=0x7fb1100ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 --2- 172.21.15.33:0/481167474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb110159530 0x7fb1100ceba0 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7fb1100caef0 tx=0x7fb100009780 comp rx=0 tx=0).stop 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 -- 172.21.15.33:0/481167474 shutdown_connections 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 --2- 172.21.15.33:0/481167474 >> v2:172.21.15.59:3300/0 conn(0x7fb1100cb6f0 0x7fb1100cbb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 --2- 172.21.15.33:0/481167474 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb110159530 0x7fb1100ceba0 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 -- 172.21.15.33:0/481167474 >> 172.21.15.33:0/481167474 conn(0x7fb1100703a0 msgr2=0x7fb1100707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 -- 172.21.15.33:0/481167474 shutdown_connections 2023-10-09T15:39:12.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.823+0000 7fb117f78700 1 -- 172.21.15.33:0/481167474 wait complete. 2023-10-09T15:39:12.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 Processor -- start 2023-10-09T15:39:12.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 -- start start 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1100cb6f0 0x7fb1100b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb110159530 0x7fb11016cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b1850 con 0x7fb11006dcf0 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1101533f0 con 0x7fb1100cb6f0 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb117f78700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1100b4770 con 0x7fb110159530 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb115d14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb115d14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41848/0 (socket says 172.21.15.33:41848) 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.825+0000 7fb115d14700 1 -- 172.21.15.33:0/3576606209 learned_addr learned my addr 172.21.15.33:0/3576606209 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb116515700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb110159530 0x7fb11016cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 -- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb110159530 msgr2=0x7fb11016cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb110159530 0x7fb11016cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115513700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1100cb6f0 0x7fb1100b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 -- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1100cb6f0 msgr2=0x7fb1100b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1100cb6f0 0x7fb1100b5e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 -- 172.21.15.33:0/3576606209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb100009a20 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb115d14700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb100019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb100001090 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb100012e20 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1100b0c40 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10001d860 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.826+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1100b1200 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.827+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb11004c3c0 con 0x7fb11006dcf0 2023-10-09T15:39:12.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.828+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb100024070 con 0x7fb11006dcf0 2023-10-09T15:39:12.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.828+0000 7fb10dffb700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 0x7fb0fc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:12.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.828+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5791+0+0 (secure 0 0 0) 0x7fb100087370 con 0x7fb11006dcf0 2023-10-09T15:39:12.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.828+0000 7fb115513700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 0x7fb0fc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:12.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.829+0000 7fb115513700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 0x7fb0fc0697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:12.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:12.833+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb100053fb0 con 0x7fb11006dcf0 2023-10-09T15:39:13.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.026+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb11015a9d0 con 0x7fb11006dcf0 2023-10-09T15:39:13.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.677+0000 7fb10dffb700 1 -- 172.21.15.33:0/3576606209 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v158) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb1000575d0 con 0x7fb11006dcf0 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 msgr2=0x7fb0fc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 0x7fb0fc0697d0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fb104007fd0 tx=0x7fb104009040 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 msgr2=0x7fb1100b05f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fb1000097c0 tx=0x7fb100019000 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 shutdown_connections 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0fc067320 0x7fb0fc0697d0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb11006dcf0 0x7fb1100b05f0 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb110159530 0x7fb11016cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 --2- 172.21.15.33:0/3576606209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb1100cb6f0 0x7fb1100b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 >> 172.21.15.33:0/3576606209 conn(0x7fb1100703a0 msgr2=0x7fb110155090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:13.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.680+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 shutdown_connections 2023-10-09T15:39:13.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.681+0000 7fb117f78700 1 -- 172.21.15.33:0/3576606209 wait complete. 2023-10-09T15:39:13.682 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:39:13.695 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:39:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.822+0000 7f122c990700 1 Processor -- start 2023-10-09T15:39:13.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.822+0000 7f122c990700 1 -- start start 2023-10-09T15:39:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122c990700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 0x7f12280b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122c990700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1228159800 0x7f12280b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122c990700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12280b0c80 con 0x7f12280b1d40 2023-10-09T15:39:13.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122c990700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280d10d0 con 0x7f1228159800 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122c990700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12280b0f60 con 0x7f12280b24f0 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1228159800 0x7f12280b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f12280b1d40 0x7f12281590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51612/0 (socket says 172.21.15.33:51612) 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122659c700 1 -- 172.21.15.33:0/1209310136 learned_addr learned my addr 172.21.15.33:0/1209310136 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1209310136 >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 0x7f12280b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 -- 172.21.15.33:0/1209310136 >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 msgr2=0x7f12280b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 --2- 172.21.15.33:0/1209310136 >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 0x7f12280b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 -- 172.21.15.33:0/1209310136 >> v1:172.21.15.33:6789/0 conn(0x7f12280b1d40 legacy=0x7f12281590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f1225d9b700 1 -- 172.21.15.33:0/1209310136 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2311049199 0 0) 0x7f12280b0c80 con 0x7f12280b1d40 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 -- 172.21.15.33:0/1209310136 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12280b1240 con 0x7f1228159800 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1209310136 >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 0x7f12280b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:13.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f122759e700 1 --2- 172.21.15.33:0/1209310136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1228159800 0x7f12280b4ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f12280d1230 tx=0x7f12200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9edfd997790fdacd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.823+0000 7f1225d9b700 1 -- 172.21.15.33:0/1209310136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000b6b0 con 0x7f1228159800 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f1225d9b700 1 -- 172.21.15.33:0/1209310136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f122000b810 con 0x7f1228159800 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f1225d9b700 1 -- 172.21.15.33:0/1209310136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f122000bbb0 con 0x7f1228159800 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 -- 172.21.15.33:0/1209310136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1228159800 msgr2=0x7f12280b4ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 --2- 172.21.15.33:0/1209310136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1228159800 0x7f12280b4ae0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f12280d1230 tx=0x7f12200091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 -- 172.21.15.33:0/1209310136 shutdown_connections 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 --2- 172.21.15.33:0/1209310136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1228159800 0x7f12280b4ae0 unknown :-1 s=CLOSED pgs=1423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 --2- 172.21.15.33:0/1209310136 >> v2:172.21.15.59:3300/0 conn(0x7f12280b24f0 0x7f12280b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 -- 172.21.15.33:0/1209310136 >> 172.21.15.33:0/1209310136 conn(0x7f12280703a0 msgr2=0x7f12280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 -- 172.21.15.33:0/1209310136 shutdown_connections 2023-10-09T15:39:13.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.824+0000 7f122c990700 1 -- 172.21.15.33:0/1209310136 wait complete. 2023-10-09T15:39:13.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.825+0000 7f122c990700 1 Processor -- start 2023-10-09T15:39:13.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.825+0000 7f122c990700 1 -- start start 2023-10-09T15:39:13.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 0x7f1228156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 0x7f12280cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12281697c0 con 0x7f12280b24f0 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1228169a40 con 0x7f1228159800 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122c990700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12280a8870 con 0x7f12280b1d40 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41868/0 (socket says 172.21.15.33:41868) 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122659c700 1 -- 172.21.15.33:0/1410386089 learned_addr learned my addr 172.21.15.33:0/1410386089 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f122759e700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 0x7f12280cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.826+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 0x7f1228156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 -- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 msgr2=0x7f1228156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 0x7f1228156080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 -- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 msgr2=0x7f12280cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 0x7f12280cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 -- 172.21.15.33:0/1410386089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1220009420 con 0x7f12280b24f0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 0x7f1228156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122759e700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 0x7f12280cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122659c700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f121000c5b0 tx=0x7f1210001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210005b30 con 0x7f12280b24f0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1210005c90 con 0x7f12280b24f0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12280a7fd0 con 0x7f12280b24f0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1210007300 con 0x7f12280b24f0 2023-10-09T15:39:13.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.827+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12280a8590 con 0x7f12280b24f0 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.828+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1228169bb0 con 0x7f12280b24f0 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.828+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f121001b3b0 con 0x7f12280b24f0 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.829+0000 7f121effd700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 0x7f12080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.829+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5353+0+0 (secure 0 0 0) 0x7f1210084040 con 0x7f12280b24f0 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.829+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 0x7f12080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:13.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.829+0000 7f1226d9d700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 0x7f12080697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f12180094d0 tx=0x7f121800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:13.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:13.833+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1228169bb0 con 0x7f12280b24f0 2023-10-09T15:39:14.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.027+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1228169bb0 con 0x7f12280b24f0 2023-10-09T15:39:14.676 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.676+0000 7f121effd700 1 -- 172.21.15.33:0/1410386089 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v159) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1228169bb0 con 0x7f12280b24f0 2023-10-09T15:39:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.681+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 msgr2=0x7f12080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.681+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 0x7f12080697d0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f12180094d0 tx=0x7f121800b040 comp rx=0 tx=0).stop 2023-10-09T15:39:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.681+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 msgr2=0x7f12280cf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:14.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.681+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f121000c5b0 tx=0x7f1210001070 comp rx=0 tx=0).stop 2023-10-09T15:39:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 shutdown_connections 2023-10-09T15:39:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1208067320 0x7f12080697d0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1228159800 0x7f12280cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12280b1d40 0x7f1228156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 --2- 172.21.15.33:0/1410386089 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12280b24f0 0x7f12280cf090 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 >> 172.21.15.33:0/1410386089 conn(0x7f12280703a0 msgr2=0x7f1228156c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 shutdown_connections 2023-10-09T15:39:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.682+0000 7f122c990700 1 -- 172.21.15.33:0/1410386089 wait complete. 2023-10-09T15:39:14.683 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:39:14.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:39:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.825+0000 7fef88050700 1 Processor -- start 2023-10-09T15:39:14.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.825+0000 7fef88050700 1 -- start start 2023-10-09T15:39:14.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef88050700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef80159530 0x7fef800ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef88050700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 0x7fef80159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef88050700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fef800ccfd0 con 0x7fef8006e0e0 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef88050700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fef800cf0e0 con 0x7fef80159530 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef88050700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef8015a3d0 con 0x7fef8006dc70 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef80159530 0x7fef800ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fef80159530 0x7fef800ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41874/0 (socket says 172.21.15.33:41874) 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 -- 172.21.15.33:0/1628598733 learned_addr learned my addr 172.21.15.33:0/1628598733 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef855eb700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 0x7fef80159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 -- 172.21.15.33:0/1628598733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 msgr2=0x7fef80159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 0x7fef80159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 -- 172.21.15.33:0/1628598733 >> v1:172.21.15.59:6789/0 conn(0x7fef8006e0e0 legacy=0x7fef800cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:14.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef85dec700 1 -- 172.21.15.33:0/1628598733 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef8015a6b0 con 0x7fef80159530 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.826+0000 7fef855eb700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 0x7fef80159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef85dec700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800ceba0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0099b0 tx=0x7fef7c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c64697656fee100 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef84dea700 1 -- 172.21.15.33:0/1628598733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00b820 con 0x7fef80159530 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef84dea700 1 -- 172.21.15.33:0/1628598733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef7c00b980 con 0x7fef80159530 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef84dea700 1 -- 172.21.15.33:0/1628598733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef7c00bd20 con 0x7fef80159530 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 -- 172.21.15.33:0/1628598733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 msgr2=0x7fef800ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800ceba0 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0099b0 tx=0x7fef7c009250 comp rx=0 tx=0).stop 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 -- 172.21.15.33:0/1628598733 shutdown_connections 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800ceba0 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 --2- 172.21.15.33:0/1628598733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006dc70 0x7fef80159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 -- 172.21.15.33:0/1628598733 >> 172.21.15.33:0/1628598733 conn(0x7fef800703a0 msgr2=0x7fef800707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:14.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 -- 172.21.15.33:0/1628598733 shutdown_connections 2023-10-09T15:39:14.830 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.827+0000 7fef88050700 1 -- 172.21.15.33:0/1628598733 wait complete. 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.828+0000 7fef88050700 1 Processor -- start 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.828+0000 7fef88050700 1 -- start start 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 0x7fef8016dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 0x7fef800cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b63a0 con 0x7fef80159530 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef8016e1c0 con 0x7fef8006dc70 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef88050700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fef800b5f10 con 0x7fef8006e0e0 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef865ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef865ed700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41882/0 (socket says 172.21.15.33:41882) 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.829+0000 7fef865ed700 1 -- 172.21.15.33:0/3796395722 learned_addr learned my addr 172.21.15.33:0/3796395722 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef855eb700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 0x7fef800cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef85dec700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 0x7fef8016dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 -- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 msgr2=0x7fef800cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 0x7fef800cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 -- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 msgr2=0x7fef8016dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 0x7fef8016dc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:14.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 -- 172.21.15.33:0/3796395722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef7c0094f0 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef85dec700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 0x7fef8016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef855eb700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 0x7fef800cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef865ed700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c890 tx=0x7fef780026a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78012630 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fef78012790 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef80152090 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fef78012b50 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.830+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef800b58c0 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.831+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef8004c3c0 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.831+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fef7800a420 con 0x7fef80159530 2023-10-09T15:39:14.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.832+0000 7fef75ffb700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 0x7fef640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.832+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fef78084b60 con 0x7fef80159530 2023-10-09T15:39:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.832+0000 7fef85dec700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 0x7fef640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:14.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.832+0000 7fef85dec700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 0x7fef640697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0099b0 tx=0x7fef7c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:14.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:14.836+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fef78051af0 con 0x7fef80159530 2023-10-09T15:39:15.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.032+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fef80152090 con 0x7fef80159530 2023-10-09T15:39:15.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.036+0000 7fef75ffb700 1 -- 172.21.15.33:0/3796395722 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v27) v1 ==== 104+0+0 (secure 0 0 0) 0x7fef80152090 con 0x7fef80159530 2023-10-09T15:39:15.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 msgr2=0x7fef640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 0x7fef640697d0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fef7c0099b0 tx=0x7fef7c016000 comp rx=0 tx=0).stop 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 msgr2=0x7fef800c9af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7fef7800c890 tx=0x7fef780026a0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 shutdown_connections 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fef64067320 0x7fef640697d0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fef80159530 0x7fef800c9af0 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fef8006dc70 0x7fef8016dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 --2- 172.21.15.33:0/3796395722 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fef8006e0e0 0x7fef800cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 >> 172.21.15.33:0/3796395722 conn(0x7fef800703a0 msgr2=0x7fef80153ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 shutdown_connections 2023-10-09T15:39:15.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.038+0000 7fef88050700 1 -- 172.21.15.33:0/3796395722 wait complete. 2023-10-09T15:39:15.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag' 2023-10-09T15:39:15.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.170+0000 7f6074a0e700 1 Processor -- start 2023-10-09T15:39:15.170 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.170+0000 7f6074a0e700 1 -- start start 2023-10-09T15:39:15.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f6074a0e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60700cb5a0 0x7f60700cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f6074a0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700cd9e0 0x7f6070159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f6074a0e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f607015ae40 con 0x7f60700cde50 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f6074a0e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60700d13f0 con 0x7f60700cb5a0 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f6074a0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f607015ab60 con 0x7f60700cd9e0 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.171+0000 7f606e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60700cb5a0 0x7f60700cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f60700cb5a0 0x7f60700cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41896/0 (socket says 172.21.15.33:41896) 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 -- 172.21.15.33:0/2036352800 learned_addr learned my addr 172.21.15.33:0/2036352800 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606dd9b700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700cd9e0 0x7f6070159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 -- 172.21.15.33:0/2036352800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700cd9e0 msgr2=0x7f6070159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700cd9e0 0x7f6070159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 -- 172.21.15.33:0/2036352800 >> v1:172.21.15.59:6789/0 conn(0x7f60700cde50 legacy=0x7f6070156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 -- 172.21.15.33:0/2036352800 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60700ccf00 con 0x7f60700cb5a0 2023-10-09T15:39:15.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606e59c700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cb5a0 0x7f60700cb970 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f60600099b0 tx=0x7f6060009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5bce0ddbfaa8fa5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606d59a700 1 -- 172.21.15.33:0/2036352800 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000b860 con 0x7f60700cb5a0 2023-10-09T15:39:15.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606d59a700 1 -- 172.21.15.33:0/2036352800 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f606000b9c0 con 0x7f60700cb5a0 2023-10-09T15:39:15.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.172+0000 7f606d59a700 1 -- 172.21.15.33:0/2036352800 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f606000bd60 con 0x7f60700cb5a0 2023-10-09T15:39:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 -- 172.21.15.33:0/2036352800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cb5a0 msgr2=0x7f60700cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cb5a0 0x7f60700cb970 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f60600099b0 tx=0x7f6060009250 comp rx=0 tx=0).stop 2023-10-09T15:39:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 -- 172.21.15.33:0/2036352800 shutdown_connections 2023-10-09T15:39:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cb5a0 0x7f60700cb970 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2036352800 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700cd9e0 0x7f6070159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 -- 172.21.15.33:0/2036352800 >> 172.21.15.33:0/2036352800 conn(0x7f6070070e30 msgr2=0x7f60700d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 -- 172.21.15.33:0/2036352800 shutdown_connections 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.173+0000 7f6074a0e700 1 -- 172.21.15.33:0/2036352800 wait complete. 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.174+0000 7f6074a0e700 1 Processor -- start 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.174+0000 7f6074a0e700 1 -- start start 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60700cb5a0 0x7f6070145ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700c9770 0x7f607006d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60700ca6b0 con 0x7f60700cd9e0 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6070151b10 con 0x7f60700cb5a0 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60700c9bd0 con 0x7f60700c9770 2023-10-09T15:39:15.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41904/0 (socket says 172.21.15.33:41904) 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 -- 172.21.15.33:0/2748654713 learned_addr learned my addr 172.21.15.33:0/2748654713 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 -- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700c9770 msgr2=0x7f607006d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700c9770 0x7f607006d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 -- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60700cb5a0 msgr2=0x7f6070145ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60700cb5a0 0x7f6070145ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 -- 172.21.15.33:0/2748654713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60600094f0 con 0x7f60700cd9e0 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f606dd9b700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f605800d890 tx=0x7f6058008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60580125f0 con 0x7f60700cd9e0 2023-10-09T15:39:15.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6058012750 con 0x7f60700cd9e0 2023-10-09T15:39:15.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.175+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60700b3670 con 0x7f60700cd9e0 2023-10-09T15:39:15.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.176+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6058012ad0 con 0x7f60700cd9e0 2023-10-09T15:39:15.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.176+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60700ca0f0 con 0x7f60700cd9e0 2023-10-09T15:39:15.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.176+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60701565e0 con 0x7f60700cd9e0 2023-10-09T15:39:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.177+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f605801e460 con 0x7f60700cd9e0 2023-10-09T15:39:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.177+0000 7f60667fc700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 0x7f60500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.177+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6058084ff0 con 0x7f60700cd9e0 2023-10-09T15:39:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.178+0000 7f606e59c700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 0x7f60500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.178+0000 7f606e59c700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 0x7f60500697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f60600099b0 tx=0x7f6060017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.182+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6058051f40 con 0x7f60700cd9e0 2023-10-09T15:39:15.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.462+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]} v 0) v1 -- 0x7f607004c3c0 con 0x7f60700cd9e0 2023-10-09T15:39:15.677 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.677+0000 7f60667fc700 1 -- 172.21.15.33:0/2748654713 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_fails_without_confirmation_flag"]}]=0 v415) v1 ==== 167+0+0 (secure 0 0 0) 0x7f6058055560 con 0x7f60700cd9e0 2023-10-09T15:39:15.679 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 msgr2=0x7f60500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 0x7f60500697d0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f60600099b0 tx=0x7f6060017000 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 msgr2=0x7f60700c9230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f605800d890 tx=0x7f6058008040 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 shutdown_connections 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6050067320 0x7f60500697d0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f60700c9770 0x7f607006d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f60700cb5a0 0x7f6070145ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 --2- 172.21.15.33:0/2748654713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f60700cd9e0 0x7f60700c9230 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 >> 172.21.15.33:0/2748654713 conn(0x7f6070070e30 msgr2=0x7f60700b0580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:15.680 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 shutdown_connections 2023-10-09T15:39:15.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.679+0000 7f6074a0e700 1 -- 172.21.15.33:0/2748654713 wait complete. 2023-10-09T15:39:15.692 INFO:tasks.cephfs_test_runner:That renaming volume fails without --yes-i-really-mean-it flag. ... ok 2023-10-09T15:39:15.692 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) That renaming a volume with more than one data pool does not change 2023-10-09T15:39:15.692 INFO:tasks.cephfs_test_runner:test_volume_rename_for_more_than_one_data_pool (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:39:15.692 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-09T15:39:15.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.813+0000 7fe25127c700 1 Processor -- start 2023-10-09T15:39:15.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.813+0000 7fe25127c700 1 -- start start 2023-10-09T15:39:15.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe24c0cb5a0 0x7fe24c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cd9e0 0x7fe24c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe24c0cde50 0x7fe24c15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c0d13f0 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe24c15a940 con 0x7fe24c0cde50 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe25127c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15ae40 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe24c0cb5a0 0x7fe24c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe24c0cb5a0 0x7fe24c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41912/0 (socket says 172.21.15.33:41912) 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 -- 172.21.15.33:0/323005317 learned_addr learned my addr 172.21.15.33:0/323005317 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24b7fe700 1 --2- 172.21.15.33:0/323005317 >> v2:172.21.15.59:3300/0 conn(0x7fe24c0cde50 0x7fe24c15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24a7fc700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cd9e0 0x7fe24c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 -- 172.21.15.33:0/323005317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cd9e0 msgr2=0x7fe24c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cd9e0 0x7fe24c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 -- 172.21.15.33:0/323005317 >> v2:172.21.15.59:3300/0 conn(0x7fe24c0cde50 msgr2=0x7fe24c15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 --2- 172.21.15.33:0/323005317 >> v2:172.21.15.59:3300/0 conn(0x7fe24c0cde50 0x7fe24c15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 -- 172.21.15.33:0/323005317 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe24c15ab60 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.814+0000 7fe24affd700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cb5a0 0x7fe24c0cb970 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0cbeb0 tx=0x7fe23c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b696440fac46a51b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe249ffb700 1 -- 172.21.15.33:0/323005317 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00b640 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe249ffb700 1 -- 172.21.15.33:0/323005317 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23c00b7a0 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe249ffb700 1 -- 172.21.15.33:0/323005317 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23c00bb40 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 -- 172.21.15.33:0/323005317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cb5a0 msgr2=0x7fe24c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cb5a0 0x7fe24c0cb970 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0cbeb0 tx=0x7fe23c009250 comp rx=0 tx=0).stop 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 -- 172.21.15.33:0/323005317 shutdown_connections 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 --2- 172.21.15.33:0/323005317 >> v2:172.21.15.59:3300/0 conn(0x7fe24c0cde50 0x7fe24c15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cb5a0 0x7fe24c0cb970 unknown :-1 s=CLOSED pgs=1429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 --2- 172.21.15.33:0/323005317 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cd9e0 0x7fe24c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 -- 172.21.15.33:0/323005317 >> 172.21.15.33:0/323005317 conn(0x7fe24c070e30 msgr2=0x7fe24c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 -- 172.21.15.33:0/323005317 shutdown_connections 2023-10-09T15:39:15.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.815+0000 7fe25127c700 1 -- 172.21.15.33:0/323005317 wait complete. 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.816+0000 7fe25127c700 1 Processor -- start 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 -- start start 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cb5a0 0x7fe24c141610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24c157330 0x7fe24c0c6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c15a0b0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c159010 con 0x7fe24c157330 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe25127c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe24c1592f0 con 0x7fe24c0cb5a0 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe24a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe24a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41916/0 (socket says 172.21.15.33:41916) 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.817+0000 7fe24a7fc700 1 -- 172.21.15.33:0/1765330224 learned_addr learned my addr 172.21.15.33:0/1765330224 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24b7fe700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24c157330 0x7fe24c0c6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24affd700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cb5a0 0x7fe24c141610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 -- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cb5a0 msgr2=0x7fe24c141610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cb5a0 0x7fe24c141610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 -- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24c157330 msgr2=0x7fe24c0c6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24c157330 0x7fe24c0c6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:15.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 -- 172.21.15.33:0/1765330224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe23c0094f0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe24a7fc700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe24000ec80 tx=0x7fe2400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe24000c9d0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe24000cb30 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe24c1595d0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe240013470 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.818+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe24c159b90 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.819+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe24c04c3c0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.819+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe240013820 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.820+0000 7fe232ffd700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 0x7fe2380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.820+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fe240084ce0 con 0x7fe24c0cd9e0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.820+0000 7fe24affd700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 0x7fe2380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:15.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.820+0000 7fe24affd700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 0x7fe2380697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0cbeb0 tx=0x7fe23c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:15.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:15.824+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe240051c70 con 0x7fe24c0cd9e0 2023-10-09T15:39:16.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.096+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7fe24c0ccf00 con 0x7fe24c0cd9e0 2023-10-09T15:39:16.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.678+0000 7fe232ffd700 1 -- 172.21.15.33:0/1765330224 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v416) v1 ==== 166+0+0 (secure 0 0 0) 0x7fe240055290 con 0x7fe24c0cd9e0 2023-10-09T15:39:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 msgr2=0x7fe2380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 0x7fe2380697d0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fe24c0cbeb0 tx=0x7fe23c017000 comp rx=0 tx=0).stop 2023-10-09T15:39:16.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 msgr2=0x7fe24c156df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7fe24000ec80 tx=0x7fe2400091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 shutdown_connections 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe238067320 0x7fe2380697d0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe24c157330 0x7fe24c0c6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe24c0cb5a0 0x7fe24c141610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 --2- 172.21.15.33:0/1765330224 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe24c0cd9e0 0x7fe24c156df0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 >> 172.21.15.33:0/1765330224 conn(0x7fe24c070e30 msgr2=0x7fe24c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 shutdown_connections 2023-10-09T15:39:16.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.681+0000 7fe25127c700 1 -- 172.21.15.33:0/1765330224 wait complete. 2023-10-09T15:39:16.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:39:16.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.825+0000 7f3b3e6cf700 1 Processor -- start 2023-10-09T15:39:16.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.825+0000 7f3b3e6cf700 1 -- start start 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3e6cf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b3806dc70 0x7f3b38159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3e6cf700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b380ccfd0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3e6cf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b3815a3d0 con 0x7f3b38159530 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3e6cf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b3815a6b0 con 0x7f3b3806dc70 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3cc6c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3b3806e0e0 0x7f3b380cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51622/0 (socket says 172.21.15.33:51622) 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b3cc6c700 1 -- 172.21.15.33:0/3405721308 learned_addr learned my addr 172.21.15.33:0/3405721308 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:16.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b377fe700 1 --2- 172.21.15.33:0/3405721308 >> v2:172.21.15.59:3300/0 conn(0x7f3b3806dc70 0x7f3b38159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3214601385 0 0) 0x7f3b380ccfd0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.826+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3b20003570 con 0x7f3b3806e0e0 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2032204836 0 0) 0x7f3b20003570 con 0x7f3b3806e0e0 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b377fe700 1 -- 172.21.15.33:0/3405721308 >> v1:172.21.15.59:6789/0 conn(0x7f3b38159530 legacy=0x7f3b380ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b377fe700 1 -- 172.21.15.33:0/3405721308 >> v1:172.21.15.33:6789/0 conn(0x7f3b3806e0e0 legacy=0x7f3b380cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b377fe700 1 -- 172.21.15.33:0/3405721308 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b3815a990 con 0x7f3b3806dc70 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b377fe700 1 --2- 172.21.15.33:0/3405721308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b38159900 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0098e0 tx=0x7f3b2c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8daa752f2d73582 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b300017f0 con 0x7f3b3806dc70 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c011420 con 0x7f3b3806dc70 2023-10-09T15:39:16.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b36ffd700 1 -- 172.21.15.33:0/3405721308 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c0117a0 con 0x7f3b3806dc70 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/3405721308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 msgr2=0x7f3b38159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.827+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/3405721308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b38159900 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c0098e0 tx=0x7f3b2c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.828+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/3405721308 shutdown_connections 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.828+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/3405721308 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b38159900 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.828+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/3405721308 >> 172.21.15.33:0/3405721308 conn(0x7f3b380703a0 msgr2=0x7f3b380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.828+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/3405721308 shutdown_connections 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.828+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/3405721308 wait complete. 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.829+0000 7f3b3e6cf700 1 Processor -- start 2023-10-09T15:39:16.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.829+0000 7f3b3e6cf700 1 -- start start 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b380b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b38159530 0x7f3b380b3e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380b63f0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380c7930 con 0x7f3b3806dc70 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b380c7c10 con 0x7f3b38159530 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41924/0 (socket says 172.21.15.33:41924) 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 -- 172.21.15.33:0/1714722503 learned_addr learned my addr 172.21.15.33:0/1714722503 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b37fff700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b380b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:16.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3cc6c700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b38159530 0x7f3b380b3e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 -- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b38159530 msgr2=0x7f3b380b3e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b38159530 0x7f3b380b3e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 -- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 msgr2=0x7f3b380b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b380b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 -- 172.21.15.33:0/1714722503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b2c009420 con 0x7f3b3806e0e0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b377fe700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009fd0 tx=0x7f3b2c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c01cc30 con 0x7f3b3806e0e0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b2c01cdb0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b380c7ef0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b2c01a6a0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.830+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b38152b90 con 0x7f3b3806e0e0 2023-10-09T15:39:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.831+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b380c8410 con 0x7f3b3806e0e0 2023-10-09T15:39:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.832+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b2c01aad0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.832+0000 7f3b1ffff700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 0x7f3b240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.832+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3b2c0862f0 con 0x7f3b3806e0e0 2023-10-09T15:39:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.832+0000 7f3b37fff700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 0x7f3b240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:16.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.833+0000 7f3b37fff700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 0x7f3b240697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3b28003a80 tx=0x7f3b28007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:16.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:16.837+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b380c8410 con 0x7f3b3806e0e0 2023-10-09T15:39:17.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.029+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3b380c8410 con 0x7f3b3806e0e0 2023-10-09T15:39:17.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.032+0000 7f3b1ffff700 1 -- 172.21.15.33:0/1714722503 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3b380c8410 con 0x7f3b3806e0e0 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.034+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 msgr2=0x7f3b240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.034+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 0x7f3b240697d0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3b28003a80 tx=0x7f3b28007ec0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.034+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 msgr2=0x7f3b38152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.034+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7f3b2c009fd0 tx=0x7f3b2c016000 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 shutdown_connections 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b24067320 0x7f3b240697d0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b38159530 0x7f3b380b3e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b3806dc70 0x7f3b380b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 --2- 172.21.15.33:0/1714722503 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b3806e0e0 0x7f3b38152650 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 >> 172.21.15.33:0/1714722503 conn(0x7f3b380703a0 msgr2=0x7f3b380cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 shutdown_connections 2023-10-09T15:39:17.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.035+0000 7f3b3e6cf700 1 -- 172.21.15.33:0/1714722503 wait complete. 2023-10-09T15:39:17.047 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:39:17.047 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:17.095 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:17.139 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:39:17.139 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:39:17.140 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:17.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.258+0000 7f30a7433700 1 Processor -- start 2023-10-09T15:39:17.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.258+0000 7f30a7433700 1 -- start start 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 0x7f30a00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 0x7f30a0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30a00cde50 0x7f30a015a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a00d13f0 con 0x7f30a00cde50 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30a015a940 con 0x7f30a00cd9e0 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a7433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a015ae40 con 0x7f30a00cb5a0 2023-10-09T15:39:17.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a59d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30a00cde50 0x7f30a015a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a59d0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f30a00cde50 0x7f30a015a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41928/0 (socket says 172.21.15.33:41928) 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.259+0000 7f30a59d0700 1 -- 172.21.15.33:0/3078711029 learned_addr learned my addr 172.21.15.33:0/3078711029 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a49ce700 1 --2- 172.21.15.33:0/3078711029 >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 0x7f30a0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a51cf700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 0x7f30a00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 -- 172.21.15.33:0/3078711029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 msgr2=0x7f30a00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 0x7f30a00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 -- 172.21.15.33:0/3078711029 >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 msgr2=0x7f30a0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 --2- 172.21.15.33:0/3078711029 >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 0x7f30a0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 -- 172.21.15.33:0/3078711029 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a015ab60 con 0x7f30a00cde50 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a49ce700 1 --2- 172.21.15.33:0/3078711029 >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 0x7f30a0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:17.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a51cf700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 0x7f30a00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a59d0700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cde50 0x7f30a015a400 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f30a006ea90 tx=0x7f3098009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6fb2cd18c8a4cf0c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f309ffff700 1 -- 172.21.15.33:0/3078711029 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800b820 con 0x7f30a00cde50 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f309ffff700 1 -- 172.21.15.33:0/3078711029 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f309800b980 con 0x7f30a00cde50 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f309ffff700 1 -- 172.21.15.33:0/3078711029 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f309800bd20 con 0x7f30a00cde50 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a7433700 1 -- 172.21.15.33:0/3078711029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cde50 msgr2=0x7f30a015a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.260+0000 7f30a7433700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cde50 0x7f30a015a400 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7f30a006ea90 tx=0x7f3098009250 comp rx=0 tx=0).stop 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 -- 172.21.15.33:0/3078711029 shutdown_connections 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cde50 0x7f30a015a400 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 --2- 172.21.15.33:0/3078711029 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a00cb5a0 0x7f30a00cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 --2- 172.21.15.33:0/3078711029 >> v2:172.21.15.59:3300/0 conn(0x7f30a00cd9e0 0x7f30a0159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 -- 172.21.15.33:0/3078711029 >> 172.21.15.33:0/3078711029 conn(0x7f30a0070e30 msgr2=0x7f30a00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:17.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 -- 172.21.15.33:0/3078711029 shutdown_connections 2023-10-09T15:39:17.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.261+0000 7f30a7433700 1 -- 172.21.15.33:0/3078711029 wait complete. 2023-10-09T15:39:17.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.262+0000 7f30a7433700 1 Processor -- start 2023-10-09T15:39:17.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.262+0000 7f30a7433700 1 -- start start 2023-10-09T15:39:17.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 0x7f30a0158580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 0x7f30a016cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a015e430 con 0x7f30a00cb5a0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30a00c8f60 con 0x7f30a00cd9e0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30a0158ac0 con 0x7f30a01668d0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41930/0 (socket says 172.21.15.33:41930) 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 -- 172.21.15.33:0/1457856760 learned_addr learned my addr 172.21.15.33:0/1457856760 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a49ce700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 0x7f30a0158580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a59d0700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 0x7f30a016cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 -- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 msgr2=0x7f30a016cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 0x7f30a016cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 -- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 msgr2=0x7f30a0158580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 0x7f30a0158580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 -- 172.21.15.33:0/1457856760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30980094f0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a59d0700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 0x7f30a016cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a49ce700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 0x7f30a0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a51cf700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f309000a400 tx=0x7f3090007880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090015440 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30900155a0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3090015920 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30a01595a0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.263+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30a01592c0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.264+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30a004c3c0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.265+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3090015cd0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.265+0000 7f309d7fa700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 0x7f308c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.265+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3090085120 con 0x7f30a00cb5a0 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.265+0000 7f30a49ce700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 0x7f308c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.266+0000 7f30a49ce700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 0x7f308c0697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3094008b20 tx=0x7f3094008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.270+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f309004e5a0 con 0x7f30a00cb5a0 2023-10-09T15:39:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.506+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30a00ccf00 con 0x7f30a00cb5a0 2023-10-09T15:39:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.507+0000 7f309d7fa700 1 -- 172.21.15.33:0/1457856760 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 106 v106) v1 ==== 95+0+3525 (secure 0 0 0) 0x7f3090052160 con 0x7f30a00cb5a0 2023-10-09T15:39:17.507 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:17.507 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":106,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6431,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1583036099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1583036099},{"type":"v1","addr":"172.21.15.59:6835","nonce":1583036099}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":6602,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/321431555","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":321431555},{"type":"v1","addr":"172.21.15.59:6834","nonce":321431555}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":106},{"gid":7920,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/3025452784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":3025452784},{"type":"v1","addr":"172.21.15.33:6836","nonce":3025452784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98},{"gid":7923,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/987657919","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":987657919},{"type":"v1","addr":"172.21.15.33:6837","nonce":987657919}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":98}],"filesystems":[]} 2023-10-09T15:39:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 msgr2=0x7f308c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 0x7f308c0697d0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3094008b20 tx=0x7f3094008040 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 msgr2=0x7f30a015def0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7f309000a400 tx=0x7f3090007880 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 shutdown_connections 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f308c067320 0x7f308c0697d0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f30a00cb5a0 0x7f30a015def0 unknown :-1 s=CLOSED pgs=1434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f30a01668d0 0x7f30a016cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 --2- 172.21.15.33:0/1457856760 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f30a00cd9e0 0x7f30a0158580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 >> 172.21.15.33:0/1457856760 conn(0x7f30a0070e30 msgr2=0x7f30a00c6fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 shutdown_connections 2023-10-09T15:39:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.509+0000 7f30a7433700 1 -- 172.21.15.33:0/1457856760 wait complete. 2023-10-09T15:39:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 106 2023-10-09T15:39:17.521 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:39:17.521 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:39:17.522 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:39:17.522 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:17.522 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:39:17.522 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:39:17.522 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:39:17.522 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:17.523 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:39:17.523 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:39:17.523 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:39:17.523 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:17.523 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:39:17.523 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:39:17.524 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:39:17.524 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:17.533 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:39:17.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:39:17.534 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:39:17.534 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:39:17.535 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:39:17.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:39:17.536 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:39:17.536 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:39:17.575 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:39:17.575 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:17.576 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:39:17.576 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:17.577 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:39:17.577 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:17.578 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:39:17.578 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:17.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:39:17.651 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:39:17.652 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:39:17.664 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:39:17.664 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:39:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.709+0000 7f681cc06700 1 Processor -- start 2023-10-09T15:39:17.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.709+0000 7f681cc06700 1 -- start start 2023-10-09T15:39:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f681cc06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 0x7f68180c42f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f681cc06700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6818140f40 0x7f681815b360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f681cc06700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f68180cd170 con 0x7f6818140b70 2023-10-09T15:39:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f681cc06700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f68180c9a20 con 0x7f6818140f40 2023-10-09T15:39:17.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f681cc06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f68180cd400 con 0x7f681806d370 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f68177fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6818140b70 0x7f68180c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51644/0 (socket says 172.21.15.33:51644) 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f68177fe700 1 -- 172.21.15.33:0/2428051405 learned_addr learned my addr 172.21.15.33:0/2428051405 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f6817fff700 1 --2- 172.21.15.33:0/2428051405 >> v2:172.21.15.59:3300/0 conn(0x7f6818140f40 0x7f681815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f6816ffd700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 0x7f68180c42f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f68167fc700 1 -- 172.21.15.33:0/2428051405 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 959443474 0 0) 0x7f68180cd170 con 0x7f6818140b70 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.710+0000 7f68167fc700 1 -- 172.21.15.33:0/2428051405 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6800003570 con 0x7f6818140b70 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6817fff700 1 -- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 msgr2=0x7f68180c42f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6817fff700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 0x7f68180c42f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6817fff700 1 -- 172.21.15.33:0/2428051405 >> v1:172.21.15.33:6789/0 conn(0x7f6818140b70 legacy=0x7f68180c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6817fff700 1 -- 172.21.15.33:0/2428051405 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68180cd6e0 con 0x7f6818140f40 2023-10-09T15:39:17.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6816ffd700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 0x7f68180c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:17.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f6817fff700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6818140f40 0x7f681815b360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6810009e60 tx=0x7f6810009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1c626b7411700bf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f68167fc700 1 -- 172.21.15.33:0/2428051405 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000e070 con 0x7f6818140f40 2023-10-09T15:39:17.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f68167fc700 1 -- 172.21.15.33:0/2428051405 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f681000bab0 con 0x7f6818140f40 2023-10-09T15:39:17.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.711+0000 7f68167fc700 1 -- 172.21.15.33:0/2428051405 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f681000be70 con 0x7f6818140f40 2023-10-09T15:39:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 -- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6818140f40 msgr2=0x7f681815b360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6818140f40 0x7f681815b360 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f6810009e60 tx=0x7f6810009780 comp rx=0 tx=0).stop 2023-10-09T15:39:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 -- 172.21.15.33:0/2428051405 shutdown_connections 2023-10-09T15:39:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6818140f40 0x7f681815b360 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 --2- 172.21.15.33:0/2428051405 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f681806d370 0x7f68180c42f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 -- 172.21.15.33:0/2428051405 >> 172.21.15.33:0/2428051405 conn(0x7f68180675a0 msgr2=0x7f68180679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 -- 172.21.15.33:0/2428051405 shutdown_connections 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.712+0000 7f681cc06700 1 -- 172.21.15.33:0/2428051405 wait complete. 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.713+0000 7f681cc06700 1 Processor -- start 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.713+0000 7f681cc06700 1 -- start start 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f681806d370 0x7f68180b2a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 0x7f681816ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6818168590 con 0x7f6818140b70 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6818167590 con 0x7f681806d370 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f681816b630 con 0x7f6818140f40 2023-10-09T15:39:17.717 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41968/0 (socket says 172.21.15.33:41968) 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 -- 172.21.15.33:0/1390487464 learned_addr learned my addr 172.21.15.33:0/1390487464 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6817fff700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 0x7f681816ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f68177fe700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f681806d370 0x7f68180b2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 -- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 msgr2=0x7f681816ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 0x7f681816ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 -- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f681806d370 msgr2=0x7f68180b2a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f681806d370 0x7f68180b2a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 -- 172.21.15.33:0/1390487464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f680c009420 con 0x7f6818140b70 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6817fff700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 0x7f681816ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:17.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f6816ffd700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f680c00ec80 tx=0x7f680c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c00c9d0 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f680c00cb30 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6810009a20 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f680c013470 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.714+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6818167850 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.715+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f681804c3c0 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.716+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f680c013820 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.716+0000 7f67ff7fe700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 0x7f68040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.716+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(163..163 src has 1..163) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f680c0849e0 con 0x7f6818140b70 2023-10-09T15:39:17.719 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.716+0000 7f68177fe700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 0x7f68040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.717+0000 7f68177fe700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 0x7f68040697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f68180c4310 tx=0x7f6808009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:17.720 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.720+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f680c051970 con 0x7f6818140b70 2023-10-09T15:39:17.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:17.930+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f68180b2fb0 con 0x7f6818140b70 2023-10-09T15:39:18.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.699+0000 7f67ff7fe700 1 -- 172.21.15.33:0/1390487464 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v164) v1 ==== 97+0+0 (secure 0 0 0) 0x7f680c017080 con 0x7f6818140b70 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 msgr2=0x7f68040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 0x7f68040697d0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f68180c4310 tx=0x7f6808009040 comp rx=0 tx=0).stop 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 msgr2=0x7f6818168050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f680c00ec80 tx=0x7f680c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 shutdown_connections 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6804067320 0x7f68040697d0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6818140f40 0x7f681816ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f681806d370 0x7f68180b2a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 --2- 172.21.15.33:0/1390487464 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6818140b70 0x7f6818168050 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.701+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 >> 172.21.15.33:0/1390487464 conn(0x7f68180675a0 msgr2=0x7f681813fb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:18.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.702+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 shutdown_connections 2023-10-09T15:39:18.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.702+0000 7f681cc06700 1 -- 172.21.15.33:0/1390487464 wait complete. 2023-10-09T15:39:18.703 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:39:18.716 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:39:18.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.843+0000 7f70eab99700 1 Processor -- start 2023-10-09T15:39:18.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 -- start start 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f70e40a8d00 0x7f70e40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70e40a90d0 0x7f70e406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f70e40aeee0 con 0x7f70e406e380 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e406e820 con 0x7f70e40a90d0 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70eab99700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f70e40ae680 con 0x7f70e40a8d00 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70e3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f70e40a90d0 0x7f70e406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.844+0000 7f70e9136700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f70e406e380 0x7f70e40cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51648/0 (socket says 172.21.15.33:51648) 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e9136700 1 -- 172.21.15.33:0/2505038641 learned_addr learned my addr 172.21.15.33:0/2505038641 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e8935700 1 --2- 172.21.15.33:0/2505038641 >> v2:172.21.15.59:3300/0 conn(0x7f70e40a8d00 0x7f70e40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e3fff700 1 -- 172.21.15.33:0/2505038641 >> v2:172.21.15.59:3300/0 conn(0x7f70e40a8d00 msgr2=0x7f70e40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e3fff700 1 --2- 172.21.15.33:0/2505038641 >> v2:172.21.15.59:3300/0 conn(0x7f70e40a8d00 0x7f70e40cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e3fff700 1 -- 172.21.15.33:0/2505038641 >> v1:172.21.15.33:6789/0 conn(0x7f70e406e380 legacy=0x7f70e40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e3fff700 1 -- 172.21.15.33:0/2505038641 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70e40cf490 con 0x7f70e40a90d0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e37fe700 1 -- 172.21.15.33:0/2505038641 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2164401857 0 0) 0x7f70e40aeee0 con 0x7f70e406e380 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e3fff700 1 --2- 172.21.15.33:0/2505038641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e406de40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f70d80098d0 tx=0x7f70d8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ebf1d2baf2e6119 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e37fe700 1 -- 172.21.15.33:0/2505038641 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d8009e70 con 0x7f70e40a90d0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e37fe700 1 -- 172.21.15.33:0/2505038641 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d8005c10 con 0x7f70e40a90d0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.845+0000 7f70e37fe700 1 -- 172.21.15.33:0/2505038641 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d800b610 con 0x7f70e40a90d0 2023-10-09T15:39:18.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 -- 172.21.15.33:0/2505038641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 msgr2=0x7f70e406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 --2- 172.21.15.33:0/2505038641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e406de40 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f70d80098d0 tx=0x7f70d8009120 comp rx=0 tx=0).stop 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 -- 172.21.15.33:0/2505038641 shutdown_connections 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 --2- 172.21.15.33:0/2505038641 >> v2:172.21.15.59:3300/0 conn(0x7f70e40a8d00 0x7f70e40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 --2- 172.21.15.33:0/2505038641 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e406de40 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 -- 172.21.15.33:0/2505038641 >> 172.21.15.33:0/2505038641 conn(0x7f70e406ce80 msgr2=0x7f70e40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 -- 172.21.15.33:0/2505038641 shutdown_connections 2023-10-09T15:39:18.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.846+0000 7f70eab99700 1 -- 172.21.15.33:0/2505038641 wait complete. 2023-10-09T15:39:18.850 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.847+0000 7f70eab99700 1 Processor -- start 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.847+0000 7f70eab99700 1 -- start start 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406e380 0x7f70e415a560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e40a8d00 0x7f70e4157010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e40a5280 con 0x7f70e40a90d0 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70e415aaa0 con 0x7f70e406e380 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70eab99700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70e4157550 con 0x7f70e40a8d00 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:41994/0 (socket says 172.21.15.33:41994) 2023-10-09T15:39:18.851 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 -- 172.21.15.33:0/2002748679 learned_addr learned my addr 172.21.15.33:0/2002748679 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e3fff700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e40a8d00 0x7f70e4157010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e8935700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406e380 0x7f70e415a560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 -- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e40a8d00 msgr2=0x7f70e4157010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e40a8d00 0x7f70e4157010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 -- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406e380 msgr2=0x7f70e415a560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406e380 0x7f70e415a560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 -- 172.21.15.33:0/2002748679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70d80093c0 con 0x7f70e40a90d0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e9136700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c7e0 tx=0x7f70d4007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.848+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4005b30 con 0x7f70e40a90d0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.849+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70d4005c90 con 0x7f70e40a90d0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.849+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70e4159650 con 0x7f70e40a90d0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.849+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f70d4007320 con 0x7f70e40a90d0 2023-10-09T15:39:18.852 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.849+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70e4159c10 con 0x7f70e40a90d0 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.849+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f70e4159e30 con 0x7f70e40a90d0 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.850+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f70d401b3b0 con 0x7f70e40a90d0 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.850+0000 7f70e0ff9700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.850+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f70d4083e50 con 0x7f70e40a90d0 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.850+0000 7f70e8935700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:18.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.851+0000 7f70e8935700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 0x7f70d00697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cbf70 tx=0x7f70dc007740 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:18.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:18.855+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f70d4050e30 con 0x7f70e40a90d0 2023-10-09T15:39:19.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.124+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f70e404c3c0 con 0x7f70e40a90d0 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.125+0000 7f70e0ff9700 1 -- 172.21.15.33:0/2002748679 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f70d4017020 con 0x7f70e40a90d0 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:39:19.126 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.127 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:19.128 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.129 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:39:19.130 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.131 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.132 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.133 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.134 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:39:19.135 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.136 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:19.137 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.138 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:39:19.139 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:19.140 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.141 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:19.141 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:39:19.141 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:39:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 msgr2=0x7f70d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 0x7f70d00697d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f70e40cbf70 tx=0x7f70dc007740 comp rx=0 tx=0).stop 2023-10-09T15:39:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 msgr2=0x7f70e40b3410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f70d400c7e0 tx=0x7f70d4007d90 comp rx=0 tx=0).stop 2023-10-09T15:39:19.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 shutdown_connections 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f70d0067320 0x7f70d00697d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f70e40a90d0 0x7f70e40b3410 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f70e406e380 0x7f70e415a560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 --2- 172.21.15.33:0/2002748679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f70e40a8d00 0x7f70e4157010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 >> 172.21.15.33:0/2002748679 conn(0x7f70e406ce80 msgr2=0x7f70e40682b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 shutdown_connections 2023-10-09T15:39:19.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.127+0000 7f70eab99700 1 -- 172.21.15.33:0/2002748679 wait complete. 2023-10-09T15:39:19.144 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:19.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.262+0000 7faf7aae1700 1 Processor -- start 2023-10-09T15:39:19.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.262+0000 7faf7aae1700 1 -- start start 2023-10-09T15:39:19.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7aae1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faf740b07d0 0x7faf740ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7aae1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf740b0ba0 0x7faf740c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7aae1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf7415a280 con 0x7faf740cf200 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7aae1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7406e180 con 0x7faf740b0ba0 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7aae1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf7406d850 con 0x7faf740b07d0 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf7907e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faf740b0ba0 0x7faf740c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf73fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faf740cf200 0x7faf7406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51660/0 (socket says 172.21.15.33:51660) 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.263+0000 7faf73fff700 1 -- 172.21.15.33:0/2851382411 learned_addr learned my addr 172.21.15.33:0/2851382411 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7887d700 1 --2- 172.21.15.33:0/2851382411 >> v2:172.21.15.59:3300/0 conn(0x7faf740b07d0 0x7faf740ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.267 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7907e700 1 -- 172.21.15.33:0/2851382411 >> v2:172.21.15.59:3300/0 conn(0x7faf740b07d0 msgr2=0x7faf740ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7907e700 1 --2- 172.21.15.33:0/2851382411 >> v2:172.21.15.59:3300/0 conn(0x7faf740b07d0 0x7faf740ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7907e700 1 -- 172.21.15.33:0/2851382411 >> v1:172.21.15.33:6789/0 conn(0x7faf740cf200 legacy=0x7faf7406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf737fe700 1 -- 172.21.15.33:0/2851382411 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4199851634 0 0) 0x7faf7415a280 con 0x7faf740cf200 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7907e700 1 -- 172.21.15.33:0/2851382411 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf7406db30 con 0x7faf740b0ba0 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf7907e700 1 --2- 172.21.15.33:0/2851382411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b0ba0 0x7faf740c42c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7faf74064720 tx=0x7faf5c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7865edda762f5467 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf737fe700 1 -- 172.21.15.33:0/2851382411 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011630 con 0x7faf740b0ba0 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf737fe700 1 -- 172.21.15.33:0/2851382411 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf5c011790 con 0x7faf740b0ba0 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.264+0000 7faf737fe700 1 -- 172.21.15.33:0/2851382411 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf5c011b30 con 0x7faf740b0ba0 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 -- 172.21.15.33:0/2851382411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b0ba0 msgr2=0x7faf740c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2851382411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b0ba0 0x7faf740c42c0 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7faf74064720 tx=0x7faf5c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 -- 172.21.15.33:0/2851382411 shutdown_connections 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2851382411 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b0ba0 0x7faf740c42c0 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2851382411 >> v2:172.21.15.59:3300/0 conn(0x7faf740b07d0 0x7faf740ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 -- 172.21.15.33:0/2851382411 >> 172.21.15.33:0/2851382411 conn(0x7faf7406ce80 msgr2=0x7faf740ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 -- 172.21.15.33:0/2851382411 shutdown_connections 2023-10-09T15:39:19.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.265+0000 7faf7aae1700 1 -- 172.21.15.33:0/2851382411 wait complete. 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.266+0000 7faf7aae1700 1 Processor -- start 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.266+0000 7faf7aae1700 1 -- start start 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf740b0ba0 0x7faf7416d100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf740cf200 0x7faf74143700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7409bff0 con 0x7faf740b07d0 2023-10-09T15:39:19.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf7416ade0 con 0x7faf740cf200 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf741445a0 con 0x7faf740b0ba0 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42022/0 (socket says 172.21.15.33:42022) 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 -- 172.21.15.33:0/2358129660 learned_addr learned my addr 172.21.15.33:0/2358129660 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 -- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf740b0ba0 msgr2=0x7faf7416d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf740b0ba0 0x7faf7416d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 -- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf740cf200 msgr2=0x7faf74143700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf740cf200 0x7faf74143700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 -- 172.21.15.33:0/2358129660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf5c009420 con 0x7faf740b07d0 2023-10-09T15:39:19.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7887d700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00ea00 tx=0x7faf6c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00c850 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf6c00c9b0 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf74144880 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.267+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf6c00cd30 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.268+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf7416aa70 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.268+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf7416b0c0 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.269+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faf6c013680 con 0x7faf740b07d0 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.269+0000 7faf70ff9700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 0x7faf540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.269+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7faf6c084fc0 con 0x7faf740b07d0 2023-10-09T15:39:19.275 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.269+0000 7faf73fff700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 0x7faf540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.275 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.270+0000 7faf73fff700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 0x7faf540697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7faf64001560 tx=0x7faf640016c0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.275 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.273+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faf6c051fa0 con 0x7faf740b07d0 2023-10-09T15:39:19.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.468+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faf7404c3c0 con 0x7faf740b07d0 2023-10-09T15:39:19.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.469+0000 7faf70ff9700 1 -- 172.21.15.33:0/2358129660 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v164) v1 ==== 74+0+12096 (secure 0 0 0) 0x7faf6c0555c0 con 0x7faf740b07d0 2023-10-09T15:39:19.470 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:19.470 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":164,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:18.692763+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":154,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 msgr2=0x7faf540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 0x7faf540697d0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7faf64001560 tx=0x7faf640016c0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 msgr2=0x7faf7416cbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7faf6c00ea00 tx=0x7faf6c009120 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 shutdown_connections 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faf54067320 0x7faf540697d0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faf740b07d0 0x7faf7416cbc0 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faf740cf200 0x7faf74143700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 --2- 172.21.15.33:0/2358129660 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faf740b0ba0 0x7faf7416d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 >> 172.21.15.33:0/2358129660 conn(0x7faf7406ce80 msgr2=0x7faf740ce840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 shutdown_connections 2023-10-09T15:39:19.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.471+0000 7faf7aae1700 1 -- 172.21.15.33:0/2358129660 wait complete. 2023-10-09T15:39:19.484 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:39:19.485 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:39:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.606+0000 7f0f432be700 1 Processor -- start 2023-10-09T15:39:19.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.606+0000 7f0f432be700 1 -- start start 2023-10-09T15:39:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f432be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f3c159530 0x7f0f3c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f432be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f3c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f432be700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f3c0ccfd0 con 0x7f0f3c06dc70 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f432be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cf0e0 con 0x7f0f3c159530 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f432be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15a3d0 con 0x7f0f3c06e0e0 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f40859700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f0f3c06dc70 0x7f0f3c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51666/0 (socket says 172.21.15.33:51666) 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f40859700 1 -- 172.21.15.33:0/1916738261 learned_addr learned my addr 172.21.15.33:0/1916738261 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f4185b700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f3c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3228374372 0 0) 0x7f0f3c0ccfd0 con 0x7f0f3c06dc70 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0f24003570 con 0x7f0f3c06dc70 2023-10-09T15:39:19.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f4105a700 1 --2- 172.21.15.33:0/1916738261 >> v2:172.21.15.59:3300/0 conn(0x7f0f3c159530 0x7f0f3c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4040057038 0 0) 0x7f0f24003570 con 0x7f0f3c06dc70 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 msgr2=0x7f0f3c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f3c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 >> v2:172.21.15.59:3300/0 conn(0x7f0f3c159530 msgr2=0x7f0f3c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 --2- 172.21.15.33:0/1916738261 >> v2:172.21.15.59:3300/0 conn(0x7f0f3c159530 0x7f0f3c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c15a6b0 con 0x7f0f3c06dc70 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.607+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f0f30001470 con 0x7f0f3c06dc70 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 >> v1:172.21.15.33:6789/0 conn(0x7f0f3c06dc70 legacy=0x7f0f3c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24003a60 0x7f0f24003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f24004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24004d50 0x7f0f240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0cf0e0 con 0x7f0f24003a60 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c15a3d0 con 0x7f0f24004d50 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f2400ba60 con 0x7f0f3c06e0e0 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24003a60 0x7f0f24003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f40859700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f24004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4185b700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24004d50 0x7f0f240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 -- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 msgr2=0x7f0f24004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f3c06e0e0 0x7f0f24004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 -- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24004d50 msgr2=0x7f0f240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24004d50 0x7f0f240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 -- 172.21.15.33:0/1916738261 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f24003570 con 0x7f0f24003a60 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4185b700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f24004d50 0x7f0f240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f4105a700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24003a60 0x7f0f24003e70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009c00 tx=0x7f0f340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6077a7051d0f81a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400e6b0 con 0x7f0f24003a60 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3400e810 con 0x7f0f24003a60 2023-10-09T15:39:19.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.608+0000 7f0f3bfff700 1 -- 172.21.15.33:0/1916738261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3400ebd0 con 0x7f0f24003a60 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 -- 172.21.15.33:0/1916738261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24003a60 msgr2=0x7f0f24003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 --2- 172.21.15.33:0/1916738261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f24003a60 0x7f0f24003e70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f0f34009c00 tx=0x7f0f340091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f4185b700 1 -- 172.21.15.33:0/1916738261 reap_dead start 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 -- 172.21.15.33:0/1916738261 shutdown_connections 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 -- 172.21.15.33:0/1916738261 >> 172.21.15.33:0/1916738261 conn(0x7f0f3c0703a0 msgr2=0x7f0f3c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 -- 172.21.15.33:0/1916738261 shutdown_connections 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.609+0000 7f0f432be700 1 -- 172.21.15.33:0/1916738261 wait complete. 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.610+0000 7f0f432be700 1 Processor -- start 2023-10-09T15:39:19.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.610+0000 7f0f432be700 1 -- start start 2023-10-09T15:39:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f24003a60 0x7f0f3c16ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3c0b3f10 0x7f0f3c0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b48a0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b5420 con 0x7f0f3c0b3f10 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f432be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f3c0b2000 con 0x7f0f24003a60 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42030/0 (socket says 172.21.15.33:42030) 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 -- 172.21.15.33:0/3721204256 learned_addr learned my addr 172.21.15.33:0/3721204256 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f4105a700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f24003a60 0x7f0f3c16ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f4185b700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3c0b3f10 0x7f0f3c0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 -- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f24003a60 msgr2=0x7f0f3c16ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f24003a60 0x7f0f3c16ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 -- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3c0b3f10 msgr2=0x7f0f3c0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3c0b3f10 0x7f0f3c0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.611+0000 7f0f40859700 1 -- 172.21.15.33:0/3721204256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f3c0b4af0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f40859700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f0f300073f0 tx=0x7f0f30001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3000f850 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f3000f9d0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f3c0b4dd0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f3000fd90 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.612+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f3c0b5df0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.613+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3c04c3c0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.613+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f300135c0 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.613+0000 7f0f397fa700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.613+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f0f30084550 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.614+0000 7f0f4105a700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.614+0000 7f0f4105a700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 0x7f0f280697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0b3760 tx=0x7f0f3401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.618+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f30051640 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.809+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0f3c0b5560 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.810 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.809+0000 7f0f397fa700 1 -- 172.21.15.33:0/3721204256 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v164) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0f30054c60 con 0x7f0f3c0b1b90 2023-10-09T15:39:19.811 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:39:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.811+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 msgr2=0x7f0f280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.811+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 0x7f0f280697d0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f0f3c0b3760 tx=0x7f0f3401a000 comp rx=0 tx=0).stop 2023-10-09T15:39:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.811+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 msgr2=0x7f0f3c0b58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.811+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f0f300073f0 tx=0x7f0f30001e90 comp rx=0 tx=0).stop 2023-10-09T15:39:19.813 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 shutdown_connections 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f28067320 0x7f0f280697d0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f3c0b3f10 0x7f0f3c0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f24003a60 0x7f0f3c16ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 --2- 172.21.15.33:0/3721204256 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f3c0b1b90 0x7f0f3c0b58b0 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 >> 172.21.15.33:0/3721204256 conn(0x7f0f3c0703a0 msgr2=0x7f0f3c154590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 shutdown_connections 2023-10-09T15:39:19.814 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.812+0000 7f0f432be700 1 -- 172.21.15.33:0/3721204256 wait complete. 2023-10-09T15:39:19.825 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:39:19.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.943+0000 7feea9b3c700 1 Processor -- start 2023-10-09T15:39:19.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.943+0000 7feea9b3c700 1 -- start start 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea9b3c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7feea4153c30 0x7feea415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea9b3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7feea415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea9b3c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feea415afd0 con 0x7feea415de50 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea9b3c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feea415b2b0 con 0x7feea4153c30 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea9b3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea415b590 con 0x7feea40cf110 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea3fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7feea415de50 0x7feea40cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:51674/0 (socket says 172.21.15.33:51674) 2023-10-09T15:39:19.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea3fff700 1 -- 172.21.15.33:0/2007382396 learned_addr learned my addr 172.21.15.33:0/2007382396 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea933b700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7feea415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> v2:172.21.15.59:3300/0 conn(0x7feea4153c30 0x7feea415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 550720089 0 0) 0x7feea415afd0 con 0x7feea415de50 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.944+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fee90003570 con 0x7feea415de50 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 279848630 0 0) 0x7fee90003570 con 0x7feea415de50 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 msgr2=0x7feea415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7feea415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 >> v2:172.21.15.59:3300/0 conn(0x7feea4153c30 msgr2=0x7feea415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 --2- 172.21.15.33:0/2007382396 >> v2:172.21.15.59:3300/0 conn(0x7feea4153c30 0x7feea415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea415b870 con 0x7feea415de50 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fee940017f0 con 0x7feea415de50 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 >> v1:172.21.15.33:6789/0 conn(0x7feea415de50 legacy=0x7feea40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90003a60 0x7fee90003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7fee90004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90004d50 0x7fee900051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415b2b0 con 0x7fee90003a60 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415b590 con 0x7fee90004d50 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee9000ba60 con 0x7feea40cf110 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> v2:172.21.15.59:3300/0 conn(0x7feea4153c30 0x7feea415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:19.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea3fff700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7fee90004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea933b700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90004d50 0x7fee900051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90003a60 0x7fee90003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 -- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 msgr2=0x7fee90004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7feea40cf110 0x7fee90004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 -- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90004d50 msgr2=0x7fee900051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee90004d50 0x7fee900051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.945+0000 7feea8b3a700 1 -- 172.21.15.33:0/2007382396 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee90003570 con 0x7fee90003a60 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90003a60 0x7fee90003e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009db0 tx=0x7fee8c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74021d8b9dbcac10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c009740 con 0x7fee90003a60 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee8c00e8c0 con 0x7fee90003a60 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea37fe700 1 -- 172.21.15.33:0/2007382396 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee8c00ec40 con 0x7fee90003a60 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 -- 172.21.15.33:0/2007382396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90003a60 msgr2=0x7fee90003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2007382396 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee90003a60 0x7fee90003e70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7fee8c009db0 tx=0x7fee8c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea933b700 1 -- 172.21.15.33:0/2007382396 reap_dead start 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 -- 172.21.15.33:0/2007382396 shutdown_connections 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 -- 172.21.15.33:0/2007382396 >> 172.21.15.33:0/2007382396 conn(0x7feea40703a0 msgr2=0x7feea40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 -- 172.21.15.33:0/2007382396 shutdown_connections 2023-10-09T15:39:19.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.946+0000 7feea9b3c700 1 -- 172.21.15.33:0/2007382396 wait complete. 2023-10-09T15:39:19.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.947+0000 7feea9b3c700 1 Processor -- start 2023-10-09T15:39:19.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 -- start start 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee90003a60 0x7feea414cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feea4151be0 0x7feea4152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea41525a0 con 0x7feea414fa70 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feea415fb10 con 0x7feea4151be0 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea9b3c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feea414d130 con 0x7fee90003a60 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42060/0 (socket says 172.21.15.33:42060) 2023-10-09T15:39:19.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.948+0000 7feea3fff700 1 -- 172.21.15.33:0/2617930139 learned_addr learned my addr 172.21.15.33:0/2617930139 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee90003a60 0x7feea414cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea933b700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feea4151be0 0x7feea4152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 -- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee90003a60 msgr2=0x7feea414cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee90003a60 0x7feea414cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 -- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feea4151be0 msgr2=0x7feea4152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feea4151be0 0x7feea4152060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 -- 172.21.15.33:0/2617930139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feea415ef00 con 0x7feea414fa70 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea3fff700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fee94007ac0 tx=0x7feea415a170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee9400ad00 con 0x7feea414fa70 2023-10-09T15:39:19.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee9400ae60 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feea415f1e0 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee94013600 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.949+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feea415f7a0 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.950+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feea404c3c0 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.950+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fee94013a30 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.951+0000 7feea0ff9700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 0x7fee840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.951+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fee94085330 con 0x7feea414fa70 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.951+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 0x7fee840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:19.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.951+0000 7feea8b3a700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 0x7fee840697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0091e0 tx=0x7fee8c019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:19.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:19.955+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee94052310 con 0x7feea414fa70 2023-10-09T15:39:20.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.149+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7feea415fc50 con 0x7feea414fa70 2023-10-09T15:39:20.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.149+0000 7feea0ff9700 1 -- 172.21.15.33:0/2617930139 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v164) v1 ==== 84+0+65 (secure 0 0 0) 0x7fee94055930 con 0x7feea414fa70 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:20.151 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:39:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 msgr2=0x7fee840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 0x7fee840697d0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fee8c0091e0 tx=0x7fee8c019000 comp rx=0 tx=0).stop 2023-10-09T15:39:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 msgr2=0x7feea414d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7fee94007ac0 tx=0x7feea415a170 comp rx=0 tx=0).stop 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 shutdown_connections 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee84067320 0x7fee840697d0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7feea4151be0 0x7feea4152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee90003a60 0x7feea414cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 --2- 172.21.15.33:0/2617930139 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7feea414fa70 0x7feea414d310 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 >> 172.21.15.33:0/2617930139 conn(0x7feea40703a0 msgr2=0x7feea40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 shutdown_connections 2023-10-09T15:39:20.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.152+0000 7feea9b3c700 1 -- 172.21.15.33:0/2617930139 wait complete. 2023-10-09T15:39:20.165 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:39:20.165 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:39:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.287+0000 7f4c64d2f700 1 Processor -- start 2023-10-09T15:39:20.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.287+0000 7f4c64d2f700 1 -- start start 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c64d2f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c600cd770 0x7f4c600cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c64d2f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 0x7f4c601591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c64d2f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c600cf330 con 0x7f4c600cb880 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c64d2f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600cead0 con 0x7f4c600cd770 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c64d2f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c600cdbc0 con 0x7f4c600b04f0 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c5dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c600cd770 0x7f4c600cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c5dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c600cd770 0x7f4c600cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42064/0 (socket says 172.21.15.33:42064) 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.288+0000 7f4c5dd9b700 1 -- 172.21.15.33:0/1205077515 learned_addr learned my addr 172.21.15.33:0/1205077515 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5ed9d700 1 --2- 172.21.15.33:0/1205077515 >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 0x7f4c601591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5dd9b700 1 -- 172.21.15.33:0/1205077515 >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 msgr2=0x7f4c601591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5dd9b700 1 --2- 172.21.15.33:0/1205077515 >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 0x7f4c601591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5dd9b700 1 -- 172.21.15.33:0/1205077515 >> v1:172.21.15.59:6789/0 conn(0x7f4c600cb880 legacy=0x7f4c600cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5dd9b700 1 -- 172.21.15.33:0/1205077515 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c600cddd0 con 0x7f4c600cd770 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5ed9d700 1 --2- 172.21.15.33:0/1205077515 >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 0x7f4c601591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5dd9b700 1 --2- 172.21.15.33:0/1205077515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c600cbc50 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4c600ccab0 tx=0x7f4c48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c5d001aca08943 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5d59a700 1 -- 172.21.15.33:0/1205077515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800b820 con 0x7f4c600cd770 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5d59a700 1 -- 172.21.15.33:0/1205077515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4800b980 con 0x7f4c600cd770 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c5d59a700 1 -- 172.21.15.33:0/1205077515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4800bd20 con 0x7f4c600cd770 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1205077515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 msgr2=0x7f4c600cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.289+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1205077515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c600cbc50 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f4c600ccab0 tx=0x7f4c48009250 comp rx=0 tx=0).stop 2023-10-09T15:39:20.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1205077515 shutdown_connections 2023-10-09T15:39:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1205077515 >> v2:172.21.15.59:3300/0 conn(0x7f4c600b04f0 0x7f4c601591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1205077515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c600cbc50 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1205077515 >> 172.21.15.33:0/1205077515 conn(0x7f4c600703a0 msgr2=0x7f4c600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1205077515 shutdown_connections 2023-10-09T15:39:20.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.290+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1205077515 wait complete. 2023-10-09T15:39:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 Processor -- start 2023-10-09T15:39:20.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 -- start start 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c600b04f0 0x7f4c6015b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c600cb880 0x7f4c600c9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c60158fb0 con 0x7f4c600cd770 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c6016ace0 con 0x7f4c600b04f0 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.291+0000 7f4c64d2f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c600c9ff0 con 0x7f4c600cb880 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42066/0 (socket says 172.21.15.33:42066) 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 -- 172.21.15.33:0/1031553108 learned_addr learned my addr 172.21.15.33:0/1031553108 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5e59c700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c600b04f0 0x7f4c6015b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5dd9b700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c600cb880 0x7f4c600c9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 -- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c600cb880 msgr2=0x7f4c600c9650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c600cb880 0x7f4c600c9650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 -- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c600b04f0 msgr2=0x7f4c6015b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c600b04f0 0x7f4c6015b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 -- 172.21.15.33:0/1031553108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c480094f0 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c5ed9d700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000cef0 tx=0x7f4c50007860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000ad20 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c50016420 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c60159200 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c5000aea0 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.292+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c601597c0 con 0x7f4c600cd770 2023-10-09T15:39:20.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.293+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c6004c3c0 con 0x7f4c600cd770 2023-10-09T15:39:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.294+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4c50016a70 con 0x7f4c600cd770 2023-10-09T15:39:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.294+0000 7f4c567fc700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 0x7f4c400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.294+0000 7f4c5e59c700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 0x7f4c400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.294+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4c50012070 con 0x7f4c600cd770 2023-10-09T15:39:20.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.295+0000 7f4c5e59c700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 0x7f4c400697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4c58003a30 tx=0x7f4c58007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.299+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c5004e5a0 con 0x7f4c600cd770 2023-10-09T15:39:20.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.491+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4c600ce680 con 0x7f4c600cd770 2023-10-09T15:39:20.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.706+0000 7f4c567fc700 1 -- 172.21.15.33:0/1031553108 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v165) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4c50052170 con 0x7f4c600cd770 2023-10-09T15:39:20.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 msgr2=0x7f4c400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 0x7f4c400697d0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4c58003a30 tx=0x7f4c58007ea0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 msgr2=0x7f4c60149d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f4c5000cef0 tx=0x7f4c50007860 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 shutdown_connections 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c40067320 0x7f4c400697d0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c600cd770 0x7f4c60149d90 unknown :-1 s=CLOSED pgs=1456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c600b04f0 0x7f4c6015b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 --2- 172.21.15.33:0/1031553108 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c600cb880 0x7f4c600c9650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.709+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 >> 172.21.15.33:0/1031553108 conn(0x7f4c600703a0 msgr2=0x7f4c600b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.710+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 shutdown_connections 2023-10-09T15:39:20.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.710+0000 7f4c64d2f700 1 -- 172.21.15.33:0/1031553108 wait complete. 2023-10-09T15:39:20.712 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:39:20.726 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:39:20.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.852+0000 7fe323cda700 1 Processor -- start 2023-10-09T15:39:20.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 -- start start 2023-10-09T15:39:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 0x7fe31c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe31c0cc6f0 0x7fe31c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe31c06d7b0 con 0x7fe31c069a00 2023-10-09T15:39:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c06a570 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.853+0000 7fe323cda700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe31c06f7d0 con 0x7fe31c0cc320 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe31c0cc6f0 0x7fe31c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe322277700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe31c069a00 0x7fe31c069e60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48606/0 (socket says 172.21.15.33:48606) 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe322277700 1 -- 172.21.15.33:0/2115699350 learned_addr learned my addr 172.21.15.33:0/2115699350 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321a76700 1 --2- 172.21.15.33:0/2115699350 >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 0x7fe31c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe320a74700 1 -- 172.21.15.33:0/2115699350 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1280800247 0 0) 0x7fe31c06d7b0 con 0x7fe31c069a00 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe320a74700 1 -- 172.21.15.33:0/2115699350 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe304003570 con 0x7fe31c069a00 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 -- 172.21.15.33:0/2115699350 >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 msgr2=0x7fe31c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 --2- 172.21.15.33:0/2115699350 >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 0x7fe31c13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 -- 172.21.15.33:0/2115699350 >> v1:172.21.15.33:6789/0 conn(0x7fe31c069a00 legacy=0x7fe31c069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 -- 172.21.15.33:0/2115699350 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe31c06e330 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321a76700 1 --2- 172.21.15.33:0/2115699350 >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 0x7fe31c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:20.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe321275700 1 --2- 172.21.15.33:0/2115699350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c0cc6f0 0x7fe31c13c7e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0cf510 tx=0x7fe3100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cff94da130cd395b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe320a74700 1 -- 172.21.15.33:0/2115699350 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011630 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe320a74700 1 -- 172.21.15.33:0/2115699350 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe310011790 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.854+0000 7fe320a74700 1 -- 172.21.15.33:0/2115699350 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe310011b30 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 -- 172.21.15.33:0/2115699350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c0cc6f0 msgr2=0x7fe31c13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 --2- 172.21.15.33:0/2115699350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c0cc6f0 0x7fe31c13c7e0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fe31c0cf510 tx=0x7fe3100091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 -- 172.21.15.33:0/2115699350 shutdown_connections 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 --2- 172.21.15.33:0/2115699350 >> v2:172.21.15.59:3300/0 conn(0x7fe31c0cc320 0x7fe31c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 --2- 172.21.15.33:0/2115699350 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c0cc6f0 0x7fe31c13c7e0 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 -- 172.21.15.33:0/2115699350 >> 172.21.15.33:0/2115699350 conn(0x7fe31c067f00 msgr2=0x7fe31c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 -- 172.21.15.33:0/2115699350 shutdown_connections 2023-10-09T15:39:20.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.855+0000 7fe323cda700 1 -- 172.21.15.33:0/2115699350 wait complete. 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.856+0000 7fe323cda700 1 Processor -- start 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.856+0000 7fe323cda700 1 -- start start 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c0cc320 0x7fe31c0cab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 0x7fe31c0cb050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c16b030 con 0x7fe31c069a00 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0a9ca0 con 0x7fe31c0cc320 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe323cda700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe31c0a9f80 con 0x7fe31c0cc6f0 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36218/0 (socket says 172.21.15.33:36218) 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 -- 172.21.15.33:0/1627269492 learned_addr learned my addr 172.21.15.33:0/1627269492 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321275700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c0cc320 0x7fe31c0cab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe322277700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 0x7fe31c0cb050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 -- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 msgr2=0x7fe31c0cb050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 0x7fe31c0cb050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 -- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c0cc320 msgr2=0x7fe31c0cab10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:20.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c0cc320 0x7fe31c0cab10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 -- 172.21.15.33:0/1627269492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe310009420 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe322277700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 0x7fe31c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe321a76700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00d1d0 tx=0x7fe30c009a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.857+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c00ddc0 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.858+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe30c00f040 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.858+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe30c015670 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.858+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe31c0aa260 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.858+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe31c0a98e0 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.859+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe31c04c3c0 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.859+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe30c015a60 con 0x7fe31c069a00 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.859+0000 7fe319ffb700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 0x7fe3080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:20.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.860+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 5223+0+0 (secure 0 0 0) 0x7fe30c085010 con 0x7fe31c069a00 2023-10-09T15:39:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.860+0000 7fe321275700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 0x7fe3080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:20.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.860+0000 7fe321275700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 0x7fe3080697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe3100091e0 tx=0x7fe310017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:20.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:20.864+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe30c04e5a0 con 0x7fe31c069a00 2023-10-09T15:39:21.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.058+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fe31c16b310 con 0x7fe31c069a00 2023-10-09T15:39:21.711 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.710+0000 7fe319ffb700 1 -- 172.21.15.33:0/1627269492 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v166) v1 ==== 170+0+0 (secure 0 0 0) 0x7fe30c01a0d0 con 0x7fe31c069a00 2023-10-09T15:39:21.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 msgr2=0x7fe3080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 0x7fe3080697d0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fe3100091e0 tx=0x7fe310017000 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 msgr2=0x7fe31c0ac730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fe30c00d1d0 tx=0x7fe30c009a90 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 shutdown_connections 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe308067320 0x7fe3080697d0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe31c069a00 0x7fe31c0ac730 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe31c0cc6f0 0x7fe31c0cb050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.724+0000 7fe323cda700 1 --2- 172.21.15.33:0/1627269492 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe31c0cc320 0x7fe31c0cab10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.725+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 >> 172.21.15.33:0/1627269492 conn(0x7fe31c067f00 msgr2=0x7fe31c0c4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.725+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 shutdown_connections 2023-10-09T15:39:21.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.725+0000 7fe323cda700 1 -- 172.21.15.33:0/1627269492 wait complete. 2023-10-09T15:39:21.731 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:39:21.744 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:39:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.867+0000 7f18e6304700 1 Processor -- start 2023-10-09T15:39:21.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.867+0000 7f18e6304700 1 -- start start 2023-10-09T15:39:21.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e6304700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18e0153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e6304700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e015ac50 con 0x7f18e015de50 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e6304700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18e015d010 con 0x7f18e00cea00 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e6304700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e015af60 con 0x7f18e0153a00 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e4b01700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f18e015de50 0x7f18e015a540 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48618/0 (socket says 172.21.15.33:48618) 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e4b01700 1 -- 172.21.15.33:0/1396968967 learned_addr learned my addr 172.21.15.33:0/1396968967 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18e5302700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18e0153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779767321 0 0) 0x7f18e015ac50 con 0x7f18e015de50 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.868+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f18c8003570 con 0x7f18e015de50 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3877192340 0 0) 0x7f18c8003570 con 0x7f18e015de50 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 msgr2=0x7f18e0153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:21.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18e0153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 >> v1:172.21.15.59:6789/0 conn(0x7f18e00cea00 legacy=0x7f18e00cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e015b240 con 0x7f18e015de50 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f18d4001470 con 0x7f18e015de50 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 >> v1:172.21.15.33:6789/0 conn(0x7f18e015de50 legacy=0x7f18e015a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18c8003a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c8004010 0x7f18c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c8004d50 0x7f18c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e015af60 con 0x7f18c8004d50 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18c800bbf0 con 0x7f18c8004010 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18c800bdb0 con 0x7f18e0153a00 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c8004d50 0x7f18c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e4b01700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c8004010 0x7f18c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5302700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18c8003a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 -- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 msgr2=0x7f18c8003a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18e0153a00 0x7f18c8003a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 -- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c8004010 msgr2=0x7f18c8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18c8004010 0x7f18c8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 -- 172.21.15.33:0/1396968967 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18c8003570 con 0x7f18c8004d50 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.869+0000 7f18e5b03700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c8004d50 0x7f18c80051c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f18d0001f90 tx=0x7f18d0001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a828f5d991a8170d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d0001950 con 0x7f18c8004d50 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d000c8b0 con 0x7f18c8004d50 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18dffff700 1 -- 172.21.15.33:0/1396968967 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d000cc70 con 0x7f18c8004d50 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 -- 172.21.15.33:0/1396968967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c8004d50 msgr2=0x7f18c80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 --2- 172.21.15.33:0/1396968967 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18c8004d50 0x7f18c80051c0 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f18d0001f90 tx=0x7f18d0001640 comp rx=0 tx=0).stop 2023-10-09T15:39:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e5b03700 1 -- 172.21.15.33:0/1396968967 reap_dead start 2023-10-09T15:39:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 -- 172.21.15.33:0/1396968967 shutdown_connections 2023-10-09T15:39:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 -- 172.21.15.33:0/1396968967 >> 172.21.15.33:0/1396968967 conn(0x7f18e00703a0 msgr2=0x7f18e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 -- 172.21.15.33:0/1396968967 shutdown_connections 2023-10-09T15:39:21.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.870+0000 7f18e6304700 1 -- 172.21.15.33:0/1396968967 wait complete. 2023-10-09T15:39:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.871+0000 7f18e6304700 1 Processor -- start 2023-10-09T15:39:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.871+0000 7f18e6304700 1 -- start start 2023-10-09T15:39:21.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18c8004d50 0x7f18e0152ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e00cc0e0 0x7f18e00cc580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b5f10 con 0x7f18e00c7d50 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00c8700 con 0x7f18e00cc0e0 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e6304700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18e00b32d0 con 0x7f18c8004d50 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e4b01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e4b01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36226/0 (socket says 172.21.15.33:36226) 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e4b01700 1 -- 172.21.15.33:0/2086171744 learned_addr learned my addr 172.21.15.33:0/2086171744 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e5302700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18c8004d50 0x7f18e0152ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.872+0000 7f18e5b03700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e00cc0e0 0x7f18e00cc580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 -- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18c8004d50 msgr2=0x7f18e0152ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18c8004d50 0x7f18e0152ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 -- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e00cc0e0 msgr2=0x7f18e00cc580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e00cc0e0 0x7f18e00cc580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 -- 172.21.15.33:0/2086171744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18e00b3e50 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e4b01700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000f60 tx=0x7f18d4001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d4018030 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18d400f8a0 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18e00ccac0 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18d400fc40 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.873+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18e00b3800 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.874+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18e00b3fe0 con 0x7f18e00c7d50 2023-10-09T15:39:21.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.875+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f18d401b070 con 0x7f18e00c7d50 2023-10-09T15:39:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.875+0000 7f18dd7fa700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 0x7f18cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.875+0000 7f18e5302700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 0x7f18cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.875+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f18d4019070 con 0x7f18e00c7d50 2023-10-09T15:39:21.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.876+0000 7f18e5302700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 0x7f18cc0697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006f00 tx=0x7f18d80091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:21.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:21.880+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f18d40518c0 con 0x7f18e00c7d50 2023-10-09T15:39:22.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.119+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f18e004c3c0 con 0x7f18e00c7d50 2023-10-09T15:39:22.721 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.720+0000 7f18dd7fa700 1 -- 172.21.15.33:0/2086171744 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 28 and data pool 29 v108) v1 ==== 174+0+0 (secure 0 0 0) 0x7f18d4054ee0 con 0x7f18e00c7d50 2023-10-09T15:39:22.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.725+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 msgr2=0x7f18cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.725+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 0x7f18cc0697d0 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7f18d8006f00 tx=0x7f18d80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.725+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 msgr2=0x7f18e00c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.725+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f18d4000f60 tx=0x7f18d4001e50 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 shutdown_connections 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f18cc067320 0x7f18cc0697d0 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f18e00cc0e0 0x7f18e00cc580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f18c8004d50 0x7f18e0152ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 --2- 172.21.15.33:0/2086171744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18e00c7d50 0x7f18e00c81c0 unknown :-1 s=CLOSED pgs=1462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 >> 172.21.15.33:0/2086171744 conn(0x7f18e00703a0 msgr2=0x7f18e00c54e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:22.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 shutdown_connections 2023-10-09T15:39:22.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.726+0000 7f18e6304700 1 -- 172.21.15.33:0/2086171744 wait complete. 2023-10-09T15:39:22.730 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 28 and data pool 29 2023-10-09T15:39:22.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:22.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.863+0000 7effc359e700 1 Processor -- start 2023-10-09T15:39:22.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.863+0000 7effc359e700 1 -- start start 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7effc40cec90 0x7effc40cd7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40b0970 0x7effc40c3ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effc406e560 con 0x7effc40b05a0 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7effc406e260 con 0x7effc40cec90 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc40c3240 con 0x7effc40b0970 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc1d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7effc40cec90 0x7effc40cd7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7effc40b05a0 0x7effc40c89b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48634/0 (socket says 172.21.15.33:48634) 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc259c700 1 -- 172.21.15.33:0/4098935076 learned_addr learned my addr 172.21.15.33:0/4098935076 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc2d9d700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40b0970 0x7effc40c3ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc1d9b700 1 -- 172.21.15.33:0/4098935076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40b0970 msgr2=0x7effc40c3ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc1d9b700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40b0970 0x7effc40c3ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc1d9b700 1 -- 172.21.15.33:0/4098935076 >> v1:172.21.15.33:6789/0 conn(0x7effc40b05a0 legacy=0x7effc40c89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc1d9b700 1 -- 172.21.15.33:0/4098935076 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effc40c3520 con 0x7effc40cec90 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.864+0000 7effc159a700 1 -- 172.21.15.33:0/4098935076 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2885115896 0 0) 0x7effc406e560 con 0x7effc40b05a0 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc1d9b700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40cec90 0x7effc40cd7d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7effb80098e0 tx=0x7effb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f13eee9a704dd1c1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc159a700 1 -- 172.21.15.33:0/4098935076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb8009e80 con 0x7effc40cec90 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc159a700 1 -- 172.21.15.33:0/4098935076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb800b860 con 0x7effc40cec90 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc159a700 1 -- 172.21.15.33:0/4098935076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800bbe0 con 0x7effc40cec90 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 -- 172.21.15.33:0/4098935076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40cec90 msgr2=0x7effc40cd7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40cec90 0x7effc40cd7d0 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7effb80098e0 tx=0x7effb80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 -- 172.21.15.33:0/4098935076 shutdown_connections 2023-10-09T15:39:22.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40b0970 0x7effc40c3ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 --2- 172.21.15.33:0/4098935076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40cec90 0x7effc40cd7d0 unknown :-1 s=CLOSED pgs=1464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 -- 172.21.15.33:0/4098935076 >> 172.21.15.33:0/4098935076 conn(0x7effc4088000 msgr2=0x7effc40ce370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.865+0000 7effc359e700 1 -- 172.21.15.33:0/4098935076 shutdown_connections 2023-10-09T15:39:22.869 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.866+0000 7effc359e700 1 -- 172.21.15.33:0/4098935076 wait complete. 2023-10-09T15:39:22.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 Processor -- start 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 -- start start 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc40b05a0 0x7effc4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40cec90 0x7effc40c9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc416e2e0 con 0x7effc40b0970 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effc416de50 con 0x7effc40b05a0 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effc416d520 con 0x7effc40cec90 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc1d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36240/0 (socket says 172.21.15.33:36240) 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.867+0000 7effc1d9b700 1 -- 172.21.15.33:0/3153076699 learned_addr learned my addr 172.21.15.33:0/3153076699 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:22.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc2d9d700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40cec90 0x7effc40c9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc259c700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc40b05a0 0x7effc4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 -- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40cec90 msgr2=0x7effc40c9ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40cec90 0x7effc40c9ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 -- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc40b05a0 msgr2=0x7effc4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc40b05a0 0x7effc4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 -- 172.21.15.33:0/3153076699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effb8009420 con 0x7effc40b0970 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc1d9b700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7effb8013000 tx=0x7effb8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb800bbe0 con 0x7effc40b0970 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb8011420 con 0x7effc40b0970 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effc416d800 con 0x7effc40b0970 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb80117e0 con 0x7effc40b0970 2023-10-09T15:39:22.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.868+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effc40b18b0 con 0x7effc40b0970 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.869+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effc416dfe0 con 0x7effc40b0970 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.870+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7effb8011b90 con 0x7effc40b0970 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.870+0000 7effb27fc700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 0x7effa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.870+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7effb8086660 con 0x7effc40b0970 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.870+0000 7effc259c700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 0x7effa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:22.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.870+0000 7effc259c700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 0x7effa40697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7effb4002800 tx=0x7effb4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:22.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:22.874+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7effb80533f0 con 0x7effc40b0970 2023-10-09T15:39:23.072 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.071+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7effc404c3c0 con 0x7effc40b0970 2023-10-09T15:39:23.073 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.072+0000 7effb27fc700 1 -- 172.21.15.33:0/3153076699 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v167) v1 ==== 74+0+15329 (secure 0 0 0) 0x7effb8056a10 con 0x7effc40b0970 2023-10-09T15:39:23.073 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:23.073 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":167,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:22.121536+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 msgr2=0x7effa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.075 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 0x7effa40697d0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7effb4002800 tx=0x7effb4009040 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 msgr2=0x7effc40c9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 secure :-1 s=READY pgs=1465 cs=0 l=1 rev1=1 crypto rx=0x7effb8013000 tx=0x7effb8017000 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 shutdown_connections 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7effa4067320 0x7effa40697d0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7effc40cec90 0x7effc40c9ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7effc40b05a0 0x7effc4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 --2- 172.21.15.33:0/3153076699 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7effc40b0970 0x7effc40c9ab0 unknown :-1 s=CLOSED pgs=1465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 >> 172.21.15.33:0/3153076699 conn(0x7effc4088000 msgr2=0x7effc41522e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 shutdown_connections 2023-10-09T15:39:23.076 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.074+0000 7effc359e700 1 -- 172.21.15.33:0/3153076699 wait complete. 2023-10-09T15:39:23.088 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:23.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.206+0000 7f0cfb3bf700 1 Processor -- start 2023-10-09T15:39:23.207 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.206+0000 7f0cfb3bf700 1 -- start start 2023-10-09T15:39:23.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cfb3bf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0cf40b07d0 0x7f0cf40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cfb3bf700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0cf40cf200 0x7f0cf40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cfb3bf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cf415a280 con 0x7f0cf40b0ba0 2023-10-09T15:39:23.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cfb3bf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf406e180 con 0x7f0cf40b07d0 2023-10-09T15:39:23.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cfb3bf700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cf40cd540 con 0x7f0cf40cf200 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0cf40b07d0 0x7f0cf40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0cf40b07d0 0x7f0cf40ccac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36244/0 (socket says 172.21.15.33:36244) 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 -- 172.21.15.33:0/2192909253 learned_addr learned my addr 172.21.15.33:0/2192909253 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf895a700 1 --2- 172.21.15.33:0/2192909253 >> v2:172.21.15.59:3300/0 conn(0x7f0cf40cf200 0x7f0cf40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 -- 172.21.15.33:0/2192909253 >> v2:172.21.15.59:3300/0 conn(0x7f0cf40cf200 msgr2=0x7f0cf40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 --2- 172.21.15.33:0/2192909253 >> v2:172.21.15.59:3300/0 conn(0x7f0cf40cf200 0x7f0cf40cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 -- 172.21.15.33:0/2192909253 >> v1:172.21.15.59:6789/0 conn(0x7f0cf40b0ba0 legacy=0x7f0cf406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 -- 172.21.15.33:0/2192909253 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cf406d850 con 0x7f0cf40b07d0 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf915b700 1 --2- 172.21.15.33:0/2192909253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf40ccac0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40cab40 tx=0x7f0ce4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2ddb63e685c125a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf3fff700 1 -- 172.21.15.33:0/2192909253 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce400e070 con 0x7f0cf40b07d0 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf3fff700 1 -- 172.21.15.33:0/2192909253 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce400ba80 con 0x7f0cf40b07d0 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.207+0000 7f0cf3fff700 1 -- 172.21.15.33:0/2192909253 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40092e0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2192909253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 msgr2=0x7f0cf40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2192909253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf40ccac0 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f0cf40cab40 tx=0x7f0ce4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2192909253 shutdown_connections 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2192909253 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf40ccac0 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2192909253 >> v2:172.21.15.59:3300/0 conn(0x7f0cf40cf200 0x7f0cf40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2192909253 >> 172.21.15.33:0/2192909253 conn(0x7f0cf406ce80 msgr2=0x7f0cf40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:23.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2192909253 shutdown_connections 2023-10-09T15:39:23.212 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.208+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2192909253 wait complete. 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.209+0000 7f0cfb3bf700 1 Processor -- start 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.209+0000 7f0cfb3bf700 1 -- start start 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf40b0ba0 0x7f0cf416a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 0x7f0cf40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c7af0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c6ee0 con 0x7f0cf40cf200 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cfb3bf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cf40c71c0 con 0x7f0cf40b0ba0 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36254/0 (socket says 172.21.15.33:36254) 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 -- 172.21.15.33:0/2938396252 learned_addr learned my addr 172.21.15.33:0/2938396252 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf895a700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf40b0ba0 0x7f0cf416a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf995c700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 0x7f0cf40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 -- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf40b0ba0 msgr2=0x7f0cf416a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf40b0ba0 0x7f0cf416a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 -- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 msgr2=0x7f0cf40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 0x7f0cf40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf915b700 1 -- 172.21.15.33:0/2938396252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4009ae0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.210+0000 7f0cf995c700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 0x7f0cf40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cf915b700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406af10 tx=0x7f0ce4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce4008b30 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce4008c90 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cf40c74a0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40266b0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.211+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cf409b3e0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.212+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cf409b600 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.212+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0ce4003040 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.213+0000 7f0cf17fa700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 0x7f0ce00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.213+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0ce4086c20 con 0x7f0cf40b07d0 2023-10-09T15:39:23.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.213+0000 7f0cf895a700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 0x7f0ce00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.213+0000 7f0cf895a700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 0x7f0ce00697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0cf409baf0 tx=0x7f0ce8008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.218 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.217+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0ce40537a0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.413+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0cf404c3c0 con 0x7f0cf40b07d0 2023-10-09T15:39:23.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.414+0000 7f0cf17fa700 1 -- 172.21.15.33:0/2938396252 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f0ce4021090 con 0x7f0cf40b07d0 2023-10-09T15:39:23.416 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:23.416 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":168,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:23.281753+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 msgr2=0x7f0ce00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 0x7f0ce00697d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f0cf409baf0 tx=0x7f0ce8008040 comp rx=0 tx=0).stop 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 msgr2=0x7f0cf409aea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f0cf406af10 tx=0x7f0ce4018000 comp rx=0 tx=0).stop 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 shutdown_connections 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0ce0067320 0x7f0ce00697d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.418 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0cf40b07d0 0x7f0cf409aea0 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0cf40cf200 0x7f0cf40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 --2- 172.21.15.33:0/2938396252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0cf40b0ba0 0x7f0cf416a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.416+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 >> 172.21.15.33:0/2938396252 conn(0x7f0cf406ce80 msgr2=0x7f0cf4068930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:23.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.417+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 shutdown_connections 2023-10-09T15:39:23.419 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.417+0000 7f0cfb3bf700 1 -- 172.21.15.33:0/2938396252 wait complete. 2023-10-09T15:39:23.430 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:39:23.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.550+0000 7fcb7f4a3700 1 Processor -- start 2023-10-09T15:39:23.551 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.551+0000 7fcb7f4a3700 1 -- start start 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.551+0000 7fcb7f4a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb780ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.551+0000 7fcb7f4a3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb780ccfd0 con 0x7fcb7806dc70 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.551+0000 7fcb7f4a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb780cf0e0 con 0x7fcb7806e0e0 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.551+0000 7fcb7f4a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7815a3d0 con 0x7fcb78159530 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7ca3e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcb7806dc70 0x7fcb78159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48648/0 (socket says 172.21.15.33:48648) 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7ca3e700 1 -- 172.21.15.33:0/2475286679 learned_addr learned my addr 172.21.15.33:0/2475286679 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb780ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 574189769 0 0) 0x7fcb780ccfd0 con 0x7fcb7806dc70 2023-10-09T15:39:23.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb60003570 con 0x7fcb7806dc70 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1819833422 0 0) 0x7fcb60003570 con 0x7fcb7806dc70 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 msgr2=0x7fcb780ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb780ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 >> v1:172.21.15.59:6789/0 conn(0x7fcb7806e0e0 legacy=0x7fcb780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb7815a6b0 con 0x7fcb7806dc70 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fcb6c001470 con 0x7fcb7806dc70 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 >> v1:172.21.15.33:6789/0 conn(0x7fcb7806dc70 legacy=0x7fcb78159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb60003a90 0x7fcb60003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb60004810 0x7fcb60004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.557 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb600051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb7815a3d0 con 0x7fcb60003a90 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6000bb10 con 0x7fcb60004810 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb6000bcd0 con 0x7fcb78159530 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb60003a90 0x7fcb60003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7ca3e700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb60004810 0x7fcb60004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.552+0000 7fcb7da40700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb600051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 -- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 msgr2=0x7fcb600051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb600051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 -- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb60004810 msgr2=0x7fcb60004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:23.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb60004810 0x7fcb60004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 -- 172.21.15.33:0/2475286679 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb60003570 con 0x7fcb60003a90 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7da40700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb78159530 0x7fcb600051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb60003a90 0x7fcb60003e60 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800e210 tx=0x7fcb6800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d72c57b9e3b8f6f8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800eac0 con 0x7fcb60003a90 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6800f040 con 0x7fcb60003a90 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb77fff700 1 -- 172.21.15.33:0/2475286679 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6800ee70 con 0x7fcb60003a90 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/2475286679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb60003a90 msgr2=0x7fcb60003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/2475286679 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb60003a90 0x7fcb60003e60 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800e210 tx=0x7fcb6800b040 comp rx=0 tx=0).stop 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7da40700 1 -- 172.21.15.33:0/2475286679 reap_dead start 2023-10-09T15:39:23.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/2475286679 shutdown_connections 2023-10-09T15:39:23.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.553+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/2475286679 >> 172.21.15.33:0/2475286679 conn(0x7fcb780703a0 msgr2=0x7fcb780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:23.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.554+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/2475286679 shutdown_connections 2023-10-09T15:39:23.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.554+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/2475286679 wait complete. 2023-10-09T15:39:23.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.555+0000 7fcb7f4a3700 1 Processor -- start 2023-10-09T15:39:23.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.555+0000 7fcb7f4a3700 1 -- start start 2023-10-09T15:39:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.555+0000 7fcb7f4a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb60003a90 0x7fcb780b3e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 0x7fcb781549e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb780b4f10 con 0x7fcb78150630 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78152570 con 0x7fcb78150aa0 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb78151960 con 0x7fcb60003a90 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36280/0 (socket says 172.21.15.33:36280) 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 -- 172.21.15.33:0/1185662701 learned_addr learned my addr 172.21.15.33:0/1185662701 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb60003a90 0x7fcb780b3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7da40700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 0x7fcb781549e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 -- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb60003a90 msgr2=0x7fcb780b3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb60003a90 0x7fcb780b3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 -- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 msgr2=0x7fcb781549e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 0x7fcb781549e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 -- 172.21.15.33:0/1185662701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb78151c40 con 0x7fcb78150630 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7da40700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 0x7fcb781549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7ca3e700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0073c0 tx=0x7fcb6c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c018030 con 0x7fcb78150630 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb6c00f870 con 0x7fcb78150630 2023-10-09T15:39:23.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb6c00fbf0 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb78151f20 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.556+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb78151580 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.557+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb78152700 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.558+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb6c01b070 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.558+0000 7fcb757fa700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 0x7fcb640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.558+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fcb6c019070 con 0x7fcb78150630 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.558+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 0x7fcb640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:23.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.559+0000 7fcb7d23f700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 0x7fcb640697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800afd0 tx=0x7fcb6801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:23.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.563+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb6c0517f0 con 0x7fcb78150630 2023-10-09T15:39:23.807 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:23.806+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fcb7804c3c0 con 0x7fcb78150630 2023-10-09T15:39:24.747 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.746+0000 7fcb757fa700 1 -- 172.21.15.33:0/1185662701 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v111) v1 ==== 118+0+0 (secure 0 0 0) 0x7fcb6c054e10 con 0x7fcb78150630 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 msgr2=0x7fcb640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 0x7fcb640697d0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcb6800afd0 tx=0x7fcb6801a000 comp rx=0 tx=0).stop 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 msgr2=0x7fcb781544a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fcb6c0073c0 tx=0x7fcb6c001e70 comp rx=0 tx=0).stop 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 shutdown_connections 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb64067320 0x7fcb640697d0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb78150aa0 0x7fcb781549e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb60003a90 0x7fcb780b3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.749+0000 7fcb7f4a3700 1 --2- 172.21.15.33:0/1185662701 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb78150630 0x7fcb781544a0 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.750+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 >> 172.21.15.33:0/1185662701 conn(0x7fcb780703a0 msgr2=0x7fcb7815f2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.750+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 shutdown_connections 2023-10-09T15:39:24.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.750+0000 7fcb7f4a3700 1 -- 172.21.15.33:0/1185662701 wait complete. 2023-10-09T15:39:24.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:39:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.895+0000 7f4c27f2c700 1 Processor -- start 2023-10-09T15:39:24.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.895+0000 7f4c27f2c700 1 -- start start 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c27f2c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4c2015abe0 0x7f4c200ca840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c27f2c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c2006d280 0x7f4c200cad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c27f2c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c2015a750 con 0x7f4c20157360 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c27f2c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c2015e400 con 0x7f4c2006d280 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c27f2c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c20068540 con 0x7f4c2015abe0 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c2006d280 0x7f4c200cad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4c2006d280 0x7f4c200cad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36292/0 (socket says 172.21.15.33:36292) 2023-10-09T15:39:24.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 -- 172.21.15.33:0/3404686389 learned_addr learned my addr 172.21.15.33:0/3404686389 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c254c7700 1 --2- 172.21.15.33:0/3404686389 >> v2:172.21.15.59:3300/0 conn(0x7f4c2015abe0 0x7f4c200ca840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 -- 172.21.15.33:0/3404686389 >> v2:172.21.15.59:3300/0 conn(0x7f4c2015abe0 msgr2=0x7f4c200ca840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 --2- 172.21.15.33:0/3404686389 >> v2:172.21.15.59:3300/0 conn(0x7f4c2015abe0 0x7f4c200ca840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 -- 172.21.15.33:0/3404686389 >> v1:172.21.15.59:6789/0 conn(0x7f4c20157360 legacy=0x7f4c20067e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.896+0000 7f4c264c9700 1 -- 172.21.15.33:0/3404686389 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c20159e40 con 0x7f4c2006d280 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c264c9700 1 --2- 172.21.15.33:0/3404686389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200cad80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4c200c7120 tx=0x7f4c18009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3c34b32a5f1fdcd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c24cc6700 1 -- 172.21.15.33:0/3404686389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800b860 con 0x7f4c2006d280 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c24cc6700 1 -- 172.21.15.33:0/3404686389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1800b9c0 con 0x7f4c2006d280 2023-10-09T15:39:24.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c24cc6700 1 -- 172.21.15.33:0/3404686389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1800bd60 con 0x7f4c2006d280 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 -- 172.21.15.33:0/3404686389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 msgr2=0x7f4c200cad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/3404686389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200cad80 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f4c200c7120 tx=0x7f4c18009250 comp rx=0 tx=0).stop 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 -- 172.21.15.33:0/3404686389 shutdown_connections 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/3404686389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200cad80 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/3404686389 >> v2:172.21.15.59:3300/0 conn(0x7f4c2015abe0 0x7f4c200ca840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 -- 172.21.15.33:0/3404686389 >> 172.21.15.33:0/3404686389 conn(0x7f4c200ccb50 msgr2=0x7f4c200ccf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:24.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 -- 172.21.15.33:0/3404686389 shutdown_connections 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.897+0000 7f4c27f2c700 1 -- 172.21.15.33:0/3404686389 wait complete. 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.898+0000 7f4c27f2c700 1 Processor -- start 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 -- start start 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c20157360 0x7f4c20156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 0x7f4c20156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c20156d80 con 0x7f4c2006d280 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c200af8f0 con 0x7f4c2015abe0 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c27f2c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c201577d0 con 0x7f4c20157360 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c25cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c25cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36302/0 (socket says 172.21.15.33:36302) 2023-10-09T15:39:24.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c25cc8700 1 -- 172.21.15.33:0/4007473717 learned_addr learned my addr 172.21.15.33:0/4007473717 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.899+0000 7f4c264c9700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 0x7f4c20156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c254c7700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c20157360 0x7f4c20156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 -- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c20157360 msgr2=0x7f4c20156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c20157360 0x7f4c20156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 -- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 msgr2=0x7f4c20156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 0x7f4c20156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 -- 172.21.15.33:0/4007473717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c180094f0 con 0x7f4c2006d280 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c264c9700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 0x7f4c20156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c25cc8700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000cb10 tx=0x7f4c100017b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000a760 con 0x7f4c2006d280 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000a8e0 con 0x7f4c2006d280 2023-10-09T15:39:24.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c20159580 con 0x7f4c2006d280 2023-10-09T15:39:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000aca0 con 0x7f4c2006d280 2023-10-09T15:39:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.900+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c20157a70 con 0x7f4c2006d280 2023-10-09T15:39:24.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.901+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c20157c90 con 0x7f4c2006d280 2023-10-09T15:39:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.902+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4c10003030 con 0x7f4c2006d280 2023-10-09T15:39:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.902+0000 7f4c1dffb700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 0x7f4c0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.902+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4c10084d30 con 0x7f4c2006d280 2023-10-09T15:39:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.902+0000 7f4c254c7700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 0x7f4c0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:24.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.903+0000 7f4c254c7700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 0x7f4c0c0697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4c2006b0a0 tx=0x7f4c14008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:24.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:24.906+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4c100519c0 con 0x7f4c2006d280 2023-10-09T15:39:25.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.149+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4c2004c3c0 con 0x7f4c2006d280 2023-10-09T15:39:25.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.751+0000 7f4c1dffb700 1 -- 172.21.15.33:0/4007473717 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v112) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4c10054fe0 con 0x7f4c2006d280 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 msgr2=0x7f4c0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 0x7f4c0c0697d0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f4c2006b0a0 tx=0x7f4c14008040 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 msgr2=0x7f4c200a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000cb10 tx=0x7f4c100017b0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 shutdown_connections 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4c0c067320 0x7f4c0c0697d0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4c2006d280 0x7f4c200a9b30 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4c2015abe0 0x7f4c20156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 --2- 172.21.15.33:0/4007473717 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4c20157360 0x7f4c20156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 >> 172.21.15.33:0/4007473717 conn(0x7f4c200ccb50 msgr2=0x7f4c200c7150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:25.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.753+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 shutdown_connections 2023-10-09T15:39:25.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.754+0000 7f4c27f2c700 1 -- 172.21.15.33:0/4007473717 wait complete. 2023-10-09T15:39:25.768 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:25.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.890+0000 7f3d6ee87700 1 Processor -- start 2023-10-09T15:39:25.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.890+0000 7f3d6ee87700 1 -- start start 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ee87700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3d68142c00 0x7f3d6806b7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ee87700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d680c7f90 0x7f3d6806c6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ee87700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d680ca480 con 0x7f3d6806bd20 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ee87700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6815e240 con 0x7f3d680c7f90 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ee87700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d6806b350 con 0x7f3d68142c00 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6e686700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3d680c7f90 0x7f3d6806c6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6d684700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3d6806bd20 0x7f3d680c7880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48652/0 (socket says 172.21.15.33:48652) 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6d684700 1 -- 172.21.15.33:0/3947229740 learned_addr learned my addr 172.21.15.33:0/3947229740 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6e686700 1 -- 172.21.15.33:0/3947229740 >> v2:172.21.15.59:3300/0 conn(0x7f3d68142c00 msgr2=0x7f3d6806b7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:25.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6e686700 1 --2- 172.21.15.33:0/3947229740 >> v2:172.21.15.59:3300/0 conn(0x7f3d68142c00 0x7f3d6806b7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6e686700 1 -- 172.21.15.33:0/3947229740 >> v1:172.21.15.33:6789/0 conn(0x7f3d6806bd20 legacy=0x7f3d680c7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6ce83700 1 -- 172.21.15.33:0/3947229740 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2023182419 0 0) 0x7f3d680ca480 con 0x7f3d6806bd20 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.891+0000 7f3d6e686700 1 -- 172.21.15.33:0/3947229740 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d6815df60 con 0x7f3d680c7f90 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6e686700 1 --2- 172.21.15.33:0/3947229740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d680c7f90 0x7f3d6806c6a0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3d6806f490 tx=0x7f3d600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ba95558e5a30b1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ce83700 1 -- 172.21.15.33:0/3947229740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000b6b0 con 0x7f3d680c7f90 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ce83700 1 -- 172.21.15.33:0/3947229740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6000b810 con 0x7f3d680c7f90 2023-10-09T15:39:25.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ce83700 1 -- 172.21.15.33:0/3947229740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6000bbb0 con 0x7f3d680c7f90 2023-10-09T15:39:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 -- 172.21.15.33:0/3947229740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d680c7f90 msgr2=0x7f3d6806c6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/3947229740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d680c7f90 0x7f3d6806c6a0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f3d6806f490 tx=0x7f3d600091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 -- 172.21.15.33:0/3947229740 shutdown_connections 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/3947229740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d680c7f90 0x7f3d6806c6a0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/3947229740 >> v2:172.21.15.59:3300/0 conn(0x7f3d68142c00 0x7f3d6806b7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 -- 172.21.15.33:0/3947229740 >> 172.21.15.33:0/3947229740 conn(0x7f3d680675a0 msgr2=0x7f3d680679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 -- 172.21.15.33:0/3947229740 shutdown_connections 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.892+0000 7f3d6ee87700 1 -- 172.21.15.33:0/3947229740 wait complete. 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.893+0000 7f3d6ee87700 1 Processor -- start 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 -- start start 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d6806bd20 0x7f3d6816d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 0x7f3d6813e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d681692c0 con 0x7f3d68142c00 2023-10-09T15:39:25.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d6813ea20 con 0x7f3d680c7f90 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6ee87700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d68169dd0 con 0x7f3d6806bd20 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6e686700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6e686700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36320/0 (socket says 172.21.15.33:36320) 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6e686700 1 -- 172.21.15.33:0/2536779441 learned_addr learned my addr 172.21.15.33:0/2536779441 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6d684700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 0x7f3d6813e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.894+0000 7f3d6de85700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d6806bd20 0x7f3d6816d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 -- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d6806bd20 msgr2=0x7f3d6816d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d6806bd20 0x7f3d6816d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 -- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 msgr2=0x7f3d6813e210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 0x7f3d6813e210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 -- 172.21.15.33:0/2536779441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d60009420 con 0x7f3d68142c00 2023-10-09T15:39:25.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6d684700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 0x7f3d6813e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6e686700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3d6806f290 tx=0x7f3d60017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d6001f070 con 0x7f3d68142c00 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d6000ba50 con 0x7f3d68142c00 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d6816a260 con 0x7f3d68142c00 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d60025690 con 0x7f3d68142c00 2023-10-09T15:39:25.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.895+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d681694a0 con 0x7f3d68142c00 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.896+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d68169f40 con 0x7f3d68142c00 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.896+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3d60023070 con 0x7f3d68142c00 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.897+0000 7f3d65ffb700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 0x7f3d540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.897+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f3d60086380 con 0x7f3d68142c00 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.897+0000 7f3d6de85700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 0x7f3d540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:25.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.897+0000 7f3d6de85700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 0x7f3d540697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3d58001250 tx=0x7f3d58009620 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:25.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:25.901+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3d60053010 con 0x7f3d68142c00 2023-10-09T15:39:26.137 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.137+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3d6804c3c0 con 0x7f3d68142c00 2023-10-09T15:39:26.138 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.137+0000 7f3d65ffb700 1 -- 172.21.15.33:0/2536779441 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f3d60056630 con 0x7f3d68142c00 2023-10-09T15:39:26.139 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:26.139 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:25.746958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 msgr2=0x7f3d540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 0x7f3d540697d0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f3d58001250 tx=0x7f3d58009620 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 msgr2=0x7f3d680c5ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f3d6806f290 tx=0x7f3d60017000 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 shutdown_connections 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3d54067320 0x7f3d540697d0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3d68142c00 0x7f3d680c5ab0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3d6806bd20 0x7f3d6816d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 --2- 172.21.15.33:0/2536779441 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3d680c7f90 0x7f3d6813e210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.139+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 >> 172.21.15.33:0/2536779441 conn(0x7f3d680675a0 msgr2=0x7f3d680cd8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:26.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.140+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 shutdown_connections 2023-10-09T15:39:26.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.140+0000 7f3d6ee87700 1 -- 172.21.15.33:0/2536779441 wait complete. 2023-10-09T15:39:26.142 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 112 2023-10-09T15:39:26.153 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:26.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.270+0000 7f634c29e700 1 Processor -- start 2023-10-09T15:39:26.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.270+0000 7f634c29e700 1 -- start start 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634c29e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63440cb5a0 0x7f63440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634c29e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634415a5d0 0x7f6344156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634c29e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f634415ae40 con 0x7f63440cd9e0 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634c29e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63440d13f0 con 0x7f63440cb5a0 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634c29e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f634415ab60 con 0x7f634415a5d0 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634a03a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f63440cb5a0 0x7f63440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f6349839700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f63440cd9e0 0x7f6344159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48660/0 (socket says 172.21.15.33:48660) 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f6349839700 1 -- 172.21.15.33:0/2475904238 learned_addr learned my addr 172.21.15.33:0/2475904238 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634a83b700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634415a5d0 0x7f6344156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634a03a700 1 -- 172.21.15.33:0/2475904238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634415a5d0 msgr2=0x7f6344156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:26.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634a03a700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634415a5d0 0x7f6344156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.271+0000 7f634a03a700 1 -- 172.21.15.33:0/2475904238 >> v1:172.21.15.33:6789/0 conn(0x7f63440cd9e0 legacy=0x7f6344159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634a03a700 1 -- 172.21.15.33:0/2475904238 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440ccf00 con 0x7f63440cb5a0 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f6349038700 1 -- 172.21.15.33:0/2475904238 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2112682597 0 0) 0x7f634415ae40 con 0x7f63440cd9e0 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634a03a700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cb5a0 0x7f63440cb970 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f6334009e90 tx=0x7f6334009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f9cc3035b1e1c2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f6349038700 1 -- 172.21.15.33:0/2475904238 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f633400e070 con 0x7f63440cb5a0 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f6349038700 1 -- 172.21.15.33:0/2475904238 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f633400bbf0 con 0x7f63440cb5a0 2023-10-09T15:39:26.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f6349038700 1 -- 172.21.15.33:0/2475904238 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6334012430 con 0x7f63440cb5a0 2023-10-09T15:39:26.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 -- 172.21.15.33:0/2475904238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cb5a0 msgr2=0x7f63440cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.276 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cb5a0 0x7f63440cb970 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f6334009e90 tx=0x7f6334009780 comp rx=0 tx=0).stop 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 -- 172.21.15.33:0/2475904238 shutdown_connections 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f634415a5d0 0x7f6344156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 --2- 172.21.15.33:0/2475904238 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cb5a0 0x7f63440cb970 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.272+0000 7f634c29e700 1 -- 172.21.15.33:0/2475904238 >> 172.21.15.33:0/2475904238 conn(0x7f6344070e30 msgr2=0x7f63440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.273+0000 7f634c29e700 1 -- 172.21.15.33:0/2475904238 shutdown_connections 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.273+0000 7f634c29e700 1 -- 172.21.15.33:0/2475904238 wait complete. 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 Processor -- start 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 -- start start 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63440cb5a0 0x7f63441512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634415a5d0 0x7f63441523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.277 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344152100 con 0x7f63440cd9e0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6344151820 con 0x7f634415a5d0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f634c29e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63440c8640 con 0x7f63440cb5a0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f6349839700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f6349839700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36342/0 (socket says 172.21.15.33:36342) 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.274+0000 7f6349839700 1 -- 172.21.15.33:0/2456631952 learned_addr learned my addr 172.21.15.33:0/2456631952 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f634a03a700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63440cb5a0 0x7f63441512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f634a83b700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634415a5d0 0x7f63441523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 -- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63440cb5a0 msgr2=0x7f63441512e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63440cb5a0 0x7f63441512e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 -- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634415a5d0 msgr2=0x7f63441523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634415a5d0 0x7f63441523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 -- 172.21.15.33:0/2456631952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6334009a20 con 0x7f63440cd9e0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f6349839700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f633800c7e0 tx=0x7f6338007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338005b30 con 0x7f63440cd9e0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6338005c90 con 0x7f63440cd9e0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6338007300 con 0x7f63440cd9e0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63440c8920 con 0x7f63440cd9e0 2023-10-09T15:39:26.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.275+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63441532a0 con 0x7f63440cd9e0 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.276+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f634404c3c0 con 0x7f63440cd9e0 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.277+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f633801b3b0 con 0x7f63440cd9e0 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.277+0000 7f63427fc700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 0x7f63300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.277+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6338084190 con 0x7f63440cd9e0 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.277+0000 7f634a03a700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 0x7f63300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.278+0000 7f634a03a700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 0x7f63300697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6334009fd0 tx=0x7f6334019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.281+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6338050e20 con 0x7f63440cd9e0 2023-10-09T15:39:26.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.477+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f63440cd270 con 0x7f63440cd9e0 2023-10-09T15:39:26.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.478+0000 7f63427fc700 1 -- 172.21.15.33:0/2456631952 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f6338001d60 con 0x7f63440cd9e0 2023-10-09T15:39:26.479 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:26.480 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":168,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:23.281753+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":29,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":166,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.480+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 msgr2=0x7f63300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.480+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 0x7f63300697d0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f6334009fd0 tx=0x7f6334019000 comp rx=0 tx=0).stop 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.480+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 msgr2=0x7f63440c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.480+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f633800c7e0 tx=0x7f6338007df0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 shutdown_connections 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6330067320 0x7f63300697d0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f634415a5d0 0x7f63441523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f63440cb5a0 0x7f63441512e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 --2- 172.21.15.33:0/2456631952 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f63440cd9e0 0x7f63440c9eb0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 >> 172.21.15.33:0/2456631952 conn(0x7f6344070e30 msgr2=0x7f63440b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:26.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 shutdown_connections 2023-10-09T15:39:26.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.481+0000 7f634c29e700 1 -- 172.21.15.33:0/2456631952 wait complete. 2023-10-09T15:39:26.494 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:39:26.494 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:39:26.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.611+0000 7f4bf760c700 1 Processor -- start 2023-10-09T15:39:26.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.612+0000 7f4bf760c700 1 -- start start 2023-10-09T15:39:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.612+0000 7f4bf760c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4bf00cb5a0 0x7f4bf00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.612+0000 7f4bf760c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf015ae40 con 0x7f4bf00cd9e0 2023-10-09T15:39:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.612+0000 7f4bf760c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bf015ab60 con 0x7f4bf015a5d0 2023-10-09T15:39:26.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.612+0000 7f4bf760c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bf00d13f0 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf53a8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4bf00cb5a0 0x7f4bf00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf4ba7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4bf00cd9e0 0x7f4bf0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48676/0 (socket says 172.21.15.33:48676) 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf4ba7700 1 -- 172.21.15.33:0/1447100405 learned_addr learned my addr 172.21.15.33:0/1447100405 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf53a8700 1 -- 172.21.15.33:0/1447100405 >> v1:172.21.15.59:6789/0 conn(0x7f4bf015a5d0 legacy=0x7f4bf0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf53a8700 1 -- 172.21.15.33:0/1447100405 >> v1:172.21.15.33:6789/0 conn(0x7f4bf00cd9e0 legacy=0x7f4bf0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf53a8700 1 -- 172.21.15.33:0/1447100405 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bf00ccf00 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4beffff700 1 -- 172.21.15.33:0/1447100405 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365680724 0 0) 0x7f4bf015ae40 con 0x7f4bf00cd9e0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4bf53a8700 1 --2- 172.21.15.33:0/1447100405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf00cb5a0 0x7f4bf00cb970 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009910 tx=0x7f4be80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489981ac89bc126e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4beffff700 1 -- 172.21.15.33:0/1447100405 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800b7e0 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4beffff700 1 -- 172.21.15.33:0/1447100405 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be800b940 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.613+0000 7f4beffff700 1 -- 172.21.15.33:0/1447100405 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be800bce0 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 -- 172.21.15.33:0/1447100405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf00cb5a0 msgr2=0x7f4bf00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 --2- 172.21.15.33:0/1447100405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf00cb5a0 0x7f4bf00cb970 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7f4be8009910 tx=0x7f4be80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 -- 172.21.15.33:0/1447100405 shutdown_connections 2023-10-09T15:39:26.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 --2- 172.21.15.33:0/1447100405 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf00cb5a0 0x7f4bf00cb970 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 -- 172.21.15.33:0/1447100405 >> 172.21.15.33:0/1447100405 conn(0x7f4bf0070e30 msgr2=0x7f4bf00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 -- 172.21.15.33:0/1447100405 shutdown_connections 2023-10-09T15:39:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.614+0000 7f4bf760c700 1 -- 172.21.15.33:0/1447100405 wait complete. 2023-10-09T15:39:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.615+0000 7f4bf760c700 1 Processor -- start 2023-10-09T15:39:26.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.615+0000 7f4bf760c700 1 -- start start 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf00cb5a0 0x7f4bf0159650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 0x7f4bf0156c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf00c8200 con 0x7f4bf015a5d0 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf01571a0 con 0x7f4bf00cd9e0 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf760c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf0157f60 con 0x7f4bf00cb5a0 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36368/0 (socket says 172.21.15.33:36368) 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 -- 172.21.15.33:0/3655465691 learned_addr learned my addr 172.21.15.33:0/3655465691 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:26.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf4ba7700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 0x7f4bf0156c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf53a8700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf00cb5a0 0x7f4bf0159650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 -- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf00cb5a0 msgr2=0x7f4bf0159650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf00cb5a0 0x7f4bf0159650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 -- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 msgr2=0x7f4bf0156c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 0x7f4bf0156c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 -- 172.21.15.33:0/3655465691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4be8009420 con 0x7f4bf015a5d0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf4ba7700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 0x7f4bf0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.616+0000 7f4bf5ba9700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4be000bbb0 tx=0x7f4be0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.617+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be00092e0 con 0x7f4bf015a5d0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.617+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4be000c7a0 con 0x7f4bf015a5d0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.617+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf01583f0 con 0x7f4bf015a5d0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.617+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4be000cb40 con 0x7f4bf015a5d0 2023-10-09T15:39:26.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.617+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf0157910 con 0x7f4bf015a5d0 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.618+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf004c3c0 con 0x7f4bf015a5d0 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.618+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4be0012070 con 0x7f4bf015a5d0 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.618+0000 7f4bed7fa700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.619+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f4be00848d0 con 0x7f4bf015a5d0 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.619+0000 7f4bf53a8700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:26.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.619+0000 7f4bf53a8700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 0x7f4bdc0697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0154110 tx=0x7f4be8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:26.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.623+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4be0051560 con 0x7f4bf015a5d0 2023-10-09T15:39:26.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.816+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4bf00b1830 con 0x7f4bdc067320 2023-10-09T15:39:26.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.825+0000 7f4bed7fa700 1 -- 172.21.15.33:0/3655465691 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289815 (secure 0 0 0) 0x7f4bf00b1830 con 0x7f4bdc067320 2023-10-09T15:39:26.829 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 msgr2=0x7f4bdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 0x7f4bdc0697d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0154110 tx=0x7f4be8016000 comp rx=0 tx=0).stop 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 msgr2=0x7f4bf01513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7f4be000bbb0 tx=0x7f4be0009840 comp rx=0 tx=0).stop 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 shutdown_connections 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4bdc067320 0x7f4bdc0697d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4bf015a5d0 0x7f4bf01513e0 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4bf00cb5a0 0x7f4bf0159650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 --2- 172.21.15.33:0/3655465691 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4bf00cd9e0 0x7f4bf0156c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 >> 172.21.15.33:0/3655465691 conn(0x7f4bf0070e30 msgr2=0x7f4bf0159ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 shutdown_connections 2023-10-09T15:39:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.828+0000 7f4bf760c700 1 -- 172.21.15.33:0/3655465691 wait complete. 2023-10-09T15:39:26.832 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:39:26.841 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2023-10-09T15:39:25.336488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428816,"kb_used_data":17744,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752545904,"statfs":{"total":773094113280,"available":770607005696,"internally_reserved":0,"allocated":18169856,"data_stored":8780467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.629390"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305800+0000","last_change":"2023-10-09T15:39:22.303544+0000","last_active":"2023-10-09T15:39:22.305800+0000","last_peered":"2023-10-09T15:39:22.305800+0000","last_clean":"2023-10-09T15:39:22.305800+0000","last_became_active":"2023-10-09T15:39:22.303183+0000","last_became_peered":"2023-10-09T15:39:22.303183+0000","last_unstale":"2023-10-09T15:39:22.305800+0000","last_undegraded":"2023-10-09T15:39:22.305800+0000","last_fullsized":"2023-10-09T15:39:22.305800+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:24.944288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309172+0000","last_change":"2023-10-09T15:39:22.309172+0000","last_active":"2023-10-09T15:39:22.309172+0000","last_peered":"2023-10-09T15:39:22.309172+0000","last_clean":"2023-10-09T15:39:22.309172+0000","last_became_active":"2023-10-09T15:39:22.308537+0000","last_became_peered":"2023-10-09T15:39:22.308537+0000","last_unstale":"2023-10-09T15:39:22.309172+0000","last_undegraded":"2023-10-09T15:39:22.309172+0000","last_fullsized":"2023-10-09T15:39:22.309172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:46.431870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308903+0000","last_change":"2023-10-09T15:39:22.304708+0000","last_active":"2023-10-09T15:39:22.308903+0000","last_peered":"2023-10-09T15:39:22.308903+0000","last_clean":"2023-10-09T15:39:22.308903+0000","last_became_active":"2023-10-09T15:39:22.304333+0000","last_became_peered":"2023-10-09T15:39:22.304333+0000","last_unstale":"2023-10-09T15:39:22.308903+0000","last_undegraded":"2023-10-09T15:39:22.308903+0000","last_fullsized":"2023-10-09T15:39:22.308903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:05.470167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305059+0000","last_change":"2023-10-09T15:39:22.305059+0000","last_active":"2023-10-09T15:39:22.305059+0000","last_peered":"2023-10-09T15:39:22.305059+0000","last_clean":"2023-10-09T15:39:22.305059+0000","last_became_active":"2023-10-09T15:39:22.304775+0000","last_became_peered":"2023-10-09T15:39:22.304775+0000","last_unstale":"2023-10-09T15:39:22.305059+0000","last_undegraded":"2023-10-09T15:39:22.305059+0000","last_fullsized":"2023-10-09T15:39:22.305059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:05.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301235+0000","last_change":"2023-10-09T15:39:22.301235+0000","last_active":"2023-10-09T15:39:22.301235+0000","last_peered":"2023-10-09T15:39:22.301235+0000","last_clean":"2023-10-09T15:39:22.301235+0000","last_became_active":"2023-10-09T15:39:22.300982+0000","last_became_peered":"2023-10-09T15:39:22.300982+0000","last_unstale":"2023-10-09T15:39:22.301235+0000","last_undegraded":"2023-10-09T15:39:22.301235+0000","last_fullsized":"2023-10-09T15:39:22.301235+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:38:47.854739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297939+0000","last_change":"2023-10-09T15:39:22.297939+0000","last_active":"2023-10-09T15:39:22.297939+0000","last_peered":"2023-10-09T15:39:22.297939+0000","last_clean":"2023-10-09T15:39:22.297939+0000","last_became_active":"2023-10-09T15:39:22.297638+0000","last_became_peered":"2023-10-09T15:39:22.297638+0000","last_unstale":"2023-10-09T15:39:22.297939+0000","last_undegraded":"2023-10-09T15:39:22.297939+0000","last_fullsized":"2023-10-09T15:39:22.297939+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:15.312414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308019+0000","last_change":"2023-10-09T15:39:22.304030+0000","last_active":"2023-10-09T15:39:22.308019+0000","last_peered":"2023-10-09T15:39:22.308019+0000","last_clean":"2023-10-09T15:39:22.308019+0000","last_became_active":"2023-10-09T15:39:22.303566+0000","last_became_peered":"2023-10-09T15:39:22.303566+0000","last_unstale":"2023-10-09T15:39:22.308019+0000","last_undegraded":"2023-10-09T15:39:22.308019+0000","last_fullsized":"2023-10-09T15:39:22.308019+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:51.526459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302875+0000","last_change":"2023-10-09T15:39:22.302564+0000","last_active":"2023-10-09T15:39:22.302875+0000","last_peered":"2023-10-09T15:39:22.302875+0000","last_clean":"2023-10-09T15:39:22.302875+0000","last_became_active":"2023-10-09T15:39:22.302053+0000","last_became_peered":"2023-10-09T15:39:22.302053+0000","last_unstale":"2023-10-09T15:39:22.302875+0000","last_undegraded":"2023-10-09T15:39:22.302875+0000","last_fullsized":"2023-10-09T15:39:22.302875+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:53.853851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.310531+0000","last_change":"2023-10-09T15:39:22.306416+0000","last_active":"2023-10-09T15:39:22.310531+0000","last_peered":"2023-10-09T15:39:22.310531+0000","last_clean":"2023-10-09T15:39:22.310531+0000","last_became_active":"2023-10-09T15:39:22.306154+0000","last_became_peered":"2023-10-09T15:39:22.306154+0000","last_unstale":"2023-10-09T15:39:22.310531+0000","last_undegraded":"2023-10-09T15:39:22.310531+0000","last_fullsized":"2023-10-09T15:39:22.310531+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:18.978938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.298495+0000","last_change":"2023-10-09T15:39:22.298495+0000","last_active":"2023-10-09T15:39:22.298495+0000","last_peered":"2023-10-09T15:39:22.298495+0000","last_clean":"2023-10-09T15:39:22.298495+0000","last_became_active":"2023-10-09T15:39:22.298240+0000","last_became_peered":"2023-10-09T15:39:22.298240+0000","last_unstale":"2023-10-09T15:39:22.298495+0000","last_undegraded":"2023-10-09T15:39:22.298495+0000","last_fullsized":"2023-10-09T15:39:22.298495+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:52.322159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304372+0000","last_change":"2023-10-09T15:39:22.301517+0000","last_active":"2023-10-09T15:39:22.304372+0000","last_peered":"2023-10-09T15:39:22.304372+0000","last_clean":"2023-10-09T15:39:22.304372+0000","last_became_active":"2023-10-09T15:39:22.301216+0000","last_became_peered":"2023-10-09T15:39:22.301216+0000","last_unstale":"2023-10-09T15:39:22.304372+0000","last_undegraded":"2023-10-09T15:39:22.304372+0000","last_fullsized":"2023-10-09T15:39:22.304372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:30.819233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304758+0000","last_change":"2023-10-09T15:39:22.304758+0000","last_active":"2023-10-09T15:39:22.304758+0000","last_peered":"2023-10-09T15:39:22.304758+0000","last_clean":"2023-10-09T15:39:22.304758+0000","last_became_active":"2023-10-09T15:39:22.304484+0000","last_became_peered":"2023-10-09T15:39:22.304484+0000","last_unstale":"2023-10-09T15:39:22.304758+0000","last_undegraded":"2023-10-09T15:39:22.304758+0000","last_fullsized":"2023-10-09T15:39:22.304758+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:16.657344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302233+0000","last_change":"2023-10-09T15:39:22.302233+0000","last_active":"2023-10-09T15:39:22.302233+0000","last_peered":"2023-10-09T15:39:22.302233+0000","last_clean":"2023-10-09T15:39:22.302233+0000","last_became_active":"2023-10-09T15:39:22.301800+0000","last_became_peered":"2023-10-09T15:39:22.301800+0000","last_unstale":"2023-10-09T15:39:22.302233+0000","last_undegraded":"2023-10-09T15:39:22.302233+0000","last_fullsized":"2023-10-09T15:39:22.302233+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:39.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.291209+0000","last_change":"2023-10-09T15:39:22.291209+0000","last_active":"2023-10-09T15:39:22.291209+0000","last_peered":"2023-10-09T15:39:22.291209+0000","last_clean":"2023-10-09T15:39:22.291209+0000","last_became_active":"2023-10-09T15:39:22.290903+0000","last_became_peered":"2023-10-09T15:39:22.290903+0000","last_unstale":"2023-10-09T15:39:22.291209+0000","last_undegraded":"2023-10-09T15:39:22.291209+0000","last_fullsized":"2023-10-09T15:39:22.291209+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:37.852027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293112+0000","last_change":"2023-10-09T15:39:22.293112+0000","last_active":"2023-10-09T15:39:22.293112+0000","last_peered":"2023-10-09T15:39:22.293112+0000","last_clean":"2023-10-09T15:39:22.293112+0000","last_became_active":"2023-10-09T15:39:22.292855+0000","last_became_peered":"2023-10-09T15:39:22.292855+0000","last_unstale":"2023-10-09T15:39:22.293112+0000","last_undegraded":"2023-10-09T15:39:22.293112+0000","last_fullsized":"2023-10-09T15:39:22.293112+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:14.736660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305551+0000","last_change":"2023-10-09T15:39:22.305551+0000","last_active":"2023-10-09T15:39:22.305551+0000","last_peered":"2023-10-09T15:39:22.305551+0000","last_clean":"2023-10-09T15:39:22.305551+0000","last_became_active":"2023-10-09T15:39:22.305291+0000","last_became_peered":"2023-10-09T15:39:22.305291+0000","last_unstale":"2023-10-09T15:39:22.305551+0000","last_undegraded":"2023-10-09T15:39:22.305551+0000","last_fullsized":"2023-10-09T15:39:22.305551+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:18.978938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299569+0000","last_change":"2023-10-09T15:39:22.299569+0000","last_active":"2023-10-09T15:39:22.299569+0000","last_peered":"2023-10-09T15:39:22.299569+0000","last_clean":"2023-10-09T15:39:22.299569+0000","last_became_active":"2023-10-09T15:39:22.299311+0000","last_became_peered":"2023-10-09T15:39:22.299311+0000","last_unstale":"2023-10-09T15:39:22.299569+0000","last_undegraded":"2023-10-09T15:39:22.299569+0000","last_fullsized":"2023-10-09T15:39:22.299569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:54.051587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.294086+0000","last_change":"2023-10-09T15:39:22.294086+0000","last_active":"2023-10-09T15:39:22.294086+0000","last_peered":"2023-10-09T15:39:22.294086+0000","last_clean":"2023-10-09T15:39:22.294086+0000","last_became_active":"2023-10-09T15:39:22.293910+0000","last_became_peered":"2023-10-09T15:39:22.293910+0000","last_unstale":"2023-10-09T15:39:22.294086+0000","last_undegraded":"2023-10-09T15:39:22.294086+0000","last_fullsized":"2023-10-09T15:39:22.294086+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:14.058662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302621+0000","last_change":"2023-10-09T15:39:22.302621+0000","last_active":"2023-10-09T15:39:22.302621+0000","last_peered":"2023-10-09T15:39:22.302621+0000","last_clean":"2023-10-09T15:39:22.302621+0000","last_became_active":"2023-10-09T15:39:22.302266+0000","last_became_peered":"2023-10-09T15:39:22.302266+0000","last_unstale":"2023-10-09T15:39:22.302621+0000","last_undegraded":"2023-10-09T15:39:22.302621+0000","last_fullsized":"2023-10-09T15:39:22.302621+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:33.318887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.292760+0000","last_change":"2023-10-09T15:39:22.292760+0000","last_active":"2023-10-09T15:39:22.292760+0000","last_peered":"2023-10-09T15:39:22.292760+0000","last_clean":"2023-10-09T15:39:22.292760+0000","last_became_active":"2023-10-09T15:39:22.292403+0000","last_became_peered":"2023-10-09T15:39:22.292403+0000","last_unstale":"2023-10-09T15:39:22.292760+0000","last_undegraded":"2023-10-09T15:39:22.292760+0000","last_fullsized":"2023-10-09T15:39:22.292760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:14.736660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.303753+0000","last_change":"2023-10-09T15:39:22.303753+0000","last_active":"2023-10-09T15:39:22.303753+0000","last_peered":"2023-10-09T15:39:22.303753+0000","last_clean":"2023-10-09T15:39:22.303753+0000","last_became_active":"2023-10-09T15:39:22.303516+0000","last_became_peered":"2023-10-09T15:39:22.303516+0000","last_unstale":"2023-10-09T15:39:22.303753+0000","last_undegraded":"2023-10-09T15:39:22.303753+0000","last_fullsized":"2023-10-09T15:39:22.303753+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:29.775130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304870+0000","last_change":"2023-10-09T15:39:22.304870+0000","last_active":"2023-10-09T15:39:22.304870+0000","last_peered":"2023-10-09T15:39:22.304870+0000","last_clean":"2023-10-09T15:39:22.304870+0000","last_became_active":"2023-10-09T15:39:22.304582+0000","last_became_peered":"2023-10-09T15:39:22.304582+0000","last_unstale":"2023-10-09T15:39:22.304870+0000","last_undegraded":"2023-10-09T15:39:22.304870+0000","last_fullsized":"2023-10-09T15:39:22.304870+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:56.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304192+0000","last_change":"2023-10-09T15:39:22.300565+0000","last_active":"2023-10-09T15:39:22.304192+0000","last_peered":"2023-10-09T15:39:22.304192+0000","last_clean":"2023-10-09T15:39:22.304192+0000","last_became_active":"2023-10-09T15:39:22.300232+0000","last_became_peered":"2023-10-09T15:39:22.300232+0000","last_unstale":"2023-10-09T15:39:22.304192+0000","last_undegraded":"2023-10-09T15:39:22.304192+0000","last_fullsized":"2023-10-09T15:39:22.304192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:33.318887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297730+0000","last_change":"2023-10-09T15:39:22.297730+0000","last_active":"2023-10-09T15:39:22.297730+0000","last_peered":"2023-10-09T15:39:22.297730+0000","last_clean":"2023-10-09T15:39:22.297730+0000","last_became_active":"2023-10-09T15:39:22.297432+0000","last_became_peered":"2023-10-09T15:39:22.297432+0000","last_unstale":"2023-10-09T15:39:22.297730+0000","last_undegraded":"2023-10-09T15:39:22.297730+0000","last_fullsized":"2023-10-09T15:39:22.297730+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:28.989522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305823+0000","last_change":"2023-10-09T15:39:22.303669+0000","last_active":"2023-10-09T15:39:22.305823+0000","last_peered":"2023-10-09T15:39:22.305823+0000","last_clean":"2023-10-09T15:39:22.305823+0000","last_became_active":"2023-10-09T15:39:22.303333+0000","last_became_peered":"2023-10-09T15:39:22.303333+0000","last_unstale":"2023-10-09T15:39:22.305823+0000","last_undegraded":"2023-10-09T15:39:22.305823+0000","last_fullsized":"2023-10-09T15:39:22.305823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:11.787323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297369+0000","last_change":"2023-10-09T15:39:22.292366+0000","last_active":"2023-10-09T15:39:22.297369+0000","last_peered":"2023-10-09T15:39:22.297369+0000","last_clean":"2023-10-09T15:39:22.297369+0000","last_became_active":"2023-10-09T15:39:22.292096+0000","last_became_peered":"2023-10-09T15:39:22.292096+0000","last_unstale":"2023-10-09T15:39:22.297369+0000","last_undegraded":"2023-10-09T15:39:22.297369+0000","last_fullsized":"2023-10-09T15:39:22.297369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:51.932232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305849+0000","last_change":"2023-10-09T15:39:22.302648+0000","last_active":"2023-10-09T15:39:22.305849+0000","last_peered":"2023-10-09T15:39:22.305849+0000","last_clean":"2023-10-09T15:39:22.305849+0000","last_became_active":"2023-10-09T15:39:22.302269+0000","last_became_peered":"2023-10-09T15:39:22.302269+0000","last_unstale":"2023-10-09T15:39:22.305849+0000","last_undegraded":"2023-10-09T15:39:22.305849+0000","last_fullsized":"2023-10-09T15:39:22.305849+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:29.993683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299549+0000","last_change":"2023-10-09T15:39:22.299549+0000","last_active":"2023-10-09T15:39:22.299549+0000","last_peered":"2023-10-09T15:39:22.299549+0000","last_clean":"2023-10-09T15:39:22.299549+0000","last_became_active":"2023-10-09T15:39:22.299299+0000","last_became_peered":"2023-10-09T15:39:22.299299+0000","last_unstale":"2023-10-09T15:39:22.299549+0000","last_undegraded":"2023-10-09T15:39:22.299549+0000","last_fullsized":"2023-10-09T15:39:22.299549+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:22.432499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293094+0000","last_change":"2023-10-09T15:39:22.293094+0000","last_active":"2023-10-09T15:39:22.293094+0000","last_peered":"2023-10-09T15:39:22.293094+0000","last_clean":"2023-10-09T15:39:22.293094+0000","last_became_active":"2023-10-09T15:39:22.292765+0000","last_became_peered":"2023-10-09T15:39:22.292765+0000","last_unstale":"2023-10-09T15:39:22.293094+0000","last_undegraded":"2023-10-09T15:39:22.293094+0000","last_fullsized":"2023-10-09T15:39:22.293094+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:21.869437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308236+0000","last_change":"2023-10-09T15:39:22.306059+0000","last_active":"2023-10-09T15:39:22.308236+0000","last_peered":"2023-10-09T15:39:22.308236+0000","last_clean":"2023-10-09T15:39:22.308236+0000","last_became_active":"2023-10-09T15:39:22.305790+0000","last_became_peered":"2023-10-09T15:39:22.305790+0000","last_unstale":"2023-10-09T15:39:22.308236+0000","last_undegraded":"2023-10-09T15:39:22.308236+0000","last_fullsized":"2023-10-09T15:39:22.308236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:23:34.843038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302651+0000","last_change":"2023-10-09T15:39:22.302651+0000","last_active":"2023-10-09T15:39:22.302651+0000","last_peered":"2023-10-09T15:39:22.302651+0000","last_clean":"2023-10-09T15:39:22.302651+0000","last_became_active":"2023-10-09T15:39:22.302388+0000","last_became_peered":"2023-10-09T15:39:22.302388+0000","last_unstale":"2023-10-09T15:39:22.302651+0000","last_undegraded":"2023-10-09T15:39:22.302651+0000","last_fullsized":"2023-10-09T15:39:22.302651+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:48:39.459279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293768+0000","last_change":"2023-10-09T15:39:22.293768+0000","last_active":"2023-10-09T15:39:22.293768+0000","last_peered":"2023-10-09T15:39:22.293768+0000","last_clean":"2023-10-09T15:39:22.293768+0000","last_became_active":"2023-10-09T15:39:22.293471+0000","last_became_peered":"2023-10-09T15:39:22.293471+0000","last_unstale":"2023-10-09T15:39:22.293768+0000","last_undegraded":"2023-10-09T15:39:22.293768+0000","last_fullsized":"2023-10-09T15:39:22.293768+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:24.349440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309023+0000","last_change":"2023-10-09T15:39:22.305071+0000","last_active":"2023-10-09T15:39:22.309023+0000","last_peered":"2023-10-09T15:39:22.309023+0000","last_clean":"2023-10-09T15:39:22.309023+0000","last_became_active":"2023-10-09T15:39:22.304737+0000","last_became_peered":"2023-10-09T15:39:22.304737+0000","last_unstale":"2023-10-09T15:39:22.309023+0000","last_undegraded":"2023-10-09T15:39:22.309023+0000","last_fullsized":"2023-10-09T15:39:22.309023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:01:25.730564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731604+0000","last_change":"2023-10-09T15:39:21.730823+0000","last_active":"2023-10-09T15:39:22.731604+0000","last_peered":"2023-10-09T15:39:22.731604+0000","last_clean":"2023-10-09T15:39:22.731604+0000","last_became_active":"2023-10-09T15:39:21.730516+0000","last_became_peered":"2023-10-09T15:39:21.730516+0000","last_unstale":"2023-10-09T15:39:22.731604+0000","last_undegraded":"2023-10-09T15:39:22.731604+0000","last_fullsized":"2023-10-09T15:39:22.731604+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:10.783035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304047+0000","last_change":"2023-10-09T15:39:22.303516+0000","last_active":"2023-10-09T15:39:22.304047+0000","last_peered":"2023-10-09T15:39:22.304047+0000","last_clean":"2023-10-09T15:39:22.304047+0000","last_became_active":"2023-10-09T15:39:22.303237+0000","last_became_peered":"2023-10-09T15:39:22.303237+0000","last_unstale":"2023-10-09T15:39:22.304047+0000","last_undegraded":"2023-10-09T15:39:22.304047+0000","last_fullsized":"2023-10-09T15:39:22.304047+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:16:08.053665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301512+0000","last_change":"2023-10-09T15:39:21.727174+0000","last_active":"2023-10-09T15:39:22.301512+0000","last_peered":"2023-10-09T15:39:22.301512+0000","last_clean":"2023-10-09T15:39:22.301512+0000","last_became_active":"2023-10-09T15:39:21.726840+0000","last_became_peered":"2023-10-09T15:39:21.726840+0000","last_unstale":"2023-10-09T15:39:22.301512+0000","last_undegraded":"2023-10-09T15:39:22.301512+0000","last_fullsized":"2023-10-09T15:39:22.301512+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:45.080442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293463+0000","last_change":"2023-10-09T15:39:22.293463+0000","last_active":"2023-10-09T15:39:22.293463+0000","last_peered":"2023-10-09T15:39:22.293463+0000","last_clean":"2023-10-09T15:39:22.293463+0000","last_became_active":"2023-10-09T15:39:22.293159+0000","last_became_peered":"2023-10-09T15:39:22.293159+0000","last_unstale":"2023-10-09T15:39:22.293463+0000","last_undegraded":"2023-10-09T15:39:22.293463+0000","last_fullsized":"2023-10-09T15:39:22.293463+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:26.036104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730765+0000","last_change":"2023-10-09T15:39:21.728792+0000","last_active":"2023-10-09T15:39:22.730765+0000","last_peered":"2023-10-09T15:39:22.730765+0000","last_clean":"2023-10-09T15:39:22.730765+0000","last_became_active":"2023-10-09T15:39:21.728510+0000","last_became_peered":"2023-10-09T15:39:21.728510+0000","last_unstale":"2023-10-09T15:39:22.730765+0000","last_undegraded":"2023-10-09T15:39:22.730765+0000","last_fullsized":"2023-10-09T15:39:22.730765+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:14.315670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309088+0000","last_change":"2023-10-09T15:39:22.308151+0000","last_active":"2023-10-09T15:39:22.309088+0000","last_peered":"2023-10-09T15:39:22.309088+0000","last_clean":"2023-10-09T15:39:22.309088+0000","last_became_active":"2023-10-09T15:39:22.307867+0000","last_became_peered":"2023-10-09T15:39:22.307867+0000","last_unstale":"2023-10-09T15:39:22.309088+0000","last_undegraded":"2023-10-09T15:39:22.309088+0000","last_fullsized":"2023-10-09T15:39:22.309088+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:18:14.515164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730904+0000","last_change":"2023-10-09T15:39:21.726206+0000","last_active":"2023-10-09T15:39:22.730904+0000","last_peered":"2023-10-09T15:39:22.730904+0000","last_clean":"2023-10-09T15:39:22.730904+0000","last_became_active":"2023-10-09T15:39:21.725936+0000","last_became_peered":"2023-10-09T15:39:21.725936+0000","last_unstale":"2023-10-09T15:39:22.730904+0000","last_undegraded":"2023-10-09T15:39:22.730904+0000","last_fullsized":"2023-10-09T15:39:22.730904+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:24.869137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304619+0000","last_change":"2023-10-09T15:39:22.304619+0000","last_active":"2023-10-09T15:39:22.304619+0000","last_peered":"2023-10-09T15:39:22.304619+0000","last_clean":"2023-10-09T15:39:22.304619+0000","last_became_active":"2023-10-09T15:39:22.304276+0000","last_became_peered":"2023-10-09T15:39:22.304276+0000","last_unstale":"2023-10-09T15:39:22.304619+0000","last_undegraded":"2023-10-09T15:39:22.304619+0000","last_fullsized":"2023-10-09T15:39:22.304619+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:31.422628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730326+0000","last_change":"2023-10-09T15:39:21.726853+0000","last_active":"2023-10-09T15:39:22.730326+0000","last_peered":"2023-10-09T15:39:22.730326+0000","last_clean":"2023-10-09T15:39:22.730326+0000","last_became_active":"2023-10-09T15:39:21.726596+0000","last_became_peered":"2023-10-09T15:39:21.726596+0000","last_unstale":"2023-10-09T15:39:22.730326+0000","last_undegraded":"2023-10-09T15:39:22.730326+0000","last_fullsized":"2023-10-09T15:39:22.730326+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:40.448248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299908+0000","last_change":"2023-10-09T15:39:22.299908+0000","last_active":"2023-10-09T15:39:22.299908+0000","last_peered":"2023-10-09T15:39:22.299908+0000","last_clean":"2023-10-09T15:39:22.299908+0000","last_became_active":"2023-10-09T15:39:22.299458+0000","last_became_peered":"2023-10-09T15:39:22.299458+0000","last_unstale":"2023-10-09T15:39:22.299908+0000","last_undegraded":"2023-10-09T15:39:22.299908+0000","last_fullsized":"2023-10-09T15:39:22.299908+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:24.349440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732650+0000","last_change":"2023-10-09T15:39:21.730819+0000","last_active":"2023-10-09T15:39:21.732650+0000","last_peered":"2023-10-09T15:39:21.732650+0000","last_clean":"2023-10-09T15:39:21.732650+0000","last_became_active":"2023-10-09T15:39:21.728928+0000","last_became_peered":"2023-10-09T15:39:21.728928+0000","last_unstale":"2023-10-09T15:39:21.732650+0000","last_undegraded":"2023-10-09T15:39:21.732650+0000","last_fullsized":"2023-10-09T15:39:21.732650+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:26.752607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308670+0000","last_change":"2023-10-09T15:39:22.308670+0000","last_active":"2023-10-09T15:39:22.308670+0000","last_peered":"2023-10-09T15:39:22.308670+0000","last_clean":"2023-10-09T15:39:22.308670+0000","last_became_active":"2023-10-09T15:39:22.308280+0000","last_became_peered":"2023-10-09T15:39:22.308280+0000","last_unstale":"2023-10-09T15:39:22.308670+0000","last_undegraded":"2023-10-09T15:39:22.308670+0000","last_fullsized":"2023-10-09T15:39:22.308670+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:32.632052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.728487+0000","last_change":"2023-10-09T15:39:21.727258+0000","last_active":"2023-10-09T15:39:21.728487+0000","last_peered":"2023-10-09T15:39:21.728487+0000","last_clean":"2023-10-09T15:39:21.728487+0000","last_became_active":"2023-10-09T15:39:21.727003+0000","last_became_peered":"2023-10-09T15:39:21.727003+0000","last_unstale":"2023-10-09T15:39:21.728487+0000","last_undegraded":"2023-10-09T15:39:21.728487+0000","last_fullsized":"2023-10-09T15:39:21.728487+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:18:13.510875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309392+0000","last_change":"2023-10-09T15:39:22.309392+0000","last_active":"2023-10-09T15:39:22.309392+0000","last_peered":"2023-10-09T15:39:22.309392+0000","last_clean":"2023-10-09T15:39:22.309392+0000","last_became_active":"2023-10-09T15:39:22.308911+0000","last_became_peered":"2023-10-09T15:39:22.308911+0000","last_unstale":"2023-10-09T15:39:22.309392+0000","last_undegraded":"2023-10-09T15:39:22.309392+0000","last_fullsized":"2023-10-09T15:39:22.309392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:35.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297693+0000","last_change":"2023-10-09T15:39:21.732365+0000","last_active":"2023-10-09T15:39:22.297693+0000","last_peered":"2023-10-09T15:39:22.297693+0000","last_clean":"2023-10-09T15:39:22.297693+0000","last_became_active":"2023-10-09T15:39:21.732031+0000","last_became_peered":"2023-10-09T15:39:21.732031+0000","last_unstale":"2023-10-09T15:39:22.297693+0000","last_undegraded":"2023-10-09T15:39:22.297693+0000","last_fullsized":"2023-10-09T15:39:22.297693+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:25.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308018+0000","last_change":"2023-10-09T15:39:22.306384+0000","last_active":"2023-10-09T15:39:22.308018+0000","last_peered":"2023-10-09T15:39:22.308018+0000","last_clean":"2023-10-09T15:39:22.308018+0000","last_became_active":"2023-10-09T15:39:22.304956+0000","last_became_peered":"2023-10-09T15:39:22.304956+0000","last_unstale":"2023-10-09T15:39:22.308018+0000","last_undegraded":"2023-10-09T15:39:22.308018+0000","last_fullsized":"2023-10-09T15:39:22.308018+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:03.589870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.724689+0000","last_change":"2023-10-09T15:39:21.721103+0000","last_active":"2023-10-09T15:39:21.724689+0000","last_peered":"2023-10-09T15:39:21.724689+0000","last_clean":"2023-10-09T15:39:21.724689+0000","last_became_active":"2023-10-09T15:39:21.720813+0000","last_became_peered":"2023-10-09T15:39:21.720813+0000","last_unstale":"2023-10-09T15:39:21.724689+0000","last_undegraded":"2023-10-09T15:39:21.724689+0000","last_fullsized":"2023-10-09T15:39:21.724689+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:23.940000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.294564+0000","last_change":"2023-10-09T15:39:22.294564+0000","last_active":"2023-10-09T15:39:22.294564+0000","last_peered":"2023-10-09T15:39:22.294564+0000","last_clean":"2023-10-09T15:39:22.294564+0000","last_became_active":"2023-10-09T15:39:22.294250+0000","last_became_peered":"2023-10-09T15:39:22.294250+0000","last_unstale":"2023-10-09T15:39:22.294564+0000","last_undegraded":"2023-10-09T15:39:22.294564+0000","last_fullsized":"2023-10-09T15:39:22.294564+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:15.319958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731164+0000","last_change":"2023-10-09T15:39:21.724948+0000","last_active":"2023-10-09T15:39:22.731164+0000","last_peered":"2023-10-09T15:39:22.731164+0000","last_clean":"2023-10-09T15:39:22.731164+0000","last_became_active":"2023-10-09T15:39:21.724615+0000","last_became_peered":"2023-10-09T15:39:21.724615+0000","last_unstale":"2023-10-09T15:39:22.731164+0000","last_undegraded":"2023-10-09T15:39:22.731164+0000","last_fullsized":"2023-10-09T15:39:22.731164+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:15.653055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307780+0000","last_change":"2023-10-09T15:39:22.305943+0000","last_active":"2023-10-09T15:39:22.307780+0000","last_peered":"2023-10-09T15:39:22.307780+0000","last_clean":"2023-10-09T15:39:22.307780+0000","last_became_active":"2023-10-09T15:39:22.305595+0000","last_became_peered":"2023-10-09T15:39:22.305595+0000","last_unstale":"2023-10-09T15:39:22.307780+0000","last_undegraded":"2023-10-09T15:39:22.307780+0000","last_fullsized":"2023-10-09T15:39:22.307780+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:45.047374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.734082+0000","last_change":"2023-10-09T15:39:21.720704+0000","last_active":"2023-10-09T15:39:22.734082+0000","last_peered":"2023-10-09T15:39:22.734082+0000","last_clean":"2023-10-09T15:39:22.734082+0000","last_became_active":"2023-10-09T15:39:21.720463+0000","last_became_peered":"2023-10-09T15:39:21.720463+0000","last_unstale":"2023-10-09T15:39:22.734082+0000","last_undegraded":"2023-10-09T15:39:22.734082+0000","last_fullsized":"2023-10-09T15:39:22.734082+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:04.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297812+0000","last_change":"2023-10-09T15:39:22.297812+0000","last_active":"2023-10-09T15:39:22.297812+0000","last_peered":"2023-10-09T15:39:22.297812+0000","last_clean":"2023-10-09T15:39:22.297812+0000","last_became_active":"2023-10-09T15:39:22.297521+0000","last_became_peered":"2023-10-09T15:39:22.297521+0000","last_unstale":"2023-10-09T15:39:22.297812+0000","last_undegraded":"2023-10-09T15:39:22.297812+0000","last_fullsized":"2023-10-09T15:39:22.297812+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:15.312414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731700+0000","last_change":"2023-10-09T15:39:21.726737+0000","last_active":"2023-10-09T15:39:22.731700+0000","last_peered":"2023-10-09T15:39:22.731700+0000","last_clean":"2023-10-09T15:39:22.731700+0000","last_became_active":"2023-10-09T15:39:21.726489+0000","last_became_peered":"2023-10-09T15:39:21.726489+0000","last_unstale":"2023-10-09T15:39:22.731700+0000","last_undegraded":"2023-10-09T15:39:22.731700+0000","last_fullsized":"2023-10-09T15:39:22.731700+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:13.157884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307548+0000","last_change":"2023-10-09T15:39:22.299694+0000","last_active":"2023-10-09T15:39:22.307548+0000","last_peered":"2023-10-09T15:39:22.307548+0000","last_clean":"2023-10-09T15:39:22.307548+0000","last_became_active":"2023-10-09T15:39:22.299411+0000","last_became_peered":"2023-10-09T15:39:22.299411+0000","last_unstale":"2023-10-09T15:39:22.307548+0000","last_undegraded":"2023-10-09T15:39:22.307548+0000","last_fullsized":"2023-10-09T15:39:22.307548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:16.657344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.733315+0000","last_change":"2023-10-09T15:39:21.730759+0000","last_active":"2023-10-09T15:39:21.733315+0000","last_peered":"2023-10-09T15:39:21.733315+0000","last_clean":"2023-10-09T15:39:21.733315+0000","last_became_active":"2023-10-09T15:39:21.728851+0000","last_became_peered":"2023-10-09T15:39:21.728851+0000","last_unstale":"2023-10-09T15:39:21.733315+0000","last_undegraded":"2023-10-09T15:39:21.733315+0000","last_fullsized":"2023-10-09T15:39:21.733315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:23:33.838750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.311608+0000","last_change":"2023-10-09T15:39:22.307750+0000","last_active":"2023-10-09T15:39:22.311608+0000","last_peered":"2023-10-09T15:39:22.311608+0000","last_clean":"2023-10-09T15:39:22.311608+0000","last_became_active":"2023-10-09T15:39:22.307443+0000","last_became_peered":"2023-10-09T15:39:22.307443+0000","last_unstale":"2023-10-09T15:39:22.311608+0000","last_undegraded":"2023-10-09T15:39:22.311608+0000","last_fullsized":"2023-10-09T15:39:22.311608+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:31.112993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.729050+0000","last_change":"2023-10-09T15:39:21.727640+0000","last_active":"2023-10-09T15:39:21.729050+0000","last_peered":"2023-10-09T15:39:21.729050+0000","last_clean":"2023-10-09T15:39:21.729050+0000","last_became_active":"2023-10-09T15:39:21.727369+0000","last_became_peered":"2023-10-09T15:39:21.727369+0000","last_unstale":"2023-10-09T15:39:21.729050+0000","last_undegraded":"2023-10-09T15:39:21.729050+0000","last_fullsized":"2023-10-09T15:39:21.729050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:29.160826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293108+0000","last_change":"2023-10-09T15:39:22.293108+0000","last_active":"2023-10-09T15:39:22.293108+0000","last_peered":"2023-10-09T15:39:22.293108+0000","last_clean":"2023-10-09T15:39:22.293108+0000","last_became_active":"2023-10-09T15:39:22.292695+0000","last_became_peered":"2023-10-09T15:39:22.292695+0000","last_unstale":"2023-10-09T15:39:22.293108+0000","last_undegraded":"2023-10-09T15:39:22.293108+0000","last_fullsized":"2023-10-09T15:39:22.293108+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:46.084730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.732019+0000","last_change":"2023-10-09T15:39:21.725847+0000","last_active":"2023-10-09T15:39:22.732019+0000","last_peered":"2023-10-09T15:39:22.732019+0000","last_clean":"2023-10-09T15:39:22.732019+0000","last_became_active":"2023-10-09T15:39:21.725549+0000","last_became_peered":"2023-10-09T15:39:21.725549+0000","last_unstale":"2023-10-09T15:39:22.732019+0000","last_undegraded":"2023-10-09T15:39:22.732019+0000","last_fullsized":"2023-10-09T15:39:22.732019+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:20.865149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.300190+0000","last_change":"2023-10-09T15:39:22.294767+0000","last_active":"2023-10-09T15:39:22.300190+0000","last_peered":"2023-10-09T15:39:22.300190+0000","last_clean":"2023-10-09T15:39:22.300190+0000","last_became_active":"2023-10-09T15:39:22.294524+0000","last_became_peered":"2023-10-09T15:39:22.294524+0000","last_unstale":"2023-10-09T15:39:22.300190+0000","last_undegraded":"2023-10-09T15:39:22.300190+0000","last_fullsized":"2023-10-09T15:39:22.300190+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:29.018018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.728222+0000","last_change":"2023-10-09T15:39:21.727519+0000","last_active":"2023-10-09T15:39:22.728222+0000","last_peered":"2023-10-09T15:39:22.728222+0000","last_clean":"2023-10-09T15:39:22.728222+0000","last_became_active":"2023-10-09T15:39:21.727171+0000","last_became_peered":"2023-10-09T15:39:21.727171+0000","last_unstale":"2023-10-09T15:39:22.728222+0000","last_undegraded":"2023-10-09T15:39:22.728222+0000","last_fullsized":"2023-10-09T15:39:22.728222+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:44.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293682+0000","last_change":"2023-10-09T15:39:22.293682+0000","last_active":"2023-10-09T15:39:22.293682+0000","last_peered":"2023-10-09T15:39:22.293682+0000","last_clean":"2023-10-09T15:39:22.293682+0000","last_became_active":"2023-10-09T15:39:22.293297+0000","last_became_peered":"2023-10-09T15:39:22.293297+0000","last_unstale":"2023-10-09T15:39:22.293682+0000","last_undegraded":"2023-10-09T15:39:22.293682+0000","last_fullsized":"2023-10-09T15:39:22.293682+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:56.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.728729+0000","last_change":"2023-10-09T15:39:21.731194+0000","last_active":"2023-10-09T15:39:22.728729+0000","last_peered":"2023-10-09T15:39:22.728729+0000","last_clean":"2023-10-09T15:39:22.728729+0000","last_became_active":"2023-10-09T15:39:21.730951+0000","last_became_peered":"2023-10-09T15:39:21.730951+0000","last_unstale":"2023-10-09T15:39:22.728729+0000","last_undegraded":"2023-10-09T15:39:22.728729+0000","last_fullsized":"2023-10-09T15:39:22.728729+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:29.814944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306973+0000","last_change":"2023-10-09T15:39:22.298470+0000","last_active":"2023-10-09T15:39:22.306973+0000","last_peered":"2023-10-09T15:39:22.306973+0000","last_clean":"2023-10-09T15:39:22.306973+0000","last_became_active":"2023-10-09T15:39:22.298148+0000","last_became_peered":"2023-10-09T15:39:22.298148+0000","last_unstale":"2023-10-09T15:39:22.306973+0000","last_undegraded":"2023-10-09T15:39:22.306973+0000","last_fullsized":"2023-10-09T15:39:22.306973+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:32.632052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731348+0000","last_change":"2023-10-09T15:39:21.728462+0000","last_active":"2023-10-09T15:39:22.731348+0000","last_peered":"2023-10-09T15:39:22.731348+0000","last_clean":"2023-10-09T15:39:22.731348+0000","last_became_active":"2023-10-09T15:39:21.728167+0000","last_became_peered":"2023-10-09T15:39:21.728167+0000","last_unstale":"2023-10-09T15:39:22.731348+0000","last_undegraded":"2023-10-09T15:39:22.731348+0000","last_fullsized":"2023-10-09T15:39:22.731348+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:50.522170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307926+0000","last_change":"2023-10-09T15:39:22.298662+0000","last_active":"2023-10-09T15:39:22.307926+0000","last_peered":"2023-10-09T15:39:22.307926+0000","last_clean":"2023-10-09T15:39:22.307926+0000","last_became_active":"2023-10-09T15:39:22.298348+0000","last_became_peered":"2023-10-09T15:39:22.298348+0000","last_unstale":"2023-10-09T15:39:22.307926+0000","last_undegraded":"2023-10-09T15:39:22.307926+0000","last_fullsized":"2023-10-09T15:39:22.307926+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:38.600738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.730443+0000","last_change":"2023-10-09T15:39:21.728921+0000","last_active":"2023-10-09T15:39:21.730443+0000","last_peered":"2023-10-09T15:39:21.730443+0000","last_clean":"2023-10-09T15:39:21.730443+0000","last_became_active":"2023-10-09T15:39:21.728312+0000","last_became_peered":"2023-10-09T15:39:21.728312+0000","last_unstale":"2023-10-09T15:39:21.730443+0000","last_undegraded":"2023-10-09T15:39:21.730443+0000","last_fullsized":"2023-10-09T15:39:21.730443+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:44.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301967+0000","last_change":"2023-10-09T15:39:22.301967+0000","last_active":"2023-10-09T15:39:22.301967+0000","last_peered":"2023-10-09T15:39:22.301967+0000","last_clean":"2023-10-09T15:39:22.301967+0000","last_became_active":"2023-10-09T15:39:22.301573+0000","last_became_peered":"2023-10-09T15:39:22.301573+0000","last_unstale":"2023-10-09T15:39:22.301967+0000","last_undegraded":"2023-10-09T15:39:22.301967+0000","last_fullsized":"2023-10-09T15:39:22.301967+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:14.347884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731291+0000","last_change":"2023-10-09T15:39:21.726671+0000","last_active":"2023-10-09T15:39:22.731291+0000","last_peered":"2023-10-09T15:39:22.731291+0000","last_clean":"2023-10-09T15:39:22.731291+0000","last_became_active":"2023-10-09T15:39:21.726403+0000","last_became_peered":"2023-10-09T15:39:21.726403+0000","last_unstale":"2023-10-09T15:39:22.731291+0000","last_undegraded":"2023-10-09T15:39:22.731291+0000","last_fullsized":"2023-10-09T15:39:22.731291+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:13.214705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.310508+0000","last_change":"2023-10-09T15:39:22.305971+0000","last_active":"2023-10-09T15:39:22.310508+0000","last_peered":"2023-10-09T15:39:22.310508+0000","last_clean":"2023-10-09T15:39:22.310508+0000","last_became_active":"2023-10-09T15:39:22.305468+0000","last_became_peered":"2023-10-09T15:39:22.305468+0000","last_unstale":"2023-10-09T15:39:22.310508+0000","last_undegraded":"2023-10-09T15:39:22.310508+0000","last_fullsized":"2023-10-09T15:39:22.310508+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:30.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732338+0000","last_change":"2023-10-09T15:39:21.728059+0000","last_active":"2023-10-09T15:39:21.732338+0000","last_peered":"2023-10-09T15:39:21.732338+0000","last_clean":"2023-10-09T15:39:21.732338+0000","last_became_active":"2023-10-09T15:39:21.727660+0000","last_became_peered":"2023-10-09T15:39:21.727660+0000","last_unstale":"2023-10-09T15:39:21.732338+0000","last_undegraded":"2023-10-09T15:39:21.732338+0000","last_fullsized":"2023-10-09T15:39:21.732338+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:38.954417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297302+0000","last_change":"2023-10-09T15:39:22.292965+0000","last_active":"2023-10-09T15:39:22.297302+0000","last_peered":"2023-10-09T15:39:22.297302+0000","last_clean":"2023-10-09T15:39:22.297302+0000","last_became_active":"2023-10-09T15:39:22.292711+0000","last_became_peered":"2023-10-09T15:39:22.292711+0000","last_unstale":"2023-10-09T15:39:22.297302+0000","last_undegraded":"2023-10-09T15:39:22.297302+0000","last_fullsized":"2023-10-09T15:39:22.297302+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:08.501440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732581+0000","last_change":"2023-10-09T15:39:21.729540+0000","last_active":"2023-10-09T15:39:21.732581+0000","last_peered":"2023-10-09T15:39:21.732581+0000","last_clean":"2023-10-09T15:39:21.732581+0000","last_became_active":"2023-10-09T15:39:21.729249+0000","last_became_peered":"2023-10-09T15:39:21.729249+0000","last_unstale":"2023-10-09T15:39:21.732581+0000","last_undegraded":"2023-10-09T15:39:21.732581+0000","last_fullsized":"2023-10-09T15:39:21.732581+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:32.584487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307485+0000","last_change":"2023-10-09T15:39:22.307485+0000","last_active":"2023-10-09T15:39:22.307485+0000","last_peered":"2023-10-09T15:39:22.307485+0000","last_clean":"2023-10-09T15:39:22.307485+0000","last_became_active":"2023-10-09T15:39:22.307170+0000","last_became_peered":"2023-10-09T15:39:22.307170+0000","last_unstale":"2023-10-09T15:39:22.307485+0000","last_undegraded":"2023-10-09T15:39:22.307485+0000","last_fullsized":"2023-10-09T15:39:22.307485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:45.047374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.288338+0000","last_change":"2023-10-09T15:39:21.728828+0000","last_active":"2023-10-09T15:39:22.288338+0000","last_peered":"2023-10-09T15:39:22.288338+0000","last_clean":"2023-10-09T15:39:22.288338+0000","last_became_active":"2023-10-09T15:39:21.728487+0000","last_became_peered":"2023-10-09T15:39:21.728487+0000","last_unstale":"2023-10-09T15:39:22.288338+0000","last_undegraded":"2023-10-09T15:39:22.288338+0000","last_fullsized":"2023-10-09T15:39:22.288338+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:26.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306956+0000","last_change":"2023-10-09T15:39:22.306956+0000","last_active":"2023-10-09T15:39:22.306956+0000","last_peered":"2023-10-09T15:39:22.306956+0000","last_clean":"2023-10-09T15:39:22.306956+0000","last_became_active":"2023-10-09T15:39:22.306746+0000","last_became_peered":"2023-10-09T15:39:22.306746+0000","last_unstale":"2023-10-09T15:39:22.306956+0000","last_undegraded":"2023-10-09T15:39:22.306956+0000","last_fullsized":"2023-10-09T15:39:22.306956+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:03.589870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731623+0000","last_change":"2023-10-09T15:39:21.731749+0000","last_active":"2023-10-09T15:39:22.731623+0000","last_peered":"2023-10-09T15:39:22.731623+0000","last_clean":"2023-10-09T15:39:22.731623+0000","last_became_active":"2023-10-09T15:39:21.731539+0000","last_became_peered":"2023-10-09T15:39:21.731539+0000","last_unstale":"2023-10-09T15:39:22.731623+0000","last_undegraded":"2023-10-09T15:39:22.731623+0000","last_fullsized":"2023-10-09T15:39:22.731623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:37.596449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307922+0000","last_change":"2023-10-09T15:39:22.301240+0000","last_active":"2023-10-09T15:39:22.307922+0000","last_peered":"2023-10-09T15:39:22.307922+0000","last_clean":"2023-10-09T15:39:22.307922+0000","last_became_active":"2023-10-09T15:39:22.300836+0000","last_became_peered":"2023-10-09T15:39:22.300836+0000","last_unstale":"2023-10-09T15:39:22.307922+0000","last_undegraded":"2023-10-09T15:39:22.307922+0000","last_fullsized":"2023-10-09T15:39:22.307922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:42.047111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297965+0000","last_change":"2023-10-09T15:39:21.729930+0000","last_active":"2023-10-09T15:39:22.297965+0000","last_peered":"2023-10-09T15:39:22.297965+0000","last_clean":"2023-10-09T15:39:22.297965+0000","last_became_active":"2023-10-09T15:39:21.729648+0000","last_became_peered":"2023-10-09T15:39:21.729648+0000","last_unstale":"2023-10-09T15:39:22.297965+0000","last_undegraded":"2023-10-09T15:39:22.297965+0000","last_fullsized":"2023-10-09T15:39:22.297965+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:04.465878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308863+0000","last_change":"2023-10-09T15:39:22.305075+0000","last_active":"2023-10-09T15:39:22.308863+0000","last_peered":"2023-10-09T15:39:22.308863+0000","last_clean":"2023-10-09T15:39:22.308863+0000","last_became_active":"2023-10-09T15:39:22.304800+0000","last_became_peered":"2023-10-09T15:39:22.304800+0000","last_unstale":"2023-10-09T15:39:22.308863+0000","last_undegraded":"2023-10-09T15:39:22.308863+0000","last_fullsized":"2023-10-09T15:39:22.308863+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:46.431870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.295674+0000","last_change":"2023-10-09T15:39:21.730612+0000","last_active":"2023-10-09T15:39:22.295674+0000","last_peered":"2023-10-09T15:39:22.295674+0000","last_clean":"2023-10-09T15:39:22.295674+0000","last_became_active":"2023-10-09T15:39:21.730301+0000","last_became_peered":"2023-10-09T15:39:21.730301+0000","last_unstale":"2023-10-09T15:39:22.295674+0000","last_undegraded":"2023-10-09T15:39:22.295674+0000","last_fullsized":"2023-10-09T15:39:22.295674+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:30.108704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.296754+0000","last_change":"2023-10-09T15:39:22.296754+0000","last_active":"2023-10-09T15:39:22.296754+0000","last_peered":"2023-10-09T15:39:22.296754+0000","last_clean":"2023-10-09T15:39:22.296754+0000","last_became_active":"2023-10-09T15:39:22.296499+0000","last_became_peered":"2023-10-09T15:39:22.296499+0000","last_unstale":"2023-10-09T15:39:22.296754+0000","last_undegraded":"2023-10-09T15:39:22.296754+0000","last_fullsized":"2023-10-09T15:39:22.296754+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:21.174448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.290653+0000","last_change":"2023-10-09T15:39:21.727208+0000","last_active":"2023-10-09T15:39:22.290653+0000","last_peered":"2023-10-09T15:39:22.290653+0000","last_clean":"2023-10-09T15:39:22.290653+0000","last_became_active":"2023-10-09T15:39:21.726334+0000","last_became_peered":"2023-10-09T15:39:21.726334+0000","last_unstale":"2023-10-09T15:39:22.290653+0000","last_undegraded":"2023-10-09T15:39:22.290653+0000","last_fullsized":"2023-10-09T15:39:22.290653+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:11.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305112+0000","last_change":"2023-10-09T15:39:22.305112+0000","last_active":"2023-10-09T15:39:22.305112+0000","last_peered":"2023-10-09T15:39:22.305112+0000","last_clean":"2023-10-09T15:39:22.305112+0000","last_became_active":"2023-10-09T15:39:22.304795+0000","last_became_peered":"2023-10-09T15:39:22.304795+0000","last_unstale":"2023-10-09T15:39:22.305112+0000","last_undegraded":"2023-10-09T15:39:22.305112+0000","last_fullsized":"2023-10-09T15:39:22.305112+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:07.478597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.733139+0000","last_change":"2023-10-09T15:39:21.731332+0000","last_active":"2023-10-09T15:39:21.733139+0000","last_peered":"2023-10-09T15:39:21.733139+0000","last_clean":"2023-10-09T15:39:21.733139+0000","last_became_active":"2023-10-09T15:39:21.730896+0000","last_became_peered":"2023-10-09T15:39:21.730896+0000","last_unstale":"2023-10-09T15:39:21.733139+0000","last_undegraded":"2023-10-09T15:39:21.733139+0000","last_fullsized":"2023-10-09T15:39:21.733139+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:42.645884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307528+0000","last_change":"2023-10-09T15:39:22.299589+0000","last_active":"2023-10-09T15:39:22.307528+0000","last_peered":"2023-10-09T15:39:22.307528+0000","last_clean":"2023-10-09T15:39:22.307528+0000","last_became_active":"2023-10-09T15:39:22.299312+0000","last_became_peered":"2023-10-09T15:39:22.299312+0000","last_unstale":"2023-10-09T15:39:22.307528+0000","last_undegraded":"2023-10-09T15:39:22.307528+0000","last_fullsized":"2023-10-09T15:39:22.307528+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:07.478597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.726858+0000","last_change":"2023-10-09T15:39:21.725346+0000","last_active":"2023-10-09T15:39:21.726858+0000","last_peered":"2023-10-09T15:39:21.726858+0000","last_clean":"2023-10-09T15:39:21.726858+0000","last_became_active":"2023-10-09T15:39:21.724903+0000","last_became_peered":"2023-10-09T15:39:21.724903+0000","last_unstale":"2023-10-09T15:39:21.726858+0000","last_undegraded":"2023-10-09T15:39:21.726858+0000","last_fullsized":"2023-10-09T15:39:21.726858+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:28.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.311589+0000","last_change":"2023-10-09T15:39:22.307709+0000","last_active":"2023-10-09T15:39:22.311589+0000","last_peered":"2023-10-09T15:39:22.311589+0000","last_clean":"2023-10-09T15:39:22.311589+0000","last_became_active":"2023-10-09T15:39:22.307115+0000","last_became_peered":"2023-10-09T15:39:22.307115+0000","last_unstale":"2023-10-09T15:39:22.311589+0000","last_undegraded":"2023-10-09T15:39:22.311589+0000","last_fullsized":"2023-10-09T15:39:22.311589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:31.780681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.731037+0000","last_change":"2023-10-09T15:39:21.730035+0000","last_active":"2023-10-09T15:39:21.731037+0000","last_peered":"2023-10-09T15:39:21.731037+0000","last_clean":"2023-10-09T15:39:21.731037+0000","last_became_active":"2023-10-09T15:39:21.729488+0000","last_became_peered":"2023-10-09T15:39:21.729488+0000","last_unstale":"2023-10-09T15:39:21.731037+0000","last_undegraded":"2023-10-09T15:39:21.731037+0000","last_fullsized":"2023-10-09T15:39:21.731037+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:01:24.726276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307156+0000","last_change":"2023-10-09T15:39:22.305552+0000","last_active":"2023-10-09T15:39:22.307156+0000","last_peered":"2023-10-09T15:39:22.307156+0000","last_clean":"2023-10-09T15:39:22.307156+0000","last_became_active":"2023-10-09T15:39:22.305248+0000","last_became_peered":"2023-10-09T15:39:22.305248+0000","last_unstale":"2023-10-09T15:39:22.307156+0000","last_undegraded":"2023-10-09T15:39:22.307156+0000","last_fullsized":"2023-10-09T15:39:22.307156+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:31.422628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.288456+0000","last_change":"2023-10-09T15:39:21.728558+0000","last_active":"2023-10-09T15:39:22.288456+0000","last_peered":"2023-10-09T15:39:22.288456+0000","last_clean":"2023-10-09T15:39:22.288456+0000","last_became_active":"2023-10-09T15:39:21.728130+0000","last_became_peered":"2023-10-09T15:39:21.728130+0000","last_unstale":"2023-10-09T15:39:22.288456+0000","last_undegraded":"2023-10-09T15:39:22.288456+0000","last_fullsized":"2023-10-09T15:39:22.288456+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:51.458524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306392+0000","last_change":"2023-10-09T15:39:22.302645+0000","last_active":"2023-10-09T15:39:22.306392+0000","last_peered":"2023-10-09T15:39:22.306392+0000","last_clean":"2023-10-09T15:39:22.306392+0000","last_became_active":"2023-10-09T15:39:22.302347+0000","last_became_peered":"2023-10-09T15:39:22.302347+0000","last_unstale":"2023-10-09T15:39:22.306392+0000","last_undegraded":"2023-10-09T15:39:22.306392+0000","last_fullsized":"2023-10-09T15:39:22.306392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:48:39.459279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731582+0000","last_change":"2023-10-09T15:39:21.728355+0000","last_active":"2023-10-09T15:39:22.731582+0000","last_peered":"2023-10-09T15:39:22.731582+0000","last_clean":"2023-10-09T15:39:22.731582+0000","last_became_active":"2023-10-09T15:39:21.728073+0000","last_became_peered":"2023-10-09T15:39:21.728073+0000","last_unstale":"2023-10-09T15:39:22.731582+0000","last_undegraded":"2023-10-09T15:39:22.731582+0000","last_fullsized":"2023-10-09T15:39:22.731582+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:13.214705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":286,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293344+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:39:22.293344+0000","last_peered":"2023-10-09T15:39:22.293344+0000","last_clean":"2023-10-09T15:39:22.293344+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:39:22.293344+0000","last_undegraded":"2023-10-09T15:39:22.293344+0000","last_fullsized":"2023-10-09T15:39:22.293344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304032,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067808,"statfs":{"total":96636764160,"available":96325435392,"internally_reserved":0,"allocated":2711552,"data_stored":1540054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.77500000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63700000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.874},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.71799999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78000000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":0.84399999999999997,"15min":0.88},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.40699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303460,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068380,"statfs":{"total":96636764160,"available":96326021120,"internally_reserved":0,"allocated":2125824,"data_stored":949742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.83699999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.78400000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53000000000000003,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":1.379},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.3999999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.73699999999999999},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.93600000000000005},"last":0.495},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.872},"last":0.52600000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.89700000000000002},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.87,"5min":0.87,"15min":1.004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33800000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.215},"max":{"1min":0.44700000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.34699999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46800000000000003,"5min":0.55300000000000005,"15min":1.512},"last":0.25}]},{"osd":2,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33200000000000002,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.437,"5min":0.56399999999999995,"15min":1.286},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.32200000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.96899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.54600000000000004,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.377,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.222},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77400000000000002,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66200000000000003,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.498},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93100000000000005,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.39300000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.76800000000000002},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.93600000000000005,"15min":1.258},"last":0.41299999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65700000000000003,"15min":0.66600000000000004},"min":{"1min":0.46700000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.996,"15min":0.997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.77300000000000002},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77100000000000002,"5min":1.024,"15min":5.5819999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1539043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54500000000000004,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55900000000000005,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.441,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":6.484,"15min":6.484},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45900000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.308}]},{"osd":3,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.495},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44,"15min":0.57599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":2.109,"15min":4.5890000000000004},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76000000000000001,"5min":1.921,"15min":1.921},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.64400000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.508},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":2.032,"15min":2.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303472,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068368,"statfs":{"total":96636764160,"available":96326008832,"internally_reserved":0,"allocated":2138112,"data_stored":951278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.44500000000000001,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.35599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.441,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.318}]},{"osd":1,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.22500000000000001},"max":{"1min":0.442,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46600000000000003,"5min":0.622,"15min":0.73699999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.46400000000000002,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.71999999999999997,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79900000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.432},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":2.5249999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90000000000000002,"5min":0.997,"15min":1.5189999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":1.0620000000000001,"15min":1.407},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":951292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.76100000000000001},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54000000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.58999999999999997},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.378,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.372,"15min":1.143},"min":{"1min":0.311,"5min":0.247,"15min":0.247},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.65900000000000003},"min":{"1min":0.29999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":0.996,"15min":17.02},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.84199999999999997},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.498,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":1.004},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.85199999999999998},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.016,"5min":1.016,"15min":1.278},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":1.044},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":9.6029999999999998},"last":1.024}]}]},{"osd":4,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":2.879},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.621},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34599999999999997},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78700000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.245,"15min":0.245},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.87},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.439,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.79400000000000004,"15min":1.165},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.45100000000000001,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.871,"15min":2.089},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.81299999999999994},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.441},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.83799999999999997},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.84299999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":1.0569999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83399999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":1.016},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.83499999999999996,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:39:26.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:39:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.999+0000 7f9020cae700 1 Processor -- start 2023-10-09T15:39:27.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:26.999+0000 7f9020cae700 1 -- start start 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f9020cae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c06add0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f9020cae700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c15be20 con 0x7f901c15abe0 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f9020cae700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f901c15b210 con 0x7f901c068050 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f9020cae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c06b310 con 0x7f901c0b2580 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f901affd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f901c15abe0 0x7f901c06c7a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48686/0 (socket says 172.21.15.33:48686) 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f901affd700 1 -- 172.21.15.33:0/4251719637 learned_addr learned my addr 172.21.15.33:0/4251719637 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:27.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.000+0000 7f901bfff700 1 --2- 172.21.15.33:0/4251719637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c06add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124970129 0 0) 0x7f901c15be20 con 0x7f901c15abe0 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9004003570 con 0x7f901c15abe0 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2616345068 0 0) 0x7f901c15b210 con 0x7f901c068050 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f901c15be20 con 0x7f901c068050 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901bfff700 1 -- 172.21.15.33:0/4251719637 >> v1:172.21.15.59:6789/0 conn(0x7f901c068050 legacy=0x7f901c15a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901bfff700 1 -- 172.21.15.33:0/4251719637 >> v1:172.21.15.33:6789/0 conn(0x7f901c15abe0 legacy=0x7f901c06c7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3102731783 0 0) 0x7f9004003570 con 0x7f901c15abe0 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901bfff700 1 -- 172.21.15.33:0/4251719637 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f901c15b4f0 con 0x7f901c0b2580 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901bfff700 1 --2- 172.21.15.33:0/4251719637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c06add0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9014009e90 tx=0x7f9014009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=730a80e1a0fe63ee server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f901400e070 con 0x7f901c0b2580 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901400b870 con 0x7f901c0b2580 2023-10-09T15:39:27.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.001+0000 7f901a7fc700 1 -- 172.21.15.33:0/4251719637 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010001470 con 0x7f901c0b2580 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 -- 172.21.15.33:0/4251719637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 msgr2=0x7f901c06add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 --2- 172.21.15.33:0/4251719637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c06add0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9014009e90 tx=0x7f9014009780 comp rx=0 tx=0).stop 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 -- 172.21.15.33:0/4251719637 shutdown_connections 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 --2- 172.21.15.33:0/4251719637 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c06add0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 -- 172.21.15.33:0/4251719637 >> 172.21.15.33:0/4251719637 conn(0x7f901c0cca00 msgr2=0x7f901c0cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 -- 172.21.15.33:0/4251719637 shutdown_connections 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.002+0000 7f9020cae700 1 -- 172.21.15.33:0/4251719637 wait complete. 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.003+0000 7f9020cae700 1 Processor -- start 2023-10-09T15:39:27.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.003+0000 7f9020cae700 1 -- start start 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c156ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 0x7f901c0cb040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0c3c30 con 0x7f901c068050 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0c3900 con 0x7f901c15abe0 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f9020cae700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f901c0aa530 con 0x7f901c0b2580 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36384/0 (socket says 172.21.15.33:36384) 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 -- 172.21.15.33:0/1904122585 learned_addr learned my addr 172.21.15.33:0/1904122585 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901affd700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c156ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901bfff700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 0x7f901c0cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 -- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 msgr2=0x7f901c156ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c156ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 -- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 msgr2=0x7f901c0cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 0x7f901c0cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 -- 172.21.15.33:0/1904122585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9014009a20 con 0x7f901c068050 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901bfff700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 0x7f901c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f901b7fe700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c790 tx=0x7f900c007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.004+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c010510 con 0x7f901c068050 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.005+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f900c010670 con 0x7f901c068050 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.005+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f901c0aa7d0 con 0x7f901c068050 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.005+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f900c010a30 con 0x7f901c068050 2023-10-09T15:39:27.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.005+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f901c0aad90 con 0x7f901c068050 2023-10-09T15:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.006+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f901c0aaf80 con 0x7f901c068050 2023-10-09T15:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.006+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f900c01b3b0 con 0x7f901c068050 2023-10-09T15:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.006+0000 7f90037fe700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 0x7f90080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.007+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f900c084490 con 0x7f901c068050 2023-10-09T15:39:27.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.007+0000 7f901affd700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 0x7f90080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.007+0000 7f901affd700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 0x7f90080697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9010001ed0 tx=0x7f9010000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.011+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f900c051120 con 0x7f901c068050 2023-10-09T15:39:27.200 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.199+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f901c0c3d70 con 0x7f9008067320 2023-10-09T15:39:27.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.208+0000 7f90037fe700 1 -- 172.21.15.33:0/1904122585 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289815 (secure 0 0 0) 0x7f9010004e60 con 0x7f9008067320 2023-10-09T15:39:27.212 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 msgr2=0x7f90080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 0x7f90080697d0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f9010001ed0 tx=0x7f9010000bc0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 msgr2=0x7f901c0a9ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f900c00c790 tx=0x7f900c007e10 comp rx=0 tx=0).stop 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 shutdown_connections 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9008067320 0x7f90080697d0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.214 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f901c068050 0x7f901c0a9ff0 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f901c15abe0 0x7f901c0cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 --2- 172.21.15.33:0/1904122585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f901c0b2580 0x7f901c156ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 >> 172.21.15.33:0/1904122585 conn(0x7f901c0cca00 msgr2=0x7f901c06c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 shutdown_connections 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.211+0000 7f9020cae700 1 -- 172.21.15.33:0/1904122585 wait complete. 2023-10-09T15:39:27.215 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:39:27.224 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":417,"stamp":"2023-10-09T15:39:25.336488+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2428816,"kb_used_data":17744,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752545904,"statfs":{"total":773094113280,"available":770607005696,"internally_reserved":0,"allocated":18169856,"data_stored":8780467,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.629390"},"pg_stats":[{"pgid":"29.3f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305800+0000","last_change":"2023-10-09T15:39:22.303544+0000","last_active":"2023-10-09T15:39:22.305800+0000","last_peered":"2023-10-09T15:39:22.305800+0000","last_clean":"2023-10-09T15:39:22.305800+0000","last_became_active":"2023-10-09T15:39:22.303183+0000","last_became_peered":"2023-10-09T15:39:22.303183+0000","last_unstale":"2023-10-09T15:39:22.305800+0000","last_undegraded":"2023-10-09T15:39:22.305800+0000","last_fullsized":"2023-10-09T15:39:22.305800+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:24.944288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.3e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309172+0000","last_change":"2023-10-09T15:39:22.309172+0000","last_active":"2023-10-09T15:39:22.309172+0000","last_peered":"2023-10-09T15:39:22.309172+0000","last_clean":"2023-10-09T15:39:22.309172+0000","last_became_active":"2023-10-09T15:39:22.308537+0000","last_became_peered":"2023-10-09T15:39:22.308537+0000","last_unstale":"2023-10-09T15:39:22.309172+0000","last_undegraded":"2023-10-09T15:39:22.309172+0000","last_fullsized":"2023-10-09T15:39:22.309172+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:46.431870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.3d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308903+0000","last_change":"2023-10-09T15:39:22.304708+0000","last_active":"2023-10-09T15:39:22.308903+0000","last_peered":"2023-10-09T15:39:22.308903+0000","last_clean":"2023-10-09T15:39:22.308903+0000","last_became_active":"2023-10-09T15:39:22.304333+0000","last_became_peered":"2023-10-09T15:39:22.304333+0000","last_unstale":"2023-10-09T15:39:22.308903+0000","last_undegraded":"2023-10-09T15:39:22.308903+0000","last_fullsized":"2023-10-09T15:39:22.308903+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:05.470167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.3c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305059+0000","last_change":"2023-10-09T15:39:22.305059+0000","last_active":"2023-10-09T15:39:22.305059+0000","last_peered":"2023-10-09T15:39:22.305059+0000","last_clean":"2023-10-09T15:39:22.305059+0000","last_became_active":"2023-10-09T15:39:22.304775+0000","last_became_peered":"2023-10-09T15:39:22.304775+0000","last_unstale":"2023-10-09T15:39:22.305059+0000","last_undegraded":"2023-10-09T15:39:22.305059+0000","last_fullsized":"2023-10-09T15:39:22.305059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:05.268592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301235+0000","last_change":"2023-10-09T15:39:22.301235+0000","last_active":"2023-10-09T15:39:22.301235+0000","last_peered":"2023-10-09T15:39:22.301235+0000","last_clean":"2023-10-09T15:39:22.301235+0000","last_became_active":"2023-10-09T15:39:22.300982+0000","last_became_peered":"2023-10-09T15:39:22.300982+0000","last_unstale":"2023-10-09T15:39:22.301235+0000","last_undegraded":"2023-10-09T15:39:22.301235+0000","last_fullsized":"2023-10-09T15:39:22.301235+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:38:47.854739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.3a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297939+0000","last_change":"2023-10-09T15:39:22.297939+0000","last_active":"2023-10-09T15:39:22.297939+0000","last_peered":"2023-10-09T15:39:22.297939+0000","last_clean":"2023-10-09T15:39:22.297939+0000","last_became_active":"2023-10-09T15:39:22.297638+0000","last_became_peered":"2023-10-09T15:39:22.297638+0000","last_unstale":"2023-10-09T15:39:22.297939+0000","last_undegraded":"2023-10-09T15:39:22.297939+0000","last_fullsized":"2023-10-09T15:39:22.297939+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:15.312414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.39","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308019+0000","last_change":"2023-10-09T15:39:22.304030+0000","last_active":"2023-10-09T15:39:22.308019+0000","last_peered":"2023-10-09T15:39:22.308019+0000","last_clean":"2023-10-09T15:39:22.308019+0000","last_became_active":"2023-10-09T15:39:22.303566+0000","last_became_peered":"2023-10-09T15:39:22.303566+0000","last_unstale":"2023-10-09T15:39:22.308019+0000","last_undegraded":"2023-10-09T15:39:22.308019+0000","last_fullsized":"2023-10-09T15:39:22.308019+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:51.526459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.38","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302875+0000","last_change":"2023-10-09T15:39:22.302564+0000","last_active":"2023-10-09T15:39:22.302875+0000","last_peered":"2023-10-09T15:39:22.302875+0000","last_clean":"2023-10-09T15:39:22.302875+0000","last_became_active":"2023-10-09T15:39:22.302053+0000","last_became_peered":"2023-10-09T15:39:22.302053+0000","last_unstale":"2023-10-09T15:39:22.302875+0000","last_undegraded":"2023-10-09T15:39:22.302875+0000","last_fullsized":"2023-10-09T15:39:22.302875+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:53.853851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.37","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.310531+0000","last_change":"2023-10-09T15:39:22.306416+0000","last_active":"2023-10-09T15:39:22.310531+0000","last_peered":"2023-10-09T15:39:22.310531+0000","last_clean":"2023-10-09T15:39:22.310531+0000","last_became_active":"2023-10-09T15:39:22.306154+0000","last_became_peered":"2023-10-09T15:39:22.306154+0000","last_unstale":"2023-10-09T15:39:22.310531+0000","last_undegraded":"2023-10-09T15:39:22.310531+0000","last_fullsized":"2023-10-09T15:39:22.310531+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:18.978938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.36","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.298495+0000","last_change":"2023-10-09T15:39:22.298495+0000","last_active":"2023-10-09T15:39:22.298495+0000","last_peered":"2023-10-09T15:39:22.298495+0000","last_clean":"2023-10-09T15:39:22.298495+0000","last_became_active":"2023-10-09T15:39:22.298240+0000","last_became_peered":"2023-10-09T15:39:22.298240+0000","last_unstale":"2023-10-09T15:39:22.298495+0000","last_undegraded":"2023-10-09T15:39:22.298495+0000","last_fullsized":"2023-10-09T15:39:22.298495+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:52:52.322159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.35","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304372+0000","last_change":"2023-10-09T15:39:22.301517+0000","last_active":"2023-10-09T15:39:22.304372+0000","last_peered":"2023-10-09T15:39:22.304372+0000","last_clean":"2023-10-09T15:39:22.304372+0000","last_became_active":"2023-10-09T15:39:22.301216+0000","last_became_peered":"2023-10-09T15:39:22.301216+0000","last_unstale":"2023-10-09T15:39:22.304372+0000","last_undegraded":"2023-10-09T15:39:22.304372+0000","last_fullsized":"2023-10-09T15:39:22.304372+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:30.819233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.34","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304758+0000","last_change":"2023-10-09T15:39:22.304758+0000","last_active":"2023-10-09T15:39:22.304758+0000","last_peered":"2023-10-09T15:39:22.304758+0000","last_clean":"2023-10-09T15:39:22.304758+0000","last_became_active":"2023-10-09T15:39:22.304484+0000","last_became_peered":"2023-10-09T15:39:22.304484+0000","last_unstale":"2023-10-09T15:39:22.304758+0000","last_undegraded":"2023-10-09T15:39:22.304758+0000","last_fullsized":"2023-10-09T15:39:22.304758+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:16.657344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.33","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302233+0000","last_change":"2023-10-09T15:39:22.302233+0000","last_active":"2023-10-09T15:39:22.302233+0000","last_peered":"2023-10-09T15:39:22.302233+0000","last_clean":"2023-10-09T15:39:22.302233+0000","last_became_active":"2023-10-09T15:39:22.301800+0000","last_became_peered":"2023-10-09T15:39:22.301800+0000","last_unstale":"2023-10-09T15:39:22.302233+0000","last_undegraded":"2023-10-09T15:39:22.302233+0000","last_fullsized":"2023-10-09T15:39:22.302233+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:39.120631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.32","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.291209+0000","last_change":"2023-10-09T15:39:22.291209+0000","last_active":"2023-10-09T15:39:22.291209+0000","last_peered":"2023-10-09T15:39:22.291209+0000","last_clean":"2023-10-09T15:39:22.291209+0000","last_became_active":"2023-10-09T15:39:22.290903+0000","last_became_peered":"2023-10-09T15:39:22.290903+0000","last_unstale":"2023-10-09T15:39:22.291209+0000","last_undegraded":"2023-10-09T15:39:22.291209+0000","last_fullsized":"2023-10-09T15:39:22.291209+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:18:37.852027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.31","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293112+0000","last_change":"2023-10-09T15:39:22.293112+0000","last_active":"2023-10-09T15:39:22.293112+0000","last_peered":"2023-10-09T15:39:22.293112+0000","last_clean":"2023-10-09T15:39:22.293112+0000","last_became_active":"2023-10-09T15:39:22.292855+0000","last_became_peered":"2023-10-09T15:39:22.292855+0000","last_unstale":"2023-10-09T15:39:22.293112+0000","last_undegraded":"2023-10-09T15:39:22.293112+0000","last_fullsized":"2023-10-09T15:39:22.293112+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:14.736660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.30","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305551+0000","last_change":"2023-10-09T15:39:22.305551+0000","last_active":"2023-10-09T15:39:22.305551+0000","last_peered":"2023-10-09T15:39:22.305551+0000","last_clean":"2023-10-09T15:39:22.305551+0000","last_became_active":"2023-10-09T15:39:22.305291+0000","last_became_peered":"2023-10-09T15:39:22.305291+0000","last_unstale":"2023-10-09T15:39:22.305551+0000","last_undegraded":"2023-10-09T15:39:22.305551+0000","last_fullsized":"2023-10-09T15:39:22.305551+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:18.978938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.2f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299569+0000","last_change":"2023-10-09T15:39:22.299569+0000","last_active":"2023-10-09T15:39:22.299569+0000","last_peered":"2023-10-09T15:39:22.299569+0000","last_clean":"2023-10-09T15:39:22.299569+0000","last_became_active":"2023-10-09T15:39:22.299311+0000","last_became_peered":"2023-10-09T15:39:22.299311+0000","last_unstale":"2023-10-09T15:39:22.299569+0000","last_undegraded":"2023-10-09T15:39:22.299569+0000","last_fullsized":"2023-10-09T15:39:22.299569+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:54.051587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.2e","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.294086+0000","last_change":"2023-10-09T15:39:22.294086+0000","last_active":"2023-10-09T15:39:22.294086+0000","last_peered":"2023-10-09T15:39:22.294086+0000","last_clean":"2023-10-09T15:39:22.294086+0000","last_became_active":"2023-10-09T15:39:22.293910+0000","last_became_peered":"2023-10-09T15:39:22.293910+0000","last_unstale":"2023-10-09T15:39:22.294086+0000","last_undegraded":"2023-10-09T15:39:22.294086+0000","last_fullsized":"2023-10-09T15:39:22.294086+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:14.058662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302621+0000","last_change":"2023-10-09T15:39:22.302621+0000","last_active":"2023-10-09T15:39:22.302621+0000","last_peered":"2023-10-09T15:39:22.302621+0000","last_clean":"2023-10-09T15:39:22.302621+0000","last_became_active":"2023-10-09T15:39:22.302266+0000","last_became_peered":"2023-10-09T15:39:22.302266+0000","last_unstale":"2023-10-09T15:39:22.302621+0000","last_undegraded":"2023-10-09T15:39:22.302621+0000","last_fullsized":"2023-10-09T15:39:22.302621+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:33.318887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2c","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.292760+0000","last_change":"2023-10-09T15:39:22.292760+0000","last_active":"2023-10-09T15:39:22.292760+0000","last_peered":"2023-10-09T15:39:22.292760+0000","last_clean":"2023-10-09T15:39:22.292760+0000","last_became_active":"2023-10-09T15:39:22.292403+0000","last_became_peered":"2023-10-09T15:39:22.292403+0000","last_unstale":"2023-10-09T15:39:22.292760+0000","last_undegraded":"2023-10-09T15:39:22.292760+0000","last_fullsized":"2023-10-09T15:39:22.292760+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:14.736660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.2b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.303753+0000","last_change":"2023-10-09T15:39:22.303753+0000","last_active":"2023-10-09T15:39:22.303753+0000","last_peered":"2023-10-09T15:39:22.303753+0000","last_clean":"2023-10-09T15:39:22.303753+0000","last_became_active":"2023-10-09T15:39:22.303516+0000","last_became_peered":"2023-10-09T15:39:22.303516+0000","last_unstale":"2023-10-09T15:39:22.303753+0000","last_undegraded":"2023-10-09T15:39:22.303753+0000","last_fullsized":"2023-10-09T15:39:22.303753+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:22:29.775130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.2a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304870+0000","last_change":"2023-10-09T15:39:22.304870+0000","last_active":"2023-10-09T15:39:22.304870+0000","last_peered":"2023-10-09T15:39:22.304870+0000","last_clean":"2023-10-09T15:39:22.304870+0000","last_became_active":"2023-10-09T15:39:22.304582+0000","last_became_peered":"2023-10-09T15:39:22.304582+0000","last_unstale":"2023-10-09T15:39:22.304870+0000","last_undegraded":"2023-10-09T15:39:22.304870+0000","last_fullsized":"2023-10-09T15:39:22.304870+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:56.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.29","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304192+0000","last_change":"2023-10-09T15:39:22.300565+0000","last_active":"2023-10-09T15:39:22.304192+0000","last_peered":"2023-10-09T15:39:22.304192+0000","last_clean":"2023-10-09T15:39:22.304192+0000","last_became_active":"2023-10-09T15:39:22.300232+0000","last_became_peered":"2023-10-09T15:39:22.300232+0000","last_unstale":"2023-10-09T15:39:22.304192+0000","last_undegraded":"2023-10-09T15:39:22.304192+0000","last_fullsized":"2023-10-09T15:39:22.304192+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:59:33.318887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.28","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297730+0000","last_change":"2023-10-09T15:39:22.297730+0000","last_active":"2023-10-09T15:39:22.297730+0000","last_peered":"2023-10-09T15:39:22.297730+0000","last_clean":"2023-10-09T15:39:22.297730+0000","last_became_active":"2023-10-09T15:39:22.297432+0000","last_became_peered":"2023-10-09T15:39:22.297432+0000","last_unstale":"2023-10-09T15:39:22.297730+0000","last_undegraded":"2023-10-09T15:39:22.297730+0000","last_fullsized":"2023-10-09T15:39:22.297730+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:42:28.989522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.27","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305823+0000","last_change":"2023-10-09T15:39:22.303669+0000","last_active":"2023-10-09T15:39:22.305823+0000","last_peered":"2023-10-09T15:39:22.305823+0000","last_clean":"2023-10-09T15:39:22.305823+0000","last_became_active":"2023-10-09T15:39:22.303333+0000","last_became_peered":"2023-10-09T15:39:22.303333+0000","last_unstale":"2023-10-09T15:39:22.305823+0000","last_undegraded":"2023-10-09T15:39:22.305823+0000","last_fullsized":"2023-10-09T15:39:22.305823+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:11.787323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.26","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297369+0000","last_change":"2023-10-09T15:39:22.292366+0000","last_active":"2023-10-09T15:39:22.297369+0000","last_peered":"2023-10-09T15:39:22.297369+0000","last_clean":"2023-10-09T15:39:22.297369+0000","last_became_active":"2023-10-09T15:39:22.292096+0000","last_became_peered":"2023-10-09T15:39:22.292096+0000","last_unstale":"2023-10-09T15:39:22.297369+0000","last_undegraded":"2023-10-09T15:39:22.297369+0000","last_fullsized":"2023-10-09T15:39:22.297369+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:02:51.932232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.25","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305849+0000","last_change":"2023-10-09T15:39:22.302648+0000","last_active":"2023-10-09T15:39:22.305849+0000","last_peered":"2023-10-09T15:39:22.305849+0000","last_clean":"2023-10-09T15:39:22.305849+0000","last_became_active":"2023-10-09T15:39:22.302269+0000","last_became_peered":"2023-10-09T15:39:22.302269+0000","last_unstale":"2023-10-09T15:39:22.305849+0000","last_undegraded":"2023-10-09T15:39:22.305849+0000","last_fullsized":"2023-10-09T15:39:22.305849+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:29.993683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.24","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299549+0000","last_change":"2023-10-09T15:39:22.299549+0000","last_active":"2023-10-09T15:39:22.299549+0000","last_peered":"2023-10-09T15:39:22.299549+0000","last_clean":"2023-10-09T15:39:22.299549+0000","last_became_active":"2023-10-09T15:39:22.299299+0000","last_became_peered":"2023-10-09T15:39:22.299299+0000","last_unstale":"2023-10-09T15:39:22.299549+0000","last_undegraded":"2023-10-09T15:39:22.299549+0000","last_fullsized":"2023-10-09T15:39:22.299549+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:48:22.432499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.23","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293094+0000","last_change":"2023-10-09T15:39:22.293094+0000","last_active":"2023-10-09T15:39:22.293094+0000","last_peered":"2023-10-09T15:39:22.293094+0000","last_clean":"2023-10-09T15:39:22.293094+0000","last_became_active":"2023-10-09T15:39:22.292765+0000","last_became_peered":"2023-10-09T15:39:22.292765+0000","last_unstale":"2023-10-09T15:39:22.293094+0000","last_undegraded":"2023-10-09T15:39:22.293094+0000","last_fullsized":"2023-10-09T15:39:22.293094+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:21.869437+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.22","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308236+0000","last_change":"2023-10-09T15:39:22.306059+0000","last_active":"2023-10-09T15:39:22.308236+0000","last_peered":"2023-10-09T15:39:22.308236+0000","last_clean":"2023-10-09T15:39:22.308236+0000","last_became_active":"2023-10-09T15:39:22.305790+0000","last_became_peered":"2023-10-09T15:39:22.305790+0000","last_unstale":"2023-10-09T15:39:22.308236+0000","last_undegraded":"2023-10-09T15:39:22.308236+0000","last_fullsized":"2023-10-09T15:39:22.308236+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:23:34.843038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.21","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.302651+0000","last_change":"2023-10-09T15:39:22.302651+0000","last_active":"2023-10-09T15:39:22.302651+0000","last_peered":"2023-10-09T15:39:22.302651+0000","last_clean":"2023-10-09T15:39:22.302651+0000","last_became_active":"2023-10-09T15:39:22.302388+0000","last_became_peered":"2023-10-09T15:39:22.302388+0000","last_unstale":"2023-10-09T15:39:22.302651+0000","last_undegraded":"2023-10-09T15:39:22.302651+0000","last_fullsized":"2023-10-09T15:39:22.302651+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:48:39.459279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.20","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293768+0000","last_change":"2023-10-09T15:39:22.293768+0000","last_active":"2023-10-09T15:39:22.293768+0000","last_peered":"2023-10-09T15:39:22.293768+0000","last_clean":"2023-10-09T15:39:22.293768+0000","last_became_active":"2023-10-09T15:39:22.293471+0000","last_became_peered":"2023-10-09T15:39:22.293471+0000","last_unstale":"2023-10-09T15:39:22.293768+0000","last_undegraded":"2023-10-09T15:39:22.293768+0000","last_fullsized":"2023-10-09T15:39:22.293768+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:24.349440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309023+0000","last_change":"2023-10-09T15:39:22.305071+0000","last_active":"2023-10-09T15:39:22.309023+0000","last_peered":"2023-10-09T15:39:22.309023+0000","last_clean":"2023-10-09T15:39:22.309023+0000","last_became_active":"2023-10-09T15:39:22.304737+0000","last_became_peered":"2023-10-09T15:39:22.304737+0000","last_unstale":"2023-10-09T15:39:22.309023+0000","last_undegraded":"2023-10-09T15:39:22.309023+0000","last_fullsized":"2023-10-09T15:39:22.309023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:01:25.730564+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1f","version":"167'4","reported_seq":13,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731604+0000","last_change":"2023-10-09T15:39:21.730823+0000","last_active":"2023-10-09T15:39:22.731604+0000","last_peered":"2023-10-09T15:39:22.731604+0000","last_clean":"2023-10-09T15:39:22.731604+0000","last_became_active":"2023-10-09T15:39:21.730516+0000","last_became_peered":"2023-10-09T15:39:21.730516+0000","last_unstale":"2023-10-09T15:39:22.731604+0000","last_undegraded":"2023-10-09T15:39:22.731604+0000","last_fullsized":"2023-10-09T15:39:22.731604+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:53:10.783035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.1f","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304047+0000","last_change":"2023-10-09T15:39:22.303516+0000","last_active":"2023-10-09T15:39:22.304047+0000","last_peered":"2023-10-09T15:39:22.304047+0000","last_clean":"2023-10-09T15:39:22.304047+0000","last_became_active":"2023-10-09T15:39:22.303237+0000","last_became_peered":"2023-10-09T15:39:22.303237+0000","last_unstale":"2023-10-09T15:39:22.304047+0000","last_undegraded":"2023-10-09T15:39:22.304047+0000","last_fullsized":"2023-10-09T15:39:22.304047+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:16:08.053665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.1e","version":"167'1","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301512+0000","last_change":"2023-10-09T15:39:21.727174+0000","last_active":"2023-10-09T15:39:22.301512+0000","last_peered":"2023-10-09T15:39:22.301512+0000","last_clean":"2023-10-09T15:39:22.301512+0000","last_became_active":"2023-10-09T15:39:21.726840+0000","last_became_peered":"2023-10-09T15:39:21.726840+0000","last_unstale":"2023-10-09T15:39:22.301512+0000","last_undegraded":"2023-10-09T15:39:22.301512+0000","last_fullsized":"2023-10-09T15:39:22.301512+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:45.080442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1d","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293463+0000","last_change":"2023-10-09T15:39:22.293463+0000","last_active":"2023-10-09T15:39:22.293463+0000","last_peered":"2023-10-09T15:39:22.293463+0000","last_clean":"2023-10-09T15:39:22.293463+0000","last_became_active":"2023-10-09T15:39:22.293159+0000","last_became_peered":"2023-10-09T15:39:22.293159+0000","last_unstale":"2023-10-09T15:39:22.293463+0000","last_undegraded":"2023-10-09T15:39:22.293463+0000","last_fullsized":"2023-10-09T15:39:22.293463+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:56:26.036104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.1c","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730765+0000","last_change":"2023-10-09T15:39:21.728792+0000","last_active":"2023-10-09T15:39:22.730765+0000","last_peered":"2023-10-09T15:39:22.730765+0000","last_clean":"2023-10-09T15:39:22.730765+0000","last_became_active":"2023-10-09T15:39:21.728510+0000","last_became_peered":"2023-10-09T15:39:21.728510+0000","last_unstale":"2023-10-09T15:39:22.730765+0000","last_undegraded":"2023-10-09T15:39:22.730765+0000","last_fullsized":"2023-10-09T15:39:22.730765+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:14.315670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.1a","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309088+0000","last_change":"2023-10-09T15:39:22.308151+0000","last_active":"2023-10-09T15:39:22.309088+0000","last_peered":"2023-10-09T15:39:22.309088+0000","last_clean":"2023-10-09T15:39:22.309088+0000","last_became_active":"2023-10-09T15:39:22.307867+0000","last_became_peered":"2023-10-09T15:39:22.307867+0000","last_unstale":"2023-10-09T15:39:22.309088+0000","last_undegraded":"2023-10-09T15:39:22.309088+0000","last_fullsized":"2023-10-09T15:39:22.309088+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:18:14.515164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1b","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730904+0000","last_change":"2023-10-09T15:39:21.726206+0000","last_active":"2023-10-09T15:39:22.730904+0000","last_peered":"2023-10-09T15:39:22.730904+0000","last_clean":"2023-10-09T15:39:22.730904+0000","last_became_active":"2023-10-09T15:39:21.725936+0000","last_became_peered":"2023-10-09T15:39:21.725936+0000","last_unstale":"2023-10-09T15:39:22.730904+0000","last_undegraded":"2023-10-09T15:39:22.730904+0000","last_fullsized":"2023-10-09T15:39:22.730904+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:17:24.869137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.1b","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.304619+0000","last_change":"2023-10-09T15:39:22.304619+0000","last_active":"2023-10-09T15:39:22.304619+0000","last_peered":"2023-10-09T15:39:22.304619+0000","last_clean":"2023-10-09T15:39:22.304619+0000","last_became_active":"2023-10-09T15:39:22.304276+0000","last_became_peered":"2023-10-09T15:39:22.304276+0000","last_unstale":"2023-10-09T15:39:22.304619+0000","last_undegraded":"2023-10-09T15:39:22.304619+0000","last_fullsized":"2023-10-09T15:39:22.304619+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:31.422628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.1a","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.730326+0000","last_change":"2023-10-09T15:39:21.726853+0000","last_active":"2023-10-09T15:39:22.730326+0000","last_peered":"2023-10-09T15:39:22.730326+0000","last_clean":"2023-10-09T15:39:22.730326+0000","last_became_active":"2023-10-09T15:39:21.726596+0000","last_became_peered":"2023-10-09T15:39:21.726596+0000","last_unstale":"2023-10-09T15:39:22.730326+0000","last_undegraded":"2023-10-09T15:39:22.730326+0000","last_fullsized":"2023-10-09T15:39:22.730326+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:40.448248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.18","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.299908+0000","last_change":"2023-10-09T15:39:22.299908+0000","last_active":"2023-10-09T15:39:22.299908+0000","last_peered":"2023-10-09T15:39:22.299908+0000","last_clean":"2023-10-09T15:39:22.299908+0000","last_became_active":"2023-10-09T15:39:22.299458+0000","last_became_peered":"2023-10-09T15:39:22.299458+0000","last_unstale":"2023-10-09T15:39:22.299908+0000","last_undegraded":"2023-10-09T15:39:22.299908+0000","last_fullsized":"2023-10-09T15:39:22.299908+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:24.349440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.19","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732650+0000","last_change":"2023-10-09T15:39:21.730819+0000","last_active":"2023-10-09T15:39:21.732650+0000","last_peered":"2023-10-09T15:39:21.732650+0000","last_clean":"2023-10-09T15:39:21.732650+0000","last_became_active":"2023-10-09T15:39:21.728928+0000","last_became_peered":"2023-10-09T15:39:21.728928+0000","last_unstale":"2023-10-09T15:39:21.732650+0000","last_undegraded":"2023-10-09T15:39:21.732650+0000","last_fullsized":"2023-10-09T15:39:21.732650+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:55:26.752607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.19","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308670+0000","last_change":"2023-10-09T15:39:22.308670+0000","last_active":"2023-10-09T15:39:22.308670+0000","last_peered":"2023-10-09T15:39:22.308670+0000","last_clean":"2023-10-09T15:39:22.308670+0000","last_became_active":"2023-10-09T15:39:22.308280+0000","last_became_peered":"2023-10-09T15:39:22.308280+0000","last_unstale":"2023-10-09T15:39:22.308670+0000","last_undegraded":"2023-10-09T15:39:22.308670+0000","last_fullsized":"2023-10-09T15:39:22.308670+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:32.632052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.18","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.728487+0000","last_change":"2023-10-09T15:39:21.727258+0000","last_active":"2023-10-09T15:39:21.728487+0000","last_peered":"2023-10-09T15:39:21.728487+0000","last_clean":"2023-10-09T15:39:21.728487+0000","last_became_active":"2023-10-09T15:39:21.727003+0000","last_became_peered":"2023-10-09T15:39:21.727003+0000","last_unstale":"2023-10-09T15:39:21.728487+0000","last_undegraded":"2023-10-09T15:39:21.728487+0000","last_fullsized":"2023-10-09T15:39:21.728487+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:18:13.510875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.16","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.309392+0000","last_change":"2023-10-09T15:39:22.309392+0000","last_active":"2023-10-09T15:39:22.309392+0000","last_peered":"2023-10-09T15:39:22.309392+0000","last_clean":"2023-10-09T15:39:22.309392+0000","last_became_active":"2023-10-09T15:39:22.308911+0000","last_became_peered":"2023-10-09T15:39:22.308911+0000","last_unstale":"2023-10-09T15:39:22.309392+0000","last_undegraded":"2023-10-09T15:39:22.309392+0000","last_fullsized":"2023-10-09T15:39:22.309392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:35.331525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.17","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297693+0000","last_change":"2023-10-09T15:39:21.732365+0000","last_active":"2023-10-09T15:39:22.297693+0000","last_peered":"2023-10-09T15:39:22.297693+0000","last_clean":"2023-10-09T15:39:22.297693+0000","last_became_active":"2023-10-09T15:39:21.732031+0000","last_became_peered":"2023-10-09T15:39:21.732031+0000","last_unstale":"2023-10-09T15:39:22.297693+0000","last_undegraded":"2023-10-09T15:39:22.297693+0000","last_fullsized":"2023-10-09T15:39:22.297693+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:10:25.861802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.17","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308018+0000","last_change":"2023-10-09T15:39:22.306384+0000","last_active":"2023-10-09T15:39:22.308018+0000","last_peered":"2023-10-09T15:39:22.308018+0000","last_clean":"2023-10-09T15:39:22.308018+0000","last_became_active":"2023-10-09T15:39:22.304956+0000","last_became_peered":"2023-10-09T15:39:22.304956+0000","last_unstale":"2023-10-09T15:39:22.308018+0000","last_undegraded":"2023-10-09T15:39:22.308018+0000","last_fullsized":"2023-10-09T15:39:22.308018+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:03.589870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.16","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.724689+0000","last_change":"2023-10-09T15:39:21.721103+0000","last_active":"2023-10-09T15:39:21.724689+0000","last_peered":"2023-10-09T15:39:21.724689+0000","last_clean":"2023-10-09T15:39:21.724689+0000","last_became_active":"2023-10-09T15:39:21.720813+0000","last_became_peered":"2023-10-09T15:39:21.720813+0000","last_unstale":"2023-10-09T15:39:21.724689+0000","last_undegraded":"2023-10-09T15:39:21.724689+0000","last_fullsized":"2023-10-09T15:39:21.724689+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:23.940000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.14","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.294564+0000","last_change":"2023-10-09T15:39:22.294564+0000","last_active":"2023-10-09T15:39:22.294564+0000","last_peered":"2023-10-09T15:39:22.294564+0000","last_clean":"2023-10-09T15:39:22.294564+0000","last_became_active":"2023-10-09T15:39:22.294250+0000","last_became_peered":"2023-10-09T15:39:22.294250+0000","last_unstale":"2023-10-09T15:39:22.294564+0000","last_undegraded":"2023-10-09T15:39:22.294564+0000","last_fullsized":"2023-10-09T15:39:22.294564+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:28:15.319958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.15","version":"167'3","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731164+0000","last_change":"2023-10-09T15:39:21.724948+0000","last_active":"2023-10-09T15:39:22.731164+0000","last_peered":"2023-10-09T15:39:22.731164+0000","last_clean":"2023-10-09T15:39:22.731164+0000","last_became_active":"2023-10-09T15:39:21.724615+0000","last_became_peered":"2023-10-09T15:39:21.724615+0000","last_unstale":"2023-10-09T15:39:22.731164+0000","last_undegraded":"2023-10-09T15:39:22.731164+0000","last_fullsized":"2023-10-09T15:39:22.731164+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:15.653055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.15","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307780+0000","last_change":"2023-10-09T15:39:22.305943+0000","last_active":"2023-10-09T15:39:22.307780+0000","last_peered":"2023-10-09T15:39:22.307780+0000","last_clean":"2023-10-09T15:39:22.307780+0000","last_became_active":"2023-10-09T15:39:22.305595+0000","last_became_peered":"2023-10-09T15:39:22.305595+0000","last_unstale":"2023-10-09T15:39:22.307780+0000","last_undegraded":"2023-10-09T15:39:22.307780+0000","last_fullsized":"2023-10-09T15:39:22.307780+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:45.047374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.14","version":"167'6","reported_seq":15,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.734082+0000","last_change":"2023-10-09T15:39:21.720704+0000","last_active":"2023-10-09T15:39:22.734082+0000","last_peered":"2023-10-09T15:39:22.734082+0000","last_clean":"2023-10-09T15:39:22.734082+0000","last_became_active":"2023-10-09T15:39:21.720463+0000","last_became_peered":"2023-10-09T15:39:21.720463+0000","last_unstale":"2023-10-09T15:39:22.734082+0000","last_undegraded":"2023-10-09T15:39:22.734082+0000","last_fullsized":"2023-10-09T15:39:22.734082+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:10:04.264303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.12","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297812+0000","last_change":"2023-10-09T15:39:22.297812+0000","last_active":"2023-10-09T15:39:22.297812+0000","last_peered":"2023-10-09T15:39:22.297812+0000","last_clean":"2023-10-09T15:39:22.297812+0000","last_became_active":"2023-10-09T15:39:22.297521+0000","last_became_peered":"2023-10-09T15:39:22.297521+0000","last_unstale":"2023-10-09T15:39:22.297812+0000","last_undegraded":"2023-10-09T15:39:22.297812+0000","last_fullsized":"2023-10-09T15:39:22.297812+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:15.312414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"28.13","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731700+0000","last_change":"2023-10-09T15:39:21.726737+0000","last_active":"2023-10-09T15:39:22.731700+0000","last_peered":"2023-10-09T15:39:22.731700+0000","last_clean":"2023-10-09T15:39:22.731700+0000","last_became_active":"2023-10-09T15:39:21.726489+0000","last_became_peered":"2023-10-09T15:39:21.726489+0000","last_unstale":"2023-10-09T15:39:22.731700+0000","last_undegraded":"2023-10-09T15:39:22.731700+0000","last_fullsized":"2023-10-09T15:39:22.731700+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:13.157884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"29.13","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307548+0000","last_change":"2023-10-09T15:39:22.299694+0000","last_active":"2023-10-09T15:39:22.307548+0000","last_peered":"2023-10-09T15:39:22.307548+0000","last_clean":"2023-10-09T15:39:22.307548+0000","last_became_active":"2023-10-09T15:39:22.299411+0000","last_became_peered":"2023-10-09T15:39:22.299411+0000","last_unstale":"2023-10-09T15:39:22.307548+0000","last_undegraded":"2023-10-09T15:39:22.307548+0000","last_fullsized":"2023-10-09T15:39:22.307548+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:16:16.657344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.12","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.733315+0000","last_change":"2023-10-09T15:39:21.730759+0000","last_active":"2023-10-09T15:39:21.733315+0000","last_peered":"2023-10-09T15:39:21.733315+0000","last_clean":"2023-10-09T15:39:21.733315+0000","last_became_active":"2023-10-09T15:39:21.728851+0000","last_became_peered":"2023-10-09T15:39:21.728851+0000","last_unstale":"2023-10-09T15:39:21.733315+0000","last_undegraded":"2023-10-09T15:39:21.733315+0000","last_fullsized":"2023-10-09T15:39:21.733315+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:23:33.838750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.10","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.311608+0000","last_change":"2023-10-09T15:39:22.307750+0000","last_active":"2023-10-09T15:39:22.311608+0000","last_peered":"2023-10-09T15:39:22.311608+0000","last_clean":"2023-10-09T15:39:22.311608+0000","last_became_active":"2023-10-09T15:39:22.307443+0000","last_became_peered":"2023-10-09T15:39:22.307443+0000","last_unstale":"2023-10-09T15:39:22.311608+0000","last_undegraded":"2023-10-09T15:39:22.311608+0000","last_fullsized":"2023-10-09T15:39:22.311608+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:31.112993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.11","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.729050+0000","last_change":"2023-10-09T15:39:21.727640+0000","last_active":"2023-10-09T15:39:21.729050+0000","last_peered":"2023-10-09T15:39:21.729050+0000","last_clean":"2023-10-09T15:39:21.729050+0000","last_became_active":"2023-10-09T15:39:21.727369+0000","last_became_peered":"2023-10-09T15:39:21.727369+0000","last_unstale":"2023-10-09T15:39:21.729050+0000","last_undegraded":"2023-10-09T15:39:21.729050+0000","last_fullsized":"2023-10-09T15:39:21.729050+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:29.160826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.11","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293108+0000","last_change":"2023-10-09T15:39:22.293108+0000","last_active":"2023-10-09T15:39:22.293108+0000","last_peered":"2023-10-09T15:39:22.293108+0000","last_clean":"2023-10-09T15:39:22.293108+0000","last_became_active":"2023-10-09T15:39:22.292695+0000","last_became_peered":"2023-10-09T15:39:22.292695+0000","last_unstale":"2023-10-09T15:39:22.293108+0000","last_undegraded":"2023-10-09T15:39:22.293108+0000","last_fullsized":"2023-10-09T15:39:22.293108+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:28:46.084730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"28.10","version":"167'8","reported_seq":17,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.732019+0000","last_change":"2023-10-09T15:39:21.725847+0000","last_active":"2023-10-09T15:39:22.732019+0000","last_peered":"2023-10-09T15:39:22.732019+0000","last_clean":"2023-10-09T15:39:22.732019+0000","last_became_active":"2023-10-09T15:39:21.725549+0000","last_became_peered":"2023-10-09T15:39:21.725549+0000","last_unstale":"2023-10-09T15:39:22.732019+0000","last_undegraded":"2023-10-09T15:39:22.732019+0000","last_fullsized":"2023-10-09T15:39:22.732019+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:18:20.865149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"29.e","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.300190+0000","last_change":"2023-10-09T15:39:22.294767+0000","last_active":"2023-10-09T15:39:22.300190+0000","last_peered":"2023-10-09T15:39:22.300190+0000","last_clean":"2023-10-09T15:39:22.300190+0000","last_became_active":"2023-10-09T15:39:22.294524+0000","last_became_peered":"2023-10-09T15:39:22.294524+0000","last_unstale":"2023-10-09T15:39:22.300190+0000","last_undegraded":"2023-10-09T15:39:22.300190+0000","last_fullsized":"2023-10-09T15:39:22.300190+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:21:29.018018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.f","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.728222+0000","last_change":"2023-10-09T15:39:21.727519+0000","last_active":"2023-10-09T15:39:22.728222+0000","last_peered":"2023-10-09T15:39:22.728222+0000","last_clean":"2023-10-09T15:39:22.728222+0000","last_became_active":"2023-10-09T15:39:21.727171+0000","last_became_peered":"2023-10-09T15:39:21.727171+0000","last_unstale":"2023-10-09T15:39:22.728222+0000","last_undegraded":"2023-10-09T15:39:22.728222+0000","last_fullsized":"2023-10-09T15:39:22.728222+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:08:44.125505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.f","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293682+0000","last_change":"2023-10-09T15:39:22.293682+0000","last_active":"2023-10-09T15:39:22.293682+0000","last_peered":"2023-10-09T15:39:22.293682+0000","last_clean":"2023-10-09T15:39:22.293682+0000","last_became_active":"2023-10-09T15:39:22.293297+0000","last_became_peered":"2023-10-09T15:39:22.293297+0000","last_unstale":"2023-10-09T15:39:22.293682+0000","last_undegraded":"2023-10-09T15:39:22.293682+0000","last_fullsized":"2023-10-09T15:39:22.293682+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:56.403813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"28.e","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.728729+0000","last_change":"2023-10-09T15:39:21.731194+0000","last_active":"2023-10-09T15:39:22.728729+0000","last_peered":"2023-10-09T15:39:22.728729+0000","last_clean":"2023-10-09T15:39:22.728729+0000","last_became_active":"2023-10-09T15:39:21.730951+0000","last_became_peered":"2023-10-09T15:39:21.730951+0000","last_unstale":"2023-10-09T15:39:22.728729+0000","last_undegraded":"2023-10-09T15:39:22.728729+0000","last_fullsized":"2023-10-09T15:39:22.728729+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:01:29.814944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306973+0000","last_change":"2023-10-09T15:39:22.298470+0000","last_active":"2023-10-09T15:39:22.306973+0000","last_peered":"2023-10-09T15:39:22.306973+0000","last_clean":"2023-10-09T15:39:22.306973+0000","last_became_active":"2023-10-09T15:39:22.298148+0000","last_became_peered":"2023-10-09T15:39:22.298148+0000","last_unstale":"2023-10-09T15:39:22.306973+0000","last_undegraded":"2023-10-09T15:39:22.306973+0000","last_fullsized":"2023-10-09T15:39:22.306973+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:37:32.632052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.d","version":"167'1","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731348+0000","last_change":"2023-10-09T15:39:21.728462+0000","last_active":"2023-10-09T15:39:22.731348+0000","last_peered":"2023-10-09T15:39:22.731348+0000","last_clean":"2023-10-09T15:39:22.731348+0000","last_became_active":"2023-10-09T15:39:21.728167+0000","last_became_peered":"2023-10-09T15:39:21.728167+0000","last_unstale":"2023-10-09T15:39:22.731348+0000","last_undegraded":"2023-10-09T15:39:22.731348+0000","last_fullsized":"2023-10-09T15:39:22.731348+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:56:50.522170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.d","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307926+0000","last_change":"2023-10-09T15:39:22.298662+0000","last_active":"2023-10-09T15:39:22.307926+0000","last_peered":"2023-10-09T15:39:22.307926+0000","last_clean":"2023-10-09T15:39:22.307926+0000","last_became_active":"2023-10-09T15:39:22.298348+0000","last_became_peered":"2023-10-09T15:39:22.298348+0000","last_unstale":"2023-10-09T15:39:22.307926+0000","last_undegraded":"2023-10-09T15:39:22.307926+0000","last_fullsized":"2023-10-09T15:39:22.307926+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:38.600738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.c","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.730443+0000","last_change":"2023-10-09T15:39:21.728921+0000","last_active":"2023-10-09T15:39:21.730443+0000","last_peered":"2023-10-09T15:39:21.730443+0000","last_clean":"2023-10-09T15:39:21.730443+0000","last_became_active":"2023-10-09T15:39:21.728312+0000","last_became_peered":"2023-10-09T15:39:21.728312+0000","last_unstale":"2023-10-09T15:39:21.730443+0000","last_undegraded":"2023-10-09T15:39:21.730443+0000","last_fullsized":"2023-10-09T15:39:21.730443+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:44.043086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"29.a","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.301967+0000","last_change":"2023-10-09T15:39:22.301967+0000","last_active":"2023-10-09T15:39:22.301967+0000","last_peered":"2023-10-09T15:39:22.301967+0000","last_clean":"2023-10-09T15:39:22.301967+0000","last_became_active":"2023-10-09T15:39:22.301573+0000","last_became_peered":"2023-10-09T15:39:22.301573+0000","last_unstale":"2023-10-09T15:39:22.301967+0000","last_undegraded":"2023-10-09T15:39:22.301967+0000","last_fullsized":"2023-10-09T15:39:22.301967+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:10:14.347884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.b","version":"167'2","reported_seq":12,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731291+0000","last_change":"2023-10-09T15:39:21.726671+0000","last_active":"2023-10-09T15:39:22.731291+0000","last_peered":"2023-10-09T15:39:22.731291+0000","last_clean":"2023-10-09T15:39:22.731291+0000","last_became_active":"2023-10-09T15:39:21.726403+0000","last_became_peered":"2023-10-09T15:39:21.726403+0000","last_unstale":"2023-10-09T15:39:22.731291+0000","last_undegraded":"2023-10-09T15:39:22.731291+0000","last_fullsized":"2023-10-09T15:39:22.731291+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:13.214705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.b","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.310508+0000","last_change":"2023-10-09T15:39:22.305971+0000","last_active":"2023-10-09T15:39:22.310508+0000","last_peered":"2023-10-09T15:39:22.310508+0000","last_clean":"2023-10-09T15:39:22.310508+0000","last_became_active":"2023-10-09T15:39:22.305468+0000","last_became_peered":"2023-10-09T15:39:22.305468+0000","last_unstale":"2023-10-09T15:39:22.310508+0000","last_undegraded":"2023-10-09T15:39:22.310508+0000","last_fullsized":"2023-10-09T15:39:22.310508+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:30.165115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.a","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732338+0000","last_change":"2023-10-09T15:39:21.728059+0000","last_active":"2023-10-09T15:39:21.732338+0000","last_peered":"2023-10-09T15:39:21.732338+0000","last_clean":"2023-10-09T15:39:21.732338+0000","last_became_active":"2023-10-09T15:39:21.727660+0000","last_became_peered":"2023-10-09T15:39:21.727660+0000","last_unstale":"2023-10-09T15:39:21.732338+0000","last_undegraded":"2023-10-09T15:39:21.732338+0000","last_fullsized":"2023-10-09T15:39:21.732338+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:43:38.954417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.8","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297302+0000","last_change":"2023-10-09T15:39:22.292965+0000","last_active":"2023-10-09T15:39:22.297302+0000","last_peered":"2023-10-09T15:39:22.297302+0000","last_clean":"2023-10-09T15:39:22.297302+0000","last_became_active":"2023-10-09T15:39:22.292711+0000","last_became_peered":"2023-10-09T15:39:22.292711+0000","last_unstale":"2023-10-09T15:39:22.297302+0000","last_undegraded":"2023-10-09T15:39:22.297302+0000","last_fullsized":"2023-10-09T15:39:22.297302+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:06:08.501440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"28.9","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.732581+0000","last_change":"2023-10-09T15:39:21.729540+0000","last_active":"2023-10-09T15:39:21.732581+0000","last_peered":"2023-10-09T15:39:21.732581+0000","last_clean":"2023-10-09T15:39:21.732581+0000","last_became_active":"2023-10-09T15:39:21.729249+0000","last_became_peered":"2023-10-09T15:39:21.729249+0000","last_unstale":"2023-10-09T15:39:21.732581+0000","last_undegraded":"2023-10-09T15:39:21.732581+0000","last_fullsized":"2023-10-09T15:39:21.732581+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:29:32.584487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.9","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307485+0000","last_change":"2023-10-09T15:39:22.307485+0000","last_active":"2023-10-09T15:39:22.307485+0000","last_peered":"2023-10-09T15:39:22.307485+0000","last_clean":"2023-10-09T15:39:22.307485+0000","last_became_active":"2023-10-09T15:39:22.307170+0000","last_became_peered":"2023-10-09T15:39:22.307170+0000","last_unstale":"2023-10-09T15:39:22.307485+0000","last_undegraded":"2023-10-09T15:39:22.307485+0000","last_fullsized":"2023-10-09T15:39:22.307485+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:43:45.047374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.8","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.288338+0000","last_change":"2023-10-09T15:39:21.728828+0000","last_active":"2023-10-09T15:39:22.288338+0000","last_peered":"2023-10-09T15:39:22.288338+0000","last_clean":"2023-10-09T15:39:22.288338+0000","last_became_active":"2023-10-09T15:39:21.728487+0000","last_became_peered":"2023-10-09T15:39:21.728487+0000","last_unstale":"2023-10-09T15:39:22.288338+0000","last_undegraded":"2023-10-09T15:39:22.288338+0000","last_fullsized":"2023-10-09T15:39:22.288338+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:45:26.648305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.6","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306956+0000","last_change":"2023-10-09T15:39:22.306956+0000","last_active":"2023-10-09T15:39:22.306956+0000","last_peered":"2023-10-09T15:39:22.306956+0000","last_clean":"2023-10-09T15:39:22.306956+0000","last_became_active":"2023-10-09T15:39:22.306746+0000","last_became_peered":"2023-10-09T15:39:22.306746+0000","last_unstale":"2023-10-09T15:39:22.306956+0000","last_undegraded":"2023-10-09T15:39:22.306956+0000","last_fullsized":"2023-10-09T15:39:22.306956+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:03.589870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.7","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731623+0000","last_change":"2023-10-09T15:39:21.731749+0000","last_active":"2023-10-09T15:39:22.731623+0000","last_peered":"2023-10-09T15:39:22.731623+0000","last_clean":"2023-10-09T15:39:22.731623+0000","last_became_active":"2023-10-09T15:39:21.731539+0000","last_became_peered":"2023-10-09T15:39:21.731539+0000","last_unstale":"2023-10-09T15:39:22.731623+0000","last_undegraded":"2023-10-09T15:39:22.731623+0000","last_fullsized":"2023-10-09T15:39:22.731623+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:39:37.596449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.7","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307922+0000","last_change":"2023-10-09T15:39:22.301240+0000","last_active":"2023-10-09T15:39:22.307922+0000","last_peered":"2023-10-09T15:39:22.307922+0000","last_clean":"2023-10-09T15:39:22.307922+0000","last_became_active":"2023-10-09T15:39:22.300836+0000","last_became_peered":"2023-10-09T15:39:22.300836+0000","last_unstale":"2023-10-09T15:39:22.307922+0000","last_undegraded":"2023-10-09T15:39:22.307922+0000","last_fullsized":"2023-10-09T15:39:22.307922+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:42.047111+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.6","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.297965+0000","last_change":"2023-10-09T15:39:21.729930+0000","last_active":"2023-10-09T15:39:22.297965+0000","last_peered":"2023-10-09T15:39:22.297965+0000","last_clean":"2023-10-09T15:39:22.297965+0000","last_became_active":"2023-10-09T15:39:21.729648+0000","last_became_peered":"2023-10-09T15:39:21.729648+0000","last_unstale":"2023-10-09T15:39:22.297965+0000","last_undegraded":"2023-10-09T15:39:22.297965+0000","last_fullsized":"2023-10-09T15:39:22.297965+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:04.465878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.4","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.308863+0000","last_change":"2023-10-09T15:39:22.305075+0000","last_active":"2023-10-09T15:39:22.308863+0000","last_peered":"2023-10-09T15:39:22.308863+0000","last_clean":"2023-10-09T15:39:22.308863+0000","last_became_active":"2023-10-09T15:39:22.304800+0000","last_became_peered":"2023-10-09T15:39:22.304800+0000","last_unstale":"2023-10-09T15:39:22.308863+0000","last_undegraded":"2023-10-09T15:39:22.308863+0000","last_fullsized":"2023-10-09T15:39:22.308863+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:52:46.431870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.5","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.295674+0000","last_change":"2023-10-09T15:39:21.730612+0000","last_active":"2023-10-09T15:39:22.295674+0000","last_peered":"2023-10-09T15:39:22.295674+0000","last_clean":"2023-10-09T15:39:22.295674+0000","last_became_active":"2023-10-09T15:39:21.730301+0000","last_became_peered":"2023-10-09T15:39:21.730301+0000","last_unstale":"2023-10-09T15:39:22.295674+0000","last_undegraded":"2023-10-09T15:39:22.295674+0000","last_fullsized":"2023-10-09T15:39:22.295674+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:11:30.108704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"29.5","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.296754+0000","last_change":"2023-10-09T15:39:22.296754+0000","last_active":"2023-10-09T15:39:22.296754+0000","last_peered":"2023-10-09T15:39:22.296754+0000","last_clean":"2023-10-09T15:39:22.296754+0000","last_became_active":"2023-10-09T15:39:22.296499+0000","last_became_peered":"2023-10-09T15:39:22.296499+0000","last_unstale":"2023-10-09T15:39:22.296754+0000","last_undegraded":"2023-10-09T15:39:22.296754+0000","last_fullsized":"2023-10-09T15:39:22.296754+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:21.174448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"28.4","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.290653+0000","last_change":"2023-10-09T15:39:21.727208+0000","last_active":"2023-10-09T15:39:22.290653+0000","last_peered":"2023-10-09T15:39:22.290653+0000","last_clean":"2023-10-09T15:39:22.290653+0000","last_became_active":"2023-10-09T15:39:21.726334+0000","last_became_peered":"2023-10-09T15:39:21.726334+0000","last_unstale":"2023-10-09T15:39:22.290653+0000","last_undegraded":"2023-10-09T15:39:22.290653+0000","last_fullsized":"2023-10-09T15:39:22.290653+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:57:11.461504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.2","version":"0'0","reported_seq":8,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.305112+0000","last_change":"2023-10-09T15:39:22.305112+0000","last_active":"2023-10-09T15:39:22.305112+0000","last_peered":"2023-10-09T15:39:22.305112+0000","last_clean":"2023-10-09T15:39:22.305112+0000","last_became_active":"2023-10-09T15:39:22.304795+0000","last_became_peered":"2023-10-09T15:39:22.304795+0000","last_unstale":"2023-10-09T15:39:22.305112+0000","last_undegraded":"2023-10-09T15:39:22.305112+0000","last_fullsized":"2023-10-09T15:39:22.305112+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:07.478597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"28.3","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.733139+0000","last_change":"2023-10-09T15:39:21.731332+0000","last_active":"2023-10-09T15:39:21.733139+0000","last_peered":"2023-10-09T15:39:21.733139+0000","last_clean":"2023-10-09T15:39:21.733139+0000","last_became_active":"2023-10-09T15:39:21.730896+0000","last_became_peered":"2023-10-09T15:39:21.730896+0000","last_unstale":"2023-10-09T15:39:21.733139+0000","last_undegraded":"2023-10-09T15:39:21.733139+0000","last_fullsized":"2023-10-09T15:39:21.733139+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:02:42.645884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"29.3","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307528+0000","last_change":"2023-10-09T15:39:22.299589+0000","last_active":"2023-10-09T15:39:22.307528+0000","last_peered":"2023-10-09T15:39:22.307528+0000","last_clean":"2023-10-09T15:39:22.307528+0000","last_became_active":"2023-10-09T15:39:22.299312+0000","last_became_peered":"2023-10-09T15:39:22.299312+0000","last_unstale":"2023-10-09T15:39:22.307528+0000","last_undegraded":"2023-10-09T15:39:22.307528+0000","last_fullsized":"2023-10-09T15:39:22.307528+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:57:07.478597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.2","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.726858+0000","last_change":"2023-10-09T15:39:21.725346+0000","last_active":"2023-10-09T15:39:21.726858+0000","last_peered":"2023-10-09T15:39:21.726858+0000","last_clean":"2023-10-09T15:39:21.726858+0000","last_became_active":"2023-10-09T15:39:21.724903+0000","last_became_peered":"2023-10-09T15:39:21.724903+0000","last_unstale":"2023-10-09T15:39:21.726858+0000","last_undegraded":"2023-10-09T15:39:21.726858+0000","last_fullsized":"2023-10-09T15:39:21.726858+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:23:28.989395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"29.0","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.311589+0000","last_change":"2023-10-09T15:39:22.307709+0000","last_active":"2023-10-09T15:39:22.311589+0000","last_peered":"2023-10-09T15:39:22.311589+0000","last_clean":"2023-10-09T15:39:22.311589+0000","last_became_active":"2023-10-09T15:39:22.307115+0000","last_became_peered":"2023-10-09T15:39:22.307115+0000","last_unstale":"2023-10-09T15:39:22.311589+0000","last_undegraded":"2023-10-09T15:39:22.311589+0000","last_fullsized":"2023-10-09T15:39:22.311589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:17:31.780681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"28.1","version":"0'0","reported_seq":9,"reported_epoch":166,"state":"active+clean","last_fresh":"2023-10-09T15:39:21.731037+0000","last_change":"2023-10-09T15:39:21.730035+0000","last_active":"2023-10-09T15:39:21.731037+0000","last_peered":"2023-10-09T15:39:21.731037+0000","last_clean":"2023-10-09T15:39:21.731037+0000","last_became_active":"2023-10-09T15:39:21.729488+0000","last_became_peered":"2023-10-09T15:39:21.729488+0000","last_unstale":"2023-10-09T15:39:21.731037+0000","last_undegraded":"2023-10-09T15:39:21.731037+0000","last_fullsized":"2023-10-09T15:39:21.731037+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:01:24.726276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"29.1","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.307156+0000","last_change":"2023-10-09T15:39:22.305552+0000","last_active":"2023-10-09T15:39:22.307156+0000","last_peered":"2023-10-09T15:39:22.307156+0000","last_clean":"2023-10-09T15:39:22.307156+0000","last_became_active":"2023-10-09T15:39:22.305248+0000","last_became_peered":"2023-10-09T15:39:22.305248+0000","last_unstale":"2023-10-09T15:39:22.307156+0000","last_undegraded":"2023-10-09T15:39:22.307156+0000","last_fullsized":"2023-10-09T15:39:22.307156+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:04:31.422628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.0","version":"0'0","reported_seq":10,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.288456+0000","last_change":"2023-10-09T15:39:21.728558+0000","last_active":"2023-10-09T15:39:22.288456+0000","last_peered":"2023-10-09T15:39:22.288456+0000","last_clean":"2023-10-09T15:39:22.288456+0000","last_became_active":"2023-10-09T15:39:21.728130+0000","last_became_peered":"2023-10-09T15:39:21.728130+0000","last_unstale":"2023-10-09T15:39:22.288456+0000","last_undegraded":"2023-10-09T15:39:22.288456+0000","last_fullsized":"2023-10-09T15:39:22.288456+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:26:51.458524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"29.1c","version":"0'0","reported_seq":9,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.306392+0000","last_change":"2023-10-09T15:39:22.302645+0000","last_active":"2023-10-09T15:39:22.306392+0000","last_peered":"2023-10-09T15:39:22.306392+0000","last_clean":"2023-10-09T15:39:22.306392+0000","last_became_active":"2023-10-09T15:39:22.302347+0000","last_became_peered":"2023-10-09T15:39:22.302347+0000","last_unstale":"2023-10-09T15:39:22.306392+0000","last_undegraded":"2023-10-09T15:39:22.306392+0000","last_fullsized":"2023-10-09T15:39:22.306392+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:21.706759+0000","last_clean_scrub_stamp":"2023-10-09T15:39:21.706759+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:48:39.459279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"28.1d","version":"167'2","reported_seq":11,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.731582+0000","last_change":"2023-10-09T15:39:21.728355+0000","last_active":"2023-10-09T15:39:22.731582+0000","last_peered":"2023-10-09T15:39:22.731582+0000","last_clean":"2023-10-09T15:39:22.731582+0000","last_became_active":"2023-10-09T15:39:21.728073+0000","last_became_peered":"2023-10-09T15:39:21.728073+0000","last_unstale":"2023-10-09T15:39:22.731582+0000","last_undegraded":"2023-10-09T15:39:22.731582+0000","last_fullsized":"2023-10-09T15:39:22.731582+0000","mapping_epoch":165,"log_start":"0'0","ondisk_log_start":"0'0","created":165,"last_epoch_clean":166,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:20.702470+0000","last_clean_scrub_stamp":"2023-10-09T15:39:20.702470+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:11:13.214705+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":286,"reported_epoch":167,"state":"active+clean","last_fresh":"2023-10-09T15:39:22.293344+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:39:22.293344+0000","last_peered":"2023-10-09T15:39:22.293344+0000","last_clean":"2023-10-09T15:39:22.293344+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:39:22.293344+0000","last_undegraded":"2023-10-09T15:39:22.293344+0000","last_fullsized":"2023-10-09T15:39:22.293344+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":29,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":28,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574954,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304032,"kb_used_data":2648,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067808,"statfs":{"total":96636764160,"available":96325435392,"internally_reserved":0,"allocated":2711552,"data_stored":1540054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.77500000000000002},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63700000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.874},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.73199999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.61699999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.71799999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78000000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67300000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":0.84399999999999997,"15min":0.88},"last":0.53000000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58199999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.40699999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574954,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303460,"kb_used_data":2076,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068380,"statfs":{"total":96636764160,"available":96326021120,"internally_reserved":0,"allocated":2125824,"data_stored":949742,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.83699999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.78400000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.45800000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53000000000000003,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":1.379},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.40200000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.3999999999999999},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.73699999999999999},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.56000000000000005}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.47699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.93600000000000005},"last":0.495},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.872},"last":0.52600000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.89700000000000002},"last":0.62}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.87,"5min":0.87,"15min":1.004},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.60499999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574955,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33800000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.215},"max":{"1min":0.44700000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.443},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.34699999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46800000000000003,"5min":0.55300000000000005,"15min":1.512},"last":0.25}]},{"osd":2,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33200000000000002,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.437,"5min":0.56399999999999995,"15min":1.286},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.32200000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.96899999999999997},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.54600000000000004,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.45700000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.377,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.222},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77400000000000002,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.40500000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66200000000000003,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.498},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93100000000000005,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.39300000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.76800000000000002},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.93600000000000005,"15min":1.258},"last":0.41299999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65700000000000003,"15min":0.66600000000000004},"min":{"1min":0.46700000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.996,"15min":0.997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.77300000000000002},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77100000000000002,"5min":1.024,"15min":5.5819999999999999},"last":0.55900000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304028,"kb_used_data":2644,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067812,"statfs":{"total":96636764160,"available":96325439488,"internally_reserved":0,"allocated":2707456,"data_stored":1539043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54500000000000004,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55900000000000005,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.35599999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.441,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":6.484,"15min":6.484},"last":0.34100000000000003},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45900000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.308}]},{"osd":3,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.495},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44,"15min":0.57599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":2.109,"15min":4.5890000000000004},"last":0.378}]},{"osd":4,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76000000000000001,"5min":1.921,"15min":1.921},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.64400000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.508},"last":0.55900000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.57099999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.70999999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":2.032,"15min":2.032},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.75900000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574954,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303472,"kb_used_data":2088,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068368,"statfs":{"total":96636764160,"available":96326008832,"internally_reserved":0,"allocated":2138112,"data_stored":951278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.44500000000000001,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.35599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.441,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.318}]},{"osd":1,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.22500000000000001},"max":{"1min":0.442,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46600000000000003,"5min":0.622,"15min":0.73699999999999999},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.46400000000000002,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.44}]},{"osd":4,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.71999999999999997,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79900000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.432},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":2.5249999999999999},"last":0.52000000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90000000000000002,"5min":0.997,"15min":1.5189999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.55100000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":1.0620000000000001,"15min":1.407},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.499}]}]},{"osd":3,"up_from":13,"seq":55834574952,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303468,"kb_used_data":2084,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068372,"statfs":{"total":96636764160,"available":96326012928,"internally_reserved":0,"allocated":2134016,"data_stored":951292,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.76100000000000001},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54000000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.51900000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.58999999999999997},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.378,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.372,"15min":1.143},"min":{"1min":0.311,"5min":0.247,"15min":0.247},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.65900000000000003},"min":{"1min":0.29999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.54200000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":0.996,"15min":17.02},"last":0.79900000000000004},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.84199999999999997},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.70899999999999996}]},{"osd":5,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.498,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":1.004},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.93300000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.85199999999999998},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.999},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.016,"5min":1.016,"15min":1.278},"last":0.91800000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":1.044},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.90800000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":9.6029999999999998},"last":1.024}]}]},{"osd":4,"up_from":13,"seq":55834574953,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":2.879},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.96899999999999997},"last":0.38500000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.621},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.41099999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34599999999999997},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.438},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.65100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78700000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.52800000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.245,"15min":0.245},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.63400000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.69999999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574954,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303452,"kb_used_data":2068,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068388,"statfs":{"total":96636764160,"available":96326029312,"internally_reserved":0,"allocated":2117632,"data_stored":949686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.87},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.439,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.79400000000000004,"15min":1.165},"last":0.39100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.45100000000000001,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.871,"15min":2.089},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.81299999999999994},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.441},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.83799999999999997},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.56699999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.84299999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.60199999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":1.0569999999999999},"last":0.52200000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83399999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.55200000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":1.016},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.83499999999999996,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.626}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1592,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":554,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":28,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":29,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:39:27.230 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:39:27.230 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:39:27.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.390+0000 7f6ae0cb7700 1 Processor -- start 2023-10-09T15:39:27.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.390+0000 7f6ae0cb7700 1 -- start start 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ae0cb7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6adc13c9b0 0x7f6adc069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ae0cb7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc06f7d0 con 0x7f6adc0cc6f0 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ae0cb7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6adc06d7b0 con 0x7f6adc0cc320 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ae0cb7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6adc06e330 con 0x7f6adc13c9b0 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6adad9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6adc0cc6f0 0x7f6adc069f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48702/0 (socket says 172.21.15.33:48702) 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6adad9d700 1 -- 172.21.15.33:0/969069981 learned_addr learned my addr 172.21.15.33:0/969069981 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad9d9b700 1 --2- 172.21.15.33:0/969069981 >> v2:172.21.15.59:3300/0 conn(0x7f6adc13c9b0 0x7f6adc069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 539168387 0 0) 0x7f6adc06f7d0 con 0x7f6adc0cc6f0 2023-10-09T15:39:27.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ac8003570 con 0x7f6adc0cc6f0 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1964150300 0 0) 0x7f6adc06d7b0 con 0x7f6adc0cc320 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6adc06f7d0 con 0x7f6adc0cc320 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4270528760 0 0) 0x7f6ac8003570 con 0x7f6adc0cc6f0 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad9d9b700 1 -- 172.21.15.33:0/969069981 >> v1:172.21.15.59:6789/0 conn(0x7f6adc0cc320 legacy=0x7f6adc13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad9d9b700 1 -- 172.21.15.33:0/969069981 >> v1:172.21.15.33:6789/0 conn(0x7f6adc0cc6f0 legacy=0x7f6adc069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.391+0000 7f6ad9d9b700 1 -- 172.21.15.33:0/969069981 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6adc06da00 con 0x7f6adc13c9b0 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ad9d9b700 1 --2- 172.21.15.33:0/969069981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc13c9b0 0x7f6adc069a00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098e0 tx=0x7f6ac40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=868c9794d63723fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4001470 con 0x7f6adc13c9b0 2023-10-09T15:39:27.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac4011420 con 0x7f6adc13c9b0 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ad959a700 1 -- 172.21.15.33:0/969069981 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac40117c0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/969069981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc13c9b0 msgr2=0x7f6adc069a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/969069981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc13c9b0 0x7f6adc069a00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6ac40098e0 tx=0x7f6ac40091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.392+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/969069981 shutdown_connections 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.393+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/969069981 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc13c9b0 0x7f6adc069a00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.393+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/969069981 >> 172.21.15.33:0/969069981 conn(0x7f6adc067f00 msgr2=0x7f6adc068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.393+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/969069981 shutdown_connections 2023-10-09T15:39:27.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.393+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/969069981 wait complete. 2023-10-09T15:39:27.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 Processor -- start 2023-10-09T15:39:27.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 -- start start 2023-10-09T15:39:27.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc0cc320 0x7f6adc152f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc0cc6f0 0x7f6adc16a0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc13a030 con 0x7f6adc13c9b0 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16abd0 con 0x7f6adc0cc6f0 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.394+0000 7f6ae0cb7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6adc16aeb0 con 0x7f6adc0cc320 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36394/0 (socket says 172.21.15.33:36394) 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 -- 172.21.15.33:0/3627975624 learned_addr learned my addr 172.21.15.33:0/3627975624 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ada59c700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc0cc320 0x7f6adc152f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ad9d9b700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc0cc6f0 0x7f6adc16a0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 -- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc0cc320 msgr2=0x7f6adc152f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc0cc320 0x7f6adc152f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 -- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc0cc6f0 msgr2=0x7f6adc16a0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc0cc6f0 0x7f6adc16a0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 -- 172.21.15.33:0/3627975624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac4009420 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6adad9d700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40015a0 tx=0x7f6ad4001a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4001d10 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ad4007360 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6adc139cc0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ad4007700 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.395+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6adc0cb960 con 0x7f6adc13c9b0 2023-10-09T15:39:27.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.396+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6adc0cd1f0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.397+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6ad4004a40 con 0x7f6adc13c9b0 2023-10-09T15:39:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.397+0000 7f6ad27fc700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 0x7f6abc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.397+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6ad4084380 con 0x7f6adc13c9b0 2023-10-09T15:39:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.397+0000 7f6ada59c700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 0x7f6abc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.397+0000 7f6ada59c700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 0x7f6abc0697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b0ba0 tx=0x7f6acc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.401+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ad40510d0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.678 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.677+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6adc04c3c0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.681+0000 7f6ad27fc700 1 -- 172.21.15.33:0/3627975624 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6ad40546f0 con 0x7f6adc13c9b0 2023-10-09T15:39:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 msgr2=0x7f6abc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 0x7f6abc0697d0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f6adc0b0ba0 tx=0x7f6acc009040 comp rx=0 tx=0).stop 2023-10-09T15:39:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 msgr2=0x7f6adc16a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7f6ad40015a0 tx=0x7f6ad4001a80 comp rx=0 tx=0).stop 2023-10-09T15:39:27.684 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 shutdown_connections 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6abc067320 0x7f6abc0697d0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6adc13c9b0 0x7f6adc16a5e0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6adc0cc320 0x7f6adc152f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 --2- 172.21.15.33:0/3627975624 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6adc0cc6f0 0x7f6adc16a0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 >> 172.21.15.33:0/3627975624 conn(0x7f6adc067f00 msgr2=0x7f6adc0682d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 shutdown_connections 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.683+0000 7f6ae0cb7700 1 -- 172.21.15.33:0/3627975624 wait complete. 2023-10-09T15:39:27.685 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:39:27.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:27.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.815+0000 7f08a1b43700 1 Processor -- start 2023-10-09T15:39:27.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.815+0000 7f08a1b43700 1 -- start start 2023-10-09T15:39:27.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f08a1b43700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f089c1410e0 0x7f089c06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f08a1b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c0c7a40 0x7f089c0c7ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f08a1b43700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f089c0c86e0 con 0x7f089c06c860 2023-10-09T15:39:27.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f08a1b43700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f089c15c1c0 con 0x7f089c1410e0 2023-10-09T15:39:27.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f08a1b43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089c15b400 con 0x7f089c0c7a40 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f089affd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f089c1410e0 0x7f089c06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f089b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f089c06c860 0x7f089c1409d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48710/0 (socket says 172.21.15.33:48710) 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.816+0000 7f089b7fe700 1 -- 172.21.15.33:0/4142969012 learned_addr learned my addr 172.21.15.33:0/4142969012 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089bfff700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c0c7a40 0x7f089c0c7ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089affd700 1 -- 172.21.15.33:0/4142969012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c0c7a40 msgr2=0x7f089c0c7ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089affd700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c0c7a40 0x7f089c0c7ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089affd700 1 -- 172.21.15.33:0/4142969012 >> v1:172.21.15.33:6789/0 conn(0x7f089c06c860 legacy=0x7f089c1409d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089affd700 1 -- 172.21.15.33:0/4142969012 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f089c15b6e0 con 0x7f089c1410e0 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089a7fc700 1 -- 172.21.15.33:0/4142969012 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577067503 0 0) 0x7f089c0c86e0 con 0x7f089c06c860 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089affd700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c1410e0 0x7f089c06cc30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f08900098e0 tx=0x7f08900091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8738560bea5359b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089a7fc700 1 -- 172.21.15.33:0/4142969012 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0890009e80 con 0x7f089c1410e0 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089a7fc700 1 -- 172.21.15.33:0/4142969012 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f089000b860 con 0x7f089c1410e0 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.817+0000 7f089a7fc700 1 -- 172.21.15.33:0/4142969012 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f089000bbe0 con 0x7f089c1410e0 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 -- 172.21.15.33:0/4142969012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c1410e0 msgr2=0x7f089c06cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c1410e0 0x7f089c06cc30 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f08900098e0 tx=0x7f08900091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 -- 172.21.15.33:0/4142969012 shutdown_connections 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c0c7a40 0x7f089c0c7ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 --2- 172.21.15.33:0/4142969012 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c1410e0 0x7f089c06cc30 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 -- 172.21.15.33:0/4142969012 >> 172.21.15.33:0/4142969012 conn(0x7f089c0cd400 msgr2=0x7f089c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 -- 172.21.15.33:0/4142969012 shutdown_connections 2023-10-09T15:39:27.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.818+0000 7f08a1b43700 1 -- 172.21.15.33:0/4142969012 wait complete. 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.819+0000 7f08a1b43700 1 Processor -- start 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.819+0000 7f08a1b43700 1 -- start start 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089c0c7a40 0x7f089c13b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c1410e0 0x7f089c159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c13c010 con 0x7f089c06c860 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f089c13c2f0 con 0x7f089c0c7a40 2023-10-09T15:39:27.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08a1b43700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f089c13c5d0 con 0x7f089c1410e0 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36414/0 (socket says 172.21.15.33:36414) 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 -- 172.21.15.33:0/2290534676 learned_addr learned my addr 172.21.15.33:0/2290534676 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089bfff700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c1410e0 0x7f089c159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089affd700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089c0c7a40 0x7f089c13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 -- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c1410e0 msgr2=0x7f089c159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c1410e0 0x7f089c159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 -- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089c0c7a40 msgr2=0x7f089c13b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089c0c7a40 0x7f089c13b650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 -- 172.21.15.33:0/2290534676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0890009420 con 0x7f089c06c860 2023-10-09T15:39:27.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f089b7fe700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c7e0 tx=0x7f088c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.820+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c005b30 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.821+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f088c005c90 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.821+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f089c13c8b0 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.821+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f088c007300 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.821+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f089c156430 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.821+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f089c0c4e00 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.822+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f088c01b3b0 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.822+0000 7f08837fe700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 0x7f08880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.822+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f088c084190 con 0x7f089c06c860 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.822+0000 7f089affd700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 0x7f08880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:27.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.823+0000 7f089affd700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 0x7f08880697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f08900091e0 tx=0x7f0890017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:27.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:27.826+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f089c0c4e00 con 0x7f089c06c860 2023-10-09T15:39:28.042 INFO:tasks.ceph.mds.a.smithi033.stderr:2023-10-09T15:39:28.041+0000 7f9144417700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:39:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.064+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f089c0c4e00 con 0x7f089c06c860 2023-10-09T15:39:28.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.064+0000 7f08837fe700 1 -- 172.21.15.33:0/2290534676 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 112 v112) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f089c0c4e00 con 0x7f089c06c860 2023-10-09T15:39:28.065 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:28.065 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":112,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":112,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:25.746958+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 msgr2=0x7f08880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 0x7f08880697d0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f08900091e0 tx=0x7f0890017000 comp rx=0 tx=0).stop 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 msgr2=0x7f089c155ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7f088c00c7e0 tx=0x7f088c007df0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 shutdown_connections 2023-10-09T15:39:28.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0888067320 0x7f08880697d0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f089c06c860 0x7f089c155ef0 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f089c1410e0 0x7f089c159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.066+0000 7f08a1b43700 1 --2- 172.21.15.33:0/2290534676 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f089c0c7a40 0x7f089c13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.067+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 >> 172.21.15.33:0/2290534676 conn(0x7f089c0cd400 msgr2=0x7f089c06cc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.067+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 shutdown_connections 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.067+0000 7f08a1b43700 1 -- 172.21.15.33:0/2290534676 wait complete. 2023-10-09T15:39:28.069 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 112 2023-10-09T15:39:28.482 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 112, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:39:22.121849+0000', 'modified': '2023-10-09T15:39:25.746958+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8262}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8262': {'gid': 8262, 'name': 'a', 'rank': 0, 'incarnation': 108, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6837/2271544714', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6835', 'nonce': 2271544714}, {'type': 'v1', 'addr': '172.21.15.33:6837', 'nonce': 2271544714}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [29], 'metadata_pool': 28, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:39:28.482 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:39:28.482 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-10-09T15:39:28.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.605+0000 7fa7c32e8700 1 Processor -- start 2023-10-09T15:39:28.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.605+0000 7fa7c32e8700 1 -- start start 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c32e8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7bc15de50 0x7fa7bc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c32e8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc0cf3c0 con 0x7fa7bc0cef40 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c32e8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7bc15afd0 con 0x7fa7bc153c30 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c32e8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7bc15b2b0 con 0x7fa7bc15de50 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c1ae5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa7bc15de50 0x7fa7bc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c2ae7700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa7bc0cef40 0x7fa7bc15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48716/0 (socket says 172.21.15.33:48716) 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c2ae7700 1 -- 172.21.15.33:0/337804480 learned_addr learned my addr 172.21.15.33:0/337804480 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/337804480 >> v1:172.21.15.59:6789/0 conn(0x7fa7bc153c30 legacy=0x7fa7bc15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/337804480 >> v1:172.21.15.33:6789/0 conn(0x7fa7bc0cef40 legacy=0x7fa7bc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.606+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/337804480 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7bc15b590 con 0x7fa7bc15de50 2023-10-09T15:39:28.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/337804480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0cea00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c9571de1c8e223 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c12e4700 1 -- 172.21.15.33:0/337804480 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b0009e80 con 0x7fa7bc15de50 2023-10-09T15:39:28.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c12e4700 1 -- 172.21.15.33:0/337804480 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b000b820 con 0x7fa7bc15de50 2023-10-09T15:39:28.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c12e4700 1 -- 172.21.15.33:0/337804480 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b000bba0 con 0x7fa7bc15de50 2023-10-09T15:39:28.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 -- 172.21.15.33:0/337804480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc15de50 msgr2=0x7fa7bc0cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/337804480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0cea00 secure :-1 s=READY pgs=1490 cs=0 l=1 rev1=1 crypto rx=0x7fa7b00098e0 tx=0x7fa7b00091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 -- 172.21.15.33:0/337804480 shutdown_connections 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/337804480 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0cea00 unknown :-1 s=CLOSED pgs=1490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 -- 172.21.15.33:0/337804480 >> 172.21.15.33:0/337804480 conn(0x7fa7bc0703a0 msgr2=0x7fa7bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 -- 172.21.15.33:0/337804480 shutdown_connections 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.607+0000 7fa7c32e8700 1 -- 172.21.15.33:0/337804480 wait complete. 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.608+0000 7fa7c32e8700 1 Processor -- start 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 -- start start 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc153c30 0x7fa7bc0ccca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc151260 con 0x7fa7bc0cef40 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc13eac0 con 0x7fa7bc15de50 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c32e8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7bc0c86f0 con 0x7fa7bc153c30 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c22e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c22e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36432/0 (socket says 172.21.15.33:36432) 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.609+0000 7fa7c22e6700 1 -- 172.21.15.33:0/1417529052 learned_addr learned my addr 172.21.15.33:0/1417529052 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc153c30 0x7fa7bc0ccca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 -- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc153c30 msgr2=0x7fa7bc0ccca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc153c30 0x7fa7bc0ccca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 -- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 msgr2=0x7fa7bc0b32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0b32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 -- 172.21.15.33:0/1417529052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7b0009420 con 0x7fa7bc0cef40 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c5d0 tx=0x7fa7b4007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7ba7fc700 1 -- 172.21.15.33:0/1417529052 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011590 con 0x7fa7bc0cef40 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7ba7fc700 1 -- 172.21.15.33:0/1417529052 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4011710 con 0x7fa7bc0cef40 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7ba7fc700 1 -- 172.21.15.33:0/1417529052 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b4011ad0 con 0x7fa7bc0cef40 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7bc0c7ae0 con 0x7fa7bc0cef40 2023-10-09T15:39:28.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.610+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0c80a0 con 0x7fa7bc0cef40 2023-10-09T15:39:28.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.611+0000 7fa7ba7fc700 1 -- 172.21.15.33:0/1417529052 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa7b401c460 con 0x7fa7bc0cef40 2023-10-09T15:39:28.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.612+0000 7fa7ba7fc700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 0x7fa7a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.612+0000 7fa7ba7fc700 1 -- 172.21.15.33:0/1417529052 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7b40849d0 con 0x7fa7bc0cef40 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.612+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 0x7fa7a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.612+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 0x7fa7a80697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b4f30 tx=0x7fa7b0016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.614+0000 7fa7cd842b80 1 Processor -- start 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.614+0000 7fa7cd842b80 1 -- start start 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.614+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41eb77d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.614+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41e8dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41de4a70 con 0x556e41e8b5f0 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41de2270 con 0x556e41e8db80 2023-10-09T15:39:28.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e41dde060 con 0x556e41ed8480 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36442/0 (socket says 172.21.15.33:36442) 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/2884398545 learned_addr learned my addr 172.21.15.33:0/2884398545 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41eb77d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41e8dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 msgr2=0x556e41eb77d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41eb77d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 msgr2=0x556e41e8dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41e8dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/2884398545 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e41c78270 con 0x556e41e8b5f0 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b3c0 tx=0x7fa7b001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2dedaf92e78dabe7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7a37fe700 1 -- 172.21.15.33:0/2884398545 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b001d8f0 con 0x556e41e8b5f0 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7a37fe700 1 -- 172.21.15.33:0/2884398545 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b001da50 con 0x556e41e8b5f0 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.615+0000 7fa7a37fe700 1 -- 172.21.15.33:0/2884398545 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b001ddd0 con 0x556e41e8b5f0 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2884398545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 msgr2=0x556e41ed8850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7fa7b000b3c0 tx=0x7fa7b001f040 comp rx=0 tx=0).stop 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2884398545 shutdown_connections 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41e8dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41eb77d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2884398545 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41ed8850 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2884398545 >> 172.21.15.33:0/2884398545 conn(0x556e41e8f0c0 msgr2=0x556e41e8f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2884398545 shutdown_connections 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.616+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2884398545 wait complete. 2023-10-09T15:39:28.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.617+0000 7fa7cd842b80 1 -- start start 2023-10-09T15:39:28.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.617+0000 7fa7cd842b80 1 Processor -- start 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41eb92c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41ee78c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41d89890 con 0x556e41e8b5f0 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41da4ea0 con 0x556e41e8db80 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e41c60e30 con 0x556e41ed8480 2023-10-09T15:39:28.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 10 client.0 _ll_register_callbacks cb 0x556e41e512c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36450/0 (socket says 172.21.15.33:36450) 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 -- 172.21.15.33:0/3434964984 learned_addr learned my addr 172.21.15.33:0/3434964984 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41eb92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41ee78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 -- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 msgr2=0x556e41ee78c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41ee78c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 -- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 msgr2=0x556e41eb92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41eb92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 -- 172.21.15.33:0/3434964984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7b0023070 con 0x556e41e8b5f0 2023-10-09T15:39:28.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41eb92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4051820 tx=0x7fa7b40584a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef1753aa0c91f486 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b406f070 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7b4058570 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x556e41e82cd0 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7b40550f0 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 10 client.8421 fetch_fsmap learned FSMap version 112 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.618+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x556e41c1afe0 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b4060020 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 112) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7b4054810 con 0x556e41e8b5f0 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 10 client.8421 fetch_fsmap finished waiting for FSMap version 112 2023-10-09T15:39:28.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 10 client.8421 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 20 client.8421 populate_metadata read hostname 'smithi033' 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41ed7310 0x556e41ed76e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 4 client.8421 mds_command: new command op to 8262 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 --> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x556e41e5faa0 con 0x556e41ed7310 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41ed7310 0x556e41ed76e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41ed7310 0x556e41ed76e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85f16ff5441710c1 server_cookie=dfe4298bf93a1c9d in_seq=0 out_seq=0 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.619+0000 7fa7a0ff9700 10 client.8421 ms_handle_connect on v2:172.21.15.33:6835/2271544714 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/3434964984 <== mds.0 v2:172.21.15.33:6835/2271544714 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x556e41e5faa0 con 0x556e41ed7310 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7a0ff9700 10 client.8421 handle_command_reply: tid=0 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 client.8421 shutdown 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 msgr2=0x556e41eb8930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 secure :-1 s=READY pgs=1493 cs=0 l=1 rev1=1 crypto rx=0x7fa7b4051820 tx=0x7fa7b40584a0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 shutdown_connections 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41ed7310 0x556e41ed76e0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8b5f0 0x556e41eb8930 unknown :-1 s=CLOSED pgs=1493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7a0ff9700 0 client.8421 ms_handle_reset on v2:172.21.15.33:6835/2271544714 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41ee78c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/3434964984 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8db80 0x556e41eb92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 >> 172.21.15.33:0/3434964984 conn(0x556e41e8f0c0 msgr2=0x556e41e8aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 shutdown_connections 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 1 -- 172.21.15.33:0/3434964984 wait complete. 2023-10-09T15:39:28.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.620+0000 7fa7cd842b80 20 client.8421 trim_cache size 0 max 16384 2023-10-09T15:39:28.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.637+0000 7fa7cd842b80 1 Processor -- start 2023-10-09T15:39:28.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.637+0000 7fa7cd842b80 1 -- start start 2023-10-09T15:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41e89e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41eacf00 con 0x556e41ed8480 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41e6d510 con 0x556e41e8b5f0 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e41ed60d0 con 0x556e41e8db80 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36454/0 (socket says 172.21.15.33:36454) 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 -- 172.21.15.33:0/2522734733 learned_addr learned my addr 172.21.15.33:0/2522734733 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 -- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41e8db80 msgr2=0x556e41e8aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 -- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 msgr2=0x556e41e89e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41e89e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 -- 172.21.15.33:0/2522734733 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x556e41dac780 con 0x556e41ed8480 2023-10-09T15:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0c86a0 tx=0x7fa7ac009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83897590dce73fbc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7a3fff700 1 -- 172.21.15.33:0/2522734733 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac007a60 con 0x556e41ed8480 2023-10-09T15:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7a3fff700 1 -- 172.21.15.33:0/2522734733 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7ac00d030 con 0x556e41ed8480 2023-10-09T15:39:28.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.638+0000 7fa7a3fff700 1 -- 172.21.15.33:0/2522734733 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7ac0156c0 con 0x556e41ed8480 2023-10-09T15:39:28.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2522734733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 msgr2=0x556e41e8afb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0c86a0 tx=0x7fa7ac009040 comp rx=0 tx=0).stop 2023-10-09T15:39:28.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2522734733 shutdown_connections 2023-10-09T15:39:28.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41e89e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/2522734733 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2522734733 >> 172.21.15.33:0/2522734733 conn(0x556e41e8f0c0 msgr2=0x556e41ee6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2522734733 shutdown_connections 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.639+0000 7fa7cd842b80 1 -- 172.21.15.33:0/2522734733 wait complete. 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.640+0000 7fa7cd842b80 1 -- start start 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.640+0000 7fa7cd842b80 1 Processor -- start 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41f30b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41ef3500 con 0x556e41e8db80 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x556e41ef4520 con 0x556e41e8b5f0 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x556e41eb2520 con 0x556e41ed8480 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 10 client.0 _ll_register_callbacks cb 0x556e41e512c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36458/0 (socket says 172.21.15.33:36458) 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/922145762 learned_addr learned my addr 172.21.15.33:0/922145762 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41f30b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c2ae7700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 msgr2=0x556e41e8afb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 msgr2=0x556e41f30b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41f30b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 -- 172.21.15.33:0/922145762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7bc0cf3c0 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7c1ae5700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0000e50 tx=0x7fa7b001f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42a7af5d13946f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7a0ff9700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7b003f0d0 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa7b001dbc0 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fa7b001da50 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=112) v2 ==== 24+0+0 (secure 0 0 0) 0x7fa7b001b660 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 10 client.8427 fetch_fsmap learned FSMap version 112 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.641+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=112,monmap=2+}) v3 -- 0x556e41d93470 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7b001da50 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 112) v1 ==== 3100+0+0 (secure 0 0 0) 0x7fa7b0030020 con 0x556e41e8db80 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 10 client.8427 fetch_fsmap finished waiting for FSMap version 112 2023-10-09T15:39:28.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 10 client.8427 resolve_mds: resolved name 'a' to daemon mds.a 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 20 client.8427 populate_metadata read hostname 'smithi033' 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41f3ea90 0x556e41f3ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 4 client.8427 mds_command: new command op to 8262 tid=0[{"prefix": "status"}] 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 --> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] -- command(tid 0: {"prefix": "status"}) v1 -- 0x556e41d80e00 con 0x556e41f3ea90 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41f3ea90 0x556e41f3ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7a0ff9700 10 client.8427 ms_handle_connect on v2:172.21.15.33:6835/2271544714 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7c22e6700 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41f3ea90 0x556e41f3ee60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee1ceeb7a288adec server_cookie=94280d9bd28d269c in_seq=0 out_seq=0 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7a0ff9700 1 -- 172.21.15.33:0/922145762 <== mds.0 v2:172.21.15.33:6835/2271544714 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x556e41d80e00 con 0x556e41f3ea90 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7a0ff9700 10 client.8427 handle_command_reply: tid=0 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 1 client.8427 shutdown 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.642+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 msgr2=0x556e41e8aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7fa7b0000e50 tx=0x7fa7b001f040 comp rx=0 tx=0).stop 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 shutdown_connections 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:6835/2271544714,v1:172.21.15.33:6837/2271544714] conn(0x556e41f3ea90 0x556e41f3ee60 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x556e41ed8480 0x556e41e8afb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7a0ff9700 0 client.8427 ms_handle_reset on v2:172.21.15.33:6835/2271544714 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x556e41e8b5f0 0x556e41f30b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 --2- 172.21.15.33:0/922145762 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x556e41e8db80 0x556e41e8aa70 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 >> 172.21.15.33:0/922145762 conn(0x556e41e8f0c0 msgr2=0x556e41ee6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 shutdown_connections 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 1 -- 172.21.15.33:0/922145762 wait complete. 2023-10-09T15:39:28.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7cd842b80 20 client.8427 trim_cache size 0 max 16384 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 8262, 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9241262030000001, 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 112, 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 168, 2023-10-09T15:39:28.651 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 168, 2023-10-09T15:39:28.652 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 10.990040054 2023-10-09T15:39:28.652 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:39:28.652 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 msgr2=0x7fa7a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 0x7fa7a80697d0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc0b4f30 tx=0x7fa7b0016000 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 msgr2=0x7fa7bc150d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7fa7b400c5d0 tx=0x7fa7b4007f60 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 shutdown_connections 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa7a8067320 0x7fa7a80697d0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa7bc0cef40 0x7fa7bc150d20 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa7bc15de50 0x7fa7bc0b32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 --2- 172.21.15.33:0/1417529052 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa7bc153c30 0x7fa7bc0ccca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 >> 172.21.15.33:0/1417529052 conn(0x7fa7bc0703a0 msgr2=0x7fa7bc15bf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 shutdown_connections 2023-10-09T15:39:28.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.643+0000 7fa7c32e8700 1 -- 172.21.15.33:0/1417529052 wait complete. 2023-10-09T15:39:28.656 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:39:28.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.774+0000 7f377c61b700 1 Processor -- start 2023-10-09T15:39:28.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.774+0000 7f377c61b700 1 -- start start 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377c61b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3774159c80 0x7f37740cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377c61b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37740cfe70 0x7f37740cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377c61b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37740ce9d0 con 0x7f37741598b0 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377c61b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f37740af960 con 0x7f37740cfe70 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377c61b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37740afc30 con 0x7f3774159c80 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377abb8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37740cfe70 0x7f37740cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377abb8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f37740cfe70 0x7f37740cbc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36462/0 (socket says 172.21.15.33:36462) 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f377abb8700 1 -- 172.21.15.33:0/1549556824 learned_addr learned my addr 172.21.15.33:0/1549556824 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.775+0000 7f3779bb6700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3774159c80 0x7f37740cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.778 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377abb8700 1 -- 172.21.15.33:0/1549556824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3774159c80 msgr2=0x7f37740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377abb8700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3774159c80 0x7f37740cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377abb8700 1 -- 172.21.15.33:0/1549556824 >> v1:172.21.15.59:6789/0 conn(0x7f37741598b0 legacy=0x7f37740af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377abb8700 1 -- 172.21.15.33:0/1549556824 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37740aff10 con 0x7f37740cfe70 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377abb8700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740cbc30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3764009f20 tx=0x7f3764009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37d559a9508e6411 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f37793b5700 1 -- 172.21.15.33:0/1549556824 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376400e070 con 0x7f37740cfe70 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f37793b5700 1 -- 172.21.15.33:0/1549556824 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376400ba40 con 0x7f37740cfe70 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f37793b5700 1 -- 172.21.15.33:0/1549556824 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37640092e0 con 0x7f37740cfe70 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377c61b700 1 -- 172.21.15.33:0/1549556824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 msgr2=0x7f37740cbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.776+0000 7f377c61b700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740cbc30 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f3764009f20 tx=0x7f3764009840 comp rx=0 tx=0).stop 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 -- 172.21.15.33:0/1549556824 shutdown_connections 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740cbc30 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 --2- 172.21.15.33:0/1549556824 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3774159c80 0x7f37740cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 -- 172.21.15.33:0/1549556824 >> 172.21.15.33:0/1549556824 conn(0x7f3774070e30 msgr2=0x7f37740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 -- 172.21.15.33:0/1549556824 shutdown_connections 2023-10-09T15:39:28.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.777+0000 7f377c61b700 1 -- 172.21.15.33:0/1549556824 wait complete. 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 Processor -- start 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 -- start start 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37741598b0 0x7f37740b10a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3774159c80 0x7f3774169db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377416db50 con 0x7f37740cfe70 2023-10-09T15:39:28.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f377416cf40 con 0x7f3774159c80 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.778+0000 7f377c61b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f377416d220 con 0x7f37741598b0 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36474/0 (socket says 172.21.15.33:36474) 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 -- 172.21.15.33:0/3081989523 learned_addr learned my addr 172.21.15.33:0/3081989523 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f3779bb6700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37741598b0 0x7f37740b10a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377abb8700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3774159c80 0x7f3774169db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 -- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37741598b0 msgr2=0x7f37740b10a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37741598b0 0x7f37740b10a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 -- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3774159c80 msgr2=0x7f3774169db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3774159c80 0x7f3774169db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 -- 172.21.15.33:0/3081989523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3764009ae0 con 0x7f37740cfe70 2023-10-09T15:39:28.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377a3b7700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c5d0 tx=0x7f376c007f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c011590 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f376c011710 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f377416d500 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f376c011ad0 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.779+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3774154b40 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.780+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f377404c3c0 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.781+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f376c01c460 con 0x7f37740cfe70 2023-10-09T15:39:28.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.781+0000 7f37727fc700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 0x7f37600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.781+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f376c084930 con 0x7f37740cfe70 2023-10-09T15:39:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.781+0000 7f3779bb6700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 0x7f37600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:28.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.782+0000 7f3779bb6700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 0x7f37600697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f377415c0a0 tx=0x7f3768008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:28.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:28.785+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f376c0515c0 con 0x7f37740cfe70 2023-10-09T15:39:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.023+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f37740ce380 con 0x7f37740cfe70 2023-10-09T15:39:29.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.023+0000 7f37727fc700 1 -- 172.21.15.33:0/3081989523 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) v1 ==== 53+0+73 (secure 0 0 0) 0x7f376c054be0 con 0x7f37740cfe70 2023-10-09T15:39:29.024 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:39:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 msgr2=0x7f37600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 0x7f37600697d0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f377415c0a0 tx=0x7f3768008040 comp rx=0 tx=0).stop 2023-10-09T15:39:29.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 msgr2=0x7f37740b0b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f376c00c5d0 tx=0x7f376c007f60 comp rx=0 tx=0).stop 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 shutdown_connections 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3760067320 0x7f37600697d0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f37740cfe70 0x7f37740b0b60 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3774159c80 0x7f3774169db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 --2- 172.21.15.33:0/3081989523 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f37741598b0 0x7f37740b10a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 >> 172.21.15.33:0/3081989523 conn(0x7f3774070e30 msgr2=0x7f37740cee60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 shutdown_connections 2023-10-09T15:39:29.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.025+0000 7f377c61b700 1 -- 172.21.15.33:0/3081989523 wait complete. 2023-10-09T15:39:29.038 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:39:29.038 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:39:29.038 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:39:29.038 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:39:29.038 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:29.039 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:39:29.039 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:39:29.039 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:39:29.039 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:29.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.039 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:39:29.054 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:39:29.054 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:39:29.054 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:39:29.054 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:39:29.055 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41918sec preferred_lft 41918sec 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:39:29.056 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:29.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.057 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:39:29.118 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:39:29.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.120 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:39:29.176 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:39:29.176 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:39:29.176 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:39:29.176 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:39:29.176 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:39:29.177 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:39:29.177 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:39:29.279 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.279 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:39:29.293 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:39:29.293 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:39:29.294 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:29.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.294 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:39:29.359 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:29.359 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:29.415 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:39:29.415 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:29.415 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:29.469 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:39:29.470 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:39:29.470 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:29.550 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:29.559 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:29.559 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:29.559 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:29.559 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:29.559 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:39:29.582 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:39:29.584 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:39:29.584 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:29.584 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:29.649 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:39:29.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.808+0000 7f72b9eea700 1 Processor -- start 2023-10-09T15:39:29.809 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.808+0000 7f72b9eea700 1 -- start start 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b9eea700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f72b415de50 0x7f72b40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b9eea700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72b40cef40 0x7f72b415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b9eea700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72b40cf3c0 con 0x7f72b4153c30 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b9eea700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b415afd0 con 0x7f72b40cef40 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b9eea700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72b415b2b0 con 0x7f72b415de50 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b96e9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f72b40cef40 0x7f72b415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b8ee8700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f72b4153c30 0x7f72b415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:48720/0 (socket says 172.21.15.33:48720) 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b8ee8700 1 -- 172.21.15.33:0/135842693 learned_addr learned my addr 172.21.15.33:0/135842693 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b3fff700 1 --2- 172.21.15.33:0/135842693 >> v2:172.21.15.59:3300/0 conn(0x7f72b415de50 0x7f72b40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.811 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b37fe700 1 -- 172.21.15.33:0/135842693 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355798887 0 0) 0x7f72b40cf3c0 con 0x7f72b4153c30 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b37fe700 1 -- 172.21.15.33:0/135842693 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f72a0003570 con 0x7f72b4153c30 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b96e9700 1 -- 172.21.15.33:0/135842693 >> v2:172.21.15.59:3300/0 conn(0x7f72b415de50 msgr2=0x7f72b40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b96e9700 1 --2- 172.21.15.33:0/135842693 >> v2:172.21.15.59:3300/0 conn(0x7f72b415de50 0x7f72b40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.809+0000 7f72b96e9700 1 -- 172.21.15.33:0/135842693 >> v1:172.21.15.33:6789/0 conn(0x7f72b4153c30 legacy=0x7f72b415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b96e9700 1 -- 172.21.15.33:0/135842693 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b415b590 con 0x7f72b40cef40 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b96e9700 1 --2- 172.21.15.33:0/135842693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b415c070 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f72b40713a0 tx=0x7f729c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=796b856d1e5d5ef2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b37fe700 1 -- 172.21.15.33:0/135842693 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c011630 con 0x7f72b40cef40 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b37fe700 1 -- 172.21.15.33:0/135842693 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f729c011790 con 0x7f72b40cef40 2023-10-09T15:39:29.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b37fe700 1 -- 172.21.15.33:0/135842693 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f729c011b30 con 0x7f72b40cef40 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 -- 172.21.15.33:0/135842693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 msgr2=0x7f72b415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 --2- 172.21.15.33:0/135842693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b415c070 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7f72b40713a0 tx=0x7f729c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 -- 172.21.15.33:0/135842693 shutdown_connections 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 --2- 172.21.15.33:0/135842693 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b415c070 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 --2- 172.21.15.33:0/135842693 >> v2:172.21.15.59:3300/0 conn(0x7f72b415de50 0x7f72b40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.810+0000 7f72b9eea700 1 -- 172.21.15.33:0/135842693 >> 172.21.15.33:0/135842693 conn(0x7f72b40703a0 msgr2=0x7f72b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.811+0000 7f72b9eea700 1 -- 172.21.15.33:0/135842693 shutdown_connections 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.811+0000 7f72b9eea700 1 -- 172.21.15.33:0/135842693 wait complete. 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.812+0000 7f72b9eea700 1 Processor -- start 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.812+0000 7f72b9eea700 1 -- start start 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.812+0000 7f72b9eea700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72b4153c30 0x7f72b40b5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b415de50 0x7f72b4169d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b41698e0 con 0x7f72b40cef40 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40cd630 con 0x7f72b415de50 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72b40b5b60 con 0x7f72b4153c30 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:36498/0 (socket says 172.21.15.33:36498) 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 -- 172.21.15.33:0/162427061 learned_addr learned my addr 172.21.15.33:0/162427061 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b3fff700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72b4153c30 0x7f72b40b5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b96e9700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b415de50 0x7f72b4169d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 -- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72b4153c30 msgr2=0x7f72b40b5480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72b4153c30 0x7f72b40b5480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 -- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b415de50 msgr2=0x7f72b4169d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b415de50 0x7f72b4169d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 -- 172.21.15.33:0/162427061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f729c009420 con 0x7f72b40cef40 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b8ee8700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00cc40 tx=0x7f72ac001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac00a980 con 0x7f72b40cef40 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72ac00ab00 con 0x7f72b40cef40 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b40b5e40 con 0x7f72b40cef40 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72ac0070f0 con 0x7f72b40cef40 2023-10-09T15:39:29.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.813+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72b4169490 con 0x7f72b40cef40 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.814+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72b404c3c0 con 0x7f72b40cef40 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.815+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f72ac007460 con 0x7f72b40cef40 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.815+0000 7f72b0ff9700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 0x7f72940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.815+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f72ac084fc0 con 0x7f72b40cef40 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.815+0000 7f72b3fff700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 0x7f72940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:29.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.815+0000 7f72b3fff700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 0x7f72940697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006fd0 tx=0x7f72a4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:29.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:29.819+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72ac051cd0 con 0x7f72b40cef40 2023-10-09T15:39:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.059+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72b40cd860 con 0x7f72b40cef40 2023-10-09T15:39:30.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.060+0000 7f72b0ff9700 1 -- 172.21.15.33:0/162427061 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v112) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72ac0552f0 con 0x7f72b40cef40 2023-10-09T15:39:30.061 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:39:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 msgr2=0x7f72940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 0x7f72940697d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f72a4006fd0 tx=0x7f72a4008040 comp rx=0 tx=0).stop 2023-10-09T15:39:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 msgr2=0x7f72b4158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7f72ac00cc40 tx=0x7f72ac001a60 comp rx=0 tx=0).stop 2023-10-09T15:39:30.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 shutdown_connections 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7294067320 0x7f72940697d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72b40cef40 0x7f72b4158c30 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f72b415de50 0x7f72b4169d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 --2- 172.21.15.33:0/162427061 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72b4153c30 0x7f72b40b5480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 >> 172.21.15.33:0/162427061 conn(0x7f72b40703a0 msgr2=0x7f72b40c6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 shutdown_connections 2023-10-09T15:39:30.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.062+0000 7f72b9eea700 1 -- 172.21.15.33:0/162427061 wait complete. 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:30.075 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:39:30.076 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:39:30.076 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:39:30.076 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:30.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.076 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:30.095 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41926sec preferred_lft 41926sec 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:30.096 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:39:30.097 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:39:30.098 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:39:30.098 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.098 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:39:30.163 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:39:30.165 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.165 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:39:30.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.225 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:39:30.226 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:39:30.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:39:30.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:39:30.226 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:39:30.226 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:39:30.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.336 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:39:30.351 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:39:30.351 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:39:30.351 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:30.351 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.351 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:39:30.416 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:30.417 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:30.472 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:39:30.472 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:39:30.472 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:30.526 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:39:30.526 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:39:30.527 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:30.609 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:30.609 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:30.609 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:30.617 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:30.617 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:30.618 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:30.618 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:30.618 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:30.639 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:39:30.639 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:39:30.639 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:39:30.639 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:39:30.639 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:39:30.640 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:39:30.640 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:39:30.640 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:39:30.641 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:39:30.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:30.642 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:30.707 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:39:30.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.835+0000 7fb2b8a97700 1 Processor -- start 2023-10-09T15:39:30.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.835+0000 7fb2b8a97700 1 -- start start 2023-10-09T15:39:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b8a97700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb2b40b24f0 0x7fb2b40b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b8a97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b41590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b8a97700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2b40b0c80 con 0x7fb2b40b28c0 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b8a97700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2b40d10d0 con 0x7fb2b40b24f0 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b8a97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b40b0f60 con 0x7fb2b40b1d40 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb2b40b24f0 0x7fb2b40b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b3fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb2b40b28c0 0x7fb2b415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38128/0 (socket says 172.21.15.33:38128) 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b3fff700 1 -- 172.21.15.33:0/2512059956 learned_addr learned my addr 172.21.15.33:0/2512059956 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b2ffd700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b41590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b37fe700 1 -- 172.21.15.33:0/2512059956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 msgr2=0x7fb2b41590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b37fe700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b41590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b37fe700 1 -- 172.21.15.33:0/2512059956 >> v1:172.21.15.33:6789/0 conn(0x7fb2b40b28c0 legacy=0x7fb2b415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b37fe700 1 -- 172.21.15.33:0/2512059956 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2b40b1240 con 0x7fb2b40b24f0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.836+0000 7fb2b27fc700 1 -- 172.21.15.33:0/2512059956 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3122022879 0 0) 0x7fb2b40b0c80 con 0x7fb2b40b28c0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b37fe700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b40b0580 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40098e0 tx=0x7fb2a40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52096f388aa56a94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b27fc700 1 -- 172.21.15.33:0/2512059956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a4009e80 con 0x7fb2b40b24f0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b27fc700 1 -- 172.21.15.33:0/2512059956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a400b860 con 0x7fb2b40b24f0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b27fc700 1 -- 172.21.15.33:0/2512059956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a400bbe0 con 0x7fb2b40b24f0 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 -- 172.21.15.33:0/2512059956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 msgr2=0x7fb2b40b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b40b0580 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40098e0 tx=0x7fb2a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 -- 172.21.15.33:0/2512059956 shutdown_connections 2023-10-09T15:39:30.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b40b0580 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/2512059956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b41590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 -- 172.21.15.33:0/2512059956 >> 172.21.15.33:0/2512059956 conn(0x7fb2b40703a0 msgr2=0x7fb2b40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:30.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 -- 172.21.15.33:0/2512059956 shutdown_connections 2023-10-09T15:39:30.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.837+0000 7fb2b8a97700 1 -- 172.21.15.33:0/2512059956 wait complete. 2023-10-09T15:39:30.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 Processor -- start 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 -- start start 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b4169a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 0x7fb2b414e850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41524c0 con 0x7fb2b40b24f0 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b41518e0 con 0x7fb2b40b28c0 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b8a97700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2b4152710 con 0x7fb2b40b1d40 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b2ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49306/0 (socket says 172.21.15.33:49306) 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.839+0000 7fb2b2ffd700 1 -- 172.21.15.33:0/1101904021 learned_addr learned my addr 172.21.15.33:0/1101904021 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b37fe700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b4169a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 0x7fb2b414e850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 -- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 msgr2=0x7fb2b4169a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b4169a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 -- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 msgr2=0x7fb2b414e850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 0x7fb2b414e850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 -- 172.21.15.33:0/1101904021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2a4009420 con 0x7fb2b40b24f0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b3fff700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 0x7fb2b414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b2ffd700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d860 tx=0x7fb2a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8009610 con 0x7fb2b40b24f0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2a8009770 con 0x7fb2b40b24f0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2b41529f0 con 0x7fb2b40b24f0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2a8009b30 con 0x7fb2b40b24f0 2023-10-09T15:39:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.840+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2b4169f50 con 0x7fb2b40b24f0 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.841+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2b404c3c0 con 0x7fb2b40b24f0 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.842+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb2a801e460 con 0x7fb2b40b24f0 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.842+0000 7fb29b7fe700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 0x7fb2a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.842+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb2a8085290 con 0x7fb2b40b24f0 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.842+0000 7fb2b37fe700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 0x7fb2a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:30.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.843+0000 7fb2b37fe700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 0x7fb2a00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40091e0 tx=0x7fb2a4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:30.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:30.846+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb2a8051f20 con 0x7fb2b40b24f0 2023-10-09T15:39:31.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.086+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fb2b40aff80 con 0x7fb2b40b24f0 2023-10-09T15:39:31.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.772+0000 7fb29b7fe700 1 -- 172.21.15.33:0/1101904021 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v113) v1 ==== 136+0+0 (secure 0 0 0) 0x7fb2a8055540 con 0x7fb2b40b24f0 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 msgr2=0x7fb2a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 0x7fb2a00697d0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7fb2a40091e0 tx=0x7fb2a4017000 comp rx=0 tx=0).stop 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 msgr2=0x7fb2b416c790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fb2a800d860 tx=0x7fb2a8008040 comp rx=0 tx=0).stop 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 shutdown_connections 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb2a0067320 0x7fb2a00697d0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb2b40b28c0 0x7fb2b414e850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb2b40b1d40 0x7fb2b4169a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 --2- 172.21.15.33:0/1101904021 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb2b40b24f0 0x7fb2b416c790 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 >> 172.21.15.33:0/1101904021 conn(0x7fb2b40703a0 msgr2=0x7fb2b414ff30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 shutdown_connections 2023-10-09T15:39:31.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.775+0000 7fb2b8a97700 1 -- 172.21.15.33:0/1101904021 wait complete. 2023-10-09T15:39:31.791 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:39:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.916+0000 7f12e5f8e700 1 Processor -- start 2023-10-09T15:39:31.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.916+0000 7f12e5f8e700 1 -- start start 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e5f8e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12e0153c30 0x7f12e015a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e5f8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e015c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e5f8e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12e015afd0 con 0x7f12e015de50 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e5f8e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12e015b2b0 con 0x7f12e0153c30 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e5f8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e015b590 con 0x7f12e00cf110 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12e0153c30 0x7f12e015a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f12e0153c30 0x7f12e015a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49318/0 (socket says 172.21.15.33:49318) 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 -- 172.21.15.33:0/2218275698 learned_addr learned my addr 172.21.15.33:0/2218275698 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:31.919 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 -- 172.21.15.33:0/2218275698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 msgr2=0x7f12e015c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 --2- 172.21.15.33:0/2218275698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e015c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 -- 172.21.15.33:0/2218275698 >> v1:172.21.15.59:6789/0 conn(0x7f12e015de50 legacy=0x7f12e00cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.917+0000 7f12e4f8c700 1 -- 172.21.15.33:0/2218275698 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12e015b870 con 0x7f12e0153c30 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e4f8c700 1 --2- 172.21.15.33:0/2218275698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e015a5e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f12d40099b0 tx=0x7f12d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d574e34b041c801f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12df7fe700 1 -- 172.21.15.33:0/2218275698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400b820 con 0x7f12e0153c30 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12df7fe700 1 -- 172.21.15.33:0/2218275698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12d400b980 con 0x7f12e0153c30 2023-10-09T15:39:31.920 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12df7fe700 1 -- 172.21.15.33:0/2218275698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12d400bd20 con 0x7f12e0153c30 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 -- 172.21.15.33:0/2218275698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 msgr2=0x7f12e015a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/2218275698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e015a5e0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f12d40099b0 tx=0x7f12d4009250 comp rx=0 tx=0).stop 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 -- 172.21.15.33:0/2218275698 shutdown_connections 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/2218275698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e015c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/2218275698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e015a5e0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 -- 172.21.15.33:0/2218275698 >> 172.21.15.33:0/2218275698 conn(0x7f12e00703a0 msgr2=0x7f12e00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.918+0000 7f12e5f8e700 1 -- 172.21.15.33:0/2218275698 shutdown_connections 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.919+0000 7f12e5f8e700 1 -- 172.21.15.33:0/2218275698 wait complete. 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 Processor -- start 2023-10-09T15:39:31.923 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 -- start start 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e0140f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 0x7f12e00b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c86d0 con 0x7f12e0153c30 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c7da0 con 0x7f12e015de50 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.920+0000 7f12e5f8e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12e00c8080 con 0x7f12e00cf110 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49324/0 (socket says 172.21.15.33:49324) 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 -- 172.21.15.33:0/4184691882 learned_addr learned my addr 172.21.15.33:0/4184691882 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12e4f8c700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e0140f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12e578d700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 0x7f12e00b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 -- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 msgr2=0x7f12e0140f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:31.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e0140f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 -- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 msgr2=0x7f12e00b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 0x7f12e00b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 -- 172.21.15.33:0/4184691882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d40094f0 con 0x7f12e0153c30 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12e578d700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 0x7f12e00b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dffff700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b5e0 tx=0x7f12cc0090f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00f510 con 0x7f12e0153c30 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12cc00f670 con 0x7f12e0153c30 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12e00c8360 con 0x7f12e0153c30 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12cc00fa30 con 0x7f12e0153c30 2023-10-09T15:39:31.925 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.921+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12e00b1400 con 0x7f12e0153c30 2023-10-09T15:39:31.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.922+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12e004c3c0 con 0x7f12e0153c30 2023-10-09T15:39:31.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.923+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f12cc01a400 con 0x7f12e0153c30 2023-10-09T15:39:31.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.923+0000 7f12dcff9700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 0x7f12c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:31.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.923+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f12cc084720 con 0x7f12e0153c30 2023-10-09T15:39:31.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.923+0000 7f12e4f8c700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 0x7f12c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:31.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.924+0000 7f12e4f8c700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 0x7f12c40697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f12d40099b0 tx=0x7f12d4016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:31.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:31.928+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f12cc051450 con 0x7f12e0153c30 2023-10-09T15:39:32.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.150+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f12e00c7f10 con 0x7f12c4067320 2023-10-09T15:39:32.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.151+0000 7f12dcff9700 1 -- 172.21.15.33:0/4184691882 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f12e00c7f10 con 0x7f12c4067320 2023-10-09T15:39:32.152 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:39:32.153 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:32.153 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:39:32.153 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:32.153 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 msgr2=0x7f12c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 0x7f12c40697d0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f12d40099b0 tx=0x7f12d4016000 comp rx=0 tx=0).stop 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 msgr2=0x7f12e00b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f12cc00b5e0 tx=0x7f12cc0090f0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 shutdown_connections 2023-10-09T15:39:32.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f12c4067320 0x7f12c40697d0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f12e015de50 0x7f12e00b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f12e00cf110 0x7f12e0140f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 --2- 172.21.15.33:0/4184691882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f12e0153c30 0x7f12e00b32d0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 >> 172.21.15.33:0/4184691882 conn(0x7f12e00703a0 msgr2=0x7f12e0150a30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 shutdown_connections 2023-10-09T15:39:32.156 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.154+0000 7f12e5f8e700 1 -- 172.21.15.33:0/4184691882 wait complete. 2023-10-09T15:39:32.167 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:39:32.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.288+0000 7f843a505700 1 Processor -- start 2023-10-09T15:39:32.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.288+0000 7f843a505700 1 -- start start 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f843a505700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f843406e0e0 0x7f84340cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f843a505700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84340ccfd0 con 0x7f843406dc70 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f843a505700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f843415a3d0 con 0x7f8434159530 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f843a505700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f843415a6b0 con 0x7f843406e0e0 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f8438aa2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f843406e0e0 0x7f84340cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f84337fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f843406dc70 0x7f8434159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38130/0 (socket says 172.21.15.33:38130) 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f84337fe700 1 -- 172.21.15.33:0/3851770880 learned_addr learned my addr 172.21.15.33:0/3851770880 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f8438aa2700 1 -- 172.21.15.33:0/3851770880 >> v1:172.21.15.59:6789/0 conn(0x7f8434159530 legacy=0x7f84340ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f8438aa2700 1 -- 172.21.15.33:0/3851770880 >> v1:172.21.15.33:6789/0 conn(0x7f843406dc70 legacy=0x7f8434159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.289+0000 7f8438aa2700 1 -- 172.21.15.33:0/3851770880 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f843415a990 con 0x7f843406e0e0 2023-10-09T15:39:32.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f8438aa2700 1 --2- 172.21.15.33:0/3851770880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406e0e0 0x7f84340cb6f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f842c009e60 tx=0x7f842c009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80416dcd8e1c3501 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f8432ffd700 1 -- 172.21.15.33:0/3851770880 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c00e070 con 0x7f843406e0e0 2023-10-09T15:39:32.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f8432ffd700 1 -- 172.21.15.33:0/3851770880 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f842c00bc30 con 0x7f843406e0e0 2023-10-09T15:39:32.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f8432ffd700 1 -- 172.21.15.33:0/3851770880 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f842c012430 con 0x7f843406e0e0 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 -- 172.21.15.33:0/3851770880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406e0e0 msgr2=0x7f84340cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 --2- 172.21.15.33:0/3851770880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406e0e0 0x7f84340cb6f0 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f842c009e60 tx=0x7f842c009780 comp rx=0 tx=0).stop 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 -- 172.21.15.33:0/3851770880 shutdown_connections 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 --2- 172.21.15.33:0/3851770880 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406e0e0 0x7f84340cb6f0 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 -- 172.21.15.33:0/3851770880 >> 172.21.15.33:0/3851770880 conn(0x7f84340703a0 msgr2=0x7f84340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 -- 172.21.15.33:0/3851770880 shutdown_connections 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.290+0000 7f843a505700 1 -- 172.21.15.33:0/3851770880 wait complete. 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.291+0000 7f843a505700 1 Processor -- start 2023-10-09T15:39:32.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 -- start start 2023-10-09T15:39:32.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f843406e0e0 0x7f84340c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8434159530 0x7f843415c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c9720 con 0x7f843406dc70 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c8b10 con 0x7f8434159530 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.292+0000 7f843a505700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84340c8df0 con 0x7f843406e0e0 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49340/0 (socket says 172.21.15.33:49340) 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 -- 172.21.15.33:0/3252598954 learned_addr learned my addr 172.21.15.33:0/3252598954 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8438aa2700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8434159530 0x7f843415c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f84337fe700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f843406e0e0 0x7f84340c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 -- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f843406e0e0 msgr2=0x7f84340c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f843406e0e0 0x7f84340c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 -- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8434159530 msgr2=0x7f843415c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8434159530 0x7f843415c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 -- 172.21.15.33:0/3252598954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f842c009a20 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f8433fff700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f842400c590 tx=0x7f842400c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424011590 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84240116f0 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84340c90d0 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8424011ab0 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.293+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84340c9c30 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.294+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f843404c3c0 con 0x7f843406dc70 2023-10-09T15:39:32.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.295+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f842401b3b0 con 0x7f843406dc70 2023-10-09T15:39:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.295+0000 7f841bfff700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 0x7f84200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.295+0000 7f84337fe700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 0x7f84200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.295+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f84240841d0 con 0x7f843406dc70 2023-10-09T15:39:32.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.296+0000 7f84337fe700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 0x7f84200697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f84340b2fc0 tx=0x7f8428009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.299+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8424050e60 con 0x7f843406dc70 2023-10-09T15:39:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.493+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f843415ac70 con 0x7f843406dc70 2023-10-09T15:39:32.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.493+0000 7f841bfff700 1 -- 172.21.15.33:0/3252598954 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) v1 ==== 122+0+0 (secure 0 0 0) 0x7f84240170c0 con 0x7f843406dc70 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 msgr2=0x7f84200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 0x7f84200697d0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f84340b2fc0 tx=0x7f8428009040 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 msgr2=0x7f843414e270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f842400c590 tx=0x7f842400c950 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 shutdown_connections 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8420067320 0x7f84200697d0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f843406dc70 0x7f843414e270 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8434159530 0x7f843415c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 --2- 172.21.15.33:0/3252598954 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f843406e0e0 0x7f84340c81a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.495+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 >> 172.21.15.33:0/3252598954 conn(0x7f84340703a0 msgr2=0x7f84340d0c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:32.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.496+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 shutdown_connections 2023-10-09T15:39:32.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.496+0000 7f843a505700 1 -- 172.21.15.33:0/3252598954 wait complete. 2023-10-09T15:39:32.509 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:39:32.509 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:39:32.509 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:39:32.547 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:39:32.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:32.547 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:39:32.602 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:39:32.602 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:39:32.602 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:39:32.644 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:39:32.644 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:32.644 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:39:32.703 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:39:32.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:32.703 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T15:39:32.718 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:39:32.719 INFO:teuthology.orchestra.run.smithi033.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T15:39:32.719 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:39:32.719 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:39:32.719 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T15:39:32.761 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:39:32.761 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T15:39:32.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create another-data-pool --pg_num_min 64 2023-10-09T15:39:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.884+0000 7f05724af700 1 Processor -- start 2023-10-09T15:39:32.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.884+0000 7f05724af700 1 -- start start 2023-10-09T15:39:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f05724af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 0x7f056c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.886 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f05724af700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f056c0cd770 0x7f056c1591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f05724af700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f056c0cf330 con 0x7f056c0b04f0 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f05724af700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f056c0cdbd0 con 0x7f056c0cd770 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f05724af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c0cead0 con 0x7f056c0cb880 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f056c0b04f0 0x7f056c0cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38142/0 (socket says 172.21.15.33:38142) 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056b7fe700 1 -- 172.21.15.33:0/2361118426 learned_addr learned my addr 172.21.15.33:0/2361118426 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056bfff700 1 --2- 172.21.15.33:0/2361118426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 0x7f056c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f0570a4c700 1 --2- 172.21.15.33:0/2361118426 >> v2:172.21.15.59:3300/0 conn(0x7f056c0cd770 0x7f056c1591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056affd700 1 -- 172.21.15.33:0/2361118426 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407753189 0 0) 0x7f056c0cf330 con 0x7f056c0b04f0 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056affd700 1 -- 172.21.15.33:0/2361118426 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0558003570 con 0x7f056c0b04f0 2023-10-09T15:39:32.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056bfff700 1 -- 172.21.15.33:0/2361118426 >> v2:172.21.15.59:3300/0 conn(0x7f056c0cd770 msgr2=0x7f056c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056bfff700 1 --2- 172.21.15.33:0/2361118426 >> v2:172.21.15.59:3300/0 conn(0x7f056c0cd770 0x7f056c1591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056bfff700 1 -- 172.21.15.33:0/2361118426 >> v1:172.21.15.33:6789/0 conn(0x7f056c0b04f0 legacy=0x7f056c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.885+0000 7f056bfff700 1 -- 172.21.15.33:0/2361118426 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f056c0cddd0 con 0x7f056c0cb880 2023-10-09T15:39:32.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f056bfff700 1 --2- 172.21.15.33:0/2361118426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 0x7f056c0cbc50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05540098e0 tx=0x7f05540091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d2dbdc11753a07d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f056affd700 1 -- 172.21.15.33:0/2361118426 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554011630 con 0x7f056c0cb880 2023-10-09T15:39:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f056affd700 1 -- 172.21.15.33:0/2361118426 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0554011790 con 0x7f056c0cb880 2023-10-09T15:39:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f056affd700 1 -- 172.21.15.33:0/2361118426 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0554011b30 con 0x7f056c0cb880 2023-10-09T15:39:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 -- 172.21.15.33:0/2361118426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 msgr2=0x7f056c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 --2- 172.21.15.33:0/2361118426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 0x7f056c0cbc50 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f05540098e0 tx=0x7f05540091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 -- 172.21.15.33:0/2361118426 shutdown_connections 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 --2- 172.21.15.33:0/2361118426 >> v2:172.21.15.59:3300/0 conn(0x7f056c0cd770 0x7f056c1591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 --2- 172.21.15.33:0/2361118426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cb880 0x7f056c0cbc50 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 -- 172.21.15.33:0/2361118426 >> 172.21.15.33:0/2361118426 conn(0x7f056c0703a0 msgr2=0x7f056c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 -- 172.21.15.33:0/2361118426 shutdown_connections 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.886+0000 7f05724af700 1 -- 172.21.15.33:0/2361118426 wait complete. 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.887+0000 7f05724af700 1 Processor -- start 2023-10-09T15:39:32.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 -- start start 2023-10-09T15:39:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056c0b04f0 0x7f056c16abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cd770 0x7f056c15b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c159d60 con 0x7f056c0cb880 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f056c159150 con 0x7f056c0b04f0 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f05724af700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f056c159430 con 0x7f056c0cd770 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.888+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49354/0 (socket says 172.21.15.33:49354) 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 -- 172.21.15.33:0/3616963515 learned_addr learned my addr 172.21.15.33:0/3616963515 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f0570a4c700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cd770 0x7f056c15b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056bfff700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056c0b04f0 0x7f056c16abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 -- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cd770 msgr2=0x7f056c15b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cd770 0x7f056c15b4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 -- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056c0b04f0 msgr2=0x7f056c16abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:32.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056c0b04f0 0x7f056c16abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 -- 172.21.15.33:0/3616963515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554009420 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f056b7fe700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c590 tx=0x7f055c007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c005b30 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f055c005cb0 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f055c007320 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f056c159710 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.889+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f056c16b110 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.890+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f056c04c3c0 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.891+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f055c01b3b0 con 0x7f056c0cb880 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.891+0000 7f0563fff700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 0x7f054c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:32.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.891+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f055c084230 con 0x7f056c0cb880 2023-10-09T15:39:32.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.891+0000 7f056bfff700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 0x7f054c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:32.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.891+0000 7f056bfff700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 0x7f054c0697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f05540091e0 tx=0x7f0554017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:32.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:32.895+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f055c050ec0 con 0x7f056c0cb880 2023-10-09T15:39:33.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.091+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64} v 0) v1 -- 0x7f056c159ea0 con 0x7f056c0cb880 2023-10-09T15:39:33.780 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.779+0000 7f0563fff700 1 -- 172.21.15.33:0/3616963515 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "another-data-pool", "pg_num_min": 64}]=0 pool 'another-data-pool' created v169) v1 ==== 142+0+0 (secure 0 0 0) 0x7f055c0544e0 con 0x7f056c0cb880 2023-10-09T15:39:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 msgr2=0x7f054c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 0x7f054c0697d0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f05540091e0 tx=0x7f0554017000 comp rx=0 tx=0).stop 2023-10-09T15:39:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 msgr2=0x7f056c1571e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f055c00c590 tx=0x7f055c007e00 comp rx=0 tx=0).stop 2023-10-09T15:39:33.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 shutdown_connections 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f054c067320 0x7f054c0697d0 secure :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f05540091e0 tx=0x7f0554017000 comp rx=0 tx=0).stop 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f056c0cd770 0x7f056c15b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f056c0b04f0 0x7f056c16abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 --2- 172.21.15.33:0/3616963515 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f056c0cb880 0x7f056c1571e0 unknown :-1 s=CLOSED pgs=1510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 >> 172.21.15.33:0/3616963515 conn(0x7f056c0703a0 msgr2=0x7f056c0b5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:33.786 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.784+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 shutdown_connections 2023-10-09T15:39:33.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.785+0000 7f05724af700 1 -- 172.21.15.33:0/3616963515 wait complete. 2023-10-09T15:39:33.790 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'another-data-pool' created 2023-10-09T15:39:33.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs another-data-pool 2023-10-09T15:39:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.929+0000 7f5cab454700 1 Processor -- start 2023-10-09T15:39:33.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.929+0000 7f5cab454700 1 -- start start 2023-10-09T15:39:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5cab454700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153a00 0x7f5ca4153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5cab454700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5ca415de50 0x7f5ca415a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5cab454700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca415af60 con 0x7f5ca40cea00 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5cab454700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca415d010 con 0x7f5ca415de50 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5cab454700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca415b240 con 0x7f5ca4153a00 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5caac53700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5ca40cea00 0x7f5ca40cee40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38146/0 (socket says 172.21.15.33:38146) 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5caac53700 1 -- 172.21.15.33:0/2313798215 learned_addr learned my addr 172.21.15.33:0/2313798215 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81193574 0 0) 0x7f5ca415af60 con 0x7f5ca40cea00 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5ca9c51700 1 --2- 172.21.15.33:0/2313798215 >> v2:172.21.15.59:3300/0 conn(0x7f5ca415de50 0x7f5ca415a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5c8c003570 con 0x7f5ca40cea00 2023-10-09T15:39:33.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.930+0000 7f5caa452700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153a00 0x7f5ca4153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3560629376 0 0) 0x7f5c8c003570 con 0x7f5ca40cea00 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153a00 msgr2=0x7f5ca4153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153a00 0x7f5ca4153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 >> v2:172.21.15.59:3300/0 conn(0x7f5ca415de50 msgr2=0x7f5ca415a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 --2- 172.21.15.33:0/2313798215 >> v2:172.21.15.59:3300/0 conn(0x7f5ca415de50 0x7f5ca415a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca415b520 con 0x7f5ca40cea00 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5c9c001470 con 0x7f5ca40cea00 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 >> v1:172.21.15.33:6789/0 conn(0x7f5ca40cea00 legacy=0x7f5ca40cee40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c8c003a60 0x7f5c8c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.936 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c004810 0x7f5c8c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c8c0051c0 0x7f5c8c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca415d010 con 0x7f5c8c0051c0 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca415b240 con 0x7f5c8c004810 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c8c00c050 con 0x7f5c8c003a60 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caa452700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153a00 0x7f5ca4153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c8c0051c0 0x7f5c8c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9c51700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c004810 0x7f5c8c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caa452700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c8c003a60 0x7f5c8c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 -- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c8c003a60 msgr2=0x7f5c8c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:33.937 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c8c003a60 0x7f5c8c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 -- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c004810 msgr2=0x7f5c8c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c004810 0x7f5c8c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 -- 172.21.15.33:0/2313798215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c8c003570 con 0x7f5c8c0051c0 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5caac53700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c8c0051c0 0x7f5c8c00ba60 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c3c0 tx=0x7f5c9c001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310dae94ae4b2a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00cc90 con 0x7f5c8c0051c0 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.931+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00cdf0 con 0x7f5c8c0051c0 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5ca9450700 1 -- 172.21.15.33:0/2313798215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c005b70 con 0x7f5c8c0051c0 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 -- 172.21.15.33:0/2313798215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c8c0051c0 msgr2=0x7f5c8c00ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 --2- 172.21.15.33:0/2313798215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c8c0051c0 0x7f5c8c00ba60 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c3c0 tx=0x7f5c9c001e90 comp rx=0 tx=0).stop 2023-10-09T15:39:33.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5caac53700 1 -- 172.21.15.33:0/2313798215 reap_dead start 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 -- 172.21.15.33:0/2313798215 shutdown_connections 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 -- 172.21.15.33:0/2313798215 >> 172.21.15.33:0/2313798215 conn(0x7f5ca40703a0 msgr2=0x7f5ca40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 -- 172.21.15.33:0/2313798215 shutdown_connections 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.932+0000 7f5cab454700 1 -- 172.21.15.33:0/2313798215 wait complete. 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.933+0000 7f5cab454700 1 Processor -- start 2023-10-09T15:39:33.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.933+0000 7f5cab454700 1 -- start start 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c0051c0 0x7f5ca40b12e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153180 0x7f5ca40b1820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40b4cb0 con 0x7f5ca40b3f30 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40b4f90 con 0x7f5c8c0051c0 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5cab454700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca40b5270 con 0x7f5ca4153180 2023-10-09T15:39:33.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49382/0 (socket says 172.21.15.33:49382) 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 -- 172.21.15.33:0/4014127745 learned_addr learned my addr 172.21.15.33:0/4014127745 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caa452700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c0051c0 0x7f5ca40b12e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5ca9c51700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153180 0x7f5ca40b1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 -- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153180 msgr2=0x7f5ca40b1820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153180 0x7f5ca40b1820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 -- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c0051c0 msgr2=0x7f5ca40b12e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c0051c0 0x7f5ca40b12e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 -- 172.21.15.33:0/4014127745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca40c7cb0 con 0x7f5ca40b3f30 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.934+0000 7f5caac53700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009020 tx=0x7f5c9c015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:33.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.935+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00cc90 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.935+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c001430 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.935+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca40c7f90 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.935+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c012400 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.935+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca40cb110 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.936+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca40c7b10 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.936+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5c9c019030 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.937+0000 7f5ca27fc700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 0x7f5c900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.937+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 6077+0+0 (secure 0 0 0) 0x7f5c9c0856f0 con 0x7f5ca40b3f30 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.937+0000 7f5caa452700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 0x7f5c900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:33.944 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.937+0000 7f5caa452700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 0x7f5c900697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5c94007140 tx=0x7f5c940099b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:33.945 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:33.941+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5ca40c7b10 con 0x7f5ca40b3f30 2023-10-09T15:39:34.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.184+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"} v 0) v1 -- 0x7f5ca40c7b10 con 0x7f5ca40b3f30 2023-10-09T15:39:34.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.795+0000 7f5ca27fc700 1 -- 172.21.15.33:0/4014127745 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "another-data-pool"}]=0 added data pool 30 to fsmap v114) v1 ==== 141+0+0 (secure 0 0 0) 0x7f5ca40c7b10 con 0x7f5ca40b3f30 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 msgr2=0x7f5c900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 0x7f5c900697d0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f5c94007140 tx=0x7f5c940099b0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 msgr2=0x7f5ca40b43a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c009020 tx=0x7f5c9c015000 comp rx=0 tx=0).stop 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 shutdown_connections 2023-10-09T15:39:34.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c90067320 0x7f5c900697d0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5ca40b3f30 0x7f5ca40b43a0 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c8c0051c0 0x7f5ca40b12e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 --2- 172.21.15.33:0/4014127745 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5ca4153180 0x7f5ca40b1820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 >> 172.21.15.33:0/4014127745 conn(0x7f5ca40703a0 msgr2=0x7f5ca40d0df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 shutdown_connections 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.799+0000 7f5cab454700 1 -- 172.21.15.33:0/4014127745 wait complete. 2023-10-09T15:39:34.801 INFO:teuthology.orchestra.run.smithi033.stderr:added data pool 30 to fsmap 2023-10-09T15:39:34.815 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.938+0000 7fa8be5de700 1 Processor -- start 2023-10-09T15:39:34.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.938+0000 7fa8be5de700 1 -- start start 2023-10-09T15:39:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8be5de700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8b81508c0 0x7fa8b8158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8be5de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b80af2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.941 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8be5de700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8b8158c80 con 0x7fa8b8150c90 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8be5de700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8b815afc0 con 0x7fa8b81508c0 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8be5de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b80af820 con 0x7fa8b815a7d0 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8b77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa8b8150c90 0x7fa8b815a0c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38150/0 (socket says 172.21.15.33:38150) 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.939+0000 7fa8b77fe700 1 -- 172.21.15.33:0/3473838339 learned_addr learned my addr 172.21.15.33:0/3473838339 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/3473838339 >> v2:172.21.15.59:3300/0 conn(0x7fa8b81508c0 0x7fa8b8158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8bcb7b700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b80af2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 908973904 0 0) 0x7fa8b8158c80 con 0x7fa8b8150c90 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa8a0003570 con 0x7fa8b8150c90 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 -- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 msgr2=0x7fa8b80af2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3256878546 0 0) 0x7fa8a0003570 con 0x7fa8b8150c90 2023-10-09T15:39:34.942 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b80af2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 -- 172.21.15.33:0/3473838339 >> v1:172.21.15.33:6789/0 conn(0x7fa8b8150c90 legacy=0x7fa8b815a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 -- 172.21.15.33:0/3473838339 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b8155710 con 0x7fa8b81508c0 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8bcb7b700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b80af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8158650 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009910 tx=0x7fa8a80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4c7795b2cc2cf221 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac001470 con 0x7fa8b81508c0 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8a8011420 con 0x7fa8b81508c0 2023-10-09T15:39:34.943 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.940+0000 7fa8b6ffd700 1 -- 172.21.15.33:0/3473838339 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8a80117c0 con 0x7fa8b81508c0 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 -- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 msgr2=0x7fa8b8158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8158650 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa8a8009910 tx=0x7fa8a80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 -- 172.21.15.33:0/3473838339 shutdown_connections 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b80af2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 --2- 172.21.15.33:0/3473838339 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8158650 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.946 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 -- 172.21.15.33:0/3473838339 >> 172.21.15.33:0/3473838339 conn(0x7fa8b80cded0 msgr2=0x7fa8b806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 -- 172.21.15.33:0/3473838339 shutdown_connections 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.941+0000 7fa8be5de700 1 -- 172.21.15.33:0/3473838339 wait complete. 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.942+0000 7fa8be5de700 1 Processor -- start 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.942+0000 7fa8be5de700 1 -- start start 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8068240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b8153e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8154370 con 0x7fa8b8150c90 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8167900 con 0x7fa8b81508c0 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8be5de700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8b8151210 con 0x7fa8b815a7d0 2023-10-09T15:39:34.947 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49398/0 (socket says 172.21.15.33:49398) 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 -- 172.21.15.33:0/652553509 learned_addr learned my addr 172.21.15.33:0/652553509 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8bcb7b700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b8153e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8068240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 -- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 msgr2=0x7fa8b8153e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b8153e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 -- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 msgr2=0x7fa8b8068240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8068240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b77fe700 1 -- 172.21.15.33:0/652553509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8b0009a20 con 0x7fa8b8150c90 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8bcb7b700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.943+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8068240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:34.948 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa8b77fe700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00eda0 tx=0x7fa8ac001c60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac00ee80 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8ac00cd40 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a8009420 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8ac0073a0 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.944+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8b8151850 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.945+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8b804c3c0 con 0x7fa8b8150c90 2023-10-09T15:39:34.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.945+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa8ac004830 con 0x7fa8b8150c90 2023-10-09T15:39:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.946+0000 7fa89ffff700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 0x7fa8a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.946+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fa8ac0877f0 con 0x7fa8b8150c90 2023-10-09T15:39:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.946+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 0x7fa8a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:34.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.946+0000 7fa8b7fff700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 0x7fa8a40697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a010 tx=0x7fa8a8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:34.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:34.950+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8ac054260 con 0x7fa8b8150c90 2023-10-09T15:39:35.188 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.187+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8b8158f60 con 0x7fa8b8150c90 2023-10-09T15:39:35.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.188+0000 7fa89ffff700 1 -- 172.21.15.33:0/652553509 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fa8ac057880 con 0x7fa8b8150c90 2023-10-09T15:39:35.189 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:35.189 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:34.778923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 msgr2=0x7fa8a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 0x7fa8a40697d0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fa8a800a010 tx=0x7fa8a8016000 comp rx=0 tx=0).stop 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 msgr2=0x7fa8b81538f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fa8ac00eda0 tx=0x7fa8ac001c60 comp rx=0 tx=0).stop 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 shutdown_connections 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa8a4067320 0x7fa8a40697d0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8b815a7d0 0x7fa8b8153e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.191 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8b81508c0 0x7fa8b8068240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 --2- 172.21.15.33:0/652553509 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa8b8150c90 0x7fa8b81538f0 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 >> 172.21.15.33:0/652553509 conn(0x7fa8b80cded0 msgr2=0x7fa8b80b01b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 shutdown_connections 2023-10-09T15:39:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.190+0000 7fa8be5de700 1 -- 172.21.15.33:0/652553509 wait complete. 2023-10-09T15:39:35.192 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 114 2023-10-09T15:39:35.203 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.321+0000 7f5f1d68c700 1 Processor -- start 2023-10-09T15:39:35.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.321+0000 7f5f1d68c700 1 -- start start 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f1d68c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5f180b0ba0 0x7f5f180c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f1d68c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1815a280 con 0x7f5f180b07d0 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f1d68c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f1806e180 con 0x7f5f180cf200 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f1d68c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f1806d850 con 0x7f5f180b0ba0 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f16ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5f180b07d0 0x7f5f180ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38160/0 (socket says 172.21.15.33:38160) 2023-10-09T15:39:35.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f16ffd700 1 -- 172.21.15.33:0/257237153 learned_addr learned my addr 172.21.15.33:0/257237153 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f177fe700 1 --2- 172.21.15.33:0/257237153 >> v2:172.21.15.59:3300/0 conn(0x7f5f180b0ba0 0x7f5f180c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4286841588 0 0) 0x7f5f1815a280 con 0x7f5f180b07d0 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5f00003570 con 0x7f5f180b07d0 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2308919391 0 0) 0x7f5f00003570 con 0x7f5f180b07d0 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f177fe700 1 -- 172.21.15.33:0/257237153 >> v1:172.21.15.59:6789/0 conn(0x7f5f180cf200 legacy=0x7f5f1806e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f177fe700 1 -- 172.21.15.33:0/257237153 >> v1:172.21.15.33:6789/0 conn(0x7f5f180b07d0 legacy=0x7f5f180ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.322+0000 7f5f177fe700 1 -- 172.21.15.33:0/257237153 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f1806db30 con 0x7f5f180b0ba0 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f177fe700 1 --2- 172.21.15.33:0/257237153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b0ba0 0x7f5f180c42c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009e60 tx=0x7f5f10009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a0b552533d8cf707 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000e070 con 0x7f5f180b0ba0 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f1000b850 con 0x7f5f180b0ba0 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f15ffb700 1 -- 172.21.15.33:0/257237153 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f080015f0 con 0x7f5f180b0ba0 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 -- 172.21.15.33:0/257237153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b0ba0 msgr2=0x7f5f180c42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/257237153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b0ba0 0x7f5f180c42c0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f5f10009e60 tx=0x7f5f10009780 comp rx=0 tx=0).stop 2023-10-09T15:39:35.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 -- 172.21.15.33:0/257237153 shutdown_connections 2023-10-09T15:39:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/257237153 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b0ba0 0x7f5f180c42c0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 -- 172.21.15.33:0/257237153 >> 172.21.15.33:0/257237153 conn(0x7f5f1806ce80 msgr2=0x7f5f180ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 -- 172.21.15.33:0/257237153 shutdown_connections 2023-10-09T15:39:35.326 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.323+0000 7f5f1d68c700 1 -- 172.21.15.33:0/257237153 wait complete. 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 Processor -- start 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 -- start start 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 0x7f5f180c7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f180cf200 0x7f5f18155410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c74f0 con 0x7f5f180b0ba0 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c7ec0 con 0x7f5f180b07d0 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f1d68c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f180c68e0 con 0x7f5f180cf200 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f167fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49412/0 (socket says 172.21.15.33:49412) 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.325+0000 7f5f167fc700 1 -- 172.21.15.33:0/2351648032 learned_addr learned my addr 172.21.15.33:0/2351648032 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:35.328 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f177fe700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f180cf200 0x7f5f18155410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f16ffd700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 0x7f5f180c7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 -- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f180cf200 msgr2=0x7f5f18155410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f180cf200 0x7f5f18155410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 -- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 msgr2=0x7f5f180c7980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 0x7f5f180c7980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 -- 172.21.15.33:0/2351648032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f10009a20 con 0x7f5f180b0ba0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f16ffd700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 0x7f5f180c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f167fc700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c810 tx=0x7f5f0c007f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c012630 con 0x7f5f180b0ba0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f0c012790 con 0x7f5f180b0ba0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f180c6bc0 con 0x7f5f180b0ba0 2023-10-09T15:39:35.329 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5f0c012b50 con 0x7f5f180b0ba0 2023-10-09T15:39:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.326+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f180c7180 con 0x7f5f180b0ba0 2023-10-09T15:39:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.327+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f180c7660 con 0x7f5f180b0ba0 2023-10-09T15:39:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.327+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5f0c01b400 con 0x7f5f180b0ba0 2023-10-09T15:39:35.330 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.328+0000 7f5efeffd700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 0x7f5f040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.328+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f5f0c084a00 con 0x7f5f180b0ba0 2023-10-09T15:39:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.328+0000 7f5f16ffd700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 0x7f5f040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.331 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.328+0000 7f5f16ffd700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 0x7f5f040697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000c00 tx=0x7f5f08009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.332+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5f0c051500 con 0x7f5f180b0ba0 2023-10-09T15:39:35.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.527+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5f1804c3c0 con 0x7f5f180b0ba0 2023-10-09T15:39:35.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.528+0000 7f5efeffd700 1 -- 172.21.15.33:0/2351648032 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v170) v1 ==== 74+0+16899 (secure 0 0 0) 0x7f5f0c054b20 con 0x7f5f180b0ba0 2023-10-09T15:39:35.529 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:35.529 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":170,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:34.186339+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"170","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 msgr2=0x7f5f040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 0x7f5f040697d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f5f08000c00 tx=0x7f5f08009040 comp rx=0 tx=0).stop 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 msgr2=0x7f5f1813ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f5f0c00c810 tx=0x7f5f0c007f00 comp rx=0 tx=0).stop 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 shutdown_connections 2023-10-09T15:39:35.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5f04067320 0x7f5f040697d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5f180cf200 0x7f5f18155410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5f180b07d0 0x7f5f180c7980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 --2- 172.21.15.33:0/2351648032 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5f180b0ba0 0x7f5f1813ef40 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 >> 172.21.15.33:0/2351648032 conn(0x7f5f1806ce80 msgr2=0x7f5f180cb4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 shutdown_connections 2023-10-09T15:39:35.532 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.530+0000 7f5f1d68c700 1 -- 172.21.15.33:0/2351648032 wait complete. 2023-10-09T15:39:35.543 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.660+0000 7fd4bcd83700 1 Processor -- start 2023-10-09T15:39:35.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 -- start start 2023-10-09T15:39:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4b80cb5a0 0x7fd4b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 0x7fd4b8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b815a400 0x7fd4b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.663 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b80d13f0 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4b815ae40 con 0x7fd4b80cd9e0 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.661+0000 7fd4bcd83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815ab60 con 0x7fd4b815a400 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4b80cb5a0 0x7fd4b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd4b80cb5a0 0x7fd4b80cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49418/0 (socket says 172.21.15.33:49418) 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 -- 172.21.15.33:0/2268688404 learned_addr learned my addr 172.21.15.33:0/2268688404 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b6d9d700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b815a400 0x7fd4b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b5d9b700 1 --2- 172.21.15.33:0/2268688404 >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 0x7fd4b8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 -- 172.21.15.33:0/2268688404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b815a400 msgr2=0x7fd4b8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b815a400 0x7fd4b8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 -- 172.21.15.33:0/2268688404 >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 msgr2=0x7fd4b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 --2- 172.21.15.33:0/2268688404 >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 0x7fd4b8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 -- 172.21.15.33:0/2268688404 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b80ccf00 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b5d9b700 1 --2- 172.21.15.33:0/2268688404 >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 0x7fd4b8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:35.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b659c700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80cb970 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009f20 tx=0x7fd4a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0fafba4175572ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b559a700 1 -- 172.21.15.33:0/2268688404 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a800e070 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b559a700 1 -- 172.21.15.33:0/2268688404 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4a800ba40 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.662+0000 7fd4b559a700 1 -- 172.21.15.33:0/2268688404 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4a80092e0 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 -- 172.21.15.33:0/2268688404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b80cb5a0 msgr2=0x7fd4b80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80cb970 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009f20 tx=0x7fd4a8009840 comp rx=0 tx=0).stop 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 -- 172.21.15.33:0/2268688404 shutdown_connections 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b815a400 0x7fd4b8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/2268688404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80cb970 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/2268688404 >> v2:172.21.15.59:3300/0 conn(0x7fd4b80cd9e0 0x7fd4b8159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 -- 172.21.15.33:0/2268688404 >> 172.21.15.33:0/2268688404 conn(0x7fd4b8070e30 msgr2=0x7fd4b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 -- 172.21.15.33:0/2268688404 shutdown_connections 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.663+0000 7fd4bcd83700 1 -- 172.21.15.33:0/2268688404 wait complete. 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.664+0000 7fd4bcd83700 1 Processor -- start 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.664+0000 7fd4bcd83700 1 -- start start 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80c9f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b80cd9e0 0x7fd4b81521a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b80b34b0 con 0x7fd4b815a400 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815bd80 con 0x7fd4b80cb5a0 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4bcd83700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b815c020 con 0x7fd4b80cd9e0 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49424/0 (socket says 172.21.15.33:49424) 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 -- 172.21.15.33:0/424642877 learned_addr learned my addr 172.21.15.33:0/424642877 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b659c700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80c9f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b5d9b700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b80cd9e0 0x7fd4b81521a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 -- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b80cd9e0 msgr2=0x7fd4b81521a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b80cd9e0 0x7fd4b81521a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 -- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b80cb5a0 msgr2=0x7fd4b80c9f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80c9f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 -- 172.21.15.33:0/424642877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4a8009ae0 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4b6d9d700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000d860 tx=0x7fd4b0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.665+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b00125f0 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.666+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b0012790 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.666+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4b815c300 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.666+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b0012b50 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.666+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4b815c8c0 con 0x7fd4b815a400 2023-10-09T15:39:35.670 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.667+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4b804c3c0 con 0x7fd4b815a400 2023-10-09T15:39:35.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.667+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4b0013480 con 0x7fd4b815a400 2023-10-09T15:39:35.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.667+0000 7fd4ae7fc700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 0x7fd4980697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:35.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.668+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(170..170 src has 1..170) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fd4b00850d0 con 0x7fd4b815a400 2023-10-09T15:39:35.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.668+0000 7fd4b659c700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 0x7fd4980697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:35.671 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.668+0000 7fd4b659c700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 0x7fd4980697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009880 tx=0x7fd4a8018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:35.672 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.672+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b0051bd0 con 0x7fd4b815a400 2023-10-09T15:39:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.912+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4b80cd1e0 con 0x7fd4b815a400 2023-10-09T15:39:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.912+0000 7fd4ae7fc700 1 -- 172.21.15.33:0/424642877 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 114 v114) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fd4b00551f0 con 0x7fd4b815a400 2023-10-09T15:39:35.913 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:35.913 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":114,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":114,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:34.778923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 msgr2=0x7fd4980697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 0x7fd4980697d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7fd4a8009880 tx=0x7fd4a8018000 comp rx=0 tx=0).stop 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 msgr2=0x7fd4b81526e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7fd4b000d860 tx=0x7fd4b0008040 comp rx=0 tx=0).stop 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 shutdown_connections 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd498067320 0x7fd4980697d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b815a400 0x7fd4b81526e0 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b80cb5a0 0x7fd4b80c9f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 --2- 172.21.15.33:0/424642877 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b80cd9e0 0x7fd4b81521a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.914+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 >> 172.21.15.33:0/424642877 conn(0x7fd4b8070e30 msgr2=0x7fd4b80d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.915+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 shutdown_connections 2023-10-09T15:39:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:35.915+0000 7fd4bcd83700 1 -- 172.21.15.33:0/424642877 wait complete. 2023-10-09T15:39:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 114 2023-10-09T15:39:35.927 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:36.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.046+0000 7f1cfceca700 1 Processor -- start 2023-10-09T15:39:36.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.046+0000 7f1cfceca700 1 -- start start 2023-10-09T15:39:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cfceca700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1cf80cb970 0x7f1cf8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cfceca700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf815ae40 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cfceca700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1cf815ab60 con 0x7f1cf815a400 2023-10-09T15:39:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cfceca700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cf80ce0f0 con 0x7f1cf80cb970 2023-10-09T15:39:36.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1cf80cb5a0 0x7f1cf80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38168/0 (socket says 172.21.15.33:38168) 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf659c700 1 -- 172.21.15.33:0/1571102766 learned_addr learned my addr 172.21.15.33:0/1571102766 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1855631708 0 0) 0x7f1cf815ae40 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1ce4003570 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/1571102766 >> v2:172.21.15.59:3300/0 conn(0x7f1cf80cb970 0x7f1cf8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1429889144 0 0) 0x7f1ce4003570 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 >> v2:172.21.15.59:3300/0 conn(0x7f1cf80cb970 msgr2=0x7f1cf8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 --2- 172.21.15.33:0/1571102766 >> v2:172.21.15.59:3300/0 conn(0x7f1cf80cb970 0x7f1cf8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 >> v1:172.21.15.59:6789/0 conn(0x7f1cf815a400 legacy=0x7f1cf8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80ccf00 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1cf0001470 con 0x7f1cf80cb5a0 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 >> v1:172.21.15.33:6789/0 conn(0x7f1cf80cb5a0 legacy=0x7f1cf80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ce40051c0 0x7f1ce400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80ce0f0 con 0x7f1ce4003a60 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400c0d0 con 0x7f1ce40051c0 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ce400c290 con 0x7f1ce4004810 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.047+0000 7f1cf659c700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf6d9d700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ce40051c0 0x7f1ce400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 -- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ce4004810 msgr2=0x7f1ce4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 -- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ce40051c0 msgr2=0x7f1ce400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ce40051c0 0x7f1ce400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 -- 172.21.15.33:0/1571102766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ce4003570 con 0x7f1ce4003a60 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf6d9d700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1ce40051c0 0x7f1ce400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1ce4004810 0x7f1ce4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf6d9d700 1 -- 172.21.15.33:0/1571102766 reap_dead start 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf659c700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c3c0 tx=0x7f1cf0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1a0e4228d424c74 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf000cc90 con 0x7f1ce4003a60 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf000cdf0 con 0x7f1ce4003a60 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.048+0000 7f1cf559a700 1 -- 172.21.15.33:0/1571102766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0005b50 con 0x7f1ce4003a60 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 -- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 msgr2=0x7f1ce4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f1cf000c3c0 tx=0x7f1cf0001e50 comp rx=0 tx=0).stop 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 -- 172.21.15.33:0/1571102766 shutdown_connections 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 --2- 172.21.15.33:0/1571102766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1ce4003e70 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 -- 172.21.15.33:0/1571102766 >> 172.21.15.33:0/1571102766 conn(0x7f1cf8070e30 msgr2=0x7f1cf80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:36.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 -- 172.21.15.33:0/1571102766 shutdown_connections 2023-10-09T15:39:36.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.049+0000 7f1cfceca700 1 -- 172.21.15.33:0/1571102766 wait complete. 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.050+0000 7f1cfceca700 1 Processor -- start 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.050+0000 7f1cfceca700 1 -- start start 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.050+0000 7f1cfceca700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cf80b3e80 0x7f1cf8168ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cf81693e0 0x7f1cf80c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b4f90 con 0x7f1ce4003a60 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b4380 con 0x7f1cf80b3e80 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cf80b4660 con 0x7f1cf81693e0 2023-10-09T15:39:36.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49448/0 (socket says 172.21.15.33:49448) 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 -- 172.21.15.33:0/844560983 learned_addr learned my addr 172.21.15.33:0/844560983 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cf80b3e80 0x7f1cf8168ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 -- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cf81693e0 msgr2=0x7f1cf80c67c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cf81693e0 0x7f1cf80c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 -- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cf80b3e80 msgr2=0x7f1cf8168ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cf80b3e80 0x7f1cf8168ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 -- 172.21.15.33:0/844560983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cf80b4940 con 0x7f1ce4003a60 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cf659c700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c0a0 tx=0x7f1cf0015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf00070d0 con 0x7f1ce4003a60 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cf0007290 con 0x7f1ce4003a60 2023-10-09T15:39:36.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cf80b4c20 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cf0007650 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.051+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cf813eca0 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.052+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cf813ee30 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.053+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1cf0028670 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.054+0000 7f1cee7fc700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 0x7f1cd80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.054+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 0x7f1cd80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.054+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6109+0+0 (secure 0 0 0) 0x7f1cf00872b0 con 0x7f1ce4003a60 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.054+0000 7f1cf5d9b700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 0x7f1cd80697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80d15b0 tx=0x7f1ce0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.058+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1cf0053e30 con 0x7f1ce4003a60 2023-10-09T15:39:36.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.254+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1cf804c3c0 con 0x7f1ce4003a60 2023-10-09T15:39:36.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.254+0000 7f1cee7fc700 1 -- 172.21.15.33:0/844560983 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v171) v1 ==== 74+0+16886 (secure 0 0 0) 0x7f1cf0017070 con 0x7f1ce4003a60 2023-10-09T15:39:36.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:36.256 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":171,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:35.780523+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"167","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"171","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 msgr2=0x7f1cd80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 0x7f1cd80697d0 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f1cf80d15b0 tx=0x7f1ce0008040 comp rx=0 tx=0).stop 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 msgr2=0x7f1cf8155b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7f1ce400c0a0 tx=0x7f1cf0015000 comp rx=0 tx=0).stop 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 shutdown_connections 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1cd8067320 0x7f1cd80697d0 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1ce4003a60 0x7f1cf8155b50 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1cf81693e0 0x7f1cf80c67c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 --2- 172.21.15.33:0/844560983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1cf80b3e80 0x7f1cf8168ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.256+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 >> 172.21.15.33:0/844560983 conn(0x7f1cf8070e30 msgr2=0x7f1cf80b2320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.257+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 shutdown_connections 2023-10-09T15:39:36.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.257+0000 7f1cfceca700 1 -- 172.21.15.33:0/844560983 wait complete. 2023-10-09T15:39:36.270 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000790701 --yes-i-really-mean-it 2023-10-09T15:39:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.395+0000 7fd686e0e700 1 Processor -- start 2023-10-09T15:39:36.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.395+0000 7fd686e0e700 1 -- start start 2023-10-09T15:39:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd686e0e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd68006e2a0 0x7fd6800a8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.398 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd686e0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800ae4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd686e0e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6800cced0 con 0x7fd680088400 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd686e0e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6800cd140 con 0x7fd68006e2a0 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd686e0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800cd420 con 0x7fd6800cee40 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd68006e2a0 0x7fd6800a8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd67ffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd680088400 0x7fd6800a8e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38176/0 (socket says 172.21.15.33:38176) 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd67ffff700 1 -- 172.21.15.33:0/2614721099 learned_addr learned my addr 172.21.15.33:0/2614721099 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd6853ab700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800ae4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd67f7fe700 1 -- 172.21.15.33:0/2614721099 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3164398353 0 0) 0x7fd6800cced0 con 0x7fd680088400 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd67f7fe700 1 -- 172.21.15.33:0/2614721099 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd668003570 con 0x7fd680088400 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 -- 172.21.15.33:0/2614721099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 msgr2=0x7fd6800ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:36.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800ae4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 -- 172.21.15.33:0/2614721099 >> v1:172.21.15.33:6789/0 conn(0x7fd680088400 legacy=0x7fd6800a8e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 -- 172.21.15.33:0/2614721099 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6800cd700 con 0x7fd68006e2a0 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.396+0000 7fd684baa700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd68006e2a0 0x7fd6800a8910 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098d0 tx=0x7fd670009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a09c3dfc60e490c7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd67f7fe700 1 -- 172.21.15.33:0/2614721099 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670005c10 con 0x7fd68006e2a0 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd67f7fe700 1 -- 172.21.15.33:0/2614721099 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd670005d70 con 0x7fd68006e2a0 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd67f7fe700 1 -- 172.21.15.33:0/2614721099 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd670006280 con 0x7fd68006e2a0 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 -- 172.21.15.33:0/2614721099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd68006e2a0 msgr2=0x7fd6800a8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd68006e2a0 0x7fd6800a8910 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fd6700098d0 tx=0x7fd670009120 comp rx=0 tx=0).stop 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 -- 172.21.15.33:0/2614721099 shutdown_connections 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800ae4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2614721099 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd68006e2a0 0x7fd6800a8910 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 -- 172.21.15.33:0/2614721099 >> 172.21.15.33:0/2614721099 conn(0x7fd680088000 msgr2=0x7fd6800ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:36.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 -- 172.21.15.33:0/2614721099 shutdown_connections 2023-10-09T15:39:36.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.397+0000 7fd686e0e700 1 -- 172.21.15.33:0/2614721099 wait complete. 2023-10-09T15:39:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.398+0000 7fd686e0e700 1 Processor -- start 2023-10-09T15:39:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.398+0000 7fd686e0e700 1 -- start start 2023-10-09T15:39:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68006e2a0 0x7fd68016d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.403 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800cb6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800b3430 con 0x7fd680088400 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68015ad50 con 0x7fd68006e2a0 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd686e0e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6800b3b40 con 0x7fd6800cee40 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd67ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49476/0 (socket says 172.21.15.33:49476) 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd67ffff700 1 -- 172.21.15.33:0/2562442789 learned_addr learned my addr 172.21.15.33:0/2562442789 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd6853ab700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800cb6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.399+0000 7fd684baa700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68006e2a0 0x7fd68016d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 -- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 msgr2=0x7fd6800cb6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800cb6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 -- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68006e2a0 msgr2=0x7fd68016d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68006e2a0 0x7fd68016d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 -- 172.21.15.33:0/2562442789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6700093c0 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd6853ab700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67ffff700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c7c0 tx=0x7fd674007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674005b30 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd674005c90 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68015a420 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd674007340 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.400+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68015a9e0 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.401+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68004c3c0 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.401+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd67401b400 con 0x7fd680088400 2023-10-09T15:39:36.405 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.402+0000 7fd67cff9700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 0x7fd66c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.402+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(171..171 src has 1..171) v4 ==== 6109+0+0 (secure 0 0 0) 0x7fd6740848a0 con 0x7fd680088400 2023-10-09T15:39:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.402+0000 7fd684baa700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 0x7fd66c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:36.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.402+0000 7fd684baa700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 0x7fd66c0697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd670009160 tx=0x7fd670016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:36.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.406+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd6740514a0 con 0x7fd680088400 2023-10-09T15:39:36.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:36.630+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000790701", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fd680067b20 con 0x7fd66c067320 2023-10-09T15:39:36.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:39:36.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:39:38.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.304+0000 7fd67cff9700 1 -- 172.21.15.33:0/2562442789 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+127 (secure 0 0 0) 0x7fd680067b20 con 0x7fd66c067320 2023-10-09T15:39:38.306 INFO:teuthology.orchestra.run.smithi033.stdout:FS volume 'cephfs' renamed to 'volume_0000000000790701'. But failed to rename data pools as more than one data pool was found. 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 msgr2=0x7fd66c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 0x7fd66c0697d0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fd670009160 tx=0x7fd670016000 comp rx=0 tx=0).stop 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 msgr2=0x7fd680154860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fd67400c7c0 tx=0x7fd674007e00 comp rx=0 tx=0).stop 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 shutdown_connections 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd66c067320 0x7fd66c0697d0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd6800cee40 0x7fd6800cb6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd68006e2a0 0x7fd68016d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.306+0000 7fd686e0e700 1 --2- 172.21.15.33:0/2562442789 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd680088400 0x7fd680154860 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.307+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 >> 172.21.15.33:0/2562442789 conn(0x7fd680088000 msgr2=0x7fd6800b0800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:38.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.307+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 shutdown_connections 2023-10-09T15:39:38.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.307+0000 7fd686e0e700 1 -- 172.21.15.33:0/2562442789 wait complete. 2023-10-09T15:39:38.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:39:38.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.450+0000 7fb9cbf46700 1 Processor -- start 2023-10-09T15:39:38.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.450+0000 7fb9cbf46700 1 -- start start 2023-10-09T15:39:38.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9cbf46700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9c40b07d0 0x7fb9c40ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9cbf46700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb9c40cf200 0x7fb9c40cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9cbf46700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9c415a280 con 0x7fb9c40b0ba0 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9cbf46700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c406e180 con 0x7fb9c40b07d0 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9cbf46700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9c40cd540 con 0x7fb9c40cf200 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb9c40b07d0 0x7fb9c40ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9ca4e3700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb9c40b0ba0 0x7fb9c406e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38184/0 (socket says 172.21.15.33:38184) 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9ca4e3700 1 -- 172.21.15.33:0/3889134682 learned_addr learned my addr 172.21.15.33:0/3889134682 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c94e1700 1 --2- 172.21.15.33:0/3889134682 >> v2:172.21.15.59:3300/0 conn(0x7fb9c40cf200 0x7fb9c40cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/3889134682 >> v2:172.21.15.59:3300/0 conn(0x7fb9c40cf200 msgr2=0x7fb9c40cd000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 --2- 172.21.15.33:0/3889134682 >> v2:172.21.15.59:3300/0 conn(0x7fb9c40cf200 0x7fb9c40cd000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/3889134682 >> v1:172.21.15.33:6789/0 conn(0x7fb9c40b0ba0 legacy=0x7fb9c406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c8ce0700 1 -- 172.21.15.33:0/3889134682 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 732087042 0 0) 0x7fb9c415a280 con 0x7fb9c40b0ba0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/3889134682 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c406d850 con 0x7fb9c40b07d0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.451+0000 7fb9c9ce2700 1 --2- 172.21.15.33:0/3889134682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c40ccac0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40cab40 tx=0x7fb9c0009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9b095ce49b768fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9c8ce0700 1 -- 172.21.15.33:0/3889134682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005c10 con 0x7fb9c40b07d0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9c8ce0700 1 -- 172.21.15.33:0/3889134682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c0005d70 con 0x7fb9c40b07d0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9c8ce0700 1 -- 172.21.15.33:0/3889134682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0006260 con 0x7fb9c40b07d0 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 -- 172.21.15.33:0/3889134682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 msgr2=0x7fb9c40ccac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/3889134682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c40ccac0 secure :-1 s=READY pgs=1527 cs=0 l=1 rev1=1 crypto rx=0x7fb9c40cab40 tx=0x7fb9c0009120 comp rx=0 tx=0).stop 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 -- 172.21.15.33:0/3889134682 shutdown_connections 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/3889134682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c40ccac0 unknown :-1 s=CLOSED pgs=1527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/3889134682 >> v2:172.21.15.59:3300/0 conn(0x7fb9c40cf200 0x7fb9c40cd000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 -- 172.21.15.33:0/3889134682 >> 172.21.15.33:0/3889134682 conn(0x7fb9c406ce80 msgr2=0x7fb9c40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 -- 172.21.15.33:0/3889134682 shutdown_connections 2023-10-09T15:39:38.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.452+0000 7fb9cbf46700 1 -- 172.21.15.33:0/3889134682 wait complete. 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.453+0000 7fb9cbf46700 1 Processor -- start 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.453+0000 7fb9cbf46700 1 -- start start 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9c40b0ba0 0x7fb9c415bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 0x7fb9c415a280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c416a240 con 0x7fb9c40b07d0 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c415ae60 con 0x7fb9c40cf200 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9cbf46700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c416d520 con 0x7fb9c40b0ba0 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49500/0 (socket says 172.21.15.33:49500) 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/2021377936 learned_addr learned my addr 172.21.15.33:0/2021377936 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9c40b0ba0 msgr2=0x7fb9c415bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9c40b0ba0 0x7fb9c415bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 msgr2=0x7fb9c415a280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.454+0000 7fb9ca4e3700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 0x7fb9c415a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9c9ce2700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 0x7fb9c415a280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9c9ce2700 1 -- 172.21.15.33:0/2021377936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00093c0 con 0x7fb9c40b07d0 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9ca4e3700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 0x7fb9c415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9c9ce2700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb9c406af10 tx=0x7fb9c0016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000bd80 con 0x7fb9c40b07d0 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c001b480 con 0x7fb9c40b07d0 2023-10-09T15:39:38.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9c416d800 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000bee0 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.455+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9c415b140 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.456+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9c416dd00 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.457+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb9c001bad0 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.457+0000 7fb9b9ffb700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 0x7fb9a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.457+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb9c00873d0 con 0x7fb9c40b07d0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.457+0000 7fb9c94e1700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 0x7fb9a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.458+0000 7fb9c94e1700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 0x7fb9a80697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009a40 tx=0x7fb9b4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.462+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb9c0053e80 con 0x7fb9c40b07d0 2023-10-09T15:39:38.681 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.680+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fb9c404c3c0 con 0x7fb9a8067320 2023-10-09T15:39:38.682 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.681+0000 7fb9b9ffb700 1 -- 172.21.15.33:0/2021377936 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7fb9c404c3c0 con 0x7fb9a8067320 2023-10-09T15:39:38.682 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:39:38.683 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:38.683 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000790701" 2023-10-09T15:39:38.683 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:38.683 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 msgr2=0x7fb9a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 0x7fb9a80697d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fb9b4009a40 tx=0x7fb9b4008040 comp rx=0 tx=0).stop 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 msgr2=0x7fb9c416e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fb9c406af10 tx=0x7fb9c0016000 comp rx=0 tx=0).stop 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 shutdown_connections 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb9a8067320 0x7fb9a80697d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb9c40b07d0 0x7fb9c416e000 unknown :-1 s=CLOSED pgs=1528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb9c40cf200 0x7fb9c415a280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.685 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 --2- 172.21.15.33:0/2021377936 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb9c40b0ba0 0x7fb9c415bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.683+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 >> 172.21.15.33:0/2021377936 conn(0x7fb9c406ce80 msgr2=0x7fb9c4158e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:38.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.684+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 shutdown_connections 2023-10-09T15:39:38.686 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.684+0000 7fb9cbf46700 1 -- 172.21.15.33:0/2021377936 wait complete. 2023-10-09T15:39:38.697 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:38.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 Processor -- start 2023-10-09T15:39:38.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 -- start start 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fc80c83e0 0x7f3fc80c8840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc80c7f50 con 0x7f3fc81599a0 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fc806b740 con 0x7f3fc81595d0 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.815+0000 7f3fce079700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fc806bd00 con 0x7f3fc80c83e0 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc7fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fc80c83e0 0x7f3fc80c8840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3fc81599a0 0x7f3fc806acf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38188/0 (socket says 172.21.15.33:38188) 2023-10-09T15:39:38.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc6ffd700 1 -- 172.21.15.33:0/2071281548 learned_addr learned my addr 172.21.15.33:0/2071281548 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc7fff700 1 -- 172.21.15.33:0/2071281548 >> v1:172.21.15.59:6789/0 conn(0x7f3fc81595d0 legacy=0x7f3fc80675a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc7fff700 1 -- 172.21.15.33:0/2071281548 >> v1:172.21.15.33:6789/0 conn(0x7f3fc81599a0 legacy=0x7f3fc806acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc7fff700 1 -- 172.21.15.33:0/2071281548 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc806ba20 con 0x7f3fc80c83e0 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc67fc700 1 -- 172.21.15.33:0/2071281548 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2069669411 0 0) 0x7f3fc80c7f50 con 0x7f3fc81599a0 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/2071281548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80c83e0 0x7f3fc80c8840 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009e60 tx=0x7f3fc0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a316ba76c5ff3e3b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc67fc700 1 -- 172.21.15.33:0/2071281548 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc000e070 con 0x7f3fc80c83e0 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc67fc700 1 -- 172.21.15.33:0/2071281548 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fc000bbf0 con 0x7f3fc80c83e0 2023-10-09T15:39:38.818 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.816+0000 7f3fc67fc700 1 -- 172.21.15.33:0/2071281548 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fc0012430 con 0x7f3fc80c83e0 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 -- 172.21.15.33:0/2071281548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80c83e0 msgr2=0x7f3fc80c8840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 --2- 172.21.15.33:0/2071281548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80c83e0 0x7f3fc80c8840 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f3fc0009e60 tx=0x7f3fc0009780 comp rx=0 tx=0).stop 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 -- 172.21.15.33:0/2071281548 shutdown_connections 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 --2- 172.21.15.33:0/2071281548 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc80c83e0 0x7f3fc80c8840 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 -- 172.21.15.33:0/2071281548 >> 172.21.15.33:0/2071281548 conn(0x7f3fc80cd400 msgr2=0x7f3fc80cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:38.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 -- 172.21.15.33:0/2071281548 shutdown_connections 2023-10-09T15:39:38.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.817+0000 7f3fce079700 1 -- 172.21.15.33:0/2071281548 wait complete. 2023-10-09T15:39:38.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.818+0000 7f3fce079700 1 Processor -- start 2023-10-09T15:39:38.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.818+0000 7f3fce079700 1 -- start start 2023-10-09T15:39:38.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80c83e0 0x7f3fc8157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 0x7f3fc80b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8157870 con 0x7f3fc81595d0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8156c60 con 0x7f3fc80c83e0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fc8156f40 con 0x7f3fc81599a0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49518/0 (socket says 172.21.15.33:49518) 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 -- 172.21.15.33:0/260937811 learned_addr learned my addr 172.21.15.33:0/260937811 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc77fe700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80c83e0 0x7f3fc8157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 0x7f3fc80b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 -- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 msgr2=0x7f3fc80b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 0x7f3fc80b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 -- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80c83e0 msgr2=0x7f3fc8157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80c83e0 0x7f3fc8157d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 -- 172.21.15.33:0/260937811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fc0009a20 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc7fff700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 0x7f3fc80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fc6ffd700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c7e0 tx=0x7f3fbc007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc005b30 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fbc005c90 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.819+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fc8157220 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.820+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fbc007300 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.820+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fc815b0b0 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.821+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fc81579e0 con 0x7f3fc81595d0 2023-10-09T15:39:38.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.821+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fbc01b400 con 0x7f3fc81595d0 2023-10-09T15:39:38.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.821+0000 7f3faf7fe700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 0x7f3fb40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:38.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.821+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f3fbc084820 con 0x7f3fc81595d0 2023-10-09T15:39:38.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.821+0000 7f3fc77fe700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 0x7f3fb40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:38.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.822+0000 7f3fc77fe700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 0x7f3fb40697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8003870 tx=0x7f3fb8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:38.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:38.825+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3fbc051450 con 0x7f3fc81595d0 2023-10-09T15:39:39.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.063+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3fc804c3c0 con 0x7f3fc81595d0 2023-10-09T15:39:39.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.063+0000 7f3faf7fe700 1 -- 172.21.15.33:0/260937811 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f3fbc054a70 con 0x7f3fc81595d0 2023-10-09T15:39:39.064 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:39.064 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:37.287243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000790701","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:39.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 msgr2=0x7f3fb40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 0x7f3fb40697d0 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f3fb8003870 tx=0x7f3fb8009040 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 msgr2=0x7f3fc815c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc00c7e0 tx=0x7f3fbc007df0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 shutdown_connections 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fb4067320 0x7f3fb40697d0 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fc81599a0 0x7f3fc80b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fc80c83e0 0x7f3fc8157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 --2- 172.21.15.33:0/260937811 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fc81595d0 0x7f3fc815c5d0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 >> 172.21.15.33:0/260937811 conn(0x7f3fc80cd400 msgr2=0x7f3fc806c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 shutdown_connections 2023-10-09T15:39:39.067 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.065+0000 7f3fce079700 1 -- 172.21.15.33:0/260937811 wait complete. 2023-10-09T15:39:39.068 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 115 2023-10-09T15:39:39.079 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.197+0000 7f6acf293700 1 Processor -- start 2023-10-09T15:39:39.198 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.197+0000 7f6acf293700 1 -- start start 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acf293700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6ac80cb970 0x7f6ac8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acf293700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac815ae40 con 0x7f6ac815a400 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acf293700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ac815ab60 con 0x7f6ac80cb5a0 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acf293700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ac80ce0f0 con 0x7f6ac80cb970 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acd830700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6ac815a400 0x7f6ac8156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38198/0 (socket says 172.21.15.33:38198) 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.198+0000 7f6acd830700 1 -- 172.21.15.33:0/1372536971 learned_addr learned my addr 172.21.15.33:0/1372536971 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acc82e700 1 --2- 172.21.15.33:0/1372536971 >> v2:172.21.15.59:3300/0 conn(0x7f6ac80cb970 0x7f6ac8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2912959085 0 0) 0x7f6ac815ae40 con 0x7f6ac815a400 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab0003570 con 0x7f6ac815a400 2023-10-09T15:39:39.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4038960976 0 0) 0x7f6ab0003570 con 0x7f6ac815a400 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 >> v2:172.21.15.59:3300/0 conn(0x7f6ac80cb970 msgr2=0x7f6ac8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 --2- 172.21.15.33:0/1372536971 >> v2:172.21.15.59:3300/0 conn(0x7f6ac80cb970 0x7f6ac8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 >> v1:172.21.15.59:6789/0 conn(0x7f6ac80cb5a0 legacy=0x7f6ac80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac80ccf00 con 0x7f6ac815a400 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f6ac00017f0 con 0x7f6ac815a400 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 >> v1:172.21.15.33:6789/0 conn(0x7f6ac815a400 legacy=0x7f6ac8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ab0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab0004810 0x7f6ab0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab00051c0 0x7f6ab000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80ce0f0 con 0x7f6ab0003a60 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab000c0d0 con 0x7f6ab00051c0 2023-10-09T15:39:39.203 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab000c290 con 0x7f6ab0004810 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ab0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd830700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab00051c0 0x7f6ab000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acc82e700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab0004810 0x7f6ab0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 -- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab0004810 msgr2=0x7f6ab0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ab0004810 0x7f6ab0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 -- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab00051c0 msgr2=0x7f6ab000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ab00051c0 0x7f6ab000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd830700 1 -- 172.21.15.33:0/1372536971 reap_dead start 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.199+0000 7f6acd02f700 1 -- 172.21.15.33:0/1372536971 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab0003570 con 0x7f6ab0003a60 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acd02f700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ab0003e70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80018b0 tx=0x7f6ab8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95b2396778e6f383 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8012420 con 0x7f6ab0003a60 2023-10-09T15:39:39.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab80125a0 con 0x7f6ab0003a60 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6ac7fff700 1 -- 172.21.15.33:0/1372536971 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab8012960 con 0x7f6ab0003a60 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 -- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 msgr2=0x7f6ab0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ab0003e70 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80018b0 tx=0x7f6ab8007d30 comp rx=0 tx=0).stop 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 -- 172.21.15.33:0/1372536971 shutdown_connections 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 --2- 172.21.15.33:0/1372536971 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ab0003e70 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 -- 172.21.15.33:0/1372536971 >> 172.21.15.33:0/1372536971 conn(0x7f6ac8070e30 msgr2=0x7f6ac80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 -- 172.21.15.33:0/1372536971 shutdown_connections 2023-10-09T15:39:39.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.200+0000 7f6acf293700 1 -- 172.21.15.33:0/1372536971 wait complete. 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 Processor -- start 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 -- start start 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ac80c80f0 0x7f6ac80c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ac8151df0 0x7f6ac8152270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac80c8aa0 con 0x7f6ab0003a60 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8155c00 con 0x7f6ac8151df0 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.202+0000 7f6acf293700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ac8155ee0 con 0x7f6ac80c80f0 2023-10-09T15:39:39.208 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49530/0 (socket says 172.21.15.33:49530) 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 -- 172.21.15.33:0/2338895730 learned_addr learned my addr 172.21.15.33:0/2338895730 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acc82e700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ac80c80f0 0x7f6ac80c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd830700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ac8151df0 0x7f6ac8152270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 -- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ac80c80f0 msgr2=0x7f6ac80c8560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ac80c80f0 0x7f6ac80c8560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 -- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ac8151df0 msgr2=0x7f6ac8152270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ac8151df0 0x7f6ac8152270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 -- 172.21.15.33:0/2338895730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ac81561c0 con 0x7f6ab0003a60 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acd02f700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c0a0 tx=0x7f6ab8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab801f6f0 con 0x7f6ab0003a60 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ab801f850 con 0x7f6ab0003a60 2023-10-09T15:39:39.209 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ac815c3e0 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ab801fbd0 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.203+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ac81527b0 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.204+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ac81563e0 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.205+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6ab800c420 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.205+0000 7f6ac57fa700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 0x7f6ab40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.205+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f6ab80864e0 con 0x7f6ab0003a60 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.205+0000 7f6acc82e700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 0x7f6ab40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.206+0000 7f6acc82e700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 0x7f6ab40697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006f00 tx=0x7f6abc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.210 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.210+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6ab8053050 con 0x7f6ab0003a60 2023-10-09T15:39:39.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.405+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ac80c8aa0 con 0x7f6ab0003a60 2023-10-09T15:39:39.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.406+0000 7f6ac57fa700 1 -- 172.21.15.33:0/2338895730 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f6ab8056670 con 0x7f6ab0003a60 2023-10-09T15:39:39.407 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:39.407 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":173,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:38.290926+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000790701.meta","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000790701"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:39.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 msgr2=0x7f6ab40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 0x7f6ab40697d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f6abc006f00 tx=0x7f6abc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 msgr2=0x7f6ac81553a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f6ab000c0a0 tx=0x7f6ab8015000 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 shutdown_connections 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6ab4067320 0x7f6ab40697d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6ab0003a60 0x7f6ac81553a0 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6ac8151df0 0x7f6ac8152270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 --2- 172.21.15.33:0/2338895730 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6ac80c80f0 0x7f6ac80c8560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 >> 172.21.15.33:0/2338895730 conn(0x7f6ac8070e30 msgr2=0x7f6ac80ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 shutdown_connections 2023-10-09T15:39:39.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.408+0000 7f6acf293700 1 -- 172.21.15.33:0/2338895730 wait complete. 2023-10-09T15:39:39.422 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:39:39.422 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:39.465 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:39.516 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:39:39.516 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.634+0000 7f45f659c700 1 Processor -- start 2023-10-09T15:39:39.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.634+0000 7f45f659c700 1 -- start start 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45f00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f659c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f45f00cd9e0 0x7f45f0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f659c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f015ae40 con 0x7f45f00cde50 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f659c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45f00d13f0 con 0x7f45f00cd9e0 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f659c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f015ab60 con 0x7f45f00cb5a0 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f4b39700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f45f00cde50 0x7f45f0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38204/0 (socket says 172.21.15.33:38204) 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.635+0000 7f45f4b39700 1 -- 172.21.15.33:0/2924427071 learned_addr learned my addr 172.21.15.33:0/2924427071 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45f00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3551269897 0 0) 0x7f45f015ae40 con 0x7f45f00cde50 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f45dc003570 con 0x7f45f00cde50 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45ef7fe700 1 --2- 172.21.15.33:0/2924427071 >> v2:172.21.15.59:3300/0 conn(0x7f45f00cd9e0 0x7f45f0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1796098998 0 0) 0x7f45dc003570 con 0x7f45f00cde50 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 msgr2=0x7f45f00cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45f00cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 >> v2:172.21.15.59:3300/0 conn(0x7f45f00cd9e0 msgr2=0x7f45f0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 --2- 172.21.15.33:0/2924427071 >> v2:172.21.15.59:3300/0 conn(0x7f45f00cd9e0 0x7f45f0159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00ccf00 con 0x7f45f00cde50 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f45e80017f0 con 0x7f45f00cde50 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 >> v1:172.21.15.33:6789/0 conn(0x7f45f00cde50 legacy=0x7f45f0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45dc003a60 0x7f45dc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45dc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45dc004d50 0x7f45dc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f015ab60 con 0x7f45dc003a60 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc00ba60 con 0x7f45dc004d50 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45dc00bba0 con 0x7f45f00cb5a0 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45dc003a60 0x7f45dc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45ef7fe700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45dc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45f4b39700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45dc004d50 0x7f45dc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 -- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 msgr2=0x7f45dc004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45f00cb5a0 0x7f45dc004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 -- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45dc004d50 msgr2=0x7f45dc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45dc004d50 0x7f45dc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.636+0000 7f45effff700 1 -- 172.21.15.33:0/2924427071 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45dc003570 con 0x7f45dc003a60 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45effff700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45dc003a60 0x7f45dc003e70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009c00 tx=0x7f45d80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8741a761b52190 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800e6b0 con 0x7f45dc003a60 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45d800e810 con 0x7f45dc003a60 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45eeffd700 1 -- 172.21.15.33:0/2924427071 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45d800ebd0 con 0x7f45dc003a60 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 -- 172.21.15.33:0/2924427071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45dc003a60 msgr2=0x7f45dc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 --2- 172.21.15.33:0/2924427071 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45dc003a60 0x7f45dc003e70 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f45d8009c00 tx=0x7f45d80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f4b39700 1 -- 172.21.15.33:0/2924427071 reap_dead start 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 -- 172.21.15.33:0/2924427071 shutdown_connections 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 -- 172.21.15.33:0/2924427071 >> 172.21.15.33:0/2924427071 conn(0x7f45f0070e30 msgr2=0x7f45f00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 -- 172.21.15.33:0/2924427071 shutdown_connections 2023-10-09T15:39:39.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.637+0000 7f45f659c700 1 -- 172.21.15.33:0/2924427071 wait complete. 2023-10-09T15:39:39.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.638+0000 7f45f659c700 1 Processor -- start 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 -- start start 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45dc003a60 0x7f45f01694f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0159bb0 0x7f45f0155da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00b5050 con 0x7f45f0169a30 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f0158ab0 con 0x7f45f0159bb0 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45f659c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f00b4760 con 0x7f45dc003a60 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49546/0 (socket says 172.21.15.33:49546) 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.639+0000 7f45ef7fe700 1 -- 172.21.15.33:0/1948140840 learned_addr learned my addr 172.21.15.33:0/1948140840 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45effff700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45dc003a60 0x7f45f01694f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45f4b39700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0159bb0 0x7f45f0155da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 -- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45dc003a60 msgr2=0x7f45f01694f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45dc003a60 0x7f45f01694f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 -- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0159bb0 msgr2=0x7f45f0155da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0159bb0 0x7f45f0155da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 -- 172.21.15.33:0/1948140840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f00b4a00 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45ef7fe700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011d40 tx=0x7f45e00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e000fa10 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e000fb70 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45f00b4ce0 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45e0014440 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.640+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f0156520 con 0x7f45f0169a30 2023-10-09T15:39:39.646 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.641+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f01567a0 con 0x7f45f0169a30 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.642+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f45e0014870 con 0x7f45f0169a30 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.642+0000 7f45e7fff700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 0x7f45d00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.642+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f45e0018030 con 0x7f45f0169a30 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.642+0000 7f45effff700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 0x7f45d00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.643+0000 7f45effff700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 0x7f45d00697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f45d80091e0 tx=0x7f45d801a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:39.647 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.646+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f45e0052250 con 0x7f45f0169a30 2023-10-09T15:39:39.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.888+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f45f004c3c0 con 0x7f45f0169a30 2023-10-09T15:39:39.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.889+0000 7f45e7fff700 1 -- 172.21.15.33:0/1948140840 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f45e0055870 con 0x7f45f0169a30 2023-10-09T15:39:39.890 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:39.890 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:37.287243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000790701","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:39.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 msgr2=0x7f45d00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 0x7f45d00697d0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f45d80091e0 tx=0x7f45d801a000 comp rx=0 tx=0).stop 2023-10-09T15:39:39.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 msgr2=0x7f45f0159670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:39.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f45e0011d40 tx=0x7f45e00091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 shutdown_connections 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f45d0067320 0x7f45d00697d0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f45f0159bb0 0x7f45f0155da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f45dc003a60 0x7f45f01694f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 --2- 172.21.15.33:0/1948140840 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f45f0169a30 0x7f45f0159670 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 >> 172.21.15.33:0/1948140840 conn(0x7f45f0070e30 msgr2=0x7f45f00ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 shutdown_connections 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:39.891+0000 7f45f659c700 1 -- 172.21.15.33:0/1948140840 wait complete. 2023-10-09T15:39:39.893 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 115 2023-10-09T15:39:39.904 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.022+0000 7f8e01db1700 1 Processor -- start 2023-10-09T15:39:40.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.022+0000 7f8e01db1700 1 -- start start 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8e01db1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8dfc159c80 0x7f8dfc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8e01db1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8dfc0cfe70 0x7f8dfc0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8e01db1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dfc0ce9d0 con 0x7f8dfc1598b0 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8e01db1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0af960 con 0x7f8dfc159c80 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8e01db1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dfc0afc30 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8dfaffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8dfc159c80 0x7f8dfc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8dfb7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8dfc1598b0 0x7f8dfc0af250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:38208/0 (socket says 172.21.15.33:38208) 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8dfb7fe700 1 -- 172.21.15.33:0/21325522 learned_addr learned my addr 172.21.15.33:0/21325522 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.023+0000 7f8dfbfff700 1 --2- 172.21.15.33:0/21325522 >> v2:172.21.15.59:3300/0 conn(0x7f8dfc0cfe70 0x7f8dfc0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfaffd700 1 -- 172.21.15.33:0/21325522 >> v2:172.21.15.59:3300/0 conn(0x7f8dfc0cfe70 msgr2=0x7f8dfc0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfaffd700 1 --2- 172.21.15.33:0/21325522 >> v2:172.21.15.59:3300/0 conn(0x7f8dfc0cfe70 0x7f8dfc0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfaffd700 1 -- 172.21.15.33:0/21325522 >> v1:172.21.15.33:6789/0 conn(0x7f8dfc1598b0 legacy=0x7f8dfc0af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfaffd700 1 -- 172.21.15.33:0/21325522 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0aff10 con 0x7f8dfc159c80 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfa7fc700 1 -- 172.21.15.33:0/21325522 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 816836062 0 0) 0x7f8dfc0ce9d0 con 0x7f8dfc1598b0 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfaffd700 1 --2- 172.21.15.33:0/21325522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc159c80 0x7f8dfc0cb6f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0898c0 tx=0x7f8df00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e42014345bbb1c4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfa7fc700 1 -- 172.21.15.33:0/21325522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000b6b0 con 0x7f8dfc159c80 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfa7fc700 1 -- 172.21.15.33:0/21325522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8df000b810 con 0x7f8dfc159c80 2023-10-09T15:39:40.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8dfa7fc700 1 -- 172.21.15.33:0/21325522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8df000bbb0 con 0x7f8dfc159c80 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 -- 172.21.15.33:0/21325522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc159c80 msgr2=0x7f8dfc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 --2- 172.21.15.33:0/21325522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc159c80 0x7f8dfc0cb6f0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0898c0 tx=0x7f8df00091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 -- 172.21.15.33:0/21325522 shutdown_connections 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 --2- 172.21.15.33:0/21325522 >> v2:172.21.15.59:3300/0 conn(0x7f8dfc0cfe70 0x7f8dfc0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 --2- 172.21.15.33:0/21325522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc159c80 0x7f8dfc0cb6f0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 -- 172.21.15.33:0/21325522 >> 172.21.15.33:0/21325522 conn(0x7f8dfc070e30 msgr2=0x7f8dfc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 -- 172.21.15.33:0/21325522 shutdown_connections 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.024+0000 7f8e01db1700 1 -- 172.21.15.33:0/21325522 wait complete. 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 Processor -- start 2023-10-09T15:39:40.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 -- start start 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8dfc1598b0 0x7f8dfc152960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8dfc159c80 0x7f8dfc14fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc154e30 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc1549a0 con 0x7f8dfc1598b0 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.026+0000 7f8e01db1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dfc153d90 con 0x7f8dfc159c80 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49562/0 (socket says 172.21.15.33:49562) 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 -- 172.21.15.33:0/2956608165 learned_addr learned my addr 172.21.15.33:0/2956608165 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfbfff700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8dfc159c80 0x7f8dfc14fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfaffd700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8dfc1598b0 0x7f8dfc152960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 -- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8dfc159c80 msgr2=0x7f8dfc14fe80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8dfc159c80 0x7f8dfc14fe80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 -- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8dfc1598b0 msgr2=0x7f8dfc152960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8dfc1598b0 0x7f8dfc152960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 -- 172.21.15.33:0/2956608165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8df0009420 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8dfb7fe700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c7e0 tx=0x7f8dec007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec005b30 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dec005c90 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dfc154070 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dec007300 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.027+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dfc154630 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.028+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dfc04c3c0 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.029+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8dec01b3b0 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.029+0000 7f8de37fe700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.029+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f8dec084370 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.029+0000 7f8dfaffd700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.030+0000 7f8dfaffd700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 0x7f8de80697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8df00093f0 tx=0x7f8df0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.033+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8dec050e20 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.226+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8dfc0ce380 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.227+0000 7f8de37fe700 1 -- 172.21.15.33:0/2956608165 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f8dec001d60 con 0x7f8dfc0cfe70 2023-10-09T15:39:40.228 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:40.228 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":173,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:38.290926+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000790701.meta","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000790701"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:40.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 msgr2=0x7f8de80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 0x7f8de80697d0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f8df00093f0 tx=0x7f8df0017000 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 msgr2=0x7f8dfc14e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f8dec00c7e0 tx=0x7f8dec007df0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 shutdown_connections 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8de8067320 0x7f8de80697d0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8dfc0cfe70 0x7f8dfc14e700 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8dfc159c80 0x7f8dfc14fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 --2- 172.21.15.33:0/2956608165 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8dfc1598b0 0x7f8dfc152960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 >> 172.21.15.33:0/2956608165 conn(0x7f8dfc070e30 msgr2=0x7f8dfc0b2300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 shutdown_connections 2023-10-09T15:39:40.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.229+0000 7f8e01db1700 1 -- 172.21.15.33:0/2956608165 wait complete. 2023-10-09T15:39:40.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 28, 'pool_name': 'cephfs.volume_0000000000790701.meta', 'create_time': '2023-10-09T15:39:20.523505+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000790701'}}}, {'pool': 29, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:39:21.089947+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000790701'}}}, {'pool': 30, 'pool_name': 'another-data-pool', 'create_time': '2023-10-09T15:39:33.122617+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '172', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000790701'}}}] 2023-10-09T15:39:40.243 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:39:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.365+0000 7f0d7f7a3700 1 Processor -- start 2023-10-09T15:39:40.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.365+0000 7f0d7f7a3700 1 -- start start 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7f7a3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0d78159530 0x7f0d780ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7f7a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d780cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7f7a3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d780ccfd0 con 0x7f0d7806dc70 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7f7a3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d780cf0e0 con 0x7f0d78159530 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7f7a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d7815a3d0 con 0x7f0d7806e0e0 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7d53f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0d78159530 0x7f0d780ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7d53f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0d78159530 0x7f0d780ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49574/0 (socket says 172.21.15.33:49574) 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.366+0000 7f0d7d53f700 1 -- 172.21.15.33:0/1717779878 learned_addr learned my addr 172.21.15.33:0/1717779878 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7dd40700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d780cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7d53f700 1 -- 172.21.15.33:0/1717779878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 msgr2=0x7f0d780cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:40.369 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d780cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7d53f700 1 -- 172.21.15.33:0/1717779878 >> v1:172.21.15.59:6789/0 conn(0x7f0d7806dc70 legacy=0x7f0d78159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7d53f700 1 -- 172.21.15.33:0/1717779878 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7815a6b0 con 0x7f0d78159530 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d780ceba0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009f20 tx=0x7f0d68009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d73880f820579cf0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d77fff700 1 -- 172.21.15.33:0/1717779878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d6800e070 con 0x7f0d78159530 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d77fff700 1 -- 172.21.15.33:0/1717779878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d6800ba40 con 0x7f0d78159530 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d77fff700 1 -- 172.21.15.33:0/1717779878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d680092e0 con 0x7f0d78159530 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/1717779878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 msgr2=0x7f0d780ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d780ceba0 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009f20 tx=0x7f0d68009840 comp rx=0 tx=0).stop 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/1717779878 shutdown_connections 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d780cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/1717779878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d780ceba0 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.367+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/1717779878 >> 172.21.15.33:0/1717779878 conn(0x7f0d780703a0 msgr2=0x7f0d780707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.368+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/1717779878 shutdown_connections 2023-10-09T15:39:40.371 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.368+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/1717779878 wait complete. 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 Processor -- start 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 -- start start 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 0x7f0d780c79e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d7815e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b4470 con 0x7f0d78159530 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b4750 con 0x7f0d7806dc70 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.369+0000 7f0d7f7a3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d780b4a30 con 0x7f0d7806e0e0 2023-10-09T15:39:40.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:49586/0 (socket says 172.21.15.33:49586) 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 -- 172.21.15.33:0/4100660632 learned_addr learned my addr 172.21.15.33:0/4100660632 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7cd3e700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d7815e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 0x7f0d780c79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 -- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 msgr2=0x7f0d7815e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d7815e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 -- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 msgr2=0x7f0d780c79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 0x7f0d780c79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 -- 172.21.15.33:0/4100660632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d68009ae0 con 0x7f0d78159530 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 0x7f0d780c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7dd40700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c850 tx=0x7f0d70008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011660 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d700117e0 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d780b4d10 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d70011ba0 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.370+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d780b4100 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.371+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d7804c3c0 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.372+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0d700193f0 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.372+0000 7f0d757fa700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 0x7f0d640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.372+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f0d70085250 con 0x7f0d78159530 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.372+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 0x7f0d640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.373+0000 7f0d7d53f700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 0x7f0d640697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009880 tx=0x7f0d68017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.377 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.376+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0d70055680 con 0x7f0d78159530 2023-10-09T15:39:40.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.569+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0d7815a990 con 0x7f0d78159530 2023-10-09T15:39:40.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.570+0000 7f0d757fa700 1 -- 172.21.15.33:0/4100660632 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0d70055210 con 0x7f0d78159530 2023-10-09T15:39:40.571 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:39:40.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 msgr2=0x7f0d640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 0x7f0d640697d0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f0d68009880 tx=0x7f0d68017000 comp rx=0 tx=0).stop 2023-10-09T15:39:40.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 msgr2=0x7f0d7813f820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f0d7000c850 tx=0x7f0d70008040 comp rx=0 tx=0).stop 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 shutdown_connections 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0d64067320 0x7f0d640697d0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0d78159530 0x7f0d7813f820 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0d7806dc70 0x7f0d780c79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 --2- 172.21.15.33:0/4100660632 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0d7806e0e0 0x7f0d7815e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 >> 172.21.15.33:0/4100660632 conn(0x7f0d780703a0 msgr2=0x7f0d7815b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 shutdown_connections 2023-10-09T15:39:40.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.572+0000 7f0d7f7a3700 1 -- 172.21.15.33:0/4100660632 wait complete. 2023-10-09T15:39:40.585 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000790701.meta pg_num 2023-10-09T15:39:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.706+0000 7fdcd20f5700 1 Processor -- start 2023-10-09T15:39:40.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.706+0000 7fdcd20f5700 1 -- start start 2023-10-09T15:39:40.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdcd20f5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdccc06dc70 0x7fdccc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdcd20f5700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdcd20f5700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdccc0ccfd0 con 0x7fdccc159530 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdcd20f5700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc15a3d0 con 0x7fdccc06e0e0 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdcd20f5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdccc15a6b0 con 0x7fdccc06dc70 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57940/0 (socket says 172.21.15.33:57940) 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 -- 172.21.15.33:0/3254225200 learned_addr learned my addr 172.21.15.33:0/3254225200 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccaffd700 1 --2- 172.21.15.33:0/3254225200 >> v2:172.21.15.59:3300/0 conn(0x7fdccc06dc70 0x7fdccc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 -- 172.21.15.33:0/3254225200 >> v2:172.21.15.59:3300/0 conn(0x7fdccc06dc70 msgr2=0x7fdccc159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 --2- 172.21.15.33:0/3254225200 >> v2:172.21.15.59:3300/0 conn(0x7fdccc06dc70 0x7fdccc159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 -- 172.21.15.33:0/3254225200 >> v1:172.21.15.59:6789/0 conn(0x7fdccc159530 legacy=0x7fdccc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 -- 172.21.15.33:0/3254225200 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdccc15a990 con 0x7fdccc06e0e0 2023-10-09T15:39:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.707+0000 7fdccbfff700 1 --2- 172.21.15.33:0/3254225200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0b66e0 tx=0x7fdcc4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7085b48ef242b29 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcca7fc700 1 -- 172.21.15.33:0/3254225200 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc400e070 con 0x7fdccc06e0e0 2023-10-09T15:39:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcca7fc700 1 -- 172.21.15.33:0/3254225200 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc400ba20 con 0x7fdccc06e0e0 2023-10-09T15:39:40.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcca7fc700 1 -- 172.21.15.33:0/3254225200 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40092e0 con 0x7fdccc06e0e0 2023-10-09T15:39:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 -- 172.21.15.33:0/3254225200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc06e0e0 msgr2=0x7fdccc0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/3254225200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fdccc0b66e0 tx=0x7fdcc4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 -- 172.21.15.33:0/3254225200 shutdown_connections 2023-10-09T15:39:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/3254225200 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc06e0e0 0x7fdccc0cb6f0 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.712 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/3254225200 >> v2:172.21.15.59:3300/0 conn(0x7fdccc06dc70 0x7fdccc159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 -- 172.21.15.33:0/3254225200 >> 172.21.15.33:0/3254225200 conn(0x7fdccc0703a0 msgr2=0x7fdccc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 -- 172.21.15.33:0/3254225200 shutdown_connections 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.708+0000 7fdcd20f5700 1 -- 172.21.15.33:0/3254225200 wait complete. 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.709+0000 7fdcd20f5700 1 Processor -- start 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.709+0000 7fdcd20f5700 1 -- start start 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdccc06dc70 0x7fdccc149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 0x7fdccc157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b3e40 con 0x7fdccc159530 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc149740 con 0x7fdccc06dc70 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdcd20f5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdccc0b4c40 con 0x7fdccc06e0e0 2023-10-09T15:39:40.713 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdccbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57946/0 (socket says 172.21.15.33:57946) 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdccbfff700 1 -- 172.21.15.33:0/263629720 learned_addr learned my addr 172.21.15.33:0/263629720 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdccaffd700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 0x7fdccc157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.710+0000 7fdccb7fe700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdccc06dc70 0x7fdccc149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 -- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 msgr2=0x7fdccc157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 0x7fdccc157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 -- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdccc06dc70 msgr2=0x7fdccc149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdccc06dc70 0x7fdccc149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 -- 172.21.15.33:0/263629720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc4009ae0 con 0x7fdccc159530 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccaffd700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 0x7fdccc157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdccbfff700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009880 tx=0x7fdcc4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.714 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc4008b30 con 0x7fdccc159530 2023-10-09T15:39:40.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcc4008cb0 con 0x7fdccc159530 2023-10-09T15:39:40.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdccc0b4030 con 0x7fdccc159530 2023-10-09T15:39:40.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40266b0 con 0x7fdccc159530 2023-10-09T15:39:40.715 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.711+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdccc0b45f0 con 0x7fdccc159530 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.712+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdccc0b4df0 con 0x7fdccc159530 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.712+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdcc4003040 con 0x7fdccc159530 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.713+0000 7fdcb37fe700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 0x7fdcb80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.713+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fdcc4086e60 con 0x7fdccc159530 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.713+0000 7fdccb7fe700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 0x7fdcb80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:40.716 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.713+0000 7fdccb7fe700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 0x7fdcb80697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0039e0 tx=0x7fdcbc007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:40.718 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.717+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdccc0b4df0 con 0x7fdccc159530 2023-10-09T15:39:40.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.910+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000790701.meta", "var": "pg_num"} v 0) v1 -- 0x7fdccc0b4db0 con 0x7fdccc159530 2023-10-09T15:39:40.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.911+0000 7fdcb37fe700 1 -- 172.21.15.33:0/263629720 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000790701.meta", "var": "pg_num"}]=0 v173) v1 ==== 124+0+11 (secure 0 0 0) 0x7fdcc4021020 con 0x7fdccc159530 2023-10-09T15:39:40.911 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 msgr2=0x7fdcb80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 0x7fdcb80697d0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc0039e0 tx=0x7fdcbc007ec0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 msgr2=0x7fdccc157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fdcc4009880 tx=0x7fdcc4018000 comp rx=0 tx=0).stop 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 shutdown_connections 2023-10-09T15:39:40.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdcb8067320 0x7fdcb80697d0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdccc159530 0x7fdccc157940 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdccc06dc70 0x7fdccc149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 --2- 172.21.15.33:0/263629720 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdccc06e0e0 0x7fdccc157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 >> 172.21.15.33:0/263629720 conn(0x7fdccc0703a0 msgr2=0x7fdccc153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 shutdown_connections 2023-10-09T15:39:40.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:40.913+0000 7fdcd20f5700 1 -- 172.21.15.33:0/263629720 wait complete. 2023-10-09T15:39:40.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:39:41.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.047+0000 7f0907d3f700 1 Processor -- start 2023-10-09T15:39:41.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.047+0000 7f0907d3f700 1 -- start start 2023-10-09T15:39:41.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0907d3f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f09000cd7c0 0x7f090006d940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0907d3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f09000cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0907d3f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f090006e2f0 con 0x7f09001598b0 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0907d3f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f090015d3e0 con 0x7f09000cd7c0 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0907d3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f090015df60 con 0x7f090006de80 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0905adb700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f09001598b0 0x7f09000b2560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58556/0 (socket says 172.21.15.33:58556) 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0905adb700 1 -- 172.21.15.33:0/14774709 learned_addr learned my addr 172.21.15.33:0/14774709 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.048+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053350933 0 0) 0x7f090006e2f0 con 0x7f09001598b0 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08e8003570 con 0x7f09001598b0 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f09062dc700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f09000cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f09052da700 1 --2- 172.21.15.33:0/14774709 >> v2:172.21.15.59:3300/0 conn(0x7f09000cd7c0 0x7f090006d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4122046832 0 0) 0x7f08e8003570 con 0x7f09001598b0 2023-10-09T15:39:41.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 msgr2=0x7f09000cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f09000cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 >> v2:172.21.15.59:3300/0 conn(0x7f09000cd7c0 msgr2=0x7f090006d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 --2- 172.21.15.33:0/14774709 >> v2:172.21.15.59:3300/0 conn(0x7f09000cd7c0 0x7f090006d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f090015d630 con 0x7f09001598b0 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f08f00017f0 con 0x7f09001598b0 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 >> v1:172.21.15.33:6789/0 conn(0x7f09001598b0 legacy=0x7f09000b2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8003a60 0x7f08e8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f08e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8004d50 0x7f08e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090015d3e0 con 0x7f08e8003a60 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090015df60 con 0x7f08e8004d50 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08e800ba60 con 0x7f090006de80 2023-10-09T15:39:41.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8003a60 0x7f08e8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f09052da700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f08e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f09062dc700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8004d50 0x7f08e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 -- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 msgr2=0x7f08e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090006de80 0x7f08e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 -- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8004d50 msgr2=0x7f08e80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8004d50 0x7f08e80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.049+0000 7f0905adb700 1 -- 172.21.15.33:0/14774709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08e8003570 con 0x7f08e8003a60 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0905adb700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8003a60 0x7f08e8003e70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f08f000a970 tx=0x7f08f0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2b917e900c07c94 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00070d0 con 0x7f08e8003a60 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f0007230 con 0x7f08e8003a60 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0904ad9700 1 -- 172.21.15.33:0/14774709 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f00075d0 con 0x7f08e8003a60 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 -- 172.21.15.33:0/14774709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8003a60 msgr2=0x7f08e8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 --2- 172.21.15.33:0/14774709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f08e8003a60 0x7f08e8003e70 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f08f000a970 tx=0x7f08f0002210 comp rx=0 tx=0).stop 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f09062dc700 1 -- 172.21.15.33:0/14774709 reap_dead start 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 -- 172.21.15.33:0/14774709 shutdown_connections 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 -- 172.21.15.33:0/14774709 >> 172.21.15.33:0/14774709 conn(0x7f09000703a0 msgr2=0x7f09000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 -- 172.21.15.33:0/14774709 shutdown_connections 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.050+0000 7f0907d3f700 1 -- 172.21.15.33:0/14774709 wait complete. 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.051+0000 7f0907d3f700 1 Processor -- start 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.051+0000 7f0907d3f700 1 -- start start 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8003a60 0x7f09001541b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090015bc90 0x7f090015c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f090015c640 con 0x7f09000c8820 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09000c9590 con 0x7f08e8003a60 2023-10-09T15:39:41.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0907d3f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09000c9870 con 0x7f090015bc90 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f09062dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f09062dc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57970/0 (socket says 172.21.15.33:57970) 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f09062dc700 1 -- 172.21.15.33:0/4243977986 learned_addr learned my addr 172.21.15.33:0/4243977986 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f09052da700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090015bc90 0x7f090015c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.052+0000 7f0905adb700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8003a60 0x7f09001541b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 -- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090015bc90 msgr2=0x7f090015c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090015bc90 0x7f090015c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 -- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8003a60 msgr2=0x7f09001541b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8003a60 0x7f09001541b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 -- 172.21.15.33:0/4243977986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0900159e20 con 0x7f09000c8820 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f09062dc700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f09000cb100 tx=0x7f08f80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8013750 con 0x7f09000c8820 2023-10-09T15:39:41.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08f80138b0 con 0x7f09000c8820 2023-10-09T15:39:41.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f090015a100 con 0x7f09000c8820 2023-10-09T15:39:41.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08f8013c50 con 0x7f09000c8820 2023-10-09T15:39:41.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.053+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09000c9200 con 0x7f09000c8820 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.054+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0900159c80 con 0x7f09000c8820 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.054+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f08f8014650 con 0x7f09000c8820 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.055+0000 7f08fdffb700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 0x7f08ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.055+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f08f8085370 con 0x7f09000c8820 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.055+0000 7f0905adb700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 0x7f08ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.055+0000 7f0905adb700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 0x7f08ec0697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f08f000afd0 tx=0x7f08f0015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.059+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0900159c80 con 0x7f09000c8820 2023-10-09T15:39:41.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.249+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0900159c80 con 0x7f09000c8820 2023-10-09T15:39:41.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.250+0000 7f08fdffb700 1 -- 172.21.15.33:0/4243977986 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v173) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0900159c80 con 0x7f09000c8820 2023-10-09T15:39:41.251 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:39:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 msgr2=0x7f08ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 0x7f08ec0697d0 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f08f000afd0 tx=0x7f08f0015000 comp rx=0 tx=0).stop 2023-10-09T15:39:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 msgr2=0x7f09000c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f09000cb100 tx=0x7f08f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 shutdown_connections 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f08ec067320 0x7f08ec0697d0 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f09000c8820 0x7f09000c8cc0 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f08e8003a60 0x7f09001541b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 --2- 172.21.15.33:0/4243977986 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f090015bc90 0x7f090015c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 >> 172.21.15.33:0/4243977986 conn(0x7f09000703a0 msgr2=0x7f09000b3440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 shutdown_connections 2023-10-09T15:39:41.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.252+0000 7f0907d3f700 1 -- 172.21.15.33:0/4243977986 wait complete. 2023-10-09T15:39:41.265 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get another-data-pool pg_num 2023-10-09T15:39:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.387+0000 7f8f33a70700 1 Processor -- start 2023-10-09T15:39:41.388 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.387+0000 7f8f33a70700 1 -- start start 2023-10-09T15:39:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f33a70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8f2c159530 0x7f8f2c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f33a70700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f33a70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f2c0ccfd0 con 0x7f8f2c06dc70 2023-10-09T15:39:41.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f33a70700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c0cf0e0 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f33a70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f2c15a3d0 con 0x7f8f2c159530 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57972/0 (socket says 172.21.15.33:57972) 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 -- 172.21.15.33:0/3005385525 learned_addr learned my addr 172.21.15.33:0/3005385525 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3180c700 1 --2- 172.21.15.33:0/3005385525 >> v2:172.21.15.59:3300/0 conn(0x7f8f2c159530 0x7f8f2c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 -- 172.21.15.33:0/3005385525 >> v2:172.21.15.59:3300/0 conn(0x7f8f2c159530 msgr2=0x7f8f2c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 --2- 172.21.15.33:0/3005385525 >> v2:172.21.15.59:3300/0 conn(0x7f8f2c159530 0x7f8f2c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 -- 172.21.15.33:0/3005385525 >> v1:172.21.15.59:6789/0 conn(0x7f8f2c06dc70 legacy=0x7f8f2c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 -- 172.21.15.33:0/3005385525 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f2c15a6b0 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3200d700 1 --2- 172.21.15.33:0/3005385525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c06d630 tx=0x7f8f24009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7b9b62dc3eb4f02 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.388+0000 7f8f3080a700 1 -- 172.21.15.33:0/3005385525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400b860 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f3080a700 1 -- 172.21.15.33:0/3005385525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2400b9c0 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f3080a700 1 -- 172.21.15.33:0/3005385525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400bd60 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 -- 172.21.15.33:0/3005385525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c06e0e0 msgr2=0x7f8f2c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 --2- 172.21.15.33:0/3005385525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 secure :-1 s=READY pgs=1548 cs=0 l=1 rev1=1 crypto rx=0x7f8f2c06d630 tx=0x7f8f24009250 comp rx=0 tx=0).stop 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 -- 172.21.15.33:0/3005385525 shutdown_connections 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 --2- 172.21.15.33:0/3005385525 >> v2:172.21.15.59:3300/0 conn(0x7f8f2c159530 0x7f8f2c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 --2- 172.21.15.33:0/3005385525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c0cb6f0 unknown :-1 s=CLOSED pgs=1548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 -- 172.21.15.33:0/3005385525 >> 172.21.15.33:0/3005385525 conn(0x7f8f2c0703a0 msgr2=0x7f8f2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 -- 172.21.15.33:0/3005385525 shutdown_connections 2023-10-09T15:39:41.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.389+0000 7f8f33a70700 1 -- 172.21.15.33:0/3005385525 wait complete. 2023-10-09T15:39:41.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.390+0000 7f8f33a70700 1 Processor -- start 2023-10-09T15:39:41.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.390+0000 7f8f33a70700 1 -- start start 2023-10-09T15:39:41.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f2c06dc70 0x7f8f2c14e250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.394 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c15df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15f4c0 con 0x7f8f2c159530 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15e8b0 con 0x7f8f2c06e0e0 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f33a70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f2c15eb90 con 0x7f8f2c06dc70 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f3200d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f3200d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57984/0 (socket says 172.21.15.33:57984) 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.391+0000 7f8f3200d700 1 -- 172.21.15.33:0/2263513292 learned_addr learned my addr 172.21.15.33:0/2263513292 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3180c700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f2c06dc70 0x7f8f2c14e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3100b700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c15df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 -- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f2c06dc70 msgr2=0x7f8f2c14e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f2c06dc70 0x7f8f2c14e250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 -- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 msgr2=0x7f8f2c15df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c15df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 -- 172.21.15.33:0/2263513292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f240094f0 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3100b700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f3200d700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009880 tx=0x7f8f24017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2401a630 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f2401a790 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f2c15ee70 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f2401ab50 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.392+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f2c14e790 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.393+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f2c15f630 con 0x7f8f2c159530 2023-10-09T15:39:41.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.394+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8f2402d440 con 0x7f8f2c159530 2023-10-09T15:39:41.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.394+0000 7f8f29ffb700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.394+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f8f24086b90 con 0x7f8f2c159530 2023-10-09T15:39:41.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.394+0000 7f8f3180c700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.394+0000 7f8f3180c700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 0x7f8f180697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0074f0 tx=0x7f8f1c009700 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.398+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8f24053640 con 0x7f8f2c159530 2023-10-09T15:39:41.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.590+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"} v 0) v1 -- 0x7f8f2c04c3c0 con 0x7f8f2c159530 2023-10-09T15:39:41.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.591+0000 7f8f29ffb700 1 -- 172.21.15.33:0/2263513292 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "another-data-pool", "var": "pg_num"}]=0 v173) v1 ==== 106+0+11 (secure 0 0 0) 0x7f8f24056c60 con 0x7f8f2c159530 2023-10-09T15:39:41.592 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:39:41.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 msgr2=0x7f8f180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 0x7f8f180697d0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f8f1c0074f0 tx=0x7f8f1c009700 comp rx=0 tx=0).stop 2023-10-09T15:39:41.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 msgr2=0x7f8f2c15f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f8f24009880 tx=0x7f8f24017000 comp rx=0 tx=0).stop 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 shutdown_connections 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f18067320 0x7f8f180697d0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8f2c159530 0x7f8f2c15f950 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8f2c06dc70 0x7f8f2c14e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 --2- 172.21.15.33:0/2263513292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8f2c06e0e0 0x7f8f2c15df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 >> 172.21.15.33:0/2263513292 conn(0x7f8f2c0703a0 msgr2=0x7f8f2c15acf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 shutdown_connections 2023-10-09T15:39:41.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.593+0000 7f8f33a70700 1 -- 172.21.15.33:0/2263513292 wait complete. 2023-10-09T15:39:41.606 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:41.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.725+0000 7fb559cde700 1 Processor -- start 2023-10-09T15:39:41.726 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.725+0000 7fb559cde700 1 -- start start 2023-10-09T15:39:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb559cde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 0x7fb55406d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb559cde700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540b3270 con 0x7fb554159570 2023-10-09T15:39:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb559cde700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5540b3550 con 0x7fb55415dea0 2023-10-09T15:39:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb559cde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540b3830 con 0x7fb554159940 2023-10-09T15:39:41.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb558cdc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb554159570 0x7fb5540b23e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58560/0 (socket says 172.21.15.33:58560) 2023-10-09T15:39:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb558cdc700 1 -- 172.21.15.33:0/2819079904 learned_addr learned my addr 172.21.15.33:0/2819079904 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb553fff700 1 --2- 172.21.15.33:0/2819079904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 0x7fb55406d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1261306234 0 0) 0x7fb5540b3270 con 0x7fb554159570 2023-10-09T15:39:41.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.726+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb540003570 con 0x7fb554159570 2023-10-09T15:39:41.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb553fff700 1 -- 172.21.15.33:0/2819079904 >> v1:172.21.15.59:6789/0 conn(0x7fb55415dea0 legacy=0x7fb5540b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb553fff700 1 -- 172.21.15.33:0/2819079904 >> v1:172.21.15.33:6789/0 conn(0x7fb554159570 legacy=0x7fb5540b23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3018226571 0 0) 0x7fb5540b3550 con 0x7fb55415dea0 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb553fff700 1 -- 172.21.15.33:0/2819079904 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5540b3b10 con 0x7fb554159940 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb553fff700 1 --2- 172.21.15.33:0/2819079904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 0x7fb55406d7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e90 tx=0x7fb544009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=28178a1fa27cb807 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54400e070 con 0x7fb554159940 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54400bc30 con 0x7fb554159940 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb5537fe700 1 -- 172.21.15.33:0/2819079904 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb544012430 con 0x7fb554159940 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb559cde700 1 -- 172.21.15.33:0/2819079904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 msgr2=0x7fb55406d7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.727+0000 7fb559cde700 1 --2- 172.21.15.33:0/2819079904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 0x7fb55406d7c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fb544009e90 tx=0x7fb544009780 comp rx=0 tx=0).stop 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.728+0000 7fb559cde700 1 -- 172.21.15.33:0/2819079904 shutdown_connections 2023-10-09T15:39:41.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.728+0000 7fb559cde700 1 --2- 172.21.15.33:0/2819079904 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb554159940 0x7fb55406d7c0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.728+0000 7fb559cde700 1 -- 172.21.15.33:0/2819079904 >> 172.21.15.33:0/2819079904 conn(0x7fb5540703a0 msgr2=0x7fb5540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.728+0000 7fb559cde700 1 -- 172.21.15.33:0/2819079904 shutdown_connections 2023-10-09T15:39:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.728+0000 7fb559cde700 1 -- 172.21.15.33:0/2819079904 wait complete. 2023-10-09T15:39:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.729+0000 7fb559cde700 1 Processor -- start 2023-10-09T15:39:41.731 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.729+0000 7fb559cde700 1 -- start start 2023-10-09T15:39:41.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.729+0000 7fb559cde700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.729+0000 7fb559cde700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb554159940 0x7fb55406d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb55415dea0 0x7fb554150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c4c90 con 0x7fb554159570 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c4080 con 0x7fb554159940 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5540c4360 con 0x7fb55415dea0 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:57994/0 (socket says 172.21.15.33:57994) 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 -- 172.21.15.33:0/1763907663 learned_addr learned my addr 172.21.15.33:0/1763907663 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb5594dd700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb55415dea0 0x7fb554150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb553fff700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb554159940 0x7fb55406d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 -- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb55415dea0 msgr2=0x7fb554150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb55415dea0 0x7fb554150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 -- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb554159940 msgr2=0x7fb55406d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb554159940 0x7fb55406d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 -- 172.21.15.33:0/1763907663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb544009a20 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb558cdc700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0011e0 tx=0x7fb53c007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c005b30 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb53c005c90 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5540c4640 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb53c0072e0 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.730+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5540c6c50 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.731+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55404c3c0 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.732+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb53c007650 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.732+0000 7fb550ff9700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 0x7fb5340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.732+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7fb53c084270 con 0x7fb554159570 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.732+0000 7fb553fff700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 0x7fb5340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:41.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.733+0000 7fb553fff700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 0x7fb5340697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb554159d70 tx=0x7fb544019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:41.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.736+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb53c04b5a0 con 0x7fb554159570 2023-10-09T15:39:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.975+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb5540b3df0 con 0x7fb554159570 2023-10-09T15:39:41.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.975+0000 7fb550ff9700 1 -- 172.21.15.33:0/1763907663 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4624 (secure 0 0 0) 0x7fb53c050dd0 con 0x7fb554159570 2023-10-09T15:39:41.976 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:41.977 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:37.287243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000790701","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 msgr2=0x7fb5340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 0x7fb5340697d0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7fb554159d70 tx=0x7fb544019000 comp rx=0 tx=0).stop 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 msgr2=0x7fb5540c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb53c0011e0 tx=0x7fb53c007df0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 shutdown_connections 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb534067320 0x7fb5340697d0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb554159570 0x7fb5540c6710 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb55415dea0 0x7fb554150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 --2- 172.21.15.33:0/1763907663 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb554159940 0x7fb55406d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 >> 172.21.15.33:0/1763907663 conn(0x7fb5540703a0 msgr2=0x7fb55415c450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 shutdown_connections 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:41.978+0000 7fb559cde700 1 -- 172.21.15.33:0/1763907663 wait complete. 2023-10-09T15:39:41.980 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 115 2023-10-09T15:39:41.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.110+0000 7f2b8e47d700 1 Processor -- start 2023-10-09T15:39:42.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 -- start start 2023-10-09T15:39:42.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2b88157600 0x7f2b880b1410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b881579d0 0x7f2b880b1950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b88158210 con 0x7f2b880ccba0 2023-10-09T15:39:42.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880cb850 con 0x7f2b881579d0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b8e47d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b880cb290 con 0x7f2b88157600 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.111+0000 7f2b7ffff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2b881579d0 0x7f2b880b1950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b8ca1a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2b880ccba0 0x7f2b881586a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58576/0 (socket says 172.21.15.33:58576) 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b8ca1a700 1 -- 172.21.15.33:0/3368231525 learned_addr learned my addr 172.21.15.33:0/3368231525 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b87fff700 1 --2- 172.21.15.33:0/3368231525 >> v2:172.21.15.59:3300/0 conn(0x7f2b88157600 0x7f2b880b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b7ffff700 1 -- 172.21.15.33:0/3368231525 >> v2:172.21.15.59:3300/0 conn(0x7f2b88157600 msgr2=0x7f2b880b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b7ffff700 1 --2- 172.21.15.33:0/3368231525 >> v2:172.21.15.59:3300/0 conn(0x7f2b88157600 0x7f2b880b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b7ffff700 1 -- 172.21.15.33:0/3368231525 >> v1:172.21.15.33:6789/0 conn(0x7f2b880ccba0 legacy=0x7f2b881586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b7ffff700 1 -- 172.21.15.33:0/3368231525 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b880cb570 con 0x7f2b881579d0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b877fe700 1 -- 172.21.15.33:0/3368231525 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2326488650 0 0) 0x7f2b88158210 con 0x7f2b880ccba0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b7ffff700 1 --2- 172.21.15.33:0/3368231525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b880b1950 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2b880650d0 tx=0x7f2b700091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcf4189507262914 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b877fe700 1 -- 172.21.15.33:0/3368231525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70011630 con 0x7f2b881579d0 2023-10-09T15:39:42.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b877fe700 1 -- 172.21.15.33:0/3368231525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b70011790 con 0x7f2b881579d0 2023-10-09T15:39:42.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.112+0000 7f2b877fe700 1 -- 172.21.15.33:0/3368231525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b70011b30 con 0x7f2b881579d0 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 -- 172.21.15.33:0/3368231525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 msgr2=0x7f2b880b1950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/3368231525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b880b1950 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7f2b880650d0 tx=0x7f2b700091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 -- 172.21.15.33:0/3368231525 shutdown_connections 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/3368231525 >> v2:172.21.15.59:3300/0 conn(0x7f2b88157600 0x7f2b880b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/3368231525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b880b1950 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 -- 172.21.15.33:0/3368231525 >> 172.21.15.33:0/3368231525 conn(0x7f2b8806d170 msgr2=0x7f2b880cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:42.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 -- 172.21.15.33:0/3368231525 shutdown_connections 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.113+0000 7f2b8e47d700 1 -- 172.21.15.33:0/3368231525 wait complete. 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.114+0000 7f2b8e47d700 1 Processor -- start 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.114+0000 7f2b8e47d700 1 -- start start 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b880ccba0 0x7f2b881586a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 0x7f2b8815ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88159b70 con 0x7f2b881579d0 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b88158ef0 con 0x7f2b88157600 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b881591d0 con 0x7f2b880ccba0 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58004/0 (socket says 172.21.15.33:58004) 2023-10-09T15:39:42.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 -- 172.21.15.33:0/876768500 learned_addr learned my addr 172.21.15.33:0/876768500 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b87fff700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b880ccba0 0x7f2b881586a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b7ffff700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 0x7f2b8815ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 -- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b880ccba0 msgr2=0x7f2b881586a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b880ccba0 0x7f2b881586a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 -- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 msgr2=0x7f2b8815ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 0x7f2b8815ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 -- 172.21.15.33:0/876768500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009420 con 0x7f2b881579d0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b7ffff700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 0x7f2b8815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8ca1a700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000cbf0 tx=0x7f2b800019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000a910 con 0x7f2b881579d0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b8000aa70 con 0x7f2b881579d0 2023-10-09T15:39:42.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000ae30 con 0x7f2b881579d0 2023-10-09T15:39:42.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.115+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b881594b0 con 0x7f2b881579d0 2023-10-09T15:39:42.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.116+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b88158be0 con 0x7f2b881579d0 2023-10-09T15:39:42.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.117+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b88159cb0 con 0x7f2b881579d0 2023-10-09T15:39:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.117+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2b80007300 con 0x7f2b881579d0 2023-10-09T15:39:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.117+0000 7f2b84ff9700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 0x7f2b680697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.117+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f2b80085260 con 0x7f2b881579d0 2023-10-09T15:39:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.117+0000 7f2b87fff700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 0x7f2b680697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.118+0000 7f2b87fff700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 0x7f2b680697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009d10 tx=0x7f2b780091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.122+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2b88159cb0 con 0x7f2b881579d0 2023-10-09T15:39:42.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.314+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b88159cb0 con 0x7f2b881579d0 2023-10-09T15:39:42.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.315+0000 7f2b84ff9700 1 -- 172.21.15.33:0/876768500 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f2b88159cb0 con 0x7f2b881579d0 2023-10-09T15:39:42.316 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:42.317 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":173,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:38.290926+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000790701.meta","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000790701"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 msgr2=0x7f2b680697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 0x7f2b680697d0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f2b78009d10 tx=0x7f2b780091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 msgr2=0x7f2b8815d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000cbf0 tx=0x7f2b800019b0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 shutdown_connections 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.317+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2b68067320 0x7f2b680697d0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2b881579d0 0x7f2b8815d230 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2b880ccba0 0x7f2b881586a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 --2- 172.21.15.33:0/876768500 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2b88157600 0x7f2b8815ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 >> 172.21.15.33:0/876768500 conn(0x7f2b8806d170 msgr2=0x7f2b880c18b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 shutdown_connections 2023-10-09T15:39:42.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.318+0000 7f2b8e47d700 1 -- 172.21.15.33:0/876768500 wait complete. 2023-10-09T15:39:42.331 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000790701 and related pools 2023-10-09T15:39:42.331 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:42.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.449+0000 7f40bc28b700 1 Processor -- start 2023-10-09T15:39:42.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.449+0000 7f40bc28b700 1 -- start start 2023-10-09T15:39:42.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40bc28b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f40b40cf200 0x7f40b40c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40bc28b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f40b406e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40bc28b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40b415a280 con 0x7f40b40b07d0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40bc28b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40b406e180 con 0x7f40b40cf200 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40bc28b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b406d850 con 0x7f40b40b0ba0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40ba027700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f40b40b07d0 0x7f40b40ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58582/0 (socket says 172.21.15.33:58582) 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.450+0000 7f40ba027700 1 -- 172.21.15.33:0/4192935347 learned_addr learned my addr 172.21.15.33:0/4192935347 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba828700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f40b406e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2174288970 0 0) 0x7f40b415a280 con 0x7f40b40b07d0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9826700 1 --2- 172.21.15.33:0/4192935347 >> v2:172.21.15.59:3300/0 conn(0x7f40b40cf200 0x7f40b40c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f409c003570 con 0x7f40b40b07d0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 327524960 0 0) 0x7f409c003570 con 0x7f40b40b07d0 2023-10-09T15:39:42.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 msgr2=0x7f40b406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f40b406e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 >> v2:172.21.15.59:3300/0 conn(0x7f40b40cf200 msgr2=0x7f40b40c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 --2- 172.21.15.33:0/4192935347 >> v2:172.21.15.59:3300/0 conn(0x7f40b40cf200 0x7f40b40c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b406db30 con 0x7f40b40b07d0 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f40ac0015f0 con 0x7f40b40b07d0 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 >> v1:172.21.15.33:6789/0 conn(0x7f40b40b07d0 legacy=0x7f40b40ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c003a60 0x7f409c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c004810 0x7f409c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f409c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b406e180 con 0x7f409c003a60 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b406d850 con 0x7f409c004810 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f409c00ba60 con 0x7f40b40b0ba0 2023-10-09T15:39:42.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c003a60 0x7f409c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40b9826700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c004810 0x7f409c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba828700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f409c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 -- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 msgr2=0x7f409c0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40b40b0ba0 0x7f409c0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 -- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c004810 msgr2=0x7f409c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f409c004810 0x7f409c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.451+0000 7f40ba027700 1 -- 172.21.15.33:0/4192935347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c003570 con 0x7f409c003a60 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40ba027700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c003a60 0x7f409c003e70 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c3f0 tx=0x7f40ac007920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3613a9c9b1bcbed server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac00cc80 con 0x7f409c003a60 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40ac00ce00 con 0x7f409c003a60 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40b9025700 1 -- 172.21.15.33:0/4192935347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40ac007320 con 0x7f409c003a60 2023-10-09T15:39:42.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 -- 172.21.15.33:0/4192935347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c003a60 msgr2=0x7f409c003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 --2- 172.21.15.33:0/4192935347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f409c003a60 0x7f409c003e70 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c3f0 tx=0x7f40ac007920 comp rx=0 tx=0).stop 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40ba828700 1 -- 172.21.15.33:0/4192935347 reap_dead start 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 -- 172.21.15.33:0/4192935347 shutdown_connections 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 -- 172.21.15.33:0/4192935347 >> 172.21.15.33:0/4192935347 conn(0x7f40b406ce80 msgr2=0x7f40b40ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 -- 172.21.15.33:0/4192935347 shutdown_connections 2023-10-09T15:39:42.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.452+0000 7f40bc28b700 1 -- 172.21.15.33:0/4192935347 wait complete. 2023-10-09T15:39:42.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.453+0000 7f40bc28b700 1 Processor -- start 2023-10-09T15:39:42.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 -- start start 2023-10-09T15:39:42.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f409c003a60 0x7f40b41515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 0x7f40b4154720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4156320 con 0x7f40b40c58f0 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40b4154c60 con 0x7f40b41542b0 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40bc28b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40b40c6f10 con 0x7f409c003a60 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40ba828700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40ba828700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58014/0 (socket says 172.21.15.33:58014) 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40ba828700 1 -- 172.21.15.33:0/1172660259 learned_addr learned my addr 172.21.15.33:0/1172660259 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.454+0000 7f40ba027700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f409c003a60 0x7f40b41515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40b9826700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 0x7f40b4154720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 -- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f409c003a60 msgr2=0x7f40b41515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f409c003a60 0x7f40b41515c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 -- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 msgr2=0x7f40b4154720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 0x7f40b4154720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 -- 172.21.15.33:0/1172660259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40b41565e0 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40b9826700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 0x7f40b4154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40ba828700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f40a40094d0 tx=0x7f40a400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400e040 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40a400f040 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40a400fe50 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40b40c6670 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.455+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40b40c6c30 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.456+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40b4156770 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.456+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f40a4015640 con 0x7f40b40c58f0 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.457+0000 7f40b27fc700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 0x7f40a00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.457+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f40a40857a0 con 0x7f40b40c58f0 2023-10-09T15:39:42.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.457+0000 7f40ba027700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 0x7f40a00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.457+0000 7f40ba027700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 0x7f40a00697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c390 tx=0x7f40ac015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.461+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f40a4052140 con 0x7f40b40c58f0 2023-10-09T15:39:42.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.699+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f40b404c3c0 con 0x7f40b40c58f0 2023-10-09T15:39:42.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.700+0000 7f40b27fc700 1 -- 172.21.15.33:0/1172660259 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4624 (secure 0 0 0) 0x7f40a4055760 con 0x7f40b40c58f0 2023-10-09T15:39:42.701 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:42.701 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:37.287243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000790701","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 msgr2=0x7f40a00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 0x7f40a00697d0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c390 tx=0x7f40ac015000 comp rx=0 tx=0).stop 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 msgr2=0x7f40b40c5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f40a40094d0 tx=0x7f40a400b040 comp rx=0 tx=0).stop 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 shutdown_connections 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f40a0067320 0x7f40a00697d0 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40b40c58f0 0x7f40b40c5d60 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f409c003a60 0x7f40b41515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 --2- 172.21.15.33:0/1172660259 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40b41542b0 0x7f40b4154720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 >> 172.21.15.33:0/1172660259 conn(0x7f40b406ce80 msgr2=0x7f40b40c9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 shutdown_connections 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.702+0000 7f40bc28b700 1 -- 172.21.15.33:0/1172660259 wait complete. 2023-10-09T15:39:42.704 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 115 2023-10-09T15:39:42.715 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.834+0000 7ff03359e700 1 Processor -- start 2023-10-09T15:39:42.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.834+0000 7ff03359e700 1 -- start start 2023-10-09T15:39:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff034153c30 0x7ff03415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff03415de50 0x7ff0340cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff03415afd0 con 0x7ff0340cef40 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff03415b2b0 con 0x7ff03415de50 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff03415b590 con 0x7ff034153c30 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff031d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff03415de50 0x7ff0340cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff032d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff0340cef40 0x7ff03406d790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58594/0 (socket says 172.21.15.33:58594) 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff032d9d700 1 -- 172.21.15.33:0/1318756961 learned_addr learned my addr 172.21.15.33:0/1318756961 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03259c700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff034153c30 0x7ff03415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03159a700 1 -- 172.21.15.33:0/1318756961 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3252510376 0 0) 0x7ff03415afd0 con 0x7ff0340cef40 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff03159a700 1 -- 172.21.15.33:0/1318756961 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff01c003570 con 0x7ff0340cef40 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff031d9b700 1 -- 172.21.15.33:0/1318756961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff034153c30 msgr2=0x7ff03415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff031d9b700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff034153c30 0x7ff03415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff031d9b700 1 -- 172.21.15.33:0/1318756961 >> v1:172.21.15.33:6789/0 conn(0x7ff0340cef40 legacy=0x7ff03406d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.835+0000 7ff031d9b700 1 -- 172.21.15.33:0/1318756961 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff03415b870 con 0x7ff03415de50 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff031d9b700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03415de50 0x7ff0340cea00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff0280098e0 tx=0x7ff0280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c6823e4e08a8f6 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03159a700 1 -- 172.21.15.33:0/1318756961 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011630 con 0x7ff03415de50 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03159a700 1 -- 172.21.15.33:0/1318756961 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028011790 con 0x7ff03415de50 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03159a700 1 -- 172.21.15.33:0/1318756961 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011b10 con 0x7ff03415de50 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 -- 172.21.15.33:0/1318756961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03415de50 msgr2=0x7ff0340cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03415de50 0x7ff0340cea00 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7ff0280098e0 tx=0x7ff0280091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 -- 172.21.15.33:0/1318756961 shutdown_connections 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff034153c30 0x7ff03415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 --2- 172.21.15.33:0/1318756961 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff03415de50 0x7ff0340cea00 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 -- 172.21.15.33:0/1318756961 >> 172.21.15.33:0/1318756961 conn(0x7ff0340703a0 msgr2=0x7ff0340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:42.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 -- 172.21.15.33:0/1318756961 shutdown_connections 2023-10-09T15:39:42.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.836+0000 7ff03359e700 1 -- 172.21.15.33:0/1318756961 wait complete. 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.837+0000 7ff03359e700 1 Processor -- start 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 -- start start 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0340cef40 0x7ff0340b5170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff03415de50 0x7ff0340c9510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.842 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340cb110 con 0x7ff034153c30 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340cb380 con 0x7ff0340cef40 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0340b59a0 con 0x7ff03415de50 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff031d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58038/0 (socket says 172.21.15.33:58038) 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff031d9b700 1 -- 172.21.15.33:0/4162959812 learned_addr learned my addr 172.21.15.33:0/4162959812 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff032d9d700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff03415de50 0x7ff0340c9510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.838+0000 7ff03259c700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0340cef40 0x7ff0340b5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 -- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff03415de50 msgr2=0x7ff0340c9510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff03415de50 0x7ff0340c9510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 -- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0340cef40 msgr2=0x7ff0340b5170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0340cef40 0x7ff0340b5170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:42.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 -- 172.21.15.33:0/4162959812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff028009420 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff031d9b700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff03406eb00 tx=0x7ff028017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff028011900 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff028011a60 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0340b5c80 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff02801a680 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.839+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0340b56b0 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.840+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0340b61a0 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.840+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff02801aa70 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.841+0000 7ff0227fc700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 0x7ff0140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.841+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7ff0280868f0 con 0x7ff034153c30 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.841+0000 7ff03259c700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 0x7ff0140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:42.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.841+0000 7ff03259c700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 0x7ff0140697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff024009db0 tx=0x7ff0240091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:42.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:42.845+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff0340b61a0 con 0x7ff034153c30 2023-10-09T15:39:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.082+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0340b61a0 con 0x7ff034153c30 2023-10-09T15:39:43.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.083+0000 7ff0227fc700 1 -- 172.21.15.33:0/4162959812 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 115 v115) v1 ==== 95+0+4624 (secure 0 0 0) 0x7ff0340b61a0 con 0x7ff034153c30 2023-10-09T15:39:43.084 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:43.084 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":115,"default_fscid":14,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107}],"filesystems":[{"mdsmap":{"epoch":115,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:22.121849+0000","modified":"2023-10-09T15:39:37.287243+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8262},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8262":{"gid":8262,"name":"a","rank":0,"incarnation":108,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/2271544714","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2271544714},{"type":"v1","addr":"172.21.15.33:6837","nonce":2271544714}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[29,30],"metadata_pool":28,"enabled":true,"fs_name":"volume_0000000000790701","balancer":"","standby_count_wanted":0},"id":14}]} 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 msgr2=0x7ff0140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 0x7ff0140697d0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7ff024009db0 tx=0x7ff0240091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 msgr2=0x7ff034152010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7ff03406eb00 tx=0x7ff028017000 comp rx=0 tx=0).stop 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 shutdown_connections 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff014067320 0x7ff0140697d0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff03415de50 0x7ff0340c9510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff0340cef40 0x7ff0340b5170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.084+0000 7ff03359e700 1 --2- 172.21.15.33:0/4162959812 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff034153c30 0x7ff034152010 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.085+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 >> 172.21.15.33:0/4162959812 conn(0x7ff0340703a0 msgr2=0x7ff0340c6230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.085+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 shutdown_connections 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.085+0000 7ff03359e700 1 -- 172.21.15.33:0/4162959812 wait complete. 2023-10-09T15:39:43.087 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 115 2023-10-09T15:39:43.098 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:43.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 Processor -- start 2023-10-09T15:39:43.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 -- start start 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90440cb5a0 0x7f90440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 0x7f9044156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904415ae40 con 0x7f90440cd9e0 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90440d13f0 con 0x7f90440cb5a0 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.216+0000 7f904b0c2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904415ab60 con 0x7f904415a5d0 2023-10-09T15:39:43.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90440cb5a0 0x7f90440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f90440cb5a0 0x7f90440cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58052/0 (socket says 172.21.15.33:58052) 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 -- 172.21.15.33:0/2602499726 learned_addr learned my addr 172.21.15.33:0/2602499726 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f904965f700 1 --2- 172.21.15.33:0/2602499726 >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 0x7f9044156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 -- 172.21.15.33:0/2602499726 >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 msgr2=0x7f9044156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 --2- 172.21.15.33:0/2602499726 >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 0x7f9044156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 -- 172.21.15.33:0/2602499726 >> v1:172.21.15.59:6789/0 conn(0x7f90440cd9e0 legacy=0x7f9044159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 -- 172.21.15.33:0/2602499726 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90440ccf00 con 0x7f90440cb5a0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f904965f700 1 --2- 172.21.15.33:0/2602499726 >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 0x7f9044156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f9048e5e700 1 --2- 172.21.15.33:0/2602499726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f90440cb970 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f903c0099b0 tx=0x7f903c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee6af61826dd31a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f90437fe700 1 -- 172.21.15.33:0/2602499726 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00b820 con 0x7f90440cb5a0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f90437fe700 1 -- 172.21.15.33:0/2602499726 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c00b980 con 0x7f90440cb5a0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.217+0000 7f90437fe700 1 -- 172.21.15.33:0/2602499726 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c00bd20 con 0x7f90440cb5a0 2023-10-09T15:39:43.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 -- 172.21.15.33:0/2602499726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 msgr2=0x7f90440cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 --2- 172.21.15.33:0/2602499726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f90440cb970 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f903c0099b0 tx=0x7f903c009250 comp rx=0 tx=0).stop 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 -- 172.21.15.33:0/2602499726 shutdown_connections 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 --2- 172.21.15.33:0/2602499726 >> v2:172.21.15.59:3300/0 conn(0x7f904415a5d0 0x7f9044156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 --2- 172.21.15.33:0/2602499726 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f90440cb970 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 -- 172.21.15.33:0/2602499726 >> 172.21.15.33:0/2602499726 conn(0x7f9044070e30 msgr2=0x7f90440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 -- 172.21.15.33:0/2602499726 shutdown_connections 2023-10-09T15:39:43.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.218+0000 7f904b0c2700 1 -- 172.21.15.33:0/2602499726 wait complete. 2023-10-09T15:39:43.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.219+0000 7f904b0c2700 1 Processor -- start 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.219+0000 7f904b0c2700 1 -- start start 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 0x7f904415fc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 0x7f90440c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90440afa90 con 0x7f90440cb5a0 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904415e580 con 0x7f90440cd9e0 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904b0c2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904415e860 con 0x7f904415a5d0 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58064/0 (socket says 172.21.15.33:58064) 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 -- 172.21.15.33:0/3671981714 learned_addr learned my addr 172.21.15.33:0/3671981714 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:43.224 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904965f700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 0x7f90440c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9043fff700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 0x7f904415fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 -- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 msgr2=0x7f90440c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 0x7f90440c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 -- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 msgr2=0x7f904415fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 0x7f904415fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9048e5e700 1 -- 172.21.15.33:0/3671981714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f903c0094f0 con 0x7f90440cb5a0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f904965f700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 0x7f90440c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.220+0000 7f9043fff700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 0x7f904415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f9048e5e700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f903c009290 tx=0x7f903c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c026480 con 0x7f90440cb5a0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c01f070 con 0x7f90440cb5a0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c026870 con 0x7f90440cb5a0 2023-10-09T15:39:43.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904415eb40 con 0x7f90440cb5a0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.221+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904415f100 con 0x7f90440cb5a0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.222+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904404c3c0 con 0x7f90440cb5a0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.222+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f903c026be0 con 0x7f90440cb5a0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.223+0000 7f9040ff9700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 0x7f90240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.223+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f903c021070 con 0x7f90440cb5a0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.223+0000 7f9043fff700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 0x7f90240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.223+0000 7f9043fff700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 0x7f90240697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.227+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f903c053860 con 0x7f90440cb5a0 2023-10-09T15:39:43.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.423+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f90440cd1e0 con 0x7f90440cb5a0 2023-10-09T15:39:43.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.423+0000 7f9040ff9700 1 -- 172.21.15.33:0/3671981714 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16957 (secure 0 0 0) 0x7f903c02b020 con 0x7f90440cb5a0 2023-10-09T15:39:43.425 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:43.426 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":173,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:38.290926+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":28,"pool_name":"cephfs.volume_0000000000790701.meta","create_time":"2023-10-09T15:39:20.523505+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000790701"}}},{"pool":29,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:21.089947+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}},{"pool":30,"pool_name":"another-data-pool","create_time":"2023-10-09T15:39:33.122617+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"172","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64},"application_metadata":{"cephfs":{"data":"volume_0000000000790701"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 msgr2=0x7f90240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 0x7f90240697d0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f9034007fd0 tx=0x7f9034009040 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 msgr2=0x7f904415f730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f903c009290 tx=0x7f903c017000 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 shutdown_connections 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9024067320 0x7f90240697d0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f90440cb5a0 0x7f904415f730 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f904415a5d0 0x7f90440c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 --2- 172.21.15.33:0/3671981714 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f90440cd9e0 0x7f904415fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 >> 172.21.15.33:0/3671981714 conn(0x7f9044070e30 msgr2=0x7f9044155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 shutdown_connections 2023-10-09T15:39:43.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.425+0000 7f904b0c2700 1 -- 172.21.15.33:0/3671981714 wait complete. 2023-10-09T15:39:43.439 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000790701 2023-10-09T15:39:43.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.557+0000 7f7582727700 1 Processor -- start 2023-10-09T15:39:43.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.557+0000 7f7582727700 1 -- start start 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f7582727700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f757c0a8be0 0x7f757c0a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f7582727700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f757c06d280 0x7f757c0b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f7582727700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f757c0ce1a0 con 0x7f757c0ae780 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f7582727700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0cd5d0 con 0x7f757c06d280 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f7582727700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f757c0cd870 con 0x7f757c0a8be0 2023-10-09T15:39:43.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f757b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f757c06d280 0x7f757c0b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f757b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f757c06d280 0x7f757c0b08c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58066/0 (socket says 172.21.15.33:58066) 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.558+0000 7f757b7fe700 1 -- 172.21.15.33:0/1099432664 learned_addr learned my addr 172.21.15.33:0/1099432664 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757b7fe700 1 -- 172.21.15.33:0/1099432664 >> v2:172.21.15.59:3300/0 conn(0x7f757c0a8be0 msgr2=0x7f757c0a8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757b7fe700 1 --2- 172.21.15.33:0/1099432664 >> v2:172.21.15.59:3300/0 conn(0x7f757c0a8be0 0x7f757c0a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757b7fe700 1 -- 172.21.15.33:0/1099432664 >> v1:172.21.15.59:6789/0 conn(0x7f757c0ae780 legacy=0x7f757c0aeba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757b7fe700 1 -- 172.21.15.33:0/1099432664 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f757c0cdb50 con 0x7f757c06d280 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757b7fe700 1 --2- 172.21.15.33:0/1099432664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c06d280 0x7f757c0b08c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f757c06a9e0 tx=0x7f756c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5668a2990574aa75 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757affd700 1 -- 172.21.15.33:0/1099432664 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c005c10 con 0x7f757c06d280 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757affd700 1 -- 172.21.15.33:0/1099432664 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756c005d70 con 0x7f757c06d280 2023-10-09T15:39:43.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.559+0000 7f757affd700 1 -- 172.21.15.33:0/1099432664 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f756c00b8d0 con 0x7f757c06d280 2023-10-09T15:39:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 -- 172.21.15.33:0/1099432664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c06d280 msgr2=0x7f757c0b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 --2- 172.21.15.33:0/1099432664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c06d280 0x7f757c0b08c0 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f757c06a9e0 tx=0x7f756c009220 comp rx=0 tx=0).stop 2023-10-09T15:39:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 -- 172.21.15.33:0/1099432664 shutdown_connections 2023-10-09T15:39:43.562 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 --2- 172.21.15.33:0/1099432664 >> v2:172.21.15.59:3300/0 conn(0x7f757c0a8be0 0x7f757c0a8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 --2- 172.21.15.33:0/1099432664 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c06d280 0x7f757c0b08c0 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 -- 172.21.15.33:0/1099432664 >> 172.21.15.33:0/1099432664 conn(0x7f757c06ce80 msgr2=0x7f757c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 -- 172.21.15.33:0/1099432664 shutdown_connections 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.560+0000 7f7582727700 1 -- 172.21.15.33:0/1099432664 wait complete. 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.561+0000 7f7582727700 1 Processor -- start 2023-10-09T15:39:43.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.561+0000 7f7582727700 1 -- start start 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 0x7f757c16ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757c0a8be0 0x7f757c0b3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c099610 con 0x7f757c0ae780 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f757c0998f0 con 0x7f757c06d280 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f757c099bd0 con 0x7f757c0a8be0 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58072/0 (socket says 172.21.15.33:58072) 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 -- 172.21.15.33:0/3822159647 learned_addr learned my addr 172.21.15.33:0/3822159647 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f757b7fe700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757c0a8be0 0x7f757c0b3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f757bfff700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 0x7f757c16ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 -- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757c0a8be0 msgr2=0x7f757c0b3270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757c0a8be0 0x7f757c0b3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 -- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 msgr2=0x7f757c16ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 0x7f757c16ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 -- 172.21.15.33:0/3822159647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f756c009480 con 0x7f757c0ae780 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f757bfff700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 0x7f757c16ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7580cc4700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f757400bbb0 tx=0x7f7574009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75740092e0 con 0x7f757c0ae780 2023-10-09T15:39:43.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f757400c7a0 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.562+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f757c099eb0 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.563+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f757400cb40 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.563+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f757c16b190 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.564+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f757c088a70 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.564+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7574012070 con 0x7f757c0ae780 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.564+0000 7f7573fff700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 0x7f755c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.565+0000 7f757bfff700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 0x7f755c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.565+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 6180+0+0 (secure 0 0 0) 0x7f7574084bc0 con 0x7f757c0ae780 2023-10-09T15:39:43.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.565+0000 7f757bfff700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 0x7f755c0697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7564007a40 tx=0x7f7564008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.569+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7574051670 con 0x7f757c0ae780 2023-10-09T15:39:43.808 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.807+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000790701"} v 0) v1 -- 0x7f757c04c3c0 con 0x7f757c0ae780 2023-10-09T15:39:43.808 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:39:43.807+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:39:43.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.812+0000 7f7573fff700 1 -- 172.21.15.33:0/3822159647 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000790701"}]=0 volume_0000000000790701 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v116) v1 ==== 195+0+0 (secure 0 0 0) 0x7f7574054c90 con 0x7f757c0ae780 2023-10-09T15:39:43.814 INFO:tasks.ceph.mds.a.smithi033.stderr: -851> 2023-10-09T15:39:28.041+0000 7f9144417700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 msgr2=0x7f755c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 0x7f755c0697d0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f7564007a40 tx=0x7f7564008040 comp rx=0 tx=0).stop 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 msgr2=0x7f757c09ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f757400bbb0 tx=0x7f7574009840 comp rx=0 tx=0).stop 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 shutdown_connections 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f755c067320 0x7f755c0697d0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f757c0ae780 0x7f757c09ba60 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f757c06d280 0x7f757c16ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 --2- 172.21.15.33:0/3822159647 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f757c0a8be0 0x7f757c0b3270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 >> 172.21.15.33:0/3822159647 conn(0x7f757c06ce80 msgr2=0x7f757c067f50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 shutdown_connections 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.814+0000 7f7582727700 1 -- 172.21.15.33:0/3822159647 wait complete. 2023-10-09T15:39:43.816 INFO:teuthology.orchestra.run.smithi033.stderr:volume_0000000000790701 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:39:43.828 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000790701 --yes-i-really-mean-it 2023-10-09T15:39:43.835 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:39:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.948+0000 7eff2d15a700 1 Processor -- start 2023-10-09T15:39:43.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.948+0000 7eff2d15a700 1 -- start start 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2d15a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff28153dd0 0x7eff2815de50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2d15a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2815ac50 con 0x7eff280cea00 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2d15a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff2815d010 con 0x7eff28153a00 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2d15a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff2815af60 con 0x7eff28153dd0 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff277fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7eff28153dd0 0x7eff2815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2c959700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7eff280cea00 0x7eff280ceea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58618/0 (socket says 172.21.15.33:58618) 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.949+0000 7eff2c959700 1 -- 172.21.15.33:0/2819706582 learned_addr learned my addr 172.21.15.33:0/2819706582 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff277fe700 1 -- 172.21.15.33:0/2819706582 >> v1:172.21.15.59:6789/0 conn(0x7eff28153a00 legacy=0x7eff2815a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff277fe700 1 -- 172.21.15.33:0/2819706582 >> v1:172.21.15.33:6789/0 conn(0x7eff280cea00 legacy=0x7eff280ceea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff277fe700 1 -- 172.21.15.33:0/2819706582 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff2815b240 con 0x7eff28153dd0 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff26ffd700 1 -- 172.21.15.33:0/2819706582 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3386967968 0 0) 0x7eff2815ac50 con 0x7eff280cea00 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff277fe700 1 --2- 172.21.15.33:0/2819706582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153dd0 0x7eff2815de50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0098e0 tx=0x7eff1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ce854f1fea22c52 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff26ffd700 1 -- 172.21.15.33:0/2819706582 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c009e80 con 0x7eff28153dd0 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff26ffd700 1 -- 172.21.15.33:0/2819706582 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c00b820 con 0x7eff28153dd0 2023-10-09T15:39:43.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff26ffd700 1 -- 172.21.15.33:0/2819706582 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00bba0 con 0x7eff28153dd0 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff2d15a700 1 -- 172.21.15.33:0/2819706582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153dd0 msgr2=0x7eff2815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.950+0000 7eff2d15a700 1 --2- 172.21.15.33:0/2819706582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153dd0 0x7eff2815de50 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0098e0 tx=0x7eff1c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.951+0000 7eff2d15a700 1 -- 172.21.15.33:0/2819706582 shutdown_connections 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.951+0000 7eff2d15a700 1 --2- 172.21.15.33:0/2819706582 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153dd0 0x7eff2815de50 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.951+0000 7eff2d15a700 1 -- 172.21.15.33:0/2819706582 >> 172.21.15.33:0/2819706582 conn(0x7eff280703a0 msgr2=0x7eff280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.951+0000 7eff2d15a700 1 -- 172.21.15.33:0/2819706582 shutdown_connections 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.951+0000 7eff2d15a700 1 -- 172.21.15.33:0/2819706582 wait complete. 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.952+0000 7eff2d15a700 1 Processor -- start 2023-10-09T15:39:43.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.952+0000 7eff2d15a700 1 -- start start 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff280cea00 0x7eff280ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff28153dd0 0x7eff28156a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281498d0 con 0x7eff28153a00 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff281515d0 con 0x7eff28153dd0 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff28154270 con 0x7eff280cea00 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58122/0 (socket says 172.21.15.33:58122) 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 -- 172.21.15.33:0/687843347 learned_addr learned my addr 172.21.15.33:0/687843347 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 -- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff280cea00 msgr2=0x7eff280ca000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff27fff700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff280cea00 0x7eff280ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.956 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff280cea00 0x7eff280ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 -- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff28153dd0 msgr2=0x7eff28156a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff28153dd0 0x7eff28156a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 -- 172.21.15.33:0/687843347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff1c009420 con 0x7eff28153a00 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff277fe700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0030c0 tx=0x7eff1c016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c01b470 con 0x7eff28153a00 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff1c01b5d0 con 0x7eff28153a00 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff280cb520 con 0x7eff28153a00 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff1c01b990 con 0x7eff28153a00 2023-10-09T15:39:43.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.953+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff28151ac0 con 0x7eff28153a00 2023-10-09T15:39:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.954+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff280cb6b0 con 0x7eff28153a00 2023-10-09T15:39:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.955+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7eff1c01c450 con 0x7eff28153a00 2023-10-09T15:39:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.955+0000 7eff0ffff700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 0x7eff140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.955+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6266+0+0 (secure 0 0 0) 0x7eff1c086de0 con 0x7eff28153a00 2023-10-09T15:39:43.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.955+0000 7eff27fff700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 0x7eff140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:43.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.956+0000 7eff27fff700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 0x7eff140697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7eff180027e0 tx=0x7eff18009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:43.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:43.959+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7eff1c053840 con 0x7eff28153a00 2023-10-09T15:39:44.201 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.201+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000790701", "yes_i_really_mean_it": true} v 0) v1 -- 0x7eff2804c3c0 con 0x7eff28153a00 2023-10-09T15:39:44.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.814+0000 7eff0ffff700 1 -- 172.21.15.33:0/687843347 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000790701", "yes_i_really_mean_it": true}]=0 v117) v1 ==== 121+0+0 (secure 0 0 0) 0x7eff1c02a0c0 con 0x7eff28153a00 2023-10-09T15:39:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 msgr2=0x7eff140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 0x7eff140697d0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7eff180027e0 tx=0x7eff18009040 comp rx=0 tx=0).stop 2023-10-09T15:39:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 msgr2=0x7eff28151090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:44.819 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7eff1c0030c0 tx=0x7eff1c016000 comp rx=0 tx=0).stop 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 shutdown_connections 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7eff14067320 0x7eff140697d0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7eff28153dd0 0x7eff28156a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7eff280cea00 0x7eff280ca000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 --2- 172.21.15.33:0/687843347 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7eff28153a00 0x7eff28151090 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 >> 172.21.15.33:0/687843347 conn(0x7eff280703a0 msgr2=0x7eff28153040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 shutdown_connections 2023-10-09T15:39:44.820 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:44.818+0000 7eff2d15a700 1 -- 172.21.15.33:0/687843347 wait complete. 2023-10-09T15:39:44.834 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000790701.meta cephfs.volume_0000000000790701.meta --yes-i-really-really-mean-it 2023-10-09T15:39:45.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.004+0000 7f8ea6da5700 1 Processor -- start 2023-10-09T15:39:45.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.004+0000 7f8ea6da5700 1 -- start start 2023-10-09T15:39:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea6da5700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8ea0159530 0x7f8ea00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea6da5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8ea0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea6da5700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ea00ccfd0 con 0x7f8ea0159e40 2023-10-09T15:39:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea6da5700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ea015a410 con 0x7f8ea0159530 2023-10-09T15:39:45.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea6da5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea015a6f0 con 0x7f8ea006dcf0 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea5342700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8ea0159e40 0x7f8ea00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58632/0 (socket says 172.21.15.33:58632) 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea5342700 1 -- 172.21.15.33:0/2470180979 learned_addr learned my addr 172.21.15.33:0/2470180979 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507617837 0 0) 0x7f8ea00ccfd0 con 0x7f8ea0159e40 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e88003570 con 0x7f8ea0159e40 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> v2:172.21.15.59:3300/0 conn(0x7f8ea0159530 0x7f8ea00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.005+0000 7f8e9ffff700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8ea0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1733076724 0 0) 0x7f8e88003570 con 0x7f8ea0159e40 2023-10-09T15:39:45.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 msgr2=0x7f8ea0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8ea0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 >> v2:172.21.15.59:3300/0 conn(0x7f8ea0159530 msgr2=0x7f8ea00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 --2- 172.21.15.33:0/2470180979 >> v2:172.21.15.59:3300/0 conn(0x7f8ea0159530 0x7f8ea00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea015a9d0 con 0x7f8ea0159e40 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8e980017f0 con 0x7f8ea0159e40 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 >> v1:172.21.15.33:6789/0 conn(0x7f8ea0159e40 legacy=0x7f8ea00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e88003a60 0x7f8e88003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e88004810 0x7f8e88004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8e880051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea015a410 con 0x7f8e88003a60 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea015a6f0 con 0x7f8e88004810 2023-10-09T15:39:45.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8800bae0 con 0x7f8ea006dcf0 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> v2:172.21.15.59:3300/0 conn(0x7f8ea0159530 0x7f8ea00ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e88003a60 0x7f8e88003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea5342700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8e880051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9ffff700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e88004810 0x7f8e88004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 -- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 msgr2=0x7f8e880051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8ea006dcf0 0x7f8e880051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 -- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e88004810 msgr2=0x7f8e88004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e88004810 0x7f8e88004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 -- 172.21.15.33:0/2470180979 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e88003570 con 0x7f8e88003a60 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e88003a60 0x7f8e88003e70 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009ba0 tx=0x7f8e90008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51ead68859ab3795 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000c070 con 0x7f8e88003a60 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000e5e0 con 0x7f8e88003a60 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.006+0000 7f8e9f7fe700 1 -- 172.21.15.33:0/2470180979 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000e790 con 0x7f8e88003a60 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 -- 172.21.15.33:0/2470180979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e88003a60 msgr2=0x7f8e88003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/2470180979 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e88003a60 0x7f8e88003e70 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009ba0 tx=0x7f8e90008040 comp rx=0 tx=0).stop 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea5342700 1 -- 172.21.15.33:0/2470180979 reap_dead start 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 -- 172.21.15.33:0/2470180979 shutdown_connections 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 -- 172.21.15.33:0/2470180979 >> 172.21.15.33:0/2470180979 conn(0x7f8ea00703a0 msgr2=0x7f8ea00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 -- 172.21.15.33:0/2470180979 shutdown_connections 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.007+0000 7f8ea6da5700 1 -- 172.21.15.33:0/2470180979 wait complete. 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.008+0000 7f8ea6da5700 1 Processor -- start 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.008+0000 7f8ea6da5700 1 -- start start 2023-10-09T15:39:45.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88003a60 0x7f8ea00c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 0x7f8ea01527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea00b23b0 con 0x7f8ea00b1a00 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea0158a40 con 0x7f8ea0157f10 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea6da5700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ea016d220 con 0x7f8e88003a60 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58142/0 (socket says 172.21.15.33:58142) 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 -- 172.21.15.33:0/441692427 learned_addr learned my addr 172.21.15.33:0/441692427 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8e9ffff700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 0x7f8ea01527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88003a60 0x7f8ea00c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 -- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88003a60 msgr2=0x7f8ea00c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88003a60 0x7f8ea00c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 -- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 msgr2=0x7f8ea01527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 0x7f8ea01527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8ea5342700 1 -- 172.21.15.33:0/441692427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0158480 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.009+0000 7f8e9ffff700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 0x7f8ea01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8ea5342700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8ea015a210 tx=0x7f8e98002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9800ad80 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e980133f0 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ea0158760 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e980137b0 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.010+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ea00c8f60 con 0x7f8ea00b1a00 2023-10-09T15:39:45.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.011+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ea016d390 con 0x7f8ea00b1a00 2023-10-09T15:39:45.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.011+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8e98013be0 con 0x7f8ea00b1a00 2023-10-09T15:39:45.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.011+0000 7f8e9cff9700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 0x7f8e8c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.012+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 6266+0+0 (secure 0 0 0) 0x7f8e98085830 con 0x7f8ea00b1a00 2023-10-09T15:39:45.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.012+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 0x7f8e8c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.012+0000 7f8ea4b41700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 0x7f8e8c0697d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009310 tx=0x7f8e9001a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.016+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e98052390 con 0x7f8ea00b1a00 2023-10-09T15:39:45.211 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.210+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000790701.meta", "pool2": "cephfs.volume_0000000000790701.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8ea004c3c0 con 0x7f8ea00b1a00 2023-10-09T15:39:45.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.821+0000 7f8e9cff9700 1 -- 172.21.15.33:0/441692427 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000790701.meta", "pool2": "cephfs.volume_0000000000790701.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000790701.meta' removed v175) v1 ==== 241+0+0 (secure 0 0 0) 0x7f8e98017020 con 0x7f8ea00b1a00 2023-10-09T15:39:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 msgr2=0x7f8e8c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 0x7f8e8c0697d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f8e90009310 tx=0x7f8e9001a000 comp rx=0 tx=0).stop 2023-10-09T15:39:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 msgr2=0x7f8ea00b1e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8ea015a210 tx=0x7f8e98002210 comp rx=0 tx=0).stop 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 shutdown_connections 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8e8c067320 0x7f8e8c0697d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8ea00b1a00 0x7f8ea00b1e70 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e88003a60 0x7f8ea00c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 --2- 172.21.15.33:0/441692427 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8ea0157f10 0x7f8ea01527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 >> 172.21.15.33:0/441692427 conn(0x7f8ea00703a0 msgr2=0x7f8ea00cf9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 shutdown_connections 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.825+0000 7f8ea6da5700 1 -- 172.21.15.33:0/441692427 wait complete. 2023-10-09T15:39:45.827 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000790701.meta' removed 2023-10-09T15:39:45.841 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:39:45.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.972+0000 7f8e12154700 1 Processor -- start 2023-10-09T15:39:45.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.972+0000 7f8e12154700 1 -- start start 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e12154700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e12154700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0b04f0 0x7f8e0c0cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e12154700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e0c0cf330 con 0x7f8e0c0cd5a0 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e12154700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e0c0cead0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e12154700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c0cddd0 con 0x7f8e0c0b04f0 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e0b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e0b7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58146/0 (socket says 172.21.15.33:58146) 2023-10-09T15:39:45.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.973+0000 7f8e0b7fe700 1 -- 172.21.15.33:0/668100215 learned_addr learned my addr 172.21.15.33:0/668100215 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0b7fe700 1 -- 172.21.15.33:0/668100215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0b04f0 msgr2=0x7f8e0c0cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/668100215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0b04f0 0x7f8e0c0cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0b7fe700 1 -- 172.21.15.33:0/668100215 >> v1:172.21.15.59:6789/0 conn(0x7f8e0c0cd5a0 legacy=0x7f8e0c1591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0b7fe700 1 -- 172.21.15.33:0/668100215 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e0c0cece0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/668100215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cad71a5034a7ebad server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0a7fc700 1 -- 172.21.15.33:0/668100215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00b820 con 0x7f8e0c0cb880 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0a7fc700 1 -- 172.21.15.33:0/668100215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dfc00b980 con 0x7f8e0c0cb880 2023-10-09T15:39:45.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e0a7fc700 1 -- 172.21.15.33:0/668100215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dfc00bd20 con 0x7f8e0c0cb880 2023-10-09T15:39:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 -- 172.21.15.33:0/668100215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 msgr2=0x7f8e0c0cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 --2- 172.21.15.33:0/668100215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc009250 comp rx=0 tx=0).stop 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 -- 172.21.15.33:0/668100215 shutdown_connections 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 --2- 172.21.15.33:0/668100215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c0cbc50 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 --2- 172.21.15.33:0/668100215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0b04f0 0x7f8e0c0cd060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 -- 172.21.15.33:0/668100215 >> 172.21.15.33:0/668100215 conn(0x7f8e0c0703a0 msgr2=0x7f8e0c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 -- 172.21.15.33:0/668100215 shutdown_connections 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.974+0000 7f8e12154700 1 -- 172.21.15.33:0/668100215 wait complete. 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 Processor -- start 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 -- start start 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 0x7f8e0c157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0cd5a0 0x7f8e0c15afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c159300 con 0x7f8e0c0cb880 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c169e30 con 0x7f8e0c0b04f0 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.976+0000 7f8e12154700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e0c1578b0 con 0x7f8e0c0cd5a0 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58162/0 (socket says 172.21.15.33:58162) 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 -- 172.21.15.33:0/3009236581 learned_addr learned my addr 172.21.15.33:0/3009236581 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0bfff700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0cd5a0 0x7f8e0c15afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 0x7f8e0c157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 -- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0cd5a0 msgr2=0x7f8e0c15afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0cd5a0 0x7f8e0c15afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 -- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 msgr2=0x7f8e0c157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:45.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 0x7f8e0c157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 -- 172.21.15.33:0/3009236581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dfc0094f0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 0x7f8e0c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e0affd700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000b810 tx=0x7f8e000091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000f510 con 0x7f8e0c0cb880 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e0000f690 con 0x7f8e0c0cb880 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e0c159be0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e0000fa50 con 0x7f8e0c0cb880 2023-10-09T15:39:45.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.977+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e0c15a1a0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.978+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e0c169fa0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.979+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8e0001a400 con 0x7f8e0c0cb880 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.979+0000 7f8df37fe700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 0x7f8df80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.979+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5791+0+0 (secure 0 0 0) 0x7f8e000846b0 con 0x7f8e0c0cb880 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.979+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 0x7f8df80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:45.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.980+0000 7f8e0b7fe700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 0x7f8df80697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:45.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:45.984+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8e00051470 con 0x7f8e0c0cb880 2023-10-09T15:39:46.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.178+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f8e0c04c3c0 con 0x7f8e0c0cb880 2023-10-09T15:39:46.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.821+0000 7f8df37fe700 1 -- 172.21.15.33:0/3009236581 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v176) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8e00054a90 con 0x7f8e0c0cb880 2023-10-09T15:39:46.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 msgr2=0x7f8df80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 0x7f8df80697d0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f8dfc0099b0 tx=0x7f8dfc016000 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 msgr2=0x7f8e0c16b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7f8e0000b810 tx=0x7f8e000091d0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 shutdown_connections 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8df8067320 0x7f8df80697d0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8e0c0cd5a0 0x7f8e0c15afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8e0c0b04f0 0x7f8e0c157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 --2- 172.21.15.33:0/3009236581 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8e0c0cb880 0x7f8e0c16b000 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 >> 172.21.15.33:0/3009236581 conn(0x7f8e0c0703a0 msgr2=0x7f8e0c06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 shutdown_connections 2023-10-09T15:39:46.826 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.824+0000 7f8e12154700 1 -- 172.21.15.33:0/3009236581 wait complete. 2023-10-09T15:39:46.827 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:39:46.840 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm another-data-pool another-data-pool --yes-i-really-really-mean-it 2023-10-09T15:39:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.966+0000 7f596d363700 1 Processor -- start 2023-10-09T15:39:46.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.966+0000 7f596d363700 1 -- start start 2023-10-09T15:39:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f596d363700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f596815cec0 0x7f596806d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f596d363700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59680c1790 0x7f59680c1b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f596d363700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f596806c6a0 con 0x7f596815caf0 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f596d363700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59680c20c0 con 0x7f596815cec0 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f596d363700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f596806c8f0 con 0x7f59680c1790 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f59667fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f596815cec0 0x7f596806d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f59667fc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f596815cec0 0x7f596806d990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:54904/0 (socket says 172.21.15.33:54904) 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f5966ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f596815caf0 0x7f596806ad10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:44548/0 (socket says 172.21.15.33:44548) 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.967+0000 7f59667fc700 1 -- 172.21.15.33:0/379893517 learned_addr learned my addr 172.21.15.33:0/379893517 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:46.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59677fe700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59680c1790 0x7f59680c1b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59667fc700 1 -- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59680c1790 msgr2=0x7f59680c1b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59667fc700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59680c1790 0x7f59680c1b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59667fc700 1 -- 172.21.15.33:0/379893517 >> v1:172.21.15.59:6789/0 conn(0x7f596815caf0 legacy=0x7f596806ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59667fc700 1 -- 172.21.15.33:0/379893517 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f596806cbd0 con 0x7f596815cec0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f5965ffb700 1 -- 172.21.15.33:0/379893517 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3912836974 0 0) 0x7f596806c6a0 con 0x7f596815caf0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f59667fc700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f596815cec0 0x7f596806d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f59500099b0 tx=0x7f5950009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=887f0bf277d8e327 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f5965ffb700 1 -- 172.21.15.33:0/379893517 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5950009ea0 con 0x7f596815cec0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f5965ffb700 1 -- 172.21.15.33:0/379893517 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f595000b860 con 0x7f596815cec0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.968+0000 7f5965ffb700 1 -- 172.21.15.33:0/379893517 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f595000bc00 con 0x7f596815cec0 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 -- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f596815cec0 msgr2=0x7f596806d990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f596815cec0 0x7f596806d990 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f59500099b0 tx=0x7f5950009250 comp rx=0 tx=0).stop 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 -- 172.21.15.33:0/379893517 shutdown_connections 2023-10-09T15:39:46.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f59680c1790 0x7f59680c1b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 --2- 172.21.15.33:0/379893517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f596815cec0 0x7f596806d990 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 -- 172.21.15.33:0/379893517 >> 172.21.15.33:0/379893517 conn(0x7f596806ecd0 msgr2=0x7f596806f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 -- 172.21.15.33:0/379893517 shutdown_connections 2023-10-09T15:39:46.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.969+0000 7f596d363700 1 -- 172.21.15.33:0/379893517 wait complete. 2023-10-09T15:39:46.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.970+0000 7f596d363700 1 Processor -- start 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.970+0000 7f596d363700 1 -- start start 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59680c1790 0x7f596815d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 0x7f59681423e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680afc60 con 0x7f596815cec0 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59680aff40 con 0x7f59680c1790 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f596d363700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59680b0220 con 0x7f596815caf0 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58172/0 (socket says 172.21.15.33:58172) 2023-10-09T15:39:46.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 -- 172.21.15.33:0/1576499590 learned_addr learned my addr 172.21.15.33:0/1576499590 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59667fc700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 0x7f59681423e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f5966ffd700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59680c1790 0x7f596815d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 -- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 msgr2=0x7f59681423e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 0x7f59681423e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 -- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59680c1790 msgr2=0x7f596815d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59680c1790 0x7f596815d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 -- 172.21.15.33:0/1576499590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59500094f0 con 0x7f596815cec0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59667fc700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 0x7f59681423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.971+0000 7f59677fe700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f596000e8d0 tx=0x7f59600091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.972+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960013680 con 0x7f596815cec0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.972+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59600137e0 con 0x7f596815cec0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.972+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59680b0500 con 0x7f596815cec0 2023-10-09T15:39:46.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.972+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5960013ba0 con 0x7f596815cec0 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.972+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f596814f740 con 0x7f596815cec0 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.973+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f596804c3c0 con 0x7f596815cec0 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.973+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f59600123d0 con 0x7f596815cec0 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.973+0000 7f595effd700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 0x7f59480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.974+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5360+0+0 (secure 0 0 0) 0x7f5960084bf0 con 0x7f596815cec0 2023-10-09T15:39:46.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.974+0000 7f5966ffd700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 0x7f59480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:46.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.974+0000 7f5966ffd700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 0x7f59480697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5958001560 tx=0x7f5958001b00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:46.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:46.978+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f59600519e0 con 0x7f596815cec0 2023-10-09T15:39:47.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.178+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f596815c300 con 0x7f596815cec0 2023-10-09T15:39:47.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.827+0000 7f595effd700 1 -- 172.21.15.33:0/1576499590 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "another-data-pool", "pool2": "another-data-pool", "yes_i_really_really_mean_it": true}]=0 pool 'another-data-pool' removed v177) v1 ==== 187+0+0 (secure 0 0 0) 0x7f59600170e0 con 0x7f596815cec0 2023-10-09T15:39:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 msgr2=0x7f59480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 0x7f59480697d0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f5958001560 tx=0x7f5958001b00 comp rx=0 tx=0).stop 2023-10-09T15:39:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 msgr2=0x7f5968152190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7f596000e8d0 tx=0x7f59600091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 shutdown_connections 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5948067320 0x7f59480697d0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f596815cec0 0x7f5968152190 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f59680c1790 0x7f596815d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 --2- 172.21.15.33:0/1576499590 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f596815caf0 0x7f59681423e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 >> 172.21.15.33:0/1576499590 conn(0x7f596806ecd0 msgr2=0x7f59680cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 shutdown_connections 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.830+0000 7f596d363700 1 -- 172.21.15.33:0/1576499590 wait complete. 2023-10-09T15:39:47.832 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'another-data-pool' removed 2023-10-09T15:39:47.845 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:39:47.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.969+0000 7fdd46549700 1 Processor -- start 2023-10-09T15:39:47.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.969+0000 7fdd46549700 1 -- start start 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd46549700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdd40159530 0x7fdd400ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd46549700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd4006e0e0 0x7fdd400cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd46549700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd400ccfd0 con 0x7fdd4006dc70 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd46549700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd400cf0e0 con 0x7fdd4006e0e0 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd46549700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd4015a3d0 con 0x7fdd40159530 2023-10-09T15:39:47.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd44ae6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fdd4006e0e0 0x7fdd400cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd3f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdd4006dc70 0x7fdd40159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58642/0 (socket says 172.21.15.33:58642) 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.970+0000 7fdd3f7fe700 1 -- 172.21.15.33:0/1607415252 learned_addr learned my addr 172.21.15.33:0/1607415252 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3effd700 1 -- 172.21.15.33:0/1607415252 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4273942399 0 0) 0x7fdd400ccfd0 con 0x7fdd4006dc70 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3ffff700 1 --2- 172.21.15.33:0/1607415252 >> v2:172.21.15.59:3300/0 conn(0x7fdd40159530 0x7fdd400ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3effd700 1 -- 172.21.15.33:0/1607415252 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd28003570 con 0x7fdd4006dc70 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd44ae6700 1 -- 172.21.15.33:0/1607415252 >> v2:172.21.15.59:3300/0 conn(0x7fdd40159530 msgr2=0x7fdd400ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd44ae6700 1 --2- 172.21.15.33:0/1607415252 >> v2:172.21.15.59:3300/0 conn(0x7fdd40159530 0x7fdd400ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd44ae6700 1 -- 172.21.15.33:0/1607415252 >> v1:172.21.15.33:6789/0 conn(0x7fdd4006dc70 legacy=0x7fdd40159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd44ae6700 1 -- 172.21.15.33:0/1607415252 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd4015a6b0 con 0x7fdd4006e0e0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd44ae6700 1 --2- 172.21.15.33:0/1607415252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cb6f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fdd4006d630 tx=0x7fdd38009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31c0cf548bd4e242 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3effd700 1 -- 172.21.15.33:0/1607415252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd3800e070 con 0x7fdd4006e0e0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3effd700 1 -- 172.21.15.33:0/1607415252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd3800bb60 con 0x7fdd4006e0e0 2023-10-09T15:39:47.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.971+0000 7fdd3effd700 1 -- 172.21.15.33:0/1607415252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38012430 con 0x7fdd4006e0e0 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 -- 172.21.15.33:0/1607415252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4006e0e0 msgr2=0x7fdd400cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 --2- 172.21.15.33:0/1607415252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cb6f0 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7fdd4006d630 tx=0x7fdd38009780 comp rx=0 tx=0).stop 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 -- 172.21.15.33:0/1607415252 shutdown_connections 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 --2- 172.21.15.33:0/1607415252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cb6f0 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 --2- 172.21.15.33:0/1607415252 >> v2:172.21.15.59:3300/0 conn(0x7fdd40159530 0x7fdd400ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 -- 172.21.15.33:0/1607415252 >> 172.21.15.33:0/1607415252 conn(0x7fdd400703a0 msgr2=0x7fdd400707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 -- 172.21.15.33:0/1607415252 shutdown_connections 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.972+0000 7fdd46549700 1 -- 172.21.15.33:0/1607415252 wait complete. 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.973+0000 7fdd46549700 1 Processor -- start 2023-10-09T15:39:47.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.973+0000 7fdd46549700 1 -- start start 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd4006dc70 0x7fdd400cd360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd40154510 con 0x7fdd40159530 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4016d0c0 con 0x7fdd4006e0e0 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd4016d360 con 0x7fdd4006dc70 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58192/0 (socket says 172.21.15.33:58192) 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 -- 172.21.15.33:0/3983665055 learned_addr learned my addr 172.21.15.33:0/3983665055 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd3ffff700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd4006dc70 0x7fdd400cd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd3f7fe700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 -- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd4006dc70 msgr2=0x7fdd400cd360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd4006dc70 0x7fdd400cd360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 -- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 msgr2=0x7fdd400cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 -- 172.21.15.33:0/3983665055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd38009a20 con 0x7fdd40159530 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd3f7fe700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd44ae6700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009fd0 tx=0x7fdd38019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd38027470 con 0x7fdd40159530 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd38027630 con 0x7fdd40159530 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd380279f0 con 0x7fdd40159530 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd4016d640 con 0x7fdd40159530 2023-10-09T15:39:47.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.974+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd40158b20 con 0x7fdd40159530 2023-10-09T15:39:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.975+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd4004c3c0 con 0x7fdd40159530 2023-10-09T15:39:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.976+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdd38024070 con 0x7fdd40159530 2023-10-09T15:39:47.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.976+0000 7fdd27fff700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 0x7fdd2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.976+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdd380870e0 con 0x7fdd40159530 2023-10-09T15:39:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.976+0000 7fdd3ffff700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 0x7fdd2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:47.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.977+0000 7fdd3ffff700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 0x7fdd2c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cded0 tx=0x7fdd30008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:47.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:47.981+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdd38054030 con 0x7fdd40159530 2023-10-09T15:39:48.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.175+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fdd4015a990 con 0x7fdd40159530 2023-10-09T15:39:48.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.179+0000 7fdd27fff700 1 -- 172.21.15.33:0/3983665055 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v29) v1 ==== 104+0+0 (secure 0 0 0) 0x7fdd38057650 con 0x7fdd40159530 2023-10-09T15:39:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 msgr2=0x7fdd2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 0x7fdd2c0697d0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fdd400cded0 tx=0x7fdd30008040 comp rx=0 tx=0).stop 2023-10-09T15:39:48.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 msgr2=0x7fdd40169c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7fdd38009fd0 tx=0x7fdd38019000 comp rx=0 tx=0).stop 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 shutdown_connections 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdd2c067320 0x7fdd2c0697d0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdd40159530 0x7fdd40169c60 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdd4006dc70 0x7fdd400cd360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 --2- 172.21.15.33:0/3983665055 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdd4006e0e0 0x7fdd400cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 >> 172.21.15.33:0/3983665055 conn(0x7fdd400703a0 msgr2=0x7fdd400d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 shutdown_connections 2023-10-09T15:39:48.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.181+0000 7fdd46549700 1 -- 172.21.15.33:0/3983665055 wait complete. 2023-10-09T15:39:48.194 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool' 2023-10-09T15:39:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.312+0000 7fde90310700 1 Processor -- start 2023-10-09T15:39:48.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.312+0000 7fde90310700 1 -- start start 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde90310700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fde880cb970 0x7fde88159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde90310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde88156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde90310700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde8815ae40 con 0x7fde880cb5a0 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde90310700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde880ce0f0 con 0x7fde880cb970 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde90310700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde880d13f0 con 0x7fde8815a400 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8e0ac700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fde880cb5a0 0x7fde880cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58654/0 (socket says 172.21.15.33:58654) 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8e0ac700 1 -- 172.21.15.33:0/798172473 learned_addr learned my addr 172.21.15.33:0/798172473 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:48.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2055613479 0 0) 0x7fde8815ae40 con 0x7fde880cb5a0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde74003570 con 0x7fde880cb5a0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8e8ad700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde88156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/798172473 >> v2:172.21.15.59:3300/0 conn(0x7fde880cb970 0x7fde88159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.313+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3797777105 0 0) 0x7fde74003570 con 0x7fde880cb5a0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 msgr2=0x7fde88156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde88156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 >> v2:172.21.15.59:3300/0 conn(0x7fde880cb970 msgr2=0x7fde88159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 --2- 172.21.15.33:0/798172473 >> v2:172.21.15.59:3300/0 conn(0x7fde880cb970 0x7fde88159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde8815ab60 con 0x7fde880cb5a0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fde84001470 con 0x7fde880cb5a0 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 >> v1:172.21.15.33:6789/0 conn(0x7fde880cb5a0 legacy=0x7fde880cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde74003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde74003fe0 0x7fde74004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74004d50 0x7fde740051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880ce0f0 con 0x7fde74003fe0 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde7400ba60 con 0x7fde74004d50 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde7400bbd0 con 0x7fde8815a400 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde74003fe0 0x7fde74004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8e0ac700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde74003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8e8ad700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74004d50 0x7fde740051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 -- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 msgr2=0x7fde74003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde8815a400 0x7fde74003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 -- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74004d50 msgr2=0x7fde740051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:48.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74004d50 0x7fde740051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 -- 172.21.15.33:0/798172473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde74003570 con 0x7fde74003fe0 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde74003fe0 0x7fde74004810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fde78009c00 tx=0x7fde780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a5f5518681c8c79 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.314+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800e6b0 con 0x7fde74003fe0 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde7800e810 con 0x7fde74003fe0 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde8d0aa700 1 -- 172.21.15.33:0/798172473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde7800ebd0 con 0x7fde74003fe0 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 -- 172.21.15.33:0/798172473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde74003fe0 msgr2=0x7fde74004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 --2- 172.21.15.33:0/798172473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde74003fe0 0x7fde74004810 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fde78009c00 tx=0x7fde780091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde8e8ad700 1 -- 172.21.15.33:0/798172473 reap_dead start 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 -- 172.21.15.33:0/798172473 shutdown_connections 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 -- 172.21.15.33:0/798172473 >> 172.21.15.33:0/798172473 conn(0x7fde88070e30 msgr2=0x7fde880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 -- 172.21.15.33:0/798172473 shutdown_connections 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.315+0000 7fde90310700 1 -- 172.21.15.33:0/798172473 wait complete. 2023-10-09T15:39:48.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.316+0000 7fde90310700 1 Processor -- start 2023-10-09T15:39:48.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.316+0000 7fde90310700 1 -- start start 2023-10-09T15:39:48.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74003fe0 0x7fde881511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde880c6cc0 0x7fde88155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880b3e90 con 0x7fde880c7130 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde880b4cb0 con 0x7fde74003fe0 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde90310700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde880b40a0 con 0x7fde880c6cc0 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde8e8ad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde8e8ad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58212/0 (socket says 172.21.15.33:58212) 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde8e8ad700 1 -- 172.21.15.33:0/2061386531 learned_addr learned my addr 172.21.15.33:0/2061386531 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde8d8ab700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde880c6cc0 0x7fde88155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.317+0000 7fde8e0ac700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74003fe0 0x7fde881511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 -- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde880c6cc0 msgr2=0x7fde88155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde880c6cc0 0x7fde88155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 -- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74003fe0 msgr2=0x7fde881511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74003fe0 0x7fde881511b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 -- 172.21.15.33:0/2061386531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde880b4380 con 0x7fde880c7130 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde8e8ad700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fde88064ad0 tx=0x7fde8000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000e040 con 0x7fde880c7130 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde8000f040 con 0x7fde880c7130 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde8000fdc0 con 0x7fde880c7130 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde880b4660 con 0x7fde880c7130 2023-10-09T15:39:48.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.318+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde880c99d0 con 0x7fde880c7130 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.319+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fde8804c3c0 con 0x7fde880c7130 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.319+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fde80015640 con 0x7fde880c7130 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.320+0000 7fde7e7fc700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 0x7fde6c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.320+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fde800851d0 con 0x7fde880c7130 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.320+0000 7fde8e0ac700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 0x7fde6c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.320+0000 7fde8e0ac700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 0x7fde6c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde84000e10 tx=0x7fde84009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.325 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.324+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fde80052050 con 0x7fde880c7130 2023-10-09T15:39:48.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.599+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]} v 0) v1 -- 0x7fde880cc2e0 con 0x7fde880c7130 2023-10-09T15:39:48.829 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.827+0000 7fde7e7fc700 1 -- 172.21.15.33:0/2061386531 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_for_more_than_one_data_pool"]}]=0 v447) v1 ==== 163+0+0 (secure 0 0 0) 0x7fde80055670 con 0x7fde880c7130 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 msgr2=0x7fde6c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 0x7fde6c0697d0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fde84000e10 tx=0x7fde84009040 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 msgr2=0x7fde88155e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fde88064ad0 tx=0x7fde8000b040 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 shutdown_connections 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fde6c067320 0x7fde6c0697d0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fde880c7130 0x7fde88155e50 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fde74003fe0 0x7fde881511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 --2- 172.21.15.33:0/2061386531 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fde880c6cc0 0x7fde88155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.829+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 >> 172.21.15.33:0/2061386531 conn(0x7fde88070e30 msgr2=0x7fde88154990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:48.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.830+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 shutdown_connections 2023-10-09T15:39:48.832 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.830+0000 7fde90310700 1 -- 172.21.15.33:0/2061386531 wait complete. 2023-10-09T15:39:48.843 INFO:tasks.cephfs_test_runner:That renaming a volume with more than one data pool does not change ... ok 2023-10-09T15:39:48.843 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) That volume rename is idempotent. 2023-10-09T15:39:48.843 INFO:tasks.cephfs_test_runner:test_volume_rename_idempotency (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:39:48.843 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-09T15:39:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.961+0000 7f658dc0a700 1 Processor -- start 2023-10-09T15:39:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.961+0000 7f658dc0a700 1 -- start start 2023-10-09T15:39:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f658dc0a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65880cb5a0 0x7f65880cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f658dc0a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f65880cd9e0 0x7f6588159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f658dc0a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f658815ae40 con 0x7f658815a400 2023-10-09T15:39:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f658dc0a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65880d13f0 con 0x7f65880cb5a0 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f658dc0a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f658815ab60 con 0x7f65880cd9e0 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f65877fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f65880cb5a0 0x7f65880cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f6587fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f658815a400 0x7f6588156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58660/0 (socket says 172.21.15.33:58660) 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.962+0000 7f6587fff700 1 -- 172.21.15.33:0/4277684059 learned_addr learned my addr 172.21.15.33:0/4277684059 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f6586ffd700 1 --2- 172.21.15.33:0/4277684059 >> v2:172.21.15.59:3300/0 conn(0x7f65880cd9e0 0x7f6588159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65877fe700 1 -- 172.21.15.33:0/4277684059 >> v2:172.21.15.59:3300/0 conn(0x7f65880cd9e0 msgr2=0x7f6588159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65877fe700 1 --2- 172.21.15.33:0/4277684059 >> v2:172.21.15.59:3300/0 conn(0x7f65880cd9e0 0x7f6588159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65877fe700 1 -- 172.21.15.33:0/4277684059 >> v1:172.21.15.33:6789/0 conn(0x7f658815a400 legacy=0x7f6588156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65877fe700 1 -- 172.21.15.33:0/4277684059 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65880ccf00 con 0x7f65880cb5a0 2023-10-09T15:39:48.966 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65867fc700 1 -- 172.21.15.33:0/4277684059 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3406023172 0 0) 0x7f658815ae40 con 0x7f658815a400 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65877fe700 1 --2- 172.21.15.33:0/4277684059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cb5a0 0x7f65880cb970 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f65780098e0 tx=0x7f65780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44687fec3fac0afc server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65867fc700 1 -- 172.21.15.33:0/4277684059 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6578009e80 con 0x7f65880cb5a0 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65867fc700 1 -- 172.21.15.33:0/4277684059 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657800b820 con 0x7f65880cb5a0 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.963+0000 7f65867fc700 1 -- 172.21.15.33:0/4277684059 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657800bba0 con 0x7f65880cb5a0 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 -- 172.21.15.33:0/4277684059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cb5a0 msgr2=0x7f65880cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 --2- 172.21.15.33:0/4277684059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cb5a0 0x7f65880cb970 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7f65780098e0 tx=0x7f65780091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 -- 172.21.15.33:0/4277684059 shutdown_connections 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 --2- 172.21.15.33:0/4277684059 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cb5a0 0x7f65880cb970 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 --2- 172.21.15.33:0/4277684059 >> v2:172.21.15.59:3300/0 conn(0x7f65880cd9e0 0x7f6588159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.967 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 -- 172.21.15.33:0/4277684059 >> 172.21.15.33:0/4277684059 conn(0x7f6588070e30 msgr2=0x7f65880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 -- 172.21.15.33:0/4277684059 shutdown_connections 2023-10-09T15:39:48.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.964+0000 7f658dc0a700 1 -- 172.21.15.33:0/4277684059 wait complete. 2023-10-09T15:39:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.965+0000 7f658dc0a700 1 Processor -- start 2023-10-09T15:39:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.965+0000 7f658dc0a700 1 -- start start 2023-10-09T15:39:48.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 0x7f65881533b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 0x7f65880c54b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65880c6e50 con 0x7f65880cd9e0 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65881597f0 con 0x7f658815a400 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6588152f20 con 0x7f65880cb5a0 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58240/0 (socket says 172.21.15.33:58240) 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 -- 172.21.15.33:0/3445444131 learned_addr learned my addr 172.21.15.33:0/3445444131 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f65877fe700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 0x7f65881533b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6587fff700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 0x7f65880c54b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 -- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 msgr2=0x7f65881533b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 0x7f65881533b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 -- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 msgr2=0x7f65880c54b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 0x7f65880c54b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 -- 172.21.15.33:0/3445444131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6578009420 con 0x7f65880cd9e0 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f65877fe700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 0x7f65881533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6587fff700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 0x7f65880c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f6586ffd700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d8c0 tx=0x7f657c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00de60 con 0x7f65880cd9e0 2023-10-09T15:39:48.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f657c00b780 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6588152310 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.966+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f657c00bb20 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.967+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65881528d0 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.967+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f658804c3c0 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.968+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f657c01e460 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.968+0000 7f656f7fe700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 0x7f65740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.968+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f657c085020 con 0x7f65880cd9e0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.968+0000 7f65877fe700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 0x7f65740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:48.974 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.969+0000 7f65877fe700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 0x7f65740697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f65780093f0 tx=0x7f6578017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:48.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:48.972+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f657c051fb0 con 0x7f65880cd9e0 2023-10-09T15:39:49.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.247+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7f6588153060 con 0x7f65880cd9e0 2023-10-09T15:39:49.833 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.831+0000 7f656f7fe700 1 -- 172.21.15.33:0/3445444131 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v448) v1 ==== 150+0+0 (secure 0 0 0) 0x7f657c0555d0 con 0x7f65880cd9e0 2023-10-09T15:39:49.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 msgr2=0x7f65740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 0x7f65740697d0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7f65780093f0 tx=0x7f6578017000 comp rx=0 tx=0).stop 2023-10-09T15:39:49.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 msgr2=0x7f6588157830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.835 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f657c00d8c0 tx=0x7f657c008040 comp rx=0 tx=0).stop 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 shutdown_connections 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6574067320 0x7f65740697d0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f658815a400 0x7f65880c54b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f65880cb5a0 0x7f65881533b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 --2- 172.21.15.33:0/3445444131 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f65880cd9e0 0x7f6588157830 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 >> 172.21.15.33:0/3445444131 conn(0x7f6588070e30 msgr2=0x7f6588154a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 shutdown_connections 2023-10-09T15:39:49.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.834+0000 7f658dc0a700 1 -- 172.21.15.33:0/3445444131 wait complete. 2023-10-09T15:39:49.849 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:39:49.975 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.975+0000 7f409a144700 1 Processor -- start 2023-10-09T15:39:49.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.975+0000 7f409a144700 1 -- start start 2023-10-09T15:39:49.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.975+0000 7f409a144700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40940c4580 0x7f40940cd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:49.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f409a144700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940c9310 con 0x7f4094159c90 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f409a144700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40940ce090 con 0x7f40941598c0 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f409a144700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40940ad990 con 0x7f40940c4580 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4092ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f40940c4580 0x7f40940cd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4093fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4094159c90 0x7f40940c97a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58664/0 (socket says 172.21.15.33:58664) 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4093fff700 1 -- 172.21.15.33:0/2634447453 learned_addr learned my addr 172.21.15.33:0/2634447453 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4092ffd700 1 -- 172.21.15.33:0/2634447453 >> v1:172.21.15.59:6789/0 conn(0x7f40941598c0 legacy=0x7f40940c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4092ffd700 1 -- 172.21.15.33:0/2634447453 >> v1:172.21.15.33:6789/0 conn(0x7f4094159c90 legacy=0x7f40940c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4092ffd700 1 -- 172.21.15.33:0/2634447453 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40940c8cc0 con 0x7f40940c4580 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f40927fc700 1 -- 172.21.15.33:0/2634447453 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2838498426 0 0) 0x7f40940c9310 con 0x7f4094159c90 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f4092ffd700 1 --2- 172.21.15.33:0/2634447453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40940c4580 0x7f40940cd460 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f40880098e0 tx=0x7f40880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fa744543e5266a4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f40927fc700 1 -- 172.21.15.33:0/2634447453 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4088009e80 con 0x7f40940c4580 2023-10-09T15:39:49.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f40927fc700 1 -- 172.21.15.33:0/2634447453 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408800b860 con 0x7f40940c4580 2023-10-09T15:39:49.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.976+0000 7f40927fc700 1 -- 172.21.15.33:0/2634447453 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408800bbe0 con 0x7f40940c4580 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 -- 172.21.15.33:0/2634447453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40940c4580 msgr2=0x7f40940cd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 --2- 172.21.15.33:0/2634447453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40940c4580 0x7f40940cd460 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7f40880098e0 tx=0x7f40880091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 -- 172.21.15.33:0/2634447453 shutdown_connections 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 --2- 172.21.15.33:0/2634447453 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f40940c4580 0x7f40940cd460 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 -- 172.21.15.33:0/2634447453 >> 172.21.15.33:0/2634447453 conn(0x7f4094088000 msgr2=0x7f40940883d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 -- 172.21.15.33:0/2634447453 shutdown_connections 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.977+0000 7f409a144700 1 -- 172.21.15.33:0/2634447453 wait complete. 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.978+0000 7f409a144700 1 Processor -- start 2023-10-09T15:39:49.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.978+0000 7f409a144700 1 -- start start 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40940c4580 0x7f40940b12a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40941598c0 0x7f409414a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40940b21d0 con 0x7f4094159c90 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f409414a8e0 con 0x7f40940c4580 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f409a144700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40940adc90 con 0x7f40941598c0 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58272/0 (socket says 172.21.15.33:58272) 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 -- 172.21.15.33:0/468776600 learned_addr learned my addr 172.21.15.33:0/468776600 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 -- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40941598c0 msgr2=0x7f409414a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.982 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40941598c0 0x7f409414a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 -- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40940c4580 msgr2=0x7f40940b12a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40940c4580 0x7f40940b12a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.979+0000 7f4093fff700 1 -- 172.21.15.33:0/468776600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4088009420 con 0x7f4094159c90 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f4093fff700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f408c00cbf0 tx=0x7f408c0019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c00a9c0 con 0x7f4094159c90 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f408c00ab20 con 0x7f4094159c90 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f408c0070f0 con 0x7f4094159c90 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40940b1930 con 0x7f4094159c90 2023-10-09T15:39:49.983 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.980+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40940b1ef0 con 0x7f4094159c90 2023-10-09T15:39:49.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.981+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409404c3c0 con 0x7f4094159c90 2023-10-09T15:39:49.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.981+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f408c007520 con 0x7f4094159c90 2023-10-09T15:39:49.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.981+0000 7f407b7fe700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 0x7f4080069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:49.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.982+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f408c084d80 con 0x7f4094159c90 2023-10-09T15:39:49.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.982+0000 7f40937fe700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 0x7f4080069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:49.985 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.982+0000 7f40937fe700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 0x7f4080069800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4084001730 tx=0x7f4084007b40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:49.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:49.986+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f408c051d90 con 0x7f4094159c90 2023-10-09T15:39:50.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.179+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f4094068c80 con 0x7f4094159c90 2023-10-09T15:39:50.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.185+0000 7f407b7fe700 1 -- 172.21.15.33:0/468776600 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f408c0553b0 con 0x7f4094159c90 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 msgr2=0x7f4080069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 0x7f4080069800 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4084001730 tx=0x7f4084007b40 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 msgr2=0x7f40940c3a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7f408c00cbf0 tx=0x7f408c0019b0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 shutdown_connections 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4080067350 0x7f4080069800 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4094159c90 0x7f40940c3a30 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f40940c4580 0x7f40940b12a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 --2- 172.21.15.33:0/468776600 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f40941598c0 0x7f409414a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 >> 172.21.15.33:0/468776600 conn(0x7f4094088000 msgr2=0x7f40940cc910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:50.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 shutdown_connections 2023-10-09T15:39:50.190 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.187+0000 7f409a144700 1 -- 172.21.15.33:0/468776600 wait complete. 2023-10-09T15:39:50.201 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:39:50.201 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:50.238 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:39:50.284 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:39:50.284 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:39:50.284 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.403+0000 7f6c39e2d700 1 Processor -- start 2023-10-09T15:39:50.404 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.403+0000 7f6c39e2d700 1 -- start start 2023-10-09T15:39:50.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c34153d20 0x7f6c3406b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 0x7f6c34068270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c3415d290 0x7f6c3415d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c3415e280 con 0x7f6c34153d20 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c340687b0 con 0x7f6c34067e00 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c39e2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3415dfa0 con 0x7f6c3415d290 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c38e2b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c34153d20 0x7f6c3406b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c38e2b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6c34153d20 0x7f6c3406b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58286/0 (socket says 172.21.15.33:58286) 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c38e2b700 1 -- 172.21.15.33:0/366981261 learned_addr learned my addr 172.21.15.33:0/366981261 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c33fff700 1 --2- 172.21.15.33:0/366981261 >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 0x7f6c34068270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.404+0000 7f6c3962c700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c3415d290 0x7f6c3415d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 -- 172.21.15.33:0/366981261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c3415d290 msgr2=0x7f6c3415d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:50.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c3415d290 0x7f6c3415d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 -- 172.21.15.33:0/366981261 >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 msgr2=0x7f6c34068270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/366981261 >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 0x7f6c34068270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 -- 172.21.15.33:0/366981261 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c3406a5b0 con 0x7f6c34153d20 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c33fff700 1 --2- 172.21.15.33:0/366981261 >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 0x7f6c34068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c34153d20 0x7f6c3406b090 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406fa90 tx=0x7f6c2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eafe404e088e6c3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c337fe700 1 -- 172.21.15.33:0/366981261 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c00e070 con 0x7f6c34153d20 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c337fe700 1 -- 172.21.15.33:0/366981261 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c2c00ba50 con 0x7f6c34153d20 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c337fe700 1 -- 172.21.15.33:0/366981261 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c2c0092e0 con 0x7f6c34153d20 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 -- 172.21.15.33:0/366981261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c34153d20 msgr2=0x7f6c3406b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c34153d20 0x7f6c3406b090 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f6c3406fa90 tx=0x7f6c2c009840 comp rx=0 tx=0).stop 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 -- 172.21.15.33:0/366981261 shutdown_connections 2023-10-09T15:39:50.408 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c3415d290 0x7f6c3415d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/366981261 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c34153d20 0x7f6c3406b090 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/366981261 >> v2:172.21.15.59:3300/0 conn(0x7f6c34067e00 0x7f6c34068270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.405+0000 7f6c39e2d700 1 -- 172.21.15.33:0/366981261 >> 172.21.15.33:0/366981261 conn(0x7f6c340cca00 msgr2=0x7f6c340cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.406+0000 7f6c39e2d700 1 -- 172.21.15.33:0/366981261 shutdown_connections 2023-10-09T15:39:50.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.406+0000 7f6c39e2d700 1 -- 172.21.15.33:0/366981261 wait complete. 2023-10-09T15:39:50.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 Processor -- start 2023-10-09T15:39:50.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 -- start start 2023-10-09T15:39:50.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c34067e00 0x7f6c3416ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34153d20 0x7f6c341562d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34155a80 con 0x7f6c3415d290 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c3416e300 con 0x7f6c34153d20 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.407+0000 7f6c39e2d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c34154e70 con 0x7f6c34067e00 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:58292/0 (socket says 172.21.15.33:58292) 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 -- 172.21.15.33:0/2302611426 learned_addr learned my addr 172.21.15.33:0/2302611426 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c34067e00 0x7f6c3416ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c33fff700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34153d20 0x7f6c341562d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 -- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c34067e00 msgr2=0x7f6c3416ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.412 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c34067e00 0x7f6c3416ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 -- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34153d20 msgr2=0x7f6c341562d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34153d20 0x7f6c341562d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 -- 172.21.15.33:0/2302611426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c2c009ae0 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c3962c700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d860 tx=0x7f6c24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c240125f0 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c24012790 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c34155150 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c24012b50 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.408+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c34155710 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.409+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c34155c30 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.410+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6c24013480 con 0x7f6c3415d290 2023-10-09T15:39:50.413 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.410+0000 7f6c30ff9700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 0x7f6c200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.410+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6c24084c40 con 0x7f6c3415d290 2023-10-09T15:39:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.410+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 0x7f6c200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.411+0000 7f6c38e2b700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 0x7f6c200697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009880 tx=0x7f6c2c018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.414+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6c34155c30 con 0x7f6c3415d290 2023-10-09T15:39:50.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.654+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6c3404c3c0 con 0x7f6c3415d290 2023-10-09T15:39:50.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.654+0000 7f6c30ff9700 1 -- 172.21.15.33:0/2302611426 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 117 v117) v1 ==== 95+0+3531 (secure 0 0 0) 0x7f6c24051bd0 con 0x7f6c3415d290 2023-10-09T15:39:50.655 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:50.656 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":117,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7384,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/1946252515","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1946252515},{"type":"v1","addr":"172.21.15.59:6834","nonce":1946252515}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":7387,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/486046022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":486046022},{"type":"v1","addr":"172.21.15.59:6835","nonce":486046022}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8259,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2951100251","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2951100251},{"type":"v1","addr":"172.21.15.33:6836","nonce":2951100251}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":107},{"gid":8625,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/4001040784","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":4001040784},{"type":"v1","addr":"172.21.15.33:6837","nonce":4001040784}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":117}],"filesystems":[]} 2023-10-09T15:39:50.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 msgr2=0x7f6c200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 0x7f6c200697d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f6c2c009880 tx=0x7f6c2c018000 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 msgr2=0x7f6c3416d500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f6c2400d860 tx=0x7f6c24008040 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 shutdown_connections 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6c20067320 0x7f6c200697d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6c3415d290 0x7f6c3416d500 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6c34067e00 0x7f6c3416ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 --2- 172.21.15.33:0/2302611426 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6c34153d20 0x7f6c341562d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 >> 172.21.15.33:0/2302611426 conn(0x7f6c340cca00 msgr2=0x7f6c3406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 shutdown_connections 2023-10-09T15:39:50.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.656+0000 7f6c39e2d700 1 -- 172.21.15.33:0/2302611426 wait complete. 2023-10-09T15:39:50.659 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 117 2023-10-09T15:39:50.669 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:39:50.670 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:39:50.670 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:39:50.670 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:50.670 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:39:50.670 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:39:50.670 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:39:50.671 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:50.671 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:39:50.671 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:39:50.671 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:39:50.671 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:50.671 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:39:50.671 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:39:50.672 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:39:50.672 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:39:50.679 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:39:50.679 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:39:50.680 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:39:50.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:39:50.682 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:39:50.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:39:50.683 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:39:50.683 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:39:50.721 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:39:50.721 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:50.722 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:39:50.722 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:50.725 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:39:50.725 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:50.726 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:39:50.726 DEBUG:teuthology.parallel:result is None 2023-10-09T15:39:50.726 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:39:50.797 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:39:50.797 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:39:50.812 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:39:50.812 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:39:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.853+0000 7f875615f700 1 Processor -- start 2023-10-09T15:39:50.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.853+0000 7f875615f700 1 -- start start 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f875615f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8750150c90 0x7f8750158650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f875615f700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8750158c80 con 0x7f875015a7d0 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f875615f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8750158f60 con 0x7f87501508c0 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f875615f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f875015afc0 con 0x7f8750150c90 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f874effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f875015a7d0 0x7f8750154700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46952/0 (socket says 172.21.15.33:46952) 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f874effd700 1 -- 172.21.15.33:0/1464670093 learned_addr learned my addr 172.21.15.33:0/1464670093 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:50.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.854+0000 7f874ffff700 1 --2- 172.21.15.33:0/1464670093 >> v2:172.21.15.59:3300/0 conn(0x7f8750150c90 0x7f8750158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 835575294 0 0) 0x7f8750158c80 con 0x7f875015a7d0 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f873c003570 con 0x7f875015a7d0 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874ffff700 1 -- 172.21.15.33:0/1464670093 >> v1:172.21.15.59:6789/0 conn(0x7f87501508c0 legacy=0x7f875015a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874ffff700 1 -- 172.21.15.33:0/1464670093 >> v1:172.21.15.33:6789/0 conn(0x7f875015a7d0 legacy=0x7f8750154700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4227702516 0 0) 0x7f873c003570 con 0x7f875015a7d0 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874ffff700 1 -- 172.21.15.33:0/1464670093 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8750159240 con 0x7f8750150c90 2023-10-09T15:39:50.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.855+0000 7f874ffff700 1 --2- 172.21.15.33:0/1464670093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750158650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8748009e60 tx=0x7f8748009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=82e29f71cd1b7d1b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f874800e070 con 0x7f8750150c90 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f874800b850 con 0x7f8750150c90 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f874e7fc700 1 -- 172.21.15.33:0/1464670093 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8738001470 con 0x7f8750150c90 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 -- 172.21.15.33:0/1464670093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 msgr2=0x7f8750158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 --2- 172.21.15.33:0/1464670093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750158650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8748009e60 tx=0x7f8748009780 comp rx=0 tx=0).stop 2023-10-09T15:39:50.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 -- 172.21.15.33:0/1464670093 shutdown_connections 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 --2- 172.21.15.33:0/1464670093 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750158650 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 -- 172.21.15.33:0/1464670093 >> 172.21.15.33:0/1464670093 conn(0x7f87500cded0 msgr2=0x7f875006add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 -- 172.21.15.33:0/1464670093 shutdown_connections 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.856+0000 7f875615f700 1 -- 172.21.15.33:0/1464670093 wait complete. 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.858+0000 7f875615f700 1 Processor -- start 2023-10-09T15:39:50.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.858+0000 7f875615f700 1 -- start start 2023-10-09T15:39:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750152d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f875015a7d0 0x7f8750156810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8750154260 con 0x7f87501508c0 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87501668a0 con 0x7f8750150c90 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f875615f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8750169b90 con 0x7f875015a7d0 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42744/0 (socket says 172.21.15.33:42744) 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 -- 172.21.15.33:0/3667526469 learned_addr learned my addr 172.21.15.33:0/3667526469 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874ffff700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f875015a7d0 0x7f8750156810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874effd700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750152d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 -- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f875015a7d0 msgr2=0x7f8750156810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f875015a7d0 0x7f8750156810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 -- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 msgr2=0x7f8750152d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750152d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.859+0000 7f874f7fe700 1 -- 172.21.15.33:0/3667526469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8748009a20 con 0x7f87501508c0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f874f7fe700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f874000c4e0 tx=0x7f874000c7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011590 con 0x7f87501508c0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8740011710 con 0x7f87501508c0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87501536e0 con 0x7f87501508c0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8740011ad0 con 0x7f87501508c0 2023-10-09T15:39:50.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.860+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8750153f80 con 0x7f87501508c0 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.861+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f875004c3c0 con 0x7f87501508c0 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.861+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f874001b3b0 con 0x7f87501508c0 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.862+0000 7f87477fe700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 0x7f87300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.862+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8740083d70 con 0x7f87501508c0 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.862+0000 7f874effd700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 0x7f87300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:50.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.862+0000 7f874effd700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 0x7f87300697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8738001ed0 tx=0x7f8738000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:50.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:50.866+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8740050d00 con 0x7f87501508c0 2023-10-09T15:39:51.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.076+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f8750159520 con 0x7f87501508c0 2023-10-09T15:39:51.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.859+0000 7f87477fe700 1 -- 172.21.15.33:0/3667526469 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v182) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8740017070 con 0x7f87501508c0 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 msgr2=0x7f87300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 0x7f87300697d0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f8738001ed0 tx=0x7f8738000bc0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 msgr2=0x7f8750169650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f874000c4e0 tx=0x7f874000c7f0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 shutdown_connections 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.861+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8730067320 0x7f87300697d0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87501508c0 0x7f8750169650 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.863 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f875015a7d0 0x7f8750156810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 --2- 172.21.15.33:0/3667526469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8750150c90 0x7f8750152d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:51.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 >> 172.21.15.33:0/3667526469 conn(0x7f87500cded0 msgr2=0x7f875014fd20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:51.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 shutdown_connections 2023-10-09T15:39:51.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:51.862+0000 7f875615f700 1 -- 172.21.15.33:0/3667526469 wait complete. 2023-10-09T15:39:51.864 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:39:51.877 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:39:52.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.001+0000 7f3238842700 1 Processor -- start 2023-10-09T15:39:52.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.001+0000 7f3238842700 1 -- start start 2023-10-09T15:39:52.004 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3238842700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3234153c30 0x7f323415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3238842700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32340cf110 0x7f323415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3238842700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f323415afd0 con 0x7f323415de50 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3238842700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323415b2b0 con 0x7f32340cf110 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3238842700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f323415b590 con 0x7f3234153c30 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32340cf110 0x7f323415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32340cf110 0x7f323415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42754/0 (socket says 172.21.15.33:42754) 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 -- 172.21.15.33:0/3783986634 learned_addr learned my addr 172.21.15.33:0/3783986634 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f32337fe700 1 --2- 172.21.15.33:0/3783986634 >> v2:172.21.15.59:3300/0 conn(0x7f3234153c30 0x7f323415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 -- 172.21.15.33:0/3783986634 >> v2:172.21.15.59:3300/0 conn(0x7f3234153c30 msgr2=0x7f323415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:52.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 --2- 172.21.15.33:0/3783986634 >> v2:172.21.15.59:3300/0 conn(0x7f3234153c30 0x7f323415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 -- 172.21.15.33:0/3783986634 >> v1:172.21.15.59:6789/0 conn(0x7f323415de50 legacy=0x7f32340cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.002+0000 7f3233fff700 1 -- 172.21.15.33:0/3783986634 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f323415b870 con 0x7f32340cf110 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3233fff700 1 --2- 172.21.15.33:0/3783986634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323415c070 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f323406ead0 tx=0x7f322c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf153e2a1af688fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f32327fc700 1 -- 172.21.15.33:0/3783986634 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c00e070 con 0x7f32340cf110 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f32327fc700 1 -- 172.21.15.33:0/3783986634 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322c00ba10 con 0x7f32340cf110 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f32327fc700 1 -- 172.21.15.33:0/3783986634 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322c0092e0 con 0x7f32340cf110 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 -- 172.21.15.33:0/3783986634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 msgr2=0x7f323415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 --2- 172.21.15.33:0/3783986634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323415c070 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f323406ead0 tx=0x7f322c009840 comp rx=0 tx=0).stop 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 -- 172.21.15.33:0/3783986634 shutdown_connections 2023-10-09T15:39:52.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 --2- 172.21.15.33:0/3783986634 >> v2:172.21.15.59:3300/0 conn(0x7f3234153c30 0x7f323415a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 --2- 172.21.15.33:0/3783986634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323415c070 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 -- 172.21.15.33:0/3783986634 >> 172.21.15.33:0/3783986634 conn(0x7f32340703a0 msgr2=0x7f32340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 -- 172.21.15.33:0/3783986634 shutdown_connections 2023-10-09T15:39:52.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.003+0000 7f3238842700 1 -- 172.21.15.33:0/3783986634 wait complete. 2023-10-09T15:39:52.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 Processor -- start 2023-10-09T15:39:52.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 -- start start 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234153c30 0x7f32340cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f323415de50 0x7f32340c8dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32341519d0 con 0x7f32340cf110 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f323414bec0 con 0x7f3234153c30 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3238842700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3234152020 con 0x7f323415de50 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f32337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f32337fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42764/0 (socket says 172.21.15.33:42764) 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f32337fe700 1 -- 172.21.15.33:0/1450805847 learned_addr learned my addr 172.21.15.33:0/1450805847 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3233fff700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f323415de50 0x7f32340c8dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.005+0000 7f3232ffd700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234153c30 0x7f32340cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 -- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f323415de50 msgr2=0x7f32340c8dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f323415de50 0x7f32340c8dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 -- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234153c30 msgr2=0x7f32340cbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234153c30 0x7f32340cbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 -- 172.21.15.33:0/1450805847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f322c009ae0 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f32337fe700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f322400d890 tx=0x7f3224008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400b600 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f322400b760 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32340cb2b0 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f322400bae0 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.006+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32340cb870 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.007+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32340cba90 con 0x7f32340cf110 2023-10-09T15:39:52.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.007+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f322401e460 con 0x7f32340cf110 2023-10-09T15:39:52.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.008+0000 7f321b7fe700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 0x7f32200697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.008+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3224084fe0 con 0x7f32340cf110 2023-10-09T15:39:52.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.008+0000 7f3232ffd700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 0x7f32200697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.008+0000 7f3232ffd700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 0x7f32200697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3228006fd0 tx=0x7f3228008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.013 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.012+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3224051fc0 con 0x7f32340cf110 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.281+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f323404c3c0 con 0x7f32340cf110 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.282+0000 7f321b7fe700 1 -- 172.21.15.33:0/1450805847 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f32240555e0 con 0x7f32340cf110 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.283 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.284 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:52.285 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.286 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.287 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:39:52.288 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.289 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.290 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.291 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.292 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.293 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:52.294 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.295 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:39:52.296 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:52.297 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:52.298 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:39:52.299 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 msgr2=0x7f32200697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 0x7f32200697d0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f3228006fd0 tx=0x7f3228008040 comp rx=0 tx=0).stop 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 msgr2=0x7f323414b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f322400d890 tx=0x7f3224008040 comp rx=0 tx=0).stop 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 shutdown_connections 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3220067320 0x7f32200697d0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32340cf110 0x7f323414b980 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f323415de50 0x7f32340c8dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 --2- 172.21.15.33:0/1450805847 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3234153c30 0x7f32340cbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 >> 172.21.15.33:0/1450805847 conn(0x7f32340703a0 msgr2=0x7f32340b0310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 shutdown_connections 2023-10-09T15:39:52.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.284+0000 7f3238842700 1 -- 172.21.15.33:0/1450805847 wait complete. 2023-10-09T15:39:52.301 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:52.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.419+0000 7fa63359e700 1 Processor -- start 2023-10-09T15:39:52.420 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.419+0000 7fa63359e700 1 -- start start 2023-10-09T15:39:52.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63359e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6340cf110 0x7fa634164600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63359e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415afd0 con 0x7fa634153c30 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa63415b2b0 con 0x7fa63415de50 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63359e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa63415b590 con 0x7fa6340cf110 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa632d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa6340cf110 0x7fa634164600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63259c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa634153c30 0x7fa63415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46956/0 (socket says 172.21.15.33:46956) 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63259c700 1 -- 172.21.15.33:0/2586291713 learned_addr learned my addr 172.21.15.33:0/2586291713 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63159a700 1 -- 172.21.15.33:0/2586291713 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259097712 0 0) 0x7fa63415afd0 con 0x7fa634153c30 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.420+0000 7fa63159a700 1 -- 172.21.15.33:0/2586291713 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa620003570 con 0x7fa634153c30 2023-10-09T15:39:52.423 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa632d9d700 1 -- 172.21.15.33:0/2586291713 >> v1:172.21.15.59:6789/0 conn(0x7fa63415de50 legacy=0x7fa6340cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa632d9d700 1 -- 172.21.15.33:0/2586291713 >> v1:172.21.15.33:6789/0 conn(0x7fa634153c30 legacy=0x7fa63415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa632d9d700 1 -- 172.21.15.33:0/2586291713 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa63415b870 con 0x7fa6340cf110 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa632d9d700 1 --2- 172.21.15.33:0/2586291713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6340cf110 0x7fa634164600 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa624009e60 tx=0x7fa624009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c56eb1a6b704cf2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63159a700 1 -- 172.21.15.33:0/2586291713 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62400e070 con 0x7fa6340cf110 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63159a700 1 -- 172.21.15.33:0/2586291713 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62400bb60 con 0x7fa6340cf110 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63159a700 1 -- 172.21.15.33:0/2586291713 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624012430 con 0x7fa6340cf110 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 -- 172.21.15.33:0/2586291713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6340cf110 msgr2=0x7fa634164600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 --2- 172.21.15.33:0/2586291713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6340cf110 0x7fa634164600 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7fa624009e60 tx=0x7fa624009780 comp rx=0 tx=0).stop 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 -- 172.21.15.33:0/2586291713 shutdown_connections 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 --2- 172.21.15.33:0/2586291713 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa6340cf110 0x7fa634164600 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 -- 172.21.15.33:0/2586291713 >> 172.21.15.33:0/2586291713 conn(0x7fa6340703a0 msgr2=0x7fa6340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.421+0000 7fa63359e700 1 -- 172.21.15.33:0/2586291713 shutdown_connections 2023-10-09T15:39:52.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.422+0000 7fa63359e700 1 -- 172.21.15.33:0/2586291713 wait complete. 2023-10-09T15:39:52.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 Processor -- start 2023-10-09T15:39:52.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 -- start start 2023-10-09T15:39:52.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 0x7fa634169900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 0x7fa6340b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340b4390 con 0x7fa63415de50 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340b3b80 con 0x7fa634153c30 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa63359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6340b3dd0 con 0x7fa6340cf110 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa632d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa632d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42778/0 (socket says 172.21.15.33:42778) 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.423+0000 7fa632d9d700 1 -- 172.21.15.33:0/1771445184 learned_addr learned my addr 172.21.15.33:0/1771445184 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 -- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 msgr2=0x7fa634169900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa63259c700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 0x7fa634169900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.428 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 0x7fa634169900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa631d9b700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 0x7fa6340b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 -- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 msgr2=0x7fa6340b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 0x7fa6340b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 -- 172.21.15.33:0/1771445184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624009a20 con 0x7fa63415de50 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa63259c700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 0x7fa634169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa631d9b700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 0x7fa6340b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa632d9d700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa63406eb00 tx=0x7fa624019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa624012e90 con 0x7fa63415de50 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa62401d630 con 0x7fa63415de50 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6340b40b0 con 0x7fa63415de50 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa62401d9f0 con 0x7fa63415de50 2023-10-09T15:39:52.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.424+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6340b60d0 con 0x7fa63415de50 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.425+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6340b62f0 con 0x7fa63415de50 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.425+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa624024070 con 0x7fa63415de50 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.426+0000 7fa62a7fc700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 0x7fa6140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.426+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa624087240 con 0x7fa63415de50 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.426+0000 7fa63259c700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 0x7fa6140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.426+0000 7fa63259c700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 0x7fa6140697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa62c007fd0 tx=0x7fa62c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.430+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa624054220 con 0x7fa63415de50 2023-10-09T15:39:52.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.626+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa63404c3c0 con 0x7fa63415de50 2023-10-09T15:39:52.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.626+0000 7fa62a7fc700 1 -- 172.21.15.33:0/1771445184 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+12096 (secure 0 0 0) 0x7fa624057840 con 0x7fa63415de50 2023-10-09T15:39:52.627 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:52.628 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":182,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:51.857811+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":30,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":169,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 msgr2=0x7fa6140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 0x7fa6140697d0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fa62c007fd0 tx=0x7fa62c009040 comp rx=0 tx=0).stop 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 msgr2=0x7fa6340c91e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7fa63406eb00 tx=0x7fa624019000 comp rx=0 tx=0).stop 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 shutdown_connections 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa614067320 0x7fa6140697d0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa63415de50 0x7fa6340c91e0 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa6340cf110 0x7fa634169900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 --2- 172.21.15.33:0/1771445184 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa634153c30 0x7fa6340b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.628+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 >> 172.21.15.33:0/1771445184 conn(0x7fa6340703a0 msgr2=0x7fa6340c5880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.629+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 shutdown_connections 2023-10-09T15:39:52.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.629+0000 7fa63359e700 1 -- 172.21.15.33:0/1771445184 wait complete. 2023-10-09T15:39:52.642 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:39:52.642 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:39:52.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.763+0000 7f7d0272a700 1 Processor -- start 2023-10-09T15:39:52.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.763+0000 7f7d0272a700 1 -- start start 2023-10-09T15:39:52.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0cc320 0x7f7cfc13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 0x7f7cfc069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc06d7b0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cfc06e330 con 0x7f7cfc069a00 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d0272a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc06da00 con 0x7f7cfc0cc320 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7cfb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7cfb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42792/0 (socket says 172.21.15.33:42792) 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7cfb7fe700 1 -- 172.21.15.33:0/3518190920 learned_addr learned my addr 172.21.15.33:0/3518190920 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7d00cc7700 1 --2- 172.21.15.33:0/3518190920 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 0x7f7cfc069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.764+0000 7f7cfbfff700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0cc320 0x7f7cfc13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 -- 172.21.15.33:0/3518190920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0cc320 msgr2=0x7f7cfc13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0cc320 0x7f7cfc13c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 -- 172.21.15.33:0/3518190920 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 msgr2=0x7f7cfc069e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 --2- 172.21.15.33:0/3518190920 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 0x7f7cfc069e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 -- 172.21.15.33:0/3518190920 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cfc06dce0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7d00cc7700 1 --2- 172.21.15.33:0/3518190920 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 0x7f7cfc069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:52.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfb7fe700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc06aa30 tx=0x7f7cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45b1c7301e87c8e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfaffd700 1 -- 172.21.15.33:0/3518190920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec009e70 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfaffd700 1 -- 172.21.15.33:0/3518190920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cec00b860 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.765+0000 7f7cfaffd700 1 -- 172.21.15.33:0/3518190920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cec00bc00 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 -- 172.21.15.33:0/3518190920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 msgr2=0x7f7cfc13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 secure :-1 s=READY pgs=1605 cs=0 l=1 rev1=1 crypto rx=0x7f7cfc06aa30 tx=0x7f7cec009250 comp rx=0 tx=0).stop 2023-10-09T15:39:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 -- 172.21.15.33:0/3518190920 shutdown_connections 2023-10-09T15:39:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 --2- 172.21.15.33:0/3518190920 >> v2:172.21.15.59:3300/0 conn(0x7f7cfc069a00 0x7f7cfc069e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc0cc320 0x7f7cfc13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 --2- 172.21.15.33:0/3518190920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc13c7e0 unknown :-1 s=CLOSED pgs=1605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 -- 172.21.15.33:0/3518190920 >> 172.21.15.33:0/3518190920 conn(0x7f7cfc067f00 msgr2=0x7f7cfc068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 -- 172.21.15.33:0/3518190920 shutdown_connections 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.766+0000 7f7d0272a700 1 -- 172.21.15.33:0/3518190920 wait complete. 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.767+0000 7f7d0272a700 1 Processor -- start 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.767+0000 7f7d0272a700 1 -- start start 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc069a00 0x7f7cfc138f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0cc320 0x7f7cfc16cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc16dc60 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc13bc50 con 0x7f7cfc0cc320 2023-10-09T15:39:52.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cfc0aed00 con 0x7f7cfc069a00 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42794/0 (socket says 172.21.15.33:42794) 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 -- 172.21.15.33:0/2970881292 learned_addr learned my addr 172.21.15.33:0/2970881292 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7cfbfff700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc069a00 0x7f7cfc138f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7cfb7fe700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0cc320 0x7f7cfc16cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 -- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc069a00 msgr2=0x7f7cfc138f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc069a00 0x7f7cfc138f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 -- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0cc320 msgr2=0x7f7cfc16cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0cc320 0x7f7cfc16cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 -- 172.21.15.33:0/2970881292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cec0094f0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d00cc7700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d180 tx=0x7f7cf4009a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf400dcc0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cf400f040 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cfc0aea20 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cf4015690 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.768+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cfc13b8e0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.769+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cfc04c3c0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.770+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7cf401e3b0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.770+0000 7f7cf3fff700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 0x7f7cdc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.770+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f7cf4084f30 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.770+0000 7f7cfbfff700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 0x7f7cdc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:52.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.771+0000 7f7cfbfff700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 0x7f7cdc0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d20 tx=0x7f7ce40091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:52.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.775+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7cf4051dc0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.966+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cfc06dfc0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.967+0000 7f7cf3fff700 1 -- 172.21.15.33:0/2970881292 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cf401a0a0 con 0x7f7cfc0cc6f0 2023-10-09T15:39:52.968 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:39:52.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 msgr2=0x7f7cdc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 0x7f7cdc0697d0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009d20 tx=0x7f7ce40091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 msgr2=0x7f7cfc16d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f7cf400d180 tx=0x7f7cf4009a50 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 shutdown_connections 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7cdc067320 0x7f7cdc0697d0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7cfc0cc6f0 0x7f7cfc16d310 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7cfc069a00 0x7f7cfc138f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 --2- 172.21.15.33:0/2970881292 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7cfc0cc320 0x7f7cfc16cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 >> 172.21.15.33:0/2970881292 conn(0x7f7cfc067f00 msgr2=0x7f7cfc0b3090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 shutdown_connections 2023-10-09T15:39:52.971 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:52.969+0000 7f7d0272a700 1 -- 172.21.15.33:0/2970881292 wait complete. 2023-10-09T15:39:52.982 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:39:53.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.100+0000 7f66ab59e700 1 Processor -- start 2023-10-09T15:39:53.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.100+0000 7f66ab59e700 1 -- start start 2023-10-09T15:39:53.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f66ac15de50 0x7f66ac0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66ac0cef40 0x7f66ac06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac15afd0 con 0x7f66ac0cef40 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66ac15b2b0 con 0x7f66ac15de50 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66ab59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac15b590 con 0x7f66ac153c30 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66ac0cef40 0x7f66ac06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f66ac0cef40 0x7f66ac06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42798/0 (socket says 172.21.15.33:42798) 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 -- 172.21.15.33:0/1324365199 learned_addr learned my addr 172.21.15.33:0/1324365199 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aa59c700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 -- 172.21.15.33:0/1324365199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 msgr2=0x7f66ac15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 -- 172.21.15.33:0/1324365199 >> v2:172.21.15.59:3300/0 conn(0x7f66ac15de50 msgr2=0x7f66ac0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66a9d9b700 1 --2- 172.21.15.33:0/1324365199 >> v2:172.21.15.59:3300/0 conn(0x7f66ac15de50 0x7f66ac0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 --2- 172.21.15.33:0/1324365199 >> v2:172.21.15.59:3300/0 conn(0x7f66ac15de50 0x7f66ac0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 -- 172.21.15.33:0/1324365199 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac15b870 con 0x7f66ac0cef40 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.101+0000 7f66aad9d700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac06d790 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f66ac06e800 tx=0x7f66a4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a47d9387cee6918 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66a959a700 1 -- 172.21.15.33:0/1324365199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a400e070 con 0x7f66ac0cef40 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66a959a700 1 -- 172.21.15.33:0/1324365199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a400ba50 con 0x7f66ac0cef40 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66a959a700 1 -- 172.21.15.33:0/1324365199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a40092e0 con 0x7f66ac0cef40 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 -- 172.21.15.33:0/1324365199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 msgr2=0x7f66ac06d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac06d790 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f66ac06e800 tx=0x7f66a4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 -- 172.21.15.33:0/1324365199 shutdown_connections 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac06d790 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1324365199 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1324365199 >> v2:172.21.15.59:3300/0 conn(0x7f66ac15de50 0x7f66ac0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 -- 172.21.15.33:0/1324365199 >> 172.21.15.33:0/1324365199 conn(0x7f66ac0703a0 msgr2=0x7f66ac0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:53.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 -- 172.21.15.33:0/1324365199 shutdown_connections 2023-10-09T15:39:53.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.102+0000 7f66ab59e700 1 -- 172.21.15.33:0/1324365199 wait complete. 2023-10-09T15:39:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.103+0000 7f66ab59e700 1 Processor -- start 2023-10-09T15:39:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.103+0000 7f66ab59e700 1 -- start start 2023-10-09T15:39:53.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac0b1c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15de50 0x7f66ac1511b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac153580 con 0x7f66ac0cef40 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0c8560 con 0x7f66ac15de50 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66ab59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66ac0c7c30 con 0x7f66ac153c30 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66aa59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42804/0 (socket says 172.21.15.33:42804) 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.104+0000 7f66aa59c700 1 -- 172.21.15.33:0/1299328629 learned_addr learned my addr 172.21.15.33:0/1299328629 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66a9d9b700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac0b1c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 -- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 msgr2=0x7f66ac0b1c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac0b1c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 -- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15de50 msgr2=0x7f66ac1511b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15de50 0x7f66ac1511b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 -- 172.21.15.33:0/1299328629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66a4009ae0 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66aa59c700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d890 tx=0x7f669c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00b600 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669c00b760 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66ac0c7f10 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669c00bae0 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.105+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66ac14f4d0 con 0x7f66ac0cef40 2023-10-09T15:39:53.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.106+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66ac14f6f0 con 0x7f66ac0cef40 2023-10-09T15:39:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.106+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f669c01e460 con 0x7f66ac0cef40 2023-10-09T15:39:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.107+0000 7f669a7fc700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 0x7f668c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.107+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f669c085030 con 0x7f66ac0cef40 2023-10-09T15:39:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.107+0000 7f66a9d9b700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 0x7f668c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.107+0000 7f66a9d9b700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 0x7f668c0697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f66a0006fd0 tx=0x7f66a0008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.111+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f669c0b65a0 con 0x7f66ac0cef40 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.308+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f66ac04c3c0 con 0x7f66ac0cef40 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.309+0000 7f669a7fc700 1 -- 172.21.15.33:0/1299328629 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v182) v1 ==== 84+0+65 (secure 0 0 0) 0x7f66ac14f6f0 con 0x7f66ac0cef40 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:39:53.310 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:39:53.311 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:39:53.311 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:39:53.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 msgr2=0x7f668c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 0x7f668c0697d0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f66a0006fd0 tx=0x7f66a0008040 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 msgr2=0x7f66ac0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f669c00d890 tx=0x7f669c008040 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 shutdown_connections 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f668c067320 0x7f668c0697d0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f66ac0cef40 0x7f66ac0b1720 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f66ac15de50 0x7f66ac1511b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 --2- 172.21.15.33:0/1299328629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66ac153c30 0x7f66ac0b1c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 >> 172.21.15.33:0/1299328629 conn(0x7f66ac0703a0 msgr2=0x7f66ac0c5dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:53.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 shutdown_connections 2023-10-09T15:39:53.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.311+0000 7f66ab59e700 1 -- 172.21.15.33:0/1299328629 wait complete. 2023-10-09T15:39:53.324 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:39:53.324 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:39:53.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.447+0000 7f46ea597700 1 Processor -- start 2023-10-09T15:39:53.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.447+0000 7f46ea597700 1 -- start start 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46ea597700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46e415a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46ea597700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f46e40cd5a0 0x7f46e40cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46ea597700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e415d570 con 0x7f46e415a8c0 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46ea597700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e415e180 con 0x7f46e40cd5a0 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46ea597700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415d850 con 0x7f46e4159fb0 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46e8d94700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f46e415a8c0 0x7f46e40cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46964/0 (socket says 172.21.15.33:46964) 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46e8d94700 1 -- 172.21.15.33:0/248866057 learned_addr learned my addr 172.21.15.33:0/248866057 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:53.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46e9595700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46e415a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46e9d96700 1 --2- 172.21.15.33:0/248866057 >> v2:172.21.15.59:3300/0 conn(0x7f46e40cd5a0 0x7f46e40cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.448+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 527567997 0 0) 0x7f46e415d570 con 0x7f46e415a8c0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f46cc003570 con 0x7f46e415a8c0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3888682071 0 0) 0x7f46cc003570 con 0x7f46e415a8c0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 msgr2=0x7f46e415a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46e415a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 >> v2:172.21.15.59:3300/0 conn(0x7f46e40cd5a0 msgr2=0x7f46e40cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 --2- 172.21.15.33:0/248866057 >> v2:172.21.15.59:3300/0 conn(0x7f46e40cd5a0 0x7f46e40cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e415db30 con 0x7f46e415a8c0 2023-10-09T15:39:53.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f46d8001470 con 0x7f46e415a8c0 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 >> v1:172.21.15.33:6789/0 conn(0x7f46e415a8c0 legacy=0x7f46e40cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46cc003a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46cc003fe0 0x7f46cc004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc004d50 0x7f46cc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415e180 con 0x7f46cc003fe0 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e415d850 con 0x7f46cc004d50 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46cc00ba90 con 0x7f46e4159fb0 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46cc003fe0 0x7f46cc004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e9595700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46cc003a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e9d96700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc004d50 0x7f46cc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 -- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 msgr2=0x7f46cc003a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e4159fb0 0x7f46cc003a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 -- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc004d50 msgr2=0x7f46cc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc004d50 0x7f46cc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.449+0000 7f46e8d94700 1 -- 172.21.15.33:0/248866057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc003570 con 0x7f46cc003fe0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46e8d94700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46cc003fe0 0x7f46cc004810 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c3c0 tx=0x7f46d8001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5888d9d79f09e1da server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800cc30 con 0x7f46cc003fe0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800cdd0 con 0x7f46cc003fe0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46e3fff700 1 -- 172.21.15.33:0/248866057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8005b70 con 0x7f46cc003fe0 2023-10-09T15:39:53.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 -- 172.21.15.33:0/248866057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46cc003fe0 msgr2=0x7f46cc004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 --2- 172.21.15.33:0/248866057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46cc003fe0 0x7f46cc004810 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f46d800c3c0 tx=0x7f46d8001e90 comp rx=0 tx=0).stop 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46e9d96700 1 -- 172.21.15.33:0/248866057 reap_dead start 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 -- 172.21.15.33:0/248866057 shutdown_connections 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 -- 172.21.15.33:0/248866057 >> 172.21.15.33:0/248866057 conn(0x7f46e40703a0 msgr2=0x7f46e40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 -- 172.21.15.33:0/248866057 shutdown_connections 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.450+0000 7f46ea597700 1 -- 172.21.15.33:0/248866057 wait complete. 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.451+0000 7f46ea597700 1 Processor -- start 2023-10-09T15:39:53.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 -- start start 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc003fe0 0x7f46e4151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 0x7f46e40c9190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c7600 con 0x7f46e414e030 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c9a70 con 0x7f46cc003fe0 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46ea597700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e40c9d50 con 0x7f46e416ab90 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.452+0000 7f46e9d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42818/0 (socket says 172.21.15.33:42818) 2023-10-09T15:39:53.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 -- 172.21.15.33:0/3493610766 learned_addr learned my addr 172.21.15.33:0/3493610766 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9595700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc003fe0 0x7f46e4151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e8d94700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 0x7f46e40c9190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 -- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 msgr2=0x7f46e40c9190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 0x7f46e40c9190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 -- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc003fe0 msgr2=0x7f46e4151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc003fe0 0x7f46e4151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 -- 172.21.15.33:0/3493610766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e40ca030 con 0x7f46e414e030 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e8d94700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 0x7f46e40c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e9d96700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cdcd0 tx=0x7f46d400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400e040 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d400f040 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e40ca310 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400fe20 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.453+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e414e480 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.454+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e40ca4a0 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.455+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f46d4015640 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.455+0000 7f46e17fa700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 0x7f46d0069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.455+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f46d4085220 con 0x7f46e414e030 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.455+0000 7f46e9595700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 0x7f46d0069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:53.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.455+0000 7f46e9595700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 0x7f46d0069800 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006f00 tx=0x7f46dc0091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:53.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.459+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f46d40520f0 con 0x7f46e414e030 2023-10-09T15:39:53.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.653+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f46e404c3c0 con 0x7f46e414e030 2023-10-09T15:39:53.870 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.869+0000 7f46e17fa700 1 -- 172.21.15.33:0/3493610766 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v183) v1 ==== 138+0+0 (secure 0 0 0) 0x7f46d4055710 con 0x7f46e414e030 2023-10-09T15:39:53.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 msgr2=0x7f46d0069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 0x7f46d0069800 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f46dc006f00 tx=0x7f46dc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 msgr2=0x7f46e414fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f46e40cdcd0 tx=0x7f46d400b040 comp rx=0 tx=0).stop 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 shutdown_connections 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f46d0067350 0x7f46d0069800 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f46e414e030 0x7f46e414fa30 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f46cc003fe0 0x7f46e4151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 --2- 172.21.15.33:0/3493610766 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f46e416ab90 0x7f46e40c9190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:53.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 >> 172.21.15.33:0/3493610766 conn(0x7f46e40703a0 msgr2=0x7f46e414f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:53.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 shutdown_connections 2023-10-09T15:39:53.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:53.872+0000 7f46ea597700 1 -- 172.21.15.33:0/3493610766 wait complete. 2023-10-09T15:39:53.875 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:39:53.888 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:39:54.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.013+0000 7f8fb899a700 1 Processor -- start 2023-10-09T15:39:54.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 -- start start 2023-10-09T15:39:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8fb40cc320 0x7f8fb413c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc6f0 0x7f8fb413c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fb4069a00 0x7f8fb4069e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb406d7b0 con 0x7f8fb4069a00 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8fb406e330 con 0x7f8fb40cc320 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.014+0000 7f8fb899a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb406da00 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fb4069a00 0x7f8fb4069e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8fb4069a00 0x7f8fb4069e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42828/0 (socket says 172.21.15.33:42828) 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/2362315804 learned_addr learned my addr 172.21.15.33:0/2362315804 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb259c700 1 --2- 172.21.15.33:0/2362315804 >> v2:172.21.15.59:3300/0 conn(0x7f8fb40cc320 0x7f8fb413c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb1d9b700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc6f0 0x7f8fb413c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/2362315804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc6f0 msgr2=0x7f8fb413c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc6f0 0x7f8fb413c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/2362315804 >> v2:172.21.15.59:3300/0 conn(0x7f8fb40cc320 msgr2=0x7f8fb413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:54.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/2362315804 >> v2:172.21.15.59:3300/0 conn(0x7f8fb40cc320 0x7f8fb413c2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/2362315804 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fb406dce0 con 0x7f8fb4069a00 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb4069a00 0x7f8fb4069e80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cf510 tx=0x7f8fa4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd8406a5f796d1d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb159a700 1 -- 172.21.15.33:0/2362315804 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa400e070 con 0x7f8fb4069a00 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb159a700 1 -- 172.21.15.33:0/2362315804 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa400ba50 con 0x7f8fb4069a00 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.015+0000 7f8fb159a700 1 -- 172.21.15.33:0/2362315804 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40092e0 con 0x7f8fb4069a00 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 -- 172.21.15.33:0/2362315804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb4069a00 msgr2=0x7f8fb4069e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb4069a00 0x7f8fb4069e80 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cf510 tx=0x7f8fa4009840 comp rx=0 tx=0).stop 2023-10-09T15:39:54.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 -- 172.21.15.33:0/2362315804 shutdown_connections 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 --2- 172.21.15.33:0/2362315804 >> v2:172.21.15.59:3300/0 conn(0x7f8fb40cc320 0x7f8fb413c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb4069a00 0x7f8fb4069e80 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 --2- 172.21.15.33:0/2362315804 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc6f0 0x7f8fb413c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 -- 172.21.15.33:0/2362315804 >> 172.21.15.33:0/2362315804 conn(0x7f8fb4067f00 msgr2=0x7f8fb4068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 -- 172.21.15.33:0/2362315804 shutdown_connections 2023-10-09T15:39:54.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.016+0000 7f8fb899a700 1 -- 172.21.15.33:0/2362315804 wait complete. 2023-10-09T15:39:54.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.017+0000 7f8fb899a700 1 Processor -- start 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.017+0000 7f8fb899a700 1 -- start start 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4069a00 0x7f8fb415bd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc320 0x7f8fb413a930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415b8c0 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415acb0 con 0x7f8fb4069a00 2023-10-09T15:39:54.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb899a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8fb415af90 con 0x7f8fb40cc320 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42838/0 (socket says 172.21.15.33:42838) 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/1351549878 learned_addr learned my addr 172.21.15.33:0/1351549878 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb259c700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4069a00 0x7f8fb415bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb1d9b700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc320 0x7f8fb413a930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc320 msgr2=0x7f8fb413a930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:54.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc320 0x7f8fb413a930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4069a00 msgr2=0x7f8fb415bd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4069a00 0x7f8fb415bd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 -- 172.21.15.33:0/1351549878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8fa4009ae0 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8fb2d9d700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cf610 tx=0x7f8fa4018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa40032f0 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.018+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8fa4008e80 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.019+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8fb415b270 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.019+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8fa4026690 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.019+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8fb413ae70 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.019+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8fb415ba70 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.020+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8fa4003040 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.020+0000 7f8faa7fc700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 0x7f8f940697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.020+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f8fa4086610 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.020+0000 7f8fb259c700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 0x7f8f940697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:54.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.021+0000 7f8fb259c700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 0x7f8f940697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:54.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.025+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8fb415ba70 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.220 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.219+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f8fb415ba00 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.873+0000 7f8faa7fc700 1 -- 172.21.15.33:0/1351549878 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v184) v1 ==== 170+0+0 (secure 0 0 0) 0x7f8fa4053370 con 0x7f8fb40cc6f0 2023-10-09T15:39:54.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 msgr2=0x7f8f940697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:54.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 0x7f8f940697d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f8fac006fd0 tx=0x7f8fac008040 comp rx=0 tx=0).stop 2023-10-09T15:39:54.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 msgr2=0x7f8fb4153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:54.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f8fb40cf610 tx=0x7f8fa4018000 comp rx=0 tx=0).stop 2023-10-09T15:39:54.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 shutdown_connections 2023-10-09T15:39:54.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8f94067320 0x7f8f940697d0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8fb40cc6f0 0x7f8fb4153870 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8fb4069a00 0x7f8fb415bd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 --2- 172.21.15.33:0/1351549878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8fb40cc320 0x7f8fb413a930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.879+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 >> 172.21.15.33:0/1351549878 conn(0x7f8fb4067f00 msgr2=0x7f8fb40b3730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.881+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 shutdown_connections 2023-10-09T15:39:54.882 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:54.881+0000 7f8fb899a700 1 -- 172.21.15.33:0/1351549878 wait complete. 2023-10-09T15:39:54.889 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:39:54.905 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:39:55.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.030+0000 7f2ceca41700 1 Processor -- start 2023-10-09T15:39:55.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.031+0000 7f2ceca41700 1 -- start start 2023-10-09T15:39:55.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.031+0000 7f2ceca41700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2ce8159530 0x7f2ce80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:55.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.031+0000 7f2ceca41700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce80ccfd0 con 0x7f2ce806dc70 2023-10-09T15:39:55.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.031+0000 7f2ceca41700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ce80cf0e0 con 0x7f2ce806e0e0 2023-10-09T15:39:55.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.031+0000 7f2ceca41700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ce815a3d0 con 0x7f2ce8159530 2023-10-09T15:39:55.033 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2ce8159530 0x7f2ce80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce5d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f2ce806dc70 0x7f2ce8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46970/0 (socket says 172.21.15.33:46970) 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce5d9b700 1 -- 172.21.15.33:0/2170699882 learned_addr learned my addr 172.21.15.33:0/2170699882 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce659c700 1 -- 172.21.15.33:0/2170699882 >> v1:172.21.15.59:6789/0 conn(0x7f2ce806e0e0 legacy=0x7f2ce80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce659c700 1 -- 172.21.15.33:0/2170699882 >> v1:172.21.15.33:6789/0 conn(0x7f2ce806dc70 legacy=0x7f2ce8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce659c700 1 -- 172.21.15.33:0/2170699882 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ce815a6b0 con 0x7f2ce8159530 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce559a700 1 -- 172.21.15.33:0/2170699882 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3641460707 0 0) 0x7f2ce80ccfd0 con 0x7f2ce806dc70 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce659c700 1 --2- 172.21.15.33:0/2170699882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce8159530 0x7f2ce80ceba0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e60 tx=0x7f2cd8009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1cd1f103c33e460 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce559a700 1 -- 172.21.15.33:0/2170699882 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd800e070 con 0x7f2ce8159530 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce559a700 1 -- 172.21.15.33:0/2170699882 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd800bbf0 con 0x7f2ce8159530 2023-10-09T15:39:55.034 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.032+0000 7f2ce559a700 1 -- 172.21.15.33:0/2170699882 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8012430 con 0x7f2ce8159530 2023-10-09T15:39:55.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 -- 172.21.15.33:0/2170699882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce8159530 msgr2=0x7f2ce80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 --2- 172.21.15.33:0/2170699882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce8159530 0x7f2ce80ceba0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f2cd8009e60 tx=0x7f2cd8009780 comp rx=0 tx=0).stop 2023-10-09T15:39:55.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 -- 172.21.15.33:0/2170699882 shutdown_connections 2023-10-09T15:39:55.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 --2- 172.21.15.33:0/2170699882 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce8159530 0x7f2ce80ceba0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.035 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 -- 172.21.15.33:0/2170699882 >> 172.21.15.33:0/2170699882 conn(0x7f2ce80703a0 msgr2=0x7f2ce80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 -- 172.21.15.33:0/2170699882 shutdown_connections 2023-10-09T15:39:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.033+0000 7f2ceca41700 1 -- 172.21.15.33:0/2170699882 wait complete. 2023-10-09T15:39:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.034+0000 7f2ceca41700 1 Processor -- start 2023-10-09T15:39:55.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.034+0000 7f2ceca41700 1 -- start start 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce806e0e0 0x7f2ce816afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ce8159530 0x7f2ce816b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce815e070 con 0x7f2ce806dc70 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce815d460 con 0x7f2ce806e0e0 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ceca41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce815d740 con 0x7f2ce8159530 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42850/0 (socket says 172.21.15.33:42850) 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 -- 172.21.15.33:0/892648959 learned_addr learned my addr 172.21.15.33:0/892648959 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:55.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce6d9d700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ce8159530 0x7f2ce816b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce5d9b700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce806e0e0 0x7f2ce816afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 -- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ce8159530 msgr2=0x7f2ce816b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ce8159530 0x7f2ce816b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 -- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce806e0e0 msgr2=0x7f2ce816afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce806e0e0 0x7f2ce816afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 -- 172.21.15.33:0/892648959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd8009a20 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2ce659c700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800b6c0 tx=0x7f2cd8018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.035+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd8012e80 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.036+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2cd801e640 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.036+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce815da20 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.036+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2cd801ea00 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.036+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce80b6090 con 0x7f2ce806dc70 2023-10-09T15:39:55.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.036+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce804c3c0 con 0x7f2ce806dc70 2023-10-09T15:39:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.037+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2cd8024070 con 0x7f2ce806dc70 2023-10-09T15:39:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.037+0000 7f2cde7fc700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 0x7f2cc80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.037+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f2cd8087640 con 0x7f2ce806dc70 2023-10-09T15:39:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.037+0000 7f2ce5d9b700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 0x7f2cc80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:55.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.038+0000 7f2ce5d9b700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 0x7f2cc80697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2ce815cd60 tx=0x7f2cd0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:55.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.042+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2cd80542f0 con 0x7f2ce806dc70 2023-10-09T15:39:55.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.279+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f2ce815a990 con 0x7f2ce806dc70 2023-10-09T15:39:55.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.901+0000 7f2cde7fc700 1 -- 172.21.15.33:0/892648959 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 31 and data pool 32 v119) v1 ==== 174+0+0 (secure 0 0 0) 0x7f2cd8009880 con 0x7f2ce806dc70 2023-10-09T15:39:55.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.906+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 msgr2=0x7f2cc80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.906+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 0x7f2cc80697d0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f2ce815cd60 tx=0x7f2cd0009040 comp rx=0 tx=0).stop 2023-10-09T15:39:55.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.906+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 msgr2=0x7f2ce815e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.906+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f2cd800b6c0 tx=0x7f2cd8018000 comp rx=0 tx=0).stop 2023-10-09T15:39:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 shutdown_connections 2023-10-09T15:39:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2cc8067320 0x7f2cc80697d0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2ce806dc70 0x7f2ce815e500 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2ce8159530 0x7f2ce816b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 --2- 172.21.15.33:0/892648959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2ce806e0e0 0x7f2ce816afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.907+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 >> 172.21.15.33:0/892648959 conn(0x7f2ce80703a0 msgr2=0x7f2ce80cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:55.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.908+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 shutdown_connections 2023-10-09T15:39:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:55.911+0000 7f2ceca41700 1 -- 172.21.15.33:0/892648959 wait complete. 2023-10-09T15:39:55.913 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 31 and data pool 32 2023-10-09T15:39:55.929 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:56.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.050+0000 7fee36a09700 1 Processor -- start 2023-10-09T15:39:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.050+0000 7fee36a09700 1 -- start start 2023-10-09T15:39:56.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.051+0000 7fee36a09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.051+0000 7fee36a09700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 0x7fee30156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.051+0000 7fee36a09700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee3015ae40 con 0x7fee300cd9e0 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.051+0000 7fee36a09700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300d13f0 con 0x7fee300cde50 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.051+0000 7fee36a09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee3015ab60 con 0x7fee300cb5a0 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee34fa6700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 0x7fee30156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:45950/0 (socket says 172.21.15.33:45950) 2023-10-09T15:39:56.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 -- 172.21.15.33:0/2550835234 learned_addr learned my addr 172.21.15.33:0/2550835234 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:56.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 -- 172.21.15.33:0/2550835234 >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 msgr2=0x7fee30156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 --2- 172.21.15.33:0/2550835234 >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 0x7fee30156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 -- 172.21.15.33:0/2550835234 >> v1:172.21.15.59:6789/0 conn(0x7fee300cd9e0 legacy=0x7fee30159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 -- 172.21.15.33:0/2550835234 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300ccf00 con 0x7fee300cb5a0 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee34fa6700 1 --2- 172.21.15.33:0/2550835234 >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 0x7fee30156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2ffff700 1 --2- 172.21.15.33:0/2550835234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee200099b0 tx=0x7fee20009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8c92d920c790c0a1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2effd700 1 -- 172.21.15.33:0/2550835234 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee20009ea0 con 0x7fee300cb5a0 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2effd700 1 -- 172.21.15.33:0/2550835234 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2000b860 con 0x7fee300cb5a0 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.052+0000 7fee2effd700 1 -- 172.21.15.33:0/2550835234 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2000bc00 con 0x7fee300cb5a0 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 -- 172.21.15.33:0/2550835234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 msgr2=0x7fee300cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 --2- 172.21.15.33:0/2550835234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fee200099b0 tx=0x7fee20009250 comp rx=0 tx=0).stop 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 -- 172.21.15.33:0/2550835234 shutdown_connections 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 --2- 172.21.15.33:0/2550835234 >> v2:172.21.15.59:3300/0 conn(0x7fee300cde50 0x7fee30156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 --2- 172.21.15.33:0/2550835234 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee300cb5a0 0x7fee300cb970 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 -- 172.21.15.33:0/2550835234 >> 172.21.15.33:0/2550835234 conn(0x7fee30070e30 msgr2=0x7fee300d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 -- 172.21.15.33:0/2550835234 shutdown_connections 2023-10-09T15:39:56.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.053+0000 7fee36a09700 1 -- 172.21.15.33:0/2550835234 wait complete. 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.054+0000 7fee36a09700 1 Processor -- start 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.054+0000 7fee36a09700 1 -- start start 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee300cb5a0 0x7fee301491c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 0x7fee3015c0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee3015dc50 con 0x7fee300cd9e0 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300c8470 con 0x7fee300cb5a0 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee36a09700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee300c7860 con 0x7fee3015d7d0 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee2f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42858/0 (socket says 172.21.15.33:42858) 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee2f7fe700 1 -- 172.21.15.33:0/3394603172 learned_addr learned my addr 172.21.15.33:0/3394603172 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee2ffff700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee300cb5a0 0x7fee301491c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.055+0000 7fee34fa6700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 0x7fee3015c0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 -- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 msgr2=0x7fee3015c0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 0x7fee3015c0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 -- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee300cb5a0 msgr2=0x7fee301491c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee300cb5a0 0x7fee301491c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 -- 172.21.15.33:0/3394603172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee28009a20 con 0x7fee300cd9e0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee34fa6700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 0x7fee3015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee2f7fe700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c590 tx=0x7fee1800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18011590 con 0x7fee300cd9e0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee200094f0 con 0x7fee300cd9e0 2023-10-09T15:39:56.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee180116f0 con 0x7fee300cd9e0 2023-10-09T15:39:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee18011ab0 con 0x7fee300cd9e0 2023-10-09T15:39:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.056+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee300c7ea0 con 0x7fee300cd9e0 2023-10-09T15:39:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.057+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee300c9960 con 0x7fee300cd9e0 2023-10-09T15:39:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.057+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fee1801b3b0 con 0x7fee300cd9e0 2023-10-09T15:39:56.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.058+0000 7fee27fff700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 0x7fee100697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.058+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fee18084260 con 0x7fee300cd9e0 2023-10-09T15:39:56.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.058+0000 7fee2ffff700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 0x7fee100697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.058+0000 7fee2ffff700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 0x7fee100697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fee200099b0 tx=0x7fee20017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.062+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fee18050ef0 con 0x7fee300cd9e0 2023-10-09T15:39:56.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.254+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fee300c85e0 con 0x7fee300cd9e0 2023-10-09T15:39:56.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.255+0000 7fee27fff700 1 -- 172.21.15.33:0/3394603172 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15329 (secure 0 0 0) 0x7fee18054510 con 0x7fee300cd9e0 2023-10-09T15:39:56.256 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:56.256 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":185,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:55.281015+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:54.250723+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 msgr2=0x7fee100697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 0x7fee100697d0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fee200099b0 tx=0x7fee20017000 comp rx=0 tx=0).stop 2023-10-09T15:39:56.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 msgr2=0x7fee3015d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fee1800c590 tx=0x7fee1800c950 comp rx=0 tx=0).stop 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 shutdown_connections 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fee10067320 0x7fee100697d0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fee3015d7d0 0x7fee3015c0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fee300cb5a0 0x7fee301491c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 --2- 172.21.15.33:0/3394603172 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fee300cd9e0 0x7fee3015d290 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 >> 172.21.15.33:0/3394603172 conn(0x7fee30070e30 msgr2=0x7fee300b1540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 shutdown_connections 2023-10-09T15:39:56.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.257+0000 7fee36a09700 1 -- 172.21.15.33:0/3394603172 wait complete. 2023-10-09T15:39:56.271 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:56.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.389+0000 7f5765644700 1 Processor -- start 2023-10-09T15:39:56.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.389+0000 7f5765644700 1 -- start start 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600ca100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f576015d390 0x7f576015d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57600a98f0 0x7f57600a9d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576006c6a0 con 0x7f57600a98f0 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f576006cc60 con 0x7f576015d390 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f5765644700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f576015dde0 con 0x7f57600c9d30 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f575f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57600a98f0 0x7f57600a9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f575f7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f57600a98f0 0x7f57600a9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42860/0 (socket says 172.21.15.33:42860) 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.390+0000 7f575f7fe700 1 -- 172.21.15.33:0/3610793740 learned_addr learned my addr 172.21.15.33:0/3610793740 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575e7fc700 1 --2- 172.21.15.33:0/3610793740 >> v2:172.21.15.59:3300/0 conn(0x7f576015d390 0x7f576015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575effd700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600ca100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 -- 172.21.15.33:0/3610793740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 msgr2=0x7f57600ca100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600ca100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 -- 172.21.15.33:0/3610793740 >> v2:172.21.15.59:3300/0 conn(0x7f576015d390 msgr2=0x7f576015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 --2- 172.21.15.33:0/3610793740 >> v2:172.21.15.59:3300/0 conn(0x7f576015d390 0x7f576015d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 -- 172.21.15.33:0/3610793740 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f576015e0c0 con 0x7f57600a98f0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575f7fe700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57600a98f0 0x7f57600a9d10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f57600697f0 tx=0x7f5750009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9e3b747a2a05337 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575dffb700 1 -- 172.21.15.33:0/3610793740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f575000e070 con 0x7f57600a98f0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575dffb700 1 -- 172.21.15.33:0/3610793740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f575000ba50 con 0x7f57600a98f0 2023-10-09T15:39:56.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f575dffb700 1 -- 172.21.15.33:0/3610793740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500092e0 con 0x7f57600a98f0 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.391+0000 7f5765644700 1 -- 172.21.15.33:0/3610793740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57600a98f0 msgr2=0x7f57600a9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57600a98f0 0x7f57600a9d10 secure :-1 s=READY pgs=1618 cs=0 l=1 rev1=1 crypto rx=0x7f57600697f0 tx=0x7f5750009840 comp rx=0 tx=0).stop 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 -- 172.21.15.33:0/3610793740 shutdown_connections 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f57600a98f0 0x7f57600a9d10 unknown :-1 s=CLOSED pgs=1618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 --2- 172.21.15.33:0/3610793740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600ca100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 --2- 172.21.15.33:0/3610793740 >> v2:172.21.15.59:3300/0 conn(0x7f576015d390 0x7f576015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 -- 172.21.15.33:0/3610793740 >> 172.21.15.33:0/3610793740 conn(0x7f57600675a0 msgr2=0x7f57600679a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 -- 172.21.15.33:0/3610793740 shutdown_connections 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.392+0000 7f5765644700 1 -- 172.21.15.33:0/3610793740 wait complete. 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.393+0000 7f5765644700 1 Processor -- start 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.393+0000 7f5765644700 1 -- start start 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57600a98f0 0x7f57600aea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600c5760 con 0x7f576015d390 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57600af5a0 con 0x7f57600a98f0 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57600c5170 con 0x7f57600c9d30 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.397 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42866/0 (socket says 172.21.15.33:42866) 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 -- 172.21.15.33:0/2154509744 learned_addr learned my addr 172.21.15.33:0/2154509744 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575effd700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57600a98f0 0x7f57600aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575e7fc700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 -- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 msgr2=0x7f57600acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 -- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57600a98f0 msgr2=0x7f57600aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.399 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57600a98f0 0x7f57600aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 -- 172.21.15.33:0/2154509744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750009ae0 con 0x7f576015d390 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f575f7fe700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f5750009430 tx=0x7f5750018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57500032f0 con 0x7f576015d390 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5750008e70 con 0x7f576015d390 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57600aefe0 con 0x7f576015d390 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.394+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5750025670 con 0x7f576015d390 2023-10-09T15:39:56.400 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.395+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57600c53f0 con 0x7f576015d390 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.396+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57600c6a90 con 0x7f576015d390 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.396+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5750003040 con 0x7f576015d390 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.396+0000 7f5756ffd700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 0x7f57400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.396+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5750086a90 con 0x7f576015d390 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.397+0000 7f575effd700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 0x7f57400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.401 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.397+0000 7f575effd700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 0x7f57400697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5758006fd0 tx=0x7f5758008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.402 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.401+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5750053610 con 0x7f576015d390 2023-10-09T15:39:56.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.595+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f576004c3c0 con 0x7f576015d390 2023-10-09T15:39:56.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.596+0000 7f5756ffd700 1 -- 172.21.15.33:0/2154509744 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f5750056c30 con 0x7f576015d390 2023-10-09T15:39:56.597 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:56.597 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":185,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:55.281015+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:54.250723+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:56.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 msgr2=0x7f57400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 0x7f57400697d0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f5758006fd0 tx=0x7f5758008040 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 msgr2=0x7f5760157110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f5750009430 tx=0x7f5750018000 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 shutdown_connections 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5740067320 0x7f57400697d0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f576015d390 0x7f5760157110 unknown :-1 s=CLOSED pgs=1619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f57600a98f0 0x7f57600aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 --2- 172.21.15.33:0/2154509744 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f57600c9d30 0x7f57600acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 >> 172.21.15.33:0/2154509744 conn(0x7f57600675a0 msgr2=0x7f57600b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 shutdown_connections 2023-10-09T15:39:56.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.598+0000 7f5765644700 1 -- 172.21.15.33:0/2154509744 wait complete. 2023-10-09T15:39:56.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:39:56.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.733+0000 7fa041854700 1 Processor -- start 2023-10-09T15:39:56.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.733+0000 7fa041854700 1 -- start start 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa041854700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 0x7fa03c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa041854700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c0ccfd0 con 0x7fa03c159530 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa041854700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa03c15a3d0 con 0x7fa03c06dc70 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa041854700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c15a6b0 con 0x7fa03c06e0e0 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03affd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa03c159530 0x7fa03c0ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:46986/0 (socket says 172.21.15.33:46986) 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03affd700 1 -- 172.21.15.33:0/1739834492 learned_addr learned my addr 172.21.15.33:0/1739834492 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03b7fe700 1 --2- 172.21.15.33:0/1739834492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 0x7fa03c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 374560245 0 0) 0x7fa03c0ccfd0 con 0x7fa03c159530 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa028003570 con 0x7fa03c159530 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.734+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1139204657 0 0) 0x7fa03c15a3d0 con 0x7fa03c06dc70 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa03c0ccfd0 con 0x7fa03c06dc70 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4008154836 0 0) 0x7fa028003570 con 0x7fa03c159530 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03b7fe700 1 -- 172.21.15.33:0/1739834492 >> v1:172.21.15.59:6789/0 conn(0x7fa03c06dc70 legacy=0x7fa03c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03b7fe700 1 -- 172.21.15.33:0/1739834492 >> v1:172.21.15.33:6789/0 conn(0x7fa03c159530 legacy=0x7fa03c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03b7fe700 1 -- 172.21.15.33:0/1739834492 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa03c15a990 con 0x7fa03c06e0e0 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03b7fe700 1 --2- 172.21.15.33:0/1739834492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 0x7fa03c0cb6f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa034009e90 tx=0x7fa034009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c3da5a4bd95615b5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa03400e070 con 0x7fa03c06e0e0 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa03400b870 con 0x7fa03c06e0e0 2023-10-09T15:39:56.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.735+0000 7fa03a7fc700 1 -- 172.21.15.33:0/1739834492 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c001470 con 0x7fa03c06e0e0 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 -- 172.21.15.33:0/1739834492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 msgr2=0x7fa03c0cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 --2- 172.21.15.33:0/1739834492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 0x7fa03c0cb6f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fa034009e90 tx=0x7fa034009780 comp rx=0 tx=0).stop 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 -- 172.21.15.33:0/1739834492 shutdown_connections 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 --2- 172.21.15.33:0/1739834492 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c06e0e0 0x7fa03c0cb6f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 -- 172.21.15.33:0/1739834492 >> 172.21.15.33:0/1739834492 conn(0x7fa03c0703a0 msgr2=0x7fa03c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 -- 172.21.15.33:0/1739834492 shutdown_connections 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.736+0000 7fa041854700 1 -- 172.21.15.33:0/1739834492 wait complete. 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.737+0000 7fa041854700 1 Processor -- start 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.737+0000 7fa041854700 1 -- start start 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.740 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06e0e0 0x7fa03c0c8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c159530 0x7fa03c16a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c8b40 con 0x7fa03c06dc70 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c16abc0 con 0x7fa03c06e0e0 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa03c0c7f30 con 0x7fa03c159530 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42876/0 (socket says 172.21.15.33:42876) 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 -- 172.21.15.33:0/773223025 learned_addr learned my addr 172.21.15.33:0/773223025 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa033fff700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06e0e0 0x7fa03c0c8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03b7fe700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c159530 0x7fa03c16a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 -- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c159530 msgr2=0x7fa03c16a680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c159530 0x7fa03c16a680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.741 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 -- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06e0e0 msgr2=0x7fa03c0c8fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06e0e0 0x7fa03c0c8fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 -- 172.21.15.33:0/773223025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009a20 con 0x7fa03c06dc70 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa03affd700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00cba0 tx=0x7fa02c001b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c007e90 con 0x7fa03c06dc70 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa02c007360 con 0x7fa03c06dc70 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa03c0c8210 con 0x7fa03c06dc70 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.738+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa02c004830 con 0x7fa03c06dc70 2023-10-09T15:39:56.742 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.739+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03c0c87d0 con 0x7fa03c06dc70 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.739+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa03c04c3c0 con 0x7fa03c06dc70 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.740+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa02c004ba0 con 0x7fa03c06dc70 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.740+0000 7fa032ffd700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 0x7fa01c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.740+0000 7fa033fff700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 0x7fa01c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.740+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fa02c083f70 con 0x7fa03c06dc70 2023-10-09T15:39:56.743 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.741+0000 7fa033fff700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 0x7fa01c0697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0c79c0 tx=0x7fa024007d50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:56.746 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.745+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa02c050c80 con 0x7fa03c06dc70 2023-10-09T15:39:56.986 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:56.985+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fa03c15ac70 con 0x7fa03c06dc70 2023-10-09T15:39:57.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.908+0000 7fa032ffd700 1 -- 172.21.15.33:0/773223025 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v121) v1 ==== 118+0+0 (secure 0 0 0) 0x7fa02c018020 con 0x7fa03c06dc70 2023-10-09T15:39:57.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 msgr2=0x7fa01c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:57.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 0x7fa01c0697d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7fa03c0c79c0 tx=0x7fa024007d50 comp rx=0 tx=0).stop 2023-10-09T15:39:57.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 msgr2=0x7fa03c158a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:57.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7fa02c00cba0 tx=0x7fa02c001b50 comp rx=0 tx=0).stop 2023-10-09T15:39:57.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 shutdown_connections 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa01c067320 0x7fa01c0697d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa03c06dc70 0x7fa03c158a60 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa03c159530 0x7fa03c16a680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 --2- 172.21.15.33:0/773223025 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa03c06e0e0 0x7fa03c0c8fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 >> 172.21.15.33:0/773223025 conn(0x7fa03c0703a0 msgr2=0x7fa03c0cb6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 shutdown_connections 2023-10-09T15:39:57.912 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:57.911+0000 7fa041854700 1 -- 172.21.15.33:0/773223025 wait complete. 2023-10-09T15:39:57.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:39:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.055+0000 7f8bb65ee700 1 Processor -- start 2023-10-09T15:39:58.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.055+0000 7f8bb65ee700 1 -- start start 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.055+0000 7f8bb65ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8bb00ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb65ee700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8bb006dc70 0x7f8bb0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb65ee700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8bb00ccfd0 con 0x7f8bb006e0e0 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb65ee700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bb00cf0e0 con 0x7f8bb006dc70 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb65ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb015a3d0 con 0x7f8bb0159530 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb4b8b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f8bb006e0e0 0x7f8bb00cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47000/0 (socket says 172.21.15.33:47000) 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8bb4b8b700 1 -- 172.21.15.33:0/1463428227 learned_addr learned my addr 172.21.15.33:0/1463428227 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:39:58.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baffff700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8bb00ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/1463428227 >> v2:172.21.15.59:3300/0 conn(0x7f8bb006dc70 0x7f8bb0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3327427159 0 0) 0x7f8bb00ccfd0 con 0x7f8bb006e0e0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b9c003570 con 0x7f8bb006e0e0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2084933233 0 0) 0x7f8b9c003570 con 0x7f8bb006e0e0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 msgr2=0x7f8bb00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8bb00ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 >> v2:172.21.15.59:3300/0 conn(0x7f8bb006dc70 msgr2=0x7f8bb0159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 --2- 172.21.15.33:0/1463428227 >> v2:172.21.15.59:3300/0 conn(0x7f8bb006dc70 0x7f8bb0159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb015a6b0 con 0x7f8bb006e0e0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f8ba80017f0 con 0x7f8bb006e0e0 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 >> v1:172.21.15.33:6789/0 conn(0x7f8bb006e0e0 legacy=0x7f8bb00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b9c003a60 0x7f8b9c003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8b9c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b9c004d50 0x7f8b9c0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00cf0e0 con 0x7f8b9c004d50 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb015a3d0 con 0x7f8b9c003a60 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.056+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b9c00ba60 con 0x7f8bb0159530 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b9c004d50 0x7f8b9c0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8b9c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8baffff700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b9c003a60 0x7f8b9c003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 -- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 msgr2=0x7f8b9c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb0159530 0x7f8b9c004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 -- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b9c003a60 msgr2=0x7f8b9c003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b9c003a60 0x7f8b9c003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 -- 172.21.15.33:0/1463428227 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b9c003570 con 0x7f8b9c004d50 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b9c004d50 0x7f8b9c0051c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800a940 tx=0x7f8ba8002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb2c1f85cee5cdfb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8012440 con 0x7f8b9c004d50 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba80125a0 con 0x7f8b9c004d50 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.057+0000 7f8baeffd700 1 -- 172.21.15.33:0/1463428227 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba8012960 con 0x7f8b9c004d50 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 -- 172.21.15.33:0/1463428227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b9c004d50 msgr2=0x7f8b9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/1463428227 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b9c004d50 0x7f8b9c0051c0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f8ba800a940 tx=0x7f8ba8002210 comp rx=0 tx=0).stop 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb4b8b700 1 -- 172.21.15.33:0/1463428227 reap_dead start 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 -- 172.21.15.33:0/1463428227 shutdown_connections 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 -- 172.21.15.33:0/1463428227 >> 172.21.15.33:0/1463428227 conn(0x7f8bb00703a0 msgr2=0x7f8bb00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 -- 172.21.15.33:0/1463428227 shutdown_connections 2023-10-09T15:39:58.061 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.058+0000 7f8bb65ee700 1 -- 172.21.15.33:0/1463428227 wait complete. 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.059+0000 7f8bb65ee700 1 Processor -- start 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.059+0000 7f8bb65ee700 1 -- start start 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 0x7f8bb0157030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 0x7f8bb0155c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb00ca0c0 con 0x7f8bb014c1a0 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb0157a10 con 0x7f8bb0157570 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bb016a340 con 0x7f8bb014c570 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42896/0 (socket says 172.21.15.33:42896) 2023-10-09T15:39:58.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 -- 172.21.15.33:0/367634869 learned_addr learned my addr 172.21.15.33:0/367634869 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 0x7f8bb0157030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 0x7f8bb0155c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 -- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 msgr2=0x7f8bb0157030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 0x7f8bb0157030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 -- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 msgr2=0x7f8bb0155c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 0x7f8bb0155c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 -- 172.21.15.33:0/367634869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bb0156850 con 0x7f8bb014c1a0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 0x7f8bb0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb4b8b700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 0x7f8bb0155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8baffff700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0006ac0 tx=0x7f8ba00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba000fa10 con 0x7f8bb014c1a0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ba000fb70 con 0x7f8bb014c1a0 2023-10-09T15:39:58.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.060+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb00c78c0 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.061+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ba0014440 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.061+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bb00c7e80 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.061+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb004c3c0 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.062+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8ba0014830 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.062+0000 7f8ba7fff700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 0x7f8b900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.063+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 0x7f8b900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.063+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f8ba0018030 con 0x7f8bb014c1a0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.063+0000 7f8baf7fe700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 0x7f8b900697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0153f90 tx=0x7f8b98008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:58.066 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.067+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8ba00523a0 con 0x7f8bb014c1a0 2023-10-09T15:39:58.305 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.306+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8bb015a990 con 0x7f8bb014c1a0 2023-10-09T15:39:58.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.910+0000 7f8ba7fff700 1 -- 172.21.15.33:0/367634869 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v122) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8ba00559c0 con 0x7f8bb014c1a0 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 msgr2=0x7f8b900697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 0x7f8b900697d0 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f8bb0153f90 tx=0x7f8b98008040 comp rx=0 tx=0).stop 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 msgr2=0x7f8bb0169e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f8ba0006ac0 tx=0x7f8ba00091a0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 shutdown_connections 2023-10-09T15:39:58.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b90067320 0x7f8b900697d0 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8bb014c1a0 0x7f8bb0169e00 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8bb0157570 0x7f8bb0155c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 --2- 172.21.15.33:0/367634869 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8bb014c570 0x7f8bb0157030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 >> 172.21.15.33:0/367634869 conn(0x7f8bb00703a0 msgr2=0x7f8bb00b05f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 shutdown_connections 2023-10-09T15:39:58.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:58.913+0000 7f8bb65ee700 1 -- 172.21.15.33:0/367634869 wait complete. 2023-10-09T15:39:58.926 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:39:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.049+0000 7f0152b4a700 1 Processor -- start 2023-10-09T15:39:59.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.049+0000 7f0152b4a700 1 -- start start 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f0152b4a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f014c0cb970 0x7f014c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f0152b4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 0x7f014c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f0152b4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f014c15ae40 con 0x7f014c0cb5a0 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f0152b4a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0ce0f0 con 0x7f014c0cb970 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f0152b4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f014c0d13f0 con 0x7f014c15a400 2023-10-09T15:39:59.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f014bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f014c0cb970 0x7f014c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f014bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f014c0cb970 0x7f014c159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42898/0 (socket says 172.21.15.33:42898) 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.050+0000 7f014bfff700 1 -- 172.21.15.33:0/2605127849 learned_addr learned my addr 172.21.15.33:0/2605127849 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014bfff700 1 -- 172.21.15.33:0/2605127849 >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 msgr2=0x7f014c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f01510e7700 1 --2- 172.21.15.33:0/2605127849 >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 0x7f014c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014bfff700 1 --2- 172.21.15.33:0/2605127849 >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 0x7f014c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014bfff700 1 -- 172.21.15.33:0/2605127849 >> v1:172.21.15.59:6789/0 conn(0x7f014c0cb5a0 legacy=0x7f014c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014bfff700 1 -- 172.21.15.33:0/2605127849 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f014c15ab60 con 0x7f014c0cb970 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f01510e7700 1 --2- 172.21.15.33:0/2605127849 >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 0x7f014c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014bfff700 1 --2- 172.21.15.33:0/2605127849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c159ec0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f014c0ccdf0 tx=0x7f0134009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74445d3c177a66d9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014b7fe700 1 -- 172.21.15.33:0/2605127849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400b820 con 0x7f014c0cb970 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014b7fe700 1 -- 172.21.15.33:0/2605127849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f013400b980 con 0x7f014c0cb970 2023-10-09T15:39:59.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.051+0000 7f014b7fe700 1 -- 172.21.15.33:0/2605127849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013400bd20 con 0x7f014c0cb970 2023-10-09T15:39:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 -- 172.21.15.33:0/2605127849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 msgr2=0x7f014c159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 --2- 172.21.15.33:0/2605127849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c159ec0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f014c0ccdf0 tx=0x7f0134009250 comp rx=0 tx=0).stop 2023-10-09T15:39:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 -- 172.21.15.33:0/2605127849 shutdown_connections 2023-10-09T15:39:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 --2- 172.21.15.33:0/2605127849 >> v2:172.21.15.59:3300/0 conn(0x7f014c15a400 0x7f014c156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 --2- 172.21.15.33:0/2605127849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c159ec0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 -- 172.21.15.33:0/2605127849 >> 172.21.15.33:0/2605127849 conn(0x7f014c070e30 msgr2=0x7f014c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 -- 172.21.15.33:0/2605127849 shutdown_connections 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.052+0000 7f0152b4a700 1 -- 172.21.15.33:0/2605127849 wait complete. 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.053+0000 7f0152b4a700 1 Processor -- start 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.053+0000 7f0152b4a700 1 -- start start 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014c0cb5a0 0x7f014c152980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 0x7f014c0c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c0b4b80 con 0x7f014c0cb970 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f014c152ec0 con 0x7f014c15a400 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0152b4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014c15dcc0 con 0x7f014c0cb5a0 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.056 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42912/0 (socket says 172.21.15.33:42912) 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 -- 172.21.15.33:0/3035815214 learned_addr learned my addr 172.21.15.33:0/3035815214 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f01508e6700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014c0cb5a0 0x7f014c152980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f01510e7700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 0x7f014c0c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 -- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014c0cb5a0 msgr2=0x7f014c152980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014c0cb5a0 0x7f014c152980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 -- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 msgr2=0x7f014c0c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 0x7f014c0c8ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 -- 172.21.15.33:0/3035815214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01340094f0 con 0x7f014c0cb970 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f01510e7700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 0x7f014c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f014bfff700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f01340030c0 tx=0x7f0134016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.054+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0134011e60 con 0x7f014c0cb970 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.055+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0134020070 con 0x7f014c0cb970 2023-10-09T15:39:59.057 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.055+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f013401b6a0 con 0x7f014c0cb970 2023-10-09T15:39:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.055+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f014c15dfa0 con 0x7f014c0cb970 2023-10-09T15:39:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.055+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f014c0b4810 con 0x7f014c0cb970 2023-10-09T15:39:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.055+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f014c0b4d30 con 0x7f014c0cb970 2023-10-09T15:39:59.058 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.056+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0134022030 con 0x7f014c0cb970 2023-10-09T15:39:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.056+0000 7f0148ff9700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.056+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0134086ad0 con 0x7f014c0cb970 2023-10-09T15:39:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.056+0000 7f01508e6700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.059 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.057+0000 7f01508e6700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 0x7f012c0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0144007fd0 tx=0x7f0144009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.061+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f014c0b4d30 con 0x7f014c0cb970 2023-10-09T15:39:59.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.304+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f014c04c3c0 con 0x7f014c0cb970 2023-10-09T15:39:59.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.304+0000 7f0148ff9700 1 -- 172.21.15.33:0/3035815214 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f0134053830 con 0x7f014c0cb970 2023-10-09T15:39:59.304 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:59.305 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":122,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:39:58.906642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:39:59.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 msgr2=0x7f012c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 0x7f012c0697d0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0144007fd0 tx=0x7f0144009040 comp rx=0 tx=0).stop 2023-10-09T15:39:59.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 msgr2=0x7f014c15b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f01340030c0 tx=0x7f0134016000 comp rx=0 tx=0).stop 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 shutdown_connections 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f012c067320 0x7f012c0697d0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f014c15a400 0x7f014c0c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f014c0cb5a0 0x7f014c152980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 --2- 172.21.15.33:0/3035815214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f014c0cb970 0x7f014c15b070 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 >> 172.21.15.33:0/3035815214 conn(0x7f014c070e30 msgr2=0x7f014c0cd8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 shutdown_connections 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.307+0000 7f0152b4a700 1 -- 172.21.15.33:0/3035815214 wait complete. 2023-10-09T15:39:59.308 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 122 2023-10-09T15:39:59.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:39:59.438 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.438+0000 7f0592992700 1 Processor -- start 2023-10-09T15:39:59.439 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.438+0000 7f0592992700 1 -- start start 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0592992700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f058c0cb5a0 0x7f058c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0592992700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c0cd9e0 0x7f058c159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0592992700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f058c15ae40 con 0x7f058c0cde50 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0592992700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f058c0d13f0 con 0x7f058c0cb5a0 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0592992700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c15ab60 con 0x7f058c0cd9e0 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f058bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f058c0cb5a0 0x7f058c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f058bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f058c0cb5a0 0x7f058c0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42916/0 (socket says 172.21.15.33:42916) 2023-10-09T15:39:59.441 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f0590f2f700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f058c0cde50 0x7f058c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47014/0 (socket says 172.21.15.33:47014) 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.439+0000 7f058bfff700 1 -- 172.21.15.33:0/1268705553 learned_addr learned my addr 172.21.15.33:0/1268705553 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058b7fe700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c0cd9e0 0x7f058c159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058bfff700 1 -- 172.21.15.33:0/1268705553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c0cd9e0 msgr2=0x7f058c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058bfff700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c0cd9e0 0x7f058c159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058bfff700 1 -- 172.21.15.33:0/1268705553 >> v1:172.21.15.33:6789/0 conn(0x7f058c0cde50 legacy=0x7f058c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058affd700 1 -- 172.21.15.33:0/1268705553 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 107693444 0 0) 0x7f058c15ae40 con 0x7f058c0cde50 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058bfff700 1 -- 172.21.15.33:0/1268705553 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f058c0ccf00 con 0x7f058c0cb5a0 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058bfff700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cb5a0 0x7f058c0cb970 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f057c0099b0 tx=0x7f057c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca5a2ce2a30c4106 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058affd700 1 -- 172.21.15.33:0/1268705553 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00b860 con 0x7f058c0cb5a0 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058affd700 1 -- 172.21.15.33:0/1268705553 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057c00b9c0 con 0x7f058c0cb5a0 2023-10-09T15:39:59.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.440+0000 7f058affd700 1 -- 172.21.15.33:0/1268705553 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057c00bd60 con 0x7f058c0cb5a0 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 -- 172.21.15.33:0/1268705553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cb5a0 msgr2=0x7f058c0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cb5a0 0x7f058c0cb970 secure :-1 s=READY pgs=1628 cs=0 l=1 rev1=1 crypto rx=0x7f057c0099b0 tx=0x7f057c009250 comp rx=0 tx=0).stop 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 -- 172.21.15.33:0/1268705553 shutdown_connections 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cb5a0 0x7f058c0cb970 unknown :-1 s=CLOSED pgs=1628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 --2- 172.21.15.33:0/1268705553 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c0cd9e0 0x7f058c159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 -- 172.21.15.33:0/1268705553 >> 172.21.15.33:0/1268705553 conn(0x7f058c070e30 msgr2=0x7f058c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 -- 172.21.15.33:0/1268705553 shutdown_connections 2023-10-09T15:39:59.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.441+0000 7f0592992700 1 -- 172.21.15.33:0/1268705553 wait complete. 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.442+0000 7f0592992700 1 Processor -- start 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.442+0000 7f0592992700 1 -- start start 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 0x7f058c1523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c15c560 0x7f058c154cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b4f60 con 0x7f058c0cd9e0 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b3e20 con 0x7f058c0cb5a0 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f058c0b4100 con 0x7f058c15c560 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42930/0 (socket says 172.21.15.33:42930) 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 -- 172.21.15.33:0/692184709 learned_addr learned my addr 172.21.15.33:0/692184709 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058bfff700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 0x7f058c1523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0590f2f700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c15c560 0x7f058c154cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 -- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c15c560 msgr2=0x7f058c154cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c15c560 0x7f058c154cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 -- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 msgr2=0x7f058c1523f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 0x7f058c1523f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 -- 172.21.15.33:0/692184709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f057c0094f0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058bfff700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 0x7f058c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f058b7fe700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f057400d890 tx=0x7f0574008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400b600 con 0x7f058c0cd9e0 2023-10-09T15:39:59.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f057400b760 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f058c0b43e0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f057400bae0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.443+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f058c152930 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.444+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f058c04c3c0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.445+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f057401e460 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.445+0000 7f0583fff700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.445+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0574085320 con 0x7f058c0cd9e0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.445+0000 7f058bfff700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.446+0000 7f058bfff700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 0x7f056c0697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f057c0099b0 tx=0x7f057c017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.450+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0574051fb0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.645+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f058c0b50a0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.645 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.645+0000 7f0583fff700 1 -- 172.21.15.33:0/692184709 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f05740555d0 con 0x7f058c0cd9e0 2023-10-09T15:39:59.646 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:59.646 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":186,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:39:56.883136+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":32,"pool_name":"cephfs_data","create_time":"2023-10-09T15:39:54.250723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:39:59.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 msgr2=0x7f056c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.648 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 0x7f056c0697d0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f057c0099b0 tx=0x7f057c017000 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 msgr2=0x7f058c0b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f057400d890 tx=0x7f0574008040 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 shutdown_connections 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f056c067320 0x7f056c0697d0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f058c15c560 0x7f058c154cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f058c0cb5a0 0x7f058c1523f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 --2- 172.21.15.33:0/692184709 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f058c0cd9e0 0x7f058c0b34b0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 >> 172.21.15.33:0/692184709 conn(0x7f058c070e30 msgr2=0x7f058c0d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 shutdown_connections 2023-10-09T15:39:59.649 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.648+0000 7f0592992700 1 -- 172.21.15.33:0/692184709 wait complete. 2023-10-09T15:39:59.660 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:39:59.661 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:39:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.779+0000 7f0f60237700 1 Processor -- start 2023-10-09T15:39:59.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.779+0000 7f0f60237700 1 -- start start 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f60237700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 0x7f0f58159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f60237700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f5815a400 0x7f0f58156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f60237700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f5815ae40 con 0x7f0f580cb5a0 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f60237700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580ce0f0 con 0x7f0f5815a400 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f60237700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f580d13f0 con 0x7f0f580cb970 2023-10-09T15:39:59.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f5e7d4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f5815a400 0x7f0f58156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f5e7d4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f0f5815a400 0x7f0f58156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42934/0 (socket says 172.21.15.33:42934) 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.780+0000 7f0f5e7d4700 1 -- 172.21.15.33:0/1452476522 learned_addr learned my addr 172.21.15.33:0/1452476522 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5d7d2700 1 --2- 172.21.15.33:0/1452476522 >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 0x7f0f58159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5e7d4700 1 -- 172.21.15.33:0/1452476522 >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 msgr2=0x7f0f58159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5e7d4700 1 --2- 172.21.15.33:0/1452476522 >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 0x7f0f58159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5e7d4700 1 -- 172.21.15.33:0/1452476522 >> v1:172.21.15.59:6789/0 conn(0x7f0f580cb5a0 legacy=0x7f0f580cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5e7d4700 1 -- 172.21.15.33:0/1452476522 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5815ab60 con 0x7f0f5815a400 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5d7d2700 1 --2- 172.21.15.33:0/1452476522 >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 0x7f0f58159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5e7d4700 1 --2- 172.21.15.33:0/1452476522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5815a400 0x7f0f58156e90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0f580d1780 tx=0x7f0f48009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b566d2528d5bca9c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5cfd1700 1 -- 172.21.15.33:0/1452476522 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f4800e070 con 0x7f0f5815a400 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5cfd1700 1 -- 172.21.15.33:0/1452476522 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f4800ba50 con 0x7f0f5815a400 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.781+0000 7f0f5cfd1700 1 -- 172.21.15.33:0/1452476522 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f480092e0 con 0x7f0f5815a400 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 -- 172.21.15.33:0/1452476522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5815a400 msgr2=0x7f0f58156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 --2- 172.21.15.33:0/1452476522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5815a400 0x7f0f58156e90 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f0f580d1780 tx=0x7f0f48009840 comp rx=0 tx=0).stop 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 -- 172.21.15.33:0/1452476522 shutdown_connections 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 --2- 172.21.15.33:0/1452476522 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f5815a400 0x7f0f58156e90 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 --2- 172.21.15.33:0/1452476522 >> v2:172.21.15.59:3300/0 conn(0x7f0f580cb970 0x7f0f58159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 -- 172.21.15.33:0/1452476522 >> 172.21.15.33:0/1452476522 conn(0x7f0f58070e30 msgr2=0x7f0f580d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 -- 172.21.15.33:0/1452476522 shutdown_connections 2023-10-09T15:39:59.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.782+0000 7f0f60237700 1 -- 172.21.15.33:0/1452476522 wait complete. 2023-10-09T15:39:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 Processor -- start 2023-10-09T15:39:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 -- start start 2023-10-09T15:39:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f580cb970 0x7f0f5815db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 0x7f0f58152790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f58153710 con 0x7f0f580cb5a0 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580ca610 con 0x7f0f5815a400 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.783+0000 7f0f60237700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f580ca050 con 0x7f0f580cb970 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42938/0 (socket says 172.21.15.33:42938) 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 -- 172.21.15.33:0/160787951 learned_addr learned my addr 172.21.15.33:0/160787951 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5d7d2700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f580cb970 0x7f0f5815db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5e7d4700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 0x7f0f58152790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 -- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f580cb970 msgr2=0x7f0f5815db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f580cb970 0x7f0f5815db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 -- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 msgr2=0x7f0f58152790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 0x7f0f58152790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 -- 172.21.15.33:0/160787951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f48009ae0 con 0x7f0f580cb5a0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5e7d4700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 0x7f0f58152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f5dfd3700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c590 tx=0x7f0f5000c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50011590 con 0x7f0f580cb5a0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f500116f0 con 0x7f0f580cb5a0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f580ca330 con 0x7f0f580cb5a0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.784+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f50011ab0 con 0x7f0f580cb5a0 2023-10-09T15:39:59.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.785+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f580b4860 con 0x7f0f580cb5a0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.786+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f580b4a80 con 0x7f0f580cb5a0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.786+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f0f5001b3b0 con 0x7f0f580cb5a0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.786+0000 7f0f55ffb700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 0x7f0f440697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.786+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0f50084220 con 0x7f0f580cb5a0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.786+0000 7f0f5d7d2700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 0x7f0f440697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.787+0000 7f0f5d7d2700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 0x7f0f440697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006f00 tx=0x7f0f4c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:39:59.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.790+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0f50050eb0 con 0x7f0f580cb5a0 2023-10-09T15:39:59.984 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.984+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f5804c3c0 con 0x7f0f44067320 2023-10-09T15:39:59.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.992+0000 7f0f55ffb700 1 -- 172.21.15.33:0/160787951 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289803 (secure 0 0 0) 0x7f0f5804c3c0 con 0x7f0f44067320 2023-10-09T15:39:59.996 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:39:59.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 msgr2=0x7f0f440697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 0x7f0f440697d0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c006f00 tx=0x7f0f4c008040 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 msgr2=0x7f0f5815b070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f0f5000c590 tx=0x7f0f5000c950 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 shutdown_connections 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f0f44067320 0x7f0f440697d0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f0f580cb5a0 0x7f0f5815b070 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f0f5815a400 0x7f0f58152790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 --2- 172.21.15.33:0/160787951 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f0f580cb970 0x7f0f5815db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 >> 172.21.15.33:0/160787951 conn(0x7f0f58070e30 msgr2=0x7f0f580b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:39:59.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 shutdown_connections 2023-10-09T15:40:00.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:39:59.995+0000 7f0f60237700 1 -- 172.21.15.33:0/160787951 wait complete. 2023-10-09T15:40:00.000 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:40:00.008 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2023-10-09T15:39:59.343661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430696,"kb_used_data":19624,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752544024,"statfs":{"total":773094113280,"available":770605080576,"internally_reserved":0,"allocated":20094976,"data_stored":9675849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.474603"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898792+0000","last_change":"2023-10-09T15:39:55.895774+0000","last_active":"2023-10-09T15:39:55.898792+0000","last_peered":"2023-10-09T15:39:55.898792+0000","last_clean":"2023-10-09T15:39:55.898792+0000","last_became_active":"2023-10-09T15:39:55.895466+0000","last_became_peered":"2023-10-09T15:39:55.895466+0000","last_unstale":"2023-10-09T15:39:55.898792+0000","last_undegraded":"2023-10-09T15:39:55.898792+0000","last_fullsized":"2023-10-09T15:39:55.898792+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:00.179478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.895010+0000","last_change":"2023-10-09T15:39:55.895010+0000","last_active":"2023-10-09T15:39:55.895010+0000","last_peered":"2023-10-09T15:39:55.895010+0000","last_clean":"2023-10-09T15:39:55.895010+0000","last_became_active":"2023-10-09T15:39:55.894684+0000","last_became_peered":"2023-10-09T15:39:55.894684+0000","last_unstale":"2023-10-09T15:39:55.895010+0000","last_undegraded":"2023-10-09T15:39:55.895010+0000","last_fullsized":"2023-10-09T15:39:55.895010+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:48.474424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906725+0000","last_change":"2023-10-09T15:39:55.905754+0000","last_active":"2023-10-09T15:39:55.906725+0000","last_peered":"2023-10-09T15:39:55.906725+0000","last_clean":"2023-10-09T15:39:55.906725+0000","last_became_active":"2023-10-09T15:39:55.905473+0000","last_became_peered":"2023-10-09T15:39:55.905473+0000","last_unstale":"2023-10-09T15:39:55.906725+0000","last_undegraded":"2023-10-09T15:39:55.906725+0000","last_fullsized":"2023-10-09T15:39:55.906725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917560+0000","last_change":"2023-10-09T15:39:55.915394+0000","last_active":"2023-10-09T15:39:55.917560+0000","last_peered":"2023-10-09T15:39:55.917560+0000","last_clean":"2023-10-09T15:39:55.917560+0000","last_became_active":"2023-10-09T15:39:55.914844+0000","last_became_peered":"2023-10-09T15:39:55.914844+0000","last_unstale":"2023-10-09T15:39:55.917560+0000","last_undegraded":"2023-10-09T15:39:55.917560+0000","last_fullsized":"2023-10-09T15:39:55.917560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:25.316637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917481+0000","last_change":"2023-10-09T15:39:55.917481+0000","last_active":"2023-10-09T15:39:55.917481+0000","last_peered":"2023-10-09T15:39:55.917481+0000","last_clean":"2023-10-09T15:39:55.917481+0000","last_became_active":"2023-10-09T15:39:55.917202+0000","last_became_peered":"2023-10-09T15:39:55.917202+0000","last_unstale":"2023-10-09T15:39:55.917481+0000","last_undegraded":"2023-10-09T15:39:55.917481+0000","last_fullsized":"2023-10-09T15:39:55.917481+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:40.473819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918855+0000","last_change":"2023-10-09T15:39:55.913750+0000","last_active":"2023-10-09T15:39:55.918855+0000","last_peered":"2023-10-09T15:39:55.918855+0000","last_clean":"2023-10-09T15:39:55.918855+0000","last_became_active":"2023-10-09T15:39:55.913442+0000","last_became_peered":"2023-10-09T15:39:55.913442+0000","last_unstale":"2023-10-09T15:39:55.918855+0000","last_undegraded":"2023-10-09T15:39:55.918855+0000","last_fullsized":"2023-10-09T15:39:55.918855+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:53.508615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.904007+0000","last_change":"2023-10-09T15:39:55.904007+0000","last_active":"2023-10-09T15:39:55.904007+0000","last_peered":"2023-10-09T15:39:55.904007+0000","last_clean":"2023-10-09T15:39:55.904007+0000","last_became_active":"2023-10-09T15:39:55.903682+0000","last_became_peered":"2023-10-09T15:39:55.903682+0000","last_unstale":"2023-10-09T15:39:55.904007+0000","last_undegraded":"2023-10-09T15:39:55.904007+0000","last_fullsized":"2023-10-09T15:39:55.904007+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:56.174152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899528+0000","last_change":"2023-10-09T15:39:55.899528+0000","last_active":"2023-10-09T15:39:55.899528+0000","last_peered":"2023-10-09T15:39:55.899528+0000","last_clean":"2023-10-09T15:39:55.899528+0000","last_became_active":"2023-10-09T15:39:55.899233+0000","last_became_peered":"2023-10-09T15:39:55.899233+0000","last_unstale":"2023-10-09T15:39:55.899528+0000","last_undegraded":"2023-10-09T15:39:55.899528+0000","last_fullsized":"2023-10-09T15:39:55.899528+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:51.737974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918701+0000","last_change":"2023-10-09T15:39:55.908566+0000","last_active":"2023-10-09T15:39:55.918701+0000","last_peered":"2023-10-09T15:39:55.918701+0000","last_clean":"2023-10-09T15:39:55.918701+0000","last_became_active":"2023-10-09T15:39:55.908322+0000","last_became_peered":"2023-10-09T15:39:55.908322+0000","last_unstale":"2023-10-09T15:39:55.918701+0000","last_undegraded":"2023-10-09T15:39:55.918701+0000","last_fullsized":"2023-10-09T15:39:55.918701+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:29.731630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901829+0000","last_change":"2023-10-09T15:39:55.899947+0000","last_active":"2023-10-09T15:39:55.901829+0000","last_peered":"2023-10-09T15:39:55.901829+0000","last_clean":"2023-10-09T15:39:55.901829+0000","last_became_active":"2023-10-09T15:39:55.899663+0000","last_became_peered":"2023-10-09T15:39:55.899663+0000","last_unstale":"2023-10-09T15:39:55.901829+0000","last_undegraded":"2023-10-09T15:39:55.901829+0000","last_fullsized":"2023-10-09T15:39:55.901829+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:24.472329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901803+0000","last_change":"2023-10-09T15:39:55.899896+0000","last_active":"2023-10-09T15:39:55.901803+0000","last_peered":"2023-10-09T15:39:55.901803+0000","last_clean":"2023-10-09T15:39:55.901803+0000","last_became_active":"2023-10-09T15:39:55.899607+0000","last_became_peered":"2023-10-09T15:39:55.899607+0000","last_unstale":"2023-10-09T15:39:55.901803+0000","last_undegraded":"2023-10-09T15:39:55.901803+0000","last_fullsized":"2023-10-09T15:39:55.901803+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:21.887582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919358+0000","last_change":"2023-10-09T15:39:55.914118+0000","last_active":"2023-10-09T15:39:55.919358+0000","last_peered":"2023-10-09T15:39:55.919358+0000","last_clean":"2023-10-09T15:39:55.919358+0000","last_became_active":"2023-10-09T15:39:55.913791+0000","last_became_peered":"2023-10-09T15:39:55.913791+0000","last_unstale":"2023-10-09T15:39:55.919358+0000","last_undegraded":"2023-10-09T15:39:55.919358+0000","last_fullsized":"2023-10-09T15:39:55.919358+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:30.321300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911572+0000","last_change":"2023-10-09T15:39:55.911572+0000","last_active":"2023-10-09T15:39:55.911572+0000","last_peered":"2023-10-09T15:39:55.911572+0000","last_clean":"2023-10-09T15:39:55.911572+0000","last_became_active":"2023-10-09T15:39:55.911250+0000","last_became_peered":"2023-10-09T15:39:55.911250+0000","last_unstale":"2023-10-09T15:39:55.911572+0000","last_undegraded":"2023-10-09T15:39:55.911572+0000","last_fullsized":"2023-10-09T15:39:55.911572+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:33.358972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899108+0000","last_change":"2023-10-09T15:39:55.899108+0000","last_active":"2023-10-09T15:39:55.899108+0000","last_peered":"2023-10-09T15:39:55.899108+0000","last_clean":"2023-10-09T15:39:55.899108+0000","last_became_active":"2023-10-09T15:39:55.898722+0000","last_became_peered":"2023-10-09T15:39:55.898722+0000","last_unstale":"2023-10-09T15:39:55.899108+0000","last_undegraded":"2023-10-09T15:39:55.899108+0000","last_fullsized":"2023-10-09T15:39:55.899108+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920509+0000","last_change":"2023-10-09T15:39:55.917415+0000","last_active":"2023-10-09T15:39:55.920509+0000","last_peered":"2023-10-09T15:39:55.920509+0000","last_clean":"2023-10-09T15:39:55.920509+0000","last_became_active":"2023-10-09T15:39:55.913414+0000","last_became_peered":"2023-10-09T15:39:55.913414+0000","last_unstale":"2023-10-09T15:39:55.920509+0000","last_undegraded":"2023-10-09T15:39:55.920509+0000","last_fullsized":"2023-10-09T15:39:55.920509+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:40.473819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896460+0000","last_change":"2023-10-09T15:39:55.893945+0000","last_active":"2023-10-09T15:39:55.896460+0000","last_peered":"2023-10-09T15:39:55.896460+0000","last_clean":"2023-10-09T15:39:55.896460+0000","last_became_active":"2023-10-09T15:39:55.893679+0000","last_became_peered":"2023-10-09T15:39:55.893679+0000","last_unstale":"2023-10-09T15:39:55.896460+0000","last_undegraded":"2023-10-09T15:39:55.896460+0000","last_fullsized":"2023-10-09T15:39:55.896460+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:24.478441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911320+0000","last_change":"2023-10-09T15:39:55.911320+0000","last_active":"2023-10-09T15:39:55.911320+0000","last_peered":"2023-10-09T15:39:55.911320+0000","last_clean":"2023-10-09T15:39:55.911320+0000","last_became_active":"2023-10-09T15:39:55.911024+0000","last_became_peered":"2023-10-09T15:39:55.911024+0000","last_unstale":"2023-10-09T15:39:55.911320+0000","last_undegraded":"2023-10-09T15:39:55.911320+0000","last_fullsized":"2023-10-09T15:39:55.911320+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:43.955832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896408+0000","last_change":"2023-10-09T15:39:55.892809+0000","last_active":"2023-10-09T15:39:55.896408+0000","last_peered":"2023-10-09T15:39:55.896408+0000","last_clean":"2023-10-09T15:39:55.896408+0000","last_became_active":"2023-10-09T15:39:55.892550+0000","last_became_peered":"2023-10-09T15:39:55.892550+0000","last_unstale":"2023-10-09T15:39:55.896408+0000","last_undegraded":"2023-10-09T15:39:55.896408+0000","last_fullsized":"2023-10-09T15:39:55.896408+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:45.988258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919883+0000","last_change":"2023-10-09T15:39:55.913637+0000","last_active":"2023-10-09T15:39:55.919883+0000","last_peered":"2023-10-09T15:39:55.919883+0000","last_clean":"2023-10-09T15:39:55.919883+0000","last_became_active":"2023-10-09T15:39:55.913311+0000","last_became_peered":"2023-10-09T15:39:55.913311+0000","last_unstale":"2023-10-09T15:39:55.919883+0000","last_undegraded":"2023-10-09T15:39:55.919883+0000","last_fullsized":"2023-10-09T15:39:55.919883+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.849938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899956+0000","last_change":"2023-10-09T15:39:55.899956+0000","last_active":"2023-10-09T15:39:55.899956+0000","last_peered":"2023-10-09T15:39:55.899956+0000","last_clean":"2023-10-09T15:39:55.899956+0000","last_became_active":"2023-10-09T15:39:55.899713+0000","last_became_peered":"2023-10-09T15:39:55.899713+0000","last_unstale":"2023-10-09T15:39:55.899956+0000","last_undegraded":"2023-10-09T15:39:55.899956+0000","last_fullsized":"2023-10-09T15:39:55.899956+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:47.898670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918482+0000","last_change":"2023-10-09T15:39:55.918482+0000","last_active":"2023-10-09T15:39:55.918482+0000","last_peered":"2023-10-09T15:39:55.918482+0000","last_clean":"2023-10-09T15:39:55.918482+0000","last_became_active":"2023-10-09T15:39:55.918128+0000","last_became_peered":"2023-10-09T15:39:55.918128+0000","last_unstale":"2023-10-09T15:39:55.918482+0000","last_undegraded":"2023-10-09T15:39:55.918482+0000","last_fullsized":"2023-10-09T15:39:55.918482+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:38.421611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.902311+0000","last_change":"2023-10-09T15:39:55.902311+0000","last_active":"2023-10-09T15:39:55.902311+0000","last_peered":"2023-10-09T15:39:55.902311+0000","last_clean":"2023-10-09T15:39:55.902311+0000","last_became_active":"2023-10-09T15:39:55.902025+0000","last_became_peered":"2023-10-09T15:39:55.902025+0000","last_unstale":"2023-10-09T15:39:55.902311+0000","last_undegraded":"2023-10-09T15:39:55.902311+0000","last_fullsized":"2023-10-09T15:39:55.902311+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:41.007069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920531+0000","last_change":"2023-10-09T15:39:55.917619+0000","last_active":"2023-10-09T15:39:55.920531+0000","last_peered":"2023-10-09T15:39:55.920531+0000","last_clean":"2023-10-09T15:39:55.920531+0000","last_became_active":"2023-10-09T15:39:55.913785+0000","last_became_peered":"2023-10-09T15:39:55.913785+0000","last_unstale":"2023-10-09T15:39:55.920531+0000","last_undegraded":"2023-10-09T15:39:55.920531+0000","last_fullsized":"2023-10-09T15:39:55.920531+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:42.199626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.910283+0000","last_change":"2023-10-09T15:39:55.910283+0000","last_active":"2023-10-09T15:39:55.910283+0000","last_peered":"2023-10-09T15:39:55.910283+0000","last_clean":"2023-10-09T15:39:55.910283+0000","last_became_active":"2023-10-09T15:39:55.909929+0000","last_became_peered":"2023-10-09T15:39:55.909929+0000","last_unstale":"2023-10-09T15:39:55.910283+0000","last_undegraded":"2023-10-09T15:39:55.910283+0000","last_fullsized":"2023-10-09T15:39:55.910283+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:25.392840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896660+0000","last_change":"2023-10-09T15:39:55.896660+0000","last_active":"2023-10-09T15:39:55.896660+0000","last_peered":"2023-10-09T15:39:55.896660+0000","last_clean":"2023-10-09T15:39:55.896660+0000","last_became_active":"2023-10-09T15:39:55.895819+0000","last_became_peered":"2023-10-09T15:39:55.895819+0000","last_unstale":"2023-10-09T15:39:55.896660+0000","last_undegraded":"2023-10-09T15:39:55.896660+0000","last_fullsized":"2023-10-09T15:39:55.896660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:25.484169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905296+0000","last_change":"2023-10-09T15:39:55.905296+0000","last_active":"2023-10-09T15:39:55.905296+0000","last_peered":"2023-10-09T15:39:55.905296+0000","last_clean":"2023-10-09T15:39:55.905296+0000","last_became_active":"2023-10-09T15:39:55.904986+0000","last_became_peered":"2023-10-09T15:39:55.904986+0000","last_unstale":"2023-10-09T15:39:55.905296+0000","last_undegraded":"2023-10-09T15:39:55.905296+0000","last_fullsized":"2023-10-09T15:39:55.905296+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:40.637362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.915024+0000","last_change":"2023-10-09T15:39:55.915024+0000","last_active":"2023-10-09T15:39:55.915024+0000","last_peered":"2023-10-09T15:39:55.915024+0000","last_clean":"2023-10-09T15:39:55.915024+0000","last_became_active":"2023-10-09T15:39:55.914711+0000","last_became_peered":"2023-10-09T15:39:55.914711+0000","last_unstale":"2023-10-09T15:39:55.915024+0000","last_undegraded":"2023-10-09T15:39:55.915024+0000","last_fullsized":"2023-10-09T15:39:55.915024+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:25.660550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.902511+0000","last_change":"2023-10-09T15:39:55.900886+0000","last_active":"2023-10-09T15:39:55.902511+0000","last_peered":"2023-10-09T15:39:55.902511+0000","last_clean":"2023-10-09T15:39:55.902511+0000","last_became_active":"2023-10-09T15:39:55.900570+0000","last_became_peered":"2023-10-09T15:39:55.900570+0000","last_unstale":"2023-10-09T15:39:55.902511+0000","last_undegraded":"2023-10-09T15:39:55.902511+0000","last_fullsized":"2023-10-09T15:39:55.902511+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:11:26.421938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916902+0000","last_change":"2023-10-09T15:39:55.916902+0000","last_active":"2023-10-09T15:39:55.916902+0000","last_peered":"2023-10-09T15:39:55.916902+0000","last_clean":"2023-10-09T15:39:55.916902+0000","last_became_active":"2023-10-09T15:39:55.916586+0000","last_became_peered":"2023-10-09T15:39:55.916586+0000","last_unstale":"2023-10-09T15:39:55.916902+0000","last_undegraded":"2023-10-09T15:39:55.916902+0000","last_fullsized":"2023-10-09T15:39:55.916902+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:24.472329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899923+0000","last_change":"2023-10-09T15:39:55.899923+0000","last_active":"2023-10-09T15:39:55.899923+0000","last_peered":"2023-10-09T15:39:55.899923+0000","last_clean":"2023-10-09T15:39:55.899923+0000","last_became_active":"2023-10-09T15:39:55.899686+0000","last_became_peered":"2023-10-09T15:39:55.899686+0000","last_unstale":"2023-10-09T15:39:55.899923+0000","last_undegraded":"2023-10-09T15:39:55.899923+0000","last_fullsized":"2023-10-09T15:39:55.899923+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:28.215367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.908368+0000","last_change":"2023-10-09T15:39:55.908368+0000","last_active":"2023-10-09T15:39:55.908368+0000","last_peered":"2023-10-09T15:39:55.908368+0000","last_clean":"2023-10-09T15:39:55.908368+0000","last_became_active":"2023-10-09T15:39:55.908006+0000","last_became_peered":"2023-10-09T15:39:55.908006+0000","last_unstale":"2023-10-09T15:39:55.908368+0000","last_undegraded":"2023-10-09T15:39:55.908368+0000","last_fullsized":"2023-10-09T15:39:55.908368+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:18.078950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918636+0000","last_change":"2023-10-09T15:39:55.909484+0000","last_active":"2023-10-09T15:39:55.918636+0000","last_peered":"2023-10-09T15:39:55.918636+0000","last_clean":"2023-10-09T15:39:55.918636+0000","last_became_active":"2023-10-09T15:39:55.909168+0000","last_became_peered":"2023-10-09T15:39:55.909168+0000","last_unstale":"2023-10-09T15:39:55.918636+0000","last_undegraded":"2023-10-09T15:39:55.918636+0000","last_fullsized":"2023-10-09T15:39:55.918636+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:35.302469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897087+0000","last_change":"2023-10-09T15:39:55.897087+0000","last_active":"2023-10-09T15:39:55.897087+0000","last_peered":"2023-10-09T15:39:55.897087+0000","last_clean":"2023-10-09T15:39:55.897087+0000","last_became_active":"2023-10-09T15:39:55.896670+0000","last_became_peered":"2023-10-09T15:39:55.896670+0000","last_unstale":"2023-10-09T15:39:55.897087+0000","last_undegraded":"2023-10-09T15:39:55.897087+0000","last_fullsized":"2023-10-09T15:39:55.897087+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:57.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"185'4","reported_seq":14,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919130+0000","last_change":"2023-10-09T15:39:54.886988+0000","last_active":"2023-10-09T15:39:55.919130+0000","last_peered":"2023-10-09T15:39:55.919130+0000","last_clean":"2023-10-09T15:39:55.919130+0000","last_became_active":"2023-10-09T15:39:54.886700+0000","last_became_peered":"2023-10-09T15:39:54.886700+0000","last_unstale":"2023-10-09T15:39:55.919130+0000","last_undegraded":"2023-10-09T15:39:55.919130+0000","last_fullsized":"2023-10-09T15:39:55.919130+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:24:59.458770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.922001+0000","last_change":"2023-10-09T15:39:55.920898+0000","last_active":"2023-10-09T15:39:55.922001+0000","last_peered":"2023-10-09T15:39:55.922001+0000","last_clean":"2023-10-09T15:39:55.922001+0000","last_became_active":"2023-10-09T15:39:55.920622+0000","last_became_peered":"2023-10-09T15:39:55.920622+0000","last_unstale":"2023-10-09T15:39:55.922001+0000","last_undegraded":"2023-10-09T15:39:55.922001+0000","last_fullsized":"2023-10-09T15:39:55.922001+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:45.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916989+0000","last_change":"2023-10-09T15:39:54.885685+0000","last_active":"2023-10-09T15:39:55.916989+0000","last_peered":"2023-10-09T15:39:55.916989+0000","last_clean":"2023-10-09T15:39:55.916989+0000","last_became_active":"2023-10-09T15:39:54.885257+0000","last_became_peered":"2023-10-09T15:39:54.885257+0000","last_unstale":"2023-10-09T15:39:55.916989+0000","last_undegraded":"2023-10-09T15:39:55.916989+0000","last_fullsized":"2023-10-09T15:39:55.916989+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:31:29.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.907235+0000","last_change":"2023-10-09T15:39:55.906877+0000","last_active":"2023-10-09T15:39:55.907235+0000","last_peered":"2023-10-09T15:39:55.907235+0000","last_clean":"2023-10-09T15:39:55.907235+0000","last_became_active":"2023-10-09T15:39:55.906600+0000","last_became_peered":"2023-10-09T15:39:55.906600+0000","last_unstale":"2023-10-09T15:39:55.907235+0000","last_undegraded":"2023-10-09T15:39:55.907235+0000","last_fullsized":"2023-10-09T15:39:55.907235+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:47.645104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919164+0000","last_change":"2023-10-09T15:39:54.890405+0000","last_active":"2023-10-09T15:39:55.919164+0000","last_peered":"2023-10-09T15:39:55.919164+0000","last_clean":"2023-10-09T15:39:55.919164+0000","last_became_active":"2023-10-09T15:39:54.890101+0000","last_became_peered":"2023-10-09T15:39:54.890101+0000","last_unstale":"2023-10-09T15:39:55.919164+0000","last_undegraded":"2023-10-09T15:39:55.919164+0000","last_fullsized":"2023-10-09T15:39:55.919164+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.658762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897354+0000","last_change":"2023-10-09T15:39:55.897354+0000","last_active":"2023-10-09T15:39:55.897354+0000","last_peered":"2023-10-09T15:39:55.897354+0000","last_clean":"2023-10-09T15:39:55.897354+0000","last_became_active":"2023-10-09T15:39:55.897084+0000","last_became_peered":"2023-10-09T15:39:55.897084+0000","last_unstale":"2023-10-09T15:39:55.897354+0000","last_undegraded":"2023-10-09T15:39:55.897354+0000","last_fullsized":"2023-10-09T15:39:55.897354+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:00.466485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920283+0000","last_change":"2023-10-09T15:39:54.885072+0000","last_active":"2023-10-09T15:39:55.920283+0000","last_peered":"2023-10-09T15:39:55.920283+0000","last_clean":"2023-10-09T15:39:55.920283+0000","last_became_active":"2023-10-09T15:39:54.884784+0000","last_became_peered":"2023-10-09T15:39:54.884784+0000","last_unstale":"2023-10-09T15:39:55.920283+0000","last_undegraded":"2023-10-09T15:39:55.920283+0000","last_fullsized":"2023-10-09T15:39:55.920283+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:19.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906191+0000","last_change":"2023-10-09T15:39:55.906191+0000","last_active":"2023-10-09T15:39:55.906191+0000","last_peered":"2023-10-09T15:39:55.906191+0000","last_clean":"2023-10-09T15:39:55.906191+0000","last_became_active":"2023-10-09T15:39:55.905744+0000","last_became_peered":"2023-10-09T15:39:55.905744+0000","last_unstale":"2023-10-09T15:39:55.906191+0000","last_undegraded":"2023-10-09T15:39:55.906191+0000","last_fullsized":"2023-10-09T15:39:55.906191+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:02.877253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.885729+0000","last_change":"2023-10-09T15:39:54.888663+0000","last_active":"2023-10-09T15:39:55.885729+0000","last_peered":"2023-10-09T15:39:55.885729+0000","last_clean":"2023-10-09T15:39:55.885729+0000","last_became_active":"2023-10-09T15:39:54.888356+0000","last_became_peered":"2023-10-09T15:39:54.888356+0000","last_unstale":"2023-10-09T15:39:55.885729+0000","last_undegraded":"2023-10-09T15:39:55.885729+0000","last_fullsized":"2023-10-09T15:39:55.885729+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:58.842222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917852+0000","last_change":"2023-10-09T15:39:55.916058+0000","last_active":"2023-10-09T15:39:55.917852+0000","last_peered":"2023-10-09T15:39:55.917852+0000","last_clean":"2023-10-09T15:39:55.917852+0000","last_became_active":"2023-10-09T15:39:55.915792+0000","last_became_peered":"2023-10-09T15:39:55.915792+0000","last_unstale":"2023-10-09T15:39:55.917852+0000","last_undegraded":"2023-10-09T15:39:55.917852+0000","last_fullsized":"2023-10-09T15:39:55.917852+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:27.949554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.889976+0000","last_change":"2023-10-09T15:39:54.893684+0000","last_active":"2023-10-09T15:39:55.889976+0000","last_peered":"2023-10-09T15:39:55.889976+0000","last_clean":"2023-10-09T15:39:55.889976+0000","last_became_active":"2023-10-09T15:39:54.893411+0000","last_became_peered":"2023-10-09T15:39:54.893411+0000","last_unstale":"2023-10-09T15:39:55.889976+0000","last_undegraded":"2023-10-09T15:39:55.889976+0000","last_fullsized":"2023-10-09T15:39:55.889976+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:48.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.900114+0000","last_change":"2023-10-09T15:39:55.900114+0000","last_active":"2023-10-09T15:39:55.900114+0000","last_peered":"2023-10-09T15:39:55.900114+0000","last_clean":"2023-10-09T15:39:55.900114+0000","last_became_active":"2023-10-09T15:39:55.899804+0000","last_became_peered":"2023-10-09T15:39:55.899804+0000","last_unstale":"2023-10-09T15:39:55.900114+0000","last_undegraded":"2023-10-09T15:39:55.900114+0000","last_fullsized":"2023-10-09T15:39:55.900114+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:02:36.578868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.888803+0000","last_change":"2023-10-09T15:39:54.886221+0000","last_active":"2023-10-09T15:39:55.888803+0000","last_peered":"2023-10-09T15:39:55.888803+0000","last_clean":"2023-10-09T15:39:55.888803+0000","last_became_active":"2023-10-09T15:39:54.885919+0000","last_became_peered":"2023-10-09T15:39:54.885919+0000","last_unstale":"2023-10-09T15:39:55.888803+0000","last_undegraded":"2023-10-09T15:39:55.888803+0000","last_fullsized":"2023-10-09T15:39:55.888803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:28:45.372146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913818+0000","last_change":"2023-10-09T15:39:55.913818+0000","last_active":"2023-10-09T15:39:55.913818+0000","last_peered":"2023-10-09T15:39:55.913818+0000","last_clean":"2023-10-09T15:39:55.913818+0000","last_became_active":"2023-10-09T15:39:55.913505+0000","last_became_peered":"2023-10-09T15:39:55.913505+0000","last_unstale":"2023-10-09T15:39:55.913818+0000","last_undegraded":"2023-10-09T15:39:55.913818+0000","last_fullsized":"2023-10-09T15:39:55.913818+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:12:14.489381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.894732+0000","last_change":"2023-10-09T15:39:54.892268+0000","last_active":"2023-10-09T15:39:54.894732+0000","last_peered":"2023-10-09T15:39:54.894732+0000","last_clean":"2023-10-09T15:39:54.894732+0000","last_became_active":"2023-10-09T15:39:54.891984+0000","last_became_peered":"2023-10-09T15:39:54.891984+0000","last_unstale":"2023-10-09T15:39:54.894732+0000","last_undegraded":"2023-10-09T15:39:54.894732+0000","last_fullsized":"2023-10-09T15:39:54.894732+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:44.980542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.907147+0000","last_change":"2023-10-09T15:39:55.907147+0000","last_active":"2023-10-09T15:39:55.907147+0000","last_peered":"2023-10-09T15:39:55.907147+0000","last_clean":"2023-10-09T15:39:55.907147+0000","last_became_active":"2023-10-09T15:39:55.906848+0000","last_became_peered":"2023-10-09T15:39:55.906848+0000","last_unstale":"2023-10-09T15:39:55.907147+0000","last_undegraded":"2023-10-09T15:39:55.907147+0000","last_fullsized":"2023-10-09T15:39:55.907147+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:00.089874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.890289+0000","last_change":"2023-10-09T15:39:54.894586+0000","last_active":"2023-10-09T15:39:55.890289+0000","last_peered":"2023-10-09T15:39:55.890289+0000","last_clean":"2023-10-09T15:39:55.890289+0000","last_became_active":"2023-10-09T15:39:54.894202+0000","last_became_peered":"2023-10-09T15:39:54.894202+0000","last_unstale":"2023-10-09T15:39:55.890289+0000","last_undegraded":"2023-10-09T15:39:55.890289+0000","last_fullsized":"2023-10-09T15:39:55.890289+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.345787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913003+0000","last_change":"2023-10-09T15:39:55.909633+0000","last_active":"2023-10-09T15:39:55.913003+0000","last_peered":"2023-10-09T15:39:55.913003+0000","last_clean":"2023-10-09T15:39:55.913003+0000","last_became_active":"2023-10-09T15:39:55.909390+0000","last_became_peered":"2023-10-09T15:39:55.909390+0000","last_unstale":"2023-10-09T15:39:55.913003+0000","last_undegraded":"2023-10-09T15:39:55.913003+0000","last_fullsized":"2023-10-09T15:39:55.913003+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:46.142426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"185'3","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920977+0000","last_change":"2023-10-09T15:39:54.884844+0000","last_active":"2023-10-09T15:39:55.920977+0000","last_peered":"2023-10-09T15:39:55.920977+0000","last_clean":"2023-10-09T15:39:55.920977+0000","last_became_active":"2023-10-09T15:39:54.884413+0000","last_became_peered":"2023-10-09T15:39:54.884413+0000","last_unstale":"2023-10-09T15:39:55.920977+0000","last_undegraded":"2023-10-09T15:39:55.920977+0000","last_fullsized":"2023-10-09T15:39:55.920977+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:20.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901827+0000","last_change":"2023-10-09T15:39:55.901827+0000","last_active":"2023-10-09T15:39:55.901827+0000","last_peered":"2023-10-09T15:39:55.901827+0000","last_clean":"2023-10-09T15:39:55.901827+0000","last_became_active":"2023-10-09T15:39:55.901547+0000","last_became_peered":"2023-10-09T15:39:55.901547+0000","last_unstale":"2023-10-09T15:39:55.901827+0000","last_undegraded":"2023-10-09T15:39:55.901827+0000","last_fullsized":"2023-10-09T15:39:55.901827+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:26:30.010804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"185'6","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.921950+0000","last_change":"2023-10-09T15:39:54.887577+0000","last_active":"2023-10-09T15:39:55.921950+0000","last_peered":"2023-10-09T15:39:55.921950+0000","last_clean":"2023-10-09T15:39:55.921950+0000","last_became_active":"2023-10-09T15:39:54.887308+0000","last_became_peered":"2023-10-09T15:39:54.887308+0000","last_unstale":"2023-10-09T15:39:55.921950+0000","last_undegraded":"2023-10-09T15:39:55.921950+0000","last_fullsized":"2023-10-09T15:39:55.921950+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:29.692365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897745+0000","last_change":"2023-10-09T15:39:55.897745+0000","last_active":"2023-10-09T15:39:55.897745+0000","last_peered":"2023-10-09T15:39:55.897745+0000","last_clean":"2023-10-09T15:39:55.897745+0000","last_became_active":"2023-10-09T15:39:55.896927+0000","last_became_peered":"2023-10-09T15:39:55.896927+0000","last_unstale":"2023-10-09T15:39:55.897745+0000","last_undegraded":"2023-10-09T15:39:55.897745+0000","last_fullsized":"2023-10-09T15:39:55.897745+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:04:29.565823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920400+0000","last_change":"2023-10-09T15:39:54.890287+0000","last_active":"2023-10-09T15:39:55.920400+0000","last_peered":"2023-10-09T15:39:55.920400+0000","last_clean":"2023-10-09T15:39:55.920400+0000","last_became_active":"2023-10-09T15:39:54.890002+0000","last_became_peered":"2023-10-09T15:39:54.890002+0000","last_unstale":"2023-10-09T15:39:55.920400+0000","last_undegraded":"2023-10-09T15:39:55.920400+0000","last_fullsized":"2023-10-09T15:39:55.920400+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:05.467501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906009+0000","last_change":"2023-10-09T15:39:55.906009+0000","last_active":"2023-10-09T15:39:55.906009+0000","last_peered":"2023-10-09T15:39:55.906009+0000","last_clean":"2023-10-09T15:39:55.906009+0000","last_became_active":"2023-10-09T15:39:55.905354+0000","last_became_peered":"2023-10-09T15:39:55.905354+0000","last_unstale":"2023-10-09T15:39:55.906009+0000","last_undegraded":"2023-10-09T15:39:55.906009+0000","last_fullsized":"2023-10-09T15:39:55.906009+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:30.543114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.883861+0000","last_change":"2023-10-09T15:39:54.881717+0000","last_active":"2023-10-09T15:39:54.883861+0000","last_peered":"2023-10-09T15:39:54.883861+0000","last_clean":"2023-10-09T15:39:54.883861+0000","last_became_active":"2023-10-09T15:39:54.881421+0000","last_became_peered":"2023-10-09T15:39:54.881421+0000","last_unstale":"2023-10-09T15:39:54.883861+0000","last_undegraded":"2023-10-09T15:39:54.883861+0000","last_fullsized":"2023-10-09T15:39:54.883861+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:32.351257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920379+0000","last_change":"2023-10-09T15:39:55.917863+0000","last_active":"2023-10-09T15:39:55.920379+0000","last_peered":"2023-10-09T15:39:55.920379+0000","last_clean":"2023-10-09T15:39:55.920379+0000","last_became_active":"2023-10-09T15:39:55.917565+0000","last_became_peered":"2023-10-09T15:39:55.917565+0000","last_unstale":"2023-10-09T15:39:55.920379+0000","last_undegraded":"2023-10-09T15:39:55.920379+0000","last_fullsized":"2023-10-09T15:39:55.920379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:16.354319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.892438+0000","last_change":"2023-10-09T15:39:54.888852+0000","last_active":"2023-10-09T15:39:54.892438+0000","last_peered":"2023-10-09T15:39:54.892438+0000","last_clean":"2023-10-09T15:39:54.892438+0000","last_became_active":"2023-10-09T15:39:54.888559+0000","last_became_peered":"2023-10-09T15:39:54.888559+0000","last_unstale":"2023-10-09T15:39:54.892438+0000","last_undegraded":"2023-10-09T15:39:54.892438+0000","last_fullsized":"2023-10-09T15:39:54.892438+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:42.948117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906313+0000","last_change":"2023-10-09T15:39:55.906313+0000","last_active":"2023-10-09T15:39:55.906313+0000","last_peered":"2023-10-09T15:39:55.906313+0000","last_clean":"2023-10-09T15:39:55.906313+0000","last_became_active":"2023-10-09T15:39:55.906047+0000","last_became_peered":"2023-10-09T15:39:55.906047+0000","last_unstale":"2023-10-09T15:39:55.906313+0000","last_undegraded":"2023-10-09T15:39:55.906313+0000","last_fullsized":"2023-10-09T15:39:55.906313+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.301218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"185'8","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919747+0000","last_change":"2023-10-09T15:39:54.893786+0000","last_active":"2023-10-09T15:39:55.919747+0000","last_peered":"2023-10-09T15:39:55.919747+0000","last_clean":"2023-10-09T15:39:55.919747+0000","last_became_active":"2023-10-09T15:39:54.893511+0000","last_became_peered":"2023-10-09T15:39:54.893511+0000","last_unstale":"2023-10-09T15:39:55.919747+0000","last_undegraded":"2023-10-09T15:39:55.919747+0000","last_fullsized":"2023-10-09T15:39:55.919747+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:39:20.009034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.900052+0000","last_change":"2023-10-09T15:39:55.900052+0000","last_active":"2023-10-09T15:39:55.900052+0000","last_peered":"2023-10-09T15:39:55.900052+0000","last_clean":"2023-10-09T15:39:55.900052+0000","last_became_active":"2023-10-09T15:39:55.899790+0000","last_became_peered":"2023-10-09T15:39:55.899790+0000","last_unstale":"2023-10-09T15:39:55.900052+0000","last_undegraded":"2023-10-09T15:39:55.900052+0000","last_fullsized":"2023-10-09T15:39:55.900052+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.958194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920297+0000","last_change":"2023-10-09T15:39:54.882100+0000","last_active":"2023-10-09T15:39:55.920297+0000","last_peered":"2023-10-09T15:39:55.920297+0000","last_clean":"2023-10-09T15:39:55.920297+0000","last_became_active":"2023-10-09T15:39:54.881808+0000","last_became_peered":"2023-10-09T15:39:54.881808+0000","last_unstale":"2023-10-09T15:39:55.920297+0000","last_undegraded":"2023-10-09T15:39:55.920297+0000","last_fullsized":"2023-10-09T15:39:55.920297+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:27.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.908658+0000","last_change":"2023-10-09T15:39:55.908658+0000","last_active":"2023-10-09T15:39:55.908658+0000","last_peered":"2023-10-09T15:39:55.908658+0000","last_clean":"2023-10-09T15:39:55.908658+0000","last_became_active":"2023-10-09T15:39:55.908331+0000","last_became_peered":"2023-10-09T15:39:55.908331+0000","last_unstale":"2023-10-09T15:39:55.908658+0000","last_undegraded":"2023-10-09T15:39:55.908658+0000","last_fullsized":"2023-10-09T15:39:55.908658+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:45.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916248+0000","last_change":"2023-10-09T15:39:54.893160+0000","last_active":"2023-10-09T15:39:55.916248+0000","last_peered":"2023-10-09T15:39:55.916248+0000","last_clean":"2023-10-09T15:39:55.916248+0000","last_became_active":"2023-10-09T15:39:54.892899+0000","last_became_peered":"2023-10-09T15:39:54.892899+0000","last_unstale":"2023-10-09T15:39:55.916248+0000","last_undegraded":"2023-10-09T15:39:55.916248+0000","last_fullsized":"2023-10-09T15:39:55.916248+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.576923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.909254+0000","last_change":"2023-10-09T15:39:55.909254+0000","last_active":"2023-10-09T15:39:55.909254+0000","last_peered":"2023-10-09T15:39:55.909254+0000","last_clean":"2023-10-09T15:39:55.909254+0000","last_became_active":"2023-10-09T15:39:55.908950+0000","last_became_peered":"2023-10-09T15:39:55.908950+0000","last_unstale":"2023-10-09T15:39:55.909254+0000","last_undegraded":"2023-10-09T15:39:55.909254+0000","last_fullsized":"2023-10-09T15:39:55.909254+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.406491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905029+0000","last_change":"2023-10-09T15:39:54.885521+0000","last_active":"2023-10-09T15:39:55.905029+0000","last_peered":"2023-10-09T15:39:55.905029+0000","last_clean":"2023-10-09T15:39:55.905029+0000","last_became_active":"2023-10-09T15:39:54.884868+0000","last_became_peered":"2023-10-09T15:39:54.884868+0000","last_unstale":"2023-10-09T15:39:55.905029+0000","last_undegraded":"2023-10-09T15:39:55.905029+0000","last_fullsized":"2023-10-09T15:39:55.905029+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:23.191460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917549+0000","last_change":"2023-10-09T15:39:55.915354+0000","last_active":"2023-10-09T15:39:55.917549+0000","last_peered":"2023-10-09T15:39:55.917549+0000","last_clean":"2023-10-09T15:39:55.917549+0000","last_became_active":"2023-10-09T15:39:55.914771+0000","last_became_peered":"2023-10-09T15:39:55.914771+0000","last_unstale":"2023-10-09T15:39:55.917549+0000","last_undegraded":"2023-10-09T15:39:55.917549+0000","last_fullsized":"2023-10-09T15:39:55.917549+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:38.642990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.903163+0000","last_change":"2023-10-09T15:39:54.892813+0000","last_active":"2023-10-09T15:39:55.903163+0000","last_peered":"2023-10-09T15:39:55.903163+0000","last_clean":"2023-10-09T15:39:55.903163+0000","last_became_active":"2023-10-09T15:39:54.892501+0000","last_became_peered":"2023-10-09T15:39:54.892501+0000","last_unstale":"2023-10-09T15:39:55.903163+0000","last_undegraded":"2023-10-09T15:39:55.903163+0000","last_fullsized":"2023-10-09T15:39:55.903163+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.345787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896824+0000","last_change":"2023-10-09T15:39:55.895549+0000","last_active":"2023-10-09T15:39:55.896824+0000","last_peered":"2023-10-09T15:39:55.896824+0000","last_clean":"2023-10-09T15:39:55.896824+0000","last_became_active":"2023-10-09T15:39:55.895282+0000","last_became_peered":"2023-10-09T15:39:55.895282+0000","last_unstale":"2023-10-09T15:39:55.896824+0000","last_undegraded":"2023-10-09T15:39:55.896824+0000","last_fullsized":"2023-10-09T15:39:55.896824+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:57.724107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920487+0000","last_change":"2023-10-09T15:39:54.890744+0000","last_active":"2023-10-09T15:39:55.920487+0000","last_peered":"2023-10-09T15:39:55.920487+0000","last_clean":"2023-10-09T15:39:55.920487+0000","last_became_active":"2023-10-09T15:39:54.890463+0000","last_became_peered":"2023-10-09T15:39:54.890463+0000","last_unstale":"2023-10-09T15:39:55.920487+0000","last_undegraded":"2023-10-09T15:39:55.920487+0000","last_fullsized":"2023-10-09T15:39:55.920487+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:05.467501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898360+0000","last_change":"2023-10-09T15:39:55.898360+0000","last_active":"2023-10-09T15:39:55.898360+0000","last_peered":"2023-10-09T15:39:55.898360+0000","last_clean":"2023-10-09T15:39:55.898360+0000","last_became_active":"2023-10-09T15:39:55.898096+0000","last_became_peered":"2023-10-09T15:39:55.898096+0000","last_unstale":"2023-10-09T15:39:55.898360+0000","last_undegraded":"2023-10-09T15:39:55.898360+0000","last_fullsized":"2023-10-09T15:39:55.898360+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:13.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.892532+0000","last_change":"2023-10-09T15:39:54.889300+0000","last_active":"2023-10-09T15:39:54.892532+0000","last_peered":"2023-10-09T15:39:54.892532+0000","last_clean":"2023-10-09T15:39:54.892532+0000","last_became_active":"2023-10-09T15:39:54.889022+0000","last_became_peered":"2023-10-09T15:39:54.889022+0000","last_unstale":"2023-10-09T15:39:54.892532+0000","last_undegraded":"2023-10-09T15:39:54.892532+0000","last_fullsized":"2023-10-09T15:39:54.892532+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:46.787310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920286+0000","last_change":"2023-10-09T15:39:55.920286+0000","last_active":"2023-10-09T15:39:55.920286+0000","last_peered":"2023-10-09T15:39:55.920286+0000","last_clean":"2023-10-09T15:39:55.920286+0000","last_became_active":"2023-10-09T15:39:55.919985+0000","last_became_peered":"2023-10-09T15:39:55.919985+0000","last_unstale":"2023-10-09T15:39:55.920286+0000","last_undegraded":"2023-10-09T15:39:55.920286+0000","last_fullsized":"2023-10-09T15:39:55.920286+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.889354+0000","last_change":"2023-10-09T15:39:54.885095+0000","last_active":"2023-10-09T15:39:54.889354+0000","last_peered":"2023-10-09T15:39:54.889354+0000","last_clean":"2023-10-09T15:39:54.889354+0000","last_became_active":"2023-10-09T15:39:54.884811+0000","last_became_peered":"2023-10-09T15:39:54.884811+0000","last_unstale":"2023-10-09T15:39:54.889354+0000","last_undegraded":"2023-10-09T15:39:54.889354+0000","last_fullsized":"2023-10-09T15:39:54.889354+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:10.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911912+0000","last_change":"2023-10-09T15:39:55.911912+0000","last_active":"2023-10-09T15:39:55.911912+0000","last_peered":"2023-10-09T15:39:55.911912+0000","last_clean":"2023-10-09T15:39:55.911912+0000","last_became_active":"2023-10-09T15:39:55.911565+0000","last_became_peered":"2023-10-09T15:39:55.911565+0000","last_unstale":"2023-10-09T15:39:55.911912+0000","last_undegraded":"2023-10-09T15:39:55.911912+0000","last_fullsized":"2023-10-09T15:39:55.911912+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:49.624457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.889422+0000","last_change":"2023-10-09T15:39:54.885193+0000","last_active":"2023-10-09T15:39:54.889422+0000","last_peered":"2023-10-09T15:39:54.889422+0000","last_clean":"2023-10-09T15:39:54.889422+0000","last_became_active":"2023-10-09T15:39:54.884865+0000","last_became_peered":"2023-10-09T15:39:54.884865+0000","last_unstale":"2023-10-09T15:39:54.889422+0000","last_undegraded":"2023-10-09T15:39:54.889422+0000","last_fullsized":"2023-10-09T15:39:54.889422+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:45.134711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905224+0000","last_change":"2023-10-09T15:39:55.905224+0000","last_active":"2023-10-09T15:39:55.905224+0000","last_peered":"2023-10-09T15:39:55.905224+0000","last_clean":"2023-10-09T15:39:55.905224+0000","last_became_active":"2023-10-09T15:39:55.904902+0000","last_became_peered":"2023-10-09T15:39:55.904902+0000","last_unstale":"2023-10-09T15:39:55.905224+0000","last_undegraded":"2023-10-09T15:39:55.905224+0000","last_fullsized":"2023-10-09T15:39:55.905224+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:38.079156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916428+0000","last_change":"2023-10-09T15:39:54.890914+0000","last_active":"2023-10-09T15:39:55.916428+0000","last_peered":"2023-10-09T15:39:55.916428+0000","last_clean":"2023-10-09T15:39:55.916428+0000","last_became_active":"2023-10-09T15:39:54.890643+0000","last_became_peered":"2023-10-09T15:39:54.890643+0000","last_unstale":"2023-10-09T15:39:55.916428+0000","last_undegraded":"2023-10-09T15:39:55.916428+0000","last_fullsized":"2023-10-09T15:39:55.916428+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:25.676173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.921752+0000","last_change":"2023-10-09T15:39:55.918506+0000","last_active":"2023-10-09T15:39:55.921752+0000","last_peered":"2023-10-09T15:39:55.921752+0000","last_clean":"2023-10-09T15:39:55.921752+0000","last_became_active":"2023-10-09T15:39:55.917582+0000","last_became_peered":"2023-10-09T15:39:55.917582+0000","last_unstale":"2023-10-09T15:39:55.921752+0000","last_undegraded":"2023-10-09T15:39:55.921752+0000","last_fullsized":"2023-10-09T15:39:55.921752+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:46.142426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.891873+0000","last_change":"2023-10-09T15:39:54.887836+0000","last_active":"2023-10-09T15:39:54.891873+0000","last_peered":"2023-10-09T15:39:54.891873+0000","last_clean":"2023-10-09T15:39:54.891873+0000","last_became_active":"2023-10-09T15:39:54.887533+0000","last_became_peered":"2023-10-09T15:39:54.887533+0000","last_unstale":"2023-10-09T15:39:54.891873+0000","last_undegraded":"2023-10-09T15:39:54.891873+0000","last_fullsized":"2023-10-09T15:39:54.891873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:29.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901838+0000","last_change":"2023-10-09T15:39:55.900165+0000","last_active":"2023-10-09T15:39:55.901838+0000","last_peered":"2023-10-09T15:39:55.901838+0000","last_clean":"2023-10-09T15:39:55.901838+0000","last_became_active":"2023-10-09T15:39:55.898994+0000","last_became_peered":"2023-10-09T15:39:55.898994+0000","last_unstale":"2023-10-09T15:39:55.901838+0000","last_undegraded":"2023-10-09T15:39:55.901838+0000","last_fullsized":"2023-10-09T15:39:55.901838+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:14.403681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.896642+0000","last_change":"2023-10-09T15:39:54.895633+0000","last_active":"2023-10-09T15:39:54.896642+0000","last_peered":"2023-10-09T15:39:54.896642+0000","last_clean":"2023-10-09T15:39:54.896642+0000","last_became_active":"2023-10-09T15:39:54.895323+0000","last_became_peered":"2023-10-09T15:39:54.895323+0000","last_unstale":"2023-10-09T15:39:54.896642+0000","last_undegraded":"2023-10-09T15:39:54.896642+0000","last_fullsized":"2023-10-09T15:39:54.896642+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:35.947599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913808+0000","last_change":"2023-10-09T15:39:55.913808+0000","last_active":"2023-10-09T15:39:55.913808+0000","last_peered":"2023-10-09T15:39:55.913808+0000","last_clean":"2023-10-09T15:39:55.913808+0000","last_became_active":"2023-10-09T15:39:55.908708+0000","last_became_peered":"2023-10-09T15:39:55.908708+0000","last_unstale":"2023-10-09T15:39:55.913808+0000","last_undegraded":"2023-10-09T15:39:55.913808+0000","last_fullsized":"2023-10-09T15:39:55.913808+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:26.683888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.890288+0000","last_change":"2023-10-09T15:39:54.885336+0000","last_active":"2023-10-09T15:39:54.890288+0000","last_peered":"2023-10-09T15:39:54.890288+0000","last_clean":"2023-10-09T15:39:54.890288+0000","last_became_active":"2023-10-09T15:39:54.884969+0000","last_became_peered":"2023-10-09T15:39:54.884969+0000","last_unstale":"2023-10-09T15:39:54.890288+0000","last_undegraded":"2023-10-09T15:39:54.890288+0000","last_fullsized":"2023-10-09T15:39:54.890288+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:41.191911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905804+0000","last_change":"2023-10-09T15:39:55.905804+0000","last_active":"2023-10-09T15:39:55.905804+0000","last_peered":"2023-10-09T15:39:55.905804+0000","last_clean":"2023-10-09T15:39:55.905804+0000","last_became_active":"2023-10-09T15:39:55.905431+0000","last_became_peered":"2023-10-09T15:39:55.905431+0000","last_unstale":"2023-10-09T15:39:55.905804+0000","last_undegraded":"2023-10-09T15:39:55.905804+0000","last_fullsized":"2023-10-09T15:39:55.905804+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:27.949554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.893655+0000","last_change":"2023-10-09T15:39:54.889548+0000","last_active":"2023-10-09T15:39:54.893655+0000","last_peered":"2023-10-09T15:39:54.893655+0000","last_clean":"2023-10-09T15:39:54.893655+0000","last_became_active":"2023-10-09T15:39:54.889088+0000","last_became_peered":"2023-10-09T15:39:54.889088+0000","last_unstale":"2023-10-09T15:39:54.893655+0000","last_undegraded":"2023-10-09T15:39:54.893655+0000","last_fullsized":"2023-10-09T15:39:54.893655+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:37.049528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.894017+0000","last_change":"2023-10-09T15:39:55.891975+0000","last_active":"2023-10-09T15:39:55.894017+0000","last_peered":"2023-10-09T15:39:55.894017+0000","last_clean":"2023-10-09T15:39:55.894017+0000","last_became_active":"2023-10-09T15:39:55.891693+0000","last_became_peered":"2023-10-09T15:39:55.891693+0000","last_unstale":"2023-10-09T15:39:55.894017+0000","last_undegraded":"2023-10-09T15:39:55.894017+0000","last_fullsized":"2023-10-09T15:39:55.894017+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:42.325136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.887217+0000","last_change":"2023-10-09T15:39:54.885613+0000","last_active":"2023-10-09T15:39:54.887217+0000","last_peered":"2023-10-09T15:39:54.887217+0000","last_clean":"2023-10-09T15:39:54.887217+0000","last_became_active":"2023-10-09T15:39:54.885336+0000","last_became_peered":"2023-10-09T15:39:54.885336+0000","last_unstale":"2023-10-09T15:39:54.887217+0000","last_undegraded":"2023-10-09T15:39:54.887217+0000","last_fullsized":"2023-10-09T15:39:54.887217+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:08.025583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898422+0000","last_change":"2023-10-09T15:39:55.898422+0000","last_active":"2023-10-09T15:39:55.898422+0000","last_peered":"2023-10-09T15:39:55.898422+0000","last_clean":"2023-10-09T15:39:55.898422+0000","last_became_active":"2023-10-09T15:39:55.898153+0000","last_became_peered":"2023-10-09T15:39:55.898153+0000","last_unstale":"2023-10-09T15:39:55.898422+0000","last_undegraded":"2023-10-09T15:39:55.898422+0000","last_fullsized":"2023-10-09T15:39:55.898422+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:47.220672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.890100+0000","last_change":"2023-10-09T15:39:54.892978+0000","last_active":"2023-10-09T15:39:55.890100+0000","last_peered":"2023-10-09T15:39:55.890100+0000","last_clean":"2023-10-09T15:39:55.890100+0000","last_became_active":"2023-10-09T15:39:54.892715+0000","last_became_peered":"2023-10-09T15:39:54.892715+0000","last_unstale":"2023-10-09T15:39:55.890100+0000","last_undegraded":"2023-10-09T15:39:55.890100+0000","last_fullsized":"2023-10-09T15:39:55.890100+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:19.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.912401+0000","last_change":"2023-10-09T15:39:55.912401+0000","last_active":"2023-10-09T15:39:55.912401+0000","last_peered":"2023-10-09T15:39:55.912401+0000","last_clean":"2023-10-09T15:39:55.912401+0000","last_became_active":"2023-10-09T15:39:55.912098+0000","last_became_peered":"2023-10-09T15:39:55.912098+0000","last_unstale":"2023-10-09T15:39:55.912401+0000","last_undegraded":"2023-10-09T15:39:55.912401+0000","last_fullsized":"2023-10-09T15:39:55.912401+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:32:43.230112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.885049+0000","last_change":"2023-10-09T15:39:54.882611+0000","last_active":"2023-10-09T15:39:54.885049+0000","last_peered":"2023-10-09T15:39:54.885049+0000","last_clean":"2023-10-09T15:39:54.885049+0000","last_became_active":"2023-10-09T15:39:54.882331+0000","last_became_peered":"2023-10-09T15:39:54.882331+0000","last_unstale":"2023-10-09T15:39:54.885049+0000","last_undegraded":"2023-10-09T15:39:54.885049+0000","last_fullsized":"2023-10-09T15:39:54.885049+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:39.629647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898923+0000","last_change":"2023-10-09T15:39:55.896771+0000","last_active":"2023-10-09T15:39:55.898923+0000","last_peered":"2023-10-09T15:39:55.898923+0000","last_clean":"2023-10-09T15:39:55.898923+0000","last_became_active":"2023-10-09T15:39:55.896519+0000","last_became_peered":"2023-10-09T15:39:55.896519+0000","last_unstale":"2023-10-09T15:39:55.898923+0000","last_undegraded":"2023-10-09T15:39:55.898923+0000","last_fullsized":"2023-10-09T15:39:55.898923+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:15.306323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896527+0000","last_change":"2023-10-09T15:39:54.886291+0000","last_active":"2023-10-09T15:39:55.896527+0000","last_peered":"2023-10-09T15:39:55.896527+0000","last_clean":"2023-10-09T15:39:55.896527+0000","last_became_active":"2023-10-09T15:39:54.885670+0000","last_became_peered":"2023-10-09T15:39:54.885670+0000","last_unstale":"2023-10-09T15:39:55.896527+0000","last_undegraded":"2023-10-09T15:39:55.896527+0000","last_fullsized":"2023-10-09T15:39:55.896527+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:12.740327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":301,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.904186+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:39:55.904186+0000","last_peered":"2023-10-09T15:39:55.904186+0000","last_clean":"2023-10-09T15:39:55.904186+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:39:55.904186+0000","last_undegraded":"2023-10-09T15:39:55.904186+0000","last_fullsized":"2023-10-09T15:39:55.904186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304280,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067560,"statfs":{"total":96636764160,"available":96325181440,"internally_reserved":0,"allocated":2965504,"data_stored":1655861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.77500000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.874},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.44},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.71799999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78000000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":0.84399999999999997,"15min":0.88},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2359296,"data_stored":1059193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.83699999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.78400000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53000000000000003,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":1.379},"last":0.378},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.3999999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.73699999999999999},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.872},"last":0.627}]},{"osd":5,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.89700000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.87,"5min":0.87,"15min":1.004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1065369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33800000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.215},"max":{"1min":0.44700000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.246},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.34699999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46800000000000003,"5min":0.55300000000000005,"15min":1.512},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33200000000000002,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.437,"5min":0.56399999999999995,"15min":1.286},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.96899999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.54600000000000004,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.34599999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.377,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.222},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77400000000000002,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66200000000000003,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93100000000000005,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.76800000000000002},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.93600000000000005,"15min":1.258},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65700000000000003,"15min":0.66600000000000004},"min":{"1min":0.46700000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.996,"15min":0.997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.77300000000000002},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77100000000000002,"5min":1.024,"15min":5.5819999999999999},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304268,"kb_used_data":2884,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067572,"statfs":{"total":96636764160,"available":96325193728,"internally_reserved":0,"allocated":2953216,"data_stored":1649974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54500000000000004,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55900000000000005,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.441,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":6.484,"15min":6.484},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45900000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33400000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.495},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44,"15min":0.57599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":2.109,"15min":4.5890000000000004},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76000000000000001,"5min":1.921,"15min":1.921},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.64400000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.508},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.621},{"interface":"front","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":2.032,"15min":2.032},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.46400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2359296,"data_stored":1059705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.44500000000000001,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.35599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.441,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.22500000000000001},"max":{"1min":0.442,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.436},{"interface":"front","average":{"1min":0.371,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46600000000000003,"5min":0.622,"15min":0.73699999999999999},"last":0.41699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.46400000000000002,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.504}]},{"osd":4,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.71999999999999997,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79900000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":2.5249999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90000000000000002,"5min":0.997,"15min":1.5189999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":1.0620000000000001,"15min":1.407},"last":0.879},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.90600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303716,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068124,"statfs":{"total":96636764160,"available":96325758976,"internally_reserved":0,"allocated":2387968,"data_stored":1067515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.76100000000000001},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54000000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.254}]},{"osd":1,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.58999999999999997},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.224},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.378,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.372,"15min":1.143},"min":{"1min":0.311,"5min":0.247,"15min":0.247},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.65900000000000003},"min":{"1min":0.29999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":0.996,"15min":17.02},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.84199999999999997},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.498,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":1.004},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.85199999999999998},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.016,"5min":1.016,"15min":1.278},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":1.044},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":9.6029999999999998},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303684,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068156,"statfs":{"total":96636764160,"available":96325791744,"internally_reserved":0,"allocated":2355200,"data_stored":1059151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":2.879},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.96899999999999997},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.495}]},{"osd":3,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34599999999999997},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78700000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.51400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.245,"15min":0.245},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2351104,"data_stored":1059081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.87},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.439,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.79400000000000004,"15min":1.165},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.45100000000000001,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.871,"15min":2.089},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.81299999999999994},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.44},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.83799999999999997},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.504}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.84299999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":1.0569999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83399999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":1.016},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.83499999999999996,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:40:00.016 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:40:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.169+0000 7fefbda35700 1 Processor -- start 2023-10-09T15:40:00.169 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.169+0000 7fefbda35700 1 -- start start 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefbda35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 0x7fefb8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefbda35700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb815ae40 con 0x7fefb80cb5a0 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefbda35700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb815ab60 con 0x7fefb815a400 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefbda35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80ce0f0 con 0x7fefb80cb970 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fefb80cb5a0 0x7fefb80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47022/0 (socket says 172.21.15.33:47022) 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb6ffd700 1 -- 172.21.15.33:0/1867708870 learned_addr learned my addr 172.21.15.33:0/1867708870 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb67fc700 1 --2- 172.21.15.33:0/1867708870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 0x7fefb8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.171 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2472815788 0 0) 0x7fefb815ae40 con 0x7fefb80cb5a0 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefa0003570 con 0x7fefb80cb5a0 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1058619632 0 0) 0x7fefb815ab60 con 0x7fefb815a400 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fefb815ae40 con 0x7fefb815a400 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb67fc700 1 -- 172.21.15.33:0/1867708870 >> v1:172.21.15.59:6789/0 conn(0x7fefb815a400 legacy=0x7fefb8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2599890517 0 0) 0x7fefa0003570 con 0x7fefb80cb5a0 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb67fc700 1 -- 172.21.15.33:0/1867708870 >> v1:172.21.15.33:6789/0 conn(0x7fefb80cb5a0 legacy=0x7fefb80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.170+0000 7fefb67fc700 1 -- 172.21.15.33:0/1867708870 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb80ccf00 con 0x7fefb80cb970 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefb67fc700 1 --2- 172.21.15.33:0/1867708870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 0x7fefb8159ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefac009910 tx=0x7fefac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aa93b6e5e54d4ca5 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa8001470 con 0x7fefb80cb970 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac011420 con 0x7fefb80cb970 2023-10-09T15:40:00.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefb5ffb700 1 -- 172.21.15.33:0/1867708870 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0117a0 con 0x7fefb80cb970 2023-10-09T15:40:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefbda35700 1 -- 172.21.15.33:0/1867708870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 msgr2=0x7fefb8159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefbda35700 1 --2- 172.21.15.33:0/1867708870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 0x7fefb8159ec0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fefac009910 tx=0x7fefac0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.173 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefbda35700 1 -- 172.21.15.33:0/1867708870 shutdown_connections 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefbda35700 1 --2- 172.21.15.33:0/1867708870 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb970 0x7fefb8159ec0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.171+0000 7fefbda35700 1 -- 172.21.15.33:0/1867708870 >> 172.21.15.33:0/1867708870 conn(0x7fefb8070e30 msgr2=0x7fefb80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.172+0000 7fefbda35700 1 -- 172.21.15.33:0/1867708870 shutdown_connections 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.172+0000 7fefbda35700 1 -- 172.21.15.33:0/1867708870 wait complete. 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.173+0000 7fefbda35700 1 Processor -- start 2023-10-09T15:40:00.174 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.173+0000 7fefbda35700 1 -- start start 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb5a0 0x7fefb814fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb80cb970 0x7fefb8151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb80cbde0 con 0x7fefb815a400 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb815b070 con 0x7fefb80cb970 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefbda35700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb8154ac0 con 0x7fefb80cb5a0 2023-10-09T15:40:00.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefb77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42944/0 (socket says 172.21.15.33:42944) 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefb77fe700 1 -- 172.21.15.33:0/3564827671 learned_addr learned my addr 172.21.15.33:0/3564827671 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefb67fc700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb80cb970 0x7fefb8151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.174+0000 7fefb6ffd700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb5a0 0x7fefb814fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 -- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb5a0 msgr2=0x7fefb814fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb5a0 0x7fefb814fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 -- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb80cb970 msgr2=0x7fefb8151450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb80cb970 0x7fefb8151450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 -- 172.21.15.33:0/3564827671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009420 con 0x7fefb815a400 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefb77fe700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c860 tx=0x7fefb0002700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0002030 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb8155080 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefb00021b0 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefb0012630 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.175+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb8152240 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.176+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb804c3c0 con 0x7fefb815a400 2023-10-09T15:40:00.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.176+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fefb00129e0 con 0x7fefb815a400 2023-10-09T15:40:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.177+0000 7fef9effd700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 0x7fefa40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.177+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fefb0084b80 con 0x7fefb815a400 2023-10-09T15:40:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.177+0000 7fefb6ffd700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 0x7fefa40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.177+0000 7fefb6ffd700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 0x7fefa40697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fefb8157270 tx=0x7fefa8000bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.181+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fefb0051810 con 0x7fefb815a400 2023-10-09T15:40:00.375 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.375+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fefb80c5ef0 con 0x7fefa4067320 2023-10-09T15:40:00.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.383+0000 7fef9effd700 1 -- 172.21.15.33:0/3564827671 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289803 (secure 0 0 0) 0x7fefb80c5ef0 con 0x7fefa4067320 2023-10-09T15:40:00.386 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.386+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 msgr2=0x7fefa40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.386+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 0x7fefa40697d0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fefb8157270 tx=0x7fefa8000bc0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 msgr2=0x7fefb8157600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7fefb000c860 tx=0x7fefb0002700 comp rx=0 tx=0).stop 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 shutdown_connections 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fefa4067320 0x7fefa40697d0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fefb815a400 0x7fefb8157600 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fefb80cb5a0 0x7fefb814fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 --2- 172.21.15.33:0/3564827671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fefb80cb970 0x7fefb8151450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 >> 172.21.15.33:0/3564827671 conn(0x7fefb8070e30 msgr2=0x7fefb80b06e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 shutdown_connections 2023-10-09T15:40:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.387+0000 7fefbda35700 1 -- 172.21.15.33:0/3564827671 wait complete. 2023-10-09T15:40:00.390 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:40:00.399 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":452,"stamp":"2023-10-09T15:39:59.343661+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":126,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2430696,"kb_used_data":19624,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752544024,"statfs":{"total":773094113280,"available":770605080576,"internally_reserved":0,"allocated":20094976,"data_stored":9675849,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.474603"},"pg_stats":[{"pgid":"32.1f","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898792+0000","last_change":"2023-10-09T15:39:55.895774+0000","last_active":"2023-10-09T15:39:55.898792+0000","last_peered":"2023-10-09T15:39:55.898792+0000","last_clean":"2023-10-09T15:39:55.898792+0000","last_became_active":"2023-10-09T15:39:55.895466+0000","last_became_peered":"2023-10-09T15:39:55.895466+0000","last_unstale":"2023-10-09T15:39:55.898792+0000","last_undegraded":"2023-10-09T15:39:55.898792+0000","last_fullsized":"2023-10-09T15:39:55.898792+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:00.179478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.1e","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.895010+0000","last_change":"2023-10-09T15:39:55.895010+0000","last_active":"2023-10-09T15:39:55.895010+0000","last_peered":"2023-10-09T15:39:55.895010+0000","last_clean":"2023-10-09T15:39:55.895010+0000","last_became_active":"2023-10-09T15:39:55.894684+0000","last_became_peered":"2023-10-09T15:39:55.894684+0000","last_unstale":"2023-10-09T15:39:55.895010+0000","last_undegraded":"2023-10-09T15:39:55.895010+0000","last_fullsized":"2023-10-09T15:39:55.895010+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:24:48.474424+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.1d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906725+0000","last_change":"2023-10-09T15:39:55.905754+0000","last_active":"2023-10-09T15:39:55.906725+0000","last_peered":"2023-10-09T15:39:55.906725+0000","last_clean":"2023-10-09T15:39:55.906725+0000","last_became_active":"2023-10-09T15:39:55.905473+0000","last_became_peered":"2023-10-09T15:39:55.905473+0000","last_unstale":"2023-10-09T15:39:55.906725+0000","last_undegraded":"2023-10-09T15:39:55.906725+0000","last_fullsized":"2023-10-09T15:39:55.906725+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:11.499228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1c","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917560+0000","last_change":"2023-10-09T15:39:55.915394+0000","last_active":"2023-10-09T15:39:55.917560+0000","last_peered":"2023-10-09T15:39:55.917560+0000","last_clean":"2023-10-09T15:39:55.917560+0000","last_became_active":"2023-10-09T15:39:55.914844+0000","last_became_peered":"2023-10-09T15:39:55.914844+0000","last_unstale":"2023-10-09T15:39:55.917560+0000","last_undegraded":"2023-10-09T15:39:55.917560+0000","last_fullsized":"2023-10-09T15:39:55.917560+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:25.316637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.1b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917481+0000","last_change":"2023-10-09T15:39:55.917481+0000","last_active":"2023-10-09T15:39:55.917481+0000","last_peered":"2023-10-09T15:39:55.917481+0000","last_clean":"2023-10-09T15:39:55.917481+0000","last_became_active":"2023-10-09T15:39:55.917202+0000","last_became_peered":"2023-10-09T15:39:55.917202+0000","last_unstale":"2023-10-09T15:39:55.917481+0000","last_undegraded":"2023-10-09T15:39:55.917481+0000","last_fullsized":"2023-10-09T15:39:55.917481+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:40.473819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.1a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918855+0000","last_change":"2023-10-09T15:39:55.913750+0000","last_active":"2023-10-09T15:39:55.918855+0000","last_peered":"2023-10-09T15:39:55.918855+0000","last_clean":"2023-10-09T15:39:55.918855+0000","last_became_active":"2023-10-09T15:39:55.913442+0000","last_became_peered":"2023-10-09T15:39:55.913442+0000","last_unstale":"2023-10-09T15:39:55.918855+0000","last_undegraded":"2023-10-09T15:39:55.918855+0000","last_fullsized":"2023-10-09T15:39:55.918855+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:44:53.508615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.19","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.904007+0000","last_change":"2023-10-09T15:39:55.904007+0000","last_active":"2023-10-09T15:39:55.904007+0000","last_peered":"2023-10-09T15:39:55.904007+0000","last_clean":"2023-10-09T15:39:55.904007+0000","last_became_active":"2023-10-09T15:39:55.903682+0000","last_became_peered":"2023-10-09T15:39:55.903682+0000","last_unstale":"2023-10-09T15:39:55.904007+0000","last_undegraded":"2023-10-09T15:39:55.904007+0000","last_fullsized":"2023-10-09T15:39:55.904007+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:56.174152+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.18","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899528+0000","last_change":"2023-10-09T15:39:55.899528+0000","last_active":"2023-10-09T15:39:55.899528+0000","last_peered":"2023-10-09T15:39:55.899528+0000","last_clean":"2023-10-09T15:39:55.899528+0000","last_became_active":"2023-10-09T15:39:55.899233+0000","last_became_peered":"2023-10-09T15:39:55.899233+0000","last_unstale":"2023-10-09T15:39:55.899528+0000","last_undegraded":"2023-10-09T15:39:55.899528+0000","last_fullsized":"2023-10-09T15:39:55.899528+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:51.737974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.17","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918701+0000","last_change":"2023-10-09T15:39:55.908566+0000","last_active":"2023-10-09T15:39:55.918701+0000","last_peered":"2023-10-09T15:39:55.918701+0000","last_clean":"2023-10-09T15:39:55.918701+0000","last_became_active":"2023-10-09T15:39:55.908322+0000","last_became_peered":"2023-10-09T15:39:55.908322+0000","last_unstale":"2023-10-09T15:39:55.918701+0000","last_undegraded":"2023-10-09T15:39:55.918701+0000","last_fullsized":"2023-10-09T15:39:55.918701+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:28:29.731630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.16","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901829+0000","last_change":"2023-10-09T15:39:55.899947+0000","last_active":"2023-10-09T15:39:55.901829+0000","last_peered":"2023-10-09T15:39:55.901829+0000","last_clean":"2023-10-09T15:39:55.901829+0000","last_became_active":"2023-10-09T15:39:55.899663+0000","last_became_peered":"2023-10-09T15:39:55.899663+0000","last_unstale":"2023-10-09T15:39:55.901829+0000","last_undegraded":"2023-10-09T15:39:55.901829+0000","last_fullsized":"2023-10-09T15:39:55.901829+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:24.472329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.15","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901803+0000","last_change":"2023-10-09T15:39:55.899896+0000","last_active":"2023-10-09T15:39:55.901803+0000","last_peered":"2023-10-09T15:39:55.901803+0000","last_clean":"2023-10-09T15:39:55.901803+0000","last_became_active":"2023-10-09T15:39:55.899607+0000","last_became_peered":"2023-10-09T15:39:55.899607+0000","last_unstale":"2023-10-09T15:39:55.901803+0000","last_undegraded":"2023-10-09T15:39:55.901803+0000","last_fullsized":"2023-10-09T15:39:55.901803+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:21.887582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.14","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919358+0000","last_change":"2023-10-09T15:39:55.914118+0000","last_active":"2023-10-09T15:39:55.919358+0000","last_peered":"2023-10-09T15:39:55.919358+0000","last_clean":"2023-10-09T15:39:55.919358+0000","last_became_active":"2023-10-09T15:39:55.913791+0000","last_became_peered":"2023-10-09T15:39:55.913791+0000","last_unstale":"2023-10-09T15:39:55.919358+0000","last_undegraded":"2023-10-09T15:39:55.919358+0000","last_fullsized":"2023-10-09T15:39:55.919358+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:51:30.321300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.13","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911572+0000","last_change":"2023-10-09T15:39:55.911572+0000","last_active":"2023-10-09T15:39:55.911572+0000","last_peered":"2023-10-09T15:39:55.911572+0000","last_clean":"2023-10-09T15:39:55.911572+0000","last_became_active":"2023-10-09T15:39:55.911250+0000","last_became_peered":"2023-10-09T15:39:55.911250+0000","last_unstale":"2023-10-09T15:39:55.911572+0000","last_undegraded":"2023-10-09T15:39:55.911572+0000","last_fullsized":"2023-10-09T15:39:55.911572+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:33.358972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.12","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899108+0000","last_change":"2023-10-09T15:39:55.899108+0000","last_active":"2023-10-09T15:39:55.899108+0000","last_peered":"2023-10-09T15:39:55.899108+0000","last_clean":"2023-10-09T15:39:55.899108+0000","last_became_active":"2023-10-09T15:39:55.898722+0000","last_became_peered":"2023-10-09T15:39:55.898722+0000","last_unstale":"2023-10-09T15:39:55.899108+0000","last_undegraded":"2023-10-09T15:39:55.899108+0000","last_fullsized":"2023-10-09T15:39:55.899108+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:41:34.773414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.11","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920509+0000","last_change":"2023-10-09T15:39:55.917415+0000","last_active":"2023-10-09T15:39:55.920509+0000","last_peered":"2023-10-09T15:39:55.920509+0000","last_clean":"2023-10-09T15:39:55.920509+0000","last_became_active":"2023-10-09T15:39:55.913414+0000","last_became_peered":"2023-10-09T15:39:55.913414+0000","last_unstale":"2023-10-09T15:39:55.920509+0000","last_undegraded":"2023-10-09T15:39:55.920509+0000","last_fullsized":"2023-10-09T15:39:55.920509+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:29:40.473819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.10","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896460+0000","last_change":"2023-10-09T15:39:55.893945+0000","last_active":"2023-10-09T15:39:55.896460+0000","last_peered":"2023-10-09T15:39:55.896460+0000","last_clean":"2023-10-09T15:39:55.896460+0000","last_became_active":"2023-10-09T15:39:55.893679+0000","last_became_peered":"2023-10-09T15:39:55.893679+0000","last_unstale":"2023-10-09T15:39:55.896460+0000","last_undegraded":"2023-10-09T15:39:55.896460+0000","last_fullsized":"2023-10-09T15:39:55.896460+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:24.478441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911320+0000","last_change":"2023-10-09T15:39:55.911320+0000","last_active":"2023-10-09T15:39:55.911320+0000","last_peered":"2023-10-09T15:39:55.911320+0000","last_clean":"2023-10-09T15:39:55.911320+0000","last_became_active":"2023-10-09T15:39:55.911024+0000","last_became_peered":"2023-10-09T15:39:55.911024+0000","last_unstale":"2023-10-09T15:39:55.911320+0000","last_undegraded":"2023-10-09T15:39:55.911320+0000","last_fullsized":"2023-10-09T15:39:55.911320+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:43.955832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896408+0000","last_change":"2023-10-09T15:39:55.892809+0000","last_active":"2023-10-09T15:39:55.896408+0000","last_peered":"2023-10-09T15:39:55.896408+0000","last_clean":"2023-10-09T15:39:55.896408+0000","last_became_active":"2023-10-09T15:39:55.892550+0000","last_became_peered":"2023-10-09T15:39:55.892550+0000","last_unstale":"2023-10-09T15:39:55.896408+0000","last_undegraded":"2023-10-09T15:39:55.896408+0000","last_fullsized":"2023-10-09T15:39:55.896408+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:45.988258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919883+0000","last_change":"2023-10-09T15:39:55.913637+0000","last_active":"2023-10-09T15:39:55.919883+0000","last_peered":"2023-10-09T15:39:55.919883+0000","last_clean":"2023-10-09T15:39:55.919883+0000","last_became_active":"2023-10-09T15:39:55.913311+0000","last_became_peered":"2023-10-09T15:39:55.913311+0000","last_unstale":"2023-10-09T15:39:55.919883+0000","last_undegraded":"2023-10-09T15:39:55.919883+0000","last_fullsized":"2023-10-09T15:39:55.919883+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:59.849938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899956+0000","last_change":"2023-10-09T15:39:55.899956+0000","last_active":"2023-10-09T15:39:55.899956+0000","last_peered":"2023-10-09T15:39:55.899956+0000","last_clean":"2023-10-09T15:39:55.899956+0000","last_became_active":"2023-10-09T15:39:55.899713+0000","last_became_peered":"2023-10-09T15:39:55.899713+0000","last_unstale":"2023-10-09T15:39:55.899956+0000","last_undegraded":"2023-10-09T15:39:55.899956+0000","last_fullsized":"2023-10-09T15:39:55.899956+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:19:47.898670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918482+0000","last_change":"2023-10-09T15:39:55.918482+0000","last_active":"2023-10-09T15:39:55.918482+0000","last_peered":"2023-10-09T15:39:55.918482+0000","last_clean":"2023-10-09T15:39:55.918482+0000","last_became_active":"2023-10-09T15:39:55.918128+0000","last_became_peered":"2023-10-09T15:39:55.918128+0000","last_unstale":"2023-10-09T15:39:55.918482+0000","last_undegraded":"2023-10-09T15:39:55.918482+0000","last_fullsized":"2023-10-09T15:39:55.918482+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:02:38.421611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.a","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.902311+0000","last_change":"2023-10-09T15:39:55.902311+0000","last_active":"2023-10-09T15:39:55.902311+0000","last_peered":"2023-10-09T15:39:55.902311+0000","last_clean":"2023-10-09T15:39:55.902311+0000","last_became_active":"2023-10-09T15:39:55.902025+0000","last_became_peered":"2023-10-09T15:39:55.902025+0000","last_unstale":"2023-10-09T15:39:55.902311+0000","last_undegraded":"2023-10-09T15:39:55.902311+0000","last_fullsized":"2023-10-09T15:39:55.902311+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:15:41.007069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.9","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920531+0000","last_change":"2023-10-09T15:39:55.917619+0000","last_active":"2023-10-09T15:39:55.920531+0000","last_peered":"2023-10-09T15:39:55.920531+0000","last_clean":"2023-10-09T15:39:55.920531+0000","last_became_active":"2023-10-09T15:39:55.913785+0000","last_became_peered":"2023-10-09T15:39:55.913785+0000","last_unstale":"2023-10-09T15:39:55.920531+0000","last_undegraded":"2023-10-09T15:39:55.920531+0000","last_fullsized":"2023-10-09T15:39:55.920531+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:42.199626+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.8","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.910283+0000","last_change":"2023-10-09T15:39:55.910283+0000","last_active":"2023-10-09T15:39:55.910283+0000","last_peered":"2023-10-09T15:39:55.910283+0000","last_clean":"2023-10-09T15:39:55.910283+0000","last_became_active":"2023-10-09T15:39:55.909929+0000","last_became_peered":"2023-10-09T15:39:55.909929+0000","last_unstale":"2023-10-09T15:39:55.910283+0000","last_undegraded":"2023-10-09T15:39:55.910283+0000","last_fullsized":"2023-10-09T15:39:55.910283+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:02:25.392840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.7","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896660+0000","last_change":"2023-10-09T15:39:55.896660+0000","last_active":"2023-10-09T15:39:55.896660+0000","last_peered":"2023-10-09T15:39:55.896660+0000","last_clean":"2023-10-09T15:39:55.896660+0000","last_became_active":"2023-10-09T15:39:55.895819+0000","last_became_peered":"2023-10-09T15:39:55.895819+0000","last_unstale":"2023-10-09T15:39:55.896660+0000","last_undegraded":"2023-10-09T15:39:55.896660+0000","last_fullsized":"2023-10-09T15:39:55.896660+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:25.484169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.6","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905296+0000","last_change":"2023-10-09T15:39:55.905296+0000","last_active":"2023-10-09T15:39:55.905296+0000","last_peered":"2023-10-09T15:39:55.905296+0000","last_clean":"2023-10-09T15:39:55.905296+0000","last_became_active":"2023-10-09T15:39:55.904986+0000","last_became_peered":"2023-10-09T15:39:55.904986+0000","last_unstale":"2023-10-09T15:39:55.905296+0000","last_undegraded":"2023-10-09T15:39:55.905296+0000","last_fullsized":"2023-10-09T15:39:55.905296+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:40.637362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"32.5","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.915024+0000","last_change":"2023-10-09T15:39:55.915024+0000","last_active":"2023-10-09T15:39:55.915024+0000","last_peered":"2023-10-09T15:39:55.915024+0000","last_clean":"2023-10-09T15:39:55.915024+0000","last_became_active":"2023-10-09T15:39:55.914711+0000","last_became_peered":"2023-10-09T15:39:55.914711+0000","last_unstale":"2023-10-09T15:39:55.915024+0000","last_undegraded":"2023-10-09T15:39:55.915024+0000","last_fullsized":"2023-10-09T15:39:55.915024+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:25.660550+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.4","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.902511+0000","last_change":"2023-10-09T15:39:55.900886+0000","last_active":"2023-10-09T15:39:55.902511+0000","last_peered":"2023-10-09T15:39:55.902511+0000","last_clean":"2023-10-09T15:39:55.902511+0000","last_became_active":"2023-10-09T15:39:55.900570+0000","last_became_peered":"2023-10-09T15:39:55.900570+0000","last_unstale":"2023-10-09T15:39:55.902511+0000","last_undegraded":"2023-10-09T15:39:55.902511+0000","last_fullsized":"2023-10-09T15:39:55.902511+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:11:26.421938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.3","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916902+0000","last_change":"2023-10-09T15:39:55.916902+0000","last_active":"2023-10-09T15:39:55.916902+0000","last_peered":"2023-10-09T15:39:55.916902+0000","last_clean":"2023-10-09T15:39:55.916902+0000","last_became_active":"2023-10-09T15:39:55.916586+0000","last_became_peered":"2023-10-09T15:39:55.916586+0000","last_unstale":"2023-10-09T15:39:55.916902+0000","last_undegraded":"2023-10-09T15:39:55.916902+0000","last_fullsized":"2023-10-09T15:39:55.916902+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:24.472329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.2","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.899923+0000","last_change":"2023-10-09T15:39:55.899923+0000","last_active":"2023-10-09T15:39:55.899923+0000","last_peered":"2023-10-09T15:39:55.899923+0000","last_clean":"2023-10-09T15:39:55.899923+0000","last_became_active":"2023-10-09T15:39:55.899686+0000","last_became_peered":"2023-10-09T15:39:55.899686+0000","last_unstale":"2023-10-09T15:39:55.899923+0000","last_undegraded":"2023-10-09T15:39:55.899923+0000","last_fullsized":"2023-10-09T15:39:55.899923+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:28.215367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.1","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.908368+0000","last_change":"2023-10-09T15:39:55.908368+0000","last_active":"2023-10-09T15:39:55.908368+0000","last_peered":"2023-10-09T15:39:55.908368+0000","last_clean":"2023-10-09T15:39:55.908368+0000","last_became_active":"2023-10-09T15:39:55.908006+0000","last_became_peered":"2023-10-09T15:39:55.908006+0000","last_unstale":"2023-10-09T15:39:55.908368+0000","last_undegraded":"2023-10-09T15:39:55.908368+0000","last_fullsized":"2023-10-09T15:39:55.908368+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:02:18.078950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.0","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.918636+0000","last_change":"2023-10-09T15:39:55.909484+0000","last_active":"2023-10-09T15:39:55.918636+0000","last_peered":"2023-10-09T15:39:55.918636+0000","last_clean":"2023-10-09T15:39:55.918636+0000","last_became_active":"2023-10-09T15:39:55.909168+0000","last_became_peered":"2023-10-09T15:39:55.909168+0000","last_unstale":"2023-10-09T15:39:55.918636+0000","last_undegraded":"2023-10-09T15:39:55.918636+0000","last_fullsized":"2023-10-09T15:39:55.918636+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:43:35.302469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.20","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897087+0000","last_change":"2023-10-09T15:39:55.897087+0000","last_active":"2023-10-09T15:39:55.897087+0000","last_peered":"2023-10-09T15:39:55.897087+0000","last_clean":"2023-10-09T15:39:55.897087+0000","last_became_active":"2023-10-09T15:39:55.896670+0000","last_became_peered":"2023-10-09T15:39:55.896670+0000","last_unstale":"2023-10-09T15:39:55.897087+0000","last_undegraded":"2023-10-09T15:39:55.897087+0000","last_fullsized":"2023-10-09T15:39:55.897087+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:57:57.511450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1f","version":"185'4","reported_seq":14,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919130+0000","last_change":"2023-10-09T15:39:54.886988+0000","last_active":"2023-10-09T15:39:55.919130+0000","last_peered":"2023-10-09T15:39:55.919130+0000","last_clean":"2023-10-09T15:39:55.919130+0000","last_became_active":"2023-10-09T15:39:54.886700+0000","last_became_peered":"2023-10-09T15:39:54.886700+0000","last_unstale":"2023-10-09T15:39:55.919130+0000","last_undegraded":"2023-10-09T15:39:55.919130+0000","last_fullsized":"2023-10-09T15:39:55.919130+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:24:59.458770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.22","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.922001+0000","last_change":"2023-10-09T15:39:55.920898+0000","last_active":"2023-10-09T15:39:55.922001+0000","last_peered":"2023-10-09T15:39:55.922001+0000","last_clean":"2023-10-09T15:39:55.922001+0000","last_became_active":"2023-10-09T15:39:55.920622+0000","last_became_peered":"2023-10-09T15:39:55.920622+0000","last_unstale":"2023-10-09T15:39:55.922001+0000","last_undegraded":"2023-10-09T15:39:55.922001+0000","last_fullsized":"2023-10-09T15:39:55.922001+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:45.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.1d","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916989+0000","last_change":"2023-10-09T15:39:54.885685+0000","last_active":"2023-10-09T15:39:55.916989+0000","last_peered":"2023-10-09T15:39:55.916989+0000","last_clean":"2023-10-09T15:39:55.916989+0000","last_became_active":"2023-10-09T15:39:54.885257+0000","last_became_peered":"2023-10-09T15:39:54.885257+0000","last_unstale":"2023-10-09T15:39:55.916989+0000","last_undegraded":"2023-10-09T15:39:55.916989+0000","last_fullsized":"2023-10-09T15:39:55.916989+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:31:29.857933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.23","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.907235+0000","last_change":"2023-10-09T15:39:55.906877+0000","last_active":"2023-10-09T15:39:55.907235+0000","last_peered":"2023-10-09T15:39:55.907235+0000","last_clean":"2023-10-09T15:39:55.907235+0000","last_became_active":"2023-10-09T15:39:55.906600+0000","last_became_peered":"2023-10-09T15:39:55.906600+0000","last_unstale":"2023-10-09T15:39:55.907235+0000","last_undegraded":"2023-10-09T15:39:55.907235+0000","last_fullsized":"2023-10-09T15:39:55.907235+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:02:47.645104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1c","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919164+0000","last_change":"2023-10-09T15:39:54.890405+0000","last_active":"2023-10-09T15:39:55.919164+0000","last_peered":"2023-10-09T15:39:55.919164+0000","last_clean":"2023-10-09T15:39:55.919164+0000","last_became_active":"2023-10-09T15:39:54.890101+0000","last_became_peered":"2023-10-09T15:39:54.890101+0000","last_unstale":"2023-10-09T15:39:55.919164+0000","last_undegraded":"2023-10-09T15:39:55.919164+0000","last_fullsized":"2023-10-09T15:39:55.919164+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:15.658762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.24","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897354+0000","last_change":"2023-10-09T15:39:55.897354+0000","last_active":"2023-10-09T15:39:55.897354+0000","last_peered":"2023-10-09T15:39:55.897354+0000","last_clean":"2023-10-09T15:39:55.897354+0000","last_became_active":"2023-10-09T15:39:55.897084+0000","last_became_peered":"2023-10-09T15:39:55.897084+0000","last_unstale":"2023-10-09T15:39:55.897354+0000","last_undegraded":"2023-10-09T15:39:55.897354+0000","last_fullsized":"2023-10-09T15:39:55.897354+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:25:00.466485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.1b","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920283+0000","last_change":"2023-10-09T15:39:54.885072+0000","last_active":"2023-10-09T15:39:55.920283+0000","last_peered":"2023-10-09T15:39:55.920283+0000","last_clean":"2023-10-09T15:39:55.920283+0000","last_became_active":"2023-10-09T15:39:54.884784+0000","last_became_peered":"2023-10-09T15:39:54.884784+0000","last_unstale":"2023-10-09T15:39:55.920283+0000","last_undegraded":"2023-10-09T15:39:55.920283+0000","last_fullsized":"2023-10-09T15:39:55.920283+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:19.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.25","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906191+0000","last_change":"2023-10-09T15:39:55.906191+0000","last_active":"2023-10-09T15:39:55.906191+0000","last_peered":"2023-10-09T15:39:55.906191+0000","last_clean":"2023-10-09T15:39:55.906191+0000","last_became_active":"2023-10-09T15:39:55.905744+0000","last_became_peered":"2023-10-09T15:39:55.905744+0000","last_unstale":"2023-10-09T15:39:55.906191+0000","last_undegraded":"2023-10-09T15:39:55.906191+0000","last_fullsized":"2023-10-09T15:39:55.906191+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:52:02.877253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.1a","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.885729+0000","last_change":"2023-10-09T15:39:54.888663+0000","last_active":"2023-10-09T15:39:55.885729+0000","last_peered":"2023-10-09T15:39:55.885729+0000","last_clean":"2023-10-09T15:39:55.885729+0000","last_became_active":"2023-10-09T15:39:54.888356+0000","last_became_peered":"2023-10-09T15:39:54.888356+0000","last_unstale":"2023-10-09T15:39:55.885729+0000","last_undegraded":"2023-10-09T15:39:55.885729+0000","last_fullsized":"2023-10-09T15:39:55.885729+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:31:58.842222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.26","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917852+0000","last_change":"2023-10-09T15:39:55.916058+0000","last_active":"2023-10-09T15:39:55.917852+0000","last_peered":"2023-10-09T15:39:55.917852+0000","last_clean":"2023-10-09T15:39:55.917852+0000","last_became_active":"2023-10-09T15:39:55.915792+0000","last_became_peered":"2023-10-09T15:39:55.915792+0000","last_unstale":"2023-10-09T15:39:55.917852+0000","last_undegraded":"2023-10-09T15:39:55.917852+0000","last_fullsized":"2023-10-09T15:39:55.917852+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:27.949554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.19","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.889976+0000","last_change":"2023-10-09T15:39:54.893684+0000","last_active":"2023-10-09T15:39:55.889976+0000","last_peered":"2023-10-09T15:39:55.889976+0000","last_clean":"2023-10-09T15:39:55.889976+0000","last_became_active":"2023-10-09T15:39:54.893411+0000","last_became_peered":"2023-10-09T15:39:54.893411+0000","last_unstale":"2023-10-09T15:39:55.889976+0000","last_undegraded":"2023-10-09T15:39:55.889976+0000","last_fullsized":"2023-10-09T15:39:55.889976+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:39:48.655976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.27","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.900114+0000","last_change":"2023-10-09T15:39:55.900114+0000","last_active":"2023-10-09T15:39:55.900114+0000","last_peered":"2023-10-09T15:39:55.900114+0000","last_clean":"2023-10-09T15:39:55.900114+0000","last_became_active":"2023-10-09T15:39:55.899804+0000","last_became_peered":"2023-10-09T15:39:55.899804+0000","last_unstale":"2023-10-09T15:39:55.900114+0000","last_undegraded":"2023-10-09T15:39:55.900114+0000","last_fullsized":"2023-10-09T15:39:55.900114+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:02:36.578868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.18","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.888803+0000","last_change":"2023-10-09T15:39:54.886221+0000","last_active":"2023-10-09T15:39:55.888803+0000","last_peered":"2023-10-09T15:39:55.888803+0000","last_clean":"2023-10-09T15:39:55.888803+0000","last_became_active":"2023-10-09T15:39:54.885919+0000","last_became_peered":"2023-10-09T15:39:54.885919+0000","last_unstale":"2023-10-09T15:39:55.888803+0000","last_undegraded":"2023-10-09T15:39:55.888803+0000","last_fullsized":"2023-10-09T15:39:55.888803+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:28:45.372146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.28","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913818+0000","last_change":"2023-10-09T15:39:55.913818+0000","last_active":"2023-10-09T15:39:55.913818+0000","last_peered":"2023-10-09T15:39:55.913818+0000","last_clean":"2023-10-09T15:39:55.913818+0000","last_became_active":"2023-10-09T15:39:55.913505+0000","last_became_peered":"2023-10-09T15:39:55.913505+0000","last_unstale":"2023-10-09T15:39:55.913818+0000","last_undegraded":"2023-10-09T15:39:55.913818+0000","last_fullsized":"2023-10-09T15:39:55.913818+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:12:14.489381+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.17","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.894732+0000","last_change":"2023-10-09T15:39:54.892268+0000","last_active":"2023-10-09T15:39:54.894732+0000","last_peered":"2023-10-09T15:39:54.894732+0000","last_clean":"2023-10-09T15:39:54.894732+0000","last_became_active":"2023-10-09T15:39:54.891984+0000","last_became_peered":"2023-10-09T15:39:54.891984+0000","last_unstale":"2023-10-09T15:39:54.894732+0000","last_undegraded":"2023-10-09T15:39:54.894732+0000","last_fullsized":"2023-10-09T15:39:54.894732+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:07:44.980542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.29","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.907147+0000","last_change":"2023-10-09T15:39:55.907147+0000","last_active":"2023-10-09T15:39:55.907147+0000","last_peered":"2023-10-09T15:39:55.907147+0000","last_clean":"2023-10-09T15:39:55.907147+0000","last_became_active":"2023-10-09T15:39:55.906848+0000","last_became_peered":"2023-10-09T15:39:55.906848+0000","last_unstale":"2023-10-09T15:39:55.907147+0000","last_undegraded":"2023-10-09T15:39:55.907147+0000","last_fullsized":"2023-10-09T15:39:55.907147+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:27:00.089874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.16","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.890289+0000","last_change":"2023-10-09T15:39:54.894586+0000","last_active":"2023-10-09T15:39:55.890289+0000","last_peered":"2023-10-09T15:39:55.890289+0000","last_clean":"2023-10-09T15:39:55.890289+0000","last_became_active":"2023-10-09T15:39:54.894202+0000","last_became_peered":"2023-10-09T15:39:54.894202+0000","last_unstale":"2023-10-09T15:39:55.890289+0000","last_undegraded":"2023-10-09T15:39:55.890289+0000","last_fullsized":"2023-10-09T15:39:55.890289+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.345787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.2a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913003+0000","last_change":"2023-10-09T15:39:55.909633+0000","last_active":"2023-10-09T15:39:55.913003+0000","last_peered":"2023-10-09T15:39:55.913003+0000","last_clean":"2023-10-09T15:39:55.913003+0000","last_became_active":"2023-10-09T15:39:55.909390+0000","last_became_peered":"2023-10-09T15:39:55.909390+0000","last_unstale":"2023-10-09T15:39:55.913003+0000","last_undegraded":"2023-10-09T15:39:55.913003+0000","last_fullsized":"2023-10-09T15:39:55.913003+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:46.142426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.15","version":"185'3","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920977+0000","last_change":"2023-10-09T15:39:54.884844+0000","last_active":"2023-10-09T15:39:55.920977+0000","last_peered":"2023-10-09T15:39:55.920977+0000","last_clean":"2023-10-09T15:39:55.920977+0000","last_became_active":"2023-10-09T15:39:54.884413+0000","last_became_peered":"2023-10-09T15:39:54.884413+0000","last_unstale":"2023-10-09T15:39:55.920977+0000","last_undegraded":"2023-10-09T15:39:55.920977+0000","last_fullsized":"2023-10-09T15:39:55.920977+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:32:20.609296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901827+0000","last_change":"2023-10-09T15:39:55.901827+0000","last_active":"2023-10-09T15:39:55.901827+0000","last_peered":"2023-10-09T15:39:55.901827+0000","last_clean":"2023-10-09T15:39:55.901827+0000","last_became_active":"2023-10-09T15:39:55.901547+0000","last_became_peered":"2023-10-09T15:39:55.901547+0000","last_unstale":"2023-10-09T15:39:55.901827+0000","last_undegraded":"2023-10-09T15:39:55.901827+0000","last_fullsized":"2023-10-09T15:39:55.901827+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:26:30.010804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.14","version":"185'6","reported_seq":16,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.921950+0000","last_change":"2023-10-09T15:39:54.887577+0000","last_active":"2023-10-09T15:39:55.921950+0000","last_peered":"2023-10-09T15:39:55.921950+0000","last_clean":"2023-10-09T15:39:55.921950+0000","last_became_active":"2023-10-09T15:39:54.887308+0000","last_became_peered":"2023-10-09T15:39:54.887308+0000","last_unstale":"2023-10-09T15:39:55.921950+0000","last_undegraded":"2023-10-09T15:39:55.921950+0000","last_fullsized":"2023-10-09T15:39:55.921950+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:18:29.692365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.2c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.897745+0000","last_change":"2023-10-09T15:39:55.897745+0000","last_active":"2023-10-09T15:39:55.897745+0000","last_peered":"2023-10-09T15:39:55.897745+0000","last_clean":"2023-10-09T15:39:55.897745+0000","last_became_active":"2023-10-09T15:39:55.896927+0000","last_became_peered":"2023-10-09T15:39:55.896927+0000","last_unstale":"2023-10-09T15:39:55.897745+0000","last_undegraded":"2023-10-09T15:39:55.897745+0000","last_fullsized":"2023-10-09T15:39:55.897745+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:04:29.565823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.13","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920400+0000","last_change":"2023-10-09T15:39:54.890287+0000","last_active":"2023-10-09T15:39:55.920400+0000","last_peered":"2023-10-09T15:39:55.920400+0000","last_clean":"2023-10-09T15:39:55.920400+0000","last_became_active":"2023-10-09T15:39:54.890002+0000","last_became_peered":"2023-10-09T15:39:54.890002+0000","last_unstale":"2023-10-09T15:39:55.920400+0000","last_undegraded":"2023-10-09T15:39:55.920400+0000","last_fullsized":"2023-10-09T15:39:55.920400+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:05.467501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.2d","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906009+0000","last_change":"2023-10-09T15:39:55.906009+0000","last_active":"2023-10-09T15:39:55.906009+0000","last_peered":"2023-10-09T15:39:55.906009+0000","last_clean":"2023-10-09T15:39:55.906009+0000","last_became_active":"2023-10-09T15:39:55.905354+0000","last_became_peered":"2023-10-09T15:39:55.905354+0000","last_unstale":"2023-10-09T15:39:55.906009+0000","last_undegraded":"2023-10-09T15:39:55.906009+0000","last_fullsized":"2023-10-09T15:39:55.906009+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:14:30.543114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.12","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.883861+0000","last_change":"2023-10-09T15:39:54.881717+0000","last_active":"2023-10-09T15:39:54.883861+0000","last_peered":"2023-10-09T15:39:54.883861+0000","last_clean":"2023-10-09T15:39:54.883861+0000","last_became_active":"2023-10-09T15:39:54.881421+0000","last_became_peered":"2023-10-09T15:39:54.881421+0000","last_unstale":"2023-10-09T15:39:54.883861+0000","last_undegraded":"2023-10-09T15:39:54.883861+0000","last_fullsized":"2023-10-09T15:39:54.883861+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:17:32.351257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2e","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920379+0000","last_change":"2023-10-09T15:39:55.917863+0000","last_active":"2023-10-09T15:39:55.920379+0000","last_peered":"2023-10-09T15:39:55.920379+0000","last_clean":"2023-10-09T15:39:55.920379+0000","last_became_active":"2023-10-09T15:39:55.917565+0000","last_became_peered":"2023-10-09T15:39:55.917565+0000","last_unstale":"2023-10-09T15:39:55.920379+0000","last_undegraded":"2023-10-09T15:39:55.920379+0000","last_fullsized":"2023-10-09T15:39:55.920379+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:16.354319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.11","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.892438+0000","last_change":"2023-10-09T15:39:54.888852+0000","last_active":"2023-10-09T15:39:54.892438+0000","last_peered":"2023-10-09T15:39:54.892438+0000","last_clean":"2023-10-09T15:39:54.892438+0000","last_became_active":"2023-10-09T15:39:54.888559+0000","last_became_peered":"2023-10-09T15:39:54.888559+0000","last_unstale":"2023-10-09T15:39:54.892438+0000","last_undegraded":"2023-10-09T15:39:54.892438+0000","last_fullsized":"2023-10-09T15:39:54.892438+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:41:42.948117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.2f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.906313+0000","last_change":"2023-10-09T15:39:55.906313+0000","last_active":"2023-10-09T15:39:55.906313+0000","last_peered":"2023-10-09T15:39:55.906313+0000","last_clean":"2023-10-09T15:39:55.906313+0000","last_became_active":"2023-10-09T15:39:55.906047+0000","last_became_peered":"2023-10-09T15:39:55.906047+0000","last_unstale":"2023-10-09T15:39:55.906313+0000","last_undegraded":"2023-10-09T15:39:55.906313+0000","last_fullsized":"2023-10-09T15:39:55.906313+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:04.301218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.10","version":"185'8","reported_seq":17,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.919747+0000","last_change":"2023-10-09T15:39:54.893786+0000","last_active":"2023-10-09T15:39:55.919747+0000","last_peered":"2023-10-09T15:39:55.919747+0000","last_clean":"2023-10-09T15:39:55.919747+0000","last_became_active":"2023-10-09T15:39:54.893511+0000","last_became_peered":"2023-10-09T15:39:54.893511+0000","last_unstale":"2023-10-09T15:39:55.919747+0000","last_undegraded":"2023-10-09T15:39:55.919747+0000","last_fullsized":"2023-10-09T15:39:55.919747+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:39:20.009034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.30","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.900052+0000","last_change":"2023-10-09T15:39:55.900052+0000","last_active":"2023-10-09T15:39:55.900052+0000","last_peered":"2023-10-09T15:39:55.900052+0000","last_clean":"2023-10-09T15:39:55.900052+0000","last_became_active":"2023-10-09T15:39:55.899790+0000","last_became_peered":"2023-10-09T15:39:55.899790+0000","last_unstale":"2023-10-09T15:39:55.900052+0000","last_undegraded":"2023-10-09T15:39:55.900052+0000","last_fullsized":"2023-10-09T15:39:55.900052+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:24:01.958194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.f","version":"185'1","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920297+0000","last_change":"2023-10-09T15:39:54.882100+0000","last_active":"2023-10-09T15:39:55.920297+0000","last_peered":"2023-10-09T15:39:55.920297+0000","last_clean":"2023-10-09T15:39:55.920297+0000","last_became_active":"2023-10-09T15:39:54.881808+0000","last_became_peered":"2023-10-09T15:39:54.881808+0000","last_unstale":"2023-10-09T15:39:55.920297+0000","last_undegraded":"2023-10-09T15:39:55.920297+0000","last_fullsized":"2023-10-09T15:39:55.920297+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:00:27.207652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"32.31","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.908658+0000","last_change":"2023-10-09T15:39:55.908658+0000","last_active":"2023-10-09T15:39:55.908658+0000","last_peered":"2023-10-09T15:39:55.908658+0000","last_clean":"2023-10-09T15:39:55.908658+0000","last_became_active":"2023-10-09T15:39:55.908331+0000","last_became_peered":"2023-10-09T15:39:55.908331+0000","last_unstale":"2023-10-09T15:39:55.908658+0000","last_undegraded":"2023-10-09T15:39:55.908658+0000","last_fullsized":"2023-10-09T15:39:55.908658+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:54:45.156078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.e","version":"185'2","reported_seq":11,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916248+0000","last_change":"2023-10-09T15:39:54.893160+0000","last_active":"2023-10-09T15:39:55.916248+0000","last_peered":"2023-10-09T15:39:55.916248+0000","last_clean":"2023-10-09T15:39:55.916248+0000","last_became_active":"2023-10-09T15:39:54.892899+0000","last_became_peered":"2023-10-09T15:39:54.892899+0000","last_unstale":"2023-10-09T15:39:55.916248+0000","last_undegraded":"2023-10-09T15:39:55.916248+0000","last_fullsized":"2023-10-09T15:39:55.916248+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:03.576923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"32.32","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.909254+0000","last_change":"2023-10-09T15:39:55.909254+0000","last_active":"2023-10-09T15:39:55.909254+0000","last_peered":"2023-10-09T15:39:55.909254+0000","last_clean":"2023-10-09T15:39:55.909254+0000","last_became_active":"2023-10-09T15:39:55.908950+0000","last_became_peered":"2023-10-09T15:39:55.908950+0000","last_unstale":"2023-10-09T15:39:55.909254+0000","last_undegraded":"2023-10-09T15:39:55.909254+0000","last_fullsized":"2023-10-09T15:39:55.909254+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:33:24.406491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.d","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905029+0000","last_change":"2023-10-09T15:39:54.885521+0000","last_active":"2023-10-09T15:39:55.905029+0000","last_peered":"2023-10-09T15:39:55.905029+0000","last_clean":"2023-10-09T15:39:55.905029+0000","last_became_active":"2023-10-09T15:39:54.884868+0000","last_became_peered":"2023-10-09T15:39:54.884868+0000","last_unstale":"2023-10-09T15:39:55.905029+0000","last_undegraded":"2023-10-09T15:39:55.905029+0000","last_fullsized":"2023-10-09T15:39:55.905029+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:42:23.191460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.33","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.917549+0000","last_change":"2023-10-09T15:39:55.915354+0000","last_active":"2023-10-09T15:39:55.917549+0000","last_peered":"2023-10-09T15:39:55.917549+0000","last_clean":"2023-10-09T15:39:55.917549+0000","last_became_active":"2023-10-09T15:39:55.914771+0000","last_became_peered":"2023-10-09T15:39:55.914771+0000","last_unstale":"2023-10-09T15:39:55.917549+0000","last_undegraded":"2023-10-09T15:39:55.917549+0000","last_fullsized":"2023-10-09T15:39:55.917549+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:57:38.642990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.c","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.903163+0000","last_change":"2023-10-09T15:39:54.892813+0000","last_active":"2023-10-09T15:39:55.903163+0000","last_peered":"2023-10-09T15:39:55.903163+0000","last_clean":"2023-10-09T15:39:55.903163+0000","last_became_active":"2023-10-09T15:39:54.892501+0000","last_became_peered":"2023-10-09T15:39:54.892501+0000","last_unstale":"2023-10-09T15:39:55.903163+0000","last_undegraded":"2023-10-09T15:39:55.903163+0000","last_fullsized":"2023-10-09T15:39:55.903163+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:57:56.345787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"32.34","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896824+0000","last_change":"2023-10-09T15:39:55.895549+0000","last_active":"2023-10-09T15:39:55.896824+0000","last_peered":"2023-10-09T15:39:55.896824+0000","last_clean":"2023-10-09T15:39:55.896824+0000","last_became_active":"2023-10-09T15:39:55.895282+0000","last_became_peered":"2023-10-09T15:39:55.895282+0000","last_unstale":"2023-10-09T15:39:55.896824+0000","last_undegraded":"2023-10-09T15:39:55.896824+0000","last_fullsized":"2023-10-09T15:39:55.896824+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:33:57.724107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.b","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920487+0000","last_change":"2023-10-09T15:39:54.890744+0000","last_active":"2023-10-09T15:39:55.920487+0000","last_peered":"2023-10-09T15:39:55.920487+0000","last_clean":"2023-10-09T15:39:55.920487+0000","last_became_active":"2023-10-09T15:39:54.890463+0000","last_became_peered":"2023-10-09T15:39:54.890463+0000","last_unstale":"2023-10-09T15:39:55.920487+0000","last_undegraded":"2023-10-09T15:39:55.920487+0000","last_fullsized":"2023-10-09T15:39:55.920487+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:27:05.467501+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.35","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898360+0000","last_change":"2023-10-09T15:39:55.898360+0000","last_active":"2023-10-09T15:39:55.898360+0000","last_peered":"2023-10-09T15:39:55.898360+0000","last_clean":"2023-10-09T15:39:55.898360+0000","last_became_active":"2023-10-09T15:39:55.898096+0000","last_became_peered":"2023-10-09T15:39:55.898096+0000","last_unstale":"2023-10-09T15:39:55.898360+0000","last_undegraded":"2023-10-09T15:39:55.898360+0000","last_fullsized":"2023-10-09T15:39:55.898360+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:13.748042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.a","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.892532+0000","last_change":"2023-10-09T15:39:54.889300+0000","last_active":"2023-10-09T15:39:54.892532+0000","last_peered":"2023-10-09T15:39:54.892532+0000","last_clean":"2023-10-09T15:39:54.892532+0000","last_became_active":"2023-10-09T15:39:54.889022+0000","last_became_peered":"2023-10-09T15:39:54.889022+0000","last_unstale":"2023-10-09T15:39:54.892532+0000","last_undegraded":"2023-10-09T15:39:54.892532+0000","last_fullsized":"2023-10-09T15:39:54.892532+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:34:46.787310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.36","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.920286+0000","last_change":"2023-10-09T15:39:55.920286+0000","last_active":"2023-10-09T15:39:55.920286+0000","last_peered":"2023-10-09T15:39:55.920286+0000","last_clean":"2023-10-09T15:39:55.920286+0000","last_became_active":"2023-10-09T15:39:55.919985+0000","last_became_peered":"2023-10-09T15:39:55.919985+0000","last_unstale":"2023-10-09T15:39:55.920286+0000","last_undegraded":"2023-10-09T15:39:55.920286+0000","last_fullsized":"2023-10-09T15:39:55.920286+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:30.705294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.9","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.889354+0000","last_change":"2023-10-09T15:39:54.885095+0000","last_active":"2023-10-09T15:39:54.889354+0000","last_peered":"2023-10-09T15:39:54.889354+0000","last_clean":"2023-10-09T15:39:54.889354+0000","last_became_active":"2023-10-09T15:39:54.884811+0000","last_became_peered":"2023-10-09T15:39:54.884811+0000","last_unstale":"2023-10-09T15:39:54.889354+0000","last_undegraded":"2023-10-09T15:39:54.889354+0000","last_fullsized":"2023-10-09T15:39:54.889354+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:39:10.127926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.37","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.911912+0000","last_change":"2023-10-09T15:39:55.911912+0000","last_active":"2023-10-09T15:39:55.911912+0000","last_peered":"2023-10-09T15:39:55.911912+0000","last_clean":"2023-10-09T15:39:55.911912+0000","last_became_active":"2023-10-09T15:39:55.911565+0000","last_became_peered":"2023-10-09T15:39:55.911565+0000","last_unstale":"2023-10-09T15:39:55.911912+0000","last_undegraded":"2023-10-09T15:39:55.911912+0000","last_fullsized":"2023-10-09T15:39:55.911912+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:47:49.624457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.8","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.889422+0000","last_change":"2023-10-09T15:39:54.885193+0000","last_active":"2023-10-09T15:39:54.889422+0000","last_peered":"2023-10-09T15:39:54.889422+0000","last_clean":"2023-10-09T15:39:54.889422+0000","last_became_active":"2023-10-09T15:39:54.884865+0000","last_became_peered":"2023-10-09T15:39:54.884865+0000","last_unstale":"2023-10-09T15:39:54.889422+0000","last_undegraded":"2023-10-09T15:39:54.889422+0000","last_fullsized":"2023-10-09T15:39:54.889422+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:45.134711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.38","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905224+0000","last_change":"2023-10-09T15:39:55.905224+0000","last_active":"2023-10-09T15:39:55.905224+0000","last_peered":"2023-10-09T15:39:55.905224+0000","last_clean":"2023-10-09T15:39:55.905224+0000","last_became_active":"2023-10-09T15:39:55.904902+0000","last_became_peered":"2023-10-09T15:39:55.904902+0000","last_unstale":"2023-10-09T15:39:55.905224+0000","last_undegraded":"2023-10-09T15:39:55.905224+0000","last_fullsized":"2023-10-09T15:39:55.905224+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:09:38.079156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"31.7","version":"185'2","reported_seq":12,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.916428+0000","last_change":"2023-10-09T15:39:54.890914+0000","last_active":"2023-10-09T15:39:55.916428+0000","last_peered":"2023-10-09T15:39:55.916428+0000","last_clean":"2023-10-09T15:39:55.916428+0000","last_became_active":"2023-10-09T15:39:54.890643+0000","last_became_peered":"2023-10-09T15:39:54.890643+0000","last_unstale":"2023-10-09T15:39:55.916428+0000","last_undegraded":"2023-10-09T15:39:55.916428+0000","last_fullsized":"2023-10-09T15:39:55.916428+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:25.676173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.39","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.921752+0000","last_change":"2023-10-09T15:39:55.918506+0000","last_active":"2023-10-09T15:39:55.921752+0000","last_peered":"2023-10-09T15:39:55.921752+0000","last_clean":"2023-10-09T15:39:55.921752+0000","last_became_active":"2023-10-09T15:39:55.917582+0000","last_became_peered":"2023-10-09T15:39:55.917582+0000","last_unstale":"2023-10-09T15:39:55.921752+0000","last_undegraded":"2023-10-09T15:39:55.921752+0000","last_fullsized":"2023-10-09T15:39:55.921752+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:23:46.142426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"31.6","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.891873+0000","last_change":"2023-10-09T15:39:54.887836+0000","last_active":"2023-10-09T15:39:54.891873+0000","last_peered":"2023-10-09T15:39:54.891873+0000","last_clean":"2023-10-09T15:39:54.891873+0000","last_became_active":"2023-10-09T15:39:54.887533+0000","last_became_peered":"2023-10-09T15:39:54.887533+0000","last_unstale":"2023-10-09T15:39:54.891873+0000","last_undegraded":"2023-10-09T15:39:54.891873+0000","last_fullsized":"2023-10-09T15:39:54.891873+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:29.697579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3a","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.901838+0000","last_change":"2023-10-09T15:39:55.900165+0000","last_active":"2023-10-09T15:39:55.901838+0000","last_peered":"2023-10-09T15:39:55.901838+0000","last_clean":"2023-10-09T15:39:55.901838+0000","last_became_active":"2023-10-09T15:39:55.898994+0000","last_became_peered":"2023-10-09T15:39:55.898994+0000","last_unstale":"2023-10-09T15:39:55.901838+0000","last_undegraded":"2023-10-09T15:39:55.901838+0000","last_fullsized":"2023-10-09T15:39:55.901838+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:00:14.403681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"31.5","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.896642+0000","last_change":"2023-10-09T15:39:54.895633+0000","last_active":"2023-10-09T15:39:54.896642+0000","last_peered":"2023-10-09T15:39:54.896642+0000","last_clean":"2023-10-09T15:39:54.896642+0000","last_became_active":"2023-10-09T15:39:54.895323+0000","last_became_peered":"2023-10-09T15:39:54.895323+0000","last_unstale":"2023-10-09T15:39:54.896642+0000","last_undegraded":"2023-10-09T15:39:54.896642+0000","last_fullsized":"2023-10-09T15:39:54.896642+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:05:35.947599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3b","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.913808+0000","last_change":"2023-10-09T15:39:55.913808+0000","last_active":"2023-10-09T15:39:55.913808+0000","last_peered":"2023-10-09T15:39:55.913808+0000","last_clean":"2023-10-09T15:39:55.913808+0000","last_became_active":"2023-10-09T15:39:55.908708+0000","last_became_peered":"2023-10-09T15:39:55.908708+0000","last_unstale":"2023-10-09T15:39:55.913808+0000","last_undegraded":"2023-10-09T15:39:55.913808+0000","last_fullsized":"2023-10-09T15:39:55.913808+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:26.683888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"31.4","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.890288+0000","last_change":"2023-10-09T15:39:54.885336+0000","last_active":"2023-10-09T15:39:54.890288+0000","last_peered":"2023-10-09T15:39:54.890288+0000","last_clean":"2023-10-09T15:39:54.890288+0000","last_became_active":"2023-10-09T15:39:54.884969+0000","last_became_peered":"2023-10-09T15:39:54.884969+0000","last_unstale":"2023-10-09T15:39:54.890288+0000","last_undegraded":"2023-10-09T15:39:54.890288+0000","last_fullsized":"2023-10-09T15:39:54.890288+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:57:41.191911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"32.3c","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.905804+0000","last_change":"2023-10-09T15:39:55.905804+0000","last_active":"2023-10-09T15:39:55.905804+0000","last_peered":"2023-10-09T15:39:55.905804+0000","last_clean":"2023-10-09T15:39:55.905804+0000","last_became_active":"2023-10-09T15:39:55.905431+0000","last_became_peered":"2023-10-09T15:39:55.905431+0000","last_unstale":"2023-10-09T15:39:55.905804+0000","last_undegraded":"2023-10-09T15:39:55.905804+0000","last_fullsized":"2023-10-09T15:39:55.905804+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:27.949554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"31.3","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.893655+0000","last_change":"2023-10-09T15:39:54.889548+0000","last_active":"2023-10-09T15:39:54.893655+0000","last_peered":"2023-10-09T15:39:54.893655+0000","last_clean":"2023-10-09T15:39:54.893655+0000","last_became_active":"2023-10-09T15:39:54.889088+0000","last_became_peered":"2023-10-09T15:39:54.889088+0000","last_unstale":"2023-10-09T15:39:54.893655+0000","last_undegraded":"2023-10-09T15:39:54.893655+0000","last_fullsized":"2023-10-09T15:39:54.893655+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:52:37.049528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.3d","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.894017+0000","last_change":"2023-10-09T15:39:55.891975+0000","last_active":"2023-10-09T15:39:55.894017+0000","last_peered":"2023-10-09T15:39:55.894017+0000","last_clean":"2023-10-09T15:39:55.894017+0000","last_became_active":"2023-10-09T15:39:55.891693+0000","last_became_peered":"2023-10-09T15:39:55.891693+0000","last_unstale":"2023-10-09T15:39:55.894017+0000","last_undegraded":"2023-10-09T15:39:55.894017+0000","last_fullsized":"2023-10-09T15:39:55.894017+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:44:42.325136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.2","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.887217+0000","last_change":"2023-10-09T15:39:54.885613+0000","last_active":"2023-10-09T15:39:54.887217+0000","last_peered":"2023-10-09T15:39:54.887217+0000","last_clean":"2023-10-09T15:39:54.887217+0000","last_became_active":"2023-10-09T15:39:54.885336+0000","last_became_peered":"2023-10-09T15:39:54.885336+0000","last_unstale":"2023-10-09T15:39:54.887217+0000","last_undegraded":"2023-10-09T15:39:54.887217+0000","last_fullsized":"2023-10-09T15:39:54.887217+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:52:08.025583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"32.3e","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898422+0000","last_change":"2023-10-09T15:39:55.898422+0000","last_active":"2023-10-09T15:39:55.898422+0000","last_peered":"2023-10-09T15:39:55.898422+0000","last_clean":"2023-10-09T15:39:55.898422+0000","last_became_active":"2023-10-09T15:39:55.898153+0000","last_became_peered":"2023-10-09T15:39:55.898153+0000","last_unstale":"2023-10-09T15:39:55.898422+0000","last_undegraded":"2023-10-09T15:39:55.898422+0000","last_fullsized":"2023-10-09T15:39:55.898422+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:41:47.220672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"31.1","version":"0'0","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.890100+0000","last_change":"2023-10-09T15:39:54.892978+0000","last_active":"2023-10-09T15:39:55.890100+0000","last_peered":"2023-10-09T15:39:55.890100+0000","last_clean":"2023-10-09T15:39:55.890100+0000","last_became_active":"2023-10-09T15:39:54.892715+0000","last_became_peered":"2023-10-09T15:39:54.892715+0000","last_unstale":"2023-10-09T15:39:55.890100+0000","last_undegraded":"2023-10-09T15:39:55.890100+0000","last_fullsized":"2023-10-09T15:39:55.890100+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:19.304261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"32.3f","version":"0'0","reported_seq":8,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.912401+0000","last_change":"2023-10-09T15:39:55.912401+0000","last_active":"2023-10-09T15:39:55.912401+0000","last_peered":"2023-10-09T15:39:55.912401+0000","last_clean":"2023-10-09T15:39:55.912401+0000","last_became_active":"2023-10-09T15:39:55.912098+0000","last_became_peered":"2023-10-09T15:39:55.912098+0000","last_unstale":"2023-10-09T15:39:55.912401+0000","last_undegraded":"2023-10-09T15:39:55.912401+0000","last_fullsized":"2023-10-09T15:39:55.912401+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:32:43.230112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"31.0","version":"0'0","reported_seq":9,"reported_epoch":184,"state":"active+clean","last_fresh":"2023-10-09T15:39:54.885049+0000","last_change":"2023-10-09T15:39:54.882611+0000","last_active":"2023-10-09T15:39:54.885049+0000","last_peered":"2023-10-09T15:39:54.885049+0000","last_clean":"2023-10-09T15:39:54.885049+0000","last_became_active":"2023-10-09T15:39:54.882331+0000","last_became_peered":"2023-10-09T15:39:54.882331+0000","last_unstale":"2023-10-09T15:39:54.885049+0000","last_undegraded":"2023-10-09T15:39:54.885049+0000","last_fullsized":"2023-10-09T15:39:54.885049+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:11:39.629647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"32.21","version":"0'0","reported_seq":9,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.898923+0000","last_change":"2023-10-09T15:39:55.896771+0000","last_active":"2023-10-09T15:39:55.898923+0000","last_peered":"2023-10-09T15:39:55.898923+0000","last_clean":"2023-10-09T15:39:55.898923+0000","last_became_active":"2023-10-09T15:39:55.896519+0000","last_became_peered":"2023-10-09T15:39:55.896519+0000","last_unstale":"2023-10-09T15:39:55.898923+0000","last_undegraded":"2023-10-09T15:39:55.898923+0000","last_fullsized":"2023-10-09T15:39:55.898923+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:54.868769+0000","last_clean_scrub_stamp":"2023-10-09T15:39:54.868769+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:15.306323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"31.1e","version":"185'1","reported_seq":10,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.896527+0000","last_change":"2023-10-09T15:39:54.886291+0000","last_active":"2023-10-09T15:39:55.896527+0000","last_peered":"2023-10-09T15:39:55.896527+0000","last_clean":"2023-10-09T15:39:55.896527+0000","last_became_active":"2023-10-09T15:39:54.885670+0000","last_became_peered":"2023-10-09T15:39:54.885670+0000","last_unstale":"2023-10-09T15:39:55.896527+0000","last_undegraded":"2023-10-09T15:39:55.896527+0000","last_fullsized":"2023-10-09T15:39:55.896527+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:39:53.861054+0000","last_clean_scrub_stamp":"2023-10-09T15:39:53.861054+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:20:12.740327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":301,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-10-09T15:39:55.904186+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:39:55.904186+0000","last_peered":"2023-10-09T15:39:55.904186+0000","last_clean":"2023-10-09T15:39:55.904186+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:39:55.904186+0000","last_undegraded":"2023-10-09T15:39:55.904186+0000","last_fullsized":"2023-10-09T15:39:55.904186+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":32,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":31,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304280,"kb_used_data":2896,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067560,"statfs":{"total":96636764160,"available":96325181440,"internally_reserved":0,"allocated":2965504,"data_stored":1655861,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.52600000000000002,"15min":0.51200000000000001},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.73099999999999998,"5min":0.74199999999999999,"15min":0.77500000000000002},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.55100000000000005,"15min":0.53900000000000003},"min":{"1min":0.313,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53600000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.54100000000000004,"15min":0.52200000000000002},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.32600000000000001},"max":{"1min":0.748,"5min":0.82699999999999996,"15min":0.874},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56599999999999995,"15min":0.55100000000000005},"min":{"1min":0.36899999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73299999999999998,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.56299999999999994,"15min":0.54000000000000004},"min":{"1min":0.36699999999999999,"5min":0.36599999999999999,"15min":0.313},"max":{"1min":0.71499999999999997,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.44},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.56100000000000005,"15min":0.55300000000000005},"min":{"1min":0.39100000000000001,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80900000000000005,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.56999999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.58399999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.314,"15min":0.314},"max":{"1min":0.71799999999999997,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.60799999999999998},"min":{"1min":0.39500000000000002,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.78000000000000003,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.67000000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.55100000000000005,"15min":0.53800000000000003},"min":{"1min":0.32700000000000001,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.76100000000000001,"5min":0.81100000000000005,"15min":0.89000000000000001},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.59099999999999997,"15min":0.56000000000000005},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.84199999999999997,"5min":0.84399999999999997,"15min":0.88},"last":0.48999999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56899999999999995,"15min":0.58399999999999996},"min":{"1min":0.437,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.623},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.60999999999999999,"15min":0.59199999999999997},"min":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.34699999999999998},"max":{"1min":0.81000000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.58699999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:39:07 2023","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.67400000000000004,"15min":0.65700000000000003},"min":{"1min":0.50700000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.85899999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.66100000000000003,"15min":0.65300000000000002},"min":{"1min":0.47299999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.82999999999999996,"5min":0.90900000000000003,"15min":0.93000000000000005},"last":0.60199999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2359296,"data_stored":1059193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52500000000000002,"15min":0.50600000000000001},"min":{"1min":0.34699999999999998,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.83699999999999997,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.55900000000000005,"15min":0.54700000000000004},"min":{"1min":0.34799999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.78400000000000003,"5min":0.82899999999999996,"15min":0.90400000000000003},"last":0.41199999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.53000000000000003,"15min":0.55400000000000005},"min":{"1min":0.36699999999999999,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.746,"5min":0.76600000000000001,"15min":1.379},"last":0.378},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.57499999999999996,"15min":0.55600000000000005},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.55800000000000005,"15min":0.58899999999999997},"min":{"1min":0.433,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":1.3999999999999999},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.55200000000000005,"15min":0.73699999999999999},"min":{"1min":0.39200000000000002,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.45000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58699999999999997,"15min":0.61099999999999999},"min":{"1min":0.40300000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.60299999999999998,"15min":0.63500000000000001},"min":{"1min":0.53300000000000003,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.79500000000000004,"5min":0.91200000000000003,"15min":1.4399999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.55100000000000005,"15min":0.55200000000000005},"min":{"1min":0.38,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.93600000000000005},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.59199999999999997,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.872},"last":0.627}]},{"osd":5,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.58599999999999997,"15min":0.59399999999999997},"min":{"1min":0.35799999999999998,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.85599999999999998,"5min":0.88900000000000001,"15min":0.92000000000000004},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.60499999999999998,"15min":0.627},"min":{"1min":0.46400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.83599999999999997,"5min":0.83599999999999997,"15min":0.89700000000000002},"last":0.58899999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.67400000000000004,"5min":0.63100000000000001,"15min":0.64700000000000002},"min":{"1min":0.48099999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.87,"5min":0.87,"15min":1.004},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.70299999999999996,"5min":0.66000000000000003,"15min":0.66900000000000004},"min":{"1min":0.45200000000000001,"5min":0.434,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":0.93300000000000005,"15min":0.96699999999999997},"last":0.70299999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303692,"kb_used_data":2308,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068148,"statfs":{"total":96636764160,"available":96325783552,"internally_reserved":0,"allocated":2363392,"data_stored":1065369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.33800000000000002,"15min":0.34899999999999998},"min":{"1min":0.26300000000000001,"5min":0.224,"15min":0.215},"max":{"1min":0.44700000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.246},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.34699999999999998,"15min":0.377},"min":{"1min":0.252,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.46800000000000003,"5min":0.55300000000000005,"15min":1.512},"last":0.379}]},{"osd":2,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.33200000000000002,"15min":0.36299999999999999},"min":{"1min":0.24399999999999999,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.437,"5min":0.56399999999999995,"15min":1.286},"last":0.311},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38,"15min":0.40200000000000002},"min":{"1min":0.311,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51100000000000001,"5min":0.56599999999999995,"15min":1.0249999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.42199999999999999,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.96899999999999997},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.439},"min":{"1min":0.30399999999999999,"5min":0.249,"15min":0.249},"max":{"1min":0.54600000000000004,"5min":0.69699999999999995,"15min":1.4830000000000001},"last":0.34599999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.59999999999999998,"15min":0.60599999999999998},"min":{"1min":0.439,"5min":0.377,"15min":0.374},"max":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.222},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.42299999999999999,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.77400000000000002,"5min":0.86099999999999999,"15min":0.94799999999999995},"last":0.67700000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.59699999999999998,"15min":0.62},"min":{"1min":0.434,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.66200000000000003,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.61699999999999999,"15min":0.61899999999999999},"min":{"1min":0.46899999999999997,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.93100000000000005,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.69199999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.64700000000000002,"15min":0.76800000000000002},"min":{"1min":0.47199999999999998,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.89600000000000002,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.63900000000000001,"5min":0.64900000000000002,"15min":0.66900000000000004},"min":{"1min":0.48899999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.82299999999999995,"5min":0.93600000000000005,"15min":1.258},"last":0.73299999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:02 2023","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.65700000000000003,"15min":0.66600000000000004},"min":{"1min":0.46700000000000003,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.97499999999999998,"5min":0.996,"15min":0.997},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.65000000000000002,"15min":0.77300000000000002},"min":{"1min":0.45300000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77100000000000002,"5min":1.024,"15min":5.5819999999999999},"last":0.66100000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304268,"kb_used_data":2884,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067572,"statfs":{"total":96636764160,"available":96325193728,"internally_reserved":0,"allocated":2953216,"data_stored":1649974,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.36199999999999999,"15min":0.375},"min":{"1min":0.24099999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.54500000000000004,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.35199999999999998},{"interface":"front","average":{"1min":0.39400000000000002,"5min":0.40799999999999997,"15min":0.41799999999999998},"min":{"1min":0.29399999999999998,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.55900000000000005,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.36899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.40100000000000002,"5min":0.441,"15min":0.41199999999999998},"min":{"1min":0.26200000000000001,"5min":0.247,"15min":0.22800000000000001},"max":{"1min":0.66600000000000004,"5min":6.484,"15min":6.484},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.42599999999999999,"15min":0.50800000000000001},"min":{"1min":0.26600000000000001,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.45900000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33400000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36499999999999999,"15min":0.495},"min":{"1min":0.248,"5min":0.22500000000000001,"15min":0.215},"max":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.44,"15min":0.57599999999999996},"min":{"1min":0.29499999999999998,"5min":0.29099999999999998,"15min":0.29099999999999998},"max":{"1min":0.58199999999999996,"5min":2.109,"15min":4.5890000000000004},"last":0.39100000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.60399999999999998,"15min":0.63100000000000001},"min":{"1min":0.40899999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.76000000000000001,"5min":1.921,"15min":1.921},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58999999999999997,"15min":0.64400000000000002},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":1.508},"last":0.48899999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.58799999999999997,"15min":0.61599999999999999},"min":{"1min":0.39800000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.63600000000000001,"15min":0.63800000000000001},"min":{"1min":0.42999999999999999,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.83299999999999996,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.56799999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.63100000000000001,"5min":0.67500000000000004,"15min":0.68300000000000005},"min":{"1min":0.42199999999999999,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.89000000000000001,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.621},{"interface":"front","average":{"1min":0.62,"5min":0.65300000000000002,"15min":0.67700000000000005},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80500000000000005,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.55600000000000005}]},{"osd":7,"last update":"Mon Oct 9 15:39:18 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.66600000000000004,"15min":0.69699999999999995},"min":{"1min":0.45400000000000001,"5min":0.378,"15min":0.378},"max":{"1min":0.85599999999999998,"5min":2.032,"15min":2.032},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.65000000000000002,"15min":0.66700000000000004},"min":{"1min":0.42699999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.85299999999999998,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.46400000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303688,"kb_used_data":2304,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068152,"statfs":{"total":96636764160,"available":96325787648,"internally_reserved":0,"allocated":2359296,"data_stored":1059705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34100000000000003,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.44500000000000001,"5min":0.58199999999999996,"15min":0.69799999999999995},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.35099999999999998,"15min":0.35599999999999998},"min":{"1min":0.245,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.441,"5min":0.64700000000000002,"15min":1.0229999999999999},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.34899999999999998,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.27100000000000002,"5min":0.255,"15min":0.22500000000000001},"max":{"1min":0.442,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.436},{"interface":"front","average":{"1min":0.371,"5min":0.38700000000000001,"15min":0.38600000000000001},"min":{"1min":0.29399999999999998,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.46600000000000003,"5min":0.622,"15min":0.73699999999999999},"last":0.41699999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.374,"15min":0.36499999999999999},"min":{"1min":0.23300000000000001,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.46400000000000002,"5min":0.59699999999999998,"15min":0.67500000000000004},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.435,"15min":0.434},"min":{"1min":0.307,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.55000000000000004,"5min":0.73299999999999998,"15min":0.79100000000000004},"last":0.504}]},{"osd":4,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.59499999999999997,"15min":0.63600000000000001},"min":{"1min":0.44800000000000001,"5min":0.40899999999999997,"15min":0.39800000000000002},"max":{"1min":0.71999999999999997,"5min":0.88600000000000001,"15min":2.3399999999999999},"last":0.69599999999999995},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.60099999999999998,"15min":0.60599999999999998},"min":{"1min":0.48199999999999998,"5min":0.373,"15min":0.36799999999999999},"max":{"1min":0.76200000000000001,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.84199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.59699999999999998,"15min":0.60299999999999998},"min":{"1min":0.439,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.79900000000000004,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.61299999999999999,"5min":0.621,"15min":0.67000000000000004},"min":{"1min":0.47699999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.77700000000000002,"5min":0.874,"15min":2.5249999999999999},"last":0.83199999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.64200000000000002,"15min":0.67100000000000004},"min":{"1min":0.46300000000000002,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.90000000000000002,"5min":0.997,"15min":1.5189999999999999},"last":0.72299999999999998},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.66100000000000003,"15min":0.65800000000000003},"min":{"1min":0.49299999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.85099999999999998,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.86299999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:39:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.66900000000000004,"15min":0.68000000000000005},"min":{"1min":0.47099999999999997,"5min":0.44,"15min":0.44},"max":{"1min":0.82399999999999995,"5min":1.0620000000000001,"15min":1.407},"last":0.879},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.64700000000000002,"15min":0.65500000000000003},"min":{"1min":0.495,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.83999999999999997,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.90600000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574959,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303716,"kb_used_data":2332,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068124,"statfs":{"total":96636764160,"available":96325758976,"internally_reserved":0,"allocated":2387968,"data_stored":1067515,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32700000000000001,"15min":0.35499999999999998},"min":{"1min":0.255,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.56599999999999995,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.35099999999999998,"15min":0.76100000000000001},"min":{"1min":0.26200000000000001,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.54000000000000004,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.254}]},{"osd":1,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.34499999999999997,"15min":0.58999999999999997},"min":{"1min":0.28699999999999998,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.224},{"interface":"front","average":{"1min":0.41099999999999998,"5min":0.378,"15min":0.40999999999999998},"min":{"1min":0.29899999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.32200000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.372,"15min":1.143},"min":{"1min":0.311,"5min":0.247,"15min":0.247},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.39700000000000002,"15min":0.65900000000000003},"min":{"1min":0.29999999999999999,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.35899999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.58799999999999997,"15min":0.97699999999999998},"min":{"1min":0.45700000000000002,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.877,"5min":0.996,"15min":17.02},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.59499999999999997,"15min":0.84199999999999997},"min":{"1min":0.48699999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.67400000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.59599999999999997,"15min":0.623},"min":{"1min":0.498,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.60999999999999999,"15min":1.004},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.84499999999999997,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.56999999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.622,"15min":0.85199999999999998},"min":{"1min":0.46100000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.88700000000000001,"5min":0.92700000000000005,"15min":9.7319999999999993},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.64900000000000002,"15min":0.66700000000000004},"min":{"1min":0.504,"5min":0.436,"15min":0.436},"max":{"1min":1.016,"5min":1.016,"15min":1.278},"last":0.621}]},{"osd":7,"last update":"Mon Oct 9 15:39:11 2023","interfaces":[{"interface":"back","average":{"1min":0.66400000000000003,"5min":0.63800000000000001,"15min":1.044},"min":{"1min":0.43099999999999999,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.68999999999999995,"5min":0.64800000000000002,"15min":0.86899999999999999},"min":{"1min":0.55900000000000005,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":9.6029999999999998},"last":0.63300000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303684,"kb_used_data":2300,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068156,"statfs":{"total":96636764160,"available":96325791744,"internally_reserved":0,"allocated":2355200,"data_stored":1059151,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55600000000000005,"15min":0.54700000000000004},"min":{"1min":0.32900000000000001,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.622},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58799999999999997,"15min":0.58399999999999996},"min":{"1min":0.28599999999999998,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.44500000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61899999999999999,"5min":0.58999999999999997,"15min":0.64500000000000002},"min":{"1min":0.41499999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":2.879},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.36799999999999999,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.96899999999999997},"last":0.57799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.54400000000000004,"15min":0.52600000000000002},"min":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59099999999999997,"15min":0.58099999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.81399999999999995,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.495}]},{"osd":3,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.34599999999999997},"max":{"1min":0.85299999999999998,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.64800000000000002,"5min":0.61399999999999999,"15min":0.60899999999999999},"min":{"1min":0.47599999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.53300000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.375,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.78700000000000003,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.35899999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.119,"5min":1.119,"15min":1.119},"last":0.51400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.378,"5min":0.245,"15min":0.245},"max":{"1min":1.1539999999999999,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66900000000000004,"15min":0.67800000000000005},"min":{"1min":0.41199999999999998,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.89000000000000001,"5min":0.92000000000000004,"15min":0.96499999999999997},"last":0.60099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:39:08 2023","interfaces":[{"interface":"back","average":{"1min":0.60099999999999998,"5min":0.61299999999999999,"15min":0.624},"min":{"1min":0.40200000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.66300000000000003,"15min":0.66600000000000004},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":1.202,"5min":1.202,"15min":1.202},"last":0.65600000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303680,"kb_used_data":2296,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94068160,"statfs":{"total":96636764160,"available":96325795840,"internally_reserved":0,"allocated":2351104,"data_stored":1059081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.51500000000000001,"15min":0.51900000000000002},"min":{"1min":0.41499999999999998,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.73299999999999998,"5min":0.73599999999999999,"15min":0.87},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.439,"5min":0.313,"15min":0.313},"max":{"1min":0.69099999999999995,"5min":0.79400000000000004,"15min":1.165},"last":0.54300000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.45100000000000001,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.747,"5min":0.871,"15min":2.089},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.54000000000000004,"15min":0.55000000000000004},"min":{"1min":0.40200000000000002,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.46300000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54500000000000004,"15min":0.81299999999999994},"min":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.72499999999999998,"5min":0.79000000000000004,"15min":11.055},"last":0.44},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.83799999999999997},"min":{"1min":0.38800000000000001,"5min":0.35999999999999999,"15min":0.32400000000000001},"max":{"1min":0.69099999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.504}]},{"osd":3,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.58099999999999996,"15min":0.84299999999999997},"min":{"1min":0.44900000000000001,"5min":0.36799999999999999,"15min":0.34000000000000002},"max":{"1min":0.69699999999999995,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.38200000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59399999999999997,"15min":0.60299999999999998},"min":{"1min":0.52100000000000002,"5min":0.36699999999999999,"15min":0.36699999999999999},"max":{"1min":0.73999999999999999,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.55800000000000005}]},{"osd":4,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54000000000000004,"15min":0.54300000000000004},"min":{"1min":0.32800000000000001,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77300000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58599999999999997,"15min":0.58699999999999997},"min":{"1min":0.38100000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":1.0569999999999999},"last":0.48599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.57799999999999996,"15min":0.57899999999999996},"min":{"1min":0.36399999999999999,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.78700000000000003,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.58299999999999996,"15min":0.59799999999999998},"min":{"1min":0.34399999999999997,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.83399999999999996,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.52500000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:39:04 2023","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.60599999999999998,"15min":0.61499999999999999},"min":{"1min":0.42599999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.78200000000000003,"5min":0.97599999999999998,"15min":1.016},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.64700000000000002,"15min":0.65700000000000003},"min":{"1min":0.498,"5min":0.432,"15min":0.432},"max":{"1min":0.83499999999999996,"5min":1.0860000000000001,"15min":2.9359999999999999},"last":0.60199999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":624,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":31,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":32,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:40:00.405 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:40:00.406 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:40:00.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.565+0000 7f76d610b700 1 Processor -- start 2023-10-09T15:40:00.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76d610b700 1 -- start start 2023-10-09T15:40:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76d610b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f76d00ce220 0x7f76d00cbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76d610b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00cf510 con 0x7f76d0159860 2023-10-09T15:40:00.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76d610b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76d00ce6a0 con 0x7f76d00ccfa0 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76d610b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76d00d00b0 con 0x7f76d00ce220 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76ceffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f76d00ce220 0x7f76d00cbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76cf7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f76d0159860 0x7f76d00cf9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:47036/0 (socket says 172.21.15.33:47036) 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.566+0000 7f76cf7fe700 1 -- 172.21.15.33:0/1303860586 learned_addr learned my addr 172.21.15.33:0/1303860586 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ceffd700 1 -- 172.21.15.33:0/1303860586 >> v1:172.21.15.59:6789/0 conn(0x7f76d00ccfa0 legacy=0x7f76d00cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ceffd700 1 -- 172.21.15.33:0/1303860586 >> v1:172.21.15.33:6789/0 conn(0x7f76d0159860 legacy=0x7f76d00cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ceffd700 1 -- 172.21.15.33:0/1303860586 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76d00ce900 con 0x7f76d00ce220 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ceffd700 1 --2- 172.21.15.33:0/1303860586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d00ce220 0x7f76d00cbd90 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098d0 tx=0x7f76c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7fed3b5f60314b7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ce7fc700 1 -- 172.21.15.33:0/1303860586 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c4009e70 con 0x7f76d00ce220 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ce7fc700 1 -- 172.21.15.33:0/1303860586 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c400b820 con 0x7f76d00ce220 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76ce7fc700 1 -- 172.21.15.33:0/1303860586 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c400bbc0 con 0x7f76d00ce220 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76d610b700 1 -- 172.21.15.33:0/1303860586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d00ce220 msgr2=0x7f76d00cbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.567+0000 7f76d610b700 1 --2- 172.21.15.33:0/1303860586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d00ce220 0x7f76d00cbd90 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f76c40098d0 tx=0x7f76c40091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.568+0000 7f76d610b700 1 -- 172.21.15.33:0/1303860586 shutdown_connections 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.568+0000 7f76d610b700 1 --2- 172.21.15.33:0/1303860586 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d00ce220 0x7f76d00cbd90 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.568+0000 7f76d610b700 1 -- 172.21.15.33:0/1303860586 >> 172.21.15.33:0/1303860586 conn(0x7f76d00999b0 msgr2=0x7f76d0070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.568+0000 7f76d610b700 1 -- 172.21.15.33:0/1303860586 shutdown_connections 2023-10-09T15:40:00.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.568+0000 7f76d610b700 1 -- 172.21.15.33:0/1303860586 wait complete. 2023-10-09T15:40:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.569+0000 7f76d610b700 1 Processor -- start 2023-10-09T15:40:00.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.569+0000 7f76d610b700 1 -- start start 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00ccfa0 0x7f76d009d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159860 0x7f76d014daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d009db50 con 0x7f76d009bc00 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76d009c570 con 0x7f76d0159860 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76d009c850 con 0x7f76d00ccfa0 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:42960/0 (socket says 172.21.15.33:42960) 2023-10-09T15:40:00.574 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 -- 172.21.15.33:0/1295921170 learned_addr learned my addr 172.21.15.33:0/1295921170 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76ceffd700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159860 0x7f76d014daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cf7fe700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00ccfa0 0x7f76d009d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 -- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00ccfa0 msgr2=0x7f76d009d610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00ccfa0 0x7f76d009d610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 -- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159860 msgr2=0x7f76d014daf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159860 0x7f76d014daf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 -- 172.21.15.33:0/1295921170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c40093c0 con 0x7f76d009bc00 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76cffff700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f76c800bbb0 tx=0x7f76c8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c80092e0 con 0x7f76d009bc00 2023-10-09T15:40:00.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76c800c7a0 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76d009cb30 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76c800cb40 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.570+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76d009d0f0 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.571+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76d004c3c0 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.572+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f76c8012070 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.572+0000 7f76b77fe700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.573+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f76c80849b0 con 0x7f76d009bc00 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.573+0000 7f76cf7fe700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.573+0000 7f76cf7fe700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f76c0002780 tx=0x7f76c0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.577+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f76c8051640 con 0x7f76d009bc00 2023-10-09T15:40:00.849 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.849+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f76d009d280 con 0x7f76d009bc00 2023-10-09T15:40:00.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.853+0000 7f76b77fe700 1 -- 172.21.15.33:0/1295921170 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) v1 ==== 190+0+0 (secure 0 0 0) 0x7f76c8054c60 con 0x7f76d009bc00 2023-10-09T15:40:00.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 msgr2=0x7f76bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f76c0002780 tx=0x7f76c0009040 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 msgr2=0x7f76d00c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f76c800bbb0 tx=0x7f76c8009840 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 shutdown_connections 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f76bc067320 0x7f76bc0697d0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f76d009bc00 0x7f76d00c6b10 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f76d00ccfa0 0x7f76d009d610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 --2- 172.21.15.33:0/1295921170 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f76d0159860 0x7f76d014daf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 >> 172.21.15.33:0/1295921170 conn(0x7f76d00999b0 msgr2=0x7f76d00c6140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 shutdown_connections 2023-10-09T15:40:00.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.855+0000 7f76d610b700 1 -- 172.21.15.33:0/1295921170 wait complete. 2023-10-09T15:40:00.857 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:40:00.867 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.987+0000 7f44a49c1700 1 Processor -- start 2023-10-09T15:40:00.987 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.987+0000 7f44a49c1700 1 -- start start 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f44a49c1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f44a00cb970 0x7f44a0159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f44a49c1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a015ae40 con 0x7f44a015a400 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f44a49c1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44a015ab60 con 0x7f44a00cb5a0 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f44a49c1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f44a00ce0f0 con 0x7f44a00cb970 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f449dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f44a00cb970 0x7f44a0159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f449ed9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f44a015a400 0x7f44a0156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43852/0 (socket says 172.21.15.33:43852) 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.988+0000 7f449ed9d700 1 -- 172.21.15.33:0/3937087114 learned_addr learned my addr 172.21.15.33:0/3937087114 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449dd9b700 1 -- 172.21.15.33:0/3937087114 >> v1:172.21.15.59:6789/0 conn(0x7f44a00cb5a0 legacy=0x7f44a00cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449dd9b700 1 -- 172.21.15.33:0/3937087114 >> v1:172.21.15.33:6789/0 conn(0x7f44a015a400 legacy=0x7f44a0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449dd9b700 1 -- 172.21.15.33:0/3937087114 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44a00ccf00 con 0x7f44a00cb970 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449d59a700 1 -- 172.21.15.33:0/3937087114 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3216115808 0 0) 0x7f44a015ae40 con 0x7f44a015a400 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449dd9b700 1 --2- 172.21.15.33:0/3937087114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a0159ec0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=420c65f9efc570f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449d59a700 1 -- 172.21.15.33:0/3937087114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488009e80 con 0x7f44a00cb970 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449d59a700 1 -- 172.21.15.33:0/3937087114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f448800b860 con 0x7f44a00cb970 2023-10-09T15:40:00.990 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.989+0000 7f449d59a700 1 -- 172.21.15.33:0/3937087114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448800bbe0 con 0x7f44a00cb970 2023-10-09T15:40:00.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 -- 172.21.15.33:0/3937087114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 msgr2=0x7f44a0159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 --2- 172.21.15.33:0/3937087114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a0159ec0 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7f44880098e0 tx=0x7f44880091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 -- 172.21.15.33:0/3937087114 shutdown_connections 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 --2- 172.21.15.33:0/3937087114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a0159ec0 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 -- 172.21.15.33:0/3937087114 >> 172.21.15.33:0/3937087114 conn(0x7f44a0070e30 msgr2=0x7f44a00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 -- 172.21.15.33:0/3937087114 shutdown_connections 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.990+0000 7f44a49c1700 1 -- 172.21.15.33:0/3937087114 wait complete. 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.991+0000 7f44a49c1700 1 Processor -- start 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.991+0000 7f44a49c1700 1 -- start start 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a00cb5a0 0x7f44a00b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 0x7f44a0152d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00b5bd0 con 0x7f44a00cb970 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c7860 con 0x7f44a015a400 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44a00c7b40 con 0x7f44a00cb5a0 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32944/0 (socket says 172.21.15.33:32944) 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 -- 172.21.15.33:0/2660820154 learned_addr learned my addr 172.21.15.33:0/2660820154 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449e59c700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a00cb5a0 0x7f44a00b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449ed9d700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 0x7f44a0152d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 -- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a00cb5a0 msgr2=0x7f44a00b4190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a00cb5a0 0x7f44a00b4190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 -- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 msgr2=0x7f44a0152d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 0x7f44a0152d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 -- 172.21.15.33:0/2660820154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488009420 con 0x7f44a00cb970 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449ed9d700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 0x7f44a0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f449dd9b700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f44a006ea60 tx=0x7f4488017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f448801f070 con 0x7f44a00cb970 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4488000c90 con 0x7f44a00cb970 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4488025420 con 0x7f44a00cb970 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44a00b5e40 con 0x7f44a00cb970 2023-10-09T15:40:00.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.992+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44a00b46d0 con 0x7f44a00cb970 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.993+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44a00c7d60 con 0x7f44a00cb970 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.994+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4488023070 con 0x7f44a00cb970 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.994+0000 7f44967fc700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 0x7f44800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.994+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f44880861a0 con 0x7f44a00cb970 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.994+0000 7f449e59c700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 0x7f44800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:00.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.995+0000 7f449e59c700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 0x7f44800697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44a016cda0 tx=0x7f4498009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:00.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:00.998+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4488052e30 con 0x7f44a00cb970 2023-10-09T15:40:01.192 INFO:tasks.ceph.mds.d.smithi059.stderr:2023-10-09T15:40:01.192+0000 7fc7571d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:40:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.235+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f44a004c3c0 con 0x7f44a00cb970 2023-10-09T15:40:01.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.236+0000 7f44967fc700 1 -- 172.21.15.33:0/2660820154 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 122 v122) v1 ==== 95+0+4604 (secure 0 0 0) 0x7f4488056450 con 0x7f44a00cb970 2023-10-09T15:40:01.236 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:01.236 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":122,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":122,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:39:58.906642+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 msgr2=0x7f44800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 0x7f44800697d0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f44a016cda0 tx=0x7f4498009040 comp rx=0 tx=0).stop 2023-10-09T15:40:01.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 msgr2=0x7f44a015ca00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7f44a006ea60 tx=0x7f4488017000 comp rx=0 tx=0).stop 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 shutdown_connections 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4480067320 0x7f44800697d0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f44a015a400 0x7f44a0152d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f44a00cb5a0 0x7f44a00b4190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 --2- 172.21.15.33:0/2660820154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f44a00cb970 0x7f44a015ca00 unknown :-1 s=CLOSED pgs=1639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 >> 172.21.15.33:0/2660820154 conn(0x7f44a0070e30 msgr2=0x7f44a00b0750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 shutdown_connections 2023-10-09T15:40:01.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.238+0000 7f44a49c1700 1 -- 172.21.15.33:0/2660820154 wait complete. 2023-10-09T15:40:01.240 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 122 2023-10-09T15:40:01.653 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 122, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:39:55.281337+0000', 'modified': '2023-10-09T15:39:58.906642+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8709}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8709': {'gid': 8709, 'name': 'd', 'rank': 0, 'incarnation': 119, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.59:6834/1399937489', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.59:6832', 'nonce': 1399937489}, {'type': 'v1', 'addr': '172.21.15.59:6834', 'nonce': 1399937489}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [32], 'metadata_pool': 31, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:40:01.654 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:40:01.654 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-10-09T15:40:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.779+0000 7faa2625b700 1 Processor -- start 2023-10-09T15:40:01.779 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.779+0000 7faa2625b700 1 -- start start 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa2625b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa201645a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa2625b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa200ce9d0 con 0x7faa20159c80 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa2625b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa200af960 con 0x7faa201598b0 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa2625b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa200afc30 con 0x7faa200cbe00 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1effd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faa20159c80 0x7faa200cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43854/0 (socket says 172.21.15.33:43854) 2023-10-09T15:40:01.782 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1effd700 1 -- 172.21.15.33:0/320127912 learned_addr learned my addr 172.21.15.33:0/320127912 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1ffff700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa201645a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3577345747 0 0) 0x7faa200ce9d0 con 0x7faa20159c80 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa08003570 con 0x7faa20159c80 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2018722701 0 0) 0x7faa08003570 con 0x7faa20159c80 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 msgr2=0x7faa201645a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa201645a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 >> v1:172.21.15.59:6789/0 conn(0x7faa201598b0 legacy=0x7faa200af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa200aff10 con 0x7faa20159c80 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7faa14001470 con 0x7faa20159c80 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 >> v1:172.21.15.33:6789/0 conn(0x7faa20159c80 legacy=0x7faa200cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.783 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa08003a90 0x7faa08003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa08004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa08004d50 0x7faa080051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200afc30 con 0x7faa08004d50 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa0800bb10 con 0x7faa08003a90 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.780+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa0800bcd0 con 0x7faa200cbe00 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa08004d50 0x7faa080051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1effd700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa08004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa08003a90 0x7faa08003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 -- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 msgr2=0x7faa08004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa200cbe00 0x7faa08004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 -- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa08003a90 msgr2=0x7faa08003e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.784 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa08003a90 0x7faa08003e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 -- 172.21.15.33:0/320127912 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa08003570 con 0x7faa08004d50 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1ffff700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa08004d50 0x7faa080051c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7faa200cc200 tx=0x7faa1800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95804e1ddf47ec2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800ea00 con 0x7faa08004d50 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1800f040 con 0x7faa08004d50 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.781+0000 7faa1e7fc700 1 -- 172.21.15.33:0/320127912 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1800edb0 con 0x7faa08004d50 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 -- 172.21.15.33:0/320127912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa08004d50 msgr2=0x7faa080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 --2- 172.21.15.33:0/320127912 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa08004d50 0x7faa080051c0 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7faa200cc200 tx=0x7faa1800b040 comp rx=0 tx=0).stop 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa1ffff700 1 -- 172.21.15.33:0/320127912 reap_dead start 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 -- 172.21.15.33:0/320127912 shutdown_connections 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 -- 172.21.15.33:0/320127912 >> 172.21.15.33:0/320127912 conn(0x7faa20070e30 msgr2=0x7faa200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 -- 172.21.15.33:0/320127912 shutdown_connections 2023-10-09T15:40:01.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.782+0000 7faa2625b700 1 -- 172.21.15.33:0/320127912 wait complete. 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.783+0000 7faa2625b700 1 Processor -- start 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.783+0000 7faa2625b700 1 -- start start 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 0x7faa2015fa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 0x7faa2016d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa200b3e90 con 0x7faa2014e570 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa201602f0 con 0x7faa2014e1a0 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa200b3560 con 0x7faa2015d790 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32948/0 (socket says 172.21.15.33:32948) 2023-10-09T15:40:01.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 -- 172.21.15.33:0/718930114 learned_addr learned my addr 172.21.15.33:0/718930114 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1ffff700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 0x7faa2016d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 0x7faa2015fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 -- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 msgr2=0x7faa2016d370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 0x7faa2016d370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 -- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 msgr2=0x7faa2015fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 0x7faa2015fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 -- 172.21.15.33:0/718930114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa200b3840 con 0x7faa2014e570 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1ffff700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 0x7faa2016d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:01.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 0x7faa2015fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa1effd700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7faa140010e0 tx=0x7faa14001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa077fe700 1 -- 172.21.15.33:0/718930114 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14018030 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa077fe700 1 -- 172.21.15.33:0/718930114 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1400f870 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa200b3b20 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.784+0000 7faa077fe700 1 -- 172.21.15.33:0/718930114 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1400fbf0 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.785+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa200c8cd0 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.786+0000 7faa077fe700 1 -- 172.21.15.33:0/718930114 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faa1401b070 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.786+0000 7faa077fe700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 0x7faa0c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.787+0000 7faa077fe700 1 -- 172.21.15.33:0/718930114 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa14019070 con 0x7faa2014e570 2023-10-09T15:40:01.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.787+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 0x7faa0c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.787+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 0x7faa0c0697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faa10000f60 tx=0x7faa10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.788+0000 7faa2f553b80 1 Processor -- start 2023-10-09T15:40:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 -- start start 2023-10-09T15:40:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 0x557f66fbca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66f8fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66eeaa70 con 0x557f66f93a50 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66ee8270 con 0x557f66fbcf60 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f66ee4060 con 0x557f66fddd00 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa1f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32962/0 (socket says 172.21.15.33:32962) 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.789+0000 7faa1f7fe700 1 -- 172.21.15.33:0/1225384698 learned_addr learned my addr 172.21.15.33:0/1225384698 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1ffff700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66f8fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1effd700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 0x557f66fbca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 -- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 msgr2=0x557f66fbca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 0x557f66fbca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 -- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 msgr2=0x557f66f8fcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66f8fcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 -- 172.21.15.33:0/1225384698 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f66d7e270 con 0x557f66f93a50 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1ffff700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66f8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1effd700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 0x557f66fbca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa10006c10 tx=0x7faa10015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=241b2865d586462c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa04ff9700 1 -- 172.21.15.33:0/1225384698 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10002d20 con 0x557f66f93a50 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa04ff9700 1 -- 172.21.15.33:0/1225384698 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa10002e80 con 0x557f66f93a50 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.790+0000 7faa04ff9700 1 -- 172.21.15.33:0/1225384698 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa10007240 con 0x557f66f93a50 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- 172.21.15.33:0/1225384698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 msgr2=0x557f66f93e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7faa10006c10 tx=0x7faa10015000 comp rx=0 tx=0).stop 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- 172.21.15.33:0/1225384698 shutdown_connections 2023-10-09T15:40:01.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66f93a50 0x557f66f93e20 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66f8fcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1225384698 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fddd00 0x557f66fbca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- 172.21.15.33:0/1225384698 >> 172.21.15.33:0/1225384698 conn(0x557f66f95370 msgr2=0x557f66f95740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- 172.21.15.33:0/1225384698 shutdown_connections 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- 172.21.15.33:0/1225384698 wait complete. 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 -- start start 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.791+0000 7faa2f553b80 1 Processor -- start 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fd4be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66fbe0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66e8f890 con 0x557f66fddd00 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66eaaea0 con 0x557f66fbcf60 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f66d66e30 con 0x557f66f93a50 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa2f553b80 10 client.0 _ll_register_callbacks cb 0x557f66f57110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32972/0 (socket says 172.21.15.33:32972) 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa1ffff700 1 -- 172.21.15.33:0/4223410946 learned_addr learned my addr 172.21.15.33:0/4223410946 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fd4be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.792+0000 7faa1effd700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66fbe0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 -- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 msgr2=0x557f66fd4be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fd4be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 -- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 msgr2=0x557f66fbe0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66fbe0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 -- 172.21.15.33:0/4223410946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa1000f040 con 0x557f66fddd00 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fd4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa1ffff700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa18016000 tx=0x7faa1801a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11f16f27bbabed9f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18014ad0 con 0x557f66fddd00 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa18014c30 con 0x557f66fddd00 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f66f65aa0 con 0x557f66fddd00 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1801f440 con 0x557f66fddd00 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 10 client.8844 fetch_fsmap learned FSMap version 122 2023-10-09T15:40:01.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x557f66d20fe0 con 0x557f66fddd00 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f66f65aa0 con 0x557f66fddd00 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa1801f5a0 con 0x557f66fddd00 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 10 client.8844 fetch_fsmap finished waiting for FSMap version 122 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 10 client.8844 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 20 client.8844 populate_metadata read hostname 'smithi033' 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f66fc2f90 0x557f66fc3360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 4 client.8844 mds_command: new command op to 8709 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.793+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 --> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f66e86e00 con 0x557f66fc2f90 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.794+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f66fc2f90 0x557f66fc3360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.794+0000 7fa9fdffb700 10 client.8844 ms_handle_connect on v2:172.21.15.59:6832/1399937489 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.794+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f66fc2f90 0x557f66fc3360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=46b7cac27de372dc server_cookie=abbd1211e4e92c8e in_seq=0 out_seq=0 2023-10-09T15:40:01.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7fa9fdffb700 1 -- 172.21.15.33:0/4223410946 <== mds.0 v2:172.21.15.59:6832/1399937489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x557f66e86e00 con 0x557f66fc2f90 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7fa9fdffb700 10 client.8844 handle_command_reply: tid=0 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 client.8844 shutdown 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 msgr2=0x557f66fbe660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 secure :-1 s=READY pgs=1644 cs=0 l=1 rev1=1 crypto rx=0x7faa18016000 tx=0x7faa1801a000 comp rx=0 tx=0).stop 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 shutdown_connections 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f66fc2f90 0x557f66fc3360 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fbe660 unknown :-1 s=CLOSED pgs=1644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fd4be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7fa9fdffb700 0 client.8844 ms_handle_reset on v2:172.21.15.59:6832/1399937489 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 --2- 172.21.15.33:0/4223410946 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fbcf60 0x557f66fbe0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 >> 172.21.15.33:0/4223410946 conn(0x557f66f95370 msgr2=0x557f66f943e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 shutdown_connections 2023-10-09T15:40:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 1 -- 172.21.15.33:0/4223410946 wait complete. 2023-10-09T15:40:01.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.795+0000 7faa2f553b80 20 client.8844 trim_cache size 0 max 16384 2023-10-09T15:40:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.812+0000 7faa2f553b80 1 Processor -- start 2023-10-09T15:40:01.812 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.812+0000 7faa2f553b80 1 -- start start 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fec9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fddd00 0x557f66fbf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66f96fb0 con 0x557f66fbcf60 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66fd27d0 con 0x557f66fddd00 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f66f92b60 con 0x557f66f93a50 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32982/0 (socket says 172.21.15.33:32982) 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 -- 172.21.15.33:0/2893828958 learned_addr learned my addr 172.21.15.33:0/2893828958 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.815 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fec9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1ffff700 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fddd00 0x557f66fbf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 -- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 msgr2=0x557f66fec9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fec9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 -- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fddd00 msgr2=0x557f66fbf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fddd00 0x557f66fbf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 -- 172.21.15.33:0/2893828958 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f66eb2780 con 0x557f66fbcf60 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa1effd700 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7faa140015a0 tx=0x7faa14015040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1759aebda4581687 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa057fa700 1 -- 172.21.15.33:0/2893828958 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14058730 con 0x557f66fbcf60 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa057fa700 1 -- 172.21.15.33:0/2893828958 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1405c480 con 0x557f66fbcf60 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.813+0000 7faa057fa700 1 -- 172.21.15.33:0/2893828958 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa14055740 con 0x557f66fbcf60 2023-10-09T15:40:01.816 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- 172.21.15.33:0/2893828958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 msgr2=0x557f66fbf090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7faa140015a0 tx=0x7faa14015040 comp rx=0 tx=0).stop 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- 172.21.15.33:0/2893828958 shutdown_connections 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66fddd00 0x557f66fbf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66f93a50 0x557f66fec9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 --2- 172.21.15.33:0/2893828958 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fbcf60 0x557f66fbf090 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- 172.21.15.33:0/2893828958 >> 172.21.15.33:0/2893828958 conn(0x557f66f95370 msgr2=0x557f66f8c4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- 172.21.15.33:0/2893828958 shutdown_connections 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- 172.21.15.33:0/2893828958 wait complete. 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.814+0000 7faa2f553b80 1 -- start start 2023-10-09T15:40:01.817 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 Processor -- start 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 0x557f66fd6f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fbcf60 0x557f66fd74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f67041520 con 0x557f66fddd00 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f66fd6a80 con 0x557f66f93a50 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f66fd4d60 con 0x557f66fbcf60 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa2f553b80 10 client.0 _ll_register_callbacks cb 0x557f66f57110 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.821 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa1ffff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32994/0 (socket says 172.21.15.33:32994) 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.815+0000 7faa1ffff700 1 -- 172.21.15.33:0/1306599417 learned_addr learned my addr 172.21.15.33:0/1306599417 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 0x557f66fd6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1effd700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fbcf60 0x557f66fd74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 -- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fbcf60 msgr2=0x557f66fd74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fbcf60 0x557f66fd74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 -- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 msgr2=0x557f66fd6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 0x557f66fd6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 -- 172.21.15.33:0/1306599417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa200c8cd0 con 0x557f66fddd00 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 0x557f66fd6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa1ffff700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x557f66f8fb70 tx=0x7faa18022040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a281af0356147ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:40:01.822 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1801f440 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7faa1801f5a0 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f66f88b70 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=122) v2 ==== 24+0+0 (secure 0 0 0) 0x7faa1801d640 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 10 client.8850 fetch_fsmap learned FSMap version 122 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=122,monmap=2+}) v3 -- 0x557f66e99470 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f66f88b70 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 122) v1 ==== 3100+0+0 (secure 0 0 0) 0x7faa1801d7a0 con 0x557f66fddd00 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 10 client.8850 fetch_fsmap finished waiting for FSMap version 122 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 10 client.8850 resolve_mds: resolved name 'd' to daemon mds.d 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 20 client.8850 populate_metadata read hostname 'smithi033' 2023-10-09T15:40:01.823 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f67040620 0x557f670409f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 4 client.8850 mds_command: new command op to 8709 tid=0[{"prefix": "status"}] 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.816+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 --> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] -- command(tid 0: {"prefix": "status"}) v1 -- 0x557f66e86b20 con 0x557f67040620 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f67040620 0x557f670409f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7fa9fdffb700 10 client.8850 ms_handle_connect on v2:172.21.15.59:6832/1399937489 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa1f7fe700 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f67040620 0x557f670409f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5edb8e6dc55addc server_cookie=4ae95a6e10bbc13c in_seq=0 out_seq=0 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7fa9fdffb700 1 -- 172.21.15.33:0/1306599417 <== mds.0 v2:172.21.15.59:6832/1399937489 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x557f66e86b20 con 0x557f67040620 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7fa9fdffb700 10 client.8850 handle_command_reply: tid=0 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 client.8850 shutdown 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 msgr2=0x557f66fd79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x557f66f8fb70 tx=0x7faa18022040 comp rx=0 tx=0).stop 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 shutdown_connections 2023-10-09T15:40:01.824 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:6832/1399937489,v1:172.21.15.59:6834/1399937489] conn(0x557f67040620 0x557f670409f0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x557f66fddd00 0x557f66fd79e0 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7fa9fdffb700 0 client.8850 ms_handle_reset on v2:172.21.15.59:6832/1399937489 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x557f66f93a50 0x557f66fd6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 --2- 172.21.15.33:0/1306599417 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x557f66fbcf60 0x557f66fd74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.817+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 >> 172.21.15.33:0/1306599417 conn(0x557f66f95370 msgr2=0x557f66fc3360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 shutdown_connections 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2f553b80 1 -- 172.21.15.33:0/1306599417 wait complete. 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2f553b80 20 client.8850 trim_cache size 0 max 16384 2023-10-09T15:40:01.825 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 8709, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9204196050000002, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 122, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 186, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 186, 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 11.003783892 2023-10-09T15:40:01.826 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:40:01.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 msgr2=0x7faa0c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 0x7faa0c0697d0 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faa10000f60 tx=0x7faa10009040 comp rx=0 tx=0).stop 2023-10-09T15:40:01.827 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 msgr2=0x7faa200c8790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7faa140010e0 tx=0x7faa14001e70 comp rx=0 tx=0).stop 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 shutdown_connections 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa0c067320 0x7faa0c0697d0 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa2015d790 0x7faa2016d370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa2014e1a0 0x7faa2015fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 --2- 172.21.15.33:0/718930114 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa2014e570 0x7faa200c8790 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 >> 172.21.15.33:0/718930114 conn(0x7faa20070e30 msgr2=0x7faa200c67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 shutdown_connections 2023-10-09T15:40:01.828 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.818+0000 7faa2625b700 1 -- 172.21.15.33:0/718930114 wait complete. 2023-10-09T15:40:01.830 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:40:01.949 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.950+0000 7fd04c335700 1 Processor -- start 2023-10-09T15:40:01.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.950+0000 7fd04c335700 1 -- start start 2023-10-09T15:40:01.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.950+0000 7fd04c335700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 0x7fd0440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04c335700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cd9e0 0x7fd044159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04c335700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0440cde50 0x7fd04415a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04c335700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0440d13f0 con 0x7fd0440cde50 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04c335700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd04415a940 con 0x7fd0440cb5a0 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04c335700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04415ae40 con 0x7fd0440cd9e0 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0440cde50 0x7fd04415a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd0440cde50 0x7fd04415a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:32996/0 (socket says 172.21.15.33:32996) 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 -- 172.21.15.33:0/3041659064 learned_addr learned my addr 172.21.15.33:0/3041659064 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd0498d0700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cd9e0 0x7fd044159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a0d1700 1 --2- 172.21.15.33:0/3041659064 >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 0x7fd0440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 -- 172.21.15.33:0/3041659064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cd9e0 msgr2=0x7fd044159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cd9e0 0x7fd044159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 -- 172.21.15.33:0/3041659064 >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 msgr2=0x7fd0440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 --2- 172.21.15.33:0/3041659064 >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 0x7fd0440cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 -- 172.21.15.33:0/3041659064 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04415ab60 con 0x7fd0440cde50 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a0d1700 1 --2- 172.21.15.33:0/3041659064 >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 0x7fd0440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd04a8d2700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cde50 0x7fd04415a400 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd044065120 tx=0x7fd034009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d71c438da4feae server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd0490cf700 1 -- 172.21.15.33:0/3041659064 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03400e070 con 0x7fd0440cde50 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd0490cf700 1 -- 172.21.15.33:0/3041659064 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03400b990 con 0x7fd0440cde50 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.951+0000 7fd0490cf700 1 -- 172.21.15.33:0/3041659064 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0340092e0 con 0x7fd0440cde50 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 -- 172.21.15.33:0/3041659064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cde50 msgr2=0x7fd04415a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cde50 0x7fd04415a400 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7fd044065120 tx=0x7fd034009840 comp rx=0 tx=0).stop 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 -- 172.21.15.33:0/3041659064 shutdown_connections 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 --2- 172.21.15.33:0/3041659064 >> v2:172.21.15.59:3300/0 conn(0x7fd0440cb5a0 0x7fd0440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.954 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cde50 0x7fd04415a400 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 --2- 172.21.15.33:0/3041659064 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cd9e0 0x7fd044159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 -- 172.21.15.33:0/3041659064 >> 172.21.15.33:0/3041659064 conn(0x7fd044070e30 msgr2=0x7fd0440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 -- 172.21.15.33:0/3041659064 shutdown_connections 2023-10-09T15:40:01.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.952+0000 7fd04c335700 1 -- 172.21.15.33:0/3041659064 wait complete. 2023-10-09T15:40:01.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.953+0000 7fd04c335700 1 Processor -- start 2023-10-09T15:40:01.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.953+0000 7fd04c335700 1 -- start start 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cb5a0 0x7fd04415d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 0x7fd04416c870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04415d360 con 0x7fd0440cd9e0 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd04415c750 con 0x7fd044159c00 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04c335700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04415ca30 con 0x7fd0440cb5a0 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33002/0 (socket says 172.21.15.33:33002) 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 -- 172.21.15.33:0/3805181983 learned_addr learned my addr 172.21.15.33:0/3805181983 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04a0d1700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cb5a0 0x7fd04415d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04a8d2700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 0x7fd04416c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 -- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cb5a0 msgr2=0x7fd04415d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cb5a0 0x7fd04415d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 -- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 msgr2=0x7fd04416c870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 0x7fd04416c870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 -- 172.21.15.33:0/3805181983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd034009ae0 con 0x7fd0440cd9e0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd04a8d2700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 0x7fd04416c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.954+0000 7fd0498d0700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd03800ec80 tx=0x7fd0380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.955+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800c850 con 0x7fd0440cd9e0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.955+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd03800c9b0 con 0x7fd0440cd9e0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.955+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd04415cd10 con 0x7fd0440cd9e0 2023-10-09T15:40:01.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.955+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd03800cd50 con 0x7fd0440cd9e0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.955+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd04415dd30 con 0x7fd0440cd9e0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.956+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd04415d510 con 0x7fd0440cd9e0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.956+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd038013680 con 0x7fd0440cd9e0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.956+0000 7fd0427fc700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 0x7fd0300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.957+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd038085250 con 0x7fd0440cd9e0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.957+0000 7fd04a0d1700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 0x7fd0300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.957+0000 7fd04a0d1700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 0x7fd0300697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd03c006f00 tx=0x7fd03c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:01.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:01.961+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd038051ee0 con 0x7fd0440cd9e0 2023-10-09T15:40:02.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.201+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0441582b0 con 0x7fd0440cd9e0 2023-10-09T15:40:02.202 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.202+0000 7fd0427fc700 1 -- 172.21.15.33:0/3805181983 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v122) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd038055500 con 0x7fd0440cd9e0 2023-10-09T15:40:02.202 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:40:02.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 msgr2=0x7fd0300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:02.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 0x7fd0300697d0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fd03c006f00 tx=0x7fd03c008040 comp rx=0 tx=0).stop 2023-10-09T15:40:02.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 msgr2=0x7fd0441596c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:02.204 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7fd03800ec80 tx=0x7fd0380091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 shutdown_connections 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd030067320 0x7fd0300697d0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd044159c00 0x7fd04416c870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd0440cb5a0 0x7fd04415d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 --2- 172.21.15.33:0/3805181983 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd0440cd9e0 0x7fd0441596c0 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 >> 172.21.15.33:0/3805181983 conn(0x7fd044070e30 msgr2=0x7fd0440d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 shutdown_connections 2023-10-09T15:40:02.205 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.204+0000 7fd04c335700 1 -- 172.21.15.33:0/3805181983 wait complete. 2023-10-09T15:40:02.215 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:40:02.215 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:40:02.215 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:40:02.215 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:40:02.216 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:02.216 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:40:02.216 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:40:02.216 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:40:02.216 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:02.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.216 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:40:02.231 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:02.232 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41885sec preferred_lft 41885sec 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:02.233 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:40:02.234 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.235 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:02.235 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:40:02.235 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:40:02.235 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:02.235 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.235 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:40:02.295 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:40:02.297 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.297 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:40:02.353 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:40:02.353 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:40:02.353 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:40:02.353 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:40:02.353 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:40:02.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:40:02.354 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:40:02.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.456 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:40:02.471 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:40:02.471 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:40:02.471 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:02.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:40:02.535 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:02.536 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:02.591 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:02.591 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:02.591 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:02.646 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:40:02.646 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:40:02.646 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:02.727 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:02.727 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:02.727 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:02.735 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:02.735 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:02.735 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:02.735 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:02.736 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:02.758 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:02.758 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:40:02.759 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:40:02.760 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:40:02.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:02.761 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:02.827 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:40:02.988 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.988+0000 7fce72ba0700 1 Processor -- start 2023-10-09T15:40:02.989 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.988+0000 7fce72ba0700 1 -- start start 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce72ba0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fce6c159550 0x7fce6c0ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce72ba0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce6c15dfd0 0x7fce6c0aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce72ba0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fce6c0acc00 con 0x7fce6c159920 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce72ba0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0abff0 con 0x7fce6c15dfd0 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce72ba0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fce6c0ac2d0 con 0x7fce6c159550 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce6c15dfd0 0x7fce6c0aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fce6c15dfd0 0x7fce6c0aedb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33006/0 (socket says 172.21.15.33:33006) 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 -- 172.21.15.33:0/4081671388 learned_addr learned my addr 172.21.15.33:0/4081671388 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:02.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 -- 172.21.15.33:0/4081671388 >> v2:172.21.15.59:3300/0 conn(0x7fce6c159550 msgr2=0x7fce6c0ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 --2- 172.21.15.33:0/4081671388 >> v2:172.21.15.59:3300/0 conn(0x7fce6c159550 0x7fce6c0ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.989+0000 7fce7139d700 1 -- 172.21.15.33:0/4081671388 >> v1:172.21.15.59:6789/0 conn(0x7fce6c159920 legacy=0x7fce6c0ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce7139d700 1 -- 172.21.15.33:0/4081671388 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce6c0ac5b0 con 0x7fce6c15dfd0 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce7139d700 1 --2- 172.21.15.33:0/4081671388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c15dfd0 0x7fce6c0aedb0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fce6c064270 tx=0x7fce60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54f4f929ea51e1e2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce70b9c700 1 -- 172.21.15.33:0/4081671388 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000b820 con 0x7fce6c15dfd0 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce70b9c700 1 -- 172.21.15.33:0/4081671388 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6000b980 con 0x7fce6c15dfd0 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce70b9c700 1 -- 172.21.15.33:0/4081671388 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6000bd20 con 0x7fce6c15dfd0 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 -- 172.21.15.33:0/4081671388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c15dfd0 msgr2=0x7fce6c0aedb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 --2- 172.21.15.33:0/4081671388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c15dfd0 0x7fce6c0aedb0 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7fce6c064270 tx=0x7fce60009250 comp rx=0 tx=0).stop 2023-10-09T15:40:02.992 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 -- 172.21.15.33:0/4081671388 shutdown_connections 2023-10-09T15:40:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 --2- 172.21.15.33:0/4081671388 >> v2:172.21.15.59:3300/0 conn(0x7fce6c159550 0x7fce6c0ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 --2- 172.21.15.33:0/4081671388 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c15dfd0 0x7fce6c0aedb0 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 -- 172.21.15.33:0/4081671388 >> 172.21.15.33:0/4081671388 conn(0x7fce6c06ce80 msgr2=0x7fce6c0ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 -- 172.21.15.33:0/4081671388 shutdown_connections 2023-10-09T15:40:02.993 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.990+0000 7fce72ba0700 1 -- 172.21.15.33:0/4081671388 wait complete. 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.991+0000 7fce72ba0700 1 Processor -- start 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 -- start start 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 0x7fce6c0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 0x7fce6c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c0c7f30 con 0x7fce6c159920 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c152770 con 0x7fce6c159550 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce72ba0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fce6c15b170 con 0x7fce6c15dfd0 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce7139d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce7139d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33020/0 (socket says 172.21.15.33:33020) 2023-10-09T15:40:02.996 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.992+0000 7fce7139d700 1 -- 172.21.15.33:0/1911064271 learned_addr learned my addr 172.21.15.33:0/1911064271 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce71b9e700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 0x7fce6c0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7239f700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 0x7fce6c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 -- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 msgr2=0x7fce6c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 0x7fce6c15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 -- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 msgr2=0x7fce6c0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 0x7fce6c0c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 -- 172.21.15.33:0/1911064271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce600094f0 con 0x7fce6c159920 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce71b9e700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 0x7fce6c0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7239f700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 0x7fce6c15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce7139d700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fce60003080 tx=0x7fce60016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:02.997 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce60011e20 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fce6001f070 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce6c0c7600 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fce6001a8a0 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.993+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce6c0c7bc0 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.994+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce6c04c3c0 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.995+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fce6001ac90 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.995+0000 7fce69ffb700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 0x7fce58069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.995+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fce60021070 con 0x7fce6c159920 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.995+0000 7fce71b9e700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 0x7fce58069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:02.998 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.996+0000 7fce71b9e700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 0x7fce58069800 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fce64009b10 tx=0x7fce64008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:02.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:02.999+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fce60053bd0 con 0x7fce6c159920 2023-10-09T15:40:03.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.239+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fce6c06e7c0 con 0x7fce6c159920 2023-10-09T15:40:03.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.240+0000 7fce69ffb700 1 -- 172.21.15.33:0/1911064271 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v122) v1 ==== 53+0+73 (secure 0 0 0) 0x7fce600571f0 con 0x7fce6c159920 2023-10-09T15:40:03.240 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:40:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 msgr2=0x7fce58069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 0x7fce58069800 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fce64009b10 tx=0x7fce64008040 comp rx=0 tx=0).stop 2023-10-09T15:40:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 msgr2=0x7fce6c152230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7fce60003080 tx=0x7fce60016000 comp rx=0 tx=0).stop 2023-10-09T15:40:03.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 shutdown_connections 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fce58067350 0x7fce58069800 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fce6c15dfd0 0x7fce6c15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fce6c159550 0x7fce6c0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 --2- 172.21.15.33:0/1911064271 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fce6c159920 0x7fce6c152230 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 >> 172.21.15.33:0/1911064271 conn(0x7fce6c06ce80 msgr2=0x7fce6c0ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 shutdown_connections 2023-10-09T15:40:03.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:03.242+0000 7fce72ba0700 1 -- 172.21.15.33:0/1911064271 wait complete. 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:03.254 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:40:03.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:40:03.255 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:40:03.255 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:03.255 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.255 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:40:03.274 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:40:03.275 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41893sec preferred_lft 41893sec 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:03.276 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:40:03.277 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.278 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:03.278 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:40:03.278 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:40:03.278 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:03.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.278 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:40:03.344 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:40:03.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.346 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:40:03.404 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:40:03.405 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:40:03.405 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:40:03.405 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:40:03.405 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:40:03.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.405 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:40:03.405 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:40:03.405 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:40:03.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:40:03.406 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:40:03.406 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:40:03.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.516 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:40:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:40:03.531 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:40:03.532 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:03.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.532 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:40:03.598 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:03.598 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:03.654 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:03.654 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:03.654 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:03.709 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:40:03.709 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:40:03.709 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:03.791 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:03.791 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:03.791 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:03.799 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:03.799 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:03.800 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:03.800 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:03.800 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:40:03.821 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:40:03.823 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:40:03.823 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:03.823 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:03.889 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:40:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.028+0000 7f8872d31700 1 Processor -- start 2023-10-09T15:40:04.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.028+0000 7f8872d31700 1 -- start start 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f8872d31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c0cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f8872d31700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0cc090 con 0x7f886c06dcf0 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f8872d31700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f886c0ccfd0 con 0x7f886c159530 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f8872d31700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c15a410 con 0x7f886c0cb6f0 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886bfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f886c06dcf0 0x7f886c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43866/0 (socket says 172.21.15.33:43866) 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886bfff700 1 -- 172.21.15.33:0/2029338572 learned_addr learned my addr 172.21.15.33:0/2029338572 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f88712ce700 1 --2- 172.21.15.33:0/2029338572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c0cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:04.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 359215137 0 0) 0x7f8858001110 con 0x7f886c06dcf0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f885c003570 con 0x7f886c06dcf0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4232030264 0 0) 0x7f886c0ccfd0 con 0x7f886c159530 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8858001110 con 0x7f886c159530 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f88712ce700 1 -- 172.21.15.33:0/2029338572 >> v1:172.21.15.59:6789/0 conn(0x7f886c159530 legacy=0x7f886c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f88712ce700 1 -- 172.21.15.33:0/2029338572 >> v1:172.21.15.33:6789/0 conn(0x7f886c06dcf0 legacy=0x7f886c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.029+0000 7f88712ce700 1 -- 172.21.15.33:0/2029338572 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886c15a6f0 con 0x7f886c0cb6f0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f88712ce700 1 --2- 172.21.15.33:0/2029338572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c0cbb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8864009e90 tx=0x7f8864009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3e2bf746783f50f3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f886400e070 con 0x7f886c0cb6f0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f886400bb80 con 0x7f886c0cb6f0 2023-10-09T15:40:04.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f886b7fe700 1 -- 172.21.15.33:0/2029338572 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8864012430 con 0x7f886c0cb6f0 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 -- 172.21.15.33:0/2029338572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 msgr2=0x7f886c0cbb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 --2- 172.21.15.33:0/2029338572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c0cbb50 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f8864009e90 tx=0x7f8864009780 comp rx=0 tx=0).stop 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 -- 172.21.15.33:0/2029338572 shutdown_connections 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 --2- 172.21.15.33:0/2029338572 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c0cbb50 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 -- 172.21.15.33:0/2029338572 >> 172.21.15.33:0/2029338572 conn(0x7f886c0703a0 msgr2=0x7f886c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 -- 172.21.15.33:0/2029338572 shutdown_connections 2023-10-09T15:40:04.036 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.030+0000 7f8872d31700 1 -- 172.21.15.33:0/2029338572 wait complete. 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.031+0000 7f8872d31700 1 Processor -- start 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 -- start start 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c15d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f886c159530 0x7f886c15d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0b3f60 con 0x7f886c06dcf0 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f886c141090 con 0x7f886c159530 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8872d31700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886c0b4d80 con 0x7f886c0cb6f0 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8870acd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8870acd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33022/0 (socket says 172.21.15.33:33022) 2023-10-09T15:40:04.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.032+0000 7f8870acd700 1 -- 172.21.15.33:0/2587264265 learned_addr learned my addr 172.21.15.33:0/2587264265 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f88712ce700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f886c159530 0x7f886c15d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f886bfff700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c15d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 -- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 msgr2=0x7f886c15d3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c15d3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 -- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f886c159530 msgr2=0x7f886c15d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f886c159530 0x7f886c15d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 -- 172.21.15.33:0/2587264265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8864009a20 con 0x7f886c06dcf0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8870acd700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f886000c590 tx=0x7f8860007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88600105c0 con 0x7f886c06dcf0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8860010740 con 0x7f886c06dcf0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f886c0b4170 con 0x7f886c06dcf0 2023-10-09T15:40:04.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8860010b00 con 0x7f886c06dcf0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.033+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f886c0b4730 con 0x7f886c06dcf0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.034+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886c04c3c0 con 0x7f886c06dcf0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.035+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8860002030 con 0x7f886c06dcf0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.035+0000 7f8868ff9700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 0x7f88500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.035+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f88600841c0 con 0x7f886c06dcf0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.035+0000 7f886bfff700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 0x7f88500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.035+0000 7f886bfff700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 0x7f88500697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f886c16c890 tx=0x7f8858009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:04.039 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.039+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8860050f60 con 0x7f886c06dcf0 2023-10-09T15:40:04.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.278+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f886c15a9d0 con 0x7f886c06dcf0 2023-10-09T15:40:04.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.934+0000 7f8868ff9700 1 -- 172.21.15.33:0/2587264265 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v123) v1 ==== 136+0+0 (secure 0 0 0) 0x7f8860054580 con 0x7f886c06dcf0 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 msgr2=0x7f88500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 0x7f88500697d0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f886c16c890 tx=0x7f8858009040 comp rx=0 tx=0).stop 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 msgr2=0x7f886c140b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f886000c590 tx=0x7f8860007d90 comp rx=0 tx=0).stop 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 shutdown_connections 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8850067320 0x7f88500697d0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.938 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f886c06dcf0 0x7f886c140b50 unknown :-1 s=CLOSED pgs=1652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f886c159530 0x7f886c15d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 --2- 172.21.15.33:0/2587264265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886c0cb6f0 0x7f886c15d3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:04.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 >> 172.21.15.33:0/2587264265 conn(0x7f886c0703a0 msgr2=0x7f886c0d0490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:04.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 shutdown_connections 2023-10-09T15:40:04.939 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:04.937+0000 7f8872d31700 1 -- 172.21.15.33:0/2587264265 wait complete. 2023-10-09T15:40:04.952 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:40:05.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.079+0000 7f55e1bd0700 1 Processor -- start 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.079+0000 7f55e1bd0700 1 -- start start 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f55dc153c30 0x7f55dc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55dc15de50 0x7f55dc0cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc0cef40 0x7f55dc06d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc0cf3c0 con 0x7f55dc153c30 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55dc15afd0 con 0x7f55dc15de50 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e1bd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15b2b0 con 0x7f55dc0cef40 2023-10-09T15:40:05.083 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f55dc153c30 0x7f55dc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f55dc153c30 0x7f55dc15a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33028/0 (socket says 172.21.15.33:33028) 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 -- 172.21.15.33:0/3046363184 learned_addr learned my addr 172.21.15.33:0/3046363184 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e13cf700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc0cef40 0x7f55dc06d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 -- 172.21.15.33:0/3046363184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc0cef40 msgr2=0x7f55dc06d790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55dbfff700 1 --2- 172.21.15.33:0/3046363184 >> v2:172.21.15.59:3300/0 conn(0x7f55dc15de50 0x7f55dc0cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc0cef40 0x7f55dc06d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 -- 172.21.15.33:0/3046363184 >> v2:172.21.15.59:3300/0 conn(0x7f55dc15de50 msgr2=0x7f55dc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 --2- 172.21.15.33:0/3046363184 >> v2:172.21.15.59:3300/0 conn(0x7f55dc15de50 0x7f55dc0cea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 -- 172.21.15.33:0/3046363184 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55dc15b590 con 0x7f55dc153c30 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.080+0000 7f55e0bce700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc15a5e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0713a0 tx=0x7f55d4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f0dc0ac23936fe0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.084 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55db7fe700 1 -- 172.21.15.33:0/3046363184 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d400e070 con 0x7f55dc153c30 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55db7fe700 1 -- 172.21.15.33:0/3046363184 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55d400ba50 con 0x7f55dc153c30 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55db7fe700 1 -- 172.21.15.33:0/3046363184 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55d40092e0 con 0x7f55dc153c30 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 -- 172.21.15.33:0/3046363184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 msgr2=0x7f55dc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc15a5e0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f55dc0713a0 tx=0x7f55d4009840 comp rx=0 tx=0).stop 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 -- 172.21.15.33:0/3046363184 shutdown_connections 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc0cef40 0x7f55dc06d790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/3046363184 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc15a5e0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/3046363184 >> v2:172.21.15.59:3300/0 conn(0x7f55dc15de50 0x7f55dc0cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 -- 172.21.15.33:0/3046363184 >> 172.21.15.33:0/3046363184 conn(0x7f55dc0703a0 msgr2=0x7f55dc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 -- 172.21.15.33:0/3046363184 shutdown_connections 2023-10-09T15:40:05.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.081+0000 7f55e1bd0700 1 -- 172.21.15.33:0/3046363184 wait complete. 2023-10-09T15:40:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.082+0000 7f55e1bd0700 1 Processor -- start 2023-10-09T15:40:05.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 -- start start 2023-10-09T15:40:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55dc0cef40 0x7f55dc15f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc15de50 0x7f55dc16a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15e460 con 0x7f55dc153c30 2023-10-09T15:40:05.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15e740 con 0x7f55dc0cef40 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55e1bd0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55dc15ea20 con 0x7f55dc15de50 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55dbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33042/0 (socket says 172.21.15.33:33042) 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.083+0000 7f55dbfff700 1 -- 172.21.15.33:0/645561285 learned_addr learned my addr 172.21.15.33:0/645561285 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55e13cf700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc15de50 0x7f55dc16a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55e0bce700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55dc0cef40 0x7f55dc15f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 -- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc15de50 msgr2=0x7f55dc16a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc15de50 0x7f55dc16a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 -- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55dc0cef40 msgr2=0x7f55dc15f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55dc0cef40 0x7f55dc15f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.089 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 -- 172.21.15.33:0/645561285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55d4009ae0 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55dbfff700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c880 tx=0x7f55cc008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc011600 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55cc011780 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55dc15ed00 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55cc011b40 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.084+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55dc0b34e0 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.085+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55dc15f220 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.086+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55cc018360 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.086+0000 7f55d8ff9700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 0x7f55bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.086+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f55cc084ad0 con 0x7f55dc153c30 2023-10-09T15:40:05.090 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.086+0000 7f55e0bce700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 0x7f55bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.086+0000 7f55e0bce700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 0x7f55bc0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009880 tx=0x7f55d4018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.090+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55dc15f220 con 0x7f55dc153c30 2023-10-09T15:40:05.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.315+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f55dc15e8b0 con 0x7f55bc067320 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.316+0000 7f55d8ff9700 1 -- 172.21.15.33:0/645561285 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7f55dc15e8b0 con 0x7f55bc067320 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:05.316 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:40:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 msgr2=0x7f55bc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 0x7f55bc0697d0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009880 tx=0x7f55d4018000 comp rx=0 tx=0).stop 2023-10-09T15:40:05.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 msgr2=0x7f55dc0b5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f55cc00c880 tx=0x7f55cc008040 comp rx=0 tx=0).stop 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 shutdown_connections 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55bc067320 0x7f55bc0697d0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55dc15de50 0x7f55dc16a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55dc0cef40 0x7f55dc15f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 --2- 172.21.15.33:0/645561285 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55dc153c30 0x7f55dc0b5990 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 >> 172.21.15.33:0/645561285 conn(0x7f55dc0703a0 msgr2=0x7f55dc15c800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 shutdown_connections 2023-10-09T15:40:05.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.318+0000 7f55e1bd0700 1 -- 172.21.15.33:0/645561285 wait complete. 2023-10-09T15:40:05.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:40:05.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 Processor -- start 2023-10-09T15:40:05.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 -- start start 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b44159860 0x7f7b440ce220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440cbd90 0x7f7b440cf9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b440cf510 con 0x7f7b440ccfa0 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b440cc1e0 con 0x7f7b44159860 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.454+0000 7f7b4935e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b440ce900 con 0x7f7b440cbd90 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b44159860 0x7f7b440ce220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7b44159860 0x7f7b440ce220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33052/0 (socket says 172.21.15.33:33052) 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 -- 172.21.15.33:0/1384642539 learned_addr learned my addr 172.21.15.33:0/1384642539 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b427fc700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440cbd90 0x7f7b440cf9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 -- 172.21.15.33:0/1384642539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440cbd90 msgr2=0x7f7b440cf9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440cbd90 0x7f7b440cf9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 -- 172.21.15.33:0/1384642539 >> v1:172.21.15.59:6789/0 conn(0x7f7b440ccfa0 legacy=0x7f7b440cd420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 -- 172.21.15.33:0/1384642539 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b440cebe0 con 0x7f7b44159860 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b42ffd700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b44159860 0x7f7b440ce220 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009990 tx=0x7f7b34009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10affe6ee212ed9 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b41ffb700 1 -- 172.21.15.33:0/1384642539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34005c10 con 0x7f7b44159860 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b41ffb700 1 -- 172.21.15.33:0/1384642539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34005d70 con 0x7f7b44159860 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.455+0000 7f7b41ffb700 1 -- 172.21.15.33:0/1384642539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3400b840 con 0x7f7b44159860 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 -- 172.21.15.33:0/1384642539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b44159860 msgr2=0x7f7b440ce220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b44159860 0x7f7b440ce220 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009990 tx=0x7f7b34009220 comp rx=0 tx=0).stop 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 -- 172.21.15.33:0/1384642539 shutdown_connections 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b44159860 0x7f7b440ce220 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 --2- 172.21.15.33:0/1384642539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440cbd90 0x7f7b440cf9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 -- 172.21.15.33:0/1384642539 >> 172.21.15.33:0/1384642539 conn(0x7f7b440999b0 msgr2=0x7f7b44070b80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 -- 172.21.15.33:0/1384642539 shutdown_connections 2023-10-09T15:40:05.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.456+0000 7f7b4935e700 1 -- 172.21.15.33:0/1384642539 wait complete. 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.457+0000 7f7b4935e700 1 Processor -- start 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.457+0000 7f7b4935e700 1 -- start start 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440ccfa0 0x7f7b4409dc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b44159860 0x7f7b441589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4409ccc0 con 0x7f7b440cbd90 2023-10-09T15:40:05.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4409c0b0 con 0x7f7b44159860 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b4935e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b4409c390 con 0x7f7b440ccfa0 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33054/0 (socket says 172.21.15.33:33054) 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 -- 172.21.15.33:0/2664742252 learned_addr learned my addr 172.21.15.33:0/2664742252 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 -- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440ccfa0 msgr2=0x7f7b4409dc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440ccfa0 0x7f7b4409dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 -- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b44159860 msgr2=0x7f7b441589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b44159860 0x7f7b441589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 -- 172.21.15.33:0/2664742252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b34009480 con 0x7f7b440cbd90 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.458+0000 7f7b42ffd700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009260 tx=0x7f7b34015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.459+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b34011aa0 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.459+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b34011c20 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.459+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b4409c670 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.459+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b3401c420 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.459+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b4409d690 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.460+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b4404c3c0 con 0x7f7b440cbd90 2023-10-09T15:40:05.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.460+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7b3401c7d0 con 0x7f7b440cbd90 2023-10-09T15:40:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.460+0000 7f7b2affd700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 0x7f7b300697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.460+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f7b34086730 con 0x7f7b440cbd90 2023-10-09T15:40:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.460+0000 7f7b427fc700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 0x7f7b300697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:05.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.461+0000 7f7b427fc700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 0x7f7b300697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b440c7a90 tx=0x7f7b38008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:05.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.465+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7b34053440 con 0x7f7b440cbd90 2023-10-09T15:40:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.657+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7b440ceec0 con 0x7f7b440cbd90 2023-10-09T15:40:05.657 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.657+0000 7f7b2affd700 1 -- 172.21.15.33:0/2664742252 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7b34056a60 con 0x7f7b440cbd90 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 msgr2=0x7f7b300697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 0x7f7b300697d0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f7b440c7a90 tx=0x7f7b38008040 comp rx=0 tx=0).stop 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 msgr2=0x7f7b4409d150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7b34009260 tx=0x7f7b34015000 comp rx=0 tx=0).stop 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 shutdown_connections 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7b30067320 0x7f7b300697d0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7b440cbd90 0x7f7b4409d150 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.660 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.659+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7b44159860 0x7f7b441589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.660+0000 7f7b4935e700 1 --2- 172.21.15.33:0/2664742252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7b440ccfa0 0x7f7b4409dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.660+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 >> 172.21.15.33:0/2664742252 conn(0x7f7b440999b0 msgr2=0x7f7b440b4a10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.660+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 shutdown_connections 2023-10-09T15:40:05.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:05.660+0000 7f7b4935e700 1 -- 172.21.15.33:0/2664742252 wait complete. 2023-10-09T15:40:05.672 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:40:05.672 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:40:05.672 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:05.713 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:40:05.713 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:05.713 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:40:05.769 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:40:05.769 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:40:05.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:05.816 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:40:05.816 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:05.816 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:40:05.833 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:40:05.833 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:05.834 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T15:40:05.848 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:40:05.848 INFO:teuthology.orchestra.run.smithi033.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T15:40:05.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:40:05.849 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:05.849 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T15:40:05.890 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:40:05.890 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T15:40:05.890 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000437078 --yes-i-really-mean-it 2023-10-09T15:40:06.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.015+0000 7f144eb84700 1 Processor -- start 2023-10-09T15:40:06.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.015+0000 7f144eb84700 1 -- start start 2023-10-09T15:40:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f144eb84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cb880 0x7f14480cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f144eb84700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14480b04f0 0x7f14480cd060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f144eb84700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f14480cf330 con 0x7f14480cd5a0 2023-10-09T15:40:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f144eb84700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14480cead0 con 0x7f14480b04f0 2023-10-09T15:40:06.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f144eb84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480cddd0 con 0x7f14480cb880 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f1447fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14480b04f0 0x7f14480cd060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f1447fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f14480b04f0 0x7f14480cd060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33064/0 (socket says 172.21.15.33:33064) 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.016+0000 7f1447fff700 1 -- 172.21.15.33:0/3674562003 learned_addr learned my addr 172.21.15.33:0/3674562003 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f144c920700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cb880 0x7f14480cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f1447fff700 1 -- 172.21.15.33:0/3674562003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cb880 msgr2=0x7f14480cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f1447fff700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cb880 0x7f14480cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f1447fff700 1 -- 172.21.15.33:0/3674562003 >> v1:172.21.15.59:6789/0 conn(0x7f14480cd5a0 legacy=0x7f14481591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:06.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f1447fff700 1 -- 172.21.15.33:0/3674562003 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14480cece0 con 0x7f14480b04f0 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f1447fff700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f14480cd060 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bec089f1abf473 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f14477fe700 1 -- 172.21.15.33:0/3674562003 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000b820 con 0x7f14480b04f0 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f14477fe700 1 -- 172.21.15.33:0/3674562003 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f143000b980 con 0x7f14480b04f0 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f14477fe700 1 -- 172.21.15.33:0/3674562003 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f143000bd20 con 0x7f14480b04f0 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f144eb84700 1 -- 172.21.15.33:0/3674562003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 msgr2=0x7f14480cd060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.017+0000 7f144eb84700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f14480cd060 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430009250 comp rx=0 tx=0).stop 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 -- 172.21.15.33:0/3674562003 shutdown_connections 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cb880 0x7f14480cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 --2- 172.21.15.33:0/3674562003 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f14480cd060 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 -- 172.21.15.33:0/3674562003 >> 172.21.15.33:0/3674562003 conn(0x7f14480703a0 msgr2=0x7f14480707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:06.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 -- 172.21.15.33:0/3674562003 shutdown_connections 2023-10-09T15:40:06.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.018+0000 7f144eb84700 1 -- 172.21.15.33:0/3674562003 wait complete. 2023-10-09T15:40:06.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.019+0000 7f144eb84700 1 Processor -- start 2023-10-09T15:40:06.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.019+0000 7f144eb84700 1 -- start start 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 0x7f1448169940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 0x7f144815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1448156ed0 con 0x7f14480b04f0 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c78c0 con 0x7f14480cb880 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14480c7ba0 con 0x7f14480cd5a0 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33078/0 (socket says 172.21.15.33:33078) 2023-10-09T15:40:06.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 -- 172.21.15.33:0/4156724518 learned_addr learned my addr 172.21.15.33:0/4156724518 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f1447fff700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 0x7f1448169940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144d121700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 0x7f144815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 -- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 msgr2=0x7f144815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 0x7f144815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 -- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 msgr2=0x7f1448169940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 0x7f1448169940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 -- 172.21.15.33:0/4156724518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14300094f0 con 0x7f14480b04f0 2023-10-09T15:40:06.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f1447fff700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 0x7f1448169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:06.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144d121700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 0x7f144815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:06.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144c920700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f144000e190 tx=0x7f1440009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:06.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f144000ee30 con 0x7f14480b04f0 2023-10-09T15:40:06.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1440014420 con 0x7f14480b04f0 2023-10-09T15:40:06.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14480c7e80 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14400147e0 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.020+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14480c8440 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.021+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f144804c3c0 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.022+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1440014b90 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.022+0000 7f1444ff9700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 0x7f14280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.022+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f14400854d0 con 0x7f14480b04f0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.022+0000 7f1447fff700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 0x7f14280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:06.027 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.023+0000 7f1447fff700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 0x7f14280697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:06.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.026+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1440052160 con 0x7f14480b04f0 2023-10-09T15:40:06.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:06.248+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000437078", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7f14480c5a70 con 0x7f1428067320 2023-10-09T15:40:07.082 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:40:07.085 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:40:08.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.964+0000 7f1444ff9700 1 -- 172.21.15.33:0/4156724518 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7f14480c5a70 con 0x7f1428067320 2023-10-09T15:40:08.964 INFO:teuthology.orchestra.run.smithi033.stdout:FS volume 'cephfs' renamed to 'volume_0000000000437078' 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 msgr2=0x7f14280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 0x7f14280697d0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f14300099b0 tx=0x7f1430016000 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 msgr2=0x7f1448156990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f144000e190 tx=0x7f1440009920 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 shutdown_connections 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1428067320 0x7f14280697d0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f14480b04f0 0x7f1448156990 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f14480cd5a0 0x7f144815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 --2- 172.21.15.33:0/4156724518 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f14480cb880 0x7f1448169940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:08.968 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.967+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 >> 172.21.15.33:0/4156724518 conn(0x7f14480703a0 msgr2=0x7f14480b1980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:08.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.968+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 shutdown_connections 2023-10-09T15:40:08.969 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:08.968+0000 7f144eb84700 1 -- 172.21.15.33:0/4156724518 wait complete. 2023-10-09T15:40:08.983 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rename cephfs volume_0000000000437078 --yes-i-really-mean-it 2023-10-09T15:40:09.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.113+0000 7fad3dce8700 1 Processor -- start 2023-10-09T15:40:09.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.113+0000 7fad3dce8700 1 -- start start 2023-10-09T15:40:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad3dce8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 0x7fad380cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad3dce8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad380b04f0 0x7fad381591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad3dce8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad380cf330 con 0x7fad380cb880 2023-10-09T15:40:09.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad3dce8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad380cead0 con 0x7fad380b04f0 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad3dce8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad380cdbc0 con 0x7fad380cd770 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad37fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fad380b04f0 0x7fad381591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad377fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fad380cb880 0x7fad380cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43868/0 (socket says 172.21.15.33:43868) 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.114+0000 7fad377fe700 1 -- 172.21.15.33:0/4273496136 learned_addr learned my addr 172.21.15.33:0/4273496136 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad36ffd700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 0x7fad380cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad37fff700 1 -- 172.21.15.33:0/4273496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 msgr2=0x7fad380cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad37fff700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 0x7fad380cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad37fff700 1 -- 172.21.15.33:0/4273496136 >> v1:172.21.15.33:6789/0 conn(0x7fad380cb880 legacy=0x7fad380cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad37fff700 1 -- 172.21.15.33:0/4273496136 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad380cddd0 con 0x7fad380b04f0 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad367fc700 1 -- 172.21.15.33:0/4273496136 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3446076104 0 0) 0x7fad380cf330 con 0x7fad380cb880 2023-10-09T15:40:09.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad36ffd700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 0x7fad380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad37fff700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380b04f0 0x7fad381591e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fad30009e60 tx=0x7fad30009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1da223d8897287e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad367fc700 1 -- 172.21.15.33:0/4273496136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3000e070 con 0x7fad380b04f0 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad367fc700 1 -- 172.21.15.33:0/4273496136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3000bc30 con 0x7fad380b04f0 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.115+0000 7fad367fc700 1 -- 172.21.15.33:0/4273496136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30012430 con 0x7fad380b04f0 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 -- 172.21.15.33:0/4273496136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380b04f0 msgr2=0x7fad381591e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380b04f0 0x7fad381591e0 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fad30009e60 tx=0x7fad30009780 comp rx=0 tx=0).stop 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 -- 172.21.15.33:0/4273496136 shutdown_connections 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380b04f0 0x7fad381591e0 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 --2- 172.21.15.33:0/4273496136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cd770 0x7fad380cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 -- 172.21.15.33:0/4273496136 >> 172.21.15.33:0/4273496136 conn(0x7fad380703a0 msgr2=0x7fad380707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:09.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 -- 172.21.15.33:0/4273496136 shutdown_connections 2023-10-09T15:40:09.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.116+0000 7fad3dce8700 1 -- 172.21.15.33:0/4273496136 wait complete. 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.117+0000 7fad3dce8700 1 Processor -- start 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.117+0000 7fad3dce8700 1 -- start start 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 0x7fad3814c150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 0x7fad380c97a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38158fb0 con 0x7fad380cd770 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad38159200 con 0x7fad380b04f0 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad3dce8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad381594e0 con 0x7fad380cb880 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33096/0 (socket says 172.21.15.33:33096) 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 -- 172.21.15.33:0/3070581634 learned_addr learned my addr 172.21.15.33:0/3070581634 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad36ffd700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 0x7fad380c97a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 -- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 msgr2=0x7fad380c97a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 0x7fad380c97a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad377fe700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 0x7fad3814c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 -- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 msgr2=0x7fad3814c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 0x7fad3814c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 -- 172.21.15.33:0/3070581634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad30009a20 con 0x7fad380cd770 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad36ffd700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 0x7fad380c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad377fe700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 0x7fad3814c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.118+0000 7fad37fff700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fad30013000 tx=0x7fad30019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:09.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad30012e50 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad3001d630 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad381597c0 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad3001d9f0 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad3814c690 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.119+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad38159ce0 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.120+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fad30024070 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.120+0000 7fad1f7fe700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 0x7fad240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.120+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fad300874f0 con 0x7fad380cd770 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.121+0000 7fad377fe700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 0x7fad240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:09.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.121+0000 7fad377fe700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 0x7fad240697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fad280018d0 tx=0x7fad28009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:09.125 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.125+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fad38159ce0 con 0x7fad380cd770 2023-10-09T15:40:09.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.346+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rename", "vol_name": "cephfs", "new_vol_name": "volume_0000000000437078", "yes_i_really_mean_it": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fad38159ce0 con 0x7fad24067320 2023-10-09T15:40:09.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.973+0000 7fad1f7fe700 1 -- 172.21.15.33:0/3070581634 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+56 (secure 0 0 0) 0x7fad38159ce0 con 0x7fad24067320 2023-10-09T15:40:09.973 INFO:teuthology.orchestra.run.smithi033.stdout:FS volume 'cephfs' renamed to 'volume_0000000000437078' 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.975+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 msgr2=0x7fad240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.975+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 0x7fad240697d0 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fad280018d0 tx=0x7fad28009040 comp rx=0 tx=0).stop 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.975+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 msgr2=0x7fad380c9ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.975+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7fad30013000 tx=0x7fad30019000 comp rx=0 tx=0).stop 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 shutdown_connections 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fad24067320 0x7fad240697d0 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fad380cd770 0x7fad380c9ce0 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fad380b04f0 0x7fad3814c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 --2- 172.21.15.33:0/3070581634 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fad380cb880 0x7fad380c97a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 >> 172.21.15.33:0/3070581634 conn(0x7fad380703a0 msgr2=0x7fad381581d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 shutdown_connections 2023-10-09T15:40:09.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:09.976+0000 7fad3dce8700 1 -- 172.21.15.33:0/3070581634 wait complete. 2023-10-09T15:40:09.991 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:40:10.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.117+0000 7f4f900a8700 1 Processor -- start 2023-10-09T15:40:10.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.117+0000 7f4f900a8700 1 -- start start 2023-10-09T15:40:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f900a8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f881598b0 0x7f4f880af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f900a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f88163590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f900a8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f880ce9d0 con 0x7f4f88159c80 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f900a8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f880afc30 con 0x7f4f881598b0 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f900a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880aff10 con 0x7f4f880af790 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f8de44700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f881598b0 0x7f4f880af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f8de44700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4f881598b0 0x7f4f880af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33100/0 (socket says 172.21.15.33:33100) 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f8de44700 1 -- 172.21.15.33:0/671032263 learned_addr learned my addr 172.21.15.33:0/671032263 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.118+0000 7f4f8d643700 1 --1- 172.21.15.33:0/671032263 >> v1:172.21.15.33:6789/0 conn(0x7f4f88159c80 0x7f4f880cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43878/0 (socket says 172.21.15.33:43878) 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8e645700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f88163590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8de44700 1 -- 172.21.15.33:0/671032263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 msgr2=0x7f4f88163590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8de44700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f88163590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8de44700 1 -- 172.21.15.33:0/671032263 >> v1:172.21.15.33:6789/0 conn(0x7f4f88159c80 legacy=0x7f4f880cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8de44700 1 -- 172.21.15.33:0/671032263 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f880ce380 con 0x7f4f881598b0 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8ce42700 1 -- 172.21.15.33:0/671032263 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764178184 0 0) 0x7f4f880ce9d0 con 0x7f4f88159c80 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8de44700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f880af250 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009f20 tx=0x7f4f80009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70df7c8c7d57a223 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8ce42700 1 -- 172.21.15.33:0/671032263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000e070 con 0x7f4f881598b0 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8ce42700 1 -- 172.21.15.33:0/671032263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f8000ba80 con 0x7f4f881598b0 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.119+0000 7f4f8ce42700 1 -- 172.21.15.33:0/671032263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f800092e0 con 0x7f4f881598b0 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 -- 172.21.15.33:0/671032263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 msgr2=0x7f4f880af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f880af250 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009f20 tx=0x7f4f80009840 comp rx=0 tx=0).stop 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 -- 172.21.15.33:0/671032263 shutdown_connections 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f88163590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 --2- 172.21.15.33:0/671032263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f880af250 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 -- 172.21.15.33:0/671032263 >> 172.21.15.33:0/671032263 conn(0x7f4f88070e30 msgr2=0x7f4f880d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 -- 172.21.15.33:0/671032263 shutdown_connections 2023-10-09T15:40:10.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.120+0000 7f4f900a8700 1 -- 172.21.15.33:0/671032263 wait complete. 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.121+0000 7f4f900a8700 1 Processor -- start 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.121+0000 7f4f900a8700 1 -- start start 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f880b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 0x7f4f8814d4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f8815fd10 con 0x7f4f881598b0 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880b4550 con 0x7f4f88159c80 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f880b3940 con 0x7f4f880af790 2023-10-09T15:40:10.126 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33104/0 (socket says 172.21.15.33:33104) 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 -- 172.21.15.33:0/2952026517 learned_addr learned my addr 172.21.15.33:0/2952026517 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8de44700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f880b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8e645700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 0x7f4f8814d4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 -- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 msgr2=0x7f4f880b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f880b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 -- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 msgr2=0x7f4f8814d4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 0x7f4f8814d4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 -- 172.21.15.33:0/2952026517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f80009ae0 con 0x7f4f881598b0 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8e645700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 0x7f4f8814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f8d643700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c5e0 tx=0x7f4f7c001040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.127 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c005a70 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f7c005bd0 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f7c0070d0 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.122+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f880b3c20 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.123+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f880b41e0 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.123+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f8804c3c0 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.124+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4f7c007440 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.124+0000 7f4f85ffb700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 0x7f4f740697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.124+0000 7f4f8de44700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 0x7f4f740697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.124+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f4f7c084150 con 0x7f4f881598b0 2023-10-09T15:40:10.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.125+0000 7f4f8de44700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 0x7f4f740697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009880 tx=0x7f4f80018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.129 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.129+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4f7c050d90 con 0x7f4f881598b0 2023-10-09T15:40:10.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.347+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f4f880b4690 con 0x7f4f74067320 2023-10-09T15:40:10.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.349+0000 7f4f85ffb700 1 -- 172.21.15.33:0/2952026517 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+58 (secure 0 0 0) 0x7f4f880b4690 con 0x7f4f74067320 2023-10-09T15:40:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:40:10.349 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:10.349 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "volume_0000000000437078" 2023-10-09T15:40:10.349 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:10.349 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:40:10.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.350+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 msgr2=0x7f4f740697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 0x7f4f740697d0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f4f80009880 tx=0x7f4f80018000 comp rx=0 tx=0).stop 2023-10-09T15:40:10.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 msgr2=0x7f4f8815f7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c00c5e0 tx=0x7f4f7c001040 comp rx=0 tx=0).stop 2023-10-09T15:40:10.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 shutdown_connections 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4f74067320 0x7f4f740697d0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4f88159c80 0x7f4f8814d4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4f880af790 0x7f4f880b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 --2- 172.21.15.33:0/2952026517 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4f881598b0 0x7f4f8815f7d0 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 >> 172.21.15.33:0/2952026517 conn(0x7f4f88070e30 msgr2=0x7f4f881549d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 shutdown_connections 2023-10-09T15:40:10.352 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.351+0000 7f4f900a8700 1 -- 172.21.15.33:0/2952026517 wait complete. 2023-10-09T15:40:10.363 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:10.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.482+0000 7f98432cd700 1 Processor -- start 2023-10-09T15:40:10.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.482+0000 7f98432cd700 1 -- start start 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98432cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f983c15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98432cd700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c15afd0 con 0x7f983c0cf110 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98432cd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f983c15b2b0 con 0x7f983c15de50 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98432cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15b590 con 0x7f983c153c30 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f9842acc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f983c0cf110 0x7f983c15c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:43890/0 (socket says 172.21.15.33:43890) 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f9842acc700 1 -- 172.21.15.33:0/3112366703 learned_addr learned my addr 172.21.15.33:0/3112366703 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:10.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f983c15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1542027718 0 0) 0x7f983c15afd0 con 0x7f983c0cf110 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.483+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9824003570 con 0x7f983c0cf110 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1745605059 0 0) 0x7f9824003570 con 0x7f983c0cf110 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 msgr2=0x7f983c15a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f983c15a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 >> v1:172.21.15.59:6789/0 conn(0x7f983c15de50 legacy=0x7f983c0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c15b870 con 0x7f983c0cf110 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f9834001470 con 0x7f983c0cf110 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f983c15a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 >> v1:172.21.15.33:6789/0 conn(0x7f983c0cf110 legacy=0x7f983c15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f9824003e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9824004810 0x7f9824004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f98240051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c15b590 con 0x7f9824003a90 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f982400bb10 con 0x7f9824004810 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f982400bc80 con 0x7f983c153c30 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f9824003e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f9842acc700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f98240051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f9841aca700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9824004810 0x7f9824004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 -- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 msgr2=0x7f98240051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f98240051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 -- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9824004810 msgr2=0x7f9824004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9824004810 0x7f9824004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 -- 172.21.15.33:0/3112366703 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f982c009a20 con 0x7f9824003a90 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f9841aca700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9824004810 0x7f9824004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f9842acc700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c153c30 0x7f98240051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98422cb700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f9824003e60 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f982c00e3c0 tx=0x7f982c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e506f453c30d17b2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c009c50 con 0x7f9824003a90 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c00f040 con 0x7f9824003a90 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.484+0000 7f98412c9700 1 -- 172.21.15.33:0/3112366703 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c00ee40 con 0x7f9824003a90 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 -- 172.21.15.33:0/3112366703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 msgr2=0x7f9824003e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 --2- 172.21.15.33:0/3112366703 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f9824003e60 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f982c00e3c0 tx=0x7f982c00b040 comp rx=0 tx=0).stop 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f9842acc700 1 -- 172.21.15.33:0/3112366703 reap_dead start 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 -- 172.21.15.33:0/3112366703 shutdown_connections 2023-10-09T15:40:10.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 -- 172.21.15.33:0/3112366703 >> 172.21.15.33:0/3112366703 conn(0x7f983c0703a0 msgr2=0x7f983c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:10.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 -- 172.21.15.33:0/3112366703 shutdown_connections 2023-10-09T15:40:10.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.485+0000 7f98432cd700 1 -- 172.21.15.33:0/3112366703 wait complete. 2023-10-09T15:40:10.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.486+0000 7f98432cd700 1 Processor -- start 2023-10-09T15:40:10.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.486+0000 7f98432cd700 1 -- start start 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983c145fb0 0x7f983c0c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c0ca020 0x7f983c0cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0c9650 con 0x7f9824003a90 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0b6130 con 0x7f983c145fb0 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98432cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f983c0c8a40 con 0x7f983c0ca020 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33114/0 (socket says 172.21.15.33:33114) 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 -- 172.21.15.33:0/2405548989 learned_addr learned my addr 172.21.15.33:0/2405548989 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f9842acc700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c0ca020 0x7f983c0cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f9841aca700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983c145fb0 0x7f983c0c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 -- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c0ca020 msgr2=0x7f983c0cc0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c0ca020 0x7f983c0cc0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 -- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983c145fb0 msgr2=0x7f983c0c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983c145fb0 0x7f983c0c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 -- 172.21.15.33:0/2405548989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f983c0c8d20 con 0x7f9824003a90 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.487+0000 7f98422cb700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f9824004730 tx=0x7f982c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.488+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c01f650 con 0x7f9824003a90 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.488+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f982c01f7d0 con 0x7f9824003a90 2023-10-09T15:40:10.493 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.488+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f983c0c9000 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.488+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f982c01fb90 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.488+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f983c153270 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.489+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f983c04c3c0 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.489+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f982c003040 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.489+0000 7f983a7fc700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 0x7f9828069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.490+0000 7f9841aca700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 0x7f9828069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.490+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f982c0871d0 con 0x7f9824003a90 2023-10-09T15:40:10.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.490+0000 7f9841aca700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 0x7f9828069800 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f983c0d0df0 tx=0x7f9830009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.494+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f982c053db0 con 0x7f9824003a90 2023-10-09T15:40:10.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.734+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f983c15bb50 con 0x7f9824003a90 2023-10-09T15:40:10.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.735+0000 7f983a7fc700 1 -- 172.21.15.33:0/2405548989 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4621 (secure 0 0 0) 0x7f982c0573d0 con 0x7f9824003a90 2023-10-09T15:40:10.735 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:10.735 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:40:06.940989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000437078","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 msgr2=0x7f9828069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 0x7f9828069800 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f983c0d0df0 tx=0x7f9830009040 comp rx=0 tx=0).stop 2023-10-09T15:40:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 msgr2=0x7f983c0b5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f9824004730 tx=0x7f982c01a000 comp rx=0 tx=0).stop 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 shutdown_connections 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9828067350 0x7f9828069800 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9824003a90 0x7f983c0b5bf0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f983c0ca020 0x7f983c0cc0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 --2- 172.21.15.33:0/2405548989 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f983c145fb0 0x7f983c0c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 >> 172.21.15.33:0/2405548989 conn(0x7f983c0703a0 msgr2=0x7f983c0c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 shutdown_connections 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.737+0000 7f98432cd700 1 -- 172.21.15.33:0/2405548989 wait complete. 2023-10-09T15:40:10.738 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 125 2023-10-09T15:40:10.749 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.868+0000 7fdaea59c700 1 Processor -- start 2023-10-09T15:40:10.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.868+0000 7fdaea59c700 1 -- start start 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdaea59c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdae415de50 0x7fdae40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdaea59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdae415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdaea59c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdae40cf3c0 con 0x7fdae4153c30 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdaea59c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdae415afd0 con 0x7fdae415de50 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdaea59c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae415b2b0 con 0x7fdae40cef40 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae959a700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdae4153c30 0x7fdae415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40976/0 (socket says 172.21.15.33:40976) 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae959a700 1 -- 172.21.15.33:0/218485236 learned_addr learned my addr 172.21.15.33:0/218485236 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:10.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae8d99700 1 --2- 172.21.15.33:0/218485236 >> v2:172.21.15.59:3300/0 conn(0x7fdae415de50 0x7fdae40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdae415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3870315994 0 0) 0x7fdae40cf3c0 con 0x7fdae4153c30 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdacc003570 con 0x7fdae4153c30 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.869+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1780611 0 0) 0x7fdacc003570 con 0x7fdae4153c30 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 msgr2=0x7fdae415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdae415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 >> v2:172.21.15.59:3300/0 conn(0x7fdae415de50 msgr2=0x7fdae40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 --2- 172.21.15.33:0/218485236 >> v2:172.21.15.59:3300/0 conn(0x7fdae415de50 0x7fdae40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae415b590 con 0x7fdae4153c30 2023-10-09T15:40:10.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fdadc001470 con 0x7fdae4153c30 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 >> v1:172.21.15.33:6789/0 conn(0x7fdae4153c30 legacy=0x7fdae415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc003a60 0x7fdacc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc004810 0x7fdacc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdacc0051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae415afd0 con 0x7fdacc004810 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae415b2b0 con 0x7fdacc003a60 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdacc00ba60 con 0x7fdae40cef40 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc004810 0x7fdacc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae959a700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc003a60 0x7fdacc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.874 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdacc0051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 -- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 msgr2=0x7fdacc0051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdacc0051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 -- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc003a60 msgr2=0x7fdacc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc003a60 0x7fdacc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 -- 172.21.15.33:0/218485236 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdacc003570 con 0x7fdacc004810 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40cef40 0x7fdacc0051c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae8d99700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc004810 0x7fdacc004c80 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c30 tx=0x7fdad80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ac37ce3c56c299b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800e710 con 0x7fdacc004810 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad800e870 con 0x7fdacc004810 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.870+0000 7fdae3fff700 1 -- 172.21.15.33:0/218485236 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad800ec30 con 0x7fdacc004810 2023-10-09T15:40:10.875 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 -- 172.21.15.33:0/218485236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc004810 msgr2=0x7fdacc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 --2- 172.21.15.33:0/218485236 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdacc004810 0x7fdacc004c80 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdad8009c30 tx=0x7fdad80091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdae9d9b700 1 -- 172.21.15.33:0/218485236 reap_dead start 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 -- 172.21.15.33:0/218485236 shutdown_connections 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 -- 172.21.15.33:0/218485236 >> 172.21.15.33:0/218485236 conn(0x7fdae40703a0 msgr2=0x7fdae40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 -- 172.21.15.33:0/218485236 shutdown_connections 2023-10-09T15:40:10.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.871+0000 7fdaea59c700 1 -- 172.21.15.33:0/218485236 wait complete. 2023-10-09T15:40:10.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.872+0000 7fdaea59c700 1 Processor -- start 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.872+0000 7fdaea59c700 1 -- start start 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc004810 0x7fdae4151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40c8280 0x7fdae40b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae416a080 con 0x7fdae40cbdf0 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40c86f0 con 0x7fdacc004810 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdaea59c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdae40b32d0 con 0x7fdae40c8280 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43856/0 (socket says 172.21.15.33:43856) 2023-10-09T15:40:10.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 -- 172.21.15.33:0/4028296871 learned_addr learned my addr 172.21.15.33:0/4028296871 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae8d99700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40c8280 0x7fdae40b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae959a700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc004810 0x7fdae4151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 -- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40c8280 msgr2=0x7fdae40b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40c8280 0x7fdae40b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 -- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc004810 msgr2=0x7fdae4151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.873+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc004810 0x7fdae4151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdae9d9b700 1 -- 172.21.15.33:0/4028296871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdae40cb960 con 0x7fdae40cbdf0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdae9d9b700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fdae4071370 tx=0x7fdad400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad401b070 con 0x7fdae40cbdf0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdad400f040 con 0x7fdae40cbdf0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdad400e050 con 0x7fdae40cbdf0 2023-10-09T15:40:10.880 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdae40b3520 con 0x7fdae40cbdf0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.874+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdae40cb590 con 0x7fdae40cbdf0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.875+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdae40cb7b0 con 0x7fdae40cbdf0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.875+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdad4003020 con 0x7fdae40cbdf0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.876+0000 7fdae17fa700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 0x7fdad00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.876+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fdad4085290 con 0x7fdae40cbdf0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.876+0000 7fdae959a700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 0x7fdad00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.876+0000 7fdae959a700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 0x7fdad00697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdadc000e10 tx=0x7fdadc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:10.881 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:10.880+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdad4051d80 con 0x7fdae40cbdf0 2023-10-09T15:40:11.077 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.077+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdae40cbaf0 con 0x7fdae40cbdf0 2023-10-09T15:40:11.078 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.078+0000 7fdae17fa700 1 -- 172.21.15.33:0/4028296871 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fdad4010ea0 con 0x7fdae40cbdf0 2023-10-09T15:40:11.078 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:11.078 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":189,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:08.956017+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000437078.meta","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000437078"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000437078.data","create_time":"2023-10-09T15:39:54.250723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000437078"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:11.080 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 msgr2=0x7fdad00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 0x7fdad00697d0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7fdadc000e10 tx=0x7fdadc009040 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 msgr2=0x7fdae40cc270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fdae4071370 tx=0x7fdad400b040 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 shutdown_connections 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdad0067320 0x7fdad00697d0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdae40cbdf0 0x7fdae40cc270 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdacc004810 0x7fdae4151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 --2- 172.21.15.33:0/4028296871 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdae40c8280 0x7fdae40b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 >> 172.21.15.33:0/4028296871 conn(0x7fdae40703a0 msgr2=0x7fdae41530d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 shutdown_connections 2023-10-09T15:40:11.081 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.080+0000 7fdaea59c700 1 -- 172.21.15.33:0/4028296871 wait complete. 2023-10-09T15:40:11.093 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:40:11.093 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:40:11.135 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:40:11.186 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:40:11.187 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:11.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.306+0000 7fd9037cd700 1 Processor -- start 2023-10-09T15:40:11.306 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 -- start start 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cd9e0 0x7fd8fc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 0x7fd8fc15a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc0d13f0 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8fc15a940 con 0x7fd8fc0cde50 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.307+0000 7fd9037cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15ae40 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43860/0 (socket says 172.21.15.33:43860) 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 -- 172.21.15.33:0/2053297671 learned_addr learned my addr 172.21.15.33:0/2053297671 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901d6a700 1 --2- 172.21.15.33:0/2053297671 >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 0x7fd8fc15a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 -- 172.21.15.33:0/2053297671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cd9e0 msgr2=0x7fd8fc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd900d68700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cd9e0 0x7fd8fc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cd9e0 0x7fd8fc159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 -- 172.21.15.33:0/2053297671 >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 msgr2=0x7fd8fc15a400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 --2- 172.21.15.33:0/2053297671 >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 0x7fd8fc15a400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 -- 172.21.15.33:0/2053297671 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8fc15ab60 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901d6a700 1 --2- 172.21.15.33:0/2053297671 >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 0x7fd8fc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd901569700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0cbeb0 tx=0x7fd8ec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d877eef871f7abdd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd8fbfff700 1 -- 172.21.15.33:0/2053297671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec00e070 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd8fbfff700 1 -- 172.21.15.33:0/2053297671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec00ba40 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.308+0000 7fd8fbfff700 1 -- 172.21.15.33:0/2053297671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec0092e0 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 -- 172.21.15.33:0/2053297671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cb5a0 msgr2=0x7fd8fc0cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0cbeb0 tx=0x7fd8ec009840 comp rx=0 tx=0).stop 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 -- 172.21.15.33:0/2053297671 shutdown_connections 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 --2- 172.21.15.33:0/2053297671 >> v2:172.21.15.59:3300/0 conn(0x7fd8fc0cde50 0x7fd8fc15a400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cb5a0 0x7fd8fc0cb970 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 --2- 172.21.15.33:0/2053297671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cd9e0 0x7fd8fc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 -- 172.21.15.33:0/2053297671 >> 172.21.15.33:0/2053297671 conn(0x7fd8fc070e30 msgr2=0x7fd8fc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 -- 172.21.15.33:0/2053297671 shutdown_connections 2023-10-09T15:40:11.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.309+0000 7fd9037cd700 1 -- 172.21.15.33:0/2053297671 wait complete. 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.310+0000 7fd9037cd700 1 Processor -- start 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.310+0000 7fd9037cd700 1 -- start start 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cb5a0 0x7fd8fc15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8fc0ca640 0x7fd8fc0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc0b5430 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15c380 con 0x7fd8fc0ca640 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8fc15b770 con 0x7fd8fc0cb5a0 2023-10-09T15:40:11.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43872/0 (socket says 172.21.15.33:43872) 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 -- 172.21.15.33:0/1984675402 learned_addr learned my addr 172.21.15.33:0/1984675402 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd901569700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cb5a0 0x7fd8fc15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 -- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cb5a0 msgr2=0x7fd8fc15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cb5a0 0x7fd8fc15b070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 -- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8fc0ca640 msgr2=0x7fd8fc0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8fc0ca640 0x7fd8fc0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 -- 172.21.15.33:0/1984675402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8ec009ae0 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd900d68700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c7d0 tx=0x7fd8f0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0011600 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8f0011760 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.311+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8fc15ba50 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.312+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0011b20 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.312+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8fc15c010 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.312+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8fc04c3c0 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.313+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd8f00193f0 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.313+0000 7fd8f97fa700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 0x7fd8e80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.313+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd8f0085210 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.313+0000 7fd901569700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 0x7fd8e80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.314+0000 7fd901569700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 0x7fd8e80697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009f20 tx=0x7fd8ec018000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.318+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8f0051d40 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.558+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd8fc0ccf00 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.575 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.558+0000 7fd8f97fa700 1 -- 172.21.15.33:0/1984675402 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4621 (secure 0 0 0) 0x7fd8f0055360 con 0x7fd8fc0cd9e0 2023-10-09T15:40:11.575 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:11.575 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:40:06.940989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000437078","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 msgr2=0x7fd8e80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 0x7fd8e80697d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec009f20 tx=0x7fd8ec018000 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 msgr2=0x7fd8fc0b4ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd8f000c7d0 tx=0x7fd8f0008040 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 shutdown_connections 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd8e8067320 0x7fd8e80697d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8fc0ca640 0x7fd8fc0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8fc0cb5a0 0x7fd8fc15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 --2- 172.21.15.33:0/1984675402 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8fc0cd9e0 0x7fd8fc0b4ef0 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 >> 172.21.15.33:0/1984675402 conn(0x7fd8fc070e30 msgr2=0x7fd8fc0b29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 shutdown_connections 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.561+0000 7fd9037cd700 1 -- 172.21.15.33:0/1984675402 wait complete. 2023-10-09T15:40:11.577 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 125 2023-10-09T15:40:11.578 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:11.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.699+0000 7f2f9e571700 1 Processor -- start 2023-10-09T15:40:11.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.699+0000 7f2f9e571700 1 -- start start 2023-10-09T15:40:11.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 0x7f2f9815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f9815de50 0x7f2f980cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f980cef40 0x7f2f9806d790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9815afd0 con 0x7f2f980cef40 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f9815b2b0 con 0x7f2f9815de50 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9e571700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f9815b590 con 0x7f2f98153c30 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f980cef40 0x7f2f9806d790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f2f980cef40 0x7f2f9806d790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43882/0 (socket says 172.21.15.33:43882) 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 -- 172.21.15.33:0/8559237 learned_addr learned my addr 172.21.15.33:0/8559237 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:11.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9cd6e700 1 --2- 172.21.15.33:0/8559237 >> v2:172.21.15.59:3300/0 conn(0x7f2f9815de50 0x7f2f980cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9d56f700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 0x7f2f9815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 -- 172.21.15.33:0/8559237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 msgr2=0x7f2f9815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 0x7f2f9815a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 -- 172.21.15.33:0/8559237 >> v2:172.21.15.59:3300/0 conn(0x7f2f9815de50 msgr2=0x7f2f980cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/8559237 >> v2:172.21.15.59:3300/0 conn(0x7f2f9815de50 0x7f2f980cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 -- 172.21.15.33:0/8559237 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f9815b870 con 0x7f2f980cef40 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9d56f700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 0x7f2f9815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.700+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f980cef40 0x7f2f9806d790 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806e800 tx=0x7f2f90009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3707cd96e6b2f37 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f8ffff700 1 -- 172.21.15.33:0/8559237 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f9000e070 con 0x7f2f980cef40 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f8ffff700 1 -- 172.21.15.33:0/8559237 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f9000ba50 con 0x7f2f980cef40 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f8ffff700 1 -- 172.21.15.33:0/8559237 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900092e0 con 0x7f2f980cef40 2023-10-09T15:40:11.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 -- 172.21.15.33:0/8559237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f980cef40 msgr2=0x7f2f9806d790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f980cef40 0x7f2f9806d790 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806e800 tx=0x7f2f90009840 comp rx=0 tx=0).stop 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 -- 172.21.15.33:0/8559237 shutdown_connections 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f980cef40 0x7f2f9806d790 unknown :-1 s=CLOSED pgs=1673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 --2- 172.21.15.33:0/8559237 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f98153c30 0x7f2f9815a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 --2- 172.21.15.33:0/8559237 >> v2:172.21.15.59:3300/0 conn(0x7f2f9815de50 0x7f2f980cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 -- 172.21.15.33:0/8559237 >> 172.21.15.33:0/8559237 conn(0x7f2f980703a0 msgr2=0x7f2f980707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 -- 172.21.15.33:0/8559237 shutdown_connections 2023-10-09T15:40:11.704 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.701+0000 7f2f9e571700 1 -- 172.21.15.33:0/8559237 wait complete. 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.702+0000 7f2f9e571700 1 Processor -- start 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.702+0000 7f2f9e571700 1 -- start start 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f980cef40 0x7f2f9814f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f98153c30 0x7f2f980c99a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980ca420 con 0x7f2f9815de50 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f980b1c10 con 0x7f2f98153c30 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9e571700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f98151140 con 0x7f2f980cef40 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9dd70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9dd70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43890/0 (socket says 172.21.15.33:43890) 2023-10-09T15:40:11.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9dd70700 1 -- 172.21.15.33:0/3263999076 learned_addr learned my addr 172.21.15.33:0/3263999076 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9d56f700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f980cef40 0x7f2f9814f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.703+0000 7f2f9cd6e700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f98153c30 0x7f2f980c99a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 -- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f980cef40 msgr2=0x7f2f9814f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f980cef40 0x7f2f9814f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 -- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f98153c30 msgr2=0x7f2f980c99a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f98153c30 0x7f2f980c99a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 -- 172.21.15.33:0/3263999076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f90009ae0 con 0x7f2f9815de50 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9dd70700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806eb00 tx=0x7f2f90018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f900032f0 con 0x7f2f9815de50 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f90008d20 con 0x7f2f9815de50 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f98151420 con 0x7f2f9815de50 2023-10-09T15:40:11.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f90026690 con 0x7f2f9815de50 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.704+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f981519e0 con 0x7f2f9815de50 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.705+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f98151c00 con 0x7f2f9815de50 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.705+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f90003040 con 0x7f2f9815de50 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.706+0000 7f2f8d7fa700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 0x7f2f7c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.706+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f2f90086d20 con 0x7f2f9815de50 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.706+0000 7f2f9d56f700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 0x7f2f7c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:11.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.706+0000 7f2f9d56f700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 0x7f2f7c0697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400adc0 tx=0x7f2f94006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:11.710 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.710+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f90053850 con 0x7f2f9815de50 2023-10-09T15:40:11.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.905+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2f9804c3c0 con 0x7f2f9815de50 2023-10-09T15:40:11.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.905+0000 7f2f8d7fa700 1 -- 172.21.15.33:0/3263999076 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f2f90056e70 con 0x7f2f9815de50 2023-10-09T15:40:11.906 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:11.906 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":189,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:08.956017+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000437078.meta","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000437078"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000437078.data","create_time":"2023-10-09T15:39:54.250723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000437078"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:11.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.907+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 msgr2=0x7f2f7c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.907+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 0x7f2f7c0697d0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f2f9400adc0 tx=0x7f2f94006f90 comp rx=0 tx=0).stop 2023-10-09T15:40:11.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.907+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 msgr2=0x7f2f980c9ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:11.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.907+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f2f9806eb00 tx=0x7f2f90018000 comp rx=0 tx=0).stop 2023-10-09T15:40:11.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 shutdown_connections 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f7c067320 0x7f2f7c0697d0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f9815de50 0x7f2f980c9ee0 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f980cef40 0x7f2f9814f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 --2- 172.21.15.33:0/3263999076 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f98153c30 0x7f2f980c99a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 >> 172.21.15.33:0/3263999076 conn(0x7f2f980703a0 msgr2=0x7f2f980c52d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 shutdown_connections 2023-10-09T15:40:11.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:11.908+0000 7f2f9e571700 1 -- 172.21.15.33:0/3263999076 wait complete. 2023-10-09T15:40:11.920 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 31, 'pool_name': 'cephfs.volume_0000000000437078.meta', 'create_time': '2023-10-09T15:39:53.684588+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'volume_0000000000437078'}}}, {'pool': 32, 'pool_name': 'cephfs.volume_0000000000437078.data', 'create_time': '2023-10-09T15:39:54.250723+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '187', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'volume_0000000000437078'}}}] 2023-10-09T15:40:11.921 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:40:12.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.043+0000 7fb0bf942700 1 Processor -- start 2023-10-09T15:40:12.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.043+0000 7fb0bf942700 1 -- start start 2023-10-09T15:40:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bf942700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bf942700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b8068350 con 0x7fb0b80c98e0 2023-10-09T15:40:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bf942700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0b80c9d30 con 0x7fb0b8159970 2023-10-09T15:40:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bf942700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0b8068db0 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bcedd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bcedd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43900/0 (socket says 172.21.15.33:43900) 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bcedd700 1 -- 172.21.15.33:0/2052016600 learned_addr learned my addr 172.21.15.33:0/2052016600 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.044+0000 7fb0bdedf700 1 --1- 172.21.15.33:0/2052016600 >> v1:172.21.15.33:6789/0 conn(0x7fb0b80c98e0 0x7fb0b80c7d20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40978/0 (socket says 172.21.15.33:40978) 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bcedd700 1 -- 172.21.15.33:0/2052016600 >> v1:172.21.15.59:6789/0 conn(0x7fb0b8159970 legacy=0x7fb0b80686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bcedd700 1 -- 172.21.15.33:0/2052016600 >> v1:172.21.15.33:6789/0 conn(0x7fb0b80c98e0 legacy=0x7fb0b80c7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0b7fff700 1 -- 172.21.15.33:0/2052016600 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1468925199 0 0) 0x7fb0b8068350 con 0x7fb0b80c98e0 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bcedd700 1 -- 172.21.15.33:0/2052016600 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0b8067740 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bcedd700 1 --2- 172.21.15.33:0/2052016600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0099b0 tx=0x7fb0ac009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10da33f487aaff1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.047 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0b7fff700 1 -- 172.21.15.33:0/2052016600 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00b820 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0b7fff700 1 -- 172.21.15.33:0/2052016600 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ac00b980 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0b7fff700 1 -- 172.21.15.33:0/2052016600 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac00bd20 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bf942700 1 -- 172.21.15.33:0/2052016600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b80cbbc0 msgr2=0x7fb0b80c93a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bf942700 1 --2- 172.21.15.33:0/2052016600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7fb0ac0099b0 tx=0x7fb0ac009250 comp rx=0 tx=0).stop 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bf942700 1 -- 172.21.15.33:0/2052016600 shutdown_connections 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bf942700 1 --2- 172.21.15.33:0/2052016600 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b80c93a0 unknown :-1 s=CLOSED pgs=1676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.045+0000 7fb0bf942700 1 -- 172.21.15.33:0/2052016600 >> 172.21.15.33:0/2052016600 conn(0x7fb0b806e250 msgr2=0x7fb0b80cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.048 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.046+0000 7fb0bf942700 1 -- 172.21.15.33:0/2052016600 shutdown_connections 2023-10-09T15:40:12.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.046+0000 7fb0bf942700 1 -- 172.21.15.33:0/2052016600 wait complete. 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.047+0000 7fb0bf942700 1 Processor -- start 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.047+0000 7fb0bf942700 1 -- start start 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b80c98e0 0x7fb0b80c4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b8154120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b815ae80 con 0x7fb0b8159970 2023-10-09T15:40:12.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b815a5e0 con 0x7fb0b80cbbc0 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0b815a8c0 con 0x7fb0b80c98e0 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43916/0 (socket says 172.21.15.33:43916) 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 -- 172.21.15.33:0/1415029998 learned_addr learned my addr 172.21.15.33:0/1415029998 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bcedd700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b8154120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bd6de700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b80c98e0 0x7fb0b80c4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 -- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b80c98e0 msgr2=0x7fb0b80c4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b80c98e0 0x7fb0b80c4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.053 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 -- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b80cbbc0 msgr2=0x7fb0b8154120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b8154120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 -- 172.21.15.33:0/1415029998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ac0094f0 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bdedf700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800cd50 tx=0x7fb0a8001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a8005df0 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0a800a8b0 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0b815aba0 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0a800ac70 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.048+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0b80c4e80 con 0x7fb0b8159970 2023-10-09T15:40:12.054 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.049+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0b80b0690 con 0x7fb0b8159970 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.050+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb0a8007300 con 0x7fb0b8159970 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.050+0000 7fb0b57fa700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 0x7fb0a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.050+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb0a8084d40 con 0x7fb0b8159970 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.050+0000 7fb0bd6de700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 0x7fb0a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.051+0000 7fb0bd6de700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 0x7fb0a40697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009af0 tx=0x7fb0b0009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.055 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.054+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb0b80b0690 con 0x7fb0b8159970 2023-10-09T15:40:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.245+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb0b80b0690 con 0x7fb0b8159970 2023-10-09T15:40:12.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.245+0000 7fb0b57fa700 1 -- 172.21.15.33:0/1415029998 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb0b80b0690 con 0x7fb0b8159970 2023-10-09T15:40:12.246 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:40:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 msgr2=0x7fb0a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 0x7fb0a40697d0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fb0b0009af0 tx=0x7fb0b0009060 comp rx=0 tx=0).stop 2023-10-09T15:40:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 msgr2=0x7fb0b8159d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7fb0a800cd50 tx=0x7fb0a8001b10 comp rx=0 tx=0).stop 2023-10-09T15:40:12.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 shutdown_connections 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb0a4067320 0x7fb0a40697d0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb0b8159970 0x7fb0b8159d40 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb0b80c98e0 0x7fb0b80c4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 --2- 172.21.15.33:0/1415029998 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb0b80cbbc0 0x7fb0b8154120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 >> 172.21.15.33:0/1415029998 conn(0x7fb0b806e250 msgr2=0x7fb0b80cd430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 shutdown_connections 2023-10-09T15:40:12.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.248+0000 7fb0bf942700 1 -- 172.21.15.33:0/1415029998 wait complete. 2023-10-09T15:40:12.260 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000437078.meta pg_num 2023-10-09T15:40:12.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.382+0000 7f55ce77a700 1 Processor -- start 2023-10-09T15:40:12.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.382+0000 7f55ce77a700 1 -- start start 2023-10-09T15:40:12.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55ce77a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f55c8159530 0x7f55c80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55ce77a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80ccfd0 con 0x7f55c806dc70 2023-10-09T15:40:12.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55ce77a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c80cf0e0 con 0x7f55c806e0e0 2023-10-09T15:40:12.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55ce77a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55c815a3d0 con 0x7f55c8159530 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55c77fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f55c806dc70 0x7f55c8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40982/0 (socket says 172.21.15.33:40982) 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55c77fe700 1 -- 172.21.15.33:0/3601177155 learned_addr learned my addr 172.21.15.33:0/3601177155 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.383+0000 7f55c7fff700 1 --2- 172.21.15.33:0/3601177155 >> v2:172.21.15.59:3300/0 conn(0x7f55c8159530 0x7f55c80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 122359564 0 0) 0x7f55c80ccfd0 con 0x7f55c806dc70 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b4003570 con 0x7f55c806dc70 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c7fff700 1 -- 172.21.15.33:0/3601177155 >> v1:172.21.15.59:6789/0 conn(0x7f55c806e0e0 legacy=0x7f55c80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1992757657 0 0) 0x7f55b4003570 con 0x7f55c806dc70 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c7fff700 1 -- 172.21.15.33:0/3601177155 >> v1:172.21.15.33:6789/0 conn(0x7f55c806dc70 legacy=0x7f55c8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c7fff700 1 -- 172.21.15.33:0/3601177155 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c815a6b0 con 0x7f55c8159530 2023-10-09T15:40:12.385 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c7fff700 1 --2- 172.21.15.33:0/3601177155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80ceba0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f55b00098e0 tx=0x7f55b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b6c055b93f7ac51 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b8001470 con 0x7f55c8159530 2023-10-09T15:40:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0011420 con 0x7f55c8159530 2023-10-09T15:40:12.386 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.384+0000 7f55c6ffd700 1 -- 172.21.15.33:0/3601177155 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b00117c0 con 0x7f55c8159530 2023-10-09T15:40:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 -- 172.21.15.33:0/3601177155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 msgr2=0x7f55c80ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 --2- 172.21.15.33:0/3601177155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80ceba0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f55b00098e0 tx=0x7f55b00091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 -- 172.21.15.33:0/3601177155 shutdown_connections 2023-10-09T15:40:12.389 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 --2- 172.21.15.33:0/3601177155 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80ceba0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 -- 172.21.15.33:0/3601177155 >> 172.21.15.33:0/3601177155 conn(0x7f55c80703a0 msgr2=0x7f55c80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 -- 172.21.15.33:0/3601177155 shutdown_connections 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.385+0000 7f55ce77a700 1 -- 172.21.15.33:0/3601177155 wait complete. 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.386+0000 7f55ce77a700 1 Processor -- start 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.386+0000 7f55ce77a700 1 -- start start 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55c806e0e0 0x7f55c80c9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c80ca810 con 0x7f55c806dc70 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815ecc0 con 0x7f55c8159530 2023-10-09T15:40:12.390 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c815e140 con 0x7f55c806e0e0 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43932/0 (socket says 172.21.15.33:43932) 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 -- 172.21.15.33:0/1227919249 learned_addr learned my addr 172.21.15.33:0/1227919249 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c77fe700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55c806e0e0 0x7f55c80c9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ccd17700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 -- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55c806e0e0 msgr2=0x7f55c80c9350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55c806e0e0 0x7f55c80c9350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 -- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 msgr2=0x7f55c80c9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80c9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 -- 172.21.15.33:0/1227919249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0009420 con 0x7f55c806dc70 2023-10-09T15:40:12.391 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55c7fff700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f55b00030c0 tx=0x7f55b0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b0010c20 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55b0010da0 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c815e420 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.387+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55b001d680 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.388+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c815ea60 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.388+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c804c3c0 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.389+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55b001d9f0 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.389+0000 7f55bffff700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 0x7f55a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.389+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f55b00864e0 con 0x7f55c806dc70 2023-10-09T15:40:12.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.389+0000 7f55c77fe700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 0x7f55a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.390+0000 7f55c77fe700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 0x7f55a80697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f55b8001220 tx=0x7f55b80011b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.393 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.394+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55b0053120 con 0x7f55c806dc70 2023-10-09T15:40:12.588 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.588+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000437078.meta", "var": "pg_num"} v 0) v1 -- 0x7f55c815ad40 con 0x7f55c806dc70 2023-10-09T15:40:12.589 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.589+0000 7f55bffff700 1 -- 172.21.15.33:0/1227919249 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000437078.meta", "var": "pg_num"}]=0 v189) v1 ==== 124+0+11 (secure 0 0 0) 0x7f55b0006cb0 con 0x7f55c806dc70 2023-10-09T15:40:12.589 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:40:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 msgr2=0x7f55a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 0x7f55a80697d0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f55b8001220 tx=0x7f55b80011b0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 msgr2=0x7f55c80c7790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f55b00030c0 tx=0x7f55b0017000 comp rx=0 tx=0).stop 2023-10-09T15:40:12.591 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 shutdown_connections 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55a8067320 0x7f55a80697d0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55c806dc70 0x7f55c80c7790 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55c8159530 0x7f55c80c9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 --2- 172.21.15.33:0/1227919249 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55c806e0e0 0x7f55c80c9350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.590+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 >> 172.21.15.33:0/1227919249 conn(0x7f55c80703a0 msgr2=0x7f55c8153d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.591+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 shutdown_connections 2023-10-09T15:40:12.592 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.591+0000 7f55ce77a700 1 -- 172.21.15.33:0/1227919249 wait complete. 2023-10-09T15:40:12.602 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.volume_0000000000437078.data pg_num 2023-10-09T15:40:12.724 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.724+0000 7f6b20ba3700 1 Processor -- start 2023-10-09T15:40:12.725 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.725+0000 7f6b20ba3700 1 -- start start 2023-10-09T15:40:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.725+0000 7f6b20ba3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.725+0000 7f6b20ba3700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c06f7d0 con 0x7f6b1c13c9b0 2023-10-09T15:40:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.725+0000 7f6b20ba3700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c06d7b0 con 0x7f6b1c0cc320 2023-10-09T15:40:12.727 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.725+0000 7f6b20ba3700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c06e330 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43946/0 (socket says 172.21.15.33:43946) 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 -- 172.21.15.33:0/457355297 learned_addr learned my addr 172.21.15.33:0/457355297 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b19d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6b1c13c9b0 0x7f6b1c069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40994/0 (socket says 172.21.15.33:40994) 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 -- 172.21.15.33:0/457355297 >> v1:172.21.15.59:6789/0 conn(0x7f6b1c0cc320 legacy=0x7f6b1c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 -- 172.21.15.33:0/457355297 >> v1:172.21.15.33:6789/0 conn(0x7f6b1c13c9b0 legacy=0x7f6b1c069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 -- 172.21.15.33:0/457355297 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c06da00 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1ad9d700 1 --2- 172.21.15.33:0/457355297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009f20 tx=0x7f6b0c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49cfc716a8f16250 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1959a700 1 -- 172.21.15.33:0/457355297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c00e070 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.728 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1959a700 1 -- 172.21.15.33:0/457355297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c00ba80 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.726+0000 7f6b1959a700 1 -- 172.21.15.33:0/457355297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0092e0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 -- 172.21.15.33:0/457355297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 msgr2=0x7f6b1c06a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/457355297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009f20 tx=0x7f6b0c009840 comp rx=0 tx=0).stop 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 -- 172.21.15.33:0/457355297 shutdown_connections 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/457355297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c06a110 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 -- 172.21.15.33:0/457355297 >> 172.21.15.33:0/457355297 conn(0x7f6b1c067f00 msgr2=0x7f6b1c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 -- 172.21.15.33:0/457355297 shutdown_connections 2023-10-09T15:40:12.729 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.727+0000 7f6b20ba3700 1 -- 172.21.15.33:0/457355297 wait complete. 2023-10-09T15:40:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.728+0000 7f6b20ba3700 1 Processor -- start 2023-10-09T15:40:12.732 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.728+0000 7f6b20ba3700 1 -- start start 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0cc320 0x7f6b1c0c8b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c13c9b0 0x7f6b1c0b1770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c13a530 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0cb360 con 0x7f6b1c0cc320 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b20ba3700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0cb5e0 con 0x7f6b1c13c9b0 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43950/0 (socket says 172.21.15.33:43950) 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 -- 172.21.15.33:0/4276148674 learned_addr learned my addr 172.21.15.33:0/4276148674 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:12.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b1ad9d700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c13c9b0 0x7f6b1c0b1770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b1a59c700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0cc320 0x7f6b1c0c8b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 -- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c13c9b0 msgr2=0x7f6b1c0b1770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c13c9b0 0x7f6b1c0b1770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 -- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0cc320 msgr2=0x7f6b1c0c8b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0cc320 0x7f6b1c0c8b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 -- 172.21.15.33:0/4276148674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c009ae0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b19d9b700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001eb0 tx=0x7f6b04007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.729+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b04005a70 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.730+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b04005bd0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.730+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c0cb8c0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.730+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b040070d0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.730+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c139e70 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.730+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c13a6a0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.731+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b04007480 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.731+0000 7f6b127fc700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 0x7f6afc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.731+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f6b04084000 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.731+0000 7f6b1a59c700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 0x7f6afc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:12.735 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.732+0000 7f6b1a59c700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 0x7f6afc0697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c06b890 tx=0x7f6b14009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:12.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.736+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b04050c40 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.927+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.volume_0000000000437078.data", "var": "pg_num"} v 0) v1 -- 0x7f6b1c04c3c0 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.927+0000 7f6b127fc700 1 -- 172.21.15.33:0/4276148674 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.volume_0000000000437078.data", "var": "pg_num"}]=0 v189) v1 ==== 124+0+11 (secure 0 0 0) 0x7f6b04017020 con 0x7f6b1c0cc6f0 2023-10-09T15:40:12.927 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 msgr2=0x7f6afc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 0x7f6afc0697d0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c06b890 tx=0x7f6b14009040 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 msgr2=0x7f6b1c137e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 secure :-1 s=READY pgs=1682 cs=0 l=1 rev1=1 crypto rx=0x7f6b04001eb0 tx=0x7f6b04007f40 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 shutdown_connections 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6afc067320 0x7f6afc0697d0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b1c13c9b0 0x7f6b1c0b1770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b1c0cc320 0x7f6b1c0c8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 --2- 172.21.15.33:0/4276148674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b1c0cc6f0 0x7f6b1c137e50 unknown :-1 s=CLOSED pgs=1682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:12.930 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 >> 172.21.15.33:0/4276148674 conn(0x7f6b1c067f00 msgr2=0x7f6b1c0b2a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 shutdown_connections 2023-10-09T15:40:12.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:12.929+0000 7f6b20ba3700 1 -- 172.21.15.33:0/4276148674 wait complete. 2023-10-09T15:40:12.941 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.060+0000 7f51c27ab700 1 Processor -- start 2023-10-09T15:40:13.060 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.060+0000 7f51c27ab700 1 -- start start 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c27ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 0x7f51bc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c27ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 0x7f51bc163430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c27ab700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f51bc06c7d0 con 0x7f51bc0c3250 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c27ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f51bc1171e0 con 0x7f51bc143200 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c27ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc0c37a0 con 0x7f51bc15aa20 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51bb7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f51bc0c3250 0x7f51bc15a310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41002/0 (socket says 172.21.15.33:41002) 2023-10-09T15:40:13.063 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51bb7fe700 1 -- 172.21.15.33:0/4287261886 learned_addr learned my addr 172.21.15.33:0/4287261886 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51c0d48700 1 --2- 172.21.15.33:0/4287261886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 0x7f51bc163430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.061+0000 7f51bbfff700 1 --2- 172.21.15.33:0/4287261886 >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 0x7f51bc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51baffd700 1 -- 172.21.15.33:0/4287261886 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2253040744 0 0) 0x7f51bc06c7d0 con 0x7f51bc0c3250 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51baffd700 1 -- 172.21.15.33:0/4287261886 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f51a4003570 con 0x7f51bc0c3250 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51c0d48700 1 -- 172.21.15.33:0/4287261886 >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 msgr2=0x7f51bc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51c0d48700 1 --2- 172.21.15.33:0/4287261886 >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 0x7f51bc159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51c0d48700 1 -- 172.21.15.33:0/4287261886 >> v1:172.21.15.33:6789/0 conn(0x7f51bc0c3250 legacy=0x7f51bc15a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51c0d48700 1 -- 172.21.15.33:0/4287261886 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51bc0cc090 con 0x7f51bc15aa20 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51bbfff700 1 --2- 172.21.15.33:0/4287261886 >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 0x7f51bc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51c0d48700 1 --2- 172.21.15.33:0/4287261886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 0x7f51bc163430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009e60 tx=0x7f51b4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6b386a6c5cc5ff17 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51baffd700 1 -- 172.21.15.33:0/4287261886 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400e070 con 0x7f51bc15aa20 2023-10-09T15:40:13.064 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51baffd700 1 -- 172.21.15.33:0/4287261886 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51b400bab0 con 0x7f51bc15aa20 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.062+0000 7f51baffd700 1 -- 172.21.15.33:0/4287261886 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51b400be30 con 0x7f51bc15aa20 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 -- 172.21.15.33:0/4287261886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 msgr2=0x7f51bc163430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 --2- 172.21.15.33:0/4287261886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 0x7f51bc163430 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009e60 tx=0x7f51b4009780 comp rx=0 tx=0).stop 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 -- 172.21.15.33:0/4287261886 shutdown_connections 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 --2- 172.21.15.33:0/4287261886 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc15aa20 0x7f51bc163430 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 --2- 172.21.15.33:0/4287261886 >> v2:172.21.15.59:3300/0 conn(0x7f51bc143200 0x7f51bc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 -- 172.21.15.33:0/4287261886 >> 172.21.15.33:0/4287261886 conn(0x7f51bc0ccb60 msgr2=0x7f51bc0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 -- 172.21.15.33:0/4287261886 shutdown_connections 2023-10-09T15:40:13.065 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.063+0000 7f51c27ab700 1 -- 172.21.15.33:0/4287261886 wait complete. 2023-10-09T15:40:13.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.064+0000 7f51c27ab700 1 Processor -- start 2023-10-09T15:40:13.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.064+0000 7f51c27ab700 1 -- start start 2023-10-09T15:40:13.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 0x7f51bc146150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 0x7f51bc146690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15e920 con 0x7f51bc0c3250 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc143f90 con 0x7f51bc15aa20 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c27ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f51bc15e640 con 0x7f51bc143200 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43960/0 (socket says 172.21.15.33:43960) 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 -- 172.21.15.33:0/1446329214 learned_addr learned my addr 172.21.15.33:0/1446329214 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 -- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 msgr2=0x7f51bc146150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c0d48700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 0x7f51bc146690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bb7fe700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 0x7f51bc146150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 0x7f51bc146150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.069 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 -- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 msgr2=0x7f51bc146690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 0x7f51bc146690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 -- 172.21.15.33:0/1446329214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f51ac009420 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51c0d48700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 0x7f51bc146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bb7fe700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 0x7f51bc146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.065+0000 7f51bbfff700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00ec80 tx=0x7f51ac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.066+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00c9d0 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.066+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f51ac00cb30 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.066+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f51b4009a20 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.066+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f51ac00ceb0 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.066+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51bc143c20 con 0x7f51bc0c3250 2023-10-09T15:40:13.070 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.067+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f51bc144270 con 0x7f51bc0c3250 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.067+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f51ac013680 con 0x7f51bc0c3250 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.067+0000 7f51a3fff700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 0x7f51a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.068+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f51ac0851e0 con 0x7f51bc0c3250 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.068+0000 7f51bb7fe700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 0x7f51a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.068+0000 7f51bb7fe700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 0x7f51a80697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f51b00058d0 tx=0x7f51b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.071 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.072+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f51ac051e20 con 0x7f51bc0c3250 2023-10-09T15:40:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.309+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f51bc1437a0 con 0x7f51bc0c3250 2023-10-09T15:40:13.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.309+0000 7f51a3fff700 1 -- 172.21.15.33:0/1446329214 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4621 (secure 0 0 0) 0x7f51bc1437a0 con 0x7f51bc0c3250 2023-10-09T15:40:13.310 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:13.310 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:40:06.940989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000437078","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 msgr2=0x7f51a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 0x7f51a80697d0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f51b00058d0 tx=0x7f51b0009040 comp rx=0 tx=0).stop 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 msgr2=0x7f51bc12ccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f51ac00ec80 tx=0x7f51ac0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 shutdown_connections 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f51a8067320 0x7f51a80697d0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f51bc0c3250 0x7f51bc12ccd0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f51bc15aa20 0x7f51bc146690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 --2- 172.21.15.33:0/1446329214 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f51bc143200 0x7f51bc146150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 >> 172.21.15.33:0/1446329214 conn(0x7f51bc0ccb60 msgr2=0x7f51bc0c9c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:13.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 shutdown_connections 2023-10-09T15:40:13.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.311+0000 7f51c27ab700 1 -- 172.21.15.33:0/1446329214 wait complete. 2023-10-09T15:40:13.313 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 125 2023-10-09T15:40:13.324 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.443+0000 7fd4c9b94700 1 Processor -- start 2023-10-09T15:40:13.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.443+0000 7fd4c9b94700 1 -- start start 2023-10-09T15:40:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9b94700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4c4153c30 0x7fd4c415a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9b94700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c415afd0 con 0x7fd4c40cf110 2023-10-09T15:40:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9b94700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4c415b2b0 con 0x7fd4c415de50 2023-10-09T15:40:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9b94700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4c415b590 con 0x7fd4c4153c30 2023-10-09T15:40:13.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9393700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd4c40cf110 0x7fd4c415c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41012/0 (socket says 172.21.15.33:41012) 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c9393700 1 -- 172.21.15.33:0/528709629 learned_addr learned my addr 172.21.15.33:0/528709629 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c8b92700 1 --2- 172.21.15.33:0/528709629 >> v2:172.21.15.59:3300/0 conn(0x7fd4c4153c30 0x7fd4c415a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 625238758 0 0) 0x7fd4c415afd0 con 0x7fd4c40cf110 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.444+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4b4003570 con 0x7fd4c40cf110 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2834159289 0 0) 0x7fd4b4003570 con 0x7fd4c40cf110 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 >> v2:172.21.15.59:3300/0 conn(0x7fd4c4153c30 msgr2=0x7fd4c415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 --2- 172.21.15.33:0/528709629 >> v2:172.21.15.59:3300/0 conn(0x7fd4c4153c30 0x7fd4c415a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 >> v1:172.21.15.59:6789/0 conn(0x7fd4c415de50 legacy=0x7fd4c40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c415b870 con 0x7fd4c40cf110 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fd4bc0017f0 con 0x7fd4c40cf110 2023-10-09T15:40:13.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 >> v1:172.21.15.33:6789/0 conn(0x7fd4c40cf110 legacy=0x7fd4c415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b4003a60 0x7fd4b4003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b4004810 0x7fd4b4004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4b400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c415b590 con 0x7fd4b40051c0 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b400c0d0 con 0x7fd4b4004810 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4b400c290 con 0x7fd4b4003a60 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4b400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c8b92700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b4003a60 0x7fd4b4003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c3fff700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b4004810 0x7fd4b4004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 -- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b4003a60 msgr2=0x7fd4b4003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4b4003a60 0x7fd4b4003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 -- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b4004810 msgr2=0x7fd4b4004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b4004810 0x7fd4b4004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 -- 172.21.15.33:0/528709629 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4b4003570 con 0x7fd4b40051c0 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c3fff700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4b4004810 0x7fd4b4004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 -- 172.21.15.33:0/528709629 reap_dead start 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c9393700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4b400ba60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00a900 tx=0x7fd4c415e2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b4ce0cb5b42d3a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0070d0 con 0x7fd4b40051c0 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4bc007230 con 0x7fd4b40051c0 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.445+0000 7fd4c37fe700 1 -- 172.21.15.33:0/528709629 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4bc0075f0 con 0x7fd4b40051c0 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 -- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 msgr2=0x7fd4b400ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4b400ba60 secure :-1 s=READY pgs=1686 cs=0 l=1 rev1=1 crypto rx=0x7fd4bc00a900 tx=0x7fd4c415e2d0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 -- 172.21.15.33:0/528709629 shutdown_connections 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/528709629 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4b400ba60 unknown :-1 s=CLOSED pgs=1686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 -- 172.21.15.33:0/528709629 >> 172.21.15.33:0/528709629 conn(0x7fd4c40703a0 msgr2=0x7fd4c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 -- 172.21.15.33:0/528709629 shutdown_connections 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.446+0000 7fd4c9b94700 1 -- 172.21.15.33:0/528709629 wait complete. 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.447+0000 7fd4c9b94700 1 Processor -- start 2023-10-09T15:40:13.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.447+0000 7fd4c9b94700 1 -- start start 2023-10-09T15:40:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c414e380 0x7fd4c4140780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c413fdb0 0x7fd4c40c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40ca440 con 0x7fd4b40051c0 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40b1070 con 0x7fd4c413fdb0 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9b94700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4c40b1350 con 0x7fd4c414e380 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:43986/0 (socket says 172.21.15.33:43986) 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 -- 172.21.15.33:0/122301008 learned_addr learned my addr 172.21.15.33:0/122301008 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c3fff700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c414e380 0x7fd4c4140780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c9393700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c413fdb0 0x7fd4c40c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 -- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c414e380 msgr2=0x7fd4c4140780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c414e380 0x7fd4c4140780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 -- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c413fdb0 msgr2=0x7fd4c40c6740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c413fdb0 0x7fd4c40c6740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.448+0000 7fd4c8b92700 1 -- 172.21.15.33:0/122301008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4c40b1630 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c8b92700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006ac0 tx=0x7fd4b80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b800fa10 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4b800fb70 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4c40b1990 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4b8014440 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.449+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4c40b1f50 con 0x7fd4b40051c0 2023-10-09T15:40:13.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.450+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4c404c3c0 con 0x7fd4b40051c0 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.450+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd4b80147f0 con 0x7fd4b40051c0 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.451+0000 7fd4c0ff9700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 0x7fd4a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.451+0000 7fd4c3fff700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 0x7fd4a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.451+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fd4b8018030 con 0x7fd4b40051c0 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.451+0000 7fd4c3fff700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 0x7fd4a80697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd4c415c040 tx=0x7fd4b0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.455+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4b8052340 con 0x7fd4b40051c0 2023-10-09T15:40:13.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.650+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd4c415bb50 con 0x7fd4b40051c0 2023-10-09T15:40:13.650 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.651+0000 7fd4c0ff9700 1 -- 172.21.15.33:0/122301008 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15394 (secure 0 0 0) 0x7fd4b8055960 con 0x7fd4b40051c0 2023-10-09T15:40:13.651 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:13.651 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":189,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:08.956017+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000437078.meta","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000437078"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000437078.data","create_time":"2023-10-09T15:39:54.250723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000437078"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 msgr2=0x7fd4a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 0x7fd4a80697d0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fd4c415c040 tx=0x7fd4b0009040 comp rx=0 tx=0).stop 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 msgr2=0x7fd4c40c9f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7fd4b8006ac0 tx=0x7fd4b80091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 shutdown_connections 2023-10-09T15:40:13.653 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd4a8067320 0x7fd4a80697d0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4b40051c0 0x7fd4c40c9f00 unknown :-1 s=CLOSED pgs=1687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4c413fdb0 0x7fd4c40c6740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 --2- 172.21.15.33:0/122301008 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4c414e380 0x7fd4c4140780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 >> 172.21.15.33:0/122301008 conn(0x7fd4c40703a0 msgr2=0x7fd4c40d0900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 shutdown_connections 2023-10-09T15:40:13.654 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.653+0000 7fd4c9b94700 1 -- 172.21.15.33:0/122301008 wait complete. 2023-10-09T15:40:13.665 INFO:tasks.cephfs.filesystem:Destroying file system volume_0000000000437078 and related pools 2023-10-09T15:40:13.665 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.785+0000 7fb49ad36700 1 Processor -- start 2023-10-09T15:40:13.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.785+0000 7fb49ad36700 1 -- start start 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49ad36700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb494159550 0x7fb4940ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49ad36700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940acc00 con 0x7fb494159920 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49ad36700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4940abff0 con 0x7fb49415dfd0 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49ad36700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4940ac2d0 con 0x7fb494159550 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49a535700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fb494159920 0x7fb4940ad090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41022/0 (socket says 172.21.15.33:41022) 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb49a535700 1 -- 172.21.15.33:0/1588160313 learned_addr learned my addr 172.21.15.33:0/1588160313 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb499d34700 1 --2- 172.21.15.33:0/1588160313 >> v2:172.21.15.59:3300/0 conn(0x7fb494159550 0x7fb4940ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.789 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 549391455 0 0) 0x7fb4940acc00 con 0x7fb494159920 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.786+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb47c003570 con 0x7fb494159920 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3143765625 0 0) 0x7fb47c003570 con 0x7fb494159920 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 >> v2:172.21.15.59:3300/0 conn(0x7fb494159550 msgr2=0x7fb4940ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 --2- 172.21.15.33:0/1588160313 >> v2:172.21.15.59:3300/0 conn(0x7fb494159550 0x7fb4940ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 >> v1:172.21.15.59:6789/0 conn(0x7fb49415dfd0 legacy=0x7fb4940aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940ac5b0 con 0x7fb494159920 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fb4840017f0 con 0x7fb494159920 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 >> v1:172.21.15.33:6789/0 conn(0x7fb494159920 legacy=0x7fb4940ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb47c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.790 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb47c004810 0x7fb47c004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb47c0051c0 0x7fb47c00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940ac2d0 con 0x7fb47c003a60 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c00c050 con 0x7fb47c0051c0 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb47c00c210 con 0x7fb47c004810 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb47c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb49a535700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb47c0051c0 0x7fb47c00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499533700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb47c004810 0x7fb47c004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 -- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb47c004810 msgr2=0x7fb47c004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb47c004810 0x7fb47c004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.791 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 -- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb47c0051c0 msgr2=0x7fb47c00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb47c0051c0 0x7fb47c00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 -- 172.21.15.33:0/1588160313 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb47c003570 con 0x7fb47c003a60 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb49a535700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb47c0051c0 0x7fb47c00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb49a535700 1 -- 172.21.15.33:0/1588160313 reap_dead start 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb499d34700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb47c003e30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009c00 tx=0x7fb48c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddd3f2b31479766b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00e710 con 0x7fb47c003a60 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00e870 con 0x7fb47c003a60 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.787+0000 7fb498d32700 1 -- 172.21.15.33:0/1588160313 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c00ec30 con 0x7fb47c003a60 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 -- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 msgr2=0x7fb47c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb47c003e30 secure :-1 s=READY pgs=1689 cs=0 l=1 rev1=1 crypto rx=0x7fb48c009c00 tx=0x7fb48c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.792 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 -- 172.21.15.33:0/1588160313 shutdown_connections 2023-10-09T15:40:13.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 --2- 172.21.15.33:0/1588160313 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb47c003e30 unknown :-1 s=CLOSED pgs=1689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 -- 172.21.15.33:0/1588160313 >> 172.21.15.33:0/1588160313 conn(0x7fb49406ce80 msgr2=0x7fb4940ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:13.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 -- 172.21.15.33:0/1588160313 shutdown_connections 2023-10-09T15:40:13.793 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.788+0000 7fb49ad36700 1 -- 172.21.15.33:0/1588160313 wait complete. 2023-10-09T15:40:13.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.789+0000 7fb49ad36700 1 Processor -- start 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.789+0000 7fb49ad36700 1 -- start start 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4940697e0 0x7fb49414f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4940af5d0 0x7fb4940afa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb494069c50 con 0x7fb47c003a60 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4940aff90 con 0x7fb4940af5d0 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49ad36700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb49414fc60 con 0x7fb4940697e0 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44006/0 (socket says 172.21.15.33:44006) 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 -- 172.21.15.33:0/3152716205 learned_addr learned my addr 172.21.15.33:0/3152716205 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499533700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4940697e0 0x7fb49414f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb49a535700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4940af5d0 0x7fb4940afa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 -- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4940697e0 msgr2=0x7fb49414f430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4940697e0 0x7fb49414f430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 -- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4940af5d0 msgr2=0x7fb4940afa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4940af5d0 0x7fb4940afa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.790+0000 7fb499d34700 1 -- 172.21.15.33:0/3152716205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4940c7bd0 con 0x7fb47c003a60 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb499d34700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb48c013f20 tx=0x7fb48c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c022070 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb48c00ebf0 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4940c7eb0 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb48c01c6c0 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.791+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb49414f970 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.792+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb494069bb0 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.792+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb48c01ca70 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.793+0000 7fb491ffb700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 0x7fb4800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.793+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7fb48c086490 con 0x7fb47c003a60 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.793+0000 7fb499533700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 0x7fb4800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:13.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.793+0000 7fb499533700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 0x7fb4800697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c00 tx=0x7fb488009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:13.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:13.797+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb48c053190 con 0x7fb47c003a60 2023-10-09T15:40:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.038+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb49404c3c0 con 0x7fb47c003a60 2023-10-09T15:40:14.038 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.038+0000 7fb491ffb700 1 -- 172.21.15.33:0/3152716205 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4621 (secure 0 0 0) 0x7fb48c0566f0 con 0x7fb47c003a60 2023-10-09T15:40:14.039 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:14.039 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:40:06.940989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000437078","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 msgr2=0x7fb4800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 0x7fb4800697d0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fb488000c00 tx=0x7fb488009040 comp rx=0 tx=0).stop 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 msgr2=0x7fb49414d2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fb48c013f20 tx=0x7fb48c01a000 comp rx=0 tx=0).stop 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 shutdown_connections 2023-10-09T15:40:14.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb480067320 0x7fb4800697d0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb47c003a60 0x7fb49414d2e0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb4940af5d0 0x7fb4940afa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 --2- 172.21.15.33:0/3152716205 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb4940697e0 0x7fb49414f430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 >> 172.21.15.33:0/3152716205 conn(0x7fb49406ce80 msgr2=0x7fb494153c20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 shutdown_connections 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.041+0000 7fb49ad36700 1 -- 172.21.15.33:0/3152716205 wait complete. 2023-10-09T15:40:14.042 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 125 2023-10-09T15:40:14.053 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:14.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.172+0000 7f525b23d700 1 Processor -- start 2023-10-09T15:40:14.172 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.172+0000 7f525b23d700 1 -- start start 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f525b23d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f52540b07d0 0x7f52540ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f525b23d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525415a280 con 0x7f52540b0ba0 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f525b23d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f525406e180 con 0x7f52540cf200 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f525b23d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f525406d850 con 0x7f52540b07d0 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52597da700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f52540b0ba0 0x7f525406ed20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41026/0 (socket says 172.21.15.33:41026) 2023-10-09T15:40:14.176 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52597da700 1 -- 172.21.15.33:0/1711227525 learned_addr learned my addr 172.21.15.33:0/1711227525 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f5258fd9700 1 --2- 172.21.15.33:0/1711227525 >> v2:172.21.15.59:3300/0 conn(0x7f52540b07d0 0x7f52540ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3043475314 0 0) 0x7f525415a280 con 0x7f52540b0ba0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5244003570 con 0x7f52540b0ba0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 744180504 0 0) 0x7f5244003570 con 0x7f52540b0ba0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 >> v2:172.21.15.59:3300/0 conn(0x7f52540b07d0 msgr2=0x7f52540ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 --2- 172.21.15.33:0/1711227525 >> v2:172.21.15.59:3300/0 conn(0x7f52540b07d0 0x7f52540ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 >> v1:172.21.15.59:6789/0 conn(0x7f52540cf200 legacy=0x7f525406e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525406db30 con 0x7f52540b0ba0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f524c0017f0 con 0x7f52540b0ba0 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.173+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 >> v1:172.21.15.33:6789/0 conn(0x7f52540b0ba0 legacy=0x7f525406ed20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.177 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 0x7f5244003ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5244004810 0x7f5244004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244005210 0x7f524400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525406d850 con 0x7f5244003ab0 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f524400c130 con 0x7f5244004810 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f524400c2f0 con 0x7f5244005210 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 0x7f5244003ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5253fff700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5244004810 0x7f5244004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52597da700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244005210 0x7f524400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 -- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244005210 msgr2=0x7f524400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244005210 0x7f524400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 -- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5244004810 msgr2=0x7f5244004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:14.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5244004810 0x7f5244004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 -- 172.21.15.33:0/1711227525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5244003570 con 0x7f5244003ab0 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52597da700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244005210 0x7f524400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52597da700 1 -- 172.21.15.33:0/1711227525 reap_dead start 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f5258fd9700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 0x7f5244003ec0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5248009bf0 tx=0x7f5248009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3703fcc2f17f9519 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248005a00 con 0x7f5244003ab0 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248005b60 con 0x7f5244003ab0 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.174+0000 7f52537fe700 1 -- 172.21.15.33:0/1711227525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524800e710 con 0x7f5244003ab0 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 -- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 msgr2=0x7f5244003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 0x7f5244003ec0 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f5248009bf0 tx=0x7f5248009120 comp rx=0 tx=0).stop 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 -- 172.21.15.33:0/1711227525 shutdown_connections 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 --2- 172.21.15.33:0/1711227525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5244003ab0 0x7f5244003ec0 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.179 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 -- 172.21.15.33:0/1711227525 >> 172.21.15.33:0/1711227525 conn(0x7f525406ce80 msgr2=0x7f52540ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 -- 172.21.15.33:0/1711227525 shutdown_connections 2023-10-09T15:40:14.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.175+0000 7f525b23d700 1 -- 172.21.15.33:0/1711227525 wait complete. 2023-10-09T15:40:14.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.176+0000 7f525b23d700 1 Processor -- start 2023-10-09T15:40:14.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.176+0000 7f525b23d700 1 -- start start 2023-10-09T15:40:14.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 0x7f52541678d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52540b3940 0x7f525416c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5254157830 con 0x7f525416ae60 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52540b3de0 con 0x7f52540b3940 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f525b23d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525416b340 con 0x7f5244003ab0 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44028/0 (socket says 172.21.15.33:44028) 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 -- 172.21.15.33:0/235833039 learned_addr learned my addr 172.21.15.33:0/235833039 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f52597da700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52540b3940 0x7f525416c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5258fd9700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 0x7f52541678d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 -- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 msgr2=0x7f52541678d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 0x7f52541678d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 -- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52540b3940 msgr2=0x7f525416c3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.183 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52540b3940 0x7f525416c3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5253fff700 1 -- 172.21.15.33:0/235833039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f525416b620 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.177+0000 7f5258fd9700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 0x7f52541678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f5253fff700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5240002950 tx=0x7f5240007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000f8d0 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f524000fa30 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f525416b900 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f524000fdd0 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.178+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f525416bec0 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.179+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f525404c3c0 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.179+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5240013600 con 0x7f525416ae60 2023-10-09T15:40:14.184 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.179+0000 7f5250ff9700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 0x7f52380697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.180+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f52400851e0 con 0x7f525416ae60 2023-10-09T15:40:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.180+0000 7f5258fd9700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 0x7f52380697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.180+0000 7f5258fd9700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 0x7f52380697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f52540b07a0 tx=0x7f5248019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.184+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5240051e20 con 0x7f525416ae60 2023-10-09T15:40:14.421 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.421+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f525406de10 con 0x7f525416ae60 2023-10-09T15:40:14.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.422+0000 7f5250ff9700 1 -- 172.21.15.33:0/235833039 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 125 v125) v1 ==== 95+0+4621 (secure 0 0 0) 0x7f5240055440 con 0x7f525416ae60 2023-10-09T15:40:14.422 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:14.422 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":125,"default_fscid":15,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[{"mdsmap":{"epoch":124,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:39:55.281337+0000","modified":"2023-10-09T15:40:06.940989+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8709},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8709":{"gid":8709,"name":"d","rank":0,"incarnation":119,"state":"up:active","state_seq":3,"addr":"172.21.15.59:6834/1399937489","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":1399937489},{"type":"v1","addr":"172.21.15.59:6834","nonce":1399937489}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[32],"metadata_pool":31,"enabled":true,"fs_name":"volume_0000000000437078","balancer":"","standby_count_wanted":0},"id":15}]} 2023-10-09T15:40:14.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 msgr2=0x7f52380697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 0x7f52380697d0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f52540b07a0 tx=0x7f5248019000 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 msgr2=0x7f52540b3400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7f5240002950 tx=0x7f5240007d30 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 shutdown_connections 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5238067320 0x7f52380697d0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f52540b3940 0x7f525416c3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5244003ab0 0x7f52541678d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 --2- 172.21.15.33:0/235833039 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f525416ae60 0x7f52540b3400 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 >> 172.21.15.33:0/235833039 conn(0x7f525406ce80 msgr2=0x7f525406e510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 shutdown_connections 2023-10-09T15:40:14.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.424+0000 7f525b23d700 1 -- 172.21.15.33:0/235833039 wait complete. 2023-10-09T15:40:14.426 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 125 2023-10-09T15:40:14.436 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.556+0000 7f89db175700 1 Processor -- start 2023-10-09T15:40:14.556 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.556+0000 7f89db175700 1 -- start start 2023-10-09T15:40:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89db175700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f89d40cb5a0 0x7f89d40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89db175700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d4156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89db175700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89d415ae40 con 0x7f89d40cd9e0 2023-10-09T15:40:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89db175700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89d40d13f0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89db175700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d415ab60 con 0x7f89d415a5d0 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f89d40cb5a0 0x7f89d40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d3fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f89d40cd9e0 0x7f89d4159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41036/0 (socket says 172.21.15.33:41036) 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f89d40cb5a0 0x7f89d40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44034/0 (socket says 172.21.15.33:44034) 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d3fff700 1 -- 172.21.15.33:0/1110422875 learned_addr learned my addr 172.21.15.33:0/1110422875 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d9712700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d4156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 -- 172.21.15.33:0/1110422875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 msgr2=0x7f89d4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d4156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 -- 172.21.15.33:0/1110422875 >> v1:172.21.15.33:6789/0 conn(0x7f89d40cd9e0 legacy=0x7f89d4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 -- 172.21.15.33:0/1110422875 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89d40ccf00 con 0x7f89d40cb5a0 2023-10-09T15:40:14.559 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d37fe700 1 -- 172.21.15.33:0/1110422875 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 265477199 0 0) 0x7f89d415ae40 con 0x7f89d40cd9e0 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d8f11700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d40cb970 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e90 tx=0x7f89cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c53e1a49cb80e00 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d37fe700 1 -- 172.21.15.33:0/1110422875 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc00e070 con 0x7f89d40cb5a0 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d37fe700 1 -- 172.21.15.33:0/1110422875 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc00bbf0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.557+0000 7f89d37fe700 1 -- 172.21.15.33:0/1110422875 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc012430 con 0x7f89d40cb5a0 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 -- 172.21.15.33:0/1110422875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 msgr2=0x7f89d40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d40cb970 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7f89cc009e90 tx=0x7f89cc009780 comp rx=0 tx=0).stop 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 -- 172.21.15.33:0/1110422875 shutdown_connections 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d4156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 --2- 172.21.15.33:0/1110422875 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d40cb970 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 -- 172.21.15.33:0/1110422875 >> 172.21.15.33:0/1110422875 conn(0x7f89d4070e30 msgr2=0x7f89d40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 -- 172.21.15.33:0/1110422875 shutdown_connections 2023-10-09T15:40:14.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.558+0000 7f89db175700 1 -- 172.21.15.33:0/1110422875 wait complete. 2023-10-09T15:40:14.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.559+0000 7f89db175700 1 Processor -- start 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.559+0000 7f89db175700 1 -- start start 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 0x7f89d40c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d41523e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d4152100 con 0x7f89d40cb5a0 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89d4151820 con 0x7f89d40cd9e0 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89db175700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89d40c8640 con 0x7f89d415a5d0 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d8f11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d8f11700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44046/0 (socket says 172.21.15.33:44046) 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d8f11700 1 -- 172.21.15.33:0/889575612 learned_addr learned my addr 172.21.15.33:0/889575612 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:14.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d9712700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d41523e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d8f11700 1 -- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 msgr2=0x7f89d41523e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.560+0000 7f89d3fff700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 0x7f89d40c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d8f11700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d41523e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d8f11700 1 -- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 msgr2=0x7f89d40c9eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d8f11700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 0x7f89d40c9eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d8f11700 1 -- 172.21.15.33:0/889575612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89cc009a20 con 0x7f89d40cb5a0 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d9712700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d3fff700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 0x7f89d40c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d8f11700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f89d406ea60 tx=0x7f89cc019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc027470 con 0x7f89d40cb5a0 2023-10-09T15:40:14.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89cc0275f0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89d40c8920 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89cc0279b0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.561+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89d41532a0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.562+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89d404c3c0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.562+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f89cc024070 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.563+0000 7f89d0ff9700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 0x7f89c00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.563+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7f89cc087360 con 0x7f89d40cb5a0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.563+0000 7f89d3fff700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 0x7f89c00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.566 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.563+0000 7f89d3fff700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 0x7f89c00697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f89d406fd20 tx=0x7f89c8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.567+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f89cc053fa0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.763+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f89d40cd240 con 0x7f89d40cb5a0 2023-10-09T15:40:14.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.763+0000 7f89d0ff9700 1 -- 172.21.15.33:0/889575612 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+15394 (secure 0 0 0) 0x7f89cc0575c0 con 0x7f89d40cb5a0 2023-10-09T15:40:14.763 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:14.764 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":189,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:08.956017+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":31,"pool_name":"cephfs.volume_0000000000437078.meta","create_time":"2023-10-09T15:39:53.684588+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"volume_0000000000437078"}}},{"pool":32,"pool_name":"cephfs.volume_0000000000437078.data","create_time":"2023-10-09T15:39:54.250723+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"187","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"volume_0000000000437078"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 msgr2=0x7f89c00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 0x7f89c00697d0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f89d406fd20 tx=0x7f89c8009040 comp rx=0 tx=0).stop 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 msgr2=0x7f89d41512e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f89d406ea60 tx=0x7f89cc019000 comp rx=0 tx=0).stop 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 shutdown_connections 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f89c0067320 0x7f89c00697d0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f89d40cb5a0 0x7f89d41512e0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f89d415a5d0 0x7f89d41523e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.765+0000 7f89db175700 1 --2- 172.21.15.33:0/889575612 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f89d40cd9e0 0x7f89d40c9eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.766+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 >> 172.21.15.33:0/889575612 conn(0x7f89d4070e30 msgr2=0x7f89d40b06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.766+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 shutdown_connections 2023-10-09T15:40:14.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.766+0000 7f89db175700 1 -- 172.21.15.33:0/889575612 wait complete. 2023-10-09T15:40:14.778 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail volume_0000000000437078 2023-10-09T15:40:14.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 Processor -- start 2023-10-09T15:40:14.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 -- start start 2023-10-09T15:40:14.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faeec0cd9e0 0x7faeec159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faeec15ae40 con 0x7faeec0cde50 2023-10-09T15:40:14.900 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faeec0d13f0 con 0x7faeec0cd9e0 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.898+0000 7faef2af4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec15ab60 con 0x7faeec0cb5a0 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faeec0cd9e0 0x7faeec159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faeec0cd9e0 0x7faeec159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44050/0 (socket says 172.21.15.33:44050) 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faef1091700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faeec0cde50 0x7faeec156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41046/0 (socket says 172.21.15.33:41046) 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 -- 172.21.15.33:0/4217033782 learned_addr learned my addr 172.21.15.33:0/4217033782 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faef0890700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 -- 172.21.15.33:0/4217033782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 msgr2=0x7faeec0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 -- 172.21.15.33:0/4217033782 >> v1:172.21.15.33:6789/0 conn(0x7faeec0cde50 legacy=0x7faeec156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeeb7fe700 1 -- 172.21.15.33:0/4217033782 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3029276331 0 0) 0x7faeec15ae40 con 0x7faeec0cde50 2023-10-09T15:40:14.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 -- 172.21.15.33:0/4217033782 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faeec0ccf00 con 0x7faeec0cd9e0 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faef0890700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeebfff700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec0cd9e0 0x7faeec159ec0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faedc0099b0 tx=0x7faedc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e80b030ab971ba server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeeb7fe700 1 -- 172.21.15.33:0/4217033782 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00b860 con 0x7faeec0cd9e0 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeeb7fe700 1 -- 172.21.15.33:0/4217033782 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faedc00b9c0 con 0x7faeec0cd9e0 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.899+0000 7faeeb7fe700 1 -- 172.21.15.33:0/4217033782 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faedc00bd60 con 0x7faeec0cd9e0 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 -- 172.21.15.33:0/4217033782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec0cd9e0 msgr2=0x7faeec159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec0cd9e0 0x7faeec159ec0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7faedc0099b0 tx=0x7faedc009250 comp rx=0 tx=0).stop 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 -- 172.21.15.33:0/4217033782 shutdown_connections 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.902 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 --2- 172.21.15.33:0/4217033782 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec0cd9e0 0x7faeec159ec0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 -- 172.21.15.33:0/4217033782 >> 172.21.15.33:0/4217033782 conn(0x7faeec070e30 msgr2=0x7faeec0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 -- 172.21.15.33:0/4217033782 shutdown_connections 2023-10-09T15:40:14.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.900+0000 7faef2af4700 1 -- 172.21.15.33:0/4217033782 wait complete. 2023-10-09T15:40:14.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.901+0000 7faef2af4700 1 Processor -- start 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.901+0000 7faef2af4700 1 -- start start 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec15c010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec0cd9e0 0x7faeec1549a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec0c7c90 con 0x7faeec169230 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1696c0 con 0x7faeec0cd9e0 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef2af4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faeec1699a0 con 0x7faeec0cb5a0 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44066/0 (socket says 172.21.15.33:44066) 2023-10-09T15:40:14.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 -- 172.21.15.33:0/2622871419 learned_addr learned my addr 172.21.15.33:0/2622871419 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef0890700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec15c010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faeebfff700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec0cd9e0 0x7faeec1549a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 -- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 msgr2=0x7faeec15c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec15c010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 -- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec0cd9e0 msgr2=0x7faeec1549a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec0cd9e0 0x7faeec1549a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 -- 172.21.15.33:0/2622871419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faedc0094f0 con 0x7faeec169230 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef0890700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:14.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.902+0000 7faef1091700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7faed400c530 tx=0x7faed4007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.903+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed4005a70 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.903+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faed4005bd0 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.903+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faeec169c80 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.903+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faed40070d0 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.903+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faeec15c550 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.904+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faeec0c7dd0 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.904+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faed4007480 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.904+0000 7faee8ff9700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 0x7faecc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.905+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5783+0+0 (secure 0 0 0) 0x7faed40841e0 con 0x7faeec169230 2023-10-09T15:40:14.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.905+0000 7faef0890700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 0x7faecc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.905+0000 7faef0890700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 0x7faecc0697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faeec0c7080 tx=0x7faee4009910 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:14.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:14.909+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faeec0c7dd0 con 0x7faeec169230 2023-10-09T15:40:15.147 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.147+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "volume_0000000000437078"} v 0) v1 -- 0x7faeec0c7dd0 con 0x7faeec169230 2023-10-09T15:40:15.148 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:40:15.147+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:40:15.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.155+0000 7faee8ff9700 1 -- 172.21.15.33:0/2622871419 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "volume_0000000000437078"}]=0 volume_0000000000437078 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v126) v1 ==== 195+0+0 (secure 0 0 0) 0x7faeec0c7dd0 con 0x7faeec169230 2023-10-09T15:40:15.156 INFO:tasks.ceph.mds.d.smithi059.stderr: -785> 2023-10-09T15:40:01.192+0000 7fc7571d6700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:40:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.156+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 msgr2=0x7faecc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:15.157 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.156+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 0x7faecc0697d0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7faeec0c7080 tx=0x7faee4009910 comp rx=0 tx=0).stop 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.156+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 msgr2=0x7faeec0c96f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.156+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7faed400c530 tx=0x7faed4007f90 comp rx=0 tx=0).stop 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 shutdown_connections 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faecc067320 0x7faecc0697d0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faeec169230 0x7faeec0c96f0 unknown :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faeec0cb5a0 0x7faeec15c010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.158 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 --2- 172.21.15.33:0/2622871419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faeec0cd9e0 0x7faeec1549a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 >> 172.21.15.33:0/2622871419 conn(0x7faeec070e30 msgr2=0x7faeec0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 shutdown_connections 2023-10-09T15:40:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.157+0000 7faef2af4700 1 -- 172.21.15.33:0/2622871419 wait complete. 2023-10-09T15:40:15.159 INFO:teuthology.orchestra.run.smithi033.stderr:volume_0000000000437078 marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:40:15.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm volume_0000000000437078 --yes-i-really-mean-it 2023-10-09T15:40:15.180 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:40:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.290+0000 7ff611179700 1 Processor -- start 2023-10-09T15:40:15.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.290+0000 7ff611179700 1 -- start start 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff60c153a00 0x7ff60c153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c15de50 0x7ff60c15a540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff60c0cea00 0x7ff60c0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c0cf3c0 con 0x7ff60c153a00 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff60c15af60 con 0x7ff60c0cea00 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff611179700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c15b240 con 0x7ff60c15de50 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff60bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff60c153a00 0x7ff60c153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff60bfff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff60c153a00 0x7ff60c153dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44074/0 (socket says 172.21.15.33:44074) 2023-10-09T15:40:15.293 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff60bfff700 1 -- 172.21.15.33:0/2797378086 learned_addr learned my addr 172.21.15.33:0/2797378086 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff610978700 1 --2- 172.21.15.33:0/2797378086 >> v2:172.21.15.59:3300/0 conn(0x7ff60c0cea00 0x7ff60c0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.291+0000 7ff60b7fe700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c15de50 0x7ff60c15a540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 -- 172.21.15.33:0/2797378086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c15de50 msgr2=0x7ff60c15a540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c15de50 0x7ff60c15a540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 -- 172.21.15.33:0/2797378086 >> v2:172.21.15.59:3300/0 conn(0x7ff60c0cea00 msgr2=0x7ff60c0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 --2- 172.21.15.33:0/2797378086 >> v2:172.21.15.59:3300/0 conn(0x7ff60c0cea00 0x7ff60c0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 -- 172.21.15.33:0/2797378086 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff60c15b520 con 0x7ff60c153a00 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60bfff700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c153a00 0x7ff60c153dd0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2aea29523b09641 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60affd700 1 -- 172.21.15.33:0/2797378086 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00b640 con 0x7ff60c153a00 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60affd700 1 -- 172.21.15.33:0/2797378086 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5fc00b7a0 con 0x7ff60c153a00 2023-10-09T15:40:15.294 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff60affd700 1 -- 172.21.15.33:0/2797378086 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5fc00bb40 con 0x7ff60c153a00 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 -- 172.21.15.33:0/2797378086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c153a00 msgr2=0x7ff60c153dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c153a00 0x7ff60c153dd0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc009250 comp rx=0 tx=0).stop 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 -- 172.21.15.33:0/2797378086 shutdown_connections 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 --2- 172.21.15.33:0/2797378086 >> v2:172.21.15.59:3300/0 conn(0x7ff60c0cea00 0x7ff60c0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c153a00 0x7ff60c153dd0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 --2- 172.21.15.33:0/2797378086 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c15de50 0x7ff60c15a540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 -- 172.21.15.33:0/2797378086 >> 172.21.15.33:0/2797378086 conn(0x7ff60c0703a0 msgr2=0x7ff60c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.292+0000 7ff611179700 1 -- 172.21.15.33:0/2797378086 shutdown_connections 2023-10-09T15:40:15.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.293+0000 7ff611179700 1 -- 172.21.15.33:0/2797378086 wait complete. 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.294+0000 7ff611179700 1 Processor -- start 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.294+0000 7ff611179700 1 -- start start 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.294+0000 7ff611179700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c0cea00 0x7ff60c14b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.294+0000 7ff611179700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c153a00 0x7ff60c1559b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.294+0000 7ff611179700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff611179700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c8660 con 0x7ff60c15de50 2023-10-09T15:40:15.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff611179700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c7a90 con 0x7ff60c153a00 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff611179700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff60c0c7d30 con 0x7ff60c0cea00 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44080/0 (socket says 172.21.15.33:44080) 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 -- 172.21.15.33:0/3664765468 learned_addr learned my addr 172.21.15.33:0/3664765468 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff60bfff700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c0cea00 0x7ff60c14b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff60b7fe700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c153a00 0x7ff60c1559b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 -- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c0cea00 msgr2=0x7ff60c14b230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c0cea00 0x7ff60c14b230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 -- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c153a00 msgr2=0x7ff60c1559b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c153a00 0x7ff60c1559b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 -- 172.21.15.33:0/3664765468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5fc0094f0 con 0x7ff60c15de50 2023-10-09T15:40:15.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff610978700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff604009e90 tx=0x7ff60400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff60400cb70 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff60400f040 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff60c0c8010 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff604014480 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.295+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff60c0cd160 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.296+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff60c04c3c0 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.297+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff604014830 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.297+0000 7ff5f3fff700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 0x7ff5f80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.297+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5869+0+0 (secure 0 0 0) 0x7ff604085b20 con 0x7ff60c15de50 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.297+0000 7ff60bfff700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 0x7ff5f80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:15.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.298+0000 7ff60bfff700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 0x7ff5f80697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:15.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.301+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff604052600 con 0x7ff60c15de50 2023-10-09T15:40:15.540 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:15.540+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "volume_0000000000437078", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff60c0c87a0 con 0x7ff60c15de50 2023-10-09T15:40:16.162 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.162+0000 7ff5f3fff700 1 -- 172.21.15.33:0/3664765468 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "volume_0000000000437078", "yes_i_really_mean_it": true}]=0 v127) v1 ==== 121+0+0 (secure 0 0 0) 0x7ff604055c20 con 0x7ff60c15de50 2023-10-09T15:40:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 msgr2=0x7ff5f80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 0x7ff5f80697d0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff5fc0099b0 tx=0x7ff5fc017000 comp rx=0 tx=0).stop 2023-10-09T15:40:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 msgr2=0x7ff60c0b1450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7ff604009e90 tx=0x7ff60400b040 comp rx=0 tx=0).stop 2023-10-09T15:40:16.165 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 shutdown_connections 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff5f8067320 0x7ff5f80697d0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff60c15de50 0x7ff60c0b1450 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff60c0cea00 0x7ff60c14b230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 --2- 172.21.15.33:0/3664765468 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff60c153a00 0x7ff60c1559b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 >> 172.21.15.33:0/3664765468 conn(0x7ff60c0703a0 msgr2=0x7ff60c0c6470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 shutdown_connections 2023-10-09T15:40:16.166 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.165+0000 7ff611179700 1 -- 172.21.15.33:0/3664765468 wait complete. 2023-10-09T15:40:16.180 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000437078.meta cephfs.volume_0000000000437078.meta --yes-i-really-really-mean-it 2023-10-09T15:40:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.310+0000 7f85805b7700 1 Processor -- start 2023-10-09T15:40:16.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.310+0000 7f85805b7700 1 -- start start 2023-10-09T15:40:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.311+0000 7f85805b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:16.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.311+0000 7f85805b7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857806b2f0 con 0x7f85780ae140 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.311+0000 7f85805b7700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f857806ace0 con 0x7f85780c7b30 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.311+0000 7f85805b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780c8310 con 0x7f8578156480 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857eb54700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f85780ae140 0x7f85780c9ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41050/0 (socket says 172.21.15.33:41050) 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857eb54700 1 -- 172.21.15.33:0/3309385946 learned_addr learned my addr 172.21.15.33:0/3309385946 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857e353700 1 --2- 172.21.15.33:0/3309385946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3226242367 0 0) 0x7f857806b2f0 con 0x7f85780ae140 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8560003570 con 0x7f85780ae140 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3064506370 0 0) 0x7f857806ace0 con 0x7f85780c7b30 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f857806b2f0 con 0x7f85780c7b30 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857e353700 1 -- 172.21.15.33:0/3309385946 >> v1:172.21.15.59:6789/0 conn(0x7f85780c7b30 legacy=0x7f857806b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3197548291 0 0) 0x7f8560003570 con 0x7f85780ae140 2023-10-09T15:40:16.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857e353700 1 -- 172.21.15.33:0/3309385946 >> v1:172.21.15.33:6789/0 conn(0x7f85780ae140 legacy=0x7f85780c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857e353700 1 -- 172.21.15.33:0/3309385946 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85780c85f0 con 0x7f8578156480 2023-10-09T15:40:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857e353700 1 --2- 172.21.15.33:0/3309385946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8568009e90 tx=0x7f8568009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4041987b23fe4d10 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.312+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856800e070 con 0x7f8578156480 2023-10-09T15:40:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f856800b870 con 0x7f8578156480 2023-10-09T15:40:16.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f857d351700 1 -- 172.21.15.33:0/3309385946 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8570001470 con 0x7f8578156480 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 -- 172.21.15.33:0/3309385946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 msgr2=0x7f8578157710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 --2- 172.21.15.33:0/3309385946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157710 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f8568009e90 tx=0x7f8568009780 comp rx=0 tx=0).stop 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 -- 172.21.15.33:0/3309385946 shutdown_connections 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 --2- 172.21.15.33:0/3309385946 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157710 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 -- 172.21.15.33:0/3309385946 >> 172.21.15.33:0/3309385946 conn(0x7f857806d170 msgr2=0x7f85780cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 -- 172.21.15.33:0/3309385946 shutdown_connections 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.313+0000 7f85805b7700 1 -- 172.21.15.33:0/3309385946 wait complete. 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.314+0000 7f85805b7700 1 Processor -- start 2023-10-09T15:40:16.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.314+0000 7f85805b7700 1 -- start start 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 0x7f85781547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8578154d00 con 0x7f85780ae140 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b0b60 con 0x7f85780c7b30 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f85805b7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85780b0290 con 0x7f8578156480 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44084/0 (socket says 172.21.15.33:44084) 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 -- 172.21.15.33:0/1944245106 learned_addr learned my addr 172.21.15.33:0/1944245106 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857db52700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 0x7f85781547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857eb54700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:16.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 -- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 msgr2=0x7f8578157eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 -- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 msgr2=0x7f85781547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 0x7f85781547c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 -- 172.21.15.33:0/1944245106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8568009a20 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857db52700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 0x7f85781547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.315+0000 7f857e353700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f8568017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.316+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8568001090 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.316+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8568012cd0 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.316+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85781551c0 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.316+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f856801e6a0 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.316+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85780b0510 con 0x7f85780ae140 2023-10-09T15:40:16.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.317+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85780b2050 con 0x7f85780ae140 2023-10-09T15:40:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.317+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f856801ea90 con 0x7f85780ae140 2023-10-09T15:40:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.317+0000 7f85767fc700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.318+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5869+0+0 (secure 0 0 0) 0x7f8568087210 con 0x7f85780ae140 2023-10-09T15:40:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.318+0000 7f857db52700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:16.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.318+0000 7f857db52700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 0x7f85640697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f85780ad750 tx=0x7f856c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:16.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.322+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8568053cf0 con 0x7f85780ae140 2023-10-09T15:40:16.516 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:16.516+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000437078.meta", "pool2": "cephfs.volume_0000000000437078.meta", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f857806bb00 con 0x7f85780ae140 2023-10-09T15:40:17.302 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.302+0000 7f85767fc700 1 -- 172.21.15.33:0/1944245106 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000437078.meta", "pool2": "cephfs.volume_0000000000437078.meta", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000437078.meta' removed v191) v1 ==== 241+0+0 (secure 0 0 0) 0x7f8568057310 con 0x7f85780ae140 2023-10-09T15:40:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.307+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 msgr2=0x7f85640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.307 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 0x7f85640697d0 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f85780ad750 tx=0x7f856c009040 comp rx=0 tx=0).stop 2023-10-09T15:40:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 msgr2=0x7f8578154280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f85680097c0 tx=0x7f8568017000 comp rx=0 tx=0).stop 2023-10-09T15:40:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 shutdown_connections 2023-10-09T15:40:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8564067320 0x7f85640697d0 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85780ae140 0x7f8578154280 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8578156480 0x7f8578157eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 --2- 172.21.15.33:0/1944245106 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85780c7b30 0x7f85781547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 >> 172.21.15.33:0/1944245106 conn(0x7f857806d170 msgr2=0x7f85780c67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 shutdown_connections 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.308+0000 7f85805b7700 1 -- 172.21.15.33:0/1944245106 wait complete. 2023-10-09T15:40:17.309 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000437078.meta' removed 2023-10-09T15:40:17.323 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs.volume_0000000000437078.data cephfs.volume_0000000000437078.data --yes-i-really-really-mean-it 2023-10-09T15:40:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.454+0000 7fe32964a700 1 Processor -- start 2023-10-09T15:40:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.454+0000 7fe32964a700 1 -- start start 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe32964a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe324067e50 0x7fe32415de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe32964a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32415d9f0 con 0x7fe324068220 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe32964a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe32415d3c0 con 0x7fe3240c8c70 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe32964a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe32415a8f0 con 0x7fe324067e50 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe322ffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fe324067e50 0x7fe32415de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe3227fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe324068220 0x7fe324159dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41062/0 (socket says 172.21.15.33:41062) 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.455+0000 7fe3227fc700 1 -- 172.21.15.33:0/3715210199 learned_addr learned my addr 172.21.15.33:0/3715210199 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe322ffd700 1 -- 172.21.15.33:0/3715210199 >> v1:172.21.15.59:6789/0 conn(0x7fe3240c8c70 legacy=0x7fe3240c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe322ffd700 1 -- 172.21.15.33:0/3715210199 >> v1:172.21.15.33:6789/0 conn(0x7fe324068220 legacy=0x7fe324159dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe322ffd700 1 -- 172.21.15.33:0/3715210199 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe32415abd0 con 0x7fe324067e50 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe322ffd700 1 --2- 172.21.15.33:0/3715210199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324067e50 0x7fe32415de80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fe3140098e0 tx=0x7fe3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82d2f68645242678 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe321ffb700 1 -- 172.21.15.33:0/3715210199 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe314009e80 con 0x7fe324067e50 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe321ffb700 1 -- 172.21.15.33:0/3715210199 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31400b860 con 0x7fe324067e50 2023-10-09T15:40:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.456+0000 7fe321ffb700 1 -- 172.21.15.33:0/3715210199 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31400bbe0 con 0x7fe324067e50 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 -- 172.21.15.33:0/3715210199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324067e50 msgr2=0x7fe32415de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 --2- 172.21.15.33:0/3715210199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324067e50 0x7fe32415de80 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fe3140098e0 tx=0x7fe3140091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 -- 172.21.15.33:0/3715210199 shutdown_connections 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 --2- 172.21.15.33:0/3715210199 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe324067e50 0x7fe32415de80 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 -- 172.21.15.33:0/3715210199 >> 172.21.15.33:0/3715210199 conn(0x7fe3240ce4a0 msgr2=0x7fe3240ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 -- 172.21.15.33:0/3715210199 shutdown_connections 2023-10-09T15:40:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.457+0000 7fe32964a700 1 -- 172.21.15.33:0/3715210199 wait complete. 2023-10-09T15:40:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.458+0000 7fe32964a700 1 Processor -- start 2023-10-09T15:40:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.458+0000 7fe32964a700 1 -- start start 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe324067e50 0x7fe3240c3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe324068220 0x7fe3240c43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240c3690 con 0x7fe3240c8c70 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240b2010 con 0x7fe324068220 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe32964a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3240c3040 con 0x7fe324067e50 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44100/0 (socket says 172.21.15.33:44100) 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 -- 172.21.15.33:0/2719371098 learned_addr learned my addr 172.21.15.33:0/2719371098 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe322ffd700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe324067e50 0x7fe3240c3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3227fc700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe324068220 0x7fe3240c43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 -- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe324067e50 msgr2=0x7fe3240c3b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe324067e50 0x7fe3240c3b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 -- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe324068220 msgr2=0x7fe3240c43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe324068220 0x7fe3240c43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 -- 172.21.15.33:0/2719371098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe314009420 con 0x7fe3240c8c70 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe3237fe700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c8e0 tx=0x7fe31c001710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.459+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c012630 con 0x7fe3240c8c70 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.460+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe31c012790 con 0x7fe3240c8c70 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.460+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3240c3320 con 0x7fe3240c8c70 2023-10-09T15:40:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.460+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe31c012b50 con 0x7fe3240c8c70 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.460+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3241525b0 con 0x7fe3240c8c70 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.461+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe32404c3c0 con 0x7fe3240c8c70 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.461+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe31c01a3a0 con 0x7fe3240c8c70 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.461+0000 7fe31affd700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 0x7fe3040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.461+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5394+0+0 (secure 0 0 0) 0x7fe31c084d10 con 0x7fe3240c8c70 2023-10-09T15:40:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.461+0000 7fe322ffd700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 0x7fe3040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.462+0000 7fe322ffd700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 0x7fe3040697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe3140093f0 tx=0x7fe314017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.466+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe31c08a020 con 0x7fe3240c8c70 2023-10-09T15:40:17.667 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:17.667+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000437078.data", "pool2": "cephfs.volume_0000000000437078.data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe3240c37d0 con 0x7fe3240c8c70 2023-10-09T15:40:18.304 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.304+0000 7fe31affd700 1 -- 172.21.15.33:0/2719371098 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs.volume_0000000000437078.data", "pool2": "cephfs.volume_0000000000437078.data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs.volume_0000000000437078.data' removed v192) v1 ==== 241+0+0 (secure 0 0 0) 0x7fe31c055560 con 0x7fe3240c8c70 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 msgr2=0x7fe3040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 0x7fe3040697d0 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fe3140093f0 tx=0x7fe314017000 comp rx=0 tx=0).stop 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 msgr2=0x7fe324152070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fe31c00c8e0 tx=0x7fe31c001710 comp rx=0 tx=0).stop 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 shutdown_connections 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe304067320 0x7fe3040697d0 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe3240c8c70 0x7fe324152070 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.309 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe324067e50 0x7fe3240c3b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 --2- 172.21.15.33:0/2719371098 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe324068220 0x7fe3240c43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.309+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 >> 172.21.15.33:0/2719371098 conn(0x7fe3240ce4a0 msgr2=0x7fe3240cdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:18.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.310+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 shutdown_connections 2023-10-09T15:40:18.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.310+0000 7fe32964a700 1 -- 172.21.15.33:0/2719371098 wait complete. 2023-10-09T15:40:18.311 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs.volume_0000000000437078.data' removed 2023-10-09T15:40:18.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:40:18.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 Processor -- start 2023-10-09T15:40:18.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 -- start start 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e54159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e540ccfd0 con 0x7f5e54159530 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e5415a3d0 con 0x7f5e5406e0e0 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.453+0000 7f5e59bcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415a6b0 con 0x7f5e5406dc70 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e537fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5e54159530 0x7f5e540ceba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41068/0 (socket says 172.21.15.33:41068) 2023-10-09T15:40:18.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e537fe700 1 -- 172.21.15.33:0/1321329763 learned_addr learned my addr 172.21.15.33:0/1321329763 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1175694460 0 0) 0x7f5e540ccfd0 con 0x7f5e54159530 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e54159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5e40003570 con 0x7f5e54159530 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 292177277 0 0) 0x7f5e40003570 con 0x7f5e54159530 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 msgr2=0x7f5e54159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e54159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 >> v1:172.21.15.59:6789/0 conn(0x7f5e5406e0e0 legacy=0x7f5e540cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e5415a990 con 0x7f5e54159530 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f5e440017f0 con 0x7f5e54159530 2023-10-09T15:40:18.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 >> v1:172.21.15.33:6789/0 conn(0x7f5e54159530 legacy=0x7f5e540ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e40003a90 0x7f5e40003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e40004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e400051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e5415a6b0 con 0x7f5e40004810 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4000bb60 con 0x7f5e40003a90 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4000bd20 con 0x7f5e5406dc70 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.454+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e40004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e537fe700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e40003a90 0x7f5e40003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e53fff700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e400051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 -- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 msgr2=0x7f5e400051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e5406dc70 0x7f5e400051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 -- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e40003a90 msgr2=0x7f5e40003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e40003a90 0x7f5e40003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 -- 172.21.15.33:0/1321329763 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e40003570 con 0x7f5e40004810 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e40004c80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009c00 tx=0x7f5e3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f88d67ccb501b959 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00e710 con 0x7f5e40004810 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3c00e870 con 0x7f5e40004810 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.455+0000 7f5e527fc700 1 -- 172.21.15.33:0/1321329763 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c00ec30 con 0x7f5e40004810 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1321329763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 msgr2=0x7f5e40004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1321329763 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e40004c80 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009c00 tx=0x7f5e3c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e53fff700 1 -- 172.21.15.33:0/1321329763 reap_dead start 2023-10-09T15:40:18.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1321329763 shutdown_connections 2023-10-09T15:40:18.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1321329763 >> 172.21.15.33:0/1321329763 conn(0x7f5e540703a0 msgr2=0x7f5e540707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:18.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1321329763 shutdown_connections 2023-10-09T15:40:18.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.456+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1321329763 wait complete. 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.457+0000 7f5e59bcc700 1 Processor -- start 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.457+0000 7f5e59bcc700 1 -- start start 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e540c9860 0x7f5e541460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e541529b0 0x7f5e54152e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e54153370 con 0x7f5e40004810 2023-10-09T15:40:18.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540ca5e0 con 0x7f5e541529b0 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e540b3920 con 0x7f5e540c9860 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44118/0 (socket says 172.21.15.33:44118) 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 -- 172.21.15.33:0/1688547607 learned_addr learned my addr 172.21.15.33:0/1688547607 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e540c9860 0x7f5e541460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e53fff700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e541529b0 0x7f5e54152e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 -- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e540c9860 msgr2=0x7f5e541460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e540c9860 0x7f5e541460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 -- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e541529b0 msgr2=0x7f5e54152e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e541529b0 0x7f5e54152e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 -- 172.21.15.33:0/1688547607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e540ca020 con 0x7f5e40004810 2023-10-09T15:40:18.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e537fe700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f5e44007ac0 tx=0x7f5e440021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e4400ad90 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e440133f0 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e540ca300 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.458+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e440137b0 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.459+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e54146630 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.459+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e5404c3c0 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.460+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5e44013b20 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.460+0000 7f5e4b7fe700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 0x7f5e340697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.460+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5e440855f0 con 0x7f5e40004810 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.460+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 0x7f5e340697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.461+0000 7f5e52ffd700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 0x7f5e340697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0091e0 tx=0x7f5e3c01a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.464+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5e44052540 con 0x7f5e40004810 2023-10-09T15:40:18.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.658+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5e5415ac70 con 0x7f5e40004810 2023-10-09T15:40:18.661 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.662+0000 7f5e4b7fe700 1 -- 172.21.15.33:0/1688547607 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v31) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5e44055b60 con 0x7f5e40004810 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 msgr2=0x7f5e340697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 0x7f5e340697d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c0091e0 tx=0x7f5e3c01a000 comp rx=0 tx=0).stop 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 msgr2=0x7f5e540b5e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f5e44007ac0 tx=0x7f5e440021d0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 shutdown_connections 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5e34067320 0x7f5e340697d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5e40004810 0x7f5e540b5e80 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.664 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5e541529b0 0x7f5e54152e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 --2- 172.21.15.33:0/1688547607 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5e540c9860 0x7f5e541460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 >> 172.21.15.33:0/1688547607 conn(0x7f5e540703a0 msgr2=0x7f5e5415aef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 shutdown_connections 2023-10-09T15:40:18.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.664+0000 7f5e59bcc700 1 -- 172.21.15.33:0/1688547607 wait complete. 2023-10-09T15:40:18.676 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency' 2023-10-09T15:40:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.795+0000 7ffa27226700 1 Processor -- start 2023-10-09T15:40:18.795 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.795+0000 7ffa27226700 1 -- start start 2023-10-09T15:40:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.795+0000 7ffa27226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa200cb5a0 0x7ffa200cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.795+0000 7ffa27226700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa200cde50 0x7ffa20156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa27226700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa2015ae40 con 0x7ffa200cd9e0 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa27226700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa200d13f0 con 0x7ffa200cde50 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa27226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2015ab60 con 0x7ffa200cb5a0 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa200cde50 0x7ffa20156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ffa200cde50 0x7ffa20156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44124/0 (socket says 172.21.15.33:44124) 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 -- 172.21.15.33:0/4022971849 learned_addr learned my addr 172.21.15.33:0/4022971849 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa24fc2700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa200cb5a0 0x7ffa200cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 -- 172.21.15.33:0/4022971849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa200cb5a0 msgr2=0x7ffa200cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa200cb5a0 0x7ffa200cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 -- 172.21.15.33:0/4022971849 >> v1:172.21.15.59:6789/0 conn(0x7ffa200cd9e0 legacy=0x7ffa20159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 -- 172.21.15.33:0/4022971849 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa200ccf00 con 0x7ffa200cde50 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa257c3700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cde50 0x7ffa20156e90 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009f20 tx=0x7ffa18009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da63f5e647d75f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa1f7fe700 1 -- 172.21.15.33:0/4022971849 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa1800e070 con 0x7ffa200cde50 2023-10-09T15:40:18.797 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa1f7fe700 1 -- 172.21.15.33:0/4022971849 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa1800ba40 con 0x7ffa200cde50 2023-10-09T15:40:18.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.796+0000 7ffa1f7fe700 1 -- 172.21.15.33:0/4022971849 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa180092e0 con 0x7ffa200cde50 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 -- 172.21.15.33:0/4022971849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cde50 msgr2=0x7ffa20156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cde50 0x7ffa20156e90 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7ffa18009f20 tx=0x7ffa18009840 comp rx=0 tx=0).stop 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 -- 172.21.15.33:0/4022971849 shutdown_connections 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cde50 0x7ffa20156e90 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 --2- 172.21.15.33:0/4022971849 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa200cb5a0 0x7ffa200cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 -- 172.21.15.33:0/4022971849 >> 172.21.15.33:0/4022971849 conn(0x7ffa20070e30 msgr2=0x7ffa200d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 -- 172.21.15.33:0/4022971849 shutdown_connections 2023-10-09T15:40:18.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.797+0000 7ffa27226700 1 -- 172.21.15.33:0/4022971849 wait complete. 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.798+0000 7ffa27226700 1 Processor -- start 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.798+0000 7ffa27226700 1 -- start start 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 0x7ffa200b5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 0x7ffa200cef20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200c77c0 con 0x7ffa200cb5a0 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200b5960 con 0x7ffa200cd9e0 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa27226700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa200b5c40 con 0x7ffa20168de0 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44132/0 (socket says 172.21.15.33:44132) 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 -- 172.21.15.33:0/1790002823 learned_addr learned my addr 172.21.15.33:0/1790002823 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa257c3700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 0x7ffa200cef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.801 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 -- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 msgr2=0x7ffa200cef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa1ffff700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 0x7ffa200b5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 0x7ffa200cef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 -- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 msgr2=0x7ffa200b5110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 0x7ffa200b5110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 -- 172.21.15.33:0/1790002823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa18009ae0 con 0x7ffa200cb5a0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa257c3700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 0x7ffa200cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa1ffff700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 0x7ffa200b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.799+0000 7ffa24fc2700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d890 tx=0x7ffa08008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.800+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800b600 con 0x7ffa200cb5a0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.800+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa0800b760 con 0x7ffa200cb5a0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.800+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa200b5f20 con 0x7ffa200cb5a0 2023-10-09T15:40:18.802 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.800+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa0800bae0 con 0x7ffa200cb5a0 2023-10-09T15:40:18.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.800+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa200b5650 con 0x7ffa200cb5a0 2023-10-09T15:40:18.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.801+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa200c7aa0 con 0x7ffa200cb5a0 2023-10-09T15:40:18.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.801+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ffa0801e460 con 0x7ffa200cb5a0 2023-10-09T15:40:18.803 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.801+0000 7ffa1cff9700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 0x7ffa000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.801+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ffa08085050 con 0x7ffa200cb5a0 2023-10-09T15:40:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.801+0000 7ffa1ffff700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 0x7ffa000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:18.804 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.802+0000 7ffa1ffff700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 0x7ffa000697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffa2016cba0 tx=0x7ffa10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:18.805 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:18.806+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ffa08051fe0 con 0x7ffa200cb5a0 2023-10-09T15:40:19.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.085+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]} v 0) v1 -- 0x7ffa2004c3c0 con 0x7ffa200cb5a0 2023-10-09T15:40:19.310 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.310+0000 7ffa1cff9700 1 -- 172.21.15.33:0/1790002823 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rename_idempotency"]}]=0 v477) v1 ==== 147+0+0 (secure 0 0 0) 0x7ffa08055600 con 0x7ffa200cb5a0 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 msgr2=0x7ffa000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 0x7ffa000697d0 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ffa2016cba0 tx=0x7ffa10009040 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 msgr2=0x7ffa200b4360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7ffa0800d890 tx=0x7ffa08008040 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 shutdown_connections 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ffa00067320 0x7ffa000697d0 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ffa200cb5a0 0x7ffa200b4360 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ffa20168de0 0x7ffa200cef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 --2- 172.21.15.33:0/1790002823 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ffa200cd9e0 0x7ffa200b5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 >> 172.21.15.33:0/1790002823 conn(0x7ffa20070e30 msgr2=0x7ffa200ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 shutdown_connections 2023-10-09T15:40:19.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.312+0000 7ffa27226700 1 -- 172.21.15.33:0/1790002823 wait complete. 2023-10-09T15:40:19.325 INFO:tasks.cephfs_test_runner:That volume rename is idempotent. ... ok 2023-10-09T15:40:19.325 INFO:tasks.cephfs_test_runner:Starting test: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T15:40:19.325 INFO:tasks.cephfs_test_runner:test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:40:19.326 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-09T15:40:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.446+0000 7fd5425e4700 1 Processor -- start 2023-10-09T15:40:19.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.446+0000 7fd5425e4700 1 -- start start 2023-10-09T15:40:19.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd5425e4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd53c0cb5a0 0x7fd53c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd5425e4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd53c15a5d0 0x7fd53c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd5425e4700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd53c15ae40 con 0x7fd53c0cd9e0 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd5425e4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c0d13f0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd5425e4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd53c15ab60 con 0x7fd53c0cb5a0 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd540b81700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd53c15a5d0 0x7fd53c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd53b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd53c0cd9e0 0x7fd53c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:41076/0 (socket says 172.21.15.33:41076) 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd53b7fe700 1 -- 172.21.15.33:0/3171414850 learned_addr learned my addr 172.21.15.33:0/3171414850 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd53bfff700 1 --2- 172.21.15.33:0/3171414850 >> v2:172.21.15.59:3300/0 conn(0x7fd53c0cb5a0 0x7fd53c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd540b81700 1 -- 172.21.15.33:0/3171414850 >> v2:172.21.15.59:3300/0 conn(0x7fd53c0cb5a0 msgr2=0x7fd53c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:19.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd540b81700 1 --2- 172.21.15.33:0/3171414850 >> v2:172.21.15.59:3300/0 conn(0x7fd53c0cb5a0 0x7fd53c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd540b81700 1 -- 172.21.15.33:0/3171414850 >> v1:172.21.15.33:6789/0 conn(0x7fd53c0cd9e0 legacy=0x7fd53c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd540b81700 1 -- 172.21.15.33:0/3171414850 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c0ccf00 con 0x7fd53c15a5d0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.447+0000 7fd53affd700 1 -- 172.21.15.33:0/3171414850 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2611426757 0 0) 0x7fd53c15ae40 con 0x7fd53c0cd9e0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd540b81700 1 --2- 172.21.15.33:0/3171414850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c156e90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fd534009e60 tx=0x7fd534009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cba92bbef04cc39b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd53affd700 1 -- 172.21.15.33:0/3171414850 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53400e070 con 0x7fd53c15a5d0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd53affd700 1 -- 172.21.15.33:0/3171414850 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53400bbf0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd53affd700 1 -- 172.21.15.33:0/3171414850 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534012430 con 0x7fd53c15a5d0 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 -- 172.21.15.33:0/3171414850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 msgr2=0x7fd53c156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 --2- 172.21.15.33:0/3171414850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c156e90 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7fd534009e60 tx=0x7fd534009780 comp rx=0 tx=0).stop 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 -- 172.21.15.33:0/3171414850 shutdown_connections 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 --2- 172.21.15.33:0/3171414850 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c156e90 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 --2- 172.21.15.33:0/3171414850 >> v2:172.21.15.59:3300/0 conn(0x7fd53c0cb5a0 0x7fd53c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 -- 172.21.15.33:0/3171414850 >> 172.21.15.33:0/3171414850 conn(0x7fd53c070e30 msgr2=0x7fd53c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:19.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 -- 172.21.15.33:0/3171414850 shutdown_connections 2023-10-09T15:40:19.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.448+0000 7fd5425e4700 1 -- 172.21.15.33:0/3171414850 wait complete. 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.449+0000 7fd5425e4700 1 Processor -- start 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 -- start start 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd53c0cb5a0 0x7fd53c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 0x7fd53c1521c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c15b5b0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c16ddd0 con 0x7fd53c0cd9e0 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.450+0000 7fd5425e4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd53c15e370 con 0x7fd53c0cb5a0 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44158/0 (socket says 172.21.15.33:44158) 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 -- 172.21.15.33:0/460169549 learned_addr learned my addr 172.21.15.33:0/460169549 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd53b7fe700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 0x7fd53c1521c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd53bfff700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd53c0cb5a0 0x7fd53c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 -- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd53c0cb5a0 msgr2=0x7fd53c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd53c0cb5a0 0x7fd53c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 -- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 msgr2=0x7fd53c1521c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 0x7fd53c1521c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 -- 172.21.15.33:0/460169549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd534009a20 con 0x7fd53c15a5d0 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd53b7fe700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 0x7fd53c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd540b81700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06ea60 tx=0x7fd534019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd534012e50 con 0x7fd53c15a5d0 2023-10-09T15:40:19.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53401d630 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53401d9f0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd53c15e090 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.451+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd53c0c95b0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.452+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd53c04c3c0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.453+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd534024070 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.453+0000 7fd523fff700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 0x7fd5280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.453+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fd534087130 con 0x7fd53c15a5d0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.453+0000 7fd53bfff700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 0x7fd5280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:19.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.454+0000 7fd53bfff700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 0x7fd5280697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd52c006fd0 tx=0x7fd52c008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:19.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.457+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd5340540c0 con 0x7fd53c15a5d0 2023-10-09T15:40:19.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:19.730+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7fd53c0cd1e0 con 0x7fd53c15a5d0 2023-10-09T15:40:20.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.312+0000 7fd523fff700 1 -- 172.21.15.33:0/460169549 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v478) v1 ==== 134+0+0 (secure 0 0 0) 0x7fd534009880 con 0x7fd53c15a5d0 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 msgr2=0x7fd5280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 0x7fd5280697d0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd52c006fd0 tx=0x7fd52c008040 comp rx=0 tx=0).stop 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 msgr2=0x7fd53c16cf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7fd53c06ea60 tx=0x7fd534019000 comp rx=0 tx=0).stop 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 shutdown_connections 2023-10-09T15:40:20.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd528067320 0x7fd5280697d0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd53c15a5d0 0x7fd53c16cf80 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd53c0cb5a0 0x7fd53c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 --2- 172.21.15.33:0/460169549 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd53c0cd9e0 0x7fd53c1521c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 >> 172.21.15.33:0/460169549 conn(0x7fd53c070e30 msgr2=0x7fd53c0cde80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 shutdown_connections 2023-10-09T15:40:20.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.315+0000 7fd5425e4700 1 -- 172.21.15.33:0/460169549 wait complete. 2023-10-09T15:40:20.330 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:40:20.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.457+0000 7f67c96f4700 1 Processor -- start 2023-10-09T15:40:20.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.457+0000 7f67c96f4700 1 -- start start 2023-10-09T15:40:20.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c96f4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f67c406dc70 0x7f67c4159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c96f4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f67c406e0e0 0x7f67c40cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c96f4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67c40ccfd0 con 0x7f67c4159530 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c96f4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c415a3d0 con 0x7f67c406e0e0 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c96f4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67c415a6b0 con 0x7f67c406dc70 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f67c406e0e0 0x7f67c40cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f67c406e0e0 0x7f67c40cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44174/0 (socket says 172.21.15.33:44174) 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 -- 172.21.15.33:0/3229749009 learned_addr learned my addr 172.21.15.33:0/3229749009 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c27fc700 1 --2- 172.21.15.33:0/3229749009 >> v2:172.21.15.59:3300/0 conn(0x7f67c406dc70 0x7f67c4159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 -- 172.21.15.33:0/3229749009 >> v2:172.21.15.59:3300/0 conn(0x7f67c406dc70 msgr2=0x7f67c4159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 --2- 172.21.15.33:0/3229749009 >> v2:172.21.15.59:3300/0 conn(0x7f67c406dc70 0x7f67c4159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 -- 172.21.15.33:0/3229749009 >> v1:172.21.15.59:6789/0 conn(0x7f67c4159530 legacy=0x7f67c40ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 -- 172.21.15.33:0/3229749009 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67c415a990 con 0x7f67c406e0e0 2023-10-09T15:40:20.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c37fe700 1 --2- 172.21.15.33:0/3229749009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c406e0e0 0x7f67c40cb6f0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b66e0 tx=0x7f67b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59434be83d4d4cde server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.458+0000 7f67c1ffb700 1 -- 172.21.15.33:0/3229749009 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4009e70 con 0x7f67c406e0e0 2023-10-09T15:40:20.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c1ffb700 1 -- 172.21.15.33:0/3229749009 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b400b860 con 0x7f67c406e0e0 2023-10-09T15:40:20.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c1ffb700 1 -- 172.21.15.33:0/3229749009 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b400bc00 con 0x7f67c406e0e0 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 -- 172.21.15.33:0/3229749009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c406e0e0 msgr2=0x7f67c40cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 --2- 172.21.15.33:0/3229749009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c406e0e0 0x7f67c40cb6f0 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f67c40b66e0 tx=0x7f67b4009250 comp rx=0 tx=0).stop 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 -- 172.21.15.33:0/3229749009 shutdown_connections 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 --2- 172.21.15.33:0/3229749009 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c406e0e0 0x7f67c40cb6f0 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 --2- 172.21.15.33:0/3229749009 >> v2:172.21.15.59:3300/0 conn(0x7f67c406dc70 0x7f67c4159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 -- 172.21.15.33:0/3229749009 >> 172.21.15.33:0/3229749009 conn(0x7f67c40703a0 msgr2=0x7f67c40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 -- 172.21.15.33:0/3229749009 shutdown_connections 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.459+0000 7f67c96f4700 1 -- 172.21.15.33:0/3229749009 wait complete. 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.460+0000 7f67c96f4700 1 Processor -- start 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.460+0000 7f67c96f4700 1 -- start start 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 0x7f67c4149200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 0x7f67c4157400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b3e40 con 0x7f67c4159530 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67c4149740 con 0x7f67c406e0e0 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c96f4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67c40b4c40 con 0x7f67c406dc70 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c37fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:44180/0 (socket says 172.21.15.33:44180) 2023-10-09T15:40:20.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c37fe700 1 -- 172.21.15.33:0/2765354010 learned_addr learned my addr 172.21.15.33:0/2765354010 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c27fc700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 0x7f67c4157400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.461+0000 7f67c2ffd700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 0x7f67c4149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 -- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 msgr2=0x7f67c4149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 0x7f67c4149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 -- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 msgr2=0x7f67c4157400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 0x7f67c4157400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 -- 172.21.15.33:0/2765354010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b40094f0 con 0x7f67c4159530 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c27fc700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 0x7f67c4157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c2ffd700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 0x7f67c4149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c37fe700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009290 tx=0x7f67b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4025420 con 0x7f67c4159530 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67b40255a0 con 0x7f67c4159530 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67b4025960 con 0x7f67c4159530 2023-10-09T15:40:20.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67c40b4030 con 0x7f67c4159530 2023-10-09T15:40:20.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.462+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67c40b45f0 con 0x7f67c4159530 2023-10-09T15:40:20.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.463+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67c40b4db0 con 0x7f67c4159530 2023-10-09T15:40:20.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.463+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f67b4023070 con 0x7f67c4159530 2023-10-09T15:40:20.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.464+0000 7f67baffd700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 0x7f67a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.464+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f67b4086410 con 0x7f67c4159530 2023-10-09T15:40:20.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.464+0000 7f67c2ffd700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 0x7f67a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.464+0000 7f67c2ffd700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 0x7f67a40697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f67bc007fd0 tx=0x7f67bc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.468+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f67b4053420 con 0x7f67c4159530 2023-10-09T15:40:20.662 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.661+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f67c415ac70 con 0x7f67c4159530 2023-10-09T15:40:20.665 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.664+0000 7f67baffd700 1 -- 172.21.15.33:0/2765354010 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f67b40150c0 con 0x7f67c4159530 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 msgr2=0x7f67a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 0x7f67a40697d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f67bc007fd0 tx=0x7f67bc009040 comp rx=0 tx=0).stop 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 msgr2=0x7f67c4157940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7f67b4009290 tx=0x7f67b4017000 comp rx=0 tx=0).stop 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 shutdown_connections 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f67a4067320 0x7f67a40697d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f67c4159530 0x7f67c4157940 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f67c406dc70 0x7f67c4149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.668 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 --2- 172.21.15.33:0/2765354010 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f67c406e0e0 0x7f67c4157400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.666+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 >> 172.21.15.33:0/2765354010 conn(0x7f67c40703a0 msgr2=0x7f67c4153a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:20.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.667+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 shutdown_connections 2023-10-09T15:40:20.669 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.667+0000 7f67c96f4700 1 -- 172.21.15.33:0/2765354010 wait complete. 2023-10-09T15:40:20.680 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:40:20.680 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:40:20.717 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:40:20.765 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:40:20.765 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-10-09T15:40:20.765 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 Processor -- start 2023-10-09T15:40:20.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 -- start start 2023-10-09T15:40:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 0x7fb6480c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6480b0ba0 0x7fb64806e610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb64815a280 con 0x7fb6480b07d0 2023-10-09T15:40:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64806e180 con 0x7fb6480b0ba0 2023-10-09T15:40:20.887 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.884+0000 7fb64d553700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb64806d850 con 0x7fb6480cf200 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6480b0ba0 0x7fb64806e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb6480b0ba0 0x7fb64806e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33362/0 (socket says 172.21.15.33:33362) 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 -- 172.21.15.33:0/4166412779 learned_addr learned my addr 172.21.15.33:0/4166412779 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6467fc700 1 --2- 172.21.15.33:0/4166412779 >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 0x7fb6480c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 -- 172.21.15.33:0/4166412779 >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 msgr2=0x7fb6480c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 --2- 172.21.15.33:0/4166412779 >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 0x7fb6480c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 -- 172.21.15.33:0/4166412779 >> v1:172.21.15.59:6789/0 conn(0x7fb6480b07d0 legacy=0x7fb6480ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 -- 172.21.15.33:0/4166412779 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb64806db30 con 0x7fb6480b0ba0 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6467fc700 1 --2- 172.21.15.33:0/4166412779 >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 0x7fb6480c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb6477fe700 1 --2- 172.21.15.33:0/4166412779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480b0ba0 0x7fb64806e610 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb6480cab40 tx=0x7fb638009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f3e56a24e7428a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb645ffb700 1 -- 172.21.15.33:0/4166412779 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800b820 con 0x7fb6480b0ba0 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb645ffb700 1 -- 172.21.15.33:0/4166412779 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb63800b980 con 0x7fb6480b0ba0 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.885+0000 7fb645ffb700 1 -- 172.21.15.33:0/4166412779 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63800bd20 con 0x7fb6480b0ba0 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 -- 172.21.15.33:0/4166412779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480b0ba0 msgr2=0x7fb64806e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 --2- 172.21.15.33:0/4166412779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480b0ba0 0x7fb64806e610 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb6480cab40 tx=0x7fb638009250 comp rx=0 tx=0).stop 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 -- 172.21.15.33:0/4166412779 shutdown_connections 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 --2- 172.21.15.33:0/4166412779 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480b0ba0 0x7fb64806e610 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 --2- 172.21.15.33:0/4166412779 >> v2:172.21.15.59:3300/0 conn(0x7fb6480cf200 0x7fb6480c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 -- 172.21.15.33:0/4166412779 >> 172.21.15.33:0/4166412779 conn(0x7fb64806ce80 msgr2=0x7fb6480ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 -- 172.21.15.33:0/4166412779 shutdown_connections 2023-10-09T15:40:20.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.886+0000 7fb64d553700 1 -- 172.21.15.33:0/4166412779 wait complete. 2023-10-09T15:40:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.887+0000 7fb64d553700 1 Processor -- start 2023-10-09T15:40:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.887+0000 7fb64d553700 1 -- start start 2023-10-09T15:40:20.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 0x7fb648152940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 0x7fb648155430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648154fa0 con 0x7fb6480cf200 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb648152f20 con 0x7fb6480b0ba0 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb64d553700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb648154950 con 0x7fb6480b07d0 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33366/0 (socket says 172.21.15.33:33366) 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 -- 172.21.15.33:0/981868336 learned_addr learned my addr 172.21.15.33:0/981868336 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6467fc700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 0x7fb648155430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb646ffd700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 0x7fb648152940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 -- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 msgr2=0x7fb648152940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 0x7fb648152940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 -- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 msgr2=0x7fb648155430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 0x7fb648155430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 -- 172.21.15.33:0/981868336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6380094f0 con 0x7fb6480cf200 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6467fc700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 0x7fb648155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb646ffd700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 0x7fb648152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.888+0000 7fb6477fe700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb638009290 tx=0x7fb638016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.889+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63801b520 con 0x7fb6480cf200 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.889+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb638020070 con 0x7fb6480cf200 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.889+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb648154c30 con 0x7fb6480cf200 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.889+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb63801b8f0 con 0x7fb6480cf200 2023-10-09T15:40:20.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.889+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb648155970 con 0x7fb6480cf200 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.890+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb64806d4f0 con 0x7fb6480cf200 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.890+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb638022030 con 0x7fb6480cf200 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.890+0000 7fb63effd700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 0x7fb6280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.891+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb6380869f0 con 0x7fb6480cf200 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.891+0000 7fb646ffd700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 0x7fb6280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.891+0000 7fb646ffd700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 0x7fb6280697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb6481597f0 tx=0x7fb6400074f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:20.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:20.895+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb638053a90 con 0x7fb6480cf200 2023-10-09T15:40:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.136+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb64806d4f0 con 0x7fb6480cf200 2023-10-09T15:40:21.139 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.137+0000 7fb63effd700 1 -- 172.21.15.33:0/981868336 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 127 v127) v1 ==== 95+0+3531 (secure 0 0 0) 0x7fb6380570b0 con 0x7fb6480cf200 2023-10-09T15:40:21.139 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:21.139 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":127,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7687,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/562629628","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":562629628},{"type":"v1","addr":"172.21.15.59:6835","nonce":562629628}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":7876,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/3026368154","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":3026368154},{"type":"v1","addr":"172.21.15.59:6834","nonce":3026368154}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":127},{"gid":8697,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/2467583571","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":2467583571},{"type":"v1","addr":"172.21.15.33:6836","nonce":2467583571}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118},{"gid":8700,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/3195616462","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3195616462},{"type":"v1","addr":"172.21.15.33:6837","nonce":3195616462}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":118}],"filesystems":[]} 2023-10-09T15:40:21.140 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 msgr2=0x7fb6280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 0x7fb6280697d0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7fb6481597f0 tx=0x7fb6400074f0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 msgr2=0x7fb64816af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb638009290 tx=0x7fb638016000 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 shutdown_connections 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb628067320 0x7fb6280697d0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb6480cf200 0x7fb64816af60 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb6480b07d0 0x7fb648152940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 --2- 172.21.15.33:0/981868336 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb6480b0ba0 0x7fb648155430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 >> 172.21.15.33:0/981868336 conn(0x7fb64806ce80 msgr2=0x7fb6480cd3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 shutdown_connections 2023-10-09T15:40:21.141 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.139+0000 7fb64d553700 1 -- 172.21.15.33:0/981868336 wait complete. 2023-10-09T15:40:21.142 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 127 2023-10-09T15:40:21.153 INFO:tasks.ceph.mds.a:Restarting daemon 2023-10-09T15:40:21.153 INFO:tasks.ceph.mds.a:Stopping old one... 2023-10-09T15:40:21.153 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:40:21.153 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:40:21.154 INFO:tasks.ceph.mds.c:Restarting daemon 2023-10-09T15:40:21.154 INFO:tasks.ceph.mds.c:Stopping old one... 2023-10-09T15:40:21.154 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:40:21.154 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:40:21.154 INFO:tasks.ceph.mds.b:Restarting daemon 2023-10-09T15:40:21.154 INFO:tasks.ceph.mds.b:Stopping old one... 2023-10-09T15:40:21.155 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:40:21.155 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:40:21.155 INFO:tasks.ceph.mds.d:Restarting daemon 2023-10-09T15:40:21.155 INFO:tasks.ceph.mds.d:Stopping old one... 2023-10-09T15:40:21.155 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:40:21.155 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:40:21.162 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:40:21.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-10-09T15:40:21.163 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:40:21.163 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-10-09T15:40:21.166 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:40:21.167 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-10-09T15:40:21.167 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:40:21.168 DEBUG:teuthology.orchestra.run.smithi059:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-10-09T15:40:21.205 INFO:tasks.ceph.mds.a:Started 2023-10-09T15:40:21.205 DEBUG:teuthology.parallel:result is None 2023-10-09T15:40:21.206 INFO:tasks.ceph.mds.c:Started 2023-10-09T15:40:21.206 DEBUG:teuthology.parallel:result is None 2023-10-09T15:40:21.208 INFO:tasks.ceph.mds.b:Started 2023-10-09T15:40:21.208 DEBUG:teuthology.parallel:result is None 2023-10-09T15:40:21.209 INFO:tasks.ceph.mds.d:Started 2023-10-09T15:40:21.209 DEBUG:teuthology.parallel:result is None 2023-10-09T15:40:21.209 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-10-09T15:40:21.282 INFO:tasks.ceph.mds.a.smithi033.stdout:starting mds.a at 2023-10-09T15:40:21.282 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:40:21.283 INFO:tasks.ceph.mds.c.smithi033.stderr:2023-10-09T15:40:21.282+0000 7f7f92042700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T15:40:21.294 INFO:tasks.ceph.mds.b.smithi059.stdout:starting mds.b at 2023-10-09T15:40:21.294 INFO:tasks.ceph.mds.d.smithi059.stdout:starting mds.d at 2023-10-09T15:40:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.335+0000 7fba4b59e700 1 Processor -- start 2023-10-09T15:40:21.336 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.335+0000 7fba4b59e700 1 -- start start 2023-10-09T15:40:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4b59e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fba4c0ccac0 0x7fba4c0cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4b59e700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0cb460 con 0x7fba4c06c8f0 2023-10-09T15:40:21.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4b59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba4c0cb180 con 0x7fba4c0cbe30 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4b59e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba4c15db00 con 0x7fba4c0ccac0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4a59c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fba4c06c8f0 0x7fba4c15d2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53872/0 (socket says 172.21.15.33:53872) 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4a59c700 1 -- 172.21.15.33:0/3497502674 learned_addr learned my addr 172.21.15.33:0/3497502674 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3148244131 0 0) 0x7fba4c0cb460 con 0x7fba4c06c8f0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba34003570 con 0x7fba4c06c8f0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.336+0000 7fba49d9b700 1 --2- 172.21.15.33:0/3497502674 >> v2:172.21.15.59:3300/0 conn(0x7fba4c0ccac0 0x7fba4c0cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2945748236 0 0) 0x7fba34003570 con 0x7fba4c06c8f0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 >> v2:172.21.15.59:3300/0 conn(0x7fba4c0ccac0 msgr2=0x7fba4c0cb8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 --2- 172.21.15.33:0/3497502674 >> v2:172.21.15.59:3300/0 conn(0x7fba4c0ccac0 0x7fba4c0cb8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 >> v1:172.21.15.59:6789/0 conn(0x7fba4c0cbe30 legacy=0x7fba4c0a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c15dde0 con 0x7fba4c06c8f0 2023-10-09T15:40:21.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fba3c001470 con 0x7fba4c06c8f0 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 >> v1:172.21.15.33:6789/0 conn(0x7fba4c06c8f0 legacy=0x7fba4c15d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba34003a60 0x7fba34003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 0x7fba34004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba340052e0 0x7fba3400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c15db00 con 0x7fba34004810 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400c190 con 0x7fba340052e0 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba3400c350 con 0x7fba34003a60 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 0x7fba34004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4a59c700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba34003a60 0x7fba34003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4ad9d700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba340052e0 0x7fba3400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 -- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba34003a60 msgr2=0x7fba34003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba34003a60 0x7fba34003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 -- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba340052e0 msgr2=0x7fba3400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba340052e0 0x7fba3400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba4ad9d700 1 -- 172.21.15.33:0/3497502674 reap_dead start 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 -- 172.21.15.33:0/3497502674 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba34003570 con 0x7fba34004810 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.337+0000 7fba49d9b700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 0x7fba34004c80 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fba4000bb90 tx=0x7fba40008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c03f86cf945c7c2b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4000d5d0 con 0x7fba34004810 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba4000d730 con 0x7fba34004810 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4959a700 1 -- 172.21.15.33:0/3497502674 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4000daf0 con 0x7fba34004810 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 -- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 msgr2=0x7fba34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 0x7fba34004c80 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fba4000bb90 tx=0x7fba40008040 comp rx=0 tx=0).stop 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 -- 172.21.15.33:0/3497502674 shutdown_connections 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 --2- 172.21.15.33:0/3497502674 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba34004810 0x7fba34004c80 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 -- 172.21.15.33:0/3497502674 >> 172.21.15.33:0/3497502674 conn(0x7fba4c06e280 msgr2=0x7fba4c0cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:21.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 -- 172.21.15.33:0/3497502674 shutdown_connections 2023-10-09T15:40:21.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.338+0000 7fba4b59e700 1 -- 172.21.15.33:0/3497502674 wait complete. 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.339+0000 7fba4b59e700 1 Processor -- start 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.339+0000 7fba4b59e700 1 -- start start 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 0x7fba4c15a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 0x7fba4c15af20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c16b040 con 0x7fba4c0c6e80 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0c4de0 con 0x7fba34004810 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4b59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba4c0c44b0 con 0x7fba4c0c6a10 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 0x7fba4c15af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4a59c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:36188/0 (socket says 172.21.15.33:36188) 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4a59c700 1 -- 172.21.15.33:0/1141775040 learned_addr learned my addr 172.21.15.33:0/1141775040 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba49d9b700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 0x7fba4c15a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 -- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 msgr2=0x7fba4c15a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 0x7fba4c15a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 -- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 msgr2=0x7fba4c16b1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4ad9d700 1 -- 172.21.15.33:0/1141775040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba4c0c4790 con 0x7fba4c0c6e80 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba4a59c700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.340+0000 7fba49d9b700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 0x7fba4c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba4ad9d700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 0x7fba4c15af20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fba4c15d210 tx=0x7fba44001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:21.346 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba440040e0 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba44006db0 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba4c0c4a70 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba4400c7f0 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.341+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba4c0c5270 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.342+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba4c0c45f0 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.342+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fba4400cc20 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.343+0000 7fba3a7fc700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.343+0000 7fba4a59c700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.343+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(194..194 src has 1..194) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fba44083f80 con 0x7fba4c0c6e80 2023-10-09T15:40:21.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.343+0000 7fba4a59c700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 0x7fba2c0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001ce0 tx=0x7fba3c001e50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:21.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.347+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fba4c0c45f0 con 0x7fba4c0c6e80 2023-10-09T15:40:21.368 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-10-09T15:40:21.558 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:21.557+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fba4c0c45f0 con 0x7fba4c0c6e80 2023-10-09T15:40:22.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.319+0000 7fba3a7fc700 1 -- 172.21.15.33:0/1141775040 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v196) v1 ==== 97+0+0 (secure 0 0 0) 0x7fba4c0c45f0 con 0x7fba4c0c6e80 2023-10-09T15:40:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 msgr2=0x7fba2c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 0x7fba2c0697d0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7fba3c001ce0 tx=0x7fba3c001e50 comp rx=0 tx=0).stop 2023-10-09T15:40:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 msgr2=0x7fba4c15af20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 0x7fba4c15af20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fba4c15d210 tx=0x7fba44001640 comp rx=0 tx=0).stop 2023-10-09T15:40:22.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 shutdown_connections 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba2c067320 0x7fba2c0697d0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fba4c0c6e80 0x7fba4c15af20 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fba34004810 0x7fba4c16b1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 --2- 172.21.15.33:0/1141775040 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fba4c0c6a10 0x7fba4c15a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 >> 172.21.15.33:0/1141775040 conn(0x7fba4c06e280 msgr2=0x7fba4c0a9f20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 shutdown_connections 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.322+0000 7fba4b59e700 1 -- 172.21.15.33:0/1141775040 wait complete. 2023-10-09T15:40:22.324 INFO:teuthology.orchestra.run.smithi033.stderr: removed all blocklist entries 2023-10-09T15:40:22.338 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-10-09T15:40:22.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.463+0000 7fcb34897700 1 Processor -- start 2023-10-09T15:40:22.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.463+0000 7fcb34897700 1 -- start start 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb34897700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fcb3015dfd0 0x7fcb300aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb34897700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300acc00 con 0x7fcb30159550 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb34897700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb300abff0 con 0x7fcb30159920 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb34897700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb300ac2d0 con 0x7fcb3015dfd0 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb2f7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fcb30159550 0x7fcb300ceac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53876/0 (socket says 172.21.15.33:53876) 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.464+0000 7fcb2f7fe700 1 -- 172.21.15.33:0/1742377421 learned_addr learned my addr 172.21.15.33:0/1742377421 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2effd700 1 --2- 172.21.15.33:0/1742377421 >> v2:172.21.15.59:3300/0 conn(0x7fcb3015dfd0 0x7fcb300aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2801476711 0 0) 0x7fcb300acc00 con 0x7fcb30159550 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb18003570 con 0x7fcb30159550 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4034038527 0 0) 0x7fcb18003570 con 0x7fcb30159550 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 >> v2:172.21.15.59:3300/0 conn(0x7fcb3015dfd0 msgr2=0x7fcb300aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:22.468 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 --2- 172.21.15.33:0/1742377421 >> v2:172.21.15.59:3300/0 conn(0x7fcb3015dfd0 0x7fcb300aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 >> v1:172.21.15.59:6789/0 conn(0x7fcb30159920 legacy=0x7fcb300ad090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300ac5b0 con 0x7fcb30159550 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fcb20001470 con 0x7fcb30159550 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 >> v1:172.21.15.33:6789/0 conn(0x7fcb30159550 legacy=0x7fcb300ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 0x7fcb18003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18004810 0x7fcb18004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb180051c0 0x7fcb1800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300ac2d0 con 0x7fcb18003a60 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1800c0d0 con 0x7fcb18004810 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb1800c290 con 0x7fcb180051c0 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 0x7fcb18003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.469 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2effd700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18004810 0x7fcb18004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.465+0000 7fcb2ffff700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb180051c0 0x7fcb1800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 -- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb180051c0 msgr2=0x7fcb1800ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb180051c0 0x7fcb1800ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 -- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18004810 msgr2=0x7fcb18004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18004810 0x7fcb18004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 -- 172.21.15.33:0/1742377421 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb18003570 con 0x7fcb18003a60 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2ffff700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb180051c0 0x7fcb1800ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2ffff700 1 -- 172.21.15.33:0/1742377421 reap_dead start 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 0x7fcb18003e70 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c3c0 tx=0x7fcb20001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a51d648dc51a587 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2000cc90 con 0x7fcb18003a60 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2000ce10 con 0x7fcb18003a60 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb2e7fc700 1 -- 172.21.15.33:0/1742377421 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb20005b70 con 0x7fcb18003a60 2023-10-09T15:40:22.470 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 -- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 msgr2=0x7fcb18003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 0x7fcb18003e70 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7fcb2000c3c0 tx=0x7fcb20001e50 comp rx=0 tx=0).stop 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 -- 172.21.15.33:0/1742377421 shutdown_connections 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 --2- 172.21.15.33:0/1742377421 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb18003a60 0x7fcb18003e70 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 -- 172.21.15.33:0/1742377421 >> 172.21.15.33:0/1742377421 conn(0x7fcb3006ce80 msgr2=0x7fcb300ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.466+0000 7fcb34897700 1 -- 172.21.15.33:0/1742377421 shutdown_connections 2023-10-09T15:40:22.471 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.467+0000 7fcb34897700 1 -- 172.21.15.33:0/1742377421 wait complete. 2023-10-09T15:40:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 Processor -- start 2023-10-09T15:40:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 -- start start 2023-10-09T15:40:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 0x7fcb300b3e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.473 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb300acf90 0x7fcb300ad400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300ad940 con 0x7fcb300b1150 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300cdd30 con 0x7fcb18003a60 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.468+0000 7fcb34897700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb300b22e0 con 0x7fcb300acf90 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33430/0 (socket says 172.21.15.33:33430) 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 -- 172.21.15.33:0/672677974 learned_addr learned my addr 172.21.15.33:0/672677974 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 0x7fcb300b3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2ffff700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb300acf90 0x7fcb300ad400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 -- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb300acf90 msgr2=0x7fcb300ad400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb300acf90 0x7fcb300ad400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 -- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 msgr2=0x7fcb300b3e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 0x7fcb300b3e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 -- 172.21.15.33:0/672677974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb300b16d0 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 0x7fcb300b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb2effd700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fcb24011d40 tx=0x7fcb240091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb2400fac0 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb2400fc20 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb300b19b0 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb24014440 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.469+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb300b1f70 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.470+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb300caca0 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.471+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fcb24014870 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.471+0000 7fcb177fe700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 0x7fcb1c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.471+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fcb24018030 con 0x7fcb300b1150 2023-10-09T15:40:22.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.471+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 0x7fcb1c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.472+0000 7fcb2f7fe700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 0x7fcb1c0697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001ed0 tx=0x7fcb20015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.475+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fcb240523c0 con 0x7fcb300b1150 2023-10-09T15:40:22.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.752+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fcb3004c3c0 con 0x7fcb300b1150 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.752+0000 7fcb177fe700 1 -- 172.21.15.33:0/672677974 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fcb240559e0 con 0x7fcb300b1150 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stdout: "auth_dump": [ 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.753 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.a", 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlbtrKARAAdQy9op6tXavWTaaEF3yMZA==", 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.754 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.b", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlC9VSDRAAcU68/KNt4JVsC0wNYzqp1w==", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.c", 2023-10-09T15:40:22.755 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRliWi/CBAAJkcEHF8PcNKbbpVilTOlwA==", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mds.d", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlgGNJFBAAXqydwNxqWsod8ja45DrN8A==", 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.756 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.0", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCDHCRlkhlNLRAAswyE7mxQEqLDW0zXE9VGaQ==", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.757 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.1", 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCGHCRlr/P+KhAA+C5GbeRcqYs6ipX1fu6t6w==", 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.758 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.2", 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCJHCRlP5keKhAAOUzPwMutOo/rfHXtEggmww==", 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.759 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.3", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCMHCRliMVaKBAARNSPc7IA8vthnN3S7s43Ow==", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.4", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCSHCRlA9AHKxAAJS7DPqOiGVPlotv2b3zP5g==", 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.760 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.5", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCVHCRla8itKRAAdGCHnNVbqak59gBAIZySOA==", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.761 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.6", 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCYHCRlH1QuKBAAVOMFkrwGHkaVdZ3Pfbgoiw==", 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.762 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "osd.7", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCbHCRlv9fUJhAAaxRstA5Z0mCH5l7wiTBcpA==", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow profile osd", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile osd", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.0", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRljxE/GBAARHuNORrTzxkcqmLkVLPYAA==", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.763 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow r", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.1", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlR5fKIBAAYyW4RQP/87eQVScl+5u/Qg==", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:40:22.764 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.2", 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRl/qiyHRAAZFO747sZsU2iUII2AM4A1Q==", 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.765 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.3", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQCAHCRlIlc8JhAA82aPSA75wvLSS4qT4z0TUQ==", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow r", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow rw", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow rwx" 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "client.admin", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlKj5oIBAAoG4fLiq35nk6F0Y77NdjAg==", 2023-10-09T15:40:22.766 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mgr": "allow *", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow *", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.x", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlgV82OhAAJAEyguFTvx+8NRIZ1M/Q/A==", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:40:22.767 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: }, 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "entity": "mgr.y", 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "key": "AQB/HCRlToXlNBAAx7FjsWFvpNhvNz4vbKtLkw==", 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "caps": { 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "mds": "allow *", 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "mon": "allow profile mgr", 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: "osd": "allow *" 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:22.768 INFO:teuthology.orchestra.run.smithi033.stdout: ] 2023-10-09T15:40:22.769 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 msgr2=0x7fcb1c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 0x7fcb1c0697d0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fcb20001ed0 tx=0x7fcb20015000 comp rx=0 tx=0).stop 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 msgr2=0x7fcb3014af90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7fcb24011d40 tx=0x7fcb240091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 shutdown_connections 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fcb1c067320 0x7fcb1c0697d0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fcb300acf90 0x7fcb300ad400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fcb18003a60 0x7fcb300b3e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 --2- 172.21.15.33:0/672677974 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fcb300b1150 0x7fcb3014af90 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 >> 172.21.15.33:0/672677974 conn(0x7fcb3006ce80 msgr2=0x7fcb30153ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:22.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 shutdown_connections 2023-10-09T15:40:22.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.754+0000 7fcb34897700 1 -- 172.21.15.33:0/672677974 wait complete. 2023-10-09T15:40:22.771 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.889+0000 7fa265066700 1 Processor -- start 2023-10-09T15:40:22.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.889+0000 7fa265066700 1 -- start start 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa265066700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2600c29b0 0x7fa260156af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa265066700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600c3a30 con 0x7fa260070410 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa265066700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600c2e20 con 0x7fa26013fcc0 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa265066700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2600c3100 con 0x7fa2600c29b0 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa25e59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa2600c29b0 0x7fa260156af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa25f59e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa260070410 0x7fa260160120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53888/0 (socket says 172.21.15.33:53888) 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.890+0000 7fa25f59e700 1 -- 172.21.15.33:0/4109845444 learned_addr learned my addr 172.21.15.33:0/4109845444 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:22.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25e59c700 1 -- 172.21.15.33:0/4109845444 >> v1:172.21.15.59:6789/0 conn(0x7fa26013fcc0 legacy=0x7fa2600c43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25e59c700 1 -- 172.21.15.33:0/4109845444 >> v1:172.21.15.33:6789/0 conn(0x7fa260070410 legacy=0x7fa260160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25e59c700 1 -- 172.21.15.33:0/4109845444 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600c33e0 con 0x7fa2600c29b0 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25dd9b700 1 -- 172.21.15.33:0/4109845444 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1485346250 0 0) 0x7fa2600c3a30 con 0x7fa260070410 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25e59c700 1 --2- 172.21.15.33:0/4109845444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2600c29b0 0x7fa260156af0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098e0 tx=0x7fa2480091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=374b5587088b8a0a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25dd9b700 1 -- 172.21.15.33:0/4109845444 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa248009e80 con 0x7fa2600c29b0 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25dd9b700 1 -- 172.21.15.33:0/4109845444 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24800b860 con 0x7fa2600c29b0 2023-10-09T15:40:22.893 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa25dd9b700 1 -- 172.21.15.33:0/4109845444 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24800bbe0 con 0x7fa2600c29b0 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa265066700 1 -- 172.21.15.33:0/4109845444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2600c29b0 msgr2=0x7fa260156af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa265066700 1 --2- 172.21.15.33:0/4109845444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2600c29b0 0x7fa260156af0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7fa2480098e0 tx=0x7fa2480091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa265066700 1 -- 172.21.15.33:0/4109845444 shutdown_connections 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa265066700 1 --2- 172.21.15.33:0/4109845444 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2600c29b0 0x7fa260156af0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.891+0000 7fa265066700 1 -- 172.21.15.33:0/4109845444 >> 172.21.15.33:0/4109845444 conn(0x7fa2600ccb60 msgr2=0x7fa2600ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.892+0000 7fa265066700 1 -- 172.21.15.33:0/4109845444 shutdown_connections 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.892+0000 7fa265066700 1 -- 172.21.15.33:0/4109845444 wait complete. 2023-10-09T15:40:22.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 Processor -- start 2023-10-09T15:40:22.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 -- start start 2023-10-09T15:40:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa260070410 0x7fa260136fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2600c29b0 0x7fa260140120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601565c0 con 0x7fa26013fcc0 2023-10-09T15:40:22.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600ca400 con 0x7fa260070410 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.893+0000 7fa265066700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c9df0 con 0x7fa2600c29b0 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33436/0 (socket says 172.21.15.33:33436) 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 -- 172.21.15.33:0/1328419263 learned_addr learned my addr 172.21.15.33:0/1328419263 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25ed9d700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa260070410 0x7fa260136fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25e59c700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2600c29b0 0x7fa260140120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 -- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2600c29b0 msgr2=0x7fa260140120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2600c29b0 0x7fa260140120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 -- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa260070410 msgr2=0x7fa260136fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa260070410 0x7fa260136fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 -- 172.21.15.33:0/1328419263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa248009420 con 0x7fa26013fcc0 2023-10-09T15:40:22.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa25f59e700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c5b0 tx=0x7fa258007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258005b30 con 0x7fa26013fcc0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258005c90 con 0x7fa26013fcc0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2580072e0 con 0x7fa26013fcc0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2600c7eb0 con 0x7fa26013fcc0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.894+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2600ca090 con 0x7fa26013fcc0 2023-10-09T15:40:22.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.895+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa26004c3c0 con 0x7fa26013fcc0 2023-10-09T15:40:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.896+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa258007690 con 0x7fa26013fcc0 2023-10-09T15:40:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.896+0000 7fa256ffd700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.896+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7fa258083bf0 con 0x7fa26013fcc0 2023-10-09T15:40:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.896+0000 7fa25ed9d700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:22.899 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.897+0000 7fa25ed9d700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 0x7fa2400697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250001650 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:22.901 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:22.901+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa25804b5a0 con 0x7fa26013fcc0 2023-10-09T15:40:23.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.095+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2600ca540 con 0x7fa26013fcc0 2023-10-09T15:40:23.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.096+0000 7fa256ffd700 1 -- 172.21.15.33:0/1328419263 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v196) v1 ==== 74+0+12096 (secure 0 0 0) 0x7fa258017020 con 0x7fa26013fcc0 2023-10-09T15:40:23.097 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:23.098 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":196,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:22.314756+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":32,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:23.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 msgr2=0x7fa2400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 0x7fa2400697d0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250001650 comp rx=0 tx=0).stop 2023-10-09T15:40:23.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 msgr2=0x7fa260140660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 secure :-1 s=READY pgs=1734 cs=0 l=1 rev1=1 crypto rx=0x7fa25800c5b0 tx=0x7fa258007d30 comp rx=0 tx=0).stop 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 shutdown_connections 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa240067320 0x7fa2400697d0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa26013fcc0 0x7fa260140660 unknown :-1 s=CLOSED pgs=1734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa260070410 0x7fa260136fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 --2- 172.21.15.33:0/1328419263 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2600c29b0 0x7fa260140120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 >> 172.21.15.33:0/1328419263 conn(0x7fa2600ccb60 msgr2=0x7fa260158a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 shutdown_connections 2023-10-09T15:40:23.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.099+0000 7fa265066700 1 -- 172.21.15.33:0/1328419263 wait complete. 2023-10-09T15:40:23.112 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2023-10-09T15:40:23.112 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:40:23.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.234+0000 7f3b7ac70700 1 Processor -- start 2023-10-09T15:40:23.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.234+0000 7f3b7ac70700 1 -- start start 2023-10-09T15:40:23.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b7ac70700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b74159530 0x7f3b740ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b7ac70700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 0x7f3b74159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b7ac70700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b740ccfd0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b7ac70700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b740cf0e0 con 0x7f3b74159530 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b7ac70700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b7415a3d0 con 0x7f3b7406dc70 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b74159530 0x7f3b740ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3b74159530 0x7f3b740ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33450/0 (socket says 172.21.15.33:33450) 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 -- 172.21.15.33:0/3285001483 learned_addr learned my addr 172.21.15.33:0/3285001483 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 -- 172.21.15.33:0/3285001483 >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 msgr2=0x7f3b74159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b73fff700 1 --2- 172.21.15.33:0/3285001483 >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 0x7f3b74159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 --2- 172.21.15.33:0/3285001483 >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 0x7f3b74159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 -- 172.21.15.33:0/3285001483 >> v1:172.21.15.59:6789/0 conn(0x7f3b7406e0e0 legacy=0x7f3b740cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:23.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 -- 172.21.15.33:0/3285001483 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7415a6b0 con 0x7f3b74159530 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b73fff700 1 --2- 172.21.15.33:0/3285001483 >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 0x7f3b74159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.235+0000 7f3b78a0c700 1 --2- 172.21.15.33:0/3285001483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b74159530 0x7f3b740ceba0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b66e0 tx=0x7f3b6c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a5932f442f4d32 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b737fe700 1 -- 172.21.15.33:0/3285001483 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00b820 con 0x7f3b74159530 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b737fe700 1 -- 172.21.15.33:0/3285001483 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6c00b980 con 0x7f3b74159530 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b737fe700 1 -- 172.21.15.33:0/3285001483 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6c00bd20 con 0x7f3b74159530 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3285001483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b74159530 msgr2=0x7f3b740ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3285001483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b74159530 0x7f3b740ceba0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b66e0 tx=0x7f3b6c009250 comp rx=0 tx=0).stop 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3285001483 shutdown_connections 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3285001483 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b74159530 0x7f3b740ceba0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3285001483 >> v2:172.21.15.59:3300/0 conn(0x7f3b7406dc70 0x7f3b74159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3285001483 >> 172.21.15.33:0/3285001483 conn(0x7f3b740703a0 msgr2=0x7f3b740707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3285001483 shutdown_connections 2023-10-09T15:40:23.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.236+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3285001483 wait complete. 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.237+0000 7f3b7ac70700 1 Processor -- start 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.237+0000 7f3b7ac70700 1 -- start start 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7406dc70 0x7f3b740b3480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 0x7f3b740c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74151250 con 0x7f3b7406e0e0 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b740b39c0 con 0x7f3b74159530 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7ac70700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b74150640 con 0x7f3b7406dc70 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33458/0 (socket says 172.21.15.33:33458) 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b73fff700 1 -- 172.21.15.33:0/3520363790 learned_addr learned my addr 172.21.15.33:0/3520363790 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b78a0c700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7406dc70 0x7f3b740b3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.238+0000 7f3b7920d700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 0x7f3b740c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 -- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7406dc70 msgr2=0x7f3b740b3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7406dc70 0x7f3b740b3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 -- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 msgr2=0x7f3b740c81c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 0x7f3b740c81c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 -- 172.21.15.33:0/3520363790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b6c0094f0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b7920d700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 0x7f3b740c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b73fff700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400a430 tx=0x7f3b64007910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400ae10 con 0x7f3b7406e0e0 2023-10-09T15:40:23.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b6400d650 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b6400d9f0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b74150920 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.239+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b74150ee0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.240+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b7404c3c0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.240+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3b64015440 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.241+0000 7f3b70ff9700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 0x7f3b540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.241+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f3b64085170 con 0x7f3b7406e0e0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.241+0000 7f3b78a0c700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 0x7f3b540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.241+0000 7f3b78a0c700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 0x7f3b540697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b66e0 tx=0x7f3b6c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.245+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3b6404e5a0 con 0x7f3b7406e0e0 2023-10-09T15:40:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.441+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3b74151390 con 0x7f3b7406e0e0 2023-10-09T15:40:23.442 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.441+0000 7f3b70ff9700 1 -- 172.21.15.33:0/3520363790 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v196) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3b64052200 con 0x7f3b7406e0e0 2023-10-09T15:40:23.442 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 msgr2=0x7f3b540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 0x7f3b540697d0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f3b740b66e0 tx=0x7f3b6c016000 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 msgr2=0x7f3b7414c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7f3b6400a430 tx=0x7f3b64007910 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 shutdown_connections 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3b54067320 0x7f3b540697d0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3b74159530 0x7f3b740c81c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3b7406dc70 0x7f3b740b3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.443+0000 7f3b7ac70700 1 --2- 172.21.15.33:0/3520363790 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3b7406e0e0 0x7f3b7414c2c0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.444+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 >> 172.21.15.33:0/3520363790 conn(0x7f3b740703a0 msgr2=0x7f3b740d04b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.444+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 shutdown_connections 2023-10-09T15:40:23.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.444+0000 7f3b7ac70700 1 -- 172.21.15.33:0/3520363790 wait complete. 2023-10-09T15:40:23.457 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-10-09T15:40:23.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.575+0000 7f61f48d8700 1 Processor -- start 2023-10-09T15:40:23.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 -- start start 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 0x7f61f015d2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61f00ccac0 0x7f61f00cb8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f00a98f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00cb460 con 0x7f61f00ccac0 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61f00cb180 con 0x7f61f006c8f0 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61f48d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f015db00 con 0x7f61f00cbe30 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61eeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61f00ccac0 0x7f61f00cb8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.576+0000 7f61eeffd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f61f00ccac0 0x7f61f00cb8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33470/0 (socket says 172.21.15.33:33470) 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 -- 172.21.15.33:0/1587547557 learned_addr learned my addr 172.21.15.33:0/1587547557 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61effff700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f00a98f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61ef7fe700 1 --2- 172.21.15.33:0/1587547557 >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 0x7f61f015d2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 -- 172.21.15.33:0/1587547557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 msgr2=0x7f61f00a98f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f00a98f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 -- 172.21.15.33:0/1587547557 >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 msgr2=0x7f61f015d2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 --2- 172.21.15.33:0/1587547557 >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 0x7f61f015d2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 -- 172.21.15.33:0/1587547557 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f015dde0 con 0x7f61f00ccac0 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61ef7fe700 1 --2- 172.21.15.33:0/1587547557 >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 0x7f61f015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61eeffd700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f00ccac0 0x7f61f00cb8f0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f61f00cdcb0 tx=0x7f61e4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc2ddb41dca9387 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61ee7fc700 1 -- 172.21.15.33:0/1587547557 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400b860 con 0x7f61f00ccac0 2023-10-09T15:40:23.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61ee7fc700 1 -- 172.21.15.33:0/1587547557 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e400b9c0 con 0x7f61f00ccac0 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.577+0000 7f61ee7fc700 1 -- 172.21.15.33:0/1587547557 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e400bd60 con 0x7f61f00ccac0 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 -- 172.21.15.33:0/1587547557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f00ccac0 msgr2=0x7f61f00cb8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f00ccac0 0x7f61f00cb8f0 secure :-1 s=READY pgs=1737 cs=0 l=1 rev1=1 crypto rx=0x7f61f00cdcb0 tx=0x7f61e4009250 comp rx=0 tx=0).stop 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 -- 172.21.15.33:0/1587547557 shutdown_connections 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 --2- 172.21.15.33:0/1587547557 >> v2:172.21.15.59:3300/0 conn(0x7f61f006c8f0 0x7f61f015d2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f00a98f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 --2- 172.21.15.33:0/1587547557 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f00ccac0 0x7f61f00cb8f0 unknown :-1 s=CLOSED pgs=1737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 -- 172.21.15.33:0/1587547557 >> 172.21.15.33:0/1587547557 conn(0x7f61f006e280 msgr2=0x7f61f00cd260 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 -- 172.21.15.33:0/1587547557 shutdown_connections 2023-10-09T15:40:23.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.578+0000 7f61f48d8700 1 -- 172.21.15.33:0/1587547557 wait complete. 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.579+0000 7f61f48d8700 1 Processor -- start 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.579+0000 7f61f48d8700 1 -- start start 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f015b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f00ccac0 0x7f61f00c4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f016a9d0 con 0x7f61f006c8f0 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61f00b10e0 con 0x7f61f00ccac0 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61f016d5c0 con 0x7f61f00cbe30 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33474/0 (socket says 172.21.15.33:33474) 2023-10-09T15:40:23.584 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 -- 172.21.15.33:0/37979585 learned_addr learned my addr 172.21.15.33:0/37979585 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 -- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 msgr2=0x7f61f015b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f015b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 -- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f00ccac0 msgr2=0x7f61f00c4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61effff700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f00ccac0 0x7f61f00c4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f00ccac0 0x7f61f00c4310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 -- 172.21.15.33:0/37979585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61e40094f0 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61ef7fe700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c830 tx=0x7f61e0008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0011600 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61e0011760 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61e0011b20 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.580+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61f016d8a0 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.581+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61f016de60 con 0x7f61f006c8f0 2023-10-09T15:40:23.585 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.581+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61f00c7e60 con 0x7f61f006c8f0 2023-10-09T15:40:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.582+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f61e000a3e0 con 0x7f61f006c8f0 2023-10-09T15:40:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.582+0000 7f61d77fe700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 0x7f61dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.583+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f61e0084ef0 con 0x7f61f006c8f0 2023-10-09T15:40:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.583+0000 7f61eeffd700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 0x7f61dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.586 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.583+0000 7f61eeffd700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 0x7f61dc0697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f61f00cdcb0 tx=0x7f61e4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.587 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.587+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61e0051dc0 con 0x7f61f006c8f0 2023-10-09T15:40:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.784+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f61f004c3c0 con 0x7f61f006c8f0 2023-10-09T15:40:23.785 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.784+0000 7f61d77fe700 1 -- 172.21.15.33:0/37979585 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v196) v1 ==== 84+0+65 (secure 0 0 0) 0x7f61e0015090 con 0x7f61f006c8f0 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "poolnum": 1, 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: "poolname": ".mgr" 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:23.786 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:40:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 msgr2=0x7f61dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.787 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 0x7f61dc0697d0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f61f00cdcb0 tx=0x7f61e4017000 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 msgr2=0x7f61f016a490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f61e000c830 tx=0x7f61e0008040 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 shutdown_connections 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61dc067320 0x7f61dc0697d0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f61f006c8f0 0x7f61f016a490 unknown :-1 s=CLOSED pgs=1738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f61f00ccac0 0x7f61f00c4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 --2- 172.21.15.33:0/37979585 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f61f00cbe30 0x7f61f015b380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 >> 172.21.15.33:0/37979585 conn(0x7f61f006e280 msgr2=0x7f61f00cd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 shutdown_connections 2023-10-09T15:40:23.788 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.786+0000 7f61f48d8700 1 -- 172.21.15.33:0/37979585 wait complete. 2023-10-09T15:40:23.800 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-10-09T15:40:23.800 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-10-09T15:40:23.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.923+0000 7f4d20658700 1 Processor -- start 2023-10-09T15:40:23.924 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.923+0000 7f4d20658700 1 -- start start 2023-10-09T15:40:23.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d20658700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4d180cd770 0x7f4d180cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d20658700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f4d180b04f0 0x7f4d181591e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.926 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d20658700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d180cf330 con 0x7f4d180cb880 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d20658700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180cead0 con 0x7f4d180cd770 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d20658700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d180cdbc0 con 0x7f4d180b04f0 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1e3f4700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4d180cb880 0x7f4d180cd060 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53900/0 (socket says 172.21.15.33:53900) 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1e3f4700 1 -- 172.21.15.33:0/765784598 learned_addr learned my addr 172.21.15.33:0/765784598 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 --2- 172.21.15.33:0/765784598 >> v2:172.21.15.33:3300/0 conn(0x7f4d180cd770 0x7f4d180cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1ebf5700 1 --2- 172.21.15.33:0/765784598 >> v2:172.21.15.59:3300/0 conn(0x7f4d180b04f0 0x7f4d181591e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1d3f2700 1 -- 172.21.15.33:0/765784598 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3434711597 0 0) 0x7f4d180cf330 con 0x7f4d180cb880 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1d3f2700 1 -- 172.21.15.33:0/765784598 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d00003570 con 0x7f4d180cb880 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 -- 172.21.15.33:0/765784598 >> v2:172.21.15.59:3300/0 conn(0x7f4d180b04f0 msgr2=0x7f4d181591e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 --2- 172.21.15.33:0/765784598 >> v2:172.21.15.59:3300/0 conn(0x7f4d180b04f0 0x7f4d181591e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.927 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 -- 172.21.15.33:0/765784598 >> v1:172.21.15.33:6789/0 conn(0x7f4d180cb880 legacy=0x7f4d180cd060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 -- 172.21.15.33:0/765784598 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d180cddd0 con 0x7f4d180cd770 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.924+0000 7f4d1dbf3700 1 --2- 172.21.15.33:0/765784598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d180cbc50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ccab0 tx=0x7f4d0c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3739832164bac821 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d1d3f2700 1 -- 172.21.15.33:0/765784598 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c011630 con 0x7f4d180cd770 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d1d3f2700 1 -- 172.21.15.33:0/765784598 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0c011790 con 0x7f4d180cd770 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d1d3f2700 1 -- 172.21.15.33:0/765784598 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0c011b30 con 0x7f4d180cd770 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 -- 172.21.15.33:0/765784598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 msgr2=0x7f4d180cbc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 --2- 172.21.15.33:0/765784598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d180cbc50 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f4d180ccab0 tx=0x7f4d0c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 -- 172.21.15.33:0/765784598 shutdown_connections 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 --2- 172.21.15.33:0/765784598 >> v2:172.21.15.59:3300/0 conn(0x7f4d180b04f0 0x7f4d181591e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 --2- 172.21.15.33:0/765784598 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d180cbc50 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 -- 172.21.15.33:0/765784598 >> 172.21.15.33:0/765784598 conn(0x7f4d180703a0 msgr2=0x7f4d180707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:23.928 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 -- 172.21.15.33:0/765784598 shutdown_connections 2023-10-09T15:40:23.929 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.925+0000 7f4d20658700 1 -- 172.21.15.33:0/765784598 wait complete. 2023-10-09T15:40:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.926+0000 7f4d20658700 1 Processor -- start 2023-10-09T15:40:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.926+0000 7f4d20658700 1 -- start start 2023-10-09T15:40:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d180b04f0 0x7f4d1814a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 0x7f4d1815b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.931 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180c80f0 con 0x7f4d180cd770 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180c7830 con 0x7f4d180b04f0 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d20658700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d180c7aa0 con 0x7f4d180cb880 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d1ebf5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d1ebf5700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33482/0 (socket says 172.21.15.33:33482) 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d1ebf5700 1 -- 172.21.15.33:0/2321246879 learned_addr learned my addr 172.21.15.33:0/2321246879 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d1e3f4700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d180b04f0 0x7f4d1814a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.927+0000 7f4d1dbf3700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 0x7f4d1815b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 -- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 msgr2=0x7f4d1815b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 0x7f4d1815b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.932 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 -- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d180b04f0 msgr2=0x7f4d1814a340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d180b04f0 0x7f4d1814a340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 -- 172.21.15.33:0/2321246879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d0c009420 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1dbf3700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 0x7f4d1815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d1ebf5700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f4d08007f50 tx=0x7f4d08009860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d0800ec20 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d0800eda0 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d180c7d80 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d08014670 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.928+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d1816aea0 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.929+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d1816b090 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.929+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4d080149e0 con 0x7f4d180cd770 2023-10-09T15:40:23.933 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.930+0000 7f4d167fc700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 0x7f4d040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.930+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(196..196 src has 1..196) v4 ==== 4853+0+0 (secure 0 0 0) 0x7f4d08084fb0 con 0x7f4d180cd770 2023-10-09T15:40:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.930+0000 7f4d1e3f4700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 0x7f4d040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:23.934 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.930+0000 7f4d1e3f4700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 0x7f4d040697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007fd0 tx=0x7f4d10009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:23.935 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:23.934+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4d08051f90 con 0x7f4d180cd770 2023-10-09T15:40:24.128 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.127+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4d180c82a0 con 0x7f4d180cd770 2023-10-09T15:40:24.333 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.332+0000 7f4d167fc700 1 -- 172.21.15.33:0/2321246879 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v197) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4d080555b0 con 0x7f4d180cd770 2023-10-09T15:40:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 msgr2=0x7f4d040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 0x7f4d040697d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f4d10007fd0 tx=0x7f4d10009040 comp rx=0 tx=0).stop 2023-10-09T15:40:24.338 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 msgr2=0x7f4d1815b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7f4d08007f50 tx=0x7f4d08009860 comp rx=0 tx=0).stop 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 shutdown_connections 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4d04067320 0x7f4d040697d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4d180cd770 0x7f4d1815b550 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4d180b04f0 0x7f4d1814a340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 --2- 172.21.15.33:0/2321246879 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4d180cb880 0x7f4d1815b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 >> 172.21.15.33:0/2321246879 conn(0x7f4d180703a0 msgr2=0x7f4d180638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 shutdown_connections 2023-10-09T15:40:24.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.337+0000 7f4d20658700 1 -- 172.21.15.33:0/2321246879 wait complete. 2023-10-09T15:40:24.340 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' created 2023-10-09T15:40:24.352 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-10-09T15:40:24.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.477+0000 7f32f0ccc700 1 Processor -- start 2023-10-09T15:40:24.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 -- start start 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 0x7f32ec0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32ec06dc70 0x7f32ec159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f32ec06e0e0 0x7f32ec0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0ccfd0 con 0x7f32ec06dc70 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32ec0cf0e0 con 0x7f32ec06e0e0 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.478+0000 7f32f0ccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec15a3d0 con 0x7f32ec159530 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32ec06dc70 0x7f32ec159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f32ec06dc70 0x7f32ec159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33490/0 (socket says 172.21.15.33:33490) 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 -- 172.21.15.33:0/976228915 learned_addr learned my addr 172.21.15.33:0/976228915 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32ead9d700 1 --2- 172.21.15.33:0/976228915 >> v2:172.21.15.59:3300/0 conn(0x7f32ec06e0e0 0x7f32ec0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32ea59c700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 0x7f32ec0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 -- 172.21.15.33:0/976228915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 msgr2=0x7f32ec0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 0x7f32ec0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 -- 172.21.15.33:0/976228915 >> v2:172.21.15.59:3300/0 conn(0x7f32ec06e0e0 msgr2=0x7f32ec0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 --2- 172.21.15.33:0/976228915 >> v2:172.21.15.59:3300/0 conn(0x7f32ec06e0e0 0x7f32ec0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 -- 172.21.15.33:0/976228915 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32ec15a6b0 con 0x7f32ec06dc70 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32ea59c700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 0x7f32ec0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e9d9b700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec06dc70 0x7f32ec159900 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f32ec089880 tx=0x7f32d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23949ecad6382dd4 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e959a700 1 -- 172.21.15.33:0/976228915 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d4009e70 con 0x7f32ec06dc70 2023-10-09T15:40:24.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e959a700 1 -- 172.21.15.33:0/976228915 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32d400b860 con 0x7f32ec06dc70 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.479+0000 7f32e959a700 1 -- 172.21.15.33:0/976228915 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32d400bc00 con 0x7f32ec06dc70 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 -- 172.21.15.33:0/976228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec06dc70 msgr2=0x7f32ec159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec06dc70 0x7f32ec159900 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f32ec089880 tx=0x7f32d4009250 comp rx=0 tx=0).stop 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 -- 172.21.15.33:0/976228915 shutdown_connections 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/976228915 >> v2:172.21.15.59:3300/0 conn(0x7f32ec06e0e0 0x7f32ec0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec159530 0x7f32ec0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/976228915 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec06dc70 0x7f32ec159900 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 -- 172.21.15.33:0/976228915 >> 172.21.15.33:0/976228915 conn(0x7f32ec0703a0 msgr2=0x7f32ec0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 -- 172.21.15.33:0/976228915 shutdown_connections 2023-10-09T15:40:24.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.480+0000 7f32f0ccc700 1 -- 172.21.15.33:0/976228915 wait complete. 2023-10-09T15:40:24.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.481+0000 7f32f0ccc700 1 Processor -- start 2023-10-09T15:40:24.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.481+0000 7f32f0ccc700 1 -- start start 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec06dc70 0x7f32ec156380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec06e0e0 0x7f32ec0ca3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec1568c0 con 0x7f32ec159530 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec16a5f0 con 0x7f32ec06dc70 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32f0ccc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32ec16a8d0 con 0x7f32ec06e0e0 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33500/0 (socket says 172.21.15.33:33500) 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 -- 172.21.15.33:0/689451293 learned_addr learned my addr 172.21.15.33:0/689451293 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ea59c700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec06dc70 0x7f32ec156380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32e9d9b700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec06e0e0 0x7f32ec0ca3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 -- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec06e0e0 msgr2=0x7f32ec0ca3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec06e0e0 0x7f32ec0ca3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 -- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec06dc70 msgr2=0x7f32ec156380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec06dc70 0x7f32ec156380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 -- 172.21.15.33:0/689451293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d40094f0 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32ead9d700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00ea50 tx=0x7f32dc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00ee90 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.482+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32dc00c7f0 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.483+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32ec16abb0 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.483+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32dc00cbb0 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.483+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32ec0c8730 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.483+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32ec0c8920 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.484+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f32dc013470 con 0x7f32ec159530 2023-10-09T15:40:24.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.484+0000 7f32e27fc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 0x7f32cc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:24.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.485+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(197..197 src has 1..197) v4 ==== 5223+0+0 (secure 0 0 0) 0x7f32dc085420 con 0x7f32ec159530 2023-10-09T15:40:24.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.485+0000 7f32ea59c700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 0x7f32cc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:24.488 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.485+0000 7f32ea59c700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 0x7f32cc0697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f32e40076a0 tx=0x7f32e4009930 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:24.489 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.489+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f32dc052310 con 0x7f32ec159530 2023-10-09T15:40:24.683 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:24.682+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f32ec04c3c0 con 0x7f32ec159530 2023-10-09T15:40:25.334 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.333+0000 7f32e27fc700 1 -- 172.21.15.33:0/689451293 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v198) v1 ==== 170+0+0 (secure 0 0 0) 0x7f32dc055930 con 0x7f32ec159530 2023-10-09T15:40:25.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.338+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 msgr2=0x7f32cc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.339 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.338+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 0x7f32cc0697d0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f32e40076a0 tx=0x7f32e4009930 comp rx=0 tx=0).stop 2023-10-09T15:40:25.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.338+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 msgr2=0x7f32ec0cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.340 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.338+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00ea50 tx=0x7f32dc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 shutdown_connections 2023-10-09T15:40:25.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f32cc067320 0x7f32cc0697d0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f32ec159530 0x7f32ec0cf7e0 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f32ec06dc70 0x7f32ec156380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.341 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 --2- 172.21.15.33:0/689451293 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f32ec06e0e0 0x7f32ec0ca3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.342 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.339+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 >> 172.21.15.33:0/689451293 conn(0x7f32ec0703a0 msgr2=0x7f32ec0b05e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:25.343 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.342+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 shutdown_connections 2023-10-09T15:40:25.345 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.344+0000 7f32f0ccc700 1 -- 172.21.15.33:0/689451293 wait complete. 2023-10-09T15:40:25.350 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' created 2023-10-09T15:40:25.367 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-10-09T15:40:25.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.493+0000 7f01c3f13700 1 Processor -- start 2023-10-09T15:40:25.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c3f13700 1 -- start start 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c3f13700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f01bc06dc70 0x7f01bc159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c3f13700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc0ccfd0 con 0x7f01bc06e0e0 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c3f13700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01bc15a3d0 con 0x7f01bc159530 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c3f13700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01bc15a6b0 con 0x7f01bc06dc70 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.494+0000 7f01c24b0700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f01bc06e0e0 0x7f01bc0cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53912/0 (socket says 172.21.15.33:53912) 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c24b0700 1 -- 172.21.15.33:0/2823284430 learned_addr learned my addr 172.21.15.33:0/2823284430 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:25.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c14ae700 1 --2- 172.21.15.33:0/2823284430 >> v2:172.21.15.59:3300/0 conn(0x7f01bc06dc70 0x7f01bc159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70600878 0 0) 0x7f01bc0ccfd0 con 0x7f01bc06e0e0 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01a4003570 con 0x7f01bc06e0e0 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 847840655 0 0) 0x7f01bc15a3d0 con 0x7f01bc159530 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f01bc0ccfd0 con 0x7f01bc159530 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c14ae700 1 -- 172.21.15.33:0/2823284430 >> v1:172.21.15.59:6789/0 conn(0x7f01bc159530 legacy=0x7f01bc0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c14ae700 1 -- 172.21.15.33:0/2823284430 >> v1:172.21.15.33:6789/0 conn(0x7f01bc06e0e0 legacy=0x7f01bc0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c14ae700 1 -- 172.21.15.33:0/2823284430 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01bc15a990 con 0x7f01bc06dc70 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c14ae700 1 --2- 172.21.15.33:0/2823284430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc06dc70 0x7f01bc159900 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01b00098e0 tx=0x7f01b00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dcaaca7aaefeeb65 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011630 con 0x7f01bc06dc70 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b0011790 con 0x7f01bc06dc70 2023-10-09T15:40:25.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.495+0000 7f01c0cad700 1 -- 172.21.15.33:0/2823284430 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b0011b30 con 0x7f01bc06dc70 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 -- 172.21.15.33:0/2823284430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc06dc70 msgr2=0x7f01bc159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 --2- 172.21.15.33:0/2823284430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc06dc70 0x7f01bc159900 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f01b00098e0 tx=0x7f01b00091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 -- 172.21.15.33:0/2823284430 shutdown_connections 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 --2- 172.21.15.33:0/2823284430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc06dc70 0x7f01bc159900 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 -- 172.21.15.33:0/2823284430 >> 172.21.15.33:0/2823284430 conn(0x7f01bc0703a0 msgr2=0x7f01bc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 -- 172.21.15.33:0/2823284430 shutdown_connections 2023-10-09T15:40:25.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.496+0000 7f01c3f13700 1 -- 172.21.15.33:0/2823284430 wait complete. 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.497+0000 7f01c3f13700 1 Processor -- start 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.497+0000 7f01c3f13700 1 -- start start 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc06e0e0 0x7f01bc0b0ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc159530 0x7f01bc0b5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0b4480 con 0x7f01bc06dc70 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc14dea0 con 0x7f01bc159530 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c3f13700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01bc0b3ec0 con 0x7f01bc06e0e0 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:25.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33502/0 (socket says 172.21.15.33:33502) 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 -- 172.21.15.33:0/1814062775 learned_addr learned my addr 172.21.15.33:0/1814062775 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c14ae700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc06e0e0 0x7f01bc0b0ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c24b0700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc159530 0x7f01bc0b5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 -- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc06e0e0 msgr2=0x7f01bc0b0ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc06e0e0 0x7f01bc0b0ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 -- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc159530 msgr2=0x7f01bc0b5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc159530 0x7f01bc0b5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 -- 172.21.15.33:0/1814062775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b0009420 con 0x7f01bc06dc70 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01c1caf700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f01b400c7c0 tx=0x7f01b4007e10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.498+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4010510 con 0x7f01bc06dc70 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.499+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01b4010670 con 0x7f01bc06dc70 2023-10-09T15:40:25.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.499+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01bc0b41a0 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.499+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01b4010a10 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.499+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01bc1525e0 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.500+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01bc04c3c0 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.500+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f01b401b3b0 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.501+0000 7f01b9ffb700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 0x7f01a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.501+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(198..198 src has 1..198) v4 ==== 5605+0+0 (secure 0 0 0) 0x7f01b4084440 con 0x7f01bc06dc70 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.501+0000 7f01c14ae700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 0x7f01a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:25.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.501+0000 7f01c14ae700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 0x7f01a80697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f01b00093f0 tx=0x7f01b0017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:25.506 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.505+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f01b4051130 con 0x7f01bc06dc70 2023-10-09T15:40:25.745 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:25.744+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f01bc15ac70 con 0x7f01bc06dc70 2023-10-09T15:40:26.349 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.348+0000 7f01b9ffb700 1 -- 172.21.15.33:0/1814062775 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 33 and data pool 34 v130) v1 ==== 174+0+0 (secure 0 0 0) 0x7f01b4054750 con 0x7f01bc06dc70 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.352+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 msgr2=0x7f01a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.352+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 0x7f01a80697d0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f01b00093f0 tx=0x7f01b0017000 comp rx=0 tx=0).stop 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.352+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 msgr2=0x7f01bc14d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.352+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f01b400c7c0 tx=0x7f01b4007e10 comp rx=0 tx=0).stop 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 shutdown_connections 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f01a8067320 0x7f01a80697d0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.354 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f01bc06dc70 0x7f01bc14d960 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f01bc159530 0x7f01bc0b5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 --2- 172.21.15.33:0/1814062775 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f01bc06e0e0 0x7f01bc0b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 >> 172.21.15.33:0/1814062775 conn(0x7f01bc0703a0 msgr2=0x7f01bc0cd360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 shutdown_connections 2023-10-09T15:40:26.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.353+0000 7f01c3f13700 1 -- 172.21.15.33:0/1814062775 wait complete. 2023-10-09T15:40:26.356 INFO:teuthology.orchestra.run.smithi033.stderr:new fs with metadata pool 33 and data pool 34 2023-10-09T15:40:26.372 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:26.495 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.494+0000 7f0577f5b700 1 Processor -- start 2023-10-09T15:40:26.496 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.495+0000 7f0577f5b700 1 -- start start 2023-10-09T15:40:26.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.495+0000 7f0577f5b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f05700a8d00 0x7f05700cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0577f5b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 0x7f057006de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0577f5b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05700aeee0 con 0x7f057006e380 2023-10-09T15:40:26.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0577f5b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f057006e820 con 0x7f05700a8d00 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0577f5b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05700ae680 con 0x7f05700a90d0 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f05700a8d00 0x7f05700cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f05700a8d00 0x7f05700cddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33508/0 (socket says 172.21.15.33:33508) 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 -- 172.21.15.33:0/576894711 learned_addr learned my addr 172.21.15.33:0/576894711 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f05754f6700 1 --2- 172.21.15.33:0/576894711 >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 0x7f057006de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 -- 172.21.15.33:0/576894711 >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 msgr2=0x7f057006de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 --2- 172.21.15.33:0/576894711 >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 0x7f057006de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 -- 172.21.15.33:0/576894711 >> v1:172.21.15.59:6789/0 conn(0x7f057006e380 legacy=0x7f05700cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 -- 172.21.15.33:0/576894711 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05700cf490 con 0x7f05700a8d00 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f05754f6700 1 --2- 172.21.15.33:0/576894711 >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 0x7f057006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:26.499 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0575cf7700 1 --2- 172.21.15.33:0/576894711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05700a8d00 0x7f05700cddf0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f0568009990 tx=0x7f0568009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8861f6a48d89d07d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0574cf5700 1 -- 172.21.15.33:0/576894711 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568005c10 con 0x7f05700a8d00 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0574cf5700 1 -- 172.21.15.33:0/576894711 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568005d70 con 0x7f05700a8d00 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.496+0000 7f0574cf5700 1 -- 172.21.15.33:0/576894711 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056800b840 con 0x7f05700a8d00 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 -- 172.21.15.33:0/576894711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05700a8d00 msgr2=0x7f05700cddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 --2- 172.21.15.33:0/576894711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05700a8d00 0x7f05700cddf0 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f0568009990 tx=0x7f0568009220 comp rx=0 tx=0).stop 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 -- 172.21.15.33:0/576894711 shutdown_connections 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 --2- 172.21.15.33:0/576894711 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f05700a8d00 0x7f05700cddf0 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 --2- 172.21.15.33:0/576894711 >> v2:172.21.15.59:3300/0 conn(0x7f05700a90d0 0x7f057006de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 -- 172.21.15.33:0/576894711 >> 172.21.15.33:0/576894711 conn(0x7f057006ce80 msgr2=0x7f05700ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 -- 172.21.15.33:0/576894711 shutdown_connections 2023-10-09T15:40:26.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.497+0000 7f0577f5b700 1 -- 172.21.15.33:0/576894711 wait complete. 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.498+0000 7f0577f5b700 1 Processor -- start 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.498+0000 7f0577f5b700 1 -- start start 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05700a8d00 0x7f057015c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05700a90d0 0x7f057009b750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.503 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057009c110 con 0x7f057006e380 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f057015f4a0 con 0x7f05700a90d0 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0577f5b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f057015eb70 con 0x7f05700a8d00 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33512/0 (socket says 172.21.15.33:33512) 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 -- 172.21.15.33:0/559544749 learned_addr learned my addr 172.21.15.33:0/559544749 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f05764f8700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05700a90d0 0x7f057009b750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f05754f6700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05700a8d00 0x7f057015c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 -- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05700a8d00 msgr2=0x7f057015c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05700a8d00 0x7f057015c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 -- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05700a90d0 msgr2=0x7f057009b750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05700a90d0 0x7f057009b750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.504 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 -- 172.21.15.33:0/559544749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0568009480 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.499+0000 7f0575cf7700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0568009260 tx=0x7f0568016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.500+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0568011a60 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.500+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0568011c00 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.500+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f057015ee50 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.500+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f056801b430 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.500+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0570169e90 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.501+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f057004c3c0 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.501+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f056801b7a0 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.502+0000 7f056dffb700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 0x7f055c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.502+0000 7f05754f6700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 0x7f055c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.502+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f0568086520 con 0x7f057006e380 2023-10-09T15:40:26.505 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.502+0000 7f05754f6700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 0x7f055c0697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0564006ea0 tx=0x7f0564008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.507 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.506+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f0568053170 con 0x7f057006e380 2023-10-09T15:40:26.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.701+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0570067b20 con 0x7f057006e380 2023-10-09T15:40:26.703 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.702+0000 7f056dffb700 1 -- 172.21.15.33:0/559544749 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f0568056790 con 0x7f057006e380 2023-10-09T15:40:26.703 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:26.703 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":199,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:25.746288+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:26.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 msgr2=0x7f055c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 0x7f055c0697d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f0564006ea0 tx=0x7f0564008040 comp rx=0 tx=0).stop 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 msgr2=0x7f0570169950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 secure :-1 s=READY pgs=1747 cs=0 l=1 rev1=1 crypto rx=0x7f0568009260 tx=0x7f0568016000 comp rx=0 tx=0).stop 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 shutdown_connections 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f055c067320 0x7f055c0697d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f057006e380 0x7f0570169950 unknown :-1 s=CLOSED pgs=1747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f05700a90d0 0x7f057009b750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 --2- 172.21.15.33:0/559544749 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f05700a8d00 0x7f057015c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 >> 172.21.15.33:0/559544749 conn(0x7f057006ce80 msgr2=0x7f05700b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:26.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 shutdown_connections 2023-10-09T15:40:26.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.704+0000 7f0577f5b700 1 -- 172.21.15.33:0/559544749 wait complete. 2023-10-09T15:40:26.718 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:26.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.835+0000 7f136c9e1700 1 Processor -- start 2023-10-09T15:40:26.836 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.835+0000 7f136c9e1700 1 -- start start 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136c9e1700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f13680cb5a0 0x7f13680cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136c9e1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 0x7f1368156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136c9e1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f136815ae40 con 0x7f13680cd9e0 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136c9e1700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13680d13f0 con 0x7f13680cb5a0 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136c9e1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f136815ab60 con 0x7f136815a5d0 2023-10-09T15:40:26.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f13680cb5a0 0x7f13680cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136659c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f13680cb5a0 0x7f13680cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33514/0 (socket says 172.21.15.33:33514) 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.836+0000 7f136659c700 1 -- 172.21.15.33:0/1984099644 learned_addr learned my addr 172.21.15.33:0/1984099644 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f1366d9d700 1 --2- 172.21.15.33:0/1984099644 >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 0x7f1368156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136659c700 1 -- 172.21.15.33:0/1984099644 >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 msgr2=0x7f1368156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136659c700 1 --2- 172.21.15.33:0/1984099644 >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 0x7f1368156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136659c700 1 -- 172.21.15.33:0/1984099644 >> v1:172.21.15.59:6789/0 conn(0x7f13680cd9e0 legacy=0x7f1368159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136659c700 1 -- 172.21.15.33:0/1984099644 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13680ccf00 con 0x7f13680cb5a0 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f1366d9d700 1 --2- 172.21.15.33:0/1984099644 >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 0x7f1368156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136659c700 1 --2- 172.21.15.33:0/1984099644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f13680cb970 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f1360009f20 tx=0x7f1360009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82aa6104f4e7aa5f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136559a700 1 -- 172.21.15.33:0/1984099644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136000e070 con 0x7f13680cb5a0 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136559a700 1 -- 172.21.15.33:0/1984099644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136000ba00 con 0x7f13680cb5a0 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136559a700 1 -- 172.21.15.33:0/1984099644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600092e0 con 0x7f13680cb5a0 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136c9e1700 1 -- 172.21.15.33:0/1984099644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 msgr2=0x7f13680cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.837+0000 7f136c9e1700 1 --2- 172.21.15.33:0/1984099644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f13680cb970 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f1360009f20 tx=0x7f1360009840 comp rx=0 tx=0).stop 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 -- 172.21.15.33:0/1984099644 shutdown_connections 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 --2- 172.21.15.33:0/1984099644 >> v2:172.21.15.59:3300/0 conn(0x7f136815a5d0 0x7f1368156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 --2- 172.21.15.33:0/1984099644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f13680cb970 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 -- 172.21.15.33:0/1984099644 >> 172.21.15.33:0/1984099644 conn(0x7f1368070e30 msgr2=0x7f13680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 -- 172.21.15.33:0/1984099644 shutdown_connections 2023-10-09T15:40:26.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.838+0000 7f136c9e1700 1 -- 172.21.15.33:0/1984099644 wait complete. 2023-10-09T15:40:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 Processor -- start 2023-10-09T15:40:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 -- start start 2023-10-09T15:40:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13680cd9e0 0x7f13680ca170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f136815a5d0 0x7f13680c84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c9d70 con 0x7f13680cb5a0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1368157c00 con 0x7f13680cd9e0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.839+0000 7f136c9e1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13680c9720 con 0x7f136815a5d0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33530/0 (socket says 172.21.15.33:33530) 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 -- 172.21.15.33:0/2562369361 learned_addr learned my addr 172.21.15.33:0/2562369361 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f1365d9b700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13680cd9e0 0x7f13680ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f1366d9d700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f136815a5d0 0x7f13680c84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 -- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f136815a5d0 msgr2=0x7f13680c84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f136815a5d0 0x7f13680c84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 -- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13680cd9e0 msgr2=0x7f13680ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13680cd9e0 0x7f13680ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 -- 172.21.15.33:0/2562369361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1360009ae0 con 0x7f13680cb5a0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136659c700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f136806ea60 tx=0x7f1360017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13600129a0 con 0x7f13680cb5a0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1360012b00 con 0x7f13680cb5a0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13680c9a00 con 0x7f13680cb5a0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136001d420 con 0x7f13680cb5a0 2023-10-09T15:40:26.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.840+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13680af990 con 0x7f13680cb5a0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.841+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13680b3b80 con 0x7f13680cb5a0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.842+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f136001d850 con 0x7f13680cb5a0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.842+0000 7f135e7fc700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 0x7f13480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.842+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1360086400 con 0x7f13680cb5a0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.842+0000 7f1365d9b700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 0x7f13480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.842+0000 7f1365d9b700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 0x7f13480697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f136815ef10 tx=0x7f1350007ea0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:26.847 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:26.846+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1360052f80 con 0x7f13680cb5a0 2023-10-09T15:40:27.040 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.039+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f136804c3c0 con 0x7f13680cb5a0 2023-10-09T15:40:27.041 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.040+0000 7f135e7fc700 1 -- 172.21.15.33:0/2562369361 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v199) v1 ==== 74+0+15329 (secure 0 0 0) 0x7f13600565a0 con 0x7f13680cb5a0 2023-10-09T15:40:27.042 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:27.042 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":199,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:25.746288+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 msgr2=0x7f13480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 0x7f13480697d0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f136815ef10 tx=0x7f1350007ea0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 msgr2=0x7f1368157620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f136806ea60 tx=0x7f1360017000 comp rx=0 tx=0).stop 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 shutdown_connections 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1348067320 0x7f13480697d0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f13680cb5a0 0x7f1368157620 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f136815a5d0 0x7f13680c84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 --2- 172.21.15.33:0/2562369361 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f13680cd9e0 0x7f13680ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 >> 172.21.15.33:0/2562369361 conn(0x7f1368070e30 msgr2=0x7f13680b2790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 shutdown_connections 2023-10-09T15:40:27.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.042+0000 7f136c9e1700 1 -- 172.21.15.33:0/2562369361 wait complete. 2023-10-09T15:40:27.056 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-10-09T15:40:27.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.177+0000 7f1e33abf700 1 Processor -- start 2023-10-09T15:40:27.178 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.177+0000 7f1e33abf700 1 -- start start 2023-10-09T15:40:27.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.177+0000 7f1e33abf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e33abf700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e2c06dc70 0x7f1e2c159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e33abf700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e2c0ccfd0 con 0x7f1e2c06e0e0 2023-10-09T15:40:27.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e33abf700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e2c0cf0e0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.180 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e33abf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c15a3d0 con 0x7f1e2c159530 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e2c06dc70 0x7f1e2c159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1e2c06dc70 0x7f1e2c159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33546/0 (socket says 172.21.15.33:33546) 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 -- 172.21.15.33:0/981125154 learned_addr learned my addr 172.21.15.33:0/981125154 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3185b700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 -- 172.21.15.33:0/981125154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 msgr2=0x7f1e2c0ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c0ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 -- 172.21.15.33:0/981125154 >> v1:172.21.15.59:6789/0 conn(0x7f1e2c06e0e0 legacy=0x7f1e2c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 -- 172.21.15.33:0/981125154 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e2c15a6b0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3185b700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e3105a700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c159900 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099b0 tx=0x7f1e20009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f8e4d26509f5f6d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:27.181 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e30859700 1 -- 172.21.15.33:0/981125154 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000b820 con 0x7f1e2c06dc70 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e30859700 1 -- 172.21.15.33:0/981125154 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e2000b980 con 0x7f1e2c06dc70 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.178+0000 7f1e30859700 1 -- 172.21.15.33:0/981125154 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000bd20 con 0x7f1e2c06dc70 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 -- 172.21.15.33:0/981125154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 msgr2=0x7f1e2c159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c159900 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099b0 tx=0x7f1e20009250 comp rx=0 tx=0).stop 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 -- 172.21.15.33:0/981125154 shutdown_connections 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c0ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 --2- 172.21.15.33:0/981125154 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c159900 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 -- 172.21.15.33:0/981125154 >> 172.21.15.33:0/981125154 conn(0x7f1e2c0703a0 msgr2=0x7f1e2c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 -- 172.21.15.33:0/981125154 shutdown_connections 2023-10-09T15:40:27.182 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.179+0000 7f1e33abf700 1 -- 172.21.15.33:0/981125154 wait complete. 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.180+0000 7f1e33abf700 1 Processor -- start 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.180+0000 7f1e33abf700 1 -- start start 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e2c06e0e0 0x7f1e2c167190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c157440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c16ad30 con 0x7f1e2c06dc70 2023-10-09T15:40:27.185 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c1557b0 con 0x7f1e2c06e0e0 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e33abf700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e2c155a90 con 0x7f1e2c159530 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33548/0 (socket says 172.21.15.33:33548) 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 -- 172.21.15.33:0/3555300197 learned_addr learned my addr 172.21.15.33:0/3555300197 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3205c700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c157440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 -- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 msgr2=0x7f1e2c157440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3105a700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e2c06e0e0 0x7f1e2c167190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c157440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 -- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e2c06e0e0 msgr2=0x7f1e2c167190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e2c06e0e0 0x7f1e2c167190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 -- 172.21.15.33:0/3555300197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e200094f0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.186 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.181+0000 7f1e3185b700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c850 tx=0x7f1e24008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.182+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24011600 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.182+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e24011760 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.182+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e2c155d70 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.182+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e24011b00 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.182+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e2c156330 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.183+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e2c04c3c0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.183+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1e240073b0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.184+0000 7f1e29ffb700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 0x7f1e180697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.184+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(199..199 src has 1..199) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f1e24084d60 con 0x7f1e2c06dc70 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.184+0000 7f1e3105a700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 0x7f1e180697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:27.187 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.184+0000 7f1e3105a700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 0x7f1e180697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099b0 tx=0x7f1e20016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:27.189 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.188+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1e240518e0 con 0x7f1e2c06dc70 2023-10-09T15:40:27.437 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:27.436+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f1e2c15a990 con 0x7f1e2c06dc70 2023-10-09T15:40:28.080 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-10-09T15:40:28.370 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.369+0000 7f1e29ffb700 1 -- 172.21.15.33:0/3555300197 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v133) v1 ==== 118+0+0 (secure 0 0 0) 0x7f1e2401e0b0 con 0x7f1e2c06dc70 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.371+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 msgr2=0x7f1e180697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.371+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 0x7f1e180697d0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f1e200099b0 tx=0x7f1e20016000 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.371+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 msgr2=0x7f1e2c16a7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.371+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f1e2400c850 tx=0x7f1e24008040 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 shutdown_connections 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1e18067320 0x7f1e180697d0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1e2c06dc70 0x7f1e2c16a7f0 unknown :-1 s=CLOSED pgs=1751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1e2c159530 0x7f1e2c157440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 --2- 172.21.15.33:0/3555300197 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1e2c06e0e0 0x7f1e2c167190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.373 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 >> 172.21.15.33:0/3555300197 conn(0x7f1e2c0703a0 msgr2=0x7f1e2c0cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:28.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 shutdown_connections 2023-10-09T15:40:28.374 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.372+0000 7f1e33abf700 1 -- 172.21.15.33:0/3555300197 wait complete. 2023-10-09T15:40:28.388 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-10-09T15:40:28.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.516+0000 7f9810c81700 1 Processor -- start 2023-10-09T15:40:28.517 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.516+0000 7f9810c81700 1 -- start start 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9810c81700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f980c0cc320 0x7f980c13c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9810c81700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f980c0cc6f0 0x7f980c13c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9810c81700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f980c06d7b0 con 0x7f980c069a00 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9810c81700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c06a570 con 0x7f980c0cc6f0 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9810c81700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980c06f7d0 con 0x7f980c0cc320 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f980c0cc6f0 0x7f980c13c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f980c0cc6f0 0x7f980c13c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33552/0 (socket says 172.21.15.33:33552) 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 -- 172.21.15.33:0/1516525986 learned_addr learned my addr 172.21.15.33:0/1516525986 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 -- 172.21.15.33:0/1516525986 >> v2:172.21.15.59:3300/0 conn(0x7f980c0cc320 msgr2=0x7f980c13c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 --2- 172.21.15.33:0/1516525986 >> v2:172.21.15.59:3300/0 conn(0x7f980c0cc320 0x7f980c13c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.519 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 -- 172.21.15.33:0/1516525986 >> v1:172.21.15.59:6789/0 conn(0x7f980c069a00 legacy=0x7f980c069e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.517+0000 7f9809d9b700 1 -- 172.21.15.33:0/1516525986 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f980c06e330 con 0x7f980c0cc6f0 2023-10-09T15:40:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9809d9b700 1 --2- 172.21.15.33:0/1516525986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c13c7e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f980c0cf510 tx=0x7f9800009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a9818dde4b323e1 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f980959a700 1 -- 172.21.15.33:0/1516525986 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000b7e0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f980959a700 1 -- 172.21.15.33:0/1516525986 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000b940 con 0x7f980c0cc6f0 2023-10-09T15:40:28.520 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f980959a700 1 -- 172.21.15.33:0/1516525986 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000bce0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 -- 172.21.15.33:0/1516525986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 msgr2=0x7f980c13c7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:28.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 --2- 172.21.15.33:0/1516525986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c13c7e0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f980c0cf510 tx=0x7f9800009250 comp rx=0 tx=0).stop 2023-10-09T15:40:28.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 -- 172.21.15.33:0/1516525986 shutdown_connections 2023-10-09T15:40:28.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 --2- 172.21.15.33:0/1516525986 >> v2:172.21.15.59:3300/0 conn(0x7f980c0cc320 0x7f980c13c2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 --2- 172.21.15.33:0/1516525986 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c13c7e0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 -- 172.21.15.33:0/1516525986 >> 172.21.15.33:0/1516525986 conn(0x7f980c067f00 msgr2=0x7f980c068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 -- 172.21.15.33:0/1516525986 shutdown_connections 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.518+0000 7f9810c81700 1 -- 172.21.15.33:0/1516525986 wait complete. 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.519+0000 7f9810c81700 1 Processor -- start 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.519+0000 7f9810c81700 1 -- start start 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f980c069a00 0x7f980c13b650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f980c0cc320 0x7f980c0c46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c16ab40 con 0x7f980c0cc6f0 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f980c13a660 con 0x7f980c0cc320 2023-10-09T15:40:28.523 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f9810c81700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980c153700 con 0x7f980c069a00 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f980ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f980ad9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33562/0 (socket says 172.21.15.33:33562) 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.520+0000 7f980ad9d700 1 -- 172.21.15.33:0/3982473 learned_addr learned my addr 172.21.15.33:0/3982473 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f9809d9b700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f980c0cc320 0x7f980c0c46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 -- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f980c069a00 msgr2=0x7f980c13b650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f980c069a00 0x7f980c13b650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 -- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f980c0cc320 msgr2=0x7f980c0c46c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f980c0cc320 0x7f980c0c46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 -- 172.21.15.33:0/3982473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000094f0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f980ad9d700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00b5e0 tx=0x7f97fc009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:28.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00f510 con 0x7f980c0cc6f0 2023-10-09T15:40:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00f690 con 0x7f980c0cc6f0 2023-10-09T15:40:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f980c13b1c0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97fc00fa50 con 0x7f980c0cc6f0 2023-10-09T15:40:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.521+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980c13a890 con 0x7f980c0cc6f0 2023-10-09T15:40:28.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.522+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f980c04c3c0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.522+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f97fc01a400 con 0x7f980c0cc6f0 2023-10-09T15:40:28.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.523+0000 7f97fa7fc700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:28.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.523+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f97fc0846b0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.523+0000 7f980a59c700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:28.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.523+0000 7f980a59c700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 0x7f97ec0697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f980c0c5250 tx=0x7f9804009370 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:28.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.527+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f97fc0513c0 con 0x7f980c0cc6f0 2023-10-09T15:40:28.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:28.766+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f980c13b350 con 0x7f980c0cc6f0 2023-10-09T15:40:29.380 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.379+0000 7f97fa7fc700 1 -- 172.21.15.33:0/3982473 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v134) v1 ==== 122+0+0 (secure 0 0 0) 0x7f97fc0549e0 con 0x7f980c0cc6f0 2023-10-09T15:40:29.382 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 msgr2=0x7f97ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 0x7f97ec0697d0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f980c0c5250 tx=0x7f9804009370 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 msgr2=0x7f980c0c4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f97fc00b5e0 tx=0x7f97fc009120 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 shutdown_connections 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f97ec067320 0x7f97ec0697d0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f980c0cc6f0 0x7f980c0c4c00 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f980c069a00 0x7f980c13b650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 --2- 172.21.15.33:0/3982473 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f980c0cc320 0x7f980c0c46c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 >> 172.21.15.33:0/3982473 conn(0x7f980c067f00 msgr2=0x7f980c0b2570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:29.383 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 shutdown_connections 2023-10-09T15:40:29.384 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.381+0000 7f9810c81700 1 -- 172.21.15.33:0/3982473 wait complete. 2023-10-09T15:40:29.396 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 Processor -- start 2023-10-09T15:40:29.522 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 -- start start 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 0x7ff4bc159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff4bc15a400 0x7ff4bc156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4bc15ae40 con 0x7ff4bc0cb5a0 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0ce0f0 con 0x7ff4bc15a400 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.521+0000 7ff4c133f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4bc0d13f0 con 0x7ff4bc0cb970 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff4bc15a400 0x7ff4bc156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff4bc15a400 0x7ff4bc156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33568/0 (socket says 172.21.15.33:33568) 2023-10-09T15:40:29.524 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/3731081563 learned_addr learned my addr 172.21.15.33:0/3731081563 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4ba7fc700 1 --2- 172.21.15.33:0/3731081563 >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 0x7ff4bc159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/3731081563 >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 msgr2=0x7ff4bc159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 --2- 172.21.15.33:0/3731081563 >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 0x7ff4bc159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/3731081563 >> v1:172.21.15.59:6789/0 conn(0x7ff4bc0cb5a0 legacy=0x7ff4bc0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/3731081563 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4bc15ab60 con 0x7ff4bc15a400 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4ba7fc700 1 --2- 172.21.15.33:0/3731081563 >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 0x7ff4bc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4bb7fe700 1 --2- 172.21.15.33:0/3731081563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc156e90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0d1780 tx=0x7ff4b4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e50c4b4000133d95 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4b9ffb700 1 -- 172.21.15.33:0/3731081563 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400b860 con 0x7ff4bc15a400 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4b9ffb700 1 -- 172.21.15.33:0/3731081563 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b400b9c0 con 0x7ff4bc15a400 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.522+0000 7ff4b9ffb700 1 -- 172.21.15.33:0/3731081563 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b400bd60 con 0x7ff4bc15a400 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 -- 172.21.15.33:0/3731081563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 msgr2=0x7ff4bc156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.525 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 --2- 172.21.15.33:0/3731081563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc156e90 secure :-1 s=READY pgs=1754 cs=0 l=1 rev1=1 crypto rx=0x7ff4bc0d1780 tx=0x7ff4b4009250 comp rx=0 tx=0).stop 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 -- 172.21.15.33:0/3731081563 shutdown_connections 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 --2- 172.21.15.33:0/3731081563 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc156e90 unknown :-1 s=CLOSED pgs=1754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 --2- 172.21.15.33:0/3731081563 >> v2:172.21.15.59:3300/0 conn(0x7ff4bc0cb970 0x7ff4bc159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 -- 172.21.15.33:0/3731081563 >> 172.21.15.33:0/3731081563 conn(0x7ff4bc070e30 msgr2=0x7ff4bc0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 -- 172.21.15.33:0/3731081563 shutdown_connections 2023-10-09T15:40:29.526 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.523+0000 7ff4c133f700 1 -- 172.21.15.33:0/3731081563 wait complete. 2023-10-09T15:40:29.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.524+0000 7ff4c133f700 1 Processor -- start 2023-10-09T15:40:29.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.524+0000 7ff4c133f700 1 -- start start 2023-10-09T15:40:29.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 0x7ff4bc0b3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.528 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 0x7ff4bc0b08e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc0b3c20 con 0x7ff4bc15a400 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc158880 con 0x7ff4bc0cb970 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4c133f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4bc158b60 con 0x7ff4bc0cb5a0 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33570/0 (socket says 172.21.15.33:33570) 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/2700086838 learned_addr learned my addr 172.21.15.33:0/2700086838 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4ba7fc700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 0x7ff4bc0b08e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4baffd700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 0x7ff4bc0b3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 msgr2=0x7ff4bc0b3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 0x7ff4bc0b3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.529 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 msgr2=0x7ff4bc0b08e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 0x7ff4bc0b08e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 -- 172.21.15.33:0/2700086838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4b40094f0 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4ba7fc700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 0x7ff4bc0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4baffd700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 0x7ff4bc0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4bb7fe700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006f50 tx=0x7ff4b4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.525+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b401a710 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.526+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4b401f070 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.526+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4bc158e40 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.526+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4b401aaa0 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.526+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4bc0b3660 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.527+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4bc04c3c0 con 0x7ff4bc15a400 2023-10-09T15:40:29.530 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.527+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff4b401b430 con 0x7ff4bc15a400 2023-10-09T15:40:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.527+0000 7ff4a2ffd700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 0x7ff4a80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.527+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7ff4b4021070 con 0x7ff4bc15a400 2023-10-09T15:40:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.527+0000 7ff4baffd700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 0x7ff4a80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.531 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.528+0000 7ff4baffd700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 0x7ff4a80697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac007fd0 tx=0x7ff4ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.533 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.532+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff4b4053b30 con 0x7ff4bc15a400 2023-10-09T15:40:29.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.769+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff4bc0ccf00 con 0x7ff4bc15a400 2023-10-09T15:40:29.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.769+0000 7ff4a2ffd700 1 -- 172.21.15.33:0/2700086838 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4607 (secure 0 0 0) 0x7ff4b4015090 con 0x7ff4bc15a400 2023-10-09T15:40:29.770 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:29.770 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":134,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 msgr2=0x7ff4a80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 0x7ff4a80697d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7ff4ac007fd0 tx=0x7ff4ac009040 comp rx=0 tx=0).stop 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 msgr2=0x7ff4bc0b0e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7ff4b4006f50 tx=0x7ff4b4017000 comp rx=0 tx=0).stop 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 shutdown_connections 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff4a8067320 0x7ff4a80697d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff4bc15a400 0x7ff4bc0b0e20 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff4bc0cb5a0 0x7ff4bc0b3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 --2- 172.21.15.33:0/2700086838 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff4bc0cb970 0x7ff4bc0b08e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.771+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 >> 172.21.15.33:0/2700086838 conn(0x7ff4bc070e30 msgr2=0x7ff4bc0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.772+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 shutdown_connections 2023-10-09T15:40:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.772+0000 7ff4c133f700 1 -- 172.21.15.33:0/2700086838 wait complete. 2023-10-09T15:40:29.774 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 134 2023-10-09T15:40:29.785 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:40:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.903+0000 7f92dc925700 1 Processor -- start 2023-10-09T15:40:29.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.903+0000 7f92dc925700 1 -- start start 2023-10-09T15:40:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92dc925700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92d8159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92dc925700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d815ae40 con 0x7f92d80cb5a0 2023-10-09T15:40:29.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92dc925700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92d815ab60 con 0x7f92d815a400 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92dc925700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80ce0f0 con 0x7f92d80cb970 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92d659c700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f92d80cb5a0 0x7f92d80cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:53918/0 (socket says 172.21.15.33:53918) 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92d659c700 1 -- 172.21.15.33:0/1469193209 learned_addr learned my addr 172.21.15.33:0/1469193209 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3077587265 0 0) 0x7f92d815ae40 con 0x7f92d80cb5a0 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92d5d9b700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92d8159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.904+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f92c4003570 con 0x7f92d80cb5a0 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2837534897 0 0) 0x7f92c4003570 con 0x7f92d80cb5a0 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 msgr2=0x7f92d8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92d8159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 >> v1:172.21.15.59:6789/0 conn(0x7f92d815a400 legacy=0x7f92d8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80ccf00 con 0x7f92d80cb5a0 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f92d0001470 con 0x7f92d80cb5a0 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 >> v1:172.21.15.33:6789/0 conn(0x7f92d80cb5a0 legacy=0x7f92d80cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4003a90 0x7f92c4003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92c4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92c40051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80ce0f0 con 0x7f92c4004d50 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c400bba0 con 0x7f92c4003a90 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c400bd60 con 0x7f92d80cb970 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92c40051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d659c700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4003a90 0x7f92c4003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d5d9b700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92c4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 -- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 msgr2=0x7f92c4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d80cb970 0x7f92c4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 -- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4003a90 msgr2=0x7f92c4003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92c4003a90 0x7f92c4003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 -- 172.21.15.33:0/1469193209 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c4003570 con 0x7f92c4004d50 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.905+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92c40051c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f92c8001fc0 tx=0x7f92c8001640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c488c26ccb0912f2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c8001950 con 0x7f92c4004d50 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c800c8b0 con 0x7f92c4004d50 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92d559a700 1 -- 172.21.15.33:0/1469193209 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c800cc50 con 0x7f92c4004d50 2023-10-09T15:40:29.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 -- 172.21.15.33:0/1469193209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 msgr2=0x7f92c40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 --2- 172.21.15.33:0/1469193209 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92c40051c0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f92c8001fc0 tx=0x7f92c8001640 comp rx=0 tx=0).stop 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92d6d9d700 1 -- 172.21.15.33:0/1469193209 reap_dead start 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 -- 172.21.15.33:0/1469193209 shutdown_connections 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 -- 172.21.15.33:0/1469193209 >> 172.21.15.33:0/1469193209 conn(0x7f92d8070e30 msgr2=0x7f92d80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 -- 172.21.15.33:0/1469193209 shutdown_connections 2023-10-09T15:40:29.911 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.906+0000 7f92dc925700 1 -- 172.21.15.33:0/1469193209 wait complete. 2023-10-09T15:40:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.907+0000 7f92dc925700 1 Processor -- start 2023-10-09T15:40:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.907+0000 7f92dc925700 1 -- start start 2023-10-09T15:40:29.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d80b5e40 0x7f92d8159aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 0x7f92d815d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80cbde0 con 0x7f92c4004d50 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b4de0 con 0x7f92d80b5e40 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92dc925700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92d80b5080 con 0x7f92d8159fe0 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33584/0 (socket says 172.21.15.33:33584) 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 -- 172.21.15.33:0/3836230057 learned_addr learned my addr 172.21.15.33:0/3836230057 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d5d9b700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d80b5e40 0x7f92d8159aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 0x7f92d815d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 -- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 msgr2=0x7f92d815d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 0x7f92d815d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 -- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d80b5e40 msgr2=0x7f92d8159aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d80b5e40 0x7f92d8159aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d659c700 1 -- 172.21.15.33:0/3836230057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92d80b5360 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.908+0000 7f92d6d9d700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 0x7f92d815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92d659c700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f92d00073c0 tx=0x7f92d0001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d0018030 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92d0000c70 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92d80b5640 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92d000f8f0 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.909+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92d80b46d0 con 0x7f92c4004d50 2023-10-09T15:40:29.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.910+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92d804c3c0 con 0x7f92c4004d50 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.910+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f92d001b070 con 0x7f92c4004d50 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.911+0000 7f92ce7fc700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 0x7f92b80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.911+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f92d0019070 con 0x7f92c4004d50 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.911+0000 7f92d5d9b700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 0x7f92b80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.911+0000 7f92d5d9b700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 0x7f92b80697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f92d80ca7c0 tx=0x7f92c00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:29.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:29.915+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f92d0051590 con 0x7f92c4004d50 2023-10-09T15:40:30.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.108+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f92d80cc2e0 con 0x7f92c4004d50 2023-10-09T15:40:30.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.109+0000 7f92ce7fc700 1 -- 172.21.15.33:0/3836230057 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v200) v1 ==== 74+0+15316 (secure 0 0 0) 0x7f92d0054bb0 con 0x7f92c4004d50 2023-10-09T15:40:30.110 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:30.110 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":200,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:27.296238+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:40:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 msgr2=0x7f92b80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 0x7f92b80697d0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f92d80ca7c0 tx=0x7f92c00091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 msgr2=0x7f92d8153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f92d00073c0 tx=0x7f92d0001e50 comp rx=0 tx=0).stop 2023-10-09T15:40:30.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 shutdown_connections 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f92b8067320 0x7f92b80697d0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92c4004d50 0x7f92d8153130 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92d8159fe0 0x7f92d815d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 --2- 172.21.15.33:0/3836230057 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92d80b5e40 0x7f92d8159aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 >> 172.21.15.33:0/3836230057 conn(0x7f92d8070e30 msgr2=0x7f92d80c6a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 shutdown_connections 2023-10-09T15:40:30.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.111+0000 7f92dc925700 1 -- 172.21.15.33:0/3836230057 wait complete. 2023-10-09T15:40:30.124 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-10-09T15:40:30.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:40:30.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.243+0000 7fc4be69a700 1 Processor -- start 2023-10-09T15:40:30.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.243+0000 7fc4be69a700 1 -- start start 2023-10-09T15:40:30.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4be69a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cb5a0 0x7fc4b80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4be69a700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4b80cde50 0x7fc4b8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4be69a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4b815ae40 con 0x7fc4b80cd9e0 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4be69a700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b80d13f0 con 0x7fc4b80cde50 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4be69a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b815ab60 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4b80cde50 0x7fc4b8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc4b80cde50 0x7fc4b8156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33598/0 (socket says 172.21.15.33:33598) 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 -- 172.21.15.33:0/1298624987 learned_addr learned my addr 172.21.15.33:0/1298624987 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4b7fff700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cb5a0 0x7fc4b80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 -- 172.21.15.33:0/1298624987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cb5a0 msgr2=0x7fc4b80cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cb5a0 0x7fc4b80cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 -- 172.21.15.33:0/1298624987 >> v1:172.21.15.59:6789/0 conn(0x7fc4b80cd9e0 legacy=0x7fc4b8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 -- 172.21.15.33:0/1298624987 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b80ccf00 con 0x7fc4b80cde50 2023-10-09T15:40:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4bcc37700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cde50 0x7fc4b8156e90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009f20 tx=0x7fc4b0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37f18d09c6ff9f93 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4b6ffd700 1 -- 172.21.15.33:0/1298624987 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000e070 con 0x7fc4b80cde50 2023-10-09T15:40:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.244+0000 7fc4b6ffd700 1 -- 172.21.15.33:0/1298624987 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4b000ba80 con 0x7fc4b80cde50 2023-10-09T15:40:30.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4b6ffd700 1 -- 172.21.15.33:0/1298624987 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00092e0 con 0x7fc4b80cde50 2023-10-09T15:40:30.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 -- 172.21.15.33:0/1298624987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cde50 msgr2=0x7fc4b8156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cde50 0x7fc4b8156e90 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0009f20 tx=0x7fc4b0009840 comp rx=0 tx=0).stop 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 -- 172.21.15.33:0/1298624987 shutdown_connections 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cde50 0x7fc4b8156e90 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1298624987 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cb5a0 0x7fc4b80cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 -- 172.21.15.33:0/1298624987 >> 172.21.15.33:0/1298624987 conn(0x7fc4b8070e30 msgr2=0x7fc4b80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 -- 172.21.15.33:0/1298624987 shutdown_connections 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.245+0000 7fc4be69a700 1 -- 172.21.15.33:0/1298624987 wait complete. 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.246+0000 7fc4be69a700 1 Processor -- start 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.246+0000 7fc4be69a700 1 -- start start 2023-10-09T15:40:30.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 0x7fc4b816cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b81562e0 0x7fc4b816d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80ca240 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b815deb0 con 0x7fc4b81562e0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4be69a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b80c9c30 con 0x7fc4b80cd9e0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33614/0 (socket says 172.21.15.33:33614) 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 -- 172.21.15.33:0/1206457910 learned_addr learned my addr 172.21.15.33:0/1206457910 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4bcc37700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b81562e0 0x7fc4b816d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b77fe700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 0x7fc4b816cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 -- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 msgr2=0x7fc4b816cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 0x7fc4b816cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 -- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b81562e0 msgr2=0x7fc4b816d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b81562e0 0x7fc4b816d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b7fff700 1 -- 172.21.15.33:0/1206457910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009ae0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.247+0000 7fc4b77fe700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 0x7fc4b816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc4b7fff700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800d890 tx=0x7fc4a8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800b600 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800b760 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4b80ca6d0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800bae0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.248+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4b80c9ed0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.249+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b80c9aa0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.249+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc4a801e460 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.250+0000 7fc49ffff700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 0x7fc4a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.250+0000 7fc4b77fe700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 0x7fc4a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.250+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc4a8085350 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.250+0000 7fc4b77fe700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 0x7fc4a40697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8156200 tx=0x7fc4ac009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.254+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc4a8051fe0 con 0x7fc4b80cb5a0 2023-10-09T15:40:30.445 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.444+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc4b80ca060 con 0x7fc4a4067320 2023-10-09T15:40:30.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.452+0000 7fc49ffff700 1 -- 172.21.15.33:0/1206457910 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289820 (secure 0 0 0) 0x7fc4b80ca060 con 0x7fc4a4067320 2023-10-09T15:40:30.456 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:30.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 msgr2=0x7fc4a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 0x7fc4a40697d0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8156200 tx=0x7fc4ac009040 comp rx=0 tx=0).stop 2023-10-09T15:40:30.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 msgr2=0x7fc4b815c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 secure :-1 s=READY pgs=1760 cs=0 l=1 rev1=1 crypto rx=0x7fc4a800d890 tx=0x7fc4a8008040 comp rx=0 tx=0).stop 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 shutdown_connections 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc4a4067320 0x7fc4a40697d0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc4b80cb5a0 0x7fc4b815c8d0 unknown :-1 s=CLOSED pgs=1760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc4b81562e0 0x7fc4b816d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 --2- 172.21.15.33:0/1206457910 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc4b80cd9e0 0x7fc4b816cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 >> 172.21.15.33:0/1206457910 conn(0x7fc4b8070e30 msgr2=0x7fc4b80b1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 shutdown_connections 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.455+0000 7fc4be69a700 1 -- 172.21.15.33:0/1206457910 wait complete. 2023-10-09T15:40:30.459 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:40:30.468 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2023-10-09T15:40:29.349768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432104,"kb_used_data":21032,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542616,"statfs":{"total":773094113280,"available":770603638784,"internally_reserved":0,"allocated":21536768,"data_stored":10333641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.020812"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321867+0000","last_change":"2023-10-09T15:40:26.318869+0000","last_active":"2023-10-09T15:40:26.321867+0000","last_peered":"2023-10-09T15:40:26.321867+0000","last_clean":"2023-10-09T15:40:26.321867+0000","last_became_active":"2023-10-09T15:40:26.318505+0000","last_became_peered":"2023-10-09T15:40:26.318505+0000","last_unstale":"2023-10-09T15:40:26.321867+0000","last_undegraded":"2023-10-09T15:40:26.321867+0000","last_fullsized":"2023-10-09T15:40:26.321867+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:00.189132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315767+0000","last_change":"2023-10-09T15:40:26.315767+0000","last_active":"2023-10-09T15:40:26.315767+0000","last_peered":"2023-10-09T15:40:26.315767+0000","last_clean":"2023-10-09T15:40:26.315767+0000","last_became_active":"2023-10-09T15:40:26.315437+0000","last_became_peered":"2023-10-09T15:40:26.315437+0000","last_unstale":"2023-10-09T15:40:26.315767+0000","last_undegraded":"2023-10-09T15:40:26.315767+0000","last_fullsized":"2023-10-09T15:40:26.315767+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:49.200700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322931+0000","last_change":"2023-10-09T15:40:26.322931+0000","last_active":"2023-10-09T15:40:26.322931+0000","last_peered":"2023-10-09T15:40:26.322931+0000","last_clean":"2023-10-09T15:40:26.322931+0000","last_became_active":"2023-10-09T15:40:26.322616+0000","last_became_peered":"2023-10-09T15:40:26.322616+0000","last_unstale":"2023-10-09T15:40:26.322931+0000","last_undegraded":"2023-10-09T15:40:26.322931+0000","last_fullsized":"2023-10-09T15:40:26.322931+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:05.230917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319678+0000","last_change":"2023-10-09T15:40:26.317403+0000","last_active":"2023-10-09T15:40:26.319678+0000","last_peered":"2023-10-09T15:40:26.319678+0000","last_clean":"2023-10-09T15:40:26.319678+0000","last_became_active":"2023-10-09T15:40:26.316723+0000","last_became_peered":"2023-10-09T15:40:26.316723+0000","last_unstale":"2023-10-09T15:40:26.319678+0000","last_undegraded":"2023-10-09T15:40:26.319678+0000","last_fullsized":"2023-10-09T15:40:26.319678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:50.777891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317032+0000","last_change":"2023-10-09T15:40:26.313483+0000","last_active":"2023-10-09T15:40:26.317032+0000","last_peered":"2023-10-09T15:40:26.317032+0000","last_clean":"2023-10-09T15:40:26.317032+0000","last_became_active":"2023-10-09T15:40:26.313148+0000","last_became_peered":"2023-10-09T15:40:26.313148+0000","last_unstale":"2023-10-09T15:40:26.317032+0000","last_undegraded":"2023-10-09T15:40:26.317032+0000","last_fullsized":"2023-10-09T15:40:26.317032+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:44.917250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.323903+0000","last_change":"2023-10-09T15:40:26.323903+0000","last_active":"2023-10-09T15:40:26.323903+0000","last_peered":"2023-10-09T15:40:26.323903+0000","last_clean":"2023-10-09T15:40:26.323903+0000","last_became_active":"2023-10-09T15:40:26.323664+0000","last_became_peered":"2023-10-09T15:40:26.323664+0000","last_unstale":"2023-10-09T15:40:26.323903+0000","last_undegraded":"2023-10-09T15:40:26.323903+0000","last_fullsized":"2023-10-09T15:40:26.323903+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.733721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.325625+0000","last_change":"2023-10-09T15:40:26.325625+0000","last_active":"2023-10-09T15:40:26.325625+0000","last_peered":"2023-10-09T15:40:26.325625+0000","last_clean":"2023-10-09T15:40:26.325625+0000","last_became_active":"2023-10-09T15:40:26.325335+0000","last_became_peered":"2023-10-09T15:40:26.325335+0000","last_unstale":"2023-10-09T15:40:26.325625+0000","last_undegraded":"2023-10-09T15:40:26.325625+0000","last_fullsized":"2023-10-09T15:40:26.325625+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:09.100493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310853+0000","last_change":"2023-10-09T15:40:26.308814+0000","last_active":"2023-10-09T15:40:26.310853+0000","last_peered":"2023-10-09T15:40:26.310853+0000","last_clean":"2023-10-09T15:40:26.310853+0000","last_became_active":"2023-10-09T15:40:26.308527+0000","last_became_peered":"2023-10-09T15:40:26.308527+0000","last_unstale":"2023-10-09T15:40:26.310853+0000","last_undegraded":"2023-10-09T15:40:26.310853+0000","last_fullsized":"2023-10-09T15:40:26.310853+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:22.651375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317886+0000","last_change":"2023-10-09T15:40:26.317886+0000","last_active":"2023-10-09T15:40:26.317886+0000","last_peered":"2023-10-09T15:40:26.317886+0000","last_clean":"2023-10-09T15:40:26.317886+0000","last_became_active":"2023-10-09T15:40:26.317598+0000","last_became_peered":"2023-10-09T15:40:26.317598+0000","last_unstale":"2023-10-09T15:40:26.317886+0000","last_undegraded":"2023-10-09T15:40:26.317886+0000","last_fullsized":"2023-10-09T15:40:26.317886+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:48.071778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324944+0000","last_change":"2023-10-09T15:40:26.324944+0000","last_active":"2023-10-09T15:40:26.324944+0000","last_peered":"2023-10-09T15:40:26.324944+0000","last_clean":"2023-10-09T15:40:26.324944+0000","last_became_active":"2023-10-09T15:40:26.324646+0000","last_became_peered":"2023-10-09T15:40:26.324646+0000","last_unstale":"2023-10-09T15:40:26.324944+0000","last_undegraded":"2023-10-09T15:40:26.324944+0000","last_fullsized":"2023-10-09T15:40:26.324944+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.705589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318597+0000","last_change":"2023-10-09T15:40:26.314482+0000","last_active":"2023-10-09T15:40:26.318597+0000","last_peered":"2023-10-09T15:40:26.318597+0000","last_clean":"2023-10-09T15:40:26.318597+0000","last_became_active":"2023-10-09T15:40:26.313988+0000","last_became_peered":"2023-10-09T15:40:26.313988+0000","last_unstale":"2023-10-09T15:40:26.318597+0000","last_undegraded":"2023-10-09T15:40:26.318597+0000","last_fullsized":"2023-10-09T15:40:26.318597+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:15.637977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.325242+0000","last_change":"2023-10-09T15:40:26.325242+0000","last_active":"2023-10-09T15:40:26.325242+0000","last_peered":"2023-10-09T15:40:26.325242+0000","last_clean":"2023-10-09T15:40:26.325242+0000","last_became_active":"2023-10-09T15:40:26.324955+0000","last_became_peered":"2023-10-09T15:40:26.324955+0000","last_unstale":"2023-10-09T15:40:26.325242+0000","last_undegraded":"2023-10-09T15:40:26.325242+0000","last_fullsized":"2023-10-09T15:40:26.325242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:58.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326692+0000","last_change":"2023-10-09T15:40:26.326028+0000","last_active":"2023-10-09T15:40:26.326692+0000","last_peered":"2023-10-09T15:40:26.326692+0000","last_clean":"2023-10-09T15:40:26.326692+0000","last_became_active":"2023-10-09T15:40:26.325682+0000","last_became_peered":"2023-10-09T15:40:26.325682+0000","last_unstale":"2023-10-09T15:40:26.326692+0000","last_undegraded":"2023-10-09T15:40:26.326692+0000","last_fullsized":"2023-10-09T15:40:26.326692+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:34:45.618659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310474+0000","last_change":"2023-10-09T15:40:26.310474+0000","last_active":"2023-10-09T15:40:26.310474+0000","last_peered":"2023-10-09T15:40:26.310474+0000","last_clean":"2023-10-09T15:40:26.310474+0000","last_became_active":"2023-10-09T15:40:26.309135+0000","last_became_peered":"2023-10-09T15:40:26.309135+0000","last_unstale":"2023-10-09T15:40:26.310474+0000","last_undegraded":"2023-10-09T15:40:26.310474+0000","last_fullsized":"2023-10-09T15:40:26.310474+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:18.512494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322471+0000","last_change":"2023-10-09T15:40:26.322471+0000","last_active":"2023-10-09T15:40:26.322471+0000","last_peered":"2023-10-09T15:40:26.322471+0000","last_clean":"2023-10-09T15:40:26.322471+0000","last_became_active":"2023-10-09T15:40:26.322136+0000","last_became_peered":"2023-10-09T15:40:26.322136+0000","last_unstale":"2023-10-09T15:40:26.322471+0000","last_undegraded":"2023-10-09T15:40:26.322471+0000","last_fullsized":"2023-10-09T15:40:26.322471+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:05:28.355138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.320498+0000","last_change":"2023-10-09T15:40:26.320498+0000","last_active":"2023-10-09T15:40:26.320498+0000","last_peered":"2023-10-09T15:40:26.320498+0000","last_clean":"2023-10-09T15:40:26.320498+0000","last_became_active":"2023-10-09T15:40:26.320201+0000","last_became_peered":"2023-10-09T15:40:26.320201+0000","last_unstale":"2023-10-09T15:40:26.320498+0000","last_undegraded":"2023-10-09T15:40:26.320498+0000","last_fullsized":"2023-10-09T15:40:26.320498+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:23.626710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324919+0000","last_change":"2023-10-09T15:40:26.324919+0000","last_active":"2023-10-09T15:40:26.324919+0000","last_peered":"2023-10-09T15:40:26.324919+0000","last_clean":"2023-10-09T15:40:26.324919+0000","last_became_active":"2023-10-09T15:40:26.324616+0000","last_became_peered":"2023-10-09T15:40:26.324616+0000","last_unstale":"2023-10-09T15:40:26.324919+0000","last_undegraded":"2023-10-09T15:40:26.324919+0000","last_fullsized":"2023-10-09T15:40:26.324919+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:02.963269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.309172+0000","last_change":"2023-10-09T15:40:26.306117+0000","last_active":"2023-10-09T15:40:26.309172+0000","last_peered":"2023-10-09T15:40:26.309172+0000","last_clean":"2023-10-09T15:40:26.309172+0000","last_became_active":"2023-10-09T15:40:26.305826+0000","last_became_peered":"2023-10-09T15:40:26.305826+0000","last_unstale":"2023-10-09T15:40:26.309172+0000","last_undegraded":"2023-10-09T15:40:26.309172+0000","last_fullsized":"2023-10-09T15:40:26.309172+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:52.345085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314395+0000","last_change":"2023-10-09T15:40:26.314395+0000","last_active":"2023-10-09T15:40:26.314395+0000","last_peered":"2023-10-09T15:40:26.314395+0000","last_clean":"2023-10-09T15:40:26.314395+0000","last_became_active":"2023-10-09T15:40:26.313888+0000","last_became_peered":"2023-10-09T15:40:26.313888+0000","last_unstale":"2023-10-09T15:40:26.314395+0000","last_undegraded":"2023-10-09T15:40:26.314395+0000","last_fullsized":"2023-10-09T15:40:26.314395+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:20.061024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322877+0000","last_change":"2023-10-09T15:40:26.322877+0000","last_active":"2023-10-09T15:40:26.322877+0000","last_peered":"2023-10-09T15:40:26.322877+0000","last_clean":"2023-10-09T15:40:26.322877+0000","last_became_active":"2023-10-09T15:40:26.322565+0000","last_became_peered":"2023-10-09T15:40:26.322565+0000","last_unstale":"2023-10-09T15:40:26.322877+0000","last_undegraded":"2023-10-09T15:40:26.322877+0000","last_fullsized":"2023-10-09T15:40:26.322877+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:20.061024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317051+0000","last_change":"2023-10-09T15:40:26.313933+0000","last_active":"2023-10-09T15:40:26.317051+0000","last_peered":"2023-10-09T15:40:26.317051+0000","last_clean":"2023-10-09T15:40:26.317051+0000","last_became_active":"2023-10-09T15:40:26.313656+0000","last_became_peered":"2023-10-09T15:40:26.313656+0000","last_unstale":"2023-10-09T15:40:26.317051+0000","last_undegraded":"2023-10-09T15:40:26.317051+0000","last_fullsized":"2023-10-09T15:40:26.317051+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:55.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324234+0000","last_change":"2023-10-09T15:40:26.319815+0000","last_active":"2023-10-09T15:40:26.324234+0000","last_peered":"2023-10-09T15:40:26.324234+0000","last_clean":"2023-10-09T15:40:26.324234+0000","last_became_active":"2023-10-09T15:40:26.319447+0000","last_became_peered":"2023-10-09T15:40:26.319447+0000","last_unstale":"2023-10-09T15:40:26.324234+0000","last_undegraded":"2023-10-09T15:40:26.324234+0000","last_fullsized":"2023-10-09T15:40:26.324234+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:05.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317612+0000","last_change":"2023-10-09T15:40:26.317612+0000","last_active":"2023-10-09T15:40:26.317612+0000","last_peered":"2023-10-09T15:40:26.317612+0000","last_clean":"2023-10-09T15:40:26.317612+0000","last_became_active":"2023-10-09T15:40:26.316562+0000","last_became_peered":"2023-10-09T15:40:26.316562+0000","last_unstale":"2023-10-09T15:40:26.317612+0000","last_undegraded":"2023-10-09T15:40:26.317612+0000","last_fullsized":"2023-10-09T15:40:26.317612+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:25.585176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324522+0000","last_change":"2023-10-09T15:40:26.321302+0000","last_active":"2023-10-09T15:40:26.324522+0000","last_peered":"2023-10-09T15:40:26.324522+0000","last_clean":"2023-10-09T15:40:26.324522+0000","last_became_active":"2023-10-09T15:40:26.321011+0000","last_became_peered":"2023-10-09T15:40:26.321011+0000","last_unstale":"2023-10-09T15:40:26.324522+0000","last_undegraded":"2023-10-09T15:40:26.324522+0000","last_fullsized":"2023-10-09T15:40:26.324522+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:11:56.879441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319330+0000","last_change":"2023-10-09T15:40:26.319330+0000","last_active":"2023-10-09T15:40:26.319330+0000","last_peered":"2023-10-09T15:40:26.319330+0000","last_clean":"2023-10-09T15:40:26.319330+0000","last_became_active":"2023-10-09T15:40:26.318917+0000","last_became_peered":"2023-10-09T15:40:26.318917+0000","last_unstale":"2023-10-09T15:40:26.319330+0000","last_undegraded":"2023-10-09T15:40:26.319330+0000","last_fullsized":"2023-10-09T15:40:26.319330+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:54.929832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315389+0000","last_change":"2023-10-09T15:40:26.315389+0000","last_active":"2023-10-09T15:40:26.315389+0000","last_peered":"2023-10-09T15:40:26.315389+0000","last_clean":"2023-10-09T15:40:26.315389+0000","last_became_active":"2023-10-09T15:40:26.314846+0000","last_became_peered":"2023-10-09T15:40:26.314846+0000","last_unstale":"2023-10-09T15:40:26.315389+0000","last_undegraded":"2023-10-09T15:40:26.315389+0000","last_fullsized":"2023-10-09T15:40:26.315389+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:33.620386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324197+0000","last_change":"2023-10-09T15:40:26.319529+0000","last_active":"2023-10-09T15:40:26.324197+0000","last_peered":"2023-10-09T15:40:26.324197+0000","last_clean":"2023-10-09T15:40:26.324197+0000","last_became_active":"2023-10-09T15:40:26.318366+0000","last_became_peered":"2023-10-09T15:40:26.318366+0000","last_unstale":"2023-10-09T15:40:26.324197+0000","last_undegraded":"2023-10-09T15:40:26.324197+0000","last_fullsized":"2023-10-09T15:40:26.324197+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:25:45.241538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321829+0000","last_change":"2023-10-09T15:40:26.318043+0000","last_active":"2023-10-09T15:40:26.321829+0000","last_peered":"2023-10-09T15:40:26.321829+0000","last_clean":"2023-10-09T15:40:26.321829+0000","last_became_active":"2023-10-09T15:40:26.317715+0000","last_became_peered":"2023-10-09T15:40:26.317715+0000","last_unstale":"2023-10-09T15:40:26.321829+0000","last_undegraded":"2023-10-09T15:40:26.321829+0000","last_fullsized":"2023-10-09T15:40:26.321829+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:18.102607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316306+0000","last_change":"2023-10-09T15:40:26.316306+0000","last_active":"2023-10-09T15:40:26.316306+0000","last_peered":"2023-10-09T15:40:26.316306+0000","last_clean":"2023-10-09T15:40:26.316306+0000","last_became_active":"2023-10-09T15:40:26.315976+0000","last_became_peered":"2023-10-09T15:40:26.315976+0000","last_unstale":"2023-10-09T15:40:26.316306+0000","last_undegraded":"2023-10-09T15:40:26.316306+0000","last_fullsized":"2023-10-09T15:40:26.316306+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.705589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315784+0000","last_change":"2023-10-09T15:40:26.315784+0000","last_active":"2023-10-09T15:40:26.315784+0000","last_peered":"2023-10-09T15:40:26.315784+0000","last_clean":"2023-10-09T15:40:26.315784+0000","last_became_active":"2023-10-09T15:40:26.315465+0000","last_became_peered":"2023-10-09T15:40:26.315465+0000","last_unstale":"2023-10-09T15:40:26.315784+0000","last_undegraded":"2023-10-09T15:40:26.315784+0000","last_fullsized":"2023-10-09T15:40:26.315784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:53:56.447654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311632+0000","last_change":"2023-10-09T15:40:26.311632+0000","last_active":"2023-10-09T15:40:26.311632+0000","last_peered":"2023-10-09T15:40:26.311632+0000","last_clean":"2023-10-09T15:40:26.311632+0000","last_became_active":"2023-10-09T15:40:26.310580+0000","last_became_peered":"2023-10-09T15:40:26.310580+0000","last_unstale":"2023-10-09T15:40:26.311632+0000","last_undegraded":"2023-10-09T15:40:26.311632+0000","last_fullsized":"2023-10-09T15:40:26.311632+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:04.652406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317330+0000","last_change":"2023-10-09T15:40:26.317330+0000","last_active":"2023-10-09T15:40:26.317330+0000","last_peered":"2023-10-09T15:40:26.317330+0000","last_clean":"2023-10-09T15:40:26.317330+0000","last_became_active":"2023-10-09T15:40:26.317062+0000","last_became_peered":"2023-10-09T15:40:26.317062+0000","last_unstale":"2023-10-09T15:40:26.317330+0000","last_undegraded":"2023-10-09T15:40:26.317330+0000","last_fullsized":"2023-10-09T15:40:26.317330+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.733721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"199'4","reported_seq":14,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360281+0000","last_change":"2023-10-09T15:40:25.343565+0000","last_active":"2023-10-09T15:40:26.360281+0000","last_peered":"2023-10-09T15:40:26.360281+0000","last_clean":"2023-10-09T15:40:26.360281+0000","last_became_active":"2023-10-09T15:40:25.343257+0000","last_became_peered":"2023-10-09T15:40:25.343257+0000","last_unstale":"2023-10-09T15:40:26.360281+0000","last_undegraded":"2023-10-09T15:40:26.360281+0000","last_fullsized":"2023-10-09T15:40:26.360281+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:33.752345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318636+0000","last_change":"2023-10-09T15:40:26.314058+0000","last_active":"2023-10-09T15:40:26.318636+0000","last_peered":"2023-10-09T15:40:26.318636+0000","last_clean":"2023-10-09T15:40:26.318636+0000","last_became_active":"2023-10-09T15:40:26.313749+0000","last_became_peered":"2023-10-09T15:40:26.313749+0000","last_unstale":"2023-10-09T15:40:26.318636+0000","last_undegraded":"2023-10-09T15:40:26.318636+0000","last_fullsized":"2023-10-09T15:40:26.318636+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:55.774140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.308341+0000","last_change":"2023-10-09T15:40:25.345211+0000","last_active":"2023-10-09T15:40:26.308341+0000","last_peered":"2023-10-09T15:40:26.308341+0000","last_clean":"2023-10-09T15:40:26.308341+0000","last_became_active":"2023-10-09T15:40:25.344931+0000","last_became_peered":"2023-10-09T15:40:25.344931+0000","last_unstale":"2023-10-09T15:40:26.308341+0000","last_undegraded":"2023-10-09T15:40:26.308341+0000","last_fullsized":"2023-10-09T15:40:26.308341+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:25:44.235162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310746+0000","last_change":"2023-10-09T15:40:26.309006+0000","last_active":"2023-10-09T15:40:26.310746+0000","last_peered":"2023-10-09T15:40:26.310746+0000","last_clean":"2023-10-09T15:40:26.310746+0000","last_became_active":"2023-10-09T15:40:26.308738+0000","last_became_peered":"2023-10-09T15:40:26.308738+0000","last_unstale":"2023-10-09T15:40:26.310746+0000","last_undegraded":"2023-10-09T15:40:26.310746+0000","last_fullsized":"2023-10-09T15:40:26.310746+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:54.935944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.362485+0000","last_change":"2023-10-09T15:40:25.345445+0000","last_active":"2023-10-09T15:40:26.362485+0000","last_peered":"2023-10-09T15:40:26.362485+0000","last_clean":"2023-10-09T15:40:26.362485+0000","last_became_active":"2023-10-09T15:40:25.345143+0000","last_became_peered":"2023-10-09T15:40:25.345143+0000","last_unstale":"2023-10-09T15:40:26.362485+0000","last_undegraded":"2023-10-09T15:40:26.362485+0000","last_fullsized":"2023-10-09T15:40:26.362485+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:29:15.830988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312184+0000","last_change":"2023-10-09T15:40:26.312184+0000","last_active":"2023-10-09T15:40:26.312184+0000","last_peered":"2023-10-09T15:40:26.312184+0000","last_clean":"2023-10-09T15:40:26.312184+0000","last_became_active":"2023-10-09T15:40:26.311877+0000","last_became_peered":"2023-10-09T15:40:26.311877+0000","last_unstale":"2023-10-09T15:40:26.312184+0000","last_undegraded":"2023-10-09T15:40:26.312184+0000","last_fullsized":"2023-10-09T15:40:26.312184+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:42.767918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.358531+0000","last_change":"2023-10-09T15:40:25.342061+0000","last_active":"2023-10-09T15:40:26.358531+0000","last_peered":"2023-10-09T15:40:26.358531+0000","last_clean":"2023-10-09T15:40:26.358531+0000","last_became_active":"2023-10-09T15:40:25.341776+0000","last_became_peered":"2023-10-09T15:40:25.341776+0000","last_unstale":"2023-10-09T15:40:26.358531+0000","last_undegraded":"2023-10-09T15:40:26.358531+0000","last_fullsized":"2023-10-09T15:40:26.358531+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:09.256958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311780+0000","last_change":"2023-10-09T15:40:26.311780+0000","last_active":"2023-10-09T15:40:26.311780+0000","last_peered":"2023-10-09T15:40:26.311780+0000","last_clean":"2023-10-09T15:40:26.311780+0000","last_became_active":"2023-10-09T15:40:26.311500+0000","last_became_peered":"2023-10-09T15:40:26.311500+0000","last_unstale":"2023-10-09T15:40:26.311780+0000","last_undegraded":"2023-10-09T15:40:26.311780+0000","last_fullsized":"2023-10-09T15:40:26.311780+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:37.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"199'1","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.355982+0000","last_change":"2023-10-09T15:40:25.347283+0000","last_active":"2023-10-09T15:40:26.355982+0000","last_peered":"2023-10-09T15:40:26.355982+0000","last_clean":"2023-10-09T15:40:26.355982+0000","last_became_active":"2023-10-09T15:40:25.346989+0000","last_became_peered":"2023-10-09T15:40:25.346989+0000","last_unstale":"2023-10-09T15:40:26.355982+0000","last_undegraded":"2023-10-09T15:40:26.355982+0000","last_fullsized":"2023-10-09T15:40:26.355982+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:33.021649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315839+0000","last_change":"2023-10-09T15:40:26.315839+0000","last_active":"2023-10-09T15:40:26.315839+0000","last_peered":"2023-10-09T15:40:26.315839+0000","last_clean":"2023-10-09T15:40:26.315839+0000","last_became_active":"2023-10-09T15:40:26.315547+0000","last_became_peered":"2023-10-09T15:40:26.315547+0000","last_unstale":"2023-10-09T15:40:26.315839+0000","last_undegraded":"2023-10-09T15:40:26.315839+0000","last_fullsized":"2023-10-09T15:40:26.315839+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:52.113930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.304367+0000","last_change":"2023-10-09T15:40:25.350293+0000","last_active":"2023-10-09T15:40:26.304367+0000","last_peered":"2023-10-09T15:40:26.304367+0000","last_clean":"2023-10-09T15:40:26.304367+0000","last_became_active":"2023-10-09T15:40:25.350006+0000","last_became_peered":"2023-10-09T15:40:25.350006+0000","last_unstale":"2023-10-09T15:40:26.304367+0000","last_undegraded":"2023-10-09T15:40:26.304367+0000","last_fullsized":"2023-10-09T15:40:26.304367+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:51.567794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319154+0000","last_change":"2023-10-09T15:40:26.319154+0000","last_active":"2023-10-09T15:40:26.319154+0000","last_peered":"2023-10-09T15:40:26.319154+0000","last_clean":"2023-10-09T15:40:26.319154+0000","last_became_active":"2023-10-09T15:40:26.318838+0000","last_became_peered":"2023-10-09T15:40:26.318838+0000","last_unstale":"2023-10-09T15:40:26.319154+0000","last_undegraded":"2023-10-09T15:40:26.319154+0000","last_fullsized":"2023-10-09T15:40:26.319154+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:41.956731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347826+0000","last_change":"2023-10-09T15:40:25.345840+0000","last_active":"2023-10-09T15:40:25.347826+0000","last_peered":"2023-10-09T15:40:25.347826+0000","last_clean":"2023-10-09T15:40:25.347826+0000","last_became_active":"2023-10-09T15:40:25.345534+0000","last_became_peered":"2023-10-09T15:40:25.345534+0000","last_unstale":"2023-10-09T15:40:25.347826+0000","last_undegraded":"2023-10-09T15:40:25.347826+0000","last_fullsized":"2023-10-09T15:40:25.347826+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:49.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.323533+0000","last_change":"2023-10-09T15:40:26.322948+0000","last_active":"2023-10-09T15:40:26.323533+0000","last_peered":"2023-10-09T15:40:26.323533+0000","last_clean":"2023-10-09T15:40:26.323533+0000","last_became_active":"2023-10-09T15:40:26.322601+0000","last_became_peered":"2023-10-09T15:40:26.322601+0000","last_unstale":"2023-10-09T15:40:26.323533+0000","last_undegraded":"2023-10-09T15:40:26.323533+0000","last_fullsized":"2023-10-09T15:40:26.323533+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:30.104005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.301715+0000","last_change":"2023-10-09T15:40:25.347938+0000","last_active":"2023-10-09T15:40:26.301715+0000","last_peered":"2023-10-09T15:40:26.301715+0000","last_clean":"2023-10-09T15:40:26.301715+0000","last_became_active":"2023-10-09T15:40:25.347581+0000","last_became_peered":"2023-10-09T15:40:25.347581+0000","last_unstale":"2023-10-09T15:40:26.301715+0000","last_undegraded":"2023-10-09T15:40:26.301715+0000","last_fullsized":"2023-10-09T15:40:26.301715+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:31.727346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318817+0000","last_change":"2023-10-09T15:40:26.313768+0000","last_active":"2023-10-09T15:40:26.318817+0000","last_peered":"2023-10-09T15:40:26.318817+0000","last_clean":"2023-10-09T15:40:26.318817+0000","last_became_active":"2023-10-09T15:40:26.313451+0000","last_became_peered":"2023-10-09T15:40:26.313451+0000","last_unstale":"2023-10-09T15:40:26.318817+0000","last_undegraded":"2023-10-09T15:40:26.318817+0000","last_fullsized":"2023-10-09T15:40:26.318817+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:11.271668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305900+0000","last_change":"2023-10-09T15:40:25.356167+0000","last_active":"2023-10-09T15:40:26.305900+0000","last_peered":"2023-10-09T15:40:26.305900+0000","last_clean":"2023-10-09T15:40:26.305900+0000","last_became_active":"2023-10-09T15:40:25.355761+0000","last_became_peered":"2023-10-09T15:40:25.355761+0000","last_unstale":"2023-10-09T15:40:26.305900+0000","last_undegraded":"2023-10-09T15:40:26.305900+0000","last_fullsized":"2023-10-09T15:40:26.305900+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:36.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322723+0000","last_change":"2023-10-09T15:40:26.322354+0000","last_active":"2023-10-09T15:40:26.322723+0000","last_peered":"2023-10-09T15:40:26.322723+0000","last_clean":"2023-10-09T15:40:26.322723+0000","last_became_active":"2023-10-09T15:40:26.322082+0000","last_became_peered":"2023-10-09T15:40:26.322082+0000","last_unstale":"2023-10-09T15:40:26.322723+0000","last_undegraded":"2023-10-09T15:40:26.322723+0000","last_fullsized":"2023-10-09T15:40:26.322723+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:16.445761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347724+0000","last_change":"2023-10-09T15:40:25.344658+0000","last_active":"2023-10-09T15:40:25.347724+0000","last_peered":"2023-10-09T15:40:25.347724+0000","last_clean":"2023-10-09T15:40:25.347724+0000","last_became_active":"2023-10-09T15:40:25.344347+0000","last_became_peered":"2023-10-09T15:40:25.344347+0000","last_unstale":"2023-10-09T15:40:25.347724+0000","last_undegraded":"2023-10-09T15:40:25.347724+0000","last_fullsized":"2023-10-09T15:40:25.347724+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:14.631601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317564+0000","last_change":"2023-10-09T15:40:26.317564+0000","last_active":"2023-10-09T15:40:26.317564+0000","last_peered":"2023-10-09T15:40:26.317564+0000","last_clean":"2023-10-09T15:40:26.317564+0000","last_became_active":"2023-10-09T15:40:26.316416+0000","last_became_peered":"2023-10-09T15:40:26.316416+0000","last_unstale":"2023-10-09T15:40:26.317564+0000","last_undegraded":"2023-10-09T15:40:26.317564+0000","last_fullsized":"2023-10-09T15:40:26.317564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:02.963269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"199'3","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360643+0000","last_change":"2023-10-09T15:40:25.356325+0000","last_active":"2023-10-09T15:40:26.360643+0000","last_peered":"2023-10-09T15:40:26.360643+0000","last_clean":"2023-10-09T15:40:26.360643+0000","last_became_active":"2023-10-09T15:40:25.355721+0000","last_became_peered":"2023-10-09T15:40:25.355721+0000","last_unstale":"2023-10-09T15:40:26.360643+0000","last_undegraded":"2023-10-09T15:40:26.360643+0000","last_fullsized":"2023-10-09T15:40:26.360643+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:17.506118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314285+0000","last_change":"2023-10-09T15:40:26.313384+0000","last_active":"2023-10-09T15:40:26.314285+0000","last_peered":"2023-10-09T15:40:26.314285+0000","last_clean":"2023-10-09T15:40:26.314285+0000","last_became_active":"2023-10-09T15:40:26.313153+0000","last_became_peered":"2023-10-09T15:40:26.313153+0000","last_unstale":"2023-10-09T15:40:26.314285+0000","last_undegraded":"2023-10-09T15:40:26.314285+0000","last_fullsized":"2023-10-09T15:40:26.314285+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:12.782639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"199'6","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.363412+0000","last_change":"2023-10-09T15:40:25.340403+0000","last_active":"2023-10-09T15:40:26.363412+0000","last_peered":"2023-10-09T15:40:26.363412+0000","last_clean":"2023-10-09T15:40:26.363412+0000","last_became_active":"2023-10-09T15:40:25.340118+0000","last_became_peered":"2023-10-09T15:40:25.340118+0000","last_unstale":"2023-10-09T15:40:26.363412+0000","last_undegraded":"2023-10-09T15:40:26.363412+0000","last_fullsized":"2023-10-09T15:40:26.363412+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:45.805446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312697+0000","last_change":"2023-10-09T15:40:26.309178+0000","last_active":"2023-10-09T15:40:26.312697+0000","last_peered":"2023-10-09T15:40:26.312697+0000","last_clean":"2023-10-09T15:40:26.312697+0000","last_became_active":"2023-10-09T15:40:26.308905+0000","last_became_peered":"2023-10-09T15:40:26.308905+0000","last_unstale":"2023-10-09T15:40:26.312697+0000","last_undegraded":"2023-10-09T15:40:26.312697+0000","last_fullsized":"2023-10-09T15:40:26.312697+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:30.969553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.358225+0000","last_change":"2023-10-09T15:40:25.347974+0000","last_active":"2023-10-09T15:40:26.358225+0000","last_peered":"2023-10-09T15:40:26.358225+0000","last_clean":"2023-10-09T15:40:26.358225+0000","last_became_active":"2023-10-09T15:40:25.347597+0000","last_became_peered":"2023-10-09T15:40:25.347597+0000","last_unstale":"2023-10-09T15:40:26.358225+0000","last_undegraded":"2023-10-09T15:40:26.358225+0000","last_fullsized":"2023-10-09T15:40:26.358225+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:47.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324493+0000","last_change":"2023-10-09T15:40:26.320763+0000","last_active":"2023-10-09T15:40:26.324493+0000","last_peered":"2023-10-09T15:40:26.324493+0000","last_clean":"2023-10-09T15:40:26.324493+0000","last_became_active":"2023-10-09T15:40:26.320499+0000","last_became_peered":"2023-10-09T15:40:26.320499+0000","last_unstale":"2023-10-09T15:40:26.324493+0000","last_undegraded":"2023-10-09T15:40:26.324493+0000","last_fullsized":"2023-10-09T15:40:26.324493+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:10.263334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.306910+0000","last_change":"2023-10-09T15:40:25.350177+0000","last_active":"2023-10-09T15:40:26.306910+0000","last_peered":"2023-10-09T15:40:26.306910+0000","last_clean":"2023-10-09T15:40:26.306910+0000","last_became_active":"2023-10-09T15:40:25.349905+0000","last_became_peered":"2023-10-09T15:40:25.349905+0000","last_unstale":"2023-10-09T15:40:26.306910+0000","last_undegraded":"2023-10-09T15:40:26.306910+0000","last_fullsized":"2023-10-09T15:40:26.306910+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:20.204760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314653+0000","last_change":"2023-10-09T15:40:26.312128+0000","last_active":"2023-10-09T15:40:26.314653+0000","last_peered":"2023-10-09T15:40:26.314653+0000","last_clean":"2023-10-09T15:40:26.314653+0000","last_became_active":"2023-10-09T15:40:26.311845+0000","last_became_peered":"2023-10-09T15:40:26.311845+0000","last_unstale":"2023-10-09T15:40:26.314653+0000","last_undegraded":"2023-10-09T15:40:26.314653+0000","last_fullsized":"2023-10-09T15:40:26.314653+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.605544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305620+0000","last_change":"2023-10-09T15:40:25.347984+0000","last_active":"2023-10-09T15:40:26.305620+0000","last_peered":"2023-10-09T15:40:26.305620+0000","last_clean":"2023-10-09T15:40:26.305620+0000","last_became_active":"2023-10-09T15:40:25.347695+0000","last_became_peered":"2023-10-09T15:40:25.347695+0000","last_unstale":"2023-10-09T15:40:26.305620+0000","last_undegraded":"2023-10-09T15:40:26.305620+0000","last_fullsized":"2023-10-09T15:40:26.305620+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:53:55.441278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319197+0000","last_change":"2023-10-09T15:40:26.317682+0000","last_active":"2023-10-09T15:40:26.319197+0000","last_peered":"2023-10-09T15:40:26.319197+0000","last_clean":"2023-10-09T15:40:26.319197+0000","last_became_active":"2023-10-09T15:40:26.317401+0000","last_became_peered":"2023-10-09T15:40:26.317401+0000","last_unstale":"2023-10-09T15:40:26.319197+0000","last_undegraded":"2023-10-09T15:40:26.319197+0000","last_fullsized":"2023-10-09T15:40:26.319197+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:46:22.630287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"199'8","reported_seq":18,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.361346+0000","last_change":"2023-10-09T15:40:25.351022+0000","last_active":"2023-10-09T15:40:26.361346+0000","last_peered":"2023-10-09T15:40:26.361346+0000","last_clean":"2023-10-09T15:40:26.361346+0000","last_became_active":"2023-10-09T15:40:25.350734+0000","last_became_peered":"2023-10-09T15:40:25.350734+0000","last_unstale":"2023-10-09T15:40:26.361346+0000","last_undegraded":"2023-10-09T15:40:26.361346+0000","last_fullsized":"2023-10-09T15:40:26.361346+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:21:18.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315108+0000","last_change":"2023-10-09T15:40:26.314177+0000","last_active":"2023-10-09T15:40:26.315108+0000","last_peered":"2023-10-09T15:40:26.315108+0000","last_clean":"2023-10-09T15:40:26.315108+0000","last_became_active":"2023-10-09T15:40:26.313840+0000","last_became_peered":"2023-10-09T15:40:26.313840+0000","last_unstale":"2023-10-09T15:40:26.315108+0000","last_undegraded":"2023-10-09T15:40:26.315108+0000","last_fullsized":"2023-10-09T15:40:26.315108+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:50.171892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311869+0000","last_change":"2023-10-09T15:40:25.349363+0000","last_active":"2023-10-09T15:40:26.311869+0000","last_peered":"2023-10-09T15:40:26.311869+0000","last_clean":"2023-10-09T15:40:26.311869+0000","last_became_active":"2023-10-09T15:40:25.349074+0000","last_became_peered":"2023-10-09T15:40:25.349074+0000","last_unstale":"2023-10-09T15:40:26.311869+0000","last_undegraded":"2023-10-09T15:40:26.311869+0000","last_fullsized":"2023-10-09T15:40:26.311869+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:49.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326850+0000","last_change":"2023-10-09T15:40:26.323287+0000","last_active":"2023-10-09T15:40:26.326850+0000","last_peered":"2023-10-09T15:40:26.326850+0000","last_clean":"2023-10-09T15:40:26.326850+0000","last_became_active":"2023-10-09T15:40:26.323007+0000","last_became_peered":"2023-10-09T15:40:26.323007+0000","last_unstale":"2023-10-09T15:40:26.326850+0000","last_undegraded":"2023-10-09T15:40:26.326850+0000","last_fullsized":"2023-10-09T15:40:26.326850+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:26.489133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.357658+0000","last_change":"2023-10-09T15:40:25.344554+0000","last_active":"2023-10-09T15:40:26.357658+0000","last_peered":"2023-10-09T15:40:26.357658+0000","last_clean":"2023-10-09T15:40:26.357658+0000","last_became_active":"2023-10-09T15:40:25.343596+0000","last_became_peered":"2023-10-09T15:40:25.343596+0000","last_unstale":"2023-10-09T15:40:26.357658+0000","last_undegraded":"2023-10-09T15:40:26.357658+0000","last_fullsized":"2023-10-09T15:40:26.357658+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:21.189101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315172+0000","last_change":"2023-10-09T15:40:26.312364+0000","last_active":"2023-10-09T15:40:26.315172+0000","last_peered":"2023-10-09T15:40:26.315172+0000","last_clean":"2023-10-09T15:40:26.315172+0000","last_became_active":"2023-10-09T15:40:26.312082+0000","last_became_peered":"2023-10-09T15:40:26.312082+0000","last_unstale":"2023-10-09T15:40:26.315172+0000","last_undegraded":"2023-10-09T15:40:26.315172+0000","last_fullsized":"2023-10-09T15:40:26.315172+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:27:05.105257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312854+0000","last_change":"2023-10-09T15:40:25.350521+0000","last_active":"2023-10-09T15:40:26.312854+0000","last_peered":"2023-10-09T15:40:26.312854+0000","last_clean":"2023-10-09T15:40:26.312854+0000","last_became_active":"2023-10-09T15:40:25.350066+0000","last_became_peered":"2023-10-09T15:40:25.350066+0000","last_unstale":"2023-10-09T15:40:26.312854+0000","last_undegraded":"2023-10-09T15:40:26.312854+0000","last_fullsized":"2023-10-09T15:40:26.312854+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:06.406441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321847+0000","last_change":"2023-10-09T15:40:26.318780+0000","last_active":"2023-10-09T15:40:26.321847+0000","last_peered":"2023-10-09T15:40:26.321847+0000","last_clean":"2023-10-09T15:40:26.321847+0000","last_became_active":"2023-10-09T15:40:26.318361+0000","last_became_peered":"2023-10-09T15:40:26.318361+0000","last_unstale":"2023-10-09T15:40:26.321847+0000","last_undegraded":"2023-10-09T15:40:26.321847+0000","last_fullsized":"2023-10-09T15:40:26.321847+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:45.763826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299073+0000","last_change":"2023-10-09T15:40:25.349078+0000","last_active":"2023-10-09T15:40:26.299073+0000","last_peered":"2023-10-09T15:40:26.299073+0000","last_clean":"2023-10-09T15:40:26.299073+0000","last_became_active":"2023-10-09T15:40:25.348801+0000","last_became_peered":"2023-10-09T15:40:25.348801+0000","last_unstale":"2023-10-09T15:40:26.299073+0000","last_undegraded":"2023-10-09T15:40:26.299073+0000","last_fullsized":"2023-10-09T15:40:26.299073+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:09.924946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316895+0000","last_change":"2023-10-09T15:40:26.316895+0000","last_active":"2023-10-09T15:40:26.316895+0000","last_peered":"2023-10-09T15:40:26.316895+0000","last_clean":"2023-10-09T15:40:26.316895+0000","last_became_active":"2023-10-09T15:40:26.316597+0000","last_became_peered":"2023-10-09T15:40:26.316597+0000","last_unstale":"2023-10-09T15:40:26.316895+0000","last_undegraded":"2023-10-09T15:40:26.316895+0000","last_fullsized":"2023-10-09T15:40:26.316895+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:55.983389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360867+0000","last_change":"2023-10-09T15:40:25.357234+0000","last_active":"2023-10-09T15:40:26.360867+0000","last_peered":"2023-10-09T15:40:26.360867+0000","last_clean":"2023-10-09T15:40:26.360867+0000","last_became_active":"2023-10-09T15:40:25.356238+0000","last_became_peered":"2023-10-09T15:40:25.356238+0000","last_unstale":"2023-10-09T15:40:26.360867+0000","last_undegraded":"2023-10-09T15:40:26.360867+0000","last_fullsized":"2023-10-09T15:40:26.360867+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:51.567794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314254+0000","last_change":"2023-10-09T15:40:26.312489+0000","last_active":"2023-10-09T15:40:26.314254+0000","last_peered":"2023-10-09T15:40:26.314254+0000","last_clean":"2023-10-09T15:40:26.314254+0000","last_became_active":"2023-10-09T15:40:26.312189+0000","last_became_peered":"2023-10-09T15:40:26.312189+0000","last_unstale":"2023-10-09T15:40:26.314254+0000","last_undegraded":"2023-10-09T15:40:26.314254+0000","last_fullsized":"2023-10-09T15:40:26.314254+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:30.636981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.302592+0000","last_change":"2023-10-09T15:40:25.341367+0000","last_active":"2023-10-09T15:40:26.302592+0000","last_peered":"2023-10-09T15:40:26.302592+0000","last_clean":"2023-10-09T15:40:26.302592+0000","last_became_active":"2023-10-09T15:40:25.341082+0000","last_became_peered":"2023-10-09T15:40:25.341082+0000","last_unstale":"2023-10-09T15:40:26.302592+0000","last_undegraded":"2023-10-09T15:40:26.302592+0000","last_fullsized":"2023-10-09T15:40:26.302592+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:57.013252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322211+0000","last_change":"2023-10-09T15:40:26.321567+0000","last_active":"2023-10-09T15:40:26.322211+0000","last_peered":"2023-10-09T15:40:26.322211+0000","last_clean":"2023-10-09T15:40:26.322211+0000","last_became_active":"2023-10-09T15:40:26.321247+0000","last_became_peered":"2023-10-09T15:40:26.321247+0000","last_unstale":"2023-10-09T15:40:26.322211+0000","last_undegraded":"2023-10-09T15:40:26.322211+0000","last_fullsized":"2023-10-09T15:40:26.322211+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:00.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347189+0000","last_change":"2023-10-09T15:40:25.341981+0000","last_active":"2023-10-09T15:40:25.347189+0000","last_peered":"2023-10-09T15:40:25.347189+0000","last_clean":"2023-10-09T15:40:25.347189+0000","last_became_active":"2023-10-09T15:40:25.339413+0000","last_became_peered":"2023-10-09T15:40:25.339413+0000","last_unstale":"2023-10-09T15:40:25.347189+0000","last_undegraded":"2023-10-09T15:40:25.347189+0000","last_fullsized":"2023-10-09T15:40:25.347189+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:39.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317509+0000","last_change":"2023-10-09T15:40:26.317509+0000","last_active":"2023-10-09T15:40:26.317509+0000","last_peered":"2023-10-09T15:40:26.317509+0000","last_clean":"2023-10-09T15:40:26.317509+0000","last_became_active":"2023-10-09T15:40:26.317100+0000","last_became_peered":"2023-10-09T15:40:26.317100+0000","last_unstale":"2023-10-09T15:40:26.317509+0000","last_undegraded":"2023-10-09T15:40:26.317509+0000","last_fullsized":"2023-10-09T15:40:26.317509+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:43.857167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305663+0000","last_change":"2023-10-09T15:40:25.345425+0000","last_active":"2023-10-09T15:40:26.305663+0000","last_peered":"2023-10-09T15:40:26.305663+0000","last_clean":"2023-10-09T15:40:26.305663+0000","last_became_active":"2023-10-09T15:40:25.345153+0000","last_became_peered":"2023-10-09T15:40:25.345153+0000","last_unstale":"2023-10-09T15:40:26.305663+0000","last_undegraded":"2023-10-09T15:40:26.305663+0000","last_fullsized":"2023-10-09T15:40:26.305663+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:39.572136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324126+0000","last_change":"2023-10-09T15:40:26.324126+0000","last_active":"2023-10-09T15:40:26.324126+0000","last_peered":"2023-10-09T15:40:26.324126+0000","last_clean":"2023-10-09T15:40:26.324126+0000","last_became_active":"2023-10-09T15:40:26.323827+0000","last_became_peered":"2023-10-09T15:40:26.323827+0000","last_unstale":"2023-10-09T15:40:26.324126+0000","last_undegraded":"2023-10-09T15:40:26.324126+0000","last_fullsized":"2023-10-09T15:40:26.324126+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:23.626710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360641+0000","last_change":"2023-10-09T15:40:25.352438+0000","last_active":"2023-10-09T15:40:26.360641+0000","last_peered":"2023-10-09T15:40:26.360641+0000","last_clean":"2023-10-09T15:40:26.360641+0000","last_became_active":"2023-10-09T15:40:25.352146+0000","last_became_peered":"2023-10-09T15:40:25.352146+0000","last_unstale":"2023-10-09T15:40:26.360641+0000","last_undegraded":"2023-10-09T15:40:26.360641+0000","last_fullsized":"2023-10-09T15:40:26.360641+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:50.199494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316317+0000","last_change":"2023-10-09T15:40:26.316317+0000","last_active":"2023-10-09T15:40:26.316317+0000","last_peered":"2023-10-09T15:40:26.316317+0000","last_clean":"2023-10-09T15:40:26.316317+0000","last_became_active":"2023-10-09T15:40:26.315989+0000","last_became_peered":"2023-10-09T15:40:26.315989+0000","last_unstale":"2023-10-09T15:40:26.316317+0000","last_undegraded":"2023-10-09T15:40:26.316317+0000","last_fullsized":"2023-10-09T15:40:26.316317+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:52.574169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299524+0000","last_change":"2023-10-09T15:40:25.345917+0000","last_active":"2023-10-09T15:40:26.299524+0000","last_peered":"2023-10-09T15:40:26.299524+0000","last_clean":"2023-10-09T15:40:26.299524+0000","last_became_active":"2023-10-09T15:40:25.343185+0000","last_became_peered":"2023-10-09T15:40:25.343185+0000","last_unstale":"2023-10-09T15:40:26.299524+0000","last_undegraded":"2023-10-09T15:40:26.299524+0000","last_fullsized":"2023-10-09T15:40:26.299524+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:55.111677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318923+0000","last_change":"2023-10-09T15:40:26.318923+0000","last_active":"2023-10-09T15:40:26.318923+0000","last_peered":"2023-10-09T15:40:26.318923+0000","last_clean":"2023-10-09T15:40:26.318923+0000","last_became_active":"2023-10-09T15:40:26.318633+0000","last_became_peered":"2023-10-09T15:40:26.318633+0000","last_unstale":"2023-10-09T15:40:26.318923+0000","last_undegraded":"2023-10-09T15:40:26.318923+0000","last_fullsized":"2023-10-09T15:40:26.318923+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:58.407057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.348347+0000","last_change":"2023-10-09T15:40:25.347632+0000","last_active":"2023-10-09T15:40:25.348347+0000","last_peered":"2023-10-09T15:40:25.348347+0000","last_clean":"2023-10-09T15:40:25.348347+0000","last_became_active":"2023-10-09T15:40:25.347354+0000","last_became_peered":"2023-10-09T15:40:25.347354+0000","last_unstale":"2023-10-09T15:40:25.348347+0000","last_undegraded":"2023-10-09T15:40:25.348347+0000","last_fullsized":"2023-10-09T15:40:25.348347+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:29.301065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316075+0000","last_change":"2023-10-09T15:40:26.316075+0000","last_active":"2023-10-09T15:40:26.316075+0000","last_peered":"2023-10-09T15:40:26.316075+0000","last_clean":"2023-10-09T15:40:26.316075+0000","last_became_active":"2023-10-09T15:40:26.315770+0000","last_became_peered":"2023-10-09T15:40:26.315770+0000","last_unstale":"2023-10-09T15:40:26.316075+0000","last_undegraded":"2023-10-09T15:40:26.316075+0000","last_fullsized":"2023-10-09T15:40:26.316075+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:34.028025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.352042+0000","last_change":"2023-10-09T15:40:25.350402+0000","last_active":"2023-10-09T15:40:25.352042+0000","last_peered":"2023-10-09T15:40:25.352042+0000","last_clean":"2023-10-09T15:40:25.352042+0000","last_became_active":"2023-10-09T15:40:25.350070+0000","last_became_peered":"2023-10-09T15:40:25.350070+0000","last_unstale":"2023-10-09T15:40:25.352042+0000","last_undegraded":"2023-10-09T15:40:25.352042+0000","last_fullsized":"2023-10-09T15:40:25.352042+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:46.117604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319002+0000","last_change":"2023-10-09T15:40:26.313590+0000","last_active":"2023-10-09T15:40:26.319002+0000","last_peered":"2023-10-09T15:40:26.319002+0000","last_clean":"2023-10-09T15:40:26.319002+0000","last_became_active":"2023-10-09T15:40:26.313145+0000","last_became_peered":"2023-10-09T15:40:26.313145+0000","last_unstale":"2023-10-09T15:40:26.319002+0000","last_undegraded":"2023-10-09T15:40:26.319002+0000","last_fullsized":"2023-10-09T15:40:26.319002+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:49.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.298999+0000","last_change":"2023-10-09T15:40:25.343635+0000","last_active":"2023-10-09T15:40:26.298999+0000","last_peered":"2023-10-09T15:40:26.298999+0000","last_clean":"2023-10-09T15:40:26.298999+0000","last_became_active":"2023-10-09T15:40:25.343398+0000","last_became_peered":"2023-10-09T15:40:25.343398+0000","last_unstale":"2023-10-09T15:40:26.298999+0000","last_undegraded":"2023-10-09T15:40:26.298999+0000","last_fullsized":"2023-10-09T15:40:26.298999+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:06.029995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317751+0000","last_change":"2023-10-09T15:40:26.317751+0000","last_active":"2023-10-09T15:40:26.317751+0000","last_peered":"2023-10-09T15:40:26.317751+0000","last_clean":"2023-10-09T15:40:26.317751+0000","last_became_active":"2023-10-09T15:40:26.317415+0000","last_became_peered":"2023-10-09T15:40:26.317415+0000","last_unstale":"2023-10-09T15:40:26.317751+0000","last_undegraded":"2023-10-09T15:40:26.317751+0000","last_fullsized":"2023-10-09T15:40:26.317751+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:41.068336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.298988+0000","last_change":"2023-10-09T15:40:25.356950+0000","last_active":"2023-10-09T15:40:26.298988+0000","last_peered":"2023-10-09T15:40:26.298988+0000","last_clean":"2023-10-09T15:40:26.298988+0000","last_became_active":"2023-10-09T15:40:25.356657+0000","last_became_peered":"2023-10-09T15:40:25.356657+0000","last_unstale":"2023-10-09T15:40:26.298988+0000","last_undegraded":"2023-10-09T15:40:26.298988+0000","last_fullsized":"2023-10-09T15:40:26.298988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:55:14.607205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316258+0000","last_change":"2023-10-09T15:40:26.316258+0000","last_active":"2023-10-09T15:40:26.316258+0000","last_peered":"2023-10-09T15:40:26.316258+0000","last_clean":"2023-10-09T15:40:26.316258+0000","last_became_active":"2023-10-09T15:40:26.316034+0000","last_became_peered":"2023-10-09T15:40:26.316034+0000","last_unstale":"2023-10-09T15:40:26.316258+0000","last_undegraded":"2023-10-09T15:40:26.316258+0000","last_fullsized":"2023-10-09T15:40:26.316258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:29:51.264617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347916+0000","last_change":"2023-10-09T15:40:25.346742+0000","last_active":"2023-10-09T15:40:25.347916+0000","last_peered":"2023-10-09T15:40:25.347916+0000","last_clean":"2023-10-09T15:40:25.347916+0000","last_became_active":"2023-10-09T15:40:25.346495+0000","last_became_peered":"2023-10-09T15:40:25.346495+0000","last_unstale":"2023-10-09T15:40:25.347916+0000","last_undegraded":"2023-10-09T15:40:25.347916+0000","last_fullsized":"2023-10-09T15:40:25.347916+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:11.650753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315091+0000","last_change":"2023-10-09T15:40:26.315091+0000","last_active":"2023-10-09T15:40:26.315091+0000","last_peered":"2023-10-09T15:40:26.315091+0000","last_clean":"2023-10-09T15:40:26.315091+0000","last_became_active":"2023-10-09T15:40:26.314813+0000","last_became_peered":"2023-10-09T15:40:26.314813+0000","last_unstale":"2023-10-09T15:40:26.315091+0000","last_undegraded":"2023-10-09T15:40:26.315091+0000","last_fullsized":"2023-10-09T15:40:26.315091+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:19.982719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299043+0000","last_change":"2023-10-09T15:40:25.338679+0000","last_active":"2023-10-09T15:40:26.299043+0000","last_peered":"2023-10-09T15:40:26.299043+0000","last_clean":"2023-10-09T15:40:26.299043+0000","last_became_active":"2023-10-09T15:40:25.338395+0000","last_became_peered":"2023-10-09T15:40:25.338395+0000","last_unstale":"2023-10-09T15:40:26.299043+0000","last_undegraded":"2023-10-09T15:40:26.299043+0000","last_fullsized":"2023-10-09T15:40:26.299043+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:19.114818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326416+0000","last_change":"2023-10-09T15:40:26.325897+0000","last_active":"2023-10-09T15:40:26.326416+0000","last_peered":"2023-10-09T15:40:26.326416+0000","last_clean":"2023-10-09T15:40:26.326416+0000","last_became_active":"2023-10-09T15:40:26.325621+0000","last_became_peered":"2023-10-09T15:40:26.325621+0000","last_unstale":"2023-10-09T15:40:26.326416+0000","last_undegraded":"2023-10-09T15:40:26.326416+0000","last_fullsized":"2023-10-09T15:40:26.326416+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:31.892894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":313,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.342843+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:40:25.342843+0000","last_peered":"2023-10-09T15:40:25.342843+0000","last_clean":"2023-10-09T15:40:25.342843+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:40:25.342843+0000","last_undegraded":"2023-10-09T15:40:25.342843+0000","last_fullsized":"2023-10-09T15:40:25.342843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304444,"kb_used_data":3060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067396,"statfs":{"total":96636764160,"available":96325013504,"internally_reserved":0,"allocated":3133440,"data_stored":1732249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.874},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88300000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.45300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.48999999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.59699999999999998},"min":{"1min":0.5,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44}]},{"osd":6,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.66100000000000003},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.42999999999999999},"max":{"1min":0.96999999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40699999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78000000000000003,"5min":0.83799999999999997,"15min":0.86699999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":0.90400000000000003},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.379},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69699999999999995,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3999999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.71199999999999997},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75900000000000001,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.004},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303876,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067964,"statfs":{"total":96636764160,"available":96325595136,"internally_reserved":0,"allocated":2551808,"data_stored":1147717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.215},"max":{"1min":0.51400000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.373},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.512},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":1.286},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.40000000000000002},"min":{"1min":0.28599999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.0249999999999999},"last":0.437}]},{"osd":3,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41899999999999998,"15min":0.437},"min":{"1min":0.314,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.96899999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.435},"min":{"1min":0.33800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.222},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.94799999999999995},"last":0.69599999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.878,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.753},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.258},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41099999999999998},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.997},"last":0.872},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.75800000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.024,"15min":5.5819999999999999},"last":0.77600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304436,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067404,"statfs":{"total":96636764160,"available":96325021696,"internally_reserved":0,"allocated":3125248,"data_stored":1730732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.42599999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.48699999999999999,"5min":6.484,"15min":6.484},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.436,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.24199999999999999},"max":{"1min":0.65100000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.47699999999999998},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.45600000000000002,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.372},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44400000000000001,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.56100000000000005,"5min":2.109,"15min":4.5890000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60999999999999999,"15min":0.623},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.921,"15min":1.921},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.508},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.378},"max":{"1min":0.75,"5min":2.032,"15min":2.032},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.44900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77300000000000002,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303888,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067952,"statfs":{"total":96636764160,"available":96325582848,"internally_reserved":0,"allocated":2564096,"data_stored":1149705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33200000000000002},"min":{"1min":0.20300000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.69799999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.46800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58699999999999997,"5min":0.622,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.24099999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.67500000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86899999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.66200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.629,"15min":0.66400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95599999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.65500000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":1.0620000000000001,"15min":1.407},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.71199999999999997},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51900000000000002,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.55900000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.40799999999999997},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58999999999999997,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":1.0489999999999999},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40799999999999997,"15min":0.628},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.58799999999999997,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59799999999999998,"15min":0.93000000000000005},"min":{"1min":0.41799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89800000000000002,"5min":0.996,"15min":17.02},"last":0.876},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61399999999999999,"15min":0.81699999999999995},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.84499999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.95699999999999996},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64300000000000002,"15min":0.82799999999999996},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":0.999,"15min":9.7319999999999993},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":1.016,"15min":1.278},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65100000000000002,"15min":0.997},"min":{"1min":0.53000000000000003,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66300000000000003,"15min":0.84399999999999997},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.024,"5min":1.024,"15min":9.6029999999999998},"last":0.79500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1149129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.63600000000000001},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.88600000000000001,"15min":2.879},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77900000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.496},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.30499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65800000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88700000000000001,"5min":1.202,"15min":1.202},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.87},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":1.165},"last":0.36699999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":2.089},"last":0.624},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54400000000000004,"15min":0.77900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.79000000000000004,"15min":11.055},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.80800000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.434},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":0.82199999999999995,"5min":0.872,"15min":1.0569999999999999},"last":0.498}]},{"osd":6,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89300000000000002,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.87,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.86499999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.58299999999999996,"5min":0.45000000000000001,"15min":0.432},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:40:30.475 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:40:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.627+0000 7fb7f1f8c700 1 Processor -- start 2023-10-09T15:40:30.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.627+0000 7fb7f1f8c700 1 -- start start 2023-10-09T15:40:30.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.628+0000 7fb7f1f8c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 0x7fb7ec159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.630 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.628+0000 7fb7f1f8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.628+0000 7fb7f1f8c700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7ec06c7d0 con 0x7fb7ec15a850 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.628+0000 7fb7f1f8c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7ec1171e0 con 0x7fb7ec143200 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.628+0000 7fb7f1f8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec15ac90 con 0x7fb7ec0c3250 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eb7fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 0x7fb7ec159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:45900/0 (socket says 172.21.15.33:45900) 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 -- 172.21.15.33:0/961724665 learned_addr learned my addr 172.21.15.33:0/961724665 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7ebfff700 1 --1- 172.21.15.33:0/961724665 >> v1:172.21.15.59:6789/0 conn(0x7fb7ec15a850 0x7fb7ec06cc60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:46142/0 (socket says 172.21.15.33:46142) 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 -- 172.21.15.33:0/961724665 >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 msgr2=0x7fb7ec159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:30.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 --2- 172.21.15.33:0/961724665 >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 0x7fb7ec159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 -- 172.21.15.33:0/961724665 >> v1:172.21.15.59:6789/0 conn(0x7fb7ec15a850 legacy=0x7fb7ec06cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 -- 172.21.15.33:0/961724665 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7ec0c37a0 con 0x7fb7ec0c3250 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eb7fe700 1 --2- 172.21.15.33:0/961724665 >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 0x7fb7ec159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7eaffd700 1 --2- 172.21.15.33:0/961724665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00099b0 tx=0x7fb7e0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=19c3d6c22981f7ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.629+0000 7fb7ea7fc700 1 -- 172.21.15.33:0/961724665 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e0009ea0 con 0x7fb7ec0c3250 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7ea7fc700 1 -- 172.21.15.33:0/961724665 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e000b860 con 0x7fb7ec0c3250 2023-10-09T15:40:30.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7ea7fc700 1 -- 172.21.15.33:0/961724665 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000bc00 con 0x7fb7ec0c3250 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/961724665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 msgr2=0x7fb7ec15a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/961724665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fb7e00099b0 tx=0x7fb7e0009250 comp rx=0 tx=0).stop 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/961724665 shutdown_connections 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/961724665 >> v2:172.21.15.59:3300/0 conn(0x7fb7ec143200 0x7fb7ec159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/961724665 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec0c3250 0x7fb7ec15a310 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/961724665 >> 172.21.15.33:0/961724665 conn(0x7fb7ec0ccb60 msgr2=0x7fb7ec0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/961724665 shutdown_connections 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.630+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/961724665 wait complete. 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.631+0000 7fb7f1f8c700 1 Processor -- start 2023-10-09T15:40:30.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.631+0000 7fb7f1f8c700 1 -- start start 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 0x7fb7ec167750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec15a850 0x7fb7ec16c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec12a8e0 con 0x7fb7ec143200 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec16bd80 con 0x7fb7ec0c3250 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7f1f8c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7ec16b170 con 0x7fb7ec15a850 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7eaffd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:33618/0 (socket says 172.21.15.33:33618) 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7eaffd700 1 -- 172.21.15.33:0/2299950999 learned_addr learned my addr 172.21.15.33:0/2299950999 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7eb7fe700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 0x7fb7ec167750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.632+0000 7fb7ebfff700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec15a850 0x7fb7ec16c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 -- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec15a850 msgr2=0x7fb7ec16c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec15a850 0x7fb7ec16c210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 -- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 msgr2=0x7fb7ec167750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 0x7fb7ec167750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 -- 172.21.15.33:0/2299950999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009420 con 0x7fb7ec143200 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eb7fe700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 0x7fb7ec167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7eaffd700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e000bbe0 con 0x7fb7ec143200 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7e0011420 con 0x7fb7ec143200 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e00094f0 con 0x7fb7ec143200 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7e00117c0 con 0x7fb7ec143200 2023-10-09T15:40:30.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.633+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7ec16b730 con 0x7fb7ec143200 2023-10-09T15:40:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.634+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7ec16bf10 con 0x7fb7ec143200 2023-10-09T15:40:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.634+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb7e0011bb0 con 0x7fb7ec143200 2023-10-09T15:40:30.638 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.635+0000 7fb7d37fe700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 0x7fb7d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.635+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fb7e00865a0 con 0x7fb7ec143200 2023-10-09T15:40:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.635+0000 7fb7eb7fe700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 0x7fb7d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:30.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.635+0000 7fb7eb7fe700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 0x7fb7d80697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0093f0 tx=0x7fb7dc008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:30.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.639+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fb7e0053230 con 0x7fb7ec143200 2023-10-09T15:40:30.831 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.830+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fb7ec04c3c0 con 0x7fb7d8067320 2023-10-09T15:40:30.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.838+0000 7fb7d37fe700 1 -- 172.21.15.33:0/2299950999 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+289820 (secure 0 0 0) 0x7fb7ec04c3c0 con 0x7fb7d8067320 2023-10-09T15:40:30.842 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 msgr2=0x7fb7d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 0x7fb7d80697d0 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fb7dc0093f0 tx=0x7fb7dc008040 comp rx=0 tx=0).stop 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 msgr2=0x7fb7ec15e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0006fd0 tx=0x7fb7e0017000 comp rx=0 tx=0).stop 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 shutdown_connections 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb7d8067320 0x7fb7d80697d0 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb7ec15a850 0x7fb7ec16c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb7ec0c3250 0x7fb7ec167750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 --2- 172.21.15.33:0/2299950999 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb7ec143200 0x7fb7ec15e300 unknown :-1 s=CLOSED pgs=1761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 >> 172.21.15.33:0/2299950999 conn(0x7fb7ec0ccb60 msgr2=0x7fb7ec13ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 shutdown_connections 2023-10-09T15:40:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:30.841+0000 7fb7f1f8c700 1 -- 172.21.15.33:0/2299950999 wait complete. 2023-10-09T15:40:30.845 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:40:30.854 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":481,"stamp":"2023-10-09T15:40:29.349768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592674,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2429,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432104,"kb_used_data":21032,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542616,"statfs":{"total":773094113280,"available":770603638784,"internally_reserved":0,"allocated":21536768,"data_stored":10333641,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.020812"},"pg_stats":[{"pgid":"34.3f","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321867+0000","last_change":"2023-10-09T15:40:26.318869+0000","last_active":"2023-10-09T15:40:26.321867+0000","last_peered":"2023-10-09T15:40:26.321867+0000","last_clean":"2023-10-09T15:40:26.321867+0000","last_became_active":"2023-10-09T15:40:26.318505+0000","last_became_peered":"2023-10-09T15:40:26.318505+0000","last_unstale":"2023-10-09T15:40:26.321867+0000","last_undegraded":"2023-10-09T15:40:26.321867+0000","last_fullsized":"2023-10-09T15:40:26.321867+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:29:00.189132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.3e","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315767+0000","last_change":"2023-10-09T15:40:26.315767+0000","last_active":"2023-10-09T15:40:26.315767+0000","last_peered":"2023-10-09T15:40:26.315767+0000","last_clean":"2023-10-09T15:40:26.315767+0000","last_became_active":"2023-10-09T15:40:26.315437+0000","last_became_peered":"2023-10-09T15:40:26.315437+0000","last_unstale":"2023-10-09T15:40:26.315767+0000","last_undegraded":"2023-10-09T15:40:26.315767+0000","last_fullsized":"2023-10-09T15:40:26.315767+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:48:49.200700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.3d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322931+0000","last_change":"2023-10-09T15:40:26.322931+0000","last_active":"2023-10-09T15:40:26.322931+0000","last_peered":"2023-10-09T15:40:26.322931+0000","last_clean":"2023-10-09T15:40:26.322931+0000","last_became_active":"2023-10-09T15:40:26.322616+0000","last_became_peered":"2023-10-09T15:40:26.322616+0000","last_unstale":"2023-10-09T15:40:26.322931+0000","last_undegraded":"2023-10-09T15:40:26.322931+0000","last_fullsized":"2023-10-09T15:40:26.322931+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:42:05.230917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3c","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319678+0000","last_change":"2023-10-09T15:40:26.317403+0000","last_active":"2023-10-09T15:40:26.319678+0000","last_peered":"2023-10-09T15:40:26.319678+0000","last_clean":"2023-10-09T15:40:26.319678+0000","last_became_active":"2023-10-09T15:40:26.316723+0000","last_became_peered":"2023-10-09T15:40:26.316723+0000","last_unstale":"2023-10-09T15:40:26.319678+0000","last_undegraded":"2023-10-09T15:40:26.319678+0000","last_fullsized":"2023-10-09T15:40:26.319678+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:45:50.777891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.3b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317032+0000","last_change":"2023-10-09T15:40:26.313483+0000","last_active":"2023-10-09T15:40:26.317032+0000","last_peered":"2023-10-09T15:40:26.317032+0000","last_clean":"2023-10-09T15:40:26.317032+0000","last_became_active":"2023-10-09T15:40:26.313148+0000","last_became_peered":"2023-10-09T15:40:26.313148+0000","last_unstale":"2023-10-09T15:40:26.317032+0000","last_undegraded":"2023-10-09T15:40:26.317032+0000","last_fullsized":"2023-10-09T15:40:26.317032+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:27:44.917250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.3a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.323903+0000","last_change":"2023-10-09T15:40:26.323903+0000","last_active":"2023-10-09T15:40:26.323903+0000","last_peered":"2023-10-09T15:40:26.323903+0000","last_clean":"2023-10-09T15:40:26.323903+0000","last_became_active":"2023-10-09T15:40:26.323664+0000","last_became_peered":"2023-10-09T15:40:26.323664+0000","last_unstale":"2023-10-09T15:40:26.323903+0000","last_undegraded":"2023-10-09T15:40:26.323903+0000","last_fullsized":"2023-10-09T15:40:26.323903+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.733721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.39","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.325625+0000","last_change":"2023-10-09T15:40:26.325625+0000","last_active":"2023-10-09T15:40:26.325625+0000","last_peered":"2023-10-09T15:40:26.325625+0000","last_clean":"2023-10-09T15:40:26.325625+0000","last_became_active":"2023-10-09T15:40:26.325335+0000","last_became_peered":"2023-10-09T15:40:26.325335+0000","last_unstale":"2023-10-09T15:40:26.325625+0000","last_undegraded":"2023-10-09T15:40:26.325625+0000","last_fullsized":"2023-10-09T15:40:26.325625+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:58:09.100493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.38","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310853+0000","last_change":"2023-10-09T15:40:26.308814+0000","last_active":"2023-10-09T15:40:26.310853+0000","last_peered":"2023-10-09T15:40:26.310853+0000","last_clean":"2023-10-09T15:40:26.310853+0000","last_became_active":"2023-10-09T15:40:26.308527+0000","last_became_peered":"2023-10-09T15:40:26.308527+0000","last_unstale":"2023-10-09T15:40:26.310853+0000","last_undegraded":"2023-10-09T15:40:26.310853+0000","last_fullsized":"2023-10-09T15:40:26.310853+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:00:22.651375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.37","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317886+0000","last_change":"2023-10-09T15:40:26.317886+0000","last_active":"2023-10-09T15:40:26.317886+0000","last_peered":"2023-10-09T15:40:26.317886+0000","last_clean":"2023-10-09T15:40:26.317886+0000","last_became_active":"2023-10-09T15:40:26.317598+0000","last_became_peered":"2023-10-09T15:40:26.317598+0000","last_unstale":"2023-10-09T15:40:26.317886+0000","last_undegraded":"2023-10-09T15:40:26.317886+0000","last_fullsized":"2023-10-09T15:40:26.317886+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:48.071778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.36","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324944+0000","last_change":"2023-10-09T15:40:26.324944+0000","last_active":"2023-10-09T15:40:26.324944+0000","last_peered":"2023-10-09T15:40:26.324944+0000","last_clean":"2023-10-09T15:40:26.324944+0000","last_became_active":"2023-10-09T15:40:26.324646+0000","last_became_peered":"2023-10-09T15:40:26.324646+0000","last_unstale":"2023-10-09T15:40:26.324944+0000","last_undegraded":"2023-10-09T15:40:26.324944+0000","last_fullsized":"2023-10-09T15:40:26.324944+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.705589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.35","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318597+0000","last_change":"2023-10-09T15:40:26.314482+0000","last_active":"2023-10-09T15:40:26.318597+0000","last_peered":"2023-10-09T15:40:26.318597+0000","last_clean":"2023-10-09T15:40:26.318597+0000","last_became_active":"2023-10-09T15:40:26.313988+0000","last_became_peered":"2023-10-09T15:40:26.313988+0000","last_unstale":"2023-10-09T15:40:26.318597+0000","last_undegraded":"2023-10-09T15:40:26.318597+0000","last_fullsized":"2023-10-09T15:40:26.318597+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:15.637977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.34","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.325242+0000","last_change":"2023-10-09T15:40:26.325242+0000","last_active":"2023-10-09T15:40:26.325242+0000","last_peered":"2023-10-09T15:40:26.325242+0000","last_clean":"2023-10-09T15:40:26.325242+0000","last_became_active":"2023-10-09T15:40:26.324955+0000","last_became_peered":"2023-10-09T15:40:26.324955+0000","last_unstale":"2023-10-09T15:40:26.325242+0000","last_undegraded":"2023-10-09T15:40:26.325242+0000","last_fullsized":"2023-10-09T15:40:26.325242+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:58.019628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.33","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326692+0000","last_change":"2023-10-09T15:40:26.326028+0000","last_active":"2023-10-09T15:40:26.326692+0000","last_peered":"2023-10-09T15:40:26.326692+0000","last_clean":"2023-10-09T15:40:26.326692+0000","last_became_active":"2023-10-09T15:40:26.325682+0000","last_became_peered":"2023-10-09T15:40:26.325682+0000","last_unstale":"2023-10-09T15:40:26.326692+0000","last_undegraded":"2023-10-09T15:40:26.326692+0000","last_fullsized":"2023-10-09T15:40:26.326692+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:34:45.618659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.32","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310474+0000","last_change":"2023-10-09T15:40:26.310474+0000","last_active":"2023-10-09T15:40:26.310474+0000","last_peered":"2023-10-09T15:40:26.310474+0000","last_clean":"2023-10-09T15:40:26.310474+0000","last_became_active":"2023-10-09T15:40:26.309135+0000","last_became_peered":"2023-10-09T15:40:26.309135+0000","last_unstale":"2023-10-09T15:40:26.310474+0000","last_undegraded":"2023-10-09T15:40:26.310474+0000","last_fullsized":"2023-10-09T15:40:26.310474+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:18.512494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.31","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322471+0000","last_change":"2023-10-09T15:40:26.322471+0000","last_active":"2023-10-09T15:40:26.322471+0000","last_peered":"2023-10-09T15:40:26.322471+0000","last_clean":"2023-10-09T15:40:26.322471+0000","last_became_active":"2023-10-09T15:40:26.322136+0000","last_became_peered":"2023-10-09T15:40:26.322136+0000","last_unstale":"2023-10-09T15:40:26.322471+0000","last_undegraded":"2023-10-09T15:40:26.322471+0000","last_fullsized":"2023-10-09T15:40:26.322471+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:05:28.355138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.30","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.320498+0000","last_change":"2023-10-09T15:40:26.320498+0000","last_active":"2023-10-09T15:40:26.320498+0000","last_peered":"2023-10-09T15:40:26.320498+0000","last_clean":"2023-10-09T15:40:26.320498+0000","last_became_active":"2023-10-09T15:40:26.320201+0000","last_became_peered":"2023-10-09T15:40:26.320201+0000","last_unstale":"2023-10-09T15:40:26.320498+0000","last_undegraded":"2023-10-09T15:40:26.320498+0000","last_fullsized":"2023-10-09T15:40:26.320498+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:23.626710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324919+0000","last_change":"2023-10-09T15:40:26.324919+0000","last_active":"2023-10-09T15:40:26.324919+0000","last_peered":"2023-10-09T15:40:26.324919+0000","last_clean":"2023-10-09T15:40:26.324919+0000","last_became_active":"2023-10-09T15:40:26.324616+0000","last_became_peered":"2023-10-09T15:40:26.324616+0000","last_unstale":"2023-10-09T15:40:26.324919+0000","last_undegraded":"2023-10-09T15:40:26.324919+0000","last_fullsized":"2023-10-09T15:40:26.324919+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:02.963269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.309172+0000","last_change":"2023-10-09T15:40:26.306117+0000","last_active":"2023-10-09T15:40:26.309172+0000","last_peered":"2023-10-09T15:40:26.309172+0000","last_clean":"2023-10-09T15:40:26.309172+0000","last_became_active":"2023-10-09T15:40:26.305826+0000","last_became_peered":"2023-10-09T15:40:26.305826+0000","last_unstale":"2023-10-09T15:40:26.309172+0000","last_undegraded":"2023-10-09T15:40:26.309172+0000","last_fullsized":"2023-10-09T15:40:26.309172+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:33:52.345085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2d","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314395+0000","last_change":"2023-10-09T15:40:26.314395+0000","last_active":"2023-10-09T15:40:26.314395+0000","last_peered":"2023-10-09T15:40:26.314395+0000","last_clean":"2023-10-09T15:40:26.314395+0000","last_became_active":"2023-10-09T15:40:26.313888+0000","last_became_peered":"2023-10-09T15:40:26.313888+0000","last_unstale":"2023-10-09T15:40:26.314395+0000","last_undegraded":"2023-10-09T15:40:26.314395+0000","last_fullsized":"2023-10-09T15:40:26.314395+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:20.061024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.2c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322877+0000","last_change":"2023-10-09T15:40:26.322877+0000","last_active":"2023-10-09T15:40:26.322877+0000","last_peered":"2023-10-09T15:40:26.322877+0000","last_clean":"2023-10-09T15:40:26.322877+0000","last_became_active":"2023-10-09T15:40:26.322565+0000","last_became_peered":"2023-10-09T15:40:26.322565+0000","last_unstale":"2023-10-09T15:40:26.322877+0000","last_undegraded":"2023-10-09T15:40:26.322877+0000","last_fullsized":"2023-10-09T15:40:26.322877+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:45:20.061024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.2b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317051+0000","last_change":"2023-10-09T15:40:26.313933+0000","last_active":"2023-10-09T15:40:26.317051+0000","last_peered":"2023-10-09T15:40:26.317051+0000","last_clean":"2023-10-09T15:40:26.317051+0000","last_became_active":"2023-10-09T15:40:26.313656+0000","last_became_peered":"2023-10-09T15:40:26.313656+0000","last_unstale":"2023-10-09T15:40:26.317051+0000","last_undegraded":"2023-10-09T15:40:26.317051+0000","last_fullsized":"2023-10-09T15:40:26.317051+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:55.815173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.2a","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324234+0000","last_change":"2023-10-09T15:40:26.319815+0000","last_active":"2023-10-09T15:40:26.324234+0000","last_peered":"2023-10-09T15:40:26.324234+0000","last_clean":"2023-10-09T15:40:26.324234+0000","last_became_active":"2023-10-09T15:40:26.319447+0000","last_became_peered":"2023-10-09T15:40:26.319447+0000","last_unstale":"2023-10-09T15:40:26.324234+0000","last_undegraded":"2023-10-09T15:40:26.324234+0000","last_fullsized":"2023-10-09T15:40:26.324234+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:44:05.759972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.29","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317612+0000","last_change":"2023-10-09T15:40:26.317612+0000","last_active":"2023-10-09T15:40:26.317612+0000","last_peered":"2023-10-09T15:40:26.317612+0000","last_clean":"2023-10-09T15:40:26.317612+0000","last_became_active":"2023-10-09T15:40:26.316562+0000","last_became_peered":"2023-10-09T15:40:26.316562+0000","last_unstale":"2023-10-09T15:40:26.317612+0000","last_undegraded":"2023-10-09T15:40:26.317612+0000","last_fullsized":"2023-10-09T15:40:26.317612+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:52:25.585176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.28","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324522+0000","last_change":"2023-10-09T15:40:26.321302+0000","last_active":"2023-10-09T15:40:26.324522+0000","last_peered":"2023-10-09T15:40:26.324522+0000","last_clean":"2023-10-09T15:40:26.324522+0000","last_became_active":"2023-10-09T15:40:26.321011+0000","last_became_peered":"2023-10-09T15:40:26.321011+0000","last_unstale":"2023-10-09T15:40:26.324522+0000","last_undegraded":"2023-10-09T15:40:26.324522+0000","last_fullsized":"2023-10-09T15:40:26.324522+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:11:56.879441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.27","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319330+0000","last_change":"2023-10-09T15:40:26.319330+0000","last_active":"2023-10-09T15:40:26.319330+0000","last_peered":"2023-10-09T15:40:26.319330+0000","last_clean":"2023-10-09T15:40:26.319330+0000","last_became_active":"2023-10-09T15:40:26.318917+0000","last_became_peered":"2023-10-09T15:40:26.318917+0000","last_unstale":"2023-10-09T15:40:26.319330+0000","last_undegraded":"2023-10-09T15:40:26.319330+0000","last_fullsized":"2023-10-09T15:40:26.319330+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:26:54.929832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.26","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315389+0000","last_change":"2023-10-09T15:40:26.315389+0000","last_active":"2023-10-09T15:40:26.315389+0000","last_peered":"2023-10-09T15:40:26.315389+0000","last_clean":"2023-10-09T15:40:26.315389+0000","last_became_active":"2023-10-09T15:40:26.314846+0000","last_became_peered":"2023-10-09T15:40:26.314846+0000","last_unstale":"2023-10-09T15:40:26.315389+0000","last_undegraded":"2023-10-09T15:40:26.315389+0000","last_fullsized":"2023-10-09T15:40:26.315389+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:00:33.620386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.25","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324197+0000","last_change":"2023-10-09T15:40:26.319529+0000","last_active":"2023-10-09T15:40:26.324197+0000","last_peered":"2023-10-09T15:40:26.324197+0000","last_clean":"2023-10-09T15:40:26.324197+0000","last_became_active":"2023-10-09T15:40:26.318366+0000","last_became_peered":"2023-10-09T15:40:26.318366+0000","last_unstale":"2023-10-09T15:40:26.324197+0000","last_undegraded":"2023-10-09T15:40:26.324197+0000","last_fullsized":"2023-10-09T15:40:26.324197+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:25:45.241538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.24","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321829+0000","last_change":"2023-10-09T15:40:26.318043+0000","last_active":"2023-10-09T15:40:26.321829+0000","last_peered":"2023-10-09T15:40:26.321829+0000","last_clean":"2023-10-09T15:40:26.321829+0000","last_became_active":"2023-10-09T15:40:26.317715+0000","last_became_peered":"2023-10-09T15:40:26.317715+0000","last_unstale":"2023-10-09T15:40:26.321829+0000","last_undegraded":"2023-10-09T15:40:26.321829+0000","last_fullsized":"2023-10-09T15:40:26.321829+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:03:18.102607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.22","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316306+0000","last_change":"2023-10-09T15:40:26.316306+0000","last_active":"2023-10-09T15:40:26.316306+0000","last_peered":"2023-10-09T15:40:26.316306+0000","last_clean":"2023-10-09T15:40:26.316306+0000","last_became_active":"2023-10-09T15:40:26.315976+0000","last_became_peered":"2023-10-09T15:40:26.315976+0000","last_unstale":"2023-10-09T15:40:26.316306+0000","last_undegraded":"2023-10-09T15:40:26.316306+0000","last_fullsized":"2023-10-09T15:40:26.316306+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:40.705589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.21","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315784+0000","last_change":"2023-10-09T15:40:26.315784+0000","last_active":"2023-10-09T15:40:26.315784+0000","last_peered":"2023-10-09T15:40:26.315784+0000","last_clean":"2023-10-09T15:40:26.315784+0000","last_became_active":"2023-10-09T15:40:26.315465+0000","last_became_peered":"2023-10-09T15:40:26.315465+0000","last_unstale":"2023-10-09T15:40:26.315784+0000","last_undegraded":"2023-10-09T15:40:26.315784+0000","last_fullsized":"2023-10-09T15:40:26.315784+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:53:56.447654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.20","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311632+0000","last_change":"2023-10-09T15:40:26.311632+0000","last_active":"2023-10-09T15:40:26.311632+0000","last_peered":"2023-10-09T15:40:26.311632+0000","last_clean":"2023-10-09T15:40:26.311632+0000","last_became_active":"2023-10-09T15:40:26.310580+0000","last_became_peered":"2023-10-09T15:40:26.310580+0000","last_unstale":"2023-10-09T15:40:26.311632+0000","last_undegraded":"2023-10-09T15:40:26.311632+0000","last_fullsized":"2023-10-09T15:40:26.311632+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:00:04.652406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1c","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317330+0000","last_change":"2023-10-09T15:40:26.317330+0000","last_active":"2023-10-09T15:40:26.317330+0000","last_peered":"2023-10-09T15:40:26.317330+0000","last_clean":"2023-10-09T15:40:26.317330+0000","last_became_active":"2023-10-09T15:40:26.317062+0000","last_became_peered":"2023-10-09T15:40:26.317062+0000","last_unstale":"2023-10-09T15:40:26.317330+0000","last_undegraded":"2023-10-09T15:40:26.317330+0000","last_fullsized":"2023-10-09T15:40:26.317330+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:32.733721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.1f","version":"199'4","reported_seq":14,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360281+0000","last_change":"2023-10-09T15:40:25.343565+0000","last_active":"2023-10-09T15:40:26.360281+0000","last_peered":"2023-10-09T15:40:26.360281+0000","last_clean":"2023-10-09T15:40:26.360281+0000","last_became_active":"2023-10-09T15:40:25.343257+0000","last_became_peered":"2023-10-09T15:40:25.343257+0000","last_unstale":"2023-10-09T15:40:26.360281+0000","last_undegraded":"2023-10-09T15:40:26.360281+0000","last_fullsized":"2023-10-09T15:40:26.360281+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:47:33.752345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":554,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1d","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318636+0000","last_change":"2023-10-09T15:40:26.314058+0000","last_active":"2023-10-09T15:40:26.318636+0000","last_peered":"2023-10-09T15:40:26.318636+0000","last_clean":"2023-10-09T15:40:26.318636+0000","last_became_active":"2023-10-09T15:40:26.313749+0000","last_became_peered":"2023-10-09T15:40:26.313749+0000","last_unstale":"2023-10-09T15:40:26.318636+0000","last_undegraded":"2023-10-09T15:40:26.318636+0000","last_fullsized":"2023-10-09T15:40:26.318636+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:58:55.774140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1e","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.308341+0000","last_change":"2023-10-09T15:40:25.345211+0000","last_active":"2023-10-09T15:40:26.308341+0000","last_peered":"2023-10-09T15:40:26.308341+0000","last_clean":"2023-10-09T15:40:26.308341+0000","last_became_active":"2023-10-09T15:40:25.344931+0000","last_became_peered":"2023-10-09T15:40:25.344931+0000","last_unstale":"2023-10-09T15:40:26.308341+0000","last_undegraded":"2023-10-09T15:40:26.308341+0000","last_fullsized":"2023-10-09T15:40:26.308341+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:25:44.235162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.310746+0000","last_change":"2023-10-09T15:40:26.309006+0000","last_active":"2023-10-09T15:40:26.310746+0000","last_peered":"2023-10-09T15:40:26.310746+0000","last_clean":"2023-10-09T15:40:26.310746+0000","last_became_active":"2023-10-09T15:40:26.308738+0000","last_became_peered":"2023-10-09T15:40:26.308738+0000","last_unstale":"2023-10-09T15:40:26.310746+0000","last_undegraded":"2023-10-09T15:40:26.310746+0000","last_fullsized":"2023-10-09T15:40:26.310746+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:45:54.935944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.1d","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.362485+0000","last_change":"2023-10-09T15:40:25.345445+0000","last_active":"2023-10-09T15:40:26.362485+0000","last_peered":"2023-10-09T15:40:26.362485+0000","last_clean":"2023-10-09T15:40:26.362485+0000","last_became_active":"2023-10-09T15:40:25.345143+0000","last_became_peered":"2023-10-09T15:40:25.345143+0000","last_unstale":"2023-10-09T15:40:26.362485+0000","last_undegraded":"2023-10-09T15:40:26.362485+0000","last_fullsized":"2023-10-09T15:40:26.362485+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:29:15.830988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"34.1f","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312184+0000","last_change":"2023-10-09T15:40:26.312184+0000","last_active":"2023-10-09T15:40:26.312184+0000","last_peered":"2023-10-09T15:40:26.312184+0000","last_clean":"2023-10-09T15:40:26.312184+0000","last_became_active":"2023-10-09T15:40:26.311877+0000","last_became_peered":"2023-10-09T15:40:26.311877+0000","last_unstale":"2023-10-09T15:40:26.312184+0000","last_undegraded":"2023-10-09T15:40:26.312184+0000","last_fullsized":"2023-10-09T15:40:26.312184+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:47:42.767918+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1c","version":"199'2","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.358531+0000","last_change":"2023-10-09T15:40:25.342061+0000","last_active":"2023-10-09T15:40:26.358531+0000","last_peered":"2023-10-09T15:40:26.358531+0000","last_clean":"2023-10-09T15:40:26.358531+0000","last_became_active":"2023-10-09T15:40:25.341776+0000","last_became_peered":"2023-10-09T15:40:25.341776+0000","last_unstale":"2023-10-09T15:40:26.358531+0000","last_undegraded":"2023-10-09T15:40:26.358531+0000","last_fullsized":"2023-10-09T15:40:26.358531+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:09.256958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.18","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311780+0000","last_change":"2023-10-09T15:40:26.311780+0000","last_active":"2023-10-09T15:40:26.311780+0000","last_peered":"2023-10-09T15:40:26.311780+0000","last_clean":"2023-10-09T15:40:26.311780+0000","last_became_active":"2023-10-09T15:40:26.311500+0000","last_became_peered":"2023-10-09T15:40:26.311500+0000","last_unstale":"2023-10-09T15:40:26.311780+0000","last_undegraded":"2023-10-09T15:40:26.311780+0000","last_fullsized":"2023-10-09T15:40:26.311780+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:24:37.291252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1b","version":"199'1","reported_seq":11,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.355982+0000","last_change":"2023-10-09T15:40:25.347283+0000","last_active":"2023-10-09T15:40:26.355982+0000","last_peered":"2023-10-09T15:40:26.355982+0000","last_clean":"2023-10-09T15:40:26.355982+0000","last_became_active":"2023-10-09T15:40:25.346989+0000","last_became_peered":"2023-10-09T15:40:25.346989+0000","last_unstale":"2023-10-09T15:40:26.355982+0000","last_undegraded":"2023-10-09T15:40:26.355982+0000","last_fullsized":"2023-10-09T15:40:26.355982+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:33.021649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.19","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315839+0000","last_change":"2023-10-09T15:40:26.315839+0000","last_active":"2023-10-09T15:40:26.315839+0000","last_peered":"2023-10-09T15:40:26.315839+0000","last_clean":"2023-10-09T15:40:26.315839+0000","last_became_active":"2023-10-09T15:40:26.315547+0000","last_became_peered":"2023-10-09T15:40:26.315547+0000","last_unstale":"2023-10-09T15:40:26.315839+0000","last_undegraded":"2023-10-09T15:40:26.315839+0000","last_fullsized":"2023-10-09T15:40:26.315839+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:46:52.113930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1a","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.304367+0000","last_change":"2023-10-09T15:40:25.350293+0000","last_active":"2023-10-09T15:40:26.304367+0000","last_peered":"2023-10-09T15:40:26.304367+0000","last_clean":"2023-10-09T15:40:26.304367+0000","last_became_active":"2023-10-09T15:40:25.350006+0000","last_became_peered":"2023-10-09T15:40:25.350006+0000","last_unstale":"2023-10-09T15:40:26.304367+0000","last_undegraded":"2023-10-09T15:40:26.304367+0000","last_fullsized":"2023-10-09T15:40:26.304367+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:51.567794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.1a","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319154+0000","last_change":"2023-10-09T15:40:26.319154+0000","last_active":"2023-10-09T15:40:26.319154+0000","last_peered":"2023-10-09T15:40:26.319154+0000","last_clean":"2023-10-09T15:40:26.319154+0000","last_became_active":"2023-10-09T15:40:26.318838+0000","last_became_peered":"2023-10-09T15:40:26.318838+0000","last_unstale":"2023-10-09T15:40:26.319154+0000","last_undegraded":"2023-10-09T15:40:26.319154+0000","last_fullsized":"2023-10-09T15:40:26.319154+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:14:41.956731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.19","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347826+0000","last_change":"2023-10-09T15:40:25.345840+0000","last_active":"2023-10-09T15:40:25.347826+0000","last_peered":"2023-10-09T15:40:25.347826+0000","last_clean":"2023-10-09T15:40:25.347826+0000","last_became_active":"2023-10-09T15:40:25.345534+0000","last_became_peered":"2023-10-09T15:40:25.345534+0000","last_unstale":"2023-10-09T15:40:25.347826+0000","last_undegraded":"2023-10-09T15:40:25.347826+0000","last_fullsized":"2023-10-09T15:40:25.347826+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:49.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.1b","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.323533+0000","last_change":"2023-10-09T15:40:26.322948+0000","last_active":"2023-10-09T15:40:26.323533+0000","last_peered":"2023-10-09T15:40:26.323533+0000","last_clean":"2023-10-09T15:40:26.323533+0000","last_became_active":"2023-10-09T15:40:26.322601+0000","last_became_peered":"2023-10-09T15:40:26.322601+0000","last_unstale":"2023-10-09T15:40:26.323533+0000","last_undegraded":"2023-10-09T15:40:26.323533+0000","last_fullsized":"2023-10-09T15:40:26.323533+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:05:30.104005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.18","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.301715+0000","last_change":"2023-10-09T15:40:25.347938+0000","last_active":"2023-10-09T15:40:26.301715+0000","last_peered":"2023-10-09T15:40:26.301715+0000","last_clean":"2023-10-09T15:40:26.301715+0000","last_became_active":"2023-10-09T15:40:25.347581+0000","last_became_peered":"2023-10-09T15:40:25.347581+0000","last_unstale":"2023-10-09T15:40:26.301715+0000","last_undegraded":"2023-10-09T15:40:26.301715+0000","last_fullsized":"2023-10-09T15:40:26.301715+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:16:31.727346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.14","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318817+0000","last_change":"2023-10-09T15:40:26.313768+0000","last_active":"2023-10-09T15:40:26.318817+0000","last_peered":"2023-10-09T15:40:26.318817+0000","last_clean":"2023-10-09T15:40:26.318817+0000","last_became_active":"2023-10-09T15:40:26.313451+0000","last_became_peered":"2023-10-09T15:40:26.313451+0000","last_unstale":"2023-10-09T15:40:26.318817+0000","last_undegraded":"2023-10-09T15:40:26.318817+0000","last_fullsized":"2023-10-09T15:40:26.318817+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:13:11.271668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.17","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305900+0000","last_change":"2023-10-09T15:40:25.356167+0000","last_active":"2023-10-09T15:40:26.305900+0000","last_peered":"2023-10-09T15:40:26.305900+0000","last_clean":"2023-10-09T15:40:26.305900+0000","last_became_active":"2023-10-09T15:40:25.355761+0000","last_became_peered":"2023-10-09T15:40:25.355761+0000","last_unstale":"2023-10-09T15:40:26.305900+0000","last_undegraded":"2023-10-09T15:40:26.305900+0000","last_fullsized":"2023-10-09T15:40:26.305900+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:36.050495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.15","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322723+0000","last_change":"2023-10-09T15:40:26.322354+0000","last_active":"2023-10-09T15:40:26.322723+0000","last_peered":"2023-10-09T15:40:26.322723+0000","last_clean":"2023-10-09T15:40:26.322723+0000","last_became_active":"2023-10-09T15:40:26.322082+0000","last_became_peered":"2023-10-09T15:40:26.322082+0000","last_unstale":"2023-10-09T15:40:26.322723+0000","last_undegraded":"2023-10-09T15:40:26.322723+0000","last_fullsized":"2023-10-09T15:40:26.322723+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:08:16.445761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"33.16","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347724+0000","last_change":"2023-10-09T15:40:25.344658+0000","last_active":"2023-10-09T15:40:25.347724+0000","last_peered":"2023-10-09T15:40:25.347724+0000","last_clean":"2023-10-09T15:40:25.347724+0000","last_became_active":"2023-10-09T15:40:25.344347+0000","last_became_peered":"2023-10-09T15:40:25.344347+0000","last_unstale":"2023-10-09T15:40:25.347724+0000","last_undegraded":"2023-10-09T15:40:25.347724+0000","last_fullsized":"2023-10-09T15:40:25.347724+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:39:14.631601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"34.16","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317564+0000","last_change":"2023-10-09T15:40:26.317564+0000","last_active":"2023-10-09T15:40:26.317564+0000","last_peered":"2023-10-09T15:40:26.317564+0000","last_clean":"2023-10-09T15:40:26.317564+0000","last_became_active":"2023-10-09T15:40:26.316416+0000","last_became_peered":"2023-10-09T15:40:26.316416+0000","last_unstale":"2023-10-09T15:40:26.317564+0000","last_undegraded":"2023-10-09T15:40:26.317564+0000","last_fullsized":"2023-10-09T15:40:26.317564+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:05:02.963269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.15","version":"199'3","reported_seq":13,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360643+0000","last_change":"2023-10-09T15:40:25.356325+0000","last_active":"2023-10-09T15:40:26.360643+0000","last_peered":"2023-10-09T15:40:26.360643+0000","last_clean":"2023-10-09T15:40:26.360643+0000","last_became_active":"2023-10-09T15:40:25.355721+0000","last_became_peered":"2023-10-09T15:40:25.355721+0000","last_unstale":"2023-10-09T15:40:26.360643+0000","last_undegraded":"2023-10-09T15:40:26.360643+0000","last_fullsized":"2023-10-09T15:40:26.360643+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:21:17.506118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.17","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314285+0000","last_change":"2023-10-09T15:40:26.313384+0000","last_active":"2023-10-09T15:40:26.314285+0000","last_peered":"2023-10-09T15:40:26.314285+0000","last_clean":"2023-10-09T15:40:26.314285+0000","last_became_active":"2023-10-09T15:40:26.313153+0000","last_became_peered":"2023-10-09T15:40:26.313153+0000","last_unstale":"2023-10-09T15:40:26.314285+0000","last_undegraded":"2023-10-09T15:40:26.314285+0000","last_fullsized":"2023-10-09T15:40:26.314285+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:45:12.782639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.14","version":"199'6","reported_seq":16,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.363412+0000","last_change":"2023-10-09T15:40:25.340403+0000","last_active":"2023-10-09T15:40:26.363412+0000","last_peered":"2023-10-09T15:40:26.363412+0000","last_clean":"2023-10-09T15:40:26.363412+0000","last_became_active":"2023-10-09T15:40:25.340118+0000","last_became_peered":"2023-10-09T15:40:25.340118+0000","last_unstale":"2023-10-09T15:40:26.363412+0000","last_undegraded":"2023-10-09T15:40:26.363412+0000","last_fullsized":"2023-10-09T15:40:26.363412+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:14:45.805446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1536,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.10","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312697+0000","last_change":"2023-10-09T15:40:26.309178+0000","last_active":"2023-10-09T15:40:26.312697+0000","last_peered":"2023-10-09T15:40:26.312697+0000","last_clean":"2023-10-09T15:40:26.312697+0000","last_became_active":"2023-10-09T15:40:26.308905+0000","last_became_peered":"2023-10-09T15:40:26.308905+0000","last_unstale":"2023-10-09T15:40:26.312697+0000","last_undegraded":"2023-10-09T15:40:26.312697+0000","last_fullsized":"2023-10-09T15:40:26.312697+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:55:30.969553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.13","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.358225+0000","last_change":"2023-10-09T15:40:25.347974+0000","last_active":"2023-10-09T15:40:26.358225+0000","last_peered":"2023-10-09T15:40:26.358225+0000","last_clean":"2023-10-09T15:40:26.358225+0000","last_became_active":"2023-10-09T15:40:25.347597+0000","last_became_peered":"2023-10-09T15:40:25.347597+0000","last_unstale":"2023-10-09T15:40:26.358225+0000","last_undegraded":"2023-10-09T15:40:26.358225+0000","last_fullsized":"2023-10-09T15:40:26.358225+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:07:47.065402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.11","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324493+0000","last_change":"2023-10-09T15:40:26.320763+0000","last_active":"2023-10-09T15:40:26.324493+0000","last_peered":"2023-10-09T15:40:26.324493+0000","last_clean":"2023-10-09T15:40:26.324493+0000","last_became_active":"2023-10-09T15:40:26.320499+0000","last_became_peered":"2023-10-09T15:40:26.320499+0000","last_unstale":"2023-10-09T15:40:26.324493+0000","last_undegraded":"2023-10-09T15:40:26.324493+0000","last_fullsized":"2023-10-09T15:40:26.324493+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:35:10.263334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.12","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.306910+0000","last_change":"2023-10-09T15:40:25.350177+0000","last_active":"2023-10-09T15:40:26.306910+0000","last_peered":"2023-10-09T15:40:26.306910+0000","last_clean":"2023-10-09T15:40:26.306910+0000","last_became_active":"2023-10-09T15:40:25.349905+0000","last_became_peered":"2023-10-09T15:40:25.349905+0000","last_unstale":"2023-10-09T15:40:26.306910+0000","last_undegraded":"2023-10-09T15:40:26.306910+0000","last_fullsized":"2023-10-09T15:40:26.306910+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:41:20.204760+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.12","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314653+0000","last_change":"2023-10-09T15:40:26.312128+0000","last_active":"2023-10-09T15:40:26.314653+0000","last_peered":"2023-10-09T15:40:26.314653+0000","last_clean":"2023-10-09T15:40:26.314653+0000","last_became_active":"2023-10-09T15:40:26.311845+0000","last_became_peered":"2023-10-09T15:40:26.311845+0000","last_unstale":"2023-10-09T15:40:26.314653+0000","last_undegraded":"2023-10-09T15:40:26.314653+0000","last_fullsized":"2023-10-09T15:40:26.314653+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:28:54.605544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.11","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305620+0000","last_change":"2023-10-09T15:40:25.347984+0000","last_active":"2023-10-09T15:40:26.305620+0000","last_peered":"2023-10-09T15:40:26.305620+0000","last_clean":"2023-10-09T15:40:26.305620+0000","last_became_active":"2023-10-09T15:40:25.347695+0000","last_became_peered":"2023-10-09T15:40:25.347695+0000","last_unstale":"2023-10-09T15:40:26.305620+0000","last_undegraded":"2023-10-09T15:40:26.305620+0000","last_fullsized":"2023-10-09T15:40:26.305620+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:53:55.441278+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.13","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319197+0000","last_change":"2023-10-09T15:40:26.317682+0000","last_active":"2023-10-09T15:40:26.319197+0000","last_peered":"2023-10-09T15:40:26.319197+0000","last_clean":"2023-10-09T15:40:26.319197+0000","last_became_active":"2023-10-09T15:40:26.317401+0000","last_became_peered":"2023-10-09T15:40:26.317401+0000","last_unstale":"2023-10-09T15:40:26.319197+0000","last_undegraded":"2023-10-09T15:40:26.319197+0000","last_fullsized":"2023-10-09T15:40:26.319197+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:46:22.630287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"33.10","version":"199'8","reported_seq":18,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.361346+0000","last_change":"2023-10-09T15:40:25.351022+0000","last_active":"2023-10-09T15:40:26.361346+0000","last_peered":"2023-10-09T15:40:26.361346+0000","last_clean":"2023-10-09T15:40:26.361346+0000","last_became_active":"2023-10-09T15:40:25.350734+0000","last_became_peered":"2023-10-09T15:40:25.350734+0000","last_unstale":"2023-10-09T15:40:26.361346+0000","last_undegraded":"2023-10-09T15:40:26.361346+0000","last_fullsized":"2023-10-09T15:40:26.361346+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T03:21:18.186804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.c","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315108+0000","last_change":"2023-10-09T15:40:26.314177+0000","last_active":"2023-10-09T15:40:26.315108+0000","last_peered":"2023-10-09T15:40:26.315108+0000","last_clean":"2023-10-09T15:40:26.315108+0000","last_became_active":"2023-10-09T15:40:26.313840+0000","last_became_peered":"2023-10-09T15:40:26.313840+0000","last_unstale":"2023-10-09T15:40:26.315108+0000","last_undegraded":"2023-10-09T15:40:26.315108+0000","last_fullsized":"2023-10-09T15:40:26.315108+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:50.171892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.f","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.311869+0000","last_change":"2023-10-09T15:40:25.349363+0000","last_active":"2023-10-09T15:40:26.311869+0000","last_peered":"2023-10-09T15:40:26.311869+0000","last_clean":"2023-10-09T15:40:26.311869+0000","last_became_active":"2023-10-09T15:40:25.349074+0000","last_became_peered":"2023-10-09T15:40:25.349074+0000","last_unstale":"2023-10-09T15:40:26.311869+0000","last_undegraded":"2023-10-09T15:40:26.311869+0000","last_fullsized":"2023-10-09T15:40:26.311869+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:07:49.165516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"34.d","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326850+0000","last_change":"2023-10-09T15:40:26.323287+0000","last_active":"2023-10-09T15:40:26.326850+0000","last_peered":"2023-10-09T15:40:26.326850+0000","last_clean":"2023-10-09T15:40:26.326850+0000","last_became_active":"2023-10-09T15:40:26.323007+0000","last_became_peered":"2023-10-09T15:40:26.323007+0000","last_unstale":"2023-10-09T15:40:26.326850+0000","last_undegraded":"2023-10-09T15:40:26.326850+0000","last_fullsized":"2023-10-09T15:40:26.326850+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:17:26.489133+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.e","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.357658+0000","last_change":"2023-10-09T15:40:25.344554+0000","last_active":"2023-10-09T15:40:26.357658+0000","last_peered":"2023-10-09T15:40:26.357658+0000","last_clean":"2023-10-09T15:40:26.357658+0000","last_became_active":"2023-10-09T15:40:25.343596+0000","last_became_peered":"2023-10-09T15:40:25.343596+0000","last_unstale":"2023-10-09T15:40:26.357658+0000","last_undegraded":"2023-10-09T15:40:26.357658+0000","last_fullsized":"2023-10-09T15:40:26.357658+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:37:21.189101+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.e","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315172+0000","last_change":"2023-10-09T15:40:26.312364+0000","last_active":"2023-10-09T15:40:26.315172+0000","last_peered":"2023-10-09T15:40:26.315172+0000","last_clean":"2023-10-09T15:40:26.315172+0000","last_became_active":"2023-10-09T15:40:26.312082+0000","last_became_peered":"2023-10-09T15:40:26.312082+0000","last_unstale":"2023-10-09T15:40:26.315172+0000","last_undegraded":"2023-10-09T15:40:26.315172+0000","last_fullsized":"2023-10-09T15:40:26.315172+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:27:05.105257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.d","version":"199'1","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.312854+0000","last_change":"2023-10-09T15:40:25.350521+0000","last_active":"2023-10-09T15:40:26.312854+0000","last_peered":"2023-10-09T15:40:26.312854+0000","last_clean":"2023-10-09T15:40:26.312854+0000","last_became_active":"2023-10-09T15:40:25.350066+0000","last_became_peered":"2023-10-09T15:40:25.350066+0000","last_unstale":"2023-10-09T15:40:26.312854+0000","last_undegraded":"2023-10-09T15:40:26.312854+0000","last_fullsized":"2023-10-09T15:40:26.312854+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:06:06.406441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.f","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.321847+0000","last_change":"2023-10-09T15:40:26.318780+0000","last_active":"2023-10-09T15:40:26.321847+0000","last_peered":"2023-10-09T15:40:26.321847+0000","last_clean":"2023-10-09T15:40:26.321847+0000","last_became_active":"2023-10-09T15:40:26.318361+0000","last_became_peered":"2023-10-09T15:40:26.318361+0000","last_unstale":"2023-10-09T15:40:26.321847+0000","last_undegraded":"2023-10-09T15:40:26.321847+0000","last_fullsized":"2023-10-09T15:40:26.321847+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:51:45.763826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.c","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299073+0000","last_change":"2023-10-09T15:40:25.349078+0000","last_active":"2023-10-09T15:40:26.299073+0000","last_peered":"2023-10-09T15:40:26.299073+0000","last_clean":"2023-10-09T15:40:26.299073+0000","last_became_active":"2023-10-09T15:40:25.348801+0000","last_became_peered":"2023-10-09T15:40:25.348801+0000","last_unstale":"2023-10-09T15:40:26.299073+0000","last_undegraded":"2023-10-09T15:40:26.299073+0000","last_fullsized":"2023-10-09T15:40:26.299073+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:30:09.924946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.8","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316895+0000","last_change":"2023-10-09T15:40:26.316895+0000","last_active":"2023-10-09T15:40:26.316895+0000","last_peered":"2023-10-09T15:40:26.316895+0000","last_clean":"2023-10-09T15:40:26.316895+0000","last_became_active":"2023-10-09T15:40:26.316597+0000","last_became_peered":"2023-10-09T15:40:26.316597+0000","last_unstale":"2023-10-09T15:40:26.316895+0000","last_undegraded":"2023-10-09T15:40:26.316895+0000","last_fullsized":"2023-10-09T15:40:26.316895+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:35:55.983389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.b","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360867+0000","last_change":"2023-10-09T15:40:25.357234+0000","last_active":"2023-10-09T15:40:26.360867+0000","last_peered":"2023-10-09T15:40:26.360867+0000","last_clean":"2023-10-09T15:40:26.360867+0000","last_became_active":"2023-10-09T15:40:25.356238+0000","last_became_peered":"2023-10-09T15:40:25.356238+0000","last_unstale":"2023-10-09T15:40:26.360867+0000","last_undegraded":"2023-10-09T15:40:26.360867+0000","last_fullsized":"2023-10-09T15:40:26.360867+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:51.567794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.9","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.314254+0000","last_change":"2023-10-09T15:40:26.312489+0000","last_active":"2023-10-09T15:40:26.314254+0000","last_peered":"2023-10-09T15:40:26.314254+0000","last_clean":"2023-10-09T15:40:26.314254+0000","last_became_active":"2023-10-09T15:40:26.312189+0000","last_became_peered":"2023-10-09T15:40:26.312189+0000","last_unstale":"2023-10-09T15:40:26.314254+0000","last_undegraded":"2023-10-09T15:40:26.314254+0000","last_fullsized":"2023-10-09T15:40:26.314254+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:47:30.636981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"33.a","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.302592+0000","last_change":"2023-10-09T15:40:25.341367+0000","last_active":"2023-10-09T15:40:26.302592+0000","last_peered":"2023-10-09T15:40:26.302592+0000","last_clean":"2023-10-09T15:40:26.302592+0000","last_became_active":"2023-10-09T15:40:25.341082+0000","last_became_peered":"2023-10-09T15:40:25.341082+0000","last_unstale":"2023-10-09T15:40:26.302592+0000","last_undegraded":"2023-10-09T15:40:26.302592+0000","last_fullsized":"2023-10-09T15:40:26.302592+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:36:57.013252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"34.a","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.322211+0000","last_change":"2023-10-09T15:40:26.321567+0000","last_active":"2023-10-09T15:40:26.322211+0000","last_peered":"2023-10-09T15:40:26.322211+0000","last_clean":"2023-10-09T15:40:26.322211+0000","last_became_active":"2023-10-09T15:40:26.321247+0000","last_became_peered":"2023-10-09T15:40:26.321247+0000","last_unstale":"2023-10-09T15:40:26.322211+0000","last_undegraded":"2023-10-09T15:40:26.322211+0000","last_fullsized":"2023-10-09T15:40:26.322211+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T22:01:00.761122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.9","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347189+0000","last_change":"2023-10-09T15:40:25.341981+0000","last_active":"2023-10-09T15:40:25.347189+0000","last_peered":"2023-10-09T15:40:25.347189+0000","last_clean":"2023-10-09T15:40:25.347189+0000","last_became_active":"2023-10-09T15:40:25.339413+0000","last_became_peered":"2023-10-09T15:40:25.339413+0000","last_unstale":"2023-10-09T15:40:25.347189+0000","last_undegraded":"2023-10-09T15:40:25.347189+0000","last_fullsized":"2023-10-09T15:40:25.347189+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:46:39.699214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"34.b","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317509+0000","last_change":"2023-10-09T15:40:26.317509+0000","last_active":"2023-10-09T15:40:26.317509+0000","last_peered":"2023-10-09T15:40:26.317509+0000","last_clean":"2023-10-09T15:40:26.317509+0000","last_became_active":"2023-10-09T15:40:26.317100+0000","last_became_peered":"2023-10-09T15:40:26.317100+0000","last_unstale":"2023-10-09T15:40:26.317509+0000","last_undegraded":"2023-10-09T15:40:26.317509+0000","last_fullsized":"2023-10-09T15:40:26.317509+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T20:53:43.857167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.8","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.305663+0000","last_change":"2023-10-09T15:40:25.345425+0000","last_active":"2023-10-09T15:40:26.305663+0000","last_peered":"2023-10-09T15:40:26.305663+0000","last_clean":"2023-10-09T15:40:26.305663+0000","last_became_active":"2023-10-09T15:40:25.345153+0000","last_became_peered":"2023-10-09T15:40:25.345153+0000","last_unstale":"2023-10-09T15:40:26.305663+0000","last_undegraded":"2023-10-09T15:40:26.305663+0000","last_fullsized":"2023-10-09T15:40:26.305663+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T18:53:39.572136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.4","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.324126+0000","last_change":"2023-10-09T15:40:26.324126+0000","last_active":"2023-10-09T15:40:26.324126+0000","last_peered":"2023-10-09T15:40:26.324126+0000","last_clean":"2023-10-09T15:40:26.324126+0000","last_became_active":"2023-10-09T15:40:26.323827+0000","last_became_peered":"2023-10-09T15:40:26.323827+0000","last_unstale":"2023-10-09T15:40:26.324126+0000","last_undegraded":"2023-10-09T15:40:26.324126+0000","last_fullsized":"2023-10-09T15:40:26.324126+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:40:23.626710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.7","version":"199'2","reported_seq":12,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.360641+0000","last_change":"2023-10-09T15:40:25.352438+0000","last_active":"2023-10-09T15:40:26.360641+0000","last_peered":"2023-10-09T15:40:26.360641+0000","last_clean":"2023-10-09T15:40:26.360641+0000","last_became_active":"2023-10-09T15:40:25.352146+0000","last_became_peered":"2023-10-09T15:40:25.352146+0000","last_unstale":"2023-10-09T15:40:26.360641+0000","last_undegraded":"2023-10-09T15:40:26.360641+0000","last_fullsized":"2023-10-09T15:40:26.360641+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:17:50.199494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"34.5","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316317+0000","last_change":"2023-10-09T15:40:26.316317+0000","last_active":"2023-10-09T15:40:26.316317+0000","last_peered":"2023-10-09T15:40:26.316317+0000","last_clean":"2023-10-09T15:40:26.316317+0000","last_became_active":"2023-10-09T15:40:26.315989+0000","last_became_peered":"2023-10-09T15:40:26.315989+0000","last_unstale":"2023-10-09T15:40:26.316317+0000","last_undegraded":"2023-10-09T15:40:26.316317+0000","last_fullsized":"2023-10-09T15:40:26.316317+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:31:52.574169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.6","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299524+0000","last_change":"2023-10-09T15:40:25.345917+0000","last_active":"2023-10-09T15:40:26.299524+0000","last_peered":"2023-10-09T15:40:26.299524+0000","last_clean":"2023-10-09T15:40:26.299524+0000","last_became_active":"2023-10-09T15:40:25.343185+0000","last_became_peered":"2023-10-09T15:40:25.343185+0000","last_unstale":"2023-10-09T15:40:26.299524+0000","last_undegraded":"2023-10-09T15:40:26.299524+0000","last_fullsized":"2023-10-09T15:40:26.299524+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:31:55.111677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.6","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.318923+0000","last_change":"2023-10-09T15:40:26.318923+0000","last_active":"2023-10-09T15:40:26.318923+0000","last_peered":"2023-10-09T15:40:26.318923+0000","last_clean":"2023-10-09T15:40:26.318923+0000","last_became_active":"2023-10-09T15:40:26.318633+0000","last_became_peered":"2023-10-09T15:40:26.318633+0000","last_unstale":"2023-10-09T15:40:26.318923+0000","last_undegraded":"2023-10-09T15:40:26.318923+0000","last_fullsized":"2023-10-09T15:40:26.318923+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:56:58.407057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"33.5","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.348347+0000","last_change":"2023-10-09T15:40:25.347632+0000","last_active":"2023-10-09T15:40:25.348347+0000","last_peered":"2023-10-09T15:40:25.348347+0000","last_clean":"2023-10-09T15:40:25.348347+0000","last_became_active":"2023-10-09T15:40:25.347354+0000","last_became_peered":"2023-10-09T15:40:25.347354+0000","last_unstale":"2023-10-09T15:40:25.348347+0000","last_undegraded":"2023-10-09T15:40:25.348347+0000","last_fullsized":"2023-10-09T15:40:25.348347+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:32:29.301065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.7","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316075+0000","last_change":"2023-10-09T15:40:26.316075+0000","last_active":"2023-10-09T15:40:26.316075+0000","last_peered":"2023-10-09T15:40:26.316075+0000","last_clean":"2023-10-09T15:40:26.316075+0000","last_became_active":"2023-10-09T15:40:26.315770+0000","last_became_peered":"2023-10-09T15:40:26.315770+0000","last_unstale":"2023-10-09T15:40:26.316075+0000","last_undegraded":"2023-10-09T15:40:26.316075+0000","last_fullsized":"2023-10-09T15:40:26.316075+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:22:34.028025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"33.4","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.352042+0000","last_change":"2023-10-09T15:40:25.350402+0000","last_active":"2023-10-09T15:40:25.352042+0000","last_peered":"2023-10-09T15:40:25.352042+0000","last_clean":"2023-10-09T15:40:25.352042+0000","last_became_active":"2023-10-09T15:40:25.350070+0000","last_became_peered":"2023-10-09T15:40:25.350070+0000","last_unstale":"2023-10-09T15:40:25.352042+0000","last_undegraded":"2023-10-09T15:40:25.352042+0000","last_fullsized":"2023-10-09T15:40:25.352042+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T15:46:46.117604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.0","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.319002+0000","last_change":"2023-10-09T15:40:26.313590+0000","last_active":"2023-10-09T15:40:26.319002+0000","last_peered":"2023-10-09T15:40:26.319002+0000","last_clean":"2023-10-09T15:40:26.319002+0000","last_became_active":"2023-10-09T15:40:26.313145+0000","last_became_peered":"2023-10-09T15:40:26.313145+0000","last_unstale":"2023-10-09T15:40:26.319002+0000","last_undegraded":"2023-10-09T15:40:26.319002+0000","last_fullsized":"2023-10-09T15:40:26.319002+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:40:49.334520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"33.3","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.298999+0000","last_change":"2023-10-09T15:40:25.343635+0000","last_active":"2023-10-09T15:40:26.298999+0000","last_peered":"2023-10-09T15:40:26.298999+0000","last_clean":"2023-10-09T15:40:26.298999+0000","last_became_active":"2023-10-09T15:40:25.343398+0000","last_became_peered":"2023-10-09T15:40:25.343398+0000","last_unstale":"2023-10-09T15:40:26.298999+0000","last_undegraded":"2023-10-09T15:40:26.298999+0000","last_fullsized":"2023-10-09T15:40:26.298999+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T02:03:06.029995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.1","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.317751+0000","last_change":"2023-10-09T15:40:26.317751+0000","last_active":"2023-10-09T15:40:26.317751+0000","last_peered":"2023-10-09T15:40:26.317751+0000","last_clean":"2023-10-09T15:40:26.317751+0000","last_became_active":"2023-10-09T15:40:26.317415+0000","last_became_peered":"2023-10-09T15:40:26.317415+0000","last_unstale":"2023-10-09T15:40:26.317751+0000","last_undegraded":"2023-10-09T15:40:26.317751+0000","last_fullsized":"2023-10-09T15:40:26.317751+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T21:47:41.068336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.2","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.298988+0000","last_change":"2023-10-09T15:40:25.356950+0000","last_active":"2023-10-09T15:40:26.298988+0000","last_peered":"2023-10-09T15:40:26.298988+0000","last_clean":"2023-10-09T15:40:26.298988+0000","last_became_active":"2023-10-09T15:40:25.356657+0000","last_became_peered":"2023-10-09T15:40:25.356657+0000","last_unstale":"2023-10-09T15:40:26.298988+0000","last_undegraded":"2023-10-09T15:40:26.298988+0000","last_fullsized":"2023-10-09T15:40:26.298988+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:55:14.607205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.2","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.316258+0000","last_change":"2023-10-09T15:40:26.316258+0000","last_active":"2023-10-09T15:40:26.316258+0000","last_peered":"2023-10-09T15:40:26.316258+0000","last_clean":"2023-10-09T15:40:26.316258+0000","last_became_active":"2023-10-09T15:40:26.316034+0000","last_became_peered":"2023-10-09T15:40:26.316034+0000","last_unstale":"2023-10-09T15:40:26.316258+0000","last_undegraded":"2023-10-09T15:40:26.316258+0000","last_fullsized":"2023-10-09T15:40:26.316258+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:29:51.264617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"33.1","version":"0'0","reported_seq":9,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.347916+0000","last_change":"2023-10-09T15:40:25.346742+0000","last_active":"2023-10-09T15:40:25.347916+0000","last_peered":"2023-10-09T15:40:25.347916+0000","last_clean":"2023-10-09T15:40:25.347916+0000","last_became_active":"2023-10-09T15:40:25.346495+0000","last_became_peered":"2023-10-09T15:40:25.346495+0000","last_unstale":"2023-10-09T15:40:25.347916+0000","last_undegraded":"2023-10-09T15:40:25.347916+0000","last_fullsized":"2023-10-09T15:40:25.347916+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T19:58:11.650753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"34.3","version":"0'0","reported_seq":8,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.315091+0000","last_change":"2023-10-09T15:40:26.315091+0000","last_active":"2023-10-09T15:40:26.315091+0000","last_peered":"2023-10-09T15:40:26.315091+0000","last_clean":"2023-10-09T15:40:26.315091+0000","last_became_active":"2023-10-09T15:40:26.314813+0000","last_became_peered":"2023-10-09T15:40:26.314813+0000","last_unstale":"2023-10-09T15:40:26.315091+0000","last_undegraded":"2023-10-09T15:40:26.315091+0000","last_fullsized":"2023-10-09T15:40:26.315091+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T16:45:19.982719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"33.0","version":"0'0","reported_seq":10,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.299043+0000","last_change":"2023-10-09T15:40:25.338679+0000","last_active":"2023-10-09T15:40:26.299043+0000","last_peered":"2023-10-09T15:40:26.299043+0000","last_clean":"2023-10-09T15:40:26.299043+0000","last_became_active":"2023-10-09T15:40:25.338395+0000","last_became_peered":"2023-10-09T15:40:25.338395+0000","last_unstale":"2023-10-09T15:40:26.299043+0000","last_undegraded":"2023-10-09T15:40:26.299043+0000","last_fullsized":"2023-10-09T15:40:26.299043+0000","mapping_epoch":197,"log_start":"0'0","ondisk_log_start":"0'0","created":197,"last_epoch_clean":198,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:24.319896+0000","last_clean_scrub_stamp":"2023-10-09T15:40:24.319896+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T01:40:19.114818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"34.23","version":"0'0","reported_seq":9,"reported_epoch":199,"state":"active+clean","last_fresh":"2023-10-09T15:40:26.326416+0000","last_change":"2023-10-09T15:40:26.325897+0000","last_active":"2023-10-09T15:40:26.326416+0000","last_peered":"2023-10-09T15:40:26.326416+0000","last_clean":"2023-10-09T15:40:26.326416+0000","last_became_active":"2023-10-09T15:40:26.325621+0000","last_became_peered":"2023-10-09T15:40:26.325621+0000","last_unstale":"2023-10-09T15:40:26.326416+0000","last_undegraded":"2023-10-09T15:40:26.326416+0000","last_fullsized":"2023-10-09T15:40:26.326416+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":198,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:40:25.326272+0000","last_clean_scrub_stamp":"2023-10-09T15:40:25.326272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T23:33:31.892894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":313,"reported_epoch":198,"state":"active+clean","last_fresh":"2023-10-09T15:40:25.342843+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:40:25.342843+0000","last_peered":"2023-10-09T15:40:25.342843+0000","last_clean":"2023-10-09T15:40:25.342843+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:40:25.342843+0000","last_undegraded":"2023-10-09T15:40:25.342843+0000","last_fullsized":"2023-10-09T15:40:25.342843+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":34,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":33,"num_pg":32,"stat_sum":{"num_bytes":2306,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574967,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304444,"kb_used_data":3060,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067396,"statfs":{"total":96636764160,"available":96325013504,"internally_reserved":0,"allocated":3133440,"data_stored":1732249,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.29199999999999998,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.54600000000000004,"15min":0.53900000000000003},"min":{"1min":0.34399999999999997,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.83499999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.33400000000000002}]},{"osd":1,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.874},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.56699999999999995,"15min":0.55400000000000005},"min":{"1min":0.42099999999999999,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.88300000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.38600000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.55900000000000005,"15min":0.54400000000000004},"min":{"1min":0.377,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":1.0920000000000001,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.40100000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.80000000000000004,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.41899999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.59299999999999997,"15min":0.57799999999999996},"min":{"1min":0.45300000000000001,"5min":0.314,"15min":0.314},"max":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59599999999999997,"15min":0.60699999999999998},"min":{"1min":0.38500000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.79700000000000004,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.51900000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.54100000000000004},"min":{"1min":0.40200000000000002,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.61799999999999999},{"interface":"front","average":{"1min":0.65400000000000003,"5min":0.60099999999999998,"15min":0.56899999999999995},"min":{"1min":0.48999999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":1.3340000000000001,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.63300000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.60999999999999999,"5min":0.57799999999999996,"15min":0.58599999999999997},"min":{"1min":0.44900000000000001,"5min":0.377,"15min":0.376},"max":{"1min":0.86199999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.59699999999999998},"min":{"1min":0.5,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.91900000000000004,"5min":0.93500000000000005,"15min":0.93500000000000005},"last":0.44}]},{"osd":6,"last update":"Mon Oct 9 15:40:10 2023","interfaces":[{"interface":"back","average":{"1min":0.70299999999999996,"5min":0.68500000000000005,"15min":0.66100000000000003},"min":{"1min":0.55200000000000005,"5min":0.46899999999999997,"15min":0.42999999999999999},"max":{"1min":0.96999999999999997,"5min":0.97099999999999997,"15min":0.97099999999999997},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.70699999999999996,"5min":0.66700000000000004,"15min":0.65800000000000003},"min":{"1min":0.40699999999999997,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":1.288,"5min":1.288,"15min":1.288},"last":0.58299999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574967,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.51600000000000001,"15min":0.50800000000000001},"min":{"1min":0.34499999999999997,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78000000000000003,"5min":0.83799999999999997,"15min":0.86699999999999999},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54600000000000004,"15min":0.54500000000000004},"min":{"1min":0.36599999999999999,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.749,"5min":0.78400000000000003,"15min":0.90400000000000003},"last":0.58299999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52400000000000002,"15min":0.55000000000000004},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":1.379},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.56000000000000005,"15min":0.55400000000000005},"min":{"1min":0.38300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.69699999999999995,"5min":0.83099999999999996,"15min":0.86199999999999999},"last":0.43099999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55400000000000005,"15min":0.58499999999999996},"min":{"1min":0.38900000000000001,"5min":0.36899999999999999,"15min":0.308},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":1.3999999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.54800000000000004,"15min":0.71199999999999997},"min":{"1min":0.37,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.70799999999999996,"5min":0.81399999999999995,"15min":7.3419999999999996},"last":0.46999999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.58599999999999997,"15min":0.60699999999999998},"min":{"1min":0.36499999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75900000000000001,"5min":0.84099999999999997,"15min":1.3560000000000001},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60199999999999998,"15min":0.63100000000000001},"min":{"1min":0.39600000000000002,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.63700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.55600000000000005,"15min":0.55200000000000005},"min":{"1min":0.33400000000000002,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.36599999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.92700000000000005,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.66100000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.59199999999999997,"15min":0.59599999999999997},"min":{"1min":0.39400000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.627,"5min":0.61299999999999999,"15min":0.626},"min":{"1min":0.437,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88600000000000001,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.60799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:07 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.63900000000000001,"15min":0.64700000000000002},"min":{"1min":0.42599999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":1.004},"last":0.625},{"interface":"front","average":{"1min":0.67800000000000005,"5min":0.66300000000000003,"15min":0.66900000000000004},"min":{"1min":0.41599999999999998,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":1.0880000000000001,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68300000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574968,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303876,"kb_used_data":2492,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067964,"statfs":{"total":96636764160,"available":96325595136,"internally_reserved":0,"allocated":2551808,"data_stored":1147717,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33700000000000002,"15min":0.34699999999999998},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.215},"max":{"1min":0.51400000000000001,"5min":0.63,"15min":0.90200000000000002},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.34499999999999997,"15min":0.373},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":1.512},"last":0.47099999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.33200000000000002,"5min":0.32900000000000001,"15min":0.35899999999999999},"min":{"1min":0.25600000000000001,"5min":0.22800000000000001,"15min":0.221},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":1.286},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.38100000000000001,"15min":0.40000000000000002},"min":{"1min":0.28599999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.72499999999999998,"5min":0.72499999999999998,"15min":1.0249999999999999},"last":0.437}]},{"osd":3,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.41399999999999998,"5min":0.41899999999999998,"15min":0.437},"min":{"1min":0.314,"5min":0.312,"15min":0.29499999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.96899999999999997},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.41699999999999998,"5min":0.40699999999999997,"15min":0.435},"min":{"1min":0.33800000000000002,"5min":0.249,"15min":0.249},"max":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.501}]},{"osd":4,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.999,"5min":1.0469999999999999,"15min":1.222},"last":0.81100000000000005},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.61599999999999999},"min":{"1min":0.40500000000000003,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.94799999999999995},"last":0.69599999999999995}]},{"osd":5,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.61899999999999999},"min":{"1min":0.49199999999999999,"5min":0.41899999999999998,"15min":0.40000000000000002},"max":{"1min":0.878,"5min":0.92900000000000005,"15min":1.4410000000000001},"last":0.86299999999999999},{"interface":"front","average":{"1min":0.61599999999999999,"5min":0.61299999999999999,"15min":0.61699999999999999},"min":{"1min":0.39200000000000002,"5min":0.37,"15min":0.35399999999999998},"max":{"1min":0.94199999999999995,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.71599999999999997}]},{"osd":6,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.64800000000000002,"15min":0.753},"min":{"1min":0.44800000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.95899999999999996,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.63700000000000001,"5min":0.64200000000000002,"15min":0.66500000000000004},"min":{"1min":0.41299999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.258},"last":0.85099999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:03 2023","interfaces":[{"interface":"back","average":{"1min":0.63700000000000001,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.42499999999999999,"5min":0.42199999999999999,"15min":0.41099999999999998},"max":{"1min":0.96999999999999997,"5min":0.97499999999999998,"15min":0.997},"last":0.872},{"interface":"front","average":{"1min":0.66400000000000003,"5min":0.65000000000000002,"15min":0.75800000000000001},"min":{"1min":0.502,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.92000000000000004,"5min":1.024,"15min":5.5819999999999999},"last":0.77600000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574966,"num_pgs":31,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304436,"kb_used_data":3052,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067404,"statfs":{"total":96636764160,"available":96325021696,"internally_reserved":0,"allocated":3125248,"data_stored":1730732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.36899999999999999,"15min":0.371},"min":{"1min":0.22900000000000001,"5min":0.219,"15min":0.20599999999999999},"max":{"1min":0.42599999999999999,"5min":2.1520000000000001,"15min":2.1520000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.41699999999999998,"15min":0.41499999999999998},"min":{"1min":0.317,"5min":0.29299999999999998,"15min":0.27600000000000002},"max":{"1min":0.61199999999999999,"5min":2.0859999999999999,"15min":2.0859999999999999},"last":0.42199999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33000000000000002,"5min":0.442,"15min":0.40699999999999997},"min":{"1min":0.248,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.48699999999999999,"5min":6.484,"15min":6.484},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.37,"5min":0.436,"15min":0.49299999999999999},"min":{"1min":0.27200000000000002,"5min":0.253,"15min":0.24199999999999999},"max":{"1min":0.65100000000000002,"5min":6.2859999999999996,"15min":6.2859999999999996},"last":0.33300000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.36499999999999999,"15min":0.47699999999999998},"min":{"1min":0.27200000000000002,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.45600000000000002,"5min":0.59199999999999997,"15min":4.5190000000000001},"last":0.372},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.44400000000000001,"15min":0.55700000000000005},"min":{"1min":0.36099999999999999,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.56100000000000005,"5min":2.109,"15min":4.5890000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.60999999999999999,"15min":0.623},"min":{"1min":0.42899999999999999,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.70999999999999996,"5min":1.921,"15min":1.921},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.59899999999999998,"15min":0.63500000000000001},"min":{"1min":0.38600000000000001,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":1.508},"last":0.46100000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.58799999999999997,"15min":0.60899999999999999},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.71899999999999997,"5min":0.81799999999999995,"15min":1.0509999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.64500000000000002,"15min":0.63400000000000001},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.75900000000000001,"5min":4.1020000000000003,"15min":4.1020000000000003},"last":0.52600000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.67800000000000005,"15min":0.67700000000000005},"min":{"1min":0.44700000000000001,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.79100000000000004,"5min":3.9009999999999998,"15min":3.9009999999999998},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.65600000000000003,"15min":0.66900000000000004},"min":{"1min":0.441,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.72999999999999998,"5min":1.9810000000000001,"15min":1.9810000000000001},"last":0.51100000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:40:23 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.67500000000000004,"15min":0.68899999999999995},"min":{"1min":0.46700000000000003,"5min":0.40799999999999997,"15min":0.378},"max":{"1min":0.75,"5min":2.032,"15min":2.032},"last":0.53900000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.65300000000000002,"15min":0.66200000000000003},"min":{"1min":0.44900000000000001,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.77300000000000002,"5min":0.93200000000000005,"15min":0.94699999999999995},"last":0.498}]}]},{"osd":2,"up_from":13,"seq":55834574967,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303888,"kb_used_data":2504,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067952,"statfs":{"total":96636764160,"available":96325582848,"internally_reserved":0,"allocated":2564096,"data_stored":1149705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.33800000000000002,"15min":0.33200000000000002},"min":{"1min":0.20300000000000001,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.60799999999999998,"5min":0.60799999999999998,"15min":0.69799999999999995},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.33900000000000002,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.48399999999999999,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.37,"15min":0.36699999999999999},"min":{"1min":0.252,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.46800000000000003,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.38,"15min":0.38500000000000001},"min":{"1min":0.26800000000000002,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.58699999999999997,"5min":0.622,"15min":0.73699999999999999},"last":0.35299999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.371,"15min":0.36699999999999999},"min":{"1min":0.24099999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.67500000000000004},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.43099999999999999,"15min":0.435},"min":{"1min":0.33600000000000002,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.36799999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.58199999999999996,"15min":0.63},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.58899999999999997,"15min":0.60199999999999998},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.86899999999999999,"5min":0.93999999999999995,"15min":0.93999999999999995},"last":0.46999999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.58599999999999997,"15min":0.59999999999999998},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.93200000000000005,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60799999999999998,"15min":0.66200000000000003},"min":{"1min":0.38200000000000001,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.874,"5min":0.874,"15min":2.5249999999999999},"last":0.47799999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.629,"15min":0.66400000000000003},"min":{"1min":0.35799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95599999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.64800000000000002,"15min":0.65500000000000003},"min":{"1min":0.46999999999999997,"5min":0.44700000000000001,"15min":0.42199999999999999},"max":{"1min":0.86299999999999999,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.53600000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.65500000000000003,"15min":0.67300000000000004},"min":{"1min":0.441,"5min":0.441,"15min":0.44},"max":{"1min":0.91900000000000004,"5min":1.0620000000000001,"15min":1.407},"last":0.442},{"interface":"front","average":{"1min":0.61099999999999999,"5min":0.63200000000000001,"15min":0.65100000000000002},"min":{"1min":0.442,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.90600000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574965,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.35099999999999998,"5min":0.33700000000000002,"15min":0.35299999999999998},"min":{"1min":0.251,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.55300000000000005,"5min":0.57399999999999995,"15min":1.2270000000000001},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.36099999999999999,"15min":0.71199999999999997},"min":{"1min":0.254,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.51900000000000002,"5min":0.57899999999999996,"15min":17.085999999999999},"last":0.47399999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.35099999999999998,"15min":0.55900000000000005},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.48599999999999999,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.38900000000000001,"15min":0.40799999999999997},"min":{"1min":0.28100000000000003,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.58999999999999997,"5min":0.70199999999999996,"15min":1.3049999999999999},"last":0.70799999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38700000000000001,"15min":1.0489999999999999},"min":{"1min":0.29599999999999999,"5min":0.26500000000000001,"15min":0.247},"max":{"1min":0.59499999999999997,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40799999999999997,"15min":0.628},"min":{"1min":0.34100000000000003,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.58799999999999997,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.57999999999999996}]},{"osd":4,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59799999999999998,"15min":0.93000000000000005},"min":{"1min":0.41799999999999998,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.89800000000000002,"5min":0.996,"15min":17.02},"last":0.876},{"interface":"front","average":{"1min":0.65100000000000002,"5min":0.61399999999999999,"15min":0.81699999999999995},"min":{"1min":0.45100000000000001,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89400000000000002,"5min":0.92100000000000004,"15min":9.6969999999999992},"last":0.84499999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.60399999999999998,"15min":0.623},"min":{"1min":0.41599999999999998,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.85099999999999998,"5min":0.89500000000000002,"15min":5.3460000000000001},"last":0.96299999999999997},{"interface":"front","average":{"1min":0.65600000000000003,"5min":0.626,"15min":0.95699999999999996},"min":{"1min":0.47399999999999998,"5min":0.375,"15min":0.375},"max":{"1min":0.93300000000000005,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.82699999999999996}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69399999999999995,"5min":0.64300000000000002,"15min":0.82799999999999996},"min":{"1min":0.47999999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.999,"5min":0.999,"15min":9.7319999999999993},"last":0.75700000000000001},{"interface":"front","average":{"1min":0.68000000000000005,"5min":0.65900000000000003,"15min":0.66700000000000004},"min":{"1min":0.45900000000000002,"5min":0.436,"15min":0.436},"max":{"1min":0.91800000000000004,"5min":1.016,"15min":1.278},"last":0.89500000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.69499999999999995,"5min":0.65100000000000002,"15min":0.997},"min":{"1min":0.53000000000000003,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.92000000000000004,"5min":0.94599999999999995,"15min":17.053999999999998},"last":0.93999999999999995},{"interface":"front","average":{"1min":0.68899999999999995,"5min":0.66300000000000003,"15min":0.84399999999999997},"min":{"1min":0.49199999999999999,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":1.024,"5min":1.024,"15min":9.6029999999999998},"last":0.79500000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303880,"kb_used_data":2496,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067960,"statfs":{"total":96636764160,"available":96325591040,"internally_reserved":0,"allocated":2555904,"data_stored":1149129,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.54900000000000004,"15min":0.54500000000000004},"min":{"1min":0.33700000000000002,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.69499999999999995,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.432},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.36499999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.79700000000000004,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.57999999999999996,"15min":0.63600000000000001},"min":{"1min":0.375,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.85199999999999998,"5min":0.88600000000000001,"15min":2.879},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.55000000000000004,"15min":0.56100000000000005},"min":{"1min":0.29299999999999998,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":1.0960000000000001,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52800000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54600000000000004,"15min":0.52800000000000002},"min":{"1min":0.36299999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.77900000000000003,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.496},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.57799999999999996,"15min":0.57499999999999996},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.996,"5min":1.3580000000000001,"15min":1.3580000000000001},"last":0.54800000000000004}]},{"osd":3,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.55400000000000005,"15min":0.54600000000000004},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":1.1379999999999999,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.61099999999999999,"15min":0.60599999999999998},"min":{"1min":0.38,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.74099999999999999,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.61099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.55200000000000005,"15min":0.55000000000000004},"min":{"1min":0.254,"5min":0.254,"15min":0.254},"max":{"1min":0.90300000000000002,"5min":0.90600000000000003,"15min":0.90600000000000003},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.621},"min":{"1min":0.308,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.222,"5min":1.222,"15min":1.222},"last":0.63100000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.32700000000000001,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.626,"5min":0.66400000000000003,"15min":0.67400000000000004},"min":{"1min":0.35899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.04,"5min":1.04,"15min":1.04},"last":0.58999999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:40:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.60199999999999998,"15min":0.61899999999999999},"min":{"1min":0.30499999999999999,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":1.1779999999999999,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.63400000000000001,"5min":0.65800000000000003,"15min":0.66300000000000003},"min":{"1min":0.41099999999999998,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.88700000000000001,"5min":1.202,"15min":1.202},"last":0.68999999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574967,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303860,"kb_used_data":2476,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067980,"statfs":{"total":96636764160,"available":96325611520,"internally_reserved":0,"allocated":2535424,"data_stored":1141375,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51800000000000002},"min":{"1min":0.36099999999999999,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.69599999999999995,"5min":0.73599999999999999,"15min":0.87},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.53700000000000003,"15min":0.53800000000000003},"min":{"1min":0.33500000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.70899999999999996,"5min":0.73299999999999998,"15min":1.165},"last":0.36699999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.53000000000000003,"15min":0.53700000000000003},"min":{"1min":0.36599999999999999,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.72699999999999998,"5min":0.871,"15min":2.089},"last":0.624},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.36899999999999999,"5min":0.36799999999999999,"15min":0.32800000000000001},"max":{"1min":0.73399999999999999,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.34000000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.54400000000000004,"15min":0.77900000000000003},"min":{"1min":0.38100000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.755,"5min":0.79000000000000004,"15min":11.055},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.80500000000000005},"min":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.32400000000000001},"max":{"1min":0.69299999999999995,"5min":0.76700000000000002,"15min":11.092000000000001},"last":0.51900000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.57399999999999995,"15min":0.80800000000000005},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.78600000000000003,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59999999999999998,"15min":0.60199999999999998},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.36699999999999999},"max":{"1min":0.80000000000000004,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.66900000000000004}]},{"osd":4,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54800000000000004,"15min":0.54300000000000004},"min":{"1min":0.30199999999999999,"5min":0.27700000000000002,"15min":0.27700000000000002},"max":{"1min":0.77000000000000002,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.434},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":0.82199999999999995,"5min":0.872,"15min":1.0569999999999999},"last":0.498}]},{"osd":6,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59099999999999997,"15min":0.58299999999999996},"min":{"1min":0.40200000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.89300000000000002,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.64500000000000002,"5min":0.59999999999999998,"15min":0.59999999999999998},"min":{"1min":0.36699999999999999,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.87,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.48199999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:40:06 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.61799999999999999,"15min":0.61599999999999999},"min":{"1min":0.48499999999999999,"5min":0.307,"15min":0.307},"max":{"1min":0.86499999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.72999999999999998,"5min":0.66900000000000004,"15min":0.66200000000000003},"min":{"1min":0.58299999999999996,"5min":0.45000000000000001,"15min":0.432},"max":{"1min":1.6519999999999999,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.748}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1536,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":33,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":34,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:40:30.860 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-10-09T15:40:30.860 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-10-09T15:40:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.020+0000 7f668b1d8700 1 Processor -- start 2023-10-09T15:40:31.021 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.020+0000 7f668b1d8700 1 -- start start 2023-10-09T15:40:31.023 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668b1d8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f668415de50 0x7f66840cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668b1d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f668415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668b1d8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66840cf3c0 con 0x7f6684153c30 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668b1d8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f668415afd0 con 0x7f668415de50 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668b1d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f668415b2b0 con 0x7f66840cef40 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668a1d6700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6684153c30 0x7f668415a5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58372/0 (socket says 172.21.15.33:58372) 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668a1d6700 1 -- 172.21.15.33:0/1689504845 learned_addr learned my addr 172.21.15.33:0/1689504845 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f66899d5700 1 --2- 172.21.15.33:0/1689504845 >> v2:172.21.15.33:3300/0 conn(0x7f668415de50 0x7f66840cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f668a9d7700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f668415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.021+0000 7f66891d4700 1 -- 172.21.15.33:0/1689504845 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3973979629 0 0) 0x7f66840cf3c0 con 0x7f6684153c30 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66891d4700 1 -- 172.21.15.33:0/1689504845 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f666c003570 con 0x7f6684153c30 2023-10-09T15:40:31.024 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66899d5700 1 -- 172.21.15.33:0/1689504845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 msgr2=0x7f668415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66899d5700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f668415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66899d5700 1 -- 172.21.15.33:0/1689504845 >> v1:172.21.15.33:6789/0 conn(0x7f6684153c30 legacy=0x7f668415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66899d5700 1 -- 172.21.15.33:0/1689504845 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f668415b590 con 0x7f668415de50 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66899d5700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cea00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f66780098e0 tx=0x7f66780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb3e3dcd59a1c957 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66891d4700 1 -- 172.21.15.33:0/1689504845 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011630 con 0x7f668415de50 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66891d4700 1 -- 172.21.15.33:0/1689504845 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6678011790 con 0x7f668415de50 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f66891d4700 1 -- 172.21.15.33:0/1689504845 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6678011b30 con 0x7f668415de50 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f668b1d8700 1 -- 172.21.15.33:0/1689504845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 msgr2=0x7f66840cea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.022+0000 7f668b1d8700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cea00 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f66780098e0 tx=0x7f66780091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 -- 172.21.15.33:0/1689504845 shutdown_connections 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f668415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.025 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 --2- 172.21.15.33:0/1689504845 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cea00 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 -- 172.21.15.33:0/1689504845 >> 172.21.15.33:0/1689504845 conn(0x7f66840703a0 msgr2=0x7f66840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 -- 172.21.15.33:0/1689504845 shutdown_connections 2023-10-09T15:40:31.026 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.023+0000 7f668b1d8700 1 -- 172.21.15.33:0/1689504845 wait complete. 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.024+0000 7f668b1d8700 1 Processor -- start 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.024+0000 7f668b1d8700 1 -- start start 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.024+0000 7f668b1d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f6684151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6684153c30 0x7f66840c75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.028 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c8ad0 con 0x7f668415de50 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66841698b0 con 0x7f6684153c30 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66840c7ec0 con 0x7f66840cef40 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a1d6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f6684151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51322/0 (socket says 172.21.15.33:51322) 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 -- 172.21.15.33:0/4248298323 learned_addr learned my addr 172.21.15.33:0/4248298323 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f66899d5700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6684153c30 0x7f66840c75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 -- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 msgr2=0x7f6684151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f6684151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 -- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6684153c30 msgr2=0x7f66840c75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6684153c30 0x7f66840c75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.029 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 -- 172.21.15.33:0/4248298323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6678009420 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668a9d7700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f667400e8d0 tx=0x7f66740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674013680 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66740137e0 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66840c81a0 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6674013ba0 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.025+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66840c8760 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.026+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66840c8c40 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.027+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f66740123d0 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.027+0000 7f66827fc700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 0x7f66700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.027+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6674084de0 con 0x7f668415de50 2023-10-09T15:40:31.030 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.027+0000 7f668a1d6700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 0x7f66700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.031 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.028+0000 7f668a1d6700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 0x7f66700697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f667c005c50 tx=0x7f667c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.032 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.031+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6674051a30 con 0x7f668415de50 2023-10-09T15:40:31.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.307+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f6684152530 con 0x7f668415de50 2023-10-09T15:40:31.311 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.310+0000 7f66827fc700 1 -- 172.21.15.33:0/4248298323 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) v1 ==== 190+0+0 (secure 0 0 0) 0x7f6674055050 con 0x7f668415de50 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 msgr2=0x7f66700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 0x7f66700697d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f667c005c50 tx=0x7f667c009040 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 msgr2=0x7f66840cc0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f667400e8d0 tx=0x7f66740091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 shutdown_connections 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6670067320 0x7f66700697d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f668415de50 0x7f66840cc0e0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f66840cef40 0x7f6684151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 --2- 172.21.15.33:0/4248298323 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6684153c30 0x7f66840c75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.312+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 >> 172.21.15.33:0/4248298323 conn(0x7f66840703a0 msgr2=0x7f66840d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.313+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 shutdown_connections 2023-10-09T15:40:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.313+0000 7f668b1d8700 1 -- 172.21.15.33:0/4248298323 wait complete. 2023-10-09T15:40:31.315 INFO:teuthology.orchestra.run.smithi033.stderr:updated caps for client.0 2023-10-09T15:40:31.325 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:40:31.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.445+0000 7f65a3efd700 1 Processor -- start 2023-10-09T15:40:31.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.445+0000 7f65a3efd700 1 -- start start 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a3efd700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f659c1595d0 0x7f659c1599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a3efd700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f659c0675a0 0x7f659c06acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a3efd700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f659c0c7f50 con 0x7f659c06b230 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a3efd700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c06bd00 con 0x7f659c0675a0 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a3efd700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f659c06b740 con 0x7f659c1595d0 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a1498700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f659c0675a0 0x7f659c06acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a1498700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f659c0675a0 0x7f659c06acf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51330/0 (socket says 172.21.15.33:51330) 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.446+0000 7f65a1498700 1 -- 172.21.15.33:0/164321077 learned_addr learned my addr 172.21.15.33:0/164321077 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1c99700 1 --2- 172.21.15.33:0/164321077 >> v2:172.21.15.59:3300/0 conn(0x7f659c1595d0 0x7f659c1599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1498700 1 -- 172.21.15.33:0/164321077 >> v2:172.21.15.59:3300/0 conn(0x7f659c1595d0 msgr2=0x7f659c1599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1498700 1 --2- 172.21.15.33:0/164321077 >> v2:172.21.15.59:3300/0 conn(0x7f659c1595d0 0x7f659c1599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1498700 1 -- 172.21.15.33:0/164321077 >> v1:172.21.15.59:6789/0 conn(0x7f659c06b230 legacy=0x7f659c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1498700 1 -- 172.21.15.33:0/164321077 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f659c06ba20 con 0x7f659c0675a0 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a1498700 1 --2- 172.21.15.33:0/164321077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c0675a0 0x7f659c06acf0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f659c06a700 tx=0x7f6590009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d226a0b8036c053d server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a0c97700 1 -- 172.21.15.33:0/164321077 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000b820 con 0x7f659c0675a0 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a0c97700 1 -- 172.21.15.33:0/164321077 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f659000b980 con 0x7f659c0675a0 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a0c97700 1 -- 172.21.15.33:0/164321077 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f659000bd20 con 0x7f659c0675a0 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a3efd700 1 -- 172.21.15.33:0/164321077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c0675a0 msgr2=0x7f659c06acf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.447+0000 7f65a3efd700 1 --2- 172.21.15.33:0/164321077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c0675a0 0x7f659c06acf0 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f659c06a700 tx=0x7f6590009250 comp rx=0 tx=0).stop 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 -- 172.21.15.33:0/164321077 shutdown_connections 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 --2- 172.21.15.33:0/164321077 >> v2:172.21.15.59:3300/0 conn(0x7f659c1595d0 0x7f659c1599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.450 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 --2- 172.21.15.33:0/164321077 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c0675a0 0x7f659c06acf0 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 -- 172.21.15.33:0/164321077 >> 172.21.15.33:0/164321077 conn(0x7f659c0cd400 msgr2=0x7f659c0cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:31.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 -- 172.21.15.33:0/164321077 shutdown_connections 2023-10-09T15:40:31.451 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.448+0000 7f65a3efd700 1 -- 172.21.15.33:0/164321077 wait complete. 2023-10-09T15:40:31.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 Processor -- start 2023-10-09T15:40:31.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 -- start start 2023-10-09T15:40:31.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f659c0675a0 0x7f659c0b01a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f659c06b230 0x7f659c169f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c15ad80 con 0x7f659c1595d0 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0c4ff0 con 0x7f659c06b230 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.449+0000 7f65a3efd700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f659c0b0b50 con 0x7f659c0675a0 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51340/0 (socket says 172.21.15.33:51340) 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 -- 172.21.15.33:0/3236581445 learned_addr learned my addr 172.21.15.33:0/3236581445 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a1498700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f659c06b230 0x7f659c169f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a1c99700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f659c0675a0 0x7f659c0b01a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 -- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f659c0675a0 msgr2=0x7f659c0b01a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f659c0675a0 0x7f659c0b01a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 -- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f659c06b230 msgr2=0x7f659c169f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f659c06b230 0x7f659c169f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 -- 172.21.15.33:0/3236581445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65900094f0 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a249a700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f659400c510 tx=0x7f6594007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594011590 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65940116f0 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f659c0b0e30 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.450+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6594011ab0 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.451+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f659c15aa10 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.451+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f659c15aef0 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.452+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f659401c460 con 0x7f659c1595d0 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.452+0000 7f6599ffb700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 0x7f65880697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:31.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.452+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f6594084870 con 0x7f659c1595d0 2023-10-09T15:40:31.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.452+0000 7f65a1c99700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 0x7f65880697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:31.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.453+0000 7f65a1c99700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 0x7f65880697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f659c0b0a60 tx=0x7f658c0097e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:31.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.457+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f65940514c0 con 0x7f659c1595d0 2023-10-09T15:40:31.671 INFO:tasks.ceph.mds.c.smithi033.stderr:2023-10-09T15:40:31.670+0000 7f7f8c036700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:40:31.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.696+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f659c04c3c0 con 0x7f659c1595d0 2023-10-09T15:40:31.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.696+0000 7f6599ffb700 1 -- 172.21.15.33:0/3236581445 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 134 v134) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f6594084020 con 0x7f659c1595d0 2023-10-09T15:40:31.698 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:40:31.698 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":134,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:40:31.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 msgr2=0x7f65880697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 0x7f65880697d0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f659c0b0a60 tx=0x7f658c0097e0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 msgr2=0x7f659c16a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7f659400c510 tx=0x7f6594007f30 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 shutdown_connections 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6588067320 0x7f65880697d0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f659c1595d0 0x7f659c16a4a0 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f659c0675a0 0x7f659c0b01a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 --2- 172.21.15.33:0/3236581445 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f659c06b230 0x7f659c169f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 >> 172.21.15.33:0/3236581445 conn(0x7f659c0cd400 msgr2=0x7f659c0c83e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 shutdown_connections 2023-10-09T15:40:31.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:31.698+0000 7f65a3efd700 1 -- 172.21.15.33:0/3236581445 wait complete. 2023-10-09T15:40:31.701 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 134 2023-10-09T15:40:32.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 134, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-10-09T15:40:25.746616+0000', 'modified': '2023-10-09T15:40:29.369175+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9069}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9069': {'gid': 9069, 'name': 'c', 'rank': 0, 'incarnation': 130, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.33:6837/3266537603', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.33:6835', 'nonce': 3266537603}, {'type': 'v1', 'addr': '172.21.15.33:6837', 'nonce': 3266537603}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [34], 'metadata_pool': 33, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2023-10-09T15:40:32.113 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-10-09T15:40:32.113 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-10-09T15:40:32.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.235+0000 7f9e02ee9700 1 Processor -- start 2023-10-09T15:40:32.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.235+0000 7f9e02ee9700 1 -- start start 2023-10-09T15:40:32.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e02ee9700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9dfc153c30 0x7f9dfc15a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e02ee9700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f9dfc0cf110 0x7f9dfc15c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e02ee9700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9dfc15afd0 con 0x7f9dfc15de50 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e02ee9700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc15b2b0 con 0x7f9dfc153c30 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e02ee9700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9dfc15b590 con 0x7f9dfc0cf110 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e01ee7700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f9dfc153c30 0x7f9dfc15a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e016e6700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9dfc15de50 0x7f9dfc0cea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58386/0 (socket says 172.21.15.33:58386) 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e016e6700 1 -- 172.21.15.33:0/2117758128 learned_addr learned my addr 172.21.15.33:0/2117758128 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e026e8700 1 --2- 172.21.15.33:0/2117758128 >> v2:172.21.15.59:3300/0 conn(0x7f9dfc0cf110 0x7f9dfc15c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e01ee7700 1 -- 172.21.15.33:0/2117758128 >> v2:172.21.15.59:3300/0 conn(0x7f9dfc0cf110 msgr2=0x7f9dfc15c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2117758128 >> v2:172.21.15.59:3300/0 conn(0x7f9dfc0cf110 0x7f9dfc15c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e01ee7700 1 -- 172.21.15.33:0/2117758128 >> v1:172.21.15.33:6789/0 conn(0x7f9dfc15de50 legacy=0x7f9dfc0cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e01ee7700 1 -- 172.21.15.33:0/2117758128 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dfc15b870 con 0x7f9dfc153c30 2023-10-09T15:40:32.239 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.236+0000 7f9e00ee5700 1 -- 172.21.15.33:0/2117758128 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3881315958 0 0) 0x7f9dfc15afd0 con 0x7f9dfc15de50 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2117758128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc15a5e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0cdab0 tx=0x7f9dec009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aab41056fc6bfa70 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e00ee5700 1 -- 172.21.15.33:0/2117758128 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec00e070 con 0x7f9dfc153c30 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e00ee5700 1 -- 172.21.15.33:0/2117758128 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9dec00bb60 con 0x7f9dfc153c30 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e00ee5700 1 -- 172.21.15.33:0/2117758128 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec012430 con 0x7f9dfc153c30 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 -- 172.21.15.33:0/2117758128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 msgr2=0x7f9dfc15a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/2117758128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc15a5e0 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f9dfc0cdab0 tx=0x7f9dec009780 comp rx=0 tx=0).stop 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 -- 172.21.15.33:0/2117758128 shutdown_connections 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/2117758128 >> v2:172.21.15.59:3300/0 conn(0x7f9dfc0cf110 0x7f9dfc15c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/2117758128 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc15a5e0 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 -- 172.21.15.33:0/2117758128 >> 172.21.15.33:0/2117758128 conn(0x7f9dfc0703a0 msgr2=0x7f9dfc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 -- 172.21.15.33:0/2117758128 shutdown_connections 2023-10-09T15:40:32.240 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.237+0000 7f9e02ee9700 1 -- 172.21.15.33:0/2117758128 wait complete. 2023-10-09T15:40:32.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 Processor -- start 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 -- start start 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc0cf110 0x7f9dfc0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dfc15de50 0x7f9dfc152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c8d90 con 0x7f9dfc153c30 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c9070 con 0x7f9dfc0cf110 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e02ee9700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9dfc0c9350 con 0x7f9dfc15de50 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e016e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e016e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51354/0 (socket says 172.21.15.33:51354) 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.239+0000 7f9e016e6700 1 -- 172.21.15.33:0/1925052495 learned_addr learned my addr 172.21.15.33:0/1925052495 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.243 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc0cf110 0x7f9dfc0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e026e8700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dfc15de50 0x7f9dfc152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 -- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dfc15de50 msgr2=0x7f9dfc152f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dfc15de50 0x7f9dfc152f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 -- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc0cf110 msgr2=0x7f9dfc0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc0cf110 0x7f9dfc0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 -- 172.21.15.33:0/1925052495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dec009a20 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e016e6700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c5b0 tx=0x7f9df0001070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9df9ffb700 1 -- 172.21.15.33:0/1925052495 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0005b30 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9df9ffb700 1 -- 172.21.15.33:0/1925052495 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df0005c90 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9dfc0c9630 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9df9ffb700 1 -- 172.21.15.33:0/1925052495 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0007300 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.240+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9dfc0ca370 con 0x7f9dfc153c30 2023-10-09T15:40:32.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.242+0000 7f9df9ffb700 1 -- 172.21.15.33:0/1925052495 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9df001b3b0 con 0x7f9dfc153c30 2023-10-09T15:40:32.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.242+0000 7f9df9ffb700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 0x7f9de80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.242+0000 7f9df9ffb700 1 -- 172.21.15.33:0/1925052495 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9df00840a0 con 0x7f9dfc153c30 2023-10-09T15:40:32.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.242+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 0x7f9de80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.245 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.243+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 0x7f9de80697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0099f0 tx=0x7f9dec019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.244+0000 7f9e0d443b80 1 Processor -- start 2023-10-09T15:40:32.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.244+0000 7f9e0d443b80 1 -- start start 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa814c47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814e5850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa813f1a70 con 0x55fa8149ab80 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa813ef270 con 0x55fa814985f0 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa813eb060 con 0x55fa814e5480 2023-10-09T15:40:32.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51356/0 (socket says 172.21.15.33:51356) 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 -- 172.21.15.33:0/3592413491 learned_addr learned my addr 172.21.15.33:0/3592413491 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e016e6700 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814e5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa814c47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 -- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 msgr2=0x55fa814c47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa814c47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 -- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 msgr2=0x55fa814e5850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814e5850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 -- 172.21.15.33:0/3592413491 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa81285270 con 0x55fa8149ab80 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.245+0000 7f9e026e8700 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009cf0 tx=0x7f9df40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d01b289611000a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9de2ffd700 1 -- 172.21.15.33:0/3592413491 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4009850 con 0x55fa8149ab80 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9de2ffd700 1 -- 172.21.15.33:0/3592413491 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4011d50 con 0x55fa8149ab80 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9de2ffd700 1 -- 172.21.15.33:0/3592413491 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df401d690 con 0x55fa8149ab80 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 -- 172.21.15.33:0/3592413491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 msgr2=0x55fa8149aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009cf0 tx=0x7f9df40091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 -- 172.21.15.33:0/3592413491 shutdown_connections 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149aff0 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa814c47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/3592413491 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814e5850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 -- 172.21.15.33:0/3592413491 >> 172.21.15.33:0/3592413491 conn(0x55fa8149c0c0 msgr2=0x55fa8149c8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 -- 172.21.15.33:0/3592413491 shutdown_connections 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.246+0000 7f9e0d443b80 1 -- 172.21.15.33:0/3592413491 wait complete. 2023-10-09T15:40:32.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.247+0000 7f9e0d443b80 1 -- start start 2023-10-09T15:40:32.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.247+0000 7f9e0d443b80 1 Processor -- start 2023-10-09T15:40:32.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814c6200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa81396890 con 0x55fa8149ab80 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa813b1ea0 con 0x55fa814985f0 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8126de30 con 0x55fa814e5480 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e0d443b80 10 client.0 _ll_register_callbacks cb 0x55fa8145e2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51366/0 (socket says 172.21.15.33:51366) 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 -- 172.21.15.33:0/2748771601 learned_addr learned my addr 172.21.15.33:0/2748771601 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814c6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e026e8700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 -- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 msgr2=0x55fa8149b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 -- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 msgr2=0x55fa814c6200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814c6200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e016e6700 1 -- 172.21.15.33:0/2748771601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9df4009a20 con 0x55fa8149ab80 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.248+0000 7f9e026e8700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e016e6700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9df00546f0 tx=0x7f9df0050dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42bb36a9174b5ff server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df0057c40 con 0x55fa8149ab80 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9df005b990 con 0x55fa8149ab80 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa8148fcd0 con 0x55fa8149ab80 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9df0005e00 con 0x55fa8149ab80 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 10 client.9210 fetch_fsmap learned FSMap version 134 2023-10-09T15:40:32.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x55fa81227fe0 con 0x55fa8149ab80 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa8148fcd0 con 0x55fa8149ab80 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9df005bbe0 con 0x55fa8149ab80 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 10 client.9210 fetch_fsmap finished waiting for FSMap version 134 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 10 client.9210 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 20 client.9210 populate_metadata read hostname 'smithi033' 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa814c2280 0x55fa814c2650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 4 client.9210 mds_command: new command op to 9069 tid=0[{"prefix": "get_command_descriptions"}] 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 --> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55fa8146caa0 con 0x55fa814c2280 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.249+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa814c2280 0x55fa814c2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa814c2280 0x55fa814c2650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e1cccdf112b0ea7 server_cookie=1e18f720f9adb310 in_seq=0 out_seq=0 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9ddbfff700 10 client.9210 ms_handle_connect on v2:172.21.15.33:6835/3266537603 2023-10-09T15:40:32.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9ddbfff700 1 -- 172.21.15.33:0/2748771601 <== mds.0 v2:172.21.15.33:6835/3266537603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+16954 (crc 0 0 0) 0x55fa8146caa0 con 0x55fa814c2280 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9ddbfff700 10 client.9210 handle_command_reply: tid=0 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 client.9210 shutdown 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 msgr2=0x55fa8149af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 secure :-1 s=READY pgs=1771 cs=0 l=1 rev1=1 crypto rx=0x7f9df00546f0 tx=0x7f9df0050dc0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 shutdown_connections 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa814c2280 0x55fa814c2650 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa814985f0 0x55fa814c6200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9ddbfff700 0 client.9210 ms_handle_reset on v2:172.21.15.33:6835/3266537603 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/2748771601 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa8149ab80 0x55fa8149af70 unknown :-1 s=CLOSED pgs=1771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 >> 172.21.15.33:0/2748771601 conn(0x55fa8149c0c0 msgr2=0x55fa81491d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 shutdown_connections 2023-10-09T15:40:32.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.250+0000 7f9e0d443b80 1 -- 172.21.15.33:0/2748771601 wait complete. 2023-10-09T15:40:32.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.251+0000 7f9e0d443b80 20 client.9210 trim_cache size 0 max 16384 2023-10-09T15:40:32.268 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 Processor -- start 2023-10-09T15:40:32.269 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 -- start start 2023-10-09T15:40:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 0x55fa8149af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa8149b4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.271 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa814939e0 con 0x55fa814e5480 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa8149c490 con 0x55fa8149ab80 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa8147a510 con 0x55fa814985f0 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e026e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.268+0000 7f9e026e8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51382/0 (socket says 172.21.15.33:51382) 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 -- 172.21.15.33:0/1808492895 learned_addr learned my addr 172.21.15.33:0/1808492895 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 0x55fa8149af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e016e6700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa8149b4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 -- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 msgr2=0x55fa8149af70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 0x55fa8149af70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 -- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 msgr2=0x55fa8149b4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa8149b4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.272 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 -- 172.21.15.33:0/1808492895 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55fa8149d470 con 0x55fa814e5480 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 0x55fa8149af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e016e6700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa8149b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9e026e8700 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009cc0 tx=0x7f9df401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55d40166cc017b69 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9de37fe700 1 -- 172.21.15.33:0/1808492895 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df4011ec0 con 0x55fa814e5480 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9de37fe700 1 -- 172.21.15.33:0/1808492895 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9df4009850 con 0x55fa814e5480 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.269+0000 7f9de37fe700 1 -- 172.21.15.33:0/1808492895 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9df401d480 con 0x55fa814e5480 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- 172.21.15.33:0/1808492895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 msgr2=0x55fa814bf0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7f9df4009cc0 tx=0x7f9df401d000 comp rx=0 tx=0).stop 2023-10-09T15:40:32.273 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- 172.21.15.33:0/1808492895 shutdown_connections 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814e5480 0x55fa814bf0f0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814985f0 0x55fa8149af70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/1808492895 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa8149b4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- 172.21.15.33:0/1808492895 >> 172.21.15.33:0/1808492895 conn(0x55fa8149c0c0 msgr2=0x55fa81496e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- 172.21.15.33:0/1808492895 shutdown_connections 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- 172.21.15.33:0/1808492895 wait complete. 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 -- start start 2023-10-09T15:40:32.274 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.270+0000 7f9e0d443b80 1 Processor -- start 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa814ff560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa814c1a00 con 0x55fa814985f0 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x55fa81501070 con 0x55fa8149ab80 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x55fa814c2e60 con 0x55fa814e5480 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e0d443b80 10 client.0 _ll_register_callbacks cb 0x55fa814915d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e01ee7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e01ee7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51386/0 (socket says 172.21.15.33:51386) 2023-10-09T15:40:32.278 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.271+0000 7f9e01ee7700 1 -- 172.21.15.33:0/600916539 learned_addr learned my addr 172.21.15.33:0/600916539 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e016e6700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa814ff560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e026e8700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 -- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 msgr2=0x55fa8149de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 -- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 msgr2=0x55fa814ff560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa814ff560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 -- 172.21.15.33:0/600916539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55fa81285270 con 0x55fa814985f0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e016e6700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa814ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e01ee7700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f9dec012560 tx=0x7f9dec021040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c5d49896f9a0396 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 10 client.0 ms_handle_connect on v2:172.21.15.33:3300/0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9dec030040 con 0x55fa814985f0 2023-10-09T15:40:32.279 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mon.0 v2:172.21.15.33:3300/0 2 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f9dec028ae0 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55fa814e5110 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_get_version_reply(handle=1 version=134) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9dec01f430 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e0d443b80 10 client.9216 fetch_fsmap learned FSMap version 134 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,fsmap=134,monmap=2+}) v3 -- 0x55fa813b9780 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mon.0 v2:172.21.15.33:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55fa814e5110 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.272+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mon.0 v2:172.21.15.33:3300/0 5 ==== fsmap(e 134) v1 ==== 3100+0+0 (secure 0 0 0) 0x7f9dec03b020 con 0x55fa814985f0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 10 client.9216 fetch_fsmap finished waiting for FSMap version 134 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 10 client.9216 resolve_mds: resolved name 'c' to daemon mds.c 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 20 client.9216 populate_metadata read hostname 'smithi033' 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa815478b0 0x55fa81547c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 4 client.9216 mds_command: new command op to 9069 tid=0[{"prefix": "status"}] 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 --> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] -- command(tid 0: {"prefix": "status"}) v1 -- 0x7f9df4011d50 con 0x55fa815478b0 2023-10-09T15:40:32.280 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e016e6700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa815478b0 0x55fa81547c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9ddbfff700 10 client.9216 ms_handle_connect on v2:172.21.15.33:6835/3266537603 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e016e6700 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa815478b0 0x55fa81547c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8e88c975b2a3ba36 server_cookie=d8e4670e12c56303 in_seq=0 out_seq=0 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9ddbfff700 1 -- 172.21.15.33:0/600916539 <== mds.0 v2:172.21.15.33:6835/3266537603 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+328 (crc 0 0 0) 0x7f9df4011d50 con 0x55fa815478b0 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9ddbfff700 10 client.9216 handle_command_reply: tid=0 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 client.9216 shutdown 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 msgr2=0x55fa815414e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7f9dec012560 tx=0x7f9dec021040 comp rx=0 tx=0).stop 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 shutdown_connections 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:6835/3266537603,v1:172.21.15.33:6837/3266537603] conn(0x55fa815478b0 0x55fa81547c80 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x55fa814985f0 0x55fa815414e0 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9ddbfff700 0 client.9216 ms_handle_reset on v2:172.21.15.33:6835/3266537603 2023-10-09T15:40:32.281 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x55fa814e5480 0x55fa8149de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 --2- 172.21.15.33:0/600916539 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x55fa8149ab80 0x55fa814ff560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 >> 172.21.15.33:0/600916539 conn(0x55fa8149c0c0 msgr2=0x55fa8149c680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 shutdown_connections 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.273+0000 7f9e0d443b80 1 -- 172.21.15.33:0/600916539 wait complete. 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e0d443b80 20 client.9216 trim_cache size 0 max 16384 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stdout: "cluster_fsid": "38c7cb5d-ab66-41cb-ab30-25e3d813cdd1", 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stdout: "whoami": 0, 2023-10-09T15:40:32.282 INFO:teuthology.orchestra.run.smithi033.stdout: "id": 9069, 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "want_state": "up:active", 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "state": "up:active", 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "fs_name": "cephfs", 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "rank_uptime": 5.9279686979999999, 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "mdsmap_epoch": 134, 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch": 200, 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "osdmap_epoch_barrier": 200, 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout: "uptime": 10.990089591 2023-10-09T15:40:32.283 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 msgr2=0x7f9de80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 0x7f9de80697d0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f9dec0099f0 tx=0x7f9dec019000 comp rx=0 tx=0).stop 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 msgr2=0x7f9dfc0b5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c5b0 tx=0x7f9df0001070 comp rx=0 tx=0).stop 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 shutdown_connections 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9de8067320 0x7f9de80697d0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9dfc15de50 0x7f9dfc152f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.284 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9dfc0cf110 0x7f9dfc0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 --2- 172.21.15.33:0/1925052495 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9dfc153c30 0x7f9dfc0b5a20 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 >> 172.21.15.33:0/1925052495 conn(0x7f9dfc0703a0 msgr2=0x7f9dfc0d0450 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 shutdown_connections 2023-10-09T15:40:32.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.274+0000 7f9e02ee9700 1 -- 172.21.15.33:0/1925052495 wait complete. 2023-10-09T15:40:32.287 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:40:32.406 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.405+0000 7f85fdaf4700 1 Processor -- start 2023-10-09T15:40:32.407 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 -- start start 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85f81598b0 0x7f85f80af250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f85f8159c80 0x7f85f80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85f80ce9d0 con 0x7f85f80af790 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80afc30 con 0x7f85f81598b0 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85fdaf4700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f80aff10 con 0x7f85f8159c80 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.406+0000 7f85f77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85f81598b0 0x7f85f80af250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.409 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f85f81598b0 0x7f85f80af250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51398/0 (socket says 172.21.15.33:51398) 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 -- 172.21.15.33:0/218574829 learned_addr learned my addr 172.21.15.33:0/218574829 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f6ffd700 1 --2- 172.21.15.33:0/218574829 >> v2:172.21.15.59:3300/0 conn(0x7f85f8159c80 0x7f85f80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 -- 172.21.15.33:0/218574829 >> v2:172.21.15.59:3300/0 conn(0x7f85f8159c80 msgr2=0x7f85f80cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 --2- 172.21.15.33:0/218574829 >> v2:172.21.15.59:3300/0 conn(0x7f85f8159c80 0x7f85f80cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 -- 172.21.15.33:0/218574829 >> v1:172.21.15.59:6789/0 conn(0x7f85f80af790 legacy=0x7f85f80cee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 -- 172.21.15.33:0/218574829 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f80ce380 con 0x7f85f81598b0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f77fe700 1 --2- 172.21.15.33:0/218574829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f81598b0 0x7f85f80af250 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f85f80642b0 tx=0x7f85e8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72788ffcc88a158 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f67fc700 1 -- 172.21.15.33:0/218574829 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800b820 con 0x7f85f81598b0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f67fc700 1 -- 172.21.15.33:0/218574829 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e800b980 con 0x7f85f81598b0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.407+0000 7f85f67fc700 1 -- 172.21.15.33:0/218574829 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e800bd20 con 0x7f85f81598b0 2023-10-09T15:40:32.410 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 -- 172.21.15.33:0/218574829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f81598b0 msgr2=0x7f85f80af250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/218574829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f81598b0 0x7f85f80af250 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7f85f80642b0 tx=0x7f85e8009250 comp rx=0 tx=0).stop 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 -- 172.21.15.33:0/218574829 shutdown_connections 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/218574829 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f81598b0 0x7f85f80af250 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/218574829 >> v2:172.21.15.59:3300/0 conn(0x7f85f8159c80 0x7f85f80cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 -- 172.21.15.33:0/218574829 >> 172.21.15.33:0/218574829 conn(0x7f85f8070e30 msgr2=0x7f85f80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 -- 172.21.15.33:0/218574829 shutdown_connections 2023-10-09T15:40:32.411 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.408+0000 7f85fdaf4700 1 -- 172.21.15.33:0/218574829 wait complete. 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.409+0000 7f85fdaf4700 1 Processor -- start 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.409+0000 7f85fdaf4700 1 -- start start 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85f81598b0 0x7f85f8153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 0x7f85f80b5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b4a80 con 0x7f85f80af790 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b3e70 con 0x7f85f8159c80 2023-10-09T15:40:32.414 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80b4150 con 0x7f85f81598b0 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51408/0 (socket says 172.21.15.33:51408) 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 -- 172.21.15.33:0/670536053 learned_addr learned my addr 172.21.15.33:0/670536053 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f7fff700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 0x7f85f80b5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f6ffd700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85f81598b0 0x7f85f8153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 -- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85f81598b0 msgr2=0x7f85f8153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85f81598b0 0x7f85f8153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 -- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 msgr2=0x7f85f80b5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 0x7f85f80b5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 -- 172.21.15.33:0/670536053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e80094f0 con 0x7f85f80af790 2023-10-09T15:40:32.415 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f7fff700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 0x7f85f80b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85f77fe700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009290 tx=0x7f85e8016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e8011e20 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85e8020070 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.410+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85f80b4430 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.411+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85e801b6a0 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.411+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f815b920 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.411+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f815bb10 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.412+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f85e8022030 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.412+0000 7f85df7fe700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 0x7f85e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.412+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f85e8086b40 con 0x7f85f80af790 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.412+0000 7f85f6ffd700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 0x7f85e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:32.416 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.413+0000 7f85f6ffd700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 0x7f85e40697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:32.417 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.417+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f85f815bb10 con 0x7f85f80af790 2023-10-09T15:40:32.655 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.654+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f85f815bb10 con 0x7f85f80af790 2023-10-09T15:40:32.656 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.655+0000 7f85df7fe700 1 -- 172.21.15.33:0/670536053 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v134) v1 ==== 53+0+73 (secure 0 0 0) 0x7f85f815bb10 con 0x7f85f80af790 2023-10-09T15:40:32.656 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:40:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 msgr2=0x7f85e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 0x7f85e40697d0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f85ec006fd0 tx=0x7f85ec008040 comp rx=0 tx=0).stop 2023-10-09T15:40:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 msgr2=0x7f85f80b34b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:32.658 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f85e8009290 tx=0x7f85e8016000 comp rx=0 tx=0).stop 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 shutdown_connections 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85e4067320 0x7f85e40697d0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85f80af790 0x7f85f80b34b0 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85f8159c80 0x7f85f80b5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 --2- 172.21.15.33:0/670536053 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85f81598b0 0x7f85f8153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 >> 172.21.15.33:0/670536053 conn(0x7f85f8070e30 msgr2=0x7f85f80c65e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 shutdown_connections 2023-10-09T15:40:32.659 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:32.657+0000 7f85fdaf4700 1 -- 172.21.15.33:0/670536053 wait complete. 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi033.front.sepia.ceph.com 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:40:32.670 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:40:32.671 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:32.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.671 DEBUG:teuthology.orchestra.run.smithi033:> ip addr 2023-10-09T15:40:32.686 INFO:teuthology.orchestra.run.smithi033.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:40:32.686 INFO:teuthology.orchestra.run.smithi033.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 ::1/128 scope host 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:14 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f0 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 0c:c4:7a:6b:fd:15 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp7s0f1 2023-10-09T15:40:32.687 INFO:teuthology.orchestra.run.smithi033.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:94 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f0 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: inet 172.21.15.33/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft 41855sec preferred_lft 41855sec 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::ae1f:6bff:fea5:d294/64 scope link 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether ac:1f:6b:a5:d2:95 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: altname enp1s0f1 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:32.688 INFO:teuthology.orchestra.run.smithi033.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::498:7ff:fea0:210a/64 scope link 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 66:83:ee:1a:fb:33 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::6483:eeff:fe1a:fb33/64 scope link 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: link/ether 2e:2a:f6:70:c8:c3 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: inet6 fe80::2c2a:f6ff:fe70:c8c3/64 scope link 2023-10-09T15:40:32.689 INFO:teuthology.orchestra.run.smithi033.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:32.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.690 DEBUG:teuthology.orchestra.run.smithi033:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:40:32.751 INFO:teuthology.orchestra.run.smithi033.stdout:1 2023-10-09T15:40:32.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.752 DEBUG:teuthology.orchestra.run.smithi033:> route 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run.smithi033.stdout:Kernel IP routing table 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run.smithi033.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run.smithi033.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run.smithi033.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run.smithi033.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:40:32.809 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> (cd / && exec bash -c ' 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> set -e 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:40:32.810 DEBUG:teuthology.orchestra.run.smithi033:> ') 2023-10-09T15:40:32.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.912 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:40:32.926 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:40:32.926 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:40:32.927 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:32.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:32.927 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link set brx.0 up 2023-10-09T15:40:32.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:32.991 DEBUG:teuthology.orchestra.run.smithi033:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:33.047 INFO:teuthology.orchestra.run.smithi033.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-10-09T15:40:33.047 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:33.047 DEBUG:teuthology.orchestra.run.smithi033:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:33.101 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:40:33.101 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:40:33.101 DEBUG:teuthology.orchestra.run.smithi033:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:33.182 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:33.183 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:33.191 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:33.191 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:33.191 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:33.192 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:33.192 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:33.213 INFO:teuthology.orchestra.run.smithi033.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs 2023-10-09T15:40:33.213 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs". 2023-10-09T15:40:33.213 INFO:teuthology.orchestra.run.smithi033.stdout:invalid new device string format 2023-10-09T15:40:33.213 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:33.214 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:33.214 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:40:33.214 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:40:33.214 INFO:teuthology.orchestra.run.smithi033.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,key=0,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:40:33.216 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:40:33.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.216 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:33.281 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-10-09T15:40:33.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.442+0000 7f5a3d514700 1 Processor -- start 2023-10-09T15:40:33.443 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.442+0000 7f5a3d514700 1 -- start start 2023-10-09T15:40:33.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380ceac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 0x7f5a380aedb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a38159920 0x7f5a380ad090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380acc00 con 0x7f5a38159920 2023-10-09T15:40:33.446 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a380abff0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3d514700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380ac2d0 con 0x7f5a38159550 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3cd13700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a38159920 0x7f5a380ad090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3cd13700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5a38159920 0x7f5a380ad090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51416/0 (socket says 172.21.15.33:51416) 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3cd13700 1 -- 172.21.15.33:0/2298745521 learned_addr learned my addr 172.21.15.33:0/2298745521 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a377fe700 1 --2- 172.21.15.33:0/2298745521 >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 0x7f5a380aedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a37fff700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380ceac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.443+0000 7f5a3cd13700 1 -- 172.21.15.33:0/2298745521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 msgr2=0x7f5a380ceac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:33.447 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380ceac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3cd13700 1 -- 172.21.15.33:0/2298745521 >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 msgr2=0x7f5a380aedb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/2298745521 >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 0x7f5a380aedb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3cd13700 1 -- 172.21.15.33:0/2298745521 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a380ac5b0 con 0x7f5a38159920 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a377fe700 1 --2- 172.21.15.33:0/2298745521 >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 0x7f5a380aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a38159920 0x7f5a380ad090 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5a3806b120 tx=0x7f5a30009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44cc8daa8fd48ea server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a36ffd700 1 -- 172.21.15.33:0/2298745521 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a3000e070 con 0x7f5a38159920 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a36ffd700 1 -- 172.21.15.33:0/2298745521 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a3000ba50 con 0x7f5a38159920 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a36ffd700 1 -- 172.21.15.33:0/2298745521 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300092e0 con 0x7f5a38159920 2023-10-09T15:40:33.448 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 -- 172.21.15.33:0/2298745521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a38159920 msgr2=0x7f5a380ad090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a38159920 0x7f5a380ad090 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f5a3806b120 tx=0x7f5a30009840 comp rx=0 tx=0).stop 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 -- 172.21.15.33:0/2298745521 shutdown_connections 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a38159920 0x7f5a380ad090 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 --2- 172.21.15.33:0/2298745521 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 --2- 172.21.15.33:0/2298745521 >> v2:172.21.15.59:3300/0 conn(0x7f5a3815dfd0 0x7f5a380aedb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 -- 172.21.15.33:0/2298745521 >> 172.21.15.33:0/2298745521 conn(0x7f5a3806ce80 msgr2=0x7f5a380ce3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 -- 172.21.15.33:0/2298745521 shutdown_connections 2023-10-09T15:40:33.449 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.444+0000 7f5a3d514700 1 -- 172.21.15.33:0/2298745521 wait complete. 2023-10-09T15:40:33.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.445+0000 7f5a3d514700 1 Processor -- start 2023-10-09T15:40:33.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 -- start start 2023-10-09T15:40:33.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a38159920 0x7f5a380b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380b3290 con 0x7f5a3815dfd0 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a38158d80 con 0x7f5a38159920 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.446+0000 7f5a3d514700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a380b2680 con 0x7f5a38159550 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51422/0 (socket says 172.21.15.33:51422) 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 -- 172.21.15.33:0/1611379956 learned_addr learned my addr 172.21.15.33:0/1611379956 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a37fff700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a377fe700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a38159920 0x7f5a380b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 -- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 msgr2=0x7f5a380c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:33.453 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 -- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a38159920 msgr2=0x7f5a380b1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a38159920 0x7f5a380b1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 -- 172.21.15.33:0/1611379956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a30009ae0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3cd13700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f5a3806ad70 tx=0x7f5a30018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300032f0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a30008ce0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a380b2960 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a300266b0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.447+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a380b2f20 con 0x7f5a3815dfd0 2023-10-09T15:40:33.454 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.448+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a380acd90 con 0x7f5a3815dfd0 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.449+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5a30003040 con 0x7f5a3815dfd0 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.449+0000 7f5a1ffff700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 0x7f5a240697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.449+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5a30086660 con 0x7f5a3815dfd0 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.449+0000 7f5a37fff700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 0x7f5a240697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.450+0000 7f5a37fff700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 0x7f5a240697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006fd0 tx=0x7f5a28008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:33.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.453+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5a300531e0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.693 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.693+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f5a3804c3c0 con 0x7f5a3815dfd0 2023-10-09T15:40:33.694 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.693+0000 7f5a1ffff700 1 -- 172.21.15.33:0/1611379956 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v134) v1 ==== 53+0+73 (secure 0 0 0) 0x7f5a30056800 con 0x7f5a3815dfd0 2023-10-09T15:40:33.694 INFO:teuthology.orchestra.run.smithi033.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-10-09T15:40:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 msgr2=0x7f5a240697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 0x7f5a240697d0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f5a28006fd0 tx=0x7f5a28008040 comp rx=0 tx=0).stop 2023-10-09T15:40:33.696 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 msgr2=0x7f5a38158840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f5a3806ad70 tx=0x7f5a30018000 comp rx=0 tx=0).stop 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 shutdown_connections 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5a24067320 0x7f5a240697d0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5a3815dfd0 0x7f5a38158840 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5a38159550 0x7f5a380c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 --2- 172.21.15.33:0/1611379956 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5a38159920 0x7f5a380b1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 >> 172.21.15.33:0/1611379956 conn(0x7f5a3806ce80 msgr2=0x7f5a380b0200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 shutdown_connections 2023-10-09T15:40:33.697 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:33.695+0000 7f5a3d514700 1 -- 172.21.15.33:0/1611379956 wait complete. 2023-10-09T15:40:33.708 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2023-10-09T15:40:33.708 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-10-09T15:40:33.708 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi059.front.sepia.ceph.com 2023-10-09T15:40:33.708 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-10-09T15:40:33.709 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:33.709 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2023-10-09T15:40:33.709 INFO:tasks.cephfs.mount:self.cephfs_mntpt = / 2023-10-09T15:40:33.709 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-10-09T15:40:33.709 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:33.709 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.709 DEBUG:teuthology.orchestra.run.smithi059:> ip addr 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: inet 127.0.0.1/8 scope host lo 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 ::1/128 scope host 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:33.728 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:ca brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f0 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout:3: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2a brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f0 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: inet 172.21.15.59/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft 41862sec preferred_lft 41862sec 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::ec4:7aff:febd:192a/64 scope link 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout:4: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:6b:fe:cb brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp7s0f1 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-10-09T15:40:33.729 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 0c:c4:7a:bd:19:2b brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: altname enp1s0f1 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::24fa:cdff:fe55:fa3/64 scope link 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether 12:5c:a9:5e:9e:92 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::105c:a9ff:fe5e:9e92/64 scope link 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.730 INFO:teuthology.orchestra.run.smithi059.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-10-09T15:40:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: link/ether a2:2e:ed:5b:b4:72 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:40:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: inet6 fe80::a02e:edff:fe5b:b472/64 scope link 2023-10-09T15:40:33.731 INFO:teuthology.orchestra.run.smithi059.stdout: valid_lft forever preferred_lft forever 2023-10-09T15:40:33.731 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.731 DEBUG:teuthology.orchestra.run.smithi059:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-10-09T15:40:33.797 INFO:teuthology.orchestra.run.smithi059.stdout:1 2023-10-09T15:40:33.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.799 DEBUG:teuthology.orchestra.run.smithi059:> route 2023-10-09T15:40:33.858 INFO:teuthology.orchestra.run.smithi059.stdout:Kernel IP routing table 2023-10-09T15:40:33.859 INFO:teuthology.orchestra.run.smithi059.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-10-09T15:40:33.859 INFO:teuthology.orchestra.run.smithi059.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2023-10-09T15:40:33.859 INFO:teuthology.orchestra.run.smithi059.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2023-10-09T15:40:33.859 INFO:teuthology.orchestra.run.smithi059.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-10-09T15:40:33.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.859 DEBUG:teuthology.orchestra.run.smithi059:> (cd / && exec bash -c ' 2023-10-09T15:40:33.859 DEBUG:teuthology.orchestra.run.smithi059:> set -e 2023-10-09T15:40:33.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2023-10-09T15:40:33.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2023-10-09T15:40:33.860 DEBUG:teuthology.orchestra.run.smithi059:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2023-10-09T15:40:33.860 DEBUG:teuthology.orchestra.run.smithi059:> ') 2023-10-09T15:40:33.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.968 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:40:33.984 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:40:33.984 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:40:33.984 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:33.984 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:33.984 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link set brx.0 up 2023-10-09T15:40:34.050 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:34.051 DEBUG:teuthology.orchestra.run.smithi059:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:34.106 INFO:teuthology.orchestra.run.smithi059.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-10-09T15:40:34.107 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-10-09T15:40:34.107 DEBUG:teuthology.orchestra.run.smithi059:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:34.161 INFO:tasks.cephfs.kernel_mount:mounting using device: :/ 2023-10-09T15:40:34.161 INFO:teuthology.orchestra.run:Running command with timeout 1800 2023-10-09T15:40:34.162 DEBUG:teuthology.orchestra.run.smithi059:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/ /home/ubuntu/cephtest/mnt.1 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:34.243 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:34.243 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:34.243 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:34.251 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:34.251 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:34.251 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:34.251 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:34.252 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=1,mds_namespace=cephfs 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs". 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:invalid new device string format 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:3300,172.21.15.59:3300,172.21.15.59:3301" 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: switching to using v1 address with old syntax 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: resolved to: "172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790" 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.33:6789,172.21.15.59:6789,172.21.15.59:6790:/ 2023-10-09T15:40:34.274 INFO:teuthology.orchestra.run.smithi059.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=1,mds_namespace=cephfs,key=1,fsid=38c7cb5d-ab66-41cb-ab30-25e3d813cdd1" will pass to kernel 2023-10-09T15:40:34.276 INFO:tasks.cephfs.kernel_mount:mount command passed 2023-10-09T15:40:34.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:34.276 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:34.342 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2023-10-09T15:40:34.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.471+0000 7f5b88a27700 1 Processor -- start 2023-10-09T15:40:34.472 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.471+0000 7f5b88a27700 1 -- start start 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b88a27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b88a27700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b840cb6f0 0x7f5b840cbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b88a27700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b840ccfd0 con 0x7f5b8406dcf0 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b88a27700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b840cc0b0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b88a27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8415a410 con 0x7f5b84159530 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b840cb6f0 0x7f5b840cbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5b840cb6f0 0x7f5b840cbb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51430/0 (socket says 172.21.15.33:51430) 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 -- 172.21.15.33:0/1205543389 learned_addr learned my addr 172.21.15.33:0/1205543389 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:34.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b8259c700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 -- 172.21.15.33:0/1205543389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 msgr2=0x7f5b840ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 -- 172.21.15.33:0/1205543389 >> v1:172.21.15.59:6789/0 conn(0x7f5b8406dcf0 legacy=0x7f5b84159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 -- 172.21.15.33:0/1205543389 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b8415a6f0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.472+0000 7f5b82d9d700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b840cbb70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009f20 tx=0x7f5b7c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d49f8f7b1c8ed53 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b8159a700 1 -- 172.21.15.33:0/1205543389 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c00e070 con 0x7f5b840cb6f0 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b8159a700 1 -- 172.21.15.33:0/1205543389 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b7c00ba80 con 0x7f5b840cb6f0 2023-10-09T15:40:34.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b8159a700 1 -- 172.21.15.33:0/1205543389 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b7c0092e0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 -- 172.21.15.33:0/1205543389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 msgr2=0x7f5b840cbb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b840cbb70 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f5b7c009f20 tx=0x7f5b7c009840 comp rx=0 tx=0).stop 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 -- 172.21.15.33:0/1205543389 shutdown_connections 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b840cbb70 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1205543389 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 -- 172.21.15.33:0/1205543389 >> 172.21.15.33:0/1205543389 conn(0x7f5b840703a0 msgr2=0x7f5b840707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:34.478 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 -- 172.21.15.33:0/1205543389 shutdown_connections 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.473+0000 7f5b88a27700 1 -- 172.21.15.33:0/1205543389 wait complete. 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.474+0000 7f5b88a27700 1 Processor -- start 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 -- start start 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8406dcf0 0x7f5b840c8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840c9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b84154420 con 0x7f5b840cb6f0 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c9ed0 con 0x7f5b8406dcf0 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b88a27700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b840c8810 con 0x7f5b84159530 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b81d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51434/0 (socket says 172.21.15.33:51434) 2023-10-09T15:40:34.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b8259c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8406dcf0 0x7f5b840c8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b81d9b700 1 -- 172.21.15.33:0/1141081430 learned_addr learned my addr 172.21.15.33:0/1141081430 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.475+0000 7f5b82d9d700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840c9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 -- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 msgr2=0x7f5b840c9990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840c9990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 -- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8406dcf0 msgr2=0x7f5b840c8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8406dcf0 0x7f5b840c8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 -- 172.21.15.33:0/1141081430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b7c009ae0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b81d9b700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c790 tx=0x7f5b6c007f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c011590 con 0x7f5b840cb6f0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b6c011710 con 0x7f5b840cb6f0 2023-10-09T15:40:34.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b840c8af0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b6c011ad0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.476+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b840c90b0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.477+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8404c3c0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.478+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5b6c01b3b0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.478+0000 7f5b7a7fc700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:34.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.478+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f5b6c084030 con 0x7f5b840cb6f0 2023-10-09T15:40:34.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.478+0000 7f5b8259c700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:34.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.478+0000 7f5b8259c700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 0x7f5b640697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006fd0 tx=0x7f5b74008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:34.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.482+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5b6c050cc0 con 0x7f5b840cb6f0 2023-10-09T15:40:34.730 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:34.728+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f5b8415a9d0 con 0x7f5b840cb6f0 2023-10-09T15:40:35.392 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.391+0000 7f5b7a7fc700 1 -- 172.21.15.33:0/1141081430 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v135) v1 ==== 136+0+0 (secure 0 0 0) 0x7f5b6c017020 con 0x7f5b840cb6f0 2023-10-09T15:40:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 msgr2=0x7f5b640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 0x7f5b640697d0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5b74006fd0 tx=0x7f5b74008040 comp rx=0 tx=0).stop 2023-10-09T15:40:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 msgr2=0x7f5b84153ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f5b6c00c790 tx=0x7f5b6c007f40 comp rx=0 tx=0).stop 2023-10-09T15:40:35.395 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 shutdown_connections 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5b64067320 0x7f5b640697d0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5b84159530 0x7f5b840c9990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5b8406dcf0 0x7f5b840c8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 --2- 172.21.15.33:0/1141081430 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5b840cb6f0 0x7f5b84153ee0 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 >> 172.21.15.33:0/1141081430 conn(0x7f5b840703a0 msgr2=0x7f5b840cd650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 shutdown_connections 2023-10-09T15:40:35.396 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.394+0000 7f5b88a27700 1 -- 172.21.15.33:0/1141081430 wait complete. 2023-10-09T15:40:35.409 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2023-10-09T15:40:35.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 Processor -- start 2023-10-09T15:40:35.536 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 -- start start 2023-10-09T15:40:35.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.537 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc06815a400 0x7fc068156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc06815ae40 con 0x7fc0680cb5a0 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0680ce0f0 con 0x7fc06815a400 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.535+0000 7fc06ca67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680cbde0 con 0x7fc0680cb970 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc05dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc06815a400 0x7fc068156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc05dd9b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:36244/0 (socket says 172.21.15.33:36244) 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc06815a400 0x7fc068156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:34712/0 (socket says 172.21.15.33:34712) 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc05dd9b700 1 -- 172.21.15.33:0/133764855 learned_addr learned my addr 172.21.15.33:0/133764855 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc06659c700 1 --1- 172.21.15.33:0/133764855 >> v1:172.21.15.59:6789/0 conn(0x7fc0680cb5a0 0x7fc0680cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:45560/0 (socket says 172.21.15.33:45560) 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 -- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 msgr2=0x7fc068159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:35.538 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 -- 172.21.15.33:0/133764855 >> v1:172.21.15.59:6789/0 conn(0x7fc0680cb5a0 legacy=0x7fc0680cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 -- 172.21.15.33:0/133764855 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc06815ab60 con 0x7fc06815a400 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc05dd9b700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.536+0000 7fc066d9d700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06815a400 0x7fc068156e90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc060009e90 tx=0x7fc060009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4fdaa1ca75febc8b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc065d9b700 1 -- 172.21.15.33:0/133764855 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc06000e070 con 0x7fc06815a400 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc065d9b700 1 -- 172.21.15.33:0/133764855 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc06000bbf0 con 0x7fc06815a400 2023-10-09T15:40:35.539 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc065d9b700 1 -- 172.21.15.33:0/133764855 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc060012430 con 0x7fc06815a400 2023-10-09T15:40:35.541 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 -- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06815a400 msgr2=0x7fc068156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06815a400 0x7fc068156e90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fc060009e90 tx=0x7fc060009780 comp rx=0 tx=0).stop 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 -- 172.21.15.33:0/133764855 shutdown_connections 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc06815a400 0x7fc068156e90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 --2- 172.21.15.33:0/133764855 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc0680cb970 0x7fc068159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 -- 172.21.15.33:0/133764855 >> 172.21.15.33:0/133764855 conn(0x7fc068070e30 msgr2=0x7fc0680d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 -- 172.21.15.33:0/133764855 shutdown_connections 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.537+0000 7fc06ca67700 1 -- 172.21.15.33:0/133764855 wait complete. 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.538+0000 7fc06ca67700 1 Processor -- start 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 -- start start 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.542 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0680cb970 0x7fc0680b5b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06815a400 0x7fc0680b6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680c8550 con 0x7fc0680cb5a0 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680c7940 con 0x7fc0680cb970 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06ca67700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0680c7c20 con 0x7fc06815a400 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06659c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51436/0 (socket says 172.21.15.33:51436) 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.539+0000 7fc06659c700 1 -- 172.21.15.33:0/1299316911 learned_addr learned my addr 172.21.15.33:0/1299316911 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc05dd9b700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0680cb970 0x7fc0680b5b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc066d9d700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06815a400 0x7fc0680b6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 -- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06815a400 msgr2=0x7fc0680b6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06815a400 0x7fc0680b6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.543 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 -- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0680cb970 msgr2=0x7fc0680b5b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0680cb970 0x7fc0680b5b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 -- 172.21.15.33:0/1299316911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0500094f0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06659c700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c560 tx=0x7fc058007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc058005a70 con 0x7fc0680cb5a0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc058005bd0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc060009a20 con 0x7fc0680cb5a0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0580070d0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.544 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.540+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0680c81e0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.541+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc06804c3c0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.541+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc058007480 con 0x7fc0680cb5a0 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.542+0000 7fc05effd700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.542+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fc058084010 con 0x7fc0680cb5a0 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.542+0000 7fc05dd9b700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.545 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.542+0000 7fc05dd9b700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 0x7fc0480697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc0680c6b90 tx=0x7fc050009250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.547 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.546+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc058050ca0 con 0x7fc0680cb5a0 2023-10-09T15:40:35.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.767+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) v1 -- 0x7fc0680c8690 con 0x7fc048067320 2023-10-09T15:40:35.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.768+0000 7fc05effd700 1 -- 172.21.15.33:0/1299316911 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+41 (secure 0 0 0) 0x7fc050011b80 con 0x7fc048067320 2023-10-09T15:40:35.769 INFO:teuthology.orchestra.run.smithi033.stdout:[ 2023-10-09T15:40:35.770 INFO:teuthology.orchestra.run.smithi033.stdout: { 2023-10-09T15:40:35.770 INFO:teuthology.orchestra.run.smithi033.stdout: "name": "cephfs" 2023-10-09T15:40:35.770 INFO:teuthology.orchestra.run.smithi033.stdout: } 2023-10-09T15:40:35.770 INFO:teuthology.orchestra.run.smithi033.stdout:] 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 msgr2=0x7fc0480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 0x7fc0480697d0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fc0680c6b90 tx=0x7fc050009250 comp rx=0 tx=0).stop 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 msgr2=0x7fc0681523f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7fc05800c560 tx=0x7fc058007f70 comp rx=0 tx=0).stop 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 shutdown_connections 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc048067320 0x7fc0480697d0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.770+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc0680cb5a0 0x7fc0681523f0 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.771+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc06815a400 0x7fc0680b6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.771+0000 7fc06ca67700 1 --2- 172.21.15.33:0/1299316911 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc0680cb970 0x7fc0680b5b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.771+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 >> 172.21.15.33:0/1299316911 conn(0x7fc068070e30 msgr2=0x7fc0680b0910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.771+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 shutdown_connections 2023-10-09T15:40:35.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.771+0000 7fc06ca67700 1 -- 172.21.15.33:0/1299316911 wait complete. 2023-10-09T15:40:35.784 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-10-09T15:40:35.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.904+0000 7f417f5f7700 1 Processor -- start 2023-10-09T15:40:35.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.905+0000 7f417f5f7700 1 -- start start 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.905+0000 7f417f5f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780cbbc0 0x7f41780c93a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.905+0000 7f417f5f7700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f41780c98e0 0x7f41780c7d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417f5f7700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4178068350 con 0x7f4178159970 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417f5f7700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f41780c9d60 con 0x7f41780c98e0 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417f5f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4178068db0 con 0x7f41780cbbc0 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417d393700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4178159970 0x7f41780686a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58390/0 (socket says 172.21.15.33:58390) 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417d393700 1 -- 172.21.15.33:0/2445908769 learned_addr learned my addr 172.21.15.33:0/2445908769 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417cb92700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780cbbc0 0x7f41780c93a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417db94700 1 --2- 172.21.15.33:0/2445908769 >> v2:172.21.15.59:3300/0 conn(0x7f41780c98e0 0x7f41780c7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1922773303 0 0) 0x7f4178068350 con 0x7f4178159970 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4160003570 con 0x7f4178159970 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1137577786 0 0) 0x7f4160003570 con 0x7f4178159970 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417db94700 1 -- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780cbbc0 msgr2=0x7f41780c93a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417db94700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780cbbc0 0x7f41780c93a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417db94700 1 -- 172.21.15.33:0/2445908769 >> v1:172.21.15.33:6789/0 conn(0x7f4178159970 legacy=0x7f41780686a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.906+0000 7f417db94700 1 -- 172.21.15.33:0/2445908769 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4178067740 con 0x7f41780c98e0 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417db94700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41780c98e0 0x7f41780c7d20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f41700098e0 tx=0x7f41700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f478795050eb0fac server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41680017f0 con 0x7f41780c98e0 2023-10-09T15:40:35.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4170011420 con 0x7f41780c98e0 2023-10-09T15:40:35.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f4177fff700 1 -- 172.21.15.33:0/2445908769 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41700117c0 con 0x7f41780c98e0 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 -- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41780c98e0 msgr2=0x7f41780c7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41780c98e0 0x7f41780c7d20 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f41700098e0 tx=0x7f41700091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 -- 172.21.15.33:0/2445908769 shutdown_connections 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f41780c98e0 0x7f41780c7d20 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 --2- 172.21.15.33:0/2445908769 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780cbbc0 0x7f41780c93a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 -- 172.21.15.33:0/2445908769 >> 172.21.15.33:0/2445908769 conn(0x7f417806e250 msgr2=0x7f41780cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 -- 172.21.15.33:0/2445908769 shutdown_connections 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.907+0000 7f417f5f7700 1 -- 172.21.15.33:0/2445908769 wait complete. 2023-10-09T15:40:35.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.908+0000 7f417f5f7700 1 Processor -- start 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.908+0000 7f417f5f7700 1 -- start start 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780c98e0 0x7f417815c0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4178159970 0x7f4178155de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41780b3190 con 0x7f41780cbbc0 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f417815d470 con 0x7f4178159970 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417f5f7700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41780b28f0 con 0x7f41780c98e0 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417cb92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417cb92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51452/0 (socket says 172.21.15.33:51452) 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.909+0000 7f417cb92700 1 -- 172.21.15.33:0/318350615 learned_addr learned my addr 172.21.15.33:0/318350615 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417d393700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780c98e0 0x7f417815c0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417db94700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4178159970 0x7f4178155de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 -- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780c98e0 msgr2=0x7f417815c0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780c98e0 0x7f417815c0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 -- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4178159970 msgr2=0x7f4178155de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4178159970 0x7f4178155de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 -- 172.21.15.33:0/318350615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4170009420 con 0x7f41780cbbc0 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417cb92700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f416c00ec50 tx=0x7f416c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00c850 con 0x7f41780cbbc0 2023-10-09T15:40:35.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f416c00c9b0 con 0x7f41780cbbc0 2023-10-09T15:40:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f416c00cd70 con 0x7f41780cbbc0 2023-10-09T15:40:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41780b2bd0 con 0x7f41780cbbc0 2023-10-09T15:40:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.910+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41780c74f0 con 0x7f41780cbbc0 2023-10-09T15:40:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.911+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f417815d630 con 0x7f41780cbbc0 2023-10-09T15:40:35.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.912+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f416c013680 con 0x7f41780cbbc0 2023-10-09T15:40:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.912+0000 7f41757fa700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 0x7f41640697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.912+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7f416c084ea0 con 0x7f41780cbbc0 2023-10-09T15:40:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.912+0000 7f417d393700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 0x7f41640697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.913+0000 7f417d393700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 0x7f41640697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4168001560 tx=0x7f4168001640 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:35.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:35.916+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f416c051b30 con 0x7f41780cbbc0 2023-10-09T15:40:36.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.109+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f417804c3c0 con 0x7f41780cbbc0 2023-10-09T15:40:36.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.110+0000 7f41757fa700 1 -- 172.21.15.33:0/318350615 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7f416c055150 con 0x7f41780cbbc0 2023-10-09T15:40:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 msgr2=0x7f41640697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 0x7f41640697d0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4168001560 tx=0x7f4168001640 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 msgr2=0x7f41780b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f416c00ec50 tx=0x7f416c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 shutdown_connections 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4164067320 0x7f41640697d0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4178159970 0x7f4178155de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f41780c98e0 0x7f417815c0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 --2- 172.21.15.33:0/318350615 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f41780cbbc0 0x7f41780b1e30 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 >> 172.21.15.33:0/318350615 conn(0x7f417806e250 msgr2=0x7f417806b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 shutdown_connections 2023-10-09T15:40:36.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.112+0000 7f417f5f7700 1 -- 172.21.15.33:0/318350615 wait complete. 2023-10-09T15:40:36.125 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2023-10-09T15:40:36.125 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:40:36.126 DEBUG:teuthology.orchestra.run.smithi033:> sudo umount /home/ubuntu/cephtest/mnt.0 2023-10-09T15:40:36.167 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:40:36.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:36.167 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-10-09T15:40:36.223 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.1... 2023-10-09T15:40:36.223 INFO:teuthology.orchestra.run:Running command with timeout 900 2023-10-09T15:40:36.223 DEBUG:teuthology.orchestra.run.smithi059:> sudo umount /home/ubuntu/cephtest/mnt.1 2023-10-09T15:40:36.274 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:40:36.274 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:36.274 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-10-09T15:40:36.291 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:40:36.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:36.291 DEBUG:teuthology.orchestra.run.smithi033:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-10-09T15:40:36.306 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:40:36.306 INFO:teuthology.orchestra.run.smithi033.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-10-09T15:40:36.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:40:36.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:40:36.307 DEBUG:teuthology.orchestra.run.smithi059:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-10-09T15:40:36.349 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:40:36.349 INFO:teuthology.orchestra.run.smithi059.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-10-09T15:40:36.349 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs 2023-10-09T15:40:36.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.470+0000 7fd8b50d2700 1 Processor -- start 2023-10-09T15:40:36.474 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.470+0000 7fd8b50d2700 1 -- start start 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8b50d2700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b006dc70 0x7fd8b0159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8b50d2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd8b006e0e0 0x7fd8b00cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8b50d2700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8b00ccfd0 con 0x7fd8b0159530 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8b50d2700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b015a3d0 con 0x7fd8b006dc70 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8b50d2700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8b015a6b0 con 0x7fd8b006e0e0 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8ae59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b006dc70 0x7fd8b0159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8ae59c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd8b006dc70 0x7fd8b0159900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51458/0 (socket says 172.21.15.33:51458) 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.471+0000 7fd8ae59c700 1 -- 172.21.15.33:0/2791863551 learned_addr learned my addr 172.21.15.33:0/2791863551 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8ae59c700 1 -- 172.21.15.33:0/2791863551 >> v2:172.21.15.59:3300/0 conn(0x7fd8b006e0e0 msgr2=0x7fd8b00cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8ae59c700 1 --2- 172.21.15.33:0/2791863551 >> v2:172.21.15.59:3300/0 conn(0x7fd8b006e0e0 0x7fd8b00cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8ae59c700 1 -- 172.21.15.33:0/2791863551 >> v1:172.21.15.59:6789/0 conn(0x7fd8b0159530 legacy=0x7fd8b00ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.475 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8ae59c700 1 -- 172.21.15.33:0/2791863551 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b015a990 con 0x7fd8b006dc70 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8ae59c700 1 --2- 172.21.15.33:0/2791863551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b006dc70 0x7fd8b0159900 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00cf2b0 tx=0x7fd898009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675592faa8f45e26 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8add9b700 1 -- 172.21.15.33:0/2791863551 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800b820 con 0x7fd8b006dc70 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8add9b700 1 -- 172.21.15.33:0/2791863551 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd89800b980 con 0x7fd8b006dc70 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8add9b700 1 -- 172.21.15.33:0/2791863551 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd89800bd20 con 0x7fd8b006dc70 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8b50d2700 1 -- 172.21.15.33:0/2791863551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b006dc70 msgr2=0x7fd8b0159900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8b50d2700 1 --2- 172.21.15.33:0/2791863551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b006dc70 0x7fd8b0159900 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7fd8b00cf2b0 tx=0x7fd898009250 comp rx=0 tx=0).stop 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8b50d2700 1 -- 172.21.15.33:0/2791863551 shutdown_connections 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.472+0000 7fd8b50d2700 1 --2- 172.21.15.33:0/2791863551 >> v2:172.21.15.59:3300/0 conn(0x7fd8b006e0e0 0x7fd8b00cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.473+0000 7fd8b50d2700 1 --2- 172.21.15.33:0/2791863551 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b006dc70 0x7fd8b0159900 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.473+0000 7fd8b50d2700 1 -- 172.21.15.33:0/2791863551 >> 172.21.15.33:0/2791863551 conn(0x7fd8b00703a0 msgr2=0x7fd8b00707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.473+0000 7fd8b50d2700 1 -- 172.21.15.33:0/2791863551 shutdown_connections 2023-10-09T15:40:36.476 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.473+0000 7fd8b50d2700 1 -- 172.21.15.33:0/2791863551 wait complete. 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.474+0000 7fd8b50d2700 1 Processor -- start 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.474+0000 7fd8b50d2700 1 -- start start 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006dc70 0x7fd8b00c81a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b006e0e0 0x7fd8b00c86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b0159530 0x7fd8b0169de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c9c70 con 0x7fd8b0159530 2023-10-09T15:40:36.479 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b01538b0 con 0x7fd8b006e0e0 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8b00c9060 con 0x7fd8b006dc70 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b0159530 0x7fd8b0169de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b0159530 0x7fd8b0169de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51472/0 (socket says 172.21.15.33:51472) 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 -- 172.21.15.33:0/4103112654 learned_addr learned my addr 172.21.15.33:0/4103112654 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8ae59c700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b006e0e0 0x7fd8b00c86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8aed9d700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006dc70 0x7fd8b00c81a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 -- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006dc70 msgr2=0x7fd8b00c81a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd8b006dc70 0x7fd8b00c81a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 -- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b006e0e0 msgr2=0x7fd8b00c86e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd8b006e0e0 0x7fd8b00c86e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 -- 172.21.15.33:0/4103112654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8980094f0 con 0x7fd8b0159530 2023-10-09T15:40:36.480 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8af59e700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd8b0159530 0x7fd8b0169de0 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fd8a000bc60 tx=0x7fd8a0009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a00092e0 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a000c630 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8b50d2700 1 -- 172.21.15.33:0/4103112654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8b00c9340 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.475+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a000c9f0 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.476+0000 7fd8b50d2700 1 -- 172.21.15.33:0/4103112654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8b00c9900 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.476+0000 7fd8b50d2700 1 -- 172.21.15.33:0/4103112654 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8b00c9de0 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.477+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd8a0012070 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.477+0000 7fd8a6ffd700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd890067320 0x7fd8900697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.477+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fd8a00847f0 con 0x7fd8b0159530 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.477+0000 7fd8aed9d700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd890067320 0x7fd8900697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.481 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.478+0000 7fd8aed9d700 1 --2- 172.21.15.33:0/4103112654 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd890067320 0x7fd8900697d0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7fd8b015cb40 tx=0x7fd8a8009060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.482+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd8a0051480 con 0x7fd8b0159530 2023-10-09T15:40:36.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.704+0000 7fd8b50d2700 1 -- 172.21.15.33:0/4103112654 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8b004c3c0 con 0x7fd890067320 2023-10-09T15:40:36.706 INFO:tasks.ceph.mgr.y.smithi033.stderr:2023-10-09T15:40:36.705+0000 7f91f73a0700 -1 mgr.server reply reply (1) Operation not permitted WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-09T15:40:36.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.705+0000 7fd8a6ffd700 1 -- 172.21.15.33:0/4103112654 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: -1 WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it.) v1 ==== 204+0+0 (secure 0 0 0) 0x7fd8b004c3c0 con 0x7fd890067320 2023-10-09T15:40:36.708 INFO:teuthology.orchestra.run.smithi033.stderr:Error EPERM: WARNING: this will *PERMANENTLY DESTROY* all data stored in the filesystem 'cephfs'. If you are *ABSOLUTELY CERTAIN* that is what you want, re-issue the command followed by --yes-i-really-mean-it. 2023-10-09T15:40:36.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:40:36.711 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it 2023-10-09T15:40:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.832+0000 7fe1d7dc8700 1 Processor -- start 2023-10-09T15:40:36.834 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.833+0000 7fe1d7dc8700 1 -- start start 2023-10-09T15:40:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.833+0000 7fe1d7dc8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fe1d013c9b0 0x7fe1d0069a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d7dc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1d0069f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d7dc8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1d006d7b0 con 0x7fe1d00cc320 2023-10-09T15:40:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d7dc8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1d006f7d0 con 0x7fe1d013c9b0 2023-10-09T15:40:36.837 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d7dc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d006e330 con 0x7fe1d00cc6f0 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d5b64700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fe1d00cc320 0x7fe1d013c2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58400/0 (socket says 172.21.15.33:58400) 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d5b64700 1 -- 172.21.15.33:0/102177794 learned_addr learned my addr 172.21.15.33:0/102177794 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2673814939 0 0) 0x7fe1d006d7b0 con 0x7fe1d00cc320 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe1b8003570 con 0x7fe1d00cc320 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d5363700 1 --2- 172.21.15.33:0/102177794 >> v2:172.21.15.59:3300/0 conn(0x7fe1d013c9b0 0x7fe1d0069a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d6365700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1d0069f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3932890171 0 0) 0x7fe1b8003570 con 0x7fe1d00cc320 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 msgr2=0x7fe1d0069f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1d0069f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 >> v2:172.21.15.59:3300/0 conn(0x7fe1d013c9b0 msgr2=0x7fe1d0069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 --2- 172.21.15.33:0/102177794 >> v2:172.21.15.59:3300/0 conn(0x7fe1d013c9b0 0x7fe1d0069a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.838 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d006da00 con 0x7fe1d00cc320 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fe1c00017f0 con 0x7fe1d00cc320 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 >> v1:172.21.15.33:6789/0 conn(0x7fe1d00cc320 legacy=0x7fe1d013c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1b8003a60 0x7fe1b8003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b8004d50 0x7fe1b80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d006f7d0 con 0x7fe1b8004d50 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d006e330 con 0x7fe1b8003a60 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1b800bb10 con 0x7fe1d00cc6f0 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d6365700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b8004d50 0x7fe1b80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d5b64700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1b8003a60 0x7fe1b8003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.839 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.834+0000 7fe1d5363700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 -- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 msgr2=0x7fe1b8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d00cc6f0 0x7fe1b8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 -- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1b8003a60 msgr2=0x7fe1b8003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1b8003a60 0x7fe1b8003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 -- 172.21.15.33:0/102177794 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1b8003570 con 0x7fe1b8004d50 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b8004d50 0x7fe1b80051c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800bb90 tx=0x7fe1c8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b9b3538c71a9ffb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800d5d0 con 0x7fe1b8004d50 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c800d730 con 0x7fe1b8004d50 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d4b62700 1 -- 172.21.15.33:0/102177794 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c800daf0 con 0x7fe1b8004d50 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/102177794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b8004d50 msgr2=0x7fe1b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.840 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d7dc8700 1 --2- 172.21.15.33:0/102177794 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1b8004d50 0x7fe1b80051c0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7fe1c800bb90 tx=0x7fe1c8008040 comp rx=0 tx=0).stop 2023-10-09T15:40:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.835+0000 7fe1d6365700 1 -- 172.21.15.33:0/102177794 reap_dead start 2023-10-09T15:40:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.836+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/102177794 shutdown_connections 2023-10-09T15:40:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.836+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/102177794 >> 172.21.15.33:0/102177794 conn(0x7fe1d0067f00 msgr2=0x7fe1d0068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:40:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.836+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/102177794 shutdown_connections 2023-10-09T15:40:36.841 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.836+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/102177794 wait complete. 2023-10-09T15:40:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 Processor -- start 2023-10-09T15:40:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 -- start start 2023-10-09T15:40:36.843 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1d00ab860 0x7fe1d013ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d013b090 0x7fe1d0169840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d0169d80 0x7fe1d00abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d013a6c0 con 0x7fe1d00ab860 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d016a1f0 con 0x7fe1d0169d80 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d7dc8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1d0139ab0 con 0x7fe1d013b090 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.837+0000 7fe1d5b64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1d00ab860 0x7fe1d013ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1d00ab860 0x7fe1d013ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51486/0 (socket says 172.21.15.33:51486) 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 -- 172.21.15.33:0/1433038352 learned_addr learned my addr 172.21.15.33:0/1433038352 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d6365700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d0169d80 0x7fe1d00abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5363700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d013b090 0x7fe1d0169840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 -- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d013b090 msgr2=0x7fe1d0169840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.844 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d013b090 0x7fe1d0169840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 -- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d0169d80 msgr2=0x7fe1d00abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fe1d0169d80 0x7fe1d00abc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 -- 172.21.15.33:0/1433038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d0139d90 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5363700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fe1d013b090 0x7fe1d0169840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d5b64700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fe1d00ab860 0x7fe1d013ab50 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7fe1c000a100 tx=0x7fe1c0002210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c00133f0 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1c0013570 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/1433038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1d013a070 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1c0013930 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.838+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/1433038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1d00ac170 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.839+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/1433038352 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1d013a510 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.840+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fe1c0013ca0 con 0x7fe1d00ab860 2023-10-09T15:40:36.845 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.840+0000 7fe1cdffb700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe1bc067320 0x7fe1bc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:40:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.840+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(200..200 src has 1..200) v4 ==== 5705+0+0 (secure 0 0 0) 0x7fe1c0085c60 con 0x7fe1d00ab860 2023-10-09T15:40:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.840+0000 7fe1d5363700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe1bc067320 0x7fe1bc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:40:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.841+0000 7fe1d5363700 1 --2- 172.21.15.33:0/1433038352 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fe1bc067320 0x7fe1bc0697d0 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fe1d013b810 tx=0x7fe1c4008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:40:36.846 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:36.844+0000 7fe1cdffb700 1 -- 172.21.15.33:0/1433038352 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fe1c00528f0 con 0x7fe1d00ab860 2023-10-09T15:40:37.068 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:40:37.067+0000 7fe1d7dc8700 1 -- 172.21.15.33:0/1433038352 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "cephfs", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1d004c3c0 con 0x7fe1bc067320 2023-10-09T15:40:37.162 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:40:37.164 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:41:07.227 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:41:07.231 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:41:37.309 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:41:37.312 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:42:07.398 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:42:07.401 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:42:36.742 DEBUG:teuthology.orchestra.run:got remote process result: 124 2023-10-09T15:42:36.743 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-10-09T15:42:36.743 DEBUG:teuthology.orchestra.run.smithi033:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:42:36.790 DEBUG:teuthology.orchestra.run.smithi059:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-10-09T15:42:36.838 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-10-09T15:42:36.839 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:42:36.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.969+0000 7f87fdb55700 1 Processor -- start 2023-10-09T15:42:36.970 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.969+0000 7f87fdb55700 1 -- start start 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.969+0000 7f87fdb55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80b01d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87fdb55700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f815ad50 con 0x7f87f815cf20 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87fdb55700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87f815a140 con 0x7f87f80b0710 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87fdb55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f815a420 con 0x7f87f815cb50 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f6ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f87f815cf20 0x7f87f80b27d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58684/0 (socket says 172.21.15.33:58684) 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f6ffd700 1 -- 172.21.15.33:0/2980826023 learned_addr learned my addr 172.21.15.33:0/2980826023 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f77fe700 1 --2- 172.21.15.33:0/2980826023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80b01d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3557312998 0 0) 0x7f87f815ad50 con 0x7f87f815cf20 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87e0003570 con 0x7f87f815cf20 2023-10-09T15:42:36.972 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1510572298 0 0) 0x7f87f815a140 con 0x7f87f80b0710 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f87f815ad50 con 0x7f87f80b0710 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f77fe700 1 -- 172.21.15.33:0/2980826023 >> v1:172.21.15.59:6789/0 conn(0x7f87f80b0710 legacy=0x7f87f81536c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f77fe700 1 -- 172.21.15.33:0/2980826023 >> v1:172.21.15.33:6789/0 conn(0x7f87f815cf20 legacy=0x7f87f80b27d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 569619909 0 0) 0x7f87e0003570 con 0x7f87f815cf20 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f77fe700 1 -- 172.21.15.33:0/2980826023 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f815a700 con 0x7f87f815cb50 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.970+0000 7f87f77fe700 1 --2- 172.21.15.33:0/2980826023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80b01d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009910 tx=0x7f87e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bff1175fdaa9b3d3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011630 con 0x7f87f815cb50 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8011790 con 0x7f87f815cb50 2023-10-09T15:42:36.973 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87f67fc700 1 -- 172.21.15.33:0/2980826023 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8011b30 con 0x7f87f815cb50 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 -- 172.21.15.33:0/2980826023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 msgr2=0x7f87f80b01d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2980826023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80b01d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f87e8009910 tx=0x7f87e80091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 -- 172.21.15.33:0/2980826023 shutdown_connections 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2980826023 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80b01d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 -- 172.21.15.33:0/2980826023 >> 172.21.15.33:0/2980826023 conn(0x7f87f80cded0 msgr2=0x7f87f806add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 -- 172.21.15.33:0/2980826023 shutdown_connections 2023-10-09T15:42:36.976 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.971+0000 7f87fdb55700 1 -- 172.21.15.33:0/2980826023 wait complete. 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 Processor -- start 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 -- start start 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80c2410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 0x7f87f8157a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f816aa60 con 0x7f87f80b0710 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f816ad40 con 0x7f87f815cf20 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.973+0000 7f87fdb55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f816b020 con 0x7f87f815cb50 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50924/0 (socket says 172.21.15.33:50924) 2023-10-09T15:42:36.977 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 -- 172.21.15.33:0/2586850185 learned_addr learned my addr 172.21.15.33:0/2586850185 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f6ffd700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80c2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f7fff700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 0x7f87f8157a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 -- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 msgr2=0x7f87f80c2410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80c2410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 -- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 msgr2=0x7f87f8157a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 0x7f87f8157a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 -- 172.21.15.33:0/2586850185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87e8009420 con 0x7f87f80b0710 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f7fff700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 0x7f87f8157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f6ffd700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:36.978 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87f77fe700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f87e80091e0 tx=0x7f87e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e801f070 con 0x7f87f80b0710 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e8011900 con 0x7f87f80b0710 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f816b300 con 0x7f87f80b0710 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e8023410 con 0x7f87f80b0710 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.974+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f80ad550 con 0x7f87f80b0710 2023-10-09T15:42:36.979 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.975+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f816b820 con 0x7f87f80b0710 2023-10-09T15:42:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.976+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f87e80193b0 con 0x7f87f80b0710 2023-10-09T15:42:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.976+0000 7f87df7fe700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 0x7f87e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.976+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f87e8085fd0 con 0x7f87f80b0710 2023-10-09T15:42:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.976+0000 7f87f6ffd700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 0x7f87e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:36.980 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.977+0000 7f87f6ffd700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 0x7f87e40697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f87f80c3f30 tx=0x7f87ec007a90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:36.981 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:36.981+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f87e8052bd0 con 0x7f87f80b0710 2023-10-09T15:42:37.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.218+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87f804c3c0 con 0x7f87f80b0710 2023-10-09T15:42:37.219 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.218+0000 7f87df7fe700 1 -- 172.21.15.33:0/2586850185 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f87e8028090 con 0x7f87f80b0710 2023-10-09T15:42:37.220 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:37.220 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 msgr2=0x7f87e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 0x7f87e40697d0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f87f80c3f30 tx=0x7f87ec007a90 comp rx=0 tx=0).stop 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 msgr2=0x7f87f81425f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f87e80091e0 tx=0x7f87e8017000 comp rx=0 tx=0).stop 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 shutdown_connections 2023-10-09T15:42:37.222 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f87e4067320 0x7f87e40697d0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f87f80b0710 0x7f87f81425f0 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f87f815cf20 0x7f87f8157a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 --2- 172.21.15.33:0/2586850185 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f87f815cb50 0x7f87f80c2410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 >> 172.21.15.33:0/2586850185 conn(0x7f87f80cded0 msgr2=0x7f87f8157040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 shutdown_connections 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.220+0000 7f87fdb55700 1 -- 172.21.15.33:0/2586850185 wait complete. 2023-10-09T15:42:37.223 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 135 2023-10-09T15:42:37.234 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:42:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.352+0000 7f250b9bc700 1 Processor -- start 2023-10-09T15:42:37.353 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.352+0000 7f250b9bc700 1 -- start start 2023-10-09T15:42:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f250b9bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 0x7f2504159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f250b9bc700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250415ae40 con 0x7f250415a400 2023-10-09T15:42:37.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f250b9bc700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f250415ab60 con 0x7f25040cb5a0 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f250b9bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25040ce0f0 con 0x7f25040cb970 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f2509f59700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f250415a400 0x7f2504156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58688/0 (socket says 172.21.15.33:58688) 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f2509f59700 1 -- 172.21.15.33:0/323103858 learned_addr learned my addr 172.21.15.33:0/323103858 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.353+0000 7f2508f57700 1 --2- 172.21.15.33:0/323103858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 0x7f2504159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2034479835 0 0) 0x7f250415ae40 con 0x7f250415a400 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f24ec003570 con 0x7f250415a400 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 649863241 0 0) 0x7f250415ab60 con 0x7f25040cb5a0 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f250415ae40 con 0x7f25040cb5a0 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2508f57700 1 -- 172.21.15.33:0/323103858 >> v1:172.21.15.59:6789/0 conn(0x7f25040cb5a0 legacy=0x7f25040cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2508f57700 1 -- 172.21.15.33:0/323103858 >> v1:172.21.15.33:6789/0 conn(0x7f250415a400 legacy=0x7f2504156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.356 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2508f57700 1 -- 172.21.15.33:0/323103858 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25040ccf00 con 0x7f25040cb970 2023-10-09T15:42:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2508f57700 1 --2- 172.21.15.33:0/323103858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 0x7f2504159ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009910 tx=0x7f24f80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=67f78b3e39d0accf server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8011630 con 0x7f25040cb970 2023-10-09T15:42:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8011790 con 0x7f25040cb970 2023-10-09T15:42:37.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.354+0000 7f2503fff700 1 -- 172.21.15.33:0/323103858 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8011b10 con 0x7f25040cb970 2023-10-09T15:42:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 -- 172.21.15.33:0/323103858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 msgr2=0x7f2504159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 --2- 172.21.15.33:0/323103858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 0x7f2504159ec0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009910 tx=0x7f24f80091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 -- 172.21.15.33:0/323103858 shutdown_connections 2023-10-09T15:42:37.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 --2- 172.21.15.33:0/323103858 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f25040cb970 0x7f2504159ec0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 -- 172.21.15.33:0/323103858 >> 172.21.15.33:0/323103858 conn(0x7f2504070e30 msgr2=0x7f25040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 -- 172.21.15.33:0/323103858 shutdown_connections 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.355+0000 7f250b9bc700 1 -- 172.21.15.33:0/323103858 wait complete. 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.356+0000 7f250b9bc700 1 Processor -- start 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.356+0000 7f250b9bc700 1 -- start start 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25040cb5a0 0x7f2504150700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250415a400 0x7f25040c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f25040cbde0 con 0x7f25040cb970 2023-10-09T15:42:37.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2504151e10 con 0x7f25040cb5a0 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f250b9bc700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25041514e0 con 0x7f250415a400 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50940/0 (socket says 172.21.15.33:50940) 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 -- 172.21.15.33:0/2036934753 learned_addr learned my addr 172.21.15.33:0/2036934753 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2509f59700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250415a400 0x7f25040c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2509758700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25040cb5a0 0x7f2504150700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 -- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250415a400 msgr2=0x7f25040c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250415a400 0x7f25040c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 -- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25040cb5a0 msgr2=0x7f2504150700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25040cb5a0 0x7f2504150700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.362 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 -- 172.21.15.33:0/2036934753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24f8009420 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.357+0000 7f2508f57700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009860 tx=0x7f24f8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.358+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8011900 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.358+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24f8011a60 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.358+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f25041517c0 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.358+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24f8025670 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.358+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25041563c0 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.359+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2504151c60 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.359+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f24f8023070 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.359+0000 7f25017fa700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 0x7f24f00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.359+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f24f80862b0 con 0x7f25040cb970 2023-10-09T15:42:37.363 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.359+0000 7f2509758700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 0x7f24f00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.360+0000 7f2509758700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 0x7f24f00697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000f80 tx=0x7f24fc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.364+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f24f8052eb0 con 0x7f25040cb970 2023-10-09T15:42:37.560 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.559+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2504151f80 con 0x7f25040cb970 2023-10-09T15:42:37.561 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.560+0000 7f25017fa700 1 -- 172.21.15.33:0/2036934753 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7f24f80564d0 con 0x7f25040cb970 2023-10-09T15:42:37.561 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:37.561 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":202,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:49.419235+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.f","mappings":[{"from":0,"to":2}]},{"pgid":"34.21","mappings":[{"from":0,"to":1}]},{"pgid":"34.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:42:37.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 msgr2=0x7f24f00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 0x7f24f00697d0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f24fc000f80 tx=0x7f24fc009040 comp rx=0 tx=0).stop 2023-10-09T15:42:37.563 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 msgr2=0x7f2504155e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f24f8009860 tx=0x7f24f8017000 comp rx=0 tx=0).stop 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 shutdown_connections 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f24f0067320 0x7f24f00697d0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f250415a400 0x7f25040c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f25040cb5a0 0x7f2504150700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 --2- 172.21.15.33:0/2036934753 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f25040cb970 0x7f2504155e80 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 >> 172.21.15.33:0/2036934753 conn(0x7f2504070e30 msgr2=0x7f25040d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 shutdown_connections 2023-10-09T15:42:37.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.562+0000 7f250b9bc700 1 -- 172.21.15.33:0/2036934753 wait complete. 2023-10-09T15:42:37.575 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-10-09T15:30:53.288152+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}, {'pool': 33, 'pool_name': 'cephfs_metadata', 'create_time': '2023-10-09T15:40:24.159100+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '199', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 34, 'pool_name': 'cephfs_data', 'create_time': '2023-10-09T15:40:24.714403+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '200', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2023-10-09T15:42:37.576 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-10-09T15:42:37.612 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:42:37.622 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:42:37.698 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 Processor -- start 2023-10-09T15:42:37.699 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 -- start start 2023-10-09T15:42:37.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9240cc6f0 0x7fd92406a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92406f7d0 con 0x7fd92413c9b0 2023-10-09T15:42:37.700 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd92406d7b0 con 0x7fd9240cc320 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.698+0000 7fd9296ad700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd92406e330 con 0x7fd9240cc6f0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9237fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fd9240cc6f0 0x7fd92406a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9227fc700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd92413c9b0 0x7fd924069a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58702/0 (socket says 172.21.15.33:58702) 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9227fc700 1 -- 172.21.15.33:0/505476681 learned_addr learned my addr 172.21.15.33:0/505476681 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd921ffb700 1 -- 172.21.15.33:0/505476681 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 698937776 0 0) 0x7fd92406f7d0 con 0x7fd92413c9b0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd921ffb700 1 -- 172.21.15.33:0/505476681 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd910003570 con 0x7fd92413c9b0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9237fe700 1 -- 172.21.15.33:0/505476681 >> v1:172.21.15.59:6789/0 conn(0x7fd9240cc320 legacy=0x7fd92413c2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9237fe700 1 -- 172.21.15.33:0/505476681 >> v1:172.21.15.33:6789/0 conn(0x7fd92413c9b0 legacy=0x7fd924069a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9237fe700 1 -- 172.21.15.33:0/505476681 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd92406da00 con 0x7fd9240cc6f0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd9237fe700 1 --2- 172.21.15.33:0/505476681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd92406a110 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8593f604d3abbf5c server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.701 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd921ffb700 1 -- 172.21.15.33:0/505476681 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00b640 con 0x7fd9240cc6f0 2023-10-09T15:42:37.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd921ffb700 1 -- 172.21.15.33:0/505476681 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd91c00b7a0 con 0x7fd9240cc6f0 2023-10-09T15:42:37.702 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.699+0000 7fd921ffb700 1 -- 172.21.15.33:0/505476681 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd91c00bb40 con 0x7fd9240cc6f0 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 -- 172.21.15.33:0/505476681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 msgr2=0x7fd92406a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 --2- 172.21.15.33:0/505476681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd92406a110 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7fd91c0098e0 tx=0x7fd91c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 -- 172.21.15.33:0/505476681 shutdown_connections 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 --2- 172.21.15.33:0/505476681 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd92406a110 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 -- 172.21.15.33:0/505476681 >> 172.21.15.33:0/505476681 conn(0x7fd924067f00 msgr2=0x7fd924068300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 -- 172.21.15.33:0/505476681 shutdown_connections 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.700+0000 7fd9296ad700 1 -- 172.21.15.33:0/505476681 wait complete. 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.701+0000 7fd9296ad700 1 Processor -- start 2023-10-09T15:42:37.705 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.701+0000 7fd9296ad700 1 -- start start 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9240cc320 0x7fd924169dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 0x7fd924154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9240c5920 con 0x7fd9240cc6f0 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd92416a690 con 0x7fd92413c9b0 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9296ad700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd92416a970 con 0x7fd9240cc320 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50962/0 (socket says 172.21.15.33:50962) 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 -- 172.21.15.33:0/3979346920 learned_addr learned my addr 172.21.15.33:0/3979346920 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9237fe700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 0x7fd924154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.706 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd922ffd700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9240cc320 0x7fd924169dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 -- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9240cc320 msgr2=0x7fd924169dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9240cc320 0x7fd924169dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 -- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 msgr2=0x7fd924154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 0x7fd924154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 -- 172.21.15.33:0/3979346920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd91c009420 con 0x7fd9240cc6f0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9237fe700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 0x7fd924154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd9227fc700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c560 tx=0x7fd90c007dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.702+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c005c00 con 0x7fd9240cc6f0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.703+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd90c005d60 con 0x7fd9240cc6f0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.703+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd92416ac50 con 0x7fd9240cc6f0 2023-10-09T15:42:37.707 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.703+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd90c007300 con 0x7fd9240cc6f0 2023-10-09T15:42:37.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.703+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd92416a390 con 0x7fd9240cc6f0 2023-10-09T15:42:37.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.703+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9240c5a90 con 0x7fd9240cc6f0 2023-10-09T15:42:37.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.704+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd90c01b3b0 con 0x7fd9240cc6f0 2023-10-09T15:42:37.708 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.704+0000 7fd91affd700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 0x7fd9040697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:37.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.704+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fd90c084260 con 0x7fd9240cc6f0 2023-10-09T15:42:37.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.704+0000 7fd922ffd700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 0x7fd9040697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:37.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.705+0000 7fd922ffd700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 0x7fd9040697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd914007fd0 tx=0x7fd914009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:37.709 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.709+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd90c050e60 con 0x7fd9240cc6f0 2023-10-09T15:42:37.903 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.902+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd92404c3c0 con 0x7fd9240cc6f0 2023-10-09T15:42:37.904 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.902+0000 7fd91affd700 1 -- 172.21.15.33:0/3979346920 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v202) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd90c0170a0 con 0x7fd9240cc6f0 2023-10-09T15:42:37.904 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 1 2023-10-09T15:42:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 msgr2=0x7fd9040697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 0x7fd9040697d0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fd914007fd0 tx=0x7fd914009040 comp rx=0 tx=0).stop 2023-10-09T15:42:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 msgr2=0x7fd9240aee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7fd90c00c560 tx=0x7fd90c007dd0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 shutdown_connections 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd904067320 0x7fd9040697d0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd92413c9b0 0x7fd924154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd9240cc320 0x7fd924169dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 --2- 172.21.15.33:0/3979346920 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd9240cc6f0 0x7fd9240aee50 unknown :-1 s=CLOSED pgs=1796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 >> 172.21.15.33:0/3979346920 conn(0x7fd924067f00 msgr2=0x7fd9240b3b40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 shutdown_connections 2023-10-09T15:42:37.907 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:37.904+0000 7fd9296ad700 1 -- 172.21.15.33:0/3979346920 wait complete. 2023-10-09T15:42:37.917 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-10-09T15:42:38.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.081+0000 7fd44872b700 1 Processor -- start 2023-10-09T15:42:38.082 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.081+0000 7fd44872b700 1 -- start start 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd44872b700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 0x7fd440151c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd44872b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 0x7fd4400b2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd44872b700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd44015b1c0 con 0x7fd4400b24b0 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd44872b700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4400b2e70 con 0x7fd4401518a0 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd44872b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd44015ba60 con 0x7fd4401583b0 2023-10-09T15:42:38.085 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd445cc6700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fd4400b24b0 0x7fd440157ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58704/0 (socket says 172.21.15.33:58704) 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd445cc6700 1 -- 172.21.15.33:0/2487715081 learned_addr learned my addr 172.21.15.33:0/2487715081 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd4464c7700 1 --2- 172.21.15.33:0/2487715081 >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 0x7fd440151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd446cc8700 1 --2- 172.21.15.33:0/2487715081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 0x7fd4400b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd4454c5700 1 -- 172.21.15.33:0/2487715081 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1929352206 0 0) 0x7fd44015b1c0 con 0x7fd4400b24b0 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd4454c5700 1 -- 172.21.15.33:0/2487715081 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd428003570 con 0x7fd4400b24b0 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd446cc8700 1 -- 172.21.15.33:0/2487715081 >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 msgr2=0x7fd440151c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd446cc8700 1 --2- 172.21.15.33:0/2487715081 >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 0x7fd440151c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd446cc8700 1 -- 172.21.15.33:0/2487715081 >> v1:172.21.15.33:6789/0 conn(0x7fd4400b24b0 legacy=0x7fd440157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.086 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd446cc8700 1 -- 172.21.15.33:0/2487715081 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4401589d0 con 0x7fd4401583b0 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.082+0000 7fd4464c7700 1 --2- 172.21.15.33:0/2487715081 >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 0x7fd440151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd446cc8700 1 --2- 172.21.15.33:0/2487715081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 0x7fd4400b2930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd438009e60 tx=0x7fd438009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2275e91acc5e97ce server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd4454c5700 1 -- 172.21.15.33:0/2487715081 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800e070 con 0x7fd4401583b0 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd4454c5700 1 -- 172.21.15.33:0/2487715081 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd43800bab0 con 0x7fd4401583b0 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd4454c5700 1 -- 172.21.15.33:0/2487715081 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd43800be70 con 0x7fd4401583b0 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 -- 172.21.15.33:0/2487715081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 msgr2=0x7fd4400b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 --2- 172.21.15.33:0/2487715081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 0x7fd4400b2930 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fd438009e60 tx=0x7fd438009780 comp rx=0 tx=0).stop 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 -- 172.21.15.33:0/2487715081 shutdown_connections 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 --2- 172.21.15.33:0/2487715081 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4401583b0 0x7fd4400b2930 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 --2- 172.21.15.33:0/2487715081 >> v2:172.21.15.59:3300/0 conn(0x7fd4401518a0 0x7fd440151c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.087 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 -- 172.21.15.33:0/2487715081 >> 172.21.15.33:0/2487715081 conn(0x7fd44006d7b0 msgr2=0x7fd44006dbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:38.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 -- 172.21.15.33:0/2487715081 shutdown_connections 2023-10-09T15:42:38.088 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.083+0000 7fd44872b700 1 -- 172.21.15.33:0/2487715081 wait complete. 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 Processor -- start 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 -- start start 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4400b24b0 0x7fd44016ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4401518a0 0x7fd44016b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd440153fc0 con 0x7fd4401583b0 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4401533b0 con 0x7fd4401518a0 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd44872b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd440153690 con 0x7fd4400b24b0 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd446cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd446cc8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:50978/0 (socket says 172.21.15.33:50978) 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd446cc8700 1 -- 172.21.15.33:0/3811388884 learned_addr learned my addr 172.21.15.33:0/3811388884 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.085+0000 7fd4464c7700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4400b24b0 0x7fd44016ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd445cc6700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4401518a0 0x7fd44016b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 -- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4400b24b0 msgr2=0x7fd44016ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4400b24b0 0x7fd44016ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 -- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4401518a0 msgr2=0x7fd44016b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4401518a0 0x7fd44016b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 -- 172.21.15.33:0/3811388884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd430009420 con 0x7fd4401583b0 2023-10-09T15:42:38.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd446cc8700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd44015bba0 tx=0x7fd438019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438012e10 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd438027470 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd438009a20 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd438027830 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.086+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd440153c50 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.087+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd44015bef0 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.088+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fd438024070 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.088+0000 7fd43e7fc700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.088+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fd438087590 con 0x7fd4401583b0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.088+0000 7fd4464c7700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.093 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.088+0000 7fd4464c7700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 0x7fd42c0697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd430009f40 tx=0x7fd4300091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.093+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fd4380541d0 con 0x7fd4401583b0 2023-10-09T15:42:38.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.284+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd44004c3c0 con 0x7fd4401583b0 2023-10-09T15:42:38.285 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.284+0000 7fd43e7fc700 1 -- 172.21.15.33:0/3811388884 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v202) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd4380577f0 con 0x7fd4401583b0 2023-10-09T15:42:38.286 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 32 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 msgr2=0x7fd42c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 0x7fd42c0697d0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7fd430009f40 tx=0x7fd4300091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 msgr2=0x7fd440152680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7fd44015bba0 tx=0x7fd438019000 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 shutdown_connections 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fd42c067320 0x7fd42c0697d0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fd4401583b0 0x7fd440152680 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fd4400b24b0 0x7fd44016ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 --2- 172.21.15.33:0/3811388884 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fd4401518a0 0x7fd44016b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.286+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 >> 172.21.15.33:0/3811388884 conn(0x7fd44006d7b0 msgr2=0x7fd440159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:38.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.287+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 shutdown_connections 2023-10-09T15:42:38.289 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.287+0000 7fd44872b700 1 -- 172.21.15.33:0/3811388884 wait complete. 2023-10-09T15:42:38.300 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-10-09T15:42:38.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.421+0000 7f4ed0579700 1 Processor -- start 2023-10-09T15:42:38.422 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.421+0000 7f4ed0579700 1 -- start start 2023-10-09T15:42:38.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ed0579700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec80afc00 0x7f4ec806c710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ed0579700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4ec806cc50 0x7f4ec80ace80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ed0579700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ec806bbe0 con 0x7f4ec8157a40 2023-10-09T15:42:38.424 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ed0579700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ec806afd0 con 0x7f4ec806cc50 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ed0579700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec806b2b0 con 0x7f4ec80afc00 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ece315700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4ec8157a40 0x7f4ec80af4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58718/0 (socket says 172.21.15.33:58718) 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ece315700 1 -- 172.21.15.33:0/3772615643 learned_addr learned my addr 172.21.15.33:0/3772615643 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 --2- 172.21.15.33:0/3772615643 >> v2:172.21.15.33:3300/0 conn(0x7f4ec806cc50 0x7f4ec80ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ecdb14700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec80afc00 0x7f4ec806c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 -- 172.21.15.33:0/3772615643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec80afc00 msgr2=0x7f4ec806c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec80afc00 0x7f4ec806c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 -- 172.21.15.33:0/3772615643 >> v1:172.21.15.33:6789/0 conn(0x7f4ec8157a40 legacy=0x7f4ec80af4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 -- 172.21.15.33:0/3772615643 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec806b590 con 0x7f4ec806cc50 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4eceb16700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec806cc50 0x7f4ec80ace80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009e60 tx=0x7f4ec0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=900f3f5171d1615f server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.422+0000 7f4ecd313700 1 -- 172.21.15.33:0/3772615643 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec000e070 con 0x7f4ec806cc50 2023-10-09T15:42:38.425 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ecd313700 1 -- 172.21.15.33:0/3772615643 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ec000bc30 con 0x7f4ec806cc50 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ecd313700 1 -- 172.21.15.33:0/3772615643 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ec0012430 con 0x7f4ec806cc50 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 -- 172.21.15.33:0/3772615643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec806cc50 msgr2=0x7f4ec80ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec806cc50 0x7f4ec80ace80 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7f4ec0009e60 tx=0x7f4ec0009780 comp rx=0 tx=0).stop 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 -- 172.21.15.33:0/3772615643 shutdown_connections 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec806cc50 0x7f4ec80ace80 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 --2- 172.21.15.33:0/3772615643 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec80afc00 0x7f4ec806c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 -- 172.21.15.33:0/3772615643 >> 172.21.15.33:0/3772615643 conn(0x7f4ec806e250 msgr2=0x7f4ec80cd500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 -- 172.21.15.33:0/3772615643 shutdown_connections 2023-10-09T15:42:38.426 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.423+0000 7f4ed0579700 1 -- 172.21.15.33:0/3772615643 wait complete. 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.424+0000 7f4ed0579700 1 Processor -- start 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.424+0000 7f4ed0579700 1 -- start start 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 0x7f4ec80cbce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 0x7f4ec80ab540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80ac070 con 0x7f4ec80afc00 2023-10-09T15:42:38.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80cb850 con 0x7f4ec806cc50 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ed0579700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ec80abd90 con 0x7f4ec8157a40 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51002/0 (socket says 172.21.15.33:51002) 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 -- 172.21.15.33:0/911856275 learned_addr learned my addr 172.21.15.33:0/911856275 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4eceb16700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 0x7f4ec80ab540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ece315700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 0x7f4ec80cbce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 -- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 msgr2=0x7f4ec80ab540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 0x7f4ec80ab540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 -- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 msgr2=0x7f4ec80cbce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 0x7f4ec80cbce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.430 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.425+0000 7f4ecdb14700 1 -- 172.21.15.33:0/911856275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ec0009a20 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4eceb16700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 0x7f4ec80ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ece315700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 0x7f4ec80cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ecdb14700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800d890 tx=0x7f4eb8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800b600 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb800b760 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ec80cb200 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb800bae0 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.426+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ec8156ae0 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.427+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ec804c3c0 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.427+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4eb801e460 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.428+0000 7f4ebe7fc700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 0x7f4eac0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.428+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f4eb80853e0 con 0x7f4ec80afc00 2023-10-09T15:42:38.431 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.428+0000 7f4ece315700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 0x7f4eac0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.428+0000 7f4ece315700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 0x7f4eac0697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4001780 tx=0x7f4ec4009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.432+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4eb8051fe0 con 0x7f4ec80afc00 2023-10-09T15:42:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.622+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f4ec80cb990 con 0x7f4ec80afc00 2023-10-09T15:42:38.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.623+0000 7f4ebe7fc700 1 -- 172.21.15.33:0/911856275 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v202) v1 ==== 100+0+11 (secure 0 0 0) 0x7f4eb8055600 con 0x7f4ec80afc00 2023-10-09T15:42:38.624 INFO:teuthology.orchestra.run.smithi033.stdout:pg_num: 64 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 msgr2=0x7f4eac0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 0x7f4eac0697d0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f4ec4001780 tx=0x7f4ec4009040 comp rx=0 tx=0).stop 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 msgr2=0x7f4ec81565a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f4eb800d890 tx=0x7f4eb8008040 comp rx=0 tx=0).stop 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 shutdown_connections 2023-10-09T15:42:38.626 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4eac067320 0x7f4eac0697d0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4ec8157a40 0x7f4ec80ab540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4ec806cc50 0x7f4ec80cbce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 --2- 172.21.15.33:0/911856275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4ec80afc00 0x7f4ec81565a0 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 >> 172.21.15.33:0/911856275 conn(0x7f4ec806e250 msgr2=0x7f4ec8156e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 shutdown_connections 2023-10-09T15:42:38.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.625+0000 7f4ed0579700 1 -- 172.21.15.33:0/911856275 wait complete. 2023-10-09T15:42:38.638 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:42:38.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.756+0000 7fa2f81ec700 1 Processor -- start 2023-10-09T15:42:38.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.756+0000 7fa2f81ec700 1 -- start start 2023-10-09T15:42:38.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f81ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2f00c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f81ec700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f015a280 con 0x7fa2f00b07d0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f81ec700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f006e180 con 0x7fa2f00b0ba0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f81ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f006d850 con 0x7fa2f00cf200 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f5f88700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fa2f00b07d0 0x7fa2f00ccac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58724/0 (socket says 172.21.15.33:58724) 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f5f88700 1 -- 172.21.15.33:0/1338433239 learned_addr learned my addr 172.21.15.33:0/1338433239 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 818870622 0 0) 0x7fa2f015a280 con 0x7fa2f00b07d0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f5787700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2f00c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2d8003570 con 0x7fa2f00b07d0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2437911993 0 0) 0x7fa2d8003570 con 0x7fa2f00b07d0 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 msgr2=0x7fa2f00c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2f00c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 >> v1:172.21.15.59:6789/0 conn(0x7fa2f00b0ba0 legacy=0x7fa2f006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f006db30 con 0x7fa2f00b07d0 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fa2e0001970 con 0x7fa2f00b07d0 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 >> v1:172.21.15.33:6789/0 conn(0x7fa2f00b07d0 legacy=0x7fa2f00ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8003a90 0x7fa2d8003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f006d850 con 0x7fa2d8004d50 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bb70 con 0x7fa2d8003a90 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.757+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2d800bd30 con 0x7fa2f00cf200 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f5f88700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8003a90 0x7fa2d8003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f5787700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 -- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 msgr2=0x7fa2d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f00cf200 0x7fa2d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 -- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8003a90 msgr2=0x7fa2d8003ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2d8003a90 0x7fa2d8003ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 -- 172.21.15.33:0/1338433239 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2d8003570 con 0x7fa2d8004d50 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f6789700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80018b0 tx=0x7fa2e8007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e85e76838207334 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8012420 con 0x7fa2d8004d50 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8012580 con 0x7fa2d8004d50 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.758+0000 7fa2f4f86700 1 -- 172.21.15.33:0/1338433239 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8012920 con 0x7fa2d8004d50 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 -- 172.21.15.33:0/1338433239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d8004d50 msgr2=0x7fa2d80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/1338433239 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2d8004d50 0x7fa2d80051c0 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7fa2e80018b0 tx=0x7fa2e8007d30 comp rx=0 tx=0).stop 2023-10-09T15:42:38.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f6789700 1 -- 172.21.15.33:0/1338433239 reap_dead start 2023-10-09T15:42:38.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 -- 172.21.15.33:0/1338433239 shutdown_connections 2023-10-09T15:42:38.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 -- 172.21.15.33:0/1338433239 >> 172.21.15.33:0/1338433239 conn(0x7fa2f006ce80 msgr2=0x7fa2f00ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:38.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 -- 172.21.15.33:0/1338433239 shutdown_connections 2023-10-09T15:42:38.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.759+0000 7fa2f81ec700 1 -- 172.21.15.33:0/1338433239 wait complete. 2023-10-09T15:42:38.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.760+0000 7fa2f81ec700 1 Processor -- start 2023-10-09T15:42:38.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.760+0000 7fa2f81ec700 1 -- start start 2023-10-09T15:42:38.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f01572d0 0x7fa2f009bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f00b3d30 0x7fa2f00b2520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b2a60 con 0x7fa2f0098840 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00991f0 con 0x7fa2f00b3d30 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f81ec700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b38a0 con 0x7fa2f01572d0 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51026/0 (socket says 172.21.15.33:51026) 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 -- 172.21.15.33:0/3225304955 learned_addr learned my addr 172.21.15.33:0/3225304955 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f5f88700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f01572d0 0x7fa2f009bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f5787700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f00b3d30 0x7fa2f00b2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 -- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f01572d0 msgr2=0x7fa2f009bcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f01572d0 0x7fa2f009bcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 -- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f00b3d30 msgr2=0x7fa2f00b2520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f00b3d30 0x7fa2f00b2520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 -- 172.21.15.33:0/3225304955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00b2c90 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2f6789700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800c3f0 tx=0x7fa2e8015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.761+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8012420 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.762+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2e8001200 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.762+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f00b2f70 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.762+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8012ea0 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.762+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f00b3530 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.763+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f00b3a50 con 0x7fa2f0098840 2023-10-09T15:42:38.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.763+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa2e8019070 con 0x7fa2f0098840 2023-10-09T15:42:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.764+0000 7fa2edffb700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 0x7fa2dc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.764+0000 7fa2f5f88700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 0x7fa2dc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.764+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fa2e8085ef0 con 0x7fa2f0098840 2023-10-09T15:42:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.764+0000 7fa2f5f88700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 0x7fa2dc0697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0001270 tx=0x7fa2e0009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:38.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:38.768+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa2f00b3a50 con 0x7fa2f0098840 2023-10-09T15:42:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.007+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa2f00b3a10 con 0x7fa2f0098840 2023-10-09T15:42:39.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.007+0000 7fa2edffb700 1 -- 172.21.15.33:0/3225304955 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4607 (secure 0 0 0) 0x7fa2e8017070 con 0x7fa2f0098840 2023-10-09T15:42:39.009 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:39.009 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:42:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 msgr2=0x7fa2dc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 0x7fa2dc0697d0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0001270 tx=0x7fa2e0009040 comp rx=0 tx=0).stop 2023-10-09T15:42:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 msgr2=0x7fa2f0098cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fa2e800c3f0 tx=0x7fa2e8015000 comp rx=0 tx=0).stop 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 shutdown_connections 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa2dc067320 0x7fa2dc0697d0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa2f0098840 0x7fa2f0098cb0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa2f01572d0 0x7fa2f009bcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 --2- 172.21.15.33:0/3225304955 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa2f00b3d30 0x7fa2f00b2520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 >> 172.21.15.33:0/3225304955 conn(0x7fa2f006ce80 msgr2=0x7fa2f01590a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 shutdown_connections 2023-10-09T15:42:39.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.010+0000 7fa2f81ec700 1 -- 172.21.15.33:0/3225304955 wait complete. 2023-10-09T15:42:39.013 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 135 2023-10-09T15:42:39.023 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:42:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.141+0000 7fa519a33700 1 Processor -- start 2023-10-09T15:42:39.142 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.141+0000 7fa519a33700 1 -- start start 2023-10-09T15:42:39.143 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.141+0000 7fa519a33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 0x7fa514159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.141+0000 7fa519a33700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa519a33700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa51415ae40 con 0x7fa5140cb5a0 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa519a33700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa5140ce0f0 con 0x7fa51415a400 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa519a33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa5140cbde0 con 0x7fa5140cb970 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 0x7fa514159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa512ffd700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7fa5140cb5a0 0x7fa5140cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:60780/0 (socket says 172.21.15.33:60780) 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa512ffd700 1 -- 172.21.15.33:0/3638751057 learned_addr learned my addr 172.21.15.33:0/3638751057 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:39.144 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5137fe700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:39952/0 (socket says 172.21.15.33:39952) 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 -- 172.21.15.33:0/3638751057 >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 msgr2=0x7fa514156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 --2- 172.21.15.33:0/3638751057 >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 -- 172.21.15.33:0/3638751057 >> v1:172.21.15.59:6789/0 conn(0x7fa5140cb5a0 legacy=0x7fa5140cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 -- 172.21.15.33:0/3638751057 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa51415ab60 con 0x7fa5140cb970 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5137fe700 1 --2- 172.21.15.33:0/3638751057 >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.142+0000 7fa5127fc700 1 --2- 172.21.15.33:0/3638751057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 0x7fa514159ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0098e0 tx=0x7fa4fc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fb21fc9afc1a298a server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa511ffb700 1 -- 172.21.15.33:0/3638751057 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00b640 con 0x7fa5140cb970 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa511ffb700 1 -- 172.21.15.33:0/3638751057 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4fc00b7a0 con 0x7fa5140cb970 2023-10-09T15:42:39.145 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa511ffb700 1 -- 172.21.15.33:0/3638751057 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4fc00bb40 con 0x7fa5140cb970 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 -- 172.21.15.33:0/3638751057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 msgr2=0x7fa514159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 --2- 172.21.15.33:0/3638751057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 0x7fa514159ec0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa4fc0098e0 tx=0x7fa4fc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 -- 172.21.15.33:0/3638751057 shutdown_connections 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 --2- 172.21.15.33:0/3638751057 >> v2:172.21.15.59:3300/0 conn(0x7fa51415a400 0x7fa514156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 --2- 172.21.15.33:0/3638751057 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb970 0x7fa514159ec0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 -- 172.21.15.33:0/3638751057 >> 172.21.15.33:0/3638751057 conn(0x7fa514070e30 msgr2=0x7fa5140d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 -- 172.21.15.33:0/3638751057 shutdown_connections 2023-10-09T15:42:39.149 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.143+0000 7fa519a33700 1 -- 172.21.15.33:0/3638751057 wait complete. 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.144+0000 7fa519a33700 1 Processor -- start 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.144+0000 7fa519a33700 1 -- start start 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb5a0 0x7fa514150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5140cb970 0x7fa5141573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa514152470 con 0x7fa51415a400 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5141517f0 con 0x7fa5140cb970 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa519a33700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa514151ad0 con 0x7fa5140cb5a0 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa5137fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51042/0 (socket says 172.21.15.33:51042) 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa5137fe700 1 -- 172.21.15.33:0/3746798150 learned_addr learned my addr 172.21.15.33:0/3746798150 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:39.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa512ffd700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb5a0 0x7fa514150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.145+0000 7fa5127fc700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5140cb970 0x7fa5141573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 -- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb5a0 msgr2=0x7fa514150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb5a0 0x7fa514150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 -- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5140cb970 msgr2=0x7fa5141573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5140cb970 0x7fa5141573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 -- 172.21.15.33:0/3746798150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa504009a20 con 0x7fa51415a400 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa5137fe700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa504009fc0 tx=0x7fa50400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa50400cd30 con 0x7fa51415a400 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa50400f040 con 0x7fa51415a400 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4fc009420 con 0x7fa51415a400 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5040146d0 con 0x7fa51415a400 2023-10-09T15:42:39.151 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.146+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa514152090 con 0x7fa51415a400 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.147+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5141525b0 con 0x7fa51415a400 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.147+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa504003020 con 0x7fa51415a400 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.148+0000 7fa50affd700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 0x7fa4f40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.148+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7fa504085860 con 0x7fa51415a400 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.148+0000 7fa512ffd700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 0x7fa4f40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.148+0000 7fa512ffd700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 0x7fa4f40697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa50c001700 tx=0x7fa50c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.153 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.152+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa5141525b0 con 0x7fa51415a400 2023-10-09T15:42:39.347 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.346+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa5141525b0 con 0x7fa51415a400 2023-10-09T15:42:39.348 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.347+0000 7fa50affd700 1 -- 172.21.15.33:0/3746798150 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7fa5141525b0 con 0x7fa51415a400 2023-10-09T15:42:39.348 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:39.348 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":202,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:49.419235+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.f","mappings":[{"from":0,"to":2}]},{"pgid":"34.21","mappings":[{"from":0,"to":1}]},{"pgid":"34.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:42:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 msgr2=0x7fa4f40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 0x7fa4f40697d0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fa50c001700 tx=0x7fa50c009040 comp rx=0 tx=0).stop 2023-10-09T15:42:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 msgr2=0x7fa514157910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fa504009fc0 tx=0x7fa50400b040 comp rx=0 tx=0).stop 2023-10-09T15:42:39.350 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 shutdown_connections 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa4f4067320 0x7fa4f40697d0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa51415a400 0x7fa514157910 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa5140cb5a0 0x7fa514150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 --2- 172.21.15.33:0/3746798150 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa5140cb970 0x7fa5141573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 >> 172.21.15.33:0/3746798150 conn(0x7fa514070e30 msgr2=0x7fa5140c65f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 shutdown_connections 2023-10-09T15:42:39.351 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.349+0000 7fa519a33700 1 -- 172.21.15.33:0/3746798150 wait complete. 2023-10-09T15:42:39.362 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:42:39.362 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:42:39.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.481+0000 7f58b0015700 1 Processor -- start 2023-10-09T15:42:39.482 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.481+0000 7f58b0015700 1 -- start start 2023-10-09T15:42:39.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58b0015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 0x7f58a80cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58b0015700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 0x7f58a8156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58b0015700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58a815ae40 con 0x7f58a80cd9e0 2023-10-09T15:42:39.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58b0015700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58a80d13f0 con 0x7f58a80cde50 2023-10-09T15:42:39.483 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58b0015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a815ab60 con 0x7f58a80cb5a0 2023-10-09T15:42:39.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58ae5b2700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 0x7f58a8156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58addb1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 0x7f58a80cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.485 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.482+0000 7f58ad5b0700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f58a80cd9e0 0x7f58a8159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:60794/0 (socket says 172.21.15.33:60794) 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58ad5b0700 1 -- 172.21.15.33:0/2918277923 learned_addr learned my addr 172.21.15.33:0/2918277923 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58acdaf700 1 -- 172.21.15.33:0/2918277923 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1828169281 0 0) 0x7f58a815ae40 con 0x7f58a80cd9e0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58acdaf700 1 -- 172.21.15.33:0/2918277923 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5894003570 con 0x7f58a80cd9e0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58addb1700 1 -- 172.21.15.33:0/2918277923 >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 msgr2=0x7f58a8156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58addb1700 1 --2- 172.21.15.33:0/2918277923 >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 0x7f58a8156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58addb1700 1 -- 172.21.15.33:0/2918277923 >> v1:172.21.15.59:6789/0 conn(0x7f58a80cd9e0 legacy=0x7f58a8159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58addb1700 1 -- 172.21.15.33:0/2918277923 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a80ccf00 con 0x7f58a80cb5a0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58ae5b2700 1 --2- 172.21.15.33:0/2918277923 >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 0x7f58a8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58addb1700 1 --2- 172.21.15.33:0/2918277923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 0x7f58a80cb970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098e0 tx=0x7f58a40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b830ee31480af8ef server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58acdaf700 1 -- 172.21.15.33:0/2918277923 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011630 con 0x7f58a80cb5a0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58acdaf700 1 -- 172.21.15.33:0/2918277923 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a4011790 con 0x7f58a80cb5a0 2023-10-09T15:42:39.486 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.483+0000 7f58acdaf700 1 -- 172.21.15.33:0/2918277923 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a4011b30 con 0x7f58a80cb5a0 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 -- 172.21.15.33:0/2918277923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 msgr2=0x7f58a80cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 --2- 172.21.15.33:0/2918277923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 0x7f58a80cb970 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f58a40098e0 tx=0x7f58a40091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 -- 172.21.15.33:0/2918277923 shutdown_connections 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 --2- 172.21.15.33:0/2918277923 >> v2:172.21.15.59:3300/0 conn(0x7f58a80cde50 0x7f58a8156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 --2- 172.21.15.33:0/2918277923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cb5a0 0x7f58a80cb970 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 -- 172.21.15.33:0/2918277923 >> 172.21.15.33:0/2918277923 conn(0x7f58a8070e30 msgr2=0x7f58a80d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 -- 172.21.15.33:0/2918277923 shutdown_connections 2023-10-09T15:42:39.487 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.484+0000 7f58b0015700 1 -- 172.21.15.33:0/2918277923 wait complete. 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.485+0000 7f58b0015700 1 Processor -- start 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.485+0000 7f58b0015700 1 -- start start 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 0x7f58a816cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cd9e0 0x7f58a80b4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a816db10 con 0x7f58a80b54e0 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58a80c77c0 con 0x7f58a80cb5a0 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58b0015700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58a816d550 con 0x7f58a80cd9e0 2023-10-09T15:42:39.490 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51046/0 (socket says 172.21.15.33:51046) 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 -- 172.21.15.33:0/943456959 learned_addr learned my addr 172.21.15.33:0/943456959 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ad5b0700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cd9e0 0x7f58a80b4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58addb1700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 0x7f58a816cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 -- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cd9e0 msgr2=0x7f58a80b4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cd9e0 0x7f58a80b4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 -- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 msgr2=0x7f58a816cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 0x7f58a816cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58ae5b2700 1 -- 172.21.15.33:0/943456959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58a0009a20 con 0x7f58a80b54e0 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.486+0000 7f58addb1700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 0x7f58a816cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f58ae5b2700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009f20 tx=0x7f58a000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.491 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a000cb70 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58a000f040 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58a4009420 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58a0014480 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.487+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58a80c5550 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.488+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58a804c3c0 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.488+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f58a0003020 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.488+0000 7f589dffb700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 0x7f588c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.489+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f58a0085630 con 0x7f58a80b54e0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.489+0000 7f58addb1700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 0x7f588c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.492 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.489+0000 7f58addb1700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 0x7f588c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f58a40091e0 tx=0x7f58a4017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.493+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f58a0052160 con 0x7f58a80b54e0 2023-10-09T15:42:39.733 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.732+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f58a80cd210 con 0x7f58a80b54e0 2023-10-09T15:42:39.734 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.733+0000 7f589dffb700 1 -- 172.21.15.33:0/943456959 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f58a0055780 con 0x7f58a80b54e0 2023-10-09T15:42:39.734 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:39.734 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:42:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 msgr2=0x7f588c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 0x7f588c0697d0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f58a40091e0 tx=0x7f58a4017000 comp rx=0 tx=0).stop 2023-10-09T15:42:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 msgr2=0x7f58a8150e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f58a0009f20 tx=0x7f58a000b040 comp rx=0 tx=0).stop 2023-10-09T15:42:39.736 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 shutdown_connections 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f588c067320 0x7f588c0697d0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f58a80b54e0 0x7f58a8150e30 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f58a80cb5a0 0x7f58a816cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 --2- 172.21.15.33:0/943456959 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f58a80cd9e0 0x7f58a80b4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 >> 172.21.15.33:0/943456959 conn(0x7f58a8070e30 msgr2=0x7f58a80b0670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 shutdown_connections 2023-10-09T15:42:39.737 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.735+0000 7f58b0015700 1 -- 172.21.15.33:0/943456959 wait complete. 2023-10-09T15:42:39.738 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 135 2023-10-09T15:42:39.748 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:42:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.866+0000 7f7ef949d700 1 Processor -- start 2023-10-09T15:42:39.868 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.866+0000 7f7ef949d700 1 -- start start 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef949d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 0x7f7ef40cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef949d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ef40cef40 0x7f7ef415c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef949d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ef40cf3c0 con 0x7f7ef4153c30 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef949d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef415afd0 con 0x7f7ef40cef40 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef949d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ef415b2b0 con 0x7f7ef415de50 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef8c9c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ef40cef40 0x7f7ef415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef8c9c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f7ef40cef40 0x7f7ef415c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51048/0 (socket says 172.21.15.33:51048) 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.867+0000 7f7ef8c9c700 1 -- 172.21.15.33:0/1351993774 learned_addr learned my addr 172.21.15.33:0/1351993774 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:39.871 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef37fe700 1 --2- 172.21.15.33:0/1351993774 >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 0x7f7ef40cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef8c9c700 1 -- 172.21.15.33:0/1351993774 >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 msgr2=0x7f7ef40cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef8c9c700 1 --2- 172.21.15.33:0/1351993774 >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 0x7f7ef40cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef8c9c700 1 -- 172.21.15.33:0/1351993774 >> v1:172.21.15.59:6789/0 conn(0x7f7ef4153c30 legacy=0x7f7ef415a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef8c9c700 1 -- 172.21.15.33:0/1351993774 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef415b590 con 0x7f7ef40cef40 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef37fe700 1 --2- 172.21.15.33:0/1351993774 >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 0x7f7ef40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef8c9c700 1 --2- 172.21.15.33:0/1351993774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef415c070 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40713a0 tx=0x7f7eec009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbb20db95e80b1d7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef2ffd700 1 -- 172.21.15.33:0/1351993774 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec00e070 con 0x7f7ef40cef40 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef2ffd700 1 -- 172.21.15.33:0/1351993774 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7eec00ba10 con 0x7f7ef40cef40 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.868+0000 7f7ef2ffd700 1 -- 172.21.15.33:0/1351993774 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7eec0092e0 con 0x7f7ef40cef40 2023-10-09T15:42:39.872 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 -- 172.21.15.33:0/1351993774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 msgr2=0x7f7ef415c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1351993774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef415c070 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7f7ef40713a0 tx=0x7f7eec009840 comp rx=0 tx=0).stop 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 -- 172.21.15.33:0/1351993774 shutdown_connections 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1351993774 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef415c070 unknown :-1 s=CLOSED pgs=1807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1351993774 >> v2:172.21.15.59:3300/0 conn(0x7f7ef415de50 0x7f7ef40cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 -- 172.21.15.33:0/1351993774 >> 172.21.15.33:0/1351993774 conn(0x7f7ef40703a0 msgr2=0x7f7ef40707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 -- 172.21.15.33:0/1351993774 shutdown_connections 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.869+0000 7f7ef949d700 1 -- 172.21.15.33:0/1351993774 wait complete. 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.870+0000 7f7ef949d700 1 Processor -- start 2023-10-09T15:42:39.873 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.870+0000 7f7ef949d700 1 -- start start 2023-10-09T15:42:39.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ef4153c30 0x7f7ef40b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.876 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ef415de50 0x7f7ef416a360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b5460 con 0x7f7ef40cef40 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef40b3590 con 0x7f7ef415de50 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ef413ef90 con 0x7f7ef4153c30 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51058/0 (socket says 172.21.15.33:51058) 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 -- 172.21.15.33:0/1402082878 learned_addr learned my addr 172.21.15.33:0/1402082878 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef37fe700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ef4153c30 0x7f7ef40b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef8c9c700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ef415de50 0x7f7ef416a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.877 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 -- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ef4153c30 msgr2=0x7f7ef40b58f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ef4153c30 0x7f7ef40b58f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 -- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ef415de50 msgr2=0x7f7ef416a360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ef415de50 0x7f7ef416a360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 -- 172.21.15.33:0/1402082878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eec009ae0 con 0x7f7ef40cef40 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef3fff700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400b640 tx=0x7f7ee4009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400f510 con 0x7f7ef40cef40 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee400f690 con 0x7f7ef40cef40 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ef40ccc50 con 0x7f7ef40cef40 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee400fa50 con 0x7f7ef40cef40 2023-10-09T15:42:39.878 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.871+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ef40b50f0 con 0x7f7ef40cef40 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.872+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ef404c3c0 con 0x7f7ef40cef40 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.873+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7ee401a400 con 0x7f7ef40cef40 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.873+0000 7f7edbfff700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 0x7f7ee00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.873+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f7ee4084680 con 0x7f7ef40cef40 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.873+0000 7f7ef37fe700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 0x7f7ee00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.874+0000 7f7ef37fe700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 0x7f7ee00697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7ef415cdf0 tx=0x7f7ee8006f90 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:39.879 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:39.877+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f7ee4051340 con 0x7f7ef40cef40 2023-10-09T15:42:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.116+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7ef40caef0 con 0x7f7ef40cef40 2023-10-09T15:42:40.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.116+0000 7f7edbfff700 1 -- 172.21.15.33:0/1402082878 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 135 v135) v1 ==== 95+0+4607 (secure 0 0 0) 0x7f7ee4054960 con 0x7f7ef40cef40 2023-10-09T15:42:40.117 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:40.118 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":135,"default_fscid":16,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128}],"filesystems":[{"mdsmap":{"epoch":134,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-10-09T15:40:25.746616+0000","modified":"2023-10-09T15:40:29.369175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9069},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9069":{"gid":9069,"name":"c","rank":0,"incarnation":130,"state":"up:active","state_seq":3,"addr":"172.21.15.33:6837/3266537603","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":3266537603},{"type":"v1","addr":"172.21.15.33:6837","nonce":3266537603}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[34],"metadata_pool":33,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":16}]} 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 msgr2=0x7f7ee00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 0x7f7ee00697d0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f7ef415cdf0 tx=0x7f7ee8006f90 comp rx=0 tx=0).stop 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 msgr2=0x7f7ef413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400b640 tx=0x7f7ee4009120 comp rx=0 tx=0).stop 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 shutdown_connections 2023-10-09T15:42:40.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7ee0067320 0x7f7ee00697d0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f7ef40cef40 0x7f7ef413ea50 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f7ef415de50 0x7f7ef416a360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 --2- 172.21.15.33:0/1402082878 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f7ef4153c30 0x7f7ef40b58f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 >> 172.21.15.33:0/1402082878 conn(0x7f7ef40703a0 msgr2=0x7f7ef40638f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 shutdown_connections 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.119+0000 7f7ef949d700 1 -- 172.21.15.33:0/1402082878 wait complete. 2023-10-09T15:42:40.121 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 135 2023-10-09T15:42:40.132 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:42:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.250+0000 7f1d93d01700 1 Processor -- start 2023-10-09T15:42:40.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.250+0000 7f1d93d01700 1 -- start start 2023-10-09T15:42:40.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d93d01700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f1d8c0cb5a0 0x7f1d8c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d93d01700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c15ae40 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d93d01700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c15ab60 con 0x7f1d8c0cd9e0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d93d01700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d13f0 con 0x7f1d8c0cb5a0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d9229e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f1d8c15a5d0 0x7f1d8c156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58738/0 (socket says 172.21.15.33:58738) 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.251+0000 7f1d9229e700 1 -- 172.21.15.33:0/190151682 learned_addr learned my addr 172.21.15.33:0/190151682 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/190151682 >> v2:172.21.15.59:3300/0 conn(0x7f1d8c0cb5a0 0x7f1d8c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2352002277 0 0) 0x7f1d8c15ae40 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d74003570 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3113589697 0 0) 0x7f1d74003570 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 >> v2:172.21.15.59:3300/0 conn(0x7f1d8c0cb5a0 msgr2=0x7f1d8c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:40.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 --2- 172.21.15.33:0/190151682 >> v2:172.21.15.59:3300/0 conn(0x7f1d8c0cb5a0 0x7f1d8c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 >> v1:172.21.15.59:6789/0 conn(0x7f1d8c0cd9e0 legacy=0x7f1d8c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0ccf00 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f1d7c001470 con 0x7f1d8c15a5d0 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 >> v1:172.21.15.33:6789/0 conn(0x7f1d8c15a5d0 legacy=0x7f1d8c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d74003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d74004810 0x7f1d74004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d740051c0 0x7f1d7400ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7400c0a0 con 0x7f1d74003a60 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7400c210 con 0x7f1d74004810 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d7400c3d0 con 0x7f1d740051c0 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d74003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d9129c700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d74004810 0x7f1d74004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d9229e700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d740051c0 0x7f1d7400ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 -- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d740051c0 msgr2=0x7f1d7400ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d740051c0 0x7f1d7400ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 -- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d74004810 msgr2=0x7f1d74004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d74004810 0x7f1d74004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d91a9d700 1 -- 172.21.15.33:0/190151682 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d74003570 con 0x7f1d74003a60 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d9229e700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d740051c0 0x7f1d7400ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.252+0000 7f1d9229e700 1 -- 172.21.15.33:0/190151682 reap_dead start 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d74003e70 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e210 tx=0x7f1d8400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73421783a324d4fb server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400eac0 con 0x7f1d74003a60 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d8400f040 con 0x7f1d74003a60 2023-10-09T15:42:40.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d90a9b700 1 -- 172.21.15.33:0/190151682 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d8400ee70 con 0x7f1d74003a60 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 -- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 msgr2=0x7f1d74003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d74003e70 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400e210 tx=0x7f1d8400b040 comp rx=0 tx=0).stop 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 -- 172.21.15.33:0/190151682 shutdown_connections 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 --2- 172.21.15.33:0/190151682 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d74003e70 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 -- 172.21.15.33:0/190151682 >> 172.21.15.33:0/190151682 conn(0x7f1d8c070e30 msgr2=0x7f1d8c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 -- 172.21.15.33:0/190151682 shutdown_connections 2023-10-09T15:42:40.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.253+0000 7f1d93d01700 1 -- 172.21.15.33:0/190151682 wait complete. 2023-10-09T15:42:40.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.254+0000 7f1d93d01700 1 Processor -- start 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.254+0000 7f1d93d01700 1 -- start start 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c1512b0 0x7f1d8c15b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d8c0b0770 0x7f1d8c0b0be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0b1120 con 0x7f1d74003a60 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c15b5b0 con 0x7f1d8c1512b0 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d93d01700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c15b860 con 0x7f1d8c0b0770 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d91a9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d91a9d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51066/0 (socket says 172.21.15.33:51066) 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d91a9d700 1 -- 172.21.15.33:0/1384227419 learned_addr learned my addr 172.21.15.33:0/1384227419 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:40.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d9129c700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c1512b0 0x7f1d8c15b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.255+0000 7f1d9229e700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d8c0b0770 0x7f1d8c0b0be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 -- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d8c0b0770 msgr2=0x7f1d8c0b0be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d8c0b0770 0x7f1d8c0b0be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 -- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c1512b0 msgr2=0x7f1d8c15b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c1512b0 0x7f1d8c15b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 -- 172.21.15.33:0/1384227419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c15bb40 con 0x7f1d74003a60 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d91a9d700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400afd0 tx=0x7f1d8401a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d84029450 con 0x7f1d74003a60 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d840295b0 con 0x7f1d74003a60 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c15be20 con 0x7f1d74003a60 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d840299b0 con 0x7f1d74003a60 2023-10-09T15:42:40.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.256+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c169860 con 0x7f1d74003a60 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.257+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c04c3c0 con 0x7f1d74003a60 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.258+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f1d84003040 con 0x7f1d74003a60 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.258+0000 7f1d89ffb700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 0x7f1d780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.258+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f1d8408a120 con 0x7f1d74003a60 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.258+0000 7f1d9129c700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 0x7f1d780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.258+0000 7f1d9129c700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 0x7f1d780697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c15a380 tx=0x7f1d80007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.262+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f1d84053b50 con 0x7f1d74003a60 2023-10-09T15:42:40.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.461+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1d8c169c10 con 0x7f1d74003a60 2023-10-09T15:42:40.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.461+0000 7f1d89ffb700 1 -- 172.21.15.33:0/1384227419 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v202) v1 ==== 74+0+15461 (secure 0 0 0) 0x7f1d84018090 con 0x7f1d74003a60 2023-10-09T15:42:40.463 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:40.463 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":202,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:40:49.419235+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}},{"pool":33,"pool_name":"cephfs_metadata","create_time":"2023-10-09T15:40:24.159100+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"199","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":34,"pool_name":"cephfs_data","create_time":"2023-10-09T15:40:24.714403+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"200","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"34.f","mappings":[{"from":0,"to":2}]},{"pgid":"34.21","mappings":[{"from":0,"to":1}]},{"pgid":"34.26","mappings":[{"from":0,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:42:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 msgr2=0x7f1d780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 0x7f1d780697d0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c15a380 tx=0x7f1d80007d30 comp rx=0 tx=0).stop 2023-10-09T15:42:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 msgr2=0x7f1d8c0b5550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f1d8400afd0 tx=0x7f1d8401a000 comp rx=0 tx=0).stop 2023-10-09T15:42:40.465 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 shutdown_connections 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1d78067320 0x7f1d780697d0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1d74003a60 0x7f1d8c0b5550 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1d8c0b0770 0x7f1d8c0b0be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 --2- 172.21.15.33:0/1384227419 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f1d8c1512b0 0x7f1d8c15b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 >> 172.21.15.33:0/1384227419 conn(0x7f1d8c070e30 msgr2=0x7f1d8c155ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 shutdown_connections 2023-10-09T15:42:40.466 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.464+0000 7f1d93d01700 1 -- 172.21.15.33:0/1384227419 wait complete. 2023-10-09T15:42:40.477 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-10-09T15:42:40.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.596+0000 7f6b0e5f1700 1 Processor -- start 2023-10-09T15:42:40.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.596+0000 7f6b0e5f1700 1 -- start start 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b0e5f1700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b080cb970 0x7f6b08159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b0e5f1700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0815ae40 con 0x7f6b080cb5a0 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b0e5f1700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b0815ab60 con 0x7f6b0815a400 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b0e5f1700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b080ce0f0 con 0x7f6b080cb970 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b07fff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f6b080cb5a0 0x7f6b080cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:58740/0 (socket says 172.21.15.33:58740) 2023-10-09T15:42:40.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b07fff700 1 -- 172.21.15.33:0/4268509103 learned_addr learned my addr 172.21.15.33:0/4268509103 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b077fe700 1 --2- 172.21.15.33:0/4268509103 >> v2:172.21.15.59:3300/0 conn(0x7f6b080cb970 0x7f6b08159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.597+0000 7f6b06ffd700 1 -- 172.21.15.33:0/4268509103 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 9227293 0 0) 0x7f6b0815ae40 con 0x7f6b080cb5a0 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b06ffd700 1 -- 172.21.15.33:0/4268509103 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6af0003570 con 0x7f6b080cb5a0 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b077fe700 1 -- 172.21.15.33:0/4268509103 >> v1:172.21.15.59:6789/0 conn(0x7f6b0815a400 legacy=0x7f6b08156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b077fe700 1 -- 172.21.15.33:0/4268509103 >> v1:172.21.15.33:6789/0 conn(0x7f6b080cb5a0 legacy=0x7f6b080cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b077fe700 1 -- 172.21.15.33:0/4268509103 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b080ccf00 con 0x7f6b080cb970 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b077fe700 1 --2- 172.21.15.33:0/4268509103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080cb970 0x7f6b08159ec0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098e0 tx=0x7f6afc0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=17ea0b1a2d561f58 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b06ffd700 1 -- 172.21.15.33:0/4268509103 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00b640 con 0x7f6b080cb970 2023-10-09T15:42:40.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b06ffd700 1 -- 172.21.15.33:0/4268509103 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6afc00b7a0 con 0x7f6b080cb970 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.598+0000 7f6b06ffd700 1 -- 172.21.15.33:0/4268509103 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6afc00bb40 con 0x7f6b080cb970 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/4268509103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080cb970 msgr2=0x7f6b08159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/4268509103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080cb970 0x7f6b08159ec0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f6afc0098e0 tx=0x7f6afc0091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/4268509103 shutdown_connections 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/4268509103 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b080cb970 0x7f6b08159ec0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/4268509103 >> 172.21.15.33:0/4268509103 conn(0x7f6b08070e30 msgr2=0x7f6b080d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/4268509103 shutdown_connections 2023-10-09T15:42:40.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.599+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/4268509103 wait complete. 2023-10-09T15:42:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.600+0000 7f6b0e5f1700 1 Processor -- start 2023-10-09T15:42:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.600+0000 7f6b0e5f1700 1 -- start start 2023-10-09T15:42:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 0x7f6b0814e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 0x7f6b080b1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08152b80 con 0x7f6b080cb5a0 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b081536d0 con 0x7f6b0815a400 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b08151f70 con 0x7f6b080cb970 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:51074/0 (socket says 172.21.15.33:51074) 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 -- 172.21.15.33:0/42745015 learned_addr learned my addr 172.21.15.33:0/42745015 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b077fe700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 0x7f6b0814e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0cb8e700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 0x7f6b080b1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 -- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 msgr2=0x7f6b0814e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 0x7f6b0814e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 -- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 msgr2=0x7f6b080b1ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 0x7f6b080b1ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 -- 172.21.15.33:0/42745015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6afc009420 con 0x7f6b080cb5a0 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0cb8e700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 0x7f6b080b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b077fe700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 0x7f6b0814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b07fff700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c7c0 tx=0x7f6af8007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8005b30 con 0x7f6b080cb5a0 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6af8005c90 con 0x7f6b080cb5a0 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b08152250 con 0x7f6b080cb5a0 2023-10-09T15:42:40.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6af8007340 con 0x7f6b080cb5a0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.601+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b08152810 con 0x7f6b080cb5a0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.602+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b0804c3c0 con 0x7f6b080cb5a0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.603+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6af801b400 con 0x7f6b080cb5a0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.603+0000 7f6aeffff700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 0x7f6af40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.603+0000 7f6b077fe700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 0x7f6af40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.603+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(202..202 src has 1..202) v4 ==== 5792+0+0 (secure 0 0 0) 0x7f6af8084850 con 0x7f6b080cb5a0 2023-10-09T15:42:40.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.604+0000 7f6b077fe700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 0x7f6af40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6b0816d760 tx=0x7f6afc017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.608+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6af80514d0 con 0x7f6b080cb5a0 2023-10-09T15:42:40.848 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.847+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6b08152f10 con 0x7f6b080cb5a0 2023-10-09T15:42:40.848 INFO:tasks.ceph.mon.a.smithi033.stderr:2023-10-09T15:42:40.848+0000 7f29a2172700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-10-09T15:42:40.853 INFO:tasks.ceph.mds.c.smithi033.stderr: -4470> 2023-10-09T15:40:21.282+0000 7f7f92042700 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-10-09T15:42:40.854 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.853+0000 7f6aeffff700 1 -- 172.21.15.33:0/42745015 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v136) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6af8054af0 con 0x7f6b080cb5a0 2023-10-09T15:42:40.855 INFO:tasks.ceph.mds.c.smithi033.stderr: -3252> 2023-10-09T15:40:31.670+0000 7f7f8c036700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-10-09T15:42:40.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 msgr2=0x7f6af40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 0x7f6af40697d0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f6b0816d760 tx=0x7f6afc017000 comp rx=0 tx=0).stop 2023-10-09T15:42:40.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 msgr2=0x7f6b08153190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f6af800c7c0 tx=0x7f6af8007e00 comp rx=0 tx=0).stop 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 shutdown_connections 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6af4067320 0x7f6af40697d0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b080cb5a0 0x7f6b08153190 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b0815a400 0x7f6b080b1ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 --2- 172.21.15.33:0/42745015 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b080cb970 0x7f6b0814e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 >> 172.21.15.33:0/42745015 conn(0x7f6b08070e30 msgr2=0x7f6b080b0640 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 shutdown_connections 2023-10-09T15:42:40.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.855+0000 7f6b0e5f1700 1 -- 172.21.15.33:0/42745015 wait complete. 2023-10-09T15:42:40.858 INFO:teuthology.orchestra.run.smithi033.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-10-09T15:42:40.869 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-10-09T15:42:40.880 INFO:tasks.ceph.mds.c.smithi033.stdout:starting mds.c at 2023-10-09T15:42:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.990+0000 7f2f941f0700 1 Processor -- start 2023-10-09T15:42:40.991 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.990+0000 7f2f941f0700 1 -- start start 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.991+0000 7f2f941f0700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f2f8c1597e0 0x7f2f8c159bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.991+0000 7f2f941f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.991+0000 7f2f941f0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2f8c06f300 con 0x7f2f8c06e950 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.991+0000 7f2f941f0700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2f8c0c71a0 con 0x7f2f8c1597e0 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.991+0000 7f2f941f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0c7a40 con 0x7f2f8c06cdb0 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:49728/0 (socket says 172.21.15.33:49728) 2023-10-09T15:42:40.994 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 -- 172.21.15.33:0/3584262031 learned_addr learned my addr 172.21.15.33:0/3584262031 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f91f8c700 1 --2- 172.21.15.33:0/3584262031 >> v2:172.21.15.59:3300/0 conn(0x7f2f8c1597e0 0x7f2f8c159bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 -- 172.21.15.33:0/3584262031 >> v2:172.21.15.59:3300/0 conn(0x7f2f8c1597e0 msgr2=0x7f2f8c159bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 --2- 172.21.15.33:0/3584262031 >> v2:172.21.15.59:3300/0 conn(0x7f2f8c1597e0 0x7f2f8c159bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 -- 172.21.15.33:0/3584262031 >> v1:172.21.15.59:6789/0 conn(0x7f2f8c06e950 legacy=0x7f2f8c06c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 -- 172.21.15.33:0/3584262031 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f8c06d3d0 con 0x7f2f8c06cdb0 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.992+0000 7f2f9278d700 1 --2- 172.21.15.33:0/3584262031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f20 tx=0x7f2f84009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=49f54b2ce6611478 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f90f8a700 1 -- 172.21.15.33:0/3584262031 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f8400e070 con 0x7f2f8c06cdb0 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f90f8a700 1 -- 172.21.15.33:0/3584262031 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f8400b9d0 con 0x7f2f8c06cdb0 2023-10-09T15:42:40.995 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f90f8a700 1 -- 172.21.15.33:0/3584262031 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f840092e0 con 0x7f2f8c06cdb0 2023-10-09T15:42:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 -- 172.21.15.33:0/3584262031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 msgr2=0x7f2f8c06edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 --2- 172.21.15.33:0/3584262031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f84009f20 tx=0x7f2f84009840 comp rx=0 tx=0).stop 2023-10-09T15:42:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 -- 172.21.15.33:0/3584262031 shutdown_connections 2023-10-09T15:42:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 --2- 172.21.15.33:0/3584262031 >> v2:172.21.15.59:3300/0 conn(0x7f2f8c1597e0 0x7f2f8c159bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:40.999 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 --2- 172.21.15.33:0/3584262031 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06cdb0 0x7f2f8c06edc0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 -- 172.21.15.33:0/3584262031 >> 172.21.15.33:0/3584262031 conn(0x7f2f8c0ccb60 msgr2=0x7f2f8c0ccf60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 -- 172.21.15.33:0/3584262031 shutdown_connections 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.993+0000 7f2f941f0700 1 -- 172.21.15.33:0/3584262031 wait complete. 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.994+0000 7f2f941f0700 1 Processor -- start 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.994+0000 7f2f941f0700 1 -- start start 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06e950 0x7f2f8c0aae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8c1597e0 0x7f2f8c0ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c151c20 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.000 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ad050 con 0x7f2f8c1597e0 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f941f0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2f8c0ad330 con 0x7f2f8c06e950 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f91f8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f91f8c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60362/0 (socket says 172.21.15.33:60362) 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.995+0000 7f2f91f8c700 1 -- 172.21.15.33:0/973928136 learned_addr learned my addr 172.21.15.33:0/973928136 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f9278d700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8c1597e0 0x7f2f8c0ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f9178b700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06e950 0x7f2f8c0aae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 -- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06e950 msgr2=0x7f2f8c0aae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06e950 0x7f2f8c0aae00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 -- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8c1597e0 msgr2=0x7f2f8c0ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:41.001 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8c1597e0 0x7f2f8c0ab340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 -- 172.21.15.33:0/973928136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f84009ae0 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f91f8c700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ec80 tx=0x7f2f7c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c00c9d0 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2f7c00cb30 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f8c0ad610 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2f7c013470 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.996+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f8c0adbd0 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.997+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f8c04c3c0 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.002 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.998+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f2f7c013860 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.998+0000 7f2f89ffb700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 0x7f2f780697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.998+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f2f7c085530 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.998+0000 7f2f9178b700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 0x7f2f780697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:40.998+0000 7f2f9178b700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 0x7f2f780697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c16cf70 tx=0x7f2f80009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:41.003 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.002+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f2f7c052110 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.246 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.245+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2f8c0adf40 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.853 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.852+0000 7f2f89ffb700 1 -- 172.21.15.33:0/973928136 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v137) v1 ==== 104+0+0 (secure 0 0 0) 0x7f2f7c055730 con 0x7f2f8c06cdb0 2023-10-09T15:42:41.856 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 msgr2=0x7f2f780697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 0x7f2f780697d0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c16cf70 tx=0x7f2f80009040 comp rx=0 tx=0).stop 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 msgr2=0x7f2f8c1516e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f2f7c00ec80 tx=0x7f2f7c009120 comp rx=0 tx=0).stop 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 shutdown_connections 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f2f78067320 0x7f2f780697d0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f2f8c06cdb0 0x7f2f8c1516e0 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f2f8c1597e0 0x7f2f8c0ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.857 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 --2- 172.21.15.33:0/973928136 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f2f8c06e950 0x7f2f8c0aae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:41.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 >> 172.21.15.33:0/973928136 conn(0x7f2f8c0ccb60 msgr2=0x7f2f8c0ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:41.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 shutdown_connections 2023-10-09T15:42:41.858 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:41.855+0000 7f2f941f0700 1 -- 172.21.15.33:0/973928136 wait complete. 2023-10-09T15:42:41.870 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-10-09T15:42:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.036+0000 7f351bbd8700 1 Processor -- start 2023-10-09T15:42:42.037 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.036+0000 7f351bbd8700 1 -- start start 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351bbd8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f351406dcf0 0x7f3514159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351bbd8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35140ccfd0 con 0x7f3514159e40 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351bbd8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f351415a410 con 0x7f3514159530 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351bbd8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f351415a6f0 con 0x7f351406dcf0 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351a175700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3514159e40 0x7f35140cb6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56530/0 (socket says 172.21.15.33:56530) 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.037+0000 7f351a175700 1 -- 172.21.15.33:0/3247082513 learned_addr learned my addr 172.21.15.33:0/3247082513 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:42.042 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 --2- 172.21.15.33:0/3247082513 >> v2:172.21.15.59:3300/0 conn(0x7f351406dcf0 0x7f3514159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1321088211 0 0) 0x7f35140ccfd0 con 0x7f3514159e40 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f34fc003570 con 0x7f3514159e40 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3684700697 0 0) 0x7f34fc003570 con 0x7f3514159e40 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 >> v2:172.21.15.59:3300/0 conn(0x7f351406dcf0 msgr2=0x7f3514159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 --2- 172.21.15.33:0/3247082513 >> v2:172.21.15.59:3300/0 conn(0x7f351406dcf0 0x7f3514159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 >> v1:172.21.15.59:6789/0 conn(0x7f3514159530 legacy=0x7f35140ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f351415a9d0 con 0x7f3514159e40 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f35040017f0 con 0x7f3514159e40 2023-10-09T15:42:42.043 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 >> v1:172.21.15.33:6789/0 conn(0x7f3514159e40 legacy=0x7f35140cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34fc003a60 0x7f34fc003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 0x7f34fc004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc0051c0 0x7f34fc00ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f351415a6f0 con 0x7f34fc004810 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00c160 con 0x7f34fc003a60 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34fc00c320 con 0x7f34fc0051c0 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 0x7f34fc004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519974700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34fc003a60 0x7f34fc003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f351a175700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc0051c0 0x7f34fc00ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.044 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 -- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc0051c0 msgr2=0x7f34fc00ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc0051c0 0x7f34fc00ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 -- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34fc003a60 msgr2=0x7f34fc003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.038+0000 7f3519173700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f34fc003a60 0x7f34fc003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f3519173700 1 -- 172.21.15.33:0/3247082513 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34fc003570 con 0x7f34fc004810 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351a175700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc0051c0 0x7f34fc00ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351a175700 1 -- 172.21.15.33:0/3247082513 reap_dead start 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f3519173700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 0x7f34fc004c80 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f3508009c00 tx=0x7f35080091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=539f18ad159f0561 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800e710 con 0x7f34fc004810 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350800e870 con 0x7f34fc004810 2023-10-09T15:42:42.045 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f3518972700 1 -- 172.21.15.33:0/3247082513 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350800ec30 con 0x7f34fc004810 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 -- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 msgr2=0x7f34fc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 0x7f34fc004c80 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7f3508009c00 tx=0x7f35080091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 -- 172.21.15.33:0/3247082513 shutdown_connections 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3247082513 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f34fc004810 0x7f34fc004c80 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 -- 172.21.15.33:0/3247082513 >> 172.21.15.33:0/3247082513 conn(0x7f35140703a0 msgr2=0x7f35140707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 -- 172.21.15.33:0/3247082513 shutdown_connections 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.039+0000 7f351bbd8700 1 -- 172.21.15.33:0/3247082513 wait complete. 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 Processor -- start 2023-10-09T15:42:42.046 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 -- start start 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc004810 0x7f3514155a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3514154fb0 0x7f35140b5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c94f0 con 0x7f35140b5e60 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3514155f50 con 0x7f3514154fb0 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351bbd8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35140c8c00 con 0x7f34fc004810 2023-10-09T15:42:42.049 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.041+0000 7f351a175700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60388/0 (socket says 172.21.15.33:60388) 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 -- 172.21.15.33:0/3225675797 learned_addr learned my addr 172.21.15.33:0/3225675797 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f3519974700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc004810 0x7f3514155a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f3519173700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3514154fb0 0x7f35140b5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 -- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc004810 msgr2=0x7f3514155a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc004810 0x7f3514155a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 -- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3514154fb0 msgr2=0x7f35140b5920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3514154fb0 0x7f35140b5920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.050 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 -- 172.21.15.33:0/3225675797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35140c8ea0 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f351a175700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f3504001350 tx=0x7f3504001840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f350400ebc0 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f350400ed20 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.042+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3504013630 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.043+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35140c9180 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.043+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35140b46d0 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.044+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35140c9660 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.044+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3504013a60 con 0x7f35140b5e60 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.044+0000 7f3511ffb700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 0x7f35000697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:42.051 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.045+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(203..203 src has 1..203) v4 ==== 5878+0+0 (secure 0 0 0) 0x7f3504085290 con 0x7f35140b5e60 2023-10-09T15:42:42.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.045+0000 7f3519974700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 0x7f35000697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:42.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.045+0000 7f3519974700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 0x7f35000697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c007d30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:42.052 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.049+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3504051f30 con 0x7f35140b5e60 2023-10-09T15:42:42.242 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.242+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f351404c3c0 con 0x7f35140b5e60 2023-10-09T15:42:42.855 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.854+0000 7f3511ffb700 1 -- 172.21.15.33:0/3225675797 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v204) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3504055550 con 0x7f35140b5e60 2023-10-09T15:42:42.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.858+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 msgr2=0x7f35000697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.859 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.858+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 0x7f35000697d0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f350c000c00 tx=0x7f350c007d30 comp rx=0 tx=0).stop 2023-10-09T15:42:42.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.858+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 msgr2=0x7f351415dac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:42.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.858+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7f3504001350 tx=0x7f3504001840 comp rx=0 tx=0).stop 2023-10-09T15:42:42.860 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 shutdown_connections 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3500067320 0x7f35000697d0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f35140b5e60 0x7f351415dac0 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f34fc004810 0x7f3514155a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 --2- 172.21.15.33:0/3225675797 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3514154fb0 0x7f35140b5920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 >> 172.21.15.33:0/3225675797 conn(0x7f35140703a0 msgr2=0x7f35140ceb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 shutdown_connections 2023-10-09T15:42:42.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:42.859+0000 7f351bbd8700 1 -- 172.21.15.33:0/3225675797 wait complete. 2023-10-09T15:42:42.862 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_metadata' removed 2023-10-09T15:42:42.876 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-10-09T15:42:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.005+0000 7f88650f8700 1 Processor -- start 2023-10-09T15:42:43.006 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.005+0000 7f88650f8700 1 -- start start 2023-10-09T15:42:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.006+0000 7f88650f8700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8860159fb0 0x7f886015a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.006+0000 7f88650f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.006+0000 7f88650f8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88600cd830 con 0x7f88600cd3d0 2023-10-09T15:42:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.006+0000 7f88650f8700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f886015e180 con 0x7f8860159fb0 2023-10-09T15:42:43.007 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.006+0000 7f88650f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f886015d570 con 0x7f886015a8c0 2023-10-09T15:42:43.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885ffff700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8860159fb0 0x7f886015a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:49760/0 (socket says 172.21.15.33:49760) 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 -- 172.21.15.33:0/553391602 learned_addr learned my addr 172.21.15.33:0/553391602 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f88648f7700 1 --1- 172.21.15.33:0/553391602 >> v1:172.21.15.59:6789/0 conn(0x7f88600cd3d0 0x7f886006d830 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:35978/0 (socket says 172.21.15.33:35978) 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885effd700 1 -- 172.21.15.33:0/553391602 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3952865276 0 0) 0x7f8858001490 con 0x7f88600cd3d0 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885effd700 1 -- 172.21.15.33:0/553391602 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f884c003570 con 0x7f88600cd3d0 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 -- 172.21.15.33:0/553391602 >> v2:172.21.15.59:3300/0 conn(0x7f8860159fb0 msgr2=0x7f886015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:43.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 --2- 172.21.15.33:0/553391602 >> v2:172.21.15.59:3300/0 conn(0x7f8860159fb0 0x7f886015a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 -- 172.21.15.33:0/553391602 >> v1:172.21.15.59:6789/0 conn(0x7f88600cd3d0 legacy=0x7f886006d830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 -- 172.21.15.33:0/553391602 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f886015d850 con 0x7f886015a8c0 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885f7fe700 1 --2- 172.21.15.33:0/553391602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88480099b0 tx=0x7f8848009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b4ad6f8bfa39a8fd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885effd700 1 -- 172.21.15.33:0/553391602 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800b680 con 0x7f886015a8c0 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.007+0000 7f885effd700 1 -- 172.21.15.33:0/553391602 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800b7e0 con 0x7f886015a8c0 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f885effd700 1 -- 172.21.15.33:0/553391602 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800bb60 con 0x7f886015a8c0 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 -- 172.21.15.33:0/553391602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 msgr2=0x7f88600cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 --2- 172.21.15.33:0/553391602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f88480099b0 tx=0x7f8848009250 comp rx=0 tx=0).stop 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 -- 172.21.15.33:0/553391602 shutdown_connections 2023-10-09T15:42:43.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 --2- 172.21.15.33:0/553391602 >> v2:172.21.15.59:3300/0 conn(0x7f8860159fb0 0x7f886015a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 --2- 172.21.15.33:0/553391602 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600cce90 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 -- 172.21.15.33:0/553391602 >> 172.21.15.33:0/553391602 conn(0x7f88600703a0 msgr2=0x7f88600707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:43.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 -- 172.21.15.33:0/553391602 shutdown_connections 2023-10-09T15:42:43.012 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.008+0000 7f88650f8700 1 -- 172.21.15.33:0/553391602 wait complete. 2023-10-09T15:42:43.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.009+0000 7f88650f8700 1 Processor -- start 2023-10-09T15:42:43.014 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.009+0000 7f88650f8700 1 -- start start 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600cd3d0 0x7f886014d630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600c98e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600c8bb0 con 0x7f8860159fb0 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88600c9450 con 0x7f88600cd3d0 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88650f8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88601538e0 con 0x7f886015a8c0 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f885f7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60404/0 (socket says 172.21.15.33:60404) 2023-10-09T15:42:43.015 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f885f7fe700 1 -- 172.21.15.33:0/2042705742 learned_addr learned my addr 172.21.15.33:0/2042705742 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f88648f7700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600c98e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f885ffff700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600cd3d0 0x7f886014d630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.010+0000 7f885f7fe700 1 -- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 msgr2=0x7f88600c98e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f885f7fe700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600c98e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f885f7fe700 1 -- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600cd3d0 msgr2=0x7f886014d630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f885f7fe700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600cd3d0 0x7f886014d630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f885f7fe700 1 -- 172.21.15.33:0/2042705742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88480094f0 con 0x7f8860159fb0 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f885f7fe700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f8860089740 tx=0x7f8848017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:43.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884800b950 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800bad0 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88600c8e00 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884801a680 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.011+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88600c9e20 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.012+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f886004c3c0 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.012+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f884801aa30 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.013+0000 7f8857fff700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.013+0000 7f885ffff700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.013+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(204..204 src has 1..204) v4 ==== 5440+0+0 (secure 0 0 0) 0x7f8848086720 con 0x7f8860159fb0 2023-10-09T15:42:43.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.013+0000 7f885ffff700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 0x7f88400697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8850009d40 tx=0x7f8850008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:43.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.017+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f88480534c0 con 0x7f8860159fb0 2023-10-09T15:42:43.216 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.215+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f88600caef0 con 0x7f8860159fb0 2023-10-09T15:42:43.861 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.860+0000 7f8857fff700 1 -- 172.21.15.33:0/2042705742 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v205) v1 ==== 169+0+0 (secure 0 0 0) 0x7f8848086020 con 0x7f8860159fb0 2023-10-09T15:42:43.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 msgr2=0x7f88400697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 0x7f88400697d0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f8850009d40 tx=0x7f8850008040 comp rx=0 tx=0).stop 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 msgr2=0x7f8860153290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7f8860089740 tx=0x7f8848017000 comp rx=0 tx=0).stop 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 shutdown_connections 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8840067320 0x7f88400697d0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f886015a8c0 0x7f88600c98e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f88600cd3d0 0x7f886014d630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 --2- 172.21.15.33:0/2042705742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8860159fb0 0x7f8860153290 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 >> 172.21.15.33:0/2042705742 conn(0x7f88600703a0 msgr2=0x7f886014dcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 shutdown_connections 2023-10-09T15:42:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:43.864+0000 7f88650f8700 1 -- 172.21.15.33:0/2042705742 wait complete. 2023-10-09T15:42:43.867 INFO:teuthology.orchestra.run.smithi033.stderr:pool 'cephfs_data' removed 2023-10-09T15:42:43.879 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-10-09T15:42:44.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.004+0000 7ff8dfb54700 1 Processor -- start 2023-10-09T15:42:44.005 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.004+0000 7ff8dfb54700 1 -- start start 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dfb54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 0x7ff8d80ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dfb54700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff8d806e0e0 0x7ff8d80cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dfb54700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8d80ccfd0 con 0x7ff8d806dc70 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dfb54700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8d80cf0e0 con 0x7ff8d806e0e0 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dfb54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d815a3d0 con 0x7ff8d8159530 2023-10-09T15:42:44.008 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dd0ef700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7ff8d806dc70 0x7ff8d8159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56540/0 (socket says 172.21.15.33:56540) 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dd0ef700 1 -- 172.21.15.33:0/2210305692 learned_addr learned my addr 172.21.15.33:0/2210305692 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/2210305692 >> v2:172.21.15.33:3300/0 conn(0x7ff8d806e0e0 0x7ff8d80cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 0x7ff8d80ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dc8ee700 1 -- 172.21.15.33:0/2210305692 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1114920413 0 0) 0x7ff8d80ccfd0 con 0x7ff8d806dc70 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.005+0000 7ff8dc8ee700 1 -- 172.21.15.33:0/2210305692 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8c0003570 con 0x7ff8d806dc70 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8de0f1700 1 -- 172.21.15.33:0/2210305692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 msgr2=0x7ff8d80ceba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:44.009 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 0x7ff8d80ceba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8de0f1700 1 -- 172.21.15.33:0/2210305692 >> v1:172.21.15.33:6789/0 conn(0x7ff8d806dc70 legacy=0x7ff8d8159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8de0f1700 1 -- 172.21.15.33:0/2210305692 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d815a6b0 con 0x7ff8d806e0e0 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 0x7ff8d80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d806e0e0 0x7ff8d80cb6f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098e0 tx=0x7ff8d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=568c0141a91e8274 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dc8ee700 1 -- 172.21.15.33:0/2210305692 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000b640 con 0x7ff8d806e0e0 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dc8ee700 1 -- 172.21.15.33:0/2210305692 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d000b7a0 con 0x7ff8d806e0e0 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dc8ee700 1 -- 172.21.15.33:0/2210305692 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000bb40 con 0x7ff8d806e0e0 2023-10-09T15:42:44.010 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 -- 172.21.15.33:0/2210305692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d806e0e0 msgr2=0x7ff8d80cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d806e0e0 0x7ff8d80cb6f0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7ff8d00098e0 tx=0x7ff8d00091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 -- 172.21.15.33:0/2210305692 shutdown_connections 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d806e0e0 0x7ff8d80cb6f0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/2210305692 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d8159530 0x7ff8d80ceba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 -- 172.21.15.33:0/2210305692 >> 172.21.15.33:0/2210305692 conn(0x7ff8d80703a0 msgr2=0x7ff8d80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 -- 172.21.15.33:0/2210305692 shutdown_connections 2023-10-09T15:42:44.011 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.006+0000 7ff8dfb54700 1 -- 172.21.15.33:0/2210305692 wait complete. 2023-10-09T15:42:44.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.007+0000 7ff8dfb54700 1 Processor -- start 2023-10-09T15:42:44.016 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 -- start start 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 0x7ff8d81430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 0x7ff8d80d01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d816d1f0 con 0x7ff8d8159530 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d816e190 con 0x7ff8d806dc70 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8dfb54700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8d816dd00 con 0x7ff8d806e0e0 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8de0f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8de0f1700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60416/0 (socket says 172.21.15.33:60416) 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.008+0000 7ff8de0f1700 1 -- 172.21.15.33:0/614953228 learned_addr learned my addr 172.21.15.33:0/614953228 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:44.017 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dd0ef700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 0x7ff8d80d01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 0x7ff8d81430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 -- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 msgr2=0x7ff8d80d01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 0x7ff8d80d01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 -- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 msgr2=0x7ff8d81430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 0x7ff8d81430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 -- 172.21.15.33:0/614953228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8d0009420 con 0x7ff8d8159530 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dd0ef700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 0x7ff8d80d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 0x7ff8d81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:44.018 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8de0f1700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0013000 tx=0x7ff8d0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d000b640 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8d001be40 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8d816adc0 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8d0011880 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.009+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8d816d6b0 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.010+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8d816deb0 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.011+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff8d0011bf0 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.011+0000 7ff8d5ffb700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 0x7ff8c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.011+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff8d0086620 con 0x7ff8d8159530 2023-10-09T15:42:44.019 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.011+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 0x7ff8c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.011+0000 7ff8dd8f0700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 0x7ff8c40697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009fd0 tx=0x7ff8c800b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.020 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.015+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff8d816deb0 con 0x7ff8d8159530 2023-10-09T15:42:44.217 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.217+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff8d816de70 con 0x7ff8d8159530 2023-10-09T15:42:44.221 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.220+0000 7ff8d5ffb700 1 -- 172.21.15.33:0/614953228 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v33) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff8d0053570 con 0x7ff8d8159530 2023-10-09T15:42:44.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.222+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 msgr2=0x7ff8c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.226 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.222+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 0x7ff8c40697d0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7ff8c8009fd0 tx=0x7ff8c800b040 comp rx=0 tx=0).stop 2023-10-09T15:42:44.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.222+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 msgr2=0x7ff8d80d06f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.222+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7ff8d0013000 tx=0x7ff8d0017000 comp rx=0 tx=0).stop 2023-10-09T15:42:44.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 shutdown_connections 2023-10-09T15:42:44.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff8c4067320 0x7ff8c40697d0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff8d8159530 0x7ff8d80d06f0 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff8d806dc70 0x7ff8d81430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 --2- 172.21.15.33:0/614953228 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff8d806e0e0 0x7ff8d80d01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 >> 172.21.15.33:0/614953228 conn(0x7ff8d80703a0 msgr2=0x7ff8d8158720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 shutdown_connections 2023-10-09T15:42:44.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.223+0000 7ff8dfb54700 1 -- 172.21.15.33:0/614953228 wait complete. 2023-10-09T15:42:44.236 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm' 2023-10-09T15:42:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.354+0000 7f8b5751f700 1 Processor -- start 2023-10-09T15:42:44.355 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.354+0000 7f8b5751f700 1 -- start start 2023-10-09T15:42:44.357 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b50143200 0x7f8b50159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b500c3250 0x7f8b5015a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8b5015a850 0x7f8b5006cc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b501171e0 con 0x7f8b50143200 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8b5006c7d0 con 0x7f8b5015a850 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b5751f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5015ac90 con 0x7f8b500c3250 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b50143200 0x7f8b50159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.358 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f8b50143200 0x7f8b50159dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60424/0 (socket says 172.21.15.33:60424) 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 -- 172.21.15.33:0/3163912746 learned_addr learned my addr 172.21.15.33:0/3163912746 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b54aba700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b500c3250 0x7f8b5015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b55abc700 1 --2- 172.21.15.33:0/3163912746 >> v2:172.21.15.59:3300/0 conn(0x7f8b5015a850 0x7f8b5006cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 -- 172.21.15.33:0/3163912746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b500c3250 msgr2=0x7f8b5015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b500c3250 0x7f8b5015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 -- 172.21.15.33:0/3163912746 >> v2:172.21.15.59:3300/0 conn(0x7f8b5015a850 msgr2=0x7f8b5006cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 --2- 172.21.15.33:0/3163912746 >> v2:172.21.15.59:3300/0 conn(0x7f8b5015a850 0x7f8b5006cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 -- 172.21.15.33:0/3163912746 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b500c37a0 con 0x7f8b50143200 2023-10-09T15:42:44.359 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.355+0000 7f8b552bb700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b50143200 0x7f8b50159dd0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c36b0 tx=0x7f8b48009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30036f6da303f2b3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b4ffff700 1 -- 172.21.15.33:0/3163912746 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800b640 con 0x7f8b50143200 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b4ffff700 1 -- 172.21.15.33:0/3163912746 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800b7a0 con 0x7f8b50143200 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b4ffff700 1 -- 172.21.15.33:0/3163912746 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800bb60 con 0x7f8b50143200 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 -- 172.21.15.33:0/3163912746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b50143200 msgr2=0x7f8b50159dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b50143200 0x7f8b50159dd0 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7f8b500c36b0 tx=0x7f8b48009250 comp rx=0 tx=0).stop 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 -- 172.21.15.33:0/3163912746 shutdown_connections 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 --2- 172.21.15.33:0/3163912746 >> v2:172.21.15.59:3300/0 conn(0x7f8b5015a850 0x7f8b5006cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.360 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b50143200 0x7f8b50159dd0 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 --2- 172.21.15.33:0/3163912746 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b500c3250 0x7f8b5015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 -- 172.21.15.33:0/3163912746 >> 172.21.15.33:0/3163912746 conn(0x7f8b500ccb60 msgr2=0x7f8b500ccf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 -- 172.21.15.33:0/3163912746 shutdown_connections 2023-10-09T15:42:44.361 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.356+0000 7f8b5751f700 1 -- 172.21.15.33:0/3163912746 wait complete. 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.357+0000 7f8b5751f700 1 Processor -- start 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.357+0000 7f8b5751f700 1 -- start start 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b50143200 0x7f8b501699b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b5015a850 0x7f8b50169ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.364 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5015b3a0 con 0x7f8b500c3250 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50139ef0 con 0x7f8b5015a850 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b5751f700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b50139040 con 0x7f8b50143200 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b552bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b552bb700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60426/0 (socket says 172.21.15.33:60426) 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b552bb700 1 -- 172.21.15.33:0/557975985 learned_addr learned my addr 172.21.15.33:0/557975985 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b55abc700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b5015a850 0x7f8b50169ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.358+0000 7f8b54aba700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b50143200 0x7f8b501699b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 -- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b50143200 msgr2=0x7f8b501699b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.365 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b50143200 0x7f8b501699b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 -- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b5015a850 msgr2=0x7f8b50169ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b5015a850 0x7f8b50169ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 -- 172.21.15.33:0/557975985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b480094f0 con 0x7f8b500c3250 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b552bb700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8b50069bb0 tx=0x7f8b48017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b4800b910 con 0x7f8b500c3250 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b4800ba70 con 0x7f8b500c3250 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b48011630 con 0x7f8b500c3250 2023-10-09T15:42:44.366 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b501392e0 con 0x7f8b500c3250 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.359+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b50139920 con 0x7f8b500c3250 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.360+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5004c3c0 con 0x7f8b500c3250 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.360+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8b480119a0 con 0x7f8b500c3250 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.361+0000 7f8b4d7fa700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 0x7f8b3c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.361+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f8b48086040 con 0x7f8b500c3250 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.361+0000 7f8b54aba700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 0x7f8b3c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:44.367 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.361+0000 7f8b54aba700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 0x7f8b3c0697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8b500cc890 tx=0x7f8b440091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:44.368 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.365+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f8b480b75a0 con 0x7f8b500c3250 2023-10-09T15:42:44.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.637+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]} v 0) v1 -- 0x7f8b50139c40 con 0x7f8b500c3250 2023-10-09T15:42:44.862 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.861+0000 7f8b4d7fa700 1 -- 172.21.15.33:0/557975985 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestVolumes.test_volume_rm"]}]=0 v564) v1 ==== 131+0+0 (secure 0 0 0) 0x7f8b48052fd0 con 0x7f8b500c3250 2023-10-09T15:42:44.864 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 msgr2=0x7f8b3c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 0x7f8b3c0697d0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f8b500cc890 tx=0x7f8b440091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 msgr2=0x7f8b5015ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f8b50069bb0 tx=0x7f8b48017000 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 shutdown_connections 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8b3c067320 0x7f8b3c0697d0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f8b500c3250 0x7f8b5015ae60 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8b5015a850 0x7f8b50169ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 --2- 172.21.15.33:0/557975985 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8b50143200 0x7f8b501699b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:44.865 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 >> 172.21.15.33:0/557975985 conn(0x7f8b500ccb60 msgr2=0x7f8b5015fba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 shutdown_connections 2023-10-09T15:42:44.866 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:44.863+0000 7f8b5751f700 1 -- 172.21.15.33:0/557975985 wait complete. 2023-10-09T15:42:44.879 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used ... ERROR 2023-10-09T15:42:44.879 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T15:42:44.880 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.881 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T15:42:44.882 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:Ran 12 tests in 673.860s 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:FAILED (errors=1) 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:====================================================================== 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:ERROR: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:That the volume can only be removed when --yes-i-really-mean-it is used 2023-10-09T15:42:44.883 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 497, in test_volume_rm 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname) 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T15:42:44.884 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 1: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs' 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner:During handling of the above exception, another exception occurred: 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner:Traceback (most recent call last): 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 503, in test_volume_rm 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: self._fs_cmd("volume", "rm", self.volname, "--yes-i-really-mean-it") 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs/test_volumes.py", line 38, in _fs_cmd 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: return self.mgr_cluster.mon_manager.raw_cluster_cmd("fs", *args) 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1624, in raw_cluster_cmd 2023-10-09T15:42:44.885 INFO:tasks.cephfs_test_runner: return self.run_cluster_cmd(**kwargs).stdout.getvalue() 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/ceph_manager.py", line 1615, in run_cluster_cmd 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: return self.controller.run(**kwargs) 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/remote.py", line 522, in run 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: r = self._runner(client=self.ssh, name=self.shortname, **kwargs) 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 455, in run 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: r.wait() 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 161, in wait 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: self._raise_for_status() 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/orchestra/run.py", line 181, in _raise_for_status 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: raise CommandFailedError( 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner:teuthology.exceptions.CommandFailedError: Command failed on smithi033 with status 124: 'sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm cephfs --yes-i-really-mean-it' 2023-10-09T15:42:44.886 INFO:tasks.cephfs_test_runner: 2023-10-09T15:42:44.887 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:42:44.952 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=3fcab2763d2341a8b26974439a625097 Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_54e62bcbac4e53d9685e08328b790d3b20d71cae/teuthology/run_tasks.py", line 109, in run_tasks manager.__enter__() File "/usr/lib/python3.8/contextlib.py", line 113, in __enter__ return next(self.gen) File "/home/teuthworker/src/git.ceph.com_ceph-c_08cac0187919fc3a247efdf445f652e2fb30a647/qa/tasks/cephfs_test_runner.py", line 211, in task raise RuntimeError("Test failure: {0}".format(", ".join(bad_tests))) RuntimeError: Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes) 2023-10-09T15:42:44.954 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-10-09T15:42:44.963 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2023-10-09T15:42:45.022 INFO:tasks.kclient:Unmounting kernel clients... 2023-10-09T15:42:45.022 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.023 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:42:45.050 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-10-09T15:42:45.050 INFO:teuthology.orchestra.run.smithi033.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-10-09T15:42:45.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.050 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-10-09T15:42:45.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.128 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-10-09T15:42:45.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.210 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-09T15:42:45.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.303 DEBUG:teuthology.orchestra.run.smithi033:> ip netns list 2023-10-09T15:42:45.319 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.319 DEBUG:teuthology.orchestra.run.smithi033:> sudo ip link delete ceph-brx 2023-10-09T15:42:45.387 INFO:teuthology.orchestra.run.smithi033.stderr:Cannot find device "ceph-brx" 2023-10-09T15:42:45.388 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:42:45.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.388 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:42:45.407 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-10-09T15:42:45.407 INFO:teuthology.orchestra.run.smithi059.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-10-09T15:42:45.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.407 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-10-09T15:42:45.491 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.491 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-10-09T15:42:45.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.566 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-09T15:42:45.664 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.664 DEBUG:teuthology.orchestra.run.smithi059:> ip netns list 2023-10-09T15:42:45.680 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-10-09T15:42:45.680 DEBUG:teuthology.orchestra.run.smithi059:> sudo ip link delete ceph-brx 2023-10-09T15:42:45.750 INFO:teuthology.orchestra.run.smithi059.stderr:Cannot find device "ceph-brx" 2023-10-09T15:42:45.752 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:42:45.752 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-10-09T15:42:45.762 INFO:tasks.ceph.ceph_manager.ceph:Canceling any pending splits or merges... 2023-10-09T15:42:45.762 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:42:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.884+0000 7f9e79d92700 1 Processor -- start 2023-10-09T15:42:45.885 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.884+0000 7f9e79d92700 1 -- start start 2023-10-09T15:42:45.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e79d92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 0x7f9e740adfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:45.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e79d92700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e740adb20 con 0x7f9e74159c20 2023-10-09T15:42:45.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e79d92700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e740acf10 con 0x7f9e740b1040 2023-10-09T15:42:45.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e79d92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740ccdc0 con 0x7f9e74159850 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e72ffd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f9e74159c20 0x7f9e740b0930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56556/0 (socket says 172.21.15.33:56556) 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.885+0000 7f9e72ffd700 1 -- 172.21.15.33:0/937262454 learned_addr learned my addr 172.21.15.33:0/937262454 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e737fe700 1 --2- 172.21.15.33:0/937262454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 0x7f9e740adfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1900111595 0 0) 0x7f9e740adb20 con 0x7f9e74159c20 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e5c003570 con 0x7f9e74159c20 2023-10-09T15:42:45.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3539780173 0 0) 0x7f9e740acf10 con 0x7f9e740b1040 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e740adb20 con 0x7f9e740b1040 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e737fe700 1 -- 172.21.15.33:0/937262454 >> v1:172.21.15.59:6789/0 conn(0x7f9e740b1040 legacy=0x7f9e740c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e737fe700 1 -- 172.21.15.33:0/937262454 >> v1:172.21.15.33:6789/0 conn(0x7f9e74159c20 legacy=0x7f9e740b0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e737fe700 1 -- 172.21.15.33:0/937262454 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e740ad1f0 con 0x7f9e74159850 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e737fe700 1 --2- 172.21.15.33:0/937262454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 0x7f9e740adfb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009910 tx=0x7f9e640091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b7cf2ed62702c30 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64011630 con 0x7f9e74159850 2023-10-09T15:42:45.890 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e64011790 con 0x7f9e74159850 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.886+0000 7f9e727fc700 1 -- 172.21.15.33:0/937262454 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e64011b30 con 0x7f9e74159850 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 -- 172.21.15.33:0/937262454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 msgr2=0x7f9e740adfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 --2- 172.21.15.33:0/937262454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 0x7f9e740adfb0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009910 tx=0x7f9e640091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 -- 172.21.15.33:0/937262454 shutdown_connections 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 --2- 172.21.15.33:0/937262454 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e74159850 0x7f9e740adfb0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 -- 172.21.15.33:0/937262454 >> 172.21.15.33:0/937262454 conn(0x7f9e7406d170 msgr2=0x7f9e740cc300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 -- 172.21.15.33:0/937262454 shutdown_connections 2023-10-09T15:42:45.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.887+0000 7f9e79d92700 1 -- 172.21.15.33:0/937262454 wait complete. 2023-10-09T15:42:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.888+0000 7f9e79d92700 1 Processor -- start 2023-10-09T15:42:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.888+0000 7f9e79d92700 1 -- start start 2023-10-09T15:42:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 0x7f9e74150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e74159850 0x7f9e7416a8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:45.894 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740aa670 con 0x7f9e74159c20 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e7416ae10 con 0x7f9e74159850 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e79d92700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e740a9a60 con 0x7f9e740b1040 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60432/0 (socket says 172.21.15.33:60432) 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 -- 172.21.15.33:0/2152520740 learned_addr learned my addr 172.21.15.33:0/2152520740 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e737fe700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 0x7f9e74150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:45.895 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e72ffd700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e74159850 0x7f9e7416a8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 -- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 msgr2=0x7f9e74150d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 0x7f9e74150d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 -- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e74159850 msgr2=0x7f9e7416a8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e74159850 0x7f9e7416a8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e73fff700 1 -- 172.21.15.33:0/2152520740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e64009420 con 0x7f9e74159c20 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.889+0000 7f9e737fe700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 0x7f9e74150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:45.896 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e73fff700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00c910 tx=0x7f9e6c002720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00ce50 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e740a9d40 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e6c00a7e0 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e6c00aba0 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.890+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e740aa300 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.891+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e7404c3c0 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.891+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f9e6c012420 con 0x7f9e74159c20 2023-10-09T15:42:45.897 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.892+0000 7f9e5b7fe700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.892+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f9e6c084e20 con 0x7f9e74159c20 2023-10-09T15:42:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.892+0000 7f9e737fe700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.892+0000 7f9e737fe700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 0x7f9e600697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009860 tx=0x7f9e64017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:45.898 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:45.896+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9e6c051db0 con 0x7f9e74159c20 2023-10-09T15:42:46.091 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.090+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e740aa7b0 con 0x7f9e74159c20 2023-10-09T15:42:46.092 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.091+0000 7f9e5b7fe700 1 -- 172.21.15.33:0/2152520740 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+12225 (secure 0 0 0) 0x7f9e6c016090 con 0x7f9e74159c20 2023-10-09T15:42:46.092 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:46.092 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":205,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:42:43.854153+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6837/3266537603":"2023-10-10T15:42:40.849232+0000","172.21.15.33:6835/3266537603":"2023-10-10T15:42:40.849232+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:42:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.092+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 msgr2=0x7f9e600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.092+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 0x7f9e600697d0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f9e64009860 tx=0x7f9e64017000 comp rx=0 tx=0).stop 2023-10-09T15:42:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.092+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 msgr2=0x7f9e740c9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.094 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.092+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 secure :-1 s=READY pgs=1828 cs=0 l=1 rev1=1 crypto rx=0x7f9e6c00c910 tx=0x7f9e6c002720 comp rx=0 tx=0).stop 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 shutdown_connections 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9e60067320 0x7f9e600697d0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f9e74159c20 0x7f9e740c9df0 unknown :-1 s=CLOSED pgs=1828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9e740b1040 0x7f9e74150d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 --2- 172.21.15.33:0/2152520740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f9e74159850 0x7f9e7416a8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 >> 172.21.15.33:0/2152520740 conn(0x7f9e7406d170 msgr2=0x7f9e7406a5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 shutdown_connections 2023-10-09T15:42:46.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.093+0000 7f9e79d92700 1 -- 172.21.15.33:0/2152520740 wait complete. 2023-10-09T15:42:46.106 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-10-09T15:42:46.106 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:42:46.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.224+0000 7f6b2759e700 1 Processor -- start 2023-10-09T15:42:46.225 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.224+0000 7f6b2759e700 1 -- start start 2023-10-09T15:42:46.227 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b2759e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f6b2815de50 0x7f6b280cea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b2759e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b280cef40 0x7f6b2815c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b2759e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b280cf3c0 con 0x7f6b28153c30 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b2759e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2815afd0 con 0x7f6b280cef40 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b2759e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b2815b2b0 con 0x7f6b2815de50 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b280cef40 0x7f6b2815c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f6b280cef40 0x7f6b2815c070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60442/0 (socket says 172.21.15.33:60442) 2023-10-09T15:42:46.228 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 -- 172.21.15.33:0/23148747 learned_addr learned my addr 172.21.15.33:0/23148747 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b25d9b700 1 --2- 172.21.15.33:0/23148747 >> v2:172.21.15.59:3300/0 conn(0x7f6b2815de50 0x7f6b280cea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 -- 172.21.15.33:0/23148747 >> v2:172.21.15.59:3300/0 conn(0x7f6b2815de50 msgr2=0x7f6b280cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 --2- 172.21.15.33:0/23148747 >> v2:172.21.15.59:3300/0 conn(0x7f6b2815de50 0x7f6b280cea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 -- 172.21.15.33:0/23148747 >> v1:172.21.15.59:6789/0 conn(0x7f6b28153c30 legacy=0x7f6b2815a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.229 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.225+0000 7f6b26d9d700 1 -- 172.21.15.33:0/23148747 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b2815b590 con 0x7f6b280cef40 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b26d9d700 1 --2- 172.21.15.33:0/23148747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b280cef40 0x7f6b2815c070 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f6b280713a0 tx=0x7f6b20009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ec320ea9e5a3de server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2559a700 1 -- 172.21.15.33:0/23148747 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b2000e070 con 0x7f6b280cef40 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2559a700 1 -- 172.21.15.33:0/23148747 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b2000ba50 con 0x7f6b280cef40 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2559a700 1 -- 172.21.15.33:0/23148747 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b200092e0 con 0x7f6b280cef40 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 -- 172.21.15.33:0/23148747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b280cef40 msgr2=0x7f6b2815c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 --2- 172.21.15.33:0/23148747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b280cef40 0x7f6b2815c070 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f6b280713a0 tx=0x7f6b20009840 comp rx=0 tx=0).stop 2023-10-09T15:42:46.230 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 -- 172.21.15.33:0/23148747 shutdown_connections 2023-10-09T15:42:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 --2- 172.21.15.33:0/23148747 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b280cef40 0x7f6b2815c070 unknown :-1 s=CLOSED pgs=1829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 --2- 172.21.15.33:0/23148747 >> v2:172.21.15.59:3300/0 conn(0x7f6b2815de50 0x7f6b280cea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 -- 172.21.15.33:0/23148747 >> 172.21.15.33:0/23148747 conn(0x7f6b280703a0 msgr2=0x7f6b280707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 -- 172.21.15.33:0/23148747 shutdown_connections 2023-10-09T15:42:46.231 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.226+0000 7f6b2759e700 1 -- 172.21.15.33:0/23148747 wait complete. 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.227+0000 7f6b2759e700 1 Processor -- start 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.227+0000 7f6b2759e700 1 -- start start 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b280cef40 0x7f6b280c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2815de50 0x7f6b28169aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.234 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280cb110 con 0x7f6b28153c30 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b5930 con 0x7f6b280cef40 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2759e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b280b5ba0 con 0x7f6b2815de50 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b25d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60448/0 (socket says 172.21.15.33:60448) 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b25d9b700 1 -- 172.21.15.33:0/1459732667 learned_addr learned my addr 172.21.15.33:0/1459732667 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b2659c700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b280cef40 0x7f6b280c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.228+0000 7f6b26d9d700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2815de50 0x7f6b28169aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.235 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 -- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2815de50 msgr2=0x7f6b28169aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2815de50 0x7f6b28169aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 -- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b280cef40 msgr2=0x7f6b280c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b280cef40 0x7f6b280c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 -- 172.21.15.33:0/1459732667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b20009ae0 con 0x7f6b28153c30 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b25d9b700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00d890 tx=0x7f6b1c008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.236 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c0125f0 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b1c012750 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b1c012af0 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b280b5e80 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.229+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b280b3810 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.230+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b2804c3c0 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.230+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f6b1c01e460 con 0x7f6b28153c30 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.231+0000 7f6b167fc700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 0x7f6b080697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.237 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.231+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f6b1c084f20 con 0x7f6b28153c30 2023-10-09T15:42:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.231+0000 7f6b2659c700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 0x7f6b080697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.231+0000 7f6b2659c700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 0x7f6b080697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6b180039e0 tx=0x7f6b18007ec0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.238 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.235+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f6b1c051e70 con 0x7f6b28153c30 2023-10-09T15:42:46.427 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.426+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f6b280cb250 con 0x7f6b08067320 2023-10-09T15:42:46.429 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.428+0000 7f6b167fc700 1 -- 172.21.15.33:0/1459732667 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50703 (secure 0 0 0) 0x7f6b18002690 con 0x7f6b08067320 2023-10-09T15:42:46.430 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 msgr2=0x7f6b080697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 0x7f6b080697d0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f6b180039e0 tx=0x7f6b18007ec0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.432 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 msgr2=0x7f6b280b32d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c00d890 tx=0x7f6b1c008040 comp rx=0 tx=0).stop 2023-10-09T15:42:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 shutdown_connections 2023-10-09T15:42:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f6b08067320 0x7f6b080697d0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f6b2815de50 0x7f6b28169aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.433 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f6b280cef40 0x7f6b280c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 --2- 172.21.15.33:0/1459732667 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f6b28153c30 0x7f6b280b32d0 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 >> 172.21.15.33:0/1459732667 conn(0x7f6b280703a0 msgr2=0x7f6b280c5760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 shutdown_connections 2023-10-09T15:42:46.434 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.430+0000 7f6b2759e700 1 -- 172.21.15.33:0/1459732667 wait complete. 2023-10-09T15:42:46.435 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:42:46.443 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2023-10-09T15:42:45.383596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432464,"kb_used_data":21392,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542256,"statfs":{"total":773094113280,"available":770603270144,"internally_reserved":0,"allocated":21905408,"data_stored":10525477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001733"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-10-09T15:42:41.433872+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:42:41.433872+0000","last_peered":"2023-10-09T15:42:41.433872+0000","last_clean":"2023-10-09T15:42:41.433872+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:42:41.433872+0000","last_undegraded":"2023-10-09T15:42:41.433872+0000","last_fullsized":"2023-10-09T15:42:41.433872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1756772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.371},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.85199999999999998,"15min":0.874},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.96999999999999997,"15min":0.97099999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":1.288,"15min":1.288},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.443,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":1.379},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.504,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85799999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":1.3999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58299999999999996,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.3419999999999996},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.84999999999999998,"15min":1.3560000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73599999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067928,"statfs":{"total":96636764160,"available":96325558272,"internally_reserved":0,"allocated":2588672,"data_stored":1165952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35199999999999998},"min":{"1min":0.254,"5min":0.224,"15min":0.215},"max":{"1min":0.72399999999999998,"5min":1.415,"15min":1.415},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.372,"15min":0.374},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.512},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.221},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.286},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.65600000000000003,"5min":1.077,"15min":1.077},"last":0.443},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.437},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":1.0469999999999999,"15min":1.222},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4410000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.57499999999999996,"5min":0.41299999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2310000000000001,"15min":1.258},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.55600000000000005,"5min":0.42499999999999999,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":1.218,"15min":1.218},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41999999999999998,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1859999999999999,"15min":5.5819999999999999},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304484,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067356,"statfs":{"total":96636764160,"available":96324972544,"internally_reserved":0,"allocated":3174400,"data_stored":1755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":2.1520000000000001},"last":0.251},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":2.0859999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.40999999999999998},"min":{"1min":0.316,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.52900000000000003,"5min":0.89600000000000002,"15min":6.484},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":0.65100000000000002,"15min":6.2859999999999996},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38900000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":4.5190000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.53200000000000003},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":4.5890000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.921},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.93100000000000005,"15min":1.508},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":1.0509999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":4.1020000000000003},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.56000000000000005,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0960000000000001,"15min":3.9009999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.59499999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.98599999999999999,"15min":1.9810000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.032},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.56999999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.69799999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.375,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.627,"5min":0.67600000000000005,"15min":0.73699999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.624,"5min":0.628,"15min":0.67500000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.34999999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":2.5249999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95899999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.407},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.318,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51000000000000001,"5min":0.58099999999999996,"15min":1.2270000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.62},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":17.085999999999999},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.40200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":1.3049999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.86799999999999999},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.247},"max":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45300000000000001,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.83999999999999997},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.32000000000000001},"max":{"1min":0.81200000000000006,"5min":0.996,"15min":17.02},"last":0.436},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56100000000000005,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.92400000000000004,"5min":0.98399999999999999,"15min":9.6969999999999992},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.878,"5min":0.96299999999999997,"15min":5.3460000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66800000000000004,"15min":0.871},"min":{"1min":0.54800000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.92100000000000004,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89200000000000002,"5min":0.999,"15min":9.7319999999999993},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.016,"15min":1.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.90700000000000003},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":17.053999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95499999999999996,"5min":1.024,"15min":9.6029999999999998},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.875,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":2.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.498,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":1.3580000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.751,"5min":1.089,"15min":1.089},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.879,"5min":1.222,"15min":1.222},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83699999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.202,"15min":1.202},"last":0.85599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.87},"last":0.624},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.45000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":1.165},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":2.089},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56000000000000005,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":11.055},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.74299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":11.092000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.748},"min":{"1min":0.504,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.82199999999999995,"15min":1.0569999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:42:46.445 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:42:46.564 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.563+0000 7f727a230700 1 Processor -- start 2023-10-09T15:42:46.565 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.563+0000 7f727a230700 1 -- start start 2023-10-09T15:42:46.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f727a230700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f7274159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.567 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f727a230700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f727415a400 0x7f7274156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f727a230700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f727415ae40 con 0x7f72740cb5a0 2023-10-09T15:42:46.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f727a230700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72740ce0f0 con 0x7f727415a400 2023-10-09T15:42:46.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f727a230700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72740cbde0 con 0x7f72740cb970 2023-10-09T15:42:46.568 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f7273fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f727415a400 0x7f7274156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f7273fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f727415a400 0x7f7274156e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60452/0 (socket says 172.21.15.33:60452) 2023-10-09T15:42:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.564+0000 7f7273fff700 1 -- 172.21.15.33:0/2123881591 learned_addr learned my addr 172.21.15.33:0/2123881591 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7272ffd700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f7274159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7273fff700 1 -- 172.21.15.33:0/2123881591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 msgr2=0x7f7274159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:46.569 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7273fff700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f7274159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7273fff700 1 -- 172.21.15.33:0/2123881591 >> v1:172.21.15.59:6789/0 conn(0x7f72740cb5a0 legacy=0x7f72740cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:46.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7273fff700 1 -- 172.21.15.33:0/2123881591 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f727415ab60 con 0x7f727415a400 2023-10-09T15:42:46.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f7273fff700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f727415a400 0x7f7274156e90 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f726c009f50 tx=0x7f726c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3efa2896371582e7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.570 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f72727fc700 1 -- 172.21.15.33:0/2123881591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c00e070 con 0x7f727415a400 2023-10-09T15:42:46.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f72727fc700 1 -- 172.21.15.33:0/2123881591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726c00ba30 con 0x7f727415a400 2023-10-09T15:42:46.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f72727fc700 1 -- 172.21.15.33:0/2123881591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726c0092e0 con 0x7f727415a400 2023-10-09T15:42:46.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 -- 172.21.15.33:0/2123881591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f727415a400 msgr2=0x7f7274156e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.571 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f727415a400 0x7f7274156e90 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f726c009f50 tx=0x7f726c009840 comp rx=0 tx=0).stop 2023-10-09T15:42:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 -- 172.21.15.33:0/2123881591 shutdown_connections 2023-10-09T15:42:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f727415a400 0x7f7274156e90 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 --2- 172.21.15.33:0/2123881591 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f7274159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 -- 172.21.15.33:0/2123881591 >> 172.21.15.33:0/2123881591 conn(0x7f7274070e30 msgr2=0x7f72740d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.572 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 -- 172.21.15.33:0/2123881591 shutdown_connections 2023-10-09T15:42:46.573 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.565+0000 7f727a230700 1 -- 172.21.15.33:0/2123881591 wait complete. 2023-10-09T15:42:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.567+0000 7f727a230700 1 Processor -- start 2023-10-09T15:42:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.567+0000 7f727a230700 1 -- start start 2023-10-09T15:42:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f72741548f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.576 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f727415a400 0x7f72740b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727415c6b0 con 0x7f72740cb5a0 2023-10-09T15:42:46.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f727416ee00 con 0x7f727415a400 2023-10-09T15:42:46.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f727415bd80 con 0x7f72740cb970 2023-10-09T15:42:46.577 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60464/0 (socket says 172.21.15.33:60464) 2023-10-09T15:42:46.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 -- 172.21.15.33:0/2939671820 learned_addr learned my addr 172.21.15.33:0/2939671820 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:46.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f7272ffd700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f72741548f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.578 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f7273fff700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f727415a400 0x7f72740b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 -- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 msgr2=0x7f72741548f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f72741548f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 -- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f727415a400 msgr2=0x7f72740b3a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f727415a400 0x7f72740b3a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.579 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 -- 172.21.15.33:0/2939671820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f726c009ae0 con 0x7f72740cb5a0 2023-10-09T15:42:46.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f72737fe700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f726400b5e0 tx=0x7f7264009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400f510 con 0x7f72740cb5a0 2023-10-09T15:42:46.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f726400f670 con 0x7f72740cb5a0 2023-10-09T15:42:46.580 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f727415c060 con 0x7f72740cb5a0 2023-10-09T15:42:46.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f726400fa30 con 0x7f72740cb5a0 2023-10-09T15:42:46.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.568+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7274154e30 con 0x7f72740cb5a0 2023-10-09T15:42:46.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.570+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f727415c500 con 0x7f72740cb5a0 2023-10-09T15:42:46.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.570+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f726401a400 con 0x7f72740cb5a0 2023-10-09T15:42:46.581 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.570+0000 7f725b7fe700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 0x7f72600697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.570+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f72640842c0 con 0x7f72740cb5a0 2023-10-09T15:42:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.570+0000 7f7272ffd700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 0x7f72600697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.571+0000 7f7272ffd700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 0x7f72600697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f726800acb0 tx=0x7f7268008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.582 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.575+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f72640513d0 con 0x7f72740cb5a0 2023-10-09T15:42:46.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.766+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f727415c7f0 con 0x7f7260067320 2023-10-09T15:42:46.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.769+0000 7f725b7fe700 1 -- 172.21.15.33:0/2939671820 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50703 (secure 0 0 0) 0x7f726800c040 con 0x7f7260067320 2023-10-09T15:42:46.770 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:46.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 msgr2=0x7f72600697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 0x7f72600697d0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f726800acb0 tx=0x7f7268008040 comp rx=0 tx=0).stop 2023-10-09T15:42:46.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 msgr2=0x7f72741504d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f726400b5e0 tx=0x7f7264009120 comp rx=0 tx=0).stop 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 shutdown_connections 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7260067320 0x7f72600697d0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f72740cb5a0 0x7f72741504d0 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f727415a400 0x7f72740b3a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 --2- 172.21.15.33:0/2939671820 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f72740cb970 0x7f72741548f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 >> 172.21.15.33:0/2939671820 conn(0x7f7274070e30 msgr2=0x7f72740b0820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 shutdown_connections 2023-10-09T15:42:46.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.771+0000 7f727a230700 1 -- 172.21.15.33:0/2939671820 wait complete. 2023-10-09T15:42:46.774 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:42:46.784 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2023-10-09T15:42:45.383596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432464,"kb_used_data":21392,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542256,"statfs":{"total":773094113280,"available":770603270144,"internally_reserved":0,"allocated":21905408,"data_stored":10525477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001733"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-10-09T15:42:41.433872+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:42:41.433872+0000","last_peered":"2023-10-09T15:42:41.433872+0000","last_clean":"2023-10-09T15:42:41.433872+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:42:41.433872+0000","last_undegraded":"2023-10-09T15:42:41.433872+0000","last_fullsized":"2023-10-09T15:42:41.433872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1756772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.371},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.85199999999999998,"15min":0.874},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.96999999999999997,"15min":0.97099999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":1.288,"15min":1.288},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.443,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":1.379},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.504,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85799999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":1.3999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58299999999999996,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.3419999999999996},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.84999999999999998,"15min":1.3560000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73599999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067928,"statfs":{"total":96636764160,"available":96325558272,"internally_reserved":0,"allocated":2588672,"data_stored":1165952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35199999999999998},"min":{"1min":0.254,"5min":0.224,"15min":0.215},"max":{"1min":0.72399999999999998,"5min":1.415,"15min":1.415},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.372,"15min":0.374},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.512},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.221},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.286},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.65600000000000003,"5min":1.077,"15min":1.077},"last":0.443},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.437},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":1.0469999999999999,"15min":1.222},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4410000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.57499999999999996,"5min":0.41299999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2310000000000001,"15min":1.258},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.55600000000000005,"5min":0.42499999999999999,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":1.218,"15min":1.218},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41999999999999998,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1859999999999999,"15min":5.5819999999999999},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304484,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067356,"statfs":{"total":96636764160,"available":96324972544,"internally_reserved":0,"allocated":3174400,"data_stored":1755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":2.1520000000000001},"last":0.251},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":2.0859999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.40999999999999998},"min":{"1min":0.316,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.52900000000000003,"5min":0.89600000000000002,"15min":6.484},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":0.65100000000000002,"15min":6.2859999999999996},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38900000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":4.5190000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.53200000000000003},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":4.5890000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.921},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.93100000000000005,"15min":1.508},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":1.0509999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":4.1020000000000003},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.56000000000000005,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0960000000000001,"15min":3.9009999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.59499999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.98599999999999999,"15min":1.9810000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.032},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.56999999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.69799999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.375,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.627,"5min":0.67600000000000005,"15min":0.73699999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.624,"5min":0.628,"15min":0.67500000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.34999999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":2.5249999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95899999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.407},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.318,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51000000000000001,"5min":0.58099999999999996,"15min":1.2270000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.62},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":17.085999999999999},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.40200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":1.3049999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.86799999999999999},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.247},"max":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45300000000000001,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.83999999999999997},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.32000000000000001},"max":{"1min":0.81200000000000006,"5min":0.996,"15min":17.02},"last":0.436},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56100000000000005,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.92400000000000004,"5min":0.98399999999999999,"15min":9.6969999999999992},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.878,"5min":0.96299999999999997,"15min":5.3460000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66800000000000004,"15min":0.871},"min":{"1min":0.54800000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.92100000000000004,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89200000000000002,"5min":0.999,"15min":9.7319999999999993},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.016,"15min":1.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.90700000000000003},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":17.053999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95499999999999996,"5min":1.024,"15min":9.6029999999999998},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.875,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":2.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.498,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":1.3580000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.751,"5min":1.089,"15min":1.089},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.879,"5min":1.222,"15min":1.222},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83699999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.202,"15min":1.202},"last":0.85599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.87},"last":0.624},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.45000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":1.165},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":2.089},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56000000000000005,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":11.055},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.74299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":11.092000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.748},"min":{"1min":0.504,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.82199999999999995,"15min":1.0569999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:42:46.786 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-10-09T15:42:46.786 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:42:46.905 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.904+0000 7f5c6e7d8700 1 Processor -- start 2023-10-09T15:42:46.906 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.904+0000 7f5c6e7d8700 1 -- start start 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6e7d8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5c680aee90 0x7f5c680a8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6e7d8700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680ce1a0 con 0x7f5c6806d280 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6e7d8700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c680cd5d0 con 0x7f5c680a8be0 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6e7d8700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c680cd870 con 0x7f5c680aee90 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c677fe700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f5c680aee90 0x7f5c680a8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6cd75700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f5c6806d280 0x7f5c680b1490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56562/0 (socket says 172.21.15.33:56562) 2023-10-09T15:42:46.908 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.905+0000 7f5c6cd75700 1 -- 172.21.15.33:0/3725596413 learned_addr learned my addr 172.21.15.33:0/3725596413 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c677fe700 1 -- 172.21.15.33:0/3725596413 >> v1:172.21.15.59:6789/0 conn(0x7f5c680a8be0 legacy=0x7f5c680ae780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c677fe700 1 -- 172.21.15.33:0/3725596413 >> v1:172.21.15.33:6789/0 conn(0x7f5c6806d280 legacy=0x7f5c680b1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c677fe700 1 -- 172.21.15.33:0/3725596413 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c680cdb50 con 0x7f5c680aee90 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c677fe700 1 --2- 172.21.15.33:0/3725596413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c680aee90 0x7f5c680a8fb0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0098d0 tx=0x7f5c5c009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e657c45d7ee7120 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c66ffd700 1 -- 172.21.15.33:0/3725596413 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c009e70 con 0x7f5c680aee90 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c66ffd700 1 -- 172.21.15.33:0/3725596413 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c5c005c10 con 0x7f5c680aee90 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.906+0000 7f5c66ffd700 1 -- 172.21.15.33:0/3725596413 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c5c00b6e0 con 0x7f5c680aee90 2023-10-09T15:42:46.909 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/3725596413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c680aee90 msgr2=0x7f5c680a8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/3725596413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c680aee90 0x7f5c680a8fb0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f5c5c0098d0 tx=0x7f5c5c009120 comp rx=0 tx=0).stop 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/3725596413 shutdown_connections 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/3725596413 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c680aee90 0x7f5c680a8fb0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/3725596413 >> 172.21.15.33:0/3725596413 conn(0x7f5c6806ce80 msgr2=0x7f5c680ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/3725596413 shutdown_connections 2023-10-09T15:42:46.910 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.907+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/3725596413 wait complete. 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.908+0000 7f5c6e7d8700 1 Processor -- start 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.908+0000 7f5c6e7d8700 1 -- start start 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 0x7f5c68156920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c680aee90 0x7f5c68156e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c681573a0 con 0x7f5c6806d280 2023-10-09T15:42:46.913 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6816a010 con 0x7f5c680a8be0 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c6816a2f0 con 0x7f5c680aee90 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60470/0 (socket says 172.21.15.33:60470) 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 -- 172.21.15.33:0/1449956250 learned_addr learned my addr 172.21.15.33:0/1449956250 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6cd75700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c680aee90 0x7f5c68156e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c677fe700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 0x7f5c68156920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 -- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c680aee90 msgr2=0x7f5c68156e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.914 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c680aee90 0x7f5c68156e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 -- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 msgr2=0x7f5c68156920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 0x7f5c68156920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 -- 172.21.15.33:0/1449956250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c5c0093c0 con 0x7f5c6806d280 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c677fe700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 0x7f5c68156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c67fff700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c7c0 tx=0x7f5c58007f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58011590 con 0x7f5c6806d280 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c58011710 con 0x7f5c6806d280 2023-10-09T15:42:46.915 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c6816a5d0 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c58011ad0 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.909+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c6816ac10 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.910+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c6816ada0 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.911+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f5c5801b3b0 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.911+0000 7f5c4ffff700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 0x7f5c540697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.912+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f5c58083dc0 con 0x7f5c6806d280 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.912+0000 7f5c677fe700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 0x7f5c540697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:46.916 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.912+0000 7f5c677fe700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 0x7f5c540697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5c680af290 tx=0x7f5c5c016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:46.917 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:46.916+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f5c58050e00 con 0x7f5c6806d280 2023-10-09T15:42:47.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.106+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5c6804c3c0 con 0x7f5c54067320 2023-10-09T15:42:47.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.108+0000 7f5c4ffff700 1 -- 172.21.15.33:0/1449956250 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50703 (secure 0 0 0) 0x7f5c6804c3c0 con 0x7f5c54067320 2023-10-09T15:42:47.110 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:47.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 msgr2=0x7f5c540697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 0x7f5c540697d0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f5c680af290 tx=0x7f5c5c016000 comp rx=0 tx=0).stop 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 msgr2=0x7f5c68159d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7f5c5800c7c0 tx=0x7f5c58007f70 comp rx=0 tx=0).stop 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 shutdown_connections 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f5c54067320 0x7f5c540697d0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f5c6806d280 0x7f5c68159d50 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f5c680aee90 0x7f5c68156e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 --2- 172.21.15.33:0/1449956250 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f5c680a8be0 0x7f5c68156920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 >> 172.21.15.33:0/1449956250 conn(0x7f5c6806ce80 msgr2=0x7f5c680b39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:47.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 shutdown_connections 2023-10-09T15:42:47.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.110+0000 7f5c6e7d8700 1 -- 172.21.15.33:0/1449956250 wait complete. 2023-10-09T15:42:47.113 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:42:47.123 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":554,"stamp":"2023-10-09T15:42:45.383596+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":190,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":2432464,"kb_used_data":21392,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542256,"statfs":{"total":773094113280,"available":770603270144,"internally_reserved":0,"allocated":21905408,"data_stored":10525477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-4067,"num_objects":-22,"num_object_clones":0,"num_object_copies":-44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":-49,"num_write_kb":-18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001733"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":318,"reported_epoch":203,"state":"active+clean","last_fresh":"2023-10-09T15:42:41.433872+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:42:41.433872+0000","last_peered":"2023-10-09T15:42:41.433872+0000","last_clean":"2023-10-09T15:42:41.433872+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:42:41.433872+0000","last_undegraded":"2023-10-09T15:42:41.433872+0000","last_fullsized":"2023-10-09T15:42:41.433872+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574994,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304492,"kb_used_data":3108,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067348,"statfs":{"total":96636764160,"available":96324964352,"internally_reserved":0,"allocated":3182592,"data_stored":1756772,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.371},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.47499999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.85199999999999998,"15min":0.874},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.42599999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86699999999999999},"last":0.64300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.495,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.61599999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"last":0.65800000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.96999999999999997,"15min":0.97099999999999997},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":1.288,"15min":1.288},"last":0.68600000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574994,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.443,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.90400000000000003},"last":0.54100000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":1.379},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.504,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85799999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.48899999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":1.3999999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58299999999999996,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.3419999999999996},"last":0.47399999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.84999999999999998,"15min":1.3560000000000001},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.60699999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73599999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.59099999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.57499999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.004},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.68600000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574995,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303912,"kb_used_data":2528,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067928,"statfs":{"total":96636764160,"available":96325558272,"internally_reserved":0,"allocated":2588672,"data_stored":1165952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35199999999999998},"min":{"1min":0.254,"5min":0.224,"15min":0.215},"max":{"1min":0.72399999999999998,"5min":1.415,"15min":1.415},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.372,"15min":0.374},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.512},"last":0.36499999999999999}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.221},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.286},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.40400000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.65600000000000003,"5min":1.077,"15min":1.077},"last":0.443},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.437},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.47599999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":1.0469999999999999,"15min":1.222},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.49099999999999999}]},{"osd":5,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4410000000000001},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.45400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.57499999999999996,"5min":0.41299999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2310000000000001,"15min":1.258},"last":0.58399999999999996}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.55600000000000005,"5min":0.42499999999999999,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":1.218,"15min":1.218},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41999999999999998,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1859999999999999,"15min":5.5819999999999999},"last":0.63300000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574993,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304484,"kb_used_data":3100,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067356,"statfs":{"total":96636764160,"available":96324972544,"internally_reserved":0,"allocated":3174400,"data_stored":1755255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":2.1520000000000001},"last":0.251},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":2.0859999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.40999999999999998},"min":{"1min":0.316,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.52900000000000003,"5min":0.89600000000000002,"15min":6.484},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":0.65100000000000002,"15min":6.2859999999999996},"last":0.36199999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38900000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":4.5190000000000001},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.53200000000000003},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":4.5890000000000004},"last":0.38700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.921},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.93100000000000005,"15min":1.508},"last":0.67100000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":1.0509999999999999},"last":0.64200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":4.1020000000000003},"last":0.65100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.56000000000000005,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0960000000000001,"15min":3.9009999999999998},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.59499999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.98599999999999999,"15min":1.9810000000000001},"last":0.60899999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.032},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.56999999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.68999999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574994,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.69799999999999995},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.36299999999999999}]},{"osd":1,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.375,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.627,"5min":0.67600000000000005,"15min":0.73699999999999999},"last":0.46899999999999997}]},{"osd":3,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.624,"5min":0.628,"15min":0.67500000000000004},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.48599999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.63800000000000001},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.77300000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.34999999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":2.5249999999999999},"last":0.61599999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95899999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.59299999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.407},"last":0.81499999999999995},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.64700000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303908,"kb_used_data":2524,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067932,"statfs":{"total":96636764160,"available":96325562368,"internally_reserved":0,"allocated":2584576,"data_stored":1165918,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.318,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51000000000000001,"5min":0.58099999999999996,"15min":1.2270000000000001},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.62},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":17.085999999999999},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.495,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.40200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":1.3049999999999999},"last":0.34499999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.86799999999999999},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.247},"max":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45300000000000001,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.42699999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.83999999999999997},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.32000000000000001},"max":{"1min":0.81200000000000006,"5min":0.996,"15min":17.02},"last":0.436},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56100000000000005,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.92400000000000004,"5min":0.98399999999999999,"15min":9.6969999999999992},"last":0.52000000000000002}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.878,"5min":0.96299999999999997,"15min":5.3460000000000001},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66800000000000004,"15min":0.871},"min":{"1min":0.54800000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.92100000000000004,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.56100000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89200000000000002,"5min":0.999,"15min":9.7319999999999993},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.016,"15min":1.278},"last":0.50600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.90700000000000003},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":17.053999999999998},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95499999999999996,"5min":1.024,"15min":9.6029999999999998},"last":0.626}]}]},{"osd":4,"up_from":13,"seq":55834574993,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.875,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":2.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.498,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":1.3580000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.751,"5min":1.089,"15min":1.089},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.879,"5min":1.222,"15min":1.222},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83699999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.202,"15min":1.202},"last":0.85599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574994,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":303920,"kb_used_data":2536,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067920,"statfs":{"total":96636764160,"available":96325550080,"internally_reserved":0,"allocated":2596864,"data_stored":1171906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.87},"last":0.624},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.45000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":1.165},"last":0.57899999999999996}]},{"osd":1,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":2.089},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.47799999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56000000000000005,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":11.055},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.74299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":11.092000000000001},"last":0.52800000000000002}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.748},"min":{"1min":0.504,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.65500000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.5,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.82199999999999995,"15min":1.0569999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.75800000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.77600000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.747}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:42:47.125 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-10-09T15:42:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.243+0000 7fc2c8a76700 1 Processor -- start 2023-10-09T15:42:47.244 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.243+0000 7fc2c8a76700 1 -- start start 2023-10-09T15:42:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c8a76700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc2c40cb5a0 0x7fc2c40cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c8a76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40cd9e0 0x7fc2c4159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c8a76700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2c415ae40 con 0x7fc2c40cde50 2023-10-09T15:42:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c8a76700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2c40d13f0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.247 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c8a76700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c415ab60 con 0x7fc2c40cd9e0 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c259c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc2c40cb5a0 0x7fc2c40cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c2d9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc2c40cde50 0x7fc2c4156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56572/0 (socket says 172.21.15.33:56572) 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c2d9d700 1 -- 172.21.15.33:0/2418582680 learned_addr learned my addr 172.21.15.33:0/2418582680 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.244+0000 7fc2c259c700 1 --2- 172.21.15.33:0/2418582680 >> v2:172.21.15.33:3300/0 conn(0x7fc2c40cb5a0 0x7fc2c40cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60484/0 (socket says 172.21.15.33:60484) 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c1d9b700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40cd9e0 0x7fc2c4159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c259c700 1 -- 172.21.15.33:0/2418582680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40cd9e0 msgr2=0x7fc2c4159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c259c700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40cd9e0 0x7fc2c4159ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.248 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c259c700 1 -- 172.21.15.33:0/2418582680 >> v1:172.21.15.33:6789/0 conn(0x7fc2c40cde50 legacy=0x7fc2c4156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c259c700 1 -- 172.21.15.33:0/2418582680 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2c40ccf00 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c259c700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c40cb970 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098e0 tx=0x7fc2b40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=844486fe4ce552a3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c159a700 1 -- 172.21.15.33:0/2418582680 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b4009e80 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c159a700 1 -- 172.21.15.33:0/2418582680 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b400b760 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.245+0000 7fc2c159a700 1 -- 172.21.15.33:0/2418582680 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400bae0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 -- 172.21.15.33:0/2418582680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 msgr2=0x7fc2c40cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.249 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c40cb970 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7fc2b40098e0 tx=0x7fc2b40091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 -- 172.21.15.33:0/2418582680 shutdown_connections 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c40cb970 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/2418582680 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40cd9e0 0x7fc2c4159ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 -- 172.21.15.33:0/2418582680 >> 172.21.15.33:0/2418582680 conn(0x7fc2c4070e30 msgr2=0x7fc2c40d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 -- 172.21.15.33:0/2418582680 shutdown_connections 2023-10-09T15:42:47.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.246+0000 7fc2c8a76700 1 -- 172.21.15.33:0/2418582680 wait complete. 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.247+0000 7fc2c8a76700 1 Processor -- start 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.247+0000 7fc2c8a76700 1 -- start start 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.247+0000 7fc2c8a76700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c40cd9e0 0x7fc2c4153d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40b4d50 0x7fc2c415d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.253 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c41542c0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c416d230 con 0x7fc2c40cd9e0 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2c4158000 con 0x7fc2c40b4d50 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60494/0 (socket says 172.21.15.33:60494) 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 -- 172.21.15.33:0/3528519672 learned_addr learned my addr 172.21.15.33:0/3528519672 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c1d9b700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c40cd9e0 0x7fc2c4153d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c2d9d700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40b4d50 0x7fc2c415d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 -- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40b4d50 msgr2=0x7fc2c415d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40b4d50 0x7fc2c415d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 -- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c40cd9e0 msgr2=0x7fc2c4153d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c40cd9e0 0x7fc2c4153d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 -- 172.21.15.33:0/3528519672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2b4009420 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c259c700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc2c406ea60 tx=0x7fc2b4016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b400bae0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2b401c460 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2b401c7e0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2c40b56f0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.248+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2c41579b0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.249+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2c40afdb0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.250+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc2b401cb90 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.250+0000 7fc2ba7fc700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 0x7fc2a40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.250+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc2b4086ca0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.250+0000 7fc2c1d9b700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 0x7fc2a40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.251+0000 7fc2c1d9b700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 0x7fc2a40697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4167a40 tx=0x7fc2ac008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:47.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.254+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc2b4053c30 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.450+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2c40afdb0 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.452 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.451+0000 7fc2ba7fc700 1 -- 172.21.15.33:0/3528519672 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v205) v1 ==== 74+0+12225 (secure 0 0 0) 0x7fc2b4057250 con 0x7fc2c40cb5a0 2023-10-09T15:42:47.452 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:47.453 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":205,"fsid":"38c7cb5d-ab66-41cb-ab30-25e3d813cdd1","created":"2023-10-09T15:30:41.428408+0000","modified":"2023-10-09T15:42:43.854153+0000","last_up_change":"2023-10-09T15:30:52.334027+0000","last_in_change":"2023-10-09T15:30:43.928887+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":34,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-10-09T15:30:53.288152+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"11698e8d-2071-4bc8-b0a2-9a3180ed683a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6808","nonce":90914},{"type":"v1","addr":"172.21.15.33:6809","nonce":90914}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6810","nonce":90914},{"type":"v1","addr":"172.21.15.33:6811","nonce":90914}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6814","nonce":90914},{"type":"v1","addr":"172.21.15.33:6815","nonce":90914}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6812","nonce":90914},{"type":"v1","addr":"172.21.15.33:6813","nonce":90914}]},"public_addr":"172.21.15.33:6809/90914","cluster_addr":"172.21.15.33:6811/90914","heartbeat_back_addr":"172.21.15.33:6815/90914","heartbeat_front_addr":"172.21.15.33:6813/90914","state":["exists","up"]},{"osd":1,"uuid":"5735ffa2-877b-4776-a802-b46feeedf128","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6817","nonce":90915},{"type":"v1","addr":"172.21.15.33:6819","nonce":90915}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6821","nonce":90915},{"type":"v1","addr":"172.21.15.33:6823","nonce":90915}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6830","nonce":90915},{"type":"v1","addr":"172.21.15.33:6831","nonce":90915}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6825","nonce":90915},{"type":"v1","addr":"172.21.15.33:6827","nonce":90915}]},"public_addr":"172.21.15.33:6819/90915","cluster_addr":"172.21.15.33:6823/90915","heartbeat_back_addr":"172.21.15.33:6831/90915","heartbeat_front_addr":"172.21.15.33:6827/90915","state":["exists","up"]},{"osd":2,"uuid":"5447cdc2-e857-406d-b56c-0f238c8332ad","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6816","nonce":90920},{"type":"v1","addr":"172.21.15.33:6818","nonce":90920}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6820","nonce":90920},{"type":"v1","addr":"172.21.15.33:6822","nonce":90920}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6828","nonce":90920},{"type":"v1","addr":"172.21.15.33:6829","nonce":90920}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6824","nonce":90920},{"type":"v1","addr":"172.21.15.33:6826","nonce":90920}]},"public_addr":"172.21.15.33:6818/90920","cluster_addr":"172.21.15.33:6822/90920","heartbeat_back_addr":"172.21.15.33:6829/90920","heartbeat_front_addr":"172.21.15.33:6826/90920","state":["exists","up"]},{"osd":3,"uuid":"c5b016b7-3590-4fd7-ab97-6198dc0fa04a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6800","nonce":90903},{"type":"v1","addr":"172.21.15.33:6801","nonce":90903}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6802","nonce":90903},{"type":"v1","addr":"172.21.15.33:6803","nonce":90903}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6806","nonce":90903},{"type":"v1","addr":"172.21.15.33:6807","nonce":90903}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6804","nonce":90903},{"type":"v1","addr":"172.21.15.33:6805","nonce":90903}]},"public_addr":"172.21.15.33:6801/90903","cluster_addr":"172.21.15.33:6803/90903","heartbeat_back_addr":"172.21.15.33:6807/90903","heartbeat_front_addr":"172.21.15.33:6805/90903","state":["exists","up"]},{"osd":4,"uuid":"4a7d4640-8d7f-476f-aea1-1c935778d122","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":201,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6804","nonce":91143},{"type":"v1","addr":"172.21.15.59:6806","nonce":91143}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6808","nonce":91143},{"type":"v1","addr":"172.21.15.59:6810","nonce":91143}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6814","nonce":91143},{"type":"v1","addr":"172.21.15.59:6815","nonce":91143}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6812","nonce":91143},{"type":"v1","addr":"172.21.15.59:6813","nonce":91143}]},"public_addr":"172.21.15.59:6806/91143","cluster_addr":"172.21.15.59:6810/91143","heartbeat_back_addr":"172.21.15.59:6815/91143","heartbeat_front_addr":"172.21.15.59:6813/91143","state":["exists","up"]},{"osd":5,"uuid":"cdfeca37-6607-4e31-849f-f9c2d90f49f9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6800","nonce":91144},{"type":"v1","addr":"172.21.15.59:6801","nonce":91144}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6802","nonce":91144},{"type":"v1","addr":"172.21.15.59:6803","nonce":91144}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6809","nonce":91144},{"type":"v1","addr":"172.21.15.59:6811","nonce":91144}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6805","nonce":91144},{"type":"v1","addr":"172.21.15.59:6807","nonce":91144}]},"public_addr":"172.21.15.59:6801/91144","cluster_addr":"172.21.15.59:6803/91144","heartbeat_back_addr":"172.21.15.59:6811/91144","heartbeat_front_addr":"172.21.15.59:6807/91144","state":["exists","up"]},{"osd":6,"uuid":"182e9ee5-69eb-42f5-8140-c236652bd24e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6824","nonce":91188},{"type":"v1","addr":"172.21.15.59:6825","nonce":91188}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6826","nonce":91188},{"type":"v1","addr":"172.21.15.59:6827","nonce":91188}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6830","nonce":91188},{"type":"v1","addr":"172.21.15.59:6831","nonce":91188}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6828","nonce":91188},{"type":"v1","addr":"172.21.15.59:6829","nonce":91188}]},"public_addr":"172.21.15.59:6825/91188","cluster_addr":"172.21.15.59:6827/91188","heartbeat_back_addr":"172.21.15.59:6831/91188","heartbeat_front_addr":"172.21.15.59:6829/91188","state":["exists","up"]},{"osd":7,"uuid":"22ca6a0f-6836-46df-a2b3-6dd040198cfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":198,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6816","nonce":91145},{"type":"v1","addr":"172.21.15.59:6817","nonce":91145}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6818","nonce":91145},{"type":"v1","addr":"172.21.15.59:6819","nonce":91145}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6822","nonce":91145},{"type":"v1","addr":"172.21.15.59:6823","nonce":91145}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6820","nonce":91145},{"type":"v1","addr":"172.21.15.59:6821","nonce":91145}]},"public_addr":"172.21.15.59:6817/91145","cluster_addr":"172.21.15.59:6819/91145","heartbeat_back_addr":"172.21.15.59:6823/91145","heartbeat_front_addr":"172.21.15.59:6821/91145","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.071186+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.060562+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:48.878847+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.076087+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.061542+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.030544+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.132251+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2023-10-09T15:30:49.055199+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.33:6837/3266537603":"2023-10-10T15:42:40.849232+0000","172.21.15.33:6835/3266537603":"2023-10-10T15:42:40.849232+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-10-09T15:42:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 msgr2=0x7fc2a40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 0x7fc2a40697d0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7fc2c4167a40 tx=0x7fc2ac008040 comp rx=0 tx=0).stop 2023-10-09T15:42:47.455 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 msgr2=0x7fc2c416b020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc2c406ea60 tx=0x7fc2b4016000 comp rx=0 tx=0).stop 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 shutdown_connections 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc2a4067320 0x7fc2a40697d0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc2c40cb5a0 0x7fc2c416b020 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc2c40b4d50 0x7fc2c415d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 --2- 172.21.15.33:0/3528519672 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc2c40cd9e0 0x7fc2c4153d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.453+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 >> 172.21.15.33:0/3528519672 conn(0x7fc2c4070e30 msgr2=0x7fc2c40b27a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:47.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.454+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 shutdown_connections 2023-10-09T15:42:47.457 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:47.454+0000 7fc2c8a76700 1 -- 172.21.15.33:0/3528519672 wait complete. 2023-10-09T15:42:48.467 INFO:tasks.ceph:Scrubbing osd.0 2023-10-09T15:42:48.467 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.602+0000 7fbaa9f41700 1 Processor -- start 2023-10-09T15:42:48.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.602+0000 7fbaa9f41700 1 -- start start 2023-10-09T15:42:48.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa9f41700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fbaa406c6a0 0x7fbaa406cb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa9f41700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbaa40aa740 0x7fbaa40aab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa9f41700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbaa40af670 con 0x7fbaa4159940 2023-10-09T15:42:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa9f41700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa406d080 con 0x7fbaa40aa740 2023-10-09T15:42:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa9f41700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbaa40aa2b0 con 0x7fbaa406c6a0 2023-10-09T15:42:48.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fbaa40aa740 0x7fbaa40aab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa37fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fbaa4159940 0x7fbaa40b08c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56586/0 (socket says 172.21.15.33:56586) 2023-10-09T15:42:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa37fe700 1 -- 172.21.15.33:0/2505734900 learned_addr learned my addr 172.21.15.33:0/2505734900 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa2ffd700 1 --2- 172.21.15.33:0/2505734900 >> v2:172.21.15.59:3300/0 conn(0x7fbaa406c6a0 0x7fbaa406cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 -- 172.21.15.33:0/2505734900 >> v2:172.21.15.59:3300/0 conn(0x7fbaa406c6a0 msgr2=0x7fbaa406cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:48.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 --2- 172.21.15.33:0/2505734900 >> v2:172.21.15.59:3300/0 conn(0x7fbaa406c6a0 0x7fbaa406cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 -- 172.21.15.33:0/2505734900 >> v1:172.21.15.33:6789/0 conn(0x7fbaa4159940 legacy=0x7fbaa40b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 -- 172.21.15.33:0/2505734900 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbaa40b12a0 con 0x7fbaa40aa740 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa27fc700 1 -- 172.21.15.33:0/2505734900 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259131973 0 0) 0x7fba94001610 con 0x7fbaa4159940 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa3fff700 1 --2- 172.21.15.33:0/2505734900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa40aa740 0x7fbaa40aab90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aff10 tx=0x7fba9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc5f8fecfa4943a2 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.603+0000 7fbaa27fc700 1 -- 172.21.15.33:0/2505734900 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c011630 con 0x7fbaa40aa740 2023-10-09T15:42:48.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa27fc700 1 -- 172.21.15.33:0/2505734900 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c011790 con 0x7fbaa40aa740 2023-10-09T15:42:48.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa27fc700 1 -- 172.21.15.33:0/2505734900 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c011b30 con 0x7fbaa40aa740 2023-10-09T15:42:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 -- 172.21.15.33:0/2505734900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa40aa740 msgr2=0x7fbaa40aab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/2505734900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa40aa740 0x7fbaa40aab90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40aff10 tx=0x7fba9c0091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 -- 172.21.15.33:0/2505734900 shutdown_connections 2023-10-09T15:42:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/2505734900 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa40aa740 0x7fbaa40aab90 unknown :-1 s=CLOSED pgs=1840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/2505734900 >> v2:172.21.15.59:3300/0 conn(0x7fbaa406c6a0 0x7fbaa406cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 -- 172.21.15.33:0/2505734900 >> 172.21.15.33:0/2505734900 conn(0x7fbaa40cd3e0 msgr2=0x7fbaa40cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:48.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 -- 172.21.15.33:0/2505734900 shutdown_connections 2023-10-09T15:42:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.604+0000 7fbaa9f41700 1 -- 172.21.15.33:0/2505734900 wait complete. 2023-10-09T15:42:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.605+0000 7fbaa9f41700 1 Processor -- start 2023-10-09T15:42:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 -- start start 2023-10-09T15:42:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa406c6a0 0x7fbaa40ae6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa40aa740 0x7fbaa416c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 0x7fbaa41584f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa416cd20 con 0x7fbaa4159940 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa415a440 con 0x7fbaa40aa740 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa9f41700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbaa415a720 con 0x7fbaa406c6a0 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 0x7fbaa41584f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa3fff700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 0x7fbaa41584f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60514/0 (socket says 172.21.15.33:60514) 2023-10-09T15:42:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.606+0000 7fbaa3fff700 1 -- 172.21.15.33:0/344890407 learned_addr learned my addr 172.21.15.33:0/344890407 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa2ffd700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa40aa740 0x7fbaa416c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 -- 172.21.15.33:0/344890407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa406c6a0 msgr2=0x7fbaa40ae6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fbaa406c6a0 0x7fbaa40ae6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 -- 172.21.15.33:0/344890407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa40aa740 msgr2=0x7fbaa416c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fbaa40aa740 0x7fbaa416c7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba9c009420 con 0x7fbaa4159940 2023-10-09T15:42:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa3fff700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 0x7fbaa41584f0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40696f0 tx=0x7fba9c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c0195c0 con 0x7fbaa4159940 2023-10-09T15:42:48.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba9c019720 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbaa415aa00 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba9c019ae0 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.607+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbaa415afc0 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.608+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbaa404c3c0 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.608+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fba9c02c3b0 con 0x7fbaa4159940 2023-10-09T15:42:48.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fba9b7fe700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba84067320 0x7fba840697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fba9c0860e0 con 0x7fbaa4159940 2023-10-09T15:42:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fbaa37fe700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba84067320 0x7fba840697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fba9b7fe700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fba8406d170 0x7fba8406f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba8406fc50 con 0x7fba8406d170 2023-10-09T15:42:48.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7fba9c088580 con 0x7fbaa4159940 2023-10-09T15:42:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fbaa2ffd700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fba8406d170 0x7fba8406f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.609+0000 7fbaa37fe700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba84067320 0x7fba840697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40adc70 tx=0x7fba94007dc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.610+0000 7fbaa2ffd700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fba8406d170 0x7fba8406f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.610+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== osd.0 v2:172.21.15.33:6808/90914 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fba8406fc50 con 0x7fba8406d170 2023-10-09T15:42:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.624+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 --> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fbaa40b1f60 con 0x7fba8406d170 2023-10-09T15:42:48.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.624+0000 7fba9b7fe700 1 -- 172.21.15.33:0/344890407 <== osd.0 v2:172.21.15.33:6808/90914 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fbaa40b1f60 con 0x7fba8406d170 2023-10-09T15:42:48.626 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:48.626 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:48.626 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fba8406d170 msgr2=0x7fba8406f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.627 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6808/90914,v1:172.21.15.33:6809/90914] conn(0x7fba8406d170 0x7fba8406f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba84067320 msgr2=0x7fba840697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fba84067320 0x7fba840697d0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40adc70 tx=0x7fba94007dc0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 msgr2=0x7fbaa41584f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 --2- 172.21.15.33:0/344890407 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fbaa4159940 0x7fbaa41584f0 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fbaa40696f0 tx=0x7fba9c017000 comp rx=0 tx=0).stop 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa3fff700 1 -- 172.21.15.33:0/344890407 reap_dead start 2023-10-09T15:42:48.628 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 shutdown_connections 2023-10-09T15:42:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 >> 172.21.15.33:0/344890407 conn(0x7fbaa40cd3e0 msgr2=0x7fbaa40aab10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 shutdown_connections 2023-10-09T15:42:48.629 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.625+0000 7fbaa9f41700 1 -- 172.21.15.33:0/344890407 wait complete. 2023-10-09T15:42:48.638 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-10-09T15:42:48.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.756+0000 7faa94f79700 1 Processor -- start 2023-10-09T15:42:48.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 -- start start 2023-10-09T15:42:48.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 0x7faa900ccac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa900cf200 0x7faa900cd000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa9015a280 con 0x7faa900b0ba0 2023-10-09T15:42:48.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa9006e180 con 0x7faa900cf200 2023-10-09T15:42:48.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.757+0000 7faa94f79700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa900cd540 con 0x7faa900b07d0 2023-10-09T15:42:48.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7faa900cf200 0x7faa900cd000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8ed9d700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7faa900b0ba0 0x7faa9006e610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56594/0 (socket says 172.21.15.33:56594) 2023-10-09T15:42:48.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8ed9d700 1 -- 172.21.15.33:0/1375342591 learned_addr learned my addr 172.21.15.33:0/1375342591 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:48.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8e59c700 1 --2- 172.21.15.33:0/1375342591 >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 0x7faa900ccac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 -- 172.21.15.33:0/1375342591 >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 msgr2=0x7faa900ccac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:48.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 --2- 172.21.15.33:0/1375342591 >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 0x7faa900ccac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 -- 172.21.15.33:0/1375342591 >> v1:172.21.15.33:6789/0 conn(0x7faa900b0ba0 legacy=0x7faa9006e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8d59a700 1 -- 172.21.15.33:0/1375342591 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100655931 0 0) 0x7faa9015a280 con 0x7faa900b0ba0 2023-10-09T15:42:48.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 -- 172.21.15.33:0/1375342591 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa9006d850 con 0x7faa900cf200 2023-10-09T15:42:48.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8e59c700 1 --2- 172.21.15.33:0/1375342591 >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 0x7faa900ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:48.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8dd9b700 1 --2- 172.21.15.33:0/1375342591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900cf200 0x7faa900cd000 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7faa90064720 tx=0x7faa780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6685e2af25b4c4fe server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8d59a700 1 -- 172.21.15.33:0/1375342591 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800b740 con 0x7faa900cf200 2023-10-09T15:42:48.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8d59a700 1 -- 172.21.15.33:0/1375342591 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7800b8a0 con 0x7faa900cf200 2023-10-09T15:42:48.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.758+0000 7faa8d59a700 1 -- 172.21.15.33:0/1375342591 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7800bc40 con 0x7faa900cf200 2023-10-09T15:42:48.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 -- 172.21.15.33:0/1375342591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900cf200 msgr2=0x7faa900cd000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 --2- 172.21.15.33:0/1375342591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900cf200 0x7faa900cd000 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7faa90064720 tx=0x7faa780091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 -- 172.21.15.33:0/1375342591 shutdown_connections 2023-10-09T15:42:48.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 --2- 172.21.15.33:0/1375342591 >> v2:172.21.15.59:3300/0 conn(0x7faa900b07d0 0x7faa900ccac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 --2- 172.21.15.33:0/1375342591 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900cf200 0x7faa900cd000 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 -- 172.21.15.33:0/1375342591 >> 172.21.15.33:0/1375342591 conn(0x7faa9006ce80 msgr2=0x7faa900ce510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:48.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 -- 172.21.15.33:0/1375342591 shutdown_connections 2023-10-09T15:42:48.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.759+0000 7faa94f79700 1 -- 172.21.15.33:0/1375342591 wait complete. 2023-10-09T15:42:48.769 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.760+0000 7faa94f79700 1 Processor -- start 2023-10-09T15:42:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.760+0000 7faa94f79700 1 -- start start 2023-10-09T15:42:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa900b0ba0 0x7faa90156e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.770 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa900cf200 0x7faa9009acf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9015da80 con 0x7faa900b07d0 2023-10-09T15:42:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa9015dd60 con 0x7faa900b0ba0 2023-10-09T15:42:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa94f79700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa9015e040 con 0x7faa900cf200 2023-10-09T15:42:48.771 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60528/0 (socket says 172.21.15.33:60528) 2023-10-09T15:42:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 -- 172.21.15.33:0/3963184265 learned_addr learned my addr 172.21.15.33:0/3963184265 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8dd9b700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa900b0ba0 0x7faa90156e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.772 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8ed9d700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa900cf200 0x7faa9009acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 -- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa900cf200 msgr2=0x7faa9009acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa900cf200 0x7faa9009acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 -- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa900b0ba0 msgr2=0x7faa90156e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.773 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa900b0ba0 0x7faa90156e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 -- 172.21.15.33:0/3963184265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa78009420 con 0x7faa900b07d0 2023-10-09T15:42:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa8e59c700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7faa8800e920 tx=0x7faa88008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.761+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88005a00 con 0x7faa900b07d0 2023-10-09T15:42:48.774 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.762+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa88005b60 con 0x7faa900b07d0 2023-10-09T15:42:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.762+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa88006020 con 0x7faa900b07d0 2023-10-09T15:42:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.762+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa9015e320 con 0x7faa900b07d0 2023-10-09T15:42:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.762+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa9015f060 con 0x7faa900b07d0 2023-10-09T15:42:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.762+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa9004c3c0 con 0x7faa900b07d0 2023-10-09T15:42:48.775 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.763+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7faa88006410 con 0x7faa900b07d0 2023-10-09T15:42:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.763+0000 7faa867fc700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 0x7faa700697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.763+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7faa88084c00 con 0x7faa900b07d0 2023-10-09T15:42:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.763+0000 7faa8dd9b700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 0x7faa700697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:48.776 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.764+0000 7faa8dd9b700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 0x7faa700697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7faa780091e0 tx=0x7faa78017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:48.777 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.768+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7faa88051a80 con 0x7faa900b07d0 2023-10-09T15:42:48.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.958+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7faa9006db30 con 0x7faa70067320 2023-10-09T15:42:48.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.959+0000 7faa867fc700 1 -- 172.21.15.33:0/3963184265 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7faa9006db30 con 0x7faa70067320 2023-10-09T15:42:48.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 msgr2=0x7faa700697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 0x7faa700697d0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7faa780091e0 tx=0x7faa78017000 comp rx=0 tx=0).stop 2023-10-09T15:42:48.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 msgr2=0x7faa9015eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7faa8800e920 tx=0x7faa88008040 comp rx=0 tx=0).stop 2023-10-09T15:42:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 shutdown_connections 2023-10-09T15:42:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7faa70067320 0x7faa700697d0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7faa900b07d0 0x7faa9015eb20 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7faa900cf200 0x7faa9009acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 --2- 172.21.15.33:0/3963184265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7faa900b0ba0 0x7faa90156e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:48.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 >> 172.21.15.33:0/3963184265 conn(0x7faa9006ce80 msgr2=0x7faa900cd6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:48.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 shutdown_connections 2023-10-09T15:42:48.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:48.961+0000 7faa94f79700 1 -- 172.21.15.33:0/3963184265 wait complete. 2023-10-09T15:42:48.965 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 0 to deep-scrub 2023-10-09T15:42:48.974 INFO:tasks.ceph:Scrubbing osd.1 2023-10-09T15:42:48.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:49.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.096+0000 7f7fff59e700 1 Processor -- start 2023-10-09T15:42:49.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.096+0000 7f7fff59e700 1 -- start start 2023-10-09T15:42:49.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 0x7f80000cd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7fff59e700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80000cb440 0x7f80000cb860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7fff59e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80000cd840 con 0x7f8000159fb0 2023-10-09T15:42:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7fff59e700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f800015e180 con 0x7f80000cb440 2023-10-09T15:42:49.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7fff59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f800015d570 con 0x7f80000cce90 2023-10-09T15:42:49.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f80000cb440 0x7f80000cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffe59c700 1 --1- >> v1:172.21.15.59:6789/0 conn(0x7f8000159fb0 0x7f800015a380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:35998/0 (socket says 172.21.15.33:35998) 2023-10-09T15:42:49.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffe59c700 1 -- 172.21.15.33:0/4288751718 learned_addr learned my addr 172.21.15.33:0/4288751718 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:49.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffdd9b700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 0x7f80000cd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/4288751718 >> v2:172.21.15.33:3300/0 conn(0x7f80000cb440 0x7f80000cb860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60542/0 (socket says 172.21.15.33:60542) 2023-10-09T15:42:49.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 -- 172.21.15.33:0/4288751718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 msgr2=0x7f80000cd300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 0x7f80000cd300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffd59a700 1 -- 172.21.15.33:0/4288751718 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1140253434 0 0) 0x7f80000cd840 con 0x7f8000159fb0 2023-10-09T15:42:49.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 -- 172.21.15.33:0/4288751718 >> v1:172.21.15.59:6789/0 conn(0x7f8000159fb0 legacy=0x7f800015a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 -- 172.21.15.33:0/4288751718 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f800015d850 con 0x7f80000cb440 2023-10-09T15:42:49.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffdd9b700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 0x7f80000cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cb440 0x7f80000cb860 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00098e0 tx=0x7f7ff00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=935e9f8b0500a1e3 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.097+0000 7f7ffd59a700 1 -- 172.21.15.33:0/4288751718 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000b640 con 0x7f80000cb440 2023-10-09T15:42:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7ffd59a700 1 -- 172.21.15.33:0/4288751718 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ff000b7a0 con 0x7f80000cb440 2023-10-09T15:42:49.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7ffd59a700 1 -- 172.21.15.33:0/4288751718 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ff000bb40 con 0x7f80000cb440 2023-10-09T15:42:49.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 -- 172.21.15.33:0/4288751718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cb440 msgr2=0x7f80000cb860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cb440 0x7f80000cb860 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f7ff00098e0 tx=0x7f7ff00091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 -- 172.21.15.33:0/4288751718 shutdown_connections 2023-10-09T15:42:49.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cb440 0x7f80000cb860 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 --2- 172.21.15.33:0/4288751718 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f80000cce90 0x7f80000cd300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 -- 172.21.15.33:0/4288751718 >> 172.21.15.33:0/4288751718 conn(0x7f80000703a0 msgr2=0x7f80000707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 -- 172.21.15.33:0/4288751718 shutdown_connections 2023-10-09T15:42:49.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.098+0000 7f7fff59e700 1 -- 172.21.15.33:0/4288751718 wait complete. 2023-10-09T15:42:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.099+0000 7f7fff59e700 1 Processor -- start 2023-10-09T15:42:49.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.099+0000 7f7fff59e700 1 -- start start 2023-10-09T15:42:49.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000cb440 0x7f80000c9bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 0x7f8000143e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8000159fb0 0x7f80000b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b1010 con 0x7f80000cce90 2023-10-09T15:42:49.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80000ca100 con 0x7f80000cb440 2023-10-09T15:42:49.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7fff59e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80000b0400 con 0x7f8000159fb0 2023-10-09T15:42:49.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7ffdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 0x7f8000143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7ffdd9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 0x7f8000143e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60556/0 (socket says 172.21.15.33:60556) 2023-10-09T15:42:49.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7ffdd9b700 1 -- 172.21.15.33:0/2622676297 learned_addr learned my addr 172.21.15.33:0/2622676297 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:49.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7ffe59c700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000cb440 0x7f80000c9bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.100+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8000159fb0 0x7f80000b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 -- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8000159fb0 msgr2=0x7f80000b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8000159fb0 0x7f80000b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 -- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000cb440 msgr2=0x7f80000c9bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f80000cb440 0x7f80000c9bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe8009420 con 0x7f80000cce90 2023-10-09T15:42:49.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ffdd9b700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 0x7f8000143e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800ecb0 tx=0x7f7fe80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe800ee60 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fe800cbe0 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff0009420 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fe8013470 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.101+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80000b09c0 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.102+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f800004c3c0 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.102+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f7fe8013820 con 0x7f80000cce90 2023-10-09T15:42:49.114 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ff67fc700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fe0067320 0x7f7fe00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f7fe8084dd0 con 0x7f80000cce90 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ffe59c700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fe0067320 0x7f7fe00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ff67fc700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f7fe006d170 0x7f7fe006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f7fe006fc50 con 0x7f7fe006d170 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7fe8088020 con 0x7f80000cce90 2023-10-09T15:42:49.115 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f7fe006d170 0x7f7fe006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ffe59c700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fe0067320 0x7f7fe00697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001560 tx=0x7f7ff8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.103+0000 7f7ffed9d700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f7fe006d170 0x7f7fe006f580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.116 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.104+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== osd.1 v2:172.21.15.33:6817/90915 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f7fe006fc50 con 0x7f7fe006d170 2023-10-09T15:42:49.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 --> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f80000caef0 con 0x7f7fe006d170 2023-10-09T15:42:49.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7ff67fc700 1 -- 172.21.15.33:0/2622676297 <== osd.1 v2:172.21.15.33:6817/90915 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f80000caef0 con 0x7f7fe006d170 2023-10-09T15:42:49.119 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:49.120 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:49.120 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f7fe006d170 msgr2=0x7f7fe006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6817/90915,v1:172.21.15.33:6819/90915] conn(0x7f7fe006d170 0x7f7fe006f580 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fe0067320 msgr2=0x7f7fe00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f7fe0067320 0x7f7fe00697d0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f7ff8001560 tx=0x7f7ff8009040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 msgr2=0x7f8000143e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 --2- 172.21.15.33:0/2622676297 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f80000cce90 0x7f8000143e90 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7f7fe800ecb0 tx=0x7f7fe80091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7ffed9d700 1 -- 172.21.15.33:0/2622676297 reap_dead start 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 shutdown_connections 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.118+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 >> 172.21.15.33:0/2622676297 conn(0x7f80000703a0 msgr2=0x7f80001500c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.119+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 shutdown_connections 2023-10-09T15:42:49.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.119+0000 7f7fff59e700 1 -- 172.21.15.33:0/2622676297 wait complete. 2023-10-09T15:42:49.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-10-09T15:42:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.251+0000 7f21fdb62700 1 Processor -- start 2023-10-09T15:42:49.252 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.251+0000 7f21fdb62700 1 -- start start 2023-10-09T15:42:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fdb62700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21f8153c30 0x7f21f815a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fdb62700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f815afd0 con 0x7f21f80cf110 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fdb62700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21f815b2b0 con 0x7f21f815de50 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fdb62700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21f815b590 con 0x7f21f8153c30 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fcb60700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f21f8153c30 0x7f21f815a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fd361700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f21f80cf110 0x7f21f815c070 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56604/0 (socket says 172.21.15.33:56604) 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fd361700 1 -- 172.21.15.33:0/1911146356 learned_addr learned my addr 172.21.15.33:0/1911146356 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fcb60700 1 -- 172.21.15.33:0/1911146356 >> v1:172.21.15.59:6789/0 conn(0x7f21f815de50 legacy=0x7f21f80cea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fcb60700 1 -- 172.21.15.33:0/1911146356 >> v1:172.21.15.33:6789/0 conn(0x7f21f80cf110 legacy=0x7f21f815c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fcb60700 1 -- 172.21.15.33:0/1911146356 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f815b870 con 0x7f21f8153c30 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.252+0000 7f21fcb60700 1 --2- 172.21.15.33:0/1911146356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f8153c30 0x7f21f815a5e0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e60 tx=0x7f21f0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82cdfc3a379ee87b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21f77fe700 1 -- 172.21.15.33:0/1911146356 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f000e070 con 0x7f21f8153c30 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21f77fe700 1 -- 172.21.15.33:0/1911146356 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f000bc30 con 0x7f21f8153c30 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21f77fe700 1 -- 172.21.15.33:0/1911146356 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f0012430 con 0x7f21f8153c30 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 -- 172.21.15.33:0/1911146356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f8153c30 msgr2=0x7f21f815a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1911146356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f8153c30 0x7f21f815a5e0 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f21f0009e60 tx=0x7f21f0009780 comp rx=0 tx=0).stop 2023-10-09T15:42:49.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 -- 172.21.15.33:0/1911146356 shutdown_connections 2023-10-09T15:42:49.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1911146356 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f8153c30 0x7f21f815a5e0 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 -- 172.21.15.33:0/1911146356 >> 172.21.15.33:0/1911146356 conn(0x7f21f80703a0 msgr2=0x7f21f80707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 -- 172.21.15.33:0/1911146356 shutdown_connections 2023-10-09T15:42:49.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.253+0000 7f21fdb62700 1 -- 172.21.15.33:0/1911146356 wait complete. 2023-10-09T15:42:49.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.254+0000 7f21fdb62700 1 Processor -- start 2023-10-09T15:42:49.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.254+0000 7f21fdb62700 1 -- start start 2023-10-09T15:42:49.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.260 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 0x7f21f80c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f815de50 0x7f21f80cc4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f8169f60 con 0x7f21f80cf110 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80b4110 con 0x7f21f8153c30 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fdb62700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21f80c91c0 con 0x7f21f815de50 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fcb60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fcb60700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60574/0 (socket says 172.21.15.33:60574) 2023-10-09T15:42:49.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.255+0000 7f21fcb60700 1 -- 172.21.15.33:0/1617407034 learned_addr learned my addr 172.21.15.33:0/1617407034 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21f7fff700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 0x7f21f80c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 -- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f815de50 msgr2=0x7f21f80cc4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f815de50 0x7f21f80cc4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 -- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 msgr2=0x7f21f80c9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 0x7f21f80c9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 -- 172.21.15.33:0/1617407034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21f0009a20 con 0x7f21f80cf110 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21f7fff700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 0x7f21f80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:49.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fcb60700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f21f00097c0 tx=0x7f21f0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001d630 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21f001d7b0 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21f80c94a0 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21f001db70 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.256+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21f80b43f0 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.257+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21f804c3c0 con 0x7f21f80cf110 2023-10-09T15:42:49.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.257+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f21f0024070 con 0x7f21f80cf110 2023-10-09T15:42:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.258+0000 7f21f4ff9700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 0x7f21d80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.258+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f21f0087200 con 0x7f21f80cf110 2023-10-09T15:42:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.258+0000 7f21f7fff700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 0x7f21d80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.258+0000 7f21f7fff700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 0x7f21d80697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f21f80c6560 tx=0x7f21e8009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.262+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f21f0054190 con 0x7f21f80cf110 2023-10-09T15:42:49.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.458+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f21f815bb50 con 0x7f21d8067320 2023-10-09T15:42:49.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.458+0000 7f21f4ff9700 1 -- 172.21.15.33:0/1617407034 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f21f815bb50 con 0x7f21d8067320 2023-10-09T15:42:49.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 msgr2=0x7f21d80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 0x7f21d80697d0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f21f80c6560 tx=0x7f21e8009040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 msgr2=0x7f21f80b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f21f00097c0 tx=0x7f21f0019000 comp rx=0 tx=0).stop 2023-10-09T15:42:49.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 shutdown_connections 2023-10-09T15:42:49.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f21d8067320 0x7f21d80697d0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f21f80cf110 0x7f21f80b5a50 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f21f815de50 0x7f21f80cc4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 --2- 172.21.15.33:0/1617407034 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f21f8153c30 0x7f21f80c9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 >> 172.21.15.33:0/1617407034 conn(0x7f21f80703a0 msgr2=0x7f21f8151010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 shutdown_connections 2023-10-09T15:42:49.464 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.461+0000 7f21fdb62700 1 -- 172.21.15.33:0/1617407034 wait complete. 2023-10-09T15:42:49.464 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 1 to deep-scrub 2023-10-09T15:42:49.474 INFO:tasks.ceph:Scrubbing osd.2 2023-10-09T15:42:49.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:49.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.598+0000 7f86084ab700 1 Processor -- start 2023-10-09T15:42:49.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.598+0000 7f86084ab700 1 -- start start 2023-10-09T15:42:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f86084ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f86000a9020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f86084ab700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000cced0 con 0x7f860006e2a0 2023-10-09T15:42:49.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f86084ab700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86000cd140 con 0x7f8600088400 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f86084ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86000cd420 con 0x7f86000cee40 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8606247700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f860006e2a0 0x7f86000a8910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56616/0 (socket says 172.21.15.33:56616) 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8606247700 1 -- 172.21.15.33:0/2984862571 learned_addr learned my addr 172.21.15.33:0/2984862571 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8606a48700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f86000a9020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3645063503 0 0) 0x7f86000cced0 con 0x7f860006e2a0 2023-10-09T15:42:49.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f85e8003570 con 0x7f860006e2a0 2023-10-09T15:42:49.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.1 v1:172.21.15.59:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2877770578 0 0) 0x7f86000cd140 con 0x7f8600088400 2023-10-09T15:42:49.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> v1:172.21.15.59:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86000cced0 con 0x7f8600088400 2023-10-09T15:42:49.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1889435781 0 0) 0x7f85e8003570 con 0x7f860006e2a0 2023-10-09T15:42:49.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 msgr2=0x7f86000a9020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f86000a9020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 >> v1:172.21.15.59:6789/0 conn(0x7f8600088400 legacy=0x7f86000ae4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000cd700 con 0x7f860006e2a0 2023-10-09T15:42:49.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f85f00015f0 con 0x7f860006e2a0 2023-10-09T15:42:49.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 >> v1:172.21.15.33:6789/0 conn(0x7f860006e2a0 legacy=0x7f86000a8910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f85e8003c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85e8004180 0x7f85e8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85e8004d50 0x7f85e80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000cd420 con 0x7f85e8004d50 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85e800bba0 con 0x7f85e8004180 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85e800bd60 con 0x7f86000cee40 2023-10-09T15:42:49.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.599+0000 7f8606a48700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85e8004d50 0x7f85e80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606247700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f85e8003c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8605a46700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85e8004180 0x7f85e8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 -- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 msgr2=0x7f85e8003c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f85e8003c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 -- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85e8004180 msgr2=0x7f85e8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85e8004180 0x7f85e8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 -- 172.21.15.33:0/2984862571 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85e8003570 con 0x7f85e8004d50 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606247700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f86000cee40 0x7f85e8003c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8605a46700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f85e8004180 0x7f85e8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8606a48700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85e8004d50 0x7f85e80051c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e210 tx=0x7f85f800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23f5aa261b15492b server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800eac0 con 0x7f85e8004d50 2023-10-09T15:42:49.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f800f040 con 0x7f85e8004d50 2023-10-09T15:42:49.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.600+0000 7f8605245700 1 -- 172.21.15.33:0/2984862571 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f800ee70 con 0x7f85e8004d50 2023-10-09T15:42:49.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 -- 172.21.15.33:0/2984862571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85e8004d50 msgr2=0x7f85e80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 --2- 172.21.15.33:0/2984862571 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f85e8004d50 0x7f85e80051c0 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f85f800e210 tx=0x7f85f800b040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f8606a48700 1 -- 172.21.15.33:0/2984862571 reap_dead start 2023-10-09T15:42:49.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 -- 172.21.15.33:0/2984862571 shutdown_connections 2023-10-09T15:42:49.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 -- 172.21.15.33:0/2984862571 >> 172.21.15.33:0/2984862571 conn(0x7f8600088000 msgr2=0x7f86000ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 -- 172.21.15.33:0/2984862571 shutdown_connections 2023-10-09T15:42:49.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.601+0000 7f86084ab700 1 -- 172.21.15.33:0/2984862571 wait complete. 2023-10-09T15:42:49.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.602+0000 7f86084ab700 1 Processor -- start 2023-10-09T15:42:49.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.602+0000 7f86084ab700 1 -- start start 2023-10-09T15:42:49.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85e8004d50 0x7f8600146940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 0x7f86000b24d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600155640 0x7f8600155ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8600155ff0 con 0x7f86000b2060 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86000b0a30 con 0x7f8600155640 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8600146e80 con 0x7f85e8004d50 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 0x7f86000b24d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 0x7f86000b24d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60598/0 (socket says 172.21.15.33:60598) 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 -- 172.21.15.33:0/814138953 learned_addr learned my addr 172.21.15.33:0/814138953 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8606247700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85e8004d50 0x7f8600146940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8606a48700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600155640 0x7f8600155ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 -- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85e8004d50 msgr2=0x7f8600146940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f85e8004d50 0x7f8600146940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 -- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600155640 msgr2=0x7f8600155ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f8600155640 0x7f8600155ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86000afe20 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f8605a46700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 0x7f86000b24d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f85f400e700 tx=0x7f85f4009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f4001570 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f4010040 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85f40018e0 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86000b0100 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.603+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86000b06c0 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.604+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f860004c3c0 con 0x7f86000b2060 2023-10-09T15:42:49.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f85f4001c50 con 0x7f86000b2060 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85ec067320 0x7f85ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f85f4084740 con 0x7f86000b2060 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f8606247700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85ec067320 0x7f85ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f85ec06d170 0x7f85ec06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f85ec06fc50 con 0x7f85ec06d170 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f85f4086ca0 con 0x7f86000b2060 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.605+0000 7f8606a48700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f85ec06d170 0x7f85ec06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.606+0000 7f8606247700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85ec067320 0x7f85ec0697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f85f0000e10 tx=0x7f85f000c040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.606+0000 7f8606a48700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f85ec06d170 0x7f85ec06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.606+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== osd.2 v2:172.21.15.33:6816/90920 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f85ec06fc50 con 0x7f85ec06d170 2023-10-09T15:42:49.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.620+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 --> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f8600067b20 con 0x7f85ec06d170 2023-10-09T15:42:49.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f85fe7fc700 1 -- 172.21.15.33:0/814138953 <== osd.2 v2:172.21.15.33:6816/90920 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f8600067b20 con 0x7f85ec06d170 2023-10-09T15:42:49.622 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:49.622 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:49.623 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f85ec06d170 msgr2=0x7f85ec06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6816/90920,v1:172.21.15.33:6818/90920] conn(0x7f85ec06d170 0x7f85ec06f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85ec067320 msgr2=0x7f85ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f85ec067320 0x7f85ec0697d0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f85f0000e10 tx=0x7f85f000c040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 msgr2=0x7f86000b24d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 --2- 172.21.15.33:0/814138953 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f86000b2060 0x7f86000b24d0 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f85f400e700 tx=0x7f85f4009040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.624 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f8606a48700 1 -- 172.21.15.33:0/814138953 reap_dead start 2023-10-09T15:42:49.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 shutdown_connections 2023-10-09T15:42:49.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 >> 172.21.15.33:0/814138953 conn(0x7f8600088000 msgr2=0x7f860015d800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 shutdown_connections 2023-10-09T15:42:49.625 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.621+0000 7f86084ab700 1 -- 172.21.15.33:0/814138953 wait complete. 2023-10-09T15:42:49.634 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-10-09T15:42:49.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.752+0000 7f924c7b6700 1 Processor -- start 2023-10-09T15:42:49.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.752+0000 7f924c7b6700 1 -- start start 2023-10-09T15:42:49.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.753+0000 7f924c7b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92440cb5a0 0x7f92440cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.753+0000 7f924c7b6700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92440cd9e0 0x7f9244159ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.753+0000 7f924c7b6700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f924415ae40 con 0x7f92440cde50 2023-10-09T15:42:49.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.753+0000 7f924c7b6700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92440d13f0 con 0x7f92440cd9e0 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.753+0000 7f924c7b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924415ab60 con 0x7f92440cb5a0 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92440cd9e0 0x7f9244159ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f92440cd9e0 0x7f9244159ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60612/0 (socket says 172.21.15.33:60612) 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 -- 172.21.15.33:0/1990590923 learned_addr learned my addr 172.21.15.33:0/1990590923 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f924a552700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92440cb5a0 0x7f92440cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 -- 172.21.15.33:0/1990590923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92440cb5a0 msgr2=0x7f92440cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92440cb5a0 0x7f92440cb970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 -- 172.21.15.33:0/1990590923 >> v1:172.21.15.59:6789/0 conn(0x7f92440cde50 legacy=0x7f9244156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 -- 172.21.15.33:0/1990590923 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92440ccf00 con 0x7f92440cd9e0 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249d51700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f9244159ec0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f92340099b0 tx=0x7f9234009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b211d56e9d3766 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249550700 1 -- 172.21.15.33:0/1990590923 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400b860 con 0x7f92440cd9e0 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249550700 1 -- 172.21.15.33:0/1990590923 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f923400b9c0 con 0x7f92440cd9e0 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.754+0000 7f9249550700 1 -- 172.21.15.33:0/1990590923 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f923400bd60 con 0x7f92440cd9e0 2023-10-09T15:42:49.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 -- 172.21.15.33:0/1990590923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 msgr2=0x7f9244159ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f9244159ec0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f92340099b0 tx=0x7f9234009250 comp rx=0 tx=0).stop 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 -- 172.21.15.33:0/1990590923 shutdown_connections 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f92440cb5a0 0x7f92440cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 --2- 172.21.15.33:0/1990590923 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f9244159ec0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 -- 172.21.15.33:0/1990590923 >> 172.21.15.33:0/1990590923 conn(0x7f9244070e30 msgr2=0x7f92440d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 -- 172.21.15.33:0/1990590923 shutdown_connections 2023-10-09T15:42:49.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.755+0000 7f924c7b6700 1 -- 172.21.15.33:0/1990590923 wait complete. 2023-10-09T15:42:49.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.756+0000 7f924c7b6700 1 Processor -- start 2023-10-09T15:42:49.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.756+0000 7f924c7b6700 1 -- start start 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92440cb5a0 0x7f924414f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9244156c60 0x7f92441593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244155560 con 0x7f92440cd9e0 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9244157440 con 0x7f92440cb5a0 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924c7b6700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9244157160 con 0x7f9244156c60 2023-10-09T15:42:49.763 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60628/0 (socket says 172.21.15.33:60628) 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 -- 172.21.15.33:0/4022111252 learned_addr learned my addr 172.21.15.33:0/4022111252 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924a552700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92440cb5a0 0x7f924414f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f924ad53700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9244156c60 0x7f92441593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 -- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9244156c60 msgr2=0x7f92441593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9244156c60 0x7f92441593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 -- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92440cb5a0 msgr2=0x7f924414f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92440cb5a0 0x7f924414f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 -- 172.21.15.33:0/4022111252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92340094f0 con 0x7f92440cd9e0 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f9249d51700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9234009290 tx=0x7f9234017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234024440 con 0x7f92440cd9e0 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92340245a0 con 0x7f92440cd9e0 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.757+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9234024960 con 0x7f92440cd9e0 2023-10-09T15:42:49.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.758+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9244154fa0 con 0x7f92440cd9e0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.758+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92441598f0 con 0x7f92440cd9e0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.758+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924404c3c0 con 0x7f92440cd9e0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.759+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f923401a420 con 0x7f92440cd9e0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.759+0000 7f923a7fc700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.759+0000 7f924a552700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.759+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f92340868c0 con 0x7f92440cd9e0 2023-10-09T15:42:49.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.760+0000 7f924a552700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 0x7f92280697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f924000acb0 tx=0x7f9240008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:49.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.764+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f9234053850 con 0x7f92440cd9e0 2023-10-09T15:42:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.958+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f9244154e20 con 0x7f9228067320 2023-10-09T15:42:49.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.958+0000 7f923a7fc700 1 -- 172.21.15.33:0/4022111252 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f924000c040 con 0x7f9228067320 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 msgr2=0x7f92280697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 0x7f92280697d0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f924000acb0 tx=0x7f9240008040 comp rx=0 tx=0).stop 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 msgr2=0x7f924414eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f9234009290 tx=0x7f9234017000 comp rx=0 tx=0).stop 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 shutdown_connections 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f9228067320 0x7f92280697d0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f9244156c60 0x7f92441593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f92440cb5a0 0x7f924414f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 --2- 172.21.15.33:0/4022111252 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f92440cd9e0 0x7f924414eaa0 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 >> 172.21.15.33:0/4022111252 conn(0x7f9244070e30 msgr2=0x7f92440d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 shutdown_connections 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:49.960+0000 7f924c7b6700 1 -- 172.21.15.33:0/4022111252 wait complete. 2023-10-09T15:42:49.963 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 2 to deep-scrub 2023-10-09T15:42:49.973 INFO:tasks.ceph:Scrubbing osd.3 2023-10-09T15:42:49.974 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:50.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.095+0000 7f3fc19be700 1 Processor -- start 2023-10-09T15:42:50.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.095+0000 7f3fc19be700 1 -- start start 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc19be700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fbc159fb0 0x7f3fbc15a380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc19be700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 0x7f3fbc0cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc19be700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3fbc15d570 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc19be700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc15e180 con 0x7f3fbc159fb0 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc19be700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3fbc15d850 con 0x7f3fbc0cd5a0 2023-10-09T15:42:50.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc09bc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f3fbc159fb0 0x7f3fbc15a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fbbfff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3fbc15a8c0 0x7f3fbc0cce90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56628/0 (socket says 172.21.15.33:56628) 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fbbfff700 1 -- 172.21.15.33:0/2472991106 learned_addr learned my addr 172.21.15.33:0/2472991106 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc11bd700 1 --2- 172.21.15.33:0/2472991106 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 0x7f3fbc0cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc09bc700 1 -- 172.21.15.33:0/2472991106 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 msgr2=0x7f3fbc0cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fc09bc700 1 --2- 172.21.15.33:0/2472991106 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 0x7f3fbc0cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc09bc700 1 -- 172.21.15.33:0/2472991106 >> v1:172.21.15.33:6789/0 conn(0x7f3fbc15a8c0 legacy=0x7f3fbc0cce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.096+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/2472991106 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313599231 0 0) 0x7f3fbc15d570 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc09bc700 1 -- 172.21.15.33:0/2472991106 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fbc15db30 con 0x7f3fbc159fb0 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc11bd700 1 --2- 172.21.15.33:0/2472991106 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 0x7f3fbc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc09bc700 1 --2- 172.21.15.33:0/2472991106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc159fb0 0x7f3fbc15a380 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc089710 tx=0x7f3fb4009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d95542d4f3dbbffd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/2472991106 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb400e070 con 0x7f3fbc159fb0 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/2472991106 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fb400bc30 con 0x7f3fbc159fb0 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fbb7fe700 1 -- 172.21.15.33:0/2472991106 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fb4012430 con 0x7f3fbc159fb0 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 -- 172.21.15.33:0/2472991106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc159fb0 msgr2=0x7f3fbc15a380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 --2- 172.21.15.33:0/2472991106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc159fb0 0x7f3fbc15a380 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc089710 tx=0x7f3fb4009780 comp rx=0 tx=0).stop 2023-10-09T15:42:50.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 -- 172.21.15.33:0/2472991106 shutdown_connections 2023-10-09T15:42:50.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 --2- 172.21.15.33:0/2472991106 >> v2:172.21.15.59:3300/0 conn(0x7f3fbc0cd5a0 0x7f3fbc0cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 --2- 172.21.15.33:0/2472991106 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc159fb0 0x7f3fbc15a380 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 -- 172.21.15.33:0/2472991106 >> 172.21.15.33:0/2472991106 conn(0x7f3fbc0703a0 msgr2=0x7f3fbc0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 -- 172.21.15.33:0/2472991106 shutdown_connections 2023-10-09T15:42:50.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.097+0000 7f3fc19be700 1 -- 172.21.15.33:0/2472991106 wait complete. 2023-10-09T15:42:50.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 Processor -- start 2023-10-09T15:42:50.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 -- start start 2023-10-09T15:42:50.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0cd5a0 0x7f3fbc0c9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc159fb0 0x7f3fbc14cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 0x7f3fbc14fb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0ca3e0 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0b1fe0 con 0x7f3fbc0cd5a0 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.099+0000 7f3fc19be700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3fbc0b2470 con 0x7f3fbc159fb0 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 0x7f3fbc14fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 0x7f3fbc14fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60648/0 (socket says 172.21.15.33:60648) 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 -- 172.21.15.33:0/312124544 learned_addr learned my addr 172.21.15.33:0/312124544 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc09bc700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0cd5a0 0x7f3fbc0c9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fbbfff700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc159fb0 0x7f3fbc14cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 -- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc159fb0 msgr2=0x7f3fbc14cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc159fb0 0x7f3fbc14cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 -- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0cd5a0 msgr2=0x7f3fbc0c9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3fbc0cd5a0 0x7f3fbc0c9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fb4009a20 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fbbfff700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3fbc159fb0 0x7f3fbc14cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc11bd700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 0x7f3fbc14fb00 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00c880 tx=0x7f3fac008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac011600 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fac011760 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fbc0b13d0 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fac011b20 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.100+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fbc0b1990 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.101+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f3fbc04c3c0 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3fac0193b0 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3fac084a80 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fc09bc700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f3fa806d170 0x7f3fa806f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3fa806fc50 con 0x7f3fa806d170 2023-10-09T15:42:50.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f3fac089220 con 0x7f3fbc15a8c0 2023-10-09T15:42:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fbbfff700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f3fa806d170 0x7f3fa806f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.102+0000 7f3fc09bc700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc089710 tx=0x7f3fb4019000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.103+0000 7f3fbbfff700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f3fa806d170 0x7f3fa806f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.103+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== osd.3 v2:172.21.15.33:6800/90903 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f3fa806fc50 con 0x7f3fa806d170 2023-10-09T15:42:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.117+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 --> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f3fbc0caef0 con 0x7f3fa806d170 2023-10-09T15:42:50.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.117+0000 7f3fb8ff9700 1 -- 172.21.15.33:0/312124544 <== osd.3 v2:172.21.15.33:6800/90903 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f3fbc0caef0 con 0x7f3fa806d170 2023-10-09T15:42:50.119 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:50.119 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:50.119 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f3fa806d170 msgr2=0x7f3fa806f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6800/90903,v1:172.21.15.33:6801/90903] conn(0x7f3fa806d170 0x7f3fa806f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 msgr2=0x7f3fa80697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3fa8067320 0x7f3fa80697d0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f3fbc089710 tx=0x7f3fb4019000 comp rx=0 tx=0).stop 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 msgr2=0x7f3fbc14fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 --2- 172.21.15.33:0/312124544 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3fbc15a8c0 0x7f3fbc14fb00 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00c880 tx=0x7f3fac008040 comp rx=0 tx=0).stop 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc11bd700 1 -- 172.21.15.33:0/312124544 reap_dead start 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 shutdown_connections 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 >> 172.21.15.33:0/312124544 conn(0x7f3fbc0703a0 msgr2=0x7f3fbc14efa0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 shutdown_connections 2023-10-09T15:42:50.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.118+0000 7f3fc19be700 1 -- 172.21.15.33:0/312124544 wait complete. 2023-10-09T15:42:50.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-10-09T15:42:50.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.249+0000 7f4cfb875700 1 Processor -- start 2023-10-09T15:42:50.308 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.249+0000 7f4cfb875700 1 -- start start 2023-10-09T15:42:50.312 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cfb875700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf40cddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cfb875700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4cf40a90d0 0x7f4cf406de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cfb875700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4cf406e7f0 con 0x7f4cf406e380 2023-10-09T15:42:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cfb875700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4cf40ae680 con 0x7f4cf40a90d0 2023-10-09T15:42:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cfb875700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40aeee0 con 0x7f4cf40a8d00 2023-10-09T15:42:50.313 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cf8e10700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f4cf40a90d0 0x7f4cf406de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cf9e12700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f4cf406e380 0x7f4cf40cc420 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56644/0 (socket says 172.21.15.33:56644) 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.250+0000 7f4cf9e12700 1 -- 172.21.15.33:0/1081072742 learned_addr learned my addr 172.21.15.33:0/1081072742 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf8e10700 1 -- 172.21.15.33:0/1081072742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 msgr2=0x7f4cf40cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf8e10700 1 --2- 172.21.15.33:0/1081072742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf40cddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf8e10700 1 -- 172.21.15.33:0/1081072742 >> v1:172.21.15.33:6789/0 conn(0x7f4cf406e380 legacy=0x7f4cf40cc420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.314 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf8e10700 1 -- 172.21.15.33:0/1081072742 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cf40cf490 con 0x7f4cf40a90d0 2023-10-09T15:42:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf3fff700 1 -- 172.21.15.33:0/1081072742 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 314420656 0 0) 0x7f4cf406e7f0 con 0x7f4cf406e380 2023-10-09T15:42:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf8e10700 1 --2- 172.21.15.33:0/1081072742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf40a90d0 0x7f4cf406de40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098d0 tx=0x7f4ce8009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58999d8b38074e4e server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf3fff700 1 -- 172.21.15.33:0/1081072742 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce8009e70 con 0x7f4cf40a90d0 2023-10-09T15:42:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf3fff700 1 -- 172.21.15.33:0/1081072742 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ce8005c10 con 0x7f4cf40a90d0 2023-10-09T15:42:50.315 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.251+0000 7f4cf3fff700 1 -- 172.21.15.33:0/1081072742 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ce800b650 con 0x7f4cf40a90d0 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 -- 172.21.15.33:0/1081072742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf40a90d0 msgr2=0x7f4cf406de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1081072742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf40a90d0 0x7f4cf406de40 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f4ce80098d0 tx=0x7f4ce8009120 comp rx=0 tx=0).stop 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 -- 172.21.15.33:0/1081072742 shutdown_connections 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1081072742 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf40cddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1081072742 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf40a90d0 0x7f4cf406de40 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.316 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 -- 172.21.15.33:0/1081072742 >> 172.21.15.33:0/1081072742 conn(0x7f4cf406ce80 msgr2=0x7f4cf40ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 -- 172.21.15.33:0/1081072742 shutdown_connections 2023-10-09T15:42:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.252+0000 7f4cfb875700 1 -- 172.21.15.33:0/1081072742 wait complete. 2023-10-09T15:42:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.253+0000 7f4cfb875700 1 Processor -- start 2023-10-09T15:42:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.253+0000 7f4cfb875700 1 -- start start 2023-10-09T15:42:50.317 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf416aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 0x7f4cf416a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf4099c20 con 0x7f4cf406e380 2023-10-09T15:42:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf416a910 con 0x7f4cf40a90d0 2023-10-09T15:42:50.318 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4cf40986d0 con 0x7f4cf40a8d00 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60652/0 (socket says 172.21.15.33:60652) 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 -- 172.21.15.33:0/1585266940 learned_addr learned my addr 172.21.15.33:0/1585266940 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9e12700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 0x7f4cf416a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf8e10700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf416aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.319 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 -- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 msgr2=0x7f4cf416aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf416aae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 -- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 msgr2=0x7f4cf416a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 0x7f4cf416a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 -- 172.21.15.33:0/1585266940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80093c0 con 0x7f4cf406e380 2023-10-09T15:42:50.320 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9e12700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 0x7f4cf416a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf9611700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b810 tx=0x7f4cec009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00f510 con 0x7f4cf406e380 2023-10-09T15:42:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cec00f690 con 0x7f4cf406e380 2023-10-09T15:42:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cec00fa50 con 0x7f4cf406e380 2023-10-09T15:42:50.321 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.254+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4cf40989b0 con 0x7f4cf406e380 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.255+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4cf4098f70 con 0x7f4cf406e380 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.256+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4cf4070770 con 0x7f4cf406e380 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.256+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f4cec01a400 con 0x7f4cf406e380 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.256+0000 7f4cf17fa700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 0x7f4ce00697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.256+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f4cec084510 con 0x7f4cf406e380 2023-10-09T15:42:50.322 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.256+0000 7f4cf8e10700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 0x7f4ce00697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.257+0000 7f4cf8e10700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 0x7f4ce00697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009160 tx=0x7f4ce8016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.323 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.261+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f4cec051520 con 0x7f4cf406e380 2023-10-09T15:42:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.457+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4cf4099d60 con 0x7f4ce0067320 2023-10-09T15:42:50.458 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.457+0000 7f4cf17fa700 1 -- 172.21.15.33:0/1585266940 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f4ce8000bc0 con 0x7f4ce0067320 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 msgr2=0x7f4ce00697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 0x7f4ce00697d0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8009160 tx=0x7f4ce8016000 comp rx=0 tx=0).stop 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 msgr2=0x7f4cf40980f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4cec00b810 tx=0x7f4cec009250 comp rx=0 tx=0).stop 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 shutdown_connections 2023-10-09T15:42:50.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f4ce0067320 0x7f4ce00697d0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f4cf406e380 0x7f4cf40980f0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f4cf40a90d0 0x7f4cf416a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 --2- 172.21.15.33:0/1585266940 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f4cf40a8d00 0x7f4cf416aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.459+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 >> 172.21.15.33:0/1585266940 conn(0x7f4cf406ce80 msgr2=0x7f4cf415e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.460+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 shutdown_connections 2023-10-09T15:42:50.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.460+0000 7f4cfb875700 1 -- 172.21.15.33:0/1585266940 wait complete. 2023-10-09T15:42:50.463 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 3 to deep-scrub 2023-10-09T15:42:50.472 INFO:tasks.ceph:Scrubbing osd.4 2023-10-09T15:42:50.473 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.595+0000 7f849ab55700 1 Processor -- start 2023-10-09T15:42:50.596 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.595+0000 7f849ab55700 1 -- start start 2023-10-09T15:42:50.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849ab55700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f84940b24f0 0x7f84940b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849ab55700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84940b1d40 0x7f84941590f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849ab55700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84940b0c80 con 0x7f84940b28c0 2023-10-09T15:42:50.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849ab55700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940d10d0 con 0x7f84940b1d40 2023-10-09T15:42:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849ab55700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84940b0f60 con 0x7f84940b24f0 2023-10-09T15:42:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849a354700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f84940b28c0 0x7f849415d260 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:56652/0 (socket says 172.21.15.33:56652) 2023-10-09T15:42:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499352700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f84940b1d40 0x7f84941590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f849a354700 1 -- 172.21.15.33:0/1010228287 learned_addr learned my addr 172.21.15.33:0/1010228287 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499b53700 1 --2- 172.21.15.33:0/1010228287 >> v2:172.21.15.59:3300/0 conn(0x7f84940b24f0 0x7f84940b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8498b51700 1 -- 172.21.15.33:0/1010228287 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1222454630 0 0) 0x7f84940b0c80 con 0x7f84940b28c0 2023-10-09T15:42:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8498b51700 1 -- 172.21.15.33:0/1010228287 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f847c003570 con 0x7f84940b28c0 2023-10-09T15:42:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499352700 1 -- 172.21.15.33:0/1010228287 >> v2:172.21.15.59:3300/0 conn(0x7f84940b24f0 msgr2=0x7f84940b0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499352700 1 --2- 172.21.15.33:0/1010228287 >> v2:172.21.15.59:3300/0 conn(0x7f84940b24f0 0x7f84940b0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499352700 1 -- 172.21.15.33:0/1010228287 >> v1:172.21.15.33:6789/0 conn(0x7f84940b28c0 legacy=0x7f849415d260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.596+0000 7f8499352700 1 -- 172.21.15.33:0/1010228287 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84940b1240 con 0x7f84940b1d40 2023-10-09T15:42:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f8499352700 1 --2- 172.21.15.33:0/1010228287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f84941590f0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f84940d1230 tx=0x7f84880091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d629af083ca15e20 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f8498b51700 1 -- 172.21.15.33:0/1010228287 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011630 con 0x7f84940b1d40 2023-10-09T15:42:50.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f8498b51700 1 -- 172.21.15.33:0/1010228287 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8488011790 con 0x7f84940b1d40 2023-10-09T15:42:50.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f8498b51700 1 -- 172.21.15.33:0/1010228287 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8488011b30 con 0x7f84940b1d40 2023-10-09T15:42:50.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 -- 172.21.15.33:0/1010228287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 msgr2=0x7f84941590f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 --2- 172.21.15.33:0/1010228287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f84941590f0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f84940d1230 tx=0x7f84880091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 -- 172.21.15.33:0/1010228287 shutdown_connections 2023-10-09T15:42:50.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 --2- 172.21.15.33:0/1010228287 >> v2:172.21.15.59:3300/0 conn(0x7f84940b24f0 0x7f84940b0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 --2- 172.21.15.33:0/1010228287 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f84941590f0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 -- 172.21.15.33:0/1010228287 >> 172.21.15.33:0/1010228287 conn(0x7f84940703a0 msgr2=0x7f84940707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 -- 172.21.15.33:0/1010228287 shutdown_connections 2023-10-09T15:42:50.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.597+0000 7f849ab55700 1 -- 172.21.15.33:0/1010228287 wait complete. 2023-10-09T15:42:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.598+0000 7f849ab55700 1 Processor -- start 2023-10-09T15:42:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 -- start start 2023-10-09T15:42:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f8494152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940b24f0 0x7f84940af1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940b28c0 0x7f849415afd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f849415ab40 con 0x7f84940b1d40 2023-10-09T15:42:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8494159f30 con 0x7f84940b28c0 2023-10-09T15:42:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f849ab55700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f849415a210 con 0x7f84940b24f0 2023-10-09T15:42:50.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f8499b53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f8494152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f8499b53700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f8494152d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:60674/0 (socket says 172.21.15.33:60674) 2023-10-09T15:42:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f8499b53700 1 -- 172.21.15.33:0/1145824644 learned_addr learned my addr 172.21.15.33:0/1145824644 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.599+0000 7f8499352700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940b24f0 0x7f84940af1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f849a354700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940b28c0 0x7f849415afd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 -- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940b24f0 msgr2=0x7f84940af1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f84940b24f0 0x7f84940af1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 -- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940b28c0 msgr2=0x7f849415afd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.611 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f84940b28c0 0x7f849415afd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8488009420 con 0x7f84940b1d40 2023-10-09T15:42:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8499b53700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f8494152d80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f848400e190 tx=0x7f8484009920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848400ee30 con 0x7f84940b1d40 2023-10-09T15:42:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484014420 con 0x7f84940b1d40 2023-10-09T15:42:50.612 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f849415a4f0 con 0x7f84940b1d40 2023-10-09T15:42:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84840147e0 con 0x7f84940b1d40 2023-10-09T15:42:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.600+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84941532c0 con 0x7f84940b1d40 2023-10-09T15:42:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.601+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f849404c3c0 con 0x7f84940b1d40 2023-10-09T15:42:50.613 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.601+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f8484014b90 con 0x7f84940b1d40 2023-10-09T15:42:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8491ffb700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8480067320 0x7f84800697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f84840851d0 con 0x7f84940b1d40 2023-10-09T15:42:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8499352700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8480067320 0x7f84800697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.614 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8491ffb700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f848006d170 0x7f848006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f848006fc50 con 0x7f848006d170 2023-10-09T15:42:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8484087730 con 0x7f84940b1d40 2023-10-09T15:42:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f849a354700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f848006d170 0x7f848006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.615 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.602+0000 7f8499352700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8480067320 0x7f84800697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f84880093f0 tx=0x7f8488017000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.603+0000 7f849a354700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f848006d170 0x7f848006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.603+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== osd.4 v2:172.21.15.59:6804/91143 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f848006fc50 con 0x7f848006d170 2023-10-09T15:42:50.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.617+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 --> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f84940d01d0 con 0x7f848006d170 2023-10-09T15:42:50.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f8491ffb700 1 -- 172.21.15.33:0/1145824644 <== osd.4 v2:172.21.15.59:6804/91143 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f84940d01d0 con 0x7f848006d170 2023-10-09T15:42:50.619 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:50.620 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:50.620 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f848006d170 msgr2=0x7f848006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.59:6804/91143,v1:172.21.15.59:6806/91143] conn(0x7f848006d170 0x7f848006f580 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.621 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8480067320 msgr2=0x7f84800697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8480067320 0x7f84800697d0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f84880093f0 tx=0x7f8488017000 comp rx=0 tx=0).stop 2023-10-09T15:42:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 msgr2=0x7f8494152d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 --2- 172.21.15.33:0/1145824644 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f84940b1d40 0x7f8494152d80 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f848400e190 tx=0x7f8484009920 comp rx=0 tx=0).stop 2023-10-09T15:42:50.622 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849a354700 1 -- 172.21.15.33:0/1145824644 reap_dead start 2023-10-09T15:42:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 shutdown_connections 2023-10-09T15:42:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.618+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 >> 172.21.15.33:0/1145824644 conn(0x7f84940703a0 msgr2=0x7f8494154ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.619+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 shutdown_connections 2023-10-09T15:42:50.623 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.619+0000 7f849ab55700 1 -- 172.21.15.33:0/1145824644 wait complete. 2023-10-09T15:42:50.631 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-10-09T15:42:50.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.751+0000 7f3f61ee0700 1 Processor -- start 2023-10-09T15:42:50.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.751+0000 7f3f61ee0700 1 -- start start 2023-10-09T15:42:50.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f61ee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f5c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f61ee0700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c15ae40 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f61ee0700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f5c15ab60 con 0x7f3f5c0cb970 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f61ee0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0ce0f0 con 0x7f3f5c15a5d0 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5b7fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f3f5c0cb5a0 0x7f3f5c0cd9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40528/0 (socket says 172.21.15.33:40528) 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5b7fe700 1 -- 172.21.15.33:0/432430792 learned_addr learned my addr 172.21.15.33:0/432430792 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5bfff700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f5c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.756 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2957469267 0 0) 0x7f3f5c15ae40 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f44003570 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1050298649 0 0) 0x7f3f44003570 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 msgr2=0x7f3f5c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f5c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 >> v1:172.21.15.59:6789/0 conn(0x7f3f5c0cb970 legacy=0x7f3f5c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c0ccf00 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f3f4c001470 con 0x7f3f5c0cb5a0 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 >> v1:172.21.15.33:6789/0 conn(0x7f3f5c0cb5a0 legacy=0x7f3f5c0cd9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f44003a90 0x7f3f44003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.752+0000 7f3f5a7fc700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f44005270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c0ce0f0 con 0x7f3f44003a90 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4400bbf0 con 0x7f3f44004810 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f4400bd80 con 0x7f3f5c15a5d0 2023-10-09T15:42:50.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f44003a90 0x7f3f44003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5affd700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5bfff700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f44005270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 -- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 msgr2=0x7f3f44005270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c15a5d0 0x7f3f44005270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 -- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44004810 msgr2=0x7f3f44004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44004810 0x7f3f44004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 -- 172.21.15.33:0/432430792 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44003570 con 0x7f3f44003a90 2023-10-09T15:42:50.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f44003a90 0x7f3f44003ea0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c300 tx=0x7f3f4c001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55f4b0048ece8d91 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c00cb90 con 0x7f3f44003a90 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f4c00cd10 con 0x7f3f44003a90 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.753+0000 7f3f5a7fc700 1 -- 172.21.15.33:0/432430792 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f4c005b70 con 0x7f3f44003a90 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 -- 172.21.15.33:0/432430792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f44003a90 msgr2=0x7f3f44003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/432430792 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f44003a90 0x7f3f44003ea0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c300 tx=0x7f3f4c001d80 comp rx=0 tx=0).stop 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f5bfff700 1 -- 172.21.15.33:0/432430792 reap_dead start 2023-10-09T15:42:50.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 -- 172.21.15.33:0/432430792 shutdown_connections 2023-10-09T15:42:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 -- 172.21.15.33:0/432430792 >> 172.21.15.33:0/432430792 conn(0x7f3f5c070e30 msgr2=0x7f3f5c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 -- 172.21.15.33:0/432430792 shutdown_connections 2023-10-09T15:42:50.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.754+0000 7f3f61ee0700 1 -- 172.21.15.33:0/432430792 wait complete. 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.755+0000 7f3f61ee0700 1 Processor -- start 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.755+0000 7f3f61ee0700 1 -- start start 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 0x7f3f5c0b52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 0x7f3f5c153580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.764 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c15b070 con 0x7f3f5c1698e0 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c151330 con 0x7f3f44003a90 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f61ee0700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5c153ac0 con 0x7f3f5c153110 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59298/0 (socket says 172.21.15.33:59298) 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 -- 172.21.15.33:0/248604525 learned_addr learned my addr 172.21.15.33:0/248604525 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 0x7f3f5c0b52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5bfff700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 0x7f3f5c153580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.765 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 -- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 msgr2=0x7f3f5c153580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 0x7f3f5c153580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 -- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 msgr2=0x7f3f5c0b52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 0x7f3f5c0b52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 -- 172.21.15.33:0/248604525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f5c151760 con 0x7f3f5c1698e0 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 0x7f3f5c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5bfff700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 0x7f3f5c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f5affd700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3f50002aa0 tx=0x7f3f50007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.766 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000f8d0 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.756+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f5000fa30 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.757+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f5c169e30 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.757+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f5000fdf0 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.757+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f5c16a3f0 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.757+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5c15b220 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.758+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f3f50013600 con 0x7f3f5c1698e0 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.758+0000 7f3f437fe700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 0x7f3f480697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:50.767 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.758+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f3f50084e80 con 0x7f3f5c1698e0 2023-10-09T15:42:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.758+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 0x7f3f480697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.759+0000 7f3f5b7fe700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 0x7f3f480697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c2a0 tx=0x7f3f4c015000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:50.768 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.763+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f3f5c15b220 con 0x7f3f5c1698e0 2023-10-09T15:42:50.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.958+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f5c15b220 con 0x7f3f48067320 2023-10-09T15:42:50.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.958+0000 7f3f437fe700 1 -- 172.21.15.33:0/248604525 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3f5c15b220 con 0x7f3f48067320 2023-10-09T15:42:50.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 msgr2=0x7f3f480697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 0x7f3f480697d0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f3f4c00c2a0 tx=0x7f3f4c015000 comp rx=0 tx=0).stop 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 msgr2=0x7f3f5c150df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f3f50002aa0 tx=0x7f3f50007d30 comp rx=0 tx=0).stop 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 shutdown_connections 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f3f48067320 0x7f3f480697d0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f3f5c153110 0x7f3f5c153580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f3f44003a90 0x7f3f5c0b52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 --2- 172.21.15.33:0/248604525 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f3f5c1698e0 0x7f3f5c150df0 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 >> 172.21.15.33:0/248604525 conn(0x7f3f5c070e30 msgr2=0x7f3f5c0ce230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 shutdown_connections 2023-10-09T15:42:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:50.960+0000 7f3f61ee0700 1 -- 172.21.15.33:0/248604525 wait complete. 2023-10-09T15:42:50.963 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 4 to deep-scrub 2023-10-09T15:42:50.973 INFO:tasks.ceph:Scrubbing osd.5 2023-10-09T15:42:50.973 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:51.096 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.095+0000 7fb99006b700 1 Processor -- start 2023-10-09T15:42:51.097 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.095+0000 7fb99006b700 1 -- start start 2023-10-09T15:42:51.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb99006b700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb988159530 0x7fb9880ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb99006b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb988159900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb99006b700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9880ccfd0 con 0x7fb988159e40 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb99006b700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb98815a410 con 0x7fb988159530 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb99006b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb98815a6f0 con 0x7fb98806dcf0 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb98de07700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb988159530 0x7fb9880ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb98de07700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fb988159530 0x7fb9880ceba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59314/0 (socket says 172.21.15.33:59314) 2023-10-09T15:42:51.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.096+0000 7fb98de07700 1 -- 172.21.15.33:0/325702955 learned_addr learned my addr 172.21.15.33:0/325702955 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98d606700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb988159900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98de07700 1 -- 172.21.15.33:0/325702955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 msgr2=0x7fb988159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:51.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98de07700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb988159900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98de07700 1 -- 172.21.15.33:0/325702955 >> v1:172.21.15.59:6789/0 conn(0x7fb988159e40 legacy=0x7fb9880cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98de07700 1 -- 172.21.15.33:0/325702955 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb98815a9d0 con 0x7fb988159530 2023-10-09T15:42:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98de07700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb9880ceba0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb9840099b0 tx=0x7fb984009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9b62a894670abd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.102 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98ce05700 1 -- 172.21.15.33:0/325702955 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400b820 con 0x7fb988159530 2023-10-09T15:42:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98ce05700 1 -- 172.21.15.33:0/325702955 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb98400b980 con 0x7fb988159530 2023-10-09T15:42:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.097+0000 7fb98ce05700 1 -- 172.21.15.33:0/325702955 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb98400bd20 con 0x7fb988159530 2023-10-09T15:42:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 -- 172.21.15.33:0/325702955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 msgr2=0x7fb9880ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.103 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb9880ceba0 secure :-1 s=READY pgs=1867 cs=0 l=1 rev1=1 crypto rx=0x7fb9840099b0 tx=0x7fb984009250 comp rx=0 tx=0).stop 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 -- 172.21.15.33:0/325702955 shutdown_connections 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb9880ceba0 unknown :-1 s=CLOSED pgs=1867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 --2- 172.21.15.33:0/325702955 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb988159900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 -- 172.21.15.33:0/325702955 >> 172.21.15.33:0/325702955 conn(0x7fb9880703a0 msgr2=0x7fb9880707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 -- 172.21.15.33:0/325702955 shutdown_connections 2023-10-09T15:42:51.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.098+0000 7fb99006b700 1 -- 172.21.15.33:0/325702955 wait complete. 2023-10-09T15:42:51.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 Processor -- start 2023-10-09T15:42:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 -- start start 2023-10-09T15:42:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb9880c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb988153560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb988159e40 0x7fb9880af980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb988153aa0 con 0x7fb988159530 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.099+0000 7fb99006b700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880c81f0 con 0x7fb988159e40 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb99006b700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9880afec0 con 0x7fb98806dcf0 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb988153560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb988153560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59324/0 (socket says 172.21.15.33:59324) 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 -- 172.21.15.33:0/3691561921 learned_addr learned my addr 172.21.15.33:0/3691561921 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.109 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98de07700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb9880c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98e608700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb988159e40 0x7fb9880af980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 -- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 msgr2=0x7fb9880c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fb98806dcf0 0x7fb9880c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 -- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb988159e40 msgr2=0x7fb9880af980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fb988159e40 0x7fb9880af980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9840094f0 con 0x7fb988159530 2023-10-09T15:42:51.110 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb98d606700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb988153560 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d8c0 tx=0x7fb978008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9780125f0 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb978012770 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9880ca600 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.100+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb978012b30 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.101+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9880c7ba0 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.101+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb98804c3c0 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fb97801e460 con 0x7fb988159530 2023-10-09T15:42:51.111 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb96c067320 0x7fb96c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fb978084ef0 con 0x7fb988159530 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb98de07700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb96c067320 0x7fb96c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7fb96c06d170 0x7fb96c06f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb96c06fc50 con 0x7fb96c06d170 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.102+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb978087450 con 0x7fb988159530 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.103+0000 7fb98e608700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7fb96c06d170 0x7fb96c06f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.103+0000 7fb98de07700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb96c067320 0x7fb96c0697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb9840099b0 tx=0x7fb984016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.112 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.103+0000 7fb98e608700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7fb96c06d170 0x7fb96c06f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.113 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.104+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== osd.5 v2:172.21.15.59:6800/91144 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7fb96c06fc50 con 0x7fb96c06d170 2023-10-09T15:42:51.119 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.118+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 --> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb98815acb0 con 0x7fb96c06d170 2023-10-09T15:42:51.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.118+0000 7fb97dffb700 1 -- 172.21.15.33:0/3691561921 <== osd.5 v2:172.21.15.59:6800/91144 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7fb98815acb0 con 0x7fb96c06d170 2023-10-09T15:42:51.120 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:51.120 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:51.121 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:51.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7fb96c06d170 msgr2=0x7fb96c06f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.59:6800/91144,v1:172.21.15.59:6801/91144] conn(0x7fb96c06d170 0x7fb96c06f580 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.122 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb96c067320 msgr2=0x7fb96c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fb96c067320 0x7fb96c0697d0 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7fb9840099b0 tx=0x7fb984016000 comp rx=0 tx=0).stop 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 msgr2=0x7fb988153560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 --2- 172.21.15.33:0/3691561921 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fb988159530 0x7fb988153560 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fb97800d8c0 tx=0x7fb978008040 comp rx=0 tx=0).stop 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb98e608700 1 -- 172.21.15.33:0/3691561921 reap_dead start 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 shutdown_connections 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 >> 172.21.15.33:0/3691561921 conn(0x7fb9880703a0 msgr2=0x7fb9880cb4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.123 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 shutdown_connections 2023-10-09T15:42:51.124 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.119+0000 7fb99006b700 1 -- 172.21.15.33:0/3691561921 wait complete. 2023-10-09T15:42:51.131 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-10-09T15:42:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.250+0000 7f62062ab700 1 Processor -- start 2023-10-09T15:42:51.251 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.250+0000 7f62062ab700 1 -- start start 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001595d0 0x7f62001599a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f62000675a0 0x7f620006acf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f620006b230 0x7f62000c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620006bd00 con 0x7f620006b230 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62000c7f50 con 0x7f62000675a0 2023-10-09T15:42:51.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f62062ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620006b740 con 0x7f62001595d0 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f6204848700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f620006b230 0x7f62000c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f6204848700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f620006b230 0x7f62000c83e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59334/0 (socket says 172.21.15.33:59334) 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f6204848700 1 -- 172.21.15.33:0/1484900866 learned_addr learned my addr 172.21.15.33:0/1484900866 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f61fffff700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001595d0 0x7f62001599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.251+0000 7f61ff7fe700 1 --2- 172.21.15.33:0/1484900866 >> v2:172.21.15.59:3300/0 conn(0x7f62000675a0 0x7f620006acf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 -- 172.21.15.33:0/1484900866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001595d0 msgr2=0x7f62001599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001595d0 0x7f62001599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 -- 172.21.15.33:0/1484900866 >> v2:172.21.15.59:3300/0 conn(0x7f62000675a0 msgr2=0x7f620006acf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 --2- 172.21.15.33:0/1484900866 >> v2:172.21.15.59:3300/0 conn(0x7f62000675a0 0x7f620006acf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 -- 172.21.15.33:0/1484900866 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620006ba20 con 0x7f620006b230 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f6204848700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f62000c83e0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f6200064900 tx=0x7f61f8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca92f91bc4296fa server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f61feffd700 1 -- 172.21.15.33:0/1484900866 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f800e070 con 0x7f620006b230 2023-10-09T15:42:51.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f61feffd700 1 -- 172.21.15.33:0/1484900866 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f800b970 con 0x7f620006b230 2023-10-09T15:42:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f61feffd700 1 -- 172.21.15.33:0/1484900866 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f80092e0 con 0x7f620006b230 2023-10-09T15:42:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 -- 172.21.15.33:0/1484900866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 msgr2=0x7f62000c83e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f62000c83e0 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7f6200064900 tx=0x7f61f8009840 comp rx=0 tx=0).stop 2023-10-09T15:42:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 -- 172.21.15.33:0/1484900866 shutdown_connections 2023-10-09T15:42:51.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f62000c83e0 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 --2- 172.21.15.33:0/1484900866 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62001595d0 0x7f62001599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 --2- 172.21.15.33:0/1484900866 >> v2:172.21.15.59:3300/0 conn(0x7f62000675a0 0x7f620006acf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.252+0000 7f62062ab700 1 -- 172.21.15.33:0/1484900866 >> 172.21.15.33:0/1484900866 conn(0x7f62000cd400 msgr2=0x7f62000cd800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.253+0000 7f62062ab700 1 -- 172.21.15.33:0/1484900866 shutdown_connections 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.253+0000 7f62062ab700 1 -- 172.21.15.33:0/1484900866 wait complete. 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 Processor -- start 2023-10-09T15:42:51.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 -- start start 2023-10-09T15:42:51.261 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62000675a0 0x7f62000c4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001595d0 0x7f620015aeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620015c270 con 0x7f620006b230 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f620015b3f0 con 0x7f62001595d0 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.254+0000 7f62062ab700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f620015b660 con 0x7f62000675a0 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59342/0 (socket says 172.21.15.33:59342) 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 -- 172.21.15.33:0/2175732194 learned_addr learned my addr 172.21.15.33:0/2175732194 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61fffff700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62000675a0 0x7f62000c4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f6204848700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001595d0 0x7f620015aeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 -- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62000675a0 msgr2=0x7f62000c4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62000675a0 0x7f62000c4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 -- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001595d0 msgr2=0x7f620015aeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001595d0 0x7f620015aeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 -- 172.21.15.33:0/2175732194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f8009ae0 con 0x7f620006b230 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61ff7fe700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f61f400ec80 tx=0x7f61f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400c850 con 0x7f620006b230 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f400c9b0 con 0x7f620006b230 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f620015b940 con 0x7f620006b230 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f400cd50 con 0x7f620006b230 2023-10-09T15:42:51.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.255+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f620015bf00 con 0x7f620006b230 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.256+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620004c3c0 con 0x7f620006b230 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.257+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f61f4013680 con 0x7f620006b230 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.257+0000 7f61e7fff700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 0x7f61ec0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.257+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f61f4084f20 con 0x7f620006b230 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.257+0000 7f61fffff700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 0x7f61ec0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.257+0000 7f61fffff700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 0x7f61ec0697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009d10 tx=0x7f61f00091a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.261+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f61f4051eb0 con 0x7f620006b230 2023-10-09T15:42:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.455+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f62000c7be0 con 0x7f61ec067320 2023-10-09T15:42:51.456 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.455+0000 7f61e7fff700 1 -- 172.21.15.33:0/2175732194 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f62000c7be0 con 0x7f61ec067320 2023-10-09T15:42:51.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 msgr2=0x7f61ec0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 0x7f61ec0697d0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f61f0009d10 tx=0x7f61f00091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 msgr2=0x7f620015a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f61f400ec80 tx=0x7f61f40091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 shutdown_connections 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f61ec067320 0x7f61ec0697d0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f62001595d0 0x7f620015aeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f62000675a0 0x7f62000c4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 --2- 172.21.15.33:0/2175732194 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f620006b230 0x7f620015a970 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 >> 172.21.15.33:0/2175732194 conn(0x7f62000cd400 msgr2=0x7f62000c2510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 shutdown_connections 2023-10-09T15:42:51.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.458+0000 7f62062ab700 1 -- 172.21.15.33:0/2175732194 wait complete. 2023-10-09T15:42:51.461 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 5 to deep-scrub 2023-10-09T15:42:51.471 INFO:tasks.ceph:Scrubbing osd.6 2023-10-09T15:42:51.471 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.593+0000 7f1869116700 1 Processor -- start 2023-10-09T15:42:51.595 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.593+0000 7f1869116700 1 -- start start 2023-10-09T15:42:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f1869116700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1864159940 0x7f18640b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f1869116700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18640af670 con 0x7f186406cdb0 2023-10-09T15:42:51.597 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f1869116700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18640aa2b0 con 0x7f18640b0e00 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f1869116700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18640b12a0 con 0x7f1864159940 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f1862d9d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7f1864159940 0x7f18640b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f186359e700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f186406cdb0 0x7f18640aa740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40530/0 (socket says 172.21.15.33:40530) 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.594+0000 7f186359e700 1 -- 172.21.15.33:0/23451426 learned_addr learned my addr 172.21.15.33:0/23451426 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1862d9d700 1 -- 172.21.15.33:0/23451426 >> v1:172.21.15.59:6789/0 conn(0x7f18640b0e00 legacy=0x7f186406c6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1862d9d700 1 -- 172.21.15.33:0/23451426 >> v1:172.21.15.33:6789/0 conn(0x7f186406cdb0 legacy=0x7f18640aa740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1862d9d700 1 -- 172.21.15.33:0/23451426 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1864159d10 con 0x7f1864159940 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1861d9b700 1 -- 172.21.15.33:0/23451426 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1633579646 0 0) 0x7f185c001490 con 0x7f186406cdb0 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1862d9d700 1 --2- 172.21.15.33:0/23451426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1864159940 0x7f18640b08c0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f18540098d0 tx=0x7f1854009120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c07f809de3af1bf8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1861d9b700 1 -- 172.21.15.33:0/23451426 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854009e70 con 0x7f1864159940 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1861d9b700 1 -- 172.21.15.33:0/23451426 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854005c10 con 0x7f1864159940 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1861d9b700 1 -- 172.21.15.33:0/23451426 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185400b650 con 0x7f1864159940 2023-10-09T15:42:51.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1869116700 1 -- 172.21.15.33:0/23451426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1864159940 msgr2=0x7f18640b08c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.595+0000 7f1869116700 1 --2- 172.21.15.33:0/23451426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1864159940 0x7f18640b08c0 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7f18540098d0 tx=0x7f1854009120 comp rx=0 tx=0).stop 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.596+0000 7f1869116700 1 -- 172.21.15.33:0/23451426 shutdown_connections 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.596+0000 7f1869116700 1 --2- 172.21.15.33:0/23451426 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f1864159940 0x7f18640b08c0 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.596+0000 7f1869116700 1 -- 172.21.15.33:0/23451426 >> 172.21.15.33:0/23451426 conn(0x7f18640cd3e0 msgr2=0x7f18640cd7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.596+0000 7f1869116700 1 -- 172.21.15.33:0/23451426 shutdown_connections 2023-10-09T15:42:51.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.596+0000 7f1869116700 1 -- 172.21.15.33:0/23451426 wait complete. 2023-10-09T15:42:51.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.597+0000 7f1869116700 1 Processor -- start 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.597+0000 7f1869116700 1 -- start start 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186406cdb0 0x7f1864155d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 0x7f186415afa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1864159940 0x7f1864068980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f186415ab10 con 0x7f18640b0e00 2023-10-09T15:42:51.605 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1864159f00 con 0x7f186406cdb0 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f186415a1e0 con 0x7f1864159940 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 0x7f186415afa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 0x7f186415afa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59368/0 (socket says 172.21.15.33:59368) 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 -- 172.21.15.33:0/811451275 learned_addr learned my addr 172.21.15.33:0/811451275 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1862d9d700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186406cdb0 0x7f1864155d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186359e700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1864159940 0x7f1864068980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 -- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1864159940 msgr2=0x7f1864068980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f1864159940 0x7f1864068980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 -- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186406cdb0 msgr2=0x7f1864155d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f186406cdb0 0x7f1864155d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18540093c0 con 0x7f18640b0e00 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f186259c700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 0x7f186415afa0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f185800c590 tx=0x7f185800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011590 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1858011710 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186415a4c0 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1858011ad0 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.598+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18641562b0 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.599+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f186404c3c0 con 0x7f18640b0e00 2023-10-09T15:42:51.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f185801b3b0 con 0x7f18640b0e00 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1850067320 0x7f18500697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f1858083da0 con 0x7f18640b0e00 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f1862d9d700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1850067320 0x7f18500697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7f185006d170 0x7f185006f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f185006fc50 con 0x7f185006d170 2023-10-09T15:42:51.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.600+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f1858086300 con 0x7f18640b0e00 2023-10-09T15:42:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.601+0000 7f186359e700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7f185006d170 0x7f185006f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.601+0000 7f1862d9d700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1850067320 0x7f18500697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1854009390 tx=0x7f1854016000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.601+0000 7f186359e700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7f185006d170 0x7f185006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.602+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== osd.6 v2:172.21.15.59:6824/91188 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f185006fc50 con 0x7f185006d170 2023-10-09T15:42:51.616 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 --> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f18640a9980 con 0x7f185006d170 2023-10-09T15:42:51.617 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f184affd700 1 -- 172.21.15.33:0/811451275 <== osd.6 v2:172.21.15.59:6824/91188 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f18640a9980 con 0x7f185006d170 2023-10-09T15:42:51.617 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:51.617 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:51.618 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:51.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7f185006d170 msgr2=0x7f185006f580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.618 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.59:6824/91188,v1:172.21.15.59:6825/91188] conn(0x7f185006d170 0x7f185006f580 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1850067320 msgr2=0x7f18500697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f1850067320 0x7f18500697d0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1854009390 tx=0x7f1854016000 comp rx=0 tx=0).stop 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 msgr2=0x7f186415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.616+0000 7f1869116700 1 --2- 172.21.15.33:0/811451275 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f18640b0e00 0x7f186415afa0 secure :-1 s=READY pgs=1873 cs=0 l=1 rev1=1 crypto rx=0x7f185800c590 tx=0x7f185800c8a0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.617+0000 7f186359e700 1 -- 172.21.15.33:0/811451275 reap_dead start 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.617+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 shutdown_connections 2023-10-09T15:42:51.619 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.617+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 >> 172.21.15.33:0/811451275 conn(0x7f18640cd3e0 msgr2=0x7f18640cc430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.617+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 shutdown_connections 2023-10-09T15:42:51.620 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.617+0000 7f1869116700 1 -- 172.21.15.33:0/811451275 wait complete. 2023-10-09T15:42:51.629 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-10-09T15:42:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.748+0000 7fc3e721c700 1 Processor -- start 2023-10-09T15:42:51.749 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.748+0000 7fc3e721c700 1 -- start start 2023-10-09T15:42:51.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e721c700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3e00cb5a0 0x7fc3e00cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.751 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e721c700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc3e015a5d0 0x7fc3e0156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e721c700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3e015ae40 con 0x7fc3e00cd9e0 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e721c700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e00d13f0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e721c700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3e015ab60 con 0x7fc3e015a5d0 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fc3e00cb5a0 0x7fc3e00cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3dffff700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc3e00cd9e0 0x7fc3e0159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40538/0 (socket says 172.21.15.33:40538) 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3dffff700 1 -- 172.21.15.33:0/1608580956 learned_addr learned my addr 172.21.15.33:0/1608580956 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e57b9700 1 --2- 172.21.15.33:0/1608580956 >> v2:172.21.15.59:3300/0 conn(0x7fc3e015a5d0 0x7fc3e0156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.752 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/1608580956 >> v2:172.21.15.59:3300/0 conn(0x7fc3e015a5d0 msgr2=0x7fc3e0156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 --2- 172.21.15.33:0/1608580956 >> v2:172.21.15.59:3300/0 conn(0x7fc3e015a5d0 0x7fc3e0156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/1608580956 >> v1:172.21.15.33:6789/0 conn(0x7fc3e00cd9e0 legacy=0x7fc3e0159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/1608580956 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e00ccf00 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3df7fe700 1 -- 172.21.15.33:0/1608580956 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3576143050 0 0) 0x7fc3e015ae40 con 0x7fc3e00cd9e0 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.749+0000 7fc3e4fb8700 1 --2- 172.21.15.33:0/1608580956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e00cb970 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40098e0 tx=0x7fc3d40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b27078bb224d5b47 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3df7fe700 1 -- 172.21.15.33:0/1608580956 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4009e80 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.753 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3df7fe700 1 -- 172.21.15.33:0/1608580956 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d400b820 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3df7fe700 1 -- 172.21.15.33:0/1608580956 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400bba0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 -- 172.21.15.33:0/1608580956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 msgr2=0x7fc3e00cb970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 --2- 172.21.15.33:0/1608580956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e00cb970 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7fc3d40098e0 tx=0x7fc3d40091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 -- 172.21.15.33:0/1608580956 shutdown_connections 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 --2- 172.21.15.33:0/1608580956 >> v2:172.21.15.59:3300/0 conn(0x7fc3e015a5d0 0x7fc3e0156e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 --2- 172.21.15.33:0/1608580956 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e00cb970 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 -- 172.21.15.33:0/1608580956 >> 172.21.15.33:0/1608580956 conn(0x7fc3e0070e30 msgr2=0x7fc3e00d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.754 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 -- 172.21.15.33:0/1608580956 shutdown_connections 2023-10-09T15:42:51.755 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.750+0000 7fc3e721c700 1 -- 172.21.15.33:0/1608580956 wait complete. 2023-10-09T15:42:51.757 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.751+0000 7fc3e721c700 1 Processor -- start 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.751+0000 7fc3e721c700 1 -- start start 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3e00cd9e0 0x7fc3e0159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 0x7fc3e0152da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0158fb0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e0151b40 con 0x7fc3e015a5d0 2023-10-09T15:42:51.758 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e721c700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e01583e0 con 0x7fc3e00cd9e0 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e4fb8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e4fb8700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59386/0 (socket says 172.21.15.33:59386) 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/51462137 learned_addr learned my addr 172.21.15.33:0/51462137 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3dffff700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3e00cd9e0 0x7fc3e0159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.752+0000 7fc3e57b9700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 0x7fc3e0152da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3e00cd9e0 msgr2=0x7fc3e0159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3e00cd9e0 0x7fc3e0159440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.759 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 msgr2=0x7fc3e0152da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 0x7fc3e0152da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 -- 172.21.15.33:0/51462137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3d4009420 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e57b9700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 0x7fc3e0152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e4fb8700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc3e006ea60 tx=0x7fc3d4017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d400bba0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3d4011420 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3d4011800 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.760 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3e0158680 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.753+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3e0158c40 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.754+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3e004c3c0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.755+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc3d4011b70 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.755+0000 7fc3dcff9700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 0x7fc3c40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.755+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc3d4086350 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.755+0000 7fc3dffff700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 0x7fc3c40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:51.761 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.756+0000 7fc3dffff700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 0x7fc3c40697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b6130 tx=0x7fc3cc009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:51.762 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.759+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc3d40533e0 con 0x7fc3e00cb5a0 2023-10-09T15:42:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.954+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fc3e01590f0 con 0x7fc3c4067320 2023-10-09T15:42:51.955 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.954+0000 7fc3dcff9700 1 -- 172.21.15.33:0/51462137 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc3cc001cc0 con 0x7fc3c4067320 2023-10-09T15:42:51.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 msgr2=0x7fc3c40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 0x7fc3c40697d0 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fc3e00b6130 tx=0x7fc3cc009040 comp rx=0 tx=0).stop 2023-10-09T15:42:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 msgr2=0x7fc3e0151600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 secure :-1 s=READY pgs=1876 cs=0 l=1 rev1=1 crypto rx=0x7fc3e006ea60 tx=0x7fc3d4017000 comp rx=0 tx=0).stop 2023-10-09T15:42:51.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 shutdown_connections 2023-10-09T15:42:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc3c4067320 0x7fc3c40697d0 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc3e00cb5a0 0x7fc3e0151600 unknown :-1 s=CLOSED pgs=1876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc3e015a5d0 0x7fc3e0152da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 --2- 172.21.15.33:0/51462137 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc3e00cd9e0 0x7fc3e0159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:51.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 >> 172.21.15.33:0/51462137 conn(0x7fc3e0070e30 msgr2=0x7fc3e0155360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:51.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 shutdown_connections 2023-10-09T15:42:51.960 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:51.956+0000 7fc3e721c700 1 -- 172.21.15.33:0/51462137 wait complete. 2023-10-09T15:42:51.960 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 6 to deep-scrub 2023-10-09T15:42:51.969 INFO:tasks.ceph:Scrubbing osd.7 2023-10-09T15:42:51.970 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-10-09T15:42:52.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.094+0000 7f813359e700 1 Processor -- start 2023-10-09T15:42:52.095 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.094+0000 7f813359e700 1 -- start start 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813359e700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 0x7f81340b4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813359e700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f81340b0c80 con 0x7f81340b1d40 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813359e700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81340d10d0 con 0x7f8134159800 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81340b0f60 con 0x7f81340b24f0 2023-10-09T15:42:52.098 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f8132d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 0x7f81340b4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813259c700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3301/0 says I am v2:172.21.15.33:59998/0 (socket says 172.21.15.33:59998) 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f8132d9d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 0x7f81340b4ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.59:3300/0 says I am v2:172.21.15.33:50814/0 (socket says 172.21.15.33:50814) 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f813259c700 1 -- 172.21.15.33:0/3126516662 learned_addr learned my addr 172.21.15.33:0/3126516662 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.095+0000 7f8131d9b700 1 --1- 172.21.15.33:0/3126516662 >> v1:172.21.15.59:6789/0 conn(0x7f81340b1d40 0x7f81341590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.59:6789/0 says I am v1:172.21.15.33:50166/0 (socket says 172.21.15.33:50166) 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813259c700 1 -- 172.21.15.33:0/3126516662 >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 msgr2=0x7f81340b4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813259c700 1 --2- 172.21.15.33:0/3126516662 >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 0x7f81340b4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.099 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813259c700 1 -- 172.21.15.33:0/3126516662 >> v1:172.21.15.59:6789/0 conn(0x7f81340b1d40 legacy=0x7f81341590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813259c700 1 -- 172.21.15.33:0/3126516662 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81340b1240 con 0x7f81340b24f0 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813259c700 1 --2- 172.21.15.33:0/3126516662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f812c0099b0 tx=0x7f812c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=52a149df6b6e1476 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813159a700 1 -- 172.21.15.33:0/3126516662 <== mon.2 v2:172.21.15.59:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c009ea0 con 0x7f81340b24f0 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813159a700 1 -- 172.21.15.33:0/3126516662 <== mon.2 v2:172.21.15.59:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00b860 con 0x7f81340b24f0 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813159a700 1 -- 172.21.15.33:0/3126516662 <== mon.2 v2:172.21.15.59:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c00bc00 con 0x7f81340b24f0 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.096+0000 7f813359e700 1 -- 172.21.15.33:0/3126516662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 msgr2=0x7f81340b0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 --2- 172.21.15.33:0/3126516662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f812c0099b0 tx=0x7f812c009250 comp rx=0 tx=0).stop 2023-10-09T15:42:52.100 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 -- 172.21.15.33:0/3126516662 shutdown_connections 2023-10-09T15:42:52.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 --2- 172.21.15.33:0/3126516662 >> v2:172.21.15.59:3300/0 conn(0x7f8134159800 0x7f81340b4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 --2- 172.21.15.33:0/3126516662 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f81340b24f0 0x7f81340b0580 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 -- 172.21.15.33:0/3126516662 >> 172.21.15.33:0/3126516662 conn(0x7f81340703a0 msgr2=0x7f81340707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 -- 172.21.15.33:0/3126516662 shutdown_connections 2023-10-09T15:42:52.101 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.097+0000 7f813359e700 1 -- 172.21.15.33:0/3126516662 wait complete. 2023-10-09T15:42:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 Processor -- start 2023-10-09T15:42:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 -- start start 2023-10-09T15:42:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 0x7f8134153d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81340b24f0 0x7f81340a8d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.104 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8134159800 0x7f81340a9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f813415dab0 con 0x7f81340b1d40 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8134154240 con 0x7f81340b24f0 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.098+0000 7f813359e700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f813415cf30 con 0x7f8134159800 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 0x7f8134153d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 0x7f8134153d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59400/0 (socket says 172.21.15.33:59400) 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 -- 172.21.15.33:0/3685572671 learned_addr learned my addr 172.21.15.33:0/3685572671 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f8132d9d700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8134159800 0x7f81340a9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.105 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f8131d9b700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81340b24f0 0x7f81340a8d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 -- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8134159800 msgr2=0x7f81340a9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f8134159800 0x7f81340a9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 -- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81340b24f0 msgr2=0x7f81340a8d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f81340b24f0 0x7f81340a8d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f812c0094f0 con 0x7f81340b1d40 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813259c700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 0x7f8134153d00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f81340b10a0 tx=0x7f812c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.106 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c000d10 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f812c00bbe0 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f813415d210 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f812c011670 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.099+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f813415d7d0 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.100+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f813404c3c0 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f812c011aa0 con 0x7f81340b1d40 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8114067320 0x7f81140697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.107 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f812c086cc0 con 0x7f81340b1d40 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f8131d9b700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8114067320 0x7f81140697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7f811406d000 0x7f811406f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f811406fae0 con 0x7f811406d000 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.101+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_get_version_reply(handle=1 version=205) v2 ==== 24+0+0 (secure 0 0 0) 0x7f812c086fd0 con 0x7f81340b1d40 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.102+0000 7f8132d9d700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7f811406d000 0x7f811406f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.102+0000 7f8131d9b700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8114067320 0x7f81140697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f81340ce2e0 tx=0x7f811c007eb0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.102+0000 7f8132d9d700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7f811406d000 0x7f811406f410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.108 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.103+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== osd.7 v2:172.21.15.59:6816/91145 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23999 (crc 0 0 0) 0x7f811406fae0 con 0x7f811406d000 2023-10-09T15:42:52.117 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 --> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81340aff80 con 0x7f811406d000 2023-10-09T15:42:52.118 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f812a7fc700 1 -- 172.21.15.33:0/3685572671 <== osd.7 v2:172.21.15.59:6816/91145 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+105 (crc 0 0 0) 0x7f81340aff80 con 0x7f811406d000 2023-10-09T15:42:52.118 INFO:teuthology.orchestra.run.smithi033.stdout:{ 2023-10-09T15:42:52.119 INFO:teuthology.orchestra.run.smithi033.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " 2023-10-09T15:42:52.119 INFO:teuthology.orchestra.run.smithi033.stdout:} 2023-10-09T15:42:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7f811406d000 msgr2=0x7f811406f410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.59:6816/91145,v1:172.21.15.59:6817/91145] conn(0x7f811406d000 0x7f811406f410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8114067320 msgr2=0x7f81140697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f8114067320 0x7f81140697d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f81340ce2e0 tx=0x7f811c007eb0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.120 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 msgr2=0x7f8134153d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.117+0000 7f813359e700 1 --2- 172.21.15.33:0/3685572671 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f81340b1d40 0x7f8134153d00 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f81340b10a0 tx=0x7f812c017000 comp rx=0 tx=0).stop 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.118+0000 7f8132d9d700 1 -- 172.21.15.33:0/3685572671 reap_dead start 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.118+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 shutdown_connections 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.118+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 >> 172.21.15.33:0/3685572671 conn(0x7f81340703a0 msgr2=0x7f81340af430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.118+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 shutdown_connections 2023-10-09T15:42:52.121 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.118+0000 7f813359e700 1 -- 172.21.15.33:0/3685572671 wait complete. 2023-10-09T15:42:52.130 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-10-09T15:42:52.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.249+0000 7fc970a6d700 1 Processor -- start 2023-10-09T15:42:52.250 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.249+0000 7fc970a6d700 1 -- start start 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc970a6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0cb5a0 0x7fc96c0cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc970a6d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fc96c0cde50 0x7fc96c156e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc970a6d700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc96c15ae40 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc970a6d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc96c0d13f0 con 0x7fc96c0cde50 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc970a6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15ab60 con 0x7fc96c0cb5a0 2023-10-09T15:42:52.254 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc969d9b700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fc96c0cd9e0 0x7fc96c159ec0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40544/0 (socket says 172.21.15.33:40544) 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.250+0000 7fc969d9b700 1 -- 172.21.15.33:0/935595740 learned_addr learned my addr 172.21.15.33:0/935595740 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96a59c700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0cb5a0 0x7fc96c0cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/935595740 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0cde50 0x7fc96c156e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 259555304 0 0) 0x7fc96c15ae40 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc958003570 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2247558855 0 0) 0x7fc958003570 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0cb5a0 msgr2=0x7fc96c0cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.255 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0cb5a0 0x7fc96c0cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0cde50 msgr2=0x7fc96c156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 --2- 172.21.15.33:0/935595740 >> v2:172.21.15.59:3300/0 conn(0x7fc96c0cde50 0x7fc96c156e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c0ccf00 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7fc954001470 con 0x7fc96c0cd9e0 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 >> v1:172.21.15.33:6789/0 conn(0x7fc96c0cd9e0 legacy=0x7fc96c159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc958003a60 0x7fc958003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc958004810 0x7fc958004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.256 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9580051c0 0x7fc95800ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c15ab60 con 0x7fc9580051c0 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc958004680 con 0x7fc958003a60 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95800c020 con 0x7fc958004810 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96a59c700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c0cb5a0 0x7fc96c0cb970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9580051c0 0x7fc95800ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc969d9b700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc958004810 0x7fc958004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96a59c700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc958003a60 0x7fc958003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.257 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 -- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc958004810 msgr2=0x7fc958004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc958004810 0x7fc958004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 -- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc958003a60 msgr2=0x7fc958003e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.251+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc958003a60 0x7fc958003e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96ad9d700 1 -- 172.21.15.33:0/935595740 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc958003570 con 0x7fc9580051c0 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96a59c700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc958003a60 0x7fc958003e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9580051c0 0x7fc95800ba60 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fc964009c00 tx=0x7fc9640091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=882cdab350e327f7 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400e710 con 0x7fc9580051c0 2023-10-09T15:42:52.258 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc96400e870 con 0x7fc9580051c0 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96959a700 1 -- 172.21.15.33:0/935595740 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc96400ec30 con 0x7fc9580051c0 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc970a6d700 1 -- 172.21.15.33:0/935595740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9580051c0 msgr2=0x7fc95800ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc970a6d700 1 --2- 172.21.15.33:0/935595740 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc9580051c0 0x7fc95800ba60 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fc964009c00 tx=0x7fc9640091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc96ad9d700 1 -- 172.21.15.33:0/935595740 reap_dead start 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc970a6d700 1 -- 172.21.15.33:0/935595740 shutdown_connections 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc970a6d700 1 -- 172.21.15.33:0/935595740 >> 172.21.15.33:0/935595740 conn(0x7fc96c070e30 msgr2=0x7fc96c0d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.252+0000 7fc970a6d700 1 -- 172.21.15.33:0/935595740 shutdown_connections 2023-10-09T15:42:52.259 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.253+0000 7fc970a6d700 1 -- 172.21.15.33:0/935595740 wait complete. 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 Processor -- start 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 -- start start 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9580051c0 0x7fc96c144430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c159320 0x7fc96c1597a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c144970 con 0x7fc96c155d60 2023-10-09T15:42:52.262 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c158280 con 0x7fc9580051c0 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc970a6d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc96c158560 con 0x7fc96c159320 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc969d9b700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59424/0 (socket says 172.21.15.33:59424) 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc969d9b700 1 -- 172.21.15.33:0/644641469 learned_addr learned my addr 172.21.15.33:0/644641469 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc96ad9d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c159320 0x7fc96c1597a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.254+0000 7fc96a59c700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9580051c0 0x7fc96c144430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 -- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c159320 msgr2=0x7fc96c1597a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.263 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c159320 0x7fc96c1597a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 -- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9580051c0 msgr2=0x7fc96c144430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9580051c0 0x7fc96c144430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 -- 172.21.15.33:0/644641469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc96c158840 con 0x7fc96c155d60 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc969d9b700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fc954007390 tx=0x7fc954001e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954018030 con 0x7fc96c155d60 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95400f640 con 0x7fc96c155d60 2023-10-09T15:42:52.264 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95400fa00 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc96c158b20 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.255+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc96c145110 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.256+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc96c159040 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.256+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fc95401b070 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.257+0000 7fc9627fc700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 0x7fc94c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.257+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fc954019070 con 0x7fc96c155d60 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.257+0000 7fc96a59c700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 0x7fc94c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.265 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.257+0000 7fc96a59c700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 0x7fc94c0697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b2a40 tx=0x7fc95c00b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.266 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.261+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fc96c159040 con 0x7fc96c155d60 2023-10-09T15:42:52.459 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.458+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7fc96c159040 con 0x7fc94c067320 2023-10-09T15:42:52.460 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.458+0000 7fc9627fc700 1 -- 172.21.15.33:0/644641469 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fc96c159040 con 0x7fc94c067320 2023-10-09T15:42:52.461 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 msgr2=0x7fc94c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 0x7fc94c0697d0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fc96c0b2a40 tx=0x7fc95c00b040 comp rx=0 tx=0).stop 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 msgr2=0x7fc96c144bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fc954007390 tx=0x7fc954001e90 comp rx=0 tx=0).stop 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 shutdown_connections 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fc94c067320 0x7fc94c0697d0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fc96c159320 0x7fc96c1597a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.462 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fc9580051c0 0x7fc96c144430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 --2- 172.21.15.33:0/644641469 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fc96c155d60 0x7fc96c144bd0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.460+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 >> 172.21.15.33:0/644641469 conn(0x7fc96c070e30 msgr2=0x7fc96c0b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.461+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 shutdown_connections 2023-10-09T15:42:52.463 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.461+0000 7fc970a6d700 1 -- 172.21.15.33:0/644641469 wait complete. 2023-10-09T15:42:52.464 INFO:teuthology.orchestra.run.smithi033.stderr:instructed osd(s) 7 to deep-scrub 2023-10-09T15:42:52.474 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:42:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.593+0000 7f5609a4a700 1 Processor -- start 2023-10-09T15:42:52.594 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.593+0000 7f5609a4a700 1 -- start start 2023-10-09T15:42:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f5609a4a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7f56040cb5a0 0x7f56040cb970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.598 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f5609a4a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560415ae40 con 0x7f560415a5d0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f5609a4a700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560415ab60 con 0x7f56040cd9e0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f5609a4a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56040d13f0 con 0x7f56040cb5a0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f56037fe700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7f560415a5d0 0x7f5604156e90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:40556/0 (socket says 172.21.15.33:40556) 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f56037fe700 1 -- 172.21.15.33:0/3979120215 learned_addr learned my addr 172.21.15.33:0/3979120215 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.594+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3979120215 >> v2:172.21.15.59:3300/0 conn(0x7f56040cb5a0 0x7f56040cb970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 928236139 0 0) 0x7f560415ae40 con 0x7f560415a5d0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55f0003570 con 0x7f560415a5d0 2023-10-09T15:42:52.599 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v1:172.21.15.33:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1184842285 0 0) 0x7f55f0003570 con 0x7f560415a5d0 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 >> v2:172.21.15.59:3300/0 conn(0x7f56040cb5a0 msgr2=0x7f56040cb970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 --2- 172.21.15.33:0/3979120215 >> v2:172.21.15.59:3300/0 conn(0x7f56040cb5a0 0x7f56040cb970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 >> v1:172.21.15.59:6789/0 conn(0x7f56040cd9e0 legacy=0x7f5604159ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 --> v1:172.21.15.33:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56040ccf00 con 0x7f560415a5d0 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v1:172.21.15.33:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 669702962 0 0) 0x7f55fc0017f0 con 0x7f560415a5d0 2023-10-09T15:42:52.600 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 >> v1:172.21.15.33:6789/0 conn(0x7f560415a5d0 legacy=0x7f5604156e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 0x7f55f0003e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0004810 0x7f55f0004c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55f00051c0 0x7f55f000ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f000c0a0 con 0x7f55f0003a60 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f000c210 con 0x7f55f0004810 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f000c3d0 con 0x7f55f00051c0 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 0x7f55f0003e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.601 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f56027fc700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0004810 0x7f55f0004c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f56037fe700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55f00051c0 0x7f55f000ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 -- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55f00051c0 msgr2=0x7f55f000ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f55f00051c0 0x7f55f000ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 -- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0004810 msgr2=0x7f55f0004c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0004810 0x7f55f0004c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 -- 172.21.15.33:0/3979120215 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f0003570 con 0x7f55f0003a60 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f56037fe700 1 -- 172.21.15.33:0/3979120215 reap_dead start 2023-10-09T15:42:52.602 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f56027fc700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0004810 0x7f55f0004c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.595+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 0x7f55f0003e70 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009c00 tx=0x7f55f40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6570b8dc016cfde server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400e710 con 0x7f55f0003a60 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f400e870 con 0x7f55f0003a60 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5601ffb700 1 -- 172.21.15.33:0/3979120215 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f400ec30 con 0x7f55f0003a60 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 -- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 msgr2=0x7f55f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 0x7f55f0003e70 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7f55f4009c00 tx=0x7f55f40091a0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 -- 172.21.15.33:0/3979120215 shutdown_connections 2023-10-09T15:42:52.603 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3979120215 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f55f0003a60 0x7f55f0003e70 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 -- 172.21.15.33:0/3979120215 >> 172.21.15.33:0/3979120215 conn(0x7f5604070e30 msgr2=0x7f56040d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 -- 172.21.15.33:0/3979120215 shutdown_connections 2023-10-09T15:42:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.596+0000 7f5609a4a700 1 -- 172.21.15.33:0/3979120215 wait complete. 2023-10-09T15:42:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.597+0000 7f5609a4a700 1 Processor -- start 2023-10-09T15:42:52.604 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 -- start start 2023-10-09T15:42:52.606 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0003a60 0x7f560415b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56040cecf0 0x7f56040cf160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56040cf6a0 con 0x7f56041512e0 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560415b5b0 con 0x7f55f0003a60 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f5609a4a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560415b830 con 0x7f56040cecf0 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f56027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f56027fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:59446/0 (socket says 172.21.15.33:59446) 2023-10-09T15:42:52.607 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.598+0000 7f56027fc700 1 -- 172.21.15.33:0/3857280806 learned_addr learned my addr 172.21.15.33:0/3857280806 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56037fe700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56040cecf0 0x7f56040cf160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0003a60 0x7f560415b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 -- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56040cecf0 msgr2=0x7f56040cf160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56040cecf0 0x7f56040cf160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 -- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0003a60 msgr2=0x7f560415b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0003a60 0x7f560415b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.608 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 -- 172.21.15.33:0/3857280806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560415bb10 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f56027fc700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00e5e0 tx=0x7f55ec009040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec0115c0 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ec011720 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560415bdf0 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ec011aa0 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.599+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5604151070 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.600+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560415c440 con 0x7f56041512e0 2023-10-09T15:42:52.609 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.601+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7f55ec014480 con 0x7f56041512e0 2023-10-09T15:42:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.601+0000 7f55faffd700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 0x7f55e40697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:42:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.601+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7f55ec0841a0 con 0x7f56041512e0 2023-10-09T15:42:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.601+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 0x7f55e40697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:42:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.601+0000 7f5602ffd700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 0x7f55e40697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f55f40091e0 tx=0x7f55f401a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:42:52.610 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.605+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7f55ec04d5a0 con 0x7f56041512e0 2023-10-09T15:42:52.794 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.793+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f560415c290 con 0x7f55e4067320 2023-10-09T15:42:52.796 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.795+0000 7f55faffd700 1 -- 172.21.15.33:0/3857280806 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50565 (secure 0 0 0) 0x7f560415c290 con 0x7f55e4067320 2023-10-09T15:42:52.797 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:42:52.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 msgr2=0x7f55e40697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.798 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 0x7f55e40697d0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f55f40091e0 tx=0x7f55f401a000 comp rx=0 tx=0).stop 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 msgr2=0x7f5604150b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f55ec00e5e0 tx=0x7f55ec009040 comp rx=0 tx=0).stop 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 shutdown_connections 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7f55e4067320 0x7f55e40697d0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7f56040cecf0 0x7f56040cf160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.799 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7f55f0003a60 0x7f560415b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 --2- 172.21.15.33:0/3857280806 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7f56041512e0 0x7f5604150b30 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:42:52.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 >> 172.21.15.33:0/3857280806 conn(0x7f5604070e30 msgr2=0x7f56040b0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:42:52.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 shutdown_connections 2023-10-09T15:42:52.800 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:42:52.797+0000 7f5609a4a700 1 -- 172.21.15.33:0/3857280806 wait complete. 2023-10-09T15:42:52.800 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:42:52.810 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":557,"stamp":"2023-10-09T15:42:51.384496+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2432644,"kb_used_data":21572,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542076,"statfs":{"total":773094113280,"available":770603085824,"internally_reserved":0,"allocated":22089728,"data_stored":10599805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.530006"},"pg_stats":[{"pgid":"1.0","version":"16'117","reported_seq":319,"reported_epoch":204,"state":"active+clean","last_fresh":"2023-10-09T15:42:43.106719+0000","last_change":"2023-10-09T15:30:55.024498+0000","last_active":"2023-10-09T15:42:43.106719+0000","last_peered":"2023-10-09T15:42:43.106719+0000","last_clean":"2023-10-09T15:42:43.106719+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:42:43.106719+0000","last_undegraded":"2023-10-09T15:42:43.106719+0000","last_fullsized":"2023-10-09T15:42:43.106719+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-10-09T15:30:53.594429+0000","last_clean_scrub_stamp":"2023-10-09T15:30:53.594429+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-10-11T00:50:07.641615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574995,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1767878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.67400000000000004}]},{"osd":1,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.85199999999999998,"15min":0.874},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.55700000000000005}]},{"osd":2,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.65600000000000003}]},{"osd":3,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.626},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86699999999999999},"last":0.52600000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.47299999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"last":0.38}]},{"osd":6,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.96999999999999997,"15min":0.97099999999999997},"last":0.503},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":1.288,"15min":1.288},"last":0.39700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.443,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.90400000000000003},"last":0.57099999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":1.379},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.504,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85799999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.39900000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":1.3999999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58299999999999996,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.3419999999999996},"last":0.495}]},{"osd":3,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.84999999999999998,"15min":1.3560000000000001},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.51500000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73599999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.628}]},{"osd":5,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.61699999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.004},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.64200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574996,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35199999999999998},"min":{"1min":0.254,"5min":0.224,"15min":0.215},"max":{"1min":0.72399999999999998,"5min":1.415,"15min":1.415},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.372,"15min":0.374},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.512},"last":0.44700000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.221},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.286},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.43099999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.65600000000000003,"5min":1.077,"15min":1.077},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.437},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.50700000000000001}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":1.0469999999999999,"15min":1.222},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.754}]},{"osd":5,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4410000000000001},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.82199999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.88},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.57499999999999996,"5min":0.41299999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2310000000000001,"15min":1.258},"last":0.89200000000000002}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.55600000000000005,"5min":0.42499999999999999,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":1.218,"15min":1.218},"last":0.83599999999999997},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41999999999999998,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1859999999999999,"15min":5.5819999999999999},"last":0.80500000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574994,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304512,"kb_used_data":3128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067328,"statfs":{"total":96636764160,"available":96324943872,"internally_reserved":0,"allocated":3203072,"data_stored":1766867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":2.1520000000000001},"last":0.311},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":2.0859999999999999},"last":0.35499999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.40999999999999998},"min":{"1min":0.316,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.52900000000000003,"5min":0.89600000000000002,"15min":6.484},"last":0.372},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":0.65100000000000002,"15min":6.2859999999999996},"last":0.26200000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38900000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":4.5190000000000001},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.53200000000000003},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":4.5890000000000004},"last":0.437}]},{"osd":4,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.921},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.93100000000000005,"15min":1.508},"last":0.56000000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":1.0509999999999999},"last":0.626},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":4.1020000000000003},"last":0.75900000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.56000000000000005,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0960000000000001,"15min":3.9009999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.59499999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.98599999999999999,"15min":1.9810000000000001},"last":0.61299999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.032},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.56999999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.66200000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.69799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.253}]},{"osd":1,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.375,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.627,"5min":0.67600000000000005,"15min":0.73699999999999999},"last":0.32600000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.624,"5min":0.628,"15min":0.67500000000000004},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.374}]},{"osd":4,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.46700000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.439},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.34999999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":2.5249999999999999},"last":0.51400000000000001}]},{"osd":6,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95899999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.47799999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.407},"last":0.432},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.50600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574993,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.318,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51000000000000001,"5min":0.58099999999999996,"15min":1.2270000000000001},"last":0.379},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.62},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":17.085999999999999},"last":0.441}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.495,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.40200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":1.3049999999999999},"last":0.40799999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.86799999999999999},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.247},"max":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45300000000000001,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.46300000000000002}]},{"osd":4,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.83999999999999997},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.32000000000000001},"max":{"1min":0.81200000000000006,"5min":0.996,"15min":17.02},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56100000000000005,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.92400000000000004,"5min":0.98399999999999999,"15min":9.6969999999999992},"last":0.65400000000000003}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.878,"5min":0.96299999999999997,"15min":5.3460000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66800000000000004,"15min":0.871},"min":{"1min":0.54800000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.92100000000000004,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.69099999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89200000000000002,"5min":0.999,"15min":9.7319999999999993},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.016,"15min":1.278},"last":0.63300000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.90700000000000003},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":17.053999999999998},"last":0.71799999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95499999999999996,"5min":1.024,"15min":9.6029999999999998},"last":0.622}]}]},{"osd":4,"up_from":13,"seq":55834574994,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.875,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.55600000000000005}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":2.879},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.498,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.52500000000000002}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":1.3580000000000001},"last":0.39000000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.751,"5min":1.089,"15min":1.089},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.879,"5min":1.222,"15min":1.222},"last":0.77100000000000002}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83699999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.79000000000000004}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.625},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.202,"15min":1.202},"last":0.85599999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574995,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.87},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.45000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":1.165},"last":0.60799999999999998}]},{"osd":1,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":2.089},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.51600000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56000000000000005,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":11.055},"last":0.71099999999999997},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.74299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":11.092000000000001},"last":0.48499999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.748},"min":{"1min":0.504,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.58999999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.5,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.82199999999999995,"15min":1.0569999999999999},"last":0.74199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.72399999999999998}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.76800000000000002},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.68100000000000005}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:42:52.815 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-10-09T15:30:53.594429+0000 time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=15, tm_min=30, tm_sec=53, tm_wday=0, tm_yday=282, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=10, tm_mday=9, tm_hour=15, tm_min=42, tm_sec=47, tm_wday=0, tm_yday=282, tm_isdst=0) 2023-10-09T15:42:52.815 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-10-09T15:43:07.685 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:07.688 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:12.816 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-10-09T15:43:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 Processor -- start 2023-10-09T15:43:12.950 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 -- start start 2023-10-09T15:43:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff26c0a90d0 0x7ff26c06de40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.951 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7ff26c06e380 0x7ff26c0af370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff26c0aeee0 con 0x7ff26c0a8d00 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c06e820 con 0x7ff26c0a90d0 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.950+0000 7ff271512700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff26c0ae680 con 0x7ff26c06e380 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff26c0a90d0 0x7ff26c06de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7ff26c0a90d0 0x7ff26c06de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52482/0 (socket says 172.21.15.33:52482) 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 -- 172.21.15.33:0/2124748220 learned_addr learned my addr 172.21.15.33:0/2124748220 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:43:12.952 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26b7fe700 1 --2- 172.21.15.33:0/2124748220 >> v2:172.21.15.59:3300/0 conn(0x7ff26c06e380 0x7ff26c0af370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 -- 172.21.15.33:0/2124748220 >> v2:172.21.15.59:3300/0 conn(0x7ff26c06e380 msgr2=0x7ff26c0af370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 --2- 172.21.15.33:0/2124748220 >> v2:172.21.15.59:3300/0 conn(0x7ff26c06e380 0x7ff26c0af370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 -- 172.21.15.33:0/2124748220 >> v1:172.21.15.59:6789/0 conn(0x7ff26c0a8d00 legacy=0x7ff26c0cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 -- 172.21.15.33:0/2124748220 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff26c0cf490 con 0x7ff26c0a90d0 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff26a7fc700 1 --2- 172.21.15.33:0/2124748220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a90d0 0x7ff26c06de40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff254009990 tx=0x7ff254009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72807a17579f0efd server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff269ffb700 1 -- 172.21.15.33:0/2124748220 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254009e80 con 0x7ff26c0a90d0 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff269ffb700 1 -- 172.21.15.33:0/2124748220 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff254005c10 con 0x7ff26c0a90d0 2023-10-09T15:43:12.953 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.951+0000 7ff269ffb700 1 -- 172.21.15.33:0/2124748220 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25400b610 con 0x7ff26c0a90d0 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 -- 172.21.15.33:0/2124748220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a90d0 msgr2=0x7ff26c06de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 --2- 172.21.15.33:0/2124748220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a90d0 0x7ff26c06de40 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7ff254009990 tx=0x7ff254009220 comp rx=0 tx=0).stop 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 -- 172.21.15.33:0/2124748220 shutdown_connections 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 --2- 172.21.15.33:0/2124748220 >> v2:172.21.15.59:3300/0 conn(0x7ff26c06e380 0x7ff26c0af370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 --2- 172.21.15.33:0/2124748220 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a90d0 0x7ff26c06de40 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 -- 172.21.15.33:0/2124748220 >> 172.21.15.33:0/2124748220 conn(0x7ff26c06ce80 msgr2=0x7ff26c0ce520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 -- 172.21.15.33:0/2124748220 shutdown_connections 2023-10-09T15:43:12.957 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.952+0000 7ff271512700 1 -- 172.21.15.33:0/2124748220 wait complete. 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.953+0000 7ff271512700 1 Processor -- start 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.953+0000 7ff271512700 1 -- start start 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c06e380 0x7ff26c152b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a90d0 0x7ff26c157f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c157700 con 0x7ff26c0a8d00 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c15bae0 con 0x7ff26c0a90d0 2023-10-09T15:43:12.958 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff271512700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff26c15b1b0 con 0x7ff26c06e380 2023-10-09T15:43:12.959 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52484/0 (socket says 172.21.15.33:52484) 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 -- 172.21.15.33:0/1670632404 learned_addr learned my addr 172.21.15.33:0/1670632404 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26b7fe700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a90d0 0x7ff26c157f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26affd700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c06e380 0x7ff26c152b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 -- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c06e380 msgr2=0x7ff26c152b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:12.961 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c06e380 0x7ff26c152b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 -- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a90d0 msgr2=0x7ff26c157f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.954+0000 7ff26a7fc700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a90d0 0x7ff26c157f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff26a7fc700 1 -- 172.21.15.33:0/1670632404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff254009480 con 0x7ff26c0a8d00 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff26a7fc700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7ff254012000 tx=0x7ff254016000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff254011b40 con 0x7ff26c0a8d00 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff254011ca0 con 0x7ff26c0a8d00 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff26c15b490 con 0x7ff26c0a8d00 2023-10-09T15:43:12.962 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff25401b680 con 0x7ff26c0a8d00 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.955+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff26c15c4b0 con 0x7ff26c0a8d00 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.956+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff26c15bc90 con 0x7ff26c0a8d00 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.956+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7ff25401ba70 con 0x7ff26c0a8d00 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.957+0000 7ff262ffd700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 0x7ff24c0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.957+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7ff254086240 con 0x7ff26c0a8d00 2023-10-09T15:43:12.963 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.957+0000 7ff26affd700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 0x7ff24c0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.957+0000 7ff26affd700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 0x7ff24c0697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c580 tx=0x7ff25c001b20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:12.964 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:12.961+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7ff26c15bc90 con 0x7ff26c0a8d00 2023-10-09T15:43:13.150 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.149+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 --> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff26c15bc50 con 0x7ff24c067320 2023-10-09T15:43:13.152 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.152+0000 7ff262ffd700 1 -- 172.21.15.33:0/1670632404 <== mgr.4102 v2:172.21.15.33:6832/90672 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50573 (secure 0 0 0) 0x7ff26c15bc50 con 0x7ff24c067320 2023-10-09T15:43:13.153 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:43:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.153+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 msgr2=0x7ff24c0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.153+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 0x7ff24c0697d0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7ff25c00c580 tx=0x7ff25c001b20 comp rx=0 tx=0).stop 2023-10-09T15:43:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.153+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 msgr2=0x7ff26c15bf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7ff254012000 tx=0x7ff254016000 comp rx=0 tx=0).stop 2023-10-09T15:43:13.154 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 shutdown_connections 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7ff24c067320 0x7ff24c0697d0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7ff26c0a90d0 0x7ff26c157f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7ff26c06e380 0x7ff26c152b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 --2- 172.21.15.33:0/1670632404 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7ff26c0a8d00 0x7ff26c15bf70 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 >> 172.21.15.33:0/1670632404 conn(0x7ff26c06ce80 msgr2=0x7ff26c0cd660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 shutdown_connections 2023-10-09T15:43:13.155 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.154+0000 7ff271512700 1 -- 172.21.15.33:0/1670632404 wait complete. 2023-10-09T15:43:13.156 INFO:teuthology.orchestra.run.smithi033.stderr:dumped all 2023-10-09T15:43:13.166 INFO:teuthology.orchestra.run.smithi033.stdout:{"pg_ready":true,"pg_map":{"version":567,"stamp":"2023-10-09T15:43:11.388783+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":2432644,"kb_used_data":21572,"kb_used_omap":0,"kb_used_meta":2411008,"kb_avail":752542076,"statfs":{"total":773094113280,"available":770603085824,"internally_reserved":0,"allocated":22089728,"data_stored":10599805,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":2468872192},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002477"},"pg_stats":[{"pgid":"1.0","version":"205'119","reported_seq":332,"reported_epoch":205,"state":"active+clean","last_fresh":"2023-10-09T15:42:52.570476+0000","last_change":"2023-10-09T15:42:52.570444+0000","last_active":"2023-10-09T15:42:52.570476+0000","last_peered":"2023-10-09T15:42:52.570476+0000","last_clean":"2023-10-09T15:42:52.570476+0000","last_became_active":"2023-10-09T15:30:55.023444+0000","last_became_peered":"2023-10-09T15:30:55.023444+0000","last_unstale":"2023-10-09T15:42:52.570476+0000","last_undegraded":"2023-10-09T15:42:52.570476+0000","last_fullsized":"2023-10-09T15:42:52.570476+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"205'119","last_scrub_stamp":"2023-10-09T15:42:52.570323+0000","last_deep_scrub":"205'119","last_deep_scrub_stamp":"2023-10-09T15:42:52.570323+0000","last_clean_scrub_stamp":"2023-10-09T15:42:52.570323+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-10-10T17:07:29.417119+0000","scrub_duration":0.0046431529999999997,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304516,"kb_used_data":3132,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067324,"statfs":{"total":96636764160,"available":96324939776,"internally_reserved":0,"allocated":3207168,"data_stored":1767878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.443,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.82199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.56599999999999995,"15min":0.54600000000000004},"min":{"1min":0.371,"5min":0.313,"15min":0.28299999999999997},"max":{"1min":0.76500000000000001,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63100000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.53900000000000003,"15min":0.52700000000000002},"min":{"1min":0.40100000000000002,"5min":0.34000000000000002,"15min":0.32600000000000001},"max":{"1min":0.76100000000000001,"5min":0.85199999999999998,"15min":0.874},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.38200000000000001,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.76200000000000001,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.51200000000000001}]},{"osd":2,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.56699999999999995,"15min":0.55000000000000004},"min":{"1min":0.38,"5min":0.36699999999999999,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56799999999999995,"15min":0.55800000000000005},"min":{"1min":0.436,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.73899999999999999,"5min":0.88700000000000001,"15min":0.88700000000000001},"last":0.47999999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.59599999999999997,"15min":0.58199999999999996},"min":{"1min":0.35299999999999998,"5min":0.314,"15min":0.314},"max":{"1min":0.74099999999999999,"5min":1.2150000000000001,"15min":1.2150000000000001},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.60899999999999999,"15min":0.60599999999999998},"min":{"1min":0.44500000000000001,"5min":0.38500000000000001,"15min":0.35699999999999998},"max":{"1min":0.745,"5min":0.79700000000000004,"15min":0.86699999999999999},"last":0.66200000000000003}]},{"osd":4,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.53600000000000003,"15min":0.53900000000000003},"min":{"1min":0.315,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70799999999999996,"5min":0.83799999999999997,"15min":0.89000000000000001},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.495,"5min":0.57599999999999996,"15min":0.56799999999999995},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.33500000000000002},"max":{"1min":0.79600000000000004,"5min":1.3340000000000001,"15min":1.3340000000000001},"last":0.67900000000000005}]},{"osd":5,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.56299999999999994,"15min":0.57699999999999996},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.752,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.58899999999999997,"15min":0.59499999999999997},"min":{"1min":0.40200000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"max":{"1min":0.82299999999999995,"5min":0.91900000000000004,"15min":0.93500000000000005},"last":0.69599999999999995}]},{"osd":6,"last update":"Mon Oct 9 15:42:12 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.66400000000000003,"15min":0.66000000000000003},"min":{"1min":0.45400000000000001,"5min":0.45400000000000001,"15min":0.42999999999999999},"max":{"1min":0.78100000000000003,"5min":0.96999999999999997,"15min":0.97099999999999997},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.64900000000000002,"15min":0.65400000000000003},"min":{"1min":0.41099999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80300000000000005,"5min":1.288,"15min":1.288},"last":0.72299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61699999999999999,"5min":0.55500000000000005,"15min":0.52400000000000002},"min":{"1min":0.443,"5min":0.27900000000000003,"15min":0.252},"max":{"1min":0.78600000000000003,"5min":0.89900000000000002,"15min":0.89900000000000002},"last":0.754},{"interface":"front","average":{"1min":0.64300000000000002,"5min":0.59199999999999997,"15min":0.55800000000000005},"min":{"1min":0.47299999999999998,"5min":0.33700000000000002,"15min":0.30599999999999999},"max":{"1min":0.83099999999999996,"5min":0.85299999999999998,"15min":0.90400000000000003},"last":0.71999999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.57199999999999995,"15min":0.55500000000000005},"min":{"1min":0.374,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.78800000000000003,"5min":0.82399999999999995,"15min":1.379},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.66000000000000003,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.504,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.85799999999999998,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.68000000000000005}]},{"osd":2,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.59299999999999997,"15min":0.58699999999999997},"min":{"1min":0.41099999999999998,"5min":0.38900000000000001,"15min":0.308},"max":{"1min":0.82399999999999995,"5min":0.90800000000000003,"15min":1.3999999999999999},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58299999999999996,"15min":0.67600000000000005},"min":{"1min":0.499,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":7.3419999999999996},"last":0.69399999999999995}]},{"osd":3,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61899999999999999,"15min":0.61099999999999999},"min":{"1min":0.45100000000000001,"5min":0.36499999999999999,"15min":0.35499999999999998},"max":{"1min":0.81399999999999995,"5min":0.84999999999999998,"15min":1.3560000000000001},"last":0.77000000000000002},{"interface":"front","average":{"1min":0.67200000000000004,"5min":0.63500000000000001,"15min":0.63200000000000001},"min":{"1min":0.48299999999999998,"5min":0.376,"15min":0.34699999999999998},"max":{"1min":0.86899999999999999,"5min":0.96499999999999997,"15min":1.4399999999999999},"last":0.61299999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.53200000000000003,"15min":0.54500000000000004},"min":{"1min":0.34100000000000003,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.73599999999999999,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.58699999999999997,"15min":0.58299999999999996},"min":{"1min":0.379,"5min":0.34200000000000003,"15min":0.34100000000000003},"max":{"1min":0.75900000000000001,"5min":0.92700000000000005,"15min":0.92700000000000005},"last":0.47499999999999998}]},{"osd":5,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.57899999999999996,"15min":0.58899999999999997},"min":{"1min":0.39900000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.042,"15min":1.042},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60399999999999998,"15min":0.61899999999999999},"min":{"1min":0.39500000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.84199999999999997,"5min":0.88600000000000001,"15min":0.89700000000000002},"last":0.64000000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:10 2023","interfaces":[{"interface":"back","average":{"1min":0.62,"5min":0.63,"15min":0.64200000000000002},"min":{"1min":0.39000000000000001,"5min":0.311,"15min":0.311},"max":{"1min":0.91700000000000004,"5min":0.97899999999999998,"15min":1.004},"last":0.63},{"interface":"front","average":{"1min":0.64200000000000002,"5min":0.66200000000000003,"15min":0.66700000000000004},"min":{"1min":0.434,"5min":0.41599999999999998,"15min":0.38200000000000001},"max":{"1min":0.90900000000000003,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.65900000000000003}]}]},{"osd":1,"up_from":13,"seq":55834575000,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35899999999999999,"15min":0.35199999999999998},"min":{"1min":0.254,"5min":0.224,"15min":0.215},"max":{"1min":0.72399999999999998,"5min":1.415,"15min":1.415},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.42299999999999999,"5min":0.372,"15min":0.374},"min":{"1min":0.29999999999999999,"5min":0.24099999999999999,"15min":0.23699999999999999},"max":{"1min":0.69999999999999996,"5min":0.69999999999999996,"15min":1.512},"last":0.47499999999999998}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.35599999999999998,"15min":0.35799999999999998},"min":{"1min":0.28100000000000003,"5min":0.24399999999999999,"15min":0.221},"max":{"1min":0.47199999999999998,"5min":0.55700000000000005,"15min":1.286},"last":0.38},{"interface":"front","average":{"1min":0.438,"5min":0.40500000000000003,"15min":0.40200000000000002},"min":{"1min":0.33800000000000002,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.59899999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.44400000000000001}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.45800000000000002,"15min":0.44400000000000001},"min":{"1min":0.38500000000000001,"5min":0.314,"15min":0.29499999999999998},"max":{"1min":0.65600000000000003,"5min":1.077,"15min":1.077},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.438,"15min":0.437},"min":{"1min":0.308,"5min":0.28699999999999998,"15min":0.249},"max":{"1min":0.58899999999999997,"5min":0.69899999999999995,"15min":1.4830000000000001},"last":0.42099999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63200000000000001,"5min":0.60399999999999998,"15min":0.59999999999999998},"min":{"1min":0.41699999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.81000000000000005,"5min":1.0469999999999999,"15min":1.222},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.623,"15min":0.61799999999999999},"min":{"1min":0.499,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.83499999999999996,"5min":1.4770000000000001,"15min":1.4770000000000001},"last":0.67200000000000004}]},{"osd":5,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.65100000000000002,"5min":0.623,"15min":0.61899999999999999},"min":{"1min":0.47699999999999998,"5min":0.40500000000000003,"15min":0.40000000000000002},"max":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":1.4410000000000001},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.64000000000000001,"15min":0.62},"min":{"1min":0.52300000000000002,"5min":0.39200000000000002,"15min":0.35399999999999998},"max":{"1min":0.85799999999999998,"5min":0.98699999999999999,"15min":1.1850000000000001},"last":0.72299999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70999999999999996,"5min":0.67700000000000005,"15min":0.72899999999999998},"min":{"1min":0.58299999999999996,"5min":0.44800000000000001,"15min":0.38200000000000001},"max":{"1min":0.88700000000000001,"5min":1.0009999999999999,"15min":5.5010000000000003},"last":0.752},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.68400000000000005,"15min":0.67000000000000004},"min":{"1min":0.57499999999999996,"5min":0.41299999999999998,"15min":0.40999999999999998},"max":{"1min":0.91200000000000003,"5min":1.2310000000000001,"15min":1.258},"last":0.65600000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.70099999999999996,"5min":0.68200000000000005,"15min":0.66700000000000004},"min":{"1min":0.55600000000000005,"5min":0.42499999999999999,"15min":0.41099999999999998},"max":{"1min":0.89100000000000001,"5min":1.218,"15min":1.218},"last":0.73499999999999999},{"interface":"front","average":{"1min":0.73999999999999999,"5min":0.69299999999999995,"15min":0.73699999999999999},"min":{"1min":0.54600000000000004,"5min":0.41999999999999998,"15min":0.38100000000000001},"max":{"1min":0.91200000000000003,"5min":1.1859999999999999,"15min":5.5819999999999999},"last":0.624}]}]},{"osd":0,"up_from":13,"seq":55834574998,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":304512,"kb_used_data":3128,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067328,"statfs":{"total":96636764160,"available":96324943872,"internally_reserved":0,"allocated":3203072,"data_stored":1766867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.36799999999999999,"15min":0.371},"min":{"1min":0.27000000000000002,"5min":0.22900000000000001,"15min":0.20599999999999999},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":2.1520000000000001},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.42599999999999999,"15min":0.41999999999999998},"min":{"1min":0.38200000000000001,"5min":0.29399999999999998,"15min":0.27600000000000002},"max":{"1min":0.60899999999999999,"5min":0.66200000000000003,"15min":2.0859999999999999},"last":0.65400000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.39700000000000002,"15min":0.40999999999999998},"min":{"1min":0.316,"5min":0.248,"15min":0.22800000000000001},"max":{"1min":0.52900000000000003,"5min":0.89600000000000002,"15min":6.484},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38800000000000001,"15min":0.46700000000000003},"min":{"1min":0.307,"5min":0.26600000000000001,"15min":0.24199999999999999},"max":{"1min":0.56599999999999995,"5min":0.65100000000000002,"15min":6.2859999999999996},"last":0.57999999999999996}]},{"osd":3,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.38900000000000001,"15min":0.45300000000000001},"min":{"1min":0.30299999999999999,"5min":0.24099999999999999,"15min":0.215},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":4.5190000000000001},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.46300000000000002,"15min":0.53200000000000003},"min":{"1min":0.39000000000000001,"5min":0.29499999999999998,"15min":0.29099999999999998},"max":{"1min":0.69699999999999995,"5min":0.71999999999999997,"15min":4.5890000000000004},"last":0.72499999999999998}]},{"osd":4,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59699999999999998,"15min":0.61899999999999999},"min":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.32100000000000001},"max":{"1min":0.83299999999999996,"5min":0.83299999999999996,"15min":1.921},"last":0.83899999999999997},{"interface":"front","average":{"1min":0.627,"5min":0.61099999999999999,"15min":0.628},"min":{"1min":0.40600000000000003,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.79300000000000004,"5min":0.93100000000000005,"15min":1.508},"last":0.89000000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.60699999999999998,"15min":0.61099999999999999},"min":{"1min":0.53000000000000003,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.877,"5min":0.877,"15min":1.0509999999999999},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.63200000000000001,"15min":0.63900000000000001},"min":{"1min":0.496,"5min":0.42199999999999999,"15min":0.33400000000000002},"max":{"1min":0.89000000000000001,"5min":1.002,"15min":4.1020000000000003},"last":1.079}]},{"osd":6,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.65800000000000003,"15min":0.67600000000000005},"min":{"1min":0.56000000000000005,"5min":0.42199999999999999,"15min":0.39300000000000002},"max":{"1min":0.80800000000000005,"5min":1.0960000000000001,"15min":3.9009999999999998},"last":1.01},{"interface":"front","average":{"1min":0.74199999999999999,"5min":0.65600000000000003,"15min":0.67000000000000004},"min":{"1min":0.59499999999999997,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.90900000000000003,"5min":0.98599999999999999,"15min":1.9810000000000001},"last":0.78700000000000003}]},{"osd":7,"last update":"Mon Oct 9 15:42:25 2023","interfaces":[{"interface":"back","average":{"1min":0.68600000000000005,"5min":0.66400000000000003,"15min":0.68400000000000005},"min":{"1min":0.48899999999999999,"5min":0.45400000000000001,"15min":0.378},"max":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":2.032},"last":1.0609999999999999},{"interface":"front","average":{"1min":0.72799999999999998,"5min":0.67800000000000005,"15min":0.66800000000000004},"min":{"1min":0.56999999999999995,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.86799999999999999,"5min":1.0489999999999999,"15min":1.0489999999999999},"last":0.94299999999999995}]}]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.36499999999999999,"15min":0.34200000000000003},"min":{"1min":0.26700000000000002,"5min":0.20200000000000001,"15min":0.187},"max":{"1min":0.57099999999999995,"5min":0.64500000000000002,"15min":0.69799999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.35499999999999998,"15min":0.35599999999999998},"min":{"1min":0.255,"5min":0.218,"15min":0.218},"max":{"1min":0.53200000000000003,"5min":0.56100000000000005,"15min":1.0229999999999999},"last":0.379}]},{"osd":1,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.42099999999999999,"5min":0.38300000000000001,"15min":0.373},"min":{"1min":0.31900000000000001,"5min":0.252,"15min":0.22500000000000001},"max":{"1min":0.60199999999999998,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.438},{"interface":"front","average":{"1min":0.46100000000000002,"5min":0.40300000000000002,"15min":0.39200000000000002},"min":{"1min":0.375,"5min":0.24099999999999999,"15min":0.22600000000000001},"max":{"1min":0.627,"5min":0.67600000000000005,"15min":0.73699999999999999},"last":0.42599999999999999}]},{"osd":3,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.39500000000000002,"15min":0.374},"min":{"1min":0.30499999999999999,"5min":0.23300000000000001,"15min":0.22700000000000001},"max":{"1min":0.624,"5min":0.628,"15min":0.67500000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.44},"min":{"1min":0.34699999999999998,"5min":0.307,"15min":0.30199999999999999},"max":{"1min":0.63900000000000001,"5min":0.75700000000000001,"15min":0.79100000000000004},"last":0.47099999999999997}]},{"osd":4,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.622,"5min":0.59499999999999997,"15min":0.622},"min":{"1min":0.43099999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.86799999999999999,"5min":0.88900000000000001,"15min":2.3399999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.623,"5min":0.60399999999999998,"15min":0.60399999999999998},"min":{"1min":0.442,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.71199999999999997}]},{"osd":5,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.63500000000000001,"5min":0.60499999999999998,"15min":0.60299999999999998},"min":{"1min":0.45500000000000002,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.86299999999999999,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.629,"15min":0.65300000000000002},"min":{"1min":0.495,"5min":0.38200000000000001,"15min":0.34999999999999998},"max":{"1min":0.93200000000000005,"5min":0.93200000000000005,"15min":2.5249999999999999},"last":0.67600000000000005}]},{"osd":6,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.67600000000000005,"5min":0.63900000000000001,"15min":0.65800000000000003},"min":{"1min":0.47799999999999998,"5min":0.35799999999999998,"15min":0.35799999999999998},"max":{"1min":0.95899999999999996,"5min":0.997,"15min":1.5189999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.68100000000000005,"5min":0.66300000000000003,"15min":0.65600000000000003},"min":{"1min":0.47299999999999998,"5min":0.45200000000000001,"15min":0.42199999999999999},"max":{"1min":0.96899999999999997,"5min":1.0780000000000001,"15min":1.0780000000000001},"last":0.74399999999999999}]},{"osd":7,"last update":"Mon Oct 9 15:42:14 2023","interfaces":[{"interface":"back","average":{"1min":0.68400000000000005,"5min":0.66100000000000003,"15min":0.67000000000000004},"min":{"1min":0.46000000000000002,"5min":0.441,"15min":0.44},"max":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.407},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.70399999999999996,"5min":0.65400000000000003,"15min":0.65300000000000002},"min":{"1min":0.56999999999999995,"5min":0.442,"15min":0.42899999999999999},"max":{"1min":0.97899999999999998,"5min":0.97899999999999998,"15min":0.97899999999999998},"last":0.68799999999999994}]}]},{"osd":3,"up_from":13,"seq":55834574997,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.35699999999999998,"15min":0.35399999999999998},"min":{"1min":0.318,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.51000000000000001,"5min":0.58099999999999996,"15min":1.2270000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.44500000000000001,"5min":0.39800000000000002,"15min":0.62},"min":{"1min":0.26700000000000002,"5min":0.247,"15min":0.23000000000000001},"max":{"1min":0.57999999999999996,"5min":0.59299999999999997,"15min":17.085999999999999},"last":0.45300000000000001}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.50600000000000001},"min":{"1min":0.29899999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.59499999999999997,"15min":9.6600000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.495,"5min":0.43099999999999999,"15min":0.41299999999999998},"min":{"1min":0.40200000000000002,"5min":0.23799999999999999,"15min":0.23599999999999999},"max":{"1min":0.59599999999999997,"5min":0.70799999999999996,"15min":1.3049999999999999},"last":0.46899999999999997}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.42699999999999999,"15min":0.86799999999999999},"min":{"1min":0.379,"5min":0.27400000000000002,"15min":0.247},"max":{"1min":0.60199999999999998,"5min":0.66600000000000004,"15min":16.937999999999999},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.45300000000000001,"15min":0.57499999999999996},"min":{"1min":0.39600000000000002,"5min":0.28899999999999998,"15min":0.27900000000000003},"max":{"1min":0.61599999999999999,"5min":0.73599999999999999,"15min":10.451000000000001},"last":0.42499999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.65400000000000003,"5min":0.623,"15min":0.83999999999999997},"min":{"1min":0.48799999999999999,"5min":0.41799999999999998,"15min":0.32000000000000001},"max":{"1min":0.81200000000000006,"5min":0.996,"15min":17.02},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.64900000000000002,"15min":0.76900000000000002},"min":{"1min":0.56100000000000005,"5min":0.40100000000000002,"15min":0.36599999999999999},"max":{"1min":0.92400000000000004,"5min":0.98399999999999999,"15min":9.6969999999999992},"last":0.75900000000000001}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.71599999999999997,"5min":0.63900000000000001,"15min":0.63200000000000001},"min":{"1min":0.59599999999999997,"5min":0.41299999999999998,"15min":0.36899999999999999},"max":{"1min":0.878,"5min":0.96299999999999997,"15min":5.3460000000000001},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.73299999999999998,"5min":0.66800000000000004,"15min":0.871},"min":{"1min":0.54800000000000004,"5min":0.375,"15min":0.375},"max":{"1min":0.92100000000000004,"5min":1.0249999999999999,"15min":16.984999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.69599999999999995,"5min":0.67400000000000004,"15min":0.77900000000000003},"min":{"1min":0.51500000000000001,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":0.89200000000000002,"5min":0.999,"15min":9.7319999999999993},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.69299999999999995,"15min":0.67400000000000004},"min":{"1min":0.57199999999999995,"5min":0.441,"15min":0.436},"max":{"1min":0.94999999999999996,"5min":1.016,"15min":1.278},"last":0.83699999999999997}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.73699999999999999,"5min":0.68799999999999994,"15min":0.90700000000000003},"min":{"1min":0.52800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"max":{"1min":0.96699999999999997,"5min":0.96699999999999997,"15min":17.053999999999998},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.69699999999999995,"15min":0.80200000000000005},"min":{"1min":0.58999999999999997,"5min":0.44700000000000001,"15min":0.44700000000000001},"max":{"1min":0.95499999999999996,"5min":1.024,"15min":9.6029999999999998},"last":0.82099999999999995}]}]},{"osd":4,"up_from":13,"seq":55834574998,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.58199999999999996,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.308,"15min":0.28299999999999997},"max":{"1min":0.85499999999999998,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.67000000000000004,"5min":0.60999999999999999,"15min":0.58999999999999997},"min":{"1min":0.46500000000000002,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":0.875,"5min":0.99399999999999999,"15min":0.99399999999999999},"last":0.69199999999999995}]},{"osd":1,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.61699999999999999,"15min":0.63100000000000001},"min":{"1min":0.39400000000000002,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.83899999999999997,"5min":0.89900000000000002,"15min":2.879},"last":0.77200000000000002},{"interface":"front","average":{"1min":0.68400000000000005,"5min":0.59599999999999997,"15min":0.57399999999999995},"min":{"1min":0.498,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.86099999999999999,"5min":1.0960000000000001,"15min":1.0960000000000001},"last":0.66100000000000003}]},{"osd":2,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.54000000000000004},"min":{"1min":0.39800000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74099999999999999,"5min":0.96999999999999997,"15min":0.96999999999999997},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.64100000000000001,"5min":0.58699999999999997,"15min":0.58199999999999996},"min":{"1min":0.45000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.84299999999999997,"5min":0.996,"15min":1.3580000000000001},"last":0.73199999999999998}]},{"osd":3,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.58299999999999996,"15min":0.55600000000000005},"min":{"1min":0.44,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.82399999999999995,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.67700000000000005,"5min":0.63200000000000001,"15min":0.61199999999999999},"min":{"1min":0.35799999999999998,"5min":0.35499999999999998,"15min":0.34799999999999998},"max":{"1min":0.88800000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"last":0.624}]},{"osd":5,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.54500000000000004,"15min":0.54800000000000004},"min":{"1min":0.34699999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.751,"5min":1.089,"15min":1.089},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.624,"5min":0.622,"15min":0.62},"min":{"1min":0.48399999999999999,"5min":0.308,"15min":0.30399999999999999},"max":{"1min":0.879,"5min":1.222,"15min":1.222},"last":0.40500000000000003}]},{"osd":6,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58499999999999996},"min":{"1min":0.377,"5min":0.245,"15min":0.245},"max":{"1min":0.84899999999999998,"5min":1.1539999999999999,"15min":1.1539999999999999},"last":0.504},{"interface":"front","average":{"1min":0.65200000000000002,"5min":0.66400000000000003,"15min":0.67100000000000004},"min":{"1min":0.42899999999999999,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.83699999999999997,"5min":1.1619999999999999,"15min":1.1619999999999999},"last":0.63700000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:17 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.59099999999999997,"15min":0.61099999999999999},"min":{"1min":0.39300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.76200000000000001,"5min":1.1779999999999999,"15min":1.1779999999999999},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.65800000000000003},"min":{"1min":0.36599999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.82199999999999995,"5min":1.202,"15min":1.202},"last":0.45000000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574999,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":303936,"kb_used_data":2552,"kb_used_omap":0,"kb_used_meta":301376,"kb_avail":94067904,"statfs":{"total":96636764160,"available":96325533696,"internally_reserved":0,"allocated":2613248,"data_stored":1177510,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":308609024},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53300000000000003,"15min":0.52100000000000002},"min":{"1min":0.38500000000000001,"5min":0.307,"15min":0.27800000000000002},"max":{"1min":0.748,"5min":0.748,"15min":0.87},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55100000000000005,"15min":0.54500000000000004},"min":{"1min":0.45000000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.69499999999999995,"5min":0.79200000000000004,"15min":1.165},"last":0.72099999999999997}]},{"osd":1,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.56100000000000005,"15min":0.54700000000000004},"min":{"1min":0.46600000000000003,"5min":0.308,"15min":0.30299999999999999},"max":{"1min":0.77100000000000002,"5min":0.871,"15min":2.089},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.56499999999999995,"15min":0.55200000000000005},"min":{"1min":0.432,"5min":0.34000000000000002,"15min":0.32800000000000001},"max":{"1min":0.72099999999999997,"5min":0.81100000000000005,"15min":0.94199999999999995},"last":0.57999999999999996}]},{"osd":2,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.63,"5min":0.56000000000000005,"15min":0.71999999999999997},"min":{"1min":0.50600000000000001,"5min":0.33900000000000002,"15min":0.33800000000000002},"max":{"1min":0.78200000000000003,"5min":0.78200000000000003,"15min":11.055},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.58899999999999997,"15min":0.74299999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.32400000000000001},"max":{"1min":0.72899999999999998,"5min":0.877,"15min":11.092000000000001},"last":0.622}]},{"osd":3,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.625,"5min":0.58999999999999997,"15min":0.748},"min":{"1min":0.504,"5min":0.34699999999999998,"15min":0.34000000000000002},"max":{"1min":0.754,"5min":0.84599999999999997,"15min":11.164999999999999},"last":0.504},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.61499999999999999,"15min":0.60499999999999998},"min":{"1min":0.497,"5min":0.41599999999999998,"15min":0.36699999999999999},"max":{"1min":0.78600000000000003,"5min":0.94199999999999995,"15min":2.2000000000000002},"last":0.73899999999999999}]},{"osd":4,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.52800000000000002,"15min":0.53500000000000003},"min":{"1min":0.317,"5min":0.30199999999999999,"15min":0.27700000000000002},"max":{"1min":0.70899999999999996,"5min":0.80800000000000005,"15min":2.3290000000000002},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.5,"5min":0.56799999999999995,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.36299999999999999,"15min":0.31},"max":{"1min":0.69199999999999995,"5min":0.82199999999999995,"15min":1.0569999999999999},"last":0.36199999999999999}]},{"osd":6,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.57899999999999996,"15min":0.57599999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.33600000000000002},"max":{"1min":0.72899999999999998,"5min":0.97999999999999998,"15min":2.2349999999999999},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.34699999999999998,"5min":0.34399999999999997,"15min":0.32100000000000001},"max":{"1min":0.75600000000000001,"5min":0.92100000000000004,"15min":0.92100000000000004},"last":0.51600000000000001}]},{"osd":7,"last update":"Mon Oct 9 15:42:09 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.61399999999999999,"15min":0.61199999999999999},"min":{"1min":0.38,"5min":0.38,"15min":0.307},"max":{"1min":0.74199999999999999,"5min":0.97599999999999998,"15min":1.016},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.66700000000000004,"15min":0.65700000000000003},"min":{"1min":0.41399999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.82399999999999995,"5min":1.6519999999999999,"15min":2.9359999999999999},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2023-10-09T15:43:13.169 DEBUG:teuthology.orchestra.run.smithi033:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-10-09T15:43:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.288+0000 7fdf2211a700 1 Processor -- start 2023-10-09T15:43:13.288 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.288+0000 7fdf2211a700 1 -- start start 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf2211a700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fdf1c159530 0x7fdf1c0ceba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf2211a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c0cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf2211a700 1 -- --> v1:172.21.15.33:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf1c0ccfd0 con 0x7fdf1c06dc70 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf2211a700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf1c0cf0e0 con 0x7fdf1c159530 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf2211a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15a3d0 con 0x7fdf1c06e0e0 2023-10-09T15:43:13.290 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1affd700 1 --1- >> v1:172.21.15.33:6789/0 conn(0x7fdf1c06dc70 0x7fdf1c159900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.33:6789/0 says I am v1:172.21.15.33:39442/0 (socket says 172.21.15.33:39442) 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1affd700 1 -- 172.21.15.33:0/1862246611 learned_addr learned my addr 172.21.15.33:0/1862246611 (peer_addr_for_me v1:172.21.15.33:0/0) 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1bfff700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c0cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/1862246611 >> v2:172.21.15.59:3300/0 conn(0x7fdf1c159530 0x7fdf1c0ceba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1a7fc700 1 -- 172.21.15.33:0/1862246611 <== mon.0 v1:172.21.15.33:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2889701184 0 0) 0x7fdf1c0ccfd0 con 0x7fdf1c06dc70 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1a7fc700 1 -- 172.21.15.33:0/1862246611 --> v1:172.21.15.33:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf08003570 con 0x7fdf1c06dc70 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 msgr2=0x7fdf1c0cb6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c0cb6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.291 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/1862246611 >> v1:172.21.15.33:6789/0 conn(0x7fdf1c06dc70 legacy=0x7fdf1c159900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.289+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/1862246611 --> v2:172.21.15.59:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf1c15a6b0 con 0x7fdf1c159530 2023-10-09T15:43:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c0ceba0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdf040098e0 tx=0x7fdf040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0fba3546d5436a8 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf1a7fc700 1 -- 172.21.15.33:0/1862246611 <== mon.1 v2:172.21.15.59:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011630 con 0x7fdf1c159530 2023-10-09T15:43:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf1a7fc700 1 -- 172.21.15.33:0/1862246611 <== mon.1 v2:172.21.15.59:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf04011790 con 0x7fdf1c159530 2023-10-09T15:43:13.292 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf1a7fc700 1 -- 172.21.15.33:0/1862246611 <== mon.1 v2:172.21.15.59:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011b30 con 0x7fdf1c159530 2023-10-09T15:43:13.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 -- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 msgr2=0x7fdf1c0ceba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.295 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c0ceba0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fdf040098e0 tx=0x7fdf040091a0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 -- 172.21.15.33:0/1862246611 shutdown_connections 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c0cb6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 --2- 172.21.15.33:0/1862246611 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c0ceba0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 -- 172.21.15.33:0/1862246611 >> 172.21.15.33:0/1862246611 conn(0x7fdf1c0703a0 msgr2=0x7fdf1c0707a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 -- 172.21.15.33:0/1862246611 shutdown_connections 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.290+0000 7fdf2211a700 1 -- 172.21.15.33:0/1862246611 wait complete. 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 Processor -- start 2023-10-09T15:43:13.296 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 -- start start 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c145020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c15c530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c0b3480 con 0x7fdf1c06dc70 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c15ebd0 con 0x7fdf1c159530 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf2211a700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf1c156c90 con 0x7fdf1c06e0e0 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.292+0000 7fdf1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.297 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52490/0 (socket says 172.21.15.33:52490) 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/2099448265 learned_addr learned my addr 172.21.15.33:0/2099448265 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1affd700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c145020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1bfff700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c15c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 msgr2=0x7fdf1c145020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c145020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 msgr2=0x7fdf1c15c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.298 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c15c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 -- 172.21.15.33:0/2099448265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf04009420 con 0x7fdf1c06dc70 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1bfff700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf1b7fe700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c089650 tx=0x7fdf04017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04011b10 con 0x7fdf1c06dc70 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf040253f0 con 0x7fdf1c06dc70 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf1c156f70 con 0x7fdf1c06dc70 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf04025790 con 0x7fdf1c06dc70 2023-10-09T15:43:13.299 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.293+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf1c15e860 con 0x7fdf1c06dc70 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.294+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf1c04c3c0 con 0x7fdf1c06dc70 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.294+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fdf04025b80 con 0x7fdf1c06dc70 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.295+0000 7fdf137fe700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 0x7fdefc0697d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.295+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fdf040861e0 con 0x7fdf1c06dc70 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.295+0000 7fdf1affd700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 0x7fdefc0697d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.300 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.295+0000 7fdf1affd700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 0x7fdefc0697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c1529c0 tx=0x7fdf0c009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.301 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.299+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fdf04053170 con 0x7fdf1c06dc70 2023-10-09T15:43:13.494 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.494+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7fdf1c15a990 con 0x7fdf1c06dc70 2023-10-09T15:43:13.497 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.497+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fdf04053170 con 0x7fdf1c06dc70 2023-10-09T15:43:13.498 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.497+0000 7fdf137fe700 1 -- 172.21.15.33:0/2099448265 <== mon.0 v2:172.21.15.33:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v34)=0 v34) v1 ==== 123+0+0 (secure 0 0 0) 0x7fdf04056790 con 0x7fdf1c06dc70 2023-10-09T15:43:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 msgr2=0x7fdefc0697d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.500 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 0x7fdefc0697d0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c1529c0 tx=0x7fdf0c009040 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 msgr2=0x7fdf1c156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7fdf1c089650 tx=0x7fdf04017000 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 shutdown_connections 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fdefc067320 0x7fdefc0697d0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fdf1c06dc70 0x7fdf1c156440 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fdf1c159530 0x7fdf1c15c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 --2- 172.21.15.33:0/2099448265 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fdf1c06e0e0 0x7fdf1c145020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.501 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 >> 172.21.15.33:0/2099448265 conn(0x7fdf1c0703a0 msgr2=0x7fdf1c0d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:13.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 shutdown_connections 2023-10-09T15:43:13.502 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.500+0000 7fdf2211a700 1 -- 172.21.15.33:0/2099448265 wait complete. 2023-10-09T15:43:13.512 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-10-09T15:43:13.513 DEBUG:teuthology.orchestra.run.smithi033:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-10-09T15:43:13.631 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.631+0000 7fa83067d700 1 Processor -- start 2023-10-09T15:43:13.632 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.631+0000 7fa83067d700 1 -- start start 2023-10-09T15:43:13.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa83067d700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa828159c80 0x7fa8280cb6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa83067d700 1 --2- >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 0x7fa8280cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa83067d700 1 -- --> v1:172.21.15.59:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8280ce9d0 con 0x7fa8281598b0 2023-10-09T15:43:13.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa83067d700 1 -- --> v2:172.21.15.33:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280af960 con 0x7fa828159c80 2023-10-09T15:43:13.634 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa83067d700 1 -- --> v2:172.21.15.59:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8280afc30 con 0x7fa8280cfe70 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa82dc18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa828159c80 0x7fa8280cb6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa82dc18700 1 --2- >> v2:172.21.15.33:3300/0 conn(0x7fa828159c80 0x7fa8280cb6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52498/0 (socket says 172.21.15.33:52498) 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.632+0000 7fa82dc18700 1 -- 172.21.15.33:0/177030049 learned_addr learned my addr 172.21.15.33:0/177030049 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82ec1a700 1 --2- 172.21.15.33:0/177030049 >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 0x7fa8280cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82dc18700 1 -- 172.21.15.33:0/177030049 >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 msgr2=0x7fa8280cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82dc18700 1 --2- 172.21.15.33:0/177030049 >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 0x7fa8280cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82dc18700 1 -- 172.21.15.33:0/177030049 >> v1:172.21.15.59:6789/0 conn(0x7fa8281598b0 legacy=0x7fa8280af250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.635 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82dc18700 1 -- 172.21.15.33:0/177030049 --> v2:172.21.15.33:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8280aff10 con 0x7fa828159c80 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82ec1a700 1 --2- 172.21.15.33:0/177030049 >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 0x7fa8280cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82dc18700 1 --2- 172.21.15.33:0/177030049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280cb6f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa8280898c0 tx=0x7fa81c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9aa454bbcadf1c83 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82d417700 1 -- 172.21.15.33:0/177030049 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00b860 con 0x7fa828159c80 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82d417700 1 -- 172.21.15.33:0/177030049 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa81c00b9c0 con 0x7fa828159c80 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.633+0000 7fa82d417700 1 -- 172.21.15.33:0/177030049 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81c00bd80 con 0x7fa828159c80 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 -- 172.21.15.33:0/177030049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 msgr2=0x7fa8280cb6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 --2- 172.21.15.33:0/177030049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280cb6f0 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7fa8280898c0 tx=0x7fa81c009250 comp rx=0 tx=0).stop 2023-10-09T15:43:13.636 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 -- 172.21.15.33:0/177030049 shutdown_connections 2023-10-09T15:43:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 --2- 172.21.15.33:0/177030049 >> v2:172.21.15.59:3300/0 conn(0x7fa8280cfe70 0x7fa8280cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 --2- 172.21.15.33:0/177030049 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280cb6f0 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 -- 172.21.15.33:0/177030049 >> 172.21.15.33:0/177030049 conn(0x7fa828070e30 msgr2=0x7fa8280d0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 -- 172.21.15.33:0/177030049 shutdown_connections 2023-10-09T15:43:13.637 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.634+0000 7fa83067d700 1 -- 172.21.15.33:0/177030049 wait complete. 2023-10-09T15:43:13.639 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.635+0000 7fa83067d700 1 Processor -- start 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.635+0000 7fa83067d700 1 -- start start 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.635+0000 7fa83067d700 1 --2- >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8280cfe70 0x7fa828153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 --2- >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281598b0 0x7fa8280b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 -- --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa828157ef0 con 0x7fa828159c80 2023-10-09T15:43:13.640 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 -- --> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8281572e0 con 0x7fa8281598b0 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 -- --> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8281575c0 con 0x7fa8280cfe70 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 --2- >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.33:3300/0 says I am v2:172.21.15.33:52504/0 (socket says 172.21.15.33:52504) 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 -- 172.21.15.33:0/3081254446 learned_addr learned my addr 172.21.15.33:0/3081254446 (peer_addr_for_me v2:172.21.15.33:0/0) 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82dc18700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281598b0 0x7fa8280b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82e419700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8280cfe70 0x7fa828153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 -- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8280cfe70 msgr2=0x7fa828153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.641 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8280cfe70 0x7fa828153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 -- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281598b0 msgr2=0x7fa8280b2950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281598b0 0x7fa8280b2950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 -- 172.21.15.33:0/3081254446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa81c0094f0 con 0x7fa828159c80 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa82ec1a700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa818009fc0 tx=0x7fa8180099b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa81800dc90 con 0x7fa828159c80 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7fa81800f040 con 0x7fa828159c80 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8281578a0 con 0x7fa828159c80 2023-10-09T15:43:13.642 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8180156b0 con 0x7fa828159c80 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.636+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8280b2570 con 0x7fa828159c80 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.637+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8281580a0 con 0x7fa828159c80 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.638+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 4 ==== mgrmap(e 12) v1 ==== 85097+0+0 (secure 0 0 0) 0x7fa81801e3b0 con 0x7fa828159c80 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.638+0000 7fa8267fc700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 0x7fa814069800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.638+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 5 ==== osd_map(205..205 src has 1..205) v4 ==== 4939+0+0 (secure 0 0 0) 0x7fa818084f20 con 0x7fa828159c80 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.638+0000 7fa82e419700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 0x7fa814069800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-10-09T15:43:13.643 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.639+0000 7fa82e419700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 0x7fa814069800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa820003860 tx=0x7fa820009040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-10-09T15:43:13.644 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.642+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+173446 (secure 0 0 0) 0x7fa8281580a0 con 0x7fa828159c80 2023-10-09T15:43:13.888 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.888+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 --> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8281580a0 con 0x7fa828159c80 2023-10-09T15:43:13.889 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.888+0000 7fa8267fc700 1 -- 172.21.15.33:0/3081254446 <== mon.0 v2:172.21.15.33:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 137 v137) v1 ==== 95+0+3534 (secure 0 0 0) 0x7fa8281580a0 con 0x7fa828159c80 2023-10-09T15:43:13.889 INFO:teuthology.orchestra.run.smithi033.stdout: 2023-10-09T15:43:13.889 INFO:teuthology.orchestra.run.smithi033.stdout:{"epoch":137,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7085,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6835/1644132550","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6833","nonce":1644132550},{"type":"v1","addr":"172.21.15.59:6835","nonce":1644132550}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":129},{"gid":7936,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.59:6834/2060877693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.59:6832","nonce":2060877693},{"type":"v1","addr":"172.21.15.59:6834","nonce":2060877693}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9066,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6836/1941934955","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6834","nonce":1941934955},{"type":"v1","addr":"172.21.15.33:6836","nonce":1941934955}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":128},{"gid":9333,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.33:6837/2566036631","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.33:6835","nonce":2566036631},{"type":"v1","addr":"172.21.15.33:6837","nonce":2566036631}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":137}],"filesystems":[]} 2023-10-09T15:43:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 msgr2=0x7fa814069800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 0x7fa814069800 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fa820003860 tx=0x7fa820009040 comp rx=0 tx=0).stop 2023-10-09T15:43:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 msgr2=0x7fa8280b54c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-10-09T15:43:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7fa818009fc0 tx=0x7fa8180099b0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.891 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 shutdown_connections 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:6832/90672,v1:172.21.15.33:6833/90672] conn(0x7fa814067350 0x7fa814069800 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.33:3300/0,v1:172.21.15.33:6789/0] conn(0x7fa828159c80 0x7fa8280b54c0 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3301/0,v1:172.21.15.59:6790/0] conn(0x7fa8280cfe70 0x7fa828153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 --2- 172.21.15.33:0/3081254446 >> [v2:172.21.15.59:3300/0,v1:172.21.15.59:6789/0] conn(0x7fa8281598b0 0x7fa8280b2950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 >> 172.21.15.33:0/3081254446 conn(0x7fa828070e30 msgr2=0x7fa8280d0510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 shutdown_connections 2023-10-09T15:43:13.892 INFO:teuthology.orchestra.run.smithi033.stderr:2023-10-09T15:43:13.890+0000 7fa83067d700 1 -- 172.21.15.33:0/3081254446 wait complete. 2023-10-09T15:43:13.893 INFO:teuthology.orchestra.run.smithi033.stderr:dumped fsmap epoch 137 2023-10-09T15:43:13.902 DEBUG:tasks.cephfs.filesystem:already dead... 2023-10-09T15:43:13.903 INFO:teuthology.misc:Shutting down mds daemons... 2023-10-09T15:43:13.903 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-10-09T15:43:13.903 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:13.911 INFO:tasks.ceph.mds.a:Stopped 2023-10-09T15:43:13.912 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-10-09T15:43:13.912 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:13.960 INFO:tasks.ceph.mds.c:Stopped 2023-10-09T15:43:13.961 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-10-09T15:43:13.961 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:13.972 INFO:tasks.ceph.mds.b:Stopped 2023-10-09T15:43:13.972 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-10-09T15:43:13.972 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.023 INFO:tasks.ceph.mds.d:Stopped 2023-10-09T15:43:14.023 INFO:teuthology.misc:Shutting down osd daemons... 2023-10-09T15:43:14.023 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-10-09T15:43:14.024 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.066 INFO:tasks.ceph.osd.0:Stopped 2023-10-09T15:43:14.066 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-10-09T15:43:14.066 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.108 INFO:tasks.ceph.osd.1:Stopped 2023-10-09T15:43:14.108 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-10-09T15:43:14.108 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.153 INFO:tasks.ceph.osd.2:Stopped 2023-10-09T15:43:14.153 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-10-09T15:43:14.154 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.186 INFO:tasks.ceph.osd.3:Stopped 2023-10-09T15:43:14.187 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-10-09T15:43:14.187 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.225 INFO:tasks.ceph.osd.4:Stopped 2023-10-09T15:43:14.225 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-10-09T15:43:14.226 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.293 INFO:tasks.ceph.osd.5:Stopped 2023-10-09T15:43:14.294 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-10-09T15:43:14.294 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.367 INFO:tasks.ceph.osd.6:Stopped 2023-10-09T15:43:14.367 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-10-09T15:43:14.367 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.438 INFO:tasks.ceph.osd.7:Stopped 2023-10-09T15:43:14.438 INFO:teuthology.misc:Shutting down mgr daemons... 2023-10-09T15:43:14.438 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-10-09T15:43:14.438 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.464 INFO:tasks.ceph.mgr.y:Stopped 2023-10-09T15:43:14.464 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-10-09T15:43:14.464 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.504 INFO:tasks.ceph.mgr.x:Stopped 2023-10-09T15:43:14.505 INFO:teuthology.misc:Shutting down mon daemons... 2023-10-09T15:43:14.505 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-10-09T15:43:14.505 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.516 INFO:tasks.ceph.mon.a:Stopped 2023-10-09T15:43:14.517 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-10-09T15:43:14.517 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.557 INFO:tasks.ceph.mon.b:Stopped 2023-10-09T15:43:14.557 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-10-09T15:43:14.557 INFO:teuthology.orchestra.run:waiting for 300 2023-10-09T15:43:14.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-10-09T15:43:14.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-10-09T15:43:14.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-10-09T15:43:14.609 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-10-09T15:43:14.610 INFO:tasks.ceph.mon.c:Stopped 2023-10-09T15:43:14.610 INFO:tasks.ceph:Checking cluster log for badness... 2023-10-09T15:43:14.611 DEBUG:teuthology.orchestra.run.smithi033:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2023-10-09T15:43:14.642 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:43:14.643 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-10-09T15:43:14.885 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:43:14.885 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-10-09T15:43:14.950 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:43:14.950 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-10-09T15:43:15.016 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:43:15.016 DEBUG:teuthology.orchestra.run.smithi033:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-10-09T15:43:15.088 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:43:15.088 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-10-09T15:43:15.336 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:43:15.336 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-10-09T15:43:15.426 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:43:15.426 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-10-09T15:43:15.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:43:15.498 DEBUG:teuthology.orchestra.run.smithi059:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-10-09T15:43:15.607 INFO:tasks.ceph:Archiving mon data... 2023-10-09T15:43:15.609 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/data/mon.a.tgz 2023-10-09T15:43:15.609 DEBUG:teuthology.orchestra.run.smithi033:> mktemp 2023-10-09T15:43:15.625 INFO:teuthology.orchestra.run.smithi033.stdout:/tmp/tmp.h2afyxut5r 2023-10-09T15:43:15.625 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.h2afyxut5r 2023-10-09T15:43:15.804 DEBUG:teuthology.orchestra.run.smithi033:> sudo chmod 0666 /tmp/tmp.h2afyxut5r 2023-10-09T15:43:15.886 DEBUG:teuthology.orchestra.remote:smithi033:/tmp/tmp.h2afyxut5r is 597KB 2023-10-09T15:43:15.984 DEBUG:teuthology.orchestra.run.smithi033:> rm -fr /tmp/tmp.h2afyxut5r 2023-10-09T15:43:15.999 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/data/mon.b.tgz 2023-10-09T15:43:15.999 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-09T15:43:16.016 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.sJK01AEfvk 2023-10-09T15:43:16.017 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.sJK01AEfvk 2023-10-09T15:43:16.235 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.sJK01AEfvk 2023-10-09T15:43:16.317 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.sJK01AEfvk is 605KB 2023-10-09T15:43:16.415 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.sJK01AEfvk 2023-10-09T15:43:16.430 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/data/mon.c.tgz 2023-10-09T15:43:16.430 DEBUG:teuthology.orchestra.run.smithi059:> mktemp 2023-10-09T15:43:16.484 INFO:teuthology.orchestra.run.smithi059.stdout:/tmp/tmp.oNfR4sfvbh 2023-10-09T15:43:16.484 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.oNfR4sfvbh 2023-10-09T15:43:16.660 DEBUG:teuthology.orchestra.run.smithi059:> sudo chmod 0666 /tmp/tmp.oNfR4sfvbh 2023-10-09T15:43:16.742 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.oNfR4sfvbh is 606KB 2023-10-09T15:43:16.840 DEBUG:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.oNfR4sfvbh 2023-10-09T15:43:16.855 INFO:tasks.ceph:Cleaning ceph cluster... 2023-10-09T15:43:16.855 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T15:43:16.857 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-10-09T15:43:16.919 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-10-09T15:43:16.919 DEBUG:teuthology.orchestra.run.smithi033:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T15:43:16.926 DEBUG:teuthology.orchestra.run.smithi059:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-10-09T15:43:16.953 INFO:teuthology.orchestra.run.smithi033.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T15:43:16.985 INFO:teuthology.orchestra.run.smithi059.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-10-09T15:43:16.991 INFO:tasks.ceph:Archiving crash dumps... 2023-10-09T15:43:16.993 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi033/crash 2023-10-09T15:43:16.994 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T15:43:17.027 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi059/crash 2023-10-09T15:43:17.028 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-10-09T15:43:17.055 INFO:tasks.ceph:Shutting down logrotate 2023-10-09T15:43:17.056 DEBUG:teuthology.orchestra.run.smithi033:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:17.071 DEBUG:teuthology.orchestra.run.smithi059:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:17.159 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:17.185 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-10-09T15:43:17.210 INFO:tasks.ceph:Compressing logs... 2023-10-09T15:43:17.210 DEBUG:teuthology.orchestra.run.smithi033:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T15:43:17.227 DEBUG:teuthology.orchestra.run.smithi059:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2023-10-09T15:43:17.250 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99492.log 2023-10-09T15:43:17.251 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99240.log 2023-10-09T15:43:17.298 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100335.log 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98272.log 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.100335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91004.log 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100335.log.gz 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.98272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90832.log 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98272.log.gz 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.91004.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99956.log 2023-10-09T15:43:17.299 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.90832.log: 88.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.91004.log.gz-5 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:--verbose -- /var/log/ceph/ceph-client.3.97879.log 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.90832.log.gz 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.99956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102676.log 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99956.log.gz 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.3.97879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90791.log 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97879.log.gz 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.102676.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T15:43:17.300 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102676.log.gz 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.90791.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101097.log 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.90791.log.gz/var/log/ceph/ceph.log: 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102269.log 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101097.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101097.log.gz 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.102269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101877.log 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102269.log.gz 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99578.log 2023-10-09T15:43:17.301 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101877.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102273.log 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101877.log.gz 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.99578.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99578.log.gz 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.102273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99960.log 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102273.log.gz 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101101.log 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.99960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91047.log 2023-10-09T15:43:17.302 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99960.log.gz 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100331.log 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101101.log.gz 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.91047.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97517.log 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.91047.log.gz 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr: 92.1% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.100331.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100331.log.gz 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2023-10-09T15:43:17.303 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.97517.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97517.log.gz 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 /var/log/ceph/ceph-mgr.x.log: --verbose -- /var/log/ceph/ceph-client.3.97875.log 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.3.97875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101881.log 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.3.97875.log.gz 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100696.log 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101881.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101881.log.gz 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.100696.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100696.log.gz 2023-10-09T15:43:17.304 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99091.log 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.99091.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99091.log.gz 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.c.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.102680.log 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90875.log 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.102680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90917.log 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.102680.log.gz 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.90875.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.90875.log.gz 2023-10-09T15:43:17.305 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.90917.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90917.log.gz 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98682.log 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.98682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.100700.log 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98682.log.gz 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101486.log 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.100700.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.100700.log.gz 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101486.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101486.log.gz 2023-10-09T15:43:17.306 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2023-10-09T15:43:17.307 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99095.log 2023-10-09T15:43:17.307 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.6.log: /var/log/ceph/ceph-client.1.99095.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99095.log.gz 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.101490.log 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.101490.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.101490.log.gz 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98686.log 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.98686.log: 94.3% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98686.log.gz 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2023-10-09T15:43:17.308 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90963.log 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-osd.5.log: /var/log/ceph/ceph-client.admin.90963.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.90963.log.gz 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90751.log 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.admin.90751.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.90751.log.gz 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.98276.log 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.98276.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.98276.log.gz 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2023-10-09T15:43:17.309 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.99574.log 2023-10-09T15:43:17.319 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.99574.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.99574.log.gz 2023-10-09T15:43:17.330 INFO:teuthology.orchestra.run.smithi059.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.97509.log 2023-10-09T15:43:17.330 INFO:teuthology.orchestra.run.smithi059.stderr: 90.5% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2023-10-09T15:43:17.336 INFO:teuthology.orchestra.run.smithi059.stderr:/var/log/ceph/ceph-client.1.97509.log: 0.0% -- replaced with /var/log/ceph/ceph-client.1.97509.log.gz 2023-10-09T15:43:17.342 INFO:teuthology.orchestra.run.smithi059.stderr: 90.9% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101157.log 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99492.log: /var/log/ceph/ceph-client.admin.99240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102906.log 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99492.log.gz 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101157.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99240.log.gz 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157305.log 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101157.log.gz 2023-10-09T15:43:17.422 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102906.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104740.log 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157305.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102906.log.gz 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166328.log 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6%/var/log/ceph/ceph-client.admin.104740.log: -- replaced with /var/log/ceph/ceph-client.admin.157305.log.gz 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108523.log 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3%/var/log/ceph/ceph-client.admin.166328.log: -- replaced with /var/log/ceph/ceph-client.admin.104740.log.gz 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180798.log 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.108523.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.166328.log.gz 2023-10-09T15:43:17.423 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175607.log 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108523.log.gz 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96766.log 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175607.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180798.log.gz 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179676.log 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96766.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175607.log.gz 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102990.log 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179676.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.96766.log.gz 2023-10-09T15:43:17.424 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104343.log 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.179676.log.gz 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179760.log 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106447.log 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.102990.log.gz 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.104343.log.gz 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160083.log 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106447.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.179760.log.gz 2023-10-09T15:43:17.425 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167430.log 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:gzip 89.0%-5 -- replaced with /var/log/ceph/ceph-client.admin.106447.log.gz/var/log/ceph/ceph-client.admin.160083.log: 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.167570.log 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165128.log /var/log/ceph/ceph-client.admin.167430.log: 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.160083.log.gz 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107077.log 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.167430.log.gz 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.167570.log.gz 2023-10-09T15:43:17.426 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176618.log 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165128.log.gz 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172254.log 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176618.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167736.log 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.107077.log.gz 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172254.log: gzip 89.1%-5 -- replaced with /var/log/ceph/ceph-client.admin.176618.log.gz--verbose 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.162313.log 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.172254.log.gz 2023-10-09T15:43:17.427 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160389.log 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99668.log 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.167736.log.gz 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160389.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.162313.log.gz 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170008.log 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.160389.log.gz 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170442.log 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180378.log 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.99668.log.gz 2023-10-09T15:43:17.428 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170442.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170008.log.gz 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177964.log 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170442.log.gz 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180378.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106993.log 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174480.log 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180378.log.gz 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177964.log.gz 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106993.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174082.log 2023-10-09T15:43:17.429 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.106993.log.gz 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174480.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160737.log 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.174480.log.gz 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174082.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101241.log 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160737.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174082.log.gz 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175565.log 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101241.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.160737.log.gz 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105214.log 2023-10-09T15:43:17.430 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175565.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178774.log 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101241.log.gz 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105214.log: 89.4%gzip -- replaced with /var/log/ceph/ceph-client.admin.175565.log.gz-5 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.180546.log 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.105214.log.gz 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162890.log 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173036.log 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178774.log.gz 2023-10-09T15:43:17.431 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162890.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180546.log.gz 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175733.log 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173036.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162890.log.gz 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97155.log 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.173036.log.gz 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164281.log 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175733.log.gz 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97155.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171876.log 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164281.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97155.log.gz 2023-10-09T15:43:17.432 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158879.log 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164281.log.gz 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106909.log 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7%/var/log/ceph/ceph-client.admin.158879.log: -- replaced with /var/log/ceph/ceph-client.admin.171876.log.gz 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103630.log 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106909.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106657.log 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158879.log.gz 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106909.log.gz 2023-10-09T15:43:17.433 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98352.log 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103630.log.gz 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103995.log 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98352.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169798.log 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.106657.log.gz 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103995.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98352.log.gz 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173771.log 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.103995.log.gz 2023-10-09T15:43:17.434 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.169798.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105830.log 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173771.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173727.log 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.169798.log.gz 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174961.log 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.173771.log.gz 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3%/var/log/ceph/ceph-client.admin.173727.log: -- replaced with /var/log/ceph/ceph-client.admin.105830.log.gz 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104469.log 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97111.log 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.173727.log.gz 2023-10-09T15:43:17.435 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104469.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174961.log.gz 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105428.log 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97111.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104469.log.gz 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164968.log 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105428.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.97111.log.gz 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167864.log 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.105428.log.gz 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164968.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178452.log 2023-10-09T15:43:17.436 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167864.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164968.log.gz 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108736.log 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178452.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.167864.log.gz 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106573.log 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.178452.log.gz 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164155.log 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106573.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.108736.log.gz 2023-10-09T15:43:17.437 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103680.log 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164155.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106573.log.gz 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164155.log.gz 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157473.log 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.a.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.103680.log.gzgzip 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.101199.log 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157473.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171386.log 2023-10-09T15:43:17.438 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157473.log.gz 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161547.log 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168506.log 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101199.log.gz 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161547.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.171386.log.gz 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161824.log 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161547.log.gz 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168506.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164005.log 2023-10-09T15:43:17.439 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161824.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168506.log.gz 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174396.log 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164005.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.161824.log.gz 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169359.log 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.164005.log.gz 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162034.log 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169359.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174396.log.gz 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.156943.log 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162034.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.169359.log.gz 2023-10-09T15:43:17.440 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107733.log 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162034.log.gz 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.156943.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98025.log 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107733.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.156943.log.gz 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100778.log 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98025.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.107733.log.gz 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176216.log 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98025.log.gz 2023-10-09T15:43:17.441 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171750.log 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.176216.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.100778.log.gz 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161950.log 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.176216.log.gz 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106211.log 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171750.log.gz 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106068.log 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106211.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.161950.log.gz 2023-10-09T15:43:17.442 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171540.log 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106068.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.106211.log.gz 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163574.log 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106068.log.gz 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98663.log 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163574.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171540.log.gz 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174312.log 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160907.log 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5%/var/log/ceph/ceph-client.admin.174312.log: -- replaced with /var/log/ceph/ceph-client.admin.98663.log.gz 2023-10-09T15:43:17.443 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.163574.log.gz 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163640.log 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.174312.log.gz 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165856.log 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160907.log.gz 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175861.log 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165856.log: 87.7%gzip -- replaced with /var/log/ceph/ceph-client.admin.163640.log.gz-5 2023-10-09T15:43:17.444 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106615.log 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169966.log 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106615.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.175861.log.gz 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.165856.log.gz 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168042.log 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106615.log.gz 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166949.log 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169966.log.gz 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168042.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177784.log 2023-10-09T15:43:17.445 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168042.log.gz 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175481.log 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177784.log: gzip -5 --verbose -- 88.2%/var/log/ceph/ceph-client.admin.175523.log 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.166949.log.gz 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.177784.log.gz 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160473.log 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175523.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175481.log.gz 2023-10-09T15:43:17.446 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175953.log 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160473.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.175523.log.gz 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178006.log 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.160473.log.gz 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168338.log 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100526.log 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178006.log.gz 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168338.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.175953.log.gz 2023-10-09T15:43:17.447 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173939.log 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99156.log 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100526.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.168338.log.gz 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100610.log 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100526.log.gz 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99156.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157263.log 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173939.log.gz 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.99156.log.gz 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106531.log 2023-10-09T15:43:17.448 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100610.log.gz 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157263.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175225.log 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106531.log: gzip -5 88.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.157263.log.gz/var/log/ceph/ceph-client.admin.158603.log 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175225.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106531.log.gz 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97325.log 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.175225.log.gz 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164533.log 2023-10-09T15:43:17.449 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97325.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.158603.log.gz--verbose 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.107691.log 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164533.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97325.log.gz 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158645.log 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164533.log.gz 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160167.log 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180000.log 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.107691.log.gz 2023-10-09T15:43:17.450 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160167.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158645.log.gz 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159999.log 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160167.log.gz 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171022.log 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180000.log.gz 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159999.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159957.log 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171022.log: 88.1%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.159999.log.gz--verbose 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.163879.log 2023-10-09T15:43:17.451 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159957.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171022.log.gz 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179591.log 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.159957.log.gz 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163879.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159688.log 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179591.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.163879.log.gz 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104614.log 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179591.log.gz 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105512.log 2023-10-09T15:43:17.452 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104614.log: gzip -5 --verbose -- 88.0%/var/log/ceph/ceph-client.admin.169443.log 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.159688.log.gz 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105512.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104614.log.gz 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174564.log 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105512.log.gz 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177498.log 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176974.log 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.169443.log.gz 2023-10-09T15:43:17.453 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177498.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174564.log.gz 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105638.log 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177498.log.gz 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176974.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166480.log 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105638.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178908.log 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.176974.log.gz 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166480.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105638.log.gz 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160779.log 2023-10-09T15:43:17.454 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178908.log: gzip 88.7%-5 -- replaced with /var/log/ceph/ceph-client.admin.166480.log.gz--verbose 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.98023.log 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.178908.log.gz 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163406.log 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98023.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.160779.log.gz 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103722.log 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163406.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98023.log.gz 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99324.log 2023-10-09T15:43:17.455 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163406.log.gz 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107119.log 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99324.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103722.log.gz 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97283.log 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.99324.log.gz 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180630.log 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.97283.log: -- /var/log/ceph/ceph-client.admin.104511.log 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107119.log.gz 2023-10-09T15:43:17.456 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180630.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.97283.log.gz 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177576.log 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.180630.log.gz 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172394.log 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177576.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173467.log 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.104511.log.gz 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172394.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177576.log.gz 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179363.log 2023-10-09T15:43:17.457 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172394.log.gz 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.173467.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172002.log 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173467.log.gz 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157162.log 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172002.log: 88.4%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.179363.log.gz--verbose 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.176299.log 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.172002.log.gz 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164365.log 2023-10-09T15:43:17.458 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.157162.log.gz 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157557.log 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164365.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176299.log.gz 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178649.log 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164365.log.gz 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172602.log 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2%/var/log/ceph/ceph-client.0.178649.log: -- replaced with /var/log/ceph/ceph-client.admin.157557.log.gz 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174708.log 2023-10-09T15:43:17.459 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178649.log.gz 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163280.log 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172602.log.gz 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100988.log 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108180.log 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.174708.log.gz 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100988.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163280.log.gzgzip 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.176932.log 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100988.log.gz 2023-10-09T15:43:17.460 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163834.log 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.108180.log.gz 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104656.log 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.163834.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176932.log.gzgzip 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.175003.log 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163834.log.gz 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104656.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172128.log 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103589.log 2023-10-09T15:43:17.461 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.104656.log.gz 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.175003.log.gz 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171960.log 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.103589.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172128.log.gz 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160949.log 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103589.log.gz 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168995.log 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.171960.log.gz 2023-10-09T15:43:17.462 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160949.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161183.log 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167075.log 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160949.log.gz 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161183.log: gzip -5 89.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.168995.log.gz/var/log/ceph/ceph-client.2.100485.log 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167075.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.161183.log.gz 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164863.log 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.167075.log.gz 2023-10-09T15:43:17.463 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.2.100485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175691.log 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.100485.log.gz 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166160.log 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.164863.log.gz 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175691.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101539.log 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160601.log 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.175691.log.gz 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101539.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.166160.log.gz 2023-10-09T15:43:17.464 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98661.log 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.101539.log.gz 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168852.log 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98661.log: 88.8%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.160601.log.gz--verbose 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.168614.log 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168852.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98661.log.gz 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166115.log 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.168852.log.gz 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177016.log 2023-10-09T15:43:17.465 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.166115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97501.log 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.168614.log.gz 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.166115.log.gz 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157702.log 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97501.log: 88.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.177016.log.gz-5 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.172044.log 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161505.log 88.0% 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.97501.log.gz 2023-10-09T15:43:17.466 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172044.log: 89.3%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.157702.log.gz--verbose 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.165170.log 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0%/var/log/ceph/ceph-client.admin.161505.log: -- replaced with /var/log/ceph/ceph-client.admin.172044.log.gz 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180462.log 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.161505.log.gz 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178048.log 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180462.log: gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.170872.log -- replaced with /var/log/ceph/ceph-client.admin.165170.log.gz 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.467 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8%/var/log/ceph/ceph-client.admin.178048.log: -- replaced with /var/log/ceph/ceph-client.admin.180462.log.gz 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.176212.log 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.178048.log.gz 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170872.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170788.log 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.176212.log: gzip -5 --verbose 88.4%-- /var/log/ceph/ceph-client.admin.98351.log -- replaced with /var/log/ceph/ceph-client.admin.170872.log.gz 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.176212.log.gz 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104698.log 2023-10-09T15:43:17.468 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98351.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170788.log.gz 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163921.log 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98351.log.gz 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166370.log 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104698.log: /var/log/ceph/ceph-client.admin.163921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176341.log 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.104698.log.gz 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163921.log.gz 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166370.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2023-10-09T15:43:17.469 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166370.log.gz 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176341.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169129.log 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107995.log 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.176341.log.gz 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169129.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163068.log 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169129.log.gz 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178732.log 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.107995.log.gz 2023-10-09T15:43:17.470 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.178645.log 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163068.log: /var/log/ceph/ceph-client.admin.178732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103200.log 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.163068.log.gz 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.178645.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178732.log.gz 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164449.log 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.178645.log.gz 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103200.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.103585.log 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.103200.log.gz 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164449.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160557.log 2023-10-09T15:43:17.471 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164449.log.gz 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174186.log 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.103585.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.103585.log.gz 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr: 86.0% -- replaced with /var/log/ceph/ceph.log.gz 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170356.log 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.160557.log.gz 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167908.log 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178260.log 2023-10-09T15:43:17.472 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174186.log.gz 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167908.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170356.log.gz 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161463.log 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167908.log.gz 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177436.log 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175267.log 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.178260.log.gz 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177436.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161463.log.gz 2023-10-09T15:43:17.473 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162804.log 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177436.log.gz 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175267.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101976.log 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162804.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171834.log 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.175267.log.gz 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101976.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.162804.log.gz 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158093.log 2023-10-09T15:43:17.474 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101976.log.gz 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108330.log 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169611.log 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171834.log.gz 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108330.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.158093.log.gz 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104886.log 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108330.log.gz 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98698.log 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104886.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.91040.log 2023-10-09T15:43:17.475 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169611.log.gz 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98698.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.104886.log.gz 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161992.log 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.98698.log.gz 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.91040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106867.log 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161992.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162271.log 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.91040.log.gz 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106867.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.161992.log.gz 2023-10-09T15:43:17.476 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180950.log 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.106867.log.gz 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162271.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160041.log 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162762.log 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.162271.log.gz 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160041.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.180950.log.gz 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167958.log 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.160041.log.gz 2023-10-09T15:43:17.477 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162762.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172866.log 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102178.log 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.162762.log.gz 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172644.log 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.167958.log.gz 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.172866.log.gz 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.102178.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.103764.log 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179094.log 2023-10-09T15:43:17.478 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102178.log.gz 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172644.log.gz 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167820.log 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.103764.log.gz 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179094.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97627.log 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167820.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174438.log 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179094.log.gz 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97627.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.167820.log.gz 2023-10-09T15:43:17.479 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157389.log 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.97627.log.gz 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179136.log 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159243.log 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.174438.log.gz 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179136.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157389.log.gz 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105302.log 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179136.log.gz 2023-10-09T15:43:17.480 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167177.log 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158261.log 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.159243.log.gz 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167177.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.105302.log.gz 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167694.log 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167177.log.gz 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158687.log 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175775.log 2023-10-09T15:43:17.481 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.158261.log.gz 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158687.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167694.log.gz 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168807.log 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158687.log.gz 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171260.log 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.168807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176576.log 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168807.log.gz 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.175775.log.gz 2023-10-09T15:43:17.482 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171344.log 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176576.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171260.log.gz 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166781.log 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.176576.log.gz 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158393.log 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171344.log: /var/log/ceph/ceph-client.admin.166781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165814.log 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.171344.log.gz 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.166781.log.gz 2023-10-09T15:43:17.483 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101623.log 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.158393.log.gz 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160125.log 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101623.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173635.log 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165814.log.gz 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.101623.log.gz 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160125.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163322.log 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.160125.log.gz 2023-10-09T15:43:17.484 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98358.log 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101892.log 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.173635.log.gz 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.163322.log.gz 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107649.log 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98358.log.gz 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159072.log 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101892.log: /var/log/ceph/ceph-client.admin.107649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157744.log 2023-10-09T15:43:17.485 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101892.log.gz 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.107649.log.gz 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.159072.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100904.log 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.159072.log.gz 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163154.log 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157744.log: /var/log/ceph/ceph-client.admin.100904.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97459.log 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.157744.log.gz 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100904.log.gz 2023-10-09T15:43:17.486 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177184.log 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158561.log 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.163154.log.gz 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177184.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97459.log.gz 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102018.log 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.177184.log.gz 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158561.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.166119.log 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101934.log 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158561.log.gz 2023-10-09T15:43:17.487 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.166119.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.102018.log.gz 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.166119.log.gz 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179718.log 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175351.log 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179718.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159117.log 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101934.log.gz 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175351.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179718.log.gz 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104259.log 2023-10-09T15:43:17.488 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175351.log.gz 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.159117.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.161421.log 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104259.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169882.log 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159117.log.gz 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161421.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.104259.log.gz 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166583.log 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.161421.log.gz 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169882.log: /var/log/ceph/ceph-client.admin.165254.log 2023-10-09T15:43:17.489 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166583.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163963.log 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169882.log.gz 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165254.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166583.log.gz 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175649.log 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.165254.log.gz 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102514.log 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103326.log 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.163963.log.gz 2023-10-09T15:43:17.490 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102514.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175649.log.gz 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108792.log 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102514.log.gz 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103326.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161698.log 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90633.log 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161698.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104091.log 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.108792.log.gz 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.103326.log.gz 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161698.log.gz 2023-10-09T15:43:17.491 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.90633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173897.log 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.90633.log.gz 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103116.log 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177914.log 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104091.log.gz 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.173897.log.gz 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101283.log 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103116.log.gz 2023-10-09T15:43:17.492 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173078.log 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163364.log 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.177914.log.gz 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101283.log.gz 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173078.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.173078.log.gz 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.163364.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.160823.log 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99072.log 2023-10-09T15:43:17.493 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.163364.log.gz 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158011.log 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99072.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160823.log.gz 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166739.log 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.99072.log.gz 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180252.log 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106027.log 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2%/var/log/ceph/ceph-client.admin.166739.log: -- replaced with /var/log/ceph/ceph-client.admin.158011.log.gz 2023-10-09T15:43:17.494 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180252.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170738.log 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166739.log.gz 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.180252.log.gz 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168128.log 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.106027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106027.log.gz 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101665.log 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4%/var/log/ceph/ceph-client.admin.168128.log: -- replaced with /var/log/ceph/ceph-client.admin.170738.log.gz 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168254.log 2023-10-09T15:43:17.495 INFO:teuthology.orchestra.run.smithi033.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.168128.log.gz 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167346.log 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165604.log 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168254.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101665.log.gz 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167346.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98365.log 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168254.log.gz 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98659.log 2023-10-09T15:43:17.496 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167346.log.gz 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.165604.log.gz 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98365.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166907.log 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.98365.log.gz 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159159.log 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166907.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102820.log 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98659.log.gz 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.166907.log.gz 2023-10-09T15:43:17.497 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159159.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100694.log 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.159159.log.gz 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.102820.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.105130.log 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100694.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100081.log 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.102820.log.gz 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.100694.log.gz 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105130.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157617.log 2023-10-09T15:43:17.498 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105130.log.gz 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.100081.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173551.log 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100081.log.gz 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102556.log 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173551.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.157617.log.gz 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176764.log 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173551.log.gz 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102556.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97854.log 2023-10-09T15:43:17.499 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176764.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169695.log 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.102556.log.gz 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.176764.log.gz 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107281.log 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97854.log.gz 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97241.log 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103284.log 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.169695.log.gz 2023-10-09T15:43:17.500 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.107281.log.gz 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97241.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176890.log 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.97241.log.gz 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170654.log 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160645.log 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.103284.log.gz 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176890.log.gz 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170654.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.100073.log 2023-10-09T15:43:17.501 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.170654.log.gz 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.160645.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.101581.log 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.100073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159478.log 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.100073.log.gz 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160645.log.gz 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101581.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171792.log 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.101581.log.gz 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98359.log 2023-10-09T15:43:17.502 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 89.1%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.159478.log.gz/var/log/ceph/ceph-client.admin.173981.log 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171792.log: /var/log/ceph/ceph-client.admin.98359.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164635.log 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.171792.log.gz 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173981.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.98359.log.gz 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172560.log 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.173981.log.gz 2023-10-09T15:43:17.503 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164635.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179634.log 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172560.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180084.log 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164635.log.gz 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179634.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.172560.log.gz 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102096.log 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.179634.log.gz 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172518.log 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102096.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2023-10-09T15:43:17.504 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.180084.log.gz 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172518.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.102096.log.gz 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173855.log 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.172518.log.gz 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174354.log 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173855.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165384.log 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174354.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.173855.log.gz 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179958.log 2023-10-09T15:43:17.505 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174354.log.gz 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165384.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164407.log 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172316.log 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179958.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.165384.log.gz 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103392.log 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.179958.log.gz 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177100.log 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172316.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.164407.log.gz 2023-10-09T15:43:17.506 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101766.log 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.172316.log.gz 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108694.log 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103392.log.gz 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177100.log: /var/log/ceph/ceph-client.admin.101766.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103242.log 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.177100.log.gz 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100568.log 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108694.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.101766.log.gz 2023-10-09T15:43:17.507 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167220.log 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.108694.log.gz 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171302.log 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100568.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.103242.log.gz 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167220.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.100568.log.gz 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158219.log 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96974.log 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171302.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167220.log.gz 2023-10-09T15:43:17.508 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158219.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.171302.log.gz 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99534.log 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163532.log 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96974.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158219.log.gz 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99534.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102388.log 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.96974.log.gz 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178092.log 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163532.log: /var/log/ceph/ceph-client.admin.102388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101325.log 2023-10-09T15:43:17.509 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.163532.log.gz 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.99534.log.gz 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178092.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98361.log 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102388.log.gz 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164239.log 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.178092.log.gz 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101325.log: /var/log/ceph/ceph-client.admin.98361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165340.log 2023-10-09T15:43:17.510 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.101325.log.gz 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164239.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98361.log.gz 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172994.log 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102864.log 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.164239.log.gz 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165340.log: /var/log/ceph/ceph-client.admin.172994.log: gzip -5 89.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.165340.log.gz/var/log/ceph/ceph-client.admin.158305.log 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172994.log.gz 2023-10-09T15:43:17.511 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.84654.log 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102864.log: /var/log/ceph/ceph-client.admin.158305.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106741.log 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.102864.log.gz 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph.tmp-client.admin.84654.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.158305.log.gz 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.84654.log.gz 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107035.log 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172170.log 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107035.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.106741.log.gz 2023-10-09T15:43:17.512 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100820.log 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107035.log.gz 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175065.log 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178816.log 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100820.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172170.log.gz 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101455.log 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.100820.log.gz 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.175065.log.gz 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166202.log 2023-10-09T15:43:17.513 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178816.log: /var/log/ceph/ceph-client.admin.101455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172732.log 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178816.log.gz 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166202.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.101455.log.gz 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102598.log 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166202.log.gz 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176660.log 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169213.log 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102598.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.172732.log.gz 2023-10-09T15:43:17.514 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105046.log 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102598.log.gz 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176660.log.gz 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.159076.log 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169213.log: /var/log/ceph/ceph-client.admin.105046.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97417.log 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.169213.log.gz 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.159076.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.105046.log.gz 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- 0.0%/var/log/ceph/ceph-client.admin.101497.log 2023-10-09T15:43:17.515 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.0.159076.log.gz 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170696.log 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101497.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.97417.log.gz 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104782.log 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101497.log.gz 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170696.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171215.log 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99114.log 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104782.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.170696.log.gz 2023-10-09T15:43:17.516 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.171215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104385.log 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.171215.log.gz 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104782.log.gz 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170314.log 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99114.log: /var/log/ceph/ceph-client.admin.104385.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167652.log 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.99114.log.gz 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170314.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104385.log.gz 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96673.log 2023-10-09T15:43:17.517 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170314.log.gz 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174124.log 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108568.log 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96673.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167652.log.gz 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174124.log: 88.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.96673.log.gz 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:--verbose -- /var/log/ceph/ceph-client.admin.106169.log 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174124.log.gz 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107869.log 2023-10-09T15:43:17.518 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108568.log: /var/log/ceph/ceph-client.admin.106169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165688.log 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.108568.log.gz 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.106169.log.gz 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162596.log 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107869.log.gz 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159856.log 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98027.log 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162596.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.165688.log.gz 2023-10-09T15:43:17.519 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97375.log 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.162596.log.gz 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159856.log.gz 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173204.log 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98027.log: /var/log/ceph/ceph-client.admin.97375.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166991.log 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.98027.log.gz 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173204.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97375.log.gz 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160229.log 2023-10-09T15:43:17.520 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166991.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162355.log 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.173204.log.gz 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166991.log.gz 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160229.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177226.log 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.161380.log 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.160229.log.gz 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177226.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.162355.log.gz 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178134.log 2023-10-09T15:43:17.521 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.177226.log.gz 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.161380.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161380.log.gz 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107511.log 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176848.log 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178134.log: /var/log/ceph/ceph-client.admin.107511.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178690.log 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178134.log.gz 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176848.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107511.log.gz 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97543.log 2023-10-09T15:43:17.522 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.176848.log.gz 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169569.log 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.178690.log.gz 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106825.log 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97543.log: /var/log/ceph/ceph-client.admin.169569.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169317.log 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.97543.log.gz 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106825.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169569.log.gz 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106253.log 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.168811.log 2023-10-09T15:43:17.523 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169317.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106825.log.gz 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164323.log 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.169317.log.gz 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.106253.log.gz 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179447.log 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.168811.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.168811.log.gz 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165296.log 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179447.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.164323.log.gz 2023-10-09T15:43:17.524 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171918.log 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.179447.log.gz 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170612.log 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158519.log 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171918.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165296.log.gz 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161740.log 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.171918.log.gz 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.170612.log.gz 2023-10-09T15:43:17.525 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165518.log 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158519.log: /var/log/ceph/ceph-client.admin.161740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174919.log 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158519.log.gz 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165518.log: 89.2%gzip -- replaced with /var/log/ceph/ceph-client.admin.161740.log.gz 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.163112.log 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.165518.log.gz 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174919.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108138.log 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.174919.log.gz 2023-10-09T15:43:17.526 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168296.log 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163112.log: /var/log/ceph/ceph-client.admin.108138.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103911.log 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.163112.log.gz 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168296.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108138.log.gz 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177310.log 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165212.log 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.168296.log.gz 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103911.log: /var/log/ceph/ceph-client.admin.177310.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164720.log 2023-10-09T15:43:17.527 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.103911.log.gz 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.177310.log.gz 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177826.log 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172688.log 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.165212.log.gz 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177826.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.164720.log.gz 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174228.log 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.177826.log.gz 2023-10-09T15:43:17.528 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172688.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106489.log 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171666.log 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174228.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172688.log.gz 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172782.log 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.174228.log.gz 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.106489.log.gz 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108610.log 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171666.log: /var/log/ceph/ceph-client.admin.172782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98015.log 2023-10-09T15:43:17.529 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.171666.log.gz 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.172782.log.gz 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108610.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173270.log 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163490.log 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.108610.log.gz 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98015.log: /var/log/ceph/ceph-client.admin.173270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179178.log 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98015.log.gz 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.173270.log.gz 2023-10-09T15:43:17.530 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176722.log 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163490.log: /var/log/ceph/ceph-client.admin.179178.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164821.log 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163490.log.gz 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176722.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.179178.log.gz 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101808.log 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.176722.log.gz 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168422.log 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106699.log 2023-10-09T15:43:17.531 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101808.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.164821.log.gz 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160431.log 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.101808.log.gz 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.168422.log.gz 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106699.log: /var/log/ceph/ceph-client.admin.166823.log 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168953.log 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106699.log.gz 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166823.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.160431.log.gzgzip 2023-10-09T15:43:17.532 INFO:teuthology.orchestra.run.smithi033.stderr:-5 --verbose -- /var/log/ceph/ceph-client.0.161376.log 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.166823.log.gz 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157786.log 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.168953.log.gz 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170272.log 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.161376.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.161376.log.gz 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159339.log 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170272.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.157786.log.gz 2023-10-09T15:43:17.533 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100652.log 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106951.log 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.170272.log.gz 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159339.log: /var/log/ceph/ceph-client.admin.100652.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159898.log 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.159339.log.gz 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.100652.log.gz 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107953.log 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106951.log: /var/log/ceph/ceph-client.admin.159898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164779.log 2023-10-09T15:43:17.534 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.106951.log.gz 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107953.log: gzip 89.3%-5 -- replaced with /var/log/ceph/ceph-client.admin.159898.log.gz--verbose 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.96904.log 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.107953.log.gz 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164779.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164779.log.gz 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168548.log 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.96904.log: /var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98658.log 2023-10-09T15:43:17.535 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.96904.log.gz 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107827.log 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104427.log 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.168548.log.gz 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107827.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.98658.log.gz 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104427.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107827.log.gz 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.104427.log.gz 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162720.log 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174648.log 2023-10-09T15:43:17.536 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162720.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163026.log 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162720.log.gz 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105764.log 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163026.log: gzip -5 88.3%--verbose -- -- replaced with /var/log/ceph/ceph-client.admin.174648.log.gz/var/log/ceph/ceph-client.admin.170956.log 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175143.log 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105764.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.163026.log.gz 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170956.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162456.log 2023-10-09T15:43:17.537 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175143.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.105764.log.gz 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162456.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.175143.log.gz 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.170956.log.gz 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.162456.log.gz 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166244.log 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176383.log 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166244.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107343.log 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176383.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2023-10-09T15:43:17.538 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166244.log.gz 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.176383.log.gz 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107343.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98363.log 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178302.log 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.1.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107343.log.gz 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98363.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161075.log 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178302.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.98363.log.gz 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161075.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.178302.log.gz 2023-10-09T15:43:17.539 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.161075.log.gz 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159604.log 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170914.log 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159604.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160865.log 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159604.log.gz 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170914.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168380.log 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177658.log 2023-10-09T15:43:17.540 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170914.log.gz 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162846.log 87.5% 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.160865.log.gz 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.168380.log.gz 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177658.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167388.log 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177658.log.gz 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104964.log 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162846.log: /var/log/ceph/ceph-client.admin.167388.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99450.log 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.162846.log.gz 2023-10-09T15:43:17.541 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104964.log: 87.5%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.167388.log.gz--verbose 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.99198.log 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.104964.log.gz 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99450.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172476.log 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.99450.log.gz 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102220.log 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99198.log: /var/log/ceph/ceph-client.admin.172476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106405.log 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.99198.log.gz 2023-10-09T15:43:17.542 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.172476.log.gz 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104571.log 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101072.log 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106405.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.102220.log.gz 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106783.log 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.106405.log.gz 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101072.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.104571.log.gz 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103158.log 2023-10-09T15:43:17.543 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169401.log 87.7% 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr: -- replaced with /var/log/ceph/ceph-client.admin.101072.log.gz 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103158.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106783.log.gz 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97669.log 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.103158.log.gz 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105386.log 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.169401.log.gz 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157515.log 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97669.log: /var/log/ceph/ceph-client.admin.105386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174040.log 2023-10-09T15:43:17.544 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.97669.log.gz 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157515.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.105386.log.gz 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169171.log 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176806.log 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174040.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157515.log.gz 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169171.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97728.log 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.174040.log.gz 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169171.log.gz 2023-10-09T15:43:17.545 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176806.log: /var/log/ceph/ceph-client.admin.179916.log 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97728.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.100481.log 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.176806.log.gz 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97728.log.gz 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104175.log 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.2.100481.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.179916.log.gz 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.2.100481.log.gz 2023-10-09T15:43:17.546 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104175.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107555.log 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161782.log 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-mon.a.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.104175.log.gz 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174751.log 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161782.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97812.log 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.107555.log.gz 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.161782.log.gz 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97069.log 2023-10-09T15:43:17.547 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.admin.97812.log: --verbose -- /var/log/ceph/ceph-client.admin.107911.log 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.174751.log.gz 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97069.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.97812.log.gz 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107911.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.97069.log.gz 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.107911.log.gz 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164197.log 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106309.log 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164197.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99366.log 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.164197.log.gz 2023-10-09T15:43:17.548 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170398.log 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176257.log 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99366.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.106309.log.gz 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170398.log: gzip 88.2%-5 -- replaced with /var/log/ceph/ceph-client.admin.99366.log.gz--verbose 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.108079.log 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176257.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.170398.log.gz 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.176257.log.gz 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108079.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.108079.log.gz 2023-10-09T15:43:17.549 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157660.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157431.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175437.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162518.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157660.log.gz 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157431.log.gz 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175437.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98028.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr:gzip /var/log/ceph/ceph-client.admin.162518.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.100736.log 2023-10-09T15:43:17.550 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.175437.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98028.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162518.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169840.log 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5%/var/log/ceph/ceph-client.admin.100736.log: -- replaced with /var/log/ceph/ceph-client.admin.98028.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178949.log 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.100736.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169840.log: /var/log/ceph/ceph-client.admin.178949.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.169840.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.178949.log.gz 2023-10-09T15:43:17.551 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105722.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162186.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105722.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173509.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162186.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179405.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.105722.log.gz 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173509.log: gzip 88.9%-5 --verbose -- replaced with /var/log/ceph/ceph-client.admin.162186.log.gz-- 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158729.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105088.log 2023-10-09T15:43:17.552 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179405.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.173509.log.gz 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158729.log: 88.0%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.179405.log.gz--verbose 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:-- /var/log/ceph/ceph-client.admin.103806.log 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5%/var/log/ceph/ceph-client.admin.105088.log: -- replaced with /var/log/ceph/ceph-client.admin.158729.log.gz 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107385.log 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103806.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105088.log.gz 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169527.log 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.108527.log 2023-10-09T15:43:17.553 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107385.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.103806.log.gz 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169527.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.107385.log.gz 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.108527.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.169527.log.gz 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.108527.log.gz 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165476.log 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173593.log 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.163838.log 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.165476.log.gz 2023-10-09T15:43:17.554 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173593.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178218.log 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 /var/log/ceph/ceph-client.0.163838.log: --verbose -- /var/log/ceph/ceph-client.admin.163196.log 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.173593.log.gz 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.163838.log.gz 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104301.log 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.178218.log.gz 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167117.log 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.163196.log.gz 2023-10-09T15:43:17.555 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178344.log 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167117.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.104301.log.gz 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159730.log 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.167117.log.gz 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178344.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.178344.log.gz 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159730.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.159730.log.gz 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159772.log 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160515.log 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100122.log 2023-10-09T15:43:17.556 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102430.log 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.159772.log.gz 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.160515.log.gz 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100122.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167033.log 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157120.log 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102430.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.100122.log.gz 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167033.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.102430.log.gz 2023-10-09T15:43:17.557 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157120.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.167033.log.gz 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157120.log.gz 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168464.log 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164491.log 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.106023.log 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.168464.log.gz 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164491.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99408.log 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179279.log 2023-10-09T15:43:17.558 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.106023.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.164491.log.gz 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.106023.log.gz 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98360.log 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179279.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.99408.log.gz 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.179279.log.gz 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98360.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.98360.log.gz 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157347.log 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166424.log 2023-10-09T15:43:17.559 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180672.log 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166424.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102346.log 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157347.log.gz 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.166424.log.gz 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180672.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103869.log 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170230.log 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102346.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.180672.log.gz 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103869.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157221.log 2023-10-09T15:43:17.560 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.102346.log.gz 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170230.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.103869.log.gz 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.170230.log.gz 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157221.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175819.log 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.157221.log.gz 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162126.log 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158349.log 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162126.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105596.log 2023-10-09T15:43:17.561 INFO:teuthology.orchestra.run.smithi033.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.175819.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.162126.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158349.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165772.log 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.105596.log: -- /var/log/ceph/ceph-client.admin.180294.log 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158349.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165772.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105596.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165772.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180294.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180294.log.gz 2023-10-09T15:43:17.562 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180168.log 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180042.log 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180168.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179321.log 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.180168.log.gz 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180042.log: /var/log/ceph/ceph-client.admin.179321.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.180042.log.gz 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180756.log 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.179321.log.gz 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159646.log 2023-10-09T15:43:17.563 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105680.log 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.180756.log.gz 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159646.log: /var/log/ceph/ceph-client.admin.105680.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.159646.log.gz 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.105680.log.gz 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162084.log 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101707.log 2023-10-09T15:43:17.564 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178386.log 2023-10-09T15:43:17.595 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159814.log 2023-10-09T15:43:17.595 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.162084.log.gz 2023-10-09T15:43:17.595 INFO:teuthology.orchestra.run.smithi033.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.101707.log.gz 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178386.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98703.log 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159814.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167304.log 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98703.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.159814.log.gz 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.178386.log.gz 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167304.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.98703.log.gz 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162984.log 2023-10-09T15:43:17.596 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.167304.log.gz 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162397.log 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162984.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174793.log 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162984.log.gz 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162397.log: /var/log/ceph/ceph-client.admin.174793.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.162397.log.gz 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.174793.log.gz 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168086.log 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.173463.log 2023-10-09T15:43:17.597 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168086.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173162.log 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.168086.log.gz 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.0.173463.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.173463.log.gz 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173162.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173162.log.gz 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157870.log 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163238.log 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157933.log 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.157870.log.gz 2023-10-09T15:43:17.598 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105172.log 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177700.log 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157933.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.163238.log.gz 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105172.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.157933.log.gz 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177700.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.105172.log.gz 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.177700.log.gz 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164905.log 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170570.log 2023-10-09T15:43:17.599 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177870.log 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.164905.log.gz 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170570.log: /var/log/ceph/ceph-client.admin.177870.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.170570.log.gz 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.177870.log.gz 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166522.log 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98024.log 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107427.log 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98024.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158177.log 2023-10-09T15:43:17.600 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.166522.log.gz 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179531.log 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98024.log.gz 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158177.log: /var/log/ceph/ceph-client.admin.165730.log 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.107427.log.gz 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179531.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.158177.log.gz 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165730.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.179531.log.gz 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174522.log 2023-10-09T15:43:17.601 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.165730.log.gz 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104824.log 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107181.log 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174522.log: /var/log/ceph/ceph-client.admin.104824.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174522.log.gz 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107181.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.104824.log.gz 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.107181.log.gz 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105470.log 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167262.log 2023-10-09T15:43:17.602 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105470.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.105470.log.gz 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167262.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105344.log 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166865.log 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.0.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.167262.log.gz 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105344.log: /var/log/ceph/ceph-client.admin.166865.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.105344.log.gz 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.166865.log.gz 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174835.log 2023-10-09T15:43:17.603 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171708.log 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165646.log 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171708.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.174835.log.gz 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165646.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.171708.log.gz 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165646.log.gz 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.106110.log 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108652.log 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.106110.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170148.log 2023-10-09T15:43:17.604 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.106110.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108652.log: /var/log/ceph/ceph-client.admin.170148.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.108652.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.170148.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102736.log 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160307.log 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159201.log 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr: 88.7%/var/log/ceph/ceph-client.admin.160307.log: -- replaced with /var/log/ceph/ceph-client.admin.102736.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159201.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.160307.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159201.log.gz 2023-10-09T15:43:17.605 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173813.log 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98568.log 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.173813.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97770.log 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98568.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.173813.log.gz 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165562.log 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97770.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.98568.log.gz 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177742.log 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.97770.log.gz 2023-10-09T15:43:17.606 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165562.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.165562.log.gz 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177742.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.177742.log.gz 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98029.log 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100862.log 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98029.log: /var/log/ceph/ceph-client.admin.100862.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.98029.log.gz 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.100862.log.gz 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161866.log 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161589.log 2023-10-09T15:43:17.607 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161866.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102472.log 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161589.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.161866.log.gz 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102472.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.161589.log.gz 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.102472.log.gz 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103953.log 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179237.log 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158435.log 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.103953.log.gz 2023-10-09T15:43:17.608 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179237.log: /var/log/ceph/ceph-client.admin.158435.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.179237.log.gz 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.158435.log.gz 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162934.log 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164575.log 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162934.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180504.log 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164575.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.162934.log.gz 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180504.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.164575.log.gz 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.180504.log.gz 2023-10-09T15:43:17.609 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172086.log 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104133.log 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172086.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.172086.log.gz 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.104133.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.104133.log.gz 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102262.log 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158771.log 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102262.log: /var/log/ceph/ceph-client.admin.158771.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.102262.log.gz 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.158771.log.gz 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177394.log 2023-10-09T15:43:17.610 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101030.log 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177394.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169087.log 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9%/var/log/ceph/ceph-client.admin.101030.log: -- replaced with /var/log/ceph/ceph-client.admin.177394.log.gz 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169087.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.101030.log.gz 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.169087.log.gz 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169924.log 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102948.log 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169653.log 2023-10-09T15:43:17.611 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102948.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.169924.log.gz 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169653.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169485.log 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102948.log.gz 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.169653.log.gz 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172910.log 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169485.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165922.log 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172910.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.169485.log.gz 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.172910.log.gz 2023-10-09T15:43:17.612 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165922.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165922.log.gz 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161033.log 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.96847.log 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161033.log: /var/log/ceph/ceph-client.admin.96847.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.161033.log.gz 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.96847.log.gz 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160695.log 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97199.log 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160695.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107785.log 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.97199.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.160695.log.gz 2023-10-09T15:43:17.613 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107785.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.97199.log.gz 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107785.log.gz 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158135.log 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162678.log 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158135.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.158135.log.gz 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162678.log: /var/log/ceph/ceph-mgr.y.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.162678.log.gz 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.162229.log 2023-10-09T15:43:17.614 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167492.log 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.162229.log: /var/log/ceph/ceph-client.admin.167492.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.162229.log.gz 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.167492.log.gz 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172212.log 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.171219.log 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172212.log: /var/log/ceph/ceph-client.0.171219.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.172212.log.gz 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.0.171219.log.gz 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102778.log 2023-10-09T15:43:17.615 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98904.log 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102778.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.102778.log.gz 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98904.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.98904.log.gz 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158813.log 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170528.log 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.158813.log: /var/log/ceph/ceph-client.admin.170528.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170528.log.gz 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.158813.log.gz 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.167778.log 2023-10-09T15:43:17.616 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169755.log 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.167778.log: 87.8%/var/log/ceph/ceph-client.admin.169755.log: -- replaced with /var/log/ceph/ceph-client.admin.167778.log.gz 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.169755.log.gz 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164047.log 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103074.log 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164047.log: /var/log/ceph/ceph-client.admin.103074.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.164047.log.gz 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.103074.log.gz 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159520.log 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180868.log 2023-10-09T15:43:17.617 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159520.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159520.log.gz 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180868.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180868.log.gz 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180714.log 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108264.log 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180714.log: /var/log/ceph/ceph-client.admin.108264.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.180714.log.gz 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.108264.log.gz 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171582.log 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168212.log 2023-10-09T15:43:17.618 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.171582.log: /var/log/ceph/ceph-client.admin.168212.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.171582.log.gz 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.168212.log.gz 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170070.log 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.158477.log 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170070.log: /var/log/ceph/ceph-client.admin.158477.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.170070.log.gz 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.158477.log.gz 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170486.log 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.104217.log 2023-10-09T15:43:17.619 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170486.log: /var/log/ceph/ceph-client.admin.104217.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.170486.log.gz 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.104217.log.gz 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159562.log 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97585.log 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159562.log: /var/log/ceph/ceph-client.admin.97585.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.159562.log.gz 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.97585.log.gz 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.160991.log 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180336.log 2023-10-09T15:43:17.620 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.160991.log: /var/log/ceph/ceph-client.admin.180336.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.160991.log.gz 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.180336.log.gz 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180126.log 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99030.log 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180126.log: /var/log/ceph/ceph-client.admin.99030.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180126.log.gz 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.99030.log.gz 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.170830.log 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.163448.log 2023-10-09T15:43:17.621 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.170830.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.170830.log.gz 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.163448.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.163448.log.gz 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175903.log 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.179489.log 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.175903.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.175903.log.gz 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.179489.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.179489.log.gz 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180420.log 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180908.log 2023-10-09T15:43:17.622 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.180420.log: /var/log/ceph/ceph-client.admin.180908.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.180420.log.gz 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.180908.log.gz 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.90902.log 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102686.log 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.90902.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.90902.log.gz 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.102686.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.102686.log.gz 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165434.log 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159285.log 2023-10-09T15:43:17.623 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165434.log: /var/log/ceph/ceph-client.admin.159285.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.165434.log.gz 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.159285.log.gz 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.159436.log 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177268.log 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.159436.log: /var/log/ceph/ceph-client.admin.177268.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.159436.log.gz 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.177268.log.gz 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172952.log 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166697.log 2023-10-09T15:43:17.624 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.172952.log: /var/log/ceph/ceph-client.admin.166697.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.172952.log.gz 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.166697.log.gz 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177058.log 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175393.log 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177058.log: /var/log/ceph/ceph-client.admin.175393.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.177058.log.gz 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.175393.log.gz 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105258.log 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168894.log 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105258.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.105258.log.gz 2023-10-09T15:43:17.625 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168894.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.168894.log.gz 2023-10-09T15:43:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101114.log 2023-10-09T15:43:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98662.log 2023-10-09T15:43:17.626 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101114.log: /var/log/ceph/ceph-client.admin.98662.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.101114.log.gz 2023-10-09T15:43:17.627 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98662.log.gz 2023-10-09T15:43:17.627 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168000.log 2023-10-09T15:43:17.627 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.165046.log 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168000.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.168000.log.gz 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.165046.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.165046.log.gz 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.168170.log 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102304.log 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.168170.log: /var/log/ceph/ceph-client.admin.102304.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.168170.log.gz 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.102304.log.gz 2023-10-09T15:43:17.628 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177352.log 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176534.log 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177352.log: /var/log/ceph/ceph-client.admin.176534.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.177352.log.gz 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.176534.log.gz 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.177142.log 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.102642.log 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.177142.log: 88.3%/var/log/ceph/ceph-client.admin.102642.log: -- replaced with /var/log/ceph/ceph-client.admin.177142.log.gz 2023-10-09T15:43:17.629 INFO:teuthology.orchestra.run.smithi033.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.102642.log.gz 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.166286.log 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171624.log 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.166286.log: /var/log/ceph/ceph-client.admin.171624.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.166286.log.gz 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.171624.log.gz 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176475.log 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157023.log 2023-10-09T15:43:17.630 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176475.log: /var/log/ceph/ceph-client.admin.157023.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.176475.log.gz 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.157023.log.gz 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.105554.log 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.97019.log 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.105554.log: /var/log/ceph/ceph-client.admin.97019.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.105554.log.gz 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.97019.log.gz 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161908.log 2023-10-09T15:43:17.631 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107599.log 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.161908.log: /var/log/ceph/ceph-client.admin.107599.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.161908.log.gz 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.107599.log.gz 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.107469.log 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174877.log 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.107469.log: /var/log/ceph/ceph-client.admin.174877.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.107469.log.gz 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.174877.log.gz 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98988.log 2023-10-09T15:43:17.632 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174606.log 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98988.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.98988.log.gz 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174606.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.174606.log.gz 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.157828.log 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98026.log 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.157828.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.157828.log.gz 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.175309.log 2023-10-09T15:43:17.633 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98026.log: /var/log/ceph/ceph-client.admin.175309.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.98026.log.gz 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.175309.log.gz 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.100946.log 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.161117.log 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.100946.log: /var/log/ceph/ceph-client.admin.161117.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.100946.log.gz 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.161117.log.gz 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.99282.log 2023-10-09T15:43:17.634 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108037.log 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.99282.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.99282.log.gz 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.173120.log 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.108037.log: /var/log/ceph/ceph-client.admin.173120.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.108037.log.gz 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.173120.log.gz 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.169275.log 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180210.log 2023-10-09T15:43:17.635 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.169275.log: /var/log/ceph/ceph-client.admin.180210.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.169275.log.gz 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.180210.log.gz 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.164678.log 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.108222.log 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.164678.log: /var/log/ceph/ceph-client.admin.108222.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.164678.log.gz 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.108222.log.gz 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.178176.log 2023-10-09T15:43:17.636 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.171445.log 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.178176.log: /var/log/ceph/ceph-client.admin.171445.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.178176.log.gz 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.171445.log.gz 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.174270.log 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.180588.log 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.174270.log: 88.7%/var/log/ceph/ceph-client.admin.180588.log: -- replaced with /var/log/ceph/ceph-client.admin.174270.log.gz 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.180588.log.gz 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2023-10-09T15:43:17.637 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.172824.log 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-osd.2.log: /var/log/ceph/ceph-client.admin.172824.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.172824.log.gz 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.103032.log 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.103032.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.103032.log.gz 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.98946.log 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.98946.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.98946.log.gz 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.176019.log 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.176019.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.176019.log.gz 2023-10-09T15:43:17.638 INFO:teuthology.orchestra.run.smithi033.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.101850.log 2023-10-09T15:43:17.639 INFO:teuthology.orchestra.run.smithi033.stderr:/var/log/ceph/ceph-client.admin.101850.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.101850.log.gz 2023-10-09T15:43:17.639 INFO:teuthology.orchestra.run.smithi059.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2023-10-09T15:43:17.710 INFO:teuthology.orchestra.run.smithi059.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2023-10-09T15:43:17.901 INFO:teuthology.orchestra.run.smithi059.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2023-10-09T15:43:18.035 INFO:teuthology.orchestra.run.smithi059.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2023-10-09T15:43:18.074 INFO:teuthology.orchestra.run.smithi059.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2023-10-09T15:43:18.076 INFO:teuthology.orchestra.run.smithi059.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2023-10-09T15:43:18.078 INFO:teuthology.orchestra.run.smithi059.stderr: 2023-10-09T15:43:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:real 0m0.808s 2023-10-09T15:43:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:user 0m3.637s 2023-10-09T15:43:18.078 INFO:teuthology.orchestra.run.smithi059.stderr:sys 0m0.157s 2023-10-09T15:43:18.175 INFO:teuthology.orchestra.run.smithi033.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2023-10-09T15:43:18.340 INFO:teuthology.orchestra.run.smithi033.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2023-10-09T15:43:18.358 INFO:teuthology.orchestra.run.smithi033.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2023-10-09T15:43:18.373 INFO:teuthology.orchestra.run.smithi033.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2023-10-09T15:43:18.394 INFO:teuthology.orchestra.run.smithi033.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2023-10-09T15:43:18.588 INFO:teuthology.orchestra.run.smithi033.stderr: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2023-10-09T15:43:19.611 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-10-09T15:43:19.612 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-10-09T15:43:19.613 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-10-09T15:43:23.006 INFO:teuthology.orchestra.run.smithi033.stderr: 94.0% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2023-10-09T15:43:23.007 INFO:teuthology.orchestra.run.smithi033.stderr: 2023-10-09T15:43:23.008 INFO:teuthology.orchestra.run.smithi033.stderr:real 0m5.768s 2023-10-09T15:43:23.008 INFO:teuthology.orchestra.run.smithi033.stderr:user 0m11.414s 2023-10-09T15:43:23.008 INFO:teuthology.orchestra.run.smithi033.stderr:sys 0m0.721s 2023-10-09T15:43:23.008 INFO:tasks.ceph:Archiving logs... 2023-10-09T15:43:23.009 DEBUG:teuthology.misc:Transferring archived files from smithi033:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi033/log 2023-10-09T15:43:23.010 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T15:43:25.018 DEBUG:teuthology.misc:Transferring archived files from smithi059:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi059/log 2023-10-09T15:43:25.019 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /var/log/ceph -- . 2023-10-09T15:43:25.519 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-10-09T15:43:25.532 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-10-09T15:43:25.533 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T15:43:25.535 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-10-09T15:43:25.613 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-10-09T15:43:25.623 INFO:teuthology.task.clock:Checking final clock skew... 2023-10-09T15:43:25.624 DEBUG:teuthology.orchestra.run.smithi033:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T15:43:25.627 DEBUG:teuthology.orchestra.run.smithi059:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-10-09T15:43:25.641 INFO:teuthology.orchestra.run.smithi033.stderr:bash: ntpq: command not found 2023-10-09T15:43:25.642 INFO:teuthology.orchestra.run.smithi059.stderr:bash: ntpq: command not found 2023-10-09T15:43:25.645 INFO:teuthology.orchestra.run.smithi033.stdout:210 Number of sources = 4 2023-10-09T15:43:25.645 INFO:teuthology.orchestra.run.smithi033.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T15:43:25.645 INFO:teuthology.orchestra.run.smithi033.stdout:=============================================================================== 2023-10-09T15:43:25.645 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 39 -910us[ -918us] +/- 91ms 2023-10-09T15:43:25.646 INFO:teuthology.orchestra.run.smithi033.stdout:^* hv02.front.sepia.ceph.com 3 6 377 38 -224us[ -231us] +/- 58ms 2023-10-09T15:43:25.646 INFO:teuthology.orchestra.run.smithi033.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +993us[ +985us] +/- 71ms 2023-10-09T15:43:25.646 INFO:teuthology.orchestra.run.smithi033.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:43:25.647 INFO:teuthology.orchestra.run.smithi059.stdout:210 Number of sources = 4 2023-10-09T15:43:25.647 INFO:teuthology.orchestra.run.smithi059.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-10-09T15:43:25.647 INFO:teuthology.orchestra.run.smithi059.stdout:=============================================================================== 2023-10-09T15:43:25.647 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 41 -911us[ -911us] +/- 91ms 2023-10-09T15:43:25.648 INFO:teuthology.orchestra.run.smithi059.stdout:^* hv02.front.sepia.ceph.com 3 6 377 40 -219us[ -219us] +/- 58ms 2023-10-09T15:43:25.648 INFO:teuthology.orchestra.run.smithi059.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 42 +980us[ +979us] +/- 71ms 2023-10-09T15:43:25.648 INFO:teuthology.orchestra.run.smithi059.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-10-09T15:43:25.648 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-10-09T15:43:25.677 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-10-09T15:43:25.678 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-10-09T15:43:25.708 DEBUG:teuthology.orchestra.run.smithi033:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T15:43:25.769 DEBUG:teuthology.orchestra.run.smithi059:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-10-09T15:43:25.873 DEBUG:teuthology.orchestra.run.smithi033:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T15:43:25.903 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:43:25.903 DEBUG:teuthology.orchestra.run.smithi059:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-10-09T15:43:25.934 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:43:25.935 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-10-09T15:43:25.944 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-10-09T15:43:25.993 INFO:teuthology.task.internal:Duration was 1478.343993 seconds 2023-10-09T15:43:25.993 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-10-09T15:43:26.061 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-10-09T15:43:26.061 DEBUG:teuthology.orchestra.run.smithi033:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T15:43:26.064 DEBUG:teuthology.orchestra.run.smithi059:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-10-09T15:43:26.109 INFO:teuthology.orchestra.run.smithi059.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T15:43:26.110 INFO:teuthology.orchestra.run.smithi033.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-10-09T15:43:26.445 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-10-09T15:43:26.445 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi033.front.sepia.ceph.com 2023-10-09T15:43:26.445 DEBUG:teuthology.orchestra.run.smithi033:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T15:43:26.467 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi059.front.sepia.ceph.com 2023-10-09T15:43:26.468 DEBUG:teuthology.orchestra.run.smithi059:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-10-09T15:43:26.487 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-10-09T15:43:26.487 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T15:43:26.510 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-10-09T15:43:26.568 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-10-09T15:43:26.568 DEBUG:teuthology.orchestra.run.smithi033:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T15:43:26.570 DEBUG:teuthology.orchestra.run.smithi059:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-10-09T15:43:26.686 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-10-09T15:43:26.696 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-10-09T15:43:26.696 DEBUG:teuthology.orchestra.run.smithi033:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T15:43:26.721 DEBUG:teuthology.orchestra.run.smithi059:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-10-09T15:43:26.747 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-10-09T15:43:26.766 DEBUG:teuthology.orchestra.run.smithi033:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T15:43:26.769 DEBUG:teuthology.orchestra.run.smithi059:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-10-09T15:43:26.790 INFO:teuthology.orchestra.run.smithi033.stdout:kernel.core_pattern = core 2023-10-09T15:43:26.811 INFO:teuthology.orchestra.run.smithi059.stdout:kernel.core_pattern = core 2023-10-09T15:43:26.825 DEBUG:teuthology.orchestra.run.smithi033:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T15:43:26.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:43:26.859 DEBUG:teuthology.orchestra.run.smithi059:> test -e /home/ubuntu/cephtest/archive/coredump 2023-10-09T15:43:26.879 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-10-09T15:43:26.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-10-09T15:43:26.890 INFO:teuthology.task.internal:Transferring archived files... 2023-10-09T15:43:26.890 DEBUG:teuthology.misc:Transferring archived files from smithi033:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi033 2023-10-09T15:43:26.891 DEBUG:teuthology.orchestra.run.smithi033:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T15:43:26.934 DEBUG:teuthology.misc:Transferring archived files from smithi059:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469/remote/smithi059 2023-10-09T15:43:26.934 DEBUG:teuthology.orchestra.run.smithi059:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-10-09T15:43:26.969 INFO:teuthology.task.internal:Removing archive directory... 2023-10-09T15:43:26.969 DEBUG:teuthology.orchestra.run.smithi033:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T15:43:26.971 DEBUG:teuthology.orchestra.run.smithi059:> rm -rf -- /home/ubuntu/cephtest/archive 2023-10-09T15:43:27.019 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-10-09T15:43:27.030 INFO:teuthology.task.internal:Not uploading archives. 2023-10-09T15:43:27.031 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-10-09T15:43:27.097 INFO:teuthology.task.internal:Tidying up after the test... 2023-10-09T15:43:27.098 DEBUG:teuthology.orchestra.run.smithi033:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T15:43:27.100 DEBUG:teuthology.orchestra.run.smithi059:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-10-09T15:43:27.112 INFO:teuthology.orchestra.run.smithi033.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 15:43 /home/ubuntu/cephtest 2023-10-09T15:43:27.114 INFO:teuthology.orchestra.run.smithi059.stdout: 262153 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Oct 9 15:43 /home/ubuntu/cephtest 2023-10-09T15:43:27.115 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-10-09T15:43:27.172 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-10-09T15:43:27.255 INFO:teuthology.nuke:Checking targets against current locks 2023-10-09T15:43:27.280 DEBUG:teuthology.nuke:shortname: smithi033 2023-10-09T15:43:27.281 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T15:43:27.310 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi033.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 15:10:20.608008', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBM8Cd69H7fO59C6291Fi5/uUVmocaao6IhQtTEvcF8JmC7Fabc4duFOQe0AZeQwLthyVs+w5SISN7WfTT742QOI='} 2023-10-09T15:43:27.311 DEBUG:teuthology.nuke:shortname: smithi059 2023-10-09T15:43:27.311 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-10-09T15:43:27.337 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi059.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-10-09_15:09:03-fs-wip-yuri-testing-2023-10-06-0949-quincy-testing-default-smithi/7418469', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'rhel', 'os_version': '8.4', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-10-09 15:10:20.609495', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBD/gDT8Hk4uMQYpOVyMlMDMbG2vsnKuxqFGNcqxbQ3WXPkV8e9j4RhIqIXkz1VP3SGwAzY+QmmeNeDBOue5qjEc='} 2023-10-09T15:43:27.365 INFO:teuthology.orchestra.console.smithi033:Power off 2023-10-09T15:43:27.366 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T15:43:27.390 DEBUG:teuthology.orchestra.console.smithi033:power off output: Chassis Power Control: Down/Off 2023-10-09T15:43:27.390 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:27.404 INFO:teuthology.orchestra.console.smithi059:Power off 2023-10-09T15:43:27.404 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-10-09T15:43:27.413 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-09T15:43:27.426 DEBUG:teuthology.orchestra.console.smithi059:power off output: Chassis Power Control: Down/Off 2023-10-09T15:43:27.426 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:27.447 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-09T15:43:31.414 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:31.450 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:31.525 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is on 2023-10-09T15:43:31.559 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is on 2023-10-09T15:43:35.528 DEBUG:teuthology.orchestra.console.smithi033:pexpect command: ipmitool -H smithi033.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:35.561 DEBUG:teuthology.orchestra.console.smithi059:pexpect command: ipmitool -H smithi059.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-10-09T15:43:35.638 DEBUG:teuthology.orchestra.console.smithi033:check power output: Chassis Power is off 2023-10-09T15:43:35.669 DEBUG:teuthology.orchestra.console.smithi059:check power output: Chassis Power is off 2023-10-09T15:43:35.739 INFO:teuthology.orchestra.console.smithi033:Power off completed 2023-10-09T15:43:35.770 INFO:teuthology.orchestra.console.smithi059:Power off completed 2023-10-09T15:43:35.875 INFO:teuthology.run:Summary data: description: fs/volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{rhel_8} mount/kclient/{mount-syntax/{v1} mount overrides/{distro/stock/{k-stock rhel_8} ms-die-on-skipped}} objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/volumes/{overrides test/basic}} duration: 1478.3439934253693 failure_reason: 'Test failure: test_volume_rm (tasks.cephfs.test_volumes.TestVolumes)' flavor: default owner: scheduled_vshankar@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=3fcab2763d2341a8b26974439a625097 status: fail success: false 2023-10-09T15:43:35.875 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-10-09T15:43:35.948 INFO:teuthology.run:FAIL